-- Logs begin at Sat 2022-08-27 03:47:01 UTC, end at Sat 2022-08-27 06:21:01 UTC. -- Aug 27 04:21:08.713582 n-d-854823-1 systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 04:21:08.723173 n-d-854823-1 devstack@n-api.service[106383]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 04:21:08.725174 n-d-854823-1 devstack@n-api.service[106383]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 04:21:08 2022] *** Aug 27 04:21:08.725174 n-d-854823-1 devstack@n-api.service[106383]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 04:21:08.725174 n-d-854823-1 devstack@n-api.service[106383]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 04:21:08.725174 n-d-854823-1 devstack@n-api.service[106383]: nodename: n-d-854823-1 Aug 27 04:21:08.725174 n-d-854823-1 devstack@n-api.service[106383]: machine: x86_64 Aug 27 04:21:08.725174 n-d-854823-1 devstack@n-api.service[106383]: clock source: unix Aug 27 04:21:08.725174 n-d-854823-1 devstack@n-api.service[106383]: pcre jit disabled Aug 27 04:21:08.725174 n-d-854823-1 devstack@n-api.service[106383]: detected number of CPU cores: 4 Aug 27 04:21:08.725174 n-d-854823-1 devstack@n-api.service[106383]: current working directory: / Aug 27 04:21:08.725174 n-d-854823-1 devstack@n-api.service[106383]: detected binary path: /usr/bin/uwsgi-core Aug 27 04:21:08.725857 n-d-854823-1 devstack@n-api.service[106383]: your processes number limit is 47680 Aug 27 04:21:08.725857 n-d-854823-1 devstack@n-api.service[106383]: your memory page size is 4096 bytes Aug 27 04:21:08.725857 n-d-854823-1 devstack@n-api.service[106383]: detected max file descriptor number: 2048 Aug 27 04:21:08.725857 n-d-854823-1 devstack@n-api.service[106383]: lock engine: pthread robust mutexes Aug 27 04:21:08.725857 n-d-854823-1 devstack@n-api.service[106383]: thunder lock: enabled Aug 27 04:21:08.725857 n-d-854823-1 devstack@n-api.service[106383]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 04:21:08.725857 n-d-854823-1 devstack@n-api.service[106383]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 04:21:08.765097 n-d-854823-1 devstack@n-api.service[106383]: Python main interpreter initialized at 0x56291c8fd9c0 Aug 27 04:21:08.765097 n-d-854823-1 devstack@n-api.service[106383]: python threads support enabled Aug 27 04:21:08.765097 n-d-854823-1 devstack@n-api.service[106383]: your server socket listen backlog is limited to 100 connections Aug 27 04:21:08.765097 n-d-854823-1 devstack@n-api.service[106383]: your mercy for graceful operations on workers is 90 seconds Aug 27 04:21:08.765496 n-d-854823-1 devstack@n-api.service[106383]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 04:21:08.765579 n-d-854823-1 devstack@n-api.service[106383]: *** Operational MODE: preforking *** Aug 27 04:21:08.765779 n-d-854823-1 devstack@n-api.service[106383]: *** uWSGI is running in multiple interpreter mode *** Aug 27 04:21:08.765779 n-d-854823-1 devstack@n-api.service[106383]: spawned uWSGI master process (pid: 106383) Aug 27 04:21:08.765981 n-d-854823-1 systemd[1]: Started Devstack devstack@n-api.service. Aug 27 04:21:08.769956 n-d-854823-1 devstack@n-api.service[106383]: spawned uWSGI worker 1 (pid: 106384, cores: 1) Aug 27 04:21:08.769956 n-d-854823-1 devstack@n-api.service[106383]: spawned uWSGI worker 2 (pid: 106385, cores: 1) Aug 27 04:21:08.769956 n-d-854823-1 devstack@n-api.service[106383]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 04:21:09.428188 n-d-854823-1 devstack@n-api.service[106384]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 04:21:09.428987 n-d-854823-1 devstack@n-api.service[106385]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 04:21:10.513933 n-d-854823-1 devstack@n-api.service[106384]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:21:10.513933 n-d-854823-1 devstack@n-api.service[106384]: from cryptography.utils import int_from_bytes Aug 27 04:21:10.514468 n-d-854823-1 devstack@n-api.service[106384]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:21:10.514468 n-d-854823-1 devstack@n-api.service[106384]: from cryptography.utils import int_from_bytes Aug 27 04:21:10.514586 n-d-854823-1 devstack@n-api.service[106385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:21:10.514586 n-d-854823-1 devstack@n-api.service[106385]: from cryptography.utils import int_from_bytes Aug 27 04:21:10.514986 n-d-854823-1 devstack@n-api.service[106385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:21:10.514986 n-d-854823-1 devstack@n-api.service[106385]: from cryptography.utils import int_from_bytes Aug 27 04:21:12.990750 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:21:12.991480 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:21:12.991846 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:21:12.991945 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:21:12.992030 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:21:12.992117 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:21:12.992117 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:21:12.992262 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:21:12.992357 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:21:12.992445 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:21:12.992550 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.992634 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.992795 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.992884 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.993117 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.993205 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.993434 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.993521 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.993762 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.993862 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.994069 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.994166 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.994398 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.994490 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.994801 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.994948 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.995132 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.995395 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.995490 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.995799 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.995897 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.996121 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.996205 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854823-1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.996442 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.996558 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854823-1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.996781 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.996889 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.997087 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.997172 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.997399 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.997484 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.997708 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.997797 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.998011 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.998102 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.998313 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.998405 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.999126 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.999323 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.999632 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.999766 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:12.999944 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.000052 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.000254 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.000378 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.000583 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.000733 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.000919 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.001047 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.001232 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.001358 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.001539 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.001679 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.001857 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.001988 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.002163 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.002314 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.002486 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.002626 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.002794 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.003037 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854823-1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.003184 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854823-1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.003358 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.003499 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.003672 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.003810 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.003988 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.004129 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.004402 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.004548 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.004739 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.004870 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.005051 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.005179 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.005372 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.005497 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.005696 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.005818 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.006007 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.006122 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.006334 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.006456 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.006655 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.006773 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.006974 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.007089 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.007294 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.007404 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.007597 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.007685 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.007906 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.008032 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.008213 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.008299 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.008551 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.008650 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.008860 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.008947 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.009164 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.009250 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.009414 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.009499 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.009715 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.009809 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.010075 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.010182 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.010475 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.010591 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.010802 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.010898 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.011051 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.011146 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.011299 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.011384 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.011616 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.011702 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.011934 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.012021 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.012243 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.012327 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.012568 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.012657 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.012879 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.012973 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.013185 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.013276 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.013491 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.013583 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.013792 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.013876 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.014106 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.014197 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.014988 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.015105 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.015373 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.015458 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.015696 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.015782 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.016019 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.016112 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.016330 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.016415 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.016674 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.016813 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.017074 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.017170 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.017327 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.017412 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.017634 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.017719 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.017972 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.018184 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.018291 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.018376 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.018599 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.018683 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.018912 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.019000 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.019231 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.019316 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.019536 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.019627 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.019841 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.019927 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.020147 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.020231 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.020459 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.020578 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.020811 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.020924 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.021116 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.021211 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.021365 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.021462 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.021661 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.021752 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.021965 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.022050 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.022278 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.022375 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.022582 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.022674 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.022888 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.022979 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.023188 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.023285 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.023484 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.023578 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.023789 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.023871 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.024096 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.024189 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.024399 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.024488 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.024729 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.024815 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.025032 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.025126 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.025333 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.025424 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.025634 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.025717 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.025936 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.026033 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.026237 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.026323 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.026552 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.026635 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.026865 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.026949 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.027168 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.027312 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.027471 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.027557 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.027771 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.027864 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.028074 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.028167 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.028386 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.028481 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.028717 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.028817 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.029022 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.029108 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.029342 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.029427 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.029645 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.029739 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.029968 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.030064 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.030282 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.030375 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.030587 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.030673 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.030905 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.031040 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.031206 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.031291 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.031503 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.031590 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.031807 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.031890 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.032118 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.032201 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.032436 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.032523 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.032751 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.032847 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.033054 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.033146 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.033354 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.033439 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.033655 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.033738 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.033960 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.034053 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.034257 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.034347 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.034557 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.034650 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.034853 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.034948 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.035164 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.035248 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.035482 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.035579 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.035785 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.035881 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.036088 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.036172 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.036389 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.036474 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.036731 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.036833 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:21:13.037064 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.037148 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.037394 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.037485 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.037732 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.037863 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.038046 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.038131 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.038372 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.038455 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.038699 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.038785 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.039015 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.039099 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.039323 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.039406 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.039635 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.039719 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.039957 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.040040 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.040267 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.040360 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.040599 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.040697 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.040908 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.040992 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.041230 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.041329 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.041636 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.041822 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.041968 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.042103 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.042283 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.042425 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.042696 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.042784 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.042912 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.042998 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.043221 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.043317 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.043539 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.043624 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.043867 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.043953 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.044186 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.044285 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.044495 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.044612 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.044860 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.044953 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.045203 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.045296 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.045534 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.045626 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.045859 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.045946 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.046182 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.046269 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.046492 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.046577 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.046798 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.046883 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.047109 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.047203 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.047429 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.047519 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.047756 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.047840 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.048070 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.048165 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.048386 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.048556 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.048725 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.048824 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.049044 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.049129 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.049355 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.049447 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.049665 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.049748 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.049971 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.050056 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.050304 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.050434 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.050607 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.050721 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.050925 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.051011 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.051238 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.051323 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.051557 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.051651 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.051869 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.051953 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.052175 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.052260 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.052491 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.052636 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.052828 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.052924 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.053137 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.053221 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.053443 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.053541 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.053745 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.053836 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.054045 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.054136 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.054347 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.054433 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.054657 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.054741 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.054958 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.055042 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.055274 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.055359 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.055595 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.055681 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.055901 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.055986 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.056225 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.056317 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.056545 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.056633 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.056861 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.056959 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.057261 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.057414 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.057557 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.057717 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.057862 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.057959 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.058176 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.058270 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.058484 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.058617 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.058788 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.058883 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.059112 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.059197 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.059418 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.059503 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.059722 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.059816 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.060042 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.060127 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.060346 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.060437 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.060674 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.060780 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.060987 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.061095 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.061822 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.061910 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.062131 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.062224 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.062444 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.062531 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.062753 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.062855 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.063074 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.063163 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.063382 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.063467 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.063693 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.063777 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.064033 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.064121 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.064358 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.064442 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.064684 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.064783 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.065006 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.065093 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.065330 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.065413 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.065641 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.065733 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.065946 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.066030 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.066250 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.066334 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.066552 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.066644 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.066852 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.066936 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.067154 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.067238 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.067457 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.067550 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.067755 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.067839 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.068055 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.068139 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.068355 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.068518 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.068699 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.068798 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.069002 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.069095 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.069320 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.069413 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.069627 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.069723 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.069926 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.070025 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.070228 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.070324 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.070528 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.070620 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.070866 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.070950 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.071167 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.071265 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.071505 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.071589 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.071834 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.071918 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.072152 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.072236 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.072471 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.072575 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.072884 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.072982 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.073201 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.073286 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.073513 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.073605 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.073825 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.073917 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.074140 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.074227 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.074449 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.074534 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.074769 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.074861 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.075077 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.075162 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.075395 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.075479 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.075702 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.075794 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.076022 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.076105 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.076327 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.076411 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.076670 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.077384 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.077607 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.077694 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.077932 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.078016 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.078273 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.078359 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.078603 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.078688 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.078920 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.079012 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.079240 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.079325 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.079551 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.079634 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.079862 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.079946 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.080171 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.080257 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.080481 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.080581 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.080824 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.080910 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.081135 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.081221 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.081452 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.081536 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.081761 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.081858 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.082078 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.082163 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.082383 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.082469 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.082702 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.082794 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.083005 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.083089 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.083321 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.083405 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.083620 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.083713 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.083933 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.084017 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.084256 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.084340 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.084609 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.084712 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.084919 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.085012 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.085229 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.085320 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.085544 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.085637 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.085852 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.085943 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.086156 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.086247 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.086463 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.086549 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.086765 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.086856 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.087067 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.087158 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.087374 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.087459 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.087688 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.087771 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.087995 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.088086 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.088304 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.088397 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.088630 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.088717 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.088947 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.089031 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.089256 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.089343 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.089560 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.089645 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.089862 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.089960 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.090173 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.090258 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.090496 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.090588 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.090806 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.090900 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.091125 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.091211 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.091444 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.091528 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.091745 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.091841 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.092047 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.092134 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.092390 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.092488 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.092726 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.092823 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.093033 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.093120 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.093338 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.093422 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.093639 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.093724 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.093981 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.094117 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.094287 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.094372 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.094590 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.094676 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.094901 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.094985 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.095219 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.095303 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.095523 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.095609 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.095835 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.095921 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.096141 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.096228 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.096447 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.096559 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.096792 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.096877 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.097103 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.097203 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.097412 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.097498 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.097722 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.097806 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.098028 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.098192 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.098336 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.098423 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.098643 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.098729 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.098960 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.099059 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.099269 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.099360 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.099577 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.099663 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.099885 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.099979 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.100188 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.100279 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.100494 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.100622 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.100832 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.100919 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.101409 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.101494 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.101748 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.101834 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.102068 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.102153 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.102388 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.102472 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.102711 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.102795 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.103055 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.103150 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.103387 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.103484 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.103746 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.103990 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.104087 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.104167 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.104328 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.104416 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.104750 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.104853 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.105062 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.105180 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.105373 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.105488 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.105687 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.105801 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.105997 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.106108 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.106311 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.106426 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.106617 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.106711 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.106931 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.107017 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.107237 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.107331 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.107545 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.107630 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.107850 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.107977 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.108195 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.108285 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.108514 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.108629 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.108843 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.108948 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.109155 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.109244 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.109458 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.109544 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.109779 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.109873 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.110088 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.110174 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.110391 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.110477 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.110698 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.110792 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.110997 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.111082 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.111337 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.111463 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.111637 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.111975 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.112230 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.112326 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.112578 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.112667 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.112922 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.113022 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.113227 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.113314 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.113533 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.113616 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.113853 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.113938 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.114156 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.114241 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.114745 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.114859 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.114995 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.115078 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.115164 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.115251 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.115330 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.115421 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.115612 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.115699 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.115921 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.116017 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.116229 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.116327 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.116576 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.116664 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.116869 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.116953 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.117171 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.117267 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.117474 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.117559 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.117776 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.117860 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.118086 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.118184 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.118392 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.118478 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.118691 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.118775 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.118991 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.119075 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.119297 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.119388 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.119602 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.119693 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.119902 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.119988 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.120209 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.120295 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.120512 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.120623 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.120900 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.120987 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.121209 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.121296 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.121511 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.121597 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.121813 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.121900 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.122124 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.122207 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.122429 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.122603 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.122731 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.122818 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.123051 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.123137 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.123361 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.123460 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.124177 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.124270 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.124480 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.124584 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.124816 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.124914 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.125121 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.125206 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.125421 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.125518 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.125729 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.125824 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.126050 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.126134 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.126362 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.126447 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.126665 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.126750 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.126971 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.127062 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.127274 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.127359 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.127575 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.127667 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.127876 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.127962 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.128182 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.128265 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.128480 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.128614 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.128807 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.128893 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.129109 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.129193 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.129406 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.129491 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.129706 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.129796 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.130022 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.130115 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.130328 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.130412 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.130627 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.130711 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.130929 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.131022 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.131230 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.131321 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.131566 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.131651 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.131866 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.131962 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.132218 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.132308 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.132549 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.132644 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.132866 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.132964 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.133184 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.133271 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.133493 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.133579 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.133804 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.133893 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.134120 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.134207 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.134421 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.134509 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.134736 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.134827 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.135044 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.135129 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.135356 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.135442 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.135659 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.135750 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.135957 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.136050 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.136275 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.136361 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.136609 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.136700 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.137269 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.146837 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.146837 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.147017 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.147098 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.147192 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.147273 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.147340 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.147414 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.147511 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.147580 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.147659 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.147736 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.147802 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.147866 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.147938 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.148024 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.148092 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.148168 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.148244 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.148311 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.148388 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.148455 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.148544 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.148627 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.148696 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.148762 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.148839 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.148918 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.148984 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.149049 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.149124 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.149199 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.149277 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.149362 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.149431 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.149496 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.149561 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.149633 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.149700 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.149765 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.149830 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.149894 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.149957 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.150030 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.150097 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.150179 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.150267 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.150336 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.150421 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.150500 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.150566 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.150648 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.150733 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.150813 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.150898 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.150972 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.151050 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.151127 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.151200 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.151291 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.151381 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.151456 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.151534 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.151615 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.151682 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.151758 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.151847 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.151915 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.151992 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.152058 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.152128 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.152207 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.152478 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.152627 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.152711 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.152790 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.152868 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.152959 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.153040 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.153107 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.153171 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.153259 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.153327 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.153417 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.153505 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.153579 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.153656 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.153733 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.153799 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.153874 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.153993 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.154080 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.154159 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.154232 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.154318 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.154470 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.154551 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.154653 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.154737 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.154850 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.154948 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.155029 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.155095 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.155159 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.155235 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.155301 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.155378 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.155458 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.155524 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.155588 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.155684 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.155759 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.155844 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.155929 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.156008 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.156086 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.156171 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.156247 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.156326 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.156392 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.156466 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.156573 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.156652 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.156738 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.156819 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.156886 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.156971 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.157079 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.157253 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.157382 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.157562 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.157705 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.157890 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.158027 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.158216 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.158340 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.158533 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.158663 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.158858 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.159077 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.159277 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.159397 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.159606 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.159700 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.159922 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.160009 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.160247 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.160332 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.160600 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.160691 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.160917 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.161018 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.161226 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.161313 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.161528 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.161614 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.161833 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.161919 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.162142 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.162229 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.162444 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.162539 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.162754 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.162847 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.163065 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.163151 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.163374 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.163469 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.163676 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.163771 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.163980 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.164072 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.164288 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.164378 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.164612 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.164701 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.164933 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.165030 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.165244 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.165329 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.165556 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.165642 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.165872 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.165966 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.166175 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.166299 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.166551 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.166756 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.166846 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.166936 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.167147 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.167234 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.167450 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.167536 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.167753 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.167849 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.168093 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.168180 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.168396 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.168483 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.168742 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.168834 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.169070 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.169156 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.169391 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.169476 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.169699 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.169786 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.170013 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.170097 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.170330 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.170502 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.170670 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.170765 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.170987 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.171073 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.171304 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.171398 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.171604 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.171689 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.171905 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.171992 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.172212 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.172305 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.172511 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.172629 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.172836 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.172922 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.173137 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.173233 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.173440 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.173525 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.173737 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.173821 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.174040 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.174135 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.174342 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.174436 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.174648 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.174734 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.174947 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.175033 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.175262 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.175346 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.175565 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.175649 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.175865 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.175951 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.176167 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.176253 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.176466 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.176628 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.176796 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.176890 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.177119 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.177205 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.177429 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.177513 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.177740 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.177826 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.178055 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.178146 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.178367 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.178461 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.178681 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.178767 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.178994 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.179087 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.179307 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.179402 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.179619 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.179704 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.179930 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.180017 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.180242 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.180337 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.180562 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.180653 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.180879 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.180964 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.181189 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.181286 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.181501 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.181586 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.181819 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.182119 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.182435 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.182532 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.182747 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.182867 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.183060 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.183147 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.183368 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.183456 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.183707 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.183910 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.184039 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.184133 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.184374 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.184467 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.184710 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.184797 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.185018 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.185114 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.185340 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.185538 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.185643 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.185731 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.185960 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.186063 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.186803 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.186891 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.187127 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.187213 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.187443 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.187538 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.187756 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.187843 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.188068 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.188154 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.188381 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.188468 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.188724 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.188855 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.189061 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.189155 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.189363 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.189458 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.189674 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.189768 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.189986 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.190080 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.190293 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.190379 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.190601 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.190694 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.190909 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.191005 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.191217 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.191301 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.191522 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.191607 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.191830 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.191991 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.192137 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.192223 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.192446 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.192576 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.192785 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.192874 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.193097 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.193182 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.193422 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.193508 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.193735 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.193831 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.194048 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.194141 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.194359 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.194483 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.194670 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.194757 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.194982 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.195192 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.195503 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.195600 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.195815 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.195907 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.196140 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.196226 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.196460 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.196643 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.196804 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.196892 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.197120 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.197206 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.197438 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.197533 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.197740 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.197826 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.198045 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.198138 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.198351 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.198445 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.198658 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.198744 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.198962 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.199048 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.199268 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.199354 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.199578 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.199664 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.199881 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.199976 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.200185 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.200271 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.200489 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.200593 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.200834 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.201268 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.201381 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.201465 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.201735 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.202381 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.202575 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.202663 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.202908 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.203003 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.203234 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.203333 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.203541 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.203688 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.203850 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.203942 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.204158 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.204243 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.204463 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.204636 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.204797 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.204891 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.205103 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.205188 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.205407 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.205503 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.205710 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.205797 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.206014 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.206100 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.206318 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.206420 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.206620 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.206707 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.206923 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.207008 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.207220 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.207313 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.207523 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.207608 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.207835 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.207920 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.208138 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.208226 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.208442 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.208552 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.208773 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.208861 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.209084 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.209171 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.209388 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.209475 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.209689 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.209775 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.209991 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.210085 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.210293 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.210379 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.210592 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.210687 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.210898 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.210985 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.211199 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.211285 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.211500 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.211597 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.211800 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.211887 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.212103 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.212187 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.212413 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.212508 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.212789 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.212890 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.213092 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.213180 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.213394 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.213489 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.213710 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.213796 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.214018 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.214104 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.214346 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.214433 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.214655 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.214750 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.214966 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.215060 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.215291 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.215378 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.215609 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.215702 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.215944 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.216143 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.216477 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.216592 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.216835 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.216922 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.217157 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.217242 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.217508 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.217598 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.217815 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.217908 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.218119 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.218215 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.218424 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.218511 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.218731 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.218823 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.219041 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.219137 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.219348 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.219434 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.219657 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.219743 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.219965 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.220058 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.220269 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.220355 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.220606 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.220711 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.220920 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.221008 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.221231 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.221316 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.221537 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.221623 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.221846 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.221933 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.222150 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.222235 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.222458 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.222543 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.222762 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.222848 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.223070 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.223154 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.223381 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.223479 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.223693 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.223778 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.224027 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.224120 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.224347 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.224442 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.224683 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.224830 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.225002 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.225096 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.225314 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.225410 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.225623 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.225711 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.225932 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.226017 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.226238 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.226331 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.226545 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.226631 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.226863 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.226956 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.227173 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.227259 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.227480 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.227567 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.227788 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.227900 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.228212 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.228299 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.228562 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.228661 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.230577 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.230712 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.230800 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.230941 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.231018 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.231089 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.232156 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.232272 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.232348 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.232416 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.232491 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.234262 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.234262 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.234548 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.234659 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.234749 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.234838 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.234908 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.234973 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.235097 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.235187 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.235266 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.235344 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.235422 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.235509 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.235590 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.235667 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.235746 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.235830 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.235911 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.235997 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.236077 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.236168 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.236248 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.236333 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.236413 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.236502 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.236602 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.236693 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.237036 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.237124 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.237203 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.237300 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.237380 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.237464 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.237543 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.237631 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.237722 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.237801 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.237879 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.237967 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.238047 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.238131 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.238218 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.238298 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.238376 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.238454 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.238531 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.238607 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.238693 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.238772 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.238850 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.238927 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.239013 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.239093 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.239184 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.239269 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.239355 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.239440 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.239520 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.239677 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.239765 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.239973 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.240058 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.240273 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.240366 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.240633 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.240724 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.240996 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.241095 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.241270 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.241357 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.241581 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.241669 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.241891 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.241976 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.242198 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.242292 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.242508 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.242593 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.242823 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.242908 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.243139 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.243238 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.243447 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.243541 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.243754 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.243846 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.244073 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.244179 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.244385 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.244472 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.244721 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.244810 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.245033 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.245129 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.245341 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.245437 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.245650 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.245736 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.245977 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.246068 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.246303 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.246391 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.246606 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.246693 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.246924 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.247010 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.247238 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.247331 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.247556 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.247642 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.247869 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.247955 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.248178 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.248265 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.248489 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.249122 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.249339 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.249425 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.249650 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.249738 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.249959 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.250053 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.250286 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.250379 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.250577 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.250668 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.250888 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.251049 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.251194 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.251288 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.251503 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.251590 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.251812 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.251898 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.252121 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.252213 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.252436 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.252520 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.252782 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.252875 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.253090 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.253177 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.253404 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.253490 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.253723 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.253809 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.254046 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.254191 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.254365 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.254452 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.254696 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.254783 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.255023 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.255162 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.255337 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.255433 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.255647 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.255740 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.255950 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.256037 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.256192 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:21:13.256289 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:21:13.256485 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:21:13.411137 n-d-854823-1 devstack@n-api.service[106384]: INFO dbcounter [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] Registered counter for database nova_api Aug 27 04:21:13.411840 n-d-854823-1 devstack@n-api.service[106385]: INFO dbcounter [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Registered counter for database nova_api Aug 27 04:21:13.432756 n-d-854823-1 devstack@n-api.service[106384]: DEBUG oslo_db.sqlalchemy.engines [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:21:13.434536 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_db.sqlalchemy.engines [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:21:13.439466 n-d-854823-1 devstack@n-api.service[106384]: DEBUG dbcounter [-] [106384] Writer thread running {{(pid=106384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:21:13.441089 n-d-854823-1 devstack@n-api.service[106385]: DEBUG dbcounter [-] [106385] Writer thread running {{(pid=106385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:21:13.496976 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.context [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e7bc291f-2aa3-4d66-a942-e096e031ad4c(cell1) {{(pid=106384) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 04:21:13.498963 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.context [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e7bc291f-2aa3-4d66-a942-e096e031ad4c(cell1) {{(pid=106385) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 04:21:13.500799 n-d-854823-1 devstack@n-api.service[106384]: DEBUG oslo_concurrency.lockutils [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:13.501273 n-d-854823-1 devstack@n-api.service[106384]: DEBUG oslo_concurrency.lockutils [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:13.502808 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:13.502903 n-d-854823-1 devstack@n-api.service[106384]: DEBUG oslo_concurrency.lockutils [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:13.503278 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:13.503557 n-d-854823-1 devstack@n-api.service[106384]: DEBUG oslo_concurrency.lockutils [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:13.503995 n-d-854823-1 devstack@n-api.service[106384]: DEBUG oslo_concurrency.lockutils [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:13.504913 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:13.505635 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:13.506004 n-d-854823-1 devstack@n-api.service[106384]: DEBUG oslo_concurrency.lockutils [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:13.506096 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:13.507967 n-d-854823-1 devstack@n-api.service[106384]: INFO dbcounter [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] Registered counter for database nova_cell0 Aug 27 04:21:13.508069 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:13.510096 n-d-854823-1 devstack@n-api.service[106385]: INFO dbcounter [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Registered counter for database nova_cell0 Aug 27 04:21:13.512153 n-d-854823-1 devstack@n-api.service[106384]: INFO dbcounter [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] Registered counter for database nova_cell1 Aug 27 04:21:13.514176 n-d-854823-1 devstack@n-api.service[106385]: INFO dbcounter [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Registered counter for database nova_cell1 Aug 27 04:21:13.521089 n-d-854823-1 devstack@n-api.service[106384]: DEBUG oslo_db.sqlalchemy.engines [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:21:13.522212 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_db.sqlalchemy.engines [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:21:13.524378 n-d-854823-1 devstack@n-api.service[106384]: DEBUG oslo_db.sqlalchemy.engines [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:21:13.527010 n-d-854823-1 devstack@n-api.service[106385]: DEBUG dbcounter [-] [106385] Writer thread running {{(pid=106385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:21:13.528001 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_db.sqlalchemy.engines [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:21:13.528255 n-d-854823-1 devstack@n-api.service[106384]: DEBUG dbcounter [-] [106384] Writer thread running {{(pid=106384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:21:13.669720 n-d-854823-1 devstack@n-api.service[106384]: DEBUG dbcounter [-] [106384] Writer thread running {{(pid=106384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:21:13.673252 n-d-854823-1 devstack@n-api.service[106385]: DEBUG dbcounter [-] [106385] Writer thread running {{(pid=106385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:21:13.679939 n-d-854823-1 devstack@n-api.service[106384]: INFO dbcounter [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] Registered counter for database nova_cell0 Aug 27 04:21:13.682247 n-d-854823-1 devstack@n-api.service[106385]: INFO dbcounter [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Registered counter for database nova_cell0 Aug 27 04:21:13.687689 n-d-854823-1 devstack@n-api.service[106384]: DEBUG oslo_db.sqlalchemy.engines [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:21:13.689543 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_db.sqlalchemy.engines [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:21:13.692266 n-d-854823-1 devstack@n-api.service[106384]: DEBUG dbcounter [-] [106384] Writer thread running {{(pid=106384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:21:13.694050 n-d-854823-1 devstack@n-api.service[106385]: DEBUG dbcounter [-] [106385] Writer thread running {{(pid=106385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:21:14.031248 n-d-854823-1 devstack@n-api.service[106385]: WARNING keystonemiddleware.auth_token [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:21:14.034116 n-d-854823-1 devstack@n-api.service[106384]: WARNING keystonemiddleware.auth_token [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:21:14.038665 n-d-854823-1 devstack@n-api.service[106385]: WARNING keystonemiddleware.auth_token [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:21:14.041610 n-d-854823-1 devstack@n-api.service[106384]: WARNING keystonemiddleware.auth_token [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:21:14.380195 n-d-854823-1 devstack@n-api.service[106385]: WARNING keystonemiddleware.auth_token [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:21:14.385157 n-d-854823-1 devstack@n-api.service[106384]: WARNING keystonemiddleware.auth_token [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:21:14.386278 n-d-854823-1 devstack@n-api.service[106385]: WARNING keystonemiddleware.auth_token [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:21:14.391449 n-d-854823-1 devstack@n-api.service[106385]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56291c8fd9c0 pid: 106385 (default app) Aug 27 04:21:14.391646 n-d-854823-1 devstack@n-api.service[106384]: WARNING keystonemiddleware.auth_token [None req-dd618ffc-7573-4da9-8d38-c3913f619fa9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:21:14.393531 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:14.394716 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001726 Aug 27 04:21:14.395383 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 788 bytes} [Sat Aug 27 04:21:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:21:14.396911 n-d-854823-1 devstack@n-api.service[106384]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56291c8fd9c0 pid: 106384 (default app) Aug 27 04:22:31.851204 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:31.852217 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 27 04:22:31.852663 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 2/2] 10.222.0.79 () {54 vars in 931 bytes} [Sat Aug 27 04:22:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:31.865958 n-d-854823-1 devstack@n-api.service[106384]: DEBUG dbcounter [-] [106384] Writing DB stats nova_api:SELECT=3 {{(pid=106384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:31.867222 n-d-854823-1 devstack@n-api.service[106384]: DEBUG dbcounter [-] [106384] Writing DB stats nova_cell1:SELECT=3 {{(pid=106384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:31.868236 n-d-854823-1 devstack@n-api.service[106384]: DEBUG dbcounter [-] [106384] Writing DB stats nova_cell0:SELECT=3 {{(pid=106384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:31.869035 n-d-854823-1 devstack@n-api.service[106384]: DEBUG dbcounter [-] [106384] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:32.729117 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-d922d561-9cd2-4756-b3e7-89d2e03975bd admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:32.762768 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-d922d561-9cd2-4756-b3e7-89d2e03975bd admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.902557 Aug 27 04:22:32.763741 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 1/3] 10.222.0.79 () {60 vars in 1292 bytes} [Sat Aug 27 04:22:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:35.127661 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:35.128720 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-f74b0fd1-e73d-43d9-9022-84bf8aa8a007 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 27 04:22:35.129116 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 3/4] 10.222.0.79 () {54 vars in 931 bytes} [Sat Aug 27 04:22:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:35.610908 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-4abb6a19-40ad-4faf-9211-47e63ccb1346 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1}} {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:35.665365 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-4abb6a19-40ad-4faf-9211-47e63ccb1346 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.530005 Aug 27 04:22:35.668753 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 2/5] 10.222.0.79 () {64 vars in 1283 bytes} [Sat Aug 27 04:22:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:35.679652 n-d-854823-1 devstack@n-api.service[106385]: DEBUG dbcounter [-] [106385] Writing DB stats nova_api:SELECT=3 {{(pid=106385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:35.680459 n-d-854823-1 devstack@n-api.service[106385]: DEBUG dbcounter [-] [106385] Writing DB stats nova_cell0:SELECT=3 {{(pid=106385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:35.681187 n-d-854823-1 devstack@n-api.service[106385]: DEBUG dbcounter [-] [106385] Writing DB stats nova_cell1:SELECT=3 {{(pid=106385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:35.682245 n-d-854823-1 devstack@n-api.service[106385]: DEBUG dbcounter [-] [106385] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:35.893241 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-4c84848b-4cee-4462-941f-963b1b860d49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:35.958350 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-4c84848b-4cee-4462-941f-963b1b860d49 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283450 Aug 27 04:22:35.959416 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 4/6] 10.222.0.79 () {64 vars in 1336 bytes} [Sat Aug 27 04:22:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:38.395931 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-4abb6a19-40ad-4faf-9211-47e63ccb1346 admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:38.397514 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-4abb6a19-40ad-4faf-9211-47e63ccb1346 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 Aug 27 04:22:38.398063 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 3/7] 10.222.0.79 () {54 vars in 931 bytes} [Sat Aug 27 04:22:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:39.151349 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-fe2f8b1f-d5d8-4ebd-9eb7-51b2dba3ce54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "swap": 0, "id": "d1", "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:39.204048 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-fe2f8b1f-d5d8-4ebd-9eb7-51b2dba3ce54 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.799389 Aug 27 04:22:39.204840 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 5/8] 10.222.0.79 () {64 vars in 1283 bytes} [Sat Aug 27 04:22:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:39.217340 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-4aafcc6a-f3de-4c21-a8c5-c16638e06238 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:39.255585 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-4aafcc6a-f3de-4c21-a8c5-c16638e06238 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042372 Aug 27 04:22:39.257055 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 4/9] 10.222.0.79 () {64 vars in 1336 bytes} [Sat Aug 27 04:22:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:41.755889 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-fe2f8b1f-d5d8-4ebd-9eb7-51b2dba3ce54 admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:41.756964 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-fe2f8b1f-d5d8-4ebd-9eb7-51b2dba3ce54 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 27 04:22:41.762899 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 6/10] 10.222.0.79 () {54 vars in 931 bytes} [Sat Aug 27 04:22:41 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:42.246472 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-fd98bdc8-9587-4280-984c-1321bcf5f9cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2", "ram": 1024}} {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:42.270240 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-fd98bdc8-9587-4280-984c-1321bcf5f9cc admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506086 Aug 27 04:22:42.271283 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 5/11] 10.222.0.79 () {64 vars in 1283 bytes} [Sat Aug 27 04:22:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:42.283383 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-ba509a09-a70f-4bf6-8e70-9f982b7e8459 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:42.316808 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-ba509a09-a70f-4bf6-8e70-9f982b7e8459 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037395 Aug 27 04:22:42.326050 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 7/12] 10.222.0.79 () {64 vars in 1336 bytes} [Sat Aug 27 04:22:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:22:44.924589 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-fd98bdc8-9587-4280-984c-1321bcf5f9cc admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:44.926340 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-fd98bdc8-9587-4280-984c-1321bcf5f9cc admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002240 Aug 27 04:22:44.926966 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 6/13] 10.222.0.79 () {54 vars in 931 bytes} [Sat Aug 27 04:22:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:22:45.397987 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-da2bbf12-83f7-47fa-813a-1fa821be438e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "disk": 10}} {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:45.418050 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-da2bbf12-83f7-47fa-813a-1fa821be438e admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.484720 Aug 27 04:22:45.418908 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 8/14] 10.222.0.79 () {64 vars in 1283 bytes} [Sat Aug 27 04:22:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:45.431923 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-11f09db3-4a8f-4581-8e0f-099e1e5936a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:45.458084 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-11f09db3-4a8f-4581-8e0f-099e1e5936a8 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030165 Aug 27 04:22:45.458803 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 7/15] 10.222.0.79 () {64 vars in 1336 bytes} [Sat Aug 27 04:22:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:22:47.877588 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-da2bbf12-83f7-47fa-813a-1fa821be438e admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:47.879668 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-da2bbf12-83f7-47fa-813a-1fa821be438e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002532 Aug 27 04:22:47.880250 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 9/16] 10.222.0.79 () {54 vars in 931 bytes} [Sat Aug 27 04:22:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:48.526320 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-23d83b6b-6285-4f56-b2b9-73d8ef08f267 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "disk": 20, "swap": 0, "rxtx_factor": 1.0}} {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:48.552385 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-23d83b6b-6285-4f56-b2b9-73d8ef08f267 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.665426 Aug 27 04:22:48.561831 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 8/17] 10.222.0.79 () {64 vars in 1283 bytes} [Sat Aug 27 04:22:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:48.568216 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-d3e6340a-860d-4be0-88d0-c73991c726cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:48.605472 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-d3e6340a-860d-4be0-88d0-c73991c726cd admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040940 Aug 27 04:22:48.606715 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 10/18] 10.222.0.79 () {64 vars in 1336 bytes} [Sat Aug 27 04:22:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:51.054535 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-23d83b6b-6285-4f56-b2b9-73d8ef08f267 admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:51.056150 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-23d83b6b-6285-4f56-b2b9-73d8ef08f267 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002683 Aug 27 04:22:51.067607 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 9/19] 10.222.0.79 () {54 vars in 931 bytes} [Sat Aug 27 04:22:51 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:51.575831 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-a1e09410-6067-48c1-82fd-6751ca5fa622 admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:51.603103 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-a1e09410-6067-48c1-82fd-6751ca5fa622 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.539226 Aug 27 04:22:51.617326 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 11/20] 10.222.0.79 () {60 vars in 1292 bytes} [Sat Aug 27 04:22:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:22:54.178484 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-23d83b6b-6285-4f56-b2b9-73d8ef08f267 admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:54.180259 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-23d83b6b-6285-4f56-b2b9-73d8ef08f267 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002354 Aug 27 04:22:54.180954 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 10/21] 10.222.0.79 () {54 vars in 931 bytes} [Sat Aug 27 04:22:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:54.661903 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-3a6719d7-ef27-4924-ab9f-7c9856908750 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "id": "1", "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:54.682662 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-3a6719d7-ef27-4924-ab9f-7c9856908750 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.492298 Aug 27 04:22:54.683242 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 12/22] 10.222.0.79 () {64 vars in 1283 bytes} [Sat Aug 27 04:22:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:22:54.698296 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-4d998d38-7998-48f2-a553-0f2b434d55ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:54.734179 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-4d998d38-7998-48f2-a553-0f2b434d55ce admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041561 Aug 27 04:22:54.734944 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 11/23] 10.222.0.79 () {64 vars in 1333 bytes} [Sat Aug 27 04:22:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:57.302321 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-3a6719d7-ef27-4924-ab9f-7c9856908750 admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:57.303371 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-3a6719d7-ef27-4924-ab9f-7c9856908750 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001875 Aug 27 04:22:57.303794 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 13/24] 10.222.0.79 () {54 vars in 931 bytes} [Sat Aug 27 04:22:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:57.795509 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-4f509c6b-2889-4332-8ef2-b10fc656ab70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small"}} {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:57.816331 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-4f509c6b-2889-4332-8ef2-b10fc656ab70 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.503324 Aug 27 04:22:57.816939 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 12/25] 10.222.0.79 () {64 vars in 1283 bytes} [Sat Aug 27 04:22:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:22:57.832119 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-31280896-a6a4-402d-9393-7d724e51e844 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:57.866560 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-31280896-a6a4-402d-9393-7d724e51e844 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040355 Aug 27 04:22:57.871127 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 14/26] 10.222.0.79 () {64 vars in 1333 bytes} [Sat Aug 27 04:22:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:00.241879 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-4f509c6b-2889-4332-8ef2-b10fc656ab70 admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:00.242904 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-4f509c6b-2889-4332-8ef2-b10fc656ab70 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001748 Aug 27 04:23:00.243314 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 13/27] 10.222.0.79 () {54 vars in 931 bytes} [Sat Aug 27 04:23:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:00.643457 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-27c74c53-e13b-463c-b875-a9a3aae50f01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "ram": 4096, "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true}} {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:00.661975 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-27c74c53-e13b-463c-b875-a9a3aae50f01 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.412513 Aug 27 04:23:00.662565 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 15/28] 10.222.0.79 () {64 vars in 1283 bytes} [Sat Aug 27 04:23:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:23:00.675184 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-ccc48743-5e6f-4fe4-9ef8-42c1b787a9bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:00.700907 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-ccc48743-5e6f-4fe4-9ef8-42c1b787a9bd admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029835 Aug 27 04:23:00.701842 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 14/29] 10.222.0.79 () {64 vars in 1333 bytes} [Sat Aug 27 04:23:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:03.125982 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-27c74c53-e13b-463c-b875-a9a3aae50f01 admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:03.127158 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-27c74c53-e13b-463c-b875-a9a3aae50f01 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001929 Aug 27 04:23:03.127657 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 16/30] 10.222.0.79 () {54 vars in 931 bytes} [Sat Aug 27 04:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:03.614357 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-669c77d4-ae30-4096-bbb4-750cbb536a0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "name": "m1.large"}} {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:03.620574 n-d-854823-1 devstack@n-api.service[106384]: DEBUG dbcounter [-] [106384] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:23:03.635677 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-669c77d4-ae30-4096-bbb4-750cbb536a0c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.501674 Aug 27 04:23:03.636486 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 15/31] 10.222.0.79 () {64 vars in 1283 bytes} [Sat Aug 27 04:23:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:23:03.649120 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-92544cbb-d638-412c-8f6d-2187e74e0f48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:03.679782 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-92544cbb-d638-412c-8f6d-2187e74e0f48 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034231 Aug 27 04:23:03.680844 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 17/32] 10.222.0.79 () {64 vars in 1333 bytes} [Sat Aug 27 04:23:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:23:06.117420 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-669c77d4-ae30-4096-bbb4-750cbb536a0c admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:06.118354 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-669c77d4-ae30-4096-bbb4-750cbb536a0c admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001754 Aug 27 04:23:06.118765 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 16/33] 10.222.0.79 () {54 vars in 931 bytes} [Sat Aug 27 04:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:06.588636 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-15111f61-787b-4eff-ac6b-d05a44dfcc5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:06.595925 n-d-854823-1 devstack@n-api.service[106385]: DEBUG dbcounter [-] [106385] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:23:06.612482 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-15111f61-787b-4eff-ac6b-d05a44dfcc5e admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.487095 Aug 27 04:23:06.613065 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 18/34] 10.222.0.79 () {64 vars in 1283 bytes} [Sat Aug 27 04:23:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:23:06.626218 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-113df0b0-cdf3-4b51-b139-215bafa2e0fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:06.654671 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-113df0b0-cdf3-4b51-b139-215bafa2e0fc admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032976 Aug 27 04:23:06.655256 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 17/35] 10.222.0.79 () {64 vars in 1333 bytes} [Sat Aug 27 04:23:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:28.886679 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-15111f61-787b-4eff-ac6b-d05a44dfcc5e admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:28.887766 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-15111f61-787b-4eff-ac6b-d05a44dfcc5e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Aug 27 04:23:28.888238 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 19/36] 10.222.0.79 () {54 vars in 931 bytes} [Sat Aug 27 04:23:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:28.898822 n-d-854823-1 devstack@n-api.service[106384]: DEBUG dbcounter [-] [106384] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:23:29.278831 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-97ecc7aa-575e-4599-a5fb-ac92882cabe7 admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:29.297971 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-97ecc7aa-575e-4599-a5fb-ac92882cabe7 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403466 Aug 27 04:23:29.298508 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 18/37] 10.222.0.79 () {60 vars in 1292 bytes} [Sat Aug 27 04:23:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:23:30.347767 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-15111f61-787b-4eff-ac6b-d05a44dfcc5e admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:30.348898 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-15111f61-787b-4eff-ac6b-d05a44dfcc5e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 27 04:23:30.349292 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 20/38] 10.222.0.79 () {56 vars in 1074 bytes} [Sat Aug 27 04:23:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:30.878336 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-c4dae50d-eeba-4b91-8a34-db2b3948ed6c admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:30.883974 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.wsgi [None req-c4dae50d-eeba-4b91-8a34-db2b3948ed6c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-c4dae50d-eeba-4b91-8a34-db2b3948ed6c admin admin] Request method failure captured: Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: Accept: application/json Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: Accept-Encoding: gzip, deflate Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: Connection: keep-alive Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: Content-Length: 0 Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: Host: 10.222.0.79 Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: Openstack-Api-Version: compute 2.90 Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: Openstack-System-Scope: None Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: User-Agent: python-novaclient Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: X-Auth-Token: gAAAAABjCZxCEra9zr8H9RxWpMyIio0JLp3_JMTF7vORAhYGevWkXCzmQpDjiqtMye5EzDey1b-YbvXZVeziL13T-GtG0SaNk7hJm-vZf8qopXYsyP0dh7jrQAfHaJ8cTuHIDntj-2LjEPndGZ3WnmCQSHSQ9dIkqeaxQoHFzC1nvxXhxr-LFwg Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: X-Domain-Id: None Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: X-Domain-Name: None Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: X-Identity-Status: Confirmed Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: X-Is-Admin-Project: True Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: X-Project-Domain-Id: default Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: X-Project-Domain-Name: Default Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: X-Project-Id: b3f91bd2de7a46528177960fc698df58 Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: X-Project-Name: admin Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: X-Role: admin,reader,member Aug 27 04:23:30.887222 n-d-854823-1 devstack@n-api.service[106384]: X-Roles: admin,reader,member Aug 27 04:23:30.888923 n-d-854823-1 devstack@n-api.service[106384]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b3f91bd2de7a46528177960fc698df58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:23:30.888923 n-d-854823-1 devstack@n-api.service[106384]: X-Tenant: admin Aug 27 04:23:30.888923 n-d-854823-1 devstack@n-api.service[106384]: X-Tenant-Id: b3f91bd2de7a46528177960fc698df58 Aug 27 04:23:30.888923 n-d-854823-1 devstack@n-api.service[106384]: X-Tenant-Name: admin Aug 27 04:23:30.888923 n-d-854823-1 devstack@n-api.service[106384]: X-User: admin Aug 27 04:23:30.888923 n-d-854823-1 devstack@n-api.service[106384]: X-User-Domain-Id: default Aug 27 04:23:30.888923 n-d-854823-1 devstack@n-api.service[106384]: X-User-Domain-Name: Default Aug 27 04:23:30.888923 n-d-854823-1 devstack@n-api.service[106384]: X-User-Id: f829879e344f4b19840fd54e71b10768 Aug 27 04:23:30.888923 n-d-854823-1 devstack@n-api.service[106384]: X-User-Name: admin Aug 27 04:23:30.888923 n-d-854823-1 devstack@n-api.service[106384]: method: > Aug 27 04:23:30.888923 n-d-854823-1 devstack@n-api.service[106384]: exception: Flavor 42 could not be found. Aug 27 04:23:30.888923 n-d-854823-1 devstack@n-api.service[106384]: action_args: {'id': '42'} Aug 27 04:23:30.888923 n-d-854823-1 devstack@n-api.service[106384]: {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:23:30.888923 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:23:30.890170 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:30.892094 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-c4dae50d-eeba-4b91-8a34-db2b3948ed6c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:23:30.893495 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-c4dae50d-eeba-4b91-8a34-db2b3948ed6c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394991 Aug 27 04:23:30.893495 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 19/39] 10.222.0.79 () {60 vars in 1190 bytes} [Sat Aug 27 04:23:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:30.898854 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-2dd87303-19fa-4b8b-8464-6d741b370e14 admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:30.922625 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-2dd87303-19fa-4b8b-8464-6d741b370e14 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027323 Aug 27 04:23:30.923159 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 21/40] 10.222.0.79 () {60 vars in 1210 bytes} [Sat Aug 27 04:23:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:23:30.939425 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-b83a2e83-0858-42bb-a630-ceb31c666b20 admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:30.962609 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-b83a2e83-0858-42bb-a630-ceb31c666b20 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027450 Aug 27 04:23:30.963165 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 20/41] 10.222.0.79 () {60 vars in 1210 bytes} [Sat Aug 27 04:23:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:23:30.972838 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-a3f8f0f0-b3bf-49e8-b291-c17fb812918f admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:30.978610 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.wsgi [None req-a3f8f0f0-b3bf-49e8-b291-c17fb812918f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-a3f8f0f0-b3bf-49e8-b291-c17fb812918f admin admin] Request method failure captured: Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: Accept: application/json Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: Accept-Encoding: gzip, deflate Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: Connection: keep-alive Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: Content-Length: 0 Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: Host: 10.222.0.79 Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: Openstack-Api-Version: compute 2.90 Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: Openstack-System-Scope: None Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: User-Agent: python-novaclient Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: X-Auth-Token: gAAAAABjCZxCEra9zr8H9RxWpMyIio0JLp3_JMTF7vORAhYGevWkXCzmQpDjiqtMye5EzDey1b-YbvXZVeziL13T-GtG0SaNk7hJm-vZf8qopXYsyP0dh7jrQAfHaJ8cTuHIDntj-2LjEPndGZ3WnmCQSHSQ9dIkqeaxQoHFzC1nvxXhxr-LFwg Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: X-Domain-Id: None Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: X-Domain-Name: None Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: X-Identity-Status: Confirmed Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: X-Is-Admin-Project: True Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: X-Project-Domain-Id: default Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: X-Project-Domain-Name: Default Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: X-Project-Id: b3f91bd2de7a46528177960fc698df58 Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: X-Project-Name: admin Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: X-Role: admin,reader,member Aug 27 04:23:30.981857 n-d-854823-1 devstack@n-api.service[106385]: X-Roles: admin,reader,member Aug 27 04:23:30.983485 n-d-854823-1 devstack@n-api.service[106385]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b3f91bd2de7a46528177960fc698df58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:23:30.983485 n-d-854823-1 devstack@n-api.service[106385]: X-Tenant: admin Aug 27 04:23:30.983485 n-d-854823-1 devstack@n-api.service[106385]: X-Tenant-Id: b3f91bd2de7a46528177960fc698df58 Aug 27 04:23:30.983485 n-d-854823-1 devstack@n-api.service[106385]: X-Tenant-Name: admin Aug 27 04:23:30.983485 n-d-854823-1 devstack@n-api.service[106385]: X-User: admin Aug 27 04:23:30.983485 n-d-854823-1 devstack@n-api.service[106385]: X-User-Domain-Id: default Aug 27 04:23:30.983485 n-d-854823-1 devstack@n-api.service[106385]: X-User-Domain-Name: Default Aug 27 04:23:30.983485 n-d-854823-1 devstack@n-api.service[106385]: X-User-Id: f829879e344f4b19840fd54e71b10768 Aug 27 04:23:30.983485 n-d-854823-1 devstack@n-api.service[106385]: X-User-Name: admin Aug 27 04:23:30.983485 n-d-854823-1 devstack@n-api.service[106385]: method: > Aug 27 04:23:30.983485 n-d-854823-1 devstack@n-api.service[106385]: exception: Flavor 42 could not be found. Aug 27 04:23:30.983485 n-d-854823-1 devstack@n-api.service[106385]: action_args: {'id': '42'} Aug 27 04:23:30.983485 n-d-854823-1 devstack@n-api.service[106385]: {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:23:30.983485 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:23:30.985411 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:30.986732 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-a3f8f0f0-b3bf-49e8-b291-c17fb812918f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:23:30.987954 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-a3f8f0f0-b3bf-49e8-b291-c17fb812918f admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014190 Aug 27 04:23:30.987954 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 22/42] 10.222.0.79 () {60 vars in 1190 bytes} [Sat Aug 27 04:23:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:31.950606 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-b83a2e83-0858-42bb-a630-ceb31c666b20 admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:31.951654 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-b83a2e83-0858-42bb-a630-ceb31c666b20 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 27 04:23:31.952077 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 21/43] 10.222.0.79 () {56 vars in 1074 bytes} [Sat Aug 27 04:23:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:32.475215 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-953851b9-ad6c-4b0f-98c3-cd794e9d60ab admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:32.480624 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.wsgi [None req-953851b9-ad6c-4b0f-98c3-cd794e9d60ab admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-953851b9-ad6c-4b0f-98c3-cd794e9d60ab admin admin] Request method failure captured: Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: Accept: application/json Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: Accept-Encoding: gzip, deflate Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: Connection: keep-alive Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: Content-Length: 0 Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: Host: 10.222.0.79 Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: Openstack-Api-Version: compute 2.90 Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: Openstack-System-Scope: None Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: User-Agent: python-novaclient Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: X-Auth-Token: gAAAAABjCZxDy2SeL6ObtLQ6QbHSt2l_GJxMegKMir51XrlKlWxF0i9VrmwT--qW-yLasOQG6WV3EkAX2adkzSbkWRnza7pEBC4ppg1O8WKwzAlB1IvWyUAnLYxRYdk3-FdhnJtoxkOQHlLYPLP3a_384hDvqsJOnE6A3aqD0RqIxDEO3DqAraU Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: X-Domain-Id: None Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: X-Domain-Name: None Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: X-Identity-Status: Confirmed Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: X-Is-Admin-Project: True Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: X-Project-Domain-Id: default Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: X-Project-Domain-Name: Default Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: X-Project-Id: b3f91bd2de7a46528177960fc698df58 Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: X-Project-Name: admin Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: X-Role: admin,reader,member Aug 27 04:23:32.482134 n-d-854823-1 devstack@n-api.service[106385]: X-Roles: admin,reader,member Aug 27 04:23:32.483677 n-d-854823-1 devstack@n-api.service[106385]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b3f91bd2de7a46528177960fc698df58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:23:32.483677 n-d-854823-1 devstack@n-api.service[106385]: X-Tenant: admin Aug 27 04:23:32.483677 n-d-854823-1 devstack@n-api.service[106385]: X-Tenant-Id: b3f91bd2de7a46528177960fc698df58 Aug 27 04:23:32.483677 n-d-854823-1 devstack@n-api.service[106385]: X-Tenant-Name: admin Aug 27 04:23:32.483677 n-d-854823-1 devstack@n-api.service[106385]: X-User: admin Aug 27 04:23:32.483677 n-d-854823-1 devstack@n-api.service[106385]: X-User-Domain-Id: default Aug 27 04:23:32.483677 n-d-854823-1 devstack@n-api.service[106385]: X-User-Domain-Name: Default Aug 27 04:23:32.483677 n-d-854823-1 devstack@n-api.service[106385]: X-User-Id: f829879e344f4b19840fd54e71b10768 Aug 27 04:23:32.483677 n-d-854823-1 devstack@n-api.service[106385]: X-User-Name: admin Aug 27 04:23:32.483677 n-d-854823-1 devstack@n-api.service[106385]: method: > Aug 27 04:23:32.483677 n-d-854823-1 devstack@n-api.service[106385]: exception: Flavor 84 could not be found. Aug 27 04:23:32.483677 n-d-854823-1 devstack@n-api.service[106385]: action_args: {'id': '84'} Aug 27 04:23:32.483677 n-d-854823-1 devstack@n-api.service[106385]: {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:23:32.483677 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:23:32.484653 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:32.486610 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-953851b9-ad6c-4b0f-98c3-cd794e9d60ab admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:23:32.487903 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-953851b9-ad6c-4b0f-98c3-cd794e9d60ab admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394267 Aug 27 04:23:32.487903 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 23/44] 10.222.0.79 () {60 vars in 1190 bytes} [Sat Aug 27 04:23:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:32.494240 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-9244f2cb-d1d6-4d7c-967f-84c167e99a9c admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:32.509148 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-9244f2cb-d1d6-4d7c-967f-84c167e99a9c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018794 Aug 27 04:23:32.509689 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 22/45] 10.222.0.79 () {60 vars in 1210 bytes} [Sat Aug 27 04:23:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:23:32.519185 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-07c1a75c-bd42-4276-a0bd-845680c87394 admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:32.535174 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-07c1a75c-bd42-4276-a0bd-845680c87394 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019470 Aug 27 04:23:32.535716 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 24/46] 10.222.0.79 () {60 vars in 1210 bytes} [Sat Aug 27 04:23:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:23:32.545219 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-2b04bb7e-df01-4a0c-8c5a-d61df7fc83a3 admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:32.551171 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.wsgi [None req-2b04bb7e-df01-4a0c-8c5a-d61df7fc83a3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-2b04bb7e-df01-4a0c-8c5a-d61df7fc83a3 admin admin] Request method failure captured: Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: Accept: application/json Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: Accept-Encoding: gzip, deflate Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: Connection: keep-alive Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: Content-Length: 0 Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: Host: 10.222.0.79 Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: Openstack-Api-Version: compute 2.90 Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: Openstack-System-Scope: None Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: User-Agent: python-novaclient Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: X-Auth-Token: gAAAAABjCZxDy2SeL6ObtLQ6QbHSt2l_GJxMegKMir51XrlKlWxF0i9VrmwT--qW-yLasOQG6WV3EkAX2adkzSbkWRnza7pEBC4ppg1O8WKwzAlB1IvWyUAnLYxRYdk3-FdhnJtoxkOQHlLYPLP3a_384hDvqsJOnE6A3aqD0RqIxDEO3DqAraU Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: X-Domain-Id: None Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: X-Domain-Name: None Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: X-Identity-Status: Confirmed Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: X-Is-Admin-Project: True Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: X-Project-Domain-Id: default Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: X-Project-Domain-Name: Default Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: X-Project-Id: b3f91bd2de7a46528177960fc698df58 Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: X-Project-Name: admin Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: X-Role: admin,reader,member Aug 27 04:23:32.552707 n-d-854823-1 devstack@n-api.service[106384]: X-Roles: admin,reader,member Aug 27 04:23:32.554331 n-d-854823-1 devstack@n-api.service[106384]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b3f91bd2de7a46528177960fc698df58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:23:32.554331 n-d-854823-1 devstack@n-api.service[106384]: X-Tenant: admin Aug 27 04:23:32.554331 n-d-854823-1 devstack@n-api.service[106384]: X-Tenant-Id: b3f91bd2de7a46528177960fc698df58 Aug 27 04:23:32.554331 n-d-854823-1 devstack@n-api.service[106384]: X-Tenant-Name: admin Aug 27 04:23:32.554331 n-d-854823-1 devstack@n-api.service[106384]: X-User: admin Aug 27 04:23:32.554331 n-d-854823-1 devstack@n-api.service[106384]: X-User-Domain-Id: default Aug 27 04:23:32.554331 n-d-854823-1 devstack@n-api.service[106384]: X-User-Domain-Name: Default Aug 27 04:23:32.554331 n-d-854823-1 devstack@n-api.service[106384]: X-User-Id: f829879e344f4b19840fd54e71b10768 Aug 27 04:23:32.554331 n-d-854823-1 devstack@n-api.service[106384]: X-User-Name: admin Aug 27 04:23:32.554331 n-d-854823-1 devstack@n-api.service[106384]: method: > Aug 27 04:23:32.554331 n-d-854823-1 devstack@n-api.service[106384]: exception: Flavor 84 could not be found. Aug 27 04:23:32.554331 n-d-854823-1 devstack@n-api.service[106384]: action_args: {'id': '84'} Aug 27 04:23:32.554331 n-d-854823-1 devstack@n-api.service[106384]: {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:23:32.554331 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:23:32.555332 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:32.556684 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-2b04bb7e-df01-4a0c-8c5a-d61df7fc83a3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:23:32.557948 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-2b04bb7e-df01-4a0c-8c5a-d61df7fc83a3 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012558 Aug 27 04:23:32.557948 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 23/47] 10.222.0.79 () {60 vars in 1190 bytes} [Sat Aug 27 04:23:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 27 04:23:33.538623 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-07c1a75c-bd42-4276-a0bd-845680c87394 admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:33.539637 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-07c1a75c-bd42-4276-a0bd-845680c87394 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 27 04:23:33.540039 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 25/48] 10.222.0.79 () {56 vars in 1074 bytes} [Sat Aug 27 04:23:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:34.065740 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-12ec1856-e7f0-4493-b713-ba5e2774f07b admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:34.071410 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.wsgi [None req-12ec1856-e7f0-4493-b713-ba5e2774f07b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-12ec1856-e7f0-4493-b713-ba5e2774f07b admin admin] Request method failure captured: Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: Accept: application/json Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: Accept-Encoding: gzip, deflate Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: Connection: keep-alive Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: Content-Length: 0 Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: Host: 10.222.0.79 Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: Openstack-Api-Version: compute 2.90 Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: Openstack-System-Scope: None Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: User-Agent: python-novaclient Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: X-Auth-Token: gAAAAABjCZxFQHYj0hAM4VmZz38QgOmZ5LrpRpqnDcL--h7UPUxEGcU4o0n3ENK4Snv3LD-RLTEMPIFcVJjzStW7N_C6h7UfD6L1os-ZRfafX55JhXojkdRW39fpnPhhqzoDOYunwhkv_JuQtyW70l9xG9ctRKk4gtYlqr6Ziz9bBY9nWL6p_dI Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: X-Domain-Id: None Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: X-Domain-Name: None Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: X-Identity-Status: Confirmed Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: X-Is-Admin-Project: True Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: X-Project-Domain-Id: default Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: X-Project-Domain-Name: Default Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: X-Project-Id: b3f91bd2de7a46528177960fc698df58 Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: X-Project-Name: admin Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: X-Role: admin,reader,member Aug 27 04:23:34.072999 n-d-854823-1 devstack@n-api.service[106384]: X-Roles: admin,reader,member Aug 27 04:23:34.074587 n-d-854823-1 devstack@n-api.service[106384]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b3f91bd2de7a46528177960fc698df58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:23:34.074587 n-d-854823-1 devstack@n-api.service[106384]: X-Tenant: admin Aug 27 04:23:34.074587 n-d-854823-1 devstack@n-api.service[106384]: X-Tenant-Id: b3f91bd2de7a46528177960fc698df58 Aug 27 04:23:34.074587 n-d-854823-1 devstack@n-api.service[106384]: X-Tenant-Name: admin Aug 27 04:23:34.074587 n-d-854823-1 devstack@n-api.service[106384]: X-User: admin Aug 27 04:23:34.074587 n-d-854823-1 devstack@n-api.service[106384]: X-User-Domain-Id: default Aug 27 04:23:34.074587 n-d-854823-1 devstack@n-api.service[106384]: X-User-Domain-Name: Default Aug 27 04:23:34.074587 n-d-854823-1 devstack@n-api.service[106384]: X-User-Id: f829879e344f4b19840fd54e71b10768 Aug 27 04:23:34.074587 n-d-854823-1 devstack@n-api.service[106384]: X-User-Name: admin Aug 27 04:23:34.074587 n-d-854823-1 devstack@n-api.service[106384]: method: > Aug 27 04:23:34.074587 n-d-854823-1 devstack@n-api.service[106384]: exception: Flavor 451 could not be found. Aug 27 04:23:34.074587 n-d-854823-1 devstack@n-api.service[106384]: action_args: {'id': '451'} Aug 27 04:23:34.074587 n-d-854823-1 devstack@n-api.service[106384]: {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:23:34.074587 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:23:34.075554 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: ERROR nova.api.openstack.wsgi Aug 27 04:23:34.076798 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-12ec1856-e7f0-4493-b713-ba5e2774f07b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:23:34.078122 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-12ec1856-e7f0-4493-b713-ba5e2774f07b admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.396842 Aug 27 04:23:34.078122 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 24/49] 10.222.0.79 () {60 vars in 1193 bytes} [Sat Aug 27 04:23:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:34.084193 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-39bf620b-e39f-40fb-ac51-49a6b6a224a8 admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:34.099808 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-39bf620b-e39f-40fb-ac51-49a6b6a224a8 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019223 Aug 27 04:23:34.100348 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 26/50] 10.222.0.79 () {60 vars in 1210 bytes} [Sat Aug 27 04:23:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:23:34.110721 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-8dc20a60-74b9-4836-bb0c-a0e60e8c59cc admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:34.125813 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-8dc20a60-74b9-4836-bb0c-a0e60e8c59cc admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019238 Aug 27 04:23:34.126369 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 25/51] 10.222.0.79 () {60 vars in 1210 bytes} [Sat Aug 27 04:23:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:23:34.135868 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-349da443-5d43-4326-8b79-abbf51bb6289 admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:34.142891 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.wsgi [None req-349da443-5d43-4326-8b79-abbf51bb6289 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-349da443-5d43-4326-8b79-abbf51bb6289 admin admin] Request method failure captured: Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: Accept: application/json Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: Accept-Encoding: gzip, deflate Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: Connection: keep-alive Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: Content-Length: 0 Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: Host: 10.222.0.79 Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: Openstack-Api-Version: compute 2.90 Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: Openstack-System-Scope: None Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: User-Agent: python-novaclient Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: X-Auth-Token: gAAAAABjCZxFQHYj0hAM4VmZz38QgOmZ5LrpRpqnDcL--h7UPUxEGcU4o0n3ENK4Snv3LD-RLTEMPIFcVJjzStW7N_C6h7UfD6L1os-ZRfafX55JhXojkdRW39fpnPhhqzoDOYunwhkv_JuQtyW70l9xG9ctRKk4gtYlqr6Ziz9bBY9nWL6p_dI Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: X-Domain-Id: None Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: X-Domain-Name: None Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: X-Identity-Status: Confirmed Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: X-Is-Admin-Project: True Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: X-Project-Domain-Id: default Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: X-Project-Domain-Name: Default Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: X-Project-Id: b3f91bd2de7a46528177960fc698df58 Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: X-Project-Name: admin Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: X-Role: admin,reader,member Aug 27 04:23:34.144397 n-d-854823-1 devstack@n-api.service[106385]: X-Roles: admin,reader,member Aug 27 04:23:34.146015 n-d-854823-1 devstack@n-api.service[106385]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b3f91bd2de7a46528177960fc698df58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3f91bd2de7a46528177960fc698df58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:23:34.146015 n-d-854823-1 devstack@n-api.service[106385]: X-Tenant: admin Aug 27 04:23:34.146015 n-d-854823-1 devstack@n-api.service[106385]: X-Tenant-Id: b3f91bd2de7a46528177960fc698df58 Aug 27 04:23:34.146015 n-d-854823-1 devstack@n-api.service[106385]: X-Tenant-Name: admin Aug 27 04:23:34.146015 n-d-854823-1 devstack@n-api.service[106385]: X-User: admin Aug 27 04:23:34.146015 n-d-854823-1 devstack@n-api.service[106385]: X-User-Domain-Id: default Aug 27 04:23:34.146015 n-d-854823-1 devstack@n-api.service[106385]: X-User-Domain-Name: Default Aug 27 04:23:34.146015 n-d-854823-1 devstack@n-api.service[106385]: X-User-Id: f829879e344f4b19840fd54e71b10768 Aug 27 04:23:34.146015 n-d-854823-1 devstack@n-api.service[106385]: X-User-Name: admin Aug 27 04:23:34.146015 n-d-854823-1 devstack@n-api.service[106385]: method: > Aug 27 04:23:34.146015 n-d-854823-1 devstack@n-api.service[106385]: exception: Flavor 451 could not be found. Aug 27 04:23:34.146015 n-d-854823-1 devstack@n-api.service[106385]: action_args: {'id': '451'} Aug 27 04:23:34.146015 n-d-854823-1 devstack@n-api.service[106385]: {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:23:34.146015 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:23:34.146948 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: ERROR nova.api.openstack.wsgi Aug 27 04:23:34.148012 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-349da443-5d43-4326-8b79-abbf51bb6289 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:23:34.149103 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-349da443-5d43-4326-8b79-abbf51bb6289 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013450 Aug 27 04:23:34.149103 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 27/52] 10.222.0.79 () {60 vars in 1193 bytes} [Sat Aug 27 04:23:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:23:35.106282 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-8dc20a60-74b9-4836-bb0c-a0e60e8c59cc admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:35.107286 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-8dc20a60-74b9-4836-bb0c-a0e60e8c59cc admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 27 04:23:35.107678 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 26/53] 10.222.0.79 () {56 vars in 1074 bytes} [Sat Aug 27 04:23:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:35.634649 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-30450ca6-dc26-484d-b578-56281ed9032a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:35.653190 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-30450ca6-dc26-484d-b578-56281ed9032a admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.408197 Aug 27 04:23:35.653691 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 28/54] 10.222.0.79 () {64 vars in 1235 bytes} [Sat Aug 27 04:23:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:23:36.643136 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-8dc20a60-74b9-4836-bb0c-a0e60e8c59cc admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:36.644134 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-8dc20a60-74b9-4836-bb0c-a0e60e8c59cc admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 27 04:23:36.644557 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 27/55] 10.222.0.79 () {56 vars in 1074 bytes} [Sat Aug 27 04:23:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:37.174602 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-286b020e-8383-4dc2-8e96-f3a299e4d4bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:37.193427 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-286b020e-8383-4dc2-8e96-f3a299e4d4bd admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.407214 Aug 27 04:23:37.193984 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 29/56] 10.222.0.79 () {64 vars in 1235 bytes} [Sat Aug 27 04:23:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:23:38.190524 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-8dc20a60-74b9-4836-bb0c-a0e60e8c59cc admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:38.191543 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-8dc20a60-74b9-4836-bb0c-a0e60e8c59cc admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 27 04:23:38.191945 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 28/57] 10.222.0.79 () {56 vars in 1074 bytes} [Sat Aug 27 04:23:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:38.716112 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-d0160a47-a8fd-4146-9f5e-d747c26f842c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:38.736237 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-d0160a47-a8fd-4146-9f5e-d747c26f842c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.407702 Aug 27 04:23:38.736769 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 30/58] 10.222.0.79 () {64 vars in 1235 bytes} [Sat Aug 27 04:23:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:23:39.697646 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-8dc20a60-74b9-4836-bb0c-a0e60e8c59cc admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:39.698727 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-8dc20a60-74b9-4836-bb0c-a0e60e8c59cc admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 27 04:23:39.699123 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 29/59] 10.222.0.79 () {56 vars in 1074 bytes} [Sat Aug 27 04:23:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:40.233559 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-71edf338-4408-4746-85f2-947bf4d855e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:40.252701 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-71edf338-4408-4746-85f2-947bf4d855e2 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.410967 Aug 27 04:23:40.253247 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 31/60] 10.222.0.79 () {64 vars in 1235 bytes} [Sat Aug 27 04:23:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:23:41.217564 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-8dc20a60-74b9-4836-bb0c-a0e60e8c59cc admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:41.218603 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-8dc20a60-74b9-4836-bb0c-a0e60e8c59cc admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 27 04:23:41.219004 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 30/61] 10.222.0.79 () {56 vars in 1074 bytes} [Sat Aug 27 04:23:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:41.738556 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-c805e002-6eaa-44ac-82fe-60b1434880de admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:41.759801 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-c805e002-6eaa-44ac-82fe-60b1434880de admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404567 Aug 27 04:23:41.760327 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 32/62] 10.222.0.79 () {60 vars in 1202 bytes} [Sat Aug 27 04:23:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:24:35.759271 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-8dc20a60-74b9-4836-bb0c-a0e60e8c59cc admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:35.760288 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-8dc20a60-74b9-4836-bb0c-a0e60e8c59cc admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 27 04:24:35.760728 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 31/63] 10.222.0.79 () {54 vars in 931 bytes} [Sat Aug 27 04:24:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:24:35.771054 n-d-854823-1 devstack@n-api.service[106385]: DEBUG dbcounter [-] [106385] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:24:36.148891 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-c243a168-9469-40e6-afe8-5fd5c6ed8d41 admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:36.170247 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-c243a168-9469-40e6-afe8-5fd5c6ed8d41 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403630 Aug 27 04:24:36.170790 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 33/64] 10.222.0.79 () {60 vars in 1292 bytes} [Sat Aug 27 04:24:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:24:36.191900 n-d-854823-1 devstack@n-api.service[106384]: DEBUG dbcounter [-] [106384] Writing DB stats nova_api:SELECT=14 {{(pid=106384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:24:36.195801 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-61b354a5-4e52-45df-9aa7-12f9072d39a5 admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:36.204230 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-61b354a5-4e52-45df-9aa7-12f9072d39a5 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013725 Aug 27 04:24:36.204805 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 32/65] 10.222.0.79 () {60 vars in 1283 bytes} [Sat Aug 27 04:24:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:36.217417 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-5c1f1031-5627-4845-bf3c-b051c47a91cb admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:36.225075 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-5c1f1031-5627-4845-bf3c-b051c47a91cb admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011621 Aug 27 04:24:36.226237 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 34/66] 10.222.0.79 () {60 vars in 1286 bytes} [Sat Aug 27 04:24:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:36.237914 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-94258a21-4cc6-42df-af12-60629a2c6149 admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:36.245549 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-94258a21-4cc6-42df-af12-60629a2c6149 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011316 Aug 27 04:24:36.246315 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 33/67] 10.222.0.79 () {60 vars in 1286 bytes} [Sat Aug 27 04:24:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:36.257973 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-e59d604e-8814-4811-8e93-64bfffb4dcf8 admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:36.265569 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-e59d604e-8814-4811-8e93-64bfffb4dcf8 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011144 Aug 27 04:24:36.266082 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 35/68] 10.222.0.79 () {60 vars in 1283 bytes} [Sat Aug 27 04:24:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:30:04.610897 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-94258a21-4cc6-42df-af12-60629a2c6149 admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:04.611909 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-94258a21-4cc6-42df-af12-60629a2c6149 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 27 04:30:04.612389 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 34/69] 10.222.0.79 () {56 vars in 1074 bytes} [Sat Aug 27 04:30:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:30:04.753959 n-d-854823-1 devstack@n-api.service[106385]: DEBUG dbcounter [-] [106385] Writing DB stats nova_api:SELECT=6 {{(pid=106385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:04.903731 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-de6e7756-041c-440c-b093-a8d31dd4b282 admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:04.907117 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-de6e7756-041c-440c-b093-a8d31dd4b282 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:04.907589 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-de6e7756-041c-440c-b093-a8d31dd4b282 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:04.908014 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-de6e7756-041c-440c-b093-a8d31dd4b282 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:04.908743 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-de6e7756-041c-440c-b093-a8d31dd4b282 admin admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:04.909186 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-de6e7756-041c-440c-b093-a8d31dd4b282 admin admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:04.909597 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-de6e7756-041c-440c-b093-a8d31dd4b282 admin admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:04.952246 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-de6e7756-041c-440c-b093-a8d31dd4b282 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.199733 Aug 27 04:30:04.952857 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 36/70] 10.222.0.79 () {60 vars in 1193 bytes} [Sat Aug 27 04:30:04 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:30:05.788400 n-d-854823-1 devstack@n-api.service[106384]: DEBUG nova.api.openstack.wsgi [None req-94258a21-4cc6-42df-af12-60629a2c6149 admin admin] Calling method '>' {{(pid=106384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:05.789686 n-d-854823-1 devstack@n-api.service[106384]: INFO nova.api.openstack.requestlog [None req-94258a21-4cc6-42df-af12-60629a2c6149 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Aug 27 04:30:05.790250 n-d-854823-1 devstack@n-api.service[106384]: [pid: 106384|app: 0|req: 35/71] 10.222.0.79 () {56 vars in 1074 bytes} [Sat Aug 27 04:30:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:30:05.981360 n-d-854823-1 devstack@n-api.service[106385]: DEBUG nova.api.openstack.wsgi [None req-dc441a24-19f3-49b7-ba1d-ce0f7a4afc21 admin admin] Calling method '>' {{(pid=106385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:05.984798 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-dc441a24-19f3-49b7-ba1d-ce0f7a4afc21 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:05.985273 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-dc441a24-19f3-49b7-ba1d-ce0f7a4afc21 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:05.985698 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-dc441a24-19f3-49b7-ba1d-ce0f7a4afc21 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:05.986912 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-dc441a24-19f3-49b7-ba1d-ce0f7a4afc21 admin admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:05.987365 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-dc441a24-19f3-49b7-ba1d-ce0f7a4afc21 admin admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:05.987786 n-d-854823-1 devstack@n-api.service[106385]: DEBUG oslo_concurrency.lockutils [None req-dc441a24-19f3-49b7-ba1d-ce0f7a4afc21 admin admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:06.011146 n-d-854823-1 devstack@n-api.service[106385]: INFO nova.api.openstack.requestlog [None req-dc441a24-19f3-49b7-ba1d-ce0f7a4afc21 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.081962 Aug 27 04:30:06.011871 n-d-854823-1 devstack@n-api.service[106385]: [pid: 106385|app: 0|req: 37/72] 10.222.0.79 () {60 vars in 1193 bytes} [Sat Aug 27 04:30:05 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:30:51.306984 n-d-854823-1 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 27 04:30:51.307512 n-d-854823-1 devstack@n-api.service[106383]: Sat Aug 27 04:30:51 2022 - graceful shutdown triggered... Aug 27 04:30:51.307986 n-d-854823-1 devstack@n-api.service[106384]: Gracefully killing worker 1 (pid: 106384)... Aug 27 04:30:51.308392 n-d-854823-1 devstack@n-api.service[106385]: Gracefully killing worker 2 (pid: 106385)... Aug 27 04:30:52.308428 n-d-854823-1 devstack@n-api.service[106383]: worker 1 buried after 1 seconds Aug 27 04:30:52.308428 n-d-854823-1 devstack@n-api.service[106383]: worker 2 buried after 1 seconds Aug 27 04:30:52.308428 n-d-854823-1 devstack@n-api.service[106383]: goodbye to uWSGI. Aug 27 04:30:52.310595 n-d-854823-1 systemd[1]: devstack@n-api.service: Succeeded. Aug 27 04:30:52.311183 n-d-854823-1 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 27 04:30:52.313981 n-d-854823-1 systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 04:30:52.330152 n-d-854823-1 devstack@n-api.service[128856]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 04:30:52.347178 n-d-854823-1 devstack@n-api.service[128856]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 04:30:52 2022] *** Aug 27 04:30:52.347178 n-d-854823-1 devstack@n-api.service[128856]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 04:30:52.347178 n-d-854823-1 devstack@n-api.service[128856]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 04:30:52.347178 n-d-854823-1 devstack@n-api.service[128856]: nodename: n-d-854823-1 Aug 27 04:30:52.347178 n-d-854823-1 devstack@n-api.service[128856]: machine: x86_64 Aug 27 04:30:52.347178 n-d-854823-1 devstack@n-api.service[128856]: clock source: unix Aug 27 04:30:52.347178 n-d-854823-1 devstack@n-api.service[128856]: pcre jit disabled Aug 27 04:30:52.347178 n-d-854823-1 devstack@n-api.service[128856]: detected number of CPU cores: 4 Aug 27 04:30:52.347178 n-d-854823-1 devstack@n-api.service[128856]: current working directory: / Aug 27 04:30:52.347178 n-d-854823-1 devstack@n-api.service[128856]: detected binary path: /usr/bin/uwsgi-core Aug 27 04:30:52.347950 n-d-854823-1 devstack@n-api.service[128856]: your processes number limit is 47680 Aug 27 04:30:52.347950 n-d-854823-1 devstack@n-api.service[128856]: your memory page size is 4096 bytes Aug 27 04:30:52.347950 n-d-854823-1 devstack@n-api.service[128856]: detected max file descriptor number: 2048 Aug 27 04:30:52.347950 n-d-854823-1 devstack@n-api.service[128856]: lock engine: pthread robust mutexes Aug 27 04:30:52.347950 n-d-854823-1 devstack@n-api.service[128856]: thunder lock: enabled Aug 27 04:30:52.347950 n-d-854823-1 devstack@n-api.service[128856]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 04:30:52.347950 n-d-854823-1 devstack@n-api.service[128856]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 04:30:52.393122 n-d-854823-1 devstack@n-api.service[128856]: Python main interpreter initialized at 0x5626125499c0 Aug 27 04:30:52.393122 n-d-854823-1 devstack@n-api.service[128856]: python threads support enabled Aug 27 04:30:52.393122 n-d-854823-1 devstack@n-api.service[128856]: your server socket listen backlog is limited to 100 connections Aug 27 04:30:52.393122 n-d-854823-1 devstack@n-api.service[128856]: your mercy for graceful operations on workers is 90 seconds Aug 27 04:30:52.393620 n-d-854823-1 devstack@n-api.service[128856]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 04:30:52.393620 n-d-854823-1 devstack@n-api.service[128856]: *** Operational MODE: preforking *** Aug 27 04:30:52.393829 n-d-854823-1 devstack@n-api.service[128856]: *** uWSGI is running in multiple interpreter mode *** Aug 27 04:30:52.393829 n-d-854823-1 devstack@n-api.service[128856]: spawned uWSGI master process (pid: 128856) Aug 27 04:30:52.394038 n-d-854823-1 systemd[1]: Started Devstack devstack@n-api.service. Aug 27 04:30:52.396607 n-d-854823-1 devstack@n-api.service[128856]: spawned uWSGI worker 1 (pid: 128869, cores: 1) Aug 27 04:30:52.396607 n-d-854823-1 devstack@n-api.service[128856]: spawned uWSGI worker 2 (pid: 128870, cores: 1) Aug 27 04:30:52.396607 n-d-854823-1 devstack@n-api.service[128856]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 04:30:53.060133 n-d-854823-1 devstack@n-api.service[128869]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 04:30:53.064330 n-d-854823-1 devstack@n-api.service[128870]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 04:30:54.241858 n-d-854823-1 devstack@n-api.service[128869]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:30:54.241858 n-d-854823-1 devstack@n-api.service[128869]: from cryptography.utils import int_from_bytes Aug 27 04:30:54.242942 n-d-854823-1 devstack@n-api.service[128869]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:30:54.242942 n-d-854823-1 devstack@n-api.service[128869]: from cryptography.utils import int_from_bytes Aug 27 04:30:54.299226 n-d-854823-1 devstack@n-api.service[128870]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:30:54.299226 n-d-854823-1 devstack@n-api.service[128870]: from cryptography.utils import int_from_bytes Aug 27 04:30:54.299831 n-d-854823-1 devstack@n-api.service[128870]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:30:54.299831 n-d-854823-1 devstack@n-api.service[128870]: from cryptography.utils import int_from_bytes Aug 27 04:30:56.684518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:30:56.685160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:30:56.685427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:30:56.685719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:30:56.685978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:30:56.686372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.686701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.687030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.687351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.687683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.688000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.688328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.688674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.689007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.689270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.689589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.689925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854823-1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.690245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.690557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.690871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.691190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.691500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.691823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.692130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.692664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.693104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.693420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.696494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.696494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.696494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.696494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.696494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.696494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.696494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.696494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.697273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854823-1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.697273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.697273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.697273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.698095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.698095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.698311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.698603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.698932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.699246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.699644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.699973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.700296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.700644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.700952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.701262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.701578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.701900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.702203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.702510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.702762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.703072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.703396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.703721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.704045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.704300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.704568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.704895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.705218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.705527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.705837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.706145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.706453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.706761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.707072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.707379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.707687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.708005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.708322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.708677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.708990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.709310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.709711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.709962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.710285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.710643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.710944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.711254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.711575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.711901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.712208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.712515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.712847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.713168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.713507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.713817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.714069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.714372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.714681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.715006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.715884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.716197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.716508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.716835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.717146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.717462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.717772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.718082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.718392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.718704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.719015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.719322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.719630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.719948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.720270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.720600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.720912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.721222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.721529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.721855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.722166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.722476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.722800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.723110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.723419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.723739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.724049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.724360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.724705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.725011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.725320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.725640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.725953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.726257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.726394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:30:56.726866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.726968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:30:56.727064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.727158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.727255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:30:56.727445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.727560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:30:56.727749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.727896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:30:56.728055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.728190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.728361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.728466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.728705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.728831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.729031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.729198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.729340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.729495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.729650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.729751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.729958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.730053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.730279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.730373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.730623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.730730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.730955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.731623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.731791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.731942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.732123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854823-1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.732229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.732452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.732665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.732791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.732945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.733106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.733210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.733429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.733534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.733738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.733830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.734065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.734170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.734374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.734476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.734722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.734889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.735035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.735207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.735356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.735518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.735679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.735833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.736011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.736169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.736383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.736539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.736684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.736823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.736980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.737120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.737295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.737434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.737623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.737760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.737956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.738065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.738280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.738464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854823-1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.738594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.738787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.738938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.739103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.739286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.739421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.739601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.739838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.739949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.740157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.740251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.740473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.740591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.740829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.740932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.741159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.741275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.741468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.741914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.742266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.742516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.742516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.742686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.742770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.742853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.743042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.743137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.743357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.743459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.743669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.743761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.743990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.744083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.744300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.744400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.744633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.744751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.744889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.744981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.745203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.745296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.745529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.745649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.745854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.745947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.746180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.746282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.746472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.746608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.746720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.746885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.747042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.747158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.747367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.747472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.747681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.747773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.748025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.748133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.748437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.748625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.748920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.749025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.749112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.749197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.749296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.749382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.749581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.749682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.749904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.750006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.750226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.750326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.750531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.750641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.750861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.750969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.751178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.751280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.751735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.751834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.752049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.752157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.752363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.752464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.752700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.752820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.753019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.753135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.753331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.753432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.753639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.753777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.753946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.754024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.754266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.754364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.754575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.754673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.754886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.754995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.755194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.755291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.755503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.755603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.755824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.755931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.756137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.756260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.756389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.756484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.756728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.756838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.757041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.757143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.757407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.757546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.757681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.757786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.757995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.758089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.758307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.758407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.758613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.758719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.758925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.759024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.759237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.759330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.759548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.759649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.759859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.759959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.760171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.760263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.760481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.760592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.760812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.760903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.761123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.761225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.761428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.761529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.761740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.761842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.762047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.762140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.762389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.762488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.762699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.762806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.763007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.763120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.763313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.763407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.763635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.763741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.763946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.764061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.764252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.764355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.764612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.764712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.764895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.764990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.765203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.765449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.765557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.765761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.765855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.766109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.766201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.766434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.766541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.766740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.766869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.767051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.767347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.767443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.767528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.767674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.767822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.767984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.768138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.768291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.768452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.768622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.768791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.768932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.769108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.769241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.769433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.769550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.769750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.769844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.770074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.770182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.770388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.770481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.770713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.770817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.771027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.771145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.771352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.771451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.771658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.771751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.771974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.772077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:56.772316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.772407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.772674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.772771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.772998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.773124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.773326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.773426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.773644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.773745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.773995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.774097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.774279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.774381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.774595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.774685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.774907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.775000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.775222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.775323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.775542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.775651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.775856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.775955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.776169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.776270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.776481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.776629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.776830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.776923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.777143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.777239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.777469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.777574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.778370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.778489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.778635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.778736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.778952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.779056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.779327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.779430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.779659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.779766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.779985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.780088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.780303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.780397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.780645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.780754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.780962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.781066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.781278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.781373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.781587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.781680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.781897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.781999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.782210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.782310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.782527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.782620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.782841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.782949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.783155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.783248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.783462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.783570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.783780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.783872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.784091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.784187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.784398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.784505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.784769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.784883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.785039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.785141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.785353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.785459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.785672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.785775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.785987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.786083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.786301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.786398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.786609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.786701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.786918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.787015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.787246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.787349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.787559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.787659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.787867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.787959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.788180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.788273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.788495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.788678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.788829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.788923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.789149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.789271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.789454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.789555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.789763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.789857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.790073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.790179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.790383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.790475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.790687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.790785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.791000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.791092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.791311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.791411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.791626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.791731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.791943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.792043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.792258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.792350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.792591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.792706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.792907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.793000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.793218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.793312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.794071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.794215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.794391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.794494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.794708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.794809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.795019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.795133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.795347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.795480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.795663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.795797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.795977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.796117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.796307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.796423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.796644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.796959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.797069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.797279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.797378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.797594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.797685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.797909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.798014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.798227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.798319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.798542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.798630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.798871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.798964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.799191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.799291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.799507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.799607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.799847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.799938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.800158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.800248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.800468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.800603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.800803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.800905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.801117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.801212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.801426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.801527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.801735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.801841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.802044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.802150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.802358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.802451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.802663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.802762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.802970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.803124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.803283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.803421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.803594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.803693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.803903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.804023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.804611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.804739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.804830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.804914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.805007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.805109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.805197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.805290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.805453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.805606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.805763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.805864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.806070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.806173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.806375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.806470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.806723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.806923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.807016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.807246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.807346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.807600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.807702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.807945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.808038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.808273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.808366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.808624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.808733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.808961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.809064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.809293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.809386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.809599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.809693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.809907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.810006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.810220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.810312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.810532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.810633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.810837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.810930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.811149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.811241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.811462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.811564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.811774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.811867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.812086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.812186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.812391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.812485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.812726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.812833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.813033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.813175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.813348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.813449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.813658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.813751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.813964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.814066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.814270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.814400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.814582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.814678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.814892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.814996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.815200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.815293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.815513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.815613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.815821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.815923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.816139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.816232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.816446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.816568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.816776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.816884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.817083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.817177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.817396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.817498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.817706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.817816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.818022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.818116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.818341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.818450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.818655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.818750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.818963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.819056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.819270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.819364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.819587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.819755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.819886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.820048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.820170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.820276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.820485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.820606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.820837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.820941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.821157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.821264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.821463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.821565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.821775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.821925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.822082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.822184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.822387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.822490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.822692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.822792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.823004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.823108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.823310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.823415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.823614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.823715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.823920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.824015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.824223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.824322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.824557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.825173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.825379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.825473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.825688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.825781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.826004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.826104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.826318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.826419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.826627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.826721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.826954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.827052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.827268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.827369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.827578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.827669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.827890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.827996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.828219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.828322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.828550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.828666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.828864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.828968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.829173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.829275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.829482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.829583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.829788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.829890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.830109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.830203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.830425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.830517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.830744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.830845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.831051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.831143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.831361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.831458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.831680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.831781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.831994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.832086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.832305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.832450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.832652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.832747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.832971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.833070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.833286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.833433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.833591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.833692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.833901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.833995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.834214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.834306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.834523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.834661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.834838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.834938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.835149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.835291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.835460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.835555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.835778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.835892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.836082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.836173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.836392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.836492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.836727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.836830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.837037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.837294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.837388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.837633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.837734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.837942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.838034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.838262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.838362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.838577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.838668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.838881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.838983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.839191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.839294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.839499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.839601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.839812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.839921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.840118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.840280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.841037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.841209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.841350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.841481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.841659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.841802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.841978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.842123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.842287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.842419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.842598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.842737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.842906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.843059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.843220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.843381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.843531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.843691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.843821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.844116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.844217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.844421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.844514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.844761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.844866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.845076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.845178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.845384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.845486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.845693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.845796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.846008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.846110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.846337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.846430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.846645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.846746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.846953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.847047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.847260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.847354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.847584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.847678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.847895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.847998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.848220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.848314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.848572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.848670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.848923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.849026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.849234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.849338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.849547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.849678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.849877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.849994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.850187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.850333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.850499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.850622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.850808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.850948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.851123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.851275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.851436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.851583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.851749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.851901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.852064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.852215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.852379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.852556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.852721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.852886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.853036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.853199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.853341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.853518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.853654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.853827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.853962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.854151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.854279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.854479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.854580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.854798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.854938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.855123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.855216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.855480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.855581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.855792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.855917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.856126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.856227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.856442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.856563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.856777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.856880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.857101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.857193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.857409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.857509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.857717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.857819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.858024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.858127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.858338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.858430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.858649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.858750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.858955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.859049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.859268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.859361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.859584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.859689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.859891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.859982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.860197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.860299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.860505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.860660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.860840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.860932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.861159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.861276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.861459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.861558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.861776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.861876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.862100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.862201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.862410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.862515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.862718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.862816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.863024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.863135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.863332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.863431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.863640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.863731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.863948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.864042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.864254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.864398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.864582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.864691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.864895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.864994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.865203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.865305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.865511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.865658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.865838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.865940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.866152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.866246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.866463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.866593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.866800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.866915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.867056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.867325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.867421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.867518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.867702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.867805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.868063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.868166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.868373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.868482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.868720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.868829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.869038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.869139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.869347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.869455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.869655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.869750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.869969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.870071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.870276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.870377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.870581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.870748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.870888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.870988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.871278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.871395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.871534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.871636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.871851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.871958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.872164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.872258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.872474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.872588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.872808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.872919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.873115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.873210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.873445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.873527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.873759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.873860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.874067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.874159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.874379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.874529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.874694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.874793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.875006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.875108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.875321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.875414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.875634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.875735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.875948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.876047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.876261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.876360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.876862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.876965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.877177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.877280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.877487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.877588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.877795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.877886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.878108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.878210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.878422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.878525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.878730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.878961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.879061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.879299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.879393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.879622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.879725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.879941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.880042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.880247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.880346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.880586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.880684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.880899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.880993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.881214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.881331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.881533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.881640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.881845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.881941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.882165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.882285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.882494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.882629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.882818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.882957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.883145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.883250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.883464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.883565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.883775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.883912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.884093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.884188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.884410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.884504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.884753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.884859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.885115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.885214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.885433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.885514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.885741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.885879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.886054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.886155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.886371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.886462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.886676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.886782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.886986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.887581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.887809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.887936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.888138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.888291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.888449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.888563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.888813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.888915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.889182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.889283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.889502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.889604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.889822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.889948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.890150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.890260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.890491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.890594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.890813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.890915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.891131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.891227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.891449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.891610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.891772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.891892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.892082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.892290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.892385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.892635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.892791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.892973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.893079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.893305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.893405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.893632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.893727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.893953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.894053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.894263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.894362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.894591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.894685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.894898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.895002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.895207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.895301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.895520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.895621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.895831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.895977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.896139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.896255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.896464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.896604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.896801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.896930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.897109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.897263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.897430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.897575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.897747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.898032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.898361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.898500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.898672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.898777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.898984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.899086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.899314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.899407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.899625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.899734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.899941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.900042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.900259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.900359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.900595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.900778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.900909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.901003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.901220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.901321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.901550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.901693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.901866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.901993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.902179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.902293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.902486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.902583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.903360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.903515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.903694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.903796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.904007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.904154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.904323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.904425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.904652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.904749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.904976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.905077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.905282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.905374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.905591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.905732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.905898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.905999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.906213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.906314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.906520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.906623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.906827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.906929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.907134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.907243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.907440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.907547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.907752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.907853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.908060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.908154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.908371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.908474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.908704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.908844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.909021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.909177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.909334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.909489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.909646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.909799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.909999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.910115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.910324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.910426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.910633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.910727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.910942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.911036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.911263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.911359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.911576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.911670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.911901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.912055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.912214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.912315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.912603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.912702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.912864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.912964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.935670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.936108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.936385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.936385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.936772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.936948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.936948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.937258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.937468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.937661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.937794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.937936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.938108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.938108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.938407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.938514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.938608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.938701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.938794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.938895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.939027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.939223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.939348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.939477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.939601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.939732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.941435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.941595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.942193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.942325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.942325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.942561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.942678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.942795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.942918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.943032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.943157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.943280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.943280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.943533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.943654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.943776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.943880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.943984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.944080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.944173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.944303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.944438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.944613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.944782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.945006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.945145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.945273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.945399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.945399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.945644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.945766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.945766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.946014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.946269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.946269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.946736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.946870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.946995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.947119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.947247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.947374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.947497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.947615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.947743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.947866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.947866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.948099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.948099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.948320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.948434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.948559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.948559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.948742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.948838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.948978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.949102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.949237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.949380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.949380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.949380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.950244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.950350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.950443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.950555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.950696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.950827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.950951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.951072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.951194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.951331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.951458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.951589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.951723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.951851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.951982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.952124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.952259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.952388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.952608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.952751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.952894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.953036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.953118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.953178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.953234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.953234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.953341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.953400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.953461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.953560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.953641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.953741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.953801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.953954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.954088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.954191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.954305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.954381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.954470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.954633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.954744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.954858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.954937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.954996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.955962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.956031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.956089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.956211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.956311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.956517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.956517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.956517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.956517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.956517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.956517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.956517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.956517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.957976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.958173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.958173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.958297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.958363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.958421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.958478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.958533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.958589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.958589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.958697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.958755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.958810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.958866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.958922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.959940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.960054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.960125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.960194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.960263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.960332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.960401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.960477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.960564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.960627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.960737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.960832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.960927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.960927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.961127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.961228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.961228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.961228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.961455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.961528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.961598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.961668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.961668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.961781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.961856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.961928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.961997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.962067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.962136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.962205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.962281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.962353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.962424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.962493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.962562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.962628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.962737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.962833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.962910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.962980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.963050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.963127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.963198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.963267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.963336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.963406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.963474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.963551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.963622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.963692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.963761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.963830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.963906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.963977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.964986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.965054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.965131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.965222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.965333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.966050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.966164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.966405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.966566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.966739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.966833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.967055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.967133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.967370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.967487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.967684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.967805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.967934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:30:56.968127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.968458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.968815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.969144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.969472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.969789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.970115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.970429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.970765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.971115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.971451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.971785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.972098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.972411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.972754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.973074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.973401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.973718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.974029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.974340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.974656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.974967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.975278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.975588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.975899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.976213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.976523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.976868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.977175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.977484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.977792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.978100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.978412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.978720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.979029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.979337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.979648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.979956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.980293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.980656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.981003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.981332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.981650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.981979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.982293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.982623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.982997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.983273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.983587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.983923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.984240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.984590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.984913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.985230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.985543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.985932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.986189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.986524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.986836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.987168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.987492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.987815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.988134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.988447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.988811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.989128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.989447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.989764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.990078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.990395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.990717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.991034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.991350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.991674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.991993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.992322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.992688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.992997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.993328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.993659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.994011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.994328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.994737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.995005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.995321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.995639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.995949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:56.996197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:30:57.033052 n-d-854823-1 devstack@n-api.service[128869]: INFO dbcounter [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] Registered counter for database nova_api Aug 27 04:30:57.053448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_db.sqlalchemy.engines [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:57.060076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writer thread running {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:30:57.060470 n-d-854823-1 devstack@n-api.service[128870]: INFO dbcounter [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] Registered counter for database nova_api Aug 27 04:30:57.080775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_db.sqlalchemy.engines [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:57.087401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writer thread running {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:30:57.120379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.context [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e7bc291f-2aa3-4d66-a942-e096e031ad4c(cell1) {{(pid=128869) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 04:30:57.124557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:57.125035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:57.126866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:57.127598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:57.128048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:57.130069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:57.132318 n-d-854823-1 devstack@n-api.service[128869]: INFO dbcounter [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] Registered counter for database nova_cell0 Aug 27 04:30:57.138247 n-d-854823-1 devstack@n-api.service[128869]: INFO dbcounter [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] Registered counter for database nova_cell1 Aug 27 04:30:57.144831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.context [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e7bc291f-2aa3-4d66-a942-e096e031ad4c(cell1) {{(pid=128870) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 04:30:57.146265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_db.sqlalchemy.engines [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:57.147969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_db.sqlalchemy.engines [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:57.149058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:57.149531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:57.151111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:57.151860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:57.152466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:57.154467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writer thread running {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:30:57.155087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:57.157093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writer thread running {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:30:57.157196 n-d-854823-1 devstack@n-api.service[128870]: INFO dbcounter [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] Registered counter for database nova_cell0 Aug 27 04:30:57.162690 n-d-854823-1 devstack@n-api.service[128870]: INFO dbcounter [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] Registered counter for database nova_cell1 Aug 27 04:30:57.170475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_db.sqlalchemy.engines [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:57.172696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_db.sqlalchemy.engines [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:57.177509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writer thread running {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:30:57.180836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writer thread running {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:30:57.308210 n-d-854823-1 devstack@n-api.service[128869]: INFO dbcounter [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] Registered counter for database nova_cell0 Aug 27 04:30:57.316074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_db.sqlalchemy.engines [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:57.321115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writer thread running {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:30:57.333471 n-d-854823-1 devstack@n-api.service[128870]: INFO dbcounter [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] Registered counter for database nova_cell0 Aug 27 04:30:57.341545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_db.sqlalchemy.engines [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:57.346830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writer thread running {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:30:57.642986 n-d-854823-1 devstack@n-api.service[128869]: WARNING keystonemiddleware.auth_token [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:30:57.650435 n-d-854823-1 devstack@n-api.service[128869]: WARNING keystonemiddleware.auth_token [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:30:57.669617 n-d-854823-1 devstack@n-api.service[128870]: WARNING keystonemiddleware.auth_token [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:30:57.676943 n-d-854823-1 devstack@n-api.service[128870]: WARNING keystonemiddleware.auth_token [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:30:57.999178 n-d-854823-1 devstack@n-api.service[128869]: WARNING keystonemiddleware.auth_token [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:30:58.005462 n-d-854823-1 devstack@n-api.service[128869]: WARNING keystonemiddleware.auth_token [None req-504b6486-8ff9-45de-a31f-9c9ccc8efbde None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:30:58.010771 n-d-854823-1 devstack@n-api.service[128869]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5626125499c0 pid: 128869 (default app) Aug 27 04:30:58.023362 n-d-854823-1 devstack@n-api.service[128870]: WARNING keystonemiddleware.auth_token [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:30:58.029458 n-d-854823-1 devstack@n-api.service[128870]: WARNING keystonemiddleware.auth_token [None req-e04d49f9-0f65-461f-80ba-bf8112476975 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:30:58.034715 n-d-854823-1 devstack@n-api.service[128870]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5626125499c0 pid: 128870 (default app) Aug 27 04:31:38.848648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:38.849763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:38.850779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:38.851786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:39.323628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:39.324746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:39.325849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:39.326597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:40.402129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f32cd10-759d-4666-890e-5deaedfa4ac2 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:40.409028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f32cd10-759d-4666-890e-5deaedfa4ac2 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:40.409536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f32cd10-759d-4666-890e-5deaedfa4ac2 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:40.409974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f32cd10-759d-4666-890e-5deaedfa4ac2 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:40.410701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f32cd10-759d-4666-890e-5deaedfa4ac2 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:40.411253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f32cd10-759d-4666-890e-5deaedfa4ac2 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:40.411675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f32cd10-759d-4666-890e-5deaedfa4ac2 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:40.468090 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f32cd10-759d-4666-890e-5deaedfa4ac2 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.624661 Aug 27 04:31:40.469378 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1/1] 10.222.0.79 () {58 vars in 1176 bytes} [Sat Aug 27 04:31:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:40.487246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c06f9692-8ff2-4ebf-ad5f-113663ebb95b tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1718270361"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:40.510602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-c06f9692-8ff2-4ebf-ad5f-113663ebb95b tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Generated uuid a98868aa-7941-4071-9c8c-07dab871850a for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:31:40.591487 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c06f9692-8ff2-4ebf-ad5f-113663ebb95b tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.110257 Aug 27 04:31:40.592479 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2/2] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:31:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:31:40.604432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b62b4428-f4d5-44d7-81ac-4f6a5b8b04ac tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854823-1"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:40.639868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b62b4428-f4d5-44d7-81ac-4f6a5b8b04ac tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:40.640386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b62b4428-f4d5-44d7-81ac-4f6a5b8b04ac tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:40.640869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b62b4428-f4d5-44d7-81ac-4f6a5b8b04ac tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:40.649201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d1b6d7ea-1b34-4e39-aea5-a583842a3554 tempest-AZAdminNegativeTestJSON-647699729 tempest-AZAdminNegativeTestJSON-647699729-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:40.651239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d1b6d7ea-1b34-4e39-aea5-a583842a3554 tempest-AZAdminNegativeTestJSON-647699729 tempest-AZAdminNegativeTestJSON-647699729-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '716e7f8ecd1b43719ce4122ce3907c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e9685016184fcf97de94ccd00ed4cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d1b6d7ea-1b34-4e39-aea5-a583842a3554 tempest-AZAdminNegativeTestJSON-647699729 tempest-AZAdminNegativeTestJSON-647699729-project] Request method failure captured: Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4oGFSYidDaKiAbp-ak6Jn2iphk0c9y8jOZgsKOp4ZGkS05dO-XJVS0zOHBpY6juElTcR2U5T2T8PnV3MWMDJv4fObgqDQu9DW1RXX8PwzJ8mhqcWUl0nJk40dAF_nqnxnfbD-3UtFZQHFPAUBIGvGFyHW2hj3UyqpL7nqtzjPmYk0 Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 21e9685016184fcf97de94ccd00ed4cf Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AZAdminNegativeTestJSON-647699729 Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:31:40.655311 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:31:40.656404 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/21e9685016184fcf97de94ccd00ed4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_21e9685016184fcf97de94ccd00ed4cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/21e9685016184fcf97de94ccd00ed4cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/21e9685016184fcf97de94ccd00ed4cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:40.656404 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AZAdminNegativeTestJSON-647699729 Aug 27 04:31:40.656404 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 21e9685016184fcf97de94ccd00ed4cf Aug 27 04:31:40.656404 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-647699729 Aug 27 04:31:40.656404 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AZAdminNegativeTestJSON-647699729-project Aug 27 04:31:40.656404 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:31:40.656404 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:31:40.656404 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 716e7f8ecd1b43719ce4122ce3907c0a Aug 27 04:31:40.656404 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AZAdminNegativeTestJSON-647699729-project Aug 27 04:31:40.656404 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:31:40.656404 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 04:31:40.656404 n-d-854823-1 devstack@n-api.service[128870]: action_args: {} Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:31:40.657076 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 04:31:40.658013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:40.660217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d1b6d7ea-1b34-4e39-aea5-a583842a3554 tempest-AZAdminNegativeTestJSON-647699729 tempest-AZAdminNegativeTestJSON-647699729-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:40.661476 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d1b6d7ea-1b34-4e39-aea5-a583842a3554 tempest-AZAdminNegativeTestJSON-647699729 tempest-AZAdminNegativeTestJSON-647699729-project] 10.222.0.79 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.343709 Aug 27 04:31:40.662539 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1/3] 10.222.0.79 () {58 vars in 1185 bytes} [Sat Aug 27 04:31:39 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1346 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:31:41.371587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0faeb42a-8781-4e76-b981-4f2c6dd81b28 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Calling method '.version_select at 0x7f1f23450b80>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:41.391706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0faeb42a-8781-4e76-b981-4f2c6dd81b28 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e7bc291f-2aa3-4d66-a942-e096e031ad4c(cell1) {{(pid=128870) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 27 04:31:41.394000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0faeb42a-8781-4e76-b981-4f2c6dd81b28 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:41.399394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0faeb42a-8781-4e76-b981-4f2c6dd81b28 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:41.399854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0faeb42a-8781-4e76-b981-4f2c6dd81b28 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:41.460306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0faeb42a-8781-4e76-b981-4f2c6dd81b28 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:41.461059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0faeb42a-8781-4e76-b981-4f2c6dd81b28 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:41.463331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0faeb42a-8781-4e76-b981-4f2c6dd81b28 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:41.494546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0faeb42a-8781-4e76-b981-4f2c6dd81b28 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:41.495049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0faeb42a-8781-4e76-b981-4f2c6dd81b28 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:41.496001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0faeb42a-8781-4e76-b981-4f2c6dd81b28 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:41.519750 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0faeb42a-8781-4e76-b981-4f2c6dd81b28 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.854177 Aug 27 04:31:41.521642 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2/4] 10.222.0.79 () {60 vars in 1208 bytes} [Sat Aug 27 04:31:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:42.012287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e6f6220b-f31c-4e63-ab84-6d2ff9685e92 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '.version_select at 0x7f1f23450820>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:42.015190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f6220b-f31c-4e63-ab84-6d2ff9685e92 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:42.015681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f6220b-f31c-4e63-ab84-6d2ff9685e92 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:42.016170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f6220b-f31c-4e63-ab84-6d2ff9685e92 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:42.047015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f6220b-f31c-4e63-ab84-6d2ff9685e92 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:42.047503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f6220b-f31c-4e63-ab84-6d2ff9685e92 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:42.047938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f6220b-f31c-4e63-ab84-6d2ff9685e92 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:42.064952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f6220b-f31c-4e63-ab84-6d2ff9685e92 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:42.065644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f6220b-f31c-4e63-ab84-6d2ff9685e92 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:42.066814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f6220b-f31c-4e63-ab84-6d2ff9685e92 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:42.074739 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e6f6220b-f31c-4e63-ab84-6d2ff9685e92 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.551680 Aug 27 04:31:42.075511 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3/5] 10.222.0.79 () {58 vars in 1167 bytes} [Sat Aug 27 04:31:41 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:42.499101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fe974b19-76be-4f47-bd46-4a9e28a4a53e tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:42.502056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe974b19-76be-4f47-bd46-4a9e28a4a53e tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:42.502675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe974b19-76be-4f47-bd46-4a9e28a4a53e tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:42.503347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe974b19-76be-4f47-bd46-4a9e28a4a53e tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:42.504226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe974b19-76be-4f47-bd46-4a9e28a4a53e tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:42.506282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe974b19-76be-4f47-bd46-4a9e28a4a53e tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:42.509882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe974b19-76be-4f47-bd46-4a9e28a4a53e tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:42.516996 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b62b4428-f4d5-44d7-81ac-4f6a5b8b04ac tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 1.916912 Aug 27 04:31:42.518027 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3/6] 10.222.0.79 () {60 vars in 1191 bytes} [Sat Aug 27 04:31:40 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:31:42.530608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22eb51c0-5329-4621-8b97-7d18ed5fa2f8 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854823-1"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:42.567193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22eb51c0-5329-4621-8b97-7d18ed5fa2f8 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:42.567959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22eb51c0-5329-4621-8b97-7d18ed5fa2f8 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:42.569145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22eb51c0-5329-4621-8b97-7d18ed5fa2f8 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:42.599578 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fe974b19-76be-4f47-bd46-4a9e28a4a53e tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] 10.222.0.79 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.522884 Aug 27 04:31:42.601534 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1164 bytes} [Sat Aug 27 04:31:42 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:31:42.620837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a9060621-0be8-4d9a-8b7d-a2c7ae7f35df tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:42.629320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9060621-0be8-4d9a-8b7d-a2c7ae7f35df tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:42.630066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9060621-0be8-4d9a-8b7d-a2c7ae7f35df tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:42.630529 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-22eb51c0-5329-4621-8b97-7d18ed5fa2f8 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-854823-1. Aug 27 04:31:42.630991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9060621-0be8-4d9a-8b7d-a2c7ae7f35df tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:42.632637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9060621-0be8-4d9a-8b7d-a2c7ae7f35df tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:42.633316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9060621-0be8-4d9a-8b7d-a2c7ae7f35df tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:42.633932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9060621-0be8-4d9a-8b7d-a2c7ae7f35df tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22eb51c0-5329-4621-8b97-7d18ed5fa2f8 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Request method failure captured: Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 39 Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4q7Rm3nEUwY9JBNZ9vVa1JEU0YEY7ysPZgnXFpI1WInbwDP4Uc7xuhY_nz25-EHnzx6r8fa2S859s0Esy6KAX5xMdFVxGKUEdTy9pKfQ1TL5Asn7HylwXw8vO_PmolMxltWSwht03Hcb5rJ5Qqs1E9ZOYbJwiOBW-L7-SYd-z4G-c Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:31:42.674767 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:31:42.675996 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6c1d49516b641089bdc1067be17e386"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:42.675996 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:42.675996 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:31:42.675996 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:42.675996 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:31:42.675996 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:31:42.675996 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:31:42.675996 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: fd7891c50c0148f290c6f3e70573aa47 Aug 27 04:31:42.675996 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:31:42.675996 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:31:42.675996 n-d-854823-1 devstack@n-api.service[128869]: {"add_host": {"host": "n-h2-854823-1"}} Aug 27 04:31:42.675996 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:31:42.675996 n-d-854823-1 devstack@n-api.service[128869]: exception: Aggregate 1 already has host n-h2-854823-1. Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-854823-1'}}} Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result.read() Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:31:42.676659 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-854823-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 04:31:42.677594 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 04:31:42.678683 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:31:42.679627 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result.read() Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-854823-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 4, 31, 42, 613731), 'updated_at': None, 'host': 'n-h2-854823-1', 'aggregate_id': 1}] Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:42.680464 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-854823-1. Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:42.686332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-854823-1. Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:31:42.688925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:31:42.694064 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-854823-1. Aug 27 04:31:42.694064 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:42.694064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22eb51c0-5329-4621-8b97-7d18ed5fa2f8 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-854823-1. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:42.694064 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22eb51c0-5329-4621-8b97-7d18ed5fa2f8 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.165893 Aug 27 04:31:42.694064 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4/8] 10.222.0.79 () {60 vars in 1191 bytes} [Sat Aug 27 04:31:42 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 27 04:31:42.719751 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a9060621-0be8-4d9a-8b7d-a2c7ae7f35df tempest-AZAdminV2TestJSON-1484727468 tempest-AZAdminV2TestJSON-1484727468-project-admin] 10.222.0.79 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.106427 Aug 27 04:31:42.723989 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 5/9] 10.222.0.79 () {58 vars in 1185 bytes} [Sat Aug 27 04:31:42 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:42.726366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a971eec-0df9-4af4-8490-4124e0b089f1 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854823-1"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:42.748831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a971eec-0df9-4af4-8490-4124e0b089f1 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:42.750776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a971eec-0df9-4af4-8490-4124e0b089f1 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:42.752781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a971eec-0df9-4af4-8490-4124e0b089f1 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:42.941521 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a971eec-0df9-4af4-8490-4124e0b089f1 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.243339 Aug 27 04:31:42.943574 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 5/10] 10.222.0.79 () {60 vars in 1191 bytes} [Sat Aug 27 04:31:42 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:42.959874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5b6a0ecf-0219-482d-b9e0-6c9c1ebb1805 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:43.089916 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5b6a0ecf-0219-482d-b9e0-6c9c1ebb1805 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.139219 Aug 27 04:31:43.093615 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 6/11] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:31:42 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:31:43.108373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1796238-2f5d-4111-8108-20d6f2597a2b tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-328051453"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:43.113373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-e1796238-2f5d-4111-8108-20d6f2597a2b tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Generated uuid 77bc05f8-e5a5-406e-bc59-18fc5bfe1c7d for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:31:43.147050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e20c473e-ed98-4874-8527-55b73c88c8c8 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1053868514", "name": "tempest-test_aggregate-813982884"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:43.149188 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1796238-2f5d-4111-8108-20d6f2597a2b tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.047572 Aug 27 04:31:43.150169 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 6/12] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:31:43 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:43.214377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.aggregate [None req-e20c473e-ed98-4874-8527-55b73c88c8c8 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Generated uuid ac06b525-fde6-4513-bf65-9ec316b3464d for aggregate {{(pid=128870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:31:43.287927 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e20c473e-ed98-4874-8527-55b73c88c8c8 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.144412 Aug 27 04:31:43.298585 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 7/13] 10.222.0.79 () {60 vars in 1165 bytes} [Sat Aug 27 04:31:43 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:31:43.726297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f540e358-319f-4f02-a464-03b22256c5eb tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854823-1"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:43.736790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f540e358-319f-4f02-a464-03b22256c5eb tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '3a374f235c9d443c90a0e68370992b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d130c9f81f4e73a1caca2a8eac4f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f540e358-319f-4f02-a464-03b22256c5eb tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Request method failure captured: Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 39 Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4oB4kCZ-mKz8fBbJgrC57xM6qhYiEtEMpbYVty-QrtjPWMkZWIG1vsTkT5Ii-p2OH1Khv7ubAGgrshQGOf0tWOyLT5iOPntcG7yhJHQaS9aFkhsBZCFMpaR8zBxnxrTOT-OcsIXwP5P9wWJstmMt1WW0ixKHc9N__S9-wk58DY1Gg Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 46d130c9f81f4e73a1caca2a8eac4f5d Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:31:43.747402 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:31:43.748634 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:43.748634 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:43.748634 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 46d130c9f81f4e73a1caca2a8eac4f5d Aug 27 04:31:43.748634 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:43.748634 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminNegativeTestJSON-762562147-project Aug 27 04:31:43.748634 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:31:43.748634 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:31:43.748634 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 3a374f235c9d443c90a0e68370992b92 Aug 27 04:31:43.748634 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-762562147-project Aug 27 04:31:43.748634 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:31:43.748634 n-d-854823-1 devstack@n-api.service[128869]: {"add_host": {"host": "n-h2-854823-1"}} Aug 27 04:31:43.748634 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:31:43.748634 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-854823-1'}}} Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:31:43.749309 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 04:31:43.750336 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:43.751590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f540e358-319f-4f02-a464-03b22256c5eb tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:43.751590 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f540e358-319f-4f02-a464-03b22256c5eb tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] 10.222.0.79 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.590250 Aug 27 04:31:43.757512 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 7/14] 10.222.0.79 () {60 vars in 1191 bytes} [Sat Aug 27 04:31:43 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 596 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:31:43.757674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ce4bc4b4-842a-4f43-853d-a34f370d50c3 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1337172491", "id": 1915242256, "os-flavor-access:is_public": "False"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:43.761053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7673bb8a-e791-49a7-b148-0f8d9c640678 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:43.781513 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7673bb8a-e791-49a7-b148-0f8d9c640678 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.024808 Aug 27 04:31:43.781513 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 8/15] 10.222.0.79 () {58 vars in 1143 bytes} [Sat Aug 27 04:31:43 2022] GET /compute/v2.1/os-aggregates => generated 515 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:43.800406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-810c3412-8b7a-44a3-920f-0c402033a77c tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:43.829738 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ce4bc4b4-842a-4f43-853d-a34f370d50c3 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.529110 Aug 27 04:31:43.831817 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 8/16] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:43 2022] POST /compute/v2.1/flavors => generated 439 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:43.837431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a51d21fc-53e8-41e1-a2f7-f5f62b8c69da tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854823-1"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:43.850875 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-810c3412-8b7a-44a3-920f-0c402033a77c tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.068387 Aug 27 04:31:43.851856 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 9/17] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:31:43 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:31:43.852412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a51d21fc-53e8-41e1-a2f7-f5f62b8c69da tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:43.853337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a51d21fc-53e8-41e1-a2f7-f5f62b8c69da tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:43.856212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a51d21fc-53e8-41e1-a2f7-f5f62b8c69da tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:43.862988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be0c3583-65dc-4ff4-95de-f296a9889727 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "20626036b6ea4d618c0486d3367396c4"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:44.480184 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be0c3583-65dc-4ff4-95de-f296a9889727 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1915242256/action" status: 200 len: 97 microversion: 2.1 time: 0.626505 Aug 27 04:31:44.485305 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 10/18] 10.222.0.79 () {60 vars in 1200 bytes} [Sat Aug 27 04:31:43 2022] POST /compute/v2.1/flavors/1915242256/action => generated 97 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:31:44.490258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-081ed912-4ef3-4547-bfdc-b86198d49fd0 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-801496234"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:44.494872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-081ed912-4ef3-4547-bfdc-b86198d49fd0 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Generated uuid 15b5aec2-1bbd-430c-8692-cb08cfce8f6c for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:31:44.545135 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-081ed912-4ef3-4547-bfdc-b86198d49fd0 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.050715 Aug 27 04:31:44.545849 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 11/19] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:31:44 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:44.551634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ddfe9b5-e817-414e-86cc-a56611a53cb2 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "20626036b6ea4d618c0486d3367396c4"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:45.027433 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4ddfe9b5-e817-414e-86cc-a56611a53cb2 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] HTTP exception thrown: Flavor access already exists for flavor 15 and project 20626036b6ea4d618c0486d3367396c4 combination. Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ddfe9b5-e817-414e-86cc-a56611a53cb2 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Request method failure captured: Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/flavors/1915242256/action HTTP/1.1 Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 67 Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4t7bMprbEv8HCaIxL2pF2MzUKGqnLmQIVAnk7VEKp5Lrwl4QgAYUpEgFP6ZkJHnu8c7tnpYvUN4dY-g4eIHvqqwG6aLwKimeo36W0hWAXVHaAWm0Q3LitStHb6jJHtHipJO8_RTGWvOEm5t7v-yahYp0DFsZMAt0k5skzgnegOryI Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cbe9b27660fc4dba85fb24aa11399452 Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1765818365 Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:31:45.035810 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:31:45.037427 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cbe9b27660fc4dba85fb24aa11399452"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cbe9b27660fc4dba85fb24aa11399452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cbe9b27660fc4dba85fb24aa11399452"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cbe9b27660fc4dba85fb24aa11399452"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:45.037427 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1765818365 Aug 27 04:31:45.037427 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cbe9b27660fc4dba85fb24aa11399452 Aug 27 04:31:45.037427 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1765818365 Aug 27 04:31:45.037427 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin Aug 27 04:31:45.037427 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:31:45.037427 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:31:45.037427 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 9a7e2e8074a64635816d3ac3b586b347 Aug 27 04:31:45.037427 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin Aug 27 04:31:45.037427 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:31:45.037427 n-d-854823-1 devstack@n-api.service[128869]: {"addTenantAccess": {"tenant": "20626036b6ea4d618c0486d3367396c4"}} Aug 27 04:31:45.037427 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: exception: Flavor access already exists for flavor 15 and project 20626036b6ea4d618c0486d3367396c4 combination. Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '1915242256', 'body': {'addTenantAccess': {'tenant': '20626036b6ea4d618c0486d3367396c4'}}} Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result.read() Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:31:45.038299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '15-20626036b6ea4d618c0486d3367396c4' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 04:31:45.039591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 04:31:45.041301 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:31:45.043972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result.read() Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '15-20626036b6ea4d618c0486d3367396c4' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 4, 31, 45, 17246), 'updated_at': None, 'flavor_id': 15, 'project_id': '20626036b6ea4d618c0486d3367396c4'}] Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:45.046526 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 15 and project 20626036b6ea4d618c0486d3367396c4 combination. Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:45.048679 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 15 and project 20626036b6ea4d618c0486d3367396c4 combination. Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:31:45.052181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:31:45.054696 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 15 and project 20626036b6ea4d618c0486d3367396c4 combination. Aug 27 04:31:45.054696 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.056871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ddfe9b5-e817-414e-86cc-a56611a53cb2 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Returning 409 to user: Flavor access already exists for flavor 15 and project 20626036b6ea4d618c0486d3367396c4 combination. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:45.070846 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ddfe9b5-e817-414e-86cc-a56611a53cb2 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1915242256/action" status: 409 len: 152 microversion: 2.1 time: 0.510698 Aug 27 04:31:45.076679 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 12/20] 10.222.0.79 () {60 vars in 1200 bytes} [Sat Aug 27 04:31:44 2022] POST /compute/v2.1/flavors/1915242256/action => generated 152 bytes in 530 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:31:45.083796 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a51d21fc-53e8-41e1-a2f7-f5f62b8c69da tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.1 time: 1.250475 Aug 27 04:31:45.087523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3bff01b6-51e3-48a6-8081-e3cc93c66efc tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1683731098"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:45.097035 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 9/21] 10.222.0.79 () {60 vars in 1191 bytes} [Sat Aug 27 04:31:43 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:45.114123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-63e34e5c-d9a7-4d81-92b7-e887e1e3bb48 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "20626036b6ea4d618c0486d3367396c4"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:45.119053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3bff01b6-51e3-48a6-8081-e3cc93c66efc tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e7bc291f-2aa3-4d66-a942-e096e031ad4c(cell1) {{(pid=128869) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 27 04:31:45.119972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bff01b6-51e3-48a6-8081-e3cc93c66efc tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:45.121428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bff01b6-51e3-48a6-8081-e3cc93c66efc tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:45.122429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bff01b6-51e3-48a6-8081-e3cc93c66efc tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:45.133394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bff01b6-51e3-48a6-8081-e3cc93c66efc tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:45.133968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bff01b6-51e3-48a6-8081-e3cc93c66efc tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:45.134406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bff01b6-51e3-48a6-8081-e3cc93c66efc tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:45.146165 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3bff01b6-51e3-48a6-8081-e3cc93c66efc tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1683731098 could not be found. Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3bff01b6-51e3-48a6-8081-e3cc93c66efc tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Request method failure captured: Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 58 Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4q7Rm3nEUwY9JBNZ9vVa1JEU0YEY7ysPZgnXFpI1WInbwDP4Uc7xuhY_nz25-EHnzx6r8fa2S859s0Esy6KAX5xMdFVxGKUEdTy9pKfQ1TL5Asn7HylwXw8vO_PmolMxltWSwht03Hcb5rJ5Qqs1E9ZOYbJwiOBW-L7-SYd-z4G-c Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:31:45.150610 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:31:45.152382 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6c1d49516b641089bdc1067be17e386"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:45.152382 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:45.152382 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:31:45.152382 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:45.152382 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:31:45.152382 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:31:45.152382 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:31:45.152382 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: fd7891c50c0148f290c6f3e70573aa47 Aug 27 04:31:45.152382 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:31:45.152382 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:31:45.152382 n-d-854823-1 devstack@n-api.service[128869]: {"add_host": {"host": "tempest-nonexist_host-1683731098"}} Aug 27 04:31:45.152382 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: exception: Compute host tempest-nonexist_host-1683731098 could not be found. Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1683731098'}}} Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1683731098' is not mapped to any cell Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.153019 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 27 04:31:45.154042 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1683731098 could not be found. Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1683731098 could not be found. Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:45.154993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.155993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.155993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:45.155993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:45.155993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:31:45.155993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:31:45.155993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1683731098 could not be found. Aug 27 04:31:45.155993 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.155993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3bff01b6-51e3-48a6-8081-e3cc93c66efc tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1683731098 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:45.155993 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3bff01b6-51e3-48a6-8081-e3cc93c66efc tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.074573 Aug 27 04:31:45.159724 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 13/22] 10.222.0.79 () {60 vars in 1191 bytes} [Sat Aug 27 04:31:45 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:31:45.169337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e35e8dcb-a9e9-4d6b-bc32-998c6c7294b2 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:45.220141 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e35e8dcb-a9e9-4d6b-bc32-998c6c7294b2 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.059404 Aug 27 04:31:45.226211 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 14/23] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:31:45 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:31:45.233093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbc8f913-e7ac-427f-81a0-cbdf9eb6deb3 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbc8f913-e7ac-427f-81a0-cbdf9eb6deb3 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Request method failure captured: Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 283 Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4q7Rm3nEUwY9JBNZ9vVa1JEU0YEY7ysPZgnXFpI1WInbwDP4Uc7xuhY_nz25-EHnzx6r8fa2S859s0Esy6KAX5xMdFVxGKUEdTy9pKfQ1TL5Asn7HylwXw8vO_PmolMxltWSwht03Hcb5rJ5Qqs1E9ZOYbJwiOBW-L7-SYd-z4G-c Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:31:45.238106 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:31:45.239487 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6c1d49516b641089bdc1067be17e386"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:45.239487 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:45.239487 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:31:45.239487 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:45.239487 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:31:45.239487 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:31:45.239487 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:31:45.239487 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: fd7891c50c0148f290c6f3e70573aa47 Aug 27 04:31:45.239487 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:31:45.239487 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:31:45.240008 n-d-854823-1 devstack@n-api.service[128869]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 04:31:45.240008 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:31:45.240008 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:31:45.240008 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 04:31:45.240008 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:45.240008 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.240008 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:31:45.240008 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:31:45.240008 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:31:45.240008 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:45.240660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:45.241665 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:45.242752 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:31:45.242752 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:31:45.242752 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:31:45.242752 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.244106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbc8f913-e7ac-427f-81a0-cbdf9eb6deb3 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:45.245964 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbc8f913-e7ac-427f-81a0-cbdf9eb6deb3 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.017732 Aug 27 04:31:45.246723 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 15/24] 10.222.0.79 () {60 vars in 1165 bytes} [Sat Aug 27 04:31:45 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:31:45.260290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52b6b2a2-c340-4e01-8140-101b42528bf7 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52b6b2a2-c340-4e01-8140-101b42528bf7 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Request method failure captured: Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 27 Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4q7Rm3nEUwY9JBNZ9vVa1JEU0YEY7ysPZgnXFpI1WInbwDP4Uc7xuhY_nz25-EHnzx6r8fa2S859s0Esy6KAX5xMdFVxGKUEdTy9pKfQ1TL5Asn7HylwXw8vO_PmolMxltWSwht03Hcb5rJ5Qqs1E9ZOYbJwiOBW-L7-SYd-z4G-c Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:31:45.265527 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:31:45.266630 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6c1d49516b641089bdc1067be17e386"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:45.266630 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:45.266630 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:31:45.266630 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:45.266630 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:31:45.266630 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:31:45.266630 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:31:45.266630 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: fd7891c50c0148f290c6f3e70573aa47 Aug 27 04:31:45.266630 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:31:45.266630 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:31:45.266630 n-d-854823-1 devstack@n-api.service[128869]: {"aggregate": {"name": ""}} Aug 27 04:31:45.266630 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:31:45.266630 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi '' Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:45.267304 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:31:45.268566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:45.270948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52b6b2a2-c340-4e01-8140-101b42528bf7 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:45.270948 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52b6b2a2-c340-4e01-8140-101b42528bf7 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.014475 Aug 27 04:31:45.271867 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 16/25] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:31:45 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:31:45.708179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1631347684", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "availability_zone": "tempest-test_az-1053868514"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:45.750192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:45.751287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:45.752392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:45.753278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:45.754065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:45.754603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:46.036001 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-63e34e5c-d9a7-4d81-92b7-e887e1e3bb48 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1915242256/action" status: 200 len: 21 microversion: 2.1 time: 0.937286 Aug 27 04:31:46.037047 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 10/26] 10.222.0.79 () {60 vars in 1200 bytes} [Sat Aug 27 04:31:45 2022] POST /compute/v2.1/flavors/1915242256/action => generated 21 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:31:46.050326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c202c387-5bed-4768-95a2-edc1a7853710 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-652087286"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:46.059243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c202c387-5bed-4768-95a2-edc1a7853710 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '3a374f235c9d443c90a0e68370992b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d130c9f81f4e73a1caca2a8eac4f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c202c387-5bed-4768-95a2-edc1a7853710 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Request method failure captured: Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 59 Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4oB4kCZ-mKz8fBbJgrC57xM6qhYiEtEMpbYVty-QrtjPWMkZWIG1vsTkT5Ii-p2OH1Khv7ubAGgrshQGOf0tWOyLT5iOPntcG7yhJHQaS9aFkhsBZCFMpaR8zBxnxrTOT-OcsIXwP5P9wWJstmMt1WW0ixKHc9N__S9-wk58DY1Gg Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 46d130c9f81f4e73a1caca2a8eac4f5d Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:31:46.071759 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:31:46.073048 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:46.073048 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:46.073048 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 46d130c9f81f4e73a1caca2a8eac4f5d Aug 27 04:31:46.073048 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:46.073048 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AggregatesAdminNegativeTestJSON-762562147-project Aug 27 04:31:46.073048 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:31:46.073048 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:31:46.073048 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3a374f235c9d443c90a0e68370992b92 Aug 27 04:31:46.073048 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-762562147-project Aug 27 04:31:46.073048 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:31:46.073048 n-d-854823-1 devstack@n-api.service[128870]: {"aggregate": {"name": "tempest-test_aggregate-652087286"}} Aug 27 04:31:46.073048 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:31:46.073048 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-652087286'}}} Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:31:46.074346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:31:46.075251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 04:31:46.076255 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:46.076255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c202c387-5bed-4768-95a2-edc1a7853710 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:46.076255 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c202c387-5bed-4768-95a2-edc1a7853710 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.035082 Aug 27 04:31:46.076255 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 11/27] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:31:46 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:31:46.590551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-45b7ab3d-ac89-4583-9153-0b149a12bff6 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-156989237", "id": 309568575, "os-flavor-access:is_public": "True"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:46.653815 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-45b7ab3d-ac89-4583-9153-0b149a12bff6 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.578108 Aug 27 04:31:46.655224 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 12/28] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:46 2022] POST /compute/v2.1/flavors => generated 426 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:46.661957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-403095a1-49ab-406f-b456-be3a9321c397 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:46.733292 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-403095a1-49ab-406f-b456-be3a9321c397 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1915242256" status: 202 len: 0 microversion: 2.1 time: 0.076791 Aug 27 04:31:46.735790 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 13/29] 10.222.0.79 () {58 vars in 1161 bytes} [Sat Aug 27 04:31:46 2022] DELETE /compute/v2.1/flavors/1915242256 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:46.743163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-797a10d6-2dbc-4a57-8088-e8dd1dc590de tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-227616496"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:46.746792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.aggregate [None req-797a10d6-2dbc-4a57-8088-e8dd1dc590de tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Generated uuid 1b6bf312-b42f-4189-839d-f20580e4682e for aggregate {{(pid=128870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:31:46.781856 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-797a10d6-2dbc-4a57-8088-e8dd1dc590de tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.044815 Aug 27 04:31:46.791087 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 14/30] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:31:46 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:46.798131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5cc55f9-0460-40a9-9c8a-3eda353920a7 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:46.821758 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f5cc55f9-0460-40a9-9c8a-3eda353920a7 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/309568575" status: 202 len: 0 microversion: 2.1 time: 0.028032 Aug 27 04:31:46.822597 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 15/31] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 04:31:46 2022] DELETE /compute/v2.1/flavors/309568575 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:46.832343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc1ac030-9065-4467-abf8-d4f0cb83d94b tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:46.885617 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bc1ac030-9065-4467-abf8-d4f0cb83d94b tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061053 Aug 27 04:31:46.887030 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 16/32] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:46.890688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:31:46.893852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e0beabf6-e09b-407b-9970-6ca1c8dc8d96 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-227616496"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:46.898308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.aggregate [None req-e0beabf6-e09b-407b-9970-6ca1c8dc8d96 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Generated uuid 37f779a6-6d4a-4f9e-853a-b7c163d682aa for aggregate {{(pid=128870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:31:46.922105 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-e0beabf6-e09b-407b-9970-6ca1c8dc8d96 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-227616496 already exists. Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e0beabf6-e09b-407b-9970-6ca1c8dc8d96 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Request method failure captured: Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 59 Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4q7Rm3nEUwY9JBNZ9vVa1JEU0YEY7ysPZgnXFpI1WInbwDP4Uc7xuhY_nz25-EHnzx6r8fa2S859s0Esy6KAX5xMdFVxGKUEdTy9pKfQ1TL5Asn7HylwXw8vO_PmolMxltWSwht03Hcb5rJ5Qqs1E9ZOYbJwiOBW-L7-SYd-z4G-c Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:31:46.926496 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:31:46.927805 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6c1d49516b641089bdc1067be17e386"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:46.927805 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:46.927805 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:31:46.927805 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:46.927805 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:31:46.927805 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:31:46.927805 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:31:46.927805 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: fd7891c50c0148f290c6f3e70573aa47 Aug 27 04:31:46.927805 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:31:46.927805 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:31:46.927805 n-d-854823-1 devstack@n-api.service[128870]: {"aggregate": {"name": "tempest-test_aggregate-227616496"}} Aug 27 04:31:46.927805 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:31:46.927805 n-d-854823-1 devstack@n-api.service[128870]: exception: Aggregate tempest-test_aggregate-227616496 already exists. Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-227616496'}}} Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 27 04:31:46.928557 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-227616496 already exists. Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:46.929512 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 27 04:31:46.930782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 27 04:31:46.930782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-227616496 already exists. Aug 27 04:31:46.930782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:46.930782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:46.930782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:46.930782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:46.930782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:46.930782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:46.930782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:31:46.930782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:31:46.930782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-227616496 already exists. Aug 27 04:31:46.930782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:46.930782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e0beabf6-e09b-407b-9970-6ca1c8dc8d96 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-227616496 already exists. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:46.930782 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e0beabf6-e09b-407b-9970-6ca1c8dc8d96 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.039090 Aug 27 04:31:46.934142 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 17/33] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:31:46 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:31:46.938868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-850e2c90-8868-491d-ac38-bb5c27516021 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:46.967002 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-850e2c90-8868-491d-ac38-bb5c27516021 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031689 Aug 27 04:31:46.968210 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 18/34] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:46.973114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9f5e2e53-509f-4296-b228-f2072548d6c4 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-641028548", "id": 411636631, "os-flavor-access:is_public": "True"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:47.002763 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9f5e2e53-509f-4296-b228-f2072548d6c4 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.033031 Aug 27 04:31:47.005347 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 19/35] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:46 2022] POST /compute/v2.1/flavors => generated 434 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:47.011280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-404d16e4-124f-4a63-b2a3-617467e7f03e tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.064999 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-404d16e4-124f-4a63-b2a3-617467e7f03e tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.057398 Aug 27 04:31:47.070043 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 20/36] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:31:47 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:31:47.096218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ca139657-c18c-4b27-9d2d-6e40ddcf343b tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-935914891", "id": 1762327569, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:47.126036 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ca139657-c18c-4b27-9d2d-6e40ddcf343b tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.053651 Aug 27 04:31:47.127935 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 21/37] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:47 2022] POST /compute/v2.1/flavors => generated 416 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:47.135092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0f8b5036-908f-40f3-85ce-3bba01e43894 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.144300 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-0f8b5036-908f-40f3-85ce-3bba01e43894 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0f8b5036-908f-40f3-85ce-3bba01e43894 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Request method failure captured: Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/flavors/411636631/os-flavor-access HTTP/1.1 Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4t7bMprbEv8HCaIxL2pF2MzUKGqnLmQIVAnk7VEKp5Lrwl4QgAYUpEgFP6ZkJHnu8c7tnpYvUN4dY-g4eIHvqqwG6aLwKimeo36W0hWAXVHaAWm0Q3LitStHb6jJHtHipJO8_RTGWvOEm5t7v-yahYp0DFsZMAt0k5skzgnegOryI Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cbe9b27660fc4dba85fb24aa11399452 Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1765818365 Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:31:47.146830 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:31:47.148224 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cbe9b27660fc4dba85fb24aa11399452"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cbe9b27660fc4dba85fb24aa11399452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cbe9b27660fc4dba85fb24aa11399452"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cbe9b27660fc4dba85fb24aa11399452"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:47.148224 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1765818365 Aug 27 04:31:47.148224 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cbe9b27660fc4dba85fb24aa11399452 Aug 27 04:31:47.148224 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1765818365 Aug 27 04:31:47.148224 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin Aug 27 04:31:47.148224 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:31:47.148224 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:31:47.148224 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 9a7e2e8074a64635816d3ac3b586b347 Aug 27 04:31:47.148224 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin Aug 27 04:31:47.148224 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:31:47.148224 n-d-854823-1 devstack@n-api.service[128870]: exception: Access list not available for public flavors. Aug 27 04:31:47.148224 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'flavor_id': '411636631'} Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 27 04:31:47.149052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.150107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0f8b5036-908f-40f3-85ce-3bba01e43894 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:47.150107 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0f8b5036-908f-40f3-85ce-3bba01e43894 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/411636631/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.020563 Aug 27 04:31:47.151100 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 22/38] 10.222.0.79 () {58 vars in 1206 bytes} [Sat Aug 27 04:31:47 2022] GET /compute/v2.1/flavors/411636631/os-flavor-access => generated 91 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:31:47.156663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4b771614-2bb0-472d-b686-8233db2a6cce tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-696473337"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:47.162354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.aggregate [None req-4b771614-2bb0-472d-b686-8233db2a6cce tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Generated uuid f008cdac-3cb1-4d3e-8b48-5bd151c2064d for aggregate {{(pid=128870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:31:47.171425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=11,nova_api:INSERT=9 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:47.188250 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4b771614-2bb0-472d-b686-8233db2a6cce tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.035544 Aug 27 04:31:47.189362 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 23/39] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:31:47 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:47.197132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9edfebd0-0b83-4c70-9e54-3b10412aa05f tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.230874 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9edfebd0-0b83-4c70-9e54-3b10412aa05f tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.038998 Aug 27 04:31:47.231022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:31:47.231314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:31:47.231876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:31:47.232210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:31:47.232946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:31:47.233258 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 24/40] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:47 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:47.239466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-42d754c8-570a-41a2-a9ef-577bc42ded16 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.252666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:47.253505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:47.254598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:47.256384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:47.257731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:47.258593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:47.268958 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-42d754c8-570a-41a2-a9ef-577bc42ded16 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/411636631" status: 202 len: 0 microversion: 2.1 time: 0.034383 Aug 27 04:31:47.270257 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 25/41] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 04:31:47 2022] DELETE /compute/v2.1/flavors/411636631 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:47.276311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7772298a-66fe-449b-b9c3-bb4b9cd284a2 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.278651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7772298a-66fe-449b-b9c3-bb4b9cd284a2 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '3a374f235c9d443c90a0e68370992b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d130c9f81f4e73a1caca2a8eac4f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7772298a-66fe-449b-b9c3-bb4b9cd284a2 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Request method failure captured: Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4oB4kCZ-mKz8fBbJgrC57xM6qhYiEtEMpbYVty-QrtjPWMkZWIG1vsTkT5Ii-p2OH1Khv7ubAGgrshQGOf0tWOyLT5iOPntcG7yhJHQaS9aFkhsBZCFMpaR8zBxnxrTOT-OcsIXwP5P9wWJstmMt1WW0ixKHc9N__S9-wk58DY1Gg Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 46d130c9f81f4e73a1caca2a8eac4f5d Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:31:47.280695 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:31:47.281860 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:47.281860 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:47.281860 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 46d130c9f81f4e73a1caca2a8eac4f5d Aug 27 04:31:47.281860 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:47.281860 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AggregatesAdminNegativeTestJSON-762562147-project Aug 27 04:31:47.281860 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:31:47.281860 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:31:47.281860 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3a374f235c9d443c90a0e68370992b92 Aug 27 04:31:47.281860 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-762562147-project Aug 27 04:31:47.281860 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:31:47.281860 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 04:31:47.281860 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '6'} Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:31:47.282461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 04:31:47.283428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.285152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7772298a-66fe-449b-b9c3-bb4b9cd284a2 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:47.286254 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7772298a-66fe-449b-b9c3-bb4b9cd284a2 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.014759 Aug 27 04:31:47.287122 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 26/42] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:31:47 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:31:47.293904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2d3e978b-965b-41b2-8fa2-40f1ad60505f tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.306856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Getting quotas for project 5795c326d9474dbeaad1ade3d6359df8. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:31:47.315074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Getting quotas for user 0100800dbc6d40619bd7cd8f78d03d77 and project 5795c326d9474dbeaad1ade3d6359df8. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:31:47.320427 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2d3e978b-965b-41b2-8fa2-40f1ad60505f tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1762327569" status: 202 len: 0 microversion: 2.1 time: 0.031110 Aug 27 04:31:47.321832 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 27/43] 10.222.0.79 () {58 vars in 1161 bytes} [Sat Aug 27 04:31:47 2022] DELETE /compute/v2.1/flavors/1762327569 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:47.327268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-74bb3fbf-3bd1-4202-ace0-445b5c2021b7 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.339670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:31:47.342865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:31:47.351307 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-74bb3fbf-3bd1-4202-ace0-445b5c2021b7 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028231 Aug 27 04:31:47.352197 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 28/44] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:47.366864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c75bb25-8d6a-4371-bfa6-29084a1aa545 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.398966 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1c75bb25-8d6a-4371-bfa6-29084a1aa545 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.044988 Aug 27 04:31:47.399964 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 29/45] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:31:47 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:31:47.409772 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-715c0363-5686-4a2d-98c7-8a412f4072fe tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.136339 Aug 27 04:31:47.412578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-744798ed-2309-48ab-9bc3-d5b722ec9b2f tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.416563 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 17/46] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:31:47.423213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78b72bcd-2904-4087-aab3-19ccde206556 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-812661111", "id": 728539599, "os-flavor-access:is_public": "False"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:47.446646 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-744798ed-2309-48ab-9bc3-d5b722ec9b2f tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043941 Aug 27 04:31:47.447568 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 30/47] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:47.449065 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78b72bcd-2904-4087-aab3-19ccde206556 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.030239 Aug 27 04:31:47.450221 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 18/48] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:47 2022] POST /compute/v2.1/flavors => generated 435 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:47.456217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4304e4d4-292f-4cf0-8c27-6aa15daaa972 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.457599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4304e4d4-292f-4cf0-8c27-6aa15daaa972 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:47.464329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a61cc11e-9274-4b42-80cb-a731eee9ab86 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.483480 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-a61cc11e-9274-4b42-80cb-a731eee9ab86 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a61cc11e-9274-4b42-80cb-a731eee9ab86 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Request method failure captured: Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4q7Rm3nEUwY9JBNZ9vVa1JEU0YEY7ysPZgnXFpI1WInbwDP4Uc7xuhY_nz25-EHnzx6r8fa2S859s0Esy6KAX5xMdFVxGKUEdTy9pKfQ1TL5Asn7HylwXw8vO_PmolMxltWSwht03Hcb5rJ5Qqs1E9ZOYbJwiOBW-L7-SYd-z4G-c Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:31:47.485522 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:31:47.486598 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6c1d49516b641089bdc1067be17e386"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:47.486598 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:47.486598 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:31:47.486598 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:47.486598 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:31:47.486598 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:31:47.486598 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:31:47.486598 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: fd7891c50c0148f290c6f3e70573aa47 Aug 27 04:31:47.486598 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:31:47.486598 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:31:47.486598 n-d-854823-1 devstack@n-api.service[128870]: exception: Aggregate -1 could not be found. Aug 27 04:31:47.486598 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '-1'} Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 04:31:47.489397 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.490535 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.491587 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:47.491587 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:47.491587 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:31:47.491587 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:31:47.491587 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 27 04:31:47.491587 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.491587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a61cc11e-9274-4b42-80cb-a731eee9ab86 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:47.491587 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a61cc11e-9274-4b42-80cb-a731eee9ab86 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.037708 Aug 27 04:31:47.491587 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 31/49] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:31:47 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:31:47.605972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4304e4d4-292f-4cf0-8c27-6aa15daaa972 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:47.626870 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4304e4d4-292f-4cf0-8c27-6aa15daaa972 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1243 microversion: 2.1 time: 0.175014 Aug 27 04:31:47.628464 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 19/50] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:47 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1243 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:47.635817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c33a7437-cf3a-456b-962c-3869c363e9e5 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-645613251", "id": 1013241666, "os-flavor-access:is_public": "True"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:47.662835 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c33a7437-cf3a-456b-962c-3869c363e9e5 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.027626 Aug 27 04:31:47.664420 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 20/51] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:47 2022] POST /compute/v2.1/flavors => generated 428 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:47.679818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-24347e8d-acb1-45f2-8447-bbfa68515b8b tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1322693791"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:47.684297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-24347e8d-acb1-45f2-8447-bbfa68515b8b tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Generated uuid 590b2eb3-adec-445c-aad3-dcbd2a910fc9 for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:31:47.689429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=12,nova_api:DELETE=5 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:47.711922 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-24347e8d-acb1-45f2-8447-bbfa68515b8b tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046166 Aug 27 04:31:47.719325 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 21/52] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:31:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:47.719567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c00a037e-7d73-43d6-b3ff-2578cc14f6b3 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.748686 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c00a037e-7d73-43d6-b3ff-2578cc14f6b3 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1013241666" status: 202 len: 0 microversion: 2.1 time: 0.034979 Aug 27 04:31:47.749588 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 22/53] 10.222.0.79 () {58 vars in 1161 bytes} [Sat Aug 27 04:31:47 2022] DELETE /compute/v2.1/flavors/1013241666 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:47.756983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7e16c6a-c70c-49a8-ab60-5acc45f193e0 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.758782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7e16c6a-c70c-49a8-ab60-5acc45f193e0 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '3a374f235c9d443c90a0e68370992b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d130c9f81f4e73a1caca2a8eac4f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7e16c6a-c70c-49a8-ab60-5acc45f193e0 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Request method failure captured: Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4oB4kCZ-mKz8fBbJgrC57xM6qhYiEtEMpbYVty-QrtjPWMkZWIG1vsTkT5Ii-p2OH1Khv7ubAGgrshQGOf0tWOyLT5iOPntcG7yhJHQaS9aFkhsBZCFMpaR8zBxnxrTOT-OcsIXwP5P9wWJstmMt1WW0ixKHc9N__S9-wk58DY1Gg Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 46d130c9f81f4e73a1caca2a8eac4f5d Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:31:47.760768 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:31:47.761894 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:47.761894 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:47.761894 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 46d130c9f81f4e73a1caca2a8eac4f5d Aug 27 04:31:47.761894 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:47.761894 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminNegativeTestJSON-762562147-project Aug 27 04:31:47.761894 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:31:47.761894 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:31:47.761894 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 3a374f235c9d443c90a0e68370992b92 Aug 27 04:31:47.761894 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-762562147-project Aug 27 04:31:47.761894 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:31:47.761894 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 04:31:47.761894 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '7'} Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:31:47.762493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 04:31:47.763426 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.765699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7e16c6a-c70c-49a8-ab60-5acc45f193e0 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:47.766559 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7e16c6a-c70c-49a8-ab60-5acc45f193e0 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] 10.222.0.79 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.015855 Aug 27 04:31:47.767353 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 23/54] 10.222.0.79 () {58 vars in 1149 bytes} [Sat Aug 27 04:31:47 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:31:47.771390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e831f05-214f-4bc8-8956-856ec711534d tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.788845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7caa767-f9f6-41b9-994e-184865b0feae tempest-FlavorsAccessNegativeTestJSON-203340151 tempest-FlavorsAccessNegativeTestJSON-203340151-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "20626036b6ea4d618c0486d3367396c4"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:47.792951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c7caa767-f9f6-41b9-994e-184865b0feae tempest-FlavorsAccessNegativeTestJSON-203340151 tempest-FlavorsAccessNegativeTestJSON-203340151-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'e04ac54e40b64eff8a22bb6aab0b8f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20626036b6ea4d618c0486d3367396c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7caa767-f9f6-41b9-994e-184865b0feae tempest-FlavorsAccessNegativeTestJSON-203340151 tempest-FlavorsAccessNegativeTestJSON-203340151-project] Request method failure captured: Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/flavors/728539599/action HTTP/1.1 Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 67 Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4qYdxPyPhOOBfBtX0rAO0YyTLVzPFCDrbFihMBdeHInyFDp06jzHyy2PPj_6UsAFpX376IwilFAqujhHSoOAN5teRm-VYFcT0OFeAOT_Ttap2K7-yVoDabChF9nc_BUrO3JfVqga_gdF1N77AIttfjaBA58bRR86CVwSkiR6BROyM Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 20626036b6ea4d618c0486d3367396c4 Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-203340151 Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:31:47.795139 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:31:47.796246 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20626036b6ea4d618c0486d3367396c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_20626036b6ea4d618c0486d3367396c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/20626036b6ea4d618c0486d3367396c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20626036b6ea4d618c0486d3367396c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:47.796246 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-203340151 Aug 27 04:31:47.796246 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 20626036b6ea4d618c0486d3367396c4 Aug 27 04:31:47.796246 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-203340151 Aug 27 04:31:47.796246 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FlavorsAccessNegativeTestJSON-203340151-project Aug 27 04:31:47.796246 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:31:47.796246 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:31:47.796246 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: e04ac54e40b64eff8a22bb6aab0b8f29 Aug 27 04:31:47.796246 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-203340151-project Aug 27 04:31:47.796246 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:31:47.796246 n-d-854823-1 devstack@n-api.service[128870]: {"addTenantAccess": {"tenant": "20626036b6ea4d618c0486d3367396c4"}} Aug 27 04:31:47.796246 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '728539599', 'body': {'addTenantAccess': {'tenant': '20626036b6ea4d618c0486d3367396c4'}}} Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:31:47.796925 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 04:31:47.798562 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.799540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7caa767-f9f6-41b9-994e-184865b0feae tempest-FlavorsAccessNegativeTestJSON-203340151 tempest-FlavorsAccessNegativeTestJSON-203340151-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:47.799540 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7caa767-f9f6-41b9-994e-184865b0feae tempest-FlavorsAccessNegativeTestJSON-203340151 tempest-FlavorsAccessNegativeTestJSON-203340151-project] 10.222.0.79 "POST /compute/v2.1/flavors/728539599/action" status: 403 len: 130 microversion: 2.1 time: 0.308651 Aug 27 04:31:47.805178 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 32/55] 10.222.0.79 () {60 vars in 1197 bytes} [Sat Aug 27 04:31:47 2022] POST /compute/v2.1/flavors/728539599/action => generated 130 bytes in 317 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:31:47.810351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf0c9272-c06c-4efd-a4a5-e7559f2dafc9 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.829919 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e831f05-214f-4bc8-8956-856ec711534d tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061754 Aug 27 04:31:47.832260 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 24/56] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:47.842059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b3f8401-b9cd-46e9-a9a5-3b9ff401f0b4 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.860797 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bf0c9272-c06c-4efd-a4a5-e7559f2dafc9 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.054073 Aug 27 04:31:47.861675 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 33/57] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:31:47 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:31:47.866382 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b3f8401-b9cd-46e9-a9a5-3b9ff401f0b4 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/728539599" status: 202 len: 0 microversion: 2.1 time: 0.027627 Aug 27 04:31:47.869092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cd3db6d6-75b2-4733-8667-162dfc359dde tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-704878262", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:47.871306 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 25/58] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 04:31:47 2022] DELETE /compute/v2.1/flavors/728539599 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:47.876619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-745810f5-8c46-4dd3-a74c-48d38dad1fef tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.887608 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-745810f5-8c46-4dd3-a74c-48d38dad1fef tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-745810f5-8c46-4dd3-a74c-48d38dad1fef tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Request method failure captured: Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4q7Rm3nEUwY9JBNZ9vVa1JEU0YEY7ysPZgnXFpI1WInbwDP4Uc7xuhY_nz25-EHnzx6r8fa2S859s0Esy6KAX5xMdFVxGKUEdTy9pKfQ1TL5Asn7HylwXw8vO_PmolMxltWSwht03Hcb5rJ5Qqs1E9ZOYbJwiOBW-L7-SYd-z4G-c Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:31:47.889204 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:31:47.890283 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6c1d49516b641089bdc1067be17e386"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:47.890283 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:47.890283 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:31:47.890283 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:31:47.890283 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:31:47.890283 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:31:47.890283 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:31:47.890283 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: fd7891c50c0148f290c6f3e70573aa47 Aug 27 04:31:47.890283 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:31:47.890283 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:31:47.890283 n-d-854823-1 devstack@n-api.service[128869]: exception: Aggregate -1 could not be found. Aug 27 04:31:47.890283 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '-1'} Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.891404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 27 04:31:47.892398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.894661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-745810f5-8c46-4dd3-a74c-48d38dad1fef tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:47.894661 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-745810f5-8c46-4dd3-a74c-48d38dad1fef tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.021014 Aug 27 04:31:47.894661 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 26/59] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:31:47 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:31:47.903794 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cd3db6d6-75b2-4733-8667-162dfc359dde tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.040695 Aug 27 04:31:47.905010 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 34/60] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:47 2022] POST /compute/v2.1/flavors => generated 506 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:47.907643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab5d489d-4c94-4c5b-b720-5a6a8f6f6151 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.910656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-540dbe5a-09c3-4282-9e31-6f081abe1235 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.913307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-540dbe5a-09c3-4282-9e31-6f081abe1235 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '3a374f235c9d443c90a0e68370992b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d130c9f81f4e73a1caca2a8eac4f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-540dbe5a-09c3-4282-9e31-6f081abe1235 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Request method failure captured: Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4oB4kCZ-mKz8fBbJgrC57xM6qhYiEtEMpbYVty-QrtjPWMkZWIG1vsTkT5Ii-p2OH1Khv7ubAGgrshQGOf0tWOyLT5iOPntcG7yhJHQaS9aFkhsBZCFMpaR8zBxnxrTOT-OcsIXwP5P9wWJstmMt1WW0ixKHc9N__S9-wk58DY1Gg Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 46d130c9f81f4e73a1caca2a8eac4f5d Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:31:47.915186 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:31:47.916247 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:47.916247 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:47.916247 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 46d130c9f81f4e73a1caca2a8eac4f5d Aug 27 04:31:47.916247 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:31:47.916247 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AggregatesAdminNegativeTestJSON-762562147-project Aug 27 04:31:47.916247 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:31:47.916247 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:31:47.916247 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3a374f235c9d443c90a0e68370992b92 Aug 27 04:31:47.916247 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-762562147-project Aug 27 04:31:47.916247 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:31:47.916247 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 04:31:47.916247 n-d-854823-1 devstack@n-api.service[128870]: action_args: {} Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:31:47.918025 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:47.918940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-540dbe5a-09c3-4282-9e31-6f081abe1235 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:47.919869 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-540dbe5a-09c3-4282-9e31-6f081abe1235 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.010340 Aug 27 04:31:47.919869 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 35/61] 10.222.0.79 () {58 vars in 1143 bytes} [Sat Aug 27 04:31:47 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:31:47.924267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-117014c4-ab93-4ba1-aca6-0123dbfd5476 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.946821 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-117014c4-ab93-4ba1-aca6-0123dbfd5476 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/f1f42883-6efb-42dd-884e-1efc92cb4087" status: 202 len: 0 microversion: 2.1 time: 0.027024 Aug 27 04:31:47.949317 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 36/62] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:31:47 2022] DELETE /compute/v2.1/flavors/f1f42883-6efb-42dd-884e-1efc92cb4087 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:47.949429 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab5d489d-4c94-4c5b-b720-5a6a8f6f6151 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5487 microversion: 2.1 time: 0.047834 Aug 27 04:31:47.949980 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 27/63] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:47 2022] GET /compute/v2.1/flavors/detail => generated 5487 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:47.967328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-04b49caf-517e-4df8-8fc8-d2ae42fe3c47 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:47.971443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f805c30-1f33-4c0f-99f2-019933dd0ac0 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-591799546", "id": 1166518429, "os-flavor-access:is_public": "False"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:47.998477 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f805c30-1f33-4c0f-99f2-019933dd0ac0 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.032520 Aug 27 04:31:47.999632 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 28/64] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:47 2022] POST /compute/v2.1/flavors => generated 438 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:48.014903 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-04b49caf-517e-4df8-8fc8-d2ae42fe3c47 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056649 Aug 27 04:31:48.016747 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 37/65] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:48.028987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4db25d61-2a0a-4513-bd2a-e8a1f01d9898 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "20626036b6ea4d618c0486d3367396c4"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:48.042788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c63d5642-5633-4ff8-a6a5-2777d8899af9 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1177872693", "id": "8c655f86-b209-4460-9428-86ad30c71853", "os-flavor-access:is_public": "True"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:48.078831 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c63d5642-5633-4ff8-a6a5-2777d8899af9 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.043718 Aug 27 04:31:48.079326 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 38/66] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:48 2022] POST /compute/v2.1/flavors => generated 507 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:48.090863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-095f6126-08fa-40e8-8d8b-37d2f59af8d1 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:48.110626 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-095f6126-08fa-40e8-8d8b-37d2f59af8d1 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/8c655f86-b209-4460-9428-86ad30c71853" status: 202 len: 0 microversion: 2.1 time: 0.023117 Aug 27 04:31:48.111363 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 39/67] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:31:48 2022] DELETE /compute/v2.1/flavors/8c655f86-b209-4460-9428-86ad30c71853 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:48.121053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a0cb132d-498a-4970-ac85-02f02e90dd36 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:48.148998 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a0cb132d-498a-4970-ac85-02f02e90dd36 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033010 Aug 27 04:31:48.161485 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 40/68] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:48.169902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7e2b47f4-e239-4fea-b1ed-50fd9fc53a8e tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1805701899", "id": 1046623230, "os-flavor-access:is_public": "True"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:48.198546 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7e2b47f4-e239-4fea-b1ed-50fd9fc53a8e tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.033339 Aug 27 04:31:48.199160 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 41/69] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:48 2022] POST /compute/v2.1/flavors => generated 414 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:31:48.225542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-002d1485-f74e-4556-addc-b4aca7a98844 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:48.242561 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-002d1485-f74e-4556-addc-b4aca7a98844 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/1046623230" status: 200 len: 414 microversion: 2.1 time: 0.027824 Aug 27 04:31:48.249961 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 42/70] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 04:31:48 2022] GET /compute/v2.1/flavors/1046623230 => generated 414 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:48.629329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8a777436-82d0-454a-a3d1-581c72958b17 tempest-FlavorsAdminTestJSON-708744662 tempest-FlavorsAdminTestJSON-708744662-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:48.650158 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4db25d61-2a0a-4513-bd2a-e8a1f01d9898 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1166518429/action" status: 200 len: 97 microversion: 2.1 time: 0.631950 Aug 27 04:31:48.652208 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 29/71] 10.222.0.79 () {60 vars in 1200 bytes} [Sat Aug 27 04:31:48 2022] POST /compute/v2.1/flavors/1166518429/action => generated 97 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:31:48.659324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6a25cae-3df4-4b13-98dd-c5a5a7d2294a tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:48.662099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6a25cae-3df4-4b13-98dd-c5a5a7d2294a tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:48.680037 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8a777436-82d0-454a-a3d1-581c72958b17 tempest-FlavorsAdminTestJSON-708744662 tempest-FlavorsAdminTestJSON-708744662-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.428853 Aug 27 04:31:48.693888 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 43/72] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:48 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:48.701853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99db2e1e-84e2-40f1-9cc4-5043b3fc762d tempest-FlavorsAccessNegativeTestJSON-203340151 tempest-FlavorsAccessNegativeTestJSON-203340151-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "20626036b6ea4d618c0486d3367396c4"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:48.706581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-99db2e1e-84e2-40f1-9cc4-5043b3fc762d tempest-FlavorsAccessNegativeTestJSON-203340151 tempest-FlavorsAccessNegativeTestJSON-203340151-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'e04ac54e40b64eff8a22bb6aab0b8f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20626036b6ea4d618c0486d3367396c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99db2e1e-84e2-40f1-9cc4-5043b3fc762d tempest-FlavorsAccessNegativeTestJSON-203340151 tempest-FlavorsAccessNegativeTestJSON-203340151-project] Request method failure captured: Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/flavors/1166518429/action HTTP/1.1 Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 70 Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4qYdxPyPhOOBfBtX0rAO0YyTLVzPFCDrbFihMBdeHInyFDp06jzHyy2PPj_6UsAFpX376IwilFAqujhHSoOAN5teRm-VYFcT0OFeAOT_Ttap2K7-yVoDabChF9nc_BUrO3JfVqga_gdF1N77AIttfjaBA58bRR86CVwSkiR6BROyM Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 20626036b6ea4d618c0486d3367396c4 Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-203340151 Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:31:48.708187 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:31:48.709461 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20626036b6ea4d618c0486d3367396c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_20626036b6ea4d618c0486d3367396c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/20626036b6ea4d618c0486d3367396c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20626036b6ea4d618c0486d3367396c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:48.709461 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-203340151 Aug 27 04:31:48.709461 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 20626036b6ea4d618c0486d3367396c4 Aug 27 04:31:48.709461 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-203340151 Aug 27 04:31:48.709461 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FlavorsAccessNegativeTestJSON-203340151-project Aug 27 04:31:48.709461 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:31:48.709461 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:31:48.709461 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: e04ac54e40b64eff8a22bb6aab0b8f29 Aug 27 04:31:48.709461 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-203340151-project Aug 27 04:31:48.709461 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:31:48.709461 n-d-854823-1 devstack@n-api.service[128870]: {"removeTenantAccess": {"tenant": "20626036b6ea4d618c0486d3367396c4"}} Aug 27 04:31:48.709461 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '1166518429', 'body': {'removeTenantAccess': {'tenant': '20626036b6ea4d618c0486d3367396c4'}}} Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can( Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:31:48.710284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 04:31:48.711258 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:48.713381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99db2e1e-84e2-40f1-9cc4-5043b3fc762d tempest-FlavorsAccessNegativeTestJSON-203340151 tempest-FlavorsAccessNegativeTestJSON-203340151-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:48.713381 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-99db2e1e-84e2-40f1-9cc4-5043b3fc762d tempest-FlavorsAccessNegativeTestJSON-203340151 tempest-FlavorsAccessNegativeTestJSON-203340151-project] 10.222.0.79 "POST /compute/v2.1/flavors/1166518429/action" status: 403 len: 133 microversion: 2.1 time: 0.014384 Aug 27 04:31:48.714753 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 44/73] 10.222.0.79 () {60 vars in 1200 bytes} [Sat Aug 27 04:31:48 2022] POST /compute/v2.1/flavors/1166518429/action => generated 133 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:31:48.719719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8485e686-8c26-4ae8-ab1b-fea7826fb251 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:48.748720 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8485e686-8c26-4ae8-ab1b-fea7826fb251 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1046623230" status: 202 len: 0 microversion: 2.1 time: 0.032695 Aug 27 04:31:48.749255 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 45/74] 10.222.0.79 () {58 vars in 1161 bytes} [Sat Aug 27 04:31:48 2022] DELETE /compute/v2.1/flavors/1046623230 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:48.763477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7bb22a1-f3b0-4a3e-937a-87c0c83a3c5b tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "20626036b6ea4d618c0486d3367396c4"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:48.766408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f6a25cae-3df4-4b13-98dd-c5a5a7d2294a tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:48.774162 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6a25cae-3df4-4b13-98dd-c5a5a7d2294a tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1243 microversion: 2.1 time: 0.120389 Aug 27 04:31:48.775375 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 30/75] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:48 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1243 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:48.782628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbaded09-7786-4176-b1c7-e15761ed0d28 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:48.843104 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbaded09-7786-4176-b1c7-e15761ed0d28 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063018 Aug 27 04:31:48.846023 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 31/76] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:48.874580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f29b27c5-1850-40f0-bfb4-0b16f7a9c2ff tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1793452074", "id": 1199681164, "os-flavor-access:is_public": "False"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:48.921400 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f29b27c5-1850-40f0-bfb4-0b16f7a9c2ff tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.056336 Aug 27 04:31:48.922903 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 32/77] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:48 2022] POST /compute/v2.1/flavors => generated 430 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:48.944448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47d6c817-944e-45ca-9ffa-b9365d784e21 tempest-FlavorsAdminTestJSON-708744662 tempest-FlavorsAdminTestJSON-708744662-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "1199681164"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:48.977871 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-47d6c817-944e-45ca-9ffa-b9365d784e21 tempest-FlavorsAdminTestJSON-708744662 tempest-FlavorsAdminTestJSON-708744662-project] HTTP exception thrown: Flavor 1199681164 could not be found. Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47d6c817-944e-45ca-9ffa-b9365d784e21 tempest-FlavorsAdminTestJSON-708744662 tempest-FlavorsAdminTestJSON-708744662-project] Request method failure captured: Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 107 Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4wQqxBct64HwrsQ8I6p73aA_TnMShP-_ho5_khe4NWmjklybfff3ZZLUrARFeYSMrHbTBgfVQ2ja8PaFHdV7KoypWxbHXt2x8cPYScP0GIplR1rwz4GjZ54qS_DgP3TVVPfRAGAr5Tznh9i0Z_akhYmUJD9dEcCZuaSZq78wnmR9I Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: eaf91a3e09704977b795cbf2765c2183 Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-FlavorsAdminTestJSON-708744662 Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:31:48.988161 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:31:48.989412 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/eaf91a3e09704977b795cbf2765c2183"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_eaf91a3e09704977b795cbf2765c2183"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/eaf91a3e09704977b795cbf2765c2183"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/eaf91a3e09704977b795cbf2765c2183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:48.989412 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-FlavorsAdminTestJSON-708744662 Aug 27 04:31:48.989412 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: eaf91a3e09704977b795cbf2765c2183 Aug 27 04:31:48.989412 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-708744662 Aug 27 04:31:48.989412 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-FlavorsAdminTestJSON-708744662-project Aug 27 04:31:48.989412 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:31:48.989412 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:31:48.989412 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: d25b01fc63fa4742b69de706f7faebff Aug 27 04:31:48.989412 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-FlavorsAdminTestJSON-708744662-project Aug 27 04:31:48.989412 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:31:48.989412 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "test", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "1199681164"}} Aug 27 04:31:48.989412 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:31:48.989412 n-d-854823-1 devstack@n-api.service[128869]: exception: Flavor 1199681164 could not be found. Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '1199681164'}}} Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1199681164 could not be found. Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:48.990076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1199681164 could not be found. Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:48.991208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:48.992303 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:48.992303 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:31:48.992303 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:31:48.992303 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1199681164 could not be found. Aug 27 04:31:48.992303 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:31:48.996341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47d6c817-944e-45ca-9ffa-b9365d784e21 tempest-FlavorsAdminTestJSON-708744662 tempest-FlavorsAdminTestJSON-708744662-project] Returning 400 to user: Flavor 1199681164 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:48.999320 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47d6c817-944e-45ca-9ffa-b9365d784e21 tempest-FlavorsAdminTestJSON-708744662 tempest-FlavorsAdminTestJSON-708744662-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.065287 Aug 27 04:31:49.003636 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 33/78] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:48 2022] POST /compute/v2.1/servers => generated 81 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:31:49.020474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-773df4de-c906-4b3f-adcd-411ec613634c tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.068869 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-773df4de-c906-4b3f-adcd-411ec613634c tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1199681164" status: 202 len: 0 microversion: 2.1 time: 0.059376 Aug 27 04:31:49.070291 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 34/79] 10.222.0.79 () {58 vars in 1161 bytes} [Sat Aug 27 04:31:49 2022] DELETE /compute/v2.1/flavors/1199681164 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:49.084837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7280dd62-fa8d-479b-aaf7-5a99cbaf5b11 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.114570 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7280dd62-fa8d-479b-aaf7-5a99cbaf5b11 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035852 Aug 27 04:31:49.115580 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 35/80] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:49.138472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef9afcd8-3032-4da7-8658-016b311a663c tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-270436960", "id": 1837013364, "os-flavor-access:is_public": "False"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:49.164802 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef9afcd8-3032-4da7-8658-016b311a663c tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.033385 Aug 27 04:31:49.176711 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 36/81] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:49 2022] POST /compute/v2.1/flavors => generated 414 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:49.188145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d956894c-731b-47f8-885a-0a0fb20b796f tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1894718943", "id": 1422623748, "os-flavor-access:is_public": "True"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:49.228843 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d956894c-731b-47f8-885a-0a0fb20b796f tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.049041 Aug 27 04:31:49.240142 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 37/82] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:49 2022] POST /compute/v2.1/flavors => generated 414 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:49.256795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ee9b712-2e52-4ac6-8793-d1ede25f932a tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.285676 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ee9b712-2e52-4ac6-8793-d1ede25f932a tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 845 microversion: 2.1 time: 0.042696 Aug 27 04:31:49.286843 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 38/83] 10.222.0.79 () {58 vars in 1169 bytes} [Sat Aug 27 04:31:49 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 845 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:49.306188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f466997-7007-4390-a8ef-779236d7de90 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.324246 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f466997-7007-4390-a8ef-779236d7de90 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 845 microversion: 2.1 time: 0.027622 Aug 27 04:31:49.324840 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 39/84] 10.222.0.79 () {58 vars in 1177 bytes} [Sat Aug 27 04:31:49 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 845 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:49.349391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-80e9fbfe-c7b9-4966-a3d4-e96f2f1495d7 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.375323 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-80e9fbfe-c7b9-4966-a3d4-e96f2f1495d7 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 845 microversion: 2.1 time: 0.041679 Aug 27 04:31:49.380755 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 40/85] 10.222.0.79 () {58 vars in 1171 bytes} [Sat Aug 27 04:31:49 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 845 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:31:49.393489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c602ba3-55d0-4800-886b-715a29e7a475 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.423897 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7c602ba3-55d0-4800-886b-715a29e7a475 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 845 microversion: 2.1 time: 0.037295 Aug 27 04:31:49.434752 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 41/86] 10.222.0.79 () {58 vars in 1169 bytes} [Sat Aug 27 04:31:49 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 845 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:49.441616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b06ee5e6-49b9-4e34-b94a-af2704d0651d tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.492325 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b06ee5e6-49b9-4e34-b94a-af2704d0651d tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.055952 Aug 27 04:31:49.493468 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 42/87] 10.222.0.79 () {58 vars in 1169 bytes} [Sat Aug 27 04:31:49 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:49.517539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f735ece5-7f99-4f38-bcea-00d7f1e648c4 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.535848 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7bb22a1-f3b0-4a3e-937a-87c0c83a3c5b tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1166518429/action" status: 200 len: 21 microversion: 2.1 time: 0.781614 Aug 27 04:31:49.537451 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 46/88] 10.222.0.79 () {60 vars in 1200 bytes} [Sat Aug 27 04:31:48 2022] POST /compute/v2.1/flavors/1166518429/action => generated 21 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:31:49.547924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b94f1d3b-936f-41f7-b189-63d5dc033b71 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.550577 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f735ece5-7f99-4f38-bcea-00d7f1e648c4 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.042493 Aug 27 04:31:49.564831 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 43/89] 10.222.0.79 () {58 vars in 1175 bytes} [Sat Aug 27 04:31:49 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:49.572245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-606b7984-3ead-4829-bb4a-9ba6a6641d7e tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.578526 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b94f1d3b-936f-41f7-b189-63d5dc033b71 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1166518429" status: 202 len: 0 microversion: 2.1 time: 0.034206 Aug 27 04:31:49.583274 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 47/90] 10.222.0.79 () {58 vars in 1161 bytes} [Sat Aug 27 04:31:49 2022] DELETE /compute/v2.1/flavors/1166518429 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:31:49.598315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f206dfe4-1622-4409-8646-220ec35929dc tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.615300 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-606b7984-3ead-4829-bb4a-9ba6a6641d7e tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.047849 Aug 27 04:31:49.628566 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 44/91] 10.222.0.79 () {58 vars in 1173 bytes} [Sat Aug 27 04:31:49 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:49.639392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39f601a2-db68-44c4-a34a-e232c93655bd tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.647605 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f206dfe4-1622-4409-8646-220ec35929dc tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.062917 Aug 27 04:31:49.663944 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 48/92] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:49 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:49.672101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f45743c-beb4-481e-aeff-11f4f7cd2fee tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-908573992", "id": 761947118, "os-flavor-access:is_public": "False"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:49.686800 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39f601a2-db68-44c4-a34a-e232c93655bd tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.050856 Aug 27 04:31:49.687399 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 45/93] 10.222.0.79 () {58 vars in 1169 bytes} [Sat Aug 27 04:31:49 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:49.706439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96e0e311-14f4-4920-b5c9-b60f8b2be611 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.713165 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4f45743c-beb4-481e-aeff-11f4f7cd2fee tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.047781 Aug 27 04:31:49.723786 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 49/94] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:49 2022] POST /compute/v2.1/flavors => generated 435 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:49.731491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-84faa3dd-f06c-4d9d-b3db-d759a5b486a1 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e1c3b9332ff742e8b34c8f3a1dce30b7"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:49.764621 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96e0e311-14f4-4920-b5c9-b60f8b2be611 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1422623748" status: 202 len: 0 microversion: 2.1 time: 0.062696 Aug 27 04:31:49.765359 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 46/95] 10.222.0.79 () {58 vars in 1161 bytes} [Sat Aug 27 04:31:49 2022] DELETE /compute/v2.1/flavors/1422623748 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:31:49.778995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed3149c1-6e55-4e5d-8dbb-59bcd06196db tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.813493 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ed3149c1-6e55-4e5d-8dbb-59bcd06196db tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040631 Aug 27 04:31:49.814335 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 47/96] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:49.820753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-791c9191-b5d8-47de-a8d3-0b5163cf75a4 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:49.837462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-791c9191-b5d8-47de-a8d3-0b5163cf75a4 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:49.856591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791c9191-b5d8-47de-a8d3-0b5163cf75a4 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:49.857363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791c9191-b5d8-47de-a8d3-0b5163cf75a4 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:49.858362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791c9191-b5d8-47de-a8d3-0b5163cf75a4 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:49.859223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791c9191-b5d8-47de-a8d3-0b5163cf75a4 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:49.860217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791c9191-b5d8-47de-a8d3-0b5163cf75a4 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:49.860826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791c9191-b5d8-47de-a8d3-0b5163cf75a4 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:50.312523 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-84faa3dd-f06c-4d9d-b3db-d759a5b486a1 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] HTTP exception thrown: Flavor access not found for 28 / e1c3b9332ff742e8b34c8f3a1dce30b7 combination. Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-84faa3dd-f06c-4d9d-b3db-d759a5b486a1 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Request method failure captured: Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/flavors/761947118/action HTTP/1.1 Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 70 Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4t7bMprbEv8HCaIxL2pF2MzUKGqnLmQIVAnk7VEKp5Lrwl4QgAYUpEgFP6ZkJHnu8c7tnpYvUN4dY-g4eIHvqqwG6aLwKimeo36W0hWAXVHaAWm0Q3LitStHb6jJHtHipJO8_RTGWvOEm5t7v-yahYp0DFsZMAt0k5skzgnegOryI Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cbe9b27660fc4dba85fb24aa11399452 Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1765818365 Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:31:50.314687 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:31:50.315810 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cbe9b27660fc4dba85fb24aa11399452"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cbe9b27660fc4dba85fb24aa11399452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cbe9b27660fc4dba85fb24aa11399452"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cbe9b27660fc4dba85fb24aa11399452"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:31:50.315810 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1765818365 Aug 27 04:31:50.315810 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cbe9b27660fc4dba85fb24aa11399452 Aug 27 04:31:50.315810 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1765818365 Aug 27 04:31:50.315810 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin Aug 27 04:31:50.315810 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:31:50.315810 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:31:50.315810 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 9a7e2e8074a64635816d3ac3b586b347 Aug 27 04:31:50.315810 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin Aug 27 04:31:50.315810 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:31:50.315810 n-d-854823-1 devstack@n-api.service[128870]: {"removeTenantAccess": {"tenant": "e1c3b9332ff742e8b34c8f3a1dce30b7"}} Aug 27 04:31:50.315810 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: exception: Flavor access not found for 28 / e1c3b9332ff742e8b34c8f3a1dce30b7 combination. Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '761947118', 'body': {'removeTenantAccess': {'tenant': 'e1c3b9332ff742e8b34c8f3a1dce30b7'}}} Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 27 04:31:50.316434 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 28 / e1c3b9332ff742e8b34c8f3a1dce30b7 combination. Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 28 / e1c3b9332ff742e8b34c8f3a1dce30b7 combination. Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:50.317706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:31:50.318726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:31:50.318726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:31:50.318726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:31:50.318726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:31:50.318726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 28 / e1c3b9332ff742e8b34c8f3a1dce30b7 combination. Aug 27 04:31:50.318726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:31:50.318726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-84faa3dd-f06c-4d9d-b3db-d759a5b486a1 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Returning 404 to user: Flavor access not found for 28 / e1c3b9332ff742e8b34c8f3a1dce30b7 combination. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:31:50.318726 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-84faa3dd-f06c-4d9d-b3db-d759a5b486a1 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/761947118/action" status: 404 len: 124 microversion: 2.1 time: 0.590626 Aug 27 04:31:50.318726 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 50/97] 10.222.0.79 () {60 vars in 1197 bytes} [Sat Aug 27 04:31:49 2022] POST /compute/v2.1/flavors/761947118/action => generated 124 bytes in 593 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:31:50.326666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-791c9191-b5d8-47de-a8d3-0b5163cf75a4 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:50.355324 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-791c9191-b5d8-47de-a8d3-0b5163cf75a4 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1235 microversion: 2.1 time: 0.536514 Aug 27 04:31:50.356131 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 48/98] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:49 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1235 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:50.377933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-103e2e1d-cf89-4b2d-8036-2048d23974b7 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:50.424865 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-103e2e1d-cf89-4b2d-8036-2048d23974b7 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1837013364" status: 202 len: 0 microversion: 2.1 time: 0.067477 Aug 27 04:31:50.425448 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 49/99] 10.222.0.79 () {58 vars in 1161 bytes} [Sat Aug 27 04:31:50 2022] DELETE /compute/v2.1/flavors/1837013364 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:50.437879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c8266c0-f986-4ed9-bf6c-370297faa2ac tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:50.455624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=77,nova_api:DELETE=17 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:50.487443 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c8266c0-f986-4ed9-bf6c-370297faa2ac tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/761947118" status: 202 len: 0 microversion: 2.1 time: 0.056704 Aug 27 04:31:50.488047 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 50/100] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 04:31:50 2022] DELETE /compute/v2.1/flavors/761947118 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:50.507300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a362ac1a-301f-4795-b8a9-afda65921d18 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:50.537184 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a362ac1a-301f-4795-b8a9-afda65921d18 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043045 Aug 27 04:31:50.538652 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 51/101] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:50.544717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f0347df-8b6d-4a84-8039-aa46cf428c13 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:50.567694 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f0347df-8b6d-4a84-8039-aa46cf428c13 tempest-FlavorsAccessNegativeTestJSON-1765818365 tempest-FlavorsAccessNegativeTestJSON-1765818365-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027392 Aug 27 04:31:50.568606 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 52/102] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:50.574378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b30094e9-9ab1-4e1f-9e2c-f9b8326af0ad tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-761586085", "id": 532348320, "os-flavor-access:is_public": "False"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:50.603297 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b30094e9-9ab1-4e1f-9e2c-f9b8326af0ad tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.033514 Aug 27 04:31:50.615388 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 53/103] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:50 2022] POST /compute/v2.1/flavors => generated 411 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:50.626075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-afcb4b9a-0d4d-4842-920f-fffbb9290899 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:50.686675 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-afcb4b9a-0d4d-4842-920f-fffbb9290899 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069752 Aug 27 04:31:50.688377 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 54/104] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:50.727139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-327308637", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:50.735135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cbd61628-c2cb-433b-8bc9-5c4230f71473 tempest-FlavorsAdminTestJSON-708744662 tempest-FlavorsAdminTestJSON-708744662-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:50.914531 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cbd61628-c2cb-433b-8bc9-5c4230f71473 tempest-FlavorsAdminTestJSON-708744662 tempest-FlavorsAdminTestJSON-708744662-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.206939 Aug 27 04:31:50.936365 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 55/105] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:51.230135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77d321b9-89b2-4de9-8282-748b717df37e tempest-FlavorMetadataValidation-1325189758 tempest-FlavorMetadataValidation-1325189758-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-2097802622", "id": 1526531494, "os-flavor-access:is_public": "True"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:51.278228 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77d321b9-89b2-4de9-8282-748b717df37e tempest-FlavorMetadataValidation-1325189758 tempest-FlavorMetadataValidation-1325189758-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.340597 Aug 27 04:31:51.284715 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 56/106] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 04:31:50 2022] POST /compute/v2.1/flavors => generated 471 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:31:51.289574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fcfa835-e7d4-47d9-8eb8-8d04e41046b3 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:51.329845 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6fcfa835-e7d4-47d9-8eb8-8d04e41046b3 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/532348320" status: 202 len: 0 microversion: 2.1 time: 0.043773 Aug 27 04:31:51.330461 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 57/107] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 04:31:51 2022] DELETE /compute/v2.1/flavors/532348320 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:51.338831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cbfc5f0f-5ae0-4794-a1f2-c7eec0fa1815 tempest-FlavorMetadataValidation-1325189758 tempest-FlavorMetadataValidation-1325189758-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:51.781385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:31:51.908423 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cbfc5f0f-5ae0-4794-a1f2-c7eec0fa1815 tempest-FlavorMetadataValidation-1325189758 tempest-FlavorMetadataValidation-1325189758-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1526531494/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.557692 Aug 27 04:31:51.909138 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 58/108] 10.222.0.79 () {62 vars in 1265 bytes} [Sat Aug 27 04:31:51 2022] POST /compute/v2.1/flavors/1526531494/os-extra_specs => generated 62 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:51.928061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c0c2a91c-178a-408a-b3d7-49c0a2841a8a tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:52.016180 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c0c2a91c-178a-408a-b3d7-49c0a2841a8a tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5413 microversion: 2.1 time: 0.092447 Aug 27 04:31:52.021462 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 59/109] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:51 2022] GET /compute/v2.1/flavors/detail => generated 5413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:52.033211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-513ad835-a067-4d5a-9580-0f3571770a99 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:52.037246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-513ad835-a067-4d5a-9580-0f3571770a99 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:52.047447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-513ad835-a067-4d5a-9580-0f3571770a99 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:52.048718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-513ad835-a067-4d5a-9580-0f3571770a99 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:52.049431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-513ad835-a067-4d5a-9580-0f3571770a99 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:52.050608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-513ad835-a067-4d5a-9580-0f3571770a99 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:52.051705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-513ad835-a067-4d5a-9580-0f3571770a99 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:52.054990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-513ad835-a067-4d5a-9580-0f3571770a99 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:52.207203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-513ad835-a067-4d5a-9580-0f3571770a99 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:52.219080 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-513ad835-a067-4d5a-9580-0f3571770a99 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1297 microversion: 2.1 time: 0.196209 Aug 27 04:31:52.219925 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 60/110] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:52 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1297 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:52.248562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b54e6eed-5723-40d0-af5b-c55b156e9954 tempest-FlavorMetadataValidation-1325189758 tempest-FlavorMetadataValidation-1325189758-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:52.294586 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b54e6eed-5723-40d0-af5b-c55b156e9954 tempest-FlavorMetadataValidation-1325189758 tempest-FlavorMetadataValidation-1325189758-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1526531494" status: 202 len: 0 microversion: 2.86 time: 0.055836 Aug 27 04:31:52.295066 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 61/111] 10.222.0.79 () {60 vars in 1202 bytes} [Sat Aug 27 04:31:52 2022] DELETE /compute/v2.1/flavors/1526531494 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:31:52.307420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-15aa6e94-16b4-44d3-99ce-8078c716677f tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-720261082", "id": 971239553, "os-flavor-access:is_public": "True"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:52.419249 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-15aa6e94-16b4-44d3-99ce-8078c716677f tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.121930 Aug 27 04:31:52.419933 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 62/112] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:52 2022] POST /compute/v2.1/flavors => generated 410 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:52.427274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c662a794-d9df-44d7-a1da-a9d2c0b03347 tempest-FlavorMetadataValidation-1325189758 tempest-FlavorMetadataValidation-1325189758-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:52.467080 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c662a794-d9df-44d7-a1da-a9d2c0b03347 tempest-FlavorMetadataValidation-1325189758 tempest-FlavorMetadataValidation-1325189758-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 6216 microversion: 2.86 time: 0.046080 Aug 27 04:31:52.486748 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 63/113] 10.222.0.79 () {60 vars in 1187 bytes} [Sat Aug 27 04:31:52 2022] GET /compute/v2.1/flavors/detail => generated 6216 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:52.494308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abdf4831-d120-4d5b-999a-75c62f0a828e tempest-FlavorsAdminTestJSON-708744662 tempest-FlavorsAdminTestJSON-708744662-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:52.549429 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-abdf4831-d120-4d5b-999a-75c62f0a828e tempest-FlavorsAdminTestJSON-708744662 tempest-FlavorsAdminTestJSON-708744662-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.061428 Aug 27 04:31:52.558116 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 64/114] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:52 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:52.570039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b9da4db-5c81-467c-bd96-64a090765956 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:52.625574 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b9da4db-5c81-467c-bd96-64a090765956 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/971239553" status: 202 len: 0 microversion: 2.1 time: 0.059119 Aug 27 04:31:52.626177 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 65/115] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 04:31:52 2022] DELETE /compute/v2.1/flavors/971239553 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:31:52.634357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c918bf17-f467-40df-9b56-fe208fa5a8d8 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:52.642364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:52.676255 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c918bf17-f467-40df-9b56-fe208fa5a8d8 tempest-FlavorsAdminTestJSON-1248154009 tempest-FlavorsAdminTestJSON-1248154009-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045472 Aug 27 04:31:52.677560 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 66/116] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:31:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:53.245823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d207d8c1-5a21-42aa-b7a9-a332bbdec593 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:53.246502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d207d8c1-5a21-42aa-b7a9-a332bbdec593 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:53.266973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d207d8c1-5a21-42aa-b7a9-a332bbdec593 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:53.266973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d207d8c1-5a21-42aa-b7a9-a332bbdec593 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:53.266973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d207d8c1-5a21-42aa-b7a9-a332bbdec593 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:53.279349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d207d8c1-5a21-42aa-b7a9-a332bbdec593 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:53.279926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d207d8c1-5a21-42aa-b7a9-a332bbdec593 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:53.280373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d207d8c1-5a21-42aa-b7a9-a332bbdec593 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:53.646065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:31:53.647646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:31:53.648311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:31:53.649070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:31:53.649633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:31:53.652865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=24,nova_api:INSERT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:53.694155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:53.701480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:53.702240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:53.703254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:53.703905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:53.704504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:53.815299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Getting quotas for project 2590843f03fa4ffaafb6ccd928425042. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:31:53.834236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Getting quotas for user 94068d7cc8804363a24b4159cf861440 and project 2590843f03fa4ffaafb6ccd928425042. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:31:53.867743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:31:53.870834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:31:54.011613 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5b9be8a6-1834-4f88-9ce1-42e0ce289e8f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.685913 Aug 27 04:31:54.037178 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 51/117] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:31:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:31:54.037178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-18d202a5-3502-49f1-9266-7e015ae3e67c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:54.037178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-18d202a5-3502-49f1-9266-7e015ae3e67c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:54.660244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-18d202a5-3502-49f1-9266-7e015ae3e67c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:54.711506 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-18d202a5-3502-49f1-9266-7e015ae3e67c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1219 microversion: 2.1 time: 0.681124 Aug 27 04:31:54.712064 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 52/118] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:54 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1219 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:55.169138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d207d8c1-5a21-42aa-b7a9-a332bbdec593 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:55.190412 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d207d8c1-5a21-42aa-b7a9-a332bbdec593 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 1.943630 Aug 27 04:31:55.190412 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 67/119] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:53 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:55.737320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b7f646ce-8d23-47ae-b9ec-0bfb452bd175 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:55.738499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b7f646ce-8d23-47ae-b9ec-0bfb452bd175 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:56.117525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b7f646ce-8d23-47ae-b9ec-0bfb452bd175 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:56.134384 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b7f646ce-8d23-47ae-b9ec-0bfb452bd175 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1219 microversion: 2.1 time: 0.401828 Aug 27 04:31:56.152444 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 53/120] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:55 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1219 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:56.214701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-578147b6-1630-4ff9-acc2-a0faed2c3e52 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:56.216387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-578147b6-1630-4ff9-acc2-a0faed2c3e52 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:56.228655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-578147b6-1630-4ff9-acc2-a0faed2c3e52 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:56.231114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-578147b6-1630-4ff9-acc2-a0faed2c3e52 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:56.234223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-578147b6-1630-4ff9-acc2-a0faed2c3e52 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:56.235260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-578147b6-1630-4ff9-acc2-a0faed2c3e52 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:56.238393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-578147b6-1630-4ff9-acc2-a0faed2c3e52 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:56.240464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-578147b6-1630-4ff9-acc2-a0faed2c3e52 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:57.159694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-167d2ac7-8bb0-4ad3-8b55-ba102cf444e2 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:57.160450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-167d2ac7-8bb0-4ad3-8b55-ba102cf444e2 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:57.173639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-167d2ac7-8bb0-4ad3-8b55-ba102cf444e2 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:57.176924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-167d2ac7-8bb0-4ad3-8b55-ba102cf444e2 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:57.179265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-167d2ac7-8bb0-4ad3-8b55-ba102cf444e2 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:57.181000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-167d2ac7-8bb0-4ad3-8b55-ba102cf444e2 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:57.183631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-167d2ac7-8bb0-4ad3-8b55-ba102cf444e2 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:57.186025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-167d2ac7-8bb0-4ad3-8b55-ba102cf444e2 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:57.281617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:57.647933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-167d2ac7-8bb0-4ad3-8b55-ba102cf444e2 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:57.675743 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-167d2ac7-8bb0-4ad3-8b55-ba102cf444e2 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1289 microversion: 2.1 time: 0.520643 Aug 27 04:31:57.695040 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 54/121] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:57 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1289 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:57.897370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-578147b6-1630-4ff9-acc2-a0faed2c3e52 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:57.933345 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-578147b6-1630-4ff9-acc2-a0faed2c3e52 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 1.722467 Aug 27 04:31:57.934744 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 68/122] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:56 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:58.697788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-007fc88f-9068-454c-931b-fea32f66c3e9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:58.698866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-007fc88f-9068-454c-931b-fea32f66c3e9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:58.716379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-007fc88f-9068-454c-931b-fea32f66c3e9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:58.719162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-007fc88f-9068-454c-931b-fea32f66c3e9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:58.725053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-007fc88f-9068-454c-931b-fea32f66c3e9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:58.726890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-007fc88f-9068-454c-931b-fea32f66c3e9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:58.729526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-007fc88f-9068-454c-931b-fea32f66c3e9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:58.730197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-007fc88f-9068-454c-931b-fea32f66c3e9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:58.948892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-007fc88f-9068-454c-931b-fea32f66c3e9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:58.955163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a2ccd94-f890-4ac0-a1f2-001d028f4e63 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:58.955749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a2ccd94-f890-4ac0-a1f2-001d028f4e63 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:58.958770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:58.967308 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-007fc88f-9068-454c-931b-fea32f66c3e9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1277 microversion: 2.1 time: 0.273841 Aug 27 04:31:58.975405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a2ccd94-f890-4ac0-a1f2-001d028f4e63 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:58.980651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a2ccd94-f890-4ac0-a1f2-001d028f4e63 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:58.982322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a2ccd94-f890-4ac0-a1f2-001d028f4e63 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:58.983055 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 55/123] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:58 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1277 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:58.983895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a2ccd94-f890-4ac0-a1f2-001d028f4e63 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:58.988003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a2ccd94-f890-4ac0-a1f2-001d028f4e63 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:58.990794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a2ccd94-f890-4ac0-a1f2-001d028f4e63 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:59.920009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a2ccd94-f890-4ac0-a1f2-001d028f4e63 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:59.943667 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a2ccd94-f890-4ac0-a1f2-001d028f4e63 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 0.987725 Aug 27 04:31:59.964125 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 69/124] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:58 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:59.995385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-12b76a2d-a10c-4a04-bbcb-be8ad9053ce4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:59.996240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-12b76a2d-a10c-4a04-bbcb-be8ad9053ce4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:00.011934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12b76a2d-a10c-4a04-bbcb-be8ad9053ce4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:00.015317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12b76a2d-a10c-4a04-bbcb-be8ad9053ce4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:00.015950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12b76a2d-a10c-4a04-bbcb-be8ad9053ce4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:00.020319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12b76a2d-a10c-4a04-bbcb-be8ad9053ce4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:00.023014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12b76a2d-a10c-4a04-bbcb-be8ad9053ce4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:00.023661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12b76a2d-a10c-4a04-bbcb-be8ad9053ce4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:00.620832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-12b76a2d-a10c-4a04-bbcb-be8ad9053ce4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:00.660176 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-12b76a2d-a10c-4a04-bbcb-be8ad9053ce4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1277 microversion: 2.1 time: 0.659954 Aug 27 04:32:00.678700 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 56/125] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:59 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1277 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:00.986467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e78596f-ad0e-4787-b9a9-e44ce59a46ba tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:00.987090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e78596f-ad0e-4787-b9a9-e44ce59a46ba tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:01.006457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e78596f-ad0e-4787-b9a9-e44ce59a46ba tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:01.006740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e78596f-ad0e-4787-b9a9-e44ce59a46ba tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:01.007194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e78596f-ad0e-4787-b9a9-e44ce59a46ba tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:01.022376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e78596f-ad0e-4787-b9a9-e44ce59a46ba tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:01.023003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e78596f-ad0e-4787-b9a9-e44ce59a46ba tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:01.023460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e78596f-ad0e-4787-b9a9-e44ce59a46ba tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:01.773390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e78596f-ad0e-4787-b9a9-e44ce59a46ba tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:01.781781 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e78596f-ad0e-4787-b9a9-e44ce59a46ba tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 0.799216 Aug 27 04:32:01.786430 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 70/126] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:00 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:02.157397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-62c6f91b-5cc9-4e7b-88d9-eb1a0036a76a tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:02.184209 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-62c6f91b-5cc9-4e7b-88d9-eb1a0036a76a tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.816320 Aug 27 04:32:02.191839 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 57/127] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:32:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:02.218525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-71799714-6801-41e2-a6bf-d000d6c904a8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:02.223738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-71799714-6801-41e2-a6bf-d000d6c904a8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:02.244288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71799714-6801-41e2-a6bf-d000d6c904a8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:02.246507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71799714-6801-41e2-a6bf-d000d6c904a8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:02.247143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71799714-6801-41e2-a6bf-d000d6c904a8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:02.251875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71799714-6801-41e2-a6bf-d000d6c904a8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:02.252510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71799714-6801-41e2-a6bf-d000d6c904a8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:02.253109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71799714-6801-41e2-a6bf-d000d6c904a8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:02.306445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-41f20bc3-9e3c-4a15-acce-ab7705431f71 req-0e7610de-df79-4d33-844c-90f3c8238116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56162f18-821c-4bd7-b262-7fc46702ef4f", "tag": "6b85f720-3bfe-4f41-8a04-deaed3f68eb0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:02.347798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-41f20bc3-9e3c-4a15-acce-ab7705431f71 req-0e7610de-df79-4d33-844c-90f3c8238116 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:02.354897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-41f20bc3-9e3c-4a15-acce-ab7705431f71 req-0e7610de-df79-4d33-844c-90f3c8238116 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:02.357185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-41f20bc3-9e3c-4a15-acce-ab7705431f71 req-0e7610de-df79-4d33-844c-90f3c8238116 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:02.443087 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-41f20bc3-9e3c-4a15-acce-ab7705431f71 req-0e7610de-df79-4d33-844c-90f3c8238116 service nova] Creating event network-changed:6b85f720-3bfe-4f41-8a04-deaed3f68eb0 for instance 56162f18-821c-4bd7-b262-7fc46702ef4f on n-h2-854823-1 Aug 27 04:32:02.443795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-41f20bc3-9e3c-4a15-acce-ab7705431f71 req-0e7610de-df79-4d33-844c-90f3c8238116 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:32:02.444200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-41f20bc3-9e3c-4a15-acce-ab7705431f71 req-0e7610de-df79-4d33-844c-90f3c8238116 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:32:02.449284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e56b907-d62e-4748-9d85-41d2d142df2d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:02.449794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e56b907-d62e-4748-9d85-41d2d142df2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:02.450244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e56b907-d62e-4748-9d85-41d2d142df2d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:02.454963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e56b907-d62e-4748-9d85-41d2d142df2d None None] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:02.465164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e56b907-d62e-4748-9d85-41d2d142df2d None None] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:02.465969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e56b907-d62e-4748-9d85-41d2d142df2d None None] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:02.487613 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.compute.rpcapi [None req-6e56b907-d62e-4748-9d85-41d2d142df2d None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 27 04:32:02.488820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e56b907-d62e-4748-9d85-41d2d142df2d None None] Releasing lock "compute-rpcapi-router" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:32:02.515189 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6e56b907-d62e-4748-9d85-41d2d142df2d None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.727457 Aug 27 04:32:02.516696 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 71/128] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:02.767094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-71799714-6801-41e2-a6bf-d000d6c904a8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:02.787493 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-71799714-6801-41e2-a6bf-d000d6c904a8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.592532 Aug 27 04:32:02.796972 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 58/129] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:02 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:02.831794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-26fe5cdb-6bf3-42b2-8933-41701f5f8f31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:02.832951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-26fe5cdb-6bf3-42b2-8933-41701f5f8f31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:02.848608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26fe5cdb-6bf3-42b2-8933-41701f5f8f31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:02.849339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26fe5cdb-6bf3-42b2-8933-41701f5f8f31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:02.850013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26fe5cdb-6bf3-42b2-8933-41701f5f8f31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:02.851151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26fe5cdb-6bf3-42b2-8933-41701f5f8f31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:02.851754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26fe5cdb-6bf3-42b2-8933-41701f5f8f31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:02.852318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26fe5cdb-6bf3-42b2-8933-41701f5f8f31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:03.232127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-26fe5cdb-6bf3-42b2-8933-41701f5f8f31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:03.243972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62d1e0b9-77b6-45ab-bd7f-705da6032d99 tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-287648874", "id": 180691224, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:03.249262 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-26fe5cdb-6bf3-42b2-8933-41701f5f8f31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 0.438208 Aug 27 04:32:03.252519 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 59/130] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:02 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:03.289136 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62d1e0b9-77b6-45ab-bd7f-705da6032d99 tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.770777 Aug 27 04:32:03.290667 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 72/131] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:32:02 2022] POST /compute/v2.1/flavors => generated 421 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:03.306270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0c7e0cd4-811e-4653-9bbc-57abc7dd6593 tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:03.328910 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0c7e0cd4-811e-4653-9bbc-57abc7dd6593 tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026689 Aug 27 04:32:03.346585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abaedd0a-1b24-47e5-8c3a-6db8abf4389c tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1062895550", "id": 729764359, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:03.348479 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 60/132] 10.222.0.79 () {58 vars in 1182 bytes} [Sat Aug 27 04:32:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:32:03.392912 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-abaedd0a-1b24-47e5-8c3a-6db8abf4389c tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.055995 Aug 27 04:32:03.418493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-69c07984-671e-4e8a-8e29-4200d70a6068 tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:03.423457 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 73/133] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:32:03 2022] POST /compute/v2.1/flavors => generated 422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:03.426593 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-69c07984-671e-4e8a-8e29-4200d70a6068 tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012566 Aug 27 04:32:03.427162 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 61/134] 10.222.0.79 () {58 vars in 1182 bytes} [Sat Aug 27 04:32:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:32:03.441176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a960084-ccd4-4aaa-a596-2713f915b7e7 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Action: 'create', calling method: .version_select at 0x7f1f226ac0d0>, body: {"keypair": {"name": "tempest-keypair-182086736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmKuj/5VY7ncG2RqawiBPXRFWI4btckzcc2LXrHYwI+m/Sh/6smwg0peWPnXmav21GGewevJrke/uqWdL/NRVr4CEcIgqvnp8Bx5kMemvb1C1AW7uU9OYfGMDazBDQjow=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:03.490052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7a960084-ccd4-4aaa-a596-2713f915b7e7 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Getting quotas for project dbfb6b35f0604c108f1b30f3f7a853bc. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:32:03.511787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7a960084-ccd4-4aaa-a596-2713f915b7e7 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Getting quotas for user 50d4329bce764315901687e5ffb1f645 and project dbfb6b35f0604c108f1b30f3f7a853bc. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:32:03.571917 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a960084-ccd4-4aaa-a596-2713f915b7e7 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.134790 Aug 27 04:32:03.583190 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 74/135] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:32:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:03.752914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:03.818544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12456dc9-2ca6-48cc-b7be-15fd18495f2d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:03.824636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12456dc9-2ca6-48cc-b7be-15fd18495f2d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:03.842340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12456dc9-2ca6-48cc-b7be-15fd18495f2d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:03.849528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12456dc9-2ca6-48cc-b7be-15fd18495f2d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:03.850807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12456dc9-2ca6-48cc-b7be-15fd18495f2d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:03.859284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12456dc9-2ca6-48cc-b7be-15fd18495f2d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:03.862119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12456dc9-2ca6-48cc-b7be-15fd18495f2d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:03.862874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12456dc9-2ca6-48cc-b7be-15fd18495f2d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:04.247196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-41e4862b-95c7-4143-89e3-d70194e024c6 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Calling method '.version_select at 0x7f1f227c7f70>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:04.249610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41e4862b-95c7-4143-89e3-d70194e024c6 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:04.250097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41e4862b-95c7-4143-89e3-d70194e024c6 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:04.250757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41e4862b-95c7-4143-89e3-d70194e024c6 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:04.291465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41e4862b-95c7-4143-89e3-d70194e024c6 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:04.294868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41e4862b-95c7-4143-89e3-d70194e024c6 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:04.295674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41e4862b-95c7-4143-89e3-d70194e024c6 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:04.319115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41e4862b-95c7-4143-89e3-d70194e024c6 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:04.323593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41e4862b-95c7-4143-89e3-d70194e024c6 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:04.324109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41e4862b-95c7-4143-89e3-d70194e024c6 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:04.342412 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-41e4862b-95c7-4143-89e3-d70194e024c6 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.598178 Aug 27 04:32:04.352642 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 62/136] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:32:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:04.372944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b22c0a3d-a234-4517-b5b5-0e4012c104a5 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:04.377324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b22c0a3d-a234-4517-b5b5-0e4012c104a5 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:04.392390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22c0a3d-a234-4517-b5b5-0e4012c104a5 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:04.393087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22c0a3d-a234-4517-b5b5-0e4012c104a5 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:04.395153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22c0a3d-a234-4517-b5b5-0e4012c104a5 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:04.396024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22c0a3d-a234-4517-b5b5-0e4012c104a5 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:04.398368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22c0a3d-a234-4517-b5b5-0e4012c104a5 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:04.398887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22c0a3d-a234-4517-b5b5-0e4012c104a5 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:04.895192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b22c0a3d-a234-4517-b5b5-0e4012c104a5 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:04.915892 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b22c0a3d-a234-4517-b5b5-0e4012c104a5 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 0.561970 Aug 27 04:32:04.930272 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 63/137] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:04 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:04.947440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2a9d3aac-915a-4d0d-aaee-f38a6bc0de1e tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Calling method '.version_select at 0x7f1f2295d700>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:04.962682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9d3aac-915a-4d0d-aaee-f38a6bc0de1e tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:04.965595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9d3aac-915a-4d0d-aaee-f38a6bc0de1e tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:04.967363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9d3aac-915a-4d0d-aaee-f38a6bc0de1e tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:05.070180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9d3aac-915a-4d0d-aaee-f38a6bc0de1e tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:05.071973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9d3aac-915a-4d0d-aaee-f38a6bc0de1e tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:05.073925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9d3aac-915a-4d0d-aaee-f38a6bc0de1e tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:05.141918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-12456dc9-2ca6-48cc-b7be-15fd18495f2d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:05.154354 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12456dc9-2ca6-48cc-b7be-15fd18495f2d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 1.339921 Aug 27 04:32:05.164153 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 75/138] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:03 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:05.215635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9d3aac-915a-4d0d-aaee-f38a6bc0de1e tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:05.217533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9d3aac-915a-4d0d-aaee-f38a6bc0de1e tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:05.219450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9d3aac-915a-4d0d-aaee-f38a6bc0de1e tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:05.247973 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2a9d3aac-915a-4d0d-aaee-f38a6bc0de1e tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/n-h2-854823-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.314246 Aug 27 04:32:05.258522 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 64/139] 10.222.0.79 () {58 vars in 1212 bytes} [Sat Aug 27 04:32:04 2022] GET /compute/v2.1/os-hypervisors/n-h2-854823-1/servers => generated 196 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:05.270091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-61c9a552-ad05-48cc-baaf-05c1887c92f5 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Calling method '.version_select at 0x7f1f2253d820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:05.272809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61c9a552-ad05-48cc-baaf-05c1887c92f5 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:05.273471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61c9a552-ad05-48cc-baaf-05c1887c92f5 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:05.275405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61c9a552-ad05-48cc-baaf-05c1887c92f5 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:05.356100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=10,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:05.365631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61c9a552-ad05-48cc-baaf-05c1887c92f5 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:05.366462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61c9a552-ad05-48cc-baaf-05c1887c92f5 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:05.367698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61c9a552-ad05-48cc-baaf-05c1887c92f5 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:05.435528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61c9a552-ad05-48cc-baaf-05c1887c92f5 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:05.437210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61c9a552-ad05-48cc-baaf-05c1887c92f5 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:05.437655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61c9a552-ad05-48cc-baaf-05c1887c92f5 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:05.460681 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-61c9a552-ad05-48cc-baaf-05c1887c92f5 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.194521 Aug 27 04:32:05.468035 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 76/140] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:32:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:05.478087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fdf01768-be6e-4ab9-a3f9-a6db8d9e6789 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Calling method '.version_select at 0x7f1f227c71f0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:05.481222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdf01768-be6e-4ab9-a3f9-a6db8d9e6789 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:05.481968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdf01768-be6e-4ab9-a3f9-a6db8d9e6789 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:05.482516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdf01768-be6e-4ab9-a3f9-a6db8d9e6789 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:05.542930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdf01768-be6e-4ab9-a3f9-a6db8d9e6789 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:05.543762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdf01768-be6e-4ab9-a3f9-a6db8d9e6789 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:05.546050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdf01768-be6e-4ab9-a3f9-a6db8d9e6789 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:05.584450 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fdf01768-be6e-4ab9-a3f9-a6db8d9e6789 tempest-HypervisorAdminUnderV252Test-441522499 tempest-HypervisorAdminUnderV252Test-441522499-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/n-h2-854823-1/search" status: 200 len: 104 microversion: 2.1 time: 0.109114 Aug 27 04:32:05.589498 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 65/141] 10.222.0.79 () {58 vars in 1209 bytes} [Sat Aug 27 04:32:05 2022] GET /compute/v2.1/os-hypervisors/n-h2-854823-1/search => generated 104 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:05.940917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5595525f-4b39-42d5-8ff6-702988c4f180 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:05.941895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5595525f-4b39-42d5-8ff6-702988c4f180 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:05.975833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5595525f-4b39-42d5-8ff6-702988c4f180 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:05.978339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5595525f-4b39-42d5-8ff6-702988c4f180 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:05.982080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5595525f-4b39-42d5-8ff6-702988c4f180 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:05.983206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5595525f-4b39-42d5-8ff6-702988c4f180 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:05.985984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5595525f-4b39-42d5-8ff6-702988c4f180 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:05.986684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5595525f-4b39-42d5-8ff6-702988c4f180 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:06.192741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-09ed96db-da51-44de-aae0-7fd96779b769 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:06.193539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-09ed96db-da51-44de-aae0-7fd96779b769 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:06.205319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=10 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:06.212840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ed96db-da51-44de-aae0-7fd96779b769 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:06.214321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ed96db-da51-44de-aae0-7fd96779b769 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:06.215976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ed96db-da51-44de-aae0-7fd96779b769 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:06.217575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ed96db-da51-44de-aae0-7fd96779b769 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:06.218311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ed96db-da51-44de-aae0-7fd96779b769 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:06.218940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ed96db-da51-44de-aae0-7fd96779b769 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:07.019183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-09ed96db-da51-44de-aae0-7fd96779b769 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:07.038476 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-09ed96db-da51-44de-aae0-7fd96779b769 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.849853 Aug 27 04:32:07.041118 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 66/142] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:06 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:07.044324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-09ed96db-da51-44de-aae0-7fd96779b769 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:07.046367 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-09ed96db-da51-44de-aae0-7fd96779b769 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003425 Aug 27 04:32:07.054867 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 67/143] 10.222.0.79 () {56 vars in 886 bytes} [Sat Aug 27 04:32:07 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 04:32:07.120749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5595525f-4b39-42d5-8ff6-702988c4f180 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:07.133914 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5595525f-4b39-42d5-8ff6-702988c4f180 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 1.197666 Aug 27 04:32:07.137754 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 77/144] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:05 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:08.005654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-202f8977-05f3-4fd7-a178-bef24d842c9c req-82b907f6-b00a-4253-ae15-1432bb361b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95fe425c-a241-46b8-84d0-9ec136716def", "tag": "c70e59e4-bb46-46e8-aa91-27de81821024"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:08.051708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-202f8977-05f3-4fd7-a178-bef24d842c9c req-82b907f6-b00a-4253-ae15-1432bb361b69 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:08.053964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-202f8977-05f3-4fd7-a178-bef24d842c9c req-82b907f6-b00a-4253-ae15-1432bb361b69 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:08.056127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-202f8977-05f3-4fd7-a178-bef24d842c9c req-82b907f6-b00a-4253-ae15-1432bb361b69 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:08.084166 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-202f8977-05f3-4fd7-a178-bef24d842c9c req-82b907f6-b00a-4253-ae15-1432bb361b69 service nova] Creating event network-changed:c70e59e4-bb46-46e8-aa91-27de81821024 for instance 95fe425c-a241-46b8-84d0-9ec136716def on n-h1-854823-1 Aug 27 04:32:08.097809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-850d822a-ce6f-4cdb-b1bf-fd5d9db6acbb tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-376535193", "id": 1355441685, "os-flavor-access:is_public": "False"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:08.099261 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-202f8977-05f3-4fd7-a178-bef24d842c9c req-82b907f6-b00a-4253-ae15-1432bb361b69 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094795 Aug 27 04:32:08.103012 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 78/145] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:08.143753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-772daf91-fa3d-49f1-92be-405f21378e02 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:08.146724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-772daf91-fa3d-49f1-92be-405f21378e02 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:08.158822 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-850d822a-ce6f-4cdb-b1bf-fd5d9db6acbb tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.587387 Aug 27 04:32:08.165755 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 68/146] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:32:07 2022] POST /compute/v2.1/flavors => generated 430 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:32:08.187397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-772daf91-fa3d-49f1-92be-405f21378e02 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:08.188605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-772daf91-fa3d-49f1-92be-405f21378e02 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:08.190025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b3e5b9d3-4692-4510-8397-1a15c79e32a1 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:08.190733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-772daf91-fa3d-49f1-92be-405f21378e02 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:08.192211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-772daf91-fa3d-49f1-92be-405f21378e02 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:08.193890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b3e5b9d3-4692-4510-8397-1a15c79e32a1 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:08.195330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-772daf91-fa3d-49f1-92be-405f21378e02 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:08.200049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-772daf91-fa3d-49f1-92be-405f21378e02 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:08.225333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3e5b9d3-4692-4510-8397-1a15c79e32a1 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:08.225902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3e5b9d3-4692-4510-8397-1a15c79e32a1 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:08.228557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3e5b9d3-4692-4510-8397-1a15c79e32a1 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:08.232013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3e5b9d3-4692-4510-8397-1a15c79e32a1 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:08.235607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3e5b9d3-4692-4510-8397-1a15c79e32a1 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:08.237067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3e5b9d3-4692-4510-8397-1a15c79e32a1 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:08.696732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b3e5b9d3-4692-4510-8397-1a15c79e32a1 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:08.708159 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b3e5b9d3-4692-4510-8397-1a15c79e32a1 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 0.531267 Aug 27 04:32:08.715531 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 69/147] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:08 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:08.729514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aab5c521-8e54-4fab-bd11-98a8f1ebd2ee tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "aaf72c69837547a3bf64c6176a691c20"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:08.889641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-772daf91-fa3d-49f1-92be-405f21378e02 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:08.892632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=83 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:08.901281 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-772daf91-fa3d-49f1-92be-405f21378e02 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.796238 Aug 27 04:32:08.902697 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 79/148] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:08 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:09.429463 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aab5c521-8e54-4fab-bd11-98a8f1ebd2ee tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1355441685/action" status: 200 len: 97 microversion: 2.1 time: 0.712594 Aug 27 04:32:09.430569 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 70/149] 10.222.0.79 () {60 vars in 1200 bytes} [Sat Aug 27 04:32:08 2022] POST /compute/v2.1/flavors/1355441685/action => generated 97 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:32:09.742007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6fd2ebbb-0747-42a6-a1c9-6514285c690c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:09.743192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6fd2ebbb-0747-42a6-a1c9-6514285c690c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:09.754546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fd2ebbb-0747-42a6-a1c9-6514285c690c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:09.755436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fd2ebbb-0747-42a6-a1c9-6514285c690c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:09.756270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fd2ebbb-0747-42a6-a1c9-6514285c690c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:09.757863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fd2ebbb-0747-42a6-a1c9-6514285c690c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:09.758696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fd2ebbb-0747-42a6-a1c9-6514285c690c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:09.759768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fd2ebbb-0747-42a6-a1c9-6514285c690c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:09.767483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=89 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:09.998930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e67539ff-8973-48c0-9123-75ddb682f40f tempest-FlavorsAccessTestJSON-1888218486 tempest-FlavorsAccessTestJSON-1888218486-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:10.079954 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e67539ff-8973-48c0-9123-75ddb682f40f tempest-FlavorsAccessTestJSON-1888218486 tempest-FlavorsAccessTestJSON-1888218486-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 6234 microversion: 2.1 time: 0.642627 Aug 27 04:32:10.083826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6fd2ebbb-0747-42a6-a1c9-6514285c690c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:10.095070 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6fd2ebbb-0747-42a6-a1c9-6514285c690c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 0.359363 Aug 27 04:32:10.100281 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 80/150] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:32:09 2022] GET /compute/v2.1/flavors/detail => generated 6234 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:10.113970 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 71/151] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:09 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:10.124279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c67bb6ef-9a35-4846-8410-57bca3928cd6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:10.125787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c67bb6ef-9a35-4846-8410-57bca3928cd6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:10.131549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1200197078", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "729764359", "adminPass": "***", "networks": [{"uuid": "a2b6b0d7-e838-42c3-acca-220a63c7efe1"}], "security_groups": [{"name": "tempest-securitygroup--1810346861"}], "key_name": "tempest-keypair-182086736", "user_data": "}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:10.146878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c67bb6ef-9a35-4846-8410-57bca3928cd6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:10.154223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c67bb6ef-9a35-4846-8410-57bca3928cd6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:10.155677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c67bb6ef-9a35-4846-8410-57bca3928cd6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:10.156823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c67bb6ef-9a35-4846-8410-57bca3928cd6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:10.157813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c67bb6ef-9a35-4846-8410-57bca3928cd6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:10.159423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c67bb6ef-9a35-4846-8410-57bca3928cd6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:10.459940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c67bb6ef-9a35-4846-8410-57bca3928cd6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:10.470671 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c67bb6ef-9a35-4846-8410-57bca3928cd6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.367471 Aug 27 04:32:10.471952 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 81/152] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:10 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:10.476909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a62963ba-97a6-4066-9c29-1dc7fec892ff tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "aaf72c69837547a3bf64c6176a691c20"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:10.842191 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a62963ba-97a6-4066-9c29-1dc7fec892ff tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1355441685/action" status: 200 len: 21 microversion: 2.1 time: 0.366376 Aug 27 04:32:10.850965 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 82/153] 10.222.0.79 () {60 vars in 1200 bytes} [Sat Aug 27 04:32:10 2022] POST /compute/v2.1/flavors/1355441685/action => generated 21 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:32:10.857059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e161c53-e3c9-4c85-a688-91d75ae5dedb tempest-FlavorsAccessTestJSON-1888218486 tempest-FlavorsAccessTestJSON-1888218486-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:10.982311 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e161c53-e3c9-4c85-a688-91d75ae5dedb tempest-FlavorsAccessTestJSON-1888218486 tempest-FlavorsAccessTestJSON-1888218486-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.129762 Aug 27 04:32:10.984856 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 83/154] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:32:10 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:11.002462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c6f8ec08-5983-43bc-8588-a0d6983dd45a tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:11.072088 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c6f8ec08-5983-43bc-8588-a0d6983dd45a tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1355441685" status: 202 len: 0 microversion: 2.1 time: 0.073858 Aug 27 04:32:11.076145 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 84/155] 10.222.0.79 () {58 vars in 1161 bytes} [Sat Aug 27 04:32:10 2022] DELETE /compute/v2.1/flavors/1355441685 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:11.087261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4574326c-fa74-4530-a67a-d110b022629d tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:11.138461 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4574326c-fa74-4530-a67a-d110b022629d tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.058103 Aug 27 04:32:11.141619 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 85/156] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:32:11 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:11.153791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e84b6cf-977d-4b3e-864a-976fbae8773b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:11.157966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e84b6cf-977d-4b3e-864a-976fbae8773b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:11.168950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e84b6cf-977d-4b3e-864a-976fbae8773b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:11.172221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e84b6cf-977d-4b3e-864a-976fbae8773b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:11.173594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e84b6cf-977d-4b3e-864a-976fbae8773b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:11.176232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e84b6cf-977d-4b3e-864a-976fbae8773b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:11.178124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e84b6cf-977d-4b3e-864a-976fbae8773b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:11.178866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e84b6cf-977d-4b3e-864a-976fbae8773b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:11.329091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] validate_networks() for [('a2b6b0d7-e838-42c3-acca-220a63c7efe1', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:32:11.361622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e84b6cf-977d-4b3e-864a-976fbae8773b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:11.372309 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e84b6cf-977d-4b3e-864a-976fbae8773b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 0.228122 Aug 27 04:32:11.386931 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 86/157] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:11 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:11.394710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec6aa0b3-8899-45a3-807f-020f32ddd529 tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-462803120", "id": 659171917, "os-flavor-access:is_public": "False"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:11.416992 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec6aa0b3-8899-45a3-807f-020f32ddd529 tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.028107 Aug 27 04:32:11.418818 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 87/158] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:32:11 2022] POST /compute/v2.1/flavors => generated 427 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:11.434352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cd459df-92b9-4ff8-a9ac-ba0222179b51 tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:11.459120 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2cd459df-92b9-4ff8-a9ac-ba0222179b51 tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/659171917/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.032716 Aug 27 04:32:11.461594 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 88/159] 10.222.0.79 () {58 vars in 1206 bytes} [Sat Aug 27 04:32:11 2022] GET /compute/v2.1/flavors/659171917/os-flavor-access => generated 21 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:32:11.475648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64a17771-681e-46e8-aaaf-2c8cb521b2ba tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:11.505698 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64a17771-681e-46e8-aaaf-2c8cb521b2ba tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/659171917" status: 202 len: 0 microversion: 2.1 time: 0.038837 Aug 27 04:32:11.506945 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 89/160] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 04:32:11 2022] DELETE /compute/v2.1/flavors/659171917 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:11.512751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4abe5860-e655-4721-aa06-a90eb5858f82 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:11.513754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4abe5860-e655-4721-aa06-a90eb5858f82 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:11.520869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4abe5860-e655-4721-aa06-a90eb5858f82 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:11.521781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4abe5860-e655-4721-aa06-a90eb5858f82 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:11.526417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4abe5860-e655-4721-aa06-a90eb5858f82 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:11.527455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4abe5860-e655-4721-aa06-a90eb5858f82 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:11.528086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4abe5860-e655-4721-aa06-a90eb5858f82 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:11.528802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4abe5860-e655-4721-aa06-a90eb5858f82 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:11.701054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4abe5860-e655-4721-aa06-a90eb5858f82 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:11.711463 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4abe5860-e655-4721-aa06-a90eb5858f82 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.203002 Aug 27 04:32:11.712861 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 90/161] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:11 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:11.718583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-766ab1af-d2e4-4be5-b9dc-9d4b5b6a89eb tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:11.747719 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-766ab1af-d2e4-4be5-b9dc-9d4b5b6a89eb tempest-FlavorsAccessTestJSON-1692931563 tempest-FlavorsAccessTestJSON-1692931563-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.032774 Aug 27 04:32:11.748838 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 91/162] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:32:11 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:12.394794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4378a653-0041-4c78-b7b4-bfe285282a31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:12.396107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4378a653-0041-4c78-b7b4-bfe285282a31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:12.404395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4378a653-0041-4c78-b7b4-bfe285282a31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:12.406794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4378a653-0041-4c78-b7b4-bfe285282a31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:12.407331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4378a653-0041-4c78-b7b4-bfe285282a31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:12.411432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:32:12.412979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:32:12.414003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:32:12.414611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:32:12.415340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:32:12.423026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4378a653-0041-4c78-b7b4-bfe285282a31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:12.426006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4378a653-0041-4c78-b7b4-bfe285282a31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:12.427320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4378a653-0041-4c78-b7b4-bfe285282a31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:12.434522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:12.437515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:12.438686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:12.439712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:12.440381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:12.441048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:12.462057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Getting quotas for project dbfb6b35f0604c108f1b30f3f7a853bc. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:32:12.467425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Getting quotas for user 50d4329bce764315901687e5ffb1f645 and project dbfb6b35f0604c108f1b30f3f7a853bc. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:32:12.488808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:32:12.492356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:32:12.498553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:12.581075 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d8d1a8fd-10b2-4046-a285-6120fc85090b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.465852 Aug 27 04:32:12.585511 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 72/163] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:32:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 2471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:32:12.599393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dad5d9ab-8168-410c-8447-d10115241782 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:12.601478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dad5d9ab-8168-410c-8447-d10115241782 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:12.677731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4378a653-0041-4c78-b7b4-bfe285282a31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:12.686529 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4378a653-0041-4c78-b7b4-bfe285282a31 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 0.296112 Aug 27 04:32:12.688383 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 92/164] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:12 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:12.727795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dad5d9ab-8168-410c-8447-d10115241782 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:12.735038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03e5aac7-7bb1-40ab-816a-c83d870c6265 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:12.735645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03e5aac7-7bb1-40ab-816a-c83d870c6265 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:12.740479 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dad5d9ab-8168-410c-8447-d10115241782 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 200 len: 1262 microversion: 2.1 time: 0.147622 Aug 27 04:32:12.746088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03e5aac7-7bb1-40ab-816a-c83d870c6265 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:12.746697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03e5aac7-7bb1-40ab-816a-c83d870c6265 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:12.747134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03e5aac7-7bb1-40ab-816a-c83d870c6265 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:12.747831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03e5aac7-7bb1-40ab-816a-c83d870c6265 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:12.748281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03e5aac7-7bb1-40ab-816a-c83d870c6265 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:12.748729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03e5aac7-7bb1-40ab-816a-c83d870c6265 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:12.753543 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 73/165] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:12 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 1262 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:12.965438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-03e5aac7-7bb1-40ab-816a-c83d870c6265 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:12.976489 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03e5aac7-7bb1-40ab-816a-c83d870c6265 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.245112 Aug 27 04:32:12.977653 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 93/166] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:12 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:13.138717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ccee52c8-7bf3-4591-8dea-05be7cbd6393 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Calling method '.version_select at 0x7f1f227dd5e0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:13.141514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccee52c8-7bf3-4591-8dea-05be7cbd6393 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.142181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccee52c8-7bf3-4591-8dea-05be7cbd6393 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.143539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccee52c8-7bf3-4591-8dea-05be7cbd6393 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.165825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccee52c8-7bf3-4591-8dea-05be7cbd6393 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.167644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccee52c8-7bf3-4591-8dea-05be7cbd6393 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.168135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccee52c8-7bf3-4591-8dea-05be7cbd6393 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.184683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccee52c8-7bf3-4591-8dea-05be7cbd6393 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.185229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccee52c8-7bf3-4591-8dea-05be7cbd6393 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.185671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccee52c8-7bf3-4591-8dea-05be7cbd6393 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.193284 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ccee52c8-7bf3-4591-8dea-05be7cbd6393 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.438385 Aug 27 04:32:13.194090 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 74/167] 10.222.0.79 () {60 vars in 1187 bytes} [Sat Aug 27 04:32:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:13.207741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e55cb4a-beae-48b4-ab05-2def64b01139 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Calling method '.version_select at 0x7f1f22505f70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:13.210459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e55cb4a-beae-48b4-ab05-2def64b01139 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.210987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e55cb4a-beae-48b4-ab05-2def64b01139 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.211496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e55cb4a-beae-48b4-ab05-2def64b01139 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.236382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e55cb4a-beae-48b4-ab05-2def64b01139 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.236897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e55cb4a-beae-48b4-ab05-2def64b01139 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.237329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e55cb4a-beae-48b4-ab05-2def64b01139 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.244968 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e55cb4a-beae-48b4-ab05-2def64b01139 tempest-HypervisorAdminV228Test-1909431911 tempest-HypervisorAdminV228Test-1909431911-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.042859 Aug 27 04:32:13.245882 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 94/168] 10.222.0.79 () {60 vars in 1193 bytes} [Sat Aug 27 04:32:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:32:13.709046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-201a74d9-4d99-46f7-919e-061c0f31576f tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:13.709980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-201a74d9-4d99-46f7-919e-061c0f31576f tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:13.712219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:13.720129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-201a74d9-4d99-46f7-919e-061c0f31576f tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.721478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-201a74d9-4d99-46f7-919e-061c0f31576f tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.721929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-201a74d9-4d99-46f7-919e-061c0f31576f tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.722652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-201a74d9-4d99-46f7-919e-061c0f31576f tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.723236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-201a74d9-4d99-46f7-919e-061c0f31576f tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.723740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-201a74d9-4d99-46f7-919e-061c0f31576f tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.841734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-07c9c664-3d9b-4c67-bf6e-ed7c512c1d51 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Calling method '.version_select at 0x7f1f2295d1f0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:13.845521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c9c664-3d9b-4c67-bf6e-ed7c512c1d51 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.846012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c9c664-3d9b-4c67-bf6e-ed7c512c1d51 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.846443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c9c664-3d9b-4c67-bf6e-ed7c512c1d51 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.847180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c9c664-3d9b-4c67-bf6e-ed7c512c1d51 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.847637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c9c664-3d9b-4c67-bf6e-ed7c512c1d51 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.848057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c9c664-3d9b-4c67-bf6e-ed7c512c1d51 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.880729 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-07c9c664-3d9b-4c67-bf6e-ed7c512c1d51 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.377527 Aug 27 04:32:13.882105 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 75/169] 10.222.0.79 () {58 vars in 1128 bytes} [Sat Aug 27 04:32:13 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:13.885901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-201a74d9-4d99-46f7-919e-061c0f31576f tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:13.888476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-691e547f-b092-49f4-98f1-866081909800 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:13.889778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-691e547f-b092-49f4-98f1-866081909800 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:13.896113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-691e547f-b092-49f4-98f1-866081909800 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.896943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-691e547f-b092-49f4-98f1-866081909800 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.897620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-691e547f-b092-49f4-98f1-866081909800 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.897905 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-201a74d9-4d99-46f7-919e-061c0f31576f tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 0.192759 Aug 27 04:32:13.898628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-691e547f-b092-49f4-98f1-866081909800 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.899294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-691e547f-b092-49f4-98f1-866081909800 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.899993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-691e547f-b092-49f4-98f1-866081909800 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.912749 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 95/170] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:13 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:13.918954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-16ee22af-2cda-4510-9a61-bffb97007b38 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Calling method '.version_select at 0x7f1f2253d430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:13.923072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16ee22af-2cda-4510-9a61-bffb97007b38 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.923741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16ee22af-2cda-4510-9a61-bffb97007b38 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.924355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16ee22af-2cda-4510-9a61-bffb97007b38 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.925759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16ee22af-2cda-4510-9a61-bffb97007b38 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.926391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16ee22af-2cda-4510-9a61-bffb97007b38 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.927107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16ee22af-2cda-4510-9a61-bffb97007b38 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.959243 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-16ee22af-2cda-4510-9a61-bffb97007b38 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.045325 Aug 27 04:32:13.960436 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 96/171] 10.222.0.79 () {58 vars in 1139 bytes} [Sat Aug 27 04:32:13 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:13.978227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d31b5b49-af57-46a1-bbdf-ffa8a5d9f05f tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Calling method '.version_select at 0x7f1f22505c10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:13.980488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-691e547f-b092-49f4-98f1-866081909800 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:13.983893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31b5b49-af57-46a1-bbdf-ffa8a5d9f05f tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.985019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31b5b49-af57-46a1-bbdf-ffa8a5d9f05f tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.986161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31b5b49-af57-46a1-bbdf-ffa8a5d9f05f tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.987148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31b5b49-af57-46a1-bbdf-ffa8a5d9f05f tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:13.987816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31b5b49-af57-46a1-bbdf-ffa8a5d9f05f tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:13.988452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31b5b49-af57-46a1-bbdf-ffa8a5d9f05f tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:13.989406 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-691e547f-b092-49f4-98f1-866081909800 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 200 len: 1336 microversion: 2.1 time: 0.106015 Aug 27 04:32:13.990683 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 76/172] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:13 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 1336 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:14.000208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5d52ea4b-7aea-4828-8a9a-5fbb8bd4610c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:14.000853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5d52ea4b-7aea-4828-8a9a-5fbb8bd4610c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:14.012478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d52ea4b-7aea-4828-8a9a-5fbb8bd4610c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:14.013625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d52ea4b-7aea-4828-8a9a-5fbb8bd4610c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:14.014487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d52ea4b-7aea-4828-8a9a-5fbb8bd4610c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:14.015664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d52ea4b-7aea-4828-8a9a-5fbb8bd4610c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:14.016773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d52ea4b-7aea-4828-8a9a-5fbb8bd4610c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:14.017631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d52ea4b-7aea-4828-8a9a-5fbb8bd4610c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:14.040250 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d31b5b49-af57-46a1-bbdf-ffa8a5d9f05f tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.071401 Aug 27 04:32:14.047996 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 97/173] 10.222.0.79 () {58 vars in 1145 bytes} [Sat Aug 27 04:32:13 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:32:14.292785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5d52ea4b-7aea-4828-8a9a-5fbb8bd4610c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:14.307261 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5d52ea4b-7aea-4828-8a9a-5fbb8bd4610c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.311826 Aug 27 04:32:14.323300 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 77/174] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:13 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:14.928281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31909efc-571f-45a8-b9de-ae1c7336e950 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:14.929920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31909efc-571f-45a8-b9de-ae1c7336e950 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:14.941055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31909efc-571f-45a8-b9de-ae1c7336e950 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:14.941685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31909efc-571f-45a8-b9de-ae1c7336e950 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:14.942135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31909efc-571f-45a8-b9de-ae1c7336e950 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:14.943086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31909efc-571f-45a8-b9de-ae1c7336e950 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:14.943558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31909efc-571f-45a8-b9de-ae1c7336e950 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:14.943991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31909efc-571f-45a8-b9de-ae1c7336e950 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:15.014748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4ec468e5-48f3-46d9-828f-46de9ec93922 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:15.015464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4ec468e5-48f3-46d9-828f-46de9ec93922 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:15.017569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:15.027401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ec468e5-48f3-46d9-828f-46de9ec93922 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:15.034589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ec468e5-48f3-46d9-828f-46de9ec93922 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:15.035261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ec468e5-48f3-46d9-828f-46de9ec93922 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:15.036163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ec468e5-48f3-46d9-828f-46de9ec93922 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:15.038737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ec468e5-48f3-46d9-828f-46de9ec93922 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:15.039338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ec468e5-48f3-46d9-828f-46de9ec93922 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:15.216162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4ec468e5-48f3-46d9-828f-46de9ec93922 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:15.229971 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4ec468e5-48f3-46d9-828f-46de9ec93922 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 200 len: 1342 microversion: 2.1 time: 0.219852 Aug 27 04:32:15.234184 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 78/175] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:15 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 1342 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:15.284190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31909efc-571f-45a8-b9de-ae1c7336e950 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:15.293695 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31909efc-571f-45a8-b9de-ae1c7336e950 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 0.374777 Aug 27 04:32:15.298429 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 98/176] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:14 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:15.333487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4fd5e4e4-a260-42e5-a9ef-b9f433bdbf70 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:15.334252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4fd5e4e4-a260-42e5-a9ef-b9f433bdbf70 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:15.345656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fd5e4e4-a260-42e5-a9ef-b9f433bdbf70 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:15.346149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fd5e4e4-a260-42e5-a9ef-b9f433bdbf70 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:15.346581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fd5e4e4-a260-42e5-a9ef-b9f433bdbf70 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:15.356569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fd5e4e4-a260-42e5-a9ef-b9f433bdbf70 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:15.357341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fd5e4e4-a260-42e5-a9ef-b9f433bdbf70 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:15.357995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fd5e4e4-a260-42e5-a9ef-b9f433bdbf70 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:15.539388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4fd5e4e4-a260-42e5-a9ef-b9f433bdbf70 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:15.547581 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4fd5e4e4-a260-42e5-a9ef-b9f433bdbf70 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.218183 Aug 27 04:32:15.561212 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 79/177] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:15 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:15.802879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c290c7b-3d31-4a6f-8c85-57842f01e37a tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Calling method '.version_select at 0x7f1f22505a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:15.809576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c290c7b-3d31-4a6f-8c85-57842f01e37a tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:15.810073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c290c7b-3d31-4a6f-8c85-57842f01e37a tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:15.810513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c290c7b-3d31-4a6f-8c85-57842f01e37a tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:15.811260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c290c7b-3d31-4a6f-8c85-57842f01e37a tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:15.811717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c290c7b-3d31-4a6f-8c85-57842f01e37a tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:15.812134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c290c7b-3d31-4a6f-8c85-57842f01e37a tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:15.856466 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c290c7b-3d31-4a6f-8c85-57842f01e37a tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.266902 Aug 27 04:32:15.863163 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 99/178] 10.222.0.79 () {58 vars in 1128 bytes} [Sat Aug 27 04:32:15 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:15.999357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aba3112c-b162-46e3-8078-b3e83611c8b7 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Calling method '.version_select at 0x7f1f22775ee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:16.003131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aba3112c-b162-46e3-8078-b3e83611c8b7 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'acfd03872e864b37aa848f4460884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3a8d66f1b8462f82f4abc0ca50d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aba3112c-b162-46e3-8078-b3e83611c8b7 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Request method failure captured: Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5Om3y5sE8SMtgIkYWQ8MeLNT23Y4Rn55XtIPiduYxq2jJY41VUVqDZ1nGFGdTVOMtz1oGWeQxit50Ac-R59EBiOS7KN4YL3yAvAqHtd7c-hPUg7lzQlhjW4VLLTDQIuvXCQAPNQywtMPQgl84C8KGV-isoSsjBvmAcnRox7Qckbwg Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: af3a8d66f1b8462f82f4abc0ca50d5d2 Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:32:16.005609 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:32:16.006779 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:16.006779 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.006779 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: af3a8d66f1b8462f82f4abc0ca50d5d2 Aug 27 04:32:16.006779 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.006779 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-HostsAdminNegativeTestJSON-533607368-project Aug 27 04:32:16.006779 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:16.006779 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:16.006779 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: acfd03872e864b37aa848f4460884278 Aug 27 04:32:16.006779 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-HostsAdminNegativeTestJSON-533607368-project Aug 27 04:32:16.006779 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:32:16.006779 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 04:32:16.006779 n-d-854823-1 devstack@n-api.service[128870]: action_args: {} Aug 27 04:32:16.006779 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:16.007500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 04:32:16.008627 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.011144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aba3112c-b162-46e3-8078-b3e83611c8b7 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:16.012185 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aba3112c-b162-46e3-8078-b3e83611c8b7 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.147779 Aug 27 04:32:16.013269 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 80/179] 10.222.0.79 () {58 vars in 1128 bytes} [Sat Aug 27 04:32:15 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 149 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:16.022284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66f308ad-05e1-4a3e-8b4f-1531da82220e tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Calling method '.version_select at 0x7f1f225058b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:16.024908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66f308ad-05e1-4a3e-8b4f-1531da82220e tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'acfd03872e864b37aa848f4460884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3a8d66f1b8462f82f4abc0ca50d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66f308ad-05e1-4a3e-8b4f-1531da82220e tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Request method failure captured: Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hosts/n-d-854823-1/reboot HTTP/1.1 Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5Om3y5sE8SMtgIkYWQ8MeLNT23Y4Rn55XtIPiduYxq2jJY41VUVqDZ1nGFGdTVOMtz1oGWeQxit50Ac-R59EBiOS7KN4YL3yAvAqHtd7c-hPUg7lzQlhjW4VLLTDQIuvXCQAPNQywtMPQgl84C8KGV-isoSsjBvmAcnRox7Qckbwg Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: af3a8d66f1b8462f82f4abc0ca50d5d2 Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:32:16.027922 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:32:16.029365 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:16.029365 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.029365 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: af3a8d66f1b8462f82f4abc0ca50d5d2 Aug 27 04:32:16.029365 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.029365 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-HostsAdminNegativeTestJSON-533607368-project Aug 27 04:32:16.029365 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:32:16.029365 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:32:16.029365 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: acfd03872e864b37aa848f4460884278 Aug 27 04:32:16.029365 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-HostsAdminNegativeTestJSON-533607368-project Aug 27 04:32:16.029365 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:32:16.029365 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 04:32:16.029365 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'n-d-854823-1'} Aug 27 04:32:16.029365 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:16.030073 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 04:32:16.031063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.032938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66f308ad-05e1-4a3e-8b4f-1531da82220e tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:16.034492 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66f308ad-05e1-4a3e-8b4f-1531da82220e tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-854823-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.016053 Aug 27 04:32:16.037556 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 100/180] 10.222.0.79 () {58 vars in 1188 bytes} [Sat Aug 27 04:32:16 2022] GET /compute/v2.1/os-hosts/n-d-854823-1/reboot => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:32:16.046697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cd8dc7c2-fbe9-4186-9652-921811cc370a tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Calling method '.version_select at 0x7f1f227121f0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:16.060694 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-cd8dc7c2-fbe9-4186-9652-921811cc370a tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cd8dc7c2-fbe9-4186-9652-921811cc370a tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Request method failure captured: Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5P154fiV1g5uml0ttT2_BMZkcV5vIgtQko1BiOSiSYVSkqmWPgJLkGNpSD59pe5Nnb9RrVtWy3jLqHqpp5w42DSUG8Cngd9c4GNAvqM0LXWYk8HIn9mzuwE-x03XIy_dB3CivX2vhjDpLWhw3xlFdvPExtGLHi-0N78x_s1MfIoJw Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:32:16.063006 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:32:16.064254 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:16.064254 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.064254 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.064254 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.064254 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.064254 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:16.064254 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:16.064254 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: fe7491f4bdbb4439ba0fe43d68836d6f Aug 27 04:32:16.064254 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.064254 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:32:16.064254 n-d-854823-1 devstack@n-api.service[128870]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.064254 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'nonexistent_hostname'} Aug 27 04:32:16.064254 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:32:16.065003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 04:32:16.066099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:32:16.067184 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.067184 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.067184 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.067184 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.067184 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.067184 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.067184 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.067184 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:16.067184 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:16.067184 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.067184 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.067184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cd8dc7c2-fbe9-4186-9652-921811cc370a tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:16.067184 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cd8dc7c2-fbe9-4186-9652-921811cc370a tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.024568 Aug 27 04:32:16.072915 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 81/181] 10.222.0.79 () {58 vars in 1212 bytes} [Sat Aug 27 04:32:16 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 04:32:16.079090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34c6edc5-19a4-4257-90f1-4ed5283da60c tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Calling method '.version_select at 0x7f1f2253dca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:16.081860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34c6edc5-19a4-4257-90f1-4ed5283da60c tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'acfd03872e864b37aa848f4460884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3a8d66f1b8462f82f4abc0ca50d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34c6edc5-19a4-4257-90f1-4ed5283da60c tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Request method failure captured: Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hosts/n-d-854823-1 HTTP/1.1 Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5Om3y5sE8SMtgIkYWQ8MeLNT23Y4Rn55XtIPiduYxq2jJY41VUVqDZ1nGFGdTVOMtz1oGWeQxit50Ac-R59EBiOS7KN4YL3yAvAqHtd7c-hPUg7lzQlhjW4VLLTDQIuvXCQAPNQywtMPQgl84C8KGV-isoSsjBvmAcnRox7Qckbwg Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: af3a8d66f1b8462f82f4abc0ca50d5d2 Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:32:16.084045 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:32:16.086430 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:16.086430 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.086430 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: af3a8d66f1b8462f82f4abc0ca50d5d2 Aug 27 04:32:16.086430 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.086430 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-HostsAdminNegativeTestJSON-533607368-project Aug 27 04:32:16.086430 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:32:16.086430 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:32:16.086430 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: acfd03872e864b37aa848f4460884278 Aug 27 04:32:16.086430 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-HostsAdminNegativeTestJSON-533607368-project Aug 27 04:32:16.086430 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:32:16.086430 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 04:32:16.086430 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'n-d-854823-1'} Aug 27 04:32:16.086430 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:16.088246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 04:32:16.090081 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.095984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34c6edc5-19a4-4257-90f1-4ed5283da60c tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:16.095984 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34c6edc5-19a4-4257-90f1-4ed5283da60c tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-854823-1" status: 403 len: 109 microversion: 2.1 time: 0.010936 Aug 27 04:32:16.095984 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 101/182] 10.222.0.79 () {58 vars in 1167 bytes} [Sat Aug 27 04:32:16 2022] GET /compute/v2.1/os-hosts/n-d-854823-1 => generated 109 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:16.097740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5dd7d3e0-f39e-4878-94c7-8644a59be56b tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Calling method '.version_select at 0x7f1f22775160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:16.105865 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-5dd7d3e0-f39e-4878-94c7-8644a59be56b tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5dd7d3e0-f39e-4878-94c7-8644a59be56b tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Request method failure captured: Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5P154fiV1g5uml0ttT2_BMZkcV5vIgtQko1BiOSiSYVSkqmWPgJLkGNpSD59pe5Nnb9RrVtWy3jLqHqpp5w42DSUG8Cngd9c4GNAvqM0LXWYk8HIn9mzuwE-x03XIy_dB3CivX2vhjDpLWhw3xlFdvPExtGLHi-0N78x_s1MfIoJw Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:32:16.107410 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:32:16.114348 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:16.114348 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.114348 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.114348 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.114348 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.114348 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:16.114348 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:16.114348 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: fe7491f4bdbb4439ba0fe43d68836d6f Aug 27 04:32:16.114348 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.114348 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:32:16.114348 n-d-854823-1 devstack@n-api.service[128870]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.114348 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'nonexistent_hostname'} Aug 27 04:32:16.114348 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.115275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.116350 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.118684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5dd7d3e0-f39e-4878-94c7-8644a59be56b tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:16.118684 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5dd7d3e0-f39e-4878-94c7-8644a59be56b tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.015674 Aug 27 04:32:16.118684 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 82/183] 10.222.0.79 () {58 vars in 1191 bytes} [Sat Aug 27 04:32:16 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 04:32:16.124273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25841ad6-f057-4f98-ab7d-d338fe9abdf2 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Calling method '.version_select at 0x7f1f225058b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:16.126244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25841ad6-f057-4f98-ab7d-d338fe9abdf2 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'acfd03872e864b37aa848f4460884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3a8d66f1b8462f82f4abc0ca50d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25841ad6-f057-4f98-ab7d-d338fe9abdf2 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Request method failure captured: Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hosts/n-d-854823-1/shutdown HTTP/1.1 Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5Om3y5sE8SMtgIkYWQ8MeLNT23Y4Rn55XtIPiduYxq2jJY41VUVqDZ1nGFGdTVOMtz1oGWeQxit50Ac-R59EBiOS7KN4YL3yAvAqHtd7c-hPUg7lzQlhjW4VLLTDQIuvXCQAPNQywtMPQgl84C8KGV-isoSsjBvmAcnRox7Qckbwg Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: af3a8d66f1b8462f82f4abc0ca50d5d2 Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:32:16.128307 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:32:16.129508 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:16.129508 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.129508 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: af3a8d66f1b8462f82f4abc0ca50d5d2 Aug 27 04:32:16.129508 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.129508 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-HostsAdminNegativeTestJSON-533607368-project Aug 27 04:32:16.129508 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:32:16.129508 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:32:16.129508 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: acfd03872e864b37aa848f4460884278 Aug 27 04:32:16.129508 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-HostsAdminNegativeTestJSON-533607368-project Aug 27 04:32:16.129508 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:32:16.129508 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 04:32:16.129508 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'n-d-854823-1'} Aug 27 04:32:16.129508 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:16.130232 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 04:32:16.131288 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.132795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25841ad6-f057-4f98-ab7d-d338fe9abdf2 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:16.132795 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25841ad6-f057-4f98-ab7d-d338fe9abdf2 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-854823-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.010181 Aug 27 04:32:16.132795 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 102/184] 10.222.0.79 () {58 vars in 1194 bytes} [Sat Aug 27 04:32:16 2022] GET /compute/v2.1/os-hosts/n-d-854823-1/shutdown => generated 113 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:16.142020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c76e593-2eb6-4f3e-9f87-8f00691e09e1 tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Calling method '.version_select at 0x7f1f22775d30>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:16.152181 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-4c76e593-2eb6-4f3e-9f87-8f00691e09e1 tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c76e593-2eb6-4f3e-9f87-8f00691e09e1 tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Request method failure captured: Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5P154fiV1g5uml0ttT2_BMZkcV5vIgtQko1BiOSiSYVSkqmWPgJLkGNpSD59pe5Nnb9RrVtWy3jLqHqpp5w42DSUG8Cngd9c4GNAvqM0LXWYk8HIn9mzuwE-x03XIy_dB3CivX2vhjDpLWhw3xlFdvPExtGLHi-0N78x_s1MfIoJw Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:32:16.154419 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:32:16.155768 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:16.155768 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.155768 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.155768 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.155768 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.155768 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:16.155768 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:16.155768 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: fe7491f4bdbb4439ba0fe43d68836d6f Aug 27 04:32:16.155768 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.155768 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:32:16.155768 n-d-854823-1 devstack@n-api.service[128870]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.155768 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'nonexistent_hostname'} Aug 27 04:32:16.155768 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:32:16.156664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 04:32:16.157681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:32:16.158728 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.158728 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.158728 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.158728 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.158728 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.158728 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.158728 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.158728 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:16.158728 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:16.158728 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.158728 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.158728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c76e593-2eb6-4f3e-9f87-8f00691e09e1 tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:16.158728 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4c76e593-2eb6-4f3e-9f87-8f00691e09e1 tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.020586 Aug 27 04:32:16.165214 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 83/185] 10.222.0.79 () {58 vars in 1218 bytes} [Sat Aug 27 04:32:16 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:32:16.177413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b1144961-80bf-47b8-bc26-b0b4b2d3ca51 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Calling method '.version_select at 0x7f1f224dc280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:16.179935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b1144961-80bf-47b8-bc26-b0b4b2d3ca51 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'acfd03872e864b37aa848f4460884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3a8d66f1b8462f82f4abc0ca50d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b1144961-80bf-47b8-bc26-b0b4b2d3ca51 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Request method failure captured: Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hosts/n-d-854823-1/startup HTTP/1.1 Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5Om3y5sE8SMtgIkYWQ8MeLNT23Y4Rn55XtIPiduYxq2jJY41VUVqDZ1nGFGdTVOMtz1oGWeQxit50Ac-R59EBiOS7KN4YL3yAvAqHtd7c-hPUg7lzQlhjW4VLLTDQIuvXCQAPNQywtMPQgl84C8KGV-isoSsjBvmAcnRox7Qckbwg Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: af3a8d66f1b8462f82f4abc0ca50d5d2 Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:32:16.181709 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:32:16.182904 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:16.182904 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.182904 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: af3a8d66f1b8462f82f4abc0ca50d5d2 Aug 27 04:32:16.182904 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.182904 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-HostsAdminNegativeTestJSON-533607368-project Aug 27 04:32:16.182904 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:32:16.182904 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:32:16.182904 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: acfd03872e864b37aa848f4460884278 Aug 27 04:32:16.182904 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-HostsAdminNegativeTestJSON-533607368-project Aug 27 04:32:16.182904 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:32:16.182904 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 04:32:16.182904 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'n-d-854823-1'} Aug 27 04:32:16.182904 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:16.183630 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 04:32:16.189310 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.190675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b1144961-80bf-47b8-bc26-b0b4b2d3ca51 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:16.190675 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b1144961-80bf-47b8-bc26-b0b4b2d3ca51 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-854823-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.017935 Aug 27 04:32:16.190675 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 103/186] 10.222.0.79 () {58 vars in 1191 bytes} [Sat Aug 27 04:32:16 2022] GET /compute/v2.1/os-hosts/n-d-854823-1/startup => generated 110 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:16.204746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e51042cc-55ce-43c6-9979-b1c6bc2d76aa tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Calling method '.version_select at 0x7f1f22775af0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:16.214666 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-e51042cc-55ce-43c6-9979-b1c6bc2d76aa tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e51042cc-55ce-43c6-9979-b1c6bc2d76aa tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Request method failure captured: Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5P154fiV1g5uml0ttT2_BMZkcV5vIgtQko1BiOSiSYVSkqmWPgJLkGNpSD59pe5Nnb9RrVtWy3jLqHqpp5w42DSUG8Cngd9c4GNAvqM0LXWYk8HIn9mzuwE-x03XIy_dB3CivX2vhjDpLWhw3xlFdvPExtGLHi-0N78x_s1MfIoJw Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:32:16.216793 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:32:16.217884 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:16.217884 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.217884 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.217884 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.217884 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.217884 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:16.217884 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:16.217884 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: fe7491f4bdbb4439ba0fe43d68836d6f Aug 27 04:32:16.217884 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.217884 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:32:16.217884 n-d-854823-1 devstack@n-api.service[128870]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.217884 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'nonexistent_hostname'} Aug 27 04:32:16.217884 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:32:16.218584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 04:32:16.220690 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:32:16.221965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.221965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.221965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.221965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.221965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.221965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.221965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.221965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:16.221965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:16.221965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.221965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.221965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e51042cc-55ce-43c6-9979-b1c6bc2d76aa tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:16.221965 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e51042cc-55ce-43c6-9979-b1c6bc2d76aa tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.020885 Aug 27 04:32:16.223292 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 84/187] 10.222.0.79 () {58 vars in 1215 bytes} [Sat Aug 27 04:32:16 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:32:16.229086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3daf540-f5a5-4b9c-8cfc-39e6f54d4353 tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Action: 'update', calling method: .version_select at 0x7f1f2253dc10>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3daf540-f5a5-4b9c-8cfc-39e6f54d4353 tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Request method failure captured: Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: request: PUT /compute/v2.1/os-hosts/n-d-854823-1 HTTP/1.1 Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 51 Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5P154fiV1g5uml0ttT2_BMZkcV5vIgtQko1BiOSiSYVSkqmWPgJLkGNpSD59pe5Nnb9RrVtWy3jLqHqpp5w42DSUG8Cngd9c4GNAvqM0LXWYk8HIn9mzuwE-x03XIy_dB3CivX2vhjDpLWhw3xlFdvPExtGLHi-0N78x_s1MfIoJw Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:32:16.232846 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:32:16.233997 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:16.233997 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.233997 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.233997 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.233997 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.233997 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:32:16.233997 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:32:16.233997 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: fe7491f4bdbb4439ba0fe43d68836d6f Aug 27 04:32:16.233997 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.233997 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:32:16.233997 n-d-854823-1 devstack@n-api.service[128869]: {"status": "enable", "maintenance_mode": "invalid"} Aug 27 04:32:16.233997 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:32:16.233997 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'n-d-854823-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance: Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.236857 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.238315 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.239326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.239326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:32:16.239326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:32:16.239326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:32:16.239326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.239326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3daf540-f5a5-4b9c-8cfc-39e6f54d4353 tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:16.239326 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3daf540-f5a5-4b9c-8cfc-39e6f54d4353 tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-854823-1" status: 400 len: 199 microversion: 2.1 time: 0.010056 Aug 27 04:32:16.239326 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 104/188] 10.222.0.79 () {60 vars in 1187 bytes} [Sat Aug 27 04:32:16 2022] PUT /compute/v2.1/os-hosts/n-d-854823-1 => generated 199 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:32:16.245912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-69a19d43-b837-4958-9cb9-a89d291d255d tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Action: 'update', calling method: .version_select at 0x7f1f229f3c10>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:16.252485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23e313f5-9f91-4f68-9aa1-185339d5452c tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:16.253192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-23e313f5-9f91-4f68-9aa1-185339d5452c tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-69a19d43-b837-4958-9cb9-a89d291d255d tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Request method failure captured: Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: request: PUT /compute/v2.1/os-hosts/n-d-854823-1 HTTP/1.1 Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 51 Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5P154fiV1g5uml0ttT2_BMZkcV5vIgtQko1BiOSiSYVSkqmWPgJLkGNpSD59pe5Nnb9RrVtWy3jLqHqpp5w42DSUG8Cngd9c4GNAvqM0LXWYk8HIn9mzuwE-x03XIy_dB3CivX2vhjDpLWhw3xlFdvPExtGLHi-0N78x_s1MfIoJw Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:32:16.255129 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:32:16.256265 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:16.256265 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.256265 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.256265 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.256265 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.256265 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:16.256265 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:16.256265 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: fe7491f4bdbb4439ba0fe43d68836d6f Aug 27 04:32:16.256265 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.256265 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:32:16.256265 n-d-854823-1 devstack@n-api.service[128870]: {"status": "invalid", "maintenance_mode": "enable"} Aug 27 04:32:16.256265 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:32:16.256265 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'n-d-854823-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance: Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.257016 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.258280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.259284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.259284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:32:16.259284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:32:16.259284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 04:32:16.259284 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.260163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e313f5-9f91-4f68-9aa1-185339d5452c tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:16.261137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e313f5-9f91-4f68-9aa1-185339d5452c tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:16.261753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e313f5-9f91-4f68-9aa1-185339d5452c tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:16.261875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-69a19d43-b837-4958-9cb9-a89d291d255d tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:16.262741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e313f5-9f91-4f68-9aa1-185339d5452c tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:16.262936 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-69a19d43-b837-4958-9cb9-a89d291d255d tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-854823-1" status: 400 len: 189 microversion: 2.1 time: 0.020860 Aug 27 04:32:16.263505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e313f5-9f91-4f68-9aa1-185339d5452c tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:16.264087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e313f5-9f91-4f68-9aa1-185339d5452c tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:16.264216 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 85/189] 10.222.0.79 () {60 vars in 1187 bytes} [Sat Aug 27 04:32:16 2022] PUT /compute/v2.1/os-hosts/n-d-854823-1 => generated 189 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:32:16.273233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7bf882bc-aa61-47a6-b078-ee2056fcfb01 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Action: 'update', calling method: .version_select at 0x7f1f227755e0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:16.277488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7bf882bc-aa61-47a6-b078-ee2056fcfb01 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'acfd03872e864b37aa848f4460884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3a8d66f1b8462f82f4abc0ca50d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7bf882bc-aa61-47a6-b078-ee2056fcfb01 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Request method failure captured: Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: request: PUT /compute/v2.1/os-hosts/n-d-854823-1 HTTP/1.1 Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 50 Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5Om3y5sE8SMtgIkYWQ8MeLNT23Y4Rn55XtIPiduYxq2jJY41VUVqDZ1nGFGdTVOMtz1oGWeQxit50Ac-R59EBiOS7KN4YL3yAvAqHtd7c-hPUg7lzQlhjW4VLLTDQIuvXCQAPNQywtMPQgl84C8KGV-isoSsjBvmAcnRox7Qckbwg Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: af3a8d66f1b8462f82f4abc0ca50d5d2 Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:32:16.279508 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:32:16.280707 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af3a8d66f1b8462f82f4abc0ca50d5d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:16.280707 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.280707 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: af3a8d66f1b8462f82f4abc0ca50d5d2 Aug 27 04:32:16.280707 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-533607368 Aug 27 04:32:16.280707 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-HostsAdminNegativeTestJSON-533607368-project Aug 27 04:32:16.280707 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:16.280707 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:16.280707 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: acfd03872e864b37aa848f4460884278 Aug 27 04:32:16.280707 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-HostsAdminNegativeTestJSON-533607368-project Aug 27 04:32:16.280707 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:32:16.280707 n-d-854823-1 devstack@n-api.service[128870]: {"status": "enable", "maintenance_mode": "enable"} Aug 27 04:32:16.280707 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:32:16.280707 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 04:32:16.280707 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'n-d-854823-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:16.281483 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 04:32:16.282842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.284059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7bf882bc-aa61-47a6-b078-ee2056fcfb01 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:16.284059 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7bf882bc-aa61-47a6-b078-ee2056fcfb01 tempest-HostsAdminNegativeTestJSON-533607368 tempest-HostsAdminNegativeTestJSON-533607368-project] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-854823-1" status: 403 len: 111 microversion: 2.1 time: 0.012087 Aug 27 04:32:16.284059 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 86/190] 10.222.0.79 () {60 vars in 1187 bytes} [Sat Aug 27 04:32:16 2022] PUT /compute/v2.1/os-hosts/n-d-854823-1 => generated 111 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:32:16.291020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-39135945-ed49-4515-a95a-b089c062d467 tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Action: 'update', calling method: .version_select at 0x7f1f226e5940>, body: {"status": null, "maintenance_mode": null} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-39135945-ed49-4515-a95a-b089c062d467 tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Request method failure captured: Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: request: PUT /compute/v2.1/os-hosts/n-d-854823-1 HTTP/1.1 Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 42 Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5P154fiV1g5uml0ttT2_BMZkcV5vIgtQko1BiOSiSYVSkqmWPgJLkGNpSD59pe5Nnb9RrVtWy3jLqHqpp5w42DSUG8Cngd9c4GNAvqM0LXWYk8HIn9mzuwE-x03XIy_dB3CivX2vhjDpLWhw3xlFdvPExtGLHi-0N78x_s1MfIoJw Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:32:16.295931 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:32:16.297448 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:16.297448 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.297448 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.297448 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.297448 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.297448 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:16.297448 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:16.297448 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: fe7491f4bdbb4439ba0fe43d68836d6f Aug 27 04:32:16.297448 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.297448 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:32:16.297448 n-d-854823-1 devstack@n-api.service[128870]: {"status": null, "maintenance_mode": null} Aug 27 04:32:16.297448 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:32:16.297448 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 04:32:16.297448 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'n-d-854823-1', 'body': {'status': None, 'maintenance_mode': None}} Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance: Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi None Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.298215 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.299605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.300954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:32:16.300954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:32:16.300954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 04:32:16.300954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.300954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-39135945-ed49-4515-a95a-b089c062d467 tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:16.300954 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-39135945-ed49-4515-a95a-b089c062d467 tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-854823-1" status: 400 len: 127 microversion: 2.1 time: 0.011256 Aug 27 04:32:16.300954 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 87/191] 10.222.0.79 () {60 vars in 1187 bytes} [Sat Aug 27 04:32:16 2022] PUT /compute/v2.1/os-hosts/n-d-854823-1 => generated 127 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:32:16.311191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d1c7514-e039-405c-9c75-1a463b67ce9e tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Action: 'update', calling method: .version_select at 0x7f1f226e5670>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:16.314867 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.hosts [None req-9d1c7514-e039-405c-9c75-1a463b67ce9e tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Enabling host nonexistent_hostname. Aug 27 04:32:16.323768 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-9d1c7514-e039-405c-9c75-1a463b67ce9e tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d1c7514-e039-405c-9c75-1a463b67ce9e tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Request method failure captured: Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 50 Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5P154fiV1g5uml0ttT2_BMZkcV5vIgtQko1BiOSiSYVSkqmWPgJLkGNpSD59pe5Nnb9RrVtWy3jLqHqpp5w42DSUG8Cngd9c4GNAvqM0LXWYk8HIn9mzuwE-x03XIy_dB3CivX2vhjDpLWhw3xlFdvPExtGLHi-0N78x_s1MfIoJw Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:32:16.326352 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:32:16.327525 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19c99976a8d74e6593f8dbd23a2f08c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:16.327525 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.327525 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 19c99976a8d74e6593f8dbd23a2f08c3 Aug 27 04:32:16.327525 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2144042696 Aug 27 04:32:16.327525 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.327525 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:16.327525 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:16.327525 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: fe7491f4bdbb4439ba0fe43d68836d6f Aug 27 04:32:16.327525 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2144042696-project-admin Aug 27 04:32:16.327525 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:32:16.327525 n-d-854823-1 devstack@n-api.service[128870]: {"status": "enable", "maintenance_mode": "enable"} Aug 27 04:32:16.327525 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:32:16.327525 n-d-854823-1 devstack@n-api.service[128870]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.327525 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 04:32:16.328272 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:16.333669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:16.334842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d1c7514-e039-405c-9c75-1a463b67ce9e tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:16.335633 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9d1c7514-e039-405c-9c75-1a463b67ce9e tempest-HostsAdminNegativeTestJSON-2144042696 tempest-HostsAdminNegativeTestJSON-2144042696-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.020381 Aug 27 04:32:16.335633 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 88/192] 10.222.0.79 () {60 vars in 1211 bytes} [Sat Aug 27 04:32:16 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:32:16.335633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-17ffc657-ccb3-4057-a8b1-925bd1bc2d00 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:16.335633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-17ffc657-ccb3-4057-a8b1-925bd1bc2d00 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:16.342666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ffc657-ccb3-4057-a8b1-925bd1bc2d00 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:16.343158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ffc657-ccb3-4057-a8b1-925bd1bc2d00 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:16.344066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ffc657-ccb3-4057-a8b1-925bd1bc2d00 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:16.344971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ffc657-ccb3-4057-a8b1-925bd1bc2d00 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:16.345576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ffc657-ccb3-4057-a8b1-925bd1bc2d00 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:16.346107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ffc657-ccb3-4057-a8b1-925bd1bc2d00 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:16.532937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-17ffc657-ccb3-4057-a8b1-925bd1bc2d00 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:16.548004 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-17ffc657-ccb3-4057-a8b1-925bd1bc2d00 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 0.218437 Aug 27 04:32:16.549234 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 89/193] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:16 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:16.555294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-23001e70-af2b-458b-ac01-cdf68a84687c req-0ae68096-919a-494a-a333-1300c98de93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "000044d0-884d-4e30-a18d-5f4ebc4ba4ff", "tag": "eb3052de-ef9e-4e1d-9fe3-29285823219d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:16.570898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-23001e70-af2b-458b-ac01-cdf68a84687c req-0ae68096-919a-494a-a333-1300c98de93f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:16.571728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-23001e70-af2b-458b-ac01-cdf68a84687c req-0ae68096-919a-494a-a333-1300c98de93f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:16.572906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-23001e70-af2b-458b-ac01-cdf68a84687c req-0ae68096-919a-494a-a333-1300c98de93f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:16.580622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-23e313f5-9f91-4f68-9aa1-185339d5452c tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:16.594152 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23e313f5-9f91-4f68-9aa1-185339d5452c tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 200 len: 1410 microversion: 2.1 time: 0.343377 Aug 27 04:32:16.595385 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 105/194] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:16 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 1410 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:16.607319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c08dad80-fc87-4b28-a910-06757109ef42 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:16.609370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c08dad80-fc87-4b28-a910-06757109ef42 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:16.618915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c08dad80-fc87-4b28-a910-06757109ef42 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:16.621578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c08dad80-fc87-4b28-a910-06757109ef42 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:16.622389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c08dad80-fc87-4b28-a910-06757109ef42 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:16.623265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c08dad80-fc87-4b28-a910-06757109ef42 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:16.623879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c08dad80-fc87-4b28-a910-06757109ef42 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:16.624480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c08dad80-fc87-4b28-a910-06757109ef42 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:16.632336 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-23001e70-af2b-458b-ac01-cdf68a84687c req-0ae68096-919a-494a-a333-1300c98de93f service nova] Creating event network-changed:eb3052de-ef9e-4e1d-9fe3-29285823219d for instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff on n-h2-854823-1 Aug 27 04:32:16.632988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-23001e70-af2b-458b-ac01-cdf68a84687c req-0ae68096-919a-494a-a333-1300c98de93f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:32:16.633536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-23001e70-af2b-458b-ac01-cdf68a84687c req-0ae68096-919a-494a-a333-1300c98de93f service nova] Acquired lock "compute-rpcapi-router" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:32:16.635266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-153de6b1-ba7d-45d4-b73a-3655b6e068d8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:16.639806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-153de6b1-ba7d-45d4-b73a-3655b6e068d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:16.640334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-153de6b1-ba7d-45d4-b73a-3655b6e068d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:16.641257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-153de6b1-ba7d-45d4-b73a-3655b6e068d8 None None] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:16.641792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-153de6b1-ba7d-45d4-b73a-3655b6e068d8 None None] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:16.642217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-153de6b1-ba7d-45d4-b73a-3655b6e068d8 None None] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:16.664147 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.compute.rpcapi [None req-153de6b1-ba7d-45d4-b73a-3655b6e068d8 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 27 04:32:16.664868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-153de6b1-ba7d-45d4-b73a-3655b6e068d8 None None] Releasing lock "compute-rpcapi-router" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:32:16.697889 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-153de6b1-ba7d-45d4-b73a-3655b6e068d8 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146811 Aug 27 04:32:16.700174 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 90/195] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:16.871948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c08dad80-fc87-4b28-a910-06757109ef42 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:16.879936 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c08dad80-fc87-4b28-a910-06757109ef42 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.283347 Aug 27 04:32:16.880824 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 106/196] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:16 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:17.570789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1610ea2-7b1b-4954-b3c2-700f9481ca1b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:17.573569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1610ea2-7b1b-4954-b3c2-700f9481ca1b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:17.579852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1610ea2-7b1b-4954-b3c2-700f9481ca1b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:17.580601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1610ea2-7b1b-4954-b3c2-700f9481ca1b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:17.581277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1610ea2-7b1b-4954-b3c2-700f9481ca1b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:17.582307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1610ea2-7b1b-4954-b3c2-700f9481ca1b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:17.583068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1610ea2-7b1b-4954-b3c2-700f9481ca1b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:17.583634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1610ea2-7b1b-4954-b3c2-700f9481ca1b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:17.641979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-557d3c68-1fc6-44bb-a50a-96db7621f47a req-5a891933-1eff-4008-b4a0-20b76e93b313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56162f18-821c-4bd7-b262-7fc46702ef4f", "name": "network-vif-plugged", "status": "completed", "tag": "6b85f720-3bfe-4f41-8a04-deaed3f68eb0"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:17.654682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-557d3c68-1fc6-44bb-a50a-96db7621f47a req-5a891933-1eff-4008-b4a0-20b76e93b313 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:17.655315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-557d3c68-1fc6-44bb-a50a-96db7621f47a req-5a891933-1eff-4008-b4a0-20b76e93b313 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:17.656358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-557d3c68-1fc6-44bb-a50a-96db7621f47a req-5a891933-1eff-4008-b4a0-20b76e93b313 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:17.669326 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-557d3c68-1fc6-44bb-a50a-96db7621f47a req-5a891933-1eff-4008-b4a0-20b76e93b313 service nova] Creating event network-vif-plugged:6b85f720-3bfe-4f41-8a04-deaed3f68eb0 for instance 56162f18-821c-4bd7-b262-7fc46702ef4f on n-h2-854823-1 Aug 27 04:32:17.675249 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-557d3c68-1fc6-44bb-a50a-96db7621f47a req-5a891933-1eff-4008-b4a0-20b76e93b313 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126266 Aug 27 04:32:17.675950 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 91/197] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:17.734043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1610ea2-7b1b-4954-b3c2-700f9481ca1b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:17.743163 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1610ea2-7b1b-4954-b3c2-700f9481ca1b tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 0.176603 Aug 27 04:32:17.743512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-636cc33e-e6dc-4c37-a63a-053ece8d346c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Calling method '.version_select at 0x7f1f22712550>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:17.744969 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 107/198] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:17 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:17.745966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636cc33e-e6dc-4c37-a63a-053ece8d346c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:17.746474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636cc33e-e6dc-4c37-a63a-053ece8d346c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:17.747315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636cc33e-e6dc-4c37-a63a-053ece8d346c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:17.751808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57988b7e-e0f4-441c-bc09-f3a94c1f055e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:17.752593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57988b7e-e0f4-441c-bc09-f3a94c1f055e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:17.759173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57988b7e-e0f4-441c-bc09-f3a94c1f055e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:17.759868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57988b7e-e0f4-441c-bc09-f3a94c1f055e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:17.760625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57988b7e-e0f4-441c-bc09-f3a94c1f055e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:17.761039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57988b7e-e0f4-441c-bc09-f3a94c1f055e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:17.761511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57988b7e-e0f4-441c-bc09-f3a94c1f055e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:17.762042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57988b7e-e0f4-441c-bc09-f3a94c1f055e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:17.766692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636cc33e-e6dc-4c37-a63a-053ece8d346c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:17.767407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636cc33e-e6dc-4c37-a63a-053ece8d346c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:17.768088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636cc33e-e6dc-4c37-a63a-053ece8d346c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:17.781461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636cc33e-e6dc-4c37-a63a-053ece8d346c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:17.782203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636cc33e-e6dc-4c37-a63a-053ece8d346c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:17.782797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636cc33e-e6dc-4c37-a63a-053ece8d346c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:17.789547 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-636cc33e-e6dc-4c37-a63a-053ece8d346c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.109007 Aug 27 04:32:17.790826 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 92/199] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:32:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:18.012813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e108a5b-ba3f-463c-b03c-939d77632905 tempest-HypervisorAdminNegativeUnderV252Test-367947801 tempest-HypervisorAdminNegativeUnderV252Test-367947801-project] Calling method '.version_select at 0x7f1f22712160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:18.014815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3e108a5b-ba3f-463c-b03c-939d77632905 tempest-HypervisorAdminNegativeUnderV252Test-367947801 tempest-HypervisorAdminNegativeUnderV252Test-367947801-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '5e1fb6a426814f7ba136259b72805c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfa073fbc4446bab7204c0ff29d6613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e108a5b-ba3f-463c-b03c-939d77632905 tempest-HypervisorAdminNegativeUnderV252Test-367947801 tempest-HypervisorAdminNegativeUnderV252Test-367947801-project] Request method failure captured: Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-hypervisors/n-h2-854823-1/search HTTP/1.1 Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5QF8DD2B9aE43w482g5xrIYBJGNfdR4UaPP5phh-4kPA-wfhbCVl_K1EbUEe7zjvh1ThtPiOAVFEVBnc0k8SvshvLjGsCWF_FPjv0tArZdR_IUxGdEqUpTJIVjbuhD_OyEAE0hocdp-bjso63c15_M4norxvLVTM_BUNeFud-f77g Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cbfa073fbc4446bab7204c0ff29d6613 Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-367947801 Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:32:18.016993 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:32:18.018525 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cbfa073fbc4446bab7204c0ff29d6613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cbfa073fbc4446bab7204c0ff29d6613"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cbfa073fbc4446bab7204c0ff29d6613"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cbfa073fbc4446bab7204c0ff29d6613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:18.018525 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-367947801 Aug 27 04:32:18.018525 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cbfa073fbc4446bab7204c0ff29d6613 Aug 27 04:32:18.018525 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-367947801 Aug 27 04:32:18.018525 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-367947801-project Aug 27 04:32:18.018525 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:18.018525 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:18.018525 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 5e1fb6a426814f7ba136259b72805c01 Aug 27 04:32:18.018525 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-367947801-project Aug 27 04:32:18.018525 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:32:18.018525 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 04:32:18.018525 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'n-h2-854823-1'} Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:18.019336 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 04:32:18.020375 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:18.023740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e108a5b-ba3f-463c-b03c-939d77632905 tempest-HypervisorAdminNegativeUnderV252Test-367947801 tempest-HypervisorAdminNegativeUnderV252Test-367947801-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:18.024815 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3e108a5b-ba3f-463c-b03c-939d77632905 tempest-HypervisorAdminNegativeUnderV252Test-367947801 tempest-HypervisorAdminNegativeUnderV252Test-367947801-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/n-h2-854823-1/search" status: 403 len: 117 microversion: 2.1 time: 0.226333 Aug 27 04:32:18.030807 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 93/200] 10.222.0.79 () {58 vars in 1209 bytes} [Sat Aug 27 04:32:17 2022] GET /compute/v2.1/os-hypervisors/n-h2-854823-1/search => generated 117 bytes in 233 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:32:18.035837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5c2ad34a-2621-4097-a4c9-7e9884928a73 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:18.036988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5c2ad34a-2621-4097-a4c9-7e9884928a73 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:18.044353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c2ad34a-2621-4097-a4c9-7e9884928a73 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:18.045677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c2ad34a-2621-4097-a4c9-7e9884928a73 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:18.046318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c2ad34a-2621-4097-a4c9-7e9884928a73 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:18.047238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c2ad34a-2621-4097-a4c9-7e9884928a73 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:18.047897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c2ad34a-2621-4097-a4c9-7e9884928a73 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:18.048518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c2ad34a-2621-4097-a4c9-7e9884928a73 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:18.265266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57988b7e-e0f4-441c-bc09-f3a94c1f055e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:18.278666 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57988b7e-e0f4-441c-bc09-f3a94c1f055e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 200 len: 1410 microversion: 2.1 time: 0.532213 Aug 27 04:32:18.280385 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 108/201] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:17 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 1410 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:18.286199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b0711c0-e3ea-4ffb-959e-82891c81b0f0 tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Calling method '.version_select at 0x7f1f224dc160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:18.288552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b0711c0-e3ea-4ffb-959e-82891c81b0f0 tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:18.289987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b0711c0-e3ea-4ffb-959e-82891c81b0f0 tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:18.291714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b0711c0-e3ea-4ffb-959e-82891c81b0f0 tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:18.314016 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0b0711c0-e3ea-4ffb-959e-82891c81b0f0 tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 04:32:18.314714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5c2ad34a-2621-4097-a4c9-7e9884928a73 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b0711c0-e3ea-4ffb-959e-82891c81b0f0 tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Request method failure captured: Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5RNBvysyJ5MJOqLuMXQhmzLwT4hhfZrAdx04vRAn8uE34PTVfLnVu3eO7voBasr-cjC8yNp5jfl61dTmXMqpm55l0Qvtg4jMTfuPZ5-C4M0c5hGa4ZApYpgXYHgomW1pAItzHITiO1DgxclHWV3AbfYnbf7_NJHaqHh13ruYFpXZ4 Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 7292ff531d4245d191df007102bdee56 Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1301786899 Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:32:18.316406 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:32:18.318170 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7292ff531d4245d191df007102bdee56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7292ff531d4245d191df007102bdee56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7292ff531d4245d191df007102bdee56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7292ff531d4245d191df007102bdee56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:18.318170 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1301786899 Aug 27 04:32:18.318170 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 7292ff531d4245d191df007102bdee56 Aug 27 04:32:18.318170 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1301786899 Aug 27 04:32:18.318170 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin Aug 27 04:32:18.318170 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:32:18.318170 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:32:18.318170 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8699de02d93f4db29c862ead82bd8c90 Aug 27 04:32:18.318170 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin Aug 27 04:32:18.318170 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:32:18.318170 n-d-854823-1 devstack@n-api.service[128869]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 04:32:18.318170 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:18.319065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:18.320298 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:18.320298 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:18.320298 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:18.320298 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 04:32:18.320298 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:18.322447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b0711c0-e3ea-4ffb-959e-82891c81b0f0 tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:18.322600 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5c2ad34a-2621-4097-a4c9-7e9884928a73 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.290227 Aug 27 04:32:18.323428 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b0711c0-e3ea-4ffb-959e-82891c81b0f0 tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.041462 Aug 27 04:32:18.324419 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 109/202] 10.222.0.79 () {58 vars in 1251 bytes} [Sat Aug 27 04:32:18 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:18.335599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-170184ef-619a-4220-92e9-2ae1b569309e tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Calling method '.version_select at 0x7f1f224dc310>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:18.339403 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 94/203] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:18 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:18.342737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170184ef-619a-4220-92e9-2ae1b569309e tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:18.343400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170184ef-619a-4220-92e9-2ae1b569309e tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:18.343946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170184ef-619a-4220-92e9-2ae1b569309e tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:18.365420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170184ef-619a-4220-92e9-2ae1b569309e tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:18.366175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170184ef-619a-4220-92e9-2ae1b569309e tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:18.367069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170184ef-619a-4220-92e9-2ae1b569309e tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:18.381854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170184ef-619a-4220-92e9-2ae1b569309e tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:18.382581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170184ef-619a-4220-92e9-2ae1b569309e tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:18.383176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170184ef-619a-4220-92e9-2ae1b569309e tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:18.390771 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-170184ef-619a-4220-92e9-2ae1b569309e tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.060258 Aug 27 04:32:18.391624 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 110/204] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:32:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:18.404662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c8a0bb01-cce9-4b71-a670-4002766e80b9 tempest-HypervisorAdminNegativeUnderV252Test-367947801 tempest-HypervisorAdminNegativeUnderV252Test-367947801-project] Calling method '.version_select at 0x7f1f227120d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:18.406508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c8a0bb01-cce9-4b71-a670-4002766e80b9 tempest-HypervisorAdminNegativeUnderV252Test-367947801 tempest-HypervisorAdminNegativeUnderV252Test-367947801-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '5e1fb6a426814f7ba136259b72805c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfa073fbc4446bab7204c0ff29d6613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c8a0bb01-cce9-4b71-a670-4002766e80b9 tempest-HypervisorAdminNegativeUnderV252Test-367947801 tempest-HypervisorAdminNegativeUnderV252Test-367947801-project] Request method failure captured: Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5QF8DD2B9aE43w482g5xrIYBJGNfdR4UaPP5phh-4kPA-wfhbCVl_K1EbUEe7zjvh1ThtPiOAVFEVBnc0k8SvshvLjGsCWF_FPjv0tArZdR_IUxGdEqUpTJIVjbuhD_OyEAE0hocdp-bjso63c15_M4norxvLVTM_BUNeFud-f77g Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cbfa073fbc4446bab7204c0ff29d6613 Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-367947801 Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:32:18.408065 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:32:18.409552 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cbfa073fbc4446bab7204c0ff29d6613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cbfa073fbc4446bab7204c0ff29d6613"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cbfa073fbc4446bab7204c0ff29d6613"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cbfa073fbc4446bab7204c0ff29d6613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:18.409552 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-367947801 Aug 27 04:32:18.409552 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cbfa073fbc4446bab7204c0ff29d6613 Aug 27 04:32:18.409552 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-367947801 Aug 27 04:32:18.409552 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-367947801-project Aug 27 04:32:18.409552 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:18.409552 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:18.409552 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 5e1fb6a426814f7ba136259b72805c01 Aug 27 04:32:18.409552 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-367947801-project Aug 27 04:32:18.409552 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:32:18.409552 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 04:32:18.409552 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '1'} Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:18.410323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 04:32:18.411640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:18.412815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c8a0bb01-cce9-4b71-a670-4002766e80b9 tempest-HypervisorAdminNegativeUnderV252Test-367947801 tempest-HypervisorAdminNegativeUnderV252Test-367947801-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:18.418247 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c8a0bb01-cce9-4b71-a670-4002766e80b9 tempest-HypervisorAdminNegativeUnderV252Test-367947801 tempest-HypervisorAdminNegativeUnderV252Test-367947801-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009434 Aug 27 04:32:18.418872 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 95/205] 10.222.0.79 () {58 vars in 1176 bytes} [Sat Aug 27 04:32:18 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:18.430155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66516635-5864-4f1b-a610-9ea6362e510c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Calling method '.version_select at 0x7f1f22713700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:18.432284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66516635-5864-4f1b-a610-9ea6362e510c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:18.432797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66516635-5864-4f1b-a610-9ea6362e510c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:18.433228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66516635-5864-4f1b-a610-9ea6362e510c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:18.441889 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-66516635-5864-4f1b-a610-9ea6362e510c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] HTTP exception thrown: No hypervisor matching '9e5f13e0-7aaa-4837-a6af-01f497163ffc' could be found. Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66516635-5864-4f1b-a610-9ea6362e510c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Request method failure captured: Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hypervisors/9e5f13e0-7aaa-4837-a6af-01f497163ffc/servers HTTP/1.1 Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5RNBvysyJ5MJOqLuMXQhmzLwT4hhfZrAdx04vRAn8uE34PTVfLnVu3eO7voBasr-cjC8yNp5jfl61dTmXMqpm55l0Qvtg4jMTfuPZ5-C4M0c5hGa4ZApYpgXYHgomW1pAItzHITiO1DgxclHWV3AbfYnbf7_NJHaqHh13ruYFpXZ4 Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 7292ff531d4245d191df007102bdee56 Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1301786899 Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:32:18.444324 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:32:18.446179 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7292ff531d4245d191df007102bdee56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7292ff531d4245d191df007102bdee56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7292ff531d4245d191df007102bdee56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7292ff531d4245d191df007102bdee56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:18.446179 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1301786899 Aug 27 04:32:18.446179 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 7292ff531d4245d191df007102bdee56 Aug 27 04:32:18.446179 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1301786899 Aug 27 04:32:18.446179 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin Aug 27 04:32:18.446179 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:32:18.446179 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:32:18.446179 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8699de02d93f4db29c862ead82bd8c90 Aug 27 04:32:18.446179 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin Aug 27 04:32:18.446179 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:32:18.446179 n-d-854823-1 devstack@n-api.service[128869]: exception: No hypervisor matching '9e5f13e0-7aaa-4837-a6af-01f497163ffc' could be found. Aug 27 04:32:18.446179 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '9e5f13e0-7aaa-4837-a6af-01f497163ffc'} Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '9e5f13e0-7aaa-4837-a6af-01f497163ffc' could be found. Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:18.446827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:18.448004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:18.448004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:18.448004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:18.448004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:18.448004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '9e5f13e0-7aaa-4837-a6af-01f497163ffc' could be found. Aug 27 04:32:18.448004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:18.448004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66516635-5864-4f1b-a610-9ea6362e510c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] Returning 404 to user: No hypervisor matching '9e5f13e0-7aaa-4837-a6af-01f497163ffc' could be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:18.448004 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66516635-5864-4f1b-a610-9ea6362e510c tempest-HypervisorAdminNegativeUnderV252Test-1301786899 tempest-HypervisorAdminNegativeUnderV252Test-1301786899-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/9e5f13e0-7aaa-4837-a6af-01f497163ffc/servers" status: 404 len: 123 microversion: 2.1 time: 0.021637 Aug 27 04:32:18.451493 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 111/206] 10.222.0.79 () {58 vars in 1281 bytes} [Sat Aug 27 04:32:18 2022] GET /compute/v2.1/os-hypervisors/9e5f13e0-7aaa-4837-a6af-01f497163ffc/servers => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:18.767398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f52e3d35-6ef7-4ac7-95e4-2b507e209788 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:18.768054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f52e3d35-6ef7-4ac7-95e4-2b507e209788 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:18.774883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f52e3d35-6ef7-4ac7-95e4-2b507e209788 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:18.775680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f52e3d35-6ef7-4ac7-95e4-2b507e209788 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:18.776198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f52e3d35-6ef7-4ac7-95e4-2b507e209788 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:18.777114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f52e3d35-6ef7-4ac7-95e4-2b507e209788 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:18.777763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f52e3d35-6ef7-4ac7-95e4-2b507e209788 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:18.778257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f52e3d35-6ef7-4ac7-95e4-2b507e209788 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:18.979551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f52e3d35-6ef7-4ac7-95e4-2b507e209788 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:18.990084 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f52e3d35-6ef7-4ac7-95e4-2b507e209788 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 0.226640 Aug 27 04:32:19.006632 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 96/207] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:18 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:19.300948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cfebfdec-d94d-4292-96fb-b8705c4500f5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:19.301673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cfebfdec-d94d-4292-96fb-b8705c4500f5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:19.316385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfebfdec-d94d-4292-96fb-b8705c4500f5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:19.316917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfebfdec-d94d-4292-96fb-b8705c4500f5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:19.317358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfebfdec-d94d-4292-96fb-b8705c4500f5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:19.318075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfebfdec-d94d-4292-96fb-b8705c4500f5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:19.318522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfebfdec-d94d-4292-96fb-b8705c4500f5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:19.318938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfebfdec-d94d-4292-96fb-b8705c4500f5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:19.342991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a79b1a43-0902-4dd5-9ed5-5516c8ae7994 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:19.343717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a79b1a43-0902-4dd5-9ed5-5516c8ae7994 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:19.349894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a79b1a43-0902-4dd5-9ed5-5516c8ae7994 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:19.350472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a79b1a43-0902-4dd5-9ed5-5516c8ae7994 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:19.350966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a79b1a43-0902-4dd5-9ed5-5516c8ae7994 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:19.351857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a79b1a43-0902-4dd5-9ed5-5516c8ae7994 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:19.352757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a79b1a43-0902-4dd5-9ed5-5516c8ae7994 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:19.353823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a79b1a43-0902-4dd5-9ed5-5516c8ae7994 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:19.532221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cfebfdec-d94d-4292-96fb-b8705c4500f5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:19.540352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a79b1a43-0902-4dd5-9ed5-5516c8ae7994 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:19.541047 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cfebfdec-d94d-4292-96fb-b8705c4500f5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 200 len: 1410 microversion: 2.1 time: 0.244040 Aug 27 04:32:19.548948 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a79b1a43-0902-4dd5-9ed5-5516c8ae7994 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.209534 Aug 27 04:32:19.550180 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 97/208] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:19 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:19.554565 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 112/209] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:19 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 1410 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:19.991467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0a6dcc82-ce14-42e1-aacc-ce8f739f021a tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Calling method '.version_select at 0x7f1f22658a60>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:20.012773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b7bfe32c-a564-42b3-bf90-2e04cead4851 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:20.013405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b7bfe32c-a564-42b3-bf90-2e04cead4851 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:20.019441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7bfe32c-a564-42b3-bf90-2e04cead4851 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:20.019933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7bfe32c-a564-42b3-bf90-2e04cead4851 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:20.020473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7bfe32c-a564-42b3-bf90-2e04cead4851 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:20.021244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7bfe32c-a564-42b3-bf90-2e04cead4851 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:20.021696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7bfe32c-a564-42b3-bf90-2e04cead4851 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:20.022117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7bfe32c-a564-42b3-bf90-2e04cead4851 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:20.068110 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0a6dcc82-ce14-42e1-aacc-ce8f739f021a tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449" status: 200 len: 371 microversion: 2.1 time: 0.208624 Aug 27 04:32:20.075126 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 98/210] 10.222.0.79 () {58 vars in 1242 bytes} [Sat Aug 27 04:32:19 2022] GET /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449 => generated 371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:20.081806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b7d0104a-c22c-44fb-9279-a9ac21587fc8 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Action: 'update', calling method: .version_select at 0x7f1f226e50d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:20.157100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7d0104a-c22c-44fb-9279-a9ac21587fc8 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:20.157763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7d0104a-c22c-44fb-9279-a9ac21587fc8 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:20.158352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7d0104a-c22c-44fb-9279-a9ac21587fc8 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:20.159231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7d0104a-c22c-44fb-9279-a9ac21587fc8 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:20.159876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7d0104a-c22c-44fb-9279-a9ac21587fc8 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:20.160422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7d0104a-c22c-44fb-9279-a9ac21587fc8 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:20.180766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b7bfe32c-a564-42b3-bf90-2e04cead4851 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:20.189402 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b7bfe32c-a564-42b3-bf90-2e04cead4851 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1339 microversion: 2.1 time: 0.180439 Aug 27 04:32:20.190463 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 113/211] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:20 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1339 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:20.224503 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b7d0104a-c22c-44fb-9279-a9ac21587fc8 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449" status: 200 len: 328 microversion: 2.1 time: 0.146168 Aug 27 04:32:20.225205 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 99/212] 10.222.0.79 () {60 vars in 1262 bytes} [Sat Aug 27 04:32:20 2022] PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449 => generated 328 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:20.474281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1799301721", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:20.539327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:32:20.561574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-84956230-ab94-483e-b9fe-86f8c26ec415 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:20.562199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-84956230-ab94-483e-b9fe-86f8c26ec415 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:20.571849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84956230-ab94-483e-b9fe-86f8c26ec415 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:20.572959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84956230-ab94-483e-b9fe-86f8c26ec415 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:20.584278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84956230-ab94-483e-b9fe-86f8c26ec415 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:20.585059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84956230-ab94-483e-b9fe-86f8c26ec415 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:20.585705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84956230-ab94-483e-b9fe-86f8c26ec415 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:20.586292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84956230-ab94-483e-b9fe-86f8c26ec415 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:20.780951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-84956230-ab94-483e-b9fe-86f8c26ec415 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:20.789462 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-84956230-ab94-483e-b9fe-86f8c26ec415 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 200 len: 1410 microversion: 2.1 time: 0.232535 Aug 27 04:32:20.790031 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 100/213] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:20 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 1410 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:20.798167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:32:20.798583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:32:20.799056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:32:20.799480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:32:20.799884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:32:20.805707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d768bbe0-c588-455d-8e15-9055d8d39df0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:20.807203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d768bbe0-c588-455d-8e15-9055d8d39df0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:20.809607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:20.810089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:20.810520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:20.814195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:20.814195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:20.814195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:20.818249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d768bbe0-c588-455d-8e15-9055d8d39df0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:20.819116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d768bbe0-c588-455d-8e15-9055d8d39df0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:20.819778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d768bbe0-c588-455d-8e15-9055d8d39df0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:20.820349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:20.821348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d768bbe0-c588-455d-8e15-9055d8d39df0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:20.823345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d768bbe0-c588-455d-8e15-9055d8d39df0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:20.824294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d768bbe0-c588-455d-8e15-9055d8d39df0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:20.835314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Getting quotas for project e118fd1cf3a54c16b57ddc0567d7c449. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:32:20.839544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Getting quotas for user 128f51d2dabf42d885c2be82ef71c57b and project e118fd1cf3a54c16b57ddc0567d7c449. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:32:20.848771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=7,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:20.851226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.utils [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] cores quota exceeded for e118fd1cf3a54c16b57ddc0567d7c449, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128869) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 04:32:20.852042 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Request method failure captured: Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 145 Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5TzlHbNM-NtTY6CNr9vq31ppqrK44RAy7452tnUq0xklODeCX0Da8Zlp5Ct6Rhm5W_e9y9Z4kfEKB-9pI-z6P4janotyPql2kc8hYeE1S_tX9QvyjjerdO9TDbSIZsiaCv_zaE8M0KlUi1Pdz_L24hhoJ6VkjE0vfKfPjJD_F2l3A Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: e118fd1cf3a54c16b57ddc0567d7c449 Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-QuotasAdminNegativeTest-1396023822 Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:32:20.856514 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:32:20.857733 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:20.857733 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-QuotasAdminNegativeTest-1396023822 Aug 27 04:32:20.857733 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: e118fd1cf3a54c16b57ddc0567d7c449 Aug 27 04:32:20.857733 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1396023822 Aug 27 04:32:20.857733 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-QuotasAdminNegativeTest-1396023822-project Aug 27 04:32:20.857733 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:32:20.857733 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:32:20.857733 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 128f51d2dabf42d885c2be82ef71c57b Aug 27 04:32:20.857733 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-QuotasAdminNegativeTest-1396023822-project Aug 27 04:32:20.857733 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:32:20.857733 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1799301721", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} Aug 27 04:32:20.857733 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1799301721', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452'}}} Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 04:32:20.858450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:20.859392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:20.860520 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:20.862034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:20.862034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:20.862034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:20.862034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:20.862034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 04:32:20.862034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:20.862034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:20.862034 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d11f1c68-a1cd-441d-baa6-048a1e6f4bcd tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.527766 Aug 27 04:32:20.862034 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 114/214] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:32:20 2022] POST /compute/v2.1/servers => generated 111 bytes in 529 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:20.867246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86cfa617-7b40-4a27-a8c9-3c1accae977d tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Action: 'update', calling method: .version_select at 0x7f1f22472af0>, body: {"quota_set": {"cores": 20}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:20.978834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d768bbe0-c588-455d-8e15-9055d8d39df0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:20.991191 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d768bbe0-c588-455d-8e15-9055d8d39df0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.199864 Aug 27 04:32:20.991995 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 101/215] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:20 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:21.092090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86cfa617-7b40-4a27-a8c9-3c1accae977d tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:21.092613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86cfa617-7b40-4a27-a8c9-3c1accae977d tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:21.093090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86cfa617-7b40-4a27-a8c9-3c1accae977d tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:21.093815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86cfa617-7b40-4a27-a8c9-3c1accae977d tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:21.094286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86cfa617-7b40-4a27-a8c9-3c1accae977d tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:21.094908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86cfa617-7b40-4a27-a8c9-3c1accae977d tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:21.177372 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86cfa617-7b40-4a27-a8c9-3c1accae977d tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449" status: 200 len: 329 microversion: 2.1 time: 0.313839 Aug 27 04:32:21.180695 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 115/216] 10.222.0.79 () {60 vars in 1262 bytes} [Sat Aug 27 04:32:20 2022] PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449 => generated 329 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:21.190784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6b5850a0-823d-4e8f-a5f9-5d38a413d4f4 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Calling method '.version_select at 0x7f1f2266b1f0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:21.215842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0e5e6dd-70df-4234-8902-263d395cfd1c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:21.218060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0e5e6dd-70df-4234-8902-263d395cfd1c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:21.229303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0e5e6dd-70df-4234-8902-263d395cfd1c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:21.229796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0e5e6dd-70df-4234-8902-263d395cfd1c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:21.230281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0e5e6dd-70df-4234-8902-263d395cfd1c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:21.231109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0e5e6dd-70df-4234-8902-263d395cfd1c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:21.231577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0e5e6dd-70df-4234-8902-263d395cfd1c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:21.231961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0e5e6dd-70df-4234-8902-263d395cfd1c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:21.309259 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6b5850a0-823d-4e8f-a5f9-5d38a413d4f4 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449" status: 200 len: 371 microversion: 2.1 time: 0.122083 Aug 27 04:32:21.311512 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 102/217] 10.222.0.79 () {58 vars in 1242 bytes} [Sat Aug 27 04:32:21 2022] GET /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449 => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:21.323104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f3015a7d-d692-4d78-80d8-b7182b8002db tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Action: 'update', calling method: .version_select at 0x7f1f22712e50>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:21.408963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0e5e6dd-70df-4234-8902-263d395cfd1c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:21.410103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3015a7d-d692-4d78-80d8-b7182b8002db tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:21.411106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3015a7d-d692-4d78-80d8-b7182b8002db tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:21.411653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3015a7d-d692-4d78-80d8-b7182b8002db tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:21.412501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3015a7d-d692-4d78-80d8-b7182b8002db tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:21.413115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3015a7d-d692-4d78-80d8-b7182b8002db tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:21.413743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3015a7d-d692-4d78-80d8-b7182b8002db tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:21.421045 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0e5e6dd-70df-4234-8902-263d395cfd1c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1489 microversion: 2.1 time: 0.212962 Aug 27 04:32:21.423413 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 116/218] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:21 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1489 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:21.454778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f9834ca-2818-43cd-9ffe-daa8e6ec1675 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:21.455367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f9834ca-2818-43cd-9ffe-daa8e6ec1675 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:21.469064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f9834ca-2818-43cd-9ffe-daa8e6ec1675 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:21.470129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f9834ca-2818-43cd-9ffe-daa8e6ec1675 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:21.470383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f9834ca-2818-43cd-9ffe-daa8e6ec1675 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:21.471362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f9834ca-2818-43cd-9ffe-daa8e6ec1675 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:21.472329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f9834ca-2818-43cd-9ffe-daa8e6ec1675 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:21.472329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f9834ca-2818-43cd-9ffe-daa8e6ec1675 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:21.529097 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f3015a7d-d692-4d78-80d8-b7182b8002db tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449" status: 200 len: 328 microversion: 2.1 time: 0.209815 Aug 27 04:32:21.530165 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 103/219] 10.222.0.79 () {60 vars in 1262 bytes} [Sat Aug 27 04:32:21 2022] PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449 => generated 328 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:21.650127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1339445571", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:21.704351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:32:21.847997 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f9834ca-2818-43cd-9ffe-daa8e6ec1675 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1640 microversion: 2.1 time: 0.403382 Aug 27 04:32:21.861438 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 117/220] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:21 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1640 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:21.875321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e0aca21b-049b-4170-854c-8d36cc79dd38 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:21.877160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e0aca21b-049b-4170-854c-8d36cc79dd38 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:21.886651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0aca21b-049b-4170-854c-8d36cc79dd38 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:21.887058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0aca21b-049b-4170-854c-8d36cc79dd38 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:21.887493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0aca21b-049b-4170-854c-8d36cc79dd38 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:21.888417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0aca21b-049b-4170-854c-8d36cc79dd38 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:21.889005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0aca21b-049b-4170-854c-8d36cc79dd38 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:21.889433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0aca21b-049b-4170-854c-8d36cc79dd38 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:22.026847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:32:22.027372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:32:22.027723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:32:22.028222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:32:22.028519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:32:22.039073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:22.039566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:22.039978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:22.041375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:22.042224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:22.042650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:22.055729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e0aca21b-049b-4170-854c-8d36cc79dd38 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:22.066000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Getting quotas for project e118fd1cf3a54c16b57ddc0567d7c449. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:32:22.071325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Getting quotas for user 128f51d2dabf42d885c2be82ef71c57b and project e118fd1cf3a54c16b57ddc0567d7c449. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:32:22.083937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.utils [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] instances quota exceeded for e118fd1cf3a54c16b57ddc0567d7c449, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128870) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 04:32:22.084207 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e0aca21b-049b-4170-854c-8d36cc79dd38 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 200 len: 1410 microversion: 2.1 time: 0.215371 Aug 27 04:32:22.084854 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 118/221] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:21 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 1410 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:22.098898 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 04:32:22.102482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4dcf13d2-e677-4b33-8837-e7624cde8396 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:22.103077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4dcf13d2-e677-4b33-8837-e7624cde8396 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Request method failure captured: Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 145 Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5TzlHbNM-NtTY6CNr9vq31ppqrK44RAy7452tnUq0xklODeCX0Da8Zlp5Ct6Rhm5W_e9y9Z4kfEKB-9pI-z6P4janotyPql2kc8hYeE1S_tX9QvyjjerdO9TDbSIZsiaCv_zaE8M0KlUi1Pdz_L24hhoJ6VkjE0vfKfPjJD_F2l3A Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: e118fd1cf3a54c16b57ddc0567d7c449 Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-QuotasAdminNegativeTest-1396023822 Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:32:22.107284 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:32:22.109315 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:22.109315 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-QuotasAdminNegativeTest-1396023822 Aug 27 04:32:22.109315 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: e118fd1cf3a54c16b57ddc0567d7c449 Aug 27 04:32:22.109315 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1396023822 Aug 27 04:32:22.109315 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-QuotasAdminNegativeTest-1396023822-project Aug 27 04:32:22.109315 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:22.109315 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:22.109315 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 128f51d2dabf42d885c2be82ef71c57b Aug 27 04:32:22.109315 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-QuotasAdminNegativeTest-1396023822-project Aug 27 04:32:22.109315 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:32:22.109315 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1339445571", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} Aug 27 04:32:22.109315 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1339445571', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452'}}} Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 04:32:22.110837 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:22.113014 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:22.115543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:22.117790 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:22.117790 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:22.117790 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:22.117790 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:22.117790 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 04:32:22.117790 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:22.117790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:22.118237 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d7be7850-c8a5-49c4-a11d-2178a1b25713 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.472374 Aug 27 04:32:22.119172 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 104/222] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:32:21 2022] POST /compute/v2.1/servers => generated 119 bytes in 474 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:22.122762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dcf13d2-e677-4b33-8837-e7624cde8396 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:22.123820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dcf13d2-e677-4b33-8837-e7624cde8396 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:22.124281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dcf13d2-e677-4b33-8837-e7624cde8396 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:22.124619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6755378b-5f30-4314-a815-8c82404aba8d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:22.125182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6755378b-5f30-4314-a815-8c82404aba8d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:22.128941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dcf13d2-e677-4b33-8837-e7624cde8396 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:22.129680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dcf13d2-e677-4b33-8837-e7624cde8396 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:22.131615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6755378b-5f30-4314-a815-8c82404aba8d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:22.131988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dcf13d2-e677-4b33-8837-e7624cde8396 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:22.132105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6755378b-5f30-4314-a815-8c82404aba8d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:22.132520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6755378b-5f30-4314-a815-8c82404aba8d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:22.133299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6755378b-5f30-4314-a815-8c82404aba8d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:22.133753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6755378b-5f30-4314-a815-8c82404aba8d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:22.134177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6755378b-5f30-4314-a815-8c82404aba8d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:22.167940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4dcf13d2-e677-4b33-8837-e7624cde8396 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:32:22.286230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6755378b-5f30-4314-a815-8c82404aba8d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:22.296164 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6755378b-5f30-4314-a815-8c82404aba8d tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.175691 Aug 27 04:32:22.308562 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 105/223] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:22 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:22.308562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-659bd369-4fdb-43fc-b8d7-e4758f1980b3 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Action: 'update', calling method: .version_select at 0x7f1f2267e670>, body: {"quota_set": {"instances": 10}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:22.339552 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4dcf13d2-e677-4b33-8837-e7624cde8396 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "DELETE /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 204 len: 0 microversion: 2.1 time: 0.252501 Aug 27 04:32:22.341857 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 119/224] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:32:22 2022] DELETE /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:32:22.351931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea0bd135-19f8-4fa6-a4fc-b76b45b3dfc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:22.353535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea0bd135-19f8-4fa6-a4fc-b76b45b3dfc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:22.363184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea0bd135-19f8-4fa6-a4fc-b76b45b3dfc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:22.364776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea0bd135-19f8-4fa6-a4fc-b76b45b3dfc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:22.365393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea0bd135-19f8-4fa6-a4fc-b76b45b3dfc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:22.367131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea0bd135-19f8-4fa6-a4fc-b76b45b3dfc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:22.368013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea0bd135-19f8-4fa6-a4fc-b76b45b3dfc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:22.368636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea0bd135-19f8-4fa6-a4fc-b76b45b3dfc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:22.385346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-659bd369-4fdb-43fc-b8d7-e4758f1980b3 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:22.386097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-659bd369-4fdb-43fc-b8d7-e4758f1980b3 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:22.386868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-659bd369-4fdb-43fc-b8d7-e4758f1980b3 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:22.387748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-659bd369-4fdb-43fc-b8d7-e4758f1980b3 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:22.388992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-659bd369-4fdb-43fc-b8d7-e4758f1980b3 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:22.389702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-659bd369-4fdb-43fc-b8d7-e4758f1980b3 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:22.398934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:22.457341 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-659bd369-4fdb-43fc-b8d7-e4758f1980b3 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449" status: 200 len: 329 microversion: 2.1 time: 0.158616 Aug 27 04:32:22.458655 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 106/225] 10.222.0.79 () {60 vars in 1262 bytes} [Sat Aug 27 04:32:22 2022] PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449 => generated 329 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:22.473888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-afeab38e-1225-4c37-aacc-db8f76fe9da5 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Calling method '.version_select at 0x7f1f22834b80>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:22.544260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:22.559680 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-afeab38e-1225-4c37-aacc-db8f76fe9da5 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449" status: 200 len: 371 microversion: 2.1 time: 0.091207 Aug 27 04:32:22.560271 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 107/226] 10.222.0.79 () {58 vars in 1242 bytes} [Sat Aug 27 04:32:22 2022] GET /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449 => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:22.571679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f66a3ebc-7612-4e84-ab85-4644e0cbb60b tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Action: 'update', calling method: .version_select at 0x7f1f22581f70>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:22.647922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f66a3ebc-7612-4e84-ab85-4644e0cbb60b tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:22.648411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f66a3ebc-7612-4e84-ab85-4644e0cbb60b tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:22.649068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f66a3ebc-7612-4e84-ab85-4644e0cbb60b tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:22.649776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f66a3ebc-7612-4e84-ab85-4644e0cbb60b tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:22.650874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f66a3ebc-7612-4e84-ab85-4644e0cbb60b tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:22.651350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f66a3ebc-7612-4e84-ab85-4644e0cbb60b tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:22.692592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ea0bd135-19f8-4fa6-a4fc-b76b45b3dfc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:22.709269 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea0bd135-19f8-4fa6-a4fc-b76b45b3dfc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1495 microversion: 2.1 time: 0.362988 Aug 27 04:32:22.710499 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f66a3ebc-7612-4e84-ab85-4644e0cbb60b tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449" status: 200 len: 325 microversion: 2.1 time: 0.142573 Aug 27 04:32:22.711328 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 108/227] 10.222.0.79 () {60 vars in 1262 bytes} [Sat Aug 27 04:32:22 2022] PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449 => generated 325 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:32:22.721888 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 120/228] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:22 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1495 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:22.769766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1369127015", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:22.813769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f48eb238-79c9-452f-935a-adde78fb1f32 req-b901a653-be87-4bd7-a99f-4ee17059b87b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95fe425c-a241-46b8-84d0-9ec136716def", "name": "network-vif-plugged", "status": "completed", "tag": "c70e59e4-bb46-46e8-aa91-27de81821024"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:22.834690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f48eb238-79c9-452f-935a-adde78fb1f32 req-b901a653-be87-4bd7-a99f-4ee17059b87b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:22.835375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f48eb238-79c9-452f-935a-adde78fb1f32 req-b901a653-be87-4bd7-a99f-4ee17059b87b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:22.836009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f48eb238-79c9-452f-935a-adde78fb1f32 req-b901a653-be87-4bd7-a99f-4ee17059b87b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:22.836866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:32:22.848641 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f48eb238-79c9-452f-935a-adde78fb1f32 req-b901a653-be87-4bd7-a99f-4ee17059b87b service nova] Creating event network-vif-plugged:c70e59e4-bb46-46e8-aa91-27de81821024 for instance 95fe425c-a241-46b8-84d0-9ec136716def on n-h1-854823-1 Aug 27 04:32:22.854317 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f48eb238-79c9-452f-935a-adde78fb1f32 req-b901a653-be87-4bd7-a99f-4ee17059b87b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044123 Aug 27 04:32:22.855429 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 121/229] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:23.078771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:32:23.079281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:32:23.079953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:32:23.080320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:32:23.080852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:32:23.100413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:23.101927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:23.107473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:23.107621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6448beb-26dc-4291-b4ed-71a2e7f298e4 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:23.108249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6448beb-26dc-4291-b4ed-71a2e7f298e4 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:23.109012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:23.109622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:23.110155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:23.120870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6448beb-26dc-4291-b4ed-71a2e7f298e4 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:23.121366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6448beb-26dc-4291-b4ed-71a2e7f298e4 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:23.124523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6448beb-26dc-4291-b4ed-71a2e7f298e4 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:23.125359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6448beb-26dc-4291-b4ed-71a2e7f298e4 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:23.126546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6448beb-26dc-4291-b4ed-71a2e7f298e4 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:23.126989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6448beb-26dc-4291-b4ed-71a2e7f298e4 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:23.135649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Getting quotas for project e118fd1cf3a54c16b57ddc0567d7c449. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:32:23.143115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Getting quotas for user 128f51d2dabf42d885c2be82ef71c57b and project e118fd1cf3a54c16b57ddc0567d7c449. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:32:23.158084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.utils [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] ram quota exceeded for e118fd1cf3a54c16b57ddc0567d7c449, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128870) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 04:32:23.158894 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Request method failure captured: Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 145 Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5TzlHbNM-NtTY6CNr9vq31ppqrK44RAy7452tnUq0xklODeCX0Da8Zlp5Ct6Rhm5W_e9y9Z4kfEKB-9pI-z6P4janotyPql2kc8hYeE1S_tX9QvyjjerdO9TDbSIZsiaCv_zaE8M0KlUi1Pdz_L24hhoJ6VkjE0vfKfPjJD_F2l3A Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: e118fd1cf3a54c16b57ddc0567d7c449 Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-QuotasAdminNegativeTest-1396023822 Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:32:23.161392 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:32:23.162592 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:23.162592 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-QuotasAdminNegativeTest-1396023822 Aug 27 04:32:23.162592 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: e118fd1cf3a54c16b57ddc0567d7c449 Aug 27 04:32:23.162592 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1396023822 Aug 27 04:32:23.162592 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-QuotasAdminNegativeTest-1396023822-project Aug 27 04:32:23.162592 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:23.162592 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:23.162592 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 128f51d2dabf42d885c2be82ef71c57b Aug 27 04:32:23.162592 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-QuotasAdminNegativeTest-1396023822-project Aug 27 04:32:23.162592 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:32:23.162592 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1369127015", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} Aug 27 04:32:23.162592 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1369127015', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452'}}} Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 04:32:23.163476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:23.164432 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:23.168873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:23.172171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:23.172171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:23.172171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:23.172171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:23.172171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 04:32:23.172171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:23.178326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:23.179654 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8aad3410-998c-43f8-875a-e260cd3c67f2 tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.415050 Aug 27 04:32:23.180732 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 109/230] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:32:22 2022] POST /compute/v2.1/servers => generated 110 bytes in 417 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:23.200243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1d72c433-c51c-4748-8519-ad51c9fca227 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Action: 'update', calling method: .version_select at 0x7f1f229f3c10>, body: {"quota_set": {"ram": 51200}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:23.277856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d72c433-c51c-4748-8519-ad51c9fca227 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:23.278777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d72c433-c51c-4748-8519-ad51c9fca227 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:23.279359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d72c433-c51c-4748-8519-ad51c9fca227 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:23.280327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d72c433-c51c-4748-8519-ad51c9fca227 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:23.281017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d72c433-c51c-4748-8519-ad51c9fca227 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:23.281646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d72c433-c51c-4748-8519-ad51c9fca227 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:23.372261 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1d72c433-c51c-4748-8519-ad51c9fca227 tempest-QuotasAdminNegativeTest-870948433 tempest-QuotasAdminNegativeTest-870948433-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449" status: 200 len: 329 microversion: 2.1 time: 0.186085 Aug 27 04:32:23.373516 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 110/231] 10.222.0.79 () {60 vars in 1262 bytes} [Sat Aug 27 04:32:23 2022] PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449 => generated 329 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:23.379402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e07eb973-0ee5-4d3d-be2a-52cee2eec131 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:23.380196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e07eb973-0ee5-4d3d-be2a-52cee2eec131 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:23.388080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07eb973-0ee5-4d3d-be2a-52cee2eec131 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:23.388610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07eb973-0ee5-4d3d-be2a-52cee2eec131 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:23.389047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07eb973-0ee5-4d3d-be2a-52cee2eec131 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:23.389753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07eb973-0ee5-4d3d-be2a-52cee2eec131 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:23.390208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07eb973-0ee5-4d3d-be2a-52cee2eec131 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:23.390630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07eb973-0ee5-4d3d-be2a-52cee2eec131 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:23.471544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d6448beb-26dc-4291-b4ed-71a2e7f298e4 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:23.487870 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6448beb-26dc-4291-b4ed-71a2e7f298e4 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 200 len: 1410 microversion: 2.1 time: 0.385558 Aug 27 04:32:23.488464 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 122/232] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:23 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 1410 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:23.494448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cbf6bef-8859-45fe-ae6e-5c50ae0908eb tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Action: 'update', calling method: .version_select at 0x7f1f223eb430>, body: {"quota_set": {"ram": 0}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:23.499079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2cbf6bef-8859-45fe-ae6e-5c50ae0908eb tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '128f51d2dabf42d885c2be82ef71c57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e118fd1cf3a54c16b57ddc0567d7c449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cbf6bef-8859-45fe-ae6e-5c50ae0908eb tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Request method failure captured: Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: request: PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449 HTTP/1.1 Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 25 Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5TzlHbNM-NtTY6CNr9vq31ppqrK44RAy7452tnUq0xklODeCX0Da8Zlp5Ct6Rhm5W_e9y9Z4kfEKB-9pI-z6P4janotyPql2kc8hYeE1S_tX9QvyjjerdO9TDbSIZsiaCv_zaE8M0KlUi1Pdz_L24hhoJ6VkjE0vfKfPjJD_F2l3A Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: e118fd1cf3a54c16b57ddc0567d7c449 Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-QuotasAdminNegativeTest-1396023822 Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:32:23.501106 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:32:23.502538 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e118fd1cf3a54c16b57ddc0567d7c449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:23.502538 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-QuotasAdminNegativeTest-1396023822 Aug 27 04:32:23.502538 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: e118fd1cf3a54c16b57ddc0567d7c449 Aug 27 04:32:23.502538 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1396023822 Aug 27 04:32:23.502538 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-QuotasAdminNegativeTest-1396023822-project Aug 27 04:32:23.502538 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:32:23.502538 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:32:23.502538 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 128f51d2dabf42d885c2be82ef71c57b Aug 27 04:32:23.502538 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-QuotasAdminNegativeTest-1396023822-project Aug 27 04:32:23.502538 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:32:23.502538 n-d-854823-1 devstack@n-api.service[128869]: {"quota_set": {"ram": 0}} Aug 27 04:32:23.502538 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:32:23.502538 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 04:32:23.502538 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'e118fd1cf3a54c16b57ddc0567d7c449', 'body': {'quota_set': {'ram': 0}}} Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:23.503353 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:23.504416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:23.506929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:23.506929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:23.506929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:32:23.506929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:32:23.506929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 04:32:23.506929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:23.506929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cbf6bef-8859-45fe-ae6e-5c50ae0908eb tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:23.506929 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2cbf6bef-8859-45fe-ae6e-5c50ae0908eb tempest-QuotasAdminNegativeTest-1396023822 tempest-QuotasAdminNegativeTest-1396023822-project] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449" status: 403 len: 116 microversion: 2.1 time: 0.013213 Aug 27 04:32:23.508123 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 123/233] 10.222.0.79 () {60 vars in 1262 bytes} [Sat Aug 27 04:32:23 2022] PUT /compute/v2.1/os-quota-sets/e118fd1cf3a54c16b57ddc0567d7c449 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:23.560644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e07eb973-0ee5-4d3d-be2a-52cee2eec131 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:23.570959 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e07eb973-0ee5-4d3d-be2a-52cee2eec131 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.196063 Aug 27 04:32:23.571552 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 111/234] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:23 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:23.732892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d6feca8-20b9-4aa2-8355-d816670dcfb3 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:23.733650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d6feca8-20b9-4aa2-8355-d816670dcfb3 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:23.743173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d6feca8-20b9-4aa2-8355-d816670dcfb3 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:23.743915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d6feca8-20b9-4aa2-8355-d816670dcfb3 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:23.744509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d6feca8-20b9-4aa2-8355-d816670dcfb3 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:23.745553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d6feca8-20b9-4aa2-8355-d816670dcfb3 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:23.746025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d6feca8-20b9-4aa2-8355-d816670dcfb3 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:23.746454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d6feca8-20b9-4aa2-8355-d816670dcfb3 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:24.088355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d6feca8-20b9-4aa2-8355-d816670dcfb3 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:24.101016 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d6feca8-20b9-4aa2-8355-d816670dcfb3 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1495 microversion: 2.1 time: 0.372917 Aug 27 04:32:24.102865 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 124/235] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:23 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1495 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:24.510225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3f1e4f51-e365-460b-82f2-27fd6f79b6a0 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:24.511531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3f1e4f51-e365-460b-82f2-27fd6f79b6a0 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:24.521988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f1e4f51-e365-460b-82f2-27fd6f79b6a0 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:24.523406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f1e4f51-e365-460b-82f2-27fd6f79b6a0 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:24.526954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f1e4f51-e365-460b-82f2-27fd6f79b6a0 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:24.527828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f1e4f51-e365-460b-82f2-27fd6f79b6a0 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:24.529038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f1e4f51-e365-460b-82f2-27fd6f79b6a0 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:24.531270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f1e4f51-e365-460b-82f2-27fd6f79b6a0 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:24.597306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-235bde3b-0200-4bb8-bded-9c4e7541231a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:24.598819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-235bde3b-0200-4bb8-bded-9c4e7541231a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:24.639769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-235bde3b-0200-4bb8-bded-9c4e7541231a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:24.642798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-235bde3b-0200-4bb8-bded-9c4e7541231a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:24.643350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-235bde3b-0200-4bb8-bded-9c4e7541231a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:24.645458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-235bde3b-0200-4bb8-bded-9c4e7541231a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:24.647647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-235bde3b-0200-4bb8-bded-9c4e7541231a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:24.648209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-235bde3b-0200-4bb8-bded-9c4e7541231a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:25.090655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3f1e4f51-e365-460b-82f2-27fd6f79b6a0 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:25.101500 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3f1e4f51-e365-460b-82f2-27fd6f79b6a0 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 200 len: 1410 microversion: 2.1 time: 0.596804 Aug 27 04:32:25.104838 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 112/236] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:24 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 1410 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:25.109757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ebac77b5-4523-4fb5-9ec2-54e6f268270f req-aa18557e-40b6-4af2-bf1a-f6be1ada11d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "000044d0-884d-4e30-a18d-5f4ebc4ba4ff", "name": "network-vif-plugged", "status": "completed", "tag": "eb3052de-ef9e-4e1d-9fe3-29285823219d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:25.136999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ebac77b5-4523-4fb5-9ec2-54e6f268270f req-aa18557e-40b6-4af2-bf1a-f6be1ada11d2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:25.137480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ebac77b5-4523-4fb5-9ec2-54e6f268270f req-aa18557e-40b6-4af2-bf1a-f6be1ada11d2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:25.138106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ebac77b5-4523-4fb5-9ec2-54e6f268270f req-aa18557e-40b6-4af2-bf1a-f6be1ada11d2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:25.166774 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ebac77b5-4523-4fb5-9ec2-54e6f268270f req-aa18557e-40b6-4af2-bf1a-f6be1ada11d2 service nova] Creating event network-vif-plugged:eb3052de-ef9e-4e1d-9fe3-29285823219d for instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff on n-h2-854823-1 Aug 27 04:32:25.182083 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ebac77b5-4523-4fb5-9ec2-54e6f268270f req-aa18557e-40b6-4af2-bf1a-f6be1ada11d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075684 Aug 27 04:32:25.186932 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 113/237] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:25.206520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-de5ffb52-295b-4b7a-aa09-b363bdbc6e26 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:25.207294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-de5ffb52-295b-4b7a-aa09-b363bdbc6e26 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:25.227271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5ffb52-295b-4b7a-aa09-b363bdbc6e26 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:25.229444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5ffb52-295b-4b7a-aa09-b363bdbc6e26 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:25.230220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5ffb52-295b-4b7a-aa09-b363bdbc6e26 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:25.231502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5ffb52-295b-4b7a-aa09-b363bdbc6e26 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:25.233405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5ffb52-295b-4b7a-aa09-b363bdbc6e26 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:25.234108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5ffb52-295b-4b7a-aa09-b363bdbc6e26 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:25.300090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-235bde3b-0200-4bb8-bded-9c4e7541231a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:25.309515 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-235bde3b-0200-4bb8-bded-9c4e7541231a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1319 microversion: 2.1 time: 0.718776 Aug 27 04:32:25.327388 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 125/238] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:24 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1319 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:25.332735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-185b14cc-7ba2-4a31-8dc7-2e29d3d96bb6 req-ec023527-6b75-4f59-bf2a-015b0f6e9df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56162f18-821c-4bd7-b262-7fc46702ef4f", "name": "network-vif-deleted", "tag": "6b85f720-3bfe-4f41-8a04-deaed3f68eb0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:25.352078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-185b14cc-7ba2-4a31-8dc7-2e29d3d96bb6 req-ec023527-6b75-4f59-bf2a-015b0f6e9df3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:25.352769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-185b14cc-7ba2-4a31-8dc7-2e29d3d96bb6 req-ec023527-6b75-4f59-bf2a-015b0f6e9df3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:25.353404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-185b14cc-7ba2-4a31-8dc7-2e29d3d96bb6 req-ec023527-6b75-4f59-bf2a-015b0f6e9df3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:25.379415 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-185b14cc-7ba2-4a31-8dc7-2e29d3d96bb6 req-ec023527-6b75-4f59-bf2a-015b0f6e9df3 service nova] Creating event network-vif-deleted:6b85f720-3bfe-4f41-8a04-deaed3f68eb0 for instance 56162f18-821c-4bd7-b262-7fc46702ef4f on n-h2-854823-1 Aug 27 04:32:25.391091 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-185b14cc-7ba2-4a31-8dc7-2e29d3d96bb6 req-ec023527-6b75-4f59-bf2a-015b0f6e9df3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062024 Aug 27 04:32:25.399292 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 126/239] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:25.442244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-de5ffb52-295b-4b7a-aa09-b363bdbc6e26 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:25.464300 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-de5ffb52-295b-4b7a-aa09-b363bdbc6e26 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1324 microversion: 2.1 time: 0.274596 Aug 27 04:32:25.468004 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 114/240] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:25 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1324 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:26.124272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43700397-d4cd-4ab3-be70-8bc07b541da9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:26.125015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43700397-d4cd-4ab3-be70-8bc07b541da9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:26.135367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43700397-d4cd-4ab3-be70-8bc07b541da9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:26.135869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43700397-d4cd-4ab3-be70-8bc07b541da9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:26.136320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43700397-d4cd-4ab3-be70-8bc07b541da9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:26.137071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43700397-d4cd-4ab3-be70-8bc07b541da9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:26.137513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43700397-d4cd-4ab3-be70-8bc07b541da9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:26.137940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43700397-d4cd-4ab3-be70-8bc07b541da9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:26.334990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-354170ed-86bb-4e1c-a256-0473a5dd274a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:26.335743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-354170ed-86bb-4e1c-a256-0473a5dd274a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:26.351435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-354170ed-86bb-4e1c-a256-0473a5dd274a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:26.351866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-354170ed-86bb-4e1c-a256-0473a5dd274a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:26.352309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-354170ed-86bb-4e1c-a256-0473a5dd274a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:26.363486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-354170ed-86bb-4e1c-a256-0473a5dd274a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:26.364105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-354170ed-86bb-4e1c-a256-0473a5dd274a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:26.364587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-354170ed-86bb-4e1c-a256-0473a5dd274a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:26.420476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-43700397-d4cd-4ab3-be70-8bc07b541da9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:26.432736 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43700397-d4cd-4ab3-be70-8bc07b541da9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 200 len: 1410 microversion: 2.1 time: 0.312495 Aug 27 04:32:26.435457 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 127/241] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:26 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 1410 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:26.490185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54c19d24-f586-4037-a475-9ec28c646dc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:26.490805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-54c19d24-f586-4037-a475-9ec28c646dc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:26.505362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c19d24-f586-4037-a475-9ec28c646dc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:26.505861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c19d24-f586-4037-a475-9ec28c646dc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:26.506298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c19d24-f586-4037-a475-9ec28c646dc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:26.507178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c19d24-f586-4037-a475-9ec28c646dc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:26.507646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c19d24-f586-4037-a475-9ec28c646dc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:26.508072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c19d24-f586-4037-a475-9ec28c646dc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:26.576349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c19d24-f586-4037-a475-9ec28c646dc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:26.576568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c19d24-f586-4037-a475-9ec28c646dc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:26.577109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c19d24-f586-4037-a475-9ec28c646dc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:26.577461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-54c19d24-f586-4037-a475-9ec28c646dc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lazy-loading 'fault' on Instance uuid 56162f18-821c-4bd7-b262-7fc46702ef4f {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:32:26.659185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-54c19d24-f586-4037-a475-9ec28c646dc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0100800dbc6d40619bd7cd8f78d03d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5795c326d9474dbeaad1ade3d6359df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:26.667705 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-54c19d24-f586-4037-a475-9ec28c646dc8 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 200 len: 1329 microversion: 2.1 time: 0.183151 Aug 27 04:32:26.668790 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 128/242] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:26 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 1329 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:26.715601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-354170ed-86bb-4e1c-a256-0473a5dd274a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:26.726352 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-354170ed-86bb-4e1c-a256-0473a5dd274a tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1469 microversion: 2.1 time: 0.392948 Aug 27 04:32:26.727131 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 115/243] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:26 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1469 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:27.061462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37fa4a59-c44c-4356-9715-d88aad5c4089 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:27.061970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37fa4a59-c44c-4356-9715-d88aad5c4089 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:27.081596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37fa4a59-c44c-4356-9715-d88aad5c4089 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:27.082115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37fa4a59-c44c-4356-9715-d88aad5c4089 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:27.082560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37fa4a59-c44c-4356-9715-d88aad5c4089 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:27.083455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37fa4a59-c44c-4356-9715-d88aad5c4089 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:27.084926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37fa4a59-c44c-4356-9715-d88aad5c4089 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:27.087449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37fa4a59-c44c-4356-9715-d88aad5c4089 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:27.128041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37fa4a59-c44c-4356-9715-d88aad5c4089 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:32:27.327321 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37fa4a59-c44c-4356-9715-d88aad5c4089 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] 10.222.0.79 "DELETE /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 204 len: 0 microversion: 2.1 time: 0.581033 Aug 27 04:32:27.337310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-933885f3-698f-44d8-a6c5-1f6a8da1e79c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:27.338450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-933885f3-698f-44d8-a6c5-1f6a8da1e79c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:27.341234 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 129/244] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:32:26 2022] DELETE /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 0 bytes in 583 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:32:27.346092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-933885f3-698f-44d8-a6c5-1f6a8da1e79c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:27.346588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-933885f3-698f-44d8-a6c5-1f6a8da1e79c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:27.347024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-933885f3-698f-44d8-a6c5-1f6a8da1e79c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:27.347727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-933885f3-698f-44d8-a6c5-1f6a8da1e79c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:27.351718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-933885f3-698f-44d8-a6c5-1f6a8da1e79c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:27.352174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-933885f3-698f-44d8-a6c5-1f6a8da1e79c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:27.458541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e35e51a-2002-4988-96c6-2663a76acc63 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:27.459886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e35e51a-2002-4988-96c6-2663a76acc63 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:27.468820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e35e51a-2002-4988-96c6-2663a76acc63 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:27.469501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e35e51a-2002-4988-96c6-2663a76acc63 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:27.470151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e35e51a-2002-4988-96c6-2663a76acc63 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:27.471032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e35e51a-2002-4988-96c6-2663a76acc63 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:27.471691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e35e51a-2002-4988-96c6-2663a76acc63 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:27.472351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e35e51a-2002-4988-96c6-2663a76acc63 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:27.626555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-933885f3-698f-44d8-a6c5-1f6a8da1e79c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:27.636307 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-933885f3-698f-44d8-a6c5-1f6a8da1e79c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1475 microversion: 2.1 time: 0.302727 Aug 27 04:32:27.639511 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 116/245] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:27 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1475 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:27.689716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5e9d314-9eee-468f-a542-ae645b0207d2 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:27.690651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f5e9d314-9eee-468f-a542-ae645b0207d2 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:27.700900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5e9d314-9eee-468f-a542-ae645b0207d2 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:27.701400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5e9d314-9eee-468f-a542-ae645b0207d2 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:27.701838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5e9d314-9eee-468f-a542-ae645b0207d2 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:27.702543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5e9d314-9eee-468f-a542-ae645b0207d2 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:27.703179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5e9d314-9eee-468f-a542-ae645b0207d2 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:27.703302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e35e51a-2002-4988-96c6-2663a76acc63 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:27.703900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5e9d314-9eee-468f-a542-ae645b0207d2 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:27.710502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:27.716620 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e35e51a-2002-4988-96c6-2663a76acc63 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 200 len: 1609 microversion: 2.1 time: 0.262897 Aug 27 04:32:27.731100 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 130/246] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:27 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 1609 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-f5e9d314-9eee-468f-a542-ae645b0207d2 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] HTTP exception thrown: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5e9d314-9eee-468f-a542-ae645b0207d2 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Request method failure captured: Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f HTTP/1.1 Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4qcotD0_lYvA8py98LiaTRMoyhDlYk0GAisZaWjwo4xZycq_qUuF_2ZJ8Dlc1OpnftHmjvfhGyfCEFniKQ-5CylrJUAq6mgq76mCcDi4wbgrt59HBM6BARRLn8vpP_37e1IceewKOElU9bMhdfWauusg5GctyUDYDmyUGayVpw1AU Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 5795c326d9474dbeaad1ade3d6359df8 Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AggregatesAdminTestJSON-1885355986 Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:32:27.731315 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:32:27.732663 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5795c326d9474dbeaad1ade3d6359df8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5795c326d9474dbeaad1ade3d6359df8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5795c326d9474dbeaad1ade3d6359df8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5795c326d9474dbeaad1ade3d6359df8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:27.732663 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AggregatesAdminTestJSON-1885355986 Aug 27 04:32:27.732663 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 5795c326d9474dbeaad1ade3d6359df8 Aug 27 04:32:27.732663 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1885355986 Aug 27 04:32:27.732663 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AggregatesAdminTestJSON-1885355986-project Aug 27 04:32:27.732663 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:27.732663 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:27.732663 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 0100800dbc6d40619bd7cd8f78d03d77 Aug 27 04:32:27.732663 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AggregatesAdminTestJSON-1885355986-project Aug 27 04:32:27.732663 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:32:27.732663 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:27.732663 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '56162f18-821c-4bd7-b262-7fc46702ef4f'} Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:27.733444 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:27.734822 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:27.736037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5e9d314-9eee-468f-a542-ae645b0207d2 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Returning 404 to user: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:27.736037 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f5e9d314-9eee-468f-a542-ae645b0207d2 tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 404 len: 111 microversion: 2.1 time: 0.042743 Aug 27 04:32:27.740409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af3a23a5-f9af-4599-b42a-6bfee9bb3ea1 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854823-1"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:27.742815 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 117/247] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:27 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:32:27.751601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d0ddbfcc-f082-4931-a63a-2f7969b527b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:27.752272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d0ddbfcc-f082-4931-a63a-2f7969b527b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:27.756721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af3a23a5-f9af-4599-b42a-6bfee9bb3ea1 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:27.757443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af3a23a5-f9af-4599-b42a-6bfee9bb3ea1 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:27.758250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af3a23a5-f9af-4599-b42a-6bfee9bb3ea1 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:27.760719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ddbfcc-f082-4931-a63a-2f7969b527b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:27.761338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ddbfcc-f082-4931-a63a-2f7969b527b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:27.761882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ddbfcc-f082-4931-a63a-2f7969b527b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:27.762752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ddbfcc-f082-4931-a63a-2f7969b527b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:27.763338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ddbfcc-f082-4931-a63a-2f7969b527b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:27.763873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ddbfcc-f082-4931-a63a-2f7969b527b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:27.925566 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af3a23a5-f9af-4599-b42a-6bfee9bb3ea1 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.1 time: 0.189499 Aug 27 04:32:27.926178 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 131/248] 10.222.0.79 () {60 vars in 1191 bytes} [Sat Aug 27 04:32:27 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:27.940962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4076d3fe-0335-4dd1-a70e-48f86015b903 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:27.977195 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d0ddbfcc-f082-4931-a63a-2f7969b527b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.232144 Aug 27 04:32:27.978011 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 118/249] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 04:32:27 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:27.989008 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4076d3fe-0335-4dd1-a70e-48f86015b903 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.054759 Aug 27 04:32:27.990070 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 132/250] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:32:27 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 04:32:28.004440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d47e14e2-cfba-48b9-9d78-4b5020933140 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1318236059"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:28.007582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.aggregate [None req-d47e14e2-cfba-48b9-9d78-4b5020933140 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Generated uuid 919961f7-bc9b-4525-99da-e9979c69434a for aggregate {{(pid=128870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:32:28.048862 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d47e14e2-cfba-48b9-9d78-4b5020933140 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048880 Aug 27 04:32:28.050458 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 119/251] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:32:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:28.062354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1a33f19-15d4-4183-a53e-3dc61b0b1f89 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854823-1"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:28.077953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1a33f19-15d4-4183-a53e-3dc61b0b1f89 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:28.078411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1a33f19-15d4-4183-a53e-3dc61b0b1f89 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:28.078904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1a33f19-15d4-4183-a53e-3dc61b0b1f89 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:28.288619 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1a33f19-15d4-4183-a53e-3dc61b0b1f89 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.230406 Aug 27 04:32:28.291474 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 133/252] 10.222.0.79 () {60 vars in 1191 bytes} [Sat Aug 27 04:32:28 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:28.302811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-78d63a81-df98-443c-9d60-cbd02b25bb39 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:28.313228 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-78d63a81-df98-443c-9d60-cbd02b25bb39 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.015047 Aug 27 04:32:28.314044 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 120/253] 10.222.0.79 () {58 vars in 1149 bytes} [Sat Aug 27 04:32:28 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:32:28.327151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-945cc8b7-c585-470a-abdb-c4cd07a93464 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854823-1"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:28.341877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945cc8b7-c585-470a-abdb-c4cd07a93464 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:28.342771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945cc8b7-c585-470a-abdb-c4cd07a93464 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:28.343439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945cc8b7-c585-470a-abdb-c4cd07a93464 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:28.530948 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-945cc8b7-c585-470a-abdb-c4cd07a93464 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.208261 Aug 27 04:32:28.531827 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 134/254] 10.222.0.79 () {60 vars in 1191 bytes} [Sat Aug 27 04:32:28 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:32:28.547098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-13117244-0f00-47c9-995d-94c5a164d70e tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:28.580313 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-13117244-0f00-47c9-995d-94c5a164d70e tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.039689 Aug 27 04:32:28.581609 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 121/255] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:32:28 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:32:28.598493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb2615fd-c177-4cd0-9825-e5508fa378cd tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-609844685"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:28.605057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-eb2615fd-c177-4cd0-9825-e5508fa378cd tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Generated uuid c6a6e41e-3c17-4801-90a9-514612b2290c for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:32:28.636322 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb2615fd-c177-4cd0-9825-e5508fa378cd tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.045647 Aug 27 04:32:28.637638 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 135/256] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:32:28 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:28.652732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-74579737-5f3e-4b5d-a518-faf160996fe7 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854823-1"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:28.675788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e41a7cb0-be5f-4789-9c55-c30711dff6a9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:28.679761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e41a7cb0-be5f-4789-9c55-c30711dff6a9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:28.680167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74579737-5f3e-4b5d-a518-faf160996fe7 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:28.683154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74579737-5f3e-4b5d-a518-faf160996fe7 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:28.683790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74579737-5f3e-4b5d-a518-faf160996fe7 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:28.695102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e41a7cb0-be5f-4789-9c55-c30711dff6a9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:28.695599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e41a7cb0-be5f-4789-9c55-c30711dff6a9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:28.696036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e41a7cb0-be5f-4789-9c55-c30711dff6a9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:28.696899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e41a7cb0-be5f-4789-9c55-c30711dff6a9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:28.697395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e41a7cb0-be5f-4789-9c55-c30711dff6a9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:28.697862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e41a7cb0-be5f-4789-9c55-c30711dff6a9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:28.870334 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-74579737-5f3e-4b5d-a518-faf160996fe7 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.225409 Aug 27 04:32:28.877446 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 122/257] 10.222.0.79 () {60 vars in 1191 bytes} [Sat Aug 27 04:32:28 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:32:28.884716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3a69b06c-8996-4a4f-8c4f-b2259d6569ec tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:28.925750 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3a69b06c-8996-4a4f-8c4f-b2259d6569ec tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.046883 Aug 27 04:32:28.936141 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 123/258] 10.222.0.79 () {58 vars in 1143 bytes} [Sat Aug 27 04:32:28 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:28.952781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-109cea0a-67d4-4de4-9c66-be8c903d233d tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854823-1"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:28.971495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-109cea0a-67d4-4de4-9c66-be8c903d233d tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:28.973826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-109cea0a-67d4-4de4-9c66-be8c903d233d tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:28.975521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-109cea0a-67d4-4de4-9c66-be8c903d233d tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:29.183693 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-109cea0a-67d4-4de4-9c66-be8c903d233d tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.242551 Aug 27 04:32:29.190324 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 124/259] 10.222.0.79 () {60 vars in 1191 bytes} [Sat Aug 27 04:32:28 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:29.201128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9c7d179e-ab17-4e63-8333-d38e3820ec69 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:29.240907 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9c7d179e-ab17-4e63-8333-d38e3820ec69 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.046946 Aug 27 04:32:29.241616 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 125/260] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:32:29 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:32:29.257700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-274a0134-f8b6-401c-91f7-8f6018701216 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2117795434"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:29.262765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.aggregate [None req-274a0134-f8b6-401c-91f7-8f6018701216 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Generated uuid a1ee1bb7-b86a-4947-87b3-b40545f4f0ac for aggregate {{(pid=128870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:32:29.296402 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-274a0134-f8b6-401c-91f7-8f6018701216 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.044585 Aug 27 04:32:29.305045 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 126/261] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:32:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:29.311375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a744dc8a-07da-4ff1-87ef-4d1632f6ccf6 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854823-1"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:29.325208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:29.327606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a744dc8a-07da-4ff1-87ef-4d1632f6ccf6 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:29.328412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a744dc8a-07da-4ff1-87ef-4d1632f6ccf6 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:29.329196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a744dc8a-07da-4ff1-87ef-4d1632f6ccf6 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:29.578780 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a744dc8a-07da-4ff1-87ef-4d1632f6ccf6 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.271982 Aug 27 04:32:29.600427 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 127/262] 10.222.0.79 () {60 vars in 1194 bytes} [Sat Aug 27 04:32:29 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:29.630240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9f6cc26a-044b-41f6-b076-91a2befab918 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854823-1"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:29.649500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f6cc26a-044b-41f6-b076-91a2befab918 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:29.650030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f6cc26a-044b-41f6-b076-91a2befab918 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:29.650483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f6cc26a-044b-41f6-b076-91a2befab918 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:29.683482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e41a7cb0-be5f-4789-9c55-c30711dff6a9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:29.694751 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e41a7cb0-be5f-4789-9c55-c30711dff6a9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1475 microversion: 2.1 time: 1.024346 Aug 27 04:32:29.700111 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 136/263] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:28 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1475 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:29.843253 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9f6cc26a-044b-41f6-b076-91a2befab918 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.241492 Aug 27 04:32:29.853430 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 128/264] 10.222.0.79 () {60 vars in 1194 bytes} [Sat Aug 27 04:32:29 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:29.856035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-401ece51-f831-4227-b47f-a3da4986d614 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:29.887117 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-401ece51-f831-4227-b47f-a3da4986d614 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.034956 Aug 27 04:32:29.887712 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 137/265] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:32:29 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 04:32:29.899287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3b1179e-ccd5-4d34-961f-d3c543498251 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1107336069"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:29.902621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fbf2479c-f3b8-4d43-be81-cdd946a23b3f tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1220294994"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:29.909832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-c3b1179e-ccd5-4d34-961f-d3c543498251 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Generated uuid 1c9ea205-a3bf-45a4-9521-799977a8aa9e for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:32:29.910839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.aggregate [None req-fbf2479c-f3b8-4d43-be81-cdd946a23b3f tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Generated uuid e8dc1edf-31f3-498f-b562-b8058b346ab7 for aggregate {{(pid=128870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:32:29.927265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:29.950579 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fbf2479c-f3b8-4d43-be81-cdd946a23b3f tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.055527 Aug 27 04:32:29.956790 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 129/266] 10.222.0.79 () {62 vars in 1205 bytes} [Sat Aug 27 04:32:29 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:29.965219 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3b1179e-ccd5-4d34-961f-d3c543498251 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.067593 Aug 27 04:32:29.968933 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 138/267] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:32:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:29.978516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-035b4a93-fa7f-4fd6-9532-5d5e92fc5093 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:29.998102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a52362fa-25f4-42a1-8fb4-cb0d42618058 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1528013650"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:30.025509 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-035b4a93-fa7f-4fd6-9532-5d5e92fc5093 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.046916 Aug 27 04:32:30.027287 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 139/268] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:32:29 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 04:32:30.048093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9bb4f57c-d17c-4cf1-a289-c96ae8e5091c tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:30.064451 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9bb4f57c-d17c-4cf1-a289-c96ae8e5091c tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9bb4f57c-d17c-4cf1-a289-c96ae8e5091c tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Request method failure captured: Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4tlRf9tPrWcRzC_ZferR20Ajr6n_31pdJVd5mOjUD1PIBUrWPbM6K_LdppWZJ41ivcmhYHd5S-ydTKkqd0JGzn7NH22lHW9Q7WFU5psqyL8qwai-jy0Jr-0cS5ddiQxvuLLCIdR1e2zLlhM5_TDeoQxSUyjerg9yzwWoj1gweye24 Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 535886acc5a04f1d8b06f8488ecef288 Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminTestJSON-2133148271 Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:32:30.067665 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:32:30.068993 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:30.068993 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminTestJSON-2133148271 Aug 27 04:32:30.068993 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 535886acc5a04f1d8b06f8488ecef288 Aug 27 04:32:30.068993 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2133148271 Aug 27 04:32:30.068993 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminTestJSON-2133148271-project-admin Aug 27 04:32:30.068993 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:32:30.068993 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:32:30.068993 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: f30e5a2690ce44ec9f11c64a73c5e587 Aug 27 04:32:30.068993 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminTestJSON-2133148271-project-admin Aug 27 04:32:30.068993 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:32:30.068993 n-d-854823-1 devstack@n-api.service[128869]: exception: Aggregate 12 could not be found. Aug 27 04:32:30.068993 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '12'} Aug 27 04:32:30.068993 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:30.069767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 27 04:32:30.070886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.072469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9bb4f57c-d17c-4cf1-a289-c96ae8e5091c tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:30.072469 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9bb4f57c-d17c-4cf1-a289-c96ae8e5091c tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.036899 Aug 27 04:32:30.072469 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 140/269] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:32:30 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:32:30.086028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-187f9d18-6786-4186-9e5b-b400fd646e66 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:30.125895 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-187f9d18-6786-4186-9e5b-b400fd646e66 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-187f9d18-6786-4186-9e5b-b400fd646e66 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Request method failure captured: Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4tlRf9tPrWcRzC_ZferR20Ajr6n_31pdJVd5mOjUD1PIBUrWPbM6K_LdppWZJ41ivcmhYHd5S-ydTKkqd0JGzn7NH22lHW9Q7WFU5psqyL8qwai-jy0Jr-0cS5ddiQxvuLLCIdR1e2zLlhM5_TDeoQxSUyjerg9yzwWoj1gweye24 Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 535886acc5a04f1d8b06f8488ecef288 Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminTestJSON-2133148271 Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:32:30.127869 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:32:30.129183 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:30.129183 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminTestJSON-2133148271 Aug 27 04:32:30.129183 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 535886acc5a04f1d8b06f8488ecef288 Aug 27 04:32:30.129183 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2133148271 Aug 27 04:32:30.129183 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminTestJSON-2133148271-project-admin Aug 27 04:32:30.129183 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:32:30.129183 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:32:30.129183 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: f30e5a2690ce44ec9f11c64a73c5e587 Aug 27 04:32:30.129183 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminTestJSON-2133148271-project-admin Aug 27 04:32:30.129183 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:32:30.129183 n-d-854823-1 devstack@n-api.service[128869]: exception: Aggregate 12 could not be found. Aug 27 04:32:30.129183 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '12'} Aug 27 04:32:30.129183 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:32:30.129897 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:30.130920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:30.132035 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:30.132035 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:30.132035 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:30.132035 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 27 04:32:30.132035 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.132035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-187f9d18-6786-4186-9e5b-b400fd646e66 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:30.132035 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-187f9d18-6786-4186-9e5b-b400fd646e66 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.049691 Aug 27 04:32:30.132035 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 141/270] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:32:30 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:32:30.149066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77613962-c0dd-4a5f-b9a6-38f7199c759e tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-472091296", "name": "tempest-test_aggregate-1197906992"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:30.193235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-77613962-c0dd-4a5f-b9a6-38f7199c759e tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Generated uuid fbd00ebd-7e2f-4e96-855a-1a945944c8cf for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:32:30.255276 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77613962-c0dd-4a5f-b9a6-38f7199c759e tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.118854 Aug 27 04:32:30.256714 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 142/271] 10.222.0.79 () {60 vars in 1165 bytes} [Sat Aug 27 04:32:30 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:32:30.288413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a67b68b6-ea77-40ef-a830-5b7bb9297dba tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:30.346839 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a67b68b6-ea77-40ef-a830-5b7bb9297dba tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.081601 Aug 27 04:32:30.347772 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 143/272] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:32:30 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:32:30.361501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-135ec5fe-decc-4dd2-a129-c80c63a386a3 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:30.372627 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-135ec5fe-decc-4dd2-a129-c80c63a386a3 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-135ec5fe-decc-4dd2-a129-c80c63a386a3 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Request method failure captured: Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4tlRf9tPrWcRzC_ZferR20Ajr6n_31pdJVd5mOjUD1PIBUrWPbM6K_LdppWZJ41ivcmhYHd5S-ydTKkqd0JGzn7NH22lHW9Q7WFU5psqyL8qwai-jy0Jr-0cS5ddiQxvuLLCIdR1e2zLlhM5_TDeoQxSUyjerg9yzwWoj1gweye24 Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 535886acc5a04f1d8b06f8488ecef288 Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminTestJSON-2133148271 Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:32:30.376837 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:32:30.378387 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:30.378387 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminTestJSON-2133148271 Aug 27 04:32:30.378387 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 535886acc5a04f1d8b06f8488ecef288 Aug 27 04:32:30.378387 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2133148271 Aug 27 04:32:30.378387 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminTestJSON-2133148271-project-admin Aug 27 04:32:30.378387 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:32:30.378387 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:32:30.378387 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: f30e5a2690ce44ec9f11c64a73c5e587 Aug 27 04:32:30.378387 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminTestJSON-2133148271-project-admin Aug 27 04:32:30.378387 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:32:30.378387 n-d-854823-1 devstack@n-api.service[128869]: exception: Aggregate 13 could not be found. Aug 27 04:32:30.378387 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '13'} Aug 27 04:32:30.378387 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:30.380938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Aug 27 04:32:30.383230 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.388019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-135ec5fe-decc-4dd2-a129-c80c63a386a3 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:30.390169 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-135ec5fe-decc-4dd2-a129-c80c63a386a3 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.037597 Aug 27 04:32:30.393754 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 144/273] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:32:30 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:32:30.410316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e86e72d4-1bc3-4475-8499-f628f12adbba tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:30.422254 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e86e72d4-1bc3-4475-8499-f628f12adbba tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e86e72d4-1bc3-4475-8499-f628f12adbba tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Request method failure captured: Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4tlRf9tPrWcRzC_ZferR20Ajr6n_31pdJVd5mOjUD1PIBUrWPbM6K_LdppWZJ41ivcmhYHd5S-ydTKkqd0JGzn7NH22lHW9Q7WFU5psqyL8qwai-jy0Jr-0cS5ddiQxvuLLCIdR1e2zLlhM5_TDeoQxSUyjerg9yzwWoj1gweye24 Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 535886acc5a04f1d8b06f8488ecef288 Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminTestJSON-2133148271 Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:32:30.426199 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:32:30.427407 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/535886acc5a04f1d8b06f8488ecef288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:30.427407 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminTestJSON-2133148271 Aug 27 04:32:30.427407 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 535886acc5a04f1d8b06f8488ecef288 Aug 27 04:32:30.427407 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2133148271 Aug 27 04:32:30.427407 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminTestJSON-2133148271-project-admin Aug 27 04:32:30.427407 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:32:30.427407 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:32:30.427407 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: f30e5a2690ce44ec9f11c64a73c5e587 Aug 27 04:32:30.427407 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminTestJSON-2133148271-project-admin Aug 27 04:32:30.427407 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:32:30.427407 n-d-854823-1 devstack@n-api.service[128869]: exception: Aggregate 13 could not be found. Aug 27 04:32:30.427407 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '13'} Aug 27 04:32:30.427407 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:32:30.428115 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:30.429189 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:30.430278 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:30.430278 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:30.430278 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:30.430278 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Aug 27 04:32:30.430278 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:30.432343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e86e72d4-1bc3-4475-8499-f628f12adbba tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:30.433562 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e86e72d4-1bc3-4475-8499-f628f12adbba tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.030383 Aug 27 04:32:30.435764 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 145/274] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:32:30 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:32:30.444415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-768dbc96-12ec-4f2d-b986-1a55774fda2a tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-787663260"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:30.449098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-768dbc96-12ec-4f2d-b986-1a55774fda2a tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Generated uuid b5ee7721-097e-401e-b62f-94b6362e2362 for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:32:30.502052 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-768dbc96-12ec-4f2d-b986-1a55774fda2a tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060879 Aug 27 04:32:30.503205 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 146/275] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:32:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:32:30.506515 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a52362fa-25f4-42a1-8fb4-cb0d42618058 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 300 microversion: 2.41 time: 0.544477 Aug 27 04:32:30.517527 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 130/276] 10.222.0.79 () {62 vars in 1213 bytes} [Sat Aug 27 04:32:29 2022] PUT /compute/v2.1/os-aggregates/11 => generated 300 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:30.519375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-48040b29-1342-4385-a006-a8a7678543b2 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:30.523988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8a24421a-3461-4e37-86cb-8e568e411928 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:30.536900 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8a24421a-3461-4e37-86cb-8e568e411928 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 300 microversion: 2.41 time: 0.017397 Aug 27 04:32:30.537480 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 131/277] 10.222.0.79 () {60 vars in 1193 bytes} [Sat Aug 27 04:32:30 2022] GET /compute/v2.1/os-aggregates/11 => generated 300 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:30.545130 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-48040b29-1342-4385-a006-a8a7678543b2 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 227 microversion: 2.1 time: 0.022892 Aug 27 04:32:30.546306 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 147/278] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:32:30 2022] GET /compute/v2.1/os-aggregates/14 => generated 227 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:30.557162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-666af843-819e-4c71-b577-fb982cf22694 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854823-1"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:30.557459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae1bb43e-0c06-4c3b-9708-729a0fa67fce tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:30.570792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-666af843-819e-4c71-b577-fb982cf22694 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:30.571232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-666af843-819e-4c71-b577-fb982cf22694 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:30.572179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-666af843-819e-4c71-b577-fb982cf22694 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:30.607870 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae1bb43e-0c06-4c3b-9708-729a0fa67fce tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 265 microversion: 2.1 time: 0.054276 Aug 27 04:32:30.609123 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 148/279] 10.222.0.79 () {60 vars in 1194 bytes} [Sat Aug 27 04:32:30 2022] POST /compute/v2.1/os-aggregates/14/action => generated 265 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:32:30.621165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f63245de-cdde-40d5-9a99-6c818714ffa7 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:30.650994 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f63245de-cdde-40d5-9a99-6c818714ffa7 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 241 microversion: 2.1 time: 0.032832 Aug 27 04:32:30.651603 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 149/280] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:32:30 2022] GET /compute/v2.1/os-aggregates/14 => generated 241 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:32:30.663962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a78a5ad7-4b29-47c7-a0ff-e39da8f3f9e6 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:30.730542 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a78a5ad7-4b29-47c7-a0ff-e39da8f3f9e6 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.067541 Aug 27 04:32:30.731199 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 150/281] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:32:30 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:32:30.744521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-077ab003-90fb-47ee-8d8b-bb6b600ba148 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:30.745154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-077ab003-90fb-47ee-8d8b-bb6b600ba148 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:30.755694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-077ab003-90fb-47ee-8d8b-bb6b600ba148 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:30.756177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-077ab003-90fb-47ee-8d8b-bb6b600ba148 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:30.756652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-077ab003-90fb-47ee-8d8b-bb6b600ba148 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:30.757353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-077ab003-90fb-47ee-8d8b-bb6b600ba148 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:30.757803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-077ab003-90fb-47ee-8d8b-bb6b600ba148 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:30.758213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-077ab003-90fb-47ee-8d8b-bb6b600ba148 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:30.827206 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-666af843-819e-4c71-b577-fb982cf22694 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 315 microversion: 2.41 time: 0.280991 Aug 27 04:32:30.828573 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 132/282] 10.222.0.79 () {62 vars in 1235 bytes} [Sat Aug 27 04:32:30 2022] POST /compute/v2.1/os-aggregates/11/action => generated 315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:30.841912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b412084e-f09c-4b5a-8f25-ad89c0c6ca11 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-649029973", "availability_zone": "tempest-test_az-1804788638"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:30.847377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.aggregate [None req-b412084e-f09c-4b5a-8f25-ad89c0c6ca11 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Generated uuid 957e33a7-ce55-4ae9-b08b-2a926f8f6e70 for aggregate {{(pid=128870) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:32:30.890883 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b412084e-f09c-4b5a-8f25-ad89c0c6ca11 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.061914 Aug 27 04:32:30.899596 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 133/283] 10.222.0.79 () {60 vars in 1165 bytes} [Sat Aug 27 04:32:30 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:30.901209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d10adab9-2163-4a88-9ecc-8c2c4c6ee6ad tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854823-1"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:30.913808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d10adab9-2163-4a88-9ecc-8c2c4c6ee6ad tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:30.914451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d10adab9-2163-4a88-9ecc-8c2c4c6ee6ad tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:30.915054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d10adab9-2163-4a88-9ecc-8c2c4c6ee6ad tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:31.073649 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d10adab9-2163-4a88-9ecc-8c2c4c6ee6ad tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 300 microversion: 2.41 time: 0.179776 Aug 27 04:32:31.083588 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 134/284] 10.222.0.79 () {62 vars in 1235 bytes} [Sat Aug 27 04:32:30 2022] POST /compute/v2.1/os-aggregates/11/action => generated 300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:31.089465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ca912c74-9453-442e-aa1f-64a54e09dd0b tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-649029973_new", "availability_zone": "tempest-test_az-1804788638_new"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:31.106786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:31.131452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca912c74-9453-442e-aa1f-64a54e09dd0b tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:31.131935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca912c74-9453-442e-aa1f-64a54e09dd0b tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:31.132418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca912c74-9453-442e-aa1f-64a54e09dd0b tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:31.166561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-077ab003-90fb-47ee-8d8b-bb6b600ba148 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:31.177152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=14 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:31.181903 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-077ab003-90fb-47ee-8d8b-bb6b600ba148 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1475 microversion: 2.1 time: 0.449631 Aug 27 04:32:31.184759 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 151/285] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:30 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1475 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:31.189827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b86d494-6fb3-49d0-aa44-1842ade17b85 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:31.195322 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ca912c74-9453-442e-aa1f-64a54e09dd0b tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-aggregates/15" status: 200 len: 336 microversion: 2.1 time: 0.110503 Aug 27 04:32:31.202247 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 135/286] 10.222.0.79 () {60 vars in 1173 bytes} [Sat Aug 27 04:32:31 2022] PUT /compute/v2.1/os-aggregates/15 => generated 336 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:31.207872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c4370d56-f51f-4467-9e1e-27bda5d7450e tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:31.226278 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c4370d56-f51f-4467-9e1e-27bda5d7450e tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 578 microversion: 2.1 time: 0.021921 Aug 27 04:32:31.235100 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 136/287] 10.222.0.79 () {58 vars in 1143 bytes} [Sat Aug 27 04:32:31 2022] GET /compute/v2.1/os-aggregates => generated 578 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:32:31.242521 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b86d494-6fb3-49d0-aa44-1842ade17b85 tempest-AggregatesAdminTestV241-865079641 tempest-AggregatesAdminTestV241-865079641-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.41 time: 0.056322 Aug 27 04:32:31.242962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b45d62b5-cc1f-43cc-b9bd-5f3c9f337a86 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:31.243468 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 152/288] 10.222.0.79 () {60 vars in 1196 bytes} [Sat Aug 27 04:32:31 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:31.278010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a73ce275-f53e-4ca0-b22d-9778184f066f tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1140081439"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:31.281453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-a73ce275-f53e-4ca0-b22d-9778184f066f tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Generated uuid 0aa3c5ae-7586-46b1-804e-584e8f375b06 for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:32:31.319663 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b45d62b5-cc1f-43cc-b9bd-5f3c9f337a86 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.080852 Aug 27 04:32:31.326385 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 137/289] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:32:31 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:32:31.330183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-cd7b9533-82e2-4e50-8381-7e22879e4d1c req-ebc102d7-fda6-4c28-8f94-fcfe0b212aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95fe425c-a241-46b8-84d0-9ec136716def", "name": "network-vif-deleted", "tag": "c70e59e4-bb46-46e8-aa91-27de81821024"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:31.338400 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a73ce275-f53e-4ca0-b22d-9778184f066f tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064334 Aug 27 04:32:31.339451 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 153/290] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:32:31 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:32:31.350781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b15e3af5-1662-4144-a0e2-96fd1d3ff48f tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1982714595"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:31.358260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cd7b9533-82e2-4e50-8381-7e22879e4d1c req-ebc102d7-fda6-4c28-8f94-fcfe0b212aed service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:31.358739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cd7b9533-82e2-4e50-8381-7e22879e4d1c req-ebc102d7-fda6-4c28-8f94-fcfe0b212aed service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:31.359164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cd7b9533-82e2-4e50-8381-7e22879e4d1c req-ebc102d7-fda6-4c28-8f94-fcfe0b212aed service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:31.372610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-b15e3af5-1662-4144-a0e2-96fd1d3ff48f tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Generated uuid ba05b0c2-d137-4a4d-adca-4e3a4187719a for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:32:31.378861 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-cd7b9533-82e2-4e50-8381-7e22879e4d1c req-ebc102d7-fda6-4c28-8f94-fcfe0b212aed service nova] Creating event network-vif-deleted:c70e59e4-bb46-46e8-aa91-27de81821024 for instance 95fe425c-a241-46b8-84d0-9ec136716def on n-h1-854823-1 Aug 27 04:32:31.410603 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-cd7b9533-82e2-4e50-8381-7e22879e4d1c req-ebc102d7-fda6-4c28-8f94-fcfe0b212aed service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083894 Aug 27 04:32:31.414553 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 138/291] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:31.423002 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b15e3af5-1662-4144-a0e2-96fd1d3ff48f tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.082022 Aug 27 04:32:31.424629 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 154/292] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:32:31 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:31.433787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e87965fc-a004-460d-bf13-6031d19ddd4b tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854823-1"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:31.437110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1511f18-0447-4ef7-b733-7ae336703e7b tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:31.463193 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1511f18-0447-4ef7-b733-7ae336703e7b tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 446 microversion: 2.1 time: 0.029678 Aug 27 04:32:31.468918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e87965fc-a004-460d-bf13-6031d19ddd4b tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:31.469413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e87965fc-a004-460d-bf13-6031d19ddd4b tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:31.469890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e87965fc-a004-460d-bf13-6031d19ddd4b tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:31.491558 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 155/293] 10.222.0.79 () {58 vars in 1143 bytes} [Sat Aug 27 04:32:31 2022] GET /compute/v2.1/os-aggregates => generated 446 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:31.496574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-734ab8ad-8e01-41dc-b4d2-e577a2e82022 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:31.577814 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-734ab8ad-8e01-41dc-b4d2-e577a2e82022 tempest-AggregatesAdminTestJSON-2133148271 tempest-AggregatesAdminTestJSON-2133148271-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.084979 Aug 27 04:32:31.583671 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 156/294] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:32:31 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 04:32:31.595244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e2327a8-4595-44a2-9756-9a1384a92dcd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:31.596515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e2327a8-4595-44a2-9756-9a1384a92dcd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:31.616258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e2327a8-4595-44a2-9756-9a1384a92dcd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:31.620083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e2327a8-4595-44a2-9756-9a1384a92dcd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:31.620940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e2327a8-4595-44a2-9756-9a1384a92dcd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:31.623356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e2327a8-4595-44a2-9756-9a1384a92dcd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:31.624038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e2327a8-4595-44a2-9756-9a1384a92dcd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:31.627762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e2327a8-4595-44a2-9756-9a1384a92dcd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:31.750093 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e87965fc-a004-460d-bf13-6031d19ddd4b tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 243 microversion: 2.1 time: 0.330664 Aug 27 04:32:31.757237 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 139/295] 10.222.0.79 () {60 vars in 1194 bytes} [Sat Aug 27 04:32:31 2022] POST /compute/v2.1/os-aggregates/16/action => generated 243 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:31.757237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f2377762-fc12-4efe-a41d-3f825141dd8c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:31.757237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f2377762-fc12-4efe-a41d-3f825141dd8c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:31.781213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2377762-fc12-4efe-a41d-3f825141dd8c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:31.781743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2377762-fc12-4efe-a41d-3f825141dd8c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:31.782164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2377762-fc12-4efe-a41d-3f825141dd8c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:31.782879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2377762-fc12-4efe-a41d-3f825141dd8c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:31.783335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2377762-fc12-4efe-a41d-3f825141dd8c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:31.783755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2377762-fc12-4efe-a41d-3f825141dd8c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:31.827450 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-f2377762-fc12-4efe-a41d-3f825141dd8c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] HTTP exception thrown: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f2377762-fc12-4efe-a41d-3f825141dd8c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Request method failure captured: Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f HTTP/1.1 Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4qcotD0_lYvA8py98LiaTRMoyhDlYk0GAisZaWjwo4xZycq_qUuF_2ZJ8Dlc1OpnftHmjvfhGyfCEFniKQ-5CylrJUAq6mgq76mCcDi4wbgrt59HBM6BARRLn8vpP_37e1IceewKOElU9bMhdfWauusg5GctyUDYDmyUGayVpw1AU Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 5795c326d9474dbeaad1ade3d6359df8 Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AggregatesAdminTestJSON-1885355986 Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:32:31.840880 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:32:31.842209 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5795c326d9474dbeaad1ade3d6359df8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5795c326d9474dbeaad1ade3d6359df8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5795c326d9474dbeaad1ade3d6359df8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5795c326d9474dbeaad1ade3d6359df8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:31.842209 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AggregatesAdminTestJSON-1885355986 Aug 27 04:32:31.842209 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 5795c326d9474dbeaad1ade3d6359df8 Aug 27 04:32:31.842209 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1885355986 Aug 27 04:32:31.842209 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AggregatesAdminTestJSON-1885355986-project Aug 27 04:32:31.842209 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:31.842209 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:31.842209 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 0100800dbc6d40619bd7cd8f78d03d77 Aug 27 04:32:31.842209 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AggregatesAdminTestJSON-1885355986-project Aug 27 04:32:31.842209 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:32:31.842209 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:31.842209 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '56162f18-821c-4bd7-b262-7fc46702ef4f'} Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:31.842930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:31.844018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:31.848693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f2377762-fc12-4efe-a41d-3f825141dd8c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Returning 404 to user: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:31.848693 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f2377762-fc12-4efe-a41d-3f825141dd8c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "DELETE /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 404 len: 111 microversion: 2.1 time: 0.091736 Aug 27 04:32:31.848693 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 140/296] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:32:31 2022] DELETE /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:31.860816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aa877d6b-5ee4-464d-b2ff-be54acf32f65 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854823-1"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:31.869812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aa877d6b-5ee4-464d-b2ff-be54acf32f65 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '3a374f235c9d443c90a0e68370992b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d130c9f81f4e73a1caca2a8eac4f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aa877d6b-5ee4-464d-b2ff-be54acf32f65 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Request method failure captured: Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 42 Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4oB4kCZ-mKz8fBbJgrC57xM6qhYiEtEMpbYVty-QrtjPWMkZWIG1vsTkT5Ii-p2OH1Khv7ubAGgrshQGOf0tWOyLT5iOPntcG7yhJHQaS9aFkhsBZCFMpaR8zBxnxrTOT-OcsIXwP5P9wWJstmMt1WW0ixKHc9N__S9-wk58DY1Gg Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 46d130c9f81f4e73a1caca2a8eac4f5d Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:32:31.873940 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:32:31.875207 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46d130c9f81f4e73a1caca2a8eac4f5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:31.875207 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:32:31.875207 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 46d130c9f81f4e73a1caca2a8eac4f5d Aug 27 04:32:31.875207 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-762562147 Aug 27 04:32:31.875207 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AggregatesAdminNegativeTestJSON-762562147-project Aug 27 04:32:31.875207 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:31.875207 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:31.875207 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3a374f235c9d443c90a0e68370992b92 Aug 27 04:32:31.875207 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-762562147-project Aug 27 04:32:31.875207 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:32:31.875207 n-d-854823-1 devstack@n-api.service[128870]: {"remove_host": {"host": "n-h2-854823-1"}} Aug 27 04:32:31.875207 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:32:31.875207 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'n-h2-854823-1'}}} Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:31.875967 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 04:32:31.877268 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:31.878316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aa877d6b-5ee4-464d-b2ff-be54acf32f65 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:31.878316 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aa877d6b-5ee4-464d-b2ff-be54acf32f65 tempest-AggregatesAdminNegativeTestJSON-762562147 tempest-AggregatesAdminNegativeTestJSON-762562147-project] 10.222.0.79 "POST /compute/v2.1/os-aggregates/16/action" status: 403 len: 121 microversion: 2.1 time: 0.026310 Aug 27 04:32:31.878316 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 141/297] 10.222.0.79 () {60 vars in 1194 bytes} [Sat Aug 27 04:32:31 2022] POST /compute/v2.1/os-aggregates/16/action => generated 121 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:31.891911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6c38f670-228e-4fc3-9916-db6ba8f13e4c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:31.892575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6c38f670-228e-4fc3-9916-db6ba8f13e4c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] [instance: 56162f18-821c-4bd7-b262-7fc46702ef4f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:31.912910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c38f670-228e-4fc3-9916-db6ba8f13e4c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:31.913439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c38f670-228e-4fc3-9916-db6ba8f13e4c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:31.913945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c38f670-228e-4fc3-9916-db6ba8f13e4c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:31.914620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c38f670-228e-4fc3-9916-db6ba8f13e4c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:31.917770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c38f670-228e-4fc3-9916-db6ba8f13e4c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:31.918237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c38f670-228e-4fc3-9916-db6ba8f13e4c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:31.947835 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-6c38f670-228e-4fc3-9916-db6ba8f13e4c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] HTTP exception thrown: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6c38f670-228e-4fc3-9916-db6ba8f13e4c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Request method failure captured: Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f HTTP/1.1 Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4qcotD0_lYvA8py98LiaTRMoyhDlYk0GAisZaWjwo4xZycq_qUuF_2ZJ8Dlc1OpnftHmjvfhGyfCEFniKQ-5CylrJUAq6mgq76mCcDi4wbgrt59HBM6BARRLn8vpP_37e1IceewKOElU9bMhdfWauusg5GctyUDYDmyUGayVpw1AU Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 5795c326d9474dbeaad1ade3d6359df8 Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AggregatesAdminTestJSON-1885355986 Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:32:31.949528 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:32:31.950728 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5795c326d9474dbeaad1ade3d6359df8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5795c326d9474dbeaad1ade3d6359df8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5795c326d9474dbeaad1ade3d6359df8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5795c326d9474dbeaad1ade3d6359df8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:31.950728 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AggregatesAdminTestJSON-1885355986 Aug 27 04:32:31.950728 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 5795c326d9474dbeaad1ade3d6359df8 Aug 27 04:32:31.950728 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1885355986 Aug 27 04:32:31.950728 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AggregatesAdminTestJSON-1885355986-project Aug 27 04:32:31.950728 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:31.950728 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:31.950728 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 0100800dbc6d40619bd7cd8f78d03d77 Aug 27 04:32:31.950728 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AggregatesAdminTestJSON-1885355986-project Aug 27 04:32:31.950728 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:32:31.950728 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:31.950728 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '56162f18-821c-4bd7-b262-7fc46702ef4f'} Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:31.951498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. Aug 27 04:32:31.956265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:31.957350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6c38f670-228e-4fc3-9916-db6ba8f13e4c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] Returning 404 to user: Instance 56162f18-821c-4bd7-b262-7fc46702ef4f could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:31.957350 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6c38f670-228e-4fc3-9916-db6ba8f13e4c tempest-AggregatesAdminTestJSON-1885355986 tempest-AggregatesAdminTestJSON-1885355986-project] 10.222.0.79 "GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f" status: 404 len: 111 microversion: 2.1 time: 0.073740 Aug 27 04:32:31.957350 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 142/298] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:31 2022] GET /compute/v2.1/servers/56162f18-821c-4bd7-b262-7fc46702ef4f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:31.957350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f8aec3c3-0c9c-472b-a776-ad2d765af7b8 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854823-1"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:31.970290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8aec3c3-0c9c-472b-a776-ad2d765af7b8 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:31.975919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8aec3c3-0c9c-472b-a776-ad2d765af7b8 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:31.976470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8aec3c3-0c9c-472b-a776-ad2d765af7b8 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:32.257320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1e2327a8-4595-44a2-9756-9a1384a92dcd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:32.281220 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e2327a8-4595-44a2-9756-9a1384a92dcd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 200 len: 1587 microversion: 2.1 time: 0.700290 Aug 27 04:32:32.285083 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f8aec3c3-0c9c-472b-a776-ad2d765af7b8 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 228 microversion: 2.1 time: 0.332254 Aug 27 04:32:32.286395 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 143/299] 10.222.0.79 () {60 vars in 1194 bytes} [Sat Aug 27 04:32:31 2022] POST /compute/v2.1/os-aggregates/16/action => generated 228 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:32.298154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-52df230c-5d5f-438a-8689-11907f5c1049 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:32.301258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-52df230c-5d5f-438a-8689-11907f5c1049 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:32.302400 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 157/300] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:31 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 1587 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:32.312233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52df230c-5d5f-438a-8689-11907f5c1049 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:32.317834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52df230c-5d5f-438a-8689-11907f5c1049 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:32.318513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52df230c-5d5f-438a-8689-11907f5c1049 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:32.319416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52df230c-5d5f-438a-8689-11907f5c1049 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:32.320038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52df230c-5d5f-438a-8689-11907f5c1049 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:32.320594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-984a07ed-e837-4eeb-90dc-e35d96f143bf tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:32.320977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52df230c-5d5f-438a-8689-11907f5c1049 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:32.396667 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-984a07ed-e837-4eeb-90dc-e35d96f143bf tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.092919 Aug 27 04:32:32.399746 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 158/301] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:32:32 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:32:32.407089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52df230c-5d5f-438a-8689-11907f5c1049 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:32.410253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52df230c-5d5f-438a-8689-11907f5c1049 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:32.410946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52df230c-5d5f-438a-8689-11907f5c1049 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:32.414433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-52df230c-5d5f-438a-8689-11907f5c1049 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lazy-loading 'fault' on Instance uuid 95fe425c-a241-46b8-84d0-9ec136716def {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:32:32.420203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8bf1967f-3287-4372-8fef-b35740c4777d tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-806386271"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:32.438061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-8bf1967f-3287-4372-8fef-b35740c4777d tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Generated uuid 16519ceb-e3e7-4bc8-b2fb-b2a0bd8f2f0b for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:32:32.518501 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8bf1967f-3287-4372-8fef-b35740c4777d tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.110774 Aug 27 04:32:32.523296 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 159/302] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:32:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:32.532497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d801e1c7-a42f-4362-929d-fa62be98ac46 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Calling method '.version_select at 0x7f1f222b51f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:32.553733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d801e1c7-a42f-4362-929d-fa62be98ac46 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:32.556612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d801e1c7-a42f-4362-929d-fa62be98ac46 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:32.558114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d801e1c7-a42f-4362-929d-fa62be98ac46 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:32.561260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d801e1c7-a42f-4362-929d-fa62be98ac46 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:32.561847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d801e1c7-a42f-4362-929d-fa62be98ac46 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:32.562359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d801e1c7-a42f-4362-929d-fa62be98ac46 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:32.626063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-52df230c-5d5f-438a-8689-11907f5c1049 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:32.633940 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-52df230c-5d5f-438a-8689-11907f5c1049 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 200 len: 1309 microversion: 2.1 time: 0.346410 Aug 27 04:32:32.661878 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 144/303] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:32 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 1309 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:32.666934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c2b6c463-1531-4538-98b0-9c9f027474f5 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:32.688613 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d801e1c7-a42f-4362-929d-fa62be98ac46 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.164060 Aug 27 04:32:32.689254 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 160/304] 10.222.0.79 () {58 vars in 1128 bytes} [Sat Aug 27 04:32:32 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:32.721457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2b6c463-1531-4538-98b0-9c9f027474f5 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:32.723825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e4f6b6e-ee62-437b-a9ba-71cd76e3ab30 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Calling method '.version_select at 0x7f1f222cfc10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:32.724638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2b6c463-1531-4538-98b0-9c9f027474f5 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:32.725979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2b6c463-1531-4538-98b0-9c9f027474f5 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:32.743408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e4f6b6e-ee62-437b-a9ba-71cd76e3ab30 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:32.744590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e4f6b6e-ee62-437b-a9ba-71cd76e3ab30 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:32.745117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e4f6b6e-ee62-437b-a9ba-71cd76e3ab30 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:32.748342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e4f6b6e-ee62-437b-a9ba-71cd76e3ab30 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:32.750103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e4f6b6e-ee62-437b-a9ba-71cd76e3ab30 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:32.752364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e4f6b6e-ee62-437b-a9ba-71cd76e3ab30 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:32.766677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2b6c463-1531-4538-98b0-9c9f027474f5 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:32.768218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2b6c463-1531-4538-98b0-9c9f027474f5 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:32.772122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2b6c463-1531-4538-98b0-9c9f027474f5 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:32.797982 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.compute.aggregates [None req-c2b6c463-1531-4538-98b0-9c9f027474f5 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 27 04:32:32.798664 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-c2b6c463-1531-4538-98b0-9c9f027474f5 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c2b6c463-1531-4538-98b0-9c9f027474f5 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Request method failure captured: Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 42 Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4q7Rm3nEUwY9JBNZ9vVa1JEU0YEY7ysPZgnXFpI1WInbwDP4Uc7xuhY_nz25-EHnzx6r8fa2S859s0Esy6KAX5xMdFVxGKUEdTy9pKfQ1TL5Asn7HylwXw8vO_PmolMxltWSwht03Hcb5rJ5Qqs1E9ZOYbJwiOBW-L7-SYd-z4G-c Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:32:32.800758 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:32:32.802224 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6c1d49516b641089bdc1067be17e386"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6c1d49516b641089bdc1067be17e386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:32.802224 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:32:32.802224 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: a6c1d49516b641089bdc1067be17e386 Aug 27 04:32:32.802224 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748 Aug 27 04:32:32.802224 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:32:32.802224 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:32:32.802224 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:32:32.802224 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: fd7891c50c0148f290c6f3e70573aa47 Aug 27 04:32:32.802224 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin Aug 27 04:32:32.802224 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:32:32.802224 n-d-854823-1 devstack@n-api.service[128870]: {"remove_host": {"host": "nonexist_host"}} Aug 27 04:32:32.802224 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:32:32.802224 n-d-854823-1 devstack@n-api.service[128870]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 27 04:32:32.802932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 27 04:32:32.804087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:32.805164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:32.806324 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:32.806324 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:32.806324 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:32.806324 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:32.806324 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 27 04:32:32.806324 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:32:32.806669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c2b6c463-1531-4538-98b0-9c9f027474f5 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:32.807581 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c2b6c463-1531-4538-98b0-9c9f027474f5 tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.144334 Aug 27 04:32:32.815200 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 145/305] 10.222.0.79 () {60 vars in 1194 bytes} [Sat Aug 27 04:32:32 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:32:32.828245 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e4f6b6e-ee62-437b-a9ba-71cd76e3ab30 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.132020 Aug 27 04:32:32.830455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7f40a1e8-1c3d-46b1-8380-3b7b4c74e55f tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:32.831787 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 161/306] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:32:32 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:32.844964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e3ff95c-0964-4688-84a1-fb8e58c1357b tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Calling method '.version_select at 0x7f1f222cf790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:32.852491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e3ff95c-0964-4688-84a1-fb8e58c1357b tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:32.855875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e3ff95c-0964-4688-84a1-fb8e58c1357b tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:32.859404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e3ff95c-0964-4688-84a1-fb8e58c1357b tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:32.861913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e3ff95c-0964-4688-84a1-fb8e58c1357b tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:32.862622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e3ff95c-0964-4688-84a1-fb8e58c1357b tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:32.863409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e3ff95c-0964-4688-84a1-fb8e58c1357b tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:32.880419 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7f40a1e8-1c3d-46b1-8380-3b7b4c74e55f tempest-AggregatesAdminNegativeTestJSON-1705614748 tempest-AggregatesAdminNegativeTestJSON-1705614748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.060744 Aug 27 04:32:32.888257 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 146/307] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:32:32 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:32:32.941536 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e3ff95c-0964-4688-84a1-fb8e58c1357b tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.100747 Aug 27 04:32:32.942677 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 162/308] 10.222.0.79 () {58 vars in 1128 bytes} [Sat Aug 27 04:32:32 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:32.954876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-64489925-0c35-4560-a33c-52b62230c1b3 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Calling method '.version_select at 0x7f1f2267ed30>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:32.980063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64489925-0c35-4560-a33c-52b62230c1b3 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:32.980720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64489925-0c35-4560-a33c-52b62230c1b3 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:32.981230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64489925-0c35-4560-a33c-52b62230c1b3 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:32.998473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:DELETE=7,nova_api:UPDATE=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:33.000617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64489925-0c35-4560-a33c-52b62230c1b3 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:33.001145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64489925-0c35-4560-a33c-52b62230c1b3 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:33.003554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64489925-0c35-4560-a33c-52b62230c1b3 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:33.033410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:33.058630 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-64489925-0c35-4560-a33c-52b62230c1b3 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-h2-854823-1" status: 200 len: 467 microversion: 2.1 time: 0.106412 Aug 27 04:32:33.060840 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 147/309] 10.222.0.79 () {58 vars in 1170 bytes} [Sat Aug 27 04:32:32 2022] GET /compute/v2.1/os-hosts/n-h2-854823-1 => generated 467 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:33.080391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0c58f24-44e8-4ddb-914d-856dd795de63 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Calling method '.version_select at 0x7f1f2249bee0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:33.093066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=80,nova_api:DELETE=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:33.098364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c58f24-44e8-4ddb-914d-856dd795de63 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:33.101336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c58f24-44e8-4ddb-914d-856dd795de63 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:33.102459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c58f24-44e8-4ddb-914d-856dd795de63 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:33.140222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c58f24-44e8-4ddb-914d-856dd795de63 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:33.141462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c58f24-44e8-4ddb-914d-856dd795de63 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:33.142408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c58f24-44e8-4ddb-914d-856dd795de63 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:33.177008 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0c58f24-44e8-4ddb-914d-856dd795de63 tempest-HostsAdminTestJSON-1870244876 tempest-HostsAdminTestJSON-1870244876-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-h1-854823-1" status: 200 len: 332 microversion: 2.1 time: 0.109948 Aug 27 04:32:33.178399 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 163/310] 10.222.0.79 () {58 vars in 1170 bytes} [Sat Aug 27 04:32:33 2022] GET /compute/v2.1/os-hosts/n-h1-854823-1 => generated 332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:33.591221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-b731760c-ae45-4399-b5bf-b885da58e97e req-5b85f34c-0e23-4bc4-8b8f-bacc94e92093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "000044d0-884d-4e30-a18d-5f4ebc4ba4ff", "tag": "eb3052de-ef9e-4e1d-9fe3-29285823219d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:33.602595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=66 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:33.634666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b731760c-ae45-4399-b5bf-b885da58e97e req-5b85f34c-0e23-4bc4-8b8f-bacc94e92093 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:33.635147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b731760c-ae45-4399-b5bf-b885da58e97e req-5b85f34c-0e23-4bc4-8b8f-bacc94e92093 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:33.635593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b731760c-ae45-4399-b5bf-b885da58e97e req-5b85f34c-0e23-4bc4-8b8f-bacc94e92093 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:33.673122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25e6d7f5-a6aa-4a1b-be41-83efe179dbc9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:33.673768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25e6d7f5-a6aa-4a1b-be41-83efe179dbc9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:33.699192 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b731760c-ae45-4399-b5bf-b885da58e97e req-5b85f34c-0e23-4bc4-8b8f-bacc94e92093 service nova] Creating event network-changed:eb3052de-ef9e-4e1d-9fe3-29285823219d for instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff on n-h2-854823-1 Aug 27 04:32:33.700285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e6d7f5-a6aa-4a1b-be41-83efe179dbc9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:33.700853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e6d7f5-a6aa-4a1b-be41-83efe179dbc9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:33.709034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e6d7f5-a6aa-4a1b-be41-83efe179dbc9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:33.714967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e6d7f5-a6aa-4a1b-be41-83efe179dbc9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:33.717605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e6d7f5-a6aa-4a1b-be41-83efe179dbc9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:33.718217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e6d7f5-a6aa-4a1b-be41-83efe179dbc9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:33.733018 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-b731760c-ae45-4399-b5bf-b885da58e97e req-5b85f34c-0e23-4bc4-8b8f-bacc94e92093 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151665 Aug 27 04:32:33.749311 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 148/311] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:32:33.788968 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-25e6d7f5-a6aa-4a1b-be41-83efe179dbc9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] HTTP exception thrown: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25e6d7f5-a6aa-4a1b-be41-83efe179dbc9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Request method failure captured: Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def HTTP/1.1 Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4zG7IAg55drOOnXbjbriR9kxHxksSc5I-1By2x2jB3e5k10Et9MWBE-5X0k7bXD2cCn4T4NoHdUY5J_XQZW4N2MKMWJrdwSEAkts-MwoC5DOtF2hC-raU-69-lL-oKElBFgOKFHt8eEjIbFQv_wxMayfLg-EAo-H05v0Ut0PtpQco Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 2590843f03fa4ffaafb6ccd928425042 Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:32:33.791458 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:32:33.792917 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:32:33.792917 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:32:33.792917 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 2590843f03fa4ffaafb6ccd928425042 Aug 27 04:32:33.792917 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:32:33.792917 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersAdminTestJSON-1795848583-project Aug 27 04:32:33.792917 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:32:33.792917 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:32:33.792917 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 94068d7cc8804363a24b4159cf861440 Aug 27 04:32:33.792917 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersAdminTestJSON-1795848583-project Aug 27 04:32:33.792917 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:32:33.792917 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:32:33.792917 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '95fe425c-a241-46b8-84d0-9ec136716def'} Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:33.793729 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:32:33.795016 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:32:33.796135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25e6d7f5-a6aa-4a1b-be41-83efe179dbc9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Returning 404 to user: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:33.796135 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25e6d7f5-a6aa-4a1b-be41-83efe179dbc9 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 404 len: 111 microversion: 2.1 time: 0.126497 Aug 27 04:32:33.796135 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 164/312] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:33 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:34.277074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-452588855", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:34.396457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:32:35.361612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:32:35.362836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:32:35.363524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:32:35.364085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:32:35.364769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:32:35.381890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:35.385272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:35.385928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:35.386947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:35.387559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:35.389124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:35.408953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=23 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:35.441023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Getting quotas for project 2590843f03fa4ffaafb6ccd928425042. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:32:35.457050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Getting quotas for user 94068d7cc8804363a24b4159cf861440 and project 2590843f03fa4ffaafb6ccd928425042. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:32:35.498326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:32:35.501718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:32:35.631733 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-74ce3008-8a54-4f6c-9465-04350529f417 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.363314 Aug 27 04:32:35.632706 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 149/313] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:32:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:32:35.644549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-15257a0e-d96a-49f9-99a5-42167305fca1 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:35.645163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-15257a0e-d96a-49f9-99a5-42167305fca1 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:36.189466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-15257a0e-d96a-49f9-99a5-42167305fca1 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:36.199939 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-15257a0e-d96a-49f9-99a5-42167305fca1 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1219 microversion: 2.1 time: 0.557834 Aug 27 04:32:36.201032 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 165/314] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:35 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1219 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:37.226085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98d22842-b7a8-466a-b8d8-e9aea90d292b tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:37.226657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98d22842-b7a8-466a-b8d8-e9aea90d292b tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:37.243390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d22842-b7a8-466a-b8d8-e9aea90d292b tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:37.247592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d22842-b7a8-466a-b8d8-e9aea90d292b tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:37.248523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d22842-b7a8-466a-b8d8-e9aea90d292b tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:37.251599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d22842-b7a8-466a-b8d8-e9aea90d292b tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:37.253842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d22842-b7a8-466a-b8d8-e9aea90d292b tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:37.255486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d22842-b7a8-466a-b8d8-e9aea90d292b tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:37.653616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-98d22842-b7a8-466a-b8d8-e9aea90d292b tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:37.683837 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-98d22842-b7a8-466a-b8d8-e9aea90d292b tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1215 microversion: 2.1 time: 0.444769 Aug 27 04:32:37.688440 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 150/315] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:37 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1215 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:38.714062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a3f548ab-2984-4a85-94c7-cb6a8ec2246c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:38.715796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a3f548ab-2984-4a85-94c7-cb6a8ec2246c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:38.731737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3f548ab-2984-4a85-94c7-cb6a8ec2246c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:38.732242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3f548ab-2984-4a85-94c7-cb6a8ec2246c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:38.733707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3f548ab-2984-4a85-94c7-cb6a8ec2246c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:38.735581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3f548ab-2984-4a85-94c7-cb6a8ec2246c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:38.739216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3f548ab-2984-4a85-94c7-cb6a8ec2246c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:38.739851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3f548ab-2984-4a85-94c7-cb6a8ec2246c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:38.882203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a3f548ab-2984-4a85-94c7-cb6a8ec2246c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:38.895594 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a3f548ab-2984-4a85-94c7-cb6a8ec2246c tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1277 microversion: 2.1 time: 0.187991 Aug 27 04:32:38.903350 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 166/316] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:38 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:39.370740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c2e728be-7676-4376-a9c5-80b57a8c8b14 tempest-NetworksTest-61703487 tempest-NetworksTest-61703487-project-admin] Calling method '.version_select at 0x7f1f22b05790>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:39.778950 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c2e728be-7676-4376-a9c5-80b57a8c8b14 tempest-NetworksTest-61703487 tempest-NetworksTest-61703487-project-admin] 10.222.0.79 "GET /compute/v2.1/os-networks" status: 200 len: 5403 microversion: 2.1 time: 0.726351 Aug 27 04:32:39.779542 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 151/317] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:32:39 2022] GET /compute/v2.1/os-networks => generated 5403 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:39.787756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bf9757a-fe79-432e-a3d2-0b55ec1e9d61 tempest-NetworksTest-61703487 tempest-NetworksTest-61703487-project-admin] Calling method '.version_select at 0x7f1f225e0b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:39.926174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a6ed9fb2-317f-4b74-a0ba-dc5882915fbc tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:39.926887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a6ed9fb2-317f-4b74-a0ba-dc5882915fbc tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:39.938926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ed9fb2-317f-4b74-a0ba-dc5882915fbc tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:39.939466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ed9fb2-317f-4b74-a0ba-dc5882915fbc tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:39.940861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ed9fb2-317f-4b74-a0ba-dc5882915fbc tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:39.940861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ed9fb2-317f-4b74-a0ba-dc5882915fbc tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:39.947751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ed9fb2-317f-4b74-a0ba-dc5882915fbc tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:39.949135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ed9fb2-317f-4b74-a0ba-dc5882915fbc tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:40.414633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a6ed9fb2-317f-4b74-a0ba-dc5882915fbc tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:40.428942 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a6ed9fb2-317f-4b74-a0ba-dc5882915fbc tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1277 microversion: 2.1 time: 0.506388 Aug 27 04:32:40.430794 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 152/318] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:39 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1277 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:40.734080 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0bf9757a-fe79-432e-a3d2-0b55ec1e9d61 tempest-NetworksTest-61703487 tempest-NetworksTest-61703487-project-admin] 10.222.0.79 "GET /compute/v2.1/os-networks/b19603a7-e846-4692-9070-1ad63908fb7a" status: 200 len: 652 microversion: 2.1 time: 0.949106 Aug 27 04:32:40.736014 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 167/319] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 04:32:39 2022] GET /compute/v2.1/os-networks/b19603a7-e846-4692-9070-1ad63908fb7a => generated 652 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:40.746808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e8288a5e-991c-4c5e-8e07-5b4ad4b2a911 tempest-NetworksTest-61703487 tempest-NetworksTest-61703487-project-admin] Calling method '.version_select at 0x7f1f22514ca0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:41.190027 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e8288a5e-991c-4c5e-8e07-5b4ad4b2a911 tempest-NetworksTest-61703487 tempest-NetworksTest-61703487-project-admin] 10.222.0.79 "GET /compute/v2.1/os-networks" status: 200 len: 5403 microversion: 2.1 time: 0.448645 Aug 27 04:32:41.190811 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 153/320] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:32:40 2022] GET /compute/v2.1/os-networks => generated 5403 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:41.451098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd5bca2b-678a-400c-b345-e4d5603960ea tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:41.452317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd5bca2b-678a-400c-b345-e4d5603960ea tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:41.509762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd5bca2b-678a-400c-b345-e4d5603960ea tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:41.509762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd5bca2b-678a-400c-b345-e4d5603960ea tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:41.509762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd5bca2b-678a-400c-b345-e4d5603960ea tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:41.509762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd5bca2b-678a-400c-b345-e4d5603960ea tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:41.511011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd5bca2b-678a-400c-b345-e4d5603960ea tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:41.511011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd5bca2b-678a-400c-b345-e4d5603960ea tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:42.132550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bd5bca2b-678a-400c-b345-e4d5603960ea tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:42.144421 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd5bca2b-678a-400c-b345-e4d5603960ea tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1319 microversion: 2.1 time: 0.697537 Aug 27 04:32:42.146298 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 168/321] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:41 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1319 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:42.362165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-b9b7ec5f-42ff-4395-a3d7-879c3a3b4fd2 req-de8d77c4-8754-4fff-a8e1-ffc248c007ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a021891f-68f7-4264-a77a-f3b21788f9b6", "tag": "75f96374-5f3f-4e50-8fbd-031d916ef15b"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:42.397078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b9b7ec5f-42ff-4395-a3d7-879c3a3b4fd2 req-de8d77c4-8754-4fff-a8e1-ffc248c007ed service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:42.398374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b9b7ec5f-42ff-4395-a3d7-879c3a3b4fd2 req-de8d77c4-8754-4fff-a8e1-ffc248c007ed service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:42.399413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b9b7ec5f-42ff-4395-a3d7-879c3a3b4fd2 req-de8d77c4-8754-4fff-a8e1-ffc248c007ed service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:42.419402 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b9b7ec5f-42ff-4395-a3d7-879c3a3b4fd2 req-de8d77c4-8754-4fff-a8e1-ffc248c007ed service nova] Creating event network-changed:75f96374-5f3f-4e50-8fbd-031d916ef15b for instance a021891f-68f7-4264-a77a-f3b21788f9b6 on n-h1-854823-1 Aug 27 04:32:42.426167 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-b9b7ec5f-42ff-4395-a3d7-879c3a3b4fd2 req-de8d77c4-8754-4fff-a8e1-ffc248c007ed service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068685 Aug 27 04:32:42.428097 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 154/322] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:32:43.168076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7313e87b-5c71-40d3-8914-4fc68af547d4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:43.168881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7313e87b-5c71-40d3-8914-4fc68af547d4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:43.171630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:43.187859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7313e87b-5c71-40d3-8914-4fc68af547d4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:43.189237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7313e87b-5c71-40d3-8914-4fc68af547d4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:43.190274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7313e87b-5c71-40d3-8914-4fc68af547d4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:43.192463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7313e87b-5c71-40d3-8914-4fc68af547d4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:43.193809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7313e87b-5c71-40d3-8914-4fc68af547d4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:43.195969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7313e87b-5c71-40d3-8914-4fc68af547d4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:43.952069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7313e87b-5c71-40d3-8914-4fc68af547d4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:43.985924 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7313e87b-5c71-40d3-8914-4fc68af547d4 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1319 microversion: 2.1 time: 0.820809 Aug 27 04:32:43.988124 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 169/323] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:43 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1319 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:45.008154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c36fceb3-2368-4b74-be7b-e00731d718b8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:45.008901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c36fceb3-2368-4b74-be7b-e00731d718b8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:45.019468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c36fceb3-2368-4b74-be7b-e00731d718b8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:45.021013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c36fceb3-2368-4b74-be7b-e00731d718b8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:45.023656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c36fceb3-2368-4b74-be7b-e00731d718b8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:45.024847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c36fceb3-2368-4b74-be7b-e00731d718b8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:45.026059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c36fceb3-2368-4b74-be7b-e00731d718b8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:45.028970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c36fceb3-2368-4b74-be7b-e00731d718b8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:45.428915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:45.472449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:45.519958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c36fceb3-2368-4b74-be7b-e00731d718b8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:45.538478 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c36fceb3-2368-4b74-be7b-e00731d718b8 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1319 microversion: 2.1 time: 0.533881 Aug 27 04:32:45.541269 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 155/324] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:45 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1319 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:45.682097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-529837662", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:45.784142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4401bb36-911b-4a08-a0a1-b23fca4560c6 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-343979962", "ram": 512, "vcpus": 1, "disk": 10, "id": 54300612, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:45.794923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:32:45.851557 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4401bb36-911b-4a08-a0a1-b23fca4560c6 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.299093 Aug 27 04:32:45.852171 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 156/325] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:32:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:45.865647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7c7c9f93-3311-4106-a020-8531082bb3e5 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:45.925105 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7c7c9f93-3311-4106-a020-8531082bb3e5 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/54300612/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.063274 Aug 27 04:32:45.926615 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 157/326] 10.222.0.79 () {60 vars in 1218 bytes} [Sat Aug 27 04:32:45 2022] POST /compute/v2.1/flavors/54300612/os-extra_specs => generated 66 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:32:46.197583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:46.589042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:32:46.590079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:32:46.592257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:32:46.593896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:32:46.595895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:32:46.618923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:46.621480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:46.623026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:46.630633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:46.631601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:46.634767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:46.684063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Getting quotas for project 73540a547efa4eccb535f6e38d60f67a. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:32:46.700419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Getting quotas for user f60c624cc43945ea9de2731f0c93156c and project 73540a547efa4eccb535f6e38d60f67a. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:32:46.741361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68c48b28-e085-4401-9608-377d639d0700 tempest-FlavorsExtraSpecsTestJSON-1031758786 tempest-FlavorsExtraSpecsTestJSON-1031758786-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:46.742221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:32:46.754123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:32:46.759439 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-68c48b28-e085-4401-9608-377d639d0700 tempest-FlavorsExtraSpecsTestJSON-1031758786 tempest-FlavorsExtraSpecsTestJSON-1031758786-project] 10.222.0.79 "GET /compute/v2.1/flavors/54300612/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.826037 Aug 27 04:32:46.779819 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 158/327] 10.222.0.79 () {58 vars in 1197 bytes} [Sat Aug 27 04:32:45 2022] GET /compute/v2.1/flavors/54300612/os-extra_specs => generated 66 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:32:46.878935 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8883801-9f42-4226-8f08-ed3e3efb5ab6 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.578384 Aug 27 04:32:46.881857 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 170/328] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:32:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:32:46.889200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64e38c4c-e3da-4645-b6bf-4dc02eae9a1e tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:46.890279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-64e38c4c-e3da-4645-b6bf-4dc02eae9a1e tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:46.915769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64e38c4c-e3da-4645-b6bf-4dc02eae9a1e tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:46.919148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64e38c4c-e3da-4645-b6bf-4dc02eae9a1e tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:46.919840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64e38c4c-e3da-4645-b6bf-4dc02eae9a1e tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:46.921044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64e38c4c-e3da-4645-b6bf-4dc02eae9a1e tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:46.922525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64e38c4c-e3da-4645-b6bf-4dc02eae9a1e tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:46.923182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64e38c4c-e3da-4645-b6bf-4dc02eae9a1e tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:47.191076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-877b5ed1-0c61-4ad5-8d3f-e5fe8264ca63 tempest-InstanceUsageAuditLogTestJSON-1982502076 tempest-InstanceUsageAuditLogTestJSON-1982502076-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:47.245035 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-877b5ed1-0c61-4ad5-8d3f-e5fe8264ca63 tempest-InstanceUsageAuditLogTestJSON-1982502076 tempest-InstanceUsageAuditLogTestJSON-1982502076-project-admin] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27 04:32:46" status: 200 len: 318 microversion: 2.1 time: 0.461368 Aug 27 04:32:47.246416 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 159/329] 10.222.0.79 () {58 vars in 1251 bytes} [Sat Aug 27 04:32:46 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2004%3A32%3A46 => generated 318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:47.261699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d582bd2-4b61-403e-b88c-30fd7652a801 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:47.337819 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9d582bd2-4b61-403e-b88c-30fd7652a801 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/54300612/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.089499 Aug 27 04:32:47.349964 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 160/330] 10.222.0.79 () {60 vars in 1218 bytes} [Sat Aug 27 04:32:47 2022] POST /compute/v2.1/flavors/54300612/os-extra_specs => generated 66 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:32:47.355554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-47fce768-d5ee-43f8-ab36-e4d610f1a843 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:47.356470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-47fce768-d5ee-43f8-ab36-e4d610f1a843 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:47.472252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-47fce768-d5ee-43f8-ab36-e4d610f1a843 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:47.487107 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-47fce768-d5ee-43f8-ab36-e4d610f1a843 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1218 microversion: 2.1 time: 0.135703 Aug 27 04:32:47.493783 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 161/331] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:47 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:47.498998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e5eceed0-9939-4048-91ae-066beec0caa9 tempest-InstanceUsageAuditLogTestJSON-1982502076 tempest-InstanceUsageAuditLogTestJSON-1982502076-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:47.530567 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e5eceed0-9939-4048-91ae-066beec0caa9 tempest-InstanceUsageAuditLogTestJSON-1982502076 tempest-InstanceUsageAuditLogTestJSON-1982502076-project-admin] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.035592 Aug 27 04:32:47.537779 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 162/332] 10.222.0.79 () {58 vars in 1185 bytes} [Sat Aug 27 04:32:47 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:47.562554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-101f7e87-e411-46b0-aaf1-803203915c80 tempest-FlavorsExtraSpecsTestJSON-1031758786 tempest-FlavorsExtraSpecsTestJSON-1031758786-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:47.579819 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-101f7e87-e411-46b0-aaf1-803203915c80 tempest-FlavorsExtraSpecsTestJSON-1031758786 tempest-FlavorsExtraSpecsTestJSON-1031758786-project] 10.222.0.79 "GET /compute/v2.1/flavors/54300612/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.040736 Aug 27 04:32:47.580731 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 163/333] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:32:47 2022] GET /compute/v2.1/flavors/54300612/os-extra_specs/hw:numa_nodes => generated 22 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:32:47.591125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f3a8ffed-e78d-4682-ada5-1c7bd3bf39d9 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:47.678085 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f3a8ffed-e78d-4682-ada5-1c7bd3bf39d9 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/54300612/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.090844 Aug 27 04:32:47.678773 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 164/334] 10.222.0.79 () {60 vars in 1218 bytes} [Sat Aug 27 04:32:47 2022] POST /compute/v2.1/flavors/54300612/os-extra_specs => generated 66 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:32:47.688852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-60a43def-b9a3-4b45-965c-955da52bfe03 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:47.703693 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-60a43def-b9a3-4b45-965c-955da52bfe03 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/54300612/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018648 Aug 27 04:32:47.715700 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 165/335] 10.222.0.79 () {58 vars in 1197 bytes} [Sat Aug 27 04:32:47 2022] GET /compute/v2.1/flavors/54300612/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:32:47.720817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2a54965e-2f7d-402e-9021-7b5d1d00b7eb tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:47.796660 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2a54965e-2f7d-402e-9021-7b5d1d00b7eb tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/54300612/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.076603 Aug 27 04:32:47.797479 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 166/336] 10.222.0.79 () {60 vars in 1259 bytes} [Sat Aug 27 04:32:47 2022] PUT /compute/v2.1/flavors/54300612/os-extra_specs/hw:numa_nodes => generated 22 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:32:47.814640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ed9eea70-3e1f-4ae5-a7b9-2ca2b6409b2c tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:47.842683 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ed9eea70-3e1f-4ae5-a7b9-2ca2b6409b2c tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/54300612/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037374 Aug 27 04:32:47.845037 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 167/337] 10.222.0.79 () {58 vars in 1197 bytes} [Sat Aug 27 04:32:47 2022] GET /compute/v2.1/flavors/54300612/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:32:47.859300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-598d3b11-0e8a-43b8-9a39-96887b5b0ee3 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:47.980133 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-598d3b11-0e8a-43b8-9a39-96887b5b0ee3 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/54300612/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.128941 Aug 27 04:32:47.982112 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 168/338] 10.222.0.79 () {58 vars in 1242 bytes} [Sat Aug 27 04:32:47 2022] DELETE /compute/v2.1/flavors/54300612/os-extra_specs/hw:numa_nodes => generated 0 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:32:47.995968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d599eaa0-f0d6-4890-8df6-ae3cb37cd6c6 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:48.015696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:48.047806 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d599eaa0-f0d6-4890-8df6-ae3cb37cd6c6 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/54300612/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.062802 Aug 27 04:32:48.052511 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 169/339] 10.222.0.79 () {58 vars in 1242 bytes} [Sat Aug 27 04:32:47 2022] DELETE /compute/v2.1/flavors/54300612/os-extra_specs/hw:cpu_policy => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:32:48.066267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-11fb052a-f2d7-4574-bf54-aded2050719f tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:48.096686 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-11fb052a-f2d7-4574-bf54-aded2050719f tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/54300612/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.037288 Aug 27 04:32:48.097752 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 170/340] 10.222.0.79 () {58 vars in 1197 bytes} [Sat Aug 27 04:32:48 2022] GET /compute/v2.1/flavors/54300612/os-extra_specs => generated 19 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:32:48.110271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-60c8c587-3775-4bcf-9aaf-72345d73c526 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:48.171866 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-60c8c587-3775-4bcf-9aaf-72345d73c526 tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/54300612" status: 202 len: 0 microversion: 2.1 time: 0.065362 Aug 27 04:32:48.177725 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 171/341] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:32:48 2022] DELETE /compute/v2.1/flavors/54300612 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:48.200194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2c6b9089-46f0-4d3e-8fbd-f1a4a5b772fa tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:48.283498 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2c6b9089-46f0-4d3e-8fbd-f1a4a5b772fa tempest-FlavorsExtraSpecsTestJSON-414337864 tempest-FlavorsExtraSpecsTestJSON-414337864-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.097419 Aug 27 04:32:48.289417 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 172/342] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:32:48 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:48.439838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-64e38c4c-e3da-4645-b6bf-4dc02eae9a1e tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:48.455153 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64e38c4c-e3da-4645-b6bf-4dc02eae9a1e tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1319 microversion: 2.1 time: 1.569385 Aug 27 04:32:48.469524 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 171/343] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:46 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1319 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:48.515788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e5b556d-501e-46a7-8650-63ad8888794e tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:48.516724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4e5b556d-501e-46a7-8650-63ad8888794e tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:48.527730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e5b556d-501e-46a7-8650-63ad8888794e tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:48.528906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e5b556d-501e-46a7-8650-63ad8888794e tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:48.529950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e5b556d-501e-46a7-8650-63ad8888794e tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:48.532381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e5b556d-501e-46a7-8650-63ad8888794e tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:48.532823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e5b556d-501e-46a7-8650-63ad8888794e tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:48.533269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e5b556d-501e-46a7-8650-63ad8888794e tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:48.723945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4e5b556d-501e-46a7-8650-63ad8888794e tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:48.744486 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4e5b556d-501e-46a7-8650-63ad8888794e tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1270 microversion: 2.1 time: 0.232705 Aug 27 04:32:48.747637 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 173/344] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:48 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1270 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:49.476523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bd7e5c49-4558-4464-9312-6bf874c74e4f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:49.479507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bd7e5c49-4558-4464-9312-6bf874c74e4f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:49.494041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd7e5c49-4558-4464-9312-6bf874c74e4f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:49.498891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd7e5c49-4558-4464-9312-6bf874c74e4f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:49.502500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd7e5c49-4558-4464-9312-6bf874c74e4f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:49.511189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd7e5c49-4558-4464-9312-6bf874c74e4f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:49.511696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd7e5c49-4558-4464-9312-6bf874c74e4f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:49.514398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd7e5c49-4558-4464-9312-6bf874c74e4f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:49.918271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bd7e5c49-4558-4464-9312-6bf874c74e4f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:49.931551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-775893926", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:49.941186 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bd7e5c49-4558-4464-9312-6bf874c74e4f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1319 microversion: 2.1 time: 0.453659 Aug 27 04:32:49.944658 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 174/345] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:49 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:49.975213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ab661bfe-a7bc-4d2a-972e-5e44dc9a7f98 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:49.978327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ab661bfe-a7bc-4d2a-972e-5e44dc9a7f98 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:49.995057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab661bfe-a7bc-4d2a-972e-5e44dc9a7f98 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:49.995807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab661bfe-a7bc-4d2a-972e-5e44dc9a7f98 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:49.996458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab661bfe-a7bc-4d2a-972e-5e44dc9a7f98 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:49.997726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab661bfe-a7bc-4d2a-972e-5e44dc9a7f98 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:49.998632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab661bfe-a7bc-4d2a-972e-5e44dc9a7f98 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:50.000107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab661bfe-a7bc-4d2a-972e-5e44dc9a7f98 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:50.045018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:32:50.123759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ab661bfe-a7bc-4d2a-972e-5e44dc9a7f98 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:50.132394 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ab661bfe-a7bc-4d2a-972e-5e44dc9a7f98 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1276 microversion: 2.1 time: 0.186403 Aug 27 04:32:50.134172 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 175/346] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:49 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:50.910989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:32:50.911690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:32:50.912282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:32:50.912748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:32:50.913345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:32:50.943812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:50.945130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:50.947351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:50.948386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:50.949943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:50.950627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:50.969542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9fa700cf-7507-46f9-8381-e19abe700979 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:50.971402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9fa700cf-7507-46f9-8381-e19abe700979 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:50.979478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9fa700cf-7507-46f9-8381-e19abe700979 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:50.984498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9fa700cf-7507-46f9-8381-e19abe700979 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:50.988736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9fa700cf-7507-46f9-8381-e19abe700979 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:50.991497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9fa700cf-7507-46f9-8381-e19abe700979 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:50.993893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9fa700cf-7507-46f9-8381-e19abe700979 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:50.996792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9fa700cf-7507-46f9-8381-e19abe700979 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:51.029138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:32:51.054255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:32:51.112338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:32:51.119626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:32:51.238791 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e67ce6b-aa11-4b09-be7a-0fbde8beb494 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.911827 Aug 27 04:32:51.240926 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 172/347] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:32:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:32:51.252872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3b8cc3a-0a67-48eb-ad1d-0c3bfd07a0ec tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:51.256451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3b8cc3a-0a67-48eb-ad1d-0c3bfd07a0ec tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:51.273482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3b8cc3a-0a67-48eb-ad1d-0c3bfd07a0ec tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:51.275643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3b8cc3a-0a67-48eb-ad1d-0c3bfd07a0ec tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:51.277692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3b8cc3a-0a67-48eb-ad1d-0c3bfd07a0ec tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:51.279447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3b8cc3a-0a67-48eb-ad1d-0c3bfd07a0ec tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:51.280219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3b8cc3a-0a67-48eb-ad1d-0c3bfd07a0ec tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:51.282350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3b8cc3a-0a67-48eb-ad1d-0c3bfd07a0ec tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:52.265497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3b8cc3a-0a67-48eb-ad1d-0c3bfd07a0ec tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:52.274479 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3b8cc3a-0a67-48eb-ad1d-0c3bfd07a0ec tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1276 microversion: 2.1 time: 1.032192 Aug 27 04:32:52.285991 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 173/348] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:51 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1276 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:52.299038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a3a8808-cb8f-4975-8d63-e8f00987b91e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:52.305787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a3a8808-cb8f-4975-8d63-e8f00987b91e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:52.313596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9fa700cf-7507-46f9-8381-e19abe700979 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:52.325998 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9fa700cf-7507-46f9-8381-e19abe700979 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1319 microversion: 2.1 time: 1.360775 Aug 27 04:32:52.329226 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 176/349] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:50 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1319 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:52.443318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a3a8808-cb8f-4975-8d63-e8f00987b91e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:52.452512 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a3a8808-cb8f-4975-8d63-e8f00987b91e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1216 microversion: 2.1 time: 0.165160 Aug 27 04:32:52.454508 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 174/350] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:52 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1216 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:53.301682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bec4c3f9-597c-46e5-86b0-9592111efd68 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:53.303178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bec4c3f9-597c-46e5-86b0-9592111efd68 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:53.325203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-436a2f16-d632-4326-9aae-64d96c230327 req-42bc3b91-2086-4ffc-b2df-828aed0c259a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a021891f-68f7-4264-a77a-f3b21788f9b6", "name": "network-vif-plugged", "status": "completed", "tag": "75f96374-5f3f-4e50-8fbd-031d916ef15b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:53.351812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bec4c3f9-597c-46e5-86b0-9592111efd68 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:53.356662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-436a2f16-d632-4326-9aae-64d96c230327 req-42bc3b91-2086-4ffc-b2df-828aed0c259a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:53.357533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bec4c3f9-597c-46e5-86b0-9592111efd68 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:53.360738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bec4c3f9-597c-46e5-86b0-9592111efd68 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:53.361680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bec4c3f9-597c-46e5-86b0-9592111efd68 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:53.362501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-436a2f16-d632-4326-9aae-64d96c230327 req-42bc3b91-2086-4ffc-b2df-828aed0c259a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:53.363106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-436a2f16-d632-4326-9aae-64d96c230327 req-42bc3b91-2086-4ffc-b2df-828aed0c259a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:53.363767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bec4c3f9-597c-46e5-86b0-9592111efd68 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:53.377139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bec4c3f9-597c-46e5-86b0-9592111efd68 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:53.429191 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-436a2f16-d632-4326-9aae-64d96c230327 req-42bc3b91-2086-4ffc-b2df-828aed0c259a service nova] Creating event network-vif-plugged:75f96374-5f3f-4e50-8fbd-031d916ef15b for instance a021891f-68f7-4264-a77a-f3b21788f9b6 on n-h1-854823-1 Aug 27 04:32:53.447805 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-436a2f16-d632-4326-9aae-64d96c230327 req-42bc3b91-2086-4ffc-b2df-828aed0c259a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126229 Aug 27 04:32:53.450658 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 175/351] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:53.463933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-67b76017-4209-4e43-a2c9-a6fce108e2dd tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:53.465876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-67b76017-4209-4e43-a2c9-a6fce108e2dd tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:53.477633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67b76017-4209-4e43-a2c9-a6fce108e2dd tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:53.478444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67b76017-4209-4e43-a2c9-a6fce108e2dd tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:53.479686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67b76017-4209-4e43-a2c9-a6fce108e2dd tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:53.480698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67b76017-4209-4e43-a2c9-a6fce108e2dd tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:53.481311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67b76017-4209-4e43-a2c9-a6fce108e2dd tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:53.482104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67b76017-4209-4e43-a2c9-a6fce108e2dd tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:53.740189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bec4c3f9-597c-46e5-86b0-9592111efd68 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:53.752909 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bec4c3f9-597c-46e5-86b0-9592111efd68 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1276 microversion: 2.1 time: 0.454160 Aug 27 04:32:53.767729 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 177/352] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:53 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1276 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:53.767729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f2db61e2-6a9f-4628-a550-9e726cdc4869 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:53.767729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f2db61e2-6a9f-4628-a550-9e726cdc4869 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:53.782270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2db61e2-6a9f-4628-a550-9e726cdc4869 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:53.783301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2db61e2-6a9f-4628-a550-9e726cdc4869 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:53.783429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2db61e2-6a9f-4628-a550-9e726cdc4869 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:53.784129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2db61e2-6a9f-4628-a550-9e726cdc4869 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:53.784770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2db61e2-6a9f-4628-a550-9e726cdc4869 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:53.785212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2db61e2-6a9f-4628-a550-9e726cdc4869 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:53.970482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f2db61e2-6a9f-4628-a550-9e726cdc4869 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:53.979422 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f2db61e2-6a9f-4628-a550-9e726cdc4869 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1286 microversion: 2.1 time: 0.224448 Aug 27 04:32:53.986591 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 178/353] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:53 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1286 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:54.541851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-67b76017-4209-4e43-a2c9-a6fce108e2dd tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:54.569937 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-67b76017-4209-4e43-a2c9-a6fce108e2dd tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1319 microversion: 2.1 time: 1.114740 Aug 27 04:32:54.574730 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 176/354] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:53 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1319 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:54.731444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-717024b5-7e59-426b-a64b-68db249b4f6c tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Action: 'create', calling method: .version_select at 0x7f1f2267edc0>, body: {"keypair": {"name": "tempest-keypair-2023776569", "type": "ssh", "user_id": "7b360cad6bad40b4b3757645b8cb23a9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5DlwpeaQehuGtiWW5Brj0vBquIZAdgyWHT/GkNzS6FmJ7q5Uj92BI8LU87afnNmhpM9q5QdxvCFlkri1tjYkWjyf2SseRh7MA4yhGXliCkzxcP9JRtpoNyD3vxi2u5ew=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:54.773709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-717024b5-7e59-426b-a64b-68db249b4f6c tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Getting quotas for project 5ae8ce2fd9764aab824f7053d7b06774. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:32:54.778992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f2435aa7-697b-453d-8520-544ead4d818d tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:54.779671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f2435aa7-697b-453d-8520-544ead4d818d tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:54.784067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-717024b5-7e59-426b-a64b-68db249b4f6c tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Getting quotas for user 4177ca828f57441db404fd5cb3ecf08c and project 5ae8ce2fd9764aab824f7053d7b06774. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:32:54.788108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2435aa7-697b-453d-8520-544ead4d818d tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:54.788623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2435aa7-697b-453d-8520-544ead4d818d tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:54.789078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2435aa7-697b-453d-8520-544ead4d818d tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:54.794868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2435aa7-697b-453d-8520-544ead4d818d tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:54.796479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2435aa7-697b-453d-8520-544ead4d818d tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:54.796953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2435aa7-697b-453d-8520-544ead4d818d tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:54.843727 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-717024b5-7e59-426b-a64b-68db249b4f6c tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.773705 Aug 27 04:32:54.845056 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 179/355] 10.222.0.79 () {62 vars in 1200 bytes} [Sat Aug 27 04:32:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 776 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 27 04:32:54.859134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-79e71f3c-ebbd-4c2f-93c8-e5b5f98c8c66 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Action: 'create', calling method: .version_select at 0x7f1f22834820>, body: {"keypair": {"name": "tempest-keypair-198202523", "type": "ssh", "user_id": "7b360cad6bad40b4b3757645b8cb23a9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgqF4REQ4vsw3FjFOe6e4v1XHfdwPr71GYHIV7z1qBr1QZRlJmaNhV0AAuizg3e05R1hcRrROUc3Z0AfstP2z5XcfQGzcD8tvvMZ67TMuPax9XXnaWgcHXlIDy2B/4c1w=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:54.915005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-79e71f3c-ebbd-4c2f-93c8-e5b5f98c8c66 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Getting quotas for project 5ae8ce2fd9764aab824f7053d7b06774. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:32:54.931908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-79e71f3c-ebbd-4c2f-93c8-e5b5f98c8c66 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Getting quotas for user 4177ca828f57441db404fd5cb3ecf08c and project 5ae8ce2fd9764aab824f7053d7b06774. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:32:54.990433 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-79e71f3c-ebbd-4c2f-93c8-e5b5f98c8c66 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.135977 Aug 27 04:32:54.992090 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 180/356] 10.222.0.79 () {62 vars in 1200 bytes} [Sat Aug 27 04:32:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 27 04:32:55.010888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bbd51a39-0c4f-4072-a8cf-104e5782efad tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Calling method '.version_select at 0x7f1f22532f70>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:55.041270 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bbd51a39-0c4f-4072-a8cf-104e5782efad tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-2023776569?user_id=7b360cad6bad40b4b3757645b8cb23a9" status: 200 len: 512 microversion: 2.10 time: 0.038647 Aug 27 04:32:55.044498 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 181/357] 10.222.0.79 () {60 vars in 1340 bytes} [Sat Aug 27 04:32:54 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2023776569?user_id=7b360cad6bad40b4b3757645b8cb23a9 => generated 512 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:55.059134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59dfe25f-43f2-497e-86af-d8a44b773c3c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:55.060443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-59dfe25f-43f2-497e-86af-d8a44b773c3c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:55.070037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59dfe25f-43f2-497e-86af-d8a44b773c3c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:55.074485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59dfe25f-43f2-497e-86af-d8a44b773c3c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:55.075111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59dfe25f-43f2-497e-86af-d8a44b773c3c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:55.080231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59dfe25f-43f2-497e-86af-d8a44b773c3c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:55.080932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59dfe25f-43f2-497e-86af-d8a44b773c3c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:55.081694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59dfe25f-43f2-497e-86af-d8a44b773c3c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:55.192667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-59dfe25f-43f2-497e-86af-d8a44b773c3c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:55.206752 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-59dfe25f-43f2-497e-86af-d8a44b773c3c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1274 microversion: 2.1 time: 0.158663 Aug 27 04:32:55.210194 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 182/358] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:55 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:55.230567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1863935f-67d1-4520-8819-a95dfc931118 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Action: 'create', calling method: .version_select at 0x7f1f22834ca0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-938834188", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIc6B+0h4ecf+DioYl1zJBd/aakfrL9biNuxRWRQDKcZkpddICkSLQrPGhGPCZLpzdUYaYMMBv4jaOt7UXLXudHNderlNieEB8uAz7rt2Bw7m8NjnFr1YZtq9TIRy/JDPw=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:55.265674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-1863935f-67d1-4520-8819-a95dfc931118 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Getting quotas for project 5ae8ce2fd9764aab824f7053d7b06774. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:32:55.275517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-1863935f-67d1-4520-8819-a95dfc931118 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Getting quotas for user 4177ca828f57441db404fd5cb3ecf08c and project 5ae8ce2fd9764aab824f7053d7b06774. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:32:55.344708 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1863935f-67d1-4520-8819-a95dfc931118 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.131557 Aug 27 04:32:55.346336 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 183/359] 10.222.0.79 () {62 vars in 1200 bytes} [Sat Aug 27 04:32:55 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 04:32:55.352717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f2435aa7-697b-453d-8520-544ead4d818d tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:55.368346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f0f2ee8b-5aa7-4526-b59c-827fb83c5aa1 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Calling method '.version_select at 0x7f1f224d23a0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:55.371225 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f2435aa7-697b-453d-8520-544ead4d818d tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1318 microversion: 2.1 time: 0.597328 Aug 27 04:32:55.374443 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 177/360] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:54 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1318 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:55.379399 n-d-854823-1 devstack@n-api.service[128870]: WARNING oslo_db.sqlalchemy.utils [None req-f0f2ee8b-5aa7-4526-b59c-827fb83c5aa1 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 04:32:55.396967 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f0f2ee8b-5aa7-4526-b59c-827fb83c5aa1 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] 10.222.0.79 "GET /compute/v2.1/os-keypairs?user_id=7b360cad6bad40b4b3757645b8cb23a9" status: 200 len: 725 microversion: 2.10 time: 0.040665 Aug 27 04:32:55.397883 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 184/361] 10.222.0.79 () {60 vars in 1259 bytes} [Sat Aug 27 04:32:55 2022] GET /compute/v2.1/os-keypairs?user_id=7b360cad6bad40b4b3757645b8cb23a9 => generated 725 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:55.411307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-baaa5d3f-9b2f-4f93-b0ac-eeda7cc9477b tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Calling method '.version_select at 0x7f1f223eb940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:55.442874 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-baaa5d3f-9b2f-4f93-b0ac-eeda7cc9477b tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-938834188" status: 204 len: 0 microversion: 2.10 time: 0.035254 Aug 27 04:32:55.443789 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 178/362] 10.222.0.79 () {60 vars in 1322 bytes} [Sat Aug 27 04:32:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-938834188 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:32:55.454309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d955f831-2ca3-4c2b-8c40-44b2a04035c9 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Calling method '.version_select at 0x7f1f224c4280>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:55.486367 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d955f831-2ca3-4c2b-8c40-44b2a04035c9 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-198202523?user_id=7b360cad6bad40b4b3757645b8cb23a9" status: 204 len: 0 microversion: 2.10 time: 0.036889 Aug 27 04:32:55.487483 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 185/363] 10.222.0.79 () {60 vars in 1340 bytes} [Sat Aug 27 04:32:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-198202523?user_id=7b360cad6bad40b4b3757645b8cb23a9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:32:55.498011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62be4b4a-0c8e-47a2-b02b-f0fa07311474 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] Calling method '.version_select at 0x7f1f2225f1f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:55.573750 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62be4b4a-0c8e-47a2-b02b-f0fa07311474 tempest-KeyPairsV210TestJSON-512859488 tempest-KeyPairsV210TestJSON-512859488-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023776569?user_id=7b360cad6bad40b4b3757645b8cb23a9" status: 204 len: 0 microversion: 2.10 time: 0.081396 Aug 27 04:32:55.574731 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 179/364] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 04:32:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023776569?user_id=7b360cad6bad40b4b3757645b8cb23a9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:32:55.592805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d983982-81cb-4440-9625-65ef0404c7d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:55.593430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9d983982-81cb-4440-9625-65ef0404c7d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:55.613861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d983982-81cb-4440-9625-65ef0404c7d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:55.620162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d983982-81cb-4440-9625-65ef0404c7d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:55.621895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d983982-81cb-4440-9625-65ef0404c7d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:55.622804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d983982-81cb-4440-9625-65ef0404c7d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:55.623579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d983982-81cb-4440-9625-65ef0404c7d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:55.624410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d983982-81cb-4440-9625-65ef0404c7d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:55.889701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9d983982-81cb-4440-9625-65ef0404c7d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:55.906946 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9d983982-81cb-4440-9625-65ef0404c7d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1319 microversion: 2.1 time: 0.317493 Aug 27 04:32:55.917431 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 186/365] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:55 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:56.233585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed7dc2aa-152d-4ea3-af1a-ec028805671d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:56.234464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ed7dc2aa-152d-4ea3-af1a-ec028805671d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:56.250025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7dc2aa-152d-4ea3-af1a-ec028805671d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:56.253297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7dc2aa-152d-4ea3-af1a-ec028805671d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:56.254801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7dc2aa-152d-4ea3-af1a-ec028805671d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:56.260926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7dc2aa-152d-4ea3-af1a-ec028805671d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:56.262233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7dc2aa-152d-4ea3-af1a-ec028805671d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:56.265249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7dc2aa-152d-4ea3-af1a-ec028805671d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:56.397024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-041965bb-5e7d-479e-9288-8d2c58eeb462 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:56.397966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-041965bb-5e7d-479e-9288-8d2c58eeb462 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:56.405591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-041965bb-5e7d-479e-9288-8d2c58eeb462 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:56.407771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-041965bb-5e7d-479e-9288-8d2c58eeb462 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:56.410694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-041965bb-5e7d-479e-9288-8d2c58eeb462 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:56.414369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-041965bb-5e7d-479e-9288-8d2c58eeb462 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:56.415650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-041965bb-5e7d-479e-9288-8d2c58eeb462 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:56.417067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-041965bb-5e7d-479e-9288-8d2c58eeb462 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:56.676382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed7dc2aa-152d-4ea3-af1a-ec028805671d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:56.686188 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ed7dc2aa-152d-4ea3-af1a-ec028805671d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1274 microversion: 2.1 time: 0.458484 Aug 27 04:32:56.709314 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 180/366] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:56 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1274 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:56.982063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-041965bb-5e7d-479e-9288-8d2c58eeb462 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:56.991302 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-041965bb-5e7d-479e-9288-8d2c58eeb462 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1318 microversion: 2.1 time: 0.599471 Aug 27 04:32:57.004619 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 187/367] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:56 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1318 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:57.021558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-437bfb61-6607-451f-a2d7-ac210f8ae027 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:57.027661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-437bfb61-6607-451f-a2d7-ac210f8ae027 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:57.044624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-437bfb61-6607-451f-a2d7-ac210f8ae027 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:57.045488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-437bfb61-6607-451f-a2d7-ac210f8ae027 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:57.049875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-437bfb61-6607-451f-a2d7-ac210f8ae027 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:57.051120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-437bfb61-6607-451f-a2d7-ac210f8ae027 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:57.051690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-437bfb61-6607-451f-a2d7-ac210f8ae027 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:57.052307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-437bfb61-6607-451f-a2d7-ac210f8ae027 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:57.156089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d44b52c-4700-4b91-9699-794201c4e6f0 tempest-FlavorsV261TestJSON-1519538011 tempest-FlavorsV261TestJSON-1519538011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1707568910", "id": 1740407100, "os-flavor-access:is_public": "True"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:57.218742 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d44b52c-4700-4b91-9699-794201c4e6f0 tempest-FlavorsV261TestJSON-1519538011 tempest-FlavorsV261TestJSON-1519538011-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.404531 Aug 27 04:32:57.229224 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 181/368] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 04:32:56 2022] POST /compute/v2.1/flavors => generated 468 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:57.468650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b764cc75-4bfb-45fb-82e9-cc463bd378e6 tempest-FlavorsV261TestJSON-1386108194 tempest-FlavorsV261TestJSON-1386108194-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:57.491403 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b764cc75-4bfb-45fb-82e9-cc463bd378e6 tempest-FlavorsV261TestJSON-1386108194 tempest-FlavorsV261TestJSON-1386108194-project] 10.222.0.79 "GET /compute/v2.1/flavors/1740407100" status: 200 len: 468 microversion: 2.61 time: 0.260920 Aug 27 04:32:57.491964 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 182/369] 10.222.0.79 () {60 vars in 1199 bytes} [Sat Aug 27 04:32:57 2022] GET /compute/v2.1/flavors/1740407100 => generated 468 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:57.505357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a3afc91f-0133-4a45-9049-9e121a2357ca req-9a858b4c-fead-4dbb-906c-8b178c8060fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de5d3f95-67da-4f5c-8422-c775bd151f03", "tag": "df8756ea-0330-47f7-a318-e35c31555496"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:57.507548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-437bfb61-6607-451f-a2d7-ac210f8ae027 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:57.525058 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-437bfb61-6607-451f-a2d7-ac210f8ae027 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1468 microversion: 2.1 time: 0.513301 Aug 27 04:32:57.525235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a3afc91f-0133-4a45-9049-9e121a2357ca req-9a858b4c-fead-4dbb-906c-8b178c8060fb service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:57.525650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a3afc91f-0133-4a45-9049-9e121a2357ca req-9a858b4c-fead-4dbb-906c-8b178c8060fb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:57.530903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a3afc91f-0133-4a45-9049-9e121a2357ca req-9a858b4c-fead-4dbb-906c-8b178c8060fb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:57.537659 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 188/370] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:57 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1468 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:57.547029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7b2c70e-6541-4423-8f8f-88bad3d9ba05 tempest-FlavorsV261TestJSON-1519538011 tempest-FlavorsV261TestJSON-1519538011-project-admin] Action: 'update', calling method: .version_select at 0x7f1f2396e0d0>, body: {"flavor": {"description": "new"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:57.556050 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a3afc91f-0133-4a45-9049-9e121a2357ca req-9a858b4c-fead-4dbb-906c-8b178c8060fb service nova] Creating event network-changed:df8756ea-0330-47f7-a318-e35c31555496 for instance de5d3f95-67da-4f5c-8422-c775bd151f03 on n-h2-854823-1 Aug 27 04:32:57.569308 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a3afc91f-0133-4a45-9049-9e121a2357ca req-9a858b4c-fead-4dbb-906c-8b178c8060fb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076048 Aug 27 04:32:57.580914 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 183/371] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:57.586415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-21d64be2-3ff6-40d0-9c11-7bb2005d2e58 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:57.588776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-21d64be2-3ff6-40d0-9c11-7bb2005d2e58 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:57.596404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21d64be2-3ff6-40d0-9c11-7bb2005d2e58 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:57.618629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21d64be2-3ff6-40d0-9c11-7bb2005d2e58 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:57.619952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21d64be2-3ff6-40d0-9c11-7bb2005d2e58 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:57.621699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21d64be2-3ff6-40d0-9c11-7bb2005d2e58 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:57.622637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21d64be2-3ff6-40d0-9c11-7bb2005d2e58 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:57.624246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21d64be2-3ff6-40d0-9c11-7bb2005d2e58 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:57.637588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:57.657816 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7b2c70e-6541-4423-8f8f-88bad3d9ba05 tempest-FlavorsV261TestJSON-1519538011 tempest-FlavorsV261TestJSON-1519538011-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/1740407100" status: 200 len: 469 microversion: 2.61 time: 0.118898 Aug 27 04:32:57.658660 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 189/372] 10.222.0.79 () {62 vars in 1219 bytes} [Sat Aug 27 04:32:57 2022] PUT /compute/v2.1/flavors/1740407100 => generated 469 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:57.683799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6b9ec5a8-14af-4294-83cf-b8c4fbb8cccb tempest-FlavorsV261TestJSON-1386108194 tempest-FlavorsV261TestJSON-1386108194-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:57.726104 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6b9ec5a8-14af-4294-83cf-b8c4fbb8cccb tempest-FlavorsV261TestJSON-1386108194 tempest-FlavorsV261TestJSON-1386108194-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 7153 microversion: 2.61 time: 0.050883 Aug 27 04:32:57.761515 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 190/373] 10.222.0.79 () {60 vars in 1187 bytes} [Sat Aug 27 04:32:57 2022] GET /compute/v2.1/flavors/detail => generated 7153 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:32:57.779374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bb36c810-3955-49ab-bb2e-02e07da92db6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:57.780007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bb36c810-3955-49ab-bb2e-02e07da92db6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:57.843867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb36c810-3955-49ab-bb2e-02e07da92db6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:57.859659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb36c810-3955-49ab-bb2e-02e07da92db6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:57.860617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb36c810-3955-49ab-bb2e-02e07da92db6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:57.861741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb36c810-3955-49ab-bb2e-02e07da92db6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:57.862384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb36c810-3955-49ab-bb2e-02e07da92db6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:57.862990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb36c810-3955-49ab-bb2e-02e07da92db6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:57.914485 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-21d64be2-3ff6-40d0-9c11-7bb2005d2e58 tempest-DeleteServersAdminTestJSON-1485052240 tempest-DeleteServersAdminTestJSON-1485052240-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6/action" status: 202 len: 0 microversion: 2.1 time: 0.332134 Aug 27 04:32:57.919042 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 184/374] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:32:57 2022] POST /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:57.924289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea98ab90-7f8f-48b0-b64e-f67c632b09f9 tempest-FlavorsV261TestJSON-1386108194 tempest-FlavorsV261TestJSON-1386108194-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:58.009856 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea98ab90-7f8f-48b0-b64e-f67c632b09f9 tempest-FlavorsV261TestJSON-1386108194 tempest-FlavorsV261TestJSON-1386108194-project] 10.222.0.79 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.61 time: 0.089392 Aug 27 04:32:58.010650 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 185/375] 10.222.0.79 () {60 vars in 1166 bytes} [Sat Aug 27 04:32:57 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:32:58.015029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97e35a3a-b473-426f-9448-bdc4943eb590 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:58.031939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97e35a3a-b473-426f-9448-bdc4943eb590 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:58.048566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e35a3a-b473-426f-9448-bdc4943eb590 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:58.049198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e35a3a-b473-426f-9448-bdc4943eb590 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:58.049825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e35a3a-b473-426f-9448-bdc4943eb590 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:58.050736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e35a3a-b473-426f-9448-bdc4943eb590 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:58.051367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e35a3a-b473-426f-9448-bdc4943eb590 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:58.051948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e35a3a-b473-426f-9448-bdc4943eb590 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:58.134853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e35a3a-b473-426f-9448-bdc4943eb590 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:58.135587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e35a3a-b473-426f-9448-bdc4943eb590 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:58.138537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e35a3a-b473-426f-9448-bdc4943eb590 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:58.139258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-97e35a3a-b473-426f-9448-bdc4943eb590 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lazy-loading 'fault' on Instance uuid a021891f-68f7-4264-a77a-f3b21788f9b6 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:32:58.337966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bb36c810-3955-49ab-bb2e-02e07da92db6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:58.350640 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bb36c810-3955-49ab-bb2e-02e07da92db6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1316 microversion: 2.1 time: 0.586409 Aug 27 04:32:58.351269 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 191/376] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:57 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1316 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:58.361310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cb263db9-9625-4e25-9c27-5bf1050614ea tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:58.361829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cb263db9-9625-4e25-9c27-5bf1050614ea tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:58.389702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb263db9-9625-4e25-9c27-5bf1050614ea tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:58.392984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb263db9-9625-4e25-9c27-5bf1050614ea tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:58.397530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb263db9-9625-4e25-9c27-5bf1050614ea tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:58.398542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb263db9-9625-4e25-9c27-5bf1050614ea tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:58.399101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb263db9-9625-4e25-9c27-5bf1050614ea tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:58.405905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb263db9-9625-4e25-9c27-5bf1050614ea tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:58.984488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cb263db9-9625-4e25-9c27-5bf1050614ea tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:58.999772 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cb263db9-9625-4e25-9c27-5bf1050614ea tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1318 microversion: 2.1 time: 0.640455 Aug 27 04:32:59.016413 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 192/377] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:58 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:59.017575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97e35a3a-b473-426f-9448-bdc4943eb590 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:59.032444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c04efdf9-4fed-4a4d-a24e-33e32e6b7dfb tempest-FlavorsV261TestJSON-1519538011 tempest-FlavorsV261TestJSON-1519538011-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:59.033345 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97e35a3a-b473-426f-9448-bdc4943eb590 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1451 microversion: 2.1 time: 1.021350 Aug 27 04:32:59.052785 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 186/378] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:58 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1451 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:59.060252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-135192fa-3cf9-40e3-84dc-2732fe060600 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:59.077008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-135192fa-3cf9-40e3-84dc-2732fe060600 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:59.125017 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c04efdf9-4fed-4a4d-a24e-33e32e6b7dfb tempest-FlavorsV261TestJSON-1519538011 tempest-FlavorsV261TestJSON-1519538011-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1740407100" status: 202 len: 0 microversion: 2.61 time: 0.107327 Aug 27 04:32:59.133226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-135192fa-3cf9-40e3-84dc-2732fe060600 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:59.136863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-135192fa-3cf9-40e3-84dc-2732fe060600 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:59.137360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-135192fa-3cf9-40e3-84dc-2732fe060600 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:59.139678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-135192fa-3cf9-40e3-84dc-2732fe060600 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:59.139678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-135192fa-3cf9-40e3-84dc-2732fe060600 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:59.140519 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 193/379] 10.222.0.79 () {60 vars in 1202 bytes} [Sat Aug 27 04:32:59 2022] DELETE /compute/v2.1/flavors/1740407100 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:32:59.147895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-135192fa-3cf9-40e3-84dc-2732fe060600 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:59.163293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ba2fe5cf-2954-43db-a706-0e115a9f7574 tempest-FlavorsV261TestJSON-1519538011 tempest-FlavorsV261TestJSON-1519538011-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:59.316099 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ba2fe5cf-2954-43db-a706-0e115a9f7574 tempest-FlavorsV261TestJSON-1519538011 tempest-FlavorsV261TestJSON-1519538011-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.171824 Aug 27 04:32:59.328830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-135192fa-3cf9-40e3-84dc-2732fe060600 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:32:59.334074 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 194/380] 10.222.0.79 () {60 vars in 1187 bytes} [Sat Aug 27 04:32:59 2022] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:32:59.390836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-30e383b4-5a7c-4e81-ad66-297da53d0533 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:59.399033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-30e383b4-5a7c-4e81-ad66-297da53d0533 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:59.411524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=7,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:59.465646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30e383b4-5a7c-4e81-ad66-297da53d0533 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:59.484354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30e383b4-5a7c-4e81-ad66-297da53d0533 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:59.490792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30e383b4-5a7c-4e81-ad66-297da53d0533 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:59.492422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30e383b4-5a7c-4e81-ad66-297da53d0533 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:59.499672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30e383b4-5a7c-4e81-ad66-297da53d0533 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:59.506214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30e383b4-5a7c-4e81-ad66-297da53d0533 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:59.609202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:59.839388 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-135192fa-3cf9-40e3-84dc-2732fe060600 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 204 len: 0 microversion: 2.1 time: 0.782627 Aug 27 04:32:59.846075 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 187/381] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:32:59 2022] DELETE /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:32:59.862809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2120eec7-37a2-4a6a-aae2-e049f4baac6f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:59.867301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2120eec7-37a2-4a6a-aae2-e049f4baac6f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:59.891238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2120eec7-37a2-4a6a-aae2-e049f4baac6f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:59.892093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2120eec7-37a2-4a6a-aae2-e049f4baac6f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:59.893453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2120eec7-37a2-4a6a-aae2-e049f4baac6f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:59.896870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2120eec7-37a2-4a6a-aae2-e049f4baac6f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:59.899750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2120eec7-37a2-4a6a-aae2-e049f4baac6f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:59.901097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2120eec7-37a2-4a6a-aae2-e049f4baac6f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:59.982411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2120eec7-37a2-4a6a-aae2-e049f4baac6f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:59.983193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2120eec7-37a2-4a6a-aae2-e049f4baac6f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:59.983773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2120eec7-37a2-4a6a-aae2-e049f4baac6f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:59.984365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-2120eec7-37a2-4a6a-aae2-e049f4baac6f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lazy-loading 'fault' on Instance uuid a021891f-68f7-4264-a77a-f3b21788f9b6 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:33:00.297204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2120eec7-37a2-4a6a-aae2-e049f4baac6f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:00.307086 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2120eec7-37a2-4a6a-aae2-e049f4baac6f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1457 microversion: 2.1 time: 0.457164 Aug 27 04:33:00.311558 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 188/382] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:59 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1457 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:00.332296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-decd6a2f-ea0c-41aa-85a7-9c2b141419df tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:00.333303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-decd6a2f-ea0c-41aa-85a7-9c2b141419df tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:00.337045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:00.351537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-decd6a2f-ea0c-41aa-85a7-9c2b141419df tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:00.352853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-decd6a2f-ea0c-41aa-85a7-9c2b141419df tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:00.353215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-decd6a2f-ea0c-41aa-85a7-9c2b141419df tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:00.355005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-decd6a2f-ea0c-41aa-85a7-9c2b141419df tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:00.355488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-decd6a2f-ea0c-41aa-85a7-9c2b141419df tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:00.355924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-decd6a2f-ea0c-41aa-85a7-9c2b141419df tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:00.839226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-30e383b4-5a7c-4e81-ad66-297da53d0533 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:00.851686 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-30e383b4-5a7c-4e81-ad66-297da53d0533 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1316 microversion: 2.1 time: 1.481731 Aug 27 04:33:00.853801 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 195/383] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:59 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1316 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:00.998605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:01.282021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-decd6a2f-ea0c-41aa-85a7-9c2b141419df tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:01.295453 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-decd6a2f-ea0c-41aa-85a7-9c2b141419df tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1318 microversion: 2.1 time: 0.982539 Aug 27 04:33:01.305891 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 189/384] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:00 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1318 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:01.337853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1b2c3be9-e539-4d7f-bfb8-211aefce20f6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:01.338837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1b2c3be9-e539-4d7f-bfb8-211aefce20f6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:01.353615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b2c3be9-e539-4d7f-bfb8-211aefce20f6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:01.357830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b2c3be9-e539-4d7f-bfb8-211aefce20f6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:01.358645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b2c3be9-e539-4d7f-bfb8-211aefce20f6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:01.360219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b2c3be9-e539-4d7f-bfb8-211aefce20f6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:01.364343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b2c3be9-e539-4d7f-bfb8-211aefce20f6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:01.365028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b2c3be9-e539-4d7f-bfb8-211aefce20f6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:01.439935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b2c3be9-e539-4d7f-bfb8-211aefce20f6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:01.441498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b2c3be9-e539-4d7f-bfb8-211aefce20f6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:01.442598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b2c3be9-e539-4d7f-bfb8-211aefce20f6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:01.443321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-1b2c3be9-e539-4d7f-bfb8-211aefce20f6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lazy-loading 'fault' on Instance uuid a021891f-68f7-4264-a77a-f3b21788f9b6 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:33:01.888466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-225dea84-a9ed-45e4-b52a-b4c11d9a6c6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:01.889904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-225dea84-a9ed-45e4-b52a-b4c11d9a6c6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:01.901995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-225dea84-a9ed-45e4-b52a-b4c11d9a6c6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:01.903532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-225dea84-a9ed-45e4-b52a-b4c11d9a6c6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:01.904261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-225dea84-a9ed-45e4-b52a-b4c11d9a6c6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:01.905160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-225dea84-a9ed-45e4-b52a-b4c11d9a6c6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:01.905775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-225dea84-a9ed-45e4-b52a-b4c11d9a6c6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:01.906556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-225dea84-a9ed-45e4-b52a-b4c11d9a6c6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:02.418520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-225dea84-a9ed-45e4-b52a-b4c11d9a6c6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:02.429219 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-225dea84-a9ed-45e4-b52a-b4c11d9a6c6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1316 microversion: 2.1 time: 0.547484 Aug 27 04:33:02.432927 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 190/385] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:01 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1316 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:02.462159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ed3131ef-94ec-4f0f-af3b-50b86bd33de3 req-6c5a5d80-3991-45cc-87df-458e99628ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b4d765-c03c-44a6-8346-c3bfd70f997b", "tag": "5e84d3c2-2f47-4c2a-86e7-1658be29f5c9"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:02.482180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=14 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:02.501036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ed3131ef-94ec-4f0f-af3b-50b86bd33de3 req-6c5a5d80-3991-45cc-87df-458e99628ac3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:02.503166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ed3131ef-94ec-4f0f-af3b-50b86bd33de3 req-6c5a5d80-3991-45cc-87df-458e99628ac3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:02.503870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ed3131ef-94ec-4f0f-af3b-50b86bd33de3 req-6c5a5d80-3991-45cc-87df-458e99628ac3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:02.520865 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ed3131ef-94ec-4f0f-af3b-50b86bd33de3 req-6c5a5d80-3991-45cc-87df-458e99628ac3 service nova] Creating event network-changed:5e84d3c2-2f47-4c2a-86e7-1658be29f5c9 for instance f5b4d765-c03c-44a6-8346-c3bfd70f997b on n-h1-854823-1 Aug 27 04:33:02.530339 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ed3131ef-94ec-4f0f-af3b-50b86bd33de3 req-6c5a5d80-3991-45cc-87df-458e99628ac3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094594 Aug 27 04:33:02.531475 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 191/386] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:02.538143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd9d50cc-0f19-4a01-aadf-ec88209097c9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:02.539005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd9d50cc-0f19-4a01-aadf-ec88209097c9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:02.545613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd9d50cc-0f19-4a01-aadf-ec88209097c9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:02.546359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd9d50cc-0f19-4a01-aadf-ec88209097c9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:02.548965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd9d50cc-0f19-4a01-aadf-ec88209097c9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:02.549919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd9d50cc-0f19-4a01-aadf-ec88209097c9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:02.550643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd9d50cc-0f19-4a01-aadf-ec88209097c9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:02.551228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd9d50cc-0f19-4a01-aadf-ec88209097c9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:02.562673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1b2c3be9-e539-4d7f-bfb8-211aefce20f6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:02.571330 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1b2c3be9-e539-4d7f-bfb8-211aefce20f6 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1457 microversion: 2.1 time: 1.239140 Aug 27 04:33:02.576310 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 196/387] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:01 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1457 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:02.942929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bd9d50cc-0f19-4a01-aadf-ec88209097c9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:02.959584 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd9d50cc-0f19-4a01-aadf-ec88209097c9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1318 microversion: 2.1 time: 0.426494 Aug 27 04:33:02.960417 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 192/388] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:02 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:03.454608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a9de0275-7958-4489-89ff-4c783f6ad6f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:03.456227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a9de0275-7958-4489-89ff-4c783f6ad6f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:03.489665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9de0275-7958-4489-89ff-4c783f6ad6f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:03.500150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9de0275-7958-4489-89ff-4c783f6ad6f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:03.505887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9de0275-7958-4489-89ff-4c783f6ad6f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:03.518796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9de0275-7958-4489-89ff-4c783f6ad6f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:03.522446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9de0275-7958-4489-89ff-4c783f6ad6f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:03.523094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9de0275-7958-4489-89ff-4c783f6ad6f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:03.599295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6c35e4d-930a-428a-8eaa-c48c1eb5758f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:03.600159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6c35e4d-930a-428a-8eaa-c48c1eb5758f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:03.614881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6c35e4d-930a-428a-8eaa-c48c1eb5758f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:03.617267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6c35e4d-930a-428a-8eaa-c48c1eb5758f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:03.622224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6c35e4d-930a-428a-8eaa-c48c1eb5758f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:03.625567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6c35e4d-930a-428a-8eaa-c48c1eb5758f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:03.627150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6c35e4d-930a-428a-8eaa-c48c1eb5758f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:03.628295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6c35e4d-930a-428a-8eaa-c48c1eb5758f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:03.728705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6c35e4d-930a-428a-8eaa-c48c1eb5758f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:03.730762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6c35e4d-930a-428a-8eaa-c48c1eb5758f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:03.732588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6c35e4d-930a-428a-8eaa-c48c1eb5758f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:03.733222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-f6c35e4d-930a-428a-8eaa-c48c1eb5758f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lazy-loading 'fault' on Instance uuid a021891f-68f7-4264-a77a-f3b21788f9b6 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:33:04.019163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f6c35e4d-930a-428a-8eaa-c48c1eb5758f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:04.040421 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6c35e4d-930a-428a-8eaa-c48c1eb5758f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1457 microversion: 2.1 time: 0.435261 Aug 27 04:33:04.041533 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 193/389] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:03 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1457 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:04.057146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4d656297-7676-47fb-8495-00f9e1d67d69 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:04.067294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4d656297-7676-47fb-8495-00f9e1d67d69 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:04.093701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d656297-7676-47fb-8495-00f9e1d67d69 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:04.103292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d656297-7676-47fb-8495-00f9e1d67d69 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:04.105291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d656297-7676-47fb-8495-00f9e1d67d69 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:04.110349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d656297-7676-47fb-8495-00f9e1d67d69 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:04.111009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d656297-7676-47fb-8495-00f9e1d67d69 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:04.111606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d656297-7676-47fb-8495-00f9e1d67d69 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:04.373425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a9de0275-7958-4489-89ff-4c783f6ad6f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:04.396315 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a9de0275-7958-4489-89ff-4c783f6ad6f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1316 microversion: 2.1 time: 0.938230 Aug 27 04:33:04.405643 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 197/390] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:03 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1316 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:04.605069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4d656297-7676-47fb-8495-00f9e1d67d69 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:04.614898 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4d656297-7676-47fb-8495-00f9e1d67d69 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1318 microversion: 2.1 time: 0.572108 Aug 27 04:33:04.617597 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 194/391] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:04 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:05.078157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2737fc01-b76d-45b9-b68e-797264059348 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:05.081487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2737fc01-b76d-45b9-b68e-797264059348 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:05.106447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737fc01-b76d-45b9-b68e-797264059348 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:05.112372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737fc01-b76d-45b9-b68e-797264059348 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:05.113122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737fc01-b76d-45b9-b68e-797264059348 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:05.116251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737fc01-b76d-45b9-b68e-797264059348 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:05.120831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737fc01-b76d-45b9-b68e-797264059348 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:05.121487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737fc01-b76d-45b9-b68e-797264059348 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:05.245231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737fc01-b76d-45b9-b68e-797264059348 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:05.245914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737fc01-b76d-45b9-b68e-797264059348 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:05.248120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737fc01-b76d-45b9-b68e-797264059348 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:05.248973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-2737fc01-b76d-45b9-b68e-797264059348 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lazy-loading 'fault' on Instance uuid a021891f-68f7-4264-a77a-f3b21788f9b6 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:33:05.298386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=22 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:05.405080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2737fc01-b76d-45b9-b68e-797264059348 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94068d7cc8804363a24b4159cf861440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2590843f03fa4ffaafb6ccd928425042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:05.421244 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2737fc01-b76d-45b9-b68e-797264059348 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 200 len: 1415 microversion: 2.1 time: 0.351773 Aug 27 04:33:05.424599 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 198/392] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:05 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 1415 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:05.437247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-993baadb-63d8-4abe-815a-d92cd4392b0a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:05.438039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-993baadb-63d8-4abe-815a-d92cd4392b0a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:05.463343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-993baadb-63d8-4abe-815a-d92cd4392b0a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:05.464816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-993baadb-63d8-4abe-815a-d92cd4392b0a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:05.466856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-993baadb-63d8-4abe-815a-d92cd4392b0a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:05.469605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-993baadb-63d8-4abe-815a-d92cd4392b0a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:05.471472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-993baadb-63d8-4abe-815a-d92cd4392b0a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:05.472422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-993baadb-63d8-4abe-815a-d92cd4392b0a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:05.706783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-15ad9db5-c8b9-4181-bf48-8a04f84b5b9b req-42e1d4d8-759f-40b1-8abd-83fc6b8c3217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a021891f-68f7-4264-a77a-f3b21788f9b6", "name": "network-vif-deleted", "tag": "75f96374-5f3f-4e50-8fbd-031d916ef15b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:05.739308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-15ad9db5-c8b9-4181-bf48-8a04f84b5b9b req-42e1d4d8-759f-40b1-8abd-83fc6b8c3217 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:05.746486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-15ad9db5-c8b9-4181-bf48-8a04f84b5b9b req-42e1d4d8-759f-40b1-8abd-83fc6b8c3217 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:05.750225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-15ad9db5-c8b9-4181-bf48-8a04f84b5b9b req-42e1d4d8-759f-40b1-8abd-83fc6b8c3217 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:05.808918 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-15ad9db5-c8b9-4181-bf48-8a04f84b5b9b req-42e1d4d8-759f-40b1-8abd-83fc6b8c3217 service nova] Creating event network-vif-deleted:75f96374-5f3f-4e50-8fbd-031d916ef15b for instance a021891f-68f7-4264-a77a-f3b21788f9b6 on n-h1-854823-1 Aug 27 04:33:05.820431 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-15ad9db5-c8b9-4181-bf48-8a04f84b5b9b req-42e1d4d8-759f-40b1-8abd-83fc6b8c3217 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.494146 Aug 27 04:33:05.831656 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 195/393] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:05.860096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6f95062-7276-4cf2-b011-2adc610caa37 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:05.862054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6f95062-7276-4cf2-b011-2adc610caa37 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:05.893491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6f95062-7276-4cf2-b011-2adc610caa37 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:05.894237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6f95062-7276-4cf2-b011-2adc610caa37 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:05.897720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6f95062-7276-4cf2-b011-2adc610caa37 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:05.901436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6f95062-7276-4cf2-b011-2adc610caa37 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:05.903468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6f95062-7276-4cf2-b011-2adc610caa37 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:05.904058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6f95062-7276-4cf2-b011-2adc610caa37 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:06.597602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-993baadb-63d8-4abe-815a-d92cd4392b0a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:06.612022 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-993baadb-63d8-4abe-815a-d92cd4392b0a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1316 microversion: 2.1 time: 1.182157 Aug 27 04:33:06.616766 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 199/394] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:05 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1316 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:06.631433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-25231612-4d64-4577-aed8-487d7f0c905e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:06.637597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-25231612-4d64-4577-aed8-487d7f0c905e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:06.646565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25231612-4d64-4577-aed8-487d7f0c905e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:06.647428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25231612-4d64-4577-aed8-487d7f0c905e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:06.648083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25231612-4d64-4577-aed8-487d7f0c905e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:06.649409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25231612-4d64-4577-aed8-487d7f0c905e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:06.650104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25231612-4d64-4577-aed8-487d7f0c905e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:06.650880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25231612-4d64-4577-aed8-487d7f0c905e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:06.721372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-25231612-4d64-4577-aed8-487d7f0c905e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:33:06.963614 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-25231612-4d64-4577-aed8-487d7f0c905e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "DELETE /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 204 len: 0 microversion: 2.1 time: 0.339977 Aug 27 04:33:06.973321 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 200/395] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:33:06 2022] DELETE /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:33:06.988040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5f455d9f-bacf-4fa9-a6f1-2d7394f6815f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:06.989480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5f455d9f-bacf-4fa9-a6f1-2d7394f6815f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:07.007802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f455d9f-bacf-4fa9-a6f1-2d7394f6815f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:07.009580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f455d9f-bacf-4fa9-a6f1-2d7394f6815f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:07.011314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f455d9f-bacf-4fa9-a6f1-2d7394f6815f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:07.012787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f455d9f-bacf-4fa9-a6f1-2d7394f6815f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:07.014148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f455d9f-bacf-4fa9-a6f1-2d7394f6815f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:07.014802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f455d9f-bacf-4fa9-a6f1-2d7394f6815f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:07.046270 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-5f455d9f-bacf-4fa9-a6f1-2d7394f6815f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] HTTP exception thrown: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5f455d9f-bacf-4fa9-a6f1-2d7394f6815f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Request method failure captured: Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 HTTP/1.1 Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4zG7IAg55drOOnXbjbriR9kxHxksSc5I-1By2x2jB3e5k10Et9MWBE-5X0k7bXD2cCn4T4NoHdUY5J_XQZW4N2MKMWJrdwSEAkts-MwoC5DOtF2hC-raU-69-lL-oKElBFgOKFHt8eEjIbFQv_wxMayfLg-EAo-H05v0Ut0PtpQco Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 2590843f03fa4ffaafb6ccd928425042 Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:33:07.048335 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:33:07.049813 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:07.049813 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:07.049813 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 2590843f03fa4ffaafb6ccd928425042 Aug 27 04:33:07.049813 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:07.049813 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-DeleteServersAdminTestJSON-1795848583-project Aug 27 04:33:07.049813 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:33:07.049813 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:33:07.049813 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 94068d7cc8804363a24b4159cf861440 Aug 27 04:33:07.049813 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-DeleteServersAdminTestJSON-1795848583-project Aug 27 04:33:07.049813 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:33:07.049813 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:07.049813 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'a021891f-68f7-4264-a77a-f3b21788f9b6'} Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:07.050524 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:07.051675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:07.077238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5f455d9f-bacf-4fa9-a6f1-2d7394f6815f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Returning 404 to user: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:07.081781 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5f455d9f-bacf-4fa9-a6f1-2d7394f6815f tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 404 len: 111 microversion: 2.1 time: 0.104611 Aug 27 04:33:07.092488 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 201/396] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:06 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:07.239448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a6f95062-7276-4cf2-b011-2adc610caa37 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:07.250296 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6f95062-7276-4cf2-b011-2adc610caa37 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1318 microversion: 2.1 time: 1.411462 Aug 27 04:33:07.265599 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 196/397] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:05 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1318 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:07.273398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-33578287-3736-407f-8770-35f56b11da80 req-6ba62ba2-8fb2-4ee1-8c60-26c6624272f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de5d3f95-67da-4f5c-8422-c775bd151f03", "name": "network-vif-plugged", "status": "completed", "tag": "df8756ea-0330-47f7-a318-e35c31555496"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:07.302071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-33578287-3736-407f-8770-35f56b11da80 req-6ba62ba2-8fb2-4ee1-8c60-26c6624272f0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:07.302942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-33578287-3736-407f-8770-35f56b11da80 req-6ba62ba2-8fb2-4ee1-8c60-26c6624272f0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:07.305814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-33578287-3736-407f-8770-35f56b11da80 req-6ba62ba2-8fb2-4ee1-8c60-26c6624272f0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:07.330586 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-33578287-3736-407f-8770-35f56b11da80 req-6ba62ba2-8fb2-4ee1-8c60-26c6624272f0 service nova] Creating event network-vif-plugged:df8756ea-0330-47f7-a318-e35c31555496 for instance de5d3f95-67da-4f5c-8422-c775bd151f03 on n-h2-854823-1 Aug 27 04:33:07.340874 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-33578287-3736-407f-8770-35f56b11da80 req-6ba62ba2-8fb2-4ee1-8c60-26c6624272f0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073521 Aug 27 04:33:07.345922 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 197/398] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:07.362692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c108f75b-a46c-4e4b-be68-e0561efef926 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:07.363691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c108f75b-a46c-4e4b-be68-e0561efef926 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:07.375019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c108f75b-a46c-4e4b-be68-e0561efef926 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:07.377074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c108f75b-a46c-4e4b-be68-e0561efef926 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:07.379602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c108f75b-a46c-4e4b-be68-e0561efef926 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:07.380793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c108f75b-a46c-4e4b-be68-e0561efef926 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:07.381531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c108f75b-a46c-4e4b-be68-e0561efef926 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:07.383395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c108f75b-a46c-4e4b-be68-e0561efef926 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:07.424373 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c108f75b-a46c-4e4b-be68-e0561efef926 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] HTTP exception thrown: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c108f75b-a46c-4e4b-be68-e0561efef926 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Request method failure captured: Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 HTTP/1.1 Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4zG7IAg55drOOnXbjbriR9kxHxksSc5I-1By2x2jB3e5k10Et9MWBE-5X0k7bXD2cCn4T4NoHdUY5J_XQZW4N2MKMWJrdwSEAkts-MwoC5DOtF2hC-raU-69-lL-oKElBFgOKFHt8eEjIbFQv_wxMayfLg-EAo-H05v0Ut0PtpQco Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 2590843f03fa4ffaafb6ccd928425042 Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:33:07.426537 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:33:07.427746 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:07.427746 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:07.427746 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 2590843f03fa4ffaafb6ccd928425042 Aug 27 04:33:07.427746 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:07.427746 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersAdminTestJSON-1795848583-project Aug 27 04:33:07.427746 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:33:07.427746 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:33:07.427746 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 94068d7cc8804363a24b4159cf861440 Aug 27 04:33:07.427746 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersAdminTestJSON-1795848583-project Aug 27 04:33:07.427746 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:33:07.427746 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:07.427746 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'a021891f-68f7-4264-a77a-f3b21788f9b6'} Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:07.428416 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:07.429536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:07.438008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c108f75b-a46c-4e4b-be68-e0561efef926 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Returning 404 to user: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:07.439207 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c108f75b-a46c-4e4b-be68-e0561efef926 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 404 len: 111 microversion: 2.1 time: 0.091841 Aug 27 04:33:07.440324 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 198/399] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:33:07 2022] DELETE /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:07.451659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1108353433", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "180691224", "adminPass": "***", "networks": [{"uuid": "a2b6b0d7-e838-42c3-acca-220a63c7efe1"}], "security_groups": [{"name": "tempest-securitygroup--1810346861"}], "key_name": "tempest-keypair-182086736", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:07.658267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-615558570", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:07.760405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:33:07.999500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] validate_networks() for [('a2b6b0d7-e838-42c3-acca-220a63c7efe1', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:33:08.119294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:33:08.120384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:33:08.121046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:33:08.121602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:33:08.122161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:33:08.141318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:08.142094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:08.151969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:08.153871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:08.154524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:08.155147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:08.199338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Getting quotas for project abfa50b6f05c4413b2a96f2490ac43a1. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:08.205386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Getting quotas for user 7e6454ced7834bbdaeee89ccef19f510 and project abfa50b6f05c4413b2a96f2490ac43a1. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:08.234971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:33:08.240291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:33:08.392307 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bbb3b687-cbae-4635-9869-85ca96a42b39 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.294163 Aug 27 04:33:08.402179 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 202/400] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:33:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:33:08.415163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-67f7e7e0-9884-4db7-a591-b24d96810959 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:08.415851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-67f7e7e0-9884-4db7-a591-b24d96810959 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: a021891f-68f7-4264-a77a-f3b21788f9b6] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:08.430445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67f7e7e0-9884-4db7-a591-b24d96810959 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:08.431011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67f7e7e0-9884-4db7-a591-b24d96810959 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:08.431509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67f7e7e0-9884-4db7-a591-b24d96810959 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:08.432282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67f7e7e0-9884-4db7-a591-b24d96810959 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:08.433339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67f7e7e0-9884-4db7-a591-b24d96810959 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:08.433835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67f7e7e0-9884-4db7-a591-b24d96810959 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:08.453414 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-67f7e7e0-9884-4db7-a591-b24d96810959 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] HTTP exception thrown: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-67f7e7e0-9884-4db7-a591-b24d96810959 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Request method failure captured: Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 HTTP/1.1 Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4zG7IAg55drOOnXbjbriR9kxHxksSc5I-1By2x2jB3e5k10Et9MWBE-5X0k7bXD2cCn4T4NoHdUY5J_XQZW4N2MKMWJrdwSEAkts-MwoC5DOtF2hC-raU-69-lL-oKElBFgOKFHt8eEjIbFQv_wxMayfLg-EAo-H05v0Ut0PtpQco Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 2590843f03fa4ffaafb6ccd928425042 Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:33:08.455081 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:33:08.456290 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:08.456290 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:08.456290 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 2590843f03fa4ffaafb6ccd928425042 Aug 27 04:33:08.456290 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:08.456290 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-DeleteServersAdminTestJSON-1795848583-project Aug 27 04:33:08.456290 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:33:08.456290 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:33:08.456290 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 94068d7cc8804363a24b4159cf861440 Aug 27 04:33:08.456290 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-DeleteServersAdminTestJSON-1795848583-project Aug 27 04:33:08.456290 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:33:08.456290 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:08.456290 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'a021891f-68f7-4264-a77a-f3b21788f9b6'} Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:08.457239 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. Aug 27 04:33:08.458334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:08.459620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-67f7e7e0-9884-4db7-a591-b24d96810959 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Returning 404 to user: Instance a021891f-68f7-4264-a77a-f3b21788f9b6 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:08.459620 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-67f7e7e0-9884-4db7-a591-b24d96810959 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6" status: 404 len: 111 microversion: 2.1 time: 0.053240 Aug 27 04:33:08.459620 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 203/401] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:08 2022] GET /compute/v2.1/servers/a021891f-68f7-4264-a77a-f3b21788f9b6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:08.467836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-af039c31-2194-41a0-9790-6c71d7912f8b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:08.468569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-af039c31-2194-41a0-9790-6c71d7912f8b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:08.475939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af039c31-2194-41a0-9790-6c71d7912f8b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:08.477783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af039c31-2194-41a0-9790-6c71d7912f8b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:08.478319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af039c31-2194-41a0-9790-6c71d7912f8b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:08.480934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af039c31-2194-41a0-9790-6c71d7912f8b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:08.482257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af039c31-2194-41a0-9790-6c71d7912f8b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:08.483224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af039c31-2194-41a0-9790-6c71d7912f8b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:09.113493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-af039c31-2194-41a0-9790-6c71d7912f8b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:09.124186 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-af039c31-2194-41a0-9790-6c71d7912f8b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1316 microversion: 2.1 time: 0.662223 Aug 27 04:33:09.131015 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 204/402] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:08 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1316 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:09.152038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6011ca1b-2460-47cc-9623-06d5f4c3eb9c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:09.153041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6011ca1b-2460-47cc-9623-06d5f4c3eb9c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:09.216117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6011ca1b-2460-47cc-9623-06d5f4c3eb9c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:09.217217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6011ca1b-2460-47cc-9623-06d5f4c3eb9c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:09.217679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6011ca1b-2460-47cc-9623-06d5f4c3eb9c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:09.239385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6011ca1b-2460-47cc-9623-06d5f4c3eb9c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:09.239902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6011ca1b-2460-47cc-9623-06d5f4c3eb9c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:09.240357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6011ca1b-2460-47cc-9623-06d5f4c3eb9c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:09.970502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6011ca1b-2460-47cc-9623-06d5f4c3eb9c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:09.983594 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6011ca1b-2460-47cc-9623-06d5f4c3eb9c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1318 microversion: 2.1 time: 0.850635 Aug 27 04:33:09.986903 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 205/403] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:09 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1318 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:10.016590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-55a3896c-1fcd-47bb-a9a5-aa56ceced8b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:10.017907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-55a3896c-1fcd-47bb-a9a5-aa56ceced8b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:10.027126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55a3896c-1fcd-47bb-a9a5-aa56ceced8b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:10.028108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55a3896c-1fcd-47bb-a9a5-aa56ceced8b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:10.029090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55a3896c-1fcd-47bb-a9a5-aa56ceced8b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:10.030267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55a3896c-1fcd-47bb-a9a5-aa56ceced8b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:10.031056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55a3896c-1fcd-47bb-a9a5-aa56ceced8b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:10.031739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55a3896c-1fcd-47bb-a9a5-aa56ceced8b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:10.147653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-55a3896c-1fcd-47bb-a9a5-aa56ceced8b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:10.158748 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-55a3896c-1fcd-47bb-a9a5-aa56ceced8b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1208 microversion: 2.1 time: 0.168056 Aug 27 04:33:10.159289 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 206/404] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:09 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1208 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:10.184720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cc82cecc-ddb7-4c29-bd54-47fbfba231d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:10.186207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cc82cecc-ddb7-4c29-bd54-47fbfba231d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:10.203496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc82cecc-ddb7-4c29-bd54-47fbfba231d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:10.204473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc82cecc-ddb7-4c29-bd54-47fbfba231d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:10.206864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc82cecc-ddb7-4c29-bd54-47fbfba231d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:10.207920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc82cecc-ddb7-4c29-bd54-47fbfba231d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:10.208727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc82cecc-ddb7-4c29-bd54-47fbfba231d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:10.209500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc82cecc-ddb7-4c29-bd54-47fbfba231d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:10.243463 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-cc82cecc-ddb7-4c29-bd54-47fbfba231d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] HTTP exception thrown: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cc82cecc-ddb7-4c29-bd54-47fbfba231d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Request method failure captured: Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def HTTP/1.1 Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4zG7IAg55drOOnXbjbriR9kxHxksSc5I-1By2x2jB3e5k10Et9MWBE-5X0k7bXD2cCn4T4NoHdUY5J_XQZW4N2MKMWJrdwSEAkts-MwoC5DOtF2hC-raU-69-lL-oKElBFgOKFHt8eEjIbFQv_wxMayfLg-EAo-H05v0Ut0PtpQco Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 2590843f03fa4ffaafb6ccd928425042 Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:33:10.246252 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:33:10.247552 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:10.247552 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:10.247552 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 2590843f03fa4ffaafb6ccd928425042 Aug 27 04:33:10.247552 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:10.247552 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-DeleteServersAdminTestJSON-1795848583-project Aug 27 04:33:10.247552 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:33:10.247552 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:33:10.247552 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 94068d7cc8804363a24b4159cf861440 Aug 27 04:33:10.247552 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-DeleteServersAdminTestJSON-1795848583-project Aug 27 04:33:10.247552 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:33:10.247552 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:33:10.247552 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '95fe425c-a241-46b8-84d0-9ec136716def'} Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:10.248343 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:33:10.249571 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:10.266354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cc82cecc-ddb7-4c29-bd54-47fbfba231d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Returning 404 to user: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:10.277938 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cc82cecc-ddb7-4c29-bd54-47fbfba231d0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "DELETE /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 404 len: 111 microversion: 2.1 time: 0.110680 Aug 27 04:33:10.284254 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 207/405] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:33:10 2022] DELETE /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:10.410238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:33:10.410836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:33:10.411319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:33:10.411919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:33:10.412498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:33:10.432764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:10.433403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:10.433978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:10.437041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:10.437769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:10.438423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:10.489719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Getting quotas for project dbfb6b35f0604c108f1b30f3f7a853bc. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:10.502114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Getting quotas for user 50d4329bce764315901687e5ffb1f645 and project dbfb6b35f0604c108f1b30f3f7a853bc. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:10.542383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:33:10.554712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:33:10.648057 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1c80402-79b8-47ee-bfa6-d52dac2999da tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.205559 Aug 27 04:33:10.656214 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 199/406] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:33:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 3215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:33:10.657262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7a80583-ccee-4653-baaf-678ff075b9be tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Calling method '.version_select at 0x7f1f224ae280>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:10.659149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c7a80583-ccee-4653-baaf-678ff075b9be tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'cc50117488804645a7da0a3b454a6308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea4e5c4cb5f4451bed3b9e317f9af47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:10.665014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8888fe8a-00d2-4b7c-9625-92322c325d59 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7a80583-ccee-4653-baaf-678ff075b9be tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Request method failure captured: Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ6DWoE4iSsIb3RYvumA6WvLm97DxDUBjEVyi7ZLPnch6IVUvaFe_enSvcVUecEnOty6m-qny-Qn25ugRdYI_L085S0nB-QiT6idEf02SZZDp73w78Mgrslw8jcICL5wnuv8Iz8XjErPh_YNxZG7lPclJ8gZEtcTKY7UX1rSjcXgriA Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: dea4e5c4cb5f4451bed3b9e317f9af47 Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:33:10.665809 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:33:10.667201 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:10.667201 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:10.667201 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: dea4e5c4cb5f4451bed3b9e317f9af47 Aug 27 04:33:10.667201 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:10.667201 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-HypervisorAdminNegativeTestJSON-1084620434-project Aug 27 04:33:10.667201 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:33:10.667201 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:33:10.667201 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: cc50117488804645a7da0a3b454a6308 Aug 27 04:33:10.667201 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434-project Aug 27 04:33:10.667201 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:33:10.667201 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 04:33:10.667201 n-d-854823-1 devstack@n-api.service[128870]: action_args: {} Aug 27 04:33:10.667201 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:33:10.667974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 04:33:10.669171 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:10.670332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7a80583-ccee-4653-baaf-678ff075b9be tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:10.670332 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7a80583-ccee-4653-baaf-678ff075b9be tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.379528 Aug 27 04:33:10.672009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8888fe8a-00d2-4b7c-9625-92322c325d59 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:10.679392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8888fe8a-00d2-4b7c-9625-92322c325d59 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:10.680934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8888fe8a-00d2-4b7c-9625-92322c325d59 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:10.682189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8888fe8a-00d2-4b7c-9625-92322c325d59 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:10.683132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8888fe8a-00d2-4b7c-9625-92322c325d59 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:10.683923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8888fe8a-00d2-4b7c-9625-92322c325d59 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:10.684052 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 208/407] 10.222.0.79 () {58 vars in 1167 bytes} [Sat Aug 27 04:33:10 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 399 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:10.684827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8888fe8a-00d2-4b7c-9625-92322c325d59 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:10.706979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-217dfd16-a264-4c64-a641-02241c414ff0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:10.707809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-217dfd16-a264-4c64-a641-02241c414ff0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] [instance: 95fe425c-a241-46b8-84d0-9ec136716def] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:10.736590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-217dfd16-a264-4c64-a641-02241c414ff0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:10.737007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-217dfd16-a264-4c64-a641-02241c414ff0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:10.737447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-217dfd16-a264-4c64-a641-02241c414ff0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:10.738164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-217dfd16-a264-4c64-a641-02241c414ff0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:10.738617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-217dfd16-a264-4c64-a641-02241c414ff0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:10.739041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-217dfd16-a264-4c64-a641-02241c414ff0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:10.790201 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-217dfd16-a264-4c64-a641-02241c414ff0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] HTTP exception thrown: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-217dfd16-a264-4c64-a641-02241c414ff0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Request method failure captured: Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def HTTP/1.1 Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4zG7IAg55drOOnXbjbriR9kxHxksSc5I-1By2x2jB3e5k10Et9MWBE-5X0k7bXD2cCn4T4NoHdUY5J_XQZW4N2MKMWJrdwSEAkts-MwoC5DOtF2hC-raU-69-lL-oKElBFgOKFHt8eEjIbFQv_wxMayfLg-EAo-H05v0Ut0PtpQco Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 2590843f03fa4ffaafb6ccd928425042 Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:33:10.791873 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:33:10.793339 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2590843f03fa4ffaafb6ccd928425042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:10.793339 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:10.793339 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 2590843f03fa4ffaafb6ccd928425042 Aug 27 04:33:10.793339 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1795848583 Aug 27 04:33:10.793339 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-DeleteServersAdminTestJSON-1795848583-project Aug 27 04:33:10.793339 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:33:10.793339 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:33:10.793339 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 94068d7cc8804363a24b4159cf861440 Aug 27 04:33:10.793339 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-DeleteServersAdminTestJSON-1795848583-project Aug 27 04:33:10.793339 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:33:10.793339 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:33:10.793339 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '95fe425c-a241-46b8-84d0-9ec136716def'} Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:10.794037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. Aug 27 04:33:10.795182 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:10.796143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-217dfd16-a264-4c64-a641-02241c414ff0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] Returning 404 to user: Instance 95fe425c-a241-46b8-84d0-9ec136716def could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:10.796143 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-217dfd16-a264-4c64-a641-02241c414ff0 tempest-DeleteServersAdminTestJSON-1795848583 tempest-DeleteServersAdminTestJSON-1795848583-project] 10.222.0.79 "GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def" status: 404 len: 111 microversion: 2.1 time: 0.109814 Aug 27 04:33:10.796286 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 209/408] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:10 2022] GET /compute/v2.1/servers/95fe425c-a241-46b8-84d0-9ec136716def => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:10.810352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d6055081-4739-4327-93ed-7bdc30b95aeb tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:10.814381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d6055081-4739-4327-93ed-7bdc30b95aeb tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:11.243048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8888fe8a-00d2-4b7c-9625-92322c325d59 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:11.246615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:11.258698 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8888fe8a-00d2-4b7c-9625-92322c325d59 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1316 microversion: 2.1 time: 0.593825 Aug 27 04:33:11.270360 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 200/409] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:10 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1316 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:11.291764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a081d331-b1db-4f59-80d7-59f3fce76186 tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Calling method '.version_select at 0x7f1f22337ca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:11.300069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a081d331-b1db-4f59-80d7-59f3fce76186 tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'cc50117488804645a7da0a3b454a6308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea4e5c4cb5f4451bed3b9e317f9af47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a081d331-b1db-4f59-80d7-59f3fce76186 tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Request method failure captured: Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ6DWoE4iSsIb3RYvumA6WvLm97DxDUBjEVyi7ZLPnch6IVUvaFe_enSvcVUecEnOty6m-qny-Qn25ugRdYI_L085S0nB-QiT6idEf02SZZDp73w78Mgrslw8jcICL5wnuv8Iz8XjErPh_YNxZG7lPclJ8gZEtcTKY7UX1rSjcXgriA Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: dea4e5c4cb5f4451bed3b9e317f9af47 Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:33:11.305625 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:33:11.307221 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:11.307221 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:11.307221 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: dea4e5c4cb5f4451bed3b9e317f9af47 Aug 27 04:33:11.307221 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:11.307221 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-HypervisorAdminNegativeTestJSON-1084620434-project Aug 27 04:33:11.307221 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:33:11.307221 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:33:11.307221 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cc50117488804645a7da0a3b454a6308 Aug 27 04:33:11.307221 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434-project Aug 27 04:33:11.307221 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:33:11.307221 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 04:33:11.307221 n-d-854823-1 devstack@n-api.service[128869]: action_args: {} Aug 27 04:33:11.307221 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:33:11.308188 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 04:33:11.309524 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:11.317338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a081d331-b1db-4f59-80d7-59f3fce76186 tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:11.323260 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a081d331-b1db-4f59-80d7-59f3fce76186 tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.050564 Aug 27 04:33:11.327259 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 201/410] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:33:11 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:11.343676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8d7a3f7-9fc8-453f-ae1d-c8003112ae70 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:11.348141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8d7a3f7-9fc8-453f-ae1d-c8003112ae70 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:11.378852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d7a3f7-9fc8-453f-ae1d-c8003112ae70 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:11.381628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d7a3f7-9fc8-453f-ae1d-c8003112ae70 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:11.382462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d7a3f7-9fc8-453f-ae1d-c8003112ae70 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:11.391562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d7a3f7-9fc8-453f-ae1d-c8003112ae70 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:11.394716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d7a3f7-9fc8-453f-ae1d-c8003112ae70 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:11.396054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d7a3f7-9fc8-453f-ae1d-c8003112ae70 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:11.629383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d6055081-4739-4327-93ed-7bdc30b95aeb tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:11.641679 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d6055081-4739-4327-93ed-7bdc30b95aeb tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1262 microversion: 2.1 time: 0.843685 Aug 27 04:33:11.646849 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 210/411] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:10 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1262 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:11.671976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d557636e-3e9d-44bd-b355-8309eceb8f5b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:11.674439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d557636e-3e9d-44bd-b355-8309eceb8f5b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:11.685248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d557636e-3e9d-44bd-b355-8309eceb8f5b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:11.687418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d557636e-3e9d-44bd-b355-8309eceb8f5b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:11.689780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d557636e-3e9d-44bd-b355-8309eceb8f5b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:11.692440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d557636e-3e9d-44bd-b355-8309eceb8f5b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:11.694931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d557636e-3e9d-44bd-b355-8309eceb8f5b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:11.696588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d557636e-3e9d-44bd-b355-8309eceb8f5b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:12.044752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d557636e-3e9d-44bd-b355-8309eceb8f5b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:12.069551 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d557636e-3e9d-44bd-b355-8309eceb8f5b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1270 microversion: 2.1 time: 0.395483 Aug 27 04:33:12.074089 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 211/412] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:11 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1270 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:12.092296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e41ed371-f23d-4015-9a27-1d7b080b197f tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Calling method '.version_select at 0x7f1f224a0160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:12.094858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e41ed371-f23d-4015-9a27-1d7b080b197f tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'cc50117488804645a7da0a3b454a6308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea4e5c4cb5f4451bed3b9e317f9af47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e41ed371-f23d-4015-9a27-1d7b080b197f tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Request method failure captured: Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ6DWoE4iSsIb3RYvumA6WvLm97DxDUBjEVyi7ZLPnch6IVUvaFe_enSvcVUecEnOty6m-qny-Qn25ugRdYI_L085S0nB-QiT6idEf02SZZDp73w78Mgrslw8jcICL5wnuv8Iz8XjErPh_YNxZG7lPclJ8gZEtcTKY7UX1rSjcXgriA Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: dea4e5c4cb5f4451bed3b9e317f9af47 Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:33:12.099597 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:33:12.101058 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:12.101058 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:12.101058 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: dea4e5c4cb5f4451bed3b9e317f9af47 Aug 27 04:33:12.101058 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:12.101058 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-HypervisorAdminNegativeTestJSON-1084620434-project Aug 27 04:33:12.101058 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:33:12.101058 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:33:12.101058 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: cc50117488804645a7da0a3b454a6308 Aug 27 04:33:12.101058 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434-project Aug 27 04:33:12.101058 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:33:12.101058 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 04:33:12.101058 n-d-854823-1 devstack@n-api.service[128870]: action_args: {} Aug 27 04:33:12.101058 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:33:12.102403 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 04:33:12.104035 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:12.106977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e41ed371-f23d-4015-9a27-1d7b080b197f tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:12.108986 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e41ed371-f23d-4015-9a27-1d7b080b197f tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.033854 Aug 27 04:33:12.111729 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 212/413] 10.222.0.79 () {58 vars in 1179 bytes} [Sat Aug 27 04:33:12 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:12.122361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ad7e9f4f-6a4d-45d3-8091-626514f406c2 req-a112dab5-7145-4949-b576-18d52b66f5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b4d765-c03c-44a6-8346-c3bfd70f997b", "name": "network-vif-plugged", "status": "completed", "tag": "5e84d3c2-2f47-4c2a-86e7-1658be29f5c9"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:12.145514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ad7e9f4f-6a4d-45d3-8091-626514f406c2 req-a112dab5-7145-4949-b576-18d52b66f5c5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:12.147980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ad7e9f4f-6a4d-45d3-8091-626514f406c2 req-a112dab5-7145-4949-b576-18d52b66f5c5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:12.150729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ad7e9f4f-6a4d-45d3-8091-626514f406c2 req-a112dab5-7145-4949-b576-18d52b66f5c5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:12.174599 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ad7e9f4f-6a4d-45d3-8091-626514f406c2 req-a112dab5-7145-4949-b576-18d52b66f5c5 service nova] Creating event network-vif-plugged:5e84d3c2-2f47-4c2a-86e7-1658be29f5c9 for instance f5b4d765-c03c-44a6-8346-c3bfd70f997b on n-h1-854823-1 Aug 27 04:33:12.184158 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ad7e9f4f-6a4d-45d3-8091-626514f406c2 req-a112dab5-7145-4949-b576-18d52b66f5c5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070719 Aug 27 04:33:12.185965 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 213/414] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:12.253182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8d7a3f7-9fc8-453f-ae1d-c8003112ae70 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:12.263458 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8d7a3f7-9fc8-453f-ae1d-c8003112ae70 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1468 microversion: 2.1 time: 0.931575 Aug 27 04:33:12.282838 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 202/415] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:11 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1468 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:12.300559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac1eb127-4ab1-4863-9963-be2207f4681a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:12.302560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac1eb127-4ab1-4863-9963-be2207f4681a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:12.323452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac1eb127-4ab1-4863-9963-be2207f4681a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:12.325108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac1eb127-4ab1-4863-9963-be2207f4681a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:12.326966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac1eb127-4ab1-4863-9963-be2207f4681a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:12.331145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac1eb127-4ab1-4863-9963-be2207f4681a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:12.337294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac1eb127-4ab1-4863-9963-be2207f4681a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:12.338152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac1eb127-4ab1-4863-9963-be2207f4681a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:12.707234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f548e803-57a8-41dd-98f6-71a0afc98608 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Calling method '.version_select at 0x7f1f225144c0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:12.709131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f548e803-57a8-41dd-98f6-71a0afc98608 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:12.709626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f548e803-57a8-41dd-98f6-71a0afc98608 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:12.710068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f548e803-57a8-41dd-98f6-71a0afc98608 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:12.744370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f548e803-57a8-41dd-98f6-71a0afc98608 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:12.747327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f548e803-57a8-41dd-98f6-71a0afc98608 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:12.747797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f548e803-57a8-41dd-98f6-71a0afc98608 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:12.768345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f548e803-57a8-41dd-98f6-71a0afc98608 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:12.769005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f548e803-57a8-41dd-98f6-71a0afc98608 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:12.769454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f548e803-57a8-41dd-98f6-71a0afc98608 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:12.777372 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f548e803-57a8-41dd-98f6-71a0afc98608 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.586639 Aug 27 04:33:12.783760 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 214/416] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:33:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:13.039884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac1eb127-4ab1-4863-9963-be2207f4681a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:13.049142 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac1eb127-4ab1-4863-9963-be2207f4681a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1316 microversion: 2.1 time: 0.762341 Aug 27 04:33:13.055633 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 203/417] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:12 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1316 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:13.072938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e72d72b7-0efc-41e1-a46a-29c06a699592 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:13.086984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e72d72b7-0efc-41e1-a46a-29c06a699592 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:13.100382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e72d72b7-0efc-41e1-a46a-29c06a699592 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:13.105271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e72d72b7-0efc-41e1-a46a-29c06a699592 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:13.110750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e72d72b7-0efc-41e1-a46a-29c06a699592 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:13.113195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e72d72b7-0efc-41e1-a46a-29c06a699592 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:13.113859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e72d72b7-0efc-41e1-a46a-29c06a699592 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:13.114462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e72d72b7-0efc-41e1-a46a-29c06a699592 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:13.140888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-407b7bca-12fe-4fcc-98dc-53d79cb89a14 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1613293347", "block_migration": true, "disk_over_commit": false}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:13.144310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-407b7bca-12fe-4fcc-98dc-53d79cb89a14 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:13.152161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-407b7bca-12fe-4fcc-98dc-53d79cb89a14 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:13.154648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-407b7bca-12fe-4fcc-98dc-53d79cb89a14 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:13.155330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-407b7bca-12fe-4fcc-98dc-53d79cb89a14 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:13.156239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-407b7bca-12fe-4fcc-98dc-53d79cb89a14 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:13.160357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-407b7bca-12fe-4fcc-98dc-53d79cb89a14 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:13.161114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-407b7bca-12fe-4fcc-98dc-53d79cb89a14 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:13.357360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e72d72b7-0efc-41e1-a46a-29c06a699592 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:13.383312 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e72d72b7-0efc-41e1-a46a-29c06a699592 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1314 microversion: 2.1 time: 0.323695 Aug 27 04:33:13.383977 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 204/418] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:13 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:13.415919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77cdbdbe-f2e5-4f8b-b76e-060a166e78e3 tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Calling method '.version_select at 0x7f1f22337160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:13.428244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-77cdbdbe-f2e5-4f8b-b76e-060a166e78e3 tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'cc50117488804645a7da0a3b454a6308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea4e5c4cb5f4451bed3b9e317f9af47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77cdbdbe-f2e5-4f8b-b76e-060a166e78e3 tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Request method failure captured: Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ6DWoE4iSsIb3RYvumA6WvLm97DxDUBjEVyi7ZLPnch6IVUvaFe_enSvcVUecEnOty6m-qny-Qn25ugRdYI_L085S0nB-QiT6idEf02SZZDp73w78Mgrslw8jcICL5wnuv8Iz8XjErPh_YNxZG7lPclJ8gZEtcTKY7UX1rSjcXgriA Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: dea4e5c4cb5f4451bed3b9e317f9af47 Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:33:13.435795 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:33:13.437261 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:13.437261 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:13.437261 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: dea4e5c4cb5f4451bed3b9e317f9af47 Aug 27 04:33:13.437261 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:13.437261 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-HypervisorAdminNegativeTestJSON-1084620434-project Aug 27 04:33:13.437261 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:33:13.437261 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:33:13.437261 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cc50117488804645a7da0a3b454a6308 Aug 27 04:33:13.437261 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434-project Aug 27 04:33:13.437261 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:33:13.437261 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 04:33:13.437261 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '1'} Aug 27 04:33:13.437261 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:33:13.438174 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 04:33:13.439378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.445810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77cdbdbe-f2e5-4f8b-b76e-060a166e78e3 tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:13.446921 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77cdbdbe-f2e5-4f8b-b76e-060a166e78e3 tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.055656 Aug 27 04:33:13.447477 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 205/419] 10.222.0.79 () {58 vars in 1173 bytes} [Sat Aug 27 04:33:13 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 63 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:13.474347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c9e43fb-5b77-4b8b-bdb7-5e5cfdc0a31d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:13.477571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c9e43fb-5b77-4b8b-bdb7-5e5cfdc0a31d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:13.503744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9e43fb-5b77-4b8b-bdb7-5e5cfdc0a31d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:13.507510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9e43fb-5b77-4b8b-bdb7-5e5cfdc0a31d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:13.508465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9e43fb-5b77-4b8b-bdb7-5e5cfdc0a31d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:13.509243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9e43fb-5b77-4b8b-bdb7-5e5cfdc0a31d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:13.516033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9e43fb-5b77-4b8b-bdb7-5e5cfdc0a31d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:13.516708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9e43fb-5b77-4b8b-bdb7-5e5cfdc0a31d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:13.554968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-407b7bca-12fe-4fcc-98dc-53d79cb89a14 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lazy-loading 'flavor' on Instance uuid de5d3f95-67da-4f5c-8422-c775bd151f03 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:33:13.698943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-407b7bca-12fe-4fcc-98dc-53d79cb89a14 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Going to try to live migrate instance to tempest-host-1613293347 {{(pid=128870) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:33:13.715703 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-407b7bca-12fe-4fcc-98dc-53d79cb89a14 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] HTTP exception thrown: Compute host tempest-host-1613293347 could not be found. Aug 27 04:33:13.740717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c9e43fb-5b77-4b8b-bdb7-5e5cfdc0a31d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-407b7bca-12fe-4fcc-98dc-53d79cb89a14 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Request method failure captured: Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03/action HTTP/1.1 Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 107 Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5sKyDGbZWS6BOCwjpiHf-hPlC96RG6XYfdeCFT7qDy9yszD-Cgitt2z047mleYHQQcZW_5-CbhH8cVZKSC06zHoM7M9X0axzrUaFJzgqtzXroFQeyVEZ0azmMcp2cmp83I_FHIUw9XZcWUBB3hPkFaYc2nbrhz31vO5HLzgWTNaUg Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 6954aec770e24a278544abddc129d307 Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-LiveMigrationNegativeTest-1468990994 Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:33:13.744500 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:33:13.745984 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6954aec770e24a278544abddc129d307"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6954aec770e24a278544abddc129d307"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6954aec770e24a278544abddc129d307"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6954aec770e24a278544abddc129d307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:13.745984 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-LiveMigrationNegativeTest-1468990994 Aug 27 04:33:13.745984 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 6954aec770e24a278544abddc129d307 Aug 27 04:33:13.745984 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1468990994 Aug 27 04:33:13.745984 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-LiveMigrationNegativeTest-1468990994-project-admin Aug 27 04:33:13.745984 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:33:13.745984 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:33:13.745984 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 05fd00f530cc4680a9390c32b93075c2 Aug 27 04:33:13.745984 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-LiveMigrationNegativeTest-1468990994-project-admin Aug 27 04:33:13.745984 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:33:13.745984 n-d-854823-1 devstack@n-api.service[128870]: {"os-migrateLive": {"host": "tempest-host-1613293347", "block_migration": true, "disk_over_commit": false}} Aug 27 04:33:13.745984 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: exception: Compute host tempest-host-1613293347 could not be found. Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'de5d3f95-67da-4f5c-8422-c775bd151f03', 'body': {'os-migrateLive': {'host': 'tempest-host-1613293347', 'block_migration': True, 'disk_over_commit': False}}} Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:33:13.746793 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1613293347 could not be found. Aug 27 04:33:13.747898 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1613293347 could not be found. Aug 27 04:33:13.749151 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.752145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:13.752145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.752145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:13.752145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:13.752145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:13.752145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:33:13.752145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:33:13.752145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1613293347 could not be found. Aug 27 04:33:13.752145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.754960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-407b7bca-12fe-4fcc-98dc-53d79cb89a14 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Returning 400 to user: Compute host tempest-host-1613293347 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:13.756103 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-407b7bca-12fe-4fcc-98dc-53d79cb89a14 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03/action" status: 400 len: 100 microversion: 2.1 time: 0.970342 Aug 27 04:33:13.757222 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 215/420] 10.222.0.79 () {60 vars in 1279 bytes} [Sat Aug 27 04:33:12 2022] POST /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03/action => generated 100 bytes in 972 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:33:13.761824 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c9e43fb-5b77-4b8b-bdb7-5e5cfdc0a31d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1270 microversion: 2.1 time: 0.308834 Aug 27 04:33:13.764173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-07611f60-ab84-4f80-83b8-b1245979c6ee req-69ae8546-e4ee-4bd7-baaa-727d79418384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "000044d0-884d-4e30-a18d-5f4ebc4ba4ff", "name": "network-vif-deleted", "tag": "eb3052de-ef9e-4e1d-9fe3-29285823219d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:13.764914 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 206/421] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:13 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1270 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:13.793649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-07611f60-ab84-4f80-83b8-b1245979c6ee req-69ae8546-e4ee-4bd7-baaa-727d79418384 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:13.795023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-07611f60-ab84-4f80-83b8-b1245979c6ee req-69ae8546-e4ee-4bd7-baaa-727d79418384 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:13.797986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-07611f60-ab84-4f80-83b8-b1245979c6ee req-69ae8546-e4ee-4bd7-baaa-727d79418384 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:13.798139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb504770-cab4-4d6b-ac37-e3b09d129b46 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Calling method '.version_select at 0x7f1f223b95e0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:13.801144 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-cb504770-cab4-4d6b-ac37-e3b09d129b46 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] HTTP exception thrown: Hypervisor with ID '1d52ea47-8b97-4d5d-a2fd-bb9beaf3d99b' could not be found. Aug 27 04:33:13.830058 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-07611f60-ab84-4f80-83b8-b1245979c6ee req-69ae8546-e4ee-4bd7-baaa-727d79418384 service nova] Creating event network-vif-deleted:eb3052de-ef9e-4e1d-9fe3-29285823219d for instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff on n-h2-854823-1 Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb504770-cab4-4d6b-ac37-e3b09d129b46 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Request method failure captured: Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hypervisors/1d52ea47-8b97-4d5d-a2fd-bb9beaf3d99b/uptime HTTP/1.1 Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ6EbECnqrEIje-84pYRwQn7aTKaEllnGDC3HQEre5jnUZ1WfWCdFptGieydP1uq6saVJiMK7lqLr9IssA2JpERZG_ttGMdeSB2xMd4hGbyupt19pSIj519UkkzhuL04-vP6FCiyB3gcA1Sn5ADaneUUxvgRNgD4QuA-UlTDMPZ22UA Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: e3b3f624c78c49df89e213508a587766 Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1406170871 Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:33:13.830962 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:33:13.832236 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e3b3f624c78c49df89e213508a587766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e3b3f624c78c49df89e213508a587766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e3b3f624c78c49df89e213508a587766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e3b3f624c78c49df89e213508a587766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:13.832236 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1406170871 Aug 27 04:33:13.832236 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: e3b3f624c78c49df89e213508a587766 Aug 27 04:33:13.832236 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1406170871 Aug 27 04:33:13.832236 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin Aug 27 04:33:13.832236 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:33:13.832236 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:33:13.832236 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 80a64048bf204731b0f7712e56d913d4 Aug 27 04:33:13.832236 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin Aug 27 04:33:13.832236 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:33:13.832236 n-d-854823-1 devstack@n-api.service[128869]: exception: Hypervisor with ID '1d52ea47-8b97-4d5d-a2fd-bb9beaf3d99b' could not be found. Aug 27 04:33:13.832236 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '1d52ea47-8b97-4d5d-a2fd-bb9beaf3d99b'} Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '1d52ea47-8b97-4d5d-a2fd-bb9beaf3d99b' Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 27 04:33:13.832956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '1d52ea47-8b97-4d5d-a2fd-bb9beaf3d99b' could not be found. Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:13.834150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.835342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:13.835342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:13.835342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:13.835342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:33:13.835342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:33:13.835342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '1d52ea47-8b97-4d5d-a2fd-bb9beaf3d99b' could not be found. Aug 27 04:33:13.835342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:13.839117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb504770-cab4-4d6b-ac37-e3b09d129b46 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Returning 404 to user: Hypervisor with ID '1d52ea47-8b97-4d5d-a2fd-bb9beaf3d99b' could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:13.840205 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cb504770-cab4-4d6b-ac37-e3b09d129b46 tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1d52ea47-8b97-4d5d-a2fd-bb9beaf3d99b/uptime" status: 404 len: 123 microversion: 2.1 time: 0.073072 Aug 27 04:33:13.842838 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 207/422] 10.222.0.79 () {58 vars in 1278 bytes} [Sat Aug 27 04:33:13 2022] GET /compute/v2.1/os-hypervisors/1d52ea47-8b97-4d5d-a2fd-bb9beaf3d99b/uptime => generated 123 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:13.856770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1ca5bff-09b9-4062-9473-909bb7b17376 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:13.859663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1ca5bff-09b9-4062-9473-909bb7b17376 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:13.866120 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-07611f60-ab84-4f80-83b8-b1245979c6ee req-69ae8546-e4ee-4bd7-baaa-727d79418384 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107256 Aug 27 04:33:13.869174 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 216/423] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:13.890681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-91da56fa-bc3d-41e9-96d6-6054e002e0be tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Calling method '.version_select at 0x7f1f224c4f70>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:13.901999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91da56fa-bc3d-41e9-96d6-6054e002e0be tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:13.904957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1ca5bff-09b9-4062-9473-909bb7b17376 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:13.905533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91da56fa-bc3d-41e9-96d6-6054e002e0be tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:13.906104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91da56fa-bc3d-41e9-96d6-6054e002e0be tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:13.913803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:13.921596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1ca5bff-09b9-4062-9473-909bb7b17376 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:13.930395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1ca5bff-09b9-4062-9473-909bb7b17376 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:13.931231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1ca5bff-09b9-4062-9473-909bb7b17376 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:13.931717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1ca5bff-09b9-4062-9473-909bb7b17376 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:13.932159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1ca5bff-09b9-4062-9473-909bb7b17376 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:13.967293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91da56fa-bc3d-41e9-96d6-6054e002e0be tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:13.977223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91da56fa-bc3d-41e9-96d6-6054e002e0be tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:13.978102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91da56fa-bc3d-41e9-96d6-6054e002e0be tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:14.021757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91da56fa-bc3d-41e9-96d6-6054e002e0be tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:14.024737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91da56fa-bc3d-41e9-96d6-6054e002e0be tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:14.026658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91da56fa-bc3d-41e9-96d6-6054e002e0be tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:14.045913 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-91da56fa-bc3d-41e9-96d6-6054e002e0be tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.172331 Aug 27 04:33:14.057306 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 217/424] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:33:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:14.074501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-20f5e1fa-a950-4266-bc65-3e37c693f7ce tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Calling method '.version_select at 0x7f1f224c45e0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:14.078270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-20f5e1fa-a950-4266-bc65-3e37c693f7ce tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'cc50117488804645a7da0a3b454a6308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea4e5c4cb5f4451bed3b9e317f9af47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-20f5e1fa-a950-4266-bc65-3e37c693f7ce tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Request method failure captured: Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ6DWoE4iSsIb3RYvumA6WvLm97DxDUBjEVyi7ZLPnch6IVUvaFe_enSvcVUecEnOty6m-qny-Qn25ugRdYI_L085S0nB-QiT6idEf02SZZDp73w78Mgrslw8jcICL5wnuv8Iz8XjErPh_YNxZG7lPclJ8gZEtcTKY7UX1rSjcXgriA Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: dea4e5c4cb5f4451bed3b9e317f9af47 Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:33:14.088612 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:33:14.089846 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dea4e5c4cb5f4451bed3b9e317f9af47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:14.089846 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:14.089846 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: dea4e5c4cb5f4451bed3b9e317f9af47 Aug 27 04:33:14.089846 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434 Aug 27 04:33:14.089846 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-HypervisorAdminNegativeTestJSON-1084620434-project Aug 27 04:33:14.089846 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:33:14.089846 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:33:14.089846 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: cc50117488804645a7da0a3b454a6308 Aug 27 04:33:14.089846 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1084620434-project Aug 27 04:33:14.089846 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:33:14.089846 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 04:33:14.089846 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '1'} Aug 27 04:33:14.089846 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:33:14.090596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 04:33:14.091640 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:14.095723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-20f5e1fa-a950-4266-bc65-3e37c693f7ce tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:14.097912 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-20f5e1fa-a950-4266-bc65-3e37c693f7ce tempest-HypervisorAdminNegativeTestJSON-1084620434 tempest-HypervisorAdminNegativeTestJSON-1084620434-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.034633 Aug 27 04:33:14.101992 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 218/425] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:33:14 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:14.116770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-81a699ab-58b0-4c31-ad20-2fe2c02a54bd tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:14.127551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-81a699ab-58b0-4c31-ad20-2fe2c02a54bd tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:14.149269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81a699ab-58b0-4c31-ad20-2fe2c02a54bd tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:14.159690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81a699ab-58b0-4c31-ad20-2fe2c02a54bd tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:14.160493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81a699ab-58b0-4c31-ad20-2fe2c02a54bd tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:14.161499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81a699ab-58b0-4c31-ad20-2fe2c02a54bd tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:14.162161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81a699ab-58b0-4c31-ad20-2fe2c02a54bd tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:14.162983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81a699ab-58b0-4c31-ad20-2fe2c02a54bd tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:14.462967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1ca5bff-09b9-4062-9473-909bb7b17376 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:14.483620 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1ca5bff-09b9-4062-9473-909bb7b17376 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1468 microversion: 2.1 time: 0.639682 Aug 27 04:33:14.485322 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 208/426] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:13 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1468 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:14.490479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95ec78d5-bb2c-4dd3-9380-f4c051b8334a tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Calling method '.version_select at 0x7f1f222cf9d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:14.497776 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-95ec78d5-bb2c-4dd3-9380-f4c051b8334a tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] HTTP exception thrown: Hypervisor with ID 'd42b07c7-1b68-44f2-ac8e-2a1c4d9fc170' could not be found. Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95ec78d5-bb2c-4dd3-9380-f4c051b8334a tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Request method failure captured: Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hypervisors/d42b07c7-1b68-44f2-ac8e-2a1c4d9fc170 HTTP/1.1 Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ6EbECnqrEIje-84pYRwQn7aTKaEllnGDC3HQEre5jnUZ1WfWCdFptGieydP1uq6saVJiMK7lqLr9IssA2JpERZG_ttGMdeSB2xMd4hGbyupt19pSIj519UkkzhuL04-vP6FCiyB3gcA1Sn5ADaneUUxvgRNgD4QuA-UlTDMPZ22UA Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: e3b3f624c78c49df89e213508a587766 Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1406170871 Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:33:14.503542 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:33:14.504840 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e3b3f624c78c49df89e213508a587766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e3b3f624c78c49df89e213508a587766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e3b3f624c78c49df89e213508a587766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e3b3f624c78c49df89e213508a587766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:14.504840 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1406170871 Aug 27 04:33:14.504840 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: e3b3f624c78c49df89e213508a587766 Aug 27 04:33:14.504840 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1406170871 Aug 27 04:33:14.504840 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin Aug 27 04:33:14.504840 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:33:14.504840 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:33:14.504840 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 80a64048bf204731b0f7712e56d913d4 Aug 27 04:33:14.504840 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin Aug 27 04:33:14.504840 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:33:14.504840 n-d-854823-1 devstack@n-api.service[128869]: exception: Hypervisor with ID 'd42b07c7-1b68-44f2-ac8e-2a1c4d9fc170' could not be found. Aug 27 04:33:14.504840 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'd42b07c7-1b68-44f2-ac8e-2a1c4d9fc170'} Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'd42b07c7-1b68-44f2-ac8e-2a1c4d9fc170' Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 27 04:33:14.505626 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:33:14.507137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'd42b07c7-1b68-44f2-ac8e-2a1c4d9fc170' could not be found. Aug 27 04:33:14.509088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:14.509088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:14.509088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:14.509088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:14.509088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:14.509088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:14.509088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:33:14.509088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:33:14.509088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'd42b07c7-1b68-44f2-ac8e-2a1c4d9fc170' could not be found. Aug 27 04:33:14.509088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:14.521483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95ec78d5-bb2c-4dd3-9380-f4c051b8334a tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] Returning 404 to user: Hypervisor with ID 'd42b07c7-1b68-44f2-ac8e-2a1c4d9fc170' could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:14.524863 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95ec78d5-bb2c-4dd3-9380-f4c051b8334a tempest-HypervisorAdminNegativeTestJSON-1406170871 tempest-HypervisorAdminNegativeTestJSON-1406170871-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/d42b07c7-1b68-44f2-ac8e-2a1c4d9fc170" status: 404 len: 123 microversion: 2.1 time: 0.038050 Aug 27 04:33:14.526970 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 209/427] 10.222.0.79 () {58 vars in 1257 bytes} [Sat Aug 27 04:33:14 2022] GET /compute/v2.1/os-hypervisors/d42b07c7-1b68-44f2-ac8e-2a1c4d9fc170 => generated 123 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:14.539250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50600a2b-164f-4a85-b257-bcdfe45a57b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:14.544499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50600a2b-164f-4a85-b257-bcdfe45a57b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:14.576761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50600a2b-164f-4a85-b257-bcdfe45a57b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:14.577922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50600a2b-164f-4a85-b257-bcdfe45a57b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:14.579292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50600a2b-164f-4a85-b257-bcdfe45a57b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:14.584311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50600a2b-164f-4a85-b257-bcdfe45a57b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:14.589028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50600a2b-164f-4a85-b257-bcdfe45a57b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:14.591011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50600a2b-164f-4a85-b257-bcdfe45a57b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:14.782057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50600a2b-164f-4a85-b257-bcdfe45a57b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:14.794412 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50600a2b-164f-4a85-b257-bcdfe45a57b9 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1320 microversion: 2.1 time: 0.263866 Aug 27 04:33:14.795010 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 210/428] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:14 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:14.824908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba504493-ce2f-4c19-ad7e-3a5ecc5745d4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:14.835683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba504493-ce2f-4c19-ad7e-3a5ecc5745d4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:14.856814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba504493-ce2f-4c19-ad7e-3a5ecc5745d4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:14.859685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba504493-ce2f-4c19-ad7e-3a5ecc5745d4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:14.862803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba504493-ce2f-4c19-ad7e-3a5ecc5745d4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:14.865979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba504493-ce2f-4c19-ad7e-3a5ecc5745d4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:14.869606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba504493-ce2f-4c19-ad7e-3a5ecc5745d4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:14.870644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba504493-ce2f-4c19-ad7e-3a5ecc5745d4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:14.873347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-81a699ab-58b0-4c31-ad20-2fe2c02a54bd tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:14.884697 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-81a699ab-58b0-4c31-ad20-2fe2c02a54bd tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1316 microversion: 2.1 time: 0.775756 Aug 27 04:33:14.902038 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 219/429] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:14 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1316 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:14.906812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-573199086", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:15.067451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:33:15.207581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba504493-ce2f-4c19-ad7e-3a5ecc5745d4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:15.215364 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba504493-ce2f-4c19-ad7e-3a5ecc5745d4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1270 microversion: 2.1 time: 0.399110 Aug 27 04:33:15.216011 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 211/430] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:14 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1270 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:15.815541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff7004e5-c675-4cdd-b667-5e8c516ede8f tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:15.816246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ff7004e5-c675-4cdd-b667-5e8c516ede8f tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:15.830863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff7004e5-c675-4cdd-b667-5e8c516ede8f tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:15.834352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff7004e5-c675-4cdd-b667-5e8c516ede8f tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:15.840583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff7004e5-c675-4cdd-b667-5e8c516ede8f tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:15.842589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff7004e5-c675-4cdd-b667-5e8c516ede8f tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:15.846177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff7004e5-c675-4cdd-b667-5e8c516ede8f tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:15.854944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff7004e5-c675-4cdd-b667-5e8c516ede8f tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:16.208492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ff7004e5-c675-4cdd-b667-5e8c516ede8f tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:16.227322 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff7004e5-c675-4cdd-b667-5e8c516ede8f tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1388 microversion: 2.1 time: 0.414874 Aug 27 04:33:16.228029 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 212/431] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:15 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1388 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:16.247058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b34636e5-7e3a-41ed-a857-8e7d64544b84 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:16.250397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b34636e5-7e3a-41ed-a857-8e7d64544b84 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:16.268208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b34636e5-7e3a-41ed-a857-8e7d64544b84 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:16.280841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b34636e5-7e3a-41ed-a857-8e7d64544b84 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:16.281765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b34636e5-7e3a-41ed-a857-8e7d64544b84 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:16.282935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b34636e5-7e3a-41ed-a857-8e7d64544b84 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:16.284407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b34636e5-7e3a-41ed-a857-8e7d64544b84 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:16.285780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b34636e5-7e3a-41ed-a857-8e7d64544b84 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:16.740257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b34636e5-7e3a-41ed-a857-8e7d64544b84 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:16.750803 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b34636e5-7e3a-41ed-a857-8e7d64544b84 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1464 microversion: 2.1 time: 0.521246 Aug 27 04:33:16.753132 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 213/432] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:16 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1464 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:16.755379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:33:16.755858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:33:16.756373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:33:16.756814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:33:16.757229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:33:16.765526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2621d274-be3a-4fe8-ac5c-56a252e09fde tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:16.767186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2621d274-be3a-4fe8-ac5c-56a252e09fde tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:16.782474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2621d274-be3a-4fe8-ac5c-56a252e09fde tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:16.783192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2621d274-be3a-4fe8-ac5c-56a252e09fde tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:16.783964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2621d274-be3a-4fe8-ac5c-56a252e09fde tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:16.785060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2621d274-be3a-4fe8-ac5c-56a252e09fde tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:16.785786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2621d274-be3a-4fe8-ac5c-56a252e09fde tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:16.786487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2621d274-be3a-4fe8-ac5c-56a252e09fde tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:16.790862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:16.794030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:16.796785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:16.801664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:16.803407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:16.803866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:16.849323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Getting quotas for project 73540a547efa4eccb535f6e38d60f67a. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:16.857038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Getting quotas for user f60c624cc43945ea9de2731f0c93156c and project 73540a547efa4eccb535f6e38d60f67a. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:16.937714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:33:16.943627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:33:17.045533 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-03d39f2a-cf99-45b3-8f24-6767d90526dc tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.142384 Aug 27 04:33:17.046183 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 220/433] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:33:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:33:17.339939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2621d274-be3a-4fe8-ac5c-56a252e09fde tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:17.358339 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2621d274-be3a-4fe8-ac5c-56a252e09fde tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1312 microversion: 2.1 time: 0.601692 Aug 27 04:33:17.361744 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 214/434] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:16 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1312 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:17.380808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba10a04c-0b39-492f-a156-8bc39b7e2ace tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:17.383538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba10a04c-0b39-492f-a156-8bc39b7e2ace tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:17.511332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba10a04c-0b39-492f-a156-8bc39b7e2ace tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:17.519526 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba10a04c-0b39-492f-a156-8bc39b7e2ace tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1218 microversion: 2.1 time: 0.155259 Aug 27 04:33:17.526831 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 215/435] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:17 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:17.537170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c850c89f-07cb-473b-828f-2f95bb198bf3 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:17.549445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c850c89f-07cb-473b-828f-2f95bb198bf3 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:17.564084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c850c89f-07cb-473b-828f-2f95bb198bf3 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:17.564607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c850c89f-07cb-473b-828f-2f95bb198bf3 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:17.565044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c850c89f-07cb-473b-828f-2f95bb198bf3 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:17.565755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c850c89f-07cb-473b-828f-2f95bb198bf3 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:17.566209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c850c89f-07cb-473b-828f-2f95bb198bf3 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:17.566632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c850c89f-07cb-473b-828f-2f95bb198bf3 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:17.664090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-48f25078-ebbd-4d1b-bd7e-1ffb0b3764b2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:17.664913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-48f25078-ebbd-4d1b-bd7e-1ffb0b3764b2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:17.692814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48f25078-ebbd-4d1b-bd7e-1ffb0b3764b2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:17.701922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48f25078-ebbd-4d1b-bd7e-1ffb0b3764b2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:17.705236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48f25078-ebbd-4d1b-bd7e-1ffb0b3764b2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:17.713593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48f25078-ebbd-4d1b-bd7e-1ffb0b3764b2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:17.714407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48f25078-ebbd-4d1b-bd7e-1ffb0b3764b2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:17.721439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48f25078-ebbd-4d1b-bd7e-1ffb0b3764b2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:17.815560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c850c89f-07cb-473b-828f-2f95bb198bf3 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:17.834069 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c850c89f-07cb-473b-828f-2f95bb198bf3 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1388 microversion: 2.1 time: 0.303251 Aug 27 04:33:17.835122 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 216/436] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:17 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1388 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:18.381723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40e2aa10-c104-4e6b-b654-748d9911957f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:18.383076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40e2aa10-c104-4e6b-b654-748d9911957f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:18.390091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40e2aa10-c104-4e6b-b654-748d9911957f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:18.397279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40e2aa10-c104-4e6b-b654-748d9911957f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:18.401127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40e2aa10-c104-4e6b-b654-748d9911957f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:18.402152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40e2aa10-c104-4e6b-b654-748d9911957f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:18.402844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40e2aa10-c104-4e6b-b654-748d9911957f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:18.403552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40e2aa10-c104-4e6b-b654-748d9911957f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:18.901195 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-48f25078-ebbd-4d1b-bd7e-1ffb0b3764b2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1615 microversion: 2.1 time: 1.853744 Aug 27 04:33:18.903281 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 221/437] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:17 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1615 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:18.934002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4b3edfbc-f1d7-49cf-bdfe-a180511cdf78 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:18.937686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4b3edfbc-f1d7-49cf-bdfe-a180511cdf78 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:18.953995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b3edfbc-f1d7-49cf-bdfe-a180511cdf78 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:18.954905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b3edfbc-f1d7-49cf-bdfe-a180511cdf78 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:18.955361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b3edfbc-f1d7-49cf-bdfe-a180511cdf78 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:18.963742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b3edfbc-f1d7-49cf-bdfe-a180511cdf78 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:18.964241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b3edfbc-f1d7-49cf-bdfe-a180511cdf78 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:18.964702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b3edfbc-f1d7-49cf-bdfe-a180511cdf78 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:19.349111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40e2aa10-c104-4e6b-b654-748d9911957f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:19.363006 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40e2aa10-c104-4e6b-b654-748d9911957f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1312 microversion: 2.1 time: 0.985846 Aug 27 04:33:19.364974 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 217/438] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:18 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1312 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:19.374933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b63283ce-93fd-43f1-b938-636f07fef005 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:19.377545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b63283ce-93fd-43f1-b938-636f07fef005 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:19.388131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b63283ce-93fd-43f1-b938-636f07fef005 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:19.395902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b63283ce-93fd-43f1-b938-636f07fef005 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:19.397408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b63283ce-93fd-43f1-b938-636f07fef005 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:19.398808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b63283ce-93fd-43f1-b938-636f07fef005 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:19.399535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b63283ce-93fd-43f1-b938-636f07fef005 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:19.400342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b63283ce-93fd-43f1-b938-636f07fef005 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:19.439704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4b3edfbc-f1d7-49cf-bdfe-a180511cdf78 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:19.456093 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4b3edfbc-f1d7-49cf-bdfe-a180511cdf78 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1270 microversion: 2.1 time: 0.550293 Aug 27 04:33:19.459064 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 222/439] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:18 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1270 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:19.475356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f8b588d0-acf9-455c-b118-9fdbe388c305 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Action: 'create', calling method: .version_select at 0x7f1f223b63a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-437562441", "policies": ["affinity"]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:19.534515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-f8b588d0-acf9-455c-b118-9fdbe388c305 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:19.539489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:19.546086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-f8b588d0-acf9-455c-b118-9fdbe388c305 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:19.672821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-f8b588d0-acf9-455c-b118-9fdbe388c305 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:19.684511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-f8b588d0-acf9-455c-b118-9fdbe388c305 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:19.705280 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f8b588d0-acf9-455c-b118-9fdbe388c305 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.244800 Aug 27 04:33:19.713532 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 223/440] 10.222.0.79 () {60 vars in 1174 bytes} [Sat Aug 27 04:33:19 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:19.720040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a21b0c49-d4e2-43fe-95a6-bf7ca6e75046 req-7564699a-5a41-4660-8360-b44561b9c7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c316d2a9-3517-44df-8382-8e40ae8d3b1b", "tag": "19550fed-7930-476b-a65b-28ccbc745f07"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:19.746350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a21b0c49-d4e2-43fe-95a6-bf7ca6e75046 req-7564699a-5a41-4660-8360-b44561b9c7b6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:19.751838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a21b0c49-d4e2-43fe-95a6-bf7ca6e75046 req-7564699a-5a41-4660-8360-b44561b9c7b6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:19.752471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a21b0c49-d4e2-43fe-95a6-bf7ca6e75046 req-7564699a-5a41-4660-8360-b44561b9c7b6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:19.773890 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a21b0c49-d4e2-43fe-95a6-bf7ca6e75046 req-7564699a-5a41-4660-8360-b44561b9c7b6 service nova] Creating event network-changed:19550fed-7930-476b-a65b-28ccbc745f07 for instance c316d2a9-3517-44df-8382-8e40ae8d3b1b on n-h1-854823-1 Aug 27 04:33:19.785183 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a21b0c49-d4e2-43fe-95a6-bf7ca6e75046 req-7564699a-5a41-4660-8360-b44561b9c7b6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068802 Aug 27 04:33:19.789972 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 224/441] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:19.854703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b63283ce-93fd-43f1-b938-636f07fef005 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:19.871485 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b63283ce-93fd-43f1-b938-636f07fef005 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1388 microversion: 2.1 time: 0.502988 Aug 27 04:33:19.872106 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 218/442] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:19 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1388 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:19.982093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1849511013", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d75f5344-ce42-41f1-ac8c-29ac8338dd84"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:20.116425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:33:20.448615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:20.652994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9cefa161-2310-4b83-97c6-0e6ed916f37d tempest-QuotaClassesAdmin257Test-2113529208 tempest-QuotaClassesAdmin257Test-2113529208-project-admin] Calling method '.version_select at 0x7f1f22346040>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:20.698658 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9cefa161-2310-4b83-97c6-0e6ed916f37d tempest-QuotaClassesAdmin257Test-2113529208 tempest-QuotaClassesAdmin257Test-2113529208-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.903500 Aug 27 04:33:20.700762 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 225/443] 10.222.0.79 () {60 vars in 1226 bytes} [Sat Aug 27 04:33:19 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:20.723511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7afb11c1-c881-4d12-8934-c373e4d103f7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:20.727711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7afb11c1-c881-4d12-8934-c373e4d103f7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:20.756486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7afb11c1-c881-4d12-8934-c373e4d103f7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:20.761225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7afb11c1-c881-4d12-8934-c373e4d103f7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:20.762319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7afb11c1-c881-4d12-8934-c373e4d103f7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:20.764131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7afb11c1-c881-4d12-8934-c373e4d103f7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:20.766298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7afb11c1-c881-4d12-8934-c373e4d103f7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:20.769177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7afb11c1-c881-4d12-8934-c373e4d103f7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:20.934094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:33:20.935118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:33:20.935786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:33:20.936386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:33:20.937094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:33:21.021186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:21.031889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:21.035391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:21.038071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:21.045121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:21.046132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:21.118271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:21.128818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:21.152707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Going to run 2 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:33:21.157684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7afb11c1-c881-4d12-8934-c373e4d103f7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:21.158669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 20337dd0-bb88-4f11-85be-ec44de54c9da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:33:21.168501 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7afb11c1-c881-4d12-8934-c373e4d103f7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1312 microversion: 2.1 time: 0.463741 Aug 27 04:33:21.169526 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 226/444] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:20 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1312 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:21.174299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-065018c3-e93f-48eb-afef-eea2f417ebd4 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:21.175420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-065018c3-e93f-48eb-afef-eea2f417ebd4 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:21.185979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-065018c3-e93f-48eb-afef-eea2f417ebd4 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:21.187397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-065018c3-e93f-48eb-afef-eea2f417ebd4 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:21.188082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-065018c3-e93f-48eb-afef-eea2f417ebd4 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:21.189599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-065018c3-e93f-48eb-afef-eea2f417ebd4 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:21.190732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-065018c3-e93f-48eb-afef-eea2f417ebd4 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:21.191695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-065018c3-e93f-48eb-afef-eea2f417ebd4 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:21.207602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128869) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 27 04:33:21.250956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:21.257294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:21.268799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:21.328986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:21.341324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:21.369846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=20337dd0-bb88-4f11-85be-ec44de54c9da,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:33:21.433592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-065018c3-e93f-48eb-afef-eea2f417ebd4 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:21.433858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:21.440128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:21.442959 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-065018c3-e93f-48eb-afef-eea2f417ebd4 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1318 microversion: 2.1 time: 0.272315 Aug 27 04:33:21.453335 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 227/445] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:21 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:21.464876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1118199c-634b-4ff8-b831-f9e0e05f117a tempest-QuotaClassesAdmin257Test-2113529208 tempest-QuotaClassesAdmin257Test-2113529208-project-admin] Action: 'update', calling method: .version_select at 0x7f1f222dc940>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:21.487802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:21.499581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:21.573898 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59d19dd4-0d70-458e-877f-f2a87c44c394 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.602005 Aug 27 04:33:21.578055 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 219/446] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:33:19 2022] POST /compute/v2.1/servers => generated 32 bytes in 1607 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 04:33:21.582971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42f925f7-b33d-44a7-9d5e-c0eee9e9af0b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:21.584748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-42f925f7-b33d-44a7-9d5e-c0eee9e9af0b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:21.593564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42f925f7-b33d-44a7-9d5e-c0eee9e9af0b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:21.594386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42f925f7-b33d-44a7-9d5e-c0eee9e9af0b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:21.595130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42f925f7-b33d-44a7-9d5e-c0eee9e9af0b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:21.596059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42f925f7-b33d-44a7-9d5e-c0eee9e9af0b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:21.596831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42f925f7-b33d-44a7-9d5e-c0eee9e9af0b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:21.597455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42f925f7-b33d-44a7-9d5e-c0eee9e9af0b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:21.801539 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1118199c-634b-4ff8-b831-f9e0e05f117a tempest-QuotaClassesAdmin257Test-2113529208 tempest-QuotaClassesAdmin257Test-2113529208-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.346746 Aug 27 04:33:21.802970 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 228/447] 10.222.0.79 () {62 vars in 1247 bytes} [Sat Aug 27 04:33:21 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:21.849176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-42f925f7-b33d-44a7-9d5e-c0eee9e9af0b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:21.867693 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42f925f7-b33d-44a7-9d5e-c0eee9e9af0b tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1388 microversion: 2.1 time: 0.288233 Aug 27 04:33:21.881413 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 220/448] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:21 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1388 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:21.881413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec845462-178d-4c9d-8b36-3234b0914eb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:21.881413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec845462-178d-4c9d-8b36-3234b0914eb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:21.881413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec845462-178d-4c9d-8b36-3234b0914eb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Searching by: {'deleted': False, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:33:21.899202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec845462-178d-4c9d-8b36-3234b0914eb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:21.899764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec845462-178d-4c9d-8b36-3234b0914eb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:21.900275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec845462-178d-4c9d-8b36-3234b0914eb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:21.901286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec845462-178d-4c9d-8b36-3234b0914eb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:21.901929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec845462-178d-4c9d-8b36-3234b0914eb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:21.902597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec845462-178d-4c9d-8b36-3234b0914eb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:22.036174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-ec845462-178d-4c9d-8b36-3234b0914eb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:33:22.205584 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec845462-178d-4c9d-8b36-3234b0914eb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.335996 Aug 27 04:33:22.213757 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 221/449] 10.222.0.79 () {58 vars in 1125 bytes} [Sat Aug 27 04:33:21 2022] GET /compute/v2.1/servers => generated 1003 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:22.213757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c66d154d-5651-427e-a324-b0d9a9305a67 tempest-QuotaClassesAdmin257Test-2113529208 tempest-QuotaClassesAdmin257Test-2113529208-project-admin] Calling method '.version_select at 0x7f1f221d73a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:22.227833 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c66d154d-5651-427e-a324-b0d9a9305a67 tempest-QuotaClassesAdmin257Test-2113529208 tempest-QuotaClassesAdmin257Test-2113529208-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.019884 Aug 27 04:33:22.228976 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 222/450] 10.222.0.79 () {60 vars in 1226 bytes} [Sat Aug 27 04:33:22 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:22.234481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-917feaa0-2d19-4467-a2ea-a968633e8e0b req-66c14f8c-f329-496d-96d7-196705fa7974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c4690c-4559-494b-bf63-6df014ff0adf", "tag": "9378765a-d6e8-453c-a8f8-c6d12fd79dfa"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:22.244077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a2e15b9a-4235-444c-9647-609ef18ba72c tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654 tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:22.245987 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-a2e15b9a-4235-444c-9647-609ef18ba72c tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654 tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 27 04:33:22.247022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-917feaa0-2d19-4467-a2ea-a968633e8e0b req-66c14f8c-f329-496d-96d7-196705fa7974 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:22.248184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-917feaa0-2d19-4467-a2ea-a968633e8e0b req-66c14f8c-f329-496d-96d7-196705fa7974 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:22.248853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-917feaa0-2d19-4467-a2ea-a968633e8e0b req-66c14f8c-f329-496d-96d7-196705fa7974 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a2e15b9a-4235-444c-9647-609ef18ba72c tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654 tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654-project-admin] Request method failure captured: Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ6QKsbmyPgjyukez0aJv2bTQqP9575fgQrYKWtGadHLFqtXbdMPSB-yD3NNex1B9H4PePYm3A8h8kVb9OxrVTozcLZfyFgK0o_esJybdporLi1f_f1jo2bm-tPovSae80fmO1qqZWcqk6hpzMdeU6zVinFuJ-Uiv9uPM456wGlwReE Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 17d4f8b864ef40efa88b435fbbb712df Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654 Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:33:22.262087 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:33:22.263866 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/17d4f8b864ef40efa88b435fbbb712df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_17d4f8b864ef40efa88b435fbbb712df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/17d4f8b864ef40efa88b435fbbb712df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/17d4f8b864ef40efa88b435fbbb712df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:22.263866 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654 Aug 27 04:33:22.263866 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 17d4f8b864ef40efa88b435fbbb712df Aug 27 04:33:22.263866 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654 Aug 27 04:33:22.263866 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654-project-admin Aug 27 04:33:22.263866 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:33:22.263866 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:33:22.263866 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 99a7d0c8f5db43dc994d63227897ad2b Aug 27 04:33:22.263866 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654-project-admin Aug 27 04:33:22.263866 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:33:22.263866 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid timestamp for date invalid_time Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'invalid_time'} Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:22.264768 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a2e15b9a-4235-444c-9647-609ef18ba72c tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654 tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:22.271521 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a2e15b9a-4235-444c-9647-609ef18ba72c tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654 tempest-InstanceUsageAuditLogNegativeTestJSON-1726578654-project-admin] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.459979 Aug 27 04:33:22.274195 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 229/451] 10.222.0.79 () {58 vars in 1224 bytes} [Sat Aug 27 04:33:21 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 462 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:33:22.274472 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-917feaa0-2d19-4467-a2ea-a968633e8e0b req-66c14f8c-f329-496d-96d7-196705fa7974 service nova] Creating event network-changed:9378765a-d6e8-453c-a8f8-c6d12fd79dfa for instance 64c4690c-4559-494b-bf63-6df014ff0adf on n-h2-854823-1 Aug 27 04:33:22.276182 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-917feaa0-2d19-4467-a2ea-a968633e8e0b req-66c14f8c-f329-496d-96d7-196705fa7974 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044393 Aug 27 04:33:22.278852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0a5cf789-2ca8-4bdb-bf35-0d33765bfe74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:22.279201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0a5cf789-2ca8-4bdb-bf35-0d33765bfe74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:22.279920 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 223/452] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:22.285218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4fbe0e3c-765f-415d-835f-e80da8b97aa0 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:22.286144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4fbe0e3c-765f-415d-835f-e80da8b97aa0 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:22.301774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a5cf789-2ca8-4bdb-bf35-0d33765bfe74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:22.302287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a5cf789-2ca8-4bdb-bf35-0d33765bfe74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:22.309276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a5cf789-2ca8-4bdb-bf35-0d33765bfe74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:22.310026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a5cf789-2ca8-4bdb-bf35-0d33765bfe74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:22.310523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a5cf789-2ca8-4bdb-bf35-0d33765bfe74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:22.310960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a5cf789-2ca8-4bdb-bf35-0d33765bfe74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:22.413256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4fbe0e3c-765f-415d-835f-e80da8b97aa0 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:22.425827 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4fbe0e3c-765f-415d-835f-e80da8b97aa0 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 200 len: 1219 microversion: 2.1 time: 0.144573 Aug 27 04:33:22.428863 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 224/453] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:22 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:22.438868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28246692-1226-4d8e-86f5-6e63c0276a39 tempest-QuotaClassesAdmin257Test-2113529208 tempest-QuotaClassesAdmin257Test-2113529208-project-admin] Action: 'update', calling method: .version_select at 0x7f1f221e5550>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:22.592521 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-28246692-1226-4d8e-86f5-6e63c0276a39 tempest-QuotaClassesAdmin257Test-2113529208 tempest-QuotaClassesAdmin257Test-2113529208-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.161210 Aug 27 04:33:22.593279 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 225/454] 10.222.0.79 () {62 vars in 1247 bytes} [Sat Aug 27 04:33:22 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:22.955685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0a5cf789-2ca8-4bdb-bf35-0d33765bfe74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:22.957746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4fafc0fb-b8ef-4c8b-97cb-93fb962f9912 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:22.959652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4fafc0fb-b8ef-4c8b-97cb-93fb962f9912 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'ff8d8738e6ab4db090700982466be714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3491032b4f4aebae275f9aaaa6aeac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4fafc0fb-b8ef-4c8b-97cb-93fb962f9912 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502-project] Request method failure captured: Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ6Ptl9P8jqWceJLOrPOti_sTWQg4fFI3ejXnaxIA5iI1Bz081ownzxlxRvsStRRi1GXQKR7Uidi4rLzwj1dW3DYRsft_CeIdFu-VusrMSz4Tavn8t6i_nIDHuhBSP-Y_A96dsLMM9w79XzB2fiC2X9GYgsVcoBmrc2T27dn40J9ItA Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 9d3491032b4f4aebae275f9aaaa6aeac Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:33:22.964388 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:33:22.966307 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9d3491032b4f4aebae275f9aaaa6aeac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9d3491032b4f4aebae275f9aaaa6aeac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9d3491032b4f4aebae275f9aaaa6aeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9d3491032b4f4aebae275f9aaaa6aeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:22.966307 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 Aug 27 04:33:22.966307 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 9d3491032b4f4aebae275f9aaaa6aeac Aug 27 04:33:22.966307 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 Aug 27 04:33:22.966307 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-390011502-project Aug 27 04:33:22.966307 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:33:22.966307 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:33:22.966307 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: ff8d8738e6ab4db090700982466be714 Aug 27 04:33:22.966307 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-390011502-project Aug 27 04:33:22.966307 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: action_args: {} Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:33:22.967201 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 04:33:22.970218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:22.973846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4fafc0fb-b8ef-4c8b-97cb-93fb962f9912 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:22.975309 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0a5cf789-2ca8-4bdb-bf35-0d33765bfe74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1312 microversion: 2.1 time: 0.703834 Aug 27 04:33:22.975824 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4fafc0fb-b8ef-4c8b-97cb-93fb962f9912 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502-project] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.381173 Aug 27 04:33:22.980817 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 226/455] 10.222.0.79 () {58 vars in 1185 bytes} [Sat Aug 27 04:33:22 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 386 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:22.987834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed6de32c-19b2-4be0-975b-3b51fb2a66e8 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:22.988973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ed6de32c-19b2-4be0-975b-3b51fb2a66e8 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:22.991326 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 230/456] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:22 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1312 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:22.998672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed6de32c-19b2-4be0-975b-3b51fb2a66e8 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:22.999407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed6de32c-19b2-4be0-975b-3b51fb2a66e8 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:23.000072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed6de32c-19b2-4be0-975b-3b51fb2a66e8 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:23.001037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed6de32c-19b2-4be0-975b-3b51fb2a66e8 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:23.001962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed6de32c-19b2-4be0-975b-3b51fb2a66e8 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:23.002718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed6de32c-19b2-4be0-975b-3b51fb2a66e8 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:23.002940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b47649b7-acbe-498d-844b-cdb60c47746e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:23.003466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b47649b7-acbe-498d-844b-cdb60c47746e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:23.030665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:23.034174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b47649b7-acbe-498d-844b-cdb60c47746e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:23.034658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b47649b7-acbe-498d-844b-cdb60c47746e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:23.035091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b47649b7-acbe-498d-844b-cdb60c47746e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:23.049465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b47649b7-acbe-498d-844b-cdb60c47746e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:23.050196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b47649b7-acbe-498d-844b-cdb60c47746e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:23.054857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b47649b7-acbe-498d-844b-cdb60c47746e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:23.522387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed6de32c-19b2-4be0-975b-3b51fb2a66e8 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:23.532484 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ed6de32c-19b2-4be0-975b-3b51fb2a66e8 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1318 microversion: 2.1 time: 0.549355 Aug 27 04:33:23.537262 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 227/457] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:22 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1318 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:23.556211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be24ab88-8267-4b1e-8ca9-242ca7c2d18d tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:23.558471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be24ab88-8267-4b1e-8ca9-242ca7c2d18d tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'ff8d8738e6ab4db090700982466be714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3491032b4f4aebae275f9aaaa6aeac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be24ab88-8267-4b1e-8ca9-242ca7c2d18d tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502-project] Request method failure captured: Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2004:33:22 HTTP/1.1 Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ6Ptl9P8jqWceJLOrPOti_sTWQg4fFI3ejXnaxIA5iI1Bz081ownzxlxRvsStRRi1GXQKR7Uidi4rLzwj1dW3DYRsft_CeIdFu-VusrMSz4Tavn8t6i_nIDHuhBSP-Y_A96dsLMM9w79XzB2fiC2X9GYgsVcoBmrc2T27dn40J9ItA Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 9d3491032b4f4aebae275f9aaaa6aeac Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:33:23.560330 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:33:23.561695 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9d3491032b4f4aebae275f9aaaa6aeac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9d3491032b4f4aebae275f9aaaa6aeac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9d3491032b4f4aebae275f9aaaa6aeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9d3491032b4f4aebae275f9aaaa6aeac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:23.561695 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 Aug 27 04:33:23.561695 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 9d3491032b4f4aebae275f9aaaa6aeac Aug 27 04:33:23.561695 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 Aug 27 04:33:23.561695 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-390011502-project Aug 27 04:33:23.561695 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:33:23.561695 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:33:23.561695 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: ff8d8738e6ab4db090700982466be714 Aug 27 04:33:23.561695 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-390011502-project Aug 27 04:33:23.561695 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '2022-08-27 04:33:22'} Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:33:23.562354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 04:33:23.563480 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:23.565975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be24ab88-8267-4b1e-8ca9-242ca7c2d18d tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:23.567894 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be24ab88-8267-4b1e-8ca9-242ca7c2d18d tempest-InstanceUsageAuditLogNegativeTestJSON-390011502 tempest-InstanceUsageAuditLogNegativeTestJSON-390011502-project] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27 04:33:22" status: 403 len: 128 microversion: 2.1 time: 0.018072 Aug 27 04:33:23.573028 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 228/458] 10.222.0.79 () {58 vars in 1251 bytes} [Sat Aug 27 04:33:23 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2004%3A33%3A22 => generated 128 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:23.579104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-258962b7-a6d8-43fb-985d-aab722425dce tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:23.580308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-258962b7-a6d8-43fb-985d-aab722425dce tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:23.589030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258962b7-a6d8-43fb-985d-aab722425dce tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:23.590075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258962b7-a6d8-43fb-985d-aab722425dce tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:23.590734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258962b7-a6d8-43fb-985d-aab722425dce tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:23.591671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258962b7-a6d8-43fb-985d-aab722425dce tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:23.592341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258962b7-a6d8-43fb-985d-aab722425dce tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:23.593503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258962b7-a6d8-43fb-985d-aab722425dce tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:23.924921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-258962b7-a6d8-43fb-985d-aab722425dce tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:23.936416 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-258962b7-a6d8-43fb-985d-aab722425dce tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 200 len: 1271 microversion: 2.1 time: 0.361789 Aug 27 04:33:23.937034 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 229/459] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:23 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 1271 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:23.997556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6cbf1693-093e-4055-9e58-17bec2fb91c6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:23.998163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6cbf1693-093e-4055-9e58-17bec2fb91c6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:24.006512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cbf1693-093e-4055-9e58-17bec2fb91c6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:24.011796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cbf1693-093e-4055-9e58-17bec2fb91c6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:24.013898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cbf1693-093e-4055-9e58-17bec2fb91c6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:24.014874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cbf1693-093e-4055-9e58-17bec2fb91c6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:24.015500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cbf1693-093e-4055-9e58-17bec2fb91c6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:24.021765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cbf1693-093e-4055-9e58-17bec2fb91c6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:24.270524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b47649b7-acbe-498d-844b-cdb60c47746e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:24.281504 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b47649b7-acbe-498d-844b-cdb60c47746e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1388 microversion: 2.1 time: 1.289401 Aug 27 04:33:24.282824 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 231/460] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:22 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1388 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:24.563586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-868e0121-d5ad-4ae0-b432-2b5872c533e9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:24.565598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-868e0121-d5ad-4ae0-b432-2b5872c533e9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:24.586560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-868e0121-d5ad-4ae0-b432-2b5872c533e9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:24.588232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-868e0121-d5ad-4ae0-b432-2b5872c533e9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:24.590264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-868e0121-d5ad-4ae0-b432-2b5872c533e9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:24.592667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-868e0121-d5ad-4ae0-b432-2b5872c533e9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:24.594917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-868e0121-d5ad-4ae0-b432-2b5872c533e9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:24.597192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-868e0121-d5ad-4ae0-b432-2b5872c533e9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:24.742854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6cbf1693-093e-4055-9e58-17bec2fb91c6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:24.756860 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6cbf1693-093e-4055-9e58-17bec2fb91c6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1312 microversion: 2.1 time: 0.762983 Aug 27 04:33:24.769269 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 230/461] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:23 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1312 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:24.943638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-868e0121-d5ad-4ae0-b432-2b5872c533e9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:24.956290 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-868e0121-d5ad-4ae0-b432-2b5872c533e9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1318 microversion: 2.1 time: 0.398606 Aug 27 04:33:24.957132 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 232/462] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:24 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:24.974102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-754fa4d7-dbfa-4037-a977-fddc48fe2d48 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:24.974831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-754fa4d7-dbfa-4037-a977-fddc48fe2d48 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:24.984747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-754fa4d7-dbfa-4037-a977-fddc48fe2d48 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:24.987704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-754fa4d7-dbfa-4037-a977-fddc48fe2d48 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:24.988243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-754fa4d7-dbfa-4037-a977-fddc48fe2d48 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:24.989860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-754fa4d7-dbfa-4037-a977-fddc48fe2d48 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:24.993155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-754fa4d7-dbfa-4037-a977-fddc48fe2d48 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:24.993691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-754fa4d7-dbfa-4037-a977-fddc48fe2d48 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:25.303976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-56b290a8-caff-47ea-ad82-e0f364a98d58 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:25.305767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-56b290a8-caff-47ea-ad82-e0f364a98d58 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:25.317373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56b290a8-caff-47ea-ad82-e0f364a98d58 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:25.318292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56b290a8-caff-47ea-ad82-e0f364a98d58 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:25.318937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56b290a8-caff-47ea-ad82-e0f364a98d58 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:25.319954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56b290a8-caff-47ea-ad82-e0f364a98d58 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:25.323872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56b290a8-caff-47ea-ad82-e0f364a98d58 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:25.324654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56b290a8-caff-47ea-ad82-e0f364a98d58 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:25.682678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-754fa4d7-dbfa-4037-a977-fddc48fe2d48 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:25.693357 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-754fa4d7-dbfa-4037-a977-fddc48fe2d48 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 200 len: 1277 microversion: 2.1 time: 0.736148 Aug 27 04:33:25.697729 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 231/463] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:24 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 1277 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:25.755773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-56b290a8-caff-47ea-ad82-e0f364a98d58 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:25.775221 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-56b290a8-caff-47ea-ad82-e0f364a98d58 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1388 microversion: 2.1 time: 0.474978 Aug 27 04:33:25.777168 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 233/464] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:25 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1388 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:25.794970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-11e9da1a-729c-403d-be14-98c25db87ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:25.796349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-11e9da1a-729c-403d-be14-98c25db87ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:25.807201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11e9da1a-729c-403d-be14-98c25db87ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:25.809313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11e9da1a-729c-403d-be14-98c25db87ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:25.810763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11e9da1a-729c-403d-be14-98c25db87ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:25.814641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11e9da1a-729c-403d-be14-98c25db87ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:25.815299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11e9da1a-729c-403d-be14-98c25db87ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:25.816675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11e9da1a-729c-403d-be14-98c25db87ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:25.980927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-92de42b9-ce63-4933-ac43-e8da11de8ac0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:25.981441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-92de42b9-ce63-4933-ac43-e8da11de8ac0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:25.998473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92de42b9-ce63-4933-ac43-e8da11de8ac0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:25.999231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92de42b9-ce63-4933-ac43-e8da11de8ac0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:26.000081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92de42b9-ce63-4933-ac43-e8da11de8ac0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:26.001287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92de42b9-ce63-4933-ac43-e8da11de8ac0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:26.001898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92de42b9-ce63-4933-ac43-e8da11de8ac0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:26.002469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92de42b9-ce63-4933-ac43-e8da11de8ac0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:26.448128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11e9da1a-729c-403d-be14-98c25db87ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:26.456663 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-11e9da1a-729c-403d-be14-98c25db87ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1312 microversion: 2.1 time: 0.668802 Aug 27 04:33:26.461649 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 232/465] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:25 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1312 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:26.480398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-92de42b9-ce63-4933-ac43-e8da11de8ac0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:26.493485 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-92de42b9-ce63-4933-ac43-e8da11de8ac0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1318 microversion: 2.1 time: 0.516946 Aug 27 04:33:26.494116 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 234/466] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:25 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:26.725793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-029aae91-0046-482f-a657-2c42e28a4df9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:26.726967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-029aae91-0046-482f-a657-2c42e28a4df9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:26.739797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-029aae91-0046-482f-a657-2c42e28a4df9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:26.743203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-029aae91-0046-482f-a657-2c42e28a4df9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:26.743917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-029aae91-0046-482f-a657-2c42e28a4df9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:26.746890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-029aae91-0046-482f-a657-2c42e28a4df9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:26.748493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-029aae91-0046-482f-a657-2c42e28a4df9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:26.750753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-029aae91-0046-482f-a657-2c42e28a4df9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:26.804940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c9f2faa7-bbe4-4687-8b4f-4423d2b70832 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:26.805827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c9f2faa7-bbe4-4687-8b4f-4423d2b70832 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:26.812805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f2faa7-bbe4-4687-8b4f-4423d2b70832 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:26.833649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f2faa7-bbe4-4687-8b4f-4423d2b70832 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:26.848940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f2faa7-bbe4-4687-8b4f-4423d2b70832 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:26.849379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f2faa7-bbe4-4687-8b4f-4423d2b70832 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:26.850318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f2faa7-bbe4-4687-8b4f-4423d2b70832 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:26.850975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f2faa7-bbe4-4687-8b4f-4423d2b70832 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:26.851837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:27.230643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c9f2faa7-bbe4-4687-8b4f-4423d2b70832 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:27.247200 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c9f2faa7-bbe4-4687-8b4f-4423d2b70832 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1388 microversion: 2.1 time: 0.448017 Aug 27 04:33:27.258340 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 235/467] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:26 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1388 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:27.500755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7055dd46-9979-4bc3-a156-ec04b110c4e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:27.501748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7055dd46-9979-4bc3-a156-ec04b110c4e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:27.515395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7055dd46-9979-4bc3-a156-ec04b110c4e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:27.524726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7055dd46-9979-4bc3-a156-ec04b110c4e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:27.529027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7055dd46-9979-4bc3-a156-ec04b110c4e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:27.534597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7055dd46-9979-4bc3-a156-ec04b110c4e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:27.541218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7055dd46-9979-4bc3-a156-ec04b110c4e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:27.542040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7055dd46-9979-4bc3-a156-ec04b110c4e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:27.952732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7055dd46-9979-4bc3-a156-ec04b110c4e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:27.966533 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7055dd46-9979-4bc3-a156-ec04b110c4e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1312 microversion: 2.1 time: 0.469784 Aug 27 04:33:27.987436 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 236/468] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:27 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1312 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:27.991985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8b6590b9-b452-4926-b7d0-a1537303df9b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:27.993333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8b6590b9-b452-4926-b7d0-a1537303df9b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:28.015321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b6590b9-b452-4926-b7d0-a1537303df9b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:28.015981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b6590b9-b452-4926-b7d0-a1537303df9b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:28.019387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b6590b9-b452-4926-b7d0-a1537303df9b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:28.020220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b6590b9-b452-4926-b7d0-a1537303df9b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:28.020872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b6590b9-b452-4926-b7d0-a1537303df9b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:28.021388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b6590b9-b452-4926-b7d0-a1537303df9b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:28.060611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-029aae91-0046-482f-a657-2c42e28a4df9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:28.072772 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-029aae91-0046-482f-a657-2c42e28a4df9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 200 len: 1319 microversion: 2.1 time: 1.349151 Aug 27 04:33:28.087123 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 233/469] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:26 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 1319 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:28.093795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cdda4d95-746d-4a85-82a4-5dc5e5e9f7fa req-e512f68e-b260-472f-81e0-2dfebdf2e07c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6035d8df-720d-48d2-a799-fc5275a5788e", "tag": "b201738a-d06b-42e5-8842-0dd213c52b52"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:28.150776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cdda4d95-746d-4a85-82a4-5dc5e5e9f7fa req-e512f68e-b260-472f-81e0-2dfebdf2e07c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:28.151673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cdda4d95-746d-4a85-82a4-5dc5e5e9f7fa req-e512f68e-b260-472f-81e0-2dfebdf2e07c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:28.157976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cdda4d95-746d-4a85-82a4-5dc5e5e9f7fa req-e512f68e-b260-472f-81e0-2dfebdf2e07c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:28.180401 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cdda4d95-746d-4a85-82a4-5dc5e5e9f7fa req-e512f68e-b260-472f-81e0-2dfebdf2e07c service nova] Creating event network-changed:b201738a-d06b-42e5-8842-0dd213c52b52 for instance 6035d8df-720d-48d2-a799-fc5275a5788e on n-h1-854823-1 Aug 27 04:33:28.194412 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cdda4d95-746d-4a85-82a4-5dc5e5e9f7fa req-e512f68e-b260-472f-81e0-2dfebdf2e07c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116836 Aug 27 04:33:28.196411 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 234/470] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:28.282327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d531b818-fb91-4e68-86dc-b3d4e21b394e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:28.283440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d531b818-fb91-4e68-86dc-b3d4e21b394e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:28.295892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d531b818-fb91-4e68-86dc-b3d4e21b394e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:28.296680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d531b818-fb91-4e68-86dc-b3d4e21b394e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:28.298878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d531b818-fb91-4e68-86dc-b3d4e21b394e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:28.299870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d531b818-fb91-4e68-86dc-b3d4e21b394e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:28.305867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d531b818-fb91-4e68-86dc-b3d4e21b394e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:28.307148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d531b818-fb91-4e68-86dc-b3d4e21b394e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:28.329854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8b6590b9-b452-4926-b7d0-a1537303df9b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:28.367771 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8b6590b9-b452-4926-b7d0-a1537303df9b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1318 microversion: 2.1 time: 0.386150 Aug 27 04:33:28.372344 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 237/471] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:27 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:28.449002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e1a7cdb9-c278-4df3-b1e8-0f923c3bfb01 req-196e9e3f-53b2-48d3-b862-cd089d52aca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c4690c-4559-494b-bf63-6df014ff0adf", "name": "network-vif-plugged", "status": "completed", "tag": "9378765a-d6e8-453c-a8f8-c6d12fd79dfa"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:28.502448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e1a7cdb9-c278-4df3-b1e8-0f923c3bfb01 req-196e9e3f-53b2-48d3-b862-cd089d52aca1 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:28.503067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e1a7cdb9-c278-4df3-b1e8-0f923c3bfb01 req-196e9e3f-53b2-48d3-b862-cd089d52aca1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:28.503356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e1a7cdb9-c278-4df3-b1e8-0f923c3bfb01 req-196e9e3f-53b2-48d3-b862-cd089d52aca1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:28.529053 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e1a7cdb9-c278-4df3-b1e8-0f923c3bfb01 req-196e9e3f-53b2-48d3-b862-cd089d52aca1 service nova] Creating event network-vif-plugged:9378765a-d6e8-453c-a8f8-c6d12fd79dfa for instance 64c4690c-4559-494b-bf63-6df014ff0adf on n-h2-854823-1 Aug 27 04:33:28.548856 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e1a7cdb9-c278-4df3-b1e8-0f923c3bfb01 req-196e9e3f-53b2-48d3-b862-cd089d52aca1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108474 Aug 27 04:33:28.559744 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 238/472] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:33:28.998810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f01b87e0-8932-4061-b34e-b73fd25f3ead tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:28.999907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f01b87e0-8932-4061-b34e-b73fd25f3ead tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:29.013403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f01b87e0-8932-4061-b34e-b73fd25f3ead tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:29.014231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f01b87e0-8932-4061-b34e-b73fd25f3ead tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:29.017154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f01b87e0-8932-4061-b34e-b73fd25f3ead tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:29.020004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f01b87e0-8932-4061-b34e-b73fd25f3ead tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:29.020739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f01b87e0-8932-4061-b34e-b73fd25f3ead tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:29.021368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f01b87e0-8932-4061-b34e-b73fd25f3ead tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:29.224107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d531b818-fb91-4e68-86dc-b3d4e21b394e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:29.237329 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d531b818-fb91-4e68-86dc-b3d4e21b394e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1388 microversion: 2.1 time: 0.959586 Aug 27 04:33:29.238646 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 235/473] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:28 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1388 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:29.255644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f59f832b-0e87-443b-8583-be4d2b0c1004 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:29.256327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f01b87e0-8932-4061-b34e-b73fd25f3ead tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:29.258818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f59f832b-0e87-443b-8583-be4d2b0c1004 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:29.270117 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f01b87e0-8932-4061-b34e-b73fd25f3ead tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1312 microversion: 2.1 time: 0.279912 Aug 27 04:33:29.270828 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 239/474] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:28 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1312 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:29.285910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f59f832b-0e87-443b-8583-be4d2b0c1004 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:29.286778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f59f832b-0e87-443b-8583-be4d2b0c1004 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:29.288045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f59f832b-0e87-443b-8583-be4d2b0c1004 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:29.289741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f59f832b-0e87-443b-8583-be4d2b0c1004 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:29.290431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f59f832b-0e87-443b-8583-be4d2b0c1004 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:29.291075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f59f832b-0e87-443b-8583-be4d2b0c1004 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:29.398952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d6714b79-7d1c-4694-8d35-8e23aff586c0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:29.399875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d6714b79-7d1c-4694-8d35-8e23aff586c0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:29.413320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6714b79-7d1c-4694-8d35-8e23aff586c0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:29.415489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6714b79-7d1c-4694-8d35-8e23aff586c0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:29.417463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6714b79-7d1c-4694-8d35-8e23aff586c0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:29.422756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6714b79-7d1c-4694-8d35-8e23aff586c0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:29.424132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6714b79-7d1c-4694-8d35-8e23aff586c0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:29.424809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6714b79-7d1c-4694-8d35-8e23aff586c0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:29.981028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d6714b79-7d1c-4694-8d35-8e23aff586c0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:29.991124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:29.999114 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d6714b79-7d1c-4694-8d35-8e23aff586c0 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1318 microversion: 2.1 time: 0.605239 Aug 27 04:33:30.008602 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 240/475] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:29 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:30.247742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f59f832b-0e87-443b-8583-be4d2b0c1004 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:30.264873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8d9dcab9-1aaf-4fec-9264-e78496c38ce5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:30.265545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8d9dcab9-1aaf-4fec-9264-e78496c38ce5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:30.268840 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f59f832b-0e87-443b-8583-be4d2b0c1004 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 200 len: 1319 microversion: 2.1 time: 1.027936 Aug 27 04:33:30.272489 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 236/476] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:29 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 1319 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:30.285310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d9dcab9-1aaf-4fec-9264-e78496c38ce5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:30.285817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d9dcab9-1aaf-4fec-9264-e78496c38ce5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:30.286257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d9dcab9-1aaf-4fec-9264-e78496c38ce5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:30.286968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d9dcab9-1aaf-4fec-9264-e78496c38ce5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:30.292446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d9dcab9-1aaf-4fec-9264-e78496c38ce5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:30.293622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f76de45-9f7e-4164-9626-a7dbcf66a556 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:30.294670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d9dcab9-1aaf-4fec-9264-e78496c38ce5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:30.295261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f76de45-9f7e-4164-9626-a7dbcf66a556 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:30.307775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f76de45-9f7e-4164-9626-a7dbcf66a556 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:30.315613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f76de45-9f7e-4164-9626-a7dbcf66a556 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:30.318296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f76de45-9f7e-4164-9626-a7dbcf66a556 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:30.323642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f76de45-9f7e-4164-9626-a7dbcf66a556 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:30.324406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f76de45-9f7e-4164-9626-a7dbcf66a556 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:30.325046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f76de45-9f7e-4164-9626-a7dbcf66a556 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:30.957192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8d9dcab9-1aaf-4fec-9264-e78496c38ce5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:30.972634 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8d9dcab9-1aaf-4fec-9264-e78496c38ce5 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1388 microversion: 2.1 time: 0.717532 Aug 27 04:33:30.992046 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 241/477] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:30 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1388 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:31.023482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-fae5bfb8-1174-49ee-adb1-1ee3a3dde94e req-a22c371e-ba2a-4544-a8b7-1478ca967b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c316d2a9-3517-44df-8382-8e40ae8d3b1b", "name": "network-vif-plugged", "status": "completed", "tag": "19550fed-7930-476b-a65b-28ccbc745f07"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:31.047788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fae5bfb8-1174-49ee-adb1-1ee3a3dde94e req-a22c371e-ba2a-4544-a8b7-1478ca967b82 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:31.050694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fae5bfb8-1174-49ee-adb1-1ee3a3dde94e req-a22c371e-ba2a-4544-a8b7-1478ca967b82 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:31.051404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fae5bfb8-1174-49ee-adb1-1ee3a3dde94e req-a22c371e-ba2a-4544-a8b7-1478ca967b82 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:31.089376 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-fae5bfb8-1174-49ee-adb1-1ee3a3dde94e req-a22c371e-ba2a-4544-a8b7-1478ca967b82 service nova] Creating event network-vif-plugged:19550fed-7930-476b-a65b-28ccbc745f07 for instance c316d2a9-3517-44df-8382-8e40ae8d3b1b on n-h1-854823-1 Aug 27 04:33:31.100765 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-fae5bfb8-1174-49ee-adb1-1ee3a3dde94e req-a22c371e-ba2a-4544-a8b7-1478ca967b82 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107436 Aug 27 04:33:31.106501 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 242/478] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:31.124229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1df41ce1-23b4-494a-b8cc-00546d4c6cf7 req-229a3965-4eed-4b51-84d0-69d0364744ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1970d332-d1e0-4a16-a2b7-9c90c909b554", "tag": "6bb018be-5665-4f3e-b5ca-7e7c77aba094"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:31.145913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1df41ce1-23b4-494a-b8cc-00546d4c6cf7 req-229a3965-4eed-4b51-84d0-69d0364744ab service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:31.150612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1df41ce1-23b4-494a-b8cc-00546d4c6cf7 req-229a3965-4eed-4b51-84d0-69d0364744ab service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:31.151378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1df41ce1-23b4-494a-b8cc-00546d4c6cf7 req-229a3965-4eed-4b51-84d0-69d0364744ab service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:31.186512 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1df41ce1-23b4-494a-b8cc-00546d4c6cf7 req-229a3965-4eed-4b51-84d0-69d0364744ab service nova] Creating event network-changed:6bb018be-5665-4f3e-b5ca-7e7c77aba094 for instance 1970d332-d1e0-4a16-a2b7-9c90c909b554 on n-h2-854823-1 Aug 27 04:33:31.193339 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1df41ce1-23b4-494a-b8cc-00546d4c6cf7 req-229a3965-4eed-4b51-84d0-69d0364744ab service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082447 Aug 27 04:33:31.194594 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 243/479] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:31.203474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fe1418e7-c53f-472c-a123-8c2c5903c38a tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:31.204373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fe1418e7-c53f-472c-a123-8c2c5903c38a tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:31.214908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe1418e7-c53f-472c-a123-8c2c5903c38a tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:31.215518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe1418e7-c53f-472c-a123-8c2c5903c38a tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:31.225051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe1418e7-c53f-472c-a123-8c2c5903c38a tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:31.225952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe1418e7-c53f-472c-a123-8c2c5903c38a tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:31.226919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe1418e7-c53f-472c-a123-8c2c5903c38a tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:31.227368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe1418e7-c53f-472c-a123-8c2c5903c38a tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:31.379852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f76de45-9f7e-4164-9626-a7dbcf66a556 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:31.395490 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f76de45-9f7e-4164-9626-a7dbcf66a556 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1312 microversion: 2.1 time: 1.107045 Aug 27 04:33:31.409562 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 237/480] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:30 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1312 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:31.671855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f8e9c34-3c77-41e3-87c0-3fa425dc9d53 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Action: 'update', calling method: .version_select at 0x7f1f22073b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:31.786450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=47,nova_cell0:UPDATE=7 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:31.943454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:32.004236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fe1418e7-c53f-472c-a123-8c2c5903c38a tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:32.023033 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fe1418e7-c53f-472c-a123-8c2c5903c38a tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1318 microversion: 2.1 time: 0.823404 Aug 27 04:33:32.039340 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 244/481] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:31 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:32.057600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-25a2afad-b46a-42ef-b6ab-62d6dceb3c54 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:32.058247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-25a2afad-b46a-42ef-b6ab-62d6dceb3c54 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:32.080919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25a2afad-b46a-42ef-b6ab-62d6dceb3c54 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:32.081485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25a2afad-b46a-42ef-b6ab-62d6dceb3c54 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:32.083028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25a2afad-b46a-42ef-b6ab-62d6dceb3c54 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:32.083786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25a2afad-b46a-42ef-b6ab-62d6dceb3c54 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:32.085044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25a2afad-b46a-42ef-b6ab-62d6dceb3c54 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:32.085528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25a2afad-b46a-42ef-b6ab-62d6dceb3c54 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:32.277969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f8e9c34-3c77-41e3-87c0-3fa425dc9d53 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:32.282116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f8e9c34-3c77-41e3-87c0-3fa425dc9d53 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:32.283611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f8e9c34-3c77-41e3-87c0-3fa425dc9d53 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:32.284981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f8e9c34-3c77-41e3-87c0-3fa425dc9d53 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:32.287314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f8e9c34-3c77-41e3-87c0-3fa425dc9d53 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:32.290275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f8e9c34-3c77-41e3-87c0-3fa425dc9d53 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:32.351875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=7 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:32.393081 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6f8e9c34-3c77-41e3-87c0-3fa425dc9d53 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/9361f12f112b440ab1355bc456f0edd5" status: 200 len: 240 microversion: 2.36 time: 0.982067 Aug 27 04:33:32.394824 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 238/482] 10.222.0.79 () {62 vars in 1303 bytes} [Sat Aug 27 04:33:31 2022] PUT /compute/v2.1/os-quota-sets/9361f12f112b440ab1355bc456f0edd5 => generated 240 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:32.402334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d81bc59-8316-4da7-b0f9-d718d6154871 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:32.403198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1d81bc59-8316-4da7-b0f9-d718d6154871 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:32.414837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d81bc59-8316-4da7-b0f9-d718d6154871 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:32.415718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d81bc59-8316-4da7-b0f9-d718d6154871 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:32.416399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d81bc59-8316-4da7-b0f9-d718d6154871 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:32.417918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d81bc59-8316-4da7-b0f9-d718d6154871 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:32.418592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d81bc59-8316-4da7-b0f9-d718d6154871 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:32.419689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d81bc59-8316-4da7-b0f9-d718d6154871 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:32.556285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-25a2afad-b46a-42ef-b6ab-62d6dceb3c54 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:32.565972 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-25a2afad-b46a-42ef-b6ab-62d6dceb3c54 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 200 len: 1319 microversion: 2.1 time: 0.524912 Aug 27 04:33:32.566567 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 245/483] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:32 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 1319 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:32.572241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e08c4e5c-f575-44b7-ab1e-aa8b124d574f tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Calling method '.version_select at 0x7f1f222c2ca0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:32.797070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e08c4e5c-f575-44b7-ab1e-aa8b124d574f tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:32.799472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e08c4e5c-f575-44b7-ab1e-aa8b124d574f tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:32.800064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e08c4e5c-f575-44b7-ab1e-aa8b124d574f tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:32.801247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e08c4e5c-f575-44b7-ab1e-aa8b124d574f tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:32.801874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e08c4e5c-f575-44b7-ab1e-aa8b124d574f tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:32.802448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e08c4e5c-f575-44b7-ab1e-aa8b124d574f tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:32.827958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:UPDATE=7 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:32.855145 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e08c4e5c-f575-44b7-ab1e-aa8b124d574f tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/9361f12f112b440ab1355bc456f0edd5/detail" status: 200 len: 672 microversion: 2.36 time: 0.287489 Aug 27 04:33:32.855786 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 246/484] 10.222.0.79 () {60 vars in 1304 bytes} [Sat Aug 27 04:33:32 2022] GET /compute/v2.1/os-quota-sets/9361f12f112b440ab1355bc456f0edd5/detail => generated 672 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:32.862089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a37ae9e1-d00c-4b3b-b6c7-e143a7f75e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:32.862705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a37ae9e1-d00c-4b3b-b6c7-e143a7f75e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:32.876287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1d81bc59-8316-4da7-b0f9-d718d6154871 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:32.878738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a37ae9e1-d00c-4b3b-b6c7-e143a7f75e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:32.883687 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d81bc59-8316-4da7-b0f9-d718d6154871 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1587 microversion: 2.1 time: 0.487530 Aug 27 04:33:32.887699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a37ae9e1-d00c-4b3b-b6c7-e143a7f75e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:32.888156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a37ae9e1-d00c-4b3b-b6c7-e143a7f75e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:32.888999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a37ae9e1-d00c-4b3b-b6c7-e143a7f75e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:32.889375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a37ae9e1-d00c-4b3b-b6c7-e143a7f75e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:32.889803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a37ae9e1-d00c-4b3b-b6c7-e143a7f75e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:32.891572 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 239/485] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:32 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1587 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:32.918731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6272760a-257b-4617-a531-537ae78934b7 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:32.919566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6272760a-257b-4617-a531-537ae78934b7 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:32.945075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6272760a-257b-4617-a531-537ae78934b7 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:32.945880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6272760a-257b-4617-a531-537ae78934b7 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:32.947240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6272760a-257b-4617-a531-537ae78934b7 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:32.949035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6272760a-257b-4617-a531-537ae78934b7 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:32.954947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6272760a-257b-4617-a531-537ae78934b7 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:32.955620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6272760a-257b-4617-a531-537ae78934b7 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:33.201961 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6272760a-257b-4617-a531-537ae78934b7 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.291990 Aug 27 04:33:33.202857 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 240/486] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 04:33:32 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf/os-interface => generated 284 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:33.215252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfda6e48-085f-4445-b23a-050dbc61332c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:33.216170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dfda6e48-085f-4445-b23a-050dbc61332c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:33.227194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfda6e48-085f-4445-b23a-050dbc61332c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:33.230269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfda6e48-085f-4445-b23a-050dbc61332c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:33.231556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfda6e48-085f-4445-b23a-050dbc61332c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:33.233784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfda6e48-085f-4445-b23a-050dbc61332c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:33.235743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfda6e48-085f-4445-b23a-050dbc61332c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:33.236473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfda6e48-085f-4445-b23a-050dbc61332c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:33.561463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a37ae9e1-d00c-4b3b-b6c7-e143a7f75e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:33.579469 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a37ae9e1-d00c-4b3b-b6c7-e143a7f75e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1312 microversion: 2.1 time: 0.722473 Aug 27 04:33:33.592561 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 247/487] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:32 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1312 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:33.596823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-026a8ca2-b3d0-41be-8529-c1af98d6ecb5 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Action: 'update', calling method: .version_select at 0x7f1f222c2280>, body: {"quota_set": {"ram": "2048"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:33.703093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-026a8ca2-b3d0-41be-8529-c1af98d6ecb5 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:33.703587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-026a8ca2-b3d0-41be-8529-c1af98d6ecb5 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:33.704034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-026a8ca2-b3d0-41be-8529-c1af98d6ecb5 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:33.704783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-026a8ca2-b3d0-41be-8529-c1af98d6ecb5 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:33.705242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-026a8ca2-b3d0-41be-8529-c1af98d6ecb5 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:33.705691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-026a8ca2-b3d0-41be-8529-c1af98d6ecb5 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:33.786784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-026a8ca2-b3d0-41be-8529-c1af98d6ecb5 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:33.787275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-026a8ca2-b3d0-41be-8529-c1af98d6ecb5 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:33.787709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-026a8ca2-b3d0-41be-8529-c1af98d6ecb5 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:33.789059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-026a8ca2-b3d0-41be-8529-c1af98d6ecb5 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:33.789523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-026a8ca2-b3d0-41be-8529-c1af98d6ecb5 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:33.801160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-026a8ca2-b3d0-41be-8529-c1af98d6ecb5 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:33.986186 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-026a8ca2-b3d0-41be-8529-c1af98d6ecb5 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/9361f12f112b440ab1355bc456f0edd5?user_id=4a8bfcb66161473eba583fe46e0954a7" status: 200 len: 240 microversion: 2.36 time: 0.404658 Aug 27 04:33:34.001353 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 248/488] 10.222.0.79 () {62 vars in 1384 bytes} [Sat Aug 27 04:33:33 2022] PUT /compute/v2.1/os-quota-sets/9361f12f112b440ab1355bc456f0edd5?user_id=4a8bfcb66161473eba583fe46e0954a7 => generated 240 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:34.016269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-446917b3-3d6e-45ff-ac72-a103908157be req-0ea6769b-574f-41df-ba56-ce5d244aa1cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20337dd0-bb88-4f11-85be-ec44de54c9da", "tag": "5387b19f-5d63-4ca8-ab0a-71da1b793383"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:34.047589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-446917b3-3d6e-45ff-ac72-a103908157be req-0ea6769b-574f-41df-ba56-ce5d244aa1cc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:34.048097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-446917b3-3d6e-45ff-ac72-a103908157be req-0ea6769b-574f-41df-ba56-ce5d244aa1cc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:34.048554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-446917b3-3d6e-45ff-ac72-a103908157be req-0ea6769b-574f-41df-ba56-ce5d244aa1cc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:34.069383 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-446917b3-3d6e-45ff-ac72-a103908157be req-0ea6769b-574f-41df-ba56-ce5d244aa1cc service nova] Creating event network-changed:5387b19f-5d63-4ca8-ab0a-71da1b793383 for instance 20337dd0-bb88-4f11-85be-ec44de54c9da on n-h2-854823-1 Aug 27 04:33:34.098759 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-446917b3-3d6e-45ff-ac72-a103908157be req-0ea6769b-574f-41df-ba56-ce5d244aa1cc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095989 Aug 27 04:33:34.099350 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 249/489] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:34.105741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53a912d9-e215-450e-9093-dc05de4c3382 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:34.106691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-53a912d9-e215-450e-9093-dc05de4c3382 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:34.124350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a912d9-e215-450e-9093-dc05de4c3382 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:34.125197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a912d9-e215-450e-9093-dc05de4c3382 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:34.125819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a912d9-e215-450e-9093-dc05de4c3382 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:34.126994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a912d9-e215-450e-9093-dc05de4c3382 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:34.127601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a912d9-e215-450e-9093-dc05de4c3382 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:34.128175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a912d9-e215-450e-9093-dc05de4c3382 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:34.382753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dfda6e48-085f-4445-b23a-050dbc61332c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:34.396795 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dfda6e48-085f-4445-b23a-050dbc61332c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1318 microversion: 2.1 time: 1.192567 Aug 27 04:33:34.398616 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 241/490] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:33 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1318 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:34.427113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e2df4204-26ae-42da-b243-c19857a2c437 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] Calling method '.version_select at 0x7f1f2209bb80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:34.536264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=45 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:34.570228 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e2df4204-26ae-42da-b243-c19857a2c437 tempest-QuotasAdminTestV236-688276557 tempest-QuotasAdminTestV236-688276557-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/9361f12f112b440ab1355bc456f0edd5?user_id=4a8bfcb66161473eba583fe46e0954a7" status: 200 len: 282 microversion: 2.36 time: 0.169507 Aug 27 04:33:34.571289 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 242/491] 10.222.0.79 () {60 vars in 1364 bytes} [Sat Aug 27 04:33:34 2022] GET /compute/v2.1/os-quota-sets/9361f12f112b440ab1355bc456f0edd5?user_id=4a8bfcb66161473eba583fe46e0954a7 => generated 282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:34.605810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b1769e6-4172-4783-b37e-bcb12808d2eb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:34.606432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b1769e6-4172-4783-b37e-bcb12808d2eb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:34.627842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b1769e6-4172-4783-b37e-bcb12808d2eb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:34.628365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b1769e6-4172-4783-b37e-bcb12808d2eb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:34.636355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b1769e6-4172-4783-b37e-bcb12808d2eb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:34.638074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b1769e6-4172-4783-b37e-bcb12808d2eb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:34.642040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b1769e6-4172-4783-b37e-bcb12808d2eb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:34.642505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b1769e6-4172-4783-b37e-bcb12808d2eb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:35.357866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b1769e6-4172-4783-b37e-bcb12808d2eb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:35.367778 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b1769e6-4172-4783-b37e-bcb12808d2eb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1462 microversion: 2.1 time: 0.767052 Aug 27 04:33:35.387905 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 243/492] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:34 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1462 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:35.404897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53a912d9-e215-450e-9093-dc05de4c3382 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:35.433281 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-53a912d9-e215-450e-9093-dc05de4c3382 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 200 len: 1319 microversion: 2.1 time: 1.330304 Aug 27 04:33:35.449562 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 250/493] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:34 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 1319 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:35.466796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a2d51683-68b9-495c-8ea0-ebb68159347c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:35.467793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a2d51683-68b9-495c-8ea0-ebb68159347c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:35.488459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d51683-68b9-495c-8ea0-ebb68159347c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:35.489005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d51683-68b9-495c-8ea0-ebb68159347c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:35.489450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d51683-68b9-495c-8ea0-ebb68159347c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:35.492657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d51683-68b9-495c-8ea0-ebb68159347c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:35.494405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d51683-68b9-495c-8ea0-ebb68159347c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:35.495084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d51683-68b9-495c-8ea0-ebb68159347c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:36.098742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39f3920b-ff25-4720-8f71-57723d9d4e43 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:36.099998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39f3920b-ff25-4720-8f71-57723d9d4e43 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:36.119502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39f3920b-ff25-4720-8f71-57723d9d4e43 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:36.124026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39f3920b-ff25-4720-8f71-57723d9d4e43 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:36.125719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39f3920b-ff25-4720-8f71-57723d9d4e43 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:36.129434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39f3920b-ff25-4720-8f71-57723d9d4e43 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:36.132860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39f3920b-ff25-4720-8f71-57723d9d4e43 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:36.133548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39f3920b-ff25-4720-8f71-57723d9d4e43 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:36.612640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a2d51683-68b9-495c-8ea0-ebb68159347c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:36.623598 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a2d51683-68b9-495c-8ea0-ebb68159347c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1318 microversion: 2.1 time: 1.172555 Aug 27 04:33:36.628307 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 251/494] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:35 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1318 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:36.642302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-67251cdd-8fe3-453c-8787-897975a57856 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:36.652327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-67251cdd-8fe3-453c-8787-897975a57856 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:36.666540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67251cdd-8fe3-453c-8787-897975a57856 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:36.667459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67251cdd-8fe3-453c-8787-897975a57856 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:36.669691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67251cdd-8fe3-453c-8787-897975a57856 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:36.670754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67251cdd-8fe3-453c-8787-897975a57856 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:36.672767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67251cdd-8fe3-453c-8787-897975a57856 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:36.673486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67251cdd-8fe3-453c-8787-897975a57856 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:37.057178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-67251cdd-8fe3-453c-8787-897975a57856 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:37.067377 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-67251cdd-8fe3-453c-8787-897975a57856 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 200 len: 1319 microversion: 2.1 time: 0.437397 Aug 27 04:33:37.071866 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 252/495] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:36 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 1319 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:37.349756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f1960d1b-1563-4cf5-ba0f-8af88741c65b tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Action: 'update', calling method: .version_select at 0x7f1f222dc820>, body: {"quota_set": {"ram": "5120"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:37.447736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1960d1b-1563-4cf5-ba0f-8af88741c65b tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:37.448463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1960d1b-1563-4cf5-ba0f-8af88741c65b tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:37.450274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1960d1b-1563-4cf5-ba0f-8af88741c65b tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:37.451240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1960d1b-1563-4cf5-ba0f-8af88741c65b tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:37.453324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1960d1b-1563-4cf5-ba0f-8af88741c65b tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:37.454869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1960d1b-1563-4cf5-ba0f-8af88741c65b tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:37.555079 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f1960d1b-1563-4cf5-ba0f-8af88741c65b tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/9ff49759c33a49ddae9a8598f815653e" status: 200 len: 148 microversion: 2.57 time: 0.481176 Aug 27 04:33:37.556576 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 253/496] 10.222.0.79 () {62 vars in 1303 bytes} [Sat Aug 27 04:33:37 2022] PUT /compute/v2.1/os-quota-sets/9ff49759c33a49ddae9a8598f815653e => generated 148 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:37.719088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-514abca4-49c8-4bb2-8cd8-2b1972094bdc tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Action: 'create', calling method: .version_select at 0x7f1f22346550>, body: {"keypair": {"name": "tempest-keypair-1623762787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuGWrM2E7+Dr09sJOYBr+6S5LO8VyjdpamPKT4XoWQfe6Tlv0qB4V0m13iLzMhTCqouglqiHGGYUZ1aXleTdWrYzpA+b3XhZ1UkBuVgqAItLMpJjWPWTB5WGcDGZyANrw=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:37.736438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-514abca4-49c8-4bb2-8cd8-2b1972094bdc tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Getting quotas for project 21c5a62d0711490081fe3d1e1fa0a1fb. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:37.741946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-514abca4-49c8-4bb2-8cd8-2b1972094bdc tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Getting quotas for user 2523cdbb4f3444afb648340a73e85025 and project 21c5a62d0711490081fe3d1e1fa0a1fb. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:37.779490 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-514abca4-49c8-4bb2-8cd8-2b1972094bdc tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.221458 Aug 27 04:33:37.787887 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 254/497] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:33:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:37.794138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-61cb4746-1192-422e-98c9-164bf2d086c0 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Calling method '.version_select at 0x7f1f2228b040>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:37.798485 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39f3920b-ff25-4720-8f71-57723d9d4e43 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1613 microversion: 2.1 time: 2.408712 Aug 27 04:33:37.802997 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 244/498] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:35 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1613 bytes in 2414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:37.815717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c729ff2-137b-453f-8dce-e3a3c9c6a092 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:37.820595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c729ff2-137b-453f-8dce-e3a3c9c6a092 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:37.828003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c729ff2-137b-453f-8dce-e3a3c9c6a092 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:37.828681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c729ff2-137b-453f-8dce-e3a3c9c6a092 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:37.829256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c729ff2-137b-453f-8dce-e3a3c9c6a092 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:37.830620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c729ff2-137b-453f-8dce-e3a3c9c6a092 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:37.831094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c729ff2-137b-453f-8dce-e3a3c9c6a092 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:37.831403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c729ff2-137b-453f-8dce-e3a3c9c6a092 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:37.906728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61cb4746-1192-422e-98c9-164bf2d086c0 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:37.907596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61cb4746-1192-422e-98c9-164bf2d086c0 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:37.908651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61cb4746-1192-422e-98c9-164bf2d086c0 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:37.910190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61cb4746-1192-422e-98c9-164bf2d086c0 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:37.911095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61cb4746-1192-422e-98c9-164bf2d086c0 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:37.912071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61cb4746-1192-422e-98c9-164bf2d086c0 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:37.935813 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-61cb4746-1192-422e-98c9-164bf2d086c0 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/9ff49759c33a49ddae9a8598f815653e/detail" status: 200 len: 463 microversion: 2.57 time: 0.145705 Aug 27 04:33:37.936916 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 255/499] 10.222.0.79 () {60 vars in 1304 bytes} [Sat Aug 27 04:33:37 2022] GET /compute/v2.1/os-quota-sets/9ff49759c33a49ddae9a8598f815653e/detail => generated 463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:37.943055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-72cf1f9a-0bdc-423c-a4ca-e49e48fbacfc tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:37.943870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-72cf1f9a-0bdc-423c-a4ca-e49e48fbacfc tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:37.954823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72cf1f9a-0bdc-423c-a4ca-e49e48fbacfc tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:37.955605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72cf1f9a-0bdc-423c-a4ca-e49e48fbacfc tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:37.956318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72cf1f9a-0bdc-423c-a4ca-e49e48fbacfc tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:37.957226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72cf1f9a-0bdc-423c-a4ca-e49e48fbacfc tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:37.957847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72cf1f9a-0bdc-423c-a4ca-e49e48fbacfc tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:37.965396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72cf1f9a-0bdc-423c-a4ca-e49e48fbacfc tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:38.075202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-72cf1f9a-0bdc-423c-a4ca-e49e48fbacfc tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ce16e77bed80442e8bcdbd3a1712fbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24f008b1e264b1eb9f445a75a9eb777', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:38.076215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-72cf1f9a-0bdc-423c-a4ca-e49e48fbacfc tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] flavor_id is None. Assuming migration. {{(pid=128870) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 04:33:38.076950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-72cf1f9a-0bdc-423c-a4ca-e49e48fbacfc tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128870) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 04:33:38.464747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c729ff2-137b-453f-8dce-e3a3c9c6a092 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:38.480682 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c729ff2-137b-453f-8dce-e3a3c9c6a092 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1318 microversion: 2.1 time: 0.676268 Aug 27 04:33:38.482169 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 245/500] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:37 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1318 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:38.491096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-445e362e-c677-4eab-9cf1-d6beee94061b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:38.493258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-445e362e-c677-4eab-9cf1-d6beee94061b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:38.499955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-445e362e-c677-4eab-9cf1-d6beee94061b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:38.500670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-445e362e-c677-4eab-9cf1-d6beee94061b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:38.501509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-445e362e-c677-4eab-9cf1-d6beee94061b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:38.503855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-445e362e-c677-4eab-9cf1-d6beee94061b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:38.504504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-445e362e-c677-4eab-9cf1-d6beee94061b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:38.505191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-445e362e-c677-4eab-9cf1-d6beee94061b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:38.513282 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-72cf1f9a-0bdc-423c-a4ca-e49e48fbacfc tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b/action" status: 202 len: 0 microversion: 2.1 time: 0.574914 Aug 27 04:33:38.515876 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 256/501] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:33:37 2022] POST /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:38.533903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ee6fe625-5f76-4326-b447-2546673093e8 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:38.537213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ee6fe625-5f76-4326-b447-2546673093e8 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:38.555206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee6fe625-5f76-4326-b447-2546673093e8 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:38.555841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee6fe625-5f76-4326-b447-2546673093e8 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:38.556928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee6fe625-5f76-4326-b447-2546673093e8 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:38.558970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee6fe625-5f76-4326-b447-2546673093e8 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:38.561278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee6fe625-5f76-4326-b447-2546673093e8 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:38.561966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee6fe625-5f76-4326-b447-2546673093e8 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:38.896953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-445e362e-c677-4eab-9cf1-d6beee94061b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:38.931069 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-445e362e-c677-4eab-9cf1-d6beee94061b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 200 len: 1319 microversion: 2.1 time: 0.445162 Aug 27 04:33:38.934827 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 246/502] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:38 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:38.943018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ce4a8543-7e7f-4fbc-8919-e46d68abbdf4 req-d6668fea-225e-4d7c-a792-20b2d8ab080c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c4690c-4559-494b-bf63-6df014ff0adf", "tag": "9378765a-d6e8-453c-a8f8-c6d12fd79dfa"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:38.966025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce4a8543-7e7f-4fbc-8919-e46d68abbdf4 req-d6668fea-225e-4d7c-a792-20b2d8ab080c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:38.966660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce4a8543-7e7f-4fbc-8919-e46d68abbdf4 req-d6668fea-225e-4d7c-a792-20b2d8ab080c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:38.967178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce4a8543-7e7f-4fbc-8919-e46d68abbdf4 req-d6668fea-225e-4d7c-a792-20b2d8ab080c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:38.984805 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ce4a8543-7e7f-4fbc-8919-e46d68abbdf4 req-d6668fea-225e-4d7c-a792-20b2d8ab080c service nova] Creating event network-changed:9378765a-d6e8-453c-a8f8-c6d12fd79dfa for instance 64c4690c-4559-494b-bf63-6df014ff0adf on n-h2-854823-1 Aug 27 04:33:38.992820 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ce4a8543-7e7f-4fbc-8919-e46d68abbdf4 req-d6668fea-225e-4d7c-a792-20b2d8ab080c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056280 Aug 27 04:33:38.994128 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 247/503] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:39.021505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49265efc-ad8c-47bf-9ece-363a0bca6746 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Action: 'update', calling method: .version_select at 0x7f1f220730d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:39.231604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ee6fe625-5f76-4326-b447-2546673093e8 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:39.261457 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ee6fe625-5f76-4326-b447-2546673093e8 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1587 microversion: 2.1 time: 0.738739 Aug 27 04:33:39.263247 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 257/504] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:38 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1587 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:39.277681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fea15063-348f-429b-bd50-6f588d3e83cc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:39.279980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fea15063-348f-429b-bd50-6f588d3e83cc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:39.295753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fea15063-348f-429b-bd50-6f588d3e83cc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:39.300497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fea15063-348f-429b-bd50-6f588d3e83cc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:39.301293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fea15063-348f-429b-bd50-6f588d3e83cc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:39.302207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fea15063-348f-429b-bd50-6f588d3e83cc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:39.302837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fea15063-348f-429b-bd50-6f588d3e83cc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:39.303422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fea15063-348f-429b-bd50-6f588d3e83cc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:39.370404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265efc-ad8c-47bf-9ece-363a0bca6746 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:39.370922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265efc-ad8c-47bf-9ece-363a0bca6746 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:39.372017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265efc-ad8c-47bf-9ece-363a0bca6746 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:39.375034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265efc-ad8c-47bf-9ece-363a0bca6746 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:39.375785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265efc-ad8c-47bf-9ece-363a0bca6746 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:39.376675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265efc-ad8c-47bf-9ece-363a0bca6746 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:39.469932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265efc-ad8c-47bf-9ece-363a0bca6746 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:39.470668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265efc-ad8c-47bf-9ece-363a0bca6746 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:39.471608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265efc-ad8c-47bf-9ece-363a0bca6746 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:39.472956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265efc-ad8c-47bf-9ece-363a0bca6746 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:39.473708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265efc-ad8c-47bf-9ece-363a0bca6746 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:39.498268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265efc-ad8c-47bf-9ece-363a0bca6746 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:39.553531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:39.639198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fea15063-348f-429b-bd50-6f588d3e83cc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:39.648517 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fea15063-348f-429b-bd50-6f588d3e83cc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1471 microversion: 2.1 time: 0.382747 Aug 27 04:33:39.651674 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 258/505] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:39 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1471 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:39.673598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-085e0e13-74aa-4fae-8c4b-88ed24a25d71 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:39.675559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-085e0e13-74aa-4fae-8c4b-88ed24a25d71 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:39.685667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-085e0e13-74aa-4fae-8c4b-88ed24a25d71 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:39.686127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-085e0e13-74aa-4fae-8c4b-88ed24a25d71 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:39.688279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-085e0e13-74aa-4fae-8c4b-88ed24a25d71 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:39.689069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-085e0e13-74aa-4fae-8c4b-88ed24a25d71 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:39.690661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-085e0e13-74aa-4fae-8c4b-88ed24a25d71 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:39.691135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-085e0e13-74aa-4fae-8c4b-88ed24a25d71 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:39.746922 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49265efc-ad8c-47bf-9ece-363a0bca6746 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/9ff49759c33a49ddae9a8598f815653e?user_id=cff4653e9bb8490fa002e4d06e0be095" status: 200 len: 148 microversion: 2.57 time: 0.751480 Aug 27 04:33:39.753794 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 248/506] 10.222.0.79 () {62 vars in 1384 bytes} [Sat Aug 27 04:33:38 2022] PUT /compute/v2.1/os-quota-sets/9ff49759c33a49ddae9a8598f815653e?user_id=cff4653e9bb8490fa002e4d06e0be095 => generated 148 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:39.773861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bfa9033d-4e2f-401d-8ea3-34eddc32ac27 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] Calling method '.version_select at 0x7f1f221d74c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:39.979189 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bfa9033d-4e2f-401d-8ea3-34eddc32ac27 tempest-QuotasAdminTestV257-349542843 tempest-QuotasAdminTestV257-349542843-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/9ff49759c33a49ddae9a8598f815653e?user_id=cff4653e9bb8490fa002e4d06e0be095" status: 200 len: 190 microversion: 2.57 time: 0.214598 Aug 27 04:33:39.980944 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 249/507] 10.222.0.79 () {60 vars in 1364 bytes} [Sat Aug 27 04:33:39 2022] GET /compute/v2.1/os-quota-sets/9ff49759c33a49ddae9a8598f815653e?user_id=cff4653e9bb8490fa002e4d06e0be095 => generated 190 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:40.004181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9018fb53-ffa0-4e1c-a8c7-f8ca95117eca req-f53fd3d2-f015-4c93-8f8f-b4ae7e98d27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6035d8df-720d-48d2-a799-fc5275a5788e", "name": "network-vif-plugged", "status": "completed", "tag": "b201738a-d06b-42e5-8842-0dd213c52b52"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:40.018212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9018fb53-ffa0-4e1c-a8c7-f8ca95117eca req-f53fd3d2-f015-4c93-8f8f-b4ae7e98d27a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:40.018960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9018fb53-ffa0-4e1c-a8c7-f8ca95117eca req-f53fd3d2-f015-4c93-8f8f-b4ae7e98d27a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:40.019595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9018fb53-ffa0-4e1c-a8c7-f8ca95117eca req-f53fd3d2-f015-4c93-8f8f-b4ae7e98d27a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:40.057921 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9018fb53-ffa0-4e1c-a8c7-f8ca95117eca req-f53fd3d2-f015-4c93-8f8f-b4ae7e98d27a service nova] Creating event network-vif-plugged:b201738a-d06b-42e5-8842-0dd213c52b52 for instance 6035d8df-720d-48d2-a799-fc5275a5788e on n-h1-854823-1 Aug 27 04:33:40.066366 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9018fb53-ffa0-4e1c-a8c7-f8ca95117eca req-f53fd3d2-f015-4c93-8f8f-b4ae7e98d27a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080750 Aug 27 04:33:40.067823 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 250/508] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:40.077685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b4b8098-2ade-4ee3-a511-699afdb2e4d7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:40.078605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b4b8098-2ade-4ee3-a511-699afdb2e4d7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:40.087800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4b8098-2ade-4ee3-a511-699afdb2e4d7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:40.089042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4b8098-2ade-4ee3-a511-699afdb2e4d7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:40.090443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4b8098-2ade-4ee3-a511-699afdb2e4d7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:40.091351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4b8098-2ade-4ee3-a511-699afdb2e4d7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:40.092075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4b8098-2ade-4ee3-a511-699afdb2e4d7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:40.093106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4b8098-2ade-4ee3-a511-699afdb2e4d7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:40.292259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-085e0e13-74aa-4fae-8c4b-88ed24a25d71 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:40.308520 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-085e0e13-74aa-4fae-8c4b-88ed24a25d71 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1318 microversion: 2.1 time: 0.653340 Aug 27 04:33:40.323053 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 259/509] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:39 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:40.511860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b4b8098-2ade-4ee3-a511-699afdb2e4d7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:40.528165 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b4b8098-2ade-4ee3-a511-699afdb2e4d7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 200 len: 1319 microversion: 2.1 time: 0.458933 Aug 27 04:33:40.533504 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 251/510] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:40 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:40.672913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-23226223-9ed1-4f8d-ac9d-31bebb1ab223 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:40.673905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-23226223-9ed1-4f8d-ac9d-31bebb1ab223 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:40.683813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23226223-9ed1-4f8d-ac9d-31bebb1ab223 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:40.687357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23226223-9ed1-4f8d-ac9d-31bebb1ab223 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:40.691508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23226223-9ed1-4f8d-ac9d-31bebb1ab223 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:40.693172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23226223-9ed1-4f8d-ac9d-31bebb1ab223 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:40.696109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23226223-9ed1-4f8d-ac9d-31bebb1ab223 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:40.696806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23226223-9ed1-4f8d-ac9d-31bebb1ab223 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:40.984984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-23226223-9ed1-4f8d-ac9d-31bebb1ab223 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:40.988872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:40.994253 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-23226223-9ed1-4f8d-ac9d-31bebb1ab223 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1471 microversion: 2.1 time: 0.325141 Aug 27 04:33:40.994959 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 260/511] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:40 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1471 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:41.333960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a02dd90-e210-42de-af57-8d07c6dda98c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:41.334675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a02dd90-e210-42de-af57-8d07c6dda98c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:41.347120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a02dd90-e210-42de-af57-8d07c6dda98c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:41.354219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a02dd90-e210-42de-af57-8d07c6dda98c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:41.354916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a02dd90-e210-42de-af57-8d07c6dda98c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:41.359446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a02dd90-e210-42de-af57-8d07c6dda98c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:41.362045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a02dd90-e210-42de-af57-8d07c6dda98c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:41.364521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a02dd90-e210-42de-af57-8d07c6dda98c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:41.554842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d1eeccf1-7698-4cd8-b535-9361ea84b82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:41.555465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d1eeccf1-7698-4cd8-b535-9361ea84b82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:41.562477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1eeccf1-7698-4cd8-b535-9361ea84b82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:41.582843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1eeccf1-7698-4cd8-b535-9361ea84b82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:41.583623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1eeccf1-7698-4cd8-b535-9361ea84b82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:41.588922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1eeccf1-7698-4cd8-b535-9361ea84b82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:41.589672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1eeccf1-7698-4cd8-b535-9361ea84b82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:41.590329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1eeccf1-7698-4cd8-b535-9361ea84b82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:41.968170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a02dd90-e210-42de-af57-8d07c6dda98c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:41.982738 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a02dd90-e210-42de-af57-8d07c6dda98c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1318 microversion: 2.1 time: 0.653254 Aug 27 04:33:42.002922 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 252/512] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:41 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1318 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:42.027952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fdb15495-3f44-4881-b90f-e54d79c40a88 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:42.031027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fdb15495-3f44-4881-b90f-e54d79c40a88 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:42.064058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fdb15495-3f44-4881-b90f-e54d79c40a88 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:42.065256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fdb15495-3f44-4881-b90f-e54d79c40a88 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:42.070293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fdb15495-3f44-4881-b90f-e54d79c40a88 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:42.071952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fdb15495-3f44-4881-b90f-e54d79c40a88 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:42.075449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fdb15495-3f44-4881-b90f-e54d79c40a88 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:42.078491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fdb15495-3f44-4881-b90f-e54d79c40a88 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:42.218799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d1eeccf1-7698-4cd8-b535-9361ea84b82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:42.230519 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d1eeccf1-7698-4cd8-b535-9361ea84b82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 200 len: 1319 microversion: 2.1 time: 0.680058 Aug 27 04:33:42.235378 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 261/513] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:41 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 1319 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:42.261961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-28596807-6832-4c2b-88df-3e96fd0f63cf req-3a4e065c-42ad-4532-bae2-cc5942560947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1970d332-d1e0-4a16-a2b7-9c90c909b554", "name": "network-vif-plugged", "status": "completed", "tag": "6bb018be-5665-4f3e-b5ca-7e7c77aba094"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:42.295915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-28596807-6832-4c2b-88df-3e96fd0f63cf req-3a4e065c-42ad-4532-bae2-cc5942560947 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:42.296727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-28596807-6832-4c2b-88df-3e96fd0f63cf req-3a4e065c-42ad-4532-bae2-cc5942560947 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:42.297390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-28596807-6832-4c2b-88df-3e96fd0f63cf req-3a4e065c-42ad-4532-bae2-cc5942560947 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:42.328093 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-28596807-6832-4c2b-88df-3e96fd0f63cf req-3a4e065c-42ad-4532-bae2-cc5942560947 service nova] Creating event network-vif-plugged:6bb018be-5665-4f3e-b5ca-7e7c77aba094 for instance 1970d332-d1e0-4a16-a2b7-9c90c909b554 on n-h2-854823-1 Aug 27 04:33:42.343061 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-28596807-6832-4c2b-88df-3e96fd0f63cf req-3a4e065c-42ad-4532-bae2-cc5942560947 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102330 Aug 27 04:33:42.346919 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 262/514] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:42.784567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fdb15495-3f44-4881-b90f-e54d79c40a88 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:42.798228 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fdb15495-3f44-4881-b90f-e54d79c40a88 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1471 microversion: 2.1 time: 0.781314 Aug 27 04:33:42.798848 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 253/515] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:42 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1471 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:42.993414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-368620969", "imageRef": "5eecb9e1-4109-4dfa-8ee7-fc9a0cd0ab37", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c894c0d3-c825-40aa-a6ca-fe271bbf74a0"}], "security_groups": [{"name": "tempest-securitygroup--1280799827"}], "key_name": "tempest-keypair-1623762787", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:43.014137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-297f0fb2-7d37-4749-8d34-b11c3e47656b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:43.014753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-297f0fb2-7d37-4749-8d34-b11c3e47656b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:43.038785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-297f0fb2-7d37-4749-8d34-b11c3e47656b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:43.040001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-297f0fb2-7d37-4749-8d34-b11c3e47656b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:43.040772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-297f0fb2-7d37-4749-8d34-b11c3e47656b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:43.046791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-297f0fb2-7d37-4749-8d34-b11c3e47656b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:43.047498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-297f0fb2-7d37-4749-8d34-b11c3e47656b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:43.048172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-297f0fb2-7d37-4749-8d34-b11c3e47656b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:43.261452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] validate_networks() for [('c894c0d3-c825-40aa-a6ca-fe271bbf74a0', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:33:43.563914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-297f0fb2-7d37-4749-8d34-b11c3e47656b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:43.573547 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-297f0fb2-7d37-4749-8d34-b11c3e47656b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1468 microversion: 2.1 time: 0.563137 Aug 27 04:33:43.574167 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 254/516] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:43 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1468 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:43.606489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da4311b0-ace9-4f99-8183-0843c5e272f4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:43.607501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da4311b0-ace9-4f99-8183-0843c5e272f4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:43.630611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da4311b0-ace9-4f99-8183-0843c5e272f4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:43.634255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da4311b0-ace9-4f99-8183-0843c5e272f4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:43.635007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da4311b0-ace9-4f99-8183-0843c5e272f4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:43.639315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da4311b0-ace9-4f99-8183-0843c5e272f4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:43.640239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da4311b0-ace9-4f99-8183-0843c5e272f4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:43.641956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da4311b0-ace9-4f99-8183-0843c5e272f4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:44.014962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da4311b0-ace9-4f99-8183-0843c5e272f4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:44.043968 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da4311b0-ace9-4f99-8183-0843c5e272f4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 200 len: 1319 microversion: 2.1 time: 0.448993 Aug 27 04:33:44.048060 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 255/517] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:43 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:44.397354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:33:44.397841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:33:44.398238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:33:44.398648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:33:44.399067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:33:44.410331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:44.410856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:44.411301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:44.412040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:44.412730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:44.413995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:44.439161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Getting quotas for project 21c5a62d0711490081fe3d1e1fa0a1fb. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:44.447353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Getting quotas for user 2523cdbb4f3444afb648340a73e85025 and project 21c5a62d0711490081fe3d1e1fa0a1fb. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:44.463596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-67a789e6-33e1-4e05-ae12-1d58f5714a51 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:44.463838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:33:44.466332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5eecb9e1-4109-4dfa-8ee7-fc9a0cd0ab37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:33:44.467422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67a789e6-33e1-4e05-ae12-1d58f5714a51 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:44.467913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67a789e6-33e1-4e05-ae12-1d58f5714a51 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:44.468343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67a789e6-33e1-4e05-ae12-1d58f5714a51 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:44.469112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67a789e6-33e1-4e05-ae12-1d58f5714a51 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:44.470983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67a789e6-33e1-4e05-ae12-1d58f5714a51 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:44.471441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67a789e6-33e1-4e05-ae12-1d58f5714a51 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:44.506388 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-67a789e6-33e1-4e05-ae12-1d58f5714a51 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.455113 Aug 27 04:33:44.510203 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 256/518] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:33:44 2022] GET /compute/v2.1/os-services => generated 944 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:44.510374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:44.523337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-71be995c-4e40-45f4-b17f-da19d96932b8 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:44.524479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-71be995c-4e40-45f4-b17f-da19d96932b8 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:44.536822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71be995c-4e40-45f4-b17f-da19d96932b8 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:44.537538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71be995c-4e40-45f4-b17f-da19d96932b8 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:44.538435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71be995c-4e40-45f4-b17f-da19d96932b8 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:44.539341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71be995c-4e40-45f4-b17f-da19d96932b8 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:44.539831 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e8744ce-c97b-4eda-94d8-4b20ba886a25 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.553327 Aug 27 04:33:44.540486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71be995c-4e40-45f4-b17f-da19d96932b8 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:44.541227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71be995c-4e40-45f4-b17f-da19d96932b8 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:44.552942 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 263/519] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:33:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:33:44.560092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-97c1385c-4b67-45b1-86aa-b3fde5d666d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:44.561093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-97c1385c-4b67-45b1-86aa-b3fde5d666d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:44.570651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97c1385c-4b67-45b1-86aa-b3fde5d666d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:44.571575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97c1385c-4b67-45b1-86aa-b3fde5d666d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:44.572550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97c1385c-4b67-45b1-86aa-b3fde5d666d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:44.573683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97c1385c-4b67-45b1-86aa-b3fde5d666d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:44.574606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97c1385c-4b67-45b1-86aa-b3fde5d666d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:44.575687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97c1385c-4b67-45b1-86aa-b3fde5d666d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:44.577635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-71be995c-4e40-45f4-b17f-da19d96932b8 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lazy-loading 'flavor' on Instance uuid 6035d8df-720d-48d2-a799-fc5275a5788e {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:33:44.732570 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-71be995c-4e40-45f4-b17f-da19d96932b8 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e/action" status: 202 len: 0 microversion: 2.1 time: 0.216753 Aug 27 04:33:44.733472 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 257/520] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:33:44 2022] POST /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:44.739321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d27a514d-d6e9-40d9-8626-aa6f7e6ce5f6 req-9818f6c5-9462-42cb-b69b-9a02a6aedb85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20337dd0-bb88-4f11-85be-ec44de54c9da", "name": "network-vif-plugged", "status": "completed", "tag": "5387b19f-5d63-4ca8-ab0a-71da1b793383"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:44.753923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d27a514d-d6e9-40d9-8626-aa6f7e6ce5f6 req-9818f6c5-9462-42cb-b69b-9a02a6aedb85 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:44.754584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d27a514d-d6e9-40d9-8626-aa6f7e6ce5f6 req-9818f6c5-9462-42cb-b69b-9a02a6aedb85 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:44.755178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d27a514d-d6e9-40d9-8626-aa6f7e6ce5f6 req-9818f6c5-9462-42cb-b69b-9a02a6aedb85 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:44.777605 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d27a514d-d6e9-40d9-8626-aa6f7e6ce5f6 req-9818f6c5-9462-42cb-b69b-9a02a6aedb85 service nova] Creating event network-vif-plugged:5387b19f-5d63-4ca8-ab0a-71da1b793383 for instance 20337dd0-bb88-4f11-85be-ec44de54c9da on n-h2-854823-1 Aug 27 04:33:44.783000 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d27a514d-d6e9-40d9-8626-aa6f7e6ce5f6 req-9818f6c5-9462-42cb-b69b-9a02a6aedb85 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047877 Aug 27 04:33:44.783918 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 258/521] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:44.790262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77e05db5-9a53-4087-a0f0-fc4a5fc8d037 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:44.794560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77e05db5-9a53-4087-a0f0-fc4a5fc8d037 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:44.795852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77e05db5-9a53-4087-a0f0-fc4a5fc8d037 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:44.797012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77e05db5-9a53-4087-a0f0-fc4a5fc8d037 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:44.798206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77e05db5-9a53-4087-a0f0-fc4a5fc8d037 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:44.799442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77e05db5-9a53-4087-a0f0-fc4a5fc8d037 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:44.800052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77e05db5-9a53-4087-a0f0-fc4a5fc8d037 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:44.886232 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77e05db5-9a53-4087-a0f0-fc4a5fc8d037 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.098869 Aug 27 04:33:44.887021 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 259/522] 10.222.0.79 () {58 vars in 1170 bytes} [Sat Aug 27 04:33:44 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:44.902681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2aca51a7-382b-4467-9855-9e60ca859262 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:44.912233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2aca51a7-382b-4467-9855-9e60ca859262 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:45.121718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2aca51a7-382b-4467-9855-9e60ca859262 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:45.132919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-97c1385c-4b67-45b1-86aa-b3fde5d666d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:45.134510 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2aca51a7-382b-4467-9855-9e60ca859262 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1245 microversion: 2.1 time: 0.244509 Aug 27 04:33:45.137817 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 260/523] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:44 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1245 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:45.146399 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-97c1385c-4b67-45b1-86aa-b3fde5d666d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1471 microversion: 2.1 time: 0.590642 Aug 27 04:33:45.149676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e279bbb-5502-46f4-b330-8fd5cb54b85c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:45.152970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e279bbb-5502-46f4-b330-8fd5cb54b85c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:45.167529 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 264/524] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:44 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1471 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:45.170771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e279bbb-5502-46f4-b330-8fd5cb54b85c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:45.181212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e279bbb-5502-46f4-b330-8fd5cb54b85c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:45.182447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e279bbb-5502-46f4-b330-8fd5cb54b85c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:45.184771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e279bbb-5502-46f4-b330-8fd5cb54b85c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:45.187913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e279bbb-5502-46f4-b330-8fd5cb54b85c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:45.189755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e279bbb-5502-46f4-b330-8fd5cb54b85c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:45.193432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-21ea7d6a-5d34-4a82-bf00-b10ba4e543e9 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:45.206108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21ea7d6a-5d34-4a82-bf00-b10ba4e543e9 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:45.207971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21ea7d6a-5d34-4a82-bf00-b10ba4e543e9 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:45.209346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21ea7d6a-5d34-4a82-bf00-b10ba4e543e9 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:45.212748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21ea7d6a-5d34-4a82-bf00-b10ba4e543e9 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:45.213325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21ea7d6a-5d34-4a82-bf00-b10ba4e543e9 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:45.215298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21ea7d6a-5d34-4a82-bf00-b10ba4e543e9 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:45.289555 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-21ea7d6a-5d34-4a82-bf00-b10ba4e543e9 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.114043 Aug 27 04:33:45.291247 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 265/525] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:33:45 2022] GET /compute/v2.1/os-services => generated 944 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:45.312957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f738a2a3-ef7a-4af5-b3ea-6786a47f08fa tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:45.313822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f738a2a3-ef7a-4af5-b3ea-6786a47f08fa tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:45.321492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f738a2a3-ef7a-4af5-b3ea-6786a47f08fa tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:45.322358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f738a2a3-ef7a-4af5-b3ea-6786a47f08fa tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:45.323185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f738a2a3-ef7a-4af5-b3ea-6786a47f08fa tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:45.324476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f738a2a3-ef7a-4af5-b3ea-6786a47f08fa tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:45.325265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f738a2a3-ef7a-4af5-b3ea-6786a47f08fa tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:45.325885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f738a2a3-ef7a-4af5-b3ea-6786a47f08fa tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:45.497985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4e279bbb-5502-46f4-b330-8fd5cb54b85c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:45.510348 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e279bbb-5502-46f4-b330-8fd5cb54b85c tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1476 microversion: 2.1 time: 0.370083 Aug 27 04:33:45.511505 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 261/526] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:45 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1476 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:45.516803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3739b00-7223-4d6e-8fc8-d41eb50f4866 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:45.521304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3739b00-7223-4d6e-8fc8-d41eb50f4866 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:45.522056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3739b00-7223-4d6e-8fc8-d41eb50f4866 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:45.523152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3739b00-7223-4d6e-8fc8-d41eb50f4866 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:45.524093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3739b00-7223-4d6e-8fc8-d41eb50f4866 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:45.526174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3739b00-7223-4d6e-8fc8-d41eb50f4866 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:45.526174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3739b00-7223-4d6e-8fc8-d41eb50f4866 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:45.562105 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3739b00-7223-4d6e-8fc8-d41eb50f4866 tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=n-d-854823-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.049083 Aug 27 04:33:45.572350 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 262/527] 10.222.0.79 () {58 vars in 1194 bytes} [Sat Aug 27 04:33:45 2022] GET /compute/v2.1/os-services?host=n-d-854823-1&binary=xxx => generated 16 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:33:45.577947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4490fdb6-2b8e-46d1-a800-fbf629a7dced tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:45.582171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4490fdb6-2b8e-46d1-a800-fbf629a7dced tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:45.582659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4490fdb6-2b8e-46d1-a800-fbf629a7dced tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:45.583090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4490fdb6-2b8e-46d1-a800-fbf629a7dced tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:45.584055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4490fdb6-2b8e-46d1-a800-fbf629a7dced tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:45.584641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4490fdb6-2b8e-46d1-a800-fbf629a7dced tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:45.585068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4490fdb6-2b8e-46d1-a800-fbf629a7dced tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:45.663922 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4490fdb6-2b8e-46d1-a800-fbf629a7dced tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.089411 Aug 27 04:33:45.665198 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 263/528] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:33:45 2022] GET /compute/v2.1/os-services => generated 944 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:45.677894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f415851e-b3ef-4f18-b788-92439283a53e tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:45.682919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f415851e-b3ef-4f18-b788-92439283a53e tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:45.683801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f415851e-b3ef-4f18-b788-92439283a53e tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:45.685206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f415851e-b3ef-4f18-b788-92439283a53e tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:45.686538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f415851e-b3ef-4f18-b788-92439283a53e tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:45.687171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f415851e-b3ef-4f18-b788-92439283a53e tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:45.687776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f415851e-b3ef-4f18-b788-92439283a53e tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:45.719157 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f415851e-b3ef-4f18-b788-92439283a53e tempest-ServicesAdminNegativeTestJSON-1378968435 tempest-ServicesAdminNegativeTestJSON-1378968435-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.044752 Aug 27 04:33:45.720041 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 264/529] 10.222.0.79 () {58 vars in 1198 bytes} [Sat Aug 27 04:33:45 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:33:45.828760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f738a2a3-ef7a-4af5-b3ea-6786a47f08fa tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:45.838563 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f738a2a3-ef7a-4af5-b3ea-6786a47f08fa tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 200 len: 1468 microversion: 2.1 time: 0.545951 Aug 27 04:33:45.853459 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 266/530] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:45 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 1468 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:45.861123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-561d8560-2691-4805-a68b-b0befbd5cca6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:45.862432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-561d8560-2691-4805-a68b-b0befbd5cca6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 20337dd0-bb88-4f11-85be-ec44de54c9da] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:45.873899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-561d8560-2691-4805-a68b-b0befbd5cca6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:45.875734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-561d8560-2691-4805-a68b-b0befbd5cca6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:45.876936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-561d8560-2691-4805-a68b-b0befbd5cca6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:45.879485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-561d8560-2691-4805-a68b-b0befbd5cca6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:45.885845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-561d8560-2691-4805-a68b-b0befbd5cca6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:45.890310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-561d8560-2691-4805-a68b-b0befbd5cca6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:46.100281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9b3215e4-9e11-4db3-a98c-5b89b22e32cc tempest-ServicesAdminNegativeTestJSON-1507746759 tempest-ServicesAdminNegativeTestJSON-1507746759-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:46.104476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b3215e4-9e11-4db3-a98c-5b89b22e32cc tempest-ServicesAdminNegativeTestJSON-1507746759 tempest-ServicesAdminNegativeTestJSON-1507746759-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '2edb034b651649b8a76aada0ca4b5b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60c73f6615240dc9eca1080c806cd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9b3215e4-9e11-4db3-a98c-5b89b22e32cc tempest-ServicesAdminNegativeTestJSON-1507746759 tempest-ServicesAdminNegativeTestJSON-1507746759-project] Request method failure captured: Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ6mvPOIu1xp7XKqgB5u8bX7Ukz8c3QhjVN17wKU8fehCcV6Bh1I28M3htzyxTcvxrhOxyG7x8Np5vdKl5DvfTOZVa0lMwTXZ5wFS2SjWOjfU_yyMVGkkSR52c-IOJvmxqhKadO79zt7Vsn9LUa4vvLNpOaHpq51HTIHec3V3CeA_0k Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: c60c73f6615240dc9eca1080c806cd3b Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1507746759 Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:33:46.113380 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:33:46.114801 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c60c73f6615240dc9eca1080c806cd3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c60c73f6615240dc9eca1080c806cd3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c60c73f6615240dc9eca1080c806cd3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c60c73f6615240dc9eca1080c806cd3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:46.114801 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1507746759 Aug 27 04:33:46.114801 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: c60c73f6615240dc9eca1080c806cd3b Aug 27 04:33:46.114801 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1507746759 Aug 27 04:33:46.114801 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServicesAdminNegativeTestJSON-1507746759-project Aug 27 04:33:46.114801 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:33:46.114801 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:33:46.114801 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 2edb034b651649b8a76aada0ca4b5b6c Aug 27 04:33:46.114801 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1507746759-project Aug 27 04:33:46.114801 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:33:46.114801 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 04:33:46.114801 n-d-854823-1 devstack@n-api.service[128869]: action_args: {} Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:33:46.120561 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 04:33:46.121748 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:46.123964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9b3215e4-9e11-4db3-a98c-5b89b22e32cc tempest-ServicesAdminNegativeTestJSON-1507746759 tempest-ServicesAdminNegativeTestJSON-1507746759-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:46.123964 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9b3215e4-9e11-4db3-a98c-5b89b22e32cc tempest-ServicesAdminNegativeTestJSON-1507746759 tempest-ServicesAdminNegativeTestJSON-1507746759-project] 10.222.0.79 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.385859 Aug 27 04:33:46.123964 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 265/531] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:33:45 2022] GET /compute/v2.1/os-services => generated 112 bytes in 387 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:46.157570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-242079c2-f31b-4a98-8615-a7095ec592e8 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:46.158182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-242079c2-f31b-4a98-8615-a7095ec592e8 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:46.169937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-242079c2-f31b-4a98-8615-a7095ec592e8 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:46.170448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-242079c2-f31b-4a98-8615-a7095ec592e8 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:46.173090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-242079c2-f31b-4a98-8615-a7095ec592e8 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:46.173836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-242079c2-f31b-4a98-8615-a7095ec592e8 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:46.174378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-242079c2-f31b-4a98-8615-a7095ec592e8 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:46.176873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-242079c2-f31b-4a98-8615-a7095ec592e8 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:46.289555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-242079c2-f31b-4a98-8615-a7095ec592e8 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:46.305801 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-242079c2-f31b-4a98-8615-a7095ec592e8 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1297 microversion: 2.1 time: 0.151902 Aug 27 04:33:46.314795 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 266/532] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:46 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1297 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:46.327743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75d894d0-5d5f-4b06-9f6d-aa17ce7568c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:46.328360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75d894d0-5d5f-4b06-9f6d-aa17ce7568c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:46.341515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:46.343910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d894d0-5d5f-4b06-9f6d-aa17ce7568c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:46.345315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d894d0-5d5f-4b06-9f6d-aa17ce7568c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:46.349989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d894d0-5d5f-4b06-9f6d-aa17ce7568c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:46.351565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d894d0-5d5f-4b06-9f6d-aa17ce7568c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:46.354705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d894d0-5d5f-4b06-9f6d-aa17ce7568c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:46.355353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d894d0-5d5f-4b06-9f6d-aa17ce7568c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:46.407883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-561d8560-2691-4805-a68b-b0befbd5cca6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:46.418971 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-561d8560-2691-4805-a68b-b0befbd5cca6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da" status: 200 len: 1319 microversion: 2.1 time: 0.561721 Aug 27 04:33:46.433125 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 267/533] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:45 2022] GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da => generated 1319 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:46.560922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6277cde7-996e-49f0-a5cf-1068482d4f5b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:46.562600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6277cde7-996e-49f0-a5cf-1068482d4f5b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:46.573230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6277cde7-996e-49f0-a5cf-1068482d4f5b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:46.573727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6277cde7-996e-49f0-a5cf-1068482d4f5b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:46.574266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6277cde7-996e-49f0-a5cf-1068482d4f5b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:46.574978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6277cde7-996e-49f0-a5cf-1068482d4f5b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:46.575435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6277cde7-996e-49f0-a5cf-1068482d4f5b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:46.575858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6277cde7-996e-49f0-a5cf-1068482d4f5b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:46.699415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75d894d0-5d5f-4b06-9f6d-aa17ce7568c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:46.714198 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75d894d0-5d5f-4b06-9f6d-aa17ce7568c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1476 microversion: 2.1 time: 0.395185 Aug 27 04:33:46.715829 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 267/534] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:46 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:46.881387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6277cde7-996e-49f0-a5cf-1068482d4f5b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:46.892129 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6277cde7-996e-49f0-a5cf-1068482d4f5b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1459 microversion: 2.1 time: 0.342216 Aug 27 04:33:46.894391 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 268/535] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:46 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1459 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:46.915210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-00d17ca8-e4cd-4ff3-92f4-b31b6665d445 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:46.916153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-00d17ca8-e4cd-4ff3-92f4-b31b6665d445 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:46.924347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00d17ca8-e4cd-4ff3-92f4-b31b6665d445 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:46.925558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00d17ca8-e4cd-4ff3-92f4-b31b6665d445 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:46.926208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00d17ca8-e4cd-4ff3-92f4-b31b6665d445 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:46.927229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00d17ca8-e4cd-4ff3-92f4-b31b6665d445 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:46.928577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00d17ca8-e4cd-4ff3-92f4-b31b6665d445 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:46.929555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00d17ca8-e4cd-4ff3-92f4-b31b6665d445 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:47.328216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-90c95bd8-3a2e-44b7-b884-e293d19478d9 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:47.329196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-90c95bd8-3a2e-44b7-b884-e293d19478d9 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:47.335723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90c95bd8-3a2e-44b7-b884-e293d19478d9 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:47.349341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90c95bd8-3a2e-44b7-b884-e293d19478d9 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:47.350160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90c95bd8-3a2e-44b7-b884-e293d19478d9 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:47.351732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90c95bd8-3a2e-44b7-b884-e293d19478d9 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:47.352434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90c95bd8-3a2e-44b7-b884-e293d19478d9 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:47.353103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90c95bd8-3a2e-44b7-b884-e293d19478d9 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:47.631387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-90c95bd8-3a2e-44b7-b884-e293d19478d9 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:47.651934 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-90c95bd8-3a2e-44b7-b884-e293d19478d9 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1303 microversion: 2.1 time: 0.325097 Aug 27 04:33:47.653718 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 269/536] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:47 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1303 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:47.679834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-281d036c-d602-4a74-a0c7-da7fd1f30165 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:47.680465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-281d036c-d602-4a74-a0c7-da7fd1f30165 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 20337dd0-bb88-4f11-85be-ec44de54c9da] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:47.704716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-281d036c-d602-4a74-a0c7-da7fd1f30165 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:47.705648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-281d036c-d602-4a74-a0c7-da7fd1f30165 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:47.707880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-281d036c-d602-4a74-a0c7-da7fd1f30165 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:47.709003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-281d036c-d602-4a74-a0c7-da7fd1f30165 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:47.712087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-281d036c-d602-4a74-a0c7-da7fd1f30165 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:47.712921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-281d036c-d602-4a74-a0c7-da7fd1f30165 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:48.224690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-281d036c-d602-4a74-a0c7-da7fd1f30165 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:48.238166 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-281d036c-d602-4a74-a0c7-da7fd1f30165 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da" status: 200 len: 1469 microversion: 2.1 time: 0.581709 Aug 27 04:33:48.245966 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 270/537] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:47 2022] GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da => generated 1469 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:48.254653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-87218e62-f682-4f2f-ad35-137721b5463a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:48.265985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-87218e62-f682-4f2f-ad35-137721b5463a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:48.281682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87218e62-f682-4f2f-ad35-137721b5463a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:48.282192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87218e62-f682-4f2f-ad35-137721b5463a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:48.283969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87218e62-f682-4f2f-ad35-137721b5463a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:48.285688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87218e62-f682-4f2f-ad35-137721b5463a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:48.293593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87218e62-f682-4f2f-ad35-137721b5463a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:48.294309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87218e62-f682-4f2f-ad35-137721b5463a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:48.637109 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-00d17ca8-e4cd-4ff3-92f4-b31b6665d445 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1610 microversion: 2.1 time: 1.726438 Aug 27 04:33:48.657010 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 268/538] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:46 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1610 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:48.665936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:48.680795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:48.683907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Searching by: {'reservation_id': 'r-b78zni69', 'deleted': False, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:33:48.695760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:48.697534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:48.699321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:48.701055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:48.703223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:48.704826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:48.935746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:33:49.034292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-87218e62-f682-4f2f-ad35-137721b5463a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:49.064191 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-87218e62-f682-4f2f-ad35-137721b5463a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1476 microversion: 2.1 time: 0.798318 Aug 27 04:33:49.066040 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 271/539] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:48 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1476 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:49.088312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-83cd5917-e2cd-48c5-a1b6-d2f0605f1b5d tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:49.104767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83cd5917-e2cd-48c5-a1b6-d2f0605f1b5d tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:49.105262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83cd5917-e2cd-48c5-a1b6-d2f0605f1b5d tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:49.110368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83cd5917-e2cd-48c5-a1b6-d2f0605f1b5d tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:49.111645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83cd5917-e2cd-48c5-a1b6-d2f0605f1b5d tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:49.115695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83cd5917-e2cd-48c5-a1b6-d2f0605f1b5d tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:49.117248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83cd5917-e2cd-48c5-a1b6-d2f0605f1b5d tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:49.175534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:49.195299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:49.196052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:49.196746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:49.222292 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-83cd5917-e2cd-48c5-a1b6-d2f0605f1b5d tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.144641 Aug 27 04:33:49.232904 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 272/540] 10.222.0.79 () {58 vars in 1176 bytes} [Sat Aug 27 04:33:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:49.241520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aa974978-b45c-4ec6-a714-063b6280e6ec tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:49.242148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aa974978-b45c-4ec6-a714-063b6280e6ec tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:49.263979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa974978-b45c-4ec6-a714-063b6280e6ec tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:49.264482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa974978-b45c-4ec6-a714-063b6280e6ec tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:49.264956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa974978-b45c-4ec6-a714-063b6280e6ec tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:49.265676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa974978-b45c-4ec6-a714-063b6280e6ec tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:49.266187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa974978-b45c-4ec6-a714-063b6280e6ec tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:49.266617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa974978-b45c-4ec6-a714-063b6280e6ec tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:49.840254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aa974978-b45c-4ec6-a714-063b6280e6ec tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:49.855609 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aa974978-b45c-4ec6-a714-063b6280e6ec tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1303 microversion: 2.1 time: 0.621479 Aug 27 04:33:49.870873 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 273/541] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:49 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1303 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:49.878821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc3f91b1-9629-400e-9d13-aa16538f4224 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854823-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:49.888396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bc3f91b1-9629-400e-9d13-aa16538f4224 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:49.898385 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92c16088-a4f5-49b2-9421-95cb270aaac1 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?reservation_id=r-b78zni69" status: 200 len: 2930 microversion: 2.1 time: 1.240092 Aug 27 04:33:49.900401 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 269/542] 10.222.0.79 () {58 vars in 1197 bytes} [Sat Aug 27 04:33:48 2022] GET /compute/v2.1/servers/detail?reservation_id=r-b78zni69 => generated 2930 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:49.924355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc3f91b1-9629-400e-9d13-aa16538f4224 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:49.930159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc3f91b1-9629-400e-9d13-aa16538f4224 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:49.934161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc3f91b1-9629-400e-9d13-aa16538f4224 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:49.935185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc3f91b1-9629-400e-9d13-aa16538f4224 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:49.935934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc3f91b1-9629-400e-9d13-aa16538f4224 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:49.936581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc3f91b1-9629-400e-9d13-aa16538f4224 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:49.936843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-00c4406b-692f-4d58-9662-b77bf5580229 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:49.956954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.compute.server_groups [None req-00c4406b-692f-4d58-9662-b77bf5580229 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Querying cell e7bc291f-2aa3-4d66-a942-e096e031ad4c(cell1) for 2 instances {{(pid=128869) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 04:33:49.957877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00c4406b-692f-4d58-9662-b77bf5580229 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:49.958434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00c4406b-692f-4d58-9662-b77bf5580229 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:49.959078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00c4406b-692f-4d58-9662-b77bf5580229 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:49.994266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-bc3f91b1-9629-400e-9d13-aa16538f4224 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Lazy-loading 'flavor' on Instance uuid 6035d8df-720d-48d2-a799-fc5275a5788e {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:33:50.032181 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-00c4406b-692f-4d58-9662-b77bf5580229 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/d75f5344-ce42-41f1-ac8c-29ac8338dd84" status: 200 len: 265 microversion: 2.1 time: 0.105891 Aug 27 04:33:50.033476 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 270/543] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:33:49 2022] GET /compute/v2.1/os-server-groups/d75f5344-ce42-41f1-ac8c-29ac8338dd84 => generated 265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:50.045756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf3ab144-5757-48f7-9dc0-2b0da1bd3e8d tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:50.047485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf3ab144-5757-48f7-9dc0-2b0da1bd3e8d tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:50.049424 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-bc3f91b1-9629-400e-9d13-aa16538f4224 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 6035d8df-720d-48d2-a799-fc5275a5788e while it is in vm_state suspended Aug 27 04:33:50.055883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3ab144-5757-48f7-9dc0-2b0da1bd3e8d tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:50.056853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3ab144-5757-48f7-9dc0-2b0da1bd3e8d tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:50.057542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3ab144-5757-48f7-9dc0-2b0da1bd3e8d tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:50.058657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3ab144-5757-48f7-9dc0-2b0da1bd3e8d tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:50.059392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3ab144-5757-48f7-9dc0-2b0da1bd3e8d tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:50.060029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3ab144-5757-48f7-9dc0-2b0da1bd3e8d tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc3f91b1-9629-400e-9d13-aa16538f4224 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Request method failure captured: Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e/action HTTP/1.1 Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 97 Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5sKyDGbZWS6BOCwjpiHf-hPlC96RG6XYfdeCFT7qDy9yszD-Cgitt2z047mleYHQQcZW_5-CbhH8cVZKSC06zHoM7M9X0axzrUaFJzgqtzXroFQeyVEZ0azmMcp2cmp83I_FHIUw9XZcWUBB3hPkFaYc2nbrhz31vO5HLzgWTNaUg Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 6954aec770e24a278544abddc129d307 Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-LiveMigrationNegativeTest-1468990994 Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:33:50.061787 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:33:50.063145 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6954aec770e24a278544abddc129d307"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6954aec770e24a278544abddc129d307"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6954aec770e24a278544abddc129d307"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6954aec770e24a278544abddc129d307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:50.063145 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-LiveMigrationNegativeTest-1468990994 Aug 27 04:33:50.063145 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 6954aec770e24a278544abddc129d307 Aug 27 04:33:50.063145 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1468990994 Aug 27 04:33:50.063145 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-LiveMigrationNegativeTest-1468990994-project-admin Aug 27 04:33:50.063145 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:33:50.063145 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:33:50.063145 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 05fd00f530cc4680a9390c32b93075c2 Aug 27 04:33:50.063145 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-LiveMigrationNegativeTest-1468990994-project-admin Aug 27 04:33:50.063145 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:33:50.063145 n-d-854823-1 devstack@n-api.service[128870]: {"os-migrateLive": {"host": "n-h2-854823-1", "block_migration": true, "disk_over_commit": false}} Aug 27 04:33:50.063145 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: exception: Cannot 'os-migrateLive' instance 6035d8df-720d-48d2-a799-fc5275a5788e while it is in vm_state suspended Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '6035d8df-720d-48d2-a799-fc5275a5788e', 'body': {'os-migrateLive': {'host': 'n-h2-854823-1', 'block_migration': True, 'disk_over_commit': False}}} Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 04:33:50.063881 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6035d8df-720d-48d2-a799-fc5275a5788e in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:33:50.065251 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 6035d8df-720d-48d2-a799-fc5275a5788e while it is in vm_state suspended Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 6035d8df-720d-48d2-a799-fc5275a5788e while it is in vm_state suspended Aug 27 04:33:50.066488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:50.070511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc3f91b1-9629-400e-9d13-aa16538f4224 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 6035d8df-720d-48d2-a799-fc5275a5788e while it is in vm_state suspended {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:50.070511 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bc3f91b1-9629-400e-9d13-aa16538f4224 tempest-LiveMigrationNegativeTest-1468990994 tempest-LiveMigrationNegativeTest-1468990994-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e/action" status: 409 len: 155 microversion: 2.1 time: 0.189465 Aug 27 04:33:50.070511 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 274/544] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:33:49 2022] POST /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e/action => generated 155 bytes in 192 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:33:50.073677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:50.083029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99714859-eb6f-41e9-89ae-e1092dcc2e39 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:50.083542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-99714859-eb6f-41e9-89ae-e1092dcc2e39 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:50.113396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99714859-eb6f-41e9-89ae-e1092dcc2e39 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:50.113971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99714859-eb6f-41e9-89ae-e1092dcc2e39 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:50.114323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99714859-eb6f-41e9-89ae-e1092dcc2e39 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:50.115044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99714859-eb6f-41e9-89ae-e1092dcc2e39 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:50.115502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99714859-eb6f-41e9-89ae-e1092dcc2e39 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:50.116002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99714859-eb6f-41e9-89ae-e1092dcc2e39 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:50.187727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-99714859-eb6f-41e9-89ae-e1092dcc2e39 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:33:50.397575 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-99714859-eb6f-41e9-89ae-e1092dcc2e39 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 204 len: 0 microversion: 2.1 time: 0.320622 Aug 27 04:33:50.401424 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 275/545] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:33:50 2022] DELETE /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:33:50.406958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53f12cb3-89ee-48c0-8f24-689844c137a5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:50.407926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-53f12cb3-89ee-48c0-8f24-689844c137a5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:50.422385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53f12cb3-89ee-48c0-8f24-689844c137a5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:50.425026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53f12cb3-89ee-48c0-8f24-689844c137a5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:50.425581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53f12cb3-89ee-48c0-8f24-689844c137a5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:50.427672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53f12cb3-89ee-48c0-8f24-689844c137a5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:50.431167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53f12cb3-89ee-48c0-8f24-689844c137a5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:50.433524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53f12cb3-89ee-48c0-8f24-689844c137a5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:50.807089 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf3ab144-5757-48f7-9dc0-2b0da1bd3e8d tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 200 len: 1619 microversion: 2.1 time: 0.764939 Aug 27 04:33:50.824214 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 271/546] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:50 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 1619 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:50.824214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d818bc45-dc6f-44b4-8ac7-281a2a2fe262 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:50.824214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d818bc45-dc6f-44b4-8ac7-281a2a2fe262 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:50.830765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d818bc45-dc6f-44b4-8ac7-281a2a2fe262 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:50.831326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d818bc45-dc6f-44b4-8ac7-281a2a2fe262 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:50.831745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d818bc45-dc6f-44b4-8ac7-281a2a2fe262 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:50.832680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d818bc45-dc6f-44b4-8ac7-281a2a2fe262 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:50.833142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d818bc45-dc6f-44b4-8ac7-281a2a2fe262 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:50.833568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d818bc45-dc6f-44b4-8ac7-281a2a2fe262 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:50.893265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53f12cb3-89ee-48c0-8f24-689844c137a5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:50.911166 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-53f12cb3-89ee-48c0-8f24-689844c137a5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1476 microversion: 2.1 time: 0.508314 Aug 27 04:33:50.911762 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 276/547] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:50 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1476 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:50.923002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fcb3c0b0-2260-4b4c-b210-3136f44973d2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:50.923910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fcb3c0b0-2260-4b4c-b210-3136f44973d2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] [instance: 20337dd0-bb88-4f11-85be-ec44de54c9da] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:50.941446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb3c0b0-2260-4b4c-b210-3136f44973d2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:50.941952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb3c0b0-2260-4b4c-b210-3136f44973d2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:50.942468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb3c0b0-2260-4b4c-b210-3136f44973d2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:50.943123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb3c0b0-2260-4b4c-b210-3136f44973d2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:50.943650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb3c0b0-2260-4b4c-b210-3136f44973d2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:50.944796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb3c0b0-2260-4b4c-b210-3136f44973d2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:51.169327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d818bc45-dc6f-44b4-8ac7-281a2a2fe262 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:51.183425 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d818bc45-dc6f-44b4-8ac7-281a2a2fe262 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1465 microversion: 2.1 time: 0.371188 Aug 27 04:33:51.184376 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 272/548] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:50 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1465 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:51.198891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89aa38f3-eb35-4538-9669-92ac0a80d383 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:51.199741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89aa38f3-eb35-4538-9669-92ac0a80d383 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:51.212084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89aa38f3-eb35-4538-9669-92ac0a80d383 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:51.212750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89aa38f3-eb35-4538-9669-92ac0a80d383 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:51.230343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89aa38f3-eb35-4538-9669-92ac0a80d383 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:51.247090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89aa38f3-eb35-4538-9669-92ac0a80d383 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:51.249529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89aa38f3-eb35-4538-9669-92ac0a80d383 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:51.252334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89aa38f3-eb35-4538-9669-92ac0a80d383 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:51.911008 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fcb3c0b0-2260-4b4c-b210-3136f44973d2 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da" status: 200 len: 1620 microversion: 2.1 time: 0.997951 Aug 27 04:33:51.916621 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 277/549] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:50 2022] GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da => generated 1620 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:51.940760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-34e23aca-24ba-4009-b80a-02bbf1c39c4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:51.945920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-34e23aca-24ba-4009-b80a-02bbf1c39c4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:51.971635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34e23aca-24ba-4009-b80a-02bbf1c39c4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:51.973944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34e23aca-24ba-4009-b80a-02bbf1c39c4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:51.974687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34e23aca-24ba-4009-b80a-02bbf1c39c4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:51.981453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34e23aca-24ba-4009-b80a-02bbf1c39c4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:51.982251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34e23aca-24ba-4009-b80a-02bbf1c39c4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:51.984033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34e23aca-24ba-4009-b80a-02bbf1c39c4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:52.069929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:52.086177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89aa38f3-eb35-4538-9669-92ac0a80d383 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:52.103207 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89aa38f3-eb35-4538-9669-92ac0a80d383 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1371 microversion: 2.1 time: 0.916455 Aug 27 04:33:52.107552 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 273/550] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:51 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1371 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:52.144793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1870c8b2-169c-483c-8a8c-3edd10c33a43 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Action: 'create', calling method: .version_select at 0x7f1f221d70d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-915722098", "policies": ["anti-affinity"]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:52.213775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-1870c8b2-169c-483c-8a8c-3edd10c33a43 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:52.261718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-1870c8b2-169c-483c-8a8c-3edd10c33a43 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:52.519498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-1870c8b2-169c-483c-8a8c-3edd10c33a43 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:52.534150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-1870c8b2-169c-483c-8a8c-3edd10c33a43 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:52.595520 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1870c8b2-169c-483c-8a8c-3edd10c33a43 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.485877 Aug 27 04:33:52.600056 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 274/551] 10.222.0.79 () {60 vars in 1174 bytes} [Sat Aug 27 04:33:52 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:52.630182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a095043-8a86-449a-961c-6a3569873008 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:52.635973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5a095043-8a86-449a-961c-6a3569873008 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:52.655397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a095043-8a86-449a-961c-6a3569873008 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:52.666212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a095043-8a86-449a-961c-6a3569873008 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:52.666988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a095043-8a86-449a-961c-6a3569873008 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:52.668274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a095043-8a86-449a-961c-6a3569873008 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:52.669907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a095043-8a86-449a-961c-6a3569873008 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:52.671383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a095043-8a86-449a-961c-6a3569873008 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:53.063040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-34e23aca-24ba-4009-b80a-02bbf1c39c4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:53.075259 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-34e23aca-24ba-4009-b80a-02bbf1c39c4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1476 microversion: 2.1 time: 1.141581 Aug 27 04:33:53.094526 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 278/552] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:51 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1476 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:53.105943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1276612622", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "28a4efd2-e7db-480d-a95a-9f3c83eb1358"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:53.259274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:33:54.291419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:33:54.292787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:33:54.293575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:33:54.294226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:33:54.294812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:33:54.418177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:54.418890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:54.419406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:54.420447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:54.421150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:54.421714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:54.449175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5a095043-8a86-449a-961c-6a3569873008 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:54.467899 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5a095043-8a86-449a-961c-6a3569873008 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1465 microversion: 2.1 time: 1.865507 Aug 27 04:33:54.481690 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 275/553] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:52 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1465 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:54.495313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-11daa2d6-ad52-41b3-b916-6431908df48c tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:54.512510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-11daa2d6-ad52-41b3-b916-6431908df48c tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:54.536738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11daa2d6-ad52-41b3-b916-6431908df48c tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:54.539269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11daa2d6-ad52-41b3-b916-6431908df48c tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:54.539827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11daa2d6-ad52-41b3-b916-6431908df48c tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:54.541657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11daa2d6-ad52-41b3-b916-6431908df48c tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:54.542753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11daa2d6-ad52-41b3-b916-6431908df48c tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:54.544747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11daa2d6-ad52-41b3-b916-6431908df48c tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:54.548893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:54.571654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:54.630404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Going to run 2 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:33:54.633877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:33:54.745820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128870) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 27 04:33:54.823065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:54.840131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:54.998656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:55.006995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:55.031464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=6a00035e-e4c1-4f81-87d6-ec313135748d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:33:55.151912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:55.169033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:55.219277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:55.320112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:33:55.328666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'server_group_members'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:33:55.465157 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3b1b05ba-660d-4e7f-8349-cd4d9b785210 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.368637 Aug 27 04:33:55.473290 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 279/554] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:33:53 2022] POST /compute/v2.1/servers => generated 32 bytes in 2378 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 04:33:55.486537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c3a00a21-a494-4f36-a796-c5e72e9e96a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:55.489498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c3a00a21-a494-4f36-a796-c5e72e9e96a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:55.510149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3a00a21-a494-4f36-a796-c5e72e9e96a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:55.510902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3a00a21-a494-4f36-a796-c5e72e9e96a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:55.511760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3a00a21-a494-4f36-a796-c5e72e9e96a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:55.516872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3a00a21-a494-4f36-a796-c5e72e9e96a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:55.520023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3a00a21-a494-4f36-a796-c5e72e9e96a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:55.520745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3a00a21-a494-4f36-a796-c5e72e9e96a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:55.649848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11daa2d6-ad52-41b3-b916-6431908df48c tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:55.675284 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-11daa2d6-ad52-41b3-b916-6431908df48c tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1371 microversion: 2.1 time: 1.194128 Aug 27 04:33:55.684904 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 276/555] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:54 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1371 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:56.016105 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a965477-9e9b-4b53-b795-7dbad0cf6340 tempest-TenantUsagesNegativeTestJSON-1138688312 tempest-TenantUsagesNegativeTestJSON-1138688312-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-26T04%3A33%3A54.876295&end=2022-08-28T04%3A33%3A54.876295" status: 404 len: 112 microversion: - time: 0.329891 Aug 27 04:33:56.016932 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 277/556] 10.222.0.79 () {58 vars in 1316 bytes} [Sat Aug 27 04:33:55 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-26T04%3A33%3A54.876295&end=2022-08-28T04%3A33%3A54.876295 => generated 112 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 04:33:56.024297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09fab81c-5568-4a0c-8de8-70bad7363b17 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:56.029386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09fab81c-5568-4a0c-8de8-70bad7363b17 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:56.052155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-09fab81c-5568-4a0c-8de8-70bad7363b17 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Searching by: {'deleted': False, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:33:56.085603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09fab81c-5568-4a0c-8de8-70bad7363b17 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:56.093724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09fab81c-5568-4a0c-8de8-70bad7363b17 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:56.094409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09fab81c-5568-4a0c-8de8-70bad7363b17 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:56.095416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09fab81c-5568-4a0c-8de8-70bad7363b17 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:56.096122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09fab81c-5568-4a0c-8de8-70bad7363b17 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:56.096774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09fab81c-5568-4a0c-8de8-70bad7363b17 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:56.168122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c3a00a21-a494-4f36-a796-c5e72e9e96a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:56.185944 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c3a00a21-a494-4f36-a796-c5e72e9e96a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1476 microversion: 2.1 time: 0.702308 Aug 27 04:33:56.186676 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 280/557] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:55 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1476 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:56.188957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-09fab81c-5568-4a0c-8de8-70bad7363b17 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:33:56.200919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-34316eb4-d1f9-4549-8ce0-af326abbbcdf tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:56.201569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-34316eb4-d1f9-4549-8ce0-af326abbbcdf tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:56.211600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34316eb4-d1f9-4549-8ce0-af326abbbcdf tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:56.212161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34316eb4-d1f9-4549-8ce0-af326abbbcdf tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:56.212507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34316eb4-d1f9-4549-8ce0-af326abbbcdf tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:56.213225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34316eb4-d1f9-4549-8ce0-af326abbbcdf tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:56.213675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34316eb4-d1f9-4549-8ce0-af326abbbcdf tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:56.218209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34316eb4-d1f9-4549-8ce0-af326abbbcdf tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:56.295482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34316eb4-d1f9-4549-8ce0-af326abbbcdf tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:56.295965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34316eb4-d1f9-4549-8ce0-af326abbbcdf tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:56.300105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34316eb4-d1f9-4549-8ce0-af326abbbcdf tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:56.302044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-34316eb4-d1f9-4549-8ce0-af326abbbcdf tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lazy-loading 'fault' on Instance uuid 6035d8df-720d-48d2-a799-fc5275a5788e {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:33:56.350826 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09fab81c-5568-4a0c-8de8-70bad7363b17 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.331950 Aug 27 04:33:56.351454 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 278/558] 10.222.0.79 () {58 vars in 1125 bytes} [Sat Aug 27 04:33:56 2022] GET /compute/v2.1/servers => generated 1665 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:56.377608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cc57c8ba-9d16-4906-bc40-66a6d809dbec req-2b069ca8-181e-4d44-825e-422f0426b38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6035d8df-720d-48d2-a799-fc5275a5788e", "name": "network-vif-deleted", "tag": "b201738a-d06b-42e5-8842-0dd213c52b52"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:56.392736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-34316eb4-d1f9-4549-8ce0-af326abbbcdf tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:56.408922 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-34316eb4-d1f9-4549-8ce0-af326abbbcdf tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1308 microversion: 2.1 time: 0.220960 Aug 27 04:33:56.409237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cc57c8ba-9d16-4906-bc40-66a6d809dbec req-2b069ca8-181e-4d44-825e-422f0426b38f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:56.409726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cc57c8ba-9d16-4906-bc40-66a6d809dbec req-2b069ca8-181e-4d44-825e-422f0426b38f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:56.410165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cc57c8ba-9d16-4906-bc40-66a6d809dbec req-2b069ca8-181e-4d44-825e-422f0426b38f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:56.412679 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 281/559] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:56 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1308 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:56.425634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b8d8476e-f763-4f2a-892f-11bbc8a1e094 tempest-TenantUsagesNegativeTestJSON-1138688312 tempest-TenantUsagesNegativeTestJSON-1138688312-project-admin] Calling method '.version_select at 0x7f1f2214ee50>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:56.444190 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-b8d8476e-f763-4f2a-892f-11bbc8a1e094 tempest-TenantUsagesNegativeTestJSON-1138688312 tempest-TenantUsagesNegativeTestJSON-1138688312-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b8d8476e-f763-4f2a-892f-11bbc8a1e094 tempest-TenantUsagesNegativeTestJSON-1138688312 tempest-TenantUsagesNegativeTestJSON-1138688312-project-admin] Request method failure captured: Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-simple-tenant-usage/e90615193de24ddea336a77e3f5f33f1?start=2022-08-28T04%3A33%3A54.876295&end=2022-08-26T04%3A33%3A54.876295 HTTP/1.1 Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ6y3dXuS9AIXhU2kXSHpI0K3AOUwY7dSYqF8pNgIfR_SkUaqoQ3tf-zFVVvd731LHF2noDyzfvDR6GAvy7_33mu_UtL3aVGR_8y2YJ3a7xGTkk8Irp6C1jLJQLppjEo5cbje0WR-sF_tQ4dspvlOdBryyVB3werxxCw5N8hqloaCFM Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 4b305b196c194afe8f6ed7ed4504ca42 Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1138688312 Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:33:56.451368 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:33:56.453461 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4b305b196c194afe8f6ed7ed4504ca42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4b305b196c194afe8f6ed7ed4504ca42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4b305b196c194afe8f6ed7ed4504ca42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4b305b196c194afe8f6ed7ed4504ca42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:56.453461 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1138688312 Aug 27 04:33:56.453461 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 4b305b196c194afe8f6ed7ed4504ca42 Aug 27 04:33:56.453461 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1138688312 Aug 27 04:33:56.453461 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TenantUsagesNegativeTestJSON-1138688312-project-admin Aug 27 04:33:56.453461 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:33:56.453461 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:33:56.453461 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 5e0ac2c6fc1e4c95bcd44da13adb7b27 Aug 27 04:33:56.453461 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1138688312-project-admin Aug 27 04:33:56.453461 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:33:56.453461 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid start time. The start time cannot occur after the end time. Aug 27 04:33:56.453461 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'e90615193de24ddea336a77e3f5f33f1'} Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 04:33:56.454438 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 27 04:33:56.455703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:56.455703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:56.455703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:56.455703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:56.455703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:56.455703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:56.455703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:33:56.455703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:33:56.455703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 27 04:33:56.455703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:56.458820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b8d8476e-f763-4f2a-892f-11bbc8a1e094 tempest-TenantUsagesNegativeTestJSON-1138688312 tempest-TenantUsagesNegativeTestJSON-1138688312-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:56.461826 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b8d8476e-f763-4f2a-892f-11bbc8a1e094 tempest-TenantUsagesNegativeTestJSON-1138688312 tempest-TenantUsagesNegativeTestJSON-1138688312-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/e90615193de24ddea336a77e3f5f33f1?start=2022-08-28T04%3A33%3A54.876295&end=2022-08-26T04%3A33%3A54.876295" status: 400 len: 111 microversion: 2.1 time: 0.046468 Aug 27 04:33:56.465280 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 282/560] 10.222.0.79 () {58 vars in 1412 bytes} [Sat Aug 27 04:33:56 2022] GET /compute/v2.1/os-simple-tenant-usage/e90615193de24ddea336a77e3f5f33f1?start=2022-08-28T04%3A33%3A54.876295&end=2022-08-26T04%3A33%3A54.876295 => generated 111 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:33:56.480519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fe976e0e-f073-4142-a5b1-1943d4a6d6fe tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:56.483999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fe976e0e-f073-4142-a5b1-1943d4a6d6fe tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:56.484909 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cc57c8ba-9d16-4906-bc40-66a6d809dbec req-2b069ca8-181e-4d44-825e-422f0426b38f service nova] Creating event network-vif-deleted:b201738a-d06b-42e5-8842-0dd213c52b52 for instance 6035d8df-720d-48d2-a799-fc5275a5788e on n-h1-854823-1 Aug 27 04:33:56.501844 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cc57c8ba-9d16-4906-bc40-66a6d809dbec req-2b069ca8-181e-4d44-825e-422f0426b38f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148854 Aug 27 04:33:56.510654 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 279/561] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:56.617159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fe976e0e-f073-4142-a5b1-1943d4a6d6fe tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:56.626295 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fe976e0e-f073-4142-a5b1-1943d4a6d6fe tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1219 microversion: 2.1 time: 0.158501 Aug 27 04:33:56.630849 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 283/562] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:56 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1219 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:56.697730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-80783aab-ac79-4f4d-a109-cc79b64a8936 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:56.699090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-80783aab-ac79-4f4d-a109-cc79b64a8936 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:56.716411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80783aab-ac79-4f4d-a109-cc79b64a8936 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:56.719390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80783aab-ac79-4f4d-a109-cc79b64a8936 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:56.719933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80783aab-ac79-4f4d-a109-cc79b64a8936 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:56.723517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80783aab-ac79-4f4d-a109-cc79b64a8936 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:56.724726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80783aab-ac79-4f4d-a109-cc79b64a8936 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:56.725018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80783aab-ac79-4f4d-a109-cc79b64a8936 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:56.784342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43f051c9-1f34-4fd3-bbce-e5829f390769 tempest-TenantUsagesNegativeTestJSON-387947074 tempest-TenantUsagesNegativeTestJSON-387947074-project] Calling method '.version_select at 0x7f1f21eaf1f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:56.788514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-43f051c9-1f34-4fd3-bbce-e5829f390769 tempest-TenantUsagesNegativeTestJSON-387947074 tempest-TenantUsagesNegativeTestJSON-387947074-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '194b9a5d92f94e1db1003d3dddfa59d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e90615193de24ddea336a77e3f5f33f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43f051c9-1f34-4fd3-bbce-e5829f390769 tempest-TenantUsagesNegativeTestJSON-387947074 tempest-TenantUsagesNegativeTestJSON-387947074-project] Request method failure captured: Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T04%3A33%3A54.876295&end=2022-08-28T04%3A33%3A54.876295&detailed=1 HTTP/1.1 Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ6xy0b_FdXfVKWFOamwJPcZmflmMViwFT14Pdh-1Y_evWHgVQN0pqiCs5gsUBF17FRxb3SNtv64e8CM4GT95D1ygXGpZFL7LeBD7RZSM3_-Xj3K4Ddluu3aL3bFG8GXinQk-TOdzgjNNGcX2kAuNLtIv70itcfxDjBTTt4XKccb_zo Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: e90615193de24ddea336a77e3f5f33f1 Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-387947074 Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:33:56.801246 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:33:56.802642 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e90615193de24ddea336a77e3f5f33f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e90615193de24ddea336a77e3f5f33f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e90615193de24ddea336a77e3f5f33f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e90615193de24ddea336a77e3f5f33f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:56.802642 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-387947074 Aug 27 04:33:56.802642 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: e90615193de24ddea336a77e3f5f33f1 Aug 27 04:33:56.802642 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-387947074 Aug 27 04:33:56.802642 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TenantUsagesNegativeTestJSON-387947074-project Aug 27 04:33:56.802642 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:33:56.802642 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:33:56.802642 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 194b9a5d92f94e1db1003d3dddfa59d3 Aug 27 04:33:56.802642 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-387947074-project Aug 27 04:33:56.802642 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:33:56.802642 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 04:33:56.802642 n-d-854823-1 devstack@n-api.service[128869]: action_args: {} Aug 27 04:33:56.802642 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:33:56.803486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:33:56.804638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:33:56.805764 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 04:33:56.805764 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:33:56.807418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43f051c9-1f34-4fd3-bbce-e5829f390769 tempest-TenantUsagesNegativeTestJSON-387947074 tempest-TenantUsagesNegativeTestJSON-387947074-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:56.808496 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43f051c9-1f34-4fd3-bbce-e5829f390769 tempest-TenantUsagesNegativeTestJSON-387947074 tempest-TenantUsagesNegativeTestJSON-387947074-project] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T04%3A33%3A54.876295&end=2022-08-28T04%3A33%3A54.876295&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.296436 Aug 27 04:33:56.809750 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 280/563] 10.222.0.79 () {58 vars in 1335 bytes} [Sat Aug 27 04:33:56 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T04%3A33%3A54.876295&end=2022-08-28T04%3A33%3A54.876295&detailed=1 => generated 123 bytes in 298 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:56.979385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1993894362", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "f6f5b09f-74c4-46ac-874b-9207e349b51e"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:57.071216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-80783aab-ac79-4f4d-a109-cc79b64a8936 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:57.086173 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-80783aab-ac79-4f4d-a109-cc79b64a8936 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1371 microversion: 2.1 time: 0.392970 Aug 27 04:33:57.098890 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 284/564] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:56 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1371 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:57.108915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] validate_networks() for [('f6f5b09f-74c4-46ac-874b-9207e349b51e', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:33:57.212718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dc7c8e6b-98aa-451a-b550-ada9d6cd2bb1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:57.213566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dc7c8e6b-98aa-451a-b550-ada9d6cd2bb1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:57.228159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7c8e6b-98aa-451a-b550-ada9d6cd2bb1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:57.232004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7c8e6b-98aa-451a-b550-ada9d6cd2bb1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:57.234237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7c8e6b-98aa-451a-b550-ada9d6cd2bb1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:57.236474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7c8e6b-98aa-451a-b550-ada9d6cd2bb1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:57.238941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7c8e6b-98aa-451a-b550-ada9d6cd2bb1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:57.246439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7c8e6b-98aa-451a-b550-ada9d6cd2bb1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:57.708026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dc7c8e6b-98aa-451a-b550-ada9d6cd2bb1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:57.726587 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dc7c8e6b-98aa-451a-b550-ada9d6cd2bb1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1476 microversion: 2.1 time: 0.520341 Aug 27 04:33:57.729215 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 285/565] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:57 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1476 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:57.747701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8a71efaf-6667-4270-b30d-513de837718b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:57.753071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8a71efaf-6667-4270-b30d-513de837718b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:57.769564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a71efaf-6667-4270-b30d-513de837718b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:57.770475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a71efaf-6667-4270-b30d-513de837718b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:57.771037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a71efaf-6667-4270-b30d-513de837718b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:57.771928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a71efaf-6667-4270-b30d-513de837718b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:57.772658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a71efaf-6667-4270-b30d-513de837718b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:57.773209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a71efaf-6667-4270-b30d-513de837718b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:57.905631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a71efaf-6667-4270-b30d-513de837718b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:57.906177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a71efaf-6667-4270-b30d-513de837718b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:57.906793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a71efaf-6667-4270-b30d-513de837718b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:57.907263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-8a71efaf-6667-4270-b30d-513de837718b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lazy-loading 'fault' on Instance uuid 6035d8df-720d-48d2-a799-fc5275a5788e {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:33:58.078277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8a71efaf-6667-4270-b30d-513de837718b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:58.091439 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8a71efaf-6667-4270-b30d-513de837718b tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 200 len: 1308 microversion: 2.1 time: 0.358758 Aug 27 04:33:58.093577 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 286/566] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:57 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 1308 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:58.116096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-fc17c626-f906-4c63-860a-979688ada3e7 req-ee07b703-0a83-4057-83de-33a28bee7e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a359715d-5ce1-4edd-8d94-3bba4d560d33", "tag": "fb2c924b-d280-4f1a-85fa-1bff5b9d0c84"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:58.223666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fc17c626-f906-4c63-860a-979688ada3e7 req-ee07b703-0a83-4057-83de-33a28bee7e77 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:58.230925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fc17c626-f906-4c63-860a-979688ada3e7 req-ee07b703-0a83-4057-83de-33a28bee7e77 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:58.231726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fc17c626-f906-4c63-860a-979688ada3e7 req-ee07b703-0a83-4057-83de-33a28bee7e77 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:58.308812 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-fc17c626-f906-4c63-860a-979688ada3e7 req-ee07b703-0a83-4057-83de-33a28bee7e77 service nova] Creating event network-changed:fb2c924b-d280-4f1a-85fa-1bff5b9d0c84 for instance a359715d-5ce1-4edd-8d94-3bba4d560d33 on n-h1-854823-1 Aug 27 04:33:58.323324 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-fc17c626-f906-4c63-860a-979688ada3e7 req-ee07b703-0a83-4057-83de-33a28bee7e77 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226608 Aug 27 04:33:58.327022 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 287/567] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:58.343872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1e2b5413-7f75-441a-9fbd-7e935a182b23 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:58.345771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1e2b5413-7f75-441a-9fbd-7e935a182b23 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:58.367674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e2b5413-7f75-441a-9fbd-7e935a182b23 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:58.369729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e2b5413-7f75-441a-9fbd-7e935a182b23 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:58.372493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e2b5413-7f75-441a-9fbd-7e935a182b23 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:58.376333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e2b5413-7f75-441a-9fbd-7e935a182b23 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:58.377327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e2b5413-7f75-441a-9fbd-7e935a182b23 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:58.378692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e2b5413-7f75-441a-9fbd-7e935a182b23 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:58.568054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e2b5413-7f75-441a-9fbd-7e935a182b23 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:58.586743 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1e2b5413-7f75-441a-9fbd-7e935a182b23 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1271 microversion: 2.1 time: 0.257786 Aug 27 04:33:58.594008 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 288/568] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:58 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1271 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:58.614311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-85786730-89f1-4eec-b2de-95bd3d246035 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:58.615243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-85786730-89f1-4eec-b2de-95bd3d246035 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:58.633010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85786730-89f1-4eec-b2de-95bd3d246035 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:58.634614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85786730-89f1-4eec-b2de-95bd3d246035 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:58.636448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85786730-89f1-4eec-b2de-95bd3d246035 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:58.638755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85786730-89f1-4eec-b2de-95bd3d246035 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:58.640171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85786730-89f1-4eec-b2de-95bd3d246035 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:58.640863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85786730-89f1-4eec-b2de-95bd3d246035 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:58.924078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-85786730-89f1-4eec-b2de-95bd3d246035 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:58.965729 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-85786730-89f1-4eec-b2de-95bd3d246035 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1371 microversion: 2.1 time: 0.360418 Aug 27 04:33:58.986567 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 289/569] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:58 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1371 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:59.011114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f3a5f9c0-1966-4cc2-a996-f0abd5f65b10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:59.014373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f3a5f9c0-1966-4cc2-a996-f0abd5f65b10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:59.039715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3a5f9c0-1966-4cc2-a996-f0abd5f65b10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:59.044790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3a5f9c0-1966-4cc2-a996-f0abd5f65b10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:59.049993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3a5f9c0-1966-4cc2-a996-f0abd5f65b10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:59.051089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3a5f9c0-1966-4cc2-a996-f0abd5f65b10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:59.054712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3a5f9c0-1966-4cc2-a996-f0abd5f65b10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:59.055352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3a5f9c0-1966-4cc2-a996-f0abd5f65b10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:59.554367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f3a5f9c0-1966-4cc2-a996-f0abd5f65b10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:59.571931 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f3a5f9c0-1966-4cc2-a996-f0abd5f65b10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1476 microversion: 2.1 time: 0.582615 Aug 27 04:33:59.572477 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 290/570] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:58 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1476 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:59.588435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-30b45397-cfa8-42da-ad9f-e424b8d1de20 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:59.589080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-30b45397-cfa8-42da-ad9f-e424b8d1de20 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: 6035d8df-720d-48d2-a799-fc5275a5788e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:59.603128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30b45397-cfa8-42da-ad9f-e424b8d1de20 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:59.603631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30b45397-cfa8-42da-ad9f-e424b8d1de20 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:59.604068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30b45397-cfa8-42da-ad9f-e424b8d1de20 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:59.606977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30b45397-cfa8-42da-ad9f-e424b8d1de20 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:59.607457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30b45397-cfa8-42da-ad9f-e424b8d1de20 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:59.607882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30b45397-cfa8-42da-ad9f-e424b8d1de20 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:59.634473 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-30b45397-cfa8-42da-ad9f-e424b8d1de20 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] HTTP exception thrown: Instance 6035d8df-720d-48d2-a799-fc5275a5788e could not be found. Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-30b45397-cfa8-42da-ad9f-e424b8d1de20 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Request method failure captured: Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e HTTP/1.1 Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5qoPtu0vcquEjfsdRALCbpRpZUd4YcNLQ0ktyJj1TCKNZ4ye2btXmAUyJkG5ZC-UMghou8GV69gbfEQvYTPKajukgxLIwkGXCntZAJfoicJ81zjBHMHMNR8Yzsihsaqd3uW1tcJImz73And9NnCRyeJ1oux_EJzdHeuwhIY7YZ2bI Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 73540a547efa4eccb535f6e38d60f67a Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-LiveMigrationNegativeTest-1524304022 Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:33:59.636131 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:33:59.637601 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73540a547efa4eccb535f6e38d60f67a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_73540a547efa4eccb535f6e38d60f67a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/73540a547efa4eccb535f6e38d60f67a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73540a547efa4eccb535f6e38d60f67a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:33:59.637601 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-LiveMigrationNegativeTest-1524304022 Aug 27 04:33:59.637601 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 73540a547efa4eccb535f6e38d60f67a Aug 27 04:33:59.637601 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1524304022 Aug 27 04:33:59.637601 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-LiveMigrationNegativeTest-1524304022-project Aug 27 04:33:59.637601 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:33:59.637601 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:33:59.637601 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: f60c624cc43945ea9de2731f0c93156c Aug 27 04:33:59.637601 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-LiveMigrationNegativeTest-1524304022-project Aug 27 04:33:59.637601 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:33:59.637601 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 6035d8df-720d-48d2-a799-fc5275a5788e could not be found. Aug 27 04:33:59.637601 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '6035d8df-720d-48d2-a799-fc5275a5788e'} Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6035d8df-720d-48d2-a799-fc5275a5788e could not be found. Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:33:59.638433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6035d8df-720d-48d2-a799-fc5275a5788e could not be found. Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6035d8df-720d-48d2-a799-fc5275a5788e could not be found. Aug 27 04:33:59.640893 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:33:59.644688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-30b45397-cfa8-42da-ad9f-e424b8d1de20 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Returning 404 to user: Instance 6035d8df-720d-48d2-a799-fc5275a5788e could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:33:59.644688 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-30b45397-cfa8-42da-ad9f-e424b8d1de20 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e" status: 404 len: 111 microversion: 2.1 time: 0.053696 Aug 27 04:33:59.644688 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 291/571] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:59 2022] GET /compute/v2.1/servers/6035d8df-720d-48d2-a799-fc5275a5788e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:59.662016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c460899f-61c3-4e36-8fe6-61f2b8d50bf2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:59.663011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c460899f-61c3-4e36-8fe6-61f2b8d50bf2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:59.670107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c460899f-61c3-4e36-8fe6-61f2b8d50bf2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:59.670846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c460899f-61c3-4e36-8fe6-61f2b8d50bf2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:59.671448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c460899f-61c3-4e36-8fe6-61f2b8d50bf2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:59.672369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c460899f-61c3-4e36-8fe6-61f2b8d50bf2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:59.673147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c460899f-61c3-4e36-8fe6-61f2b8d50bf2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:59.673861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c460899f-61c3-4e36-8fe6-61f2b8d50bf2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:59.816336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c460899f-61c3-4e36-8fe6-61f2b8d50bf2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:59.845116 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c460899f-61c3-4e36-8fe6-61f2b8d50bf2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1289 microversion: 2.1 time: 0.200202 Aug 27 04:33:59.846279 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 292/572] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:59 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1289 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:59.855980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5331a4e-81b0-4969-8f3d-331562d73933 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:59.856985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f5331a4e-81b0-4969-8f3d-331562d73933 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:59.871588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5331a4e-81b0-4969-8f3d-331562d73933 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:59.872494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5331a4e-81b0-4969-8f3d-331562d73933 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:59.873612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5331a4e-81b0-4969-8f3d-331562d73933 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:59.875585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5331a4e-81b0-4969-8f3d-331562d73933 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:59.876859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5331a4e-81b0-4969-8f3d-331562d73933 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:59.884086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:33:59.886057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:33:59.887280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5331a4e-81b0-4969-8f3d-331562d73933 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:59.888017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:33:59.889422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:33:59.890984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:33:59.924639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:59.926914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:59.929912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:59.931020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:59.934648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:59.936049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:59.964441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f5331a4e-81b0-4969-8f3d-331562d73933 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:34:00.016439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Getting quotas for project 002ba94e9b364c3e8784927de5770ed1. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:34:00.028331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Getting quotas for user 1d3d23499c474adaa7fe3a2260f5ec36 and project 002ba94e9b364c3e8784927de5770ed1. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:34:00.060128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:34:00.071408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:34:00.167346 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-84a05baf-9462-4c69-9118-511c6d4bfbaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.356123 Aug 27 04:34:00.176840 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 281/573] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 04:33:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3366 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:34:00.198136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-339b2b53-b8a0-4ac0-bb2c-f716c337cddb tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:00.198136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-339b2b53-b8a0-4ac0-bb2c-f716c337cddb tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:00.198136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-339b2b53-b8a0-4ac0-bb2c-f716c337cddb tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:00.198136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-339b2b53-b8a0-4ac0-bb2c-f716c337cddb tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:00.198609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-339b2b53-b8a0-4ac0-bb2c-f716c337cddb tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:00.198609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-339b2b53-b8a0-4ac0-bb2c-f716c337cddb tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:00.198609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-339b2b53-b8a0-4ac0-bb2c-f716c337cddb tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:00.198609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-339b2b53-b8a0-4ac0-bb2c-f716c337cddb tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:00.230062 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f5331a4e-81b0-4969-8f3d-331562d73933 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "DELETE /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 204 len: 0 microversion: 2.1 time: 0.380127 Aug 27 04:34:00.230839 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 293/574] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:33:59 2022] DELETE /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:34:00.245178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-207ede15-e7e0-4766-a8d6-1792b65a14cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:00.247684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-207ede15-e7e0-4766-a8d6-1792b65a14cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:00.460920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-207ede15-e7e0-4766-a8d6-1792b65a14cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:00.474006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-207ede15-e7e0-4766-a8d6-1792b65a14cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:00.476714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-207ede15-e7e0-4766-a8d6-1792b65a14cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:00.477869 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-207ede15-e7e0-4766-a8d6-1792b65a14cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1262 microversion: 2.25 time: 0.245879 Aug 27 04:34:00.489519 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 294/575] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:00 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1262 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:00.495036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-486e71d7-0ad1-4667-8e62-1c9d0f19dcd2 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:00.497377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-486e71d7-0ad1-4667-8e62-1c9d0f19dcd2 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:00.529594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-486e71d7-0ad1-4667-8e62-1c9d0f19dcd2 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:00.531895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-486e71d7-0ad1-4667-8e62-1c9d0f19dcd2 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:00.532349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-486e71d7-0ad1-4667-8e62-1c9d0f19dcd2 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:00.534690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-486e71d7-0ad1-4667-8e62-1c9d0f19dcd2 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:00.538426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-486e71d7-0ad1-4667-8e62-1c9d0f19dcd2 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:00.538874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-486e71d7-0ad1-4667-8e62-1c9d0f19dcd2 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:01.399600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-339b2b53-b8a0-4ac0-bb2c-f716c337cddb tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:01.408991 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-339b2b53-b8a0-4ac0-bb2c-f716c337cddb tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1371 microversion: 2.1 time: 1.230719 Aug 27 04:34:01.426163 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 282/576] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:00 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1371 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:01.431947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f94b0afa-6db8-4565-942d-ef6e9c27abd4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:01.432842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f94b0afa-6db8-4565-942d-ef6e9c27abd4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:01.439369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f94b0afa-6db8-4565-942d-ef6e9c27abd4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:01.440145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f94b0afa-6db8-4565-942d-ef6e9c27abd4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:01.440912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f94b0afa-6db8-4565-942d-ef6e9c27abd4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:01.442987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f94b0afa-6db8-4565-942d-ef6e9c27abd4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:01.444229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f94b0afa-6db8-4565-942d-ef6e9c27abd4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:01.444893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f94b0afa-6db8-4565-942d-ef6e9c27abd4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:02.311413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-486e71d7-0ad1-4667-8e62-1c9d0f19dcd2 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:02.324472 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-486e71d7-0ad1-4667-8e62-1c9d0f19dcd2 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1474 microversion: 2.1 time: 1.839386 Aug 27 04:34:02.328564 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 295/577] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:00 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1474 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:02.357073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-41be2caf-59cd-463a-88dc-71e054ee0687 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:02.358102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-41be2caf-59cd-463a-88dc-71e054ee0687 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:02.367709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41be2caf-59cd-463a-88dc-71e054ee0687 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:02.369064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41be2caf-59cd-463a-88dc-71e054ee0687 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:02.369881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41be2caf-59cd-463a-88dc-71e054ee0687 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:02.371592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41be2caf-59cd-463a-88dc-71e054ee0687 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:02.372666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41be2caf-59cd-463a-88dc-71e054ee0687 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:02.375010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41be2caf-59cd-463a-88dc-71e054ee0687 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:02.446372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f94b0afa-6db8-4565-942d-ef6e9c27abd4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:02.464972 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f94b0afa-6db8-4565-942d-ef6e9c27abd4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1476 microversion: 2.1 time: 1.037119 Aug 27 04:34:02.465885 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 283/578] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:01 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1476 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:02.482686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da7f2e87-3903-44c2-b9e9-d57b956c4901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:02.483752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da7f2e87-3903-44c2-b9e9-d57b956c4901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:02.494213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da7f2e87-3903-44c2-b9e9-d57b956c4901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:02.495292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da7f2e87-3903-44c2-b9e9-d57b956c4901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:02.495842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da7f2e87-3903-44c2-b9e9-d57b956c4901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:02.498231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da7f2e87-3903-44c2-b9e9-d57b956c4901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:02.503845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da7f2e87-3903-44c2-b9e9-d57b956c4901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:02.504661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da7f2e87-3903-44c2-b9e9-d57b956c4901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:02.950460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-41be2caf-59cd-463a-88dc-71e054ee0687 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:02.967788 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-41be2caf-59cd-463a-88dc-71e054ee0687 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1319 microversion: 2.1 time: 0.637482 Aug 27 04:34:02.971316 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 296/579] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:02 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1319 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:02.984826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d08a8495-4a05-4cf4-8478-0b7e33ba701f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:02.985706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d08a8495-4a05-4cf4-8478-0b7e33ba701f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:03.005928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d08a8495-4a05-4cf4-8478-0b7e33ba701f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:03.008304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d08a8495-4a05-4cf4-8478-0b7e33ba701f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:03.011205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d08a8495-4a05-4cf4-8478-0b7e33ba701f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:03.012755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d08a8495-4a05-4cf4-8478-0b7e33ba701f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:03.014781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d08a8495-4a05-4cf4-8478-0b7e33ba701f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:03.018097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d08a8495-4a05-4cf4-8478-0b7e33ba701f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:03.435805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d08a8495-4a05-4cf4-8478-0b7e33ba701f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:03.443623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:03.450234 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d08a8495-4a05-4cf4-8478-0b7e33ba701f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1371 microversion: 2.1 time: 0.474863 Aug 27 04:34:03.452762 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 297/580] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:02 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1371 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:03.465322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-642c0198-9832-4a52-ab2b-9b998bfbabf9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:03.465918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-642c0198-9832-4a52-ab2b-9b998bfbabf9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:03.489738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-642c0198-9832-4a52-ab2b-9b998bfbabf9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:03.491953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-642c0198-9832-4a52-ab2b-9b998bfbabf9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:03.492587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-642c0198-9832-4a52-ab2b-9b998bfbabf9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:03.494367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-642c0198-9832-4a52-ab2b-9b998bfbabf9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:03.497997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-642c0198-9832-4a52-ab2b-9b998bfbabf9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:03.498844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-642c0198-9832-4a52-ab2b-9b998bfbabf9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:03.737325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da7f2e87-3903-44c2-b9e9-d57b956c4901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:03.757876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da7f2e87-3903-44c2-b9e9-d57b956c4901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:03.762049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da7f2e87-3903-44c2-b9e9-d57b956c4901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:03.765436 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da7f2e87-3903-44c2-b9e9-d57b956c4901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1314 microversion: 2.25 time: 1.298024 Aug 27 04:34:03.766029 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 284/581] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:02 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1314 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:03.792162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62efbfeb-7d43-439c-a1b3-71fb8bb8b997 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:03.792858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-62efbfeb-7d43-439c-a1b3-71fb8bb8b997 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:03.814368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62efbfeb-7d43-439c-a1b3-71fb8bb8b997 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:03.816295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62efbfeb-7d43-439c-a1b3-71fb8bb8b997 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:03.817987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62efbfeb-7d43-439c-a1b3-71fb8bb8b997 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:03.827176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62efbfeb-7d43-439c-a1b3-71fb8bb8b997 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:03.827770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62efbfeb-7d43-439c-a1b3-71fb8bb8b997 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:03.828349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62efbfeb-7d43-439c-a1b3-71fb8bb8b997 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:03.942096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-642c0198-9832-4a52-ab2b-9b998bfbabf9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:03.953161 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-642c0198-9832-4a52-ab2b-9b998bfbabf9 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1474 microversion: 2.1 time: 0.499270 Aug 27 04:34:03.965486 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 298/582] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:03 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1474 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:03.992770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b6cdb117-8d72-4240-a577-3105ab7e3bb3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:03.993439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b6cdb117-8d72-4240-a577-3105ab7e3bb3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:04.010797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6cdb117-8d72-4240-a577-3105ab7e3bb3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:04.012218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6cdb117-8d72-4240-a577-3105ab7e3bb3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:04.018641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6cdb117-8d72-4240-a577-3105ab7e3bb3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:04.019799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6cdb117-8d72-4240-a577-3105ab7e3bb3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:04.020449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6cdb117-8d72-4240-a577-3105ab7e3bb3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:04.021225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6cdb117-8d72-4240-a577-3105ab7e3bb3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:04.473360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-62efbfeb-7d43-439c-a1b3-71fb8bb8b997 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:04.489319 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62efbfeb-7d43-439c-a1b3-71fb8bb8b997 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1476 microversion: 2.1 time: 0.720368 Aug 27 04:34:04.493292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=19 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:04.494826 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 285/583] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:03 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1476 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:04.734927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a69ce99-86f1-44ea-8505-a7f2386789f9 tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:04.740219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b6cdb117-8d72-4240-a577-3105ab7e3bb3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:04.750116 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a69ce99-86f1-44ea-8505-a7f2386789f9 tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.253771 Aug 27 04:34:04.750562 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b6cdb117-8d72-4240-a577-3105ab7e3bb3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1319 microversion: 2.1 time: 0.762910 Aug 27 04:34:04.751529 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 299/584] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:03 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1319 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:04.756474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e121af40-018e-4572-95fc-38350e0c172a tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:04.764836 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 286/585] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:34:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:04.768952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e121af40-018e-4572-95fc-38350e0c172a tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:04.780416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b297a90-c5be-4f69-a43c-7b50884d72b3 tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:04.780952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e121af40-018e-4572-95fc-38350e0c172a tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:04.781456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e121af40-018e-4572-95fc-38350e0c172a tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:04.782007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e121af40-018e-4572-95fc-38350e0c172a tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:04.782813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e121af40-018e-4572-95fc-38350e0c172a tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:04.783453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e121af40-018e-4572-95fc-38350e0c172a tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:04.784040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e121af40-018e-4572-95fc-38350e0c172a tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:04.827558 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b297a90-c5be-4f69-a43c-7b50884d72b3 tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors" status: 200 len: 3075 microversion: 2.1 time: 0.051553 Aug 27 04:34:04.829337 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 287/586] 10.222.0.79 () {58 vars in 1125 bytes} [Sat Aug 27 04:34:04 2022] GET /compute/v2.1/flavors => generated 3075 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:04.838471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22294d87-56a6-4009-9c4f-148c04f91bed tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:04.843094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22294d87-56a6-4009-9c4f-148c04f91bed tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:04.855557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22294d87-56a6-4009-9c4f-148c04f91bed tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:04.864961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22294d87-56a6-4009-9c4f-148c04f91bed tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:04.865603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22294d87-56a6-4009-9c4f-148c04f91bed tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:04.866691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22294d87-56a6-4009-9c4f-148c04f91bed tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:04.867364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22294d87-56a6-4009-9c4f-148c04f91bed tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:04.867927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22294d87-56a6-4009-9c4f-148c04f91bed tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:05.026824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22294d87-56a6-4009-9c4f-148c04f91bed tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:05.039587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22294d87-56a6-4009-9c4f-148c04f91bed tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:05.041615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22294d87-56a6-4009-9c4f-148c04f91bed tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:05.043280 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22294d87-56a6-4009-9c4f-148c04f91bed tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1332 microversion: 2.25 time: 0.212717 Aug 27 04:34:05.044721 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 288/587] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:04 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1332 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:05.049704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45955687-d99b-4052-9fa6-c74a32dc936b tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:05.059564 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45955687-d99b-4052-9fa6-c74a32dc936b tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013354 Aug 27 04:34:05.060799 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 289/588] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:34:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:05.067197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84aa410c-0bf4-4f0a-8df9-083af79882ce tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:05.069131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-84aa410c-0bf4-4f0a-8df9-083af79882ce tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:05.076879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84aa410c-0bf4-4f0a-8df9-083af79882ce tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:05.077370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84aa410c-0bf4-4f0a-8df9-083af79882ce tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:05.077814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84aa410c-0bf4-4f0a-8df9-083af79882ce tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:05.078535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84aa410c-0bf4-4f0a-8df9-083af79882ce tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:05.078994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84aa410c-0bf4-4f0a-8df9-083af79882ce tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:05.079557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84aa410c-0bf4-4f0a-8df9-083af79882ce tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:05.193154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e121af40-018e-4572-95fc-38350e0c172a tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:05.202128 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e121af40-018e-4572-95fc-38350e0c172a tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1371 microversion: 2.1 time: 0.449365 Aug 27 04:34:05.204391 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 300/589] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:04 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1371 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:05.214915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-82c9746f-0589-4a9f-94b8-b68bbcdb401a tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:05.234231 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-82c9746f-0589-4a9f-94b8-b68bbcdb401a tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026636 Aug 27 04:34:05.238154 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 301/590] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:34:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:05.247283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a19d1414-4fcb-4390-aaa9-590b3c481efa req-7795cc8a-daaf-48da-b5fe-2391782b3fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de5d3f95-67da-4f5c-8422-c775bd151f03", "name": "network-vif-deleted", "tag": "df8756ea-0330-47f7-a318-e35c31555496"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:05.260866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84aa410c-0bf4-4f0a-8df9-083af79882ce tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60c624cc43945ea9de2731f0c93156c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73540a547efa4eccb535f6e38d60f67a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:05.263847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a19d1414-4fcb-4390-aaa9-590b3c481efa req-7795cc8a-daaf-48da-b5fe-2391782b3fc0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:05.265300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a19d1414-4fcb-4390-aaa9-590b3c481efa req-7795cc8a-daaf-48da-b5fe-2391782b3fc0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:05.265801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a19d1414-4fcb-4390-aaa9-590b3c481efa req-7795cc8a-daaf-48da-b5fe-2391782b3fc0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:05.271983 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-84aa410c-0bf4-4f0a-8df9-083af79882ce tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 200 len: 1432 microversion: 2.1 time: 0.207759 Aug 27 04:34:05.282482 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a19d1414-4fcb-4390-aaa9-590b3c481efa req-7795cc8a-daaf-48da-b5fe-2391782b3fc0 service nova] Creating event network-vif-deleted:df8756ea-0330-47f7-a318-e35c31555496 for instance de5d3f95-67da-4f5c-8422-c775bd151f03 on n-h2-854823-1 Aug 27 04:34:05.291354 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a19d1414-4fcb-4390-aaa9-590b3c481efa req-7795cc8a-daaf-48da-b5fe-2391782b3fc0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050893 Aug 27 04:34:05.292049 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 290/591] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:05 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 1432 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:05.292273 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 302/592] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:05.303786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe3b16d5-5b0c-4b40-943f-64dcf9cc972d tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:05.400840 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe3b16d5-5b0c-4b40-943f-64dcf9cc972d tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.103175 Aug 27 04:34:05.403320 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 291/593] 10.222.0.79 () {58 vars in 1165 bytes} [Sat Aug 27 04:34:05 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:05.426639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ba734917-02f2-4b3d-b69a-8c698934e346 req-8e4600d1-02b2-4696-9022-38e6bd5e5bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c0f478e-9899-40b9-b4fc-c937daf213fd", "tag": "00cbdba8-58fb-4799-910c-9bb07b2bd780"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:05.432260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5913da7e-a2dc-41d3-bba9-cee2e2ed87e5 tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:05.451648 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5913da7e-a2dc-41d3-bba9-cee2e2ed87e5 tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032288 Aug 27 04:34:05.452838 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 292/594] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:34:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:05.458663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ba734917-02f2-4b3d-b69a-8c698934e346 req-8e4600d1-02b2-4696-9022-38e6bd5e5bbf service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:05.460211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ba734917-02f2-4b3d-b69a-8c698934e346 req-8e4600d1-02b2-4696-9022-38e6bd5e5bbf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:05.462419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ba734917-02f2-4b3d-b69a-8c698934e346 req-8e4600d1-02b2-4696-9022-38e6bd5e5bbf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:05.465749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e5a2be68-c481-4e27-8c7a-313330697420 tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:05.503754 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ba734917-02f2-4b3d-b69a-8c698934e346 req-8e4600d1-02b2-4696-9022-38e6bd5e5bbf service nova] Creating event network-changed:00cbdba8-58fb-4799-910c-9bb07b2bd780 for instance 4c0f478e-9899-40b9-b4fc-c937daf213fd on n-h2-854823-1 Aug 27 04:34:05.517251 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ba734917-02f2-4b3d-b69a-8c698934e346 req-8e4600d1-02b2-4696-9022-38e6bd5e5bbf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113695 Aug 27 04:34:05.520028 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 303/595] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:34:05.538269 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e5a2be68-c481-4e27-8c7a-313330697420 tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.077450 Aug 27 04:34:05.543344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bff1e0a3-fea0-4bfb-9c74-9c6f4a15ea4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:05.545377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bff1e0a3-fea0-4bfb-9c74-9c6f4a15ea4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:05.555344 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 293/596] 10.222.0.79 () {58 vars in 1169 bytes} [Sat Aug 27 04:34:05 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:05.560574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff1e0a3-fea0-4bfb-9c74-9c6f4a15ea4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:05.562044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff1e0a3-fea0-4bfb-9c74-9c6f4a15ea4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:05.562256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-848b7550-bc87-49b9-8759-c2485baca304 tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:05.564865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff1e0a3-fea0-4bfb-9c74-9c6f4a15ea4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:05.565789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff1e0a3-fea0-4bfb-9c74-9c6f4a15ea4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:05.566476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff1e0a3-fea0-4bfb-9c74-9c6f4a15ea4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:05.570522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff1e0a3-fea0-4bfb-9c74-9c6f4a15ea4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:05.593458 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-848b7550-bc87-49b9-8759-c2485baca304 tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.036633 Aug 27 04:34:05.605897 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 294/597] 10.222.0.79 () {58 vars in 1161 bytes} [Sat Aug 27 04:34:05 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:05.626614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0fdfb0eb-291d-4ac7-b408-58622de8339a tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:05.652678 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0fdfb0eb-291d-4ac7-b408-58622de8339a tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033489 Aug 27 04:34:05.653299 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 295/598] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:34:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:05.683346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2739e3cc-7395-43f0-929d-db7e8fb8b93f tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:05.782539 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2739e3cc-7395-43f0-929d-db7e8fb8b93f tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2912 microversion: 2.1 time: 0.111901 Aug 27 04:34:05.783461 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 296/599] 10.222.0.79 () {58 vars in 1167 bytes} [Sat Aug 27 04:34:05 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2912 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:05.799576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58239215-b371-48ff-9ae4-a0c7d1fe0df7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:05.800475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-58239215-b371-48ff-9ae4-a0c7d1fe0df7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:05.803751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:05.807795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58239215-b371-48ff-9ae4-a0c7d1fe0df7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:05.808498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58239215-b371-48ff-9ae4-a0c7d1fe0df7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:05.809127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58239215-b371-48ff-9ae4-a0c7d1fe0df7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:05.810507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58239215-b371-48ff-9ae4-a0c7d1fe0df7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:05.811130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58239215-b371-48ff-9ae4-a0c7d1fe0df7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:05.811715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58239215-b371-48ff-9ae4-a0c7d1fe0df7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:05.906243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bff1e0a3-fea0-4bfb-9c74-9c6f4a15ea4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:05.914800 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bff1e0a3-fea0-4bfb-9c74-9c6f4a15ea4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1476 microversion: 2.1 time: 0.393404 Aug 27 04:34:05.915368 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 304/600] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:05 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1476 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:05.922257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-166af9b1-f098-4a71-b01c-9750ea680b6f tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:05.966411 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-166af9b1-f098-4a71-b01c-9750ea680b6f tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044756 Aug 27 04:34:05.969090 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 305/601] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:34:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:05.979902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8e846671-f9e1-413d-a471-2528614488f6 tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:06.018994 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8e846671-f9e1-413d-a471-2528614488f6 tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.042974 Aug 27 04:34:06.020249 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 306/602] 10.222.0.79 () {58 vars in 1144 bytes} [Sat Aug 27 04:34:05 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:06.031661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-58239215-b371-48ff-9ae4-a0c7d1fe0df7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:06.040621 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-58239215-b371-48ff-9ae4-a0c7d1fe0df7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1319 microversion: 2.1 time: 0.244784 Aug 27 04:34:06.045051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-25295cb1-d22f-41bd-a9e1-c29335bb270b tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:06.053458 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 297/603] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:05 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:06.070226 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-25295cb1-d22f-41bd-a9e1-c29335bb270b tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033156 Aug 27 04:34:06.078466 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 307/604] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:34:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:06.088229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e007576-4329-4c05-b112-7cfb8efb8714 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:06.088863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e007576-4329-4c05-b112-7cfb8efb8714 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:06.090600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-89c6591a-af50-438c-9561-3c5491010cd3 tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:06.096764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e007576-4329-4c05-b112-7cfb8efb8714 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:06.097592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e007576-4329-4c05-b112-7cfb8efb8714 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:06.098267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e007576-4329-4c05-b112-7cfb8efb8714 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:06.099298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e007576-4329-4c05-b112-7cfb8efb8714 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:06.100951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e007576-4329-4c05-b112-7cfb8efb8714 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:06.101852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e007576-4329-4c05-b112-7cfb8efb8714 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:06.127820 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-89c6591a-af50-438c-9561-3c5491010cd3 tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.042946 Aug 27 04:34:06.139464 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 308/605] 10.222.0.79 () {58 vars in 1148 bytes} [Sat Aug 27 04:34:06 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:06.145648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c1846e5b-58e4-4054-9872-d3902f60fc7b tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:06.167449 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c1846e5b-58e4-4054-9872-d3902f60fc7b tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.026483 Aug 27 04:34:06.168328 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 309/606] 10.222.0.79 () {58 vars in 1140 bytes} [Sat Aug 27 04:34:06 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:06.182612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-85c6bf60-aa04-42a0-bf61-5ca157cfadca tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:06.191712 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-85c6bf60-aa04-42a0-bf61-5ca157cfadca tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014161 Aug 27 04:34:06.199325 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 310/607] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:34:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:06.204606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0326706c-4d57-4564-b8b5-ad3970886cda tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:06.225628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e007576-4329-4c05-b112-7cfb8efb8714 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:06.237102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e007576-4329-4c05-b112-7cfb8efb8714 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:06.239180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e007576-4329-4c05-b112-7cfb8efb8714 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:06.240932 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e007576-4329-4c05-b112-7cfb8efb8714 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1332 microversion: 2.25 time: 0.156625 Aug 27 04:34:06.242079 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 298/608] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:06 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1332 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:06.246057 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0326706c-4d57-4564-b8b5-ad3970886cda tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1541 microversion: 2.1 time: 0.045187 Aug 27 04:34:06.255178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f20cd02-52d7-43a9-acf9-f94632767e59 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:06.255555 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 311/609] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:34:06 2022] GET /compute/v2.1/flavors?marker=452 => generated 1541 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:06.257218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f20cd02-52d7-43a9-acf9-f94632767e59 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:06.260483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3749ca1e-d048-407b-ada4-9c75cfa0f9ca tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:06.264061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f20cd02-52d7-43a9-acf9-f94632767e59 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:06.265487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f20cd02-52d7-43a9-acf9-f94632767e59 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:06.266038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f20cd02-52d7-43a9-acf9-f94632767e59 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:06.267016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f20cd02-52d7-43a9-acf9-f94632767e59 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:06.267636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f20cd02-52d7-43a9-acf9-f94632767e59 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:06.268163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f20cd02-52d7-43a9-acf9-f94632767e59 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:06.289669 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3749ca1e-d048-407b-ada4-9c75cfa0f9ca tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.032820 Aug 27 04:34:06.303567 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 312/610] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:34:06 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:06.311184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b0e3943d-1aa7-4441-84a0-2ec866e19c5c tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:06.319975 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b0e3943d-1aa7-4441-84a0-2ec866e19c5c tempest-FlavorsV2TestJSON-1669918862 tempest-FlavorsV2TestJSON-1669918862-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013261 Aug 27 04:34:06.320853 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 313/611] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:34:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:34:06.332115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-da57ca51-05b7-4fbb-9044-ae8f8f2f8112 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:06.333423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-da57ca51-05b7-4fbb-9044-ae8f8f2f8112 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] [instance: de5d3f95-67da-4f5c-8422-c775bd151f03] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:06.341884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da57ca51-05b7-4fbb-9044-ae8f8f2f8112 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:06.342503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da57ca51-05b7-4fbb-9044-ae8f8f2f8112 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:06.343040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da57ca51-05b7-4fbb-9044-ae8f8f2f8112 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:06.343982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da57ca51-05b7-4fbb-9044-ae8f8f2f8112 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:06.349187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da57ca51-05b7-4fbb-9044-ae8f8f2f8112 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:06.350833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da57ca51-05b7-4fbb-9044-ae8f8f2f8112 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:06.369856 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-da57ca51-05b7-4fbb-9044-ae8f8f2f8112 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] HTTP exception thrown: Instance de5d3f95-67da-4f5c-8422-c775bd151f03 could not be found. Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-da57ca51-05b7-4fbb-9044-ae8f8f2f8112 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Request method failure captured: Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 HTTP/1.1 Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5qoPtu0vcquEjfsdRALCbpRpZUd4YcNLQ0ktyJj1TCKNZ4ye2btXmAUyJkG5ZC-UMghou8GV69gbfEQvYTPKajukgxLIwkGXCntZAJfoicJ81zjBHMHMNR8Yzsihsaqd3uW1tcJImz73And9NnCRyeJ1oux_EJzdHeuwhIY7YZ2bI Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 73540a547efa4eccb535f6e38d60f67a Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-LiveMigrationNegativeTest-1524304022 Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:34:06.371709 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:34:06.373341 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73540a547efa4eccb535f6e38d60f67a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_73540a547efa4eccb535f6e38d60f67a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/73540a547efa4eccb535f6e38d60f67a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73540a547efa4eccb535f6e38d60f67a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:06.373341 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-LiveMigrationNegativeTest-1524304022 Aug 27 04:34:06.373341 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 73540a547efa4eccb535f6e38d60f67a Aug 27 04:34:06.373341 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1524304022 Aug 27 04:34:06.373341 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-LiveMigrationNegativeTest-1524304022-project Aug 27 04:34:06.373341 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:34:06.373341 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:34:06.373341 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: f60c624cc43945ea9de2731f0c93156c Aug 27 04:34:06.373341 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-LiveMigrationNegativeTest-1524304022-project Aug 27 04:34:06.373341 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:34:06.373341 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance de5d3f95-67da-4f5c-8422-c775bd151f03 could not be found. Aug 27 04:34:06.373341 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'de5d3f95-67da-4f5c-8422-c775bd151f03'} Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de5d3f95-67da-4f5c-8422-c775bd151f03 could not be found. Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:06.374294 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de5d3f95-67da-4f5c-8422-c775bd151f03 could not be found. Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de5d3f95-67da-4f5c-8422-c775bd151f03 could not be found. Aug 27 04:34:06.375782 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:06.378751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-da57ca51-05b7-4fbb-9044-ae8f8f2f8112 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] Returning 404 to user: Instance de5d3f95-67da-4f5c-8422-c775bd151f03 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:06.378751 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-da57ca51-05b7-4fbb-9044-ae8f8f2f8112 tempest-LiveMigrationNegativeTest-1524304022 tempest-LiveMigrationNegativeTest-1524304022-project] 10.222.0.79 "GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03" status: 404 len: 111 microversion: 2.1 time: 0.047485 Aug 27 04:34:06.378751 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 314/612] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:06 2022] GET /compute/v2.1/servers/de5d3f95-67da-4f5c-8422-c775bd151f03 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:34:06.509574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f20cd02-52d7-43a9-acf9-f94632767e59 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:06.521055 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f20cd02-52d7-43a9-acf9-f94632767e59 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1371 microversion: 2.1 time: 0.277639 Aug 27 04:34:06.521708 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 299/613] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:06 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:06.936782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-88f93f65-7f9b-45f8-882f-679887ee4a32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:06.937959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-88f93f65-7f9b-45f8-882f-679887ee4a32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:06.945240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88f93f65-7f9b-45f8-882f-679887ee4a32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:06.945991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88f93f65-7f9b-45f8-882f-679887ee4a32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:06.946417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88f93f65-7f9b-45f8-882f-679887ee4a32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:06.947368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88f93f65-7f9b-45f8-882f-679887ee4a32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:06.947834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88f93f65-7f9b-45f8-882f-679887ee4a32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:06.948430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88f93f65-7f9b-45f8-882f-679887ee4a32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:07.062682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ee02622-d61f-417f-b8a1-f6ec34b89edf tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:07.064443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ee02622-d61f-417f-b8a1-f6ec34b89edf tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:07.078286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ee02622-d61f-417f-b8a1-f6ec34b89edf tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:07.079198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ee02622-d61f-417f-b8a1-f6ec34b89edf tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:07.079852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ee02622-d61f-417f-b8a1-f6ec34b89edf tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:07.080795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ee02622-d61f-417f-b8a1-f6ec34b89edf tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:07.081405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ee02622-d61f-417f-b8a1-f6ec34b89edf tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:07.081984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ee02622-d61f-417f-b8a1-f6ec34b89edf tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:07.382962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-88f93f65-7f9b-45f8-882f-679887ee4a32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:07.390900 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-88f93f65-7f9b-45f8-882f-679887ee4a32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1476 microversion: 2.1 time: 0.457895 Aug 27 04:34:07.391481 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 315/614] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:06 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1476 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:07.408393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d028fe40-f79d-44ab-9a5f-482ff89ec902 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:07.409035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d028fe40-f79d-44ab-9a5f-482ff89ec902 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:07.412005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:07.426050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d028fe40-f79d-44ab-9a5f-482ff89ec902 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:07.426569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d028fe40-f79d-44ab-9a5f-482ff89ec902 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:07.426994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d028fe40-f79d-44ab-9a5f-482ff89ec902 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:07.427762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d028fe40-f79d-44ab-9a5f-482ff89ec902 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:07.428224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d028fe40-f79d-44ab-9a5f-482ff89ec902 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:07.428674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d028fe40-f79d-44ab-9a5f-482ff89ec902 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:07.562631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ee02622-d61f-417f-b8a1-f6ec34b89edf tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:07.569537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:07.572592 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ee02622-d61f-417f-b8a1-f6ec34b89edf tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1319 microversion: 2.1 time: 0.513693 Aug 27 04:34:07.586768 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 300/615] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:07 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1319 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:07.592161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e7ff53c-59c9-4eb8-9578-cf4891135ace tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:07.593093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e7ff53c-59c9-4eb8-9578-cf4891135ace tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:07.599713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e7ff53c-59c9-4eb8-9578-cf4891135ace tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:07.600628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e7ff53c-59c9-4eb8-9578-cf4891135ace tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:07.601277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e7ff53c-59c9-4eb8-9578-cf4891135ace tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:07.602202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e7ff53c-59c9-4eb8-9578-cf4891135ace tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:07.602721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e7ff53c-59c9-4eb8-9578-cf4891135ace tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:07.603343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e7ff53c-59c9-4eb8-9578-cf4891135ace tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:07.632015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d028fe40-f79d-44ab-9a5f-482ff89ec902 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:07.667534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d028fe40-f79d-44ab-9a5f-482ff89ec902 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:07.670611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d028fe40-f79d-44ab-9a5f-482ff89ec902 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:07.687385 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d028fe40-f79d-44ab-9a5f-482ff89ec902 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1320 microversion: 2.25 time: 0.291327 Aug 27 04:34:07.688680 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 316/616] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:07 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:07.794457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e7ff53c-59c9-4eb8-9578-cf4891135ace tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:07.803246 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e7ff53c-59c9-4eb8-9578-cf4891135ace tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1371 microversion: 2.1 time: 0.215084 Aug 27 04:34:07.803840 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 301/617] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:07 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:08.415211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a71dc6c7-57b5-4c31-8f75-d43ab58c7bd7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:08.415818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a71dc6c7-57b5-4c31-8f75-d43ab58c7bd7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:08.424072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a71dc6c7-57b5-4c31-8f75-d43ab58c7bd7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:08.426741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a71dc6c7-57b5-4c31-8f75-d43ab58c7bd7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:08.427382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a71dc6c7-57b5-4c31-8f75-d43ab58c7bd7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:08.431334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a71dc6c7-57b5-4c31-8f75-d43ab58c7bd7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:08.431813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a71dc6c7-57b5-4c31-8f75-d43ab58c7bd7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:08.432253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a71dc6c7-57b5-4c31-8f75-d43ab58c7bd7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:08.595479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-998352de-e612-47af-95e0-9dc5a6e8a01c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:08.596916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-998352de-e612-47af-95e0-9dc5a6e8a01c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:08.604556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-998352de-e612-47af-95e0-9dc5a6e8a01c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:08.605337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-998352de-e612-47af-95e0-9dc5a6e8a01c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:08.605919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-998352de-e612-47af-95e0-9dc5a6e8a01c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:08.606959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-998352de-e612-47af-95e0-9dc5a6e8a01c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:08.607617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-998352de-e612-47af-95e0-9dc5a6e8a01c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:08.608187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-998352de-e612-47af-95e0-9dc5a6e8a01c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:09.017401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-998352de-e612-47af-95e0-9dc5a6e8a01c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:09.031673 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-998352de-e612-47af-95e0-9dc5a6e8a01c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1319 microversion: 2.1 time: 0.440320 Aug 27 04:34:09.050884 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 302/618] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:08 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:09.069713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a71dc6c7-57b5-4c31-8f75-d43ab58c7bd7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:09.079747 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a71dc6c7-57b5-4c31-8f75-d43ab58c7bd7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1476 microversion: 2.1 time: 0.668306 Aug 27 04:34:09.085318 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 317/619] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:08 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1476 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:09.087204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c9cd4d9-58db-404a-86a6-7a6ecca07dcc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:09.089472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c9cd4d9-58db-404a-86a6-7a6ecca07dcc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:09.101961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f2279616-daea-474f-8a49-65e5953bcd2b tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:09.102882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f2279616-daea-474f-8a49-65e5953bcd2b tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:09.109411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9cd4d9-58db-404a-86a6-7a6ecca07dcc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:09.112300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9cd4d9-58db-404a-86a6-7a6ecca07dcc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:09.113155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9cd4d9-58db-404a-86a6-7a6ecca07dcc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:09.113894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9cd4d9-58db-404a-86a6-7a6ecca07dcc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:09.114364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9cd4d9-58db-404a-86a6-7a6ecca07dcc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:09.114824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9cd4d9-58db-404a-86a6-7a6ecca07dcc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:09.120588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2279616-daea-474f-8a49-65e5953bcd2b tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:09.121096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2279616-daea-474f-8a49-65e5953bcd2b tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:09.121534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2279616-daea-474f-8a49-65e5953bcd2b tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:09.122241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2279616-daea-474f-8a49-65e5953bcd2b tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:09.122863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2279616-daea-474f-8a49-65e5953bcd2b tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:09.123437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2279616-daea-474f-8a49-65e5953bcd2b tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:09.282773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c9cd4d9-58db-404a-86a6-7a6ecca07dcc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:09.299143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c9cd4d9-58db-404a-86a6-7a6ecca07dcc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:09.302103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c9cd4d9-58db-404a-86a6-7a6ecca07dcc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:09.304215 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c9cd4d9-58db-404a-86a6-7a6ecca07dcc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1320 microversion: 2.25 time: 0.251667 Aug 27 04:34:09.305390 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 303/620] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:09 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1320 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:10.048455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f2279616-daea-474f-8a49-65e5953bcd2b tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:10.061115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3cf06b0d-ecc0-4da2-a9bb-9fa66e48b618 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:10.061896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3cf06b0d-ecc0-4da2-a9bb-9fa66e48b618 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:10.067271 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f2279616-daea-474f-8a49-65e5953bcd2b tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1371 microversion: 2.1 time: 0.978668 Aug 27 04:34:10.067899 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 318/621] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:09 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1371 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:10.074176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=23 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:10.076011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=37 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:10.082280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cf06b0d-ecc0-4da2-a9bb-9fa66e48b618 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:10.085891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cf06b0d-ecc0-4da2-a9bb-9fa66e48b618 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:10.089459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cf06b0d-ecc0-4da2-a9bb-9fa66e48b618 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:10.091591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cf06b0d-ecc0-4da2-a9bb-9fa66e48b618 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:10.092378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cf06b0d-ecc0-4da2-a9bb-9fa66e48b618 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:10.093161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cf06b0d-ecc0-4da2-a9bb-9fa66e48b618 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:10.113088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7607562b-2bf5-47d4-b765-c8bd33a72b77 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:10.115954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7607562b-2bf5-47d4-b765-c8bd33a72b77 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:10.139331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7607562b-2bf5-47d4-b765-c8bd33a72b77 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:10.139935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7607562b-2bf5-47d4-b765-c8bd33a72b77 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:10.140363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7607562b-2bf5-47d4-b765-c8bd33a72b77 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:10.141112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7607562b-2bf5-47d4-b765-c8bd33a72b77 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:10.145620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7607562b-2bf5-47d4-b765-c8bd33a72b77 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:10.146284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7607562b-2bf5-47d4-b765-c8bd33a72b77 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:10.466272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=60 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:10.626831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3cf06b0d-ecc0-4da2-a9bb-9fa66e48b618 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:10.648679 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3cf06b0d-ecc0-4da2-a9bb-9fa66e48b618 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1319 microversion: 2.1 time: 0.588357 Aug 27 04:34:10.652672 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 304/622] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:10 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1319 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:10.673884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-947b60c8-e028-4f45-9d37-28b13a255b3c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:10.677052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-947b60c8-e028-4f45-9d37-28b13a255b3c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:10.701888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-947b60c8-e028-4f45-9d37-28b13a255b3c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:10.703348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-947b60c8-e028-4f45-9d37-28b13a255b3c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:10.707739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-947b60c8-e028-4f45-9d37-28b13a255b3c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:10.708562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-947b60c8-e028-4f45-9d37-28b13a255b3c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:10.711301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-947b60c8-e028-4f45-9d37-28b13a255b3c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:10.711743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-947b60c8-e028-4f45-9d37-28b13a255b3c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:10.981242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7607562b-2bf5-47d4-b765-c8bd33a72b77 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:10.997482 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7607562b-2bf5-47d4-b765-c8bd33a72b77 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1475 microversion: 2.1 time: 0.890719 Aug 27 04:34:11.012131 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 319/623] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:10 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1475 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:11.012888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-00a33f71-ca5d-4e2e-b36c-8abed4b83245 req-2d59c6c6-6ba6-42b4-9e7e-dd751f014b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a00035e-e4c1-4f81-87d6-ec313135748d", "tag": "2c4b570a-3a24-4896-99c5-f379ade7aa08"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:11.038081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-00a33f71-ca5d-4e2e-b36c-8abed4b83245 req-2d59c6c6-6ba6-42b4-9e7e-dd751f014b78 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:11.039304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-00a33f71-ca5d-4e2e-b36c-8abed4b83245 req-2d59c6c6-6ba6-42b4-9e7e-dd751f014b78 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:11.039900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-00a33f71-ca5d-4e2e-b36c-8abed4b83245 req-2d59c6c6-6ba6-42b4-9e7e-dd751f014b78 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:11.065443 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-00a33f71-ca5d-4e2e-b36c-8abed4b83245 req-2d59c6c6-6ba6-42b4-9e7e-dd751f014b78 service nova] Creating event network-changed:2c4b570a-3a24-4896-99c5-f379ade7aa08 for instance 6a00035e-e4c1-4f81-87d6-ec313135748d on n-h1-854823-1 Aug 27 04:34:11.074595 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-00a33f71-ca5d-4e2e-b36c-8abed4b83245 req-2d59c6c6-6ba6-42b4-9e7e-dd751f014b78 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071127 Aug 27 04:34:11.075906 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 320/624] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:11.083938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-7b752c9e-c655-48d7-b3a1-0cf2cb8830be req-2cbd5fa5-3f2b-4226-a0a9-d8919440a2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c316d2a9-3517-44df-8382-8e40ae8d3b1b", "name": "network-vif-unplugged", "status": "completed", "tag": "19550fed-7930-476b-a65b-28ccbc745f07"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:11.096668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7b752c9e-c655-48d7-b3a1-0cf2cb8830be req-2cbd5fa5-3f2b-4226-a0a9-d8919440a2a6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:11.097594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7b752c9e-c655-48d7-b3a1-0cf2cb8830be req-2cbd5fa5-3f2b-4226-a0a9-d8919440a2a6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:11.099018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7b752c9e-c655-48d7-b3a1-0cf2cb8830be req-2cbd5fa5-3f2b-4226-a0a9-d8919440a2a6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:11.128469 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-7b752c9e-c655-48d7-b3a1-0cf2cb8830be req-2cbd5fa5-3f2b-4226-a0a9-d8919440a2a6 service nova] Creating event network-vif-unplugged:19550fed-7930-476b-a65b-28ccbc745f07 for instance c316d2a9-3517-44df-8382-8e40ae8d3b1b on n-h2-854823-1 Aug 27 04:34:11.184943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-7b752c9e-c655-48d7-b3a1-0cf2cb8830be req-2cbd5fa5-3f2b-4226-a0a9-d8919440a2a6 service nova] Instance c316d2a9-3517-44df-8382-8e40ae8d3b1b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:34:11.201506 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-7b752c9e-c655-48d7-b3a1-0cf2cb8830be req-2cbd5fa5-3f2b-4226-a0a9-d8919440a2a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123779 Aug 27 04:34:11.202438 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 321/625] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:11.208239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5faa775a-156c-4592-894c-90911ac49793 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:11.209914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5faa775a-156c-4592-894c-90911ac49793 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:11.217308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5faa775a-156c-4592-894c-90911ac49793 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:11.217988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5faa775a-156c-4592-894c-90911ac49793 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:11.218578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5faa775a-156c-4592-894c-90911ac49793 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:11.219456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5faa775a-156c-4592-894c-90911ac49793 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:11.220075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5faa775a-156c-4592-894c-90911ac49793 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:11.220719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5faa775a-156c-4592-894c-90911ac49793 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:11.405352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-947b60c8-e028-4f45-9d37-28b13a255b3c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:11.426338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-947b60c8-e028-4f45-9d37-28b13a255b3c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:11.430348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-947b60c8-e028-4f45-9d37-28b13a255b3c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:11.432713 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-947b60c8-e028-4f45-9d37-28b13a255b3c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1362 microversion: 2.25 time: 0.776696 Aug 27 04:34:11.436974 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 305/626] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:10 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1362 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:11.678669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6a62aaf-eae3-452d-b40f-6c00e4f73423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:11.679557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6a62aaf-eae3-452d-b40f-6c00e4f73423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:11.693188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a62aaf-eae3-452d-b40f-6c00e4f73423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:11.699574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a62aaf-eae3-452d-b40f-6c00e4f73423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:11.701251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a62aaf-eae3-452d-b40f-6c00e4f73423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:11.703173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a62aaf-eae3-452d-b40f-6c00e4f73423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:11.706293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a62aaf-eae3-452d-b40f-6c00e4f73423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:11.708048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a62aaf-eae3-452d-b40f-6c00e4f73423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:12.093245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5faa775a-156c-4592-894c-90911ac49793 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:12.108135 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5faa775a-156c-4592-894c-90911ac49793 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1371 microversion: 2.1 time: 0.904236 Aug 27 04:34:12.109119 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 322/627] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:11 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1371 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:12.116356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-c2d45564-a33e-4d64-859a-b65b3b85fc96 req-c3fb04e1-4388-438c-85ce-63b5a21a97f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a359715d-5ce1-4edd-8d94-3bba4d560d33", "name": "network-vif-plugged", "status": "completed", "tag": "fb2c924b-d280-4f1a-85fa-1bff5b9d0c84"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:12.138322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c2d45564-a33e-4d64-859a-b65b3b85fc96 req-c3fb04e1-4388-438c-85ce-63b5a21a97f9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:12.139347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c2d45564-a33e-4d64-859a-b65b3b85fc96 req-c3fb04e1-4388-438c-85ce-63b5a21a97f9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:12.139797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c2d45564-a33e-4d64-859a-b65b3b85fc96 req-c3fb04e1-4388-438c-85ce-63b5a21a97f9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:12.153483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d6a62aaf-eae3-452d-b40f-6c00e4f73423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:12.154386 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-c2d45564-a33e-4d64-859a-b65b3b85fc96 req-c3fb04e1-4388-438c-85ce-63b5a21a97f9 service nova] Creating event network-vif-plugged:fb2c924b-d280-4f1a-85fa-1bff5b9d0c84 for instance a359715d-5ce1-4edd-8d94-3bba4d560d33 on n-h1-854823-1 Aug 27 04:34:12.165744 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-c2d45564-a33e-4d64-859a-b65b3b85fc96 req-c3fb04e1-4388-438c-85ce-63b5a21a97f9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053824 Aug 27 04:34:12.166882 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 323/628] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:12.169765 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6a62aaf-eae3-452d-b40f-6c00e4f73423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1319 microversion: 2.1 time: 0.498362 Aug 27 04:34:12.172713 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 306/629] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:11 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:12.185973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1359f81b-466c-4111-bfa0-9ab05def628b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:12.186992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1359f81b-466c-4111-bfa0-9ab05def628b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:12.201950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1359f81b-466c-4111-bfa0-9ab05def628b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:12.207142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1359f81b-466c-4111-bfa0-9ab05def628b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:12.207978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1359f81b-466c-4111-bfa0-9ab05def628b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:12.209265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1359f81b-466c-4111-bfa0-9ab05def628b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:12.212999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1359f81b-466c-4111-bfa0-9ab05def628b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:12.213811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1359f81b-466c-4111-bfa0-9ab05def628b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:12.395121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-83fb14ed-6cc2-4c60-bc2b-067a29146488 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Calling method '.version_select at 0x7f1f2214edc0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:12.476999 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-83fb14ed-6cc2-4c60-bc2b-067a29146488 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/6b9f18697dbc429ba2fad585d3204648" status: 200 len: 371 microversion: 2.1 time: 0.307863 Aug 27 04:34:12.478253 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 324/630] 10.222.0.79 () {58 vars in 1242 bytes} [Sat Aug 27 04:34:12 2022] GET /compute/v2.1/os-quota-sets/6b9f18697dbc429ba2fad585d3204648 => generated 371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:12.487934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2a6d58f1-ed65-4fb0-bd62-744c552f3986 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:12.489099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2a6d58f1-ed65-4fb0-bd62-744c552f3986 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:12.497993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a6d58f1-ed65-4fb0-bd62-744c552f3986 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:12.498627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a6d58f1-ed65-4fb0-bd62-744c552f3986 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:12.499237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a6d58f1-ed65-4fb0-bd62-744c552f3986 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:12.500123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a6d58f1-ed65-4fb0-bd62-744c552f3986 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:12.501213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a6d58f1-ed65-4fb0-bd62-744c552f3986 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:12.503590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a6d58f1-ed65-4fb0-bd62-744c552f3986 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:12.954400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a6d58f1-ed65-4fb0-bd62-744c552f3986 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:12.976799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a6d58f1-ed65-4fb0-bd62-744c552f3986 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:12.978817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a6d58f1-ed65-4fb0-bd62-744c552f3986 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:12.980884 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2a6d58f1-ed65-4fb0-bd62-744c552f3986 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1362 microversion: 2.25 time: 0.500941 Aug 27 04:34:12.982723 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 325/631] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:12 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1362 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:13.001675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1359f81b-466c-4111-bfa0-9ab05def628b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:13.010676 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1359f81b-466c-4111-bfa0-9ab05def628b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1475 microversion: 2.1 time: 0.836386 Aug 27 04:34:13.010997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d3fa5ff4-33f5-46d1-9193-8e1e17e8a58a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Action: 'update', calling method: .version_select at 0x7f1f22081c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:13.012038 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 307/632] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:12 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1475 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:13.126616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3fa5ff4-33f5-46d1-9193-8e1e17e8a58a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:13.127751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3fa5ff4-33f5-46d1-9193-8e1e17e8a58a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:13.128440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3fa5ff4-33f5-46d1-9193-8e1e17e8a58a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:13.129589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3fa5ff4-33f5-46d1-9193-8e1e17e8a58a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:13.130292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-594a1360-b14c-4a6c-bc8f-fe8284a176a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:13.130527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3fa5ff4-33f5-46d1-9193-8e1e17e8a58a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:13.131481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-594a1360-b14c-4a6c-bc8f-fe8284a176a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:13.132173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3fa5ff4-33f5-46d1-9193-8e1e17e8a58a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:13.151118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-594a1360-b14c-4a6c-bc8f-fe8284a176a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:13.151636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-594a1360-b14c-4a6c-bc8f-fe8284a176a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:13.152082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-594a1360-b14c-4a6c-bc8f-fe8284a176a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:13.153020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-594a1360-b14c-4a6c-bc8f-fe8284a176a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:13.154096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-594a1360-b14c-4a6c-bc8f-fe8284a176a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:13.154536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-594a1360-b14c-4a6c-bc8f-fe8284a176a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:13.220485 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d3fa5ff4-33f5-46d1-9193-8e1e17e8a58a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/6b9f18697dbc429ba2fad585d3204648" status: 200 len: 328 microversion: 2.1 time: 0.233784 Aug 27 04:34:13.221348 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 326/633] 10.222.0.79 () {60 vars in 1262 bytes} [Sat Aug 27 04:34:12 2022] PUT /compute/v2.1/os-quota-sets/6b9f18697dbc429ba2fad585d3204648 => generated 328 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:13.231770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-919cace8-8a2f-43a1-a8d6-de521381eae9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:13.232767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-919cace8-8a2f-43a1-a8d6-de521381eae9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:13.241103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-919cace8-8a2f-43a1-a8d6-de521381eae9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:13.241997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-919cace8-8a2f-43a1-a8d6-de521381eae9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:13.242708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-919cace8-8a2f-43a1-a8d6-de521381eae9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:13.243964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-919cace8-8a2f-43a1-a8d6-de521381eae9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:13.244844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-919cace8-8a2f-43a1-a8d6-de521381eae9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:13.245505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-919cace8-8a2f-43a1-a8d6-de521381eae9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:13.468796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-594a1360-b14c-4a6c-bc8f-fe8284a176a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:13.493111 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-594a1360-b14c-4a6c-bc8f-fe8284a176a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1371 microversion: 2.1 time: 0.366935 Aug 27 04:34:13.494558 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 308/634] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:13 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1371 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:13.520166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c4307ab-efa2-446a-b4bc-db1f5f3d4631 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:13.539219 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7c4307ab-efa2-446a-b4bc-db1f5f3d4631 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-quota-sets/6b9f18697dbc429ba2fad585d3204648" status: 202 len: 0 microversion: 2.1 time: 0.042584 Aug 27 04:34:13.540493 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 309/635] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 04:34:13 2022] DELETE /compute/v2.1/os-quota-sets/6b9f18697dbc429ba2fad585d3204648 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:13.548582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f9395969-1a07-4a6d-ab67-942b18ac40a3 req-9754271a-fde3-4452-be9d-677ea1f4842e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "686b50ec-d768-4cc2-bb93-e92096bc7ba0", "tag": "c861cdbe-63fe-49f8-bb14-9b4c752f86d7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:13.562628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f9395969-1a07-4a6d-ab67-942b18ac40a3 req-9754271a-fde3-4452-be9d-677ea1f4842e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:13.563336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f9395969-1a07-4a6d-ab67-942b18ac40a3 req-9754271a-fde3-4452-be9d-677ea1f4842e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:13.564648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f9395969-1a07-4a6d-ab67-942b18ac40a3 req-9754271a-fde3-4452-be9d-677ea1f4842e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:13.583466 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f9395969-1a07-4a6d-ab67-942b18ac40a3 req-9754271a-fde3-4452-be9d-677ea1f4842e service nova] Creating event network-changed:c861cdbe-63fe-49f8-bb14-9b4c752f86d7 for instance 686b50ec-d768-4cc2-bb93-e92096bc7ba0 on n-h1-854823-1 Aug 27 04:34:13.592813 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f9395969-1a07-4a6d-ab67-942b18ac40a3 req-9754271a-fde3-4452-be9d-677ea1f4842e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050328 Aug 27 04:34:13.594092 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 310/636] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:13.603199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cccab19c-8f2a-4ee9-bd42-6724777555a2 req-e567e44e-63de-4edd-a4d2-c4c38ca3f603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c316d2a9-3517-44df-8382-8e40ae8d3b1b", "tag": "19550fed-7930-476b-a65b-28ccbc745f07"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:13.619948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cccab19c-8f2a-4ee9-bd42-6724777555a2 req-e567e44e-63de-4edd-a4d2-c4c38ca3f603 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:13.620811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cccab19c-8f2a-4ee9-bd42-6724777555a2 req-e567e44e-63de-4edd-a4d2-c4c38ca3f603 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:13.621851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cccab19c-8f2a-4ee9-bd42-6724777555a2 req-e567e44e-63de-4edd-a4d2-c4c38ca3f603 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:13.625774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-919cace8-8a2f-43a1-a8d6-de521381eae9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:13.644369 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cccab19c-8f2a-4ee9-bd42-6724777555a2 req-e567e44e-63de-4edd-a4d2-c4c38ca3f603 service nova] Creating event network-changed:19550fed-7930-476b-a65b-28ccbc745f07 for instance c316d2a9-3517-44df-8382-8e40ae8d3b1b on n-h2-854823-1 Aug 27 04:34:13.645120 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-919cace8-8a2f-43a1-a8d6-de521381eae9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1319 microversion: 2.1 time: 0.419059 Aug 27 04:34:13.647681 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 327/637] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:13 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:13.659648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-cccab19c-8f2a-4ee9-bd42-6724777555a2 req-e567e44e-63de-4edd-a4d2-c4c38ca3f603 service nova] Instance c316d2a9-3517-44df-8382-8e40ae8d3b1b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:34:13.669679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-17d27a6c-5fdb-4ea6-a79e-687ab19a460c tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Calling method '.version_select at 0x7f1f22104700>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:13.689915 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cccab19c-8f2a-4ee9-bd42-6724777555a2 req-e567e44e-63de-4edd-a4d2-c4c38ca3f603 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092952 Aug 27 04:34:13.691137 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 311/638] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:13.807062 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-17d27a6c-5fdb-4ea6-a79e-687ab19a460c tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/6b9f18697dbc429ba2fad585d3204648" status: 200 len: 371 microversion: 2.1 time: 0.148489 Aug 27 04:34:13.807999 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 328/639] 10.222.0.79 () {58 vars in 1242 bytes} [Sat Aug 27 04:34:13 2022] GET /compute/v2.1/os-quota-sets/6b9f18697dbc429ba2fad585d3204648 => generated 371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:14.016220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-71229296-9eb8-4197-978a-75e0db8a47f8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:14.017247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-71229296-9eb8-4197-978a-75e0db8a47f8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:14.053877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-54bc6599-1b5c-483f-bbc2-031e06b30d93 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:14.053877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-54bc6599-1b5c-483f-bbc2-031e06b30d93 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:14.053877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54bc6599-1b5c-483f-bbc2-031e06b30d93 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:14.054540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54bc6599-1b5c-483f-bbc2-031e06b30d93 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:14.054623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54bc6599-1b5c-483f-bbc2-031e06b30d93 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:14.058162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71229296-9eb8-4197-978a-75e0db8a47f8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:14.058499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71229296-9eb8-4197-978a-75e0db8a47f8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:14.058968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71229296-9eb8-4197-978a-75e0db8a47f8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:14.059738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71229296-9eb8-4197-978a-75e0db8a47f8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:14.063314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71229296-9eb8-4197-978a-75e0db8a47f8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:14.064161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54bc6599-1b5c-483f-bbc2-031e06b30d93 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:14.067320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71229296-9eb8-4197-978a-75e0db8a47f8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:14.068100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54bc6599-1b5c-483f-bbc2-031e06b30d93 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:14.074328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54bc6599-1b5c-483f-bbc2-031e06b30d93 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:14.407744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71229296-9eb8-4197-978a-75e0db8a47f8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:14.417916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71229296-9eb8-4197-978a-75e0db8a47f8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:14.419337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71229296-9eb8-4197-978a-75e0db8a47f8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:14.420623 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-71229296-9eb8-4197-978a-75e0db8a47f8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1362 microversion: 2.25 time: 0.411943 Aug 27 04:34:14.426301 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 312/640] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:14 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1362 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:14.431769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c447f6e2-fd2a-4fc2-89cc-d0749ebf4b6a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Calling method '.version_select at 0x7f1f21e9fe50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:14.643231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-54bc6599-1b5c-483f-bbc2-031e06b30d93 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:14.657180 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-54bc6599-1b5c-483f-bbc2-031e06b30d93 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1473 microversion: 2.1 time: 0.628726 Aug 27 04:34:14.658390 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 329/641] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:14 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1473 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:14.669816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-5b7cf4de-45c2-431d-94bf-316bb59af22f req-7def65b6-c0e1-4ce7-96d7-116ba6ce71de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c0f478e-9899-40b9-b4fc-c937daf213fd", "name": "network-vif-plugged", "status": "completed", "tag": "00cbdba8-58fb-4799-910c-9bb07b2bd780"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:14.698544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5b7cf4de-45c2-431d-94bf-316bb59af22f req-7def65b6-c0e1-4ce7-96d7-116ba6ce71de service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:14.700977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5b7cf4de-45c2-431d-94bf-316bb59af22f req-7def65b6-c0e1-4ce7-96d7-116ba6ce71de service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:14.703219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5b7cf4de-45c2-431d-94bf-316bb59af22f req-7def65b6-c0e1-4ce7-96d7-116ba6ce71de service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:14.736866 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-5b7cf4de-45c2-431d-94bf-316bb59af22f req-7def65b6-c0e1-4ce7-96d7-116ba6ce71de service nova] Creating event network-vif-plugged:00cbdba8-58fb-4799-910c-9bb07b2bd780 for instance 4c0f478e-9899-40b9-b4fc-c937daf213fd on n-h2-854823-1 Aug 27 04:34:14.744376 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-5b7cf4de-45c2-431d-94bf-316bb59af22f req-7def65b6-c0e1-4ce7-96d7-116ba6ce71de service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084614 Aug 27 04:34:14.745817 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 330/642] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:14.781357 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c447f6e2-fd2a-4fc2-89cc-d0749ebf4b6a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/dc6f42427757414cb335a72cd1715dce/defaults" status: 200 len: 371 microversion: 2.1 time: 0.350142 Aug 27 04:34:14.785585 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 313/643] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 04:34:14 2022] GET /compute/v2.1/os-quota-sets/dc6f42427757414cb335a72cd1715dce/defaults => generated 371 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:14.800306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-832d6994-ea25-4b72-8c4f-e45bbef450e2 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:14.802544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-832d6994-ea25-4b72-8c4f-e45bbef450e2 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:14.810094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa1274c5-214e-467b-b3b5-9d007dd09ce3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:14.812567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fa1274c5-214e-467b-b3b5-9d007dd09ce3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:14.824968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-832d6994-ea25-4b72-8c4f-e45bbef450e2 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:14.828313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-832d6994-ea25-4b72-8c4f-e45bbef450e2 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:14.829838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-832d6994-ea25-4b72-8c4f-e45bbef450e2 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:14.832429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-832d6994-ea25-4b72-8c4f-e45bbef450e2 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:14.833009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-832d6994-ea25-4b72-8c4f-e45bbef450e2 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:14.834562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa1274c5-214e-467b-b3b5-9d007dd09ce3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:14.835243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa1274c5-214e-467b-b3b5-9d007dd09ce3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:14.835925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-832d6994-ea25-4b72-8c4f-e45bbef450e2 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:14.840591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa1274c5-214e-467b-b3b5-9d007dd09ce3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:14.843029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa1274c5-214e-467b-b3b5-9d007dd09ce3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:14.845811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa1274c5-214e-467b-b3b5-9d007dd09ce3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:14.846607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa1274c5-214e-467b-b3b5-9d007dd09ce3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:14.908945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:15.278362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa1274c5-214e-467b-b3b5-9d007dd09ce3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:15.292643 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa1274c5-214e-467b-b3b5-9d007dd09ce3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1319 microversion: 2.1 time: 0.497596 Aug 27 04:34:15.303466 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 314/644] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:14 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:15.306805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43c1daaa-7fde-45ad-9a42-0cf00a6594ad tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:15.313329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43c1daaa-7fde-45ad-9a42-0cf00a6594ad tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:15.320001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43c1daaa-7fde-45ad-9a42-0cf00a6594ad tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:15.321118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43c1daaa-7fde-45ad-9a42-0cf00a6594ad tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:15.321917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43c1daaa-7fde-45ad-9a42-0cf00a6594ad tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:15.322809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43c1daaa-7fde-45ad-9a42-0cf00a6594ad tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:15.323432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43c1daaa-7fde-45ad-9a42-0cf00a6594ad tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:15.324022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43c1daaa-7fde-45ad-9a42-0cf00a6594ad tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:15.366096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43c1daaa-7fde-45ad-9a42-0cf00a6594ad tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:34:15.500759 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43c1daaa-7fde-45ad-9a42-0cf00a6594ad tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "DELETE /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 204 len: 0 microversion: 2.1 time: 0.201049 Aug 27 04:34:15.502196 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 315/645] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:34:15 2022] DELETE /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:34:15.511406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f3f14c5-e9b6-4ded-ba90-80a2f772f3a2 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Action: 'update', calling method: .version_select at 0x7f1f21dd78b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:15.712806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f3f14c5-e9b6-4ded-ba90-80a2f772f3a2 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:15.713649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f3f14c5-e9b6-4ded-ba90-80a2f772f3a2 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:15.715696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f3f14c5-e9b6-4ded-ba90-80a2f772f3a2 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:15.717793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f3f14c5-e9b6-4ded-ba90-80a2f772f3a2 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:15.718742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f3f14c5-e9b6-4ded-ba90-80a2f772f3a2 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:15.719431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f3f14c5-e9b6-4ded-ba90-80a2f772f3a2 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:15.836298 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f3f14c5-e9b6-4ded-ba90-80a2f772f3a2 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/244a778164b047d58c379e8f6354db62" status: 200 len: 328 microversion: 2.1 time: 0.332431 Aug 27 04:34:15.837269 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 316/646] 10.222.0.79 () {60 vars in 1262 bytes} [Sat Aug 27 04:34:15 2022] PUT /compute/v2.1/os-quota-sets/244a778164b047d58c379e8f6354db62 => generated 328 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:15.850377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f664a2f-cd91-4448-9bc9-8407543179e9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:15.852070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f664a2f-cd91-4448-9bc9-8407543179e9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:15.863391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f664a2f-cd91-4448-9bc9-8407543179e9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:15.863875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f664a2f-cd91-4448-9bc9-8407543179e9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:15.864303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f664a2f-cd91-4448-9bc9-8407543179e9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:15.865884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f664a2f-cd91-4448-9bc9-8407543179e9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:15.866387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f664a2f-cd91-4448-9bc9-8407543179e9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:15.867725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f664a2f-cd91-4448-9bc9-8407543179e9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:16.215097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f664a2f-cd91-4448-9bc9-8407543179e9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:16.215307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-832d6994-ea25-4b72-8c4f-e45bbef450e2 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:16.223856 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-832d6994-ea25-4b72-8c4f-e45bbef450e2 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1371 microversion: 2.1 time: 1.476627 Aug 27 04:34:16.229024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f664a2f-cd91-4448-9bc9-8407543179e9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:16.231053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f664a2f-cd91-4448-9bc9-8407543179e9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:16.231873 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f664a2f-cd91-4448-9bc9-8407543179e9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1362 microversion: 2.25 time: 0.393579 Aug 27 04:34:16.236867 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 331/647] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:14 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1371 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:16.247948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-10cb4f36-0479-4919-8e48-8e0ed41d9b68 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:16.248587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-10cb4f36-0479-4919-8e48-8e0ed41d9b68 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:16.252238 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 317/648] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:15 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1362 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:16.256152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10cb4f36-0479-4919-8e48-8e0ed41d9b68 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:16.258174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-183d5685-9062-4b78-a22f-0bd558dc84f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:16.258881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10cb4f36-0479-4919-8e48-8e0ed41d9b68 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:16.259019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-183d5685-9062-4b78-a22f-0bd558dc84f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:16.265762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-183d5685-9062-4b78-a22f-0bd558dc84f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:16.266377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-183d5685-9062-4b78-a22f-0bd558dc84f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:16.266887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10cb4f36-0479-4919-8e48-8e0ed41d9b68 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:16.267022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-183d5685-9062-4b78-a22f-0bd558dc84f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:16.267765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-183d5685-9062-4b78-a22f-0bd558dc84f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:16.268090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10cb4f36-0479-4919-8e48-8e0ed41d9b68 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:16.268759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-183d5685-9062-4b78-a22f-0bd558dc84f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:16.268905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10cb4f36-0479-4919-8e48-8e0ed41d9b68 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:16.269349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-183d5685-9062-4b78-a22f-0bd558dc84f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:16.269643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10cb4f36-0479-4919-8e48-8e0ed41d9b68 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:16.867591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-183d5685-9062-4b78-a22f-0bd558dc84f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:16.906205 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-183d5685-9062-4b78-a22f-0bd558dc84f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1470 microversion: 2.1 time: 0.651501 Aug 27 04:34:16.908115 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 318/649] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:16 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1470 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:16.921773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10cb4f36-0479-4919-8e48-8e0ed41d9b68 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:16.936712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78ca5872-3f9f-46a1-ba83-688a88ab9ab1 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Calling method '.version_select at 0x7f1f21dd6280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:16.937071 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-10cb4f36-0479-4919-8e48-8e0ed41d9b68 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1712 microversion: 2.1 time: 0.697377 Aug 27 04:34:16.937934 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 332/650] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:16 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1712 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:16.957248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d25234d7-e734-4018-835b-ff6db5971982 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:16.960539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d25234d7-e734-4018-835b-ff6db5971982 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:16.973288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d25234d7-e734-4018-835b-ff6db5971982 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:16.974003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d25234d7-e734-4018-835b-ff6db5971982 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:16.975572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d25234d7-e734-4018-835b-ff6db5971982 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:16.976383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d25234d7-e734-4018-835b-ff6db5971982 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:16.976895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d25234d7-e734-4018-835b-ff6db5971982 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:16.977312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d25234d7-e734-4018-835b-ff6db5971982 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:17.096792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78ca5872-3f9f-46a1-ba83-688a88ab9ab1 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:17.098465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78ca5872-3f9f-46a1-ba83-688a88ab9ab1 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:17.099041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78ca5872-3f9f-46a1-ba83-688a88ab9ab1 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:17.100471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78ca5872-3f9f-46a1-ba83-688a88ab9ab1 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:17.101083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78ca5872-3f9f-46a1-ba83-688a88ab9ab1 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:17.101608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78ca5872-3f9f-46a1-ba83-688a88ab9ab1 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:17.126899 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78ca5872-3f9f-46a1-ba83-688a88ab9ab1 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/244a778164b047d58c379e8f6354db62/detail" status: 200 len: 916 microversion: 2.1 time: 0.196937 Aug 27 04:34:17.128021 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 319/651] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:34:16 2022] GET /compute/v2.1/os-quota-sets/244a778164b047d58c379e8f6354db62/detail => generated 916 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:17.137289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68556f64-f853-41f1-9129-1f6e8b77159b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:17.138629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68556f64-f853-41f1-9129-1f6e8b77159b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:17.145616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68556f64-f853-41f1-9129-1f6e8b77159b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:17.147141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68556f64-f853-41f1-9129-1f6e8b77159b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:17.147798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68556f64-f853-41f1-9129-1f6e8b77159b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:17.148777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68556f64-f853-41f1-9129-1f6e8b77159b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:17.149347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68556f64-f853-41f1-9129-1f6e8b77159b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:17.149918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68556f64-f853-41f1-9129-1f6e8b77159b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:17.158146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:17.268212 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68556f64-f853-41f1-9129-1f6e8b77159b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "POST /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b/action" status: 204 len: 0 microversion: 2.1 time: 0.138547 Aug 27 04:34:17.269153 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 320/652] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:34:17 2022] POST /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b/action => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:34:17.286345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e867ae6-c1e1-4249-b2f4-5063875a30df tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:17.287591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e867ae6-c1e1-4249-b2f4-5063875a30df tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:17.301037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e867ae6-c1e1-4249-b2f4-5063875a30df tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:17.301037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e867ae6-c1e1-4249-b2f4-5063875a30df tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:17.301394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e867ae6-c1e1-4249-b2f4-5063875a30df tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:17.302100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e867ae6-c1e1-4249-b2f4-5063875a30df tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:17.303170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e867ae6-c1e1-4249-b2f4-5063875a30df tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:17.303591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e867ae6-c1e1-4249-b2f4-5063875a30df tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:17.607146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d25234d7-e734-4018-835b-ff6db5971982 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:17.636089 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d25234d7-e734-4018-835b-ff6db5971982 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1319 microversion: 2.1 time: 0.689877 Aug 27 04:34:17.643831 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 333/653] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:16 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1319 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:17.649996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b682653a-0259-43cd-98a9-03cd95a4970a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:17.654869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b682653a-0259-43cd-98a9-03cd95a4970a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:17.666752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b682653a-0259-43cd-98a9-03cd95a4970a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:17.667246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b682653a-0259-43cd-98a9-03cd95a4970a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:17.667671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b682653a-0259-43cd-98a9-03cd95a4970a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:17.672152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b682653a-0259-43cd-98a9-03cd95a4970a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:17.672904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b682653a-0259-43cd-98a9-03cd95a4970a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:17.673509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b682653a-0259-43cd-98a9-03cd95a4970a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:17.800465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0e867ae6-c1e1-4249-b2f4-5063875a30df tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:17.818837 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e867ae6-c1e1-4249-b2f4-5063875a30df tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1557 microversion: 2.1 time: 0.544355 Aug 27 04:34:17.839588 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 321/654] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:17 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1557 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:17.845713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8606d3d3-840d-4f97-9378-b7932cbfda6d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:17.846579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8606d3d3-840d-4f97-9378-b7932cbfda6d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:17.877056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8606d3d3-840d-4f97-9378-b7932cbfda6d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:17.877764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8606d3d3-840d-4f97-9378-b7932cbfda6d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:17.881492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8606d3d3-840d-4f97-9378-b7932cbfda6d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:17.881492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8606d3d3-840d-4f97-9378-b7932cbfda6d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:17.884067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8606d3d3-840d-4f97-9378-b7932cbfda6d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:17.885122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8606d3d3-840d-4f97-9378-b7932cbfda6d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:18.313643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8606d3d3-840d-4f97-9378-b7932cbfda6d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:18.334682 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8606d3d3-840d-4f97-9378-b7932cbfda6d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1470 microversion: 2.1 time: 0.492937 Aug 27 04:34:18.335626 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 322/655] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:17 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1470 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:18.340342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-424710f4-e6ed-4294-ac66-a01b0cce2d87 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Action: 'update', calling method: .version_select at 0x7f1f21dd7310>, body: {"quota_set": {"ram": "2048"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:18.465853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424710f4-e6ed-4294-ac66-a01b0cce2d87 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:18.466665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424710f4-e6ed-4294-ac66-a01b0cce2d87 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:18.467293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424710f4-e6ed-4294-ac66-a01b0cce2d87 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:18.468257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424710f4-e6ed-4294-ac66-a01b0cce2d87 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:18.470733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424710f4-e6ed-4294-ac66-a01b0cce2d87 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:18.481944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424710f4-e6ed-4294-ac66-a01b0cce2d87 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:18.511384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b682653a-0259-43cd-98a9-03cd95a4970a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:18.520056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b682653a-0259-43cd-98a9-03cd95a4970a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:18.529303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b682653a-0259-43cd-98a9-03cd95a4970a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:18.530484 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b682653a-0259-43cd-98a9-03cd95a4970a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1362 microversion: 2.25 time: 0.885257 Aug 27 04:34:18.546149 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 334/656] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:17 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1362 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:18.551316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-61d3cad8-df4a-44b3-95a3-c3baffb8ca4e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:18.551809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-61d3cad8-df4a-44b3-95a3-c3baffb8ca4e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:18.559047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61d3cad8-df4a-44b3-95a3-c3baffb8ca4e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:18.563624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424710f4-e6ed-4294-ac66-a01b0cce2d87 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:18.564701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424710f4-e6ed-4294-ac66-a01b0cce2d87 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:18.565224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424710f4-e6ed-4294-ac66-a01b0cce2d87 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:18.566002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61d3cad8-df4a-44b3-95a3-c3baffb8ca4e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:18.566561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61d3cad8-df4a-44b3-95a3-c3baffb8ca4e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:18.569937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424710f4-e6ed-4294-ac66-a01b0cce2d87 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:18.570211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61d3cad8-df4a-44b3-95a3-c3baffb8ca4e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:18.570587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424710f4-e6ed-4294-ac66-a01b0cce2d87 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:18.571097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424710f4-e6ed-4294-ac66-a01b0cce2d87 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:18.571402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61d3cad8-df4a-44b3-95a3-c3baffb8ca4e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:18.572834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61d3cad8-df4a-44b3-95a3-c3baffb8ca4e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:18.683611 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-424710f4-e6ed-4294-ac66-a01b0cce2d87 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/244a778164b047d58c379e8f6354db62?user_id=9fe3782427174dfba272963463a52f8e" status: 200 len: 328 microversion: 2.1 time: 0.346755 Aug 27 04:34:18.684504 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 323/657] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 04:34:18 2022] PUT /compute/v2.1/os-quota-sets/244a778164b047d58c379e8f6354db62?user_id=9fe3782427174dfba272963463a52f8e => generated 328 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:18.689339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1b60375-8298-4273-b3cf-6085fafa1718 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:18.689963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f1b60375-8298-4273-b3cf-6085fafa1718 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:18.696375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b60375-8298-4273-b3cf-6085fafa1718 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:18.696901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b60375-8298-4273-b3cf-6085fafa1718 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:18.697337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b60375-8298-4273-b3cf-6085fafa1718 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:18.698052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b60375-8298-4273-b3cf-6085fafa1718 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:18.698504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b60375-8298-4273-b3cf-6085fafa1718 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:18.698934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b60375-8298-4273-b3cf-6085fafa1718 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:18.833279 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-61d3cad8-df4a-44b3-95a3-c3baffb8ca4e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.285754 Aug 27 04:34:18.834668 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 335/658] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 04:34:18 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33/os-interface => generated 285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:18.839576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-30101cf5-3589-4087-8a5e-36cfe3a6d14e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:18.841251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-30101cf5-3589-4087-8a5e-36cfe3a6d14e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:18.853682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30101cf5-3589-4087-8a5e-36cfe3a6d14e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:18.856081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30101cf5-3589-4087-8a5e-36cfe3a6d14e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:18.860915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30101cf5-3589-4087-8a5e-36cfe3a6d14e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:18.861969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30101cf5-3589-4087-8a5e-36cfe3a6d14e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:18.862662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30101cf5-3589-4087-8a5e-36cfe3a6d14e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:18.863336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30101cf5-3589-4087-8a5e-36cfe3a6d14e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:19.096915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1b60375-8298-4273-b3cf-6085fafa1718 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:19.106447 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1b60375-8298-4273-b3cf-6085fafa1718 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1712 microversion: 2.1 time: 0.420841 Aug 27 04:34:19.107241 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 324/659] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:18 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1712 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:19.132773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5bec556-20e2-4d0f-b44c-3199ec444217 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Calling method '.version_select at 0x7f1f21dd7e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:19.238396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:19.278226 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5bec556-20e2-4d0f-b44c-3199ec444217 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/244a778164b047d58c379e8f6354db62?user_id=9fe3782427174dfba272963463a52f8e" status: 200 len: 370 microversion: 2.1 time: 0.152576 Aug 27 04:34:19.280853 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 325/660] 10.222.0.79 () {58 vars in 1323 bytes} [Sat Aug 27 04:34:19 2022] GET /compute/v2.1/os-quota-sets/244a778164b047d58c379e8f6354db62?user_id=9fe3782427174dfba272963463a52f8e => generated 370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:19.340281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-70cff599-51c9-4bcd-8715-32e811e2005d req-b7c3716e-1f84-4842-800a-9656c87197c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c316d2a9-3517-44df-8382-8e40ae8d3b1b", "name": "network-vif-plugged", "status": "completed", "tag": "19550fed-7930-476b-a65b-28ccbc745f07"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:19.347647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-30101cf5-3589-4087-8a5e-36cfe3a6d14e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:19.357266 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-30101cf5-3589-4087-8a5e-36cfe3a6d14e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1469 microversion: 2.1 time: 0.521119 Aug 27 04:34:19.358352 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 336/661] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:18 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1469 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:19.375144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-70cff599-51c9-4bcd-8715-32e811e2005d req-b7c3716e-1f84-4842-800a-9656c87197c8 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:19.375636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-70cff599-51c9-4bcd-8715-32e811e2005d req-b7c3716e-1f84-4842-800a-9656c87197c8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:19.376323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-70cff599-51c9-4bcd-8715-32e811e2005d req-b7c3716e-1f84-4842-800a-9656c87197c8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:19.378729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6db70bb7-f71e-4941-a880-1d6df8b68adf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:19.379753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6db70bb7-f71e-4941-a880-1d6df8b68adf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:19.389812 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-70cff599-51c9-4bcd-8715-32e811e2005d req-b7c3716e-1f84-4842-800a-9656c87197c8 service nova] Creating event network-vif-plugged:19550fed-7930-476b-a65b-28ccbc745f07 for instance c316d2a9-3517-44df-8382-8e40ae8d3b1b on n-h2-854823-1 Aug 27 04:34:19.395660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-70cff599-51c9-4bcd-8715-32e811e2005d req-b7c3716e-1f84-4842-800a-9656c87197c8 service nova] Instance c316d2a9-3517-44df-8382-8e40ae8d3b1b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:34:19.399863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6db70bb7-f71e-4941-a880-1d6df8b68adf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:19.410049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6db70bb7-f71e-4941-a880-1d6df8b68adf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:19.410760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6db70bb7-f71e-4941-a880-1d6df8b68adf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:19.411714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6db70bb7-f71e-4941-a880-1d6df8b68adf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:19.412356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6db70bb7-f71e-4941-a880-1d6df8b68adf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:19.412992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6db70bb7-f71e-4941-a880-1d6df8b68adf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:19.414314 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-70cff599-51c9-4bcd-8715-32e811e2005d req-b7c3716e-1f84-4842-800a-9656c87197c8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077771 Aug 27 04:34:19.415103 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 326/662] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:34:19.420371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-945b59bb-c204-42d6-9d36-e0f02bff1945 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:19.426724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-945b59bb-c204-42d6-9d36-e0f02bff1945 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:19.438661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945b59bb-c204-42d6-9d36-e0f02bff1945 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:19.439195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945b59bb-c204-42d6-9d36-e0f02bff1945 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:19.439680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945b59bb-c204-42d6-9d36-e0f02bff1945 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:19.441004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945b59bb-c204-42d6-9d36-e0f02bff1945 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:19.441004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945b59bb-c204-42d6-9d36-e0f02bff1945 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:19.443659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945b59bb-c204-42d6-9d36-e0f02bff1945 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:19.980255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6db70bb7-f71e-4941-a880-1d6df8b68adf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:20.001462 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6db70bb7-f71e-4941-a880-1d6df8b68adf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1470 microversion: 2.1 time: 0.639793 Aug 27 04:34:20.009739 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 337/663] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:19 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1470 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:20.025681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f40a72bf-b51a-47e1-9b5c-b117a00e811a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:20.026432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f40a72bf-b51a-47e1-9b5c-b117a00e811a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:20.047567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f40a72bf-b51a-47e1-9b5c-b117a00e811a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:20.047757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f40a72bf-b51a-47e1-9b5c-b117a00e811a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:20.048393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f40a72bf-b51a-47e1-9b5c-b117a00e811a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:20.049654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f40a72bf-b51a-47e1-9b5c-b117a00e811a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:20.061802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f40a72bf-b51a-47e1-9b5c-b117a00e811a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:20.062909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f40a72bf-b51a-47e1-9b5c-b117a00e811a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:20.064977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-945b59bb-c204-42d6-9d36-e0f02bff1945 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:20.084644 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-945b59bb-c204-42d6-9d36-e0f02bff1945 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d" status: 200 len: 1319 microversion: 2.1 time: 0.667100 Aug 27 04:34:20.085403 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 327/664] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:19 2022] GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d => generated 1319 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:20.091152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc445879-67c4-4aa1-90e7-002469d34231 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Calling method '.version_select at 0x7f1f21dd7430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:20.448599 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc445879-67c4-4aa1-90e7-002469d34231 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/dc6f42427757414cb335a72cd1715dce/defaults" status: 200 len: 371 microversion: 2.1 time: 0.361744 Aug 27 04:34:20.450280 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 328/665] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 04:34:20 2022] GET /compute/v2.1/os-quota-sets/dc6f42427757414cb335a72cd1715dce/defaults => generated 371 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:20.462145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23c7fb33-a15b-46ba-b31d-e680f70f3905 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:20.462774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-23c7fb33-a15b-46ba-b31d-e680f70f3905 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:20.470043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23c7fb33-a15b-46ba-b31d-e680f70f3905 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:20.472819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23c7fb33-a15b-46ba-b31d-e680f70f3905 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:20.473196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23c7fb33-a15b-46ba-b31d-e680f70f3905 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:20.473966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23c7fb33-a15b-46ba-b31d-e680f70f3905 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:20.474441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23c7fb33-a15b-46ba-b31d-e680f70f3905 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:20.474830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23c7fb33-a15b-46ba-b31d-e680f70f3905 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:20.685813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f40a72bf-b51a-47e1-9b5c-b117a00e811a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:20.695152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f40a72bf-b51a-47e1-9b5c-b117a00e811a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:20.698214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f40a72bf-b51a-47e1-9b5c-b117a00e811a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:20.699039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-23c7fb33-a15b-46ba-b31d-e680f70f3905 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d4329bce764315901687e5ffb1f645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb6b35f0604c108f1b30f3f7a853bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:20.700738 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f40a72bf-b51a-47e1-9b5c-b117a00e811a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1362 microversion: 2.25 time: 0.689317 Aug 27 04:34:20.710260 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23c7fb33-a15b-46ba-b31d-e680f70f3905 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 200 len: 1644 microversion: 2.1 time: 0.257091 Aug 27 04:34:20.724976 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 329/667] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:20 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 1644 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:20.724976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9e04aa7-2c35-4404-aed6-cdafe259440a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Action: 'update', calling method: .version_select at 0x7f1f21dd6e50>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:20.726617 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 338/667] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:20 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1362 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:20.878967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9e04aa7-2c35-4404-aed6-cdafe259440a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:20.881306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9e04aa7-2c35-4404-aed6-cdafe259440a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:20.884154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9e04aa7-2c35-4404-aed6-cdafe259440a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:20.887655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9e04aa7-2c35-4404-aed6-cdafe259440a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:20.889595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9e04aa7-2c35-4404-aed6-cdafe259440a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:20.890919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9e04aa7-2c35-4404-aed6-cdafe259440a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:21.039454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9bd129bf-33ec-4de8-bb6a-7c2b1fed52a4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:21.042388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9bd129bf-33ec-4de8-bb6a-7c2b1fed52a4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:21.064260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bd129bf-33ec-4de8-bb6a-7c2b1fed52a4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:21.067774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bd129bf-33ec-4de8-bb6a-7c2b1fed52a4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:21.072609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bd129bf-33ec-4de8-bb6a-7c2b1fed52a4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:21.073498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bd129bf-33ec-4de8-bb6a-7c2b1fed52a4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:21.075951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bd129bf-33ec-4de8-bb6a-7c2b1fed52a4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:21.077477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bd129bf-33ec-4de8-bb6a-7c2b1fed52a4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:21.450515 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9e04aa7-2c35-4404-aed6-cdafe259440a tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/dc6f42427757414cb335a72cd1715dce" status: 200 len: 329 microversion: 2.1 time: 0.735282 Aug 27 04:34:21.457717 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 330/668] 10.222.0.79 () {60 vars in 1263 bytes} [Sat Aug 27 04:34:20 2022] PUT /compute/v2.1/os-quota-sets/dc6f42427757414cb335a72cd1715dce => generated 329 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:21.464994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4240ee02-f870-4b0e-88e4-0d53e2406dc5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:21.465409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4240ee02-f870-4b0e-88e4-0d53e2406dc5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:21.489724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4240ee02-f870-4b0e-88e4-0d53e2406dc5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:21.490817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4240ee02-f870-4b0e-88e4-0d53e2406dc5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:21.491164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4240ee02-f870-4b0e-88e4-0d53e2406dc5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:21.491878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4240ee02-f870-4b0e-88e4-0d53e2406dc5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:21.492330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4240ee02-f870-4b0e-88e4-0d53e2406dc5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:21.499272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4240ee02-f870-4b0e-88e4-0d53e2406dc5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:22.104618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9bd129bf-33ec-4de8-bb6a-7c2b1fed52a4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:22.136403 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9bd129bf-33ec-4de8-bb6a-7c2b1fed52a4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1470 microversion: 2.1 time: 1.108732 Aug 27 04:34:22.141196 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 339/669] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:21 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1470 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:22.172909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9ed272cb-b7be-47de-a1b5-7f2de73a6328 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Action: 'update', calling method: .version_select at 0x7f1f2218b430>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:22.310559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ed272cb-b7be-47de-a1b5-7f2de73a6328 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:22.311365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ed272cb-b7be-47de-a1b5-7f2de73a6328 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:22.311875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ed272cb-b7be-47de-a1b5-7f2de73a6328 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:22.312641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ed272cb-b7be-47de-a1b5-7f2de73a6328 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:22.313267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ed272cb-b7be-47de-a1b5-7f2de73a6328 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:22.313839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ed272cb-b7be-47de-a1b5-7f2de73a6328 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:22.334105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4240ee02-f870-4b0e-88e4-0d53e2406dc5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:22.356874 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4240ee02-f870-4b0e-88e4-0d53e2406dc5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d" status: 200 len: 1319 microversion: 2.1 time: 0.890673 Aug 27 04:34:22.358166 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 331/670] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:21 2022] GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d => generated 1319 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:22.363082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8813a28b-1478-4ff3-916c-44d3f5692043 req-043c1f5b-d7d9-4782-ba09-50e62c98441c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a00035e-e4c1-4f81-87d6-ec313135748d", "name": "network-vif-plugged", "status": "completed", "tag": "2c4b570a-3a24-4896-99c5-f379ade7aa08"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:22.396840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8813a28b-1478-4ff3-916c-44d3f5692043 req-043c1f5b-d7d9-4782-ba09-50e62c98441c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:22.397120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8813a28b-1478-4ff3-916c-44d3f5692043 req-043c1f5b-d7d9-4782-ba09-50e62c98441c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:22.397572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8813a28b-1478-4ff3-916c-44d3f5692043 req-043c1f5b-d7d9-4782-ba09-50e62c98441c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:22.432490 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8813a28b-1478-4ff3-916c-44d3f5692043 req-043c1f5b-d7d9-4782-ba09-50e62c98441c service nova] Creating event network-vif-plugged:2c4b570a-3a24-4896-99c5-f379ade7aa08 for instance 6a00035e-e4c1-4f81-87d6-ec313135748d on n-h1-854823-1 Aug 27 04:34:22.463935 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8813a28b-1478-4ff3-916c-44d3f5692043 req-043c1f5b-d7d9-4782-ba09-50e62c98441c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104312 Aug 27 04:34:22.464682 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 332/671] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:22.474335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dbcc1c74-6986-48ad-802f-7d74c3a4f23b req-6b65e150-3804-4996-9a72-f1cbb0d04d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c4690c-4559-494b-bf63-6df014ff0adf", "name": "network-vif-deleted", "tag": "9378765a-d6e8-453c-a8f8-c6d12fd79dfa"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:22.505054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dbcc1c74-6986-48ad-802f-7d74c3a4f23b req-6b65e150-3804-4996-9a72-f1cbb0d04d32 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:22.506063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dbcc1c74-6986-48ad-802f-7d74c3a4f23b req-6b65e150-3804-4996-9a72-f1cbb0d04d32 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:22.518946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dbcc1c74-6986-48ad-802f-7d74c3a4f23b req-6b65e150-3804-4996-9a72-f1cbb0d04d32 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:22.570482 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dbcc1c74-6986-48ad-802f-7d74c3a4f23b req-6b65e150-3804-4996-9a72-f1cbb0d04d32 service nova] Creating event network-vif-deleted:9378765a-d6e8-453c-a8f8-c6d12fd79dfa for instance 64c4690c-4559-494b-bf63-6df014ff0adf on n-h2-854823-1 Aug 27 04:34:22.581992 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dbcc1c74-6986-48ad-802f-7d74c3a4f23b req-6b65e150-3804-4996-9a72-f1cbb0d04d32 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116019 Aug 27 04:34:22.582621 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 333/672] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:22.594059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2d1cfe0-9c57-48d9-ba52-98ce83114757 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:22.598376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2d1cfe0-9c57-48d9-ba52-98ce83114757 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:22.617154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d1cfe0-9c57-48d9-ba52-98ce83114757 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:22.617660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d1cfe0-9c57-48d9-ba52-98ce83114757 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:22.618945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d1cfe0-9c57-48d9-ba52-98ce83114757 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:22.624149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d1cfe0-9c57-48d9-ba52-98ce83114757 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:22.624909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d1cfe0-9c57-48d9-ba52-98ce83114757 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:22.627415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d1cfe0-9c57-48d9-ba52-98ce83114757 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:22.780838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:UPDATE=7 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:23.085712 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9ed272cb-b7be-47de-a1b5-7f2de73a6328 tempest-QuotasAdminTestJSON-490723327 tempest-QuotasAdminTestJSON-490723327-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/dc6f42427757414cb335a72cd1715dce" status: 200 len: 329 microversion: 2.1 time: 0.939316 Aug 27 04:34:23.086590 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 340/673] 10.222.0.79 () {60 vars in 1263 bytes} [Sat Aug 27 04:34:22 2022] PUT /compute/v2.1/os-quota-sets/dc6f42427757414cb335a72cd1715dce => generated 329 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:23.091384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-387fd7e1-3209-404a-9473-7144847a9195 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:23.095470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-387fd7e1-3209-404a-9473-7144847a9195 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:23.106112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-387fd7e1-3209-404a-9473-7144847a9195 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:23.107672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-387fd7e1-3209-404a-9473-7144847a9195 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:23.117192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-387fd7e1-3209-404a-9473-7144847a9195 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:23.118273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-387fd7e1-3209-404a-9473-7144847a9195 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:23.118924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-387fd7e1-3209-404a-9473-7144847a9195 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:23.120314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-387fd7e1-3209-404a-9473-7144847a9195 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:23.140900 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-387fd7e1-3209-404a-9473-7144847a9195 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] HTTP exception thrown: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-387fd7e1-3209-404a-9473-7144847a9195 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Request method failure captured: Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf HTTP/1.1 Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4ycUqktgJFSmMr7TnrEx8cgs4JOs2jPav9O65D2-2J1iXDjns45AyPaDYZg1QHO7IqSFmKrilUgdxnNNG8cC4ks2U-rTUZCpSiQeleafeIzj972upa0ednQW8fOauVF9VmIYCTQK7k9LJkXe9DfjQTjVg7K4g48dngDQeXZHxfFUo Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: dbfb6b35f0604c108f1b30f3f7a853bc Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:34:23.143663 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:34:23.145604 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:23.145604 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:23.145604 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: dbfb6b35f0604c108f1b30f3f7a853bc Aug 27 04:34:23.145604 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:23.145604 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersWithSpecificFlavorTestJSON-780607697-project Aug 27 04:34:23.145604 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:34:23.145604 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:34:23.145604 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 50d4329bce764315901687e5ffb1f645 Aug 27 04:34:23.145604 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697-project Aug 27 04:34:23.145604 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:34:23.145604 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:23.145604 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '64c4690c-4559-494b-bf63-6df014ff0adf'} Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:23.147127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:23.150022 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.154167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-387fd7e1-3209-404a-9473-7144847a9195 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Returning 404 to user: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:23.155455 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-387fd7e1-3209-404a-9473-7144847a9195 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 404 len: 111 microversion: 2.1 time: 0.067758 Aug 27 04:34:23.160523 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 341/674] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:23 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:34:23.167986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2a3037d5-ce58-41c6-9827-1972f12f4985 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:23.169950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2a3037d5-ce58-41c6-9827-1972f12f4985 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:23.181155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a3037d5-ce58-41c6-9827-1972f12f4985 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:23.187069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a3037d5-ce58-41c6-9827-1972f12f4985 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:23.190084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a3037d5-ce58-41c6-9827-1972f12f4985 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:23.194442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a3037d5-ce58-41c6-9827-1972f12f4985 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:23.195967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a3037d5-ce58-41c6-9827-1972f12f4985 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:23.206008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a3037d5-ce58-41c6-9827-1972f12f4985 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:23.215977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2d1cfe0-9c57-48d9-ba52-98ce83114757 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:23.230764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2d1cfe0-9c57-48d9-ba52-98ce83114757 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:23.232660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2d1cfe0-9c57-48d9-ba52-98ce83114757 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:23.238723 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2d1cfe0-9c57-48d9-ba52-98ce83114757 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1362 microversion: 2.25 time: 0.652678 Aug 27 04:34:23.240923 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 334/675] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:22 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1362 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:23.256264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b72eb01-30b1-447b-beb1-4a497973b5bd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:23.257016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b72eb01-30b1-447b-beb1-4a497973b5bd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:23.272391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b72eb01-30b1-447b-beb1-4a497973b5bd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:23.285264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b72eb01-30b1-447b-beb1-4a497973b5bd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:23.285264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b72eb01-30b1-447b-beb1-4a497973b5bd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:23.285264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b72eb01-30b1-447b-beb1-4a497973b5bd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:23.285264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b72eb01-30b1-447b-beb1-4a497973b5bd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:23.285579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b72eb01-30b1-447b-beb1-4a497973b5bd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:23.306744 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8b72eb01-30b1-447b-beb1-4a497973b5bd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] HTTP exception thrown: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b72eb01-30b1-447b-beb1-4a497973b5bd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Request method failure captured: Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff HTTP/1.1 Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4ycUqktgJFSmMr7TnrEx8cgs4JOs2jPav9O65D2-2J1iXDjns45AyPaDYZg1QHO7IqSFmKrilUgdxnNNG8cC4ks2U-rTUZCpSiQeleafeIzj972upa0ednQW8fOauVF9VmIYCTQK7k9LJkXe9DfjQTjVg7K4g48dngDQeXZHxfFUo Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: dbfb6b35f0604c108f1b30f3f7a853bc Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:34:23.316068 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:34:23.317507 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:23.317507 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:23.317507 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: dbfb6b35f0604c108f1b30f3f7a853bc Aug 27 04:34:23.317507 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:23.317507 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersWithSpecificFlavorTestJSON-780607697-project Aug 27 04:34:23.317507 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:34:23.317507 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:34:23.317507 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 50d4329bce764315901687e5ffb1f645 Aug 27 04:34:23.317507 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697-project Aug 27 04:34:23.317507 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:34:23.317507 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:23.317507 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '000044d0-884d-4e30-a18d-5f4ebc4ba4ff'} Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:23.318295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:23.320172 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.327372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b72eb01-30b1-447b-beb1-4a497973b5bd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Returning 404 to user: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:23.328867 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b72eb01-30b1-447b-beb1-4a497973b5bd tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "DELETE /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 404 len: 111 microversion: 2.1 time: 0.085774 Aug 27 04:34:23.331388 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 335/676] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:34:23 2022] DELETE /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:34:23.343585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-aea4001b-673f-4139-9923-04533c4edf20 req-d1778b97-ee06-4d6b-93a2-5eb4618a41b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a359715d-5ce1-4edd-8d94-3bba4d560d33", "tag": "fb2c924b-d280-4f1a-85fa-1bff5b9d0c84"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:23.366357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-aea4001b-673f-4139-9923-04533c4edf20 req-d1778b97-ee06-4d6b-93a2-5eb4618a41b2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:23.367277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-aea4001b-673f-4139-9923-04533c4edf20 req-d1778b97-ee06-4d6b-93a2-5eb4618a41b2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:23.368646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-aea4001b-673f-4139-9923-04533c4edf20 req-d1778b97-ee06-4d6b-93a2-5eb4618a41b2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:23.392961 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-aea4001b-673f-4139-9923-04533c4edf20 req-d1778b97-ee06-4d6b-93a2-5eb4618a41b2 service nova] Creating event network-changed:fb2c924b-d280-4f1a-85fa-1bff5b9d0c84 for instance a359715d-5ce1-4edd-8d94-3bba4d560d33 on n-h1-854823-1 Aug 27 04:34:23.411099 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-aea4001b-673f-4139-9923-04533c4edf20 req-d1778b97-ee06-4d6b-93a2-5eb4618a41b2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077668 Aug 27 04:34:23.414148 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 336/677] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:23.446872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e4060a4-ac26-4a9d-a675-6ff645ef2360 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:23.447664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e4060a4-ac26-4a9d-a675-6ff645ef2360 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:23.454590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e4060a4-ac26-4a9d-a675-6ff645ef2360 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:23.455202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e4060a4-ac26-4a9d-a675-6ff645ef2360 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:23.455659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e4060a4-ac26-4a9d-a675-6ff645ef2360 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:23.458007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e4060a4-ac26-4a9d-a675-6ff645ef2360 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:23.459240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e4060a4-ac26-4a9d-a675-6ff645ef2360 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:23.460100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e4060a4-ac26-4a9d-a675-6ff645ef2360 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:23.476088 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4e4060a4-ac26-4a9d-a675-6ff645ef2360 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] HTTP exception thrown: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e4060a4-ac26-4a9d-a675-6ff645ef2360 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Request method failure captured: Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff HTTP/1.1 Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4ycUqktgJFSmMr7TnrEx8cgs4JOs2jPav9O65D2-2J1iXDjns45AyPaDYZg1QHO7IqSFmKrilUgdxnNNG8cC4ks2U-rTUZCpSiQeleafeIzj972upa0ednQW8fOauVF9VmIYCTQK7k9LJkXe9DfjQTjVg7K4g48dngDQeXZHxfFUo Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: dbfb6b35f0604c108f1b30f3f7a853bc Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:34:23.484877 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:34:23.486396 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:23.486396 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:23.486396 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: dbfb6b35f0604c108f1b30f3f7a853bc Aug 27 04:34:23.486396 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:23.486396 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersWithSpecificFlavorTestJSON-780607697-project Aug 27 04:34:23.486396 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:34:23.486396 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:34:23.486396 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 50d4329bce764315901687e5ffb1f645 Aug 27 04:34:23.486396 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697-project Aug 27 04:34:23.486396 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:34:23.486396 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:23.486396 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '000044d0-884d-4e30-a18d-5f4ebc4ba4ff'} Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:23.487197 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:23.488608 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:23.491267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e4060a4-ac26-4a9d-a675-6ff645ef2360 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Returning 404 to user: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:23.492583 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e4060a4-ac26-4a9d-a675-6ff645ef2360 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 404 len: 111 microversion: 2.1 time: 0.076947 Aug 27 04:34:23.493334 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 337/678] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:23 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:34:23.502458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bacf41af-c979-4711-ae94-bb23b412192f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:23.504093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bacf41af-c979-4711-ae94-bb23b412192f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:23.518229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bacf41af-c979-4711-ae94-bb23b412192f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:23.519002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bacf41af-c979-4711-ae94-bb23b412192f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:23.519607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bacf41af-c979-4711-ae94-bb23b412192f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:23.520497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bacf41af-c979-4711-ae94-bb23b412192f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:23.521711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bacf41af-c979-4711-ae94-bb23b412192f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:23.522309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bacf41af-c979-4711-ae94-bb23b412192f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:23.786045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a3037d5-ce58-41c6-9827-1972f12f4985 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:23.798802 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2a3037d5-ce58-41c6-9827-1972f12f4985 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1470 microversion: 2.1 time: 0.635134 Aug 27 04:34:23.809661 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 342/679] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:23 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1470 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:23.814695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-446b018b-93e9-42c3-9bd0-670088d0706e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '.version_select at 0x7f1f22104af0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:23.864482 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-446b018b-93e9-42c3-9bd0-670088d0706e tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-182086736" status: 202 len: 0 microversion: 2.1 time: 0.053379 Aug 27 04:34:23.865900 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 343/680] 10.222.0.79 () {58 vars in 1218 bytes} [Sat Aug 27 04:34:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-182086736 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:24.268186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-94bc2f66-f6e3-4e2d-8558-33c7b712a89a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:24.269483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-94bc2f66-f6e3-4e2d-8558-33c7b712a89a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:24.280506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94bc2f66-f6e3-4e2d-8558-33c7b712a89a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:24.284724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94bc2f66-f6e3-4e2d-8558-33c7b712a89a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:24.297463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94bc2f66-f6e3-4e2d-8558-33c7b712a89a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:24.298418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94bc2f66-f6e3-4e2d-8558-33c7b712a89a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:24.299064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94bc2f66-f6e3-4e2d-8558-33c7b712a89a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:24.299685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94bc2f66-f6e3-4e2d-8558-33c7b712a89a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:24.319735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bacf41af-c979-4711-ae94-bb23b412192f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:24.334812 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bacf41af-c979-4711-ae94-bb23b412192f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d" status: 200 len: 1319 microversion: 2.1 time: 0.830193 Aug 27 04:34:24.337477 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 338/681] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:23 2022] GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d => generated 1319 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:24.830740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df480a06-c2a9-451e-8ef3-8e0edd55669c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:24.832085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-df480a06-c2a9-451e-8ef3-8e0edd55669c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:24.845373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df480a06-c2a9-451e-8ef3-8e0edd55669c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:24.846353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df480a06-c2a9-451e-8ef3-8e0edd55669c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:24.846952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df480a06-c2a9-451e-8ef3-8e0edd55669c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:24.847843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df480a06-c2a9-451e-8ef3-8e0edd55669c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:24.848456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df480a06-c2a9-451e-8ef3-8e0edd55669c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:24.858778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df480a06-c2a9-451e-8ef3-8e0edd55669c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:24.984622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-94bc2f66-f6e3-4e2d-8558-33c7b712a89a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:24.997779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-94bc2f66-f6e3-4e2d-8558-33c7b712a89a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:25.007417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-94bc2f66-f6e3-4e2d-8558-33c7b712a89a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:25.007417 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-94bc2f66-f6e3-4e2d-8558-33c7b712a89a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1362 microversion: 2.25 time: 0.740270 Aug 27 04:34:25.007417 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 344/682] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:24 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1362 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:34:25.385586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-57e78e19-01e6-4ac3-8d37-41a1d69fb350 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Action: 'create', calling method: .version_select at 0x7f1f22045ee0>, body: {"keypair": {"name": "tempest-keypair-503247008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZqQTtSXPGVsaGmutLeLySDihV5KDkvfKm153c+PO3ox1osYDPCuuMHYlX6YStCvyWOWFfBvv+FTU03IeFXC4SQ4YIHfLPiFxV6PgT0i4ScZBMo6VGa1YAhhNRaeSfOLQ=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:25.416850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-57e78e19-01e6-4ac3-8d37-41a1d69fb350 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Getting quotas for project 8747bb92a41f4edd9b6a0cd832ce6112. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:34:25.425562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-57e78e19-01e6-4ac3-8d37-41a1d69fb350 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Getting quotas for user b6726e43aff14d27916835154cbfdf1d and project 8747bb92a41f4edd9b6a0cd832ce6112. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:34:25.457105 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-57e78e19-01e6-4ac3-8d37-41a1d69fb350 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.448053 Aug 27 04:34:25.458085 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 345/683] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:34:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:25.491886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-df480a06-c2a9-451e-8ef3-8e0edd55669c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:25.514002 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-df480a06-c2a9-451e-8ef3-8e0edd55669c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1470 microversion: 2.1 time: 0.683125 Aug 27 04:34:25.514002 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 339/684] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:24 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1470 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:25.515480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39f6e877-2d7f-455a-9f19-52b52a2273f3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:25.516093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39f6e877-2d7f-455a-9f19-52b52a2273f3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:25.527068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39f6e877-2d7f-455a-9f19-52b52a2273f3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:25.527571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39f6e877-2d7f-455a-9f19-52b52a2273f3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:25.528012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39f6e877-2d7f-455a-9f19-52b52a2273f3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:25.528769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39f6e877-2d7f-455a-9f19-52b52a2273f3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:25.529230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39f6e877-2d7f-455a-9f19-52b52a2273f3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:25.529656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39f6e877-2d7f-455a-9f19-52b52a2273f3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:25.565890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-964871498", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1a71fb22-9573-440e-a3b4-857cf66da6ea"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:25.715232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] validate_networks() for [('1a71fb22-9573-440e-a3b4-857cf66da6ea', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:34:25.893029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-39f6e877-2d7f-455a-9f19-52b52a2273f3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:25.918842 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39f6e877-2d7f-455a-9f19-52b52a2273f3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d" status: 200 len: 1469 microversion: 2.1 time: 0.406192 Aug 27 04:34:25.922804 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 340/685] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:25 2022] GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d => generated 1469 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:25.945747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:25.958839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:25.960946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Searching by: {'reservation_id': 'r-szdriteq', 'deleted': False, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:34:25.968147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:25.969305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:25.970061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:25.971881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:25.972597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:25.973303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:26.167761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:34:26.207961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:26.330419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:26.340618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:26.343520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:26.344966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:26.551013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:34:26.551478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:34:26.552870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:34:26.553297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:34:26.553860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:34:26.610222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:26.611282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:26.613976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:26.618352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:26.621528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:26.626829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:26.642686 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69f010d9-939b-49e0-882e-f44b4300e816 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?reservation_id=r-szdriteq" status: 200 len: 2931 microversion: 2.1 time: 0.703245 Aug 27 04:34:26.643303 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 341/686] 10.222.0.79 () {58 vars in 1197 bytes} [Sat Aug 27 04:34:25 2022] GET /compute/v2.1/servers/detail?reservation_id=r-szdriteq => generated 2931 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:26.655863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a04cb729-5704-4ac9-886d-e8b0a3646c19 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:26.656558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a04cb729-5704-4ac9-886d-e8b0a3646c19 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:26.680628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a04cb729-5704-4ac9-886d-e8b0a3646c19 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:26.683833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a04cb729-5704-4ac9-886d-e8b0a3646c19 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:26.685830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a04cb729-5704-4ac9-886d-e8b0a3646c19 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:26.686597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a04cb729-5704-4ac9-886d-e8b0a3646c19 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:26.687235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a04cb729-5704-4ac9-886d-e8b0a3646c19 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:26.688006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a04cb729-5704-4ac9-886d-e8b0a3646c19 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:26.699811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Getting quotas for project 67b207b502d846718f9d72f62d1d034c. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:34:26.713946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Getting quotas for user daa3b03c362d4032bd17ebfeccdcdb83 and project 67b207b502d846718f9d72f62d1d034c. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:34:26.755983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:34:26.763421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:34:26.889659 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2393f94e-6616-4599-9c79-d1b4d8ce993a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.417027 Aug 27 04:34:26.894764 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 346/687] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:34:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:34:26.919092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-273c8420-9868-4528-bfe2-cb0e563a5866 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:26.920991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-273c8420-9868-4528-bfe2-cb0e563a5866 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:26.941781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-273c8420-9868-4528-bfe2-cb0e563a5866 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:26.945638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-273c8420-9868-4528-bfe2-cb0e563a5866 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:26.946192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-273c8420-9868-4528-bfe2-cb0e563a5866 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:26.947077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-273c8420-9868-4528-bfe2-cb0e563a5866 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:26.948613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-273c8420-9868-4528-bfe2-cb0e563a5866 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:26.949703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-273c8420-9868-4528-bfe2-cb0e563a5866 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:27.198360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a04cb729-5704-4ac9-886d-e8b0a3646c19 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:27.214943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a04cb729-5704-4ac9-886d-e8b0a3646c19 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:27.216456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a04cb729-5704-4ac9-886d-e8b0a3646c19 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:27.231862 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a04cb729-5704-4ac9-886d-e8b0a3646c19 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1362 microversion: 2.25 time: 0.582116 Aug 27 04:34:27.233461 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 342/688] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:26 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1362 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:27.260236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29b2d8bc-dc35-44c9-9d0c-317cb6d23877 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:27.285597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.compute.server_groups [None req-29b2d8bc-dc35-44c9-9d0c-317cb6d23877 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Querying cell e7bc291f-2aa3-4d66-a942-e096e031ad4c(cell1) for 2 instances {{(pid=128869) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 04:34:27.287313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29b2d8bc-dc35-44c9-9d0c-317cb6d23877 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:27.288094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29b2d8bc-dc35-44c9-9d0c-317cb6d23877 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:27.292048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29b2d8bc-dc35-44c9-9d0c-317cb6d23877 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:27.329776 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29b2d8bc-dc35-44c9-9d0c-317cb6d23877 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/28a4efd2-e7db-480d-a95a-9f3c83eb1358" status: 200 len: 270 microversion: 2.1 time: 0.092191 Aug 27 04:34:27.330735 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 343/689] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:34:27 2022] GET /compute/v2.1/os-server-groups/28a4efd2-e7db-480d-a95a-9f3c83eb1358 => generated 270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:27.336843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-816f912b-3227-4b8b-b693-93d771f57bc4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:27.337893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-816f912b-3227-4b8b-b693-93d771f57bc4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:27.410739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-816f912b-3227-4b8b-b693-93d771f57bc4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:27.422212 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-816f912b-3227-4b8b-b693-93d771f57bc4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9" status: 200 len: 1207 microversion: 2.1 time: 0.089911 Aug 27 04:34:27.423907 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 344/690] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:27 2022] GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 => generated 1207 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:27.429128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bad836d-634d-4b56-bfc2-591079d9b2a3 tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:27.463823 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0bad836d-634d-4b56-bfc2-591079d9b2a3 tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/729764359" status: 202 len: 0 microversion: 2.1 time: 0.038560 Aug 27 04:34:27.466126 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 345/691] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 04:34:27 2022] DELETE /compute/v2.1/flavors/729764359 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:27.482958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d1097d62-9917-42b1-b1e2-40ddd4c331b5 req-bbd3f8ce-214b-4b7b-a04d-ea7225e7da82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686b50ec-d768-4cc2-bb93-e92096bc7ba0", "name": "network-vif-plugged", "status": "completed", "tag": "c861cdbe-63fe-49f8-bb14-9b4c752f86d7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:27.534084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d1097d62-9917-42b1-b1e2-40ddd4c331b5 req-bbd3f8ce-214b-4b7b-a04d-ea7225e7da82 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:27.534945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d1097d62-9917-42b1-b1e2-40ddd4c331b5 req-bbd3f8ce-214b-4b7b-a04d-ea7225e7da82 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:27.535598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d1097d62-9917-42b1-b1e2-40ddd4c331b5 req-bbd3f8ce-214b-4b7b-a04d-ea7225e7da82 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:27.546444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-273c8420-9868-4528-bfe2-cb0e563a5866 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:27.552960 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d1097d62-9917-42b1-b1e2-40ddd4c331b5 req-bbd3f8ce-214b-4b7b-a04d-ea7225e7da82 service nova] Creating event network-vif-plugged:c861cdbe-63fe-49f8-bb14-9b4c752f86d7 for instance 686b50ec-d768-4cc2-bb93-e92096bc7ba0 on n-h1-854823-1 Aug 27 04:34:27.562765 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d1097d62-9917-42b1-b1e2-40ddd4c331b5 req-bbd3f8ce-214b-4b7b-a04d-ea7225e7da82 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088200 Aug 27 04:34:27.563495 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-273c8420-9868-4528-bfe2-cb0e563a5866 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1462 microversion: 2.1 time: 0.661830 Aug 27 04:34:27.564240 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 347/692] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:26 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1462 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:27.565374 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 346/693] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:27.585655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-625337a9-62a5-4163-9cfb-f040c4f2bfd0 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:27.586785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-625337a9-62a5-4163-9cfb-f040c4f2bfd0 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:27.598208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a117dd6-6ac4-4ee6-8edd-988188cb97fd tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:27.601055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-625337a9-62a5-4163-9cfb-f040c4f2bfd0 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:27.601813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-625337a9-62a5-4163-9cfb-f040c4f2bfd0 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:27.602191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-625337a9-62a5-4163-9cfb-f040c4f2bfd0 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:27.602956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-625337a9-62a5-4163-9cfb-f040c4f2bfd0 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:27.603399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-625337a9-62a5-4163-9cfb-f040c4f2bfd0 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:27.603827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-625337a9-62a5-4163-9cfb-f040c4f2bfd0 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:27.642904 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a117dd6-6ac4-4ee6-8edd-988188cb97fd tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.050954 Aug 27 04:34:27.647455 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 347/694] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:34:27 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:27.670229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ffa118b0-4ce3-4654-823d-a25cc138fbd7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:27.678424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ffa118b0-4ce3-4654-823d-a25cc138fbd7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:27.685329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=14,nova_api:DELETE=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:27.690909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffa118b0-4ce3-4654-823d-a25cc138fbd7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:27.691698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffa118b0-4ce3-4654-823d-a25cc138fbd7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:27.692979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffa118b0-4ce3-4654-823d-a25cc138fbd7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:27.693915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffa118b0-4ce3-4654-823d-a25cc138fbd7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:27.694533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffa118b0-4ce3-4654-823d-a25cc138fbd7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:27.695339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffa118b0-4ce3-4654-823d-a25cc138fbd7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:27.996143 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-625337a9-62a5-4163-9cfb-f040c4f2bfd0 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 200 len: 1620 microversion: 2.1 time: 0.418124 Aug 27 04:34:28.007548 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 348/695] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:27 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 1620 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:28.017620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-82cbc458-eb80-4af2-a53f-4c497563df47 tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:28.065452 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-82cbc458-eb80-4af2-a53f-4c497563df47 tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/180691224" status: 202 len: 0 microversion: 2.1 time: 0.054610 Aug 27 04:34:28.071996 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 349/696] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 04:34:28 2022] DELETE /compute/v2.1/flavors/180691224 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:28.077981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-393c8f93-3f12-4a54-b685-130d20bb51cc tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:28.078859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-393c8f93-3f12-4a54-b685-130d20bb51cc tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:28.079024 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ffa118b0-4ce3-4654-823d-a25cc138fbd7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1613 microversion: 2.1 time: 0.426731 Aug 27 04:34:28.085502 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 348/697] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:27 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1613 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:28.086908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-393c8f93-3f12-4a54-b685-130d20bb51cc tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:28.087589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-393c8f93-3f12-4a54-b685-130d20bb51cc tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:28.088343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-393c8f93-3f12-4a54-b685-130d20bb51cc tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:28.089251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-393c8f93-3f12-4a54-b685-130d20bb51cc tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:28.089871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-393c8f93-3f12-4a54-b685-130d20bb51cc tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:28.090513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-393c8f93-3f12-4a54-b685-130d20bb51cc tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:28.128674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83c6f3cd-9816-4984-a9e7-56333f8d8461 tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:28.157601 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83c6f3cd-9816-4984-a9e7-56333f8d8461 tempest-ServersWithSpecificFlavorTestJSON-350548790 tempest-ServersWithSpecificFlavorTestJSON-350548790-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069156 Aug 27 04:34:28.158469 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 349/698] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:34:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:28.196958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef4fdb35-b018-40c3-81c7-6aeefad862c4 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Calling method '.version_select at 0x7f1f21db1820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:28.200791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef4fdb35-b018-40c3-81c7-6aeefad862c4 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:28.202299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef4fdb35-b018-40c3-81c7-6aeefad862c4 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:28.202986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef4fdb35-b018-40c3-81c7-6aeefad862c4 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:28.225441 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef4fdb35-b018-40c3-81c7-6aeefad862c4 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.043512 Aug 27 04:34:28.226540 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 350/699] 10.222.0.79 () {58 vars in 1143 bytes} [Sat Aug 27 04:34:28 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:28.241797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6f82374-3a47-4107-b9bb-4dc784f9493a tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:28.242563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6f82374-3a47-4107-b9bb-4dc784f9493a tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:28.251075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6f82374-3a47-4107-b9bb-4dc784f9493a tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:28.252390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6f82374-3a47-4107-b9bb-4dc784f9493a tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:28.253318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6f82374-3a47-4107-b9bb-4dc784f9493a tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:28.254359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6f82374-3a47-4107-b9bb-4dc784f9493a tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:28.255241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6f82374-3a47-4107-b9bb-4dc784f9493a tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:28.256364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6f82374-3a47-4107-b9bb-4dc784f9493a tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:28.272320 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d6f82374-3a47-4107-b9bb-4dc784f9493a tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] HTTP exception thrown: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6f82374-3a47-4107-b9bb-4dc784f9493a tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Request method failure captured: Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf HTTP/1.1 Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4ycUqktgJFSmMr7TnrEx8cgs4JOs2jPav9O65D2-2J1iXDjns45AyPaDYZg1QHO7IqSFmKrilUgdxnNNG8cC4ks2U-rTUZCpSiQeleafeIzj972upa0ednQW8fOauVF9VmIYCTQK7k9LJkXe9DfjQTjVg7K4g48dngDQeXZHxfFUo Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: dbfb6b35f0604c108f1b30f3f7a853bc Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:34:28.274651 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:34:28.276350 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:28.276350 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:28.276350 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: dbfb6b35f0604c108f1b30f3f7a853bc Aug 27 04:34:28.276350 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:28.276350 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersWithSpecificFlavorTestJSON-780607697-project Aug 27 04:34:28.276350 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:34:28.276350 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:34:28.276350 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 50d4329bce764315901687e5ffb1f645 Aug 27 04:34:28.276350 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697-project Aug 27 04:34:28.276350 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:34:28.276350 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:28.276350 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '64c4690c-4559-494b-bf63-6df014ff0adf'} Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:28.277272 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:28.283641 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:28.286601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6f82374-3a47-4107-b9bb-4dc784f9493a tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Returning 404 to user: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:28.286601 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6f82374-3a47-4107-b9bb-4dc784f9493a tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "DELETE /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 404 len: 111 microversion: 2.1 time: 0.041711 Aug 27 04:34:28.286601 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 351/700] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:34:28 2022] DELETE /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:34:28.287248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b1c0ee1-ae21-4064-b46c-b9e1a40b4a3b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:28.287749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b1c0ee1-ae21-4064-b46c-b9e1a40b4a3b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:28.296766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b1c0ee1-ae21-4064-b46c-b9e1a40b4a3b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:28.297555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b1c0ee1-ae21-4064-b46c-b9e1a40b4a3b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:28.297997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b1c0ee1-ae21-4064-b46c-b9e1a40b4a3b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:28.298956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b1c0ee1-ae21-4064-b46c-b9e1a40b4a3b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:28.299406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b1c0ee1-ae21-4064-b46c-b9e1a40b4a3b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:28.299847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b1c0ee1-ae21-4064-b46c-b9e1a40b4a3b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:28.582201 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-393c8f93-3f12-4a54-b685-130d20bb51cc tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d" status: 200 len: 1620 microversion: 2.1 time: 0.507027 Aug 27 04:34:28.584018 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 350/701] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:28 2022] GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d => generated 1620 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:28.593487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-823ec5e2-5d96-47ef-b017-d53214b80695 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:28.594403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-823ec5e2-5d96-47ef-b017-d53214b80695 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 64c4690c-4559-494b-bf63-6df014ff0adf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:28.608258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-823ec5e2-5d96-47ef-b017-d53214b80695 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:28.610272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-823ec5e2-5d96-47ef-b017-d53214b80695 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:28.611565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-823ec5e2-5d96-47ef-b017-d53214b80695 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:28.614614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-823ec5e2-5d96-47ef-b017-d53214b80695 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:28.616393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-823ec5e2-5d96-47ef-b017-d53214b80695 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:28.617739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-823ec5e2-5d96-47ef-b017-d53214b80695 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:28.661264 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-823ec5e2-5d96-47ef-b017-d53214b80695 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] HTTP exception thrown: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-823ec5e2-5d96-47ef-b017-d53214b80695 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Request method failure captured: Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf HTTP/1.1 Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4ycUqktgJFSmMr7TnrEx8cgs4JOs2jPav9O65D2-2J1iXDjns45AyPaDYZg1QHO7IqSFmKrilUgdxnNNG8cC4ks2U-rTUZCpSiQeleafeIzj972upa0ednQW8fOauVF9VmIYCTQK7k9LJkXe9DfjQTjVg7K4g48dngDQeXZHxfFUo Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: dbfb6b35f0604c108f1b30f3f7a853bc Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:34:28.663401 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:34:28.665034 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:28.665034 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:28.665034 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: dbfb6b35f0604c108f1b30f3f7a853bc Aug 27 04:34:28.665034 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:28.665034 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersWithSpecificFlavorTestJSON-780607697-project Aug 27 04:34:28.665034 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:34:28.665034 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:34:28.665034 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 50d4329bce764315901687e5ffb1f645 Aug 27 04:34:28.665034 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697-project Aug 27 04:34:28.665034 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:34:28.665034 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:28.665034 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '64c4690c-4559-494b-bf63-6df014ff0adf'} Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:28.668911 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. Aug 27 04:34:28.670458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:28.672427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-823ec5e2-5d96-47ef-b017-d53214b80695 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Returning 404 to user: Instance 64c4690c-4559-494b-bf63-6df014ff0adf could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:28.672427 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-823ec5e2-5d96-47ef-b017-d53214b80695 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf" status: 404 len: 111 microversion: 2.1 time: 0.079777 Aug 27 04:34:28.674457 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 351/702] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:28 2022] GET /compute/v2.1/servers/64c4690c-4559-494b-bf63-6df014ff0adf => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:34:28.680059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-564b2b37-8956-4a5a-9994-1988a85413b5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:28.680937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-564b2b37-8956-4a5a-9994-1988a85413b5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:28.697210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-564b2b37-8956-4a5a-9994-1988a85413b5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:28.697987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-564b2b37-8956-4a5a-9994-1988a85413b5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:28.698611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-564b2b37-8956-4a5a-9994-1988a85413b5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:28.700606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-564b2b37-8956-4a5a-9994-1988a85413b5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:28.701257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-564b2b37-8956-4a5a-9994-1988a85413b5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:28.702251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-564b2b37-8956-4a5a-9994-1988a85413b5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:28.720916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b1c0ee1-ae21-4064-b46c-b9e1a40b4a3b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:28.731577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b1c0ee1-ae21-4064-b46c-b9e1a40b4a3b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:28.733293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b1c0ee1-ae21-4064-b46c-b9e1a40b4a3b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:28.735666 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b1c0ee1-ae21-4064-b46c-b9e1a40b4a3b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1362 microversion: 2.25 time: 0.454271 Aug 27 04:34:28.736754 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 352/703] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:28 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:28.746392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1406923266", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:28.868863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:34:28.919690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-564b2b37-8956-4a5a-9994-1988a85413b5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:28.929409 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-564b2b37-8956-4a5a-9994-1988a85413b5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9" status: 200 len: 1259 microversion: 2.1 time: 0.253590 Aug 27 04:34:28.949512 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 352/704] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:28 2022] GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 => generated 1259 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:28.967283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-52747d02-93cb-43ea-87a4-cfd1ab8d4326 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:28.967798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-52747d02-93cb-43ea-87a4-cfd1ab8d4326 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:28.977057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52747d02-93cb-43ea-87a4-cfd1ab8d4326 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:28.977557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52747d02-93cb-43ea-87a4-cfd1ab8d4326 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:28.977994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52747d02-93cb-43ea-87a4-cfd1ab8d4326 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:28.978698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52747d02-93cb-43ea-87a4-cfd1ab8d4326 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:28.979153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52747d02-93cb-43ea-87a4-cfd1ab8d4326 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:28.979574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52747d02-93cb-43ea-87a4-cfd1ab8d4326 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:29.013241 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-52747d02-93cb-43ea-87a4-cfd1ab8d4326 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] HTTP exception thrown: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-52747d02-93cb-43ea-87a4-cfd1ab8d4326 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Request method failure captured: Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff HTTP/1.1 Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ4ycUqktgJFSmMr7TnrEx8cgs4JOs2jPav9O65D2-2J1iXDjns45AyPaDYZg1QHO7IqSFmKrilUgdxnNNG8cC4ks2U-rTUZCpSiQeleafeIzj972upa0ednQW8fOauVF9VmIYCTQK7k9LJkXe9DfjQTjVg7K4g48dngDQeXZHxfFUo Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: dbfb6b35f0604c108f1b30f3f7a853bc Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:34:29.014811 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:34:29.016348 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:29.016348 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:29.016348 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: dbfb6b35f0604c108f1b30f3f7a853bc Aug 27 04:34:29.016348 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:29.016348 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersWithSpecificFlavorTestJSON-780607697-project Aug 27 04:34:29.016348 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:34:29.016348 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:34:29.016348 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 50d4329bce764315901687e5ffb1f645 Aug 27 04:34:29.016348 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697-project Aug 27 04:34:29.016348 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:34:29.016348 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:29.016348 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '000044d0-884d-4e30-a18d-5f4ebc4ba4ff'} Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:29.017708 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:29.018873 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:29.020067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-52747d02-93cb-43ea-87a4-cfd1ab8d4326 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Returning 404 to user: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:29.020067 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-52747d02-93cb-43ea-87a4-cfd1ab8d4326 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "DELETE /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 404 len: 111 microversion: 2.1 time: 0.070653 Aug 27 04:34:29.047215 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 353/705] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:34:28 2022] DELETE /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:34:29.052783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2120698456", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "f5b4d765-c03c-44a6-8346-c3bfd70f997b"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:29.181998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:34:29.418795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:34:29.419356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:34:29.419675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:34:29.420088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:34:29.420567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:34:29.438763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:29.439747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:29.440341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:29.441304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:29.442121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:29.442566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:29.544950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Getting quotas for project abfa50b6f05c4413b2a96f2490ac43a1. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:34:29.555671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Getting quotas for user 7e6454ced7834bbdaeee89ccef19f510 and project abfa50b6f05c4413b2a96f2490ac43a1. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:34:29.571667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:34:29.575340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:34:29.693766 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3aaa5c7-cc82-44b0-a7a1-4e7548553a78 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954325 Aug 27 04:34:29.704478 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 353/706] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:34:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:34:29.710386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc08821b-cfa6-4908-aa6a-9408eb1ce273 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:29.711423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fc08821b-cfa6-4908-aa6a-9408eb1ce273 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] [instance: 000044d0-884d-4e30-a18d-5f4ebc4ba4ff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:29.728019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc08821b-cfa6-4908-aa6a-9408eb1ce273 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:29.728926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc08821b-cfa6-4908-aa6a-9408eb1ce273 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:29.729523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc08821b-cfa6-4908-aa6a-9408eb1ce273 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:29.731037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc08821b-cfa6-4908-aa6a-9408eb1ce273 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:29.731819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc08821b-cfa6-4908-aa6a-9408eb1ce273 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:29.733897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc08821b-cfa6-4908-aa6a-9408eb1ce273 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:29.763014 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-fc08821b-cfa6-4908-aa6a-9408eb1ce273 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] HTTP exception thrown: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc08821b-cfa6-4908-aa6a-9408eb1ce273 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Request method failure captured: Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff HTTP/1.1 Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ4ycUqktgJFSmMr7TnrEx8cgs4JOs2jPav9O65D2-2J1iXDjns45AyPaDYZg1QHO7IqSFmKrilUgdxnNNG8cC4ks2U-rTUZCpSiQeleafeIzj972upa0ednQW8fOauVF9VmIYCTQK7k9LJkXe9DfjQTjVg7K4g48dngDQeXZHxfFUo Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: dbfb6b35f0604c108f1b30f3f7a853bc Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:34:29.765031 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:34:29.766976 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbfb6b35f0604c108f1b30f3f7a853bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:29.766976 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:29.766976 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: dbfb6b35f0604c108f1b30f3f7a853bc Aug 27 04:34:29.766976 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697 Aug 27 04:34:29.766976 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersWithSpecificFlavorTestJSON-780607697-project Aug 27 04:34:29.766976 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:34:29.766976 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:34:29.766976 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 50d4329bce764315901687e5ffb1f645 Aug 27 04:34:29.766976 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-780607697-project Aug 27 04:34:29.766976 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:34:29.766976 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:29.766976 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '000044d0-884d-4e30-a18d-5f4ebc4ba4ff'} Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:29.768034 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. Aug 27 04:34:29.769553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:29.773142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc08821b-cfa6-4908-aa6a-9408eb1ce273 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] Returning 404 to user: Instance 000044d0-884d-4e30-a18d-5f4ebc4ba4ff could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:29.782728 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc08821b-cfa6-4908-aa6a-9408eb1ce273 tempest-ServersWithSpecificFlavorTestJSON-780607697 tempest-ServersWithSpecificFlavorTestJSON-780607697-project] 10.222.0.79 "GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff" status: 404 len: 111 microversion: 2.1 time: 0.074943 Aug 27 04:34:29.783465 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 354/707] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:29 2022] GET /compute/v2.1/servers/000044d0-884d-4e30-a18d-5f4ebc4ba4ff => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:34:29.801315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db49ed78-1ccb-4049-b836-c50c8a3fdcb3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:29.804741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db49ed78-1ccb-4049-b836-c50c8a3fdcb3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:29.917813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db49ed78-1ccb-4049-b836-c50c8a3fdcb3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:29.936324 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db49ed78-1ccb-4049-b836-c50c8a3fdcb3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1213 microversion: 2.1 time: 0.150527 Aug 27 04:34:29.939576 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 355/708] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:29 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1213 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:29.966620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33a5c961-5306-4935-be3e-48061e6e81e6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:29.970086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33a5c961-5306-4935-be3e-48061e6e81e6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:29.989896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33a5c961-5306-4935-be3e-48061e6e81e6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:29.992562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33a5c961-5306-4935-be3e-48061e6e81e6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:29.993242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33a5c961-5306-4935-be3e-48061e6e81e6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:29.995017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33a5c961-5306-4935-be3e-48061e6e81e6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:29.998102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33a5c961-5306-4935-be3e-48061e6e81e6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:29.999542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33a5c961-5306-4935-be3e-48061e6e81e6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:30.318430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:34:30.319612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:34:30.320340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:34:30.320921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:34:30.321530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:34:30.345673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33a5c961-5306-4935-be3e-48061e6e81e6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:30.360713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:30.361385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33a5c961-5306-4935-be3e-48061e6e81e6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:30.363327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:30.363787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:30.365181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33a5c961-5306-4935-be3e-48061e6e81e6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:30.365926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:30.366438 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33a5c961-5306-4935-be3e-48061e6e81e6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1558 microversion: 2.25 time: 0.411386 Aug 27 04:34:30.371044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:30.371800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:30.387114 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 356/709] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:29 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1558 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:30.393052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34a47ce6-3387-4c2a-99b3-f23dcb37f913 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:30.393715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34a47ce6-3387-4c2a-99b3-f23dcb37f913 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:30.410753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a47ce6-3387-4c2a-99b3-f23dcb37f913 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:30.411302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a47ce6-3387-4c2a-99b3-f23dcb37f913 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:30.412263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a47ce6-3387-4c2a-99b3-f23dcb37f913 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:30.413017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a47ce6-3387-4c2a-99b3-f23dcb37f913 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:30.413476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a47ce6-3387-4c2a-99b3-f23dcb37f913 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:30.413906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a47ce6-3387-4c2a-99b3-f23dcb37f913 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:30.422795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:34:30.431101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:34:30.454725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=78,nova_api:UPDATE=7,nova_api:DELETE=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:30.466322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:34:30.468506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:34:30.547684 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3549a6c5-b49d-4b95-b791-cbe53fb79a6a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.499220 Aug 27 04:34:30.554956 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 354/710] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:34:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:34:30.556966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-393179287", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "4532faea-b9fd-47c3-9050-64f8d20fc37c"}], "security_groups": [{"name": "tempest-securitygroup--818797593"}], "key_name": "tempest-keypair-503247008", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:30.644410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34a47ce6-3387-4c2a-99b3-f23dcb37f913 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:30.656983 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34a47ce6-3387-4c2a-99b3-f23dcb37f913 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9" status: 200 len: 1265 microversion: 2.1 time: 0.266268 Aug 27 04:34:30.657829 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 357/711] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:30 2022] GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:30.911142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] validate_networks() for [('4532faea-b9fd-47c3-9050-64f8d20fc37c', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:34:31.207240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6cdfbfed-248e-4e94-b9ed-21ed63277fa0 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:31.207906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6cdfbfed-248e-4e94-b9ed-21ed63277fa0 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:31.218846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cdfbfed-248e-4e94-b9ed-21ed63277fa0 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:31.219376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cdfbfed-248e-4e94-b9ed-21ed63277fa0 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:31.222335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cdfbfed-248e-4e94-b9ed-21ed63277fa0 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:31.225732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cdfbfed-248e-4e94-b9ed-21ed63277fa0 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:31.226423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cdfbfed-248e-4e94-b9ed-21ed63277fa0 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:31.227038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cdfbfed-248e-4e94-b9ed-21ed63277fa0 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:31.514524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-6cdfbfed-248e-4e94-b9ed-21ed63277fa0 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 686b50ec-d768-4cc2-bb93-e92096bc7ba0 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:34:31.646879 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6cdfbfed-248e-4e94-b9ed-21ed63277fa0 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 2051 microversion: 2.25 time: 0.987635 Aug 27 04:34:31.649254 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 358/712] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:30 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 2051 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:31.655372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69449c30-be81-4ad0-a1c7-8dc41f94643d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:31.656176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69449c30-be81-4ad0-a1c7-8dc41f94643d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:31.671810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69449c30-be81-4ad0-a1c7-8dc41f94643d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:31.672731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69449c30-be81-4ad0-a1c7-8dc41f94643d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:31.674004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69449c30-be81-4ad0-a1c7-8dc41f94643d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:31.674887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69449c30-be81-4ad0-a1c7-8dc41f94643d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:31.676316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69449c30-be81-4ad0-a1c7-8dc41f94643d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:31.677518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69449c30-be81-4ad0-a1c7-8dc41f94643d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:31.865588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-69449c30-be81-4ad0-a1c7-8dc41f94643d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:31.888605 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69449c30-be81-4ad0-a1c7-8dc41f94643d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1213 microversion: 2.1 time: 0.238005 Aug 27 04:34:31.891322 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 359/713] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:31 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1213 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:31.914746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bba19451-8a29-4cd1-961f-4d9b78abcef7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:31.915430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bba19451-8a29-4cd1-961f-4d9b78abcef7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:31.932778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bba19451-8a29-4cd1-961f-4d9b78abcef7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:31.933459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bba19451-8a29-4cd1-961f-4d9b78abcef7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:31.934148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bba19451-8a29-4cd1-961f-4d9b78abcef7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:31.935445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bba19451-8a29-4cd1-961f-4d9b78abcef7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:31.936079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bba19451-8a29-4cd1-961f-4d9b78abcef7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:31.936914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bba19451-8a29-4cd1-961f-4d9b78abcef7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:32.188086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:34:32.188573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:34:32.189365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:34:32.189789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:34:32.190209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:34:32.200824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:32.201320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:32.201821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:32.202908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:32.203374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:32.203888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:32.222315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Getting quotas for project 8747bb92a41f4edd9b6a0cd832ce6112. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:34:32.227406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Getting quotas for user b6726e43aff14d27916835154cbfdf1d and project 8747bb92a41f4edd9b6a0cd832ce6112. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:34:32.239823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:34:32.242090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:34:32.311454 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-832ed60c-0991-45cd-bdc2-a4afd38f9aa4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.760758 Aug 27 04:34:32.312598 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 355/714] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:34:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:34:32.403446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bba19451-8a29-4cd1-961f-4d9b78abcef7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:32.412366 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bba19451-8a29-4cd1-961f-4d9b78abcef7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1283 microversion: 2.1 time: 0.519763 Aug 27 04:34:32.426238 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 360/715] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:31 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1283 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:32.433984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb239034-15ff-4cc7-b0d6-82e19c5f9c83 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:32.435118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb239034-15ff-4cc7-b0d6-82e19c5f9c83 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:32.441698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb239034-15ff-4cc7-b0d6-82e19c5f9c83 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:32.443419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb239034-15ff-4cc7-b0d6-82e19c5f9c83 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:32.444139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb239034-15ff-4cc7-b0d6-82e19c5f9c83 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:32.445139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb239034-15ff-4cc7-b0d6-82e19c5f9c83 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:32.445817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb239034-15ff-4cc7-b0d6-82e19c5f9c83 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:32.446632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb239034-15ff-4cc7-b0d6-82e19c5f9c83 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:32.520813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68f27185-105d-4b55-9079-227019ae9683 tempest-SecurityGroupsTestAdminJSON-38819515 tempest-SecurityGroupsTestAdminJSON-38819515-project] Action: 'create', calling method: .version_select at 0x7f1f22104160>, body: {"security_group": {"name": "tempest-securitygroup-1796947918", "description": "tempest-description-911386868"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:32.987972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-eb239034-15ff-4cc7-b0d6-82e19c5f9c83 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 686b50ec-d768-4cc2-bb93-e92096bc7ba0 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:34:33.031214 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb239034-15ff-4cc7-b0d6-82e19c5f9c83 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 2051 microversion: 2.25 time: 0.602866 Aug 27 04:34:33.033695 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 361/716] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:32 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 2051 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:33.048218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23e64439-452e-4804-b3e8-2714f2b5f844 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:33.049130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-23e64439-452e-4804-b3e8-2714f2b5f844 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:33.072440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e64439-452e-4804-b3e8-2714f2b5f844 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:33.072976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e64439-452e-4804-b3e8-2714f2b5f844 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:33.073419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e64439-452e-4804-b3e8-2714f2b5f844 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:33.074143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e64439-452e-4804-b3e8-2714f2b5f844 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:33.074606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e64439-452e-4804-b3e8-2714f2b5f844 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:33.075035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e64439-452e-4804-b3e8-2714f2b5f844 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:33.384558 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-68f27185-105d-4b55-9079-227019ae9683 tempest-SecurityGroupsTestAdminJSON-38819515 tempest-SecurityGroupsTestAdminJSON-38819515-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.070499 Aug 27 04:34:33.396187 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 356/717] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:34:32 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:33.401525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-61ecd60c-d752-43ba-b02c-30a2afe585f2 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:33.402308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-61ecd60c-d752-43ba-b02c-30a2afe585f2 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:33.409480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61ecd60c-d752-43ba-b02c-30a2afe585f2 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:33.410212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61ecd60c-d752-43ba-b02c-30a2afe585f2 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:33.410810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61ecd60c-d752-43ba-b02c-30a2afe585f2 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:33.412506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61ecd60c-d752-43ba-b02c-30a2afe585f2 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:33.413258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61ecd60c-d752-43ba-b02c-30a2afe585f2 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:33.413877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61ecd60c-d752-43ba-b02c-30a2afe585f2 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:33.456738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:33.520293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-61ecd60c-d752-43ba-b02c-30a2afe585f2 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:33.528768 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-61ecd60c-d752-43ba-b02c-30a2afe585f2 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1292 microversion: 2.1 time: 0.131283 Aug 27 04:34:33.530117 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 357/718] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:33 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1292 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:33.535611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-82dc3eca-42c4-4222-ad9f-3a1d47c6cbc3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:33.536344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-82dc3eca-42c4-4222-ad9f-3a1d47c6cbc3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:33.542474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82dc3eca-42c4-4222-ad9f-3a1d47c6cbc3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:33.543050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82dc3eca-42c4-4222-ad9f-3a1d47c6cbc3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:33.543571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82dc3eca-42c4-4222-ad9f-3a1d47c6cbc3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:33.556323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82dc3eca-42c4-4222-ad9f-3a1d47c6cbc3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:33.556978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82dc3eca-42c4-4222-ad9f-3a1d47c6cbc3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:33.557571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82dc3eca-42c4-4222-ad9f-3a1d47c6cbc3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:33.658504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-82dc3eca-42c4-4222-ad9f-3a1d47c6cbc3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:33.671172 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-82dc3eca-42c4-4222-ad9f-3a1d47c6cbc3 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1275 microversion: 2.1 time: 0.138399 Aug 27 04:34:33.671773 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 358/719] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:33 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1275 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:33.678906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ddca092a-68ca-4ab5-9d95-70370894c12c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:33.685094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddca092a-68ca-4ab5-9d95-70370894c12c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:33.686301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddca092a-68ca-4ab5-9d95-70370894c12c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:33.686810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddca092a-68ca-4ab5-9d95-70370894c12c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:33.688568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddca092a-68ca-4ab5-9d95-70370894c12c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:33.689029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddca092a-68ca-4ab5-9d95-70370894c12c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:33.689464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddca092a-68ca-4ab5-9d95-70370894c12c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:33.690446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-23e64439-452e-4804-b3e8-2714f2b5f844 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:33.700099 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23e64439-452e-4804-b3e8-2714f2b5f844 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9" status: 200 len: 1307 microversion: 2.1 time: 0.662508 Aug 27 04:34:33.714137 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 362/720] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:33 2022] GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 => generated 1307 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:33.721496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4493aa11-e1e0-4dd2-882e-f82b90b01cb1 req-c10cc2c3-2b7c-4ac8-92f9-909cc2aba614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "503a7b07-108a-45d6-937d-f9cd43ef66a9", "tag": "f2ee1ea2-3d38-4835-832c-5a7d94cd01a8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:33.733426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4493aa11-e1e0-4dd2-882e-f82b90b01cb1 req-c10cc2c3-2b7c-4ac8-92f9-909cc2aba614 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:33.734225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4493aa11-e1e0-4dd2-882e-f82b90b01cb1 req-c10cc2c3-2b7c-4ac8-92f9-909cc2aba614 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:33.735453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4493aa11-e1e0-4dd2-882e-f82b90b01cb1 req-c10cc2c3-2b7c-4ac8-92f9-909cc2aba614 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:33.735958 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ddca092a-68ca-4ab5-9d95-70370894c12c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.062767 Aug 27 04:34:33.737215 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 359/721] 10.222.0.79 () {60 vars in 1217 bytes} [Sat Aug 27 04:34:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:34:33.742836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ed20f71d-60fa-4cf8-b510-7966348306e3 tempest-SecurityGroupsTestAdminJSON-38819515 tempest-SecurityGroupsTestAdminJSON-38819515-project] Action: 'create', calling method: .version_select at 0x7f1f220990d0>, body: {"security_group": {"name": "tempest-securitygroup-1679622438", "description": "tempest-description-688728168"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:33.758273 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4493aa11-e1e0-4dd2-882e-f82b90b01cb1 req-c10cc2c3-2b7c-4ac8-92f9-909cc2aba614 service nova] Creating event network-changed:f2ee1ea2-3d38-4835-832c-5a7d94cd01a8 for instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 on n-h2-854823-1 Aug 27 04:34:33.763836 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4493aa11-e1e0-4dd2-882e-f82b90b01cb1 req-c10cc2c3-2b7c-4ac8-92f9-909cc2aba614 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048348 Aug 27 04:34:33.764751 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 363/722] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:33.772121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b14d5e04-d99b-4ef4-b87e-36f037f0c002 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:33.772968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b14d5e04-d99b-4ef4-b87e-36f037f0c002 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:33.779395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b14d5e04-d99b-4ef4-b87e-36f037f0c002 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:33.779960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b14d5e04-d99b-4ef4-b87e-36f037f0c002 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:33.780431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b14d5e04-d99b-4ef4-b87e-36f037f0c002 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:33.781147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b14d5e04-d99b-4ef4-b87e-36f037f0c002 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:33.781821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b14d5e04-d99b-4ef4-b87e-36f037f0c002 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:33.782575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b14d5e04-d99b-4ef4-b87e-36f037f0c002 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:33.882578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b14d5e04-d99b-4ef4-b87e-36f037f0c002 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:33.902179 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b14d5e04-d99b-4ef4-b87e-36f037f0c002 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1271 microversion: 2.1 time: 0.136119 Aug 27 04:34:33.903437 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 364/723] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:33 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:33.914882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03d2168b-102f-4b45-a3a3-acbd0730f5b7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854823-1", "block_migration": "auto"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:33.918270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03d2168b-102f-4b45-a3a3-acbd0730f5b7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:33.925801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03d2168b-102f-4b45-a3a3-acbd0730f5b7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:33.926736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03d2168b-102f-4b45-a3a3-acbd0730f5b7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:33.928473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03d2168b-102f-4b45-a3a3-acbd0730f5b7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:33.929505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03d2168b-102f-4b45-a3a3-acbd0730f5b7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:33.931026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03d2168b-102f-4b45-a3a3-acbd0730f5b7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:33.931834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03d2168b-102f-4b45-a3a3-acbd0730f5b7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:34.061646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-03d2168b-102f-4b45-a3a3-acbd0730f5b7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'flavor' on Instance uuid 686b50ec-d768-4cc2-bb93-e92096bc7ba0 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:34:34.089656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03d2168b-102f-4b45-a3a3-acbd0730f5b7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Going to try to live migrate instance to n-h2-854823-1 {{(pid=128869) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:34:34.105158 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ed20f71d-60fa-4cf8-b510-7966348306e3 tempest-SecurityGroupsTestAdminJSON-38819515 tempest-SecurityGroupsTestAdminJSON-38819515-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.366555 Aug 27 04:34:34.107460 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 360/724] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:34:33 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:34.141465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:34.228675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2c44558c-4008-4ec1-a19f-a303d678be17 tempest-SecurityGroupsTestAdminJSON-723972863 tempest-SecurityGroupsTestAdminJSON-723972863-project-admin] Action: 'create', calling method: .version_select at 0x7f1f22099ee0>, body: {"security_group": {"name": "tempest-securitygroup-255288228", "description": "tempest-description-1274999928"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:35.506470 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2c44558c-4008-4ec1-a19f-a303d678be17 tempest-SecurityGroupsTestAdminJSON-723972863 tempest-SecurityGroupsTestAdminJSON-723972863-project-admin] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.389956 Aug 27 04:34:35.515383 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 361/725] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:34:34 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:34:35.521858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b1967850-dcde-4304-b14b-a37f109ee7df tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:35.522835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b1967850-dcde-4304-b14b-a37f109ee7df tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:35.541720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1967850-dcde-4304-b14b-a37f109ee7df tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:35.542335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1967850-dcde-4304-b14b-a37f109ee7df tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:35.542880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1967850-dcde-4304-b14b-a37f109ee7df tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:35.543668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1967850-dcde-4304-b14b-a37f109ee7df tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:35.544218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1967850-dcde-4304-b14b-a37f109ee7df tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:35.544815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1967850-dcde-4304-b14b-a37f109ee7df tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:35.710285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b1967850-dcde-4304-b14b-a37f109ee7df tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:35.721269 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b1967850-dcde-4304-b14b-a37f109ee7df tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1298 microversion: 2.1 time: 0.203824 Aug 27 04:34:35.722540 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 362/726] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:35 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1298 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:35.741118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3b9c3d57-fb2a-40a2-85b4-fa0753a6f46e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:35.742068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3b9c3d57-fb2a-40a2-85b4-fa0753a6f46e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:35.759866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b9c3d57-fb2a-40a2-85b4-fa0753a6f46e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:35.761477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b9c3d57-fb2a-40a2-85b4-fa0753a6f46e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:35.762135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b9c3d57-fb2a-40a2-85b4-fa0753a6f46e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:35.763265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b9c3d57-fb2a-40a2-85b4-fa0753a6f46e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:35.765243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b9c3d57-fb2a-40a2-85b4-fa0753a6f46e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:35.766037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b9c3d57-fb2a-40a2-85b4-fa0753a6f46e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:36.331013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3b9c3d57-fb2a-40a2-85b4-fa0753a6f46e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:36.341405 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3b9c3d57-fb2a-40a2-85b4-fa0753a6f46e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1317 microversion: 2.1 time: 0.617568 Aug 27 04:34:36.343082 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 363/727] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:35 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1317 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:36.361748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-62e88651-e8d0-439d-9b88-587621729f5b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:36.362399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-62e88651-e8d0-439d-9b88-587621729f5b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:36.375538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62e88651-e8d0-439d-9b88-587621729f5b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:36.376756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62e88651-e8d0-439d-9b88-587621729f5b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:36.377278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62e88651-e8d0-439d-9b88-587621729f5b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:36.378253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62e88651-e8d0-439d-9b88-587621729f5b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:36.378788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62e88651-e8d0-439d-9b88-587621729f5b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:36.379284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62e88651-e8d0-439d-9b88-587621729f5b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:37.027994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-62e88651-e8d0-439d-9b88-587621729f5b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:37.042870 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-62e88651-e8d0-439d-9b88-587621729f5b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9" status: 200 len: 1307 microversion: 2.1 time: 0.696368 Aug 27 04:34:37.049345 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 364/728] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:36 2022] GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 => generated 1307 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:37.055176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-da115d88-de4b-4d2b-a9b3-77a83ecc80d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:37.059363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-da115d88-de4b-4d2b-a9b3-77a83ecc80d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:37.074966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da115d88-de4b-4d2b-a9b3-77a83ecc80d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:37.075781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da115d88-de4b-4d2b-a9b3-77a83ecc80d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:37.076454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da115d88-de4b-4d2b-a9b3-77a83ecc80d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:37.078290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da115d88-de4b-4d2b-a9b3-77a83ecc80d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:37.080382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da115d88-de4b-4d2b-a9b3-77a83ecc80d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:37.081107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da115d88-de4b-4d2b-a9b3-77a83ecc80d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:37.287556 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03d2168b-102f-4b45-a3a3-acbd0730f5b7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0/action" status: 202 len: 0 microversion: 2.25 time: 3.381643 Aug 27 04:34:37.288568 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 365/729] 10.222.0.79 () {62 vars in 1319 bytes} [Sat Aug 27 04:34:33 2022] POST /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0/action => generated 0 bytes in 3384 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:34:37.299681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf91ed2f-858b-4b20-9b01-b0d400623a3f tempest-SecurityGroupsTestAdminJSON-723972863 tempest-SecurityGroupsTestAdminJSON-723972863-project-admin] Action: 'create', calling method: .version_select at 0x7f1f21db1790>, body: {"security_group": {"name": "tempest-securitygroup-868183683", "description": "tempest-description-1924678992"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:37.397946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-da115d88-de4b-4d2b-a9b3-77a83ecc80d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:37.412588 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-da115d88-de4b-4d2b-a9b3-77a83ecc80d8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1313 microversion: 2.1 time: 0.361161 Aug 27 04:34:37.425938 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 365/730] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:37 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:37.434412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e5a0c569-8cb8-488a-841e-5e47c1b44c4f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:37.435355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e5a0c569-8cb8-488a-841e-5e47c1b44c4f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:37.442817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5a0c569-8cb8-488a-841e-5e47c1b44c4f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:37.443666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5a0c569-8cb8-488a-841e-5e47c1b44c4f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:37.444311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5a0c569-8cb8-488a-841e-5e47c1b44c4f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:37.445932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5a0c569-8cb8-488a-841e-5e47c1b44c4f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:37.446715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5a0c569-8cb8-488a-841e-5e47c1b44c4f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:37.447880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5a0c569-8cb8-488a-841e-5e47c1b44c4f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:37.853777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e5a0c569-8cb8-488a-841e-5e47c1b44c4f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:37.871007 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e5a0c569-8cb8-488a-841e-5e47c1b44c4f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1365 microversion: 2.1 time: 0.442790 Aug 27 04:34:37.873382 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 366/731] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:37 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1365 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:37.890119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f48546e1-4436-48f1-a348-8ad4d9c2fbbe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:37.891681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f48546e1-4436-48f1-a348-8ad4d9c2fbbe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:37.900483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f48546e1-4436-48f1-a348-8ad4d9c2fbbe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:37.903135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f48546e1-4436-48f1-a348-8ad4d9c2fbbe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:37.903836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f48546e1-4436-48f1-a348-8ad4d9c2fbbe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:37.904821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f48546e1-4436-48f1-a348-8ad4d9c2fbbe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:37.905509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f48546e1-4436-48f1-a348-8ad4d9c2fbbe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:37.906292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f48546e1-4436-48f1-a348-8ad4d9c2fbbe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:38.094904 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf91ed2f-858b-4b20-9b01-b0d400623a3f tempest-SecurityGroupsTestAdminJSON-723972863 tempest-SecurityGroupsTestAdminJSON-723972863-project-admin] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.804470 Aug 27 04:34:38.095749 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 366/732] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:34:37 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:38.112895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f55f6363-081c-4de7-beed-225d32cf9974 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:38.113762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f55f6363-081c-4de7-beed-225d32cf9974 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:38.136504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f55f6363-081c-4de7-beed-225d32cf9974 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:38.138274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f55f6363-081c-4de7-beed-225d32cf9974 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:38.148945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f55f6363-081c-4de7-beed-225d32cf9974 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:38.150146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f55f6363-081c-4de7-beed-225d32cf9974 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:38.150892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f55f6363-081c-4de7-beed-225d32cf9974 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:38.151595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f55f6363-081c-4de7-beed-225d32cf9974 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:38.275517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f48546e1-4436-48f1-a348-8ad4d9c2fbbe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:38.287814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f48546e1-4436-48f1-a348-8ad4d9c2fbbe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:38.291573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f48546e1-4436-48f1-a348-8ad4d9c2fbbe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:38.295052 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f48546e1-4436-48f1-a348-8ad4d9c2fbbe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1568 microversion: 2.25 time: 0.418497 Aug 27 04:34:38.299032 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 367/733] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:37 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1568 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:38.320107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-850f1c31-03dd-42d8-9b40-38bd1bcef140 req-f65da2a2-984e-47a2-80c7-1d1ac3936203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011ab45e-31fa-4ba7-b135-d222e7a725ca", "tag": "3b944205-dafa-4b20-992c-6ddf5b0ca271"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:38.346986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-850f1c31-03dd-42d8-9b40-38bd1bcef140 req-f65da2a2-984e-47a2-80c7-1d1ac3936203 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:38.348179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-850f1c31-03dd-42d8-9b40-38bd1bcef140 req-f65da2a2-984e-47a2-80c7-1d1ac3936203 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:38.349843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-850f1c31-03dd-42d8-9b40-38bd1bcef140 req-f65da2a2-984e-47a2-80c7-1d1ac3936203 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:38.378366 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-850f1c31-03dd-42d8-9b40-38bd1bcef140 req-f65da2a2-984e-47a2-80c7-1d1ac3936203 service nova] Creating event network-changed:3b944205-dafa-4b20-992c-6ddf5b0ca271 for instance 011ab45e-31fa-4ba7-b135-d222e7a725ca on n-h1-854823-1 Aug 27 04:34:38.383879 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-850f1c31-03dd-42d8-9b40-38bd1bcef140 req-f65da2a2-984e-47a2-80c7-1d1ac3936203 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080736 Aug 27 04:34:38.384659 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 368/734] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:38.412038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e24c1dbc-9beb-47a5-99c2-82d62d842621 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:38.414155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e24c1dbc-9beb-47a5-99c2-82d62d842621 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:38.427998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e24c1dbc-9beb-47a5-99c2-82d62d842621 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:38.431676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e24c1dbc-9beb-47a5-99c2-82d62d842621 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:38.433088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e24c1dbc-9beb-47a5-99c2-82d62d842621 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:38.435138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e24c1dbc-9beb-47a5-99c2-82d62d842621 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:38.436191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e24c1dbc-9beb-47a5-99c2-82d62d842621 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:38.437106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e24c1dbc-9beb-47a5-99c2-82d62d842621 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:38.701688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f55f6363-081c-4de7-beed-225d32cf9974 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:38.731304 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f55f6363-081c-4de7-beed-225d32cf9974 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1317 microversion: 2.1 time: 0.623855 Aug 27 04:34:38.732855 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 367/735] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:38 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1317 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:38.737747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-891d8bc4-1427-427b-b68a-26598da6e4a8 tempest-SecurityGroupsTestAdminJSON-723972863 tempest-SecurityGroupsTestAdminJSON-723972863-project-admin] Calling method '.version_select at 0x7f1f21dd7b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:39.059940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e24c1dbc-9beb-47a5-99c2-82d62d842621 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:39.074257 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e24c1dbc-9beb-47a5-99c2-82d62d842621 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9" status: 200 len: 1307 microversion: 2.1 time: 0.676119 Aug 27 04:34:39.079752 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 369/736] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:38 2022] GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 => generated 1307 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:39.086435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b4ea606a-ca7e-4478-ab10-0d64a544d794 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:39.090325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b4ea606a-ca7e-4478-ab10-0d64a544d794 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:39.099224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4ea606a-ca7e-4478-ab10-0d64a544d794 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:39.100023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4ea606a-ca7e-4478-ab10-0d64a544d794 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:39.100885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4ea606a-ca7e-4478-ab10-0d64a544d794 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:39.101960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4ea606a-ca7e-4478-ab10-0d64a544d794 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:39.102654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4ea606a-ca7e-4478-ab10-0d64a544d794 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:39.103282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4ea606a-ca7e-4478-ab10-0d64a544d794 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:39.372135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b4ea606a-ca7e-4478-ab10-0d64a544d794 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:39.380882 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b4ea606a-ca7e-4478-ab10-0d64a544d794 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1313 microversion: 2.1 time: 0.299593 Aug 27 04:34:39.393026 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 370/737] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:39 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:39.400252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8f36c507-a690-43b1-9178-10b54d320a5a req-61e537d2-5646-4fa9-b0be-4077761fec8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503a7b07-108a-45d6-937d-f9cd43ef66a9", "name": "network-vif-plugged", "status": "completed", "tag": "f2ee1ea2-3d38-4835-832c-5a7d94cd01a8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:39.410213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8f36c507-a690-43b1-9178-10b54d320a5a req-61e537d2-5646-4fa9-b0be-4077761fec8e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:39.410699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8f36c507-a690-43b1-9178-10b54d320a5a req-61e537d2-5646-4fa9-b0be-4077761fec8e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:39.411767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8f36c507-a690-43b1-9178-10b54d320a5a req-61e537d2-5646-4fa9-b0be-4077761fec8e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:39.423433 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8f36c507-a690-43b1-9178-10b54d320a5a req-61e537d2-5646-4fa9-b0be-4077761fec8e service nova] Creating event network-vif-plugged:f2ee1ea2-3d38-4835-832c-5a7d94cd01a8 for instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 on n-h2-854823-1 Aug 27 04:34:39.428974 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8f36c507-a690-43b1-9178-10b54d320a5a req-61e537d2-5646-4fa9-b0be-4077761fec8e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034321 Aug 27 04:34:39.429986 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 371/738] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:39.436370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7bee1655-ec88-4945-a3e7-36a10f4a6d0c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:39.437514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7bee1655-ec88-4945-a3e7-36a10f4a6d0c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:39.444850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bee1655-ec88-4945-a3e7-36a10f4a6d0c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:39.445406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bee1655-ec88-4945-a3e7-36a10f4a6d0c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:39.445863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bee1655-ec88-4945-a3e7-36a10f4a6d0c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:39.446599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bee1655-ec88-4945-a3e7-36a10f4a6d0c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:39.447071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bee1655-ec88-4945-a3e7-36a10f4a6d0c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:39.447503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bee1655-ec88-4945-a3e7-36a10f4a6d0c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:39.501524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=15 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:39.745118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7bee1655-ec88-4945-a3e7-36a10f4a6d0c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:39.757087 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7bee1655-ec88-4945-a3e7-36a10f4a6d0c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1365 microversion: 2.1 time: 0.325603 Aug 27 04:34:39.757686 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 372/739] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:39 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:39.762343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-195ba51d-cfdf-47dc-ad0b-2befcd031d6a req-6489ef6a-dfee-4e76-9255-36dafcc8a102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce113bc-c89f-4752-817e-f3addff689b2", "tag": "8f6bbf7a-d8a5-4aa0-bbfa-2912f98e51de"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:39.773305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-195ba51d-cfdf-47dc-ad0b-2befcd031d6a req-6489ef6a-dfee-4e76-9255-36dafcc8a102 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:39.774051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-195ba51d-cfdf-47dc-ad0b-2befcd031d6a req-6489ef6a-dfee-4e76-9255-36dafcc8a102 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:39.774600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-195ba51d-cfdf-47dc-ad0b-2befcd031d6a req-6489ef6a-dfee-4e76-9255-36dafcc8a102 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:39.787317 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-195ba51d-cfdf-47dc-ad0b-2befcd031d6a req-6489ef6a-dfee-4e76-9255-36dafcc8a102 service nova] Creating event network-changed:8f6bbf7a-d8a5-4aa0-bbfa-2912f98e51de for instance 3ce113bc-c89f-4752-817e-f3addff689b2 on n-h1-854823-1 Aug 27 04:34:39.792490 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-195ba51d-cfdf-47dc-ad0b-2befcd031d6a req-6489ef6a-dfee-4e76-9255-36dafcc8a102 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033302 Aug 27 04:34:39.793669 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 373/740] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:39.801542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9b6e94c6-f3aa-4a1d-92fc-78a4955d30e5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:39.801542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9b6e94c6-f3aa-4a1d-92fc-78a4955d30e5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:39.809652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b6e94c6-f3aa-4a1d-92fc-78a4955d30e5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:39.810291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b6e94c6-f3aa-4a1d-92fc-78a4955d30e5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:39.810831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b6e94c6-f3aa-4a1d-92fc-78a4955d30e5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:39.811680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b6e94c6-f3aa-4a1d-92fc-78a4955d30e5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:39.812274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b6e94c6-f3aa-4a1d-92fc-78a4955d30e5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:39.812907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b6e94c6-f3aa-4a1d-92fc-78a4955d30e5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:39.931932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=72 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:40.138883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9b6e94c6-f3aa-4a1d-92fc-78a4955d30e5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:40.156212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9b6e94c6-f3aa-4a1d-92fc-78a4955d30e5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:40.157704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9b6e94c6-f3aa-4a1d-92fc-78a4955d30e5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:40.159116 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9b6e94c6-f3aa-4a1d-92fc-78a4955d30e5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1568 microversion: 2.25 time: 0.364139 Aug 27 04:34:40.160007 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 374/741] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:39 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1568 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:40.165365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b44ef35a-9344-46b9-979b-a0f727b709df tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:40.166162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b44ef35a-9344-46b9-979b-a0f727b709df tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:40.172461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b44ef35a-9344-46b9-979b-a0f727b709df tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:40.173164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b44ef35a-9344-46b9-979b-a0f727b709df tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:40.173866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b44ef35a-9344-46b9-979b-a0f727b709df tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:40.174791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b44ef35a-9344-46b9-979b-a0f727b709df tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:40.175466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b44ef35a-9344-46b9-979b-a0f727b709df tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:40.176132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b44ef35a-9344-46b9-979b-a0f727b709df tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:40.443218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b44ef35a-9344-46b9-979b-a0f727b709df tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:40.451775 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b44ef35a-9344-46b9-979b-a0f727b709df tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1317 microversion: 2.1 time: 0.290426 Aug 27 04:34:40.453289 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 375/742] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:40 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:40.459613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f04c7c7e-c300-4171-bb0c-dbe6f056f262 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:40.460636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f04c7c7e-c300-4171-bb0c-dbe6f056f262 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:40.466958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f04c7c7e-c300-4171-bb0c-dbe6f056f262 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:40.467693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f04c7c7e-c300-4171-bb0c-dbe6f056f262 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:40.468125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f04c7c7e-c300-4171-bb0c-dbe6f056f262 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:40.469053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f04c7c7e-c300-4171-bb0c-dbe6f056f262 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:40.469671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f04c7c7e-c300-4171-bb0c-dbe6f056f262 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:40.470386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f04c7c7e-c300-4171-bb0c-dbe6f056f262 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:40.737559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f04c7c7e-c300-4171-bb0c-dbe6f056f262 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:40.746689 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f04c7c7e-c300-4171-bb0c-dbe6f056f262 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9" status: 200 len: 1307 microversion: 2.1 time: 0.292180 Aug 27 04:34:40.747594 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 376/743] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:40 2022] GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 => generated 1307 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:40.753649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f9f7b9f2-6ff2-4be4-bb1a-dbe6c027c0b3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:40.754458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f9f7b9f2-6ff2-4be4-bb1a-dbe6c027c0b3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:40.761483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9f7b9f2-6ff2-4be4-bb1a-dbe6c027c0b3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:40.762117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9f7b9f2-6ff2-4be4-bb1a-dbe6c027c0b3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:40.762561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9f7b9f2-6ff2-4be4-bb1a-dbe6c027c0b3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:40.763274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9f7b9f2-6ff2-4be4-bb1a-dbe6c027c0b3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:40.763735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9f7b9f2-6ff2-4be4-bb1a-dbe6c027c0b3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:40.764164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9f7b9f2-6ff2-4be4-bb1a-dbe6c027c0b3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:40.972794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f9f7b9f2-6ff2-4be4-bb1a-dbe6c027c0b3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:40.985341 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f9f7b9f2-6ff2-4be4-bb1a-dbe6c027c0b3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1313 microversion: 2.1 time: 0.236344 Aug 27 04:34:40.999632 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 377/744] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:40 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:41.006295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-2ccf8d3b-3863-4b69-ac03-8ff0b6bebe6d req-3ad2b748-a89c-4233-b818-52d92acbcf89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07", "tag": "b63bbe54-1556-4795-9da0-3334f115da65"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:41.016678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2ccf8d3b-3863-4b69-ac03-8ff0b6bebe6d req-3ad2b748-a89c-4233-b818-52d92acbcf89 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:41.017411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2ccf8d3b-3863-4b69-ac03-8ff0b6bebe6d req-3ad2b748-a89c-4233-b818-52d92acbcf89 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:41.017879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2ccf8d3b-3863-4b69-ac03-8ff0b6bebe6d req-3ad2b748-a89c-4233-b818-52d92acbcf89 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:41.035287 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-2ccf8d3b-3863-4b69-ac03-8ff0b6bebe6d req-3ad2b748-a89c-4233-b818-52d92acbcf89 service nova] Creating event network-changed:b63bbe54-1556-4795-9da0-3334f115da65 for instance 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 on n-h2-854823-1 Aug 27 04:34:41.040353 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-2ccf8d3b-3863-4b69-ac03-8ff0b6bebe6d req-3ad2b748-a89c-4233-b818-52d92acbcf89 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039209 Aug 27 04:34:41.041418 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 378/745] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:41.046881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7310b0ad-36a3-4b90-a1e0-57bcbd4855c9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:41.047702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7310b0ad-36a3-4b90-a1e0-57bcbd4855c9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:41.054556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7310b0ad-36a3-4b90-a1e0-57bcbd4855c9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:41.055128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7310b0ad-36a3-4b90-a1e0-57bcbd4855c9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:41.055655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7310b0ad-36a3-4b90-a1e0-57bcbd4855c9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:41.056430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7310b0ad-36a3-4b90-a1e0-57bcbd4855c9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:41.057023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7310b0ad-36a3-4b90-a1e0-57bcbd4855c9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:41.057529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7310b0ad-36a3-4b90-a1e0-57bcbd4855c9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:41.062893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:41.292286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7310b0ad-36a3-4b90-a1e0-57bcbd4855c9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:41.311107 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7310b0ad-36a3-4b90-a1e0-57bcbd4855c9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1365 microversion: 2.1 time: 0.267992 Aug 27 04:34:41.312474 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 379/746] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:41 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:41.319074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-953c859e-ed08-469f-a2af-6e08d9ed9dba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:41.319958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-953c859e-ed08-469f-a2af-6e08d9ed9dba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:41.331834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-953c859e-ed08-469f-a2af-6e08d9ed9dba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:41.333928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-953c859e-ed08-469f-a2af-6e08d9ed9dba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:41.334783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-953c859e-ed08-469f-a2af-6e08d9ed9dba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:41.335828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-953c859e-ed08-469f-a2af-6e08d9ed9dba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:41.336450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-953c859e-ed08-469f-a2af-6e08d9ed9dba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:41.337906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-953c859e-ed08-469f-a2af-6e08d9ed9dba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:41.620488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-953c859e-ed08-469f-a2af-6e08d9ed9dba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:41.631028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-953c859e-ed08-469f-a2af-6e08d9ed9dba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:41.632648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-953c859e-ed08-469f-a2af-6e08d9ed9dba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:41.634714 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-953c859e-ed08-469f-a2af-6e08d9ed9dba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1568 microversion: 2.25 time: 0.320621 Aug 27 04:34:41.635433 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 380/747] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:41 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1568 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:41.640303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d08dd122-5c91-4d51-b40f-93fc6f72d63f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:41.641073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d08dd122-5c91-4d51-b40f-93fc6f72d63f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:41.647413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d08dd122-5c91-4d51-b40f-93fc6f72d63f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:41.648014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d08dd122-5c91-4d51-b40f-93fc6f72d63f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:41.648709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d08dd122-5c91-4d51-b40f-93fc6f72d63f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:41.649630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d08dd122-5c91-4d51-b40f-93fc6f72d63f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:41.650464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d08dd122-5c91-4d51-b40f-93fc6f72d63f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:41.651072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d08dd122-5c91-4d51-b40f-93fc6f72d63f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:41.730023 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-891d8bc4-1427-427b-b68a-26598da6e4a8 tempest-SecurityGroupsTestAdminJSON-723972863 tempest-SecurityGroupsTestAdminJSON-723972863-project-admin] 10.222.0.79 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 14419 microversion: 2.1 time: 2.995634 Aug 27 04:34:41.731628 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 368/748] 10.222.0.79 () {58 vars in 1191 bytes} [Sat Aug 27 04:34:38 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 14419 bytes in 2998 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:34:41.756832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d35654c9-53f6-4ba0-a7f7-b05d5fd69d87 tempest-SecurityGroupsTestAdminJSON-38819515 tempest-SecurityGroupsTestAdminJSON-38819515-project] Calling method '.version_select at 0x7f1f223cae50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:42.038205 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d35654c9-53f6-4ba0-a7f7-b05d5fd69d87 tempest-SecurityGroupsTestAdminJSON-38819515 tempest-SecurityGroupsTestAdminJSON-38819515-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.285850 Aug 27 04:34:42.038802 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 369/749] 10.222.0.79 () {58 vars in 1191 bytes} [Sat Aug 27 04:34:41 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:42.050631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-433c31ab-cda0-42fc-85c4-c6b7d6b1f849 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:42.051278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-433c31ab-cda0-42fc-85c4-c6b7d6b1f849 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:42.058325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-433c31ab-cda0-42fc-85c4-c6b7d6b1f849 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:42.058821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-433c31ab-cda0-42fc-85c4-c6b7d6b1f849 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:42.059266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-433c31ab-cda0-42fc-85c4-c6b7d6b1f849 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:42.060104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-433c31ab-cda0-42fc-85c4-c6b7d6b1f849 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:42.060599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-433c31ab-cda0-42fc-85c4-c6b7d6b1f849 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:42.061031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-433c31ab-cda0-42fc-85c4-c6b7d6b1f849 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:42.196930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-433c31ab-cda0-42fc-85c4-c6b7d6b1f849 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:42.205021 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-433c31ab-cda0-42fc-85c4-c6b7d6b1f849 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9" status: 200 len: 1486 microversion: 2.1 time: 0.158376 Aug 27 04:34:42.205610 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 370/750] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:42 2022] GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 => generated 1486 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:42.210189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-67991417-f436-4718-aaa7-f5dd75b5e260 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:42.210795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-67991417-f436-4718-aaa7-f5dd75b5e260 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:42.216620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67991417-f436-4718-aaa7-f5dd75b5e260 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:42.217282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67991417-f436-4718-aaa7-f5dd75b5e260 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:42.217720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67991417-f436-4718-aaa7-f5dd75b5e260 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:42.218411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67991417-f436-4718-aaa7-f5dd75b5e260 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:42.218861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67991417-f436-4718-aaa7-f5dd75b5e260 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:42.219461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67991417-f436-4718-aaa7-f5dd75b5e260 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:42.234514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=68 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:42.314369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d08dd122-5c91-4d51-b40f-93fc6f72d63f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:42.333760 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d08dd122-5c91-4d51-b40f-93fc6f72d63f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1317 microversion: 2.1 time: 0.696326 Aug 27 04:34:42.334913 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 381/751] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:41 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1317 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:42.339565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-3645805d-ce11-4f86-ae76-bccb82aef80c req-f78bc42a-d78b-4aa3-958b-d4c40b864cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686b50ec-d768-4cc2-bb93-e92096bc7ba0", "name": "network-vif-unplugged", "status": "completed", "tag": "c861cdbe-63fe-49f8-bb14-9b4c752f86d7"}, {"name": "network-changed", "server_uuid": "686b50ec-d768-4cc2-bb93-e92096bc7ba0", "tag": "c861cdbe-63fe-49f8-bb14-9b4c752f86d7"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:42.351406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3645805d-ce11-4f86-ae76-bccb82aef80c req-f78bc42a-d78b-4aa3-958b-d4c40b864cf5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:42.352175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3645805d-ce11-4f86-ae76-bccb82aef80c req-f78bc42a-d78b-4aa3-958b-d4c40b864cf5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:42.352837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3645805d-ce11-4f86-ae76-bccb82aef80c req-f78bc42a-d78b-4aa3-958b-d4c40b864cf5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:42.365692 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-3645805d-ce11-4f86-ae76-bccb82aef80c req-f78bc42a-d78b-4aa3-958b-d4c40b864cf5 service nova] Creating event network-vif-unplugged:c861cdbe-63fe-49f8-bb14-9b4c752f86d7 for instance 686b50ec-d768-4cc2-bb93-e92096bc7ba0 on n-h1-854823-1 Aug 27 04:34:42.366450 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-3645805d-ce11-4f86-ae76-bccb82aef80c req-f78bc42a-d78b-4aa3-958b-d4c40b864cf5 service nova] Creating event network-changed:c861cdbe-63fe-49f8-bb14-9b4c752f86d7 for instance 686b50ec-d768-4cc2-bb93-e92096bc7ba0 on n-h1-854823-1 Aug 27 04:34:42.372134 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-3645805d-ce11-4f86-ae76-bccb82aef80c req-f78bc42a-d78b-4aa3-958b-d4c40b864cf5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.035891 Aug 27 04:34:42.373275 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 382/752] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:42.379093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a1c455e2-ec18-47c5-af83-30c6938f7e39 tempest-SecurityGroupsTestAdminJSON-723972863 tempest-SecurityGroupsTestAdminJSON-723972863-project-admin] Calling method '.version_select at 0x7f1f22081dc0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:42.412771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-67991417-f436-4718-aaa7-f5dd75b5e260 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:42.421758 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-67991417-f436-4718-aaa7-f5dd75b5e260 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1313 microversion: 2.1 time: 0.215144 Aug 27 04:34:42.422602 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 371/753] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:42 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:42.428947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1513143e-deb3-491f-be8b-54161faa0be1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:42.429677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1513143e-deb3-491f-be8b-54161faa0be1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:42.436060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1513143e-deb3-491f-be8b-54161faa0be1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:42.436875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1513143e-deb3-491f-be8b-54161faa0be1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:42.437295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1513143e-deb3-491f-be8b-54161faa0be1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:42.438170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1513143e-deb3-491f-be8b-54161faa0be1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:42.438773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1513143e-deb3-491f-be8b-54161faa0be1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:42.439320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1513143e-deb3-491f-be8b-54161faa0be1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:42.530628 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1513143e-deb3-491f-be8b-54161faa0be1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "POST /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9/action" status: 202 len: 0 microversion: 2.1 time: 0.106563 Aug 27 04:34:42.534419 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 372/754] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:34:42 2022] POST /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:42.540773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5754bdb8-1bf4-41a5-9d5d-b20b219c8409 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:42.541619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5754bdb8-1bf4-41a5-9d5d-b20b219c8409 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:42.552287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5754bdb8-1bf4-41a5-9d5d-b20b219c8409 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:42.552841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5754bdb8-1bf4-41a5-9d5d-b20b219c8409 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:42.553840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5754bdb8-1bf4-41a5-9d5d-b20b219c8409 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:42.554801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5754bdb8-1bf4-41a5-9d5d-b20b219c8409 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:42.555831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5754bdb8-1bf4-41a5-9d5d-b20b219c8409 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:42.555831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5754bdb8-1bf4-41a5-9d5d-b20b219c8409 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:42.789953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5754bdb8-1bf4-41a5-9d5d-b20b219c8409 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:42.798811 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5754bdb8-1bf4-41a5-9d5d-b20b219c8409 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1365 microversion: 2.1 time: 0.265363 Aug 27 04:34:42.804851 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 373/755] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:42 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:42.819297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f666bcb-2308-4443-be59-1e9ebdc1a2e1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:42.819297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f666bcb-2308-4443-be59-1e9ebdc1a2e1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:42.826825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f666bcb-2308-4443-be59-1e9ebdc1a2e1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:42.826825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f666bcb-2308-4443-be59-1e9ebdc1a2e1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:42.827202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f666bcb-2308-4443-be59-1e9ebdc1a2e1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:42.827927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f666bcb-2308-4443-be59-1e9ebdc1a2e1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:42.828392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f666bcb-2308-4443-be59-1e9ebdc1a2e1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:42.828885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f666bcb-2308-4443-be59-1e9ebdc1a2e1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:43.090852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f666bcb-2308-4443-be59-1e9ebdc1a2e1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:43.102721 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f666bcb-2308-4443-be59-1e9ebdc1a2e1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9" status: 200 len: 1491 microversion: 2.1 time: 0.296765 Aug 27 04:34:43.112077 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 374/756] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:42 2022] GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 => generated 1491 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:43.120365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b39ba7a-11fe-4567-b397-99548beb5b74 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:43.121161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4b39ba7a-11fe-4567-b397-99548beb5b74 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:43.131049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b39ba7a-11fe-4567-b397-99548beb5b74 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:43.131832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b39ba7a-11fe-4567-b397-99548beb5b74 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:43.132403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b39ba7a-11fe-4567-b397-99548beb5b74 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:43.133260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b39ba7a-11fe-4567-b397-99548beb5b74 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:43.133875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b39ba7a-11fe-4567-b397-99548beb5b74 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:43.134516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b39ba7a-11fe-4567-b397-99548beb5b74 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:43.418913 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a1c455e2-ec18-47c5-af83-30c6938f7e39 tempest-SecurityGroupsTestAdminJSON-723972863 tempest-SecurityGroupsTestAdminJSON-723972863-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/54a3bdf7-a961-4dd3-a383-6674b8658835" status: 202 len: 0 microversion: 2.1 time: 1.044219 Aug 27 04:34:43.424043 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 383/757] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:34:42 2022] DELETE /compute/v2.1/os-security-groups/54a3bdf7-a961-4dd3-a383-6674b8658835 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:43.430288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-436375e0-096f-45a8-8cc9-c6502026be22 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:43.431374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-436375e0-096f-45a8-8cc9-c6502026be22 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:43.439520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-436375e0-096f-45a8-8cc9-c6502026be22 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:43.440563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-436375e0-096f-45a8-8cc9-c6502026be22 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:43.441278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-436375e0-096f-45a8-8cc9-c6502026be22 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:43.442839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-436375e0-096f-45a8-8cc9-c6502026be22 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:43.443596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-436375e0-096f-45a8-8cc9-c6502026be22 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:43.444261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-436375e0-096f-45a8-8cc9-c6502026be22 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:43.583673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4b39ba7a-11fe-4567-b397-99548beb5b74 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:43.593841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4b39ba7a-11fe-4567-b397-99548beb5b74 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:43.595523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4b39ba7a-11fe-4567-b397-99548beb5b74 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:43.596733 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b39ba7a-11fe-4567-b397-99548beb5b74 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1568 microversion: 2.25 time: 0.482970 Aug 27 04:34:43.612729 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 375/758] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:43 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1568 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:43.617908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e042b64c-817b-46dc-9519-62e8398bd247 tempest-SecurityGroupsTestAdminJSON-723972863 tempest-SecurityGroupsTestAdminJSON-723972863-project-admin] Calling method '.version_select at 0x7f1f21fc9b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:43.667186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-436375e0-096f-45a8-8cc9-c6502026be22 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:43.676015 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-436375e0-096f-45a8-8cc9-c6502026be22 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1317 microversion: 2.1 time: 0.250261 Aug 27 04:34:43.677804 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 384/759] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:43 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:43.682689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-668e5a76-a591-4df3-be54-a5db1e3b8cbb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:43.683506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-668e5a76-a591-4df3-be54-a5db1e3b8cbb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:43.690274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-668e5a76-a591-4df3-be54-a5db1e3b8cbb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:43.691001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-668e5a76-a591-4df3-be54-a5db1e3b8cbb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:43.691608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-668e5a76-a591-4df3-be54-a5db1e3b8cbb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:43.692381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-668e5a76-a591-4df3-be54-a5db1e3b8cbb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:43.692874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-668e5a76-a591-4df3-be54-a5db1e3b8cbb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:43.693302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-668e5a76-a591-4df3-be54-a5db1e3b8cbb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:43.714401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=12 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:43.891106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-668e5a76-a591-4df3-be54-a5db1e3b8cbb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:43.900242 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-668e5a76-a591-4df3-be54-a5db1e3b8cbb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1313 microversion: 2.1 time: 0.221116 Aug 27 04:34:43.913541 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 385/760] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:43 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:43.913541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-384e44c8-203f-4d5f-ab16-5fcf60c28ace tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:43.913541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-384e44c8-203f-4d5f-ab16-5fcf60c28ace tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:43.913541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-384e44c8-203f-4d5f-ab16-5fcf60c28ace tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:43.914226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-384e44c8-203f-4d5f-ab16-5fcf60c28ace tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:43.914424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-384e44c8-203f-4d5f-ab16-5fcf60c28ace tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:43.915318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-384e44c8-203f-4d5f-ab16-5fcf60c28ace tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:43.915947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-384e44c8-203f-4d5f-ab16-5fcf60c28ace tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:43.916857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-384e44c8-203f-4d5f-ab16-5fcf60c28ace tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:44.021685 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e042b64c-817b-46dc-9519-62e8398bd247 tempest-SecurityGroupsTestAdminJSON-723972863 tempest-SecurityGroupsTestAdminJSON-723972863-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/7501ba82-5d3e-4cc5-b42f-fdcda7d0d41a" status: 202 len: 0 microversion: 2.1 time: 0.407538 Aug 27 04:34:44.026469 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 376/761] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:34:43 2022] DELETE /compute/v2.1/os-security-groups/7501ba82-5d3e-4cc5-b42f-fdcda7d0d41a => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:44.031563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-972e8acd-db05-46a6-a0c1-2df8a3e9d2fa tempest-SecurityGroupsTestAdminJSON-38819515 tempest-SecurityGroupsTestAdminJSON-38819515-project] Calling method '.version_select at 0x7f1f222cfc10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:44.066216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-384e44c8-203f-4d5f-ab16-5fcf60c28ace tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:44.074874 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-384e44c8-203f-4d5f-ab16-5fcf60c28ace tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1365 microversion: 2.1 time: 0.172974 Aug 27 04:34:44.087885 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 386/762] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:43 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:44.129441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c964ff0f-67f6-48a8-a32f-e203a7a053ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:44.135156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c964ff0f-67f6-48a8-a32f-e203a7a053ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:44.142909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c964ff0f-67f6-48a8-a32f-e203a7a053ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:44.143747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c964ff0f-67f6-48a8-a32f-e203a7a053ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:44.144567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c964ff0f-67f6-48a8-a32f-e203a7a053ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:44.145823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c964ff0f-67f6-48a8-a32f-e203a7a053ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:44.146522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c964ff0f-67f6-48a8-a32f-e203a7a053ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:44.147160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c964ff0f-67f6-48a8-a32f-e203a7a053ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:44.299605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c964ff0f-67f6-48a8-a32f-e203a7a053ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:44.308193 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c964ff0f-67f6-48a8-a32f-e203a7a053ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9" status: 200 len: 1471 microversion: 2.1 time: 0.184317 Aug 27 04:34:44.308797 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 387/763] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:44 2022] GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 => generated 1471 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:44.328767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e18e799-ce27-4b25-82fe-b62eb058c888 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1601863485"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:44.331134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e18e799-ce27-4b25-82fe-b62eb058c888 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:44.337079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e18e799-ce27-4b25-82fe-b62eb058c888 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:44.337568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e18e799-ce27-4b25-82fe-b62eb058c888 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:44.338097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e18e799-ce27-4b25-82fe-b62eb058c888 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:44.338795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e18e799-ce27-4b25-82fe-b62eb058c888 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:44.339248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e18e799-ce27-4b25-82fe-b62eb058c888 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:44.339669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e18e799-ce27-4b25-82fe-b62eb058c888 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:44.420276 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-972e8acd-db05-46a6-a0c1-2df8a3e9d2fa tempest-SecurityGroupsTestAdminJSON-38819515 tempest-SecurityGroupsTestAdminJSON-38819515-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/6485a501-d148-455d-a707-5dc1854cec54" status: 202 len: 0 microversion: 2.1 time: 0.392360 Aug 27 04:34:44.421034 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 377/764] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:34:44 2022] DELETE /compute/v2.1/os-security-groups/6485a501-d148-455d-a707-5dc1854cec54 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:44.429917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bd78d50-2f85-4622-bcb2-d1f75c5177b9 tempest-SecurityGroupsTestAdminJSON-38819515 tempest-SecurityGroupsTestAdminJSON-38819515-project] Calling method '.version_select at 0x7f1f21dd73a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:44.638197 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e18e799-ce27-4b25-82fe-b62eb058c888 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "POST /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9/action" status: 202 len: 0 microversion: 2.1 time: 0.313343 Aug 27 04:34:44.642174 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 388/765] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:34:44 2022] POST /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 27 04:34:44.657022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-edb084bf-1f6d-4e52-a6f5-0282c9ab2703 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:44.658057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-edb084bf-1f6d-4e52-a6f5-0282c9ab2703 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:44.665290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edb084bf-1f6d-4e52-a6f5-0282c9ab2703 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:44.666033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edb084bf-1f6d-4e52-a6f5-0282c9ab2703 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:44.666644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edb084bf-1f6d-4e52-a6f5-0282c9ab2703 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:44.667527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edb084bf-1f6d-4e52-a6f5-0282c9ab2703 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:44.668149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edb084bf-1f6d-4e52-a6f5-0282c9ab2703 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:44.668793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edb084bf-1f6d-4e52-a6f5-0282c9ab2703 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:44.784607 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6bd78d50-2f85-4622-bcb2-d1f75c5177b9 tempest-SecurityGroupsTestAdminJSON-38819515 tempest-SecurityGroupsTestAdminJSON-38819515-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/234fdd21-0fad-4973-84c4-07d935c5d75d" status: 202 len: 0 microversion: 2.1 time: 0.359006 Aug 27 04:34:44.785316 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 378/766] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:34:44 2022] DELETE /compute/v2.1/os-security-groups/234fdd21-0fad-4973-84c4-07d935c5d75d => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:44.791193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14cecfe4-7069-447e-853f-076c01983fdf tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21db1040>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:44.884024 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14cecfe4-7069-447e-853f-076c01983fdf tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.095461 Aug 27 04:34:44.893403 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 379/767] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:34:44 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:44.905680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-edb084bf-1f6d-4e52-a6f5-0282c9ab2703 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:44.906943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ba4903b-1b0b-4e50-a8d1-b29afcf50cc6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:44.907683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ba4903b-1b0b-4e50-a8d1-b29afcf50cc6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:44.914829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ba4903b-1b0b-4e50-a8d1-b29afcf50cc6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:44.920354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-edb084bf-1f6d-4e52-a6f5-0282c9ab2703 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:44.920945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ba4903b-1b0b-4e50-a8d1-b29afcf50cc6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:44.921550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ba4903b-1b0b-4e50-a8d1-b29afcf50cc6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:44.922075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-edb084bf-1f6d-4e52-a6f5-0282c9ab2703 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:44.922202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ba4903b-1b0b-4e50-a8d1-b29afcf50cc6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:44.922656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ba4903b-1b0b-4e50-a8d1-b29afcf50cc6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:44.923086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ba4903b-1b0b-4e50-a8d1-b29afcf50cc6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:44.923411 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-edb084bf-1f6d-4e52-a6f5-0282c9ab2703 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1568 microversion: 2.25 time: 0.280253 Aug 27 04:34:44.931123 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 389/768] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:44 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:44.938559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1fd7b283-e852-4853-866d-9d49e7a86c67 req-8ad642fe-1d72-4e24-803a-e31c12598692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07", "name": "network-vif-plugged", "status": "completed", "tag": "b63bbe54-1556-4795-9da0-3334f115da65"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:44.952265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1fd7b283-e852-4853-866d-9d49e7a86c67 req-8ad642fe-1d72-4e24-803a-e31c12598692 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:44.954071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1fd7b283-e852-4853-866d-9d49e7a86c67 req-8ad642fe-1d72-4e24-803a-e31c12598692 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:44.954824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1fd7b283-e852-4853-866d-9d49e7a86c67 req-8ad642fe-1d72-4e24-803a-e31c12598692 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:44.992359 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1fd7b283-e852-4853-866d-9d49e7a86c67 req-8ad642fe-1d72-4e24-803a-e31c12598692 service nova] Creating event network-vif-plugged:b63bbe54-1556-4795-9da0-3334f115da65 for instance 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 on n-h2-854823-1 Aug 27 04:34:45.007307 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1fd7b283-e852-4853-866d-9d49e7a86c67 req-8ad642fe-1d72-4e24-803a-e31c12598692 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072807 Aug 27 04:34:45.010545 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 390/769] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:45.038604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae66ea76-1c56-4ad2-97f7-3dae92988650 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:45.039431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ae66ea76-1c56-4ad2-97f7-3dae92988650 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:45.051143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae66ea76-1c56-4ad2-97f7-3dae92988650 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:45.051833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae66ea76-1c56-4ad2-97f7-3dae92988650 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:45.052421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae66ea76-1c56-4ad2-97f7-3dae92988650 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:45.053157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae66ea76-1c56-4ad2-97f7-3dae92988650 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:45.053613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae66ea76-1c56-4ad2-97f7-3dae92988650 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:45.054034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae66ea76-1c56-4ad2-97f7-3dae92988650 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:45.164205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ba4903b-1b0b-4e50-a8d1-b29afcf50cc6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:45.178984 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ba4903b-1b0b-4e50-a8d1-b29afcf50cc6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1317 microversion: 2.1 time: 0.286249 Aug 27 04:34:45.180304 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 380/770] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:44 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:45.185553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-017d1f4e-e6e3-48c0-92e3-3983e19f80f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:45.186432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-017d1f4e-e6e3-48c0-92e3-3983e19f80f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:45.193191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017d1f4e-e6e3-48c0-92e3-3983e19f80f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:45.193876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017d1f4e-e6e3-48c0-92e3-3983e19f80f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:45.194560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017d1f4e-e6e3-48c0-92e3-3983e19f80f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:45.197514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017d1f4e-e6e3-48c0-92e3-3983e19f80f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:45.198232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017d1f4e-e6e3-48c0-92e3-3983e19f80f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:45.198847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017d1f4e-e6e3-48c0-92e3-3983e19f80f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:45.383105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ae66ea76-1c56-4ad2-97f7-3dae92988650 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:45.398175 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ae66ea76-1c56-4ad2-97f7-3dae92988650 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1313 microversion: 2.1 time: 0.385828 Aug 27 04:34:45.404607 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 391/771] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:45 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:45.713974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-017d1f4e-e6e3-48c0-92e3-3983e19f80f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:45.722169 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-017d1f4e-e6e3-48c0-92e3-3983e19f80f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1365 microversion: 2.1 time: 0.540483 Aug 27 04:34:45.723832 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 381/772] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:45 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1365 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:45.901503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc471415-237a-444b-9aea-0174a4d0325c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f2205d040>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:45.954968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-51f9fe7c-0726-4f50-ac2e-7c44d38f477f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:45.956248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-51f9fe7c-0726-4f50-ac2e-7c44d38f477f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:45.968791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51f9fe7c-0726-4f50-ac2e-7c44d38f477f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:45.969305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51f9fe7c-0726-4f50-ac2e-7c44d38f477f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:45.977694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51f9fe7c-0726-4f50-ac2e-7c44d38f477f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:45.978568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51f9fe7c-0726-4f50-ac2e-7c44d38f477f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:45.979084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51f9fe7c-0726-4f50-ac2e-7c44d38f477f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:45.979511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51f9fe7c-0726-4f50-ac2e-7c44d38f477f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:46.000515 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bc471415-237a-444b-9aea-0174a4d0325c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.105102 Aug 27 04:34:46.001824 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 392/773] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:34:45 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:46.173597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-51f9fe7c-0726-4f50-ac2e-7c44d38f477f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:46.183977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-51f9fe7c-0726-4f50-ac2e-7c44d38f477f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:46.186230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-51f9fe7c-0726-4f50-ac2e-7c44d38f477f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:46.187533 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-51f9fe7c-0726-4f50-ac2e-7c44d38f477f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1568 microversion: 2.25 time: 0.240095 Aug 27 04:34:46.198199 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 382/774] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:45 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:46.205410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3c3879b4-2b59-442e-8309-add646cc0b0c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:46.205410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3c3879b4-2b59-442e-8309-add646cc0b0c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:46.211782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c3879b4-2b59-442e-8309-add646cc0b0c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:46.212277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c3879b4-2b59-442e-8309-add646cc0b0c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:46.212783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c3879b4-2b59-442e-8309-add646cc0b0c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:46.213479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c3879b4-2b59-442e-8309-add646cc0b0c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:46.213941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c3879b4-2b59-442e-8309-add646cc0b0c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:46.214367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c3879b4-2b59-442e-8309-add646cc0b0c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:46.385604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3c3879b4-2b59-442e-8309-add646cc0b0c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:46.396770 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3c3879b4-2b59-442e-8309-add646cc0b0c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1317 microversion: 2.1 time: 0.194273 Aug 27 04:34:46.396770 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 393/775] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:46 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:46.419289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-edcc3847-8335-4bce-ab6d-09b48b5f5bee tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:46.420126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-edcc3847-8335-4bce-ab6d-09b48b5f5bee tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:46.427203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edcc3847-8335-4bce-ab6d-09b48b5f5bee tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:46.427920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edcc3847-8335-4bce-ab6d-09b48b5f5bee tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:46.428509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edcc3847-8335-4bce-ab6d-09b48b5f5bee tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:46.429364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edcc3847-8335-4bce-ab6d-09b48b5f5bee tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:46.429814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edcc3847-8335-4bce-ab6d-09b48b5f5bee tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:46.430437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edcc3847-8335-4bce-ab6d-09b48b5f5bee tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:46.586077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-edcc3847-8335-4bce-ab6d-09b48b5f5bee tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:46.594506 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-edcc3847-8335-4bce-ab6d-09b48b5f5bee tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1313 microversion: 2.1 time: 0.179026 Aug 27 04:34:46.596565 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 383/776] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:46 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:46.745830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cec3ddf4-7a1c-45bc-bdd2-307b26fdccaf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:46.747226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cec3ddf4-7a1c-45bc-bdd2-307b26fdccaf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:46.768918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cec3ddf4-7a1c-45bc-bdd2-307b26fdccaf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:46.769750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cec3ddf4-7a1c-45bc-bdd2-307b26fdccaf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:46.772369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cec3ddf4-7a1c-45bc-bdd2-307b26fdccaf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:46.775359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cec3ddf4-7a1c-45bc-bdd2-307b26fdccaf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:46.776034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cec3ddf4-7a1c-45bc-bdd2-307b26fdccaf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:46.777976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cec3ddf4-7a1c-45bc-bdd2-307b26fdccaf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:47.023231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-695ac26b-39e8-4138-b7d6-9bec6f76d891 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f22073e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:47.078483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cec3ddf4-7a1c-45bc-bdd2-307b26fdccaf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:47.094935 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-695ac26b-39e8-4138-b7d6-9bec6f76d891 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.080950 Aug 27 04:34:47.097379 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cec3ddf4-7a1c-45bc-bdd2-307b26fdccaf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1365 microversion: 2.1 time: 0.356933 Aug 27 04:34:47.109657 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 384/777] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:34:47 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:47.113832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1796b4f0-ee4a-495b-863f-c6a5cabcb3f9 req-06e676c4-9c58-400b-bf15-1221db55c0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011ab45e-31fa-4ba7-b135-d222e7a725ca", "name": "network-vif-plugged", "status": "completed", "tag": "3b944205-dafa-4b20-992c-6ddf5b0ca271"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:47.116110 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 394/778] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:46 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1365 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:47.130907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1796b4f0-ee4a-495b-863f-c6a5cabcb3f9 req-06e676c4-9c58-400b-bf15-1221db55c0d2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:47.131382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1796b4f0-ee4a-495b-863f-c6a5cabcb3f9 req-06e676c4-9c58-400b-bf15-1221db55c0d2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:47.134796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1796b4f0-ee4a-495b-863f-c6a5cabcb3f9 req-06e676c4-9c58-400b-bf15-1221db55c0d2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:47.146986 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1796b4f0-ee4a-495b-863f-c6a5cabcb3f9 req-06e676c4-9c58-400b-bf15-1221db55c0d2 service nova] Creating event network-vif-plugged:3b944205-dafa-4b20-992c-6ddf5b0ca271 for instance 011ab45e-31fa-4ba7-b135-d222e7a725ca on n-h1-854823-1 Aug 27 04:34:47.151999 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1796b4f0-ee4a-495b-863f-c6a5cabcb3f9 req-06e676c4-9c58-400b-bf15-1221db55c0d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049051 Aug 27 04:34:47.153238 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 385/779] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:47.213295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9f08b524-a501-4bc5-b8d2-aead88b6bd1c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:47.214033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9f08b524-a501-4bc5-b8d2-aead88b6bd1c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:47.221765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f08b524-a501-4bc5-b8d2-aead88b6bd1c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:47.223047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f08b524-a501-4bc5-b8d2-aead88b6bd1c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:47.223780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f08b524-a501-4bc5-b8d2-aead88b6bd1c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:47.224859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f08b524-a501-4bc5-b8d2-aead88b6bd1c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:47.225690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f08b524-a501-4bc5-b8d2-aead88b6bd1c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:47.226122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f08b524-a501-4bc5-b8d2-aead88b6bd1c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:47.418208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-04e373a0-55ca-4ecf-b001-bc967ebfbb03 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:47.419614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-04e373a0-55ca-4ecf-b001-bc967ebfbb03 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:47.446381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04e373a0-55ca-4ecf-b001-bc967ebfbb03 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:47.447228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04e373a0-55ca-4ecf-b001-bc967ebfbb03 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:47.450002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04e373a0-55ca-4ecf-b001-bc967ebfbb03 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:47.452950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04e373a0-55ca-4ecf-b001-bc967ebfbb03 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:47.453700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04e373a0-55ca-4ecf-b001-bc967ebfbb03 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:47.461419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04e373a0-55ca-4ecf-b001-bc967ebfbb03 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:47.592943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9f08b524-a501-4bc5-b8d2-aead88b6bd1c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:47.603066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9f08b524-a501-4bc5-b8d2-aead88b6bd1c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:47.605728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9f08b524-a501-4bc5-b8d2-aead88b6bd1c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:47.607222 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9f08b524-a501-4bc5-b8d2-aead88b6bd1c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1568 microversion: 2.25 time: 0.398173 Aug 27 04:34:47.619127 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 395/780] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:47 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1568 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:47.631114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0c3e7e8a-d5e4-4161-b096-0f32ffba7fc1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:47.631737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0c3e7e8a-d5e4-4161-b096-0f32ffba7fc1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:47.639562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c3e7e8a-d5e4-4161-b096-0f32ffba7fc1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:47.640136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c3e7e8a-d5e4-4161-b096-0f32ffba7fc1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:47.640875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c3e7e8a-d5e4-4161-b096-0f32ffba7fc1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:47.641651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c3e7e8a-d5e4-4161-b096-0f32ffba7fc1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:47.642177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c3e7e8a-d5e4-4161-b096-0f32ffba7fc1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:47.642670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c3e7e8a-d5e4-4161-b096-0f32ffba7fc1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:47.671035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-04e373a0-55ca-4ecf-b001-bc967ebfbb03 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:47.681281 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-04e373a0-55ca-4ecf-b001-bc967ebfbb03 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1467 microversion: 2.1 time: 0.268978 Aug 27 04:34:47.683672 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 386/781] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:47 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1467 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:47.707040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da356987-2f44-4e51-bd3f-a00306b7a0b3 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:47.708732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da356987-2f44-4e51-bd3f-a00306b7a0b3 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:47.717179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da356987-2f44-4e51-bd3f-a00306b7a0b3 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:47.718091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da356987-2f44-4e51-bd3f-a00306b7a0b3 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:47.719704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da356987-2f44-4e51-bd3f-a00306b7a0b3 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:47.721118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da356987-2f44-4e51-bd3f-a00306b7a0b3 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:47.722474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da356987-2f44-4e51-bd3f-a00306b7a0b3 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:47.723151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da356987-2f44-4e51-bd3f-a00306b7a0b3 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:47.859343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0c3e7e8a-d5e4-4161-b096-0f32ffba7fc1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:47.869249 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0c3e7e8a-d5e4-4161-b096-0f32ffba7fc1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1313 microversion: 2.1 time: 0.248890 Aug 27 04:34:47.872381 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 396/782] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:47 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:47.999795 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da356987-2f44-4e51-bd3f-a00306b7a0b3 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1618 microversion: 2.1 time: 0.299796 Aug 27 04:34:48.000369 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 387/783] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:47 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1618 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:48.110512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-010fb0cb-cd38-4bef-8e59-8630a78a6d03 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f2218b430>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:48.129095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6b13b20-eb5c-4ad1-bae3-75fb4d03a1f6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:48.132462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6b13b20-eb5c-4ad1-bae3-75fb4d03a1f6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:48.142644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6b13b20-eb5c-4ad1-bae3-75fb4d03a1f6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:48.143466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6b13b20-eb5c-4ad1-bae3-75fb4d03a1f6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:48.144130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6b13b20-eb5c-4ad1-bae3-75fb4d03a1f6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:48.145921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6b13b20-eb5c-4ad1-bae3-75fb4d03a1f6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:48.146587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6b13b20-eb5c-4ad1-bae3-75fb4d03a1f6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:48.147126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6b13b20-eb5c-4ad1-bae3-75fb4d03a1f6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:48.187503 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-010fb0cb-cd38-4bef-8e59-8630a78a6d03 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.080853 Aug 27 04:34:48.198360 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 397/784] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:34:48 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:48.204008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-963276472", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["f5b4d765-c03c-44a6-8346-c3bfd70f997b"]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:48.292938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:34:48.408781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a6b13b20-eb5c-4ad1-bae3-75fb4d03a1f6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:48.418221 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6b13b20-eb5c-4ad1-bae3-75fb4d03a1f6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1365 microversion: 2.1 time: 0.298795 Aug 27 04:34:48.420984 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 388/785] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:48 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:48.634385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9cf02524-2281-4dce-bd58-7c638550262c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:48.635332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9cf02524-2281-4dce-bd58-7c638550262c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:48.648085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cf02524-2281-4dce-bd58-7c638550262c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:48.649011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cf02524-2281-4dce-bd58-7c638550262c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:48.651120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cf02524-2281-4dce-bd58-7c638550262c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:48.652865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cf02524-2281-4dce-bd58-7c638550262c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:48.654970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cf02524-2281-4dce-bd58-7c638550262c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:48.655681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cf02524-2281-4dce-bd58-7c638550262c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:48.670033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:48.843967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:34:48.844834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:34:48.845523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:34:48.846343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:34:48.846980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:34:48.852364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:48.871911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:48.872499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:48.873060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:48.874009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:48.874544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:48.875459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:48.897229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:34:48.902869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:34:48.919694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9cf02524-2281-4dce-bd58-7c638550262c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:48.923501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:34:48.929345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:34:48.935387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9cf02524-2281-4dce-bd58-7c638550262c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:48.937445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9cf02524-2281-4dce-bd58-7c638550262c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:48.943040 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9cf02524-2281-4dce-bd58-7c638550262c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1568 microversion: 2.25 time: 0.313610 Aug 27 04:34:48.946427 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 389/786] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:48 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1568 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:48.955354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ffc85a6-7871-4c7a-b50f-9bb1845493a8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:48.956096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ffc85a6-7871-4c7a-b50f-9bb1845493a8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:48.982441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ffc85a6-7871-4c7a-b50f-9bb1845493a8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:48.986280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ffc85a6-7871-4c7a-b50f-9bb1845493a8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:48.986759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ffc85a6-7871-4c7a-b50f-9bb1845493a8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:48.987748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ffc85a6-7871-4c7a-b50f-9bb1845493a8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:48.988368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ffc85a6-7871-4c7a-b50f-9bb1845493a8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:49.007177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ffc85a6-7871-4c7a-b50f-9bb1845493a8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:49.066898 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4bc8e9cd-9fdb-4cbe-a1eb-626ebefc2ea9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.866624 Aug 27 04:34:49.074917 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 398/787] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:34:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:34:49.084170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-977281e2-5bd1-4573-8000-809726f782ad tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:49.085836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-977281e2-5bd1-4573-8000-809726f782ad tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:49.316399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-977281e2-5bd1-4573-8000-809726f782ad tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:49.328134 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-977281e2-5bd1-4573-8000-809726f782ad tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1216 microversion: 2.1 time: 0.251867 Aug 27 04:34:49.329498 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 399/788] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:49 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1216 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:49.380403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ffc85a6-7871-4c7a-b50f-9bb1845493a8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:49.388902 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ffc85a6-7871-4c7a-b50f-9bb1845493a8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1313 microversion: 2.1 time: 0.440740 Aug 27 04:34:49.403470 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 390/789] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:48 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:49.429927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f1af971-cfa2-409c-b24d-9a6f81feb769 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21e9f940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:49.595496 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f1af971-cfa2-409c-b24d-9a6f81feb769 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.201245 Aug 27 04:34:49.604701 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 391/790] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:34:49 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:49.617240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0dc8e34e-4dd9-46ac-9e45-d1f5b8f7625d tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:49.624521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0dc8e34e-4dd9-46ac-9e45-d1f5b8f7625d tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:49.650269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0dc8e34e-4dd9-46ac-9e45-d1f5b8f7625d tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:49.651378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0dc8e34e-4dd9-46ac-9e45-d1f5b8f7625d tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:49.654125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0dc8e34e-4dd9-46ac-9e45-d1f5b8f7625d tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:49.655147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0dc8e34e-4dd9-46ac-9e45-d1f5b8f7625d tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:49.655729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0dc8e34e-4dd9-46ac-9e45-d1f5b8f7625d tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:49.656277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0dc8e34e-4dd9-46ac-9e45-d1f5b8f7625d tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:50.007010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0dc8e34e-4dd9-46ac-9e45-d1f5b8f7625d tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:50.010909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-590605359", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:50.020722 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0dc8e34e-4dd9-46ac-9e45-d1f5b8f7625d tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1365 microversion: 2.1 time: 0.414300 Aug 27 04:34:50.021323 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 392/791] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:49 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1365 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:50.034120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d0d3567-725c-459b-a57d-66e4b91fb7aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:50.035075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d0d3567-725c-459b-a57d-66e4b91fb7aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:50.053395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0d3567-725c-459b-a57d-66e4b91fb7aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:50.053947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0d3567-725c-459b-a57d-66e4b91fb7aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:50.054320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0d3567-725c-459b-a57d-66e4b91fb7aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:50.057621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0d3567-725c-459b-a57d-66e4b91fb7aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:50.058356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0d3567-725c-459b-a57d-66e4b91fb7aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:50.059788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0d3567-725c-459b-a57d-66e4b91fb7aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:50.123255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:34:50.281097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d0d3567-725c-459b-a57d-66e4b91fb7aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:50.310931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d0d3567-725c-459b-a57d-66e4b91fb7aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:50.312440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d0d3567-725c-459b-a57d-66e4b91fb7aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:50.318106 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d0d3567-725c-459b-a57d-66e4b91fb7aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1568 microversion: 2.25 time: 0.293597 Aug 27 04:34:50.320404 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 393/792] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:50 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1568 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:50.351616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6981f42c-74e2-41e8-9337-672749056340 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:50.352488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6981f42c-74e2-41e8-9337-672749056340 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:50.364880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6981f42c-74e2-41e8-9337-672749056340 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:50.368275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6981f42c-74e2-41e8-9337-672749056340 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:50.375035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6981f42c-74e2-41e8-9337-672749056340 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:50.382694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6981f42c-74e2-41e8-9337-672749056340 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:50.384406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6981f42c-74e2-41e8-9337-672749056340 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:50.386487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6981f42c-74e2-41e8-9337-672749056340 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:50.505539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6981f42c-74e2-41e8-9337-672749056340 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:50.523422 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6981f42c-74e2-41e8-9337-672749056340 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1212 microversion: 2.1 time: 0.175729 Aug 27 04:34:50.525360 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 394/793] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:50 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1212 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:50.530924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-15fc22ea-d032-49bd-ab07-28123f078d7e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:50.531812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-15fc22ea-d032-49bd-ab07-28123f078d7e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:50.543105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15fc22ea-d032-49bd-ab07-28123f078d7e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:50.543961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15fc22ea-d032-49bd-ab07-28123f078d7e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:50.544635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15fc22ea-d032-49bd-ab07-28123f078d7e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:50.545822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15fc22ea-d032-49bd-ab07-28123f078d7e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:50.546197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15fc22ea-d032-49bd-ab07-28123f078d7e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:50.546697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15fc22ea-d032-49bd-ab07-28123f078d7e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:50.624376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:34:50.624997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:34:50.625308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:34:50.625976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:34:50.626400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:34:50.642559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:50.643049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:50.643491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:50.644227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:50.644720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:50.645683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:50.695776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Getting quotas for project 4885bb6c973a4e628d038f5e21461722. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:34:50.701108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Getting quotas for user 131b6d978c0d4fe0b4e6bb36b5d9d68d and project 4885bb6c973a4e628d038f5e21461722. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:34:50.715027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:34:50.717644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:34:50.772570 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-40a6f354-fd57-4142-9ca5-0ca7fe4f6423 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.441663 Aug 27 04:34:50.773920 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 400/794] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:34:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:34:50.787511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9553e073-68a7-4b6a-ae89-f1bb9232156a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f22099f70>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:50.823124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-15fc22ea-d032-49bd-ab07-28123f078d7e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:50.832213 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-15fc22ea-d032-49bd-ab07-28123f078d7e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1461 microversion: 2.1 time: 0.305492 Aug 27 04:34:50.835715 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 395/795] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:50 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1461 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:50.908402 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9553e073-68a7-4b6a-ae89-f1bb9232156a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.133107 Aug 27 04:34:50.909046 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 401/796] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:34:50 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:50.941454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7d81966e-d5ce-47a4-a047-aaff399fa15e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:50.943983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7d81966e-d5ce-47a4-a047-aaff399fa15e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:51.089230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2316f4e9-3b3d-4577-a845-a31fab07d64d tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1837511405", "ram": 512, "vcpus": 1, "disk": 10, "id": 2096966552, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:51.131560 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2316f4e9-3b3d-4577-a845-a31fab07d64d tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.294452 Aug 27 04:34:51.134678 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 396/797] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:34:50 2022] POST /compute/v2.1/flavors => generated 416 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:51.135350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7d81966e-d5ce-47a4-a047-aaff399fa15e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:51.144410 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7d81966e-d5ce-47a4-a047-aaff399fa15e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1222 microversion: 2.1 time: 0.216490 Aug 27 04:34:51.147485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:51.150303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:51.150629 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 402/798] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:50 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1222 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:51.158331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:51.158841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:51.159283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:51.160199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:51.161204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-b4230be6-2855-4791-b4ca-510d44caba9f req-73cdc244-167e-4f89-8867-45de56652e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503a7b07-108a-45d6-937d-f9cd43ef66a9", "name": "network-vif-plugged", "status": "completed", "tag": "f2ee1ea2-3d38-4835-832c-5a7d94cd01a8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:51.161357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:51.161640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:51.187022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b4230be6-2855-4791-b4ca-510d44caba9f req-73cdc244-167e-4f89-8867-45de56652e39 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:51.188098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b4230be6-2855-4791-b4ca-510d44caba9f req-73cdc244-167e-4f89-8867-45de56652e39 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:51.188838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b4230be6-2855-4791-b4ca-510d44caba9f req-73cdc244-167e-4f89-8867-45de56652e39 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:51.200965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:51.222076 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b4230be6-2855-4791-b4ca-510d44caba9f req-73cdc244-167e-4f89-8867-45de56652e39 service nova] Creating event network-vif-plugged:f2ee1ea2-3d38-4835-832c-5a7d94cd01a8 for instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 on n-h2-854823-1 Aug 27 04:34:51.244720 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-b4230be6-2855-4791-b4ca-510d44caba9f req-73cdc244-167e-4f89-8867-45de56652e39 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091590 Aug 27 04:34:51.248183 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 403/799] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:51.262396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eba1f80f-cd7d-412a-8fe3-592ae7beeebd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:51.264481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eba1f80f-cd7d-412a-8fe3-592ae7beeebd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:51.277202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eba1f80f-cd7d-412a-8fe3-592ae7beeebd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:51.280660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eba1f80f-cd7d-412a-8fe3-592ae7beeebd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:51.285041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eba1f80f-cd7d-412a-8fe3-592ae7beeebd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:51.286826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eba1f80f-cd7d-412a-8fe3-592ae7beeebd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:51.287530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eba1f80f-cd7d-412a-8fe3-592ae7beeebd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:51.289821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eba1f80f-cd7d-412a-8fe3-592ae7beeebd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:51.309002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:51.315308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:51.319720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Old instance type m1.heat2, new instance type m1.heat {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 04:34:51.328918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:34:51.331002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:34:51.331656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:34:51.333789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:34:51.335301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:34:51.531535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eba1f80f-cd7d-412a-8fe3-592ae7beeebd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:51.541577 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eba1f80f-cd7d-412a-8fe3-592ae7beeebd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1365 microversion: 2.1 time: 0.291919 Aug 27 04:34:51.553196 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 404/800] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:51 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:51.664472 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35e122e3-68ca-477b-b1a9-401b1ff69813 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "POST /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca/action" status: 202 len: 0 microversion: 2.1 time: 0.523903 Aug 27 04:34:51.668085 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 397/801] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:34:51 2022] POST /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:51.685331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-deb18a49-5d23-40be-8e5f-5d5c264280fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:51.685891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-deb18a49-5d23-40be-8e5f-5d5c264280fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:51.702709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb18a49-5d23-40be-8e5f-5d5c264280fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:51.703211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb18a49-5d23-40be-8e5f-5d5c264280fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:51.703650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb18a49-5d23-40be-8e5f-5d5c264280fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:51.704366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb18a49-5d23-40be-8e5f-5d5c264280fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:51.704848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb18a49-5d23-40be-8e5f-5d5c264280fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:51.705271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb18a49-5d23-40be-8e5f-5d5c264280fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:51.885181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d27d740d-4c79-4d28-b8b5-303ab0f19cb1 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:51.914188 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-d27d740d-4c79-4d28-b8b5-303ab0f19cb1 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] HTTP exception thrown: Flavor 2096966552 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d27d740d-4c79-4d28-b8b5-303ab0f19cb1 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Request method failure captured: Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/flavors/2096966552/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ7puV9Ux3kutI09OosDjGi4WkeH_ajOSUo5TCn-mNRGyeEUfGRBDxVquwucBuKg38SlaAH8U-fMpGj1x6Gt0u9rOo7eNuW0XgTlLt5603bc-fe0WFfEzT4TNGnXODgSnZxmIjobtJ3qyG_EKCXNXIlKBdk74crmuqW0LdZsilUMNXo Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 0f8757d4b7bb4bd5800a2d2a3429ba87 Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:34:51.928036 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:34:51.929788 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:51.929788 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 Aug 27 04:34:51.929788 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 0f8757d4b7bb4bd5800a2d2a3429ba87 Aug 27 04:34:51.929788 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 Aug 27 04:34:51.929788 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project Aug 27 04:34:51.929788 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:34:51.929788 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:34:51.929788 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: fa14c2c27d3145898ce56cb80f3d58e9 Aug 27 04:34:51.929788 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project Aug 27 04:34:51.929788 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:34:51.929788 n-d-854823-1 devstack@n-api.service[128870]: exception: Flavor 2096966552 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'flavor_id': '2096966552', 'id': 'hw:cpu_thread_policy'} Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2096966552 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:51.931060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:51.932691 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:51.932691 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:51.932691 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:51.932691 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:34:51.932691 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:34:51.932691 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2096966552 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:34:51.932691 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:51.932691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d27d740d-4c79-4d28-b8b5-303ab0f19cb1 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Returning 404 to user: Flavor 2096966552 has no extra specs with key hw:cpu_thread_policy. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:51.934190 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d27d740d-4c79-4d28-b8b5-303ab0f19cb1 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] 10.222.0.79 "GET /compute/v2.1/flavors/2096966552/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.379175 Aug 27 04:34:51.942098 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 405/802] 10.222.0.79 () {58 vars in 1266 bytes} [Sat Aug 27 04:34:51 2022] GET /compute/v2.1/flavors/2096966552/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:34:51.950941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ffe55c49-3e5e-4ad7-a81c-53a090df801d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:51.958452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ffe55c49-3e5e-4ad7-a81c-53a090df801d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:51.977696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffe55c49-3e5e-4ad7-a81c-53a090df801d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:51.978431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffe55c49-3e5e-4ad7-a81c-53a090df801d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:51.979850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffe55c49-3e5e-4ad7-a81c-53a090df801d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:51.981469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffe55c49-3e5e-4ad7-a81c-53a090df801d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:51.986264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffe55c49-3e5e-4ad7-a81c-53a090df801d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:51.987492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffe55c49-3e5e-4ad7-a81c-53a090df801d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:51.991720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-deb18a49-5d23-40be-8e5f-5d5c264280fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:52.023513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-deb18a49-5d23-40be-8e5f-5d5c264280fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:52.031699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-deb18a49-5d23-40be-8e5f-5d5c264280fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:52.040132 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-deb18a49-5d23-40be-8e5f-5d5c264280fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1558 microversion: 2.25 time: 0.364918 Aug 27 04:34:52.042158 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 398/803] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:51 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1558 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:52.049381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a2c738c-ff33-46a9-8e9e-8c90cc3925f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:52.050218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a2c738c-ff33-46a9-8e9e-8c90cc3925f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:52.061219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a2c738c-ff33-46a9-8e9e-8c90cc3925f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:52.062070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a2c738c-ff33-46a9-8e9e-8c90cc3925f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:52.063060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a2c738c-ff33-46a9-8e9e-8c90cc3925f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:52.064240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a2c738c-ff33-46a9-8e9e-8c90cc3925f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:52.064972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a2c738c-ff33-46a9-8e9e-8c90cc3925f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:52.066003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a2c738c-ff33-46a9-8e9e-8c90cc3925f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:52.204221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ffe55c49-3e5e-4ad7-a81c-53a090df801d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:52.236194 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ffe55c49-3e5e-4ad7-a81c-53a090df801d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1268 microversion: 2.1 time: 0.291706 Aug 27 04:34:52.255188 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 406/804] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:51 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1268 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:52.261464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-66b8ecf0-c250-4495-a921-141126e3f7de tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f22081820>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:52.385371 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-66b8ecf0-c250-4495-a921-141126e3f7de tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.128585 Aug 27 04:34:52.385856 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 407/805] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:34:52 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:52.411137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dda829bb-65d3-4369-bedc-4d7f69739fb6 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:52.415388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dda829bb-65d3-4369-bedc-4d7f69739fb6 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'fa14c2c27d3145898ce56cb80f3d58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8757d4b7bb4bd5800a2d2a3429ba87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dda829bb-65d3-4369-bedc-4d7f69739fb6 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Request method failure captured: Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/flavors/2096966552/os-extra_specs HTTP/1.1 Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 66 Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ7puV9Ux3kutI09OosDjGi4WkeH_ajOSUo5TCn-mNRGyeEUfGRBDxVquwucBuKg38SlaAH8U-fMpGj1x6Gt0u9rOo7eNuW0XgTlLt5603bc-fe0WFfEzT4TNGnXODgSnZxmIjobtJ3qyG_EKCXNXIlKBdk74crmuqW0LdZsilUMNXo Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 0f8757d4b7bb4bd5800a2d2a3429ba87 Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:34:52.430429 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:34:52.432712 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:52.432712 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 Aug 27 04:34:52.432712 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 0f8757d4b7bb4bd5800a2d2a3429ba87 Aug 27 04:34:52.432712 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 Aug 27 04:34:52.432712 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project Aug 27 04:34:52.432712 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:34:52.432712 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:34:52.432712 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: fa14c2c27d3145898ce56cb80f3d58e9 Aug 27 04:34:52.432712 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project Aug 27 04:34:52.432712 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:34:52.432712 n-d-854823-1 devstack@n-api.service[128870]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 27 04:34:52.432712 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'flavor_id': '2096966552', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:34:52.433605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 04:34:52.435165 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:52.447763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dda829bb-65d3-4369-bedc-4d7f69739fb6 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:52.449348 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dda829bb-65d3-4369-bedc-4d7f69739fb6 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] 10.222.0.79 "POST /compute/v2.1/flavors/2096966552/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.062498 Aug 27 04:34:52.456386 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 408/806] 10.222.0.79 () {60 vars in 1224 bytes} [Sat Aug 27 04:34:52 2022] POST /compute/v2.1/flavors/2096966552/os-extra_specs => generated 124 bytes in 70 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:34:52.482116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2a2c738c-ff33-46a9-8e9e-8c90cc3925f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:52.491871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-88d6d7f7-0fbb-46cb-afdb-7dcba780d2d4 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '.version_select at 0x7f1f220998b0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:52.506032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88d6d7f7-0fbb-46cb-afdb-7dcba780d2d4 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:52.516841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88d6d7f7-0fbb-46cb-afdb-7dcba780d2d4 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:52.520583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88d6d7f7-0fbb-46cb-afdb-7dcba780d2d4 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:52.521862 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a2c738c-ff33-46a9-8e9e-8c90cc3925f0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1470 microversion: 2.1 time: 0.478392 Aug 27 04:34:52.545231 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-88d6d7f7-0fbb-46cb-afdb-7dcba780d2d4 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1104 microversion: 2.25 time: 0.085518 Aug 27 04:34:52.548209 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 399/808] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:52 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1470 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:52.548358 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 409/808] 10.222.0.79 () {60 vars in 1184 bytes} [Sat Aug 27 04:34:52 2022] GET /compute/v2.1/os-migrations => generated 1104 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:52.558766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b1e5f122-cb93-412a-a78c-f3c7b20e4e9f tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:52.562811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7181e669-9a80-491d-843b-a936fefe4132 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:52.563609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7181e669-9a80-491d-843b-a936fefe4132 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:52.592471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7181e669-9a80-491d-843b-a936fefe4132 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:52.593012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7181e669-9a80-491d-843b-a936fefe4132 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:52.593554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7181e669-9a80-491d-843b-a936fefe4132 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:52.607696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7181e669-9a80-491d-843b-a936fefe4132 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:52.608204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7181e669-9a80-491d-843b-a936fefe4132 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:52.610793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7181e669-9a80-491d-843b-a936fefe4132 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:52.659396 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b1e5f122-cb93-412a-a78c-f3c7b20e4e9f tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/2096966552/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.108904 Aug 27 04:34:52.663756 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 410/809] 10.222.0.79 () {60 vars in 1224 bytes} [Sat Aug 27 04:34:52 2022] POST /compute/v2.1/flavors/2096966552/os-extra_specs => generated 66 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:34:52.674320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2a74a943-3219-4eac-a1fb-16bcbaee9713 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:52.675317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2a74a943-3219-4eac-a1fb-16bcbaee9713 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:52.692564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a74a943-3219-4eac-a1fb-16bcbaee9713 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:52.693463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a74a943-3219-4eac-a1fb-16bcbaee9713 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:52.697996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a74a943-3219-4eac-a1fb-16bcbaee9713 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:52.699555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a74a943-3219-4eac-a1fb-16bcbaee9713 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:52.701780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a74a943-3219-4eac-a1fb-16bcbaee9713 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:52.704210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a74a943-3219-4eac-a1fb-16bcbaee9713 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:52.757588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7181e669-9a80-491d-843b-a936fefe4132 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:52.766913 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7181e669-9a80-491d-843b-a936fefe4132 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1226 microversion: 2.1 time: 0.217468 Aug 27 04:34:52.786850 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 400/810] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:52 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1226 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:52.801725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-457ab778-b407-4b43-aee8-0696c80cd706 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:52.803447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-457ab778-b407-4b43-aee8-0696c80cd706 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:52.820938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-457ab778-b407-4b43-aee8-0696c80cd706 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:52.821807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-457ab778-b407-4b43-aee8-0696c80cd706 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:52.823269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-457ab778-b407-4b43-aee8-0696c80cd706 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:52.825070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-457ab778-b407-4b43-aee8-0696c80cd706 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:52.825772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-457ab778-b407-4b43-aee8-0696c80cd706 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:52.827228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-457ab778-b407-4b43-aee8-0696c80cd706 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:53.142534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-2a74a943-3219-4eac-a1fb-16bcbaee9713 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 686b50ec-d768-4cc2-bb93-e92096bc7ba0 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:34:53.234293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-457ab778-b407-4b43-aee8-0696c80cd706 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:53.253795 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-457ab778-b407-4b43-aee8-0696c80cd706 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1365 microversion: 2.1 time: 0.465331 Aug 27 04:34:53.255641 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 401/811] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:52 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1365 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:53.274129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7eb393d-6273-4d27-a123-8a1cc2e3a2b2 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:53.276012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7eb393d-6273-4d27-a123-8a1cc2e3a2b2 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'fa14c2c27d3145898ce56cb80f3d58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8757d4b7bb4bd5800a2d2a3429ba87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7eb393d-6273-4d27-a123-8a1cc2e3a2b2 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Request method failure captured: Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/flavors/2096966552/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ7puV9Ux3kutI09OosDjGi4WkeH_ajOSUo5TCn-mNRGyeEUfGRBDxVquwucBuKg38SlaAH8U-fMpGj1x6Gt0u9rOo7eNuW0XgTlLt5603bc-fe0WFfEzT4TNGnXODgSnZxmIjobtJ3qyG_EKCXNXIlKBdk74crmuqW0LdZsilUMNXo Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 0f8757d4b7bb4bd5800a2d2a3429ba87 Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:34:53.279924 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:34:53.281455 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:53.281455 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 Aug 27 04:34:53.281455 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 0f8757d4b7bb4bd5800a2d2a3429ba87 Aug 27 04:34:53.281455 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 Aug 27 04:34:53.281455 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project Aug 27 04:34:53.281455 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:34:53.281455 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:34:53.281455 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: fa14c2c27d3145898ce56cb80f3d58e9 Aug 27 04:34:53.281455 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project Aug 27 04:34:53.281455 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:34:53.281455 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'flavor_id': '2096966552', 'id': 'hw:numa_nodes'} Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:34:53.282163 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 04:34:53.283440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.286365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7eb393d-6273-4d27-a123-8a1cc2e3a2b2 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:53.288935 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7eb393d-6273-4d27-a123-8a1cc2e3a2b2 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] 10.222.0.79 "DELETE /compute/v2.1/flavors/2096966552/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.030861 Aug 27 04:34:53.293139 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 402/812] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 04:34:53 2022] DELETE /compute/v2.1/flavors/2096966552/os-extra_specs/hw:numa_nodes => generated 124 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:34:53.303395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28fa7eab-3b09-4267-9092-22a855ed4504 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:53.305260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-28fa7eab-3b09-4267-9092-22a855ed4504 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:53.315777 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2a74a943-3219-4eac-a1fb-16bcbaee9713 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 2051 microversion: 2.25 time: 0.650523 Aug 27 04:34:53.316377 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 411/813] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:52 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 2051 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:53.320936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fa7eab-3b09-4267-9092-22a855ed4504 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:53.325191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fa7eab-3b09-4267-9092-22a855ed4504 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:53.325915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fa7eab-3b09-4267-9092-22a855ed4504 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:53.326892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fa7eab-3b09-4267-9092-22a855ed4504 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:53.328048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fa7eab-3b09-4267-9092-22a855ed4504 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:53.329853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fa7eab-3b09-4267-9092-22a855ed4504 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:53.339360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-9b8189fe-404f-4e78-82e8-c7fb18926394 req-4f0db54c-fc4f-4510-8a38-f3be6908017b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce113bc-c89f-4752-817e-f3addff689b2", "name": "network-vif-plugged", "status": "completed", "tag": "8f6bbf7a-d8a5-4aa0-bbfa-2912f98e51de"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:53.375011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9b8189fe-404f-4e78-82e8-c7fb18926394 req-4f0db54c-fc4f-4510-8a38-f3be6908017b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:53.376034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9b8189fe-404f-4e78-82e8-c7fb18926394 req-4f0db54c-fc4f-4510-8a38-f3be6908017b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:53.376678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9b8189fe-404f-4e78-82e8-c7fb18926394 req-4f0db54c-fc4f-4510-8a38-f3be6908017b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:53.389869 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-9b8189fe-404f-4e78-82e8-c7fb18926394 req-4f0db54c-fc4f-4510-8a38-f3be6908017b service nova] Creating event network-vif-plugged:8f6bbf7a-d8a5-4aa0-bbfa-2912f98e51de for instance 3ce113bc-c89f-4752-817e-f3addff689b2 on n-h1-854823-1 Aug 27 04:34:53.397089 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-9b8189fe-404f-4e78-82e8-c7fb18926394 req-4f0db54c-fc4f-4510-8a38-f3be6908017b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070190 Aug 27 04:34:53.402111 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 412/814] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:53.408557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a2346a05-432b-4e22-85e1-6f9b6fe026de tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:53.450573 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a2346a05-432b-4e22-85e1-6f9b6fe026de tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/2096966552/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046835 Aug 27 04:34:53.451538 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 413/815] 10.222.0.79 () {60 vars in 1224 bytes} [Sat Aug 27 04:34:53 2022] POST /compute/v2.1/flavors/2096966552/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:34:53.457179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-08b81d7b-63f2-42c8-bdb4-8c5b526d3f20 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f2205d8b0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:53.519651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-28fa7eab-3b09-4267-9092-22a855ed4504 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:53.527529 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-08b81d7b-63f2-42c8-bdb4-8c5b526d3f20 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.074715 Aug 27 04:34:53.528071 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-28fa7eab-3b09-4267-9092-22a855ed4504 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1274 microversion: 2.1 time: 0.233554 Aug 27 04:34:53.529543 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 414/816] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:34:53 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:53.536445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef043b92-e2b4-4374-bf09-2541bc9d91c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:53.539169 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 403/817] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:53 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1274 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:53.543983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef043b92-e2b4-4374-bf09-2541bc9d91c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'fa14c2c27d3145898ce56cb80f3d58e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8757d4b7bb4bd5800a2d2a3429ba87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef043b92-e2b4-4374-bf09-2541bc9d91c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Request method failure captured: Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: request: PUT /compute/v2.1/flavors/2096966552/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 22 Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ7puV9Ux3kutI09OosDjGi4WkeH_ajOSUo5TCn-mNRGyeEUfGRBDxVquwucBuKg38SlaAH8U-fMpGj1x6Gt0u9rOo7eNuW0XgTlLt5603bc-fe0WFfEzT4TNGnXODgSnZxmIjobtJ3qyG_EKCXNXIlKBdk74crmuqW0LdZsilUMNXo Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 0f8757d4b7bb4bd5800a2d2a3429ba87 Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:34:53.547428 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:34:53.549111 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0f8757d4b7bb4bd5800a2d2a3429ba87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:53.549111 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 Aug 27 04:34:53.549111 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 0f8757d4b7bb4bd5800a2d2a3429ba87 Aug 27 04:34:53.549111 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 Aug 27 04:34:53.549111 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project Aug 27 04:34:53.549111 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:34:53.549111 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:34:53.549111 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: fa14c2c27d3145898ce56cb80f3d58e9 Aug 27 04:34:53.549111 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project Aug 27 04:34:53.549111 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:34:53.549111 n-d-854823-1 devstack@n-api.service[128870]: {"hw:numa_nodes": "1"} Aug 27 04:34:53.549111 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:34:53.549111 n-d-854823-1 devstack@n-api.service[128870]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'flavor_id': '2096966552', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:34:53.550202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 04:34:53.551704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.553167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee0e36e1-bedb-4b18-9dfa-1f414eb155ca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:53.553484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee0e36e1-bedb-4b18-9dfa-1f414eb155ca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:53.556016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef043b92-e2b4-4374-bf09-2541bc9d91c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:53.558195 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ef043b92-e2b4-4374-bf09-2541bc9d91c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292 tempest-FlavorsExtraSpecsNegativeTestJSON-1904563292-project] 10.222.0.79 "PUT /compute/v2.1/flavors/2096966552/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.026873 Aug 27 04:34:53.559383 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 415/818] 10.222.0.79 () {60 vars in 1265 bytes} [Sat Aug 27 04:34:53 2022] PUT /compute/v2.1/flavors/2096966552/os-extra_specs/hw:numa_nodes => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:34:53.568604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0e36e1-bedb-4b18-9dfa-1f414eb155ca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:53.569348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0e36e1-bedb-4b18-9dfa-1f414eb155ca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:53.569974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0e36e1-bedb-4b18-9dfa-1f414eb155ca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:53.570869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0e36e1-bedb-4b18-9dfa-1f414eb155ca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:53.575183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0e36e1-bedb-4b18-9dfa-1f414eb155ca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:53.575840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0e36e1-bedb-4b18-9dfa-1f414eb155ca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:53.588770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31dbeee8-8722-49cf-b3e4-b85fa47f5e68 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:53.612312 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-31dbeee8-8722-49cf-b3e4-b85fa47f5e68 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] HTTP exception thrown: Flavor 2096966552 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31dbeee8-8722-49cf-b3e4-b85fa47f5e68 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] Request method failure captured: Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/flavors/2096966552/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ7qapKeUYlmQsqHmdnmQSHOPjhuhiKggo3R9C76cwu-ZzDOS1xCeKlgAqDPQvk3-Zcn3sqqZS5SZfyFA-RSiWV2So8cjIdesyshMGKCd6PfXOfUR40U-wzRGDMbMPcZZowACjI-pCXDchdyyTZy4DRe4acesppoMkBMNmmhnp5rkIw Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 830d4faa0a14454d914fc306967a5624 Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:34:53.616814 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:34:53.618632 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/830d4faa0a14454d914fc306967a5624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_830d4faa0a14454d914fc306967a5624"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/830d4faa0a14454d914fc306967a5624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/830d4faa0a14454d914fc306967a5624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:53.618632 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 Aug 27 04:34:53.618632 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 830d4faa0a14454d914fc306967a5624 Aug 27 04:34:53.618632 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 Aug 27 04:34:53.618632 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin Aug 27 04:34:53.618632 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:34:53.618632 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:34:53.618632 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6b3ace189e584bd38e3782611cfce6d0 Aug 27 04:34:53.618632 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin Aug 27 04:34:53.618632 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:34:53.618632 n-d-854823-1 devstack@n-api.service[128870]: exception: Flavor 2096966552 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'flavor_id': '2096966552', 'id': 'hw:cpu_thread_policy'} Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2096966552 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:53.619495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.622500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:53.622500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:53.622500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:53.622500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:34:53.622500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:34:53.622500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2096966552 has no extra specs with key hw:cpu_thread_policy. Aug 27 04:34:53.622500 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.624627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31dbeee8-8722-49cf-b3e4-b85fa47f5e68 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] Returning 404 to user: Flavor 2096966552 has no extra specs with key hw:cpu_thread_policy. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:53.628726 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-31dbeee8-8722-49cf-b3e4-b85fa47f5e68 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/2096966552/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.062028 Aug 27 04:34:53.630317 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 416/819] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 04:34:53 2022] DELETE /compute/v2.1/flavors/2096966552/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:34:53.650596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7d050fb4-455a-4f2e-9eab-053ff2aee15d tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:53.671781 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-7d050fb4-455a-4f2e-9eab-053ff2aee15d tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7d050fb4-455a-4f2e-9eab-053ff2aee15d tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] Request method failure captured: Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: request: PUT /compute/v2.1/flavors/2096966552/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 27 Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ7qapKeUYlmQsqHmdnmQSHOPjhuhiKggo3R9C76cwu-ZzDOS1xCeKlgAqDPQvk3-Zcn3sqqZS5SZfyFA-RSiWV2So8cjIdesyshMGKCd6PfXOfUR40U-wzRGDMbMPcZZowACjI-pCXDchdyyTZy4DRe4acesppoMkBMNmmhnp5rkIw Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 830d4faa0a14454d914fc306967a5624 Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:34:53.678558 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:34:53.680188 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/830d4faa0a14454d914fc306967a5624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_830d4faa0a14454d914fc306967a5624"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/830d4faa0a14454d914fc306967a5624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/830d4faa0a14454d914fc306967a5624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:53.680188 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 Aug 27 04:34:53.680188 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 830d4faa0a14454d914fc306967a5624 Aug 27 04:34:53.680188 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 Aug 27 04:34:53.680188 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin Aug 27 04:34:53.680188 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:34:53.680188 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:34:53.680188 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6b3ace189e584bd38e3782611cfce6d0 Aug 27 04:34:53.680188 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin Aug 27 04:34:53.680188 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:34:53.680188 n-d-854823-1 devstack@n-api.service[128870]: {"hw:cpu_policy": "shared"} Aug 27 04:34:53.680188 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:34:53.680188 n-d-854823-1 devstack@n-api.service[128870]: exception: Request body and URI mismatch Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'flavor_id': '2096966552', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:53.681138 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:53.682608 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:34:53.682608 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:34:53.682608 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 27 04:34:53.682608 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.682608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7d050fb4-455a-4f2e-9eab-053ff2aee15d tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:53.682608 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7d050fb4-455a-4f2e-9eab-053ff2aee15d tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/2096966552/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.043212 Aug 27 04:34:53.682608 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 417/820] 10.222.0.79 () {60 vars in 1265 bytes} [Sat Aug 27 04:34:53 2022] PUT /compute/v2.1/flavors/2096966552/os-extra_specs/hw:numa_nodes => generated 73 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 27 04:34:53.712021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ecb5a363-b299-4d21-8fd6-c407a07a73e8 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ecb5a363-b299-4d21-8fd6-c407a07a73e8 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] Request method failure captured: Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: request: PUT /compute/v2.1/flavors/2096966552/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 49 Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ7qapKeUYlmQsqHmdnmQSHOPjhuhiKggo3R9C76cwu-ZzDOS1xCeKlgAqDPQvk3-Zcn3sqqZS5SZfyFA-RSiWV2So8cjIdesyshMGKCd6PfXOfUR40U-wzRGDMbMPcZZowACjI-pCXDchdyyTZy4DRe4acesppoMkBMNmmhnp5rkIw Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 830d4faa0a14454d914fc306967a5624 Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:34:53.721990 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:34:53.723585 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/830d4faa0a14454d914fc306967a5624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_830d4faa0a14454d914fc306967a5624"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/830d4faa0a14454d914fc306967a5624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/830d4faa0a14454d914fc306967a5624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:34:53.723585 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 Aug 27 04:34:53.723585 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 830d4faa0a14454d914fc306967a5624 Aug 27 04:34:53.723585 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 Aug 27 04:34:53.723585 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin Aug 27 04:34:53.723585 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:34:53.723585 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:34:53.723585 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6b3ace189e584bd38e3782611cfce6d0 Aug 27 04:34:53.723585 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin Aug 27 04:34:53.723585 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:34:53.723585 n-d-854823-1 devstack@n-api.service[128870]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 27 04:34:53.723585 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'flavor_id': '2096966552', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance: Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 27 04:34:53.724488 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.726152 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:34:53.727567 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:34:53.727567 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:34:53.727567 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:34:53.727567 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:34:53.727567 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 04:34:53.727567 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:34:53.748616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ecb5a363-b299-4d21-8fd6-c407a07a73e8 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:34:53.750221 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ecb5a363-b299-4d21-8fd6-c407a07a73e8 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/2096966552/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.056656 Aug 27 04:34:53.753336 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 418/821] 10.222.0.79 () {60 vars in 1265 bytes} [Sat Aug 27 04:34:53 2022] PUT /compute/v2.1/flavors/2096966552/os-extra_specs/hw:numa_nodes => generated 117 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:34:53.776510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-842622677", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "f6f5b09f-74c4-46ac-874b-9207e349b51e"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:53.889631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] validate_networks() for [('f6f5b09f-74c4-46ac-874b-9207e349b51e', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:34:53.945699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee0e36e1-bedb-4b18-9dfa-1f414eb155ca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:53.978030 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee0e36e1-bedb-4b18-9dfa-1f414eb155ca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1470 microversion: 2.1 time: 0.434868 Aug 27 04:34:53.979177 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 404/822] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:53 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1470 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:53.996680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4324d705-949a-4e8e-80ac-c5edf8c962d4 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:54.041112 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4324d705-949a-4e8e-80ac-c5edf8c962d4 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/2096966552" status: 202 len: 0 microversion: 2.1 time: 0.059890 Aug 27 04:34:54.041918 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 405/823] 10.222.0.79 () {58 vars in 1161 bytes} [Sat Aug 27 04:34:53 2022] DELETE /compute/v2.1/flavors/2096966552 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:54.055175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c3dc327-ca1c-4532-8a3e-86eec14e6468 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:54.056297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c3dc327-ca1c-4532-8a3e-86eec14e6468 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:54.077595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3dc327-ca1c-4532-8a3e-86eec14e6468 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:54.078456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3dc327-ca1c-4532-8a3e-86eec14e6468 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:54.083216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3dc327-ca1c-4532-8a3e-86eec14e6468 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:54.085090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3dc327-ca1c-4532-8a3e-86eec14e6468 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:54.086857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3dc327-ca1c-4532-8a3e-86eec14e6468 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:54.087966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3dc327-ca1c-4532-8a3e-86eec14e6468 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:54.202770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c3dc327-ca1c-4532-8a3e-86eec14e6468 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:54.215957 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c3dc327-ca1c-4532-8a3e-86eec14e6468 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1274 microversion: 2.1 time: 0.172310 Aug 27 04:34:54.231946 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 406/824] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:54 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:54.251421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d846c4a-759b-44da-9ed7-ced2d3d1d06a tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:54.321283 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d846c4a-759b-44da-9ed7-ced2d3d1d06a tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135 tempest-FlavorsExtraSpecsNegativeTestJSON-2133826135-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088552 Aug 27 04:34:54.350008 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 407/825] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:34:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:54.369705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18297fb2-7ea7-4f1a-96f3-676e7eefdd8a tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:54.370695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18297fb2-7ea7-4f1a-96f3-676e7eefdd8a tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:54.387751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18297fb2-7ea7-4f1a-96f3-676e7eefdd8a tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:54.392627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18297fb2-7ea7-4f1a-96f3-676e7eefdd8a tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:54.396668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18297fb2-7ea7-4f1a-96f3-676e7eefdd8a tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:54.399547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18297fb2-7ea7-4f1a-96f3-676e7eefdd8a tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:54.401285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18297fb2-7ea7-4f1a-96f3-676e7eefdd8a tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:54.402366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18297fb2-7ea7-4f1a-96f3-676e7eefdd8a tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:54.769521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18297fb2-7ea7-4f1a-96f3-676e7eefdd8a tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:54.795014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:34:54.795581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:34:54.796252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:34:54.796896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:34:54.797429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:34:54.797964 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18297fb2-7ea7-4f1a-96f3-676e7eefdd8a tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1365 microversion: 2.1 time: 0.441629 Aug 27 04:34:54.802035 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 408/826] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:54 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1365 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:54.809305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58f50061-fcff-4a64-9692-655ec4426c79 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21c2dee0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:54.812922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:54.814901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:54.815603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:54.816692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:54.818199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:54.820199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:54.875967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Getting quotas for project 002ba94e9b364c3e8784927de5770ed1. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:34:54.900598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Getting quotas for user 1d3d23499c474adaa7fe3a2260f5ec36 and project 002ba94e9b364c3e8784927de5770ed1. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:34:54.907620 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-58f50061-fcff-4a64-9692-655ec4426c79 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.100044 Aug 27 04:34:54.909069 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 409/827] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:34:54 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:54.916974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-255de577-5b11-417c-8598-4f2bb4024012 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:54.917840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-255de577-5b11-417c-8598-4f2bb4024012 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:54.926930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-255de577-5b11-417c-8598-4f2bb4024012 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:54.927634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-255de577-5b11-417c-8598-4f2bb4024012 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:54.928269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-255de577-5b11-417c-8598-4f2bb4024012 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:54.929241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-255de577-5b11-417c-8598-4f2bb4024012 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:54.929870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-255de577-5b11-417c-8598-4f2bb4024012 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:54.930519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-255de577-5b11-417c-8598-4f2bb4024012 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:54.945692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:34:54.961315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:34:54.979033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:55.102756 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d4ca5026-bd69-495c-ad35-21e3c7f4e276 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.346845 Aug 27 04:34:55.115578 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 419/828] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 04:34:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:34:55.123397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a751e62-fe80-4019-ac93-7f3fde49c48f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:55.132647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a751e62-fe80-4019-ac93-7f3fde49c48f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:55.164267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a751e62-fe80-4019-ac93-7f3fde49c48f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:55.165005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a751e62-fe80-4019-ac93-7f3fde49c48f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:55.165563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a751e62-fe80-4019-ac93-7f3fde49c48f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:55.166412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a751e62-fe80-4019-ac93-7f3fde49c48f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:55.170522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a751e62-fe80-4019-ac93-7f3fde49c48f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:55.171916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a751e62-fe80-4019-ac93-7f3fde49c48f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:55.242018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-255de577-5b11-417c-8598-4f2bb4024012 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:55.253663 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-255de577-5b11-417c-8598-4f2bb4024012 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1316 microversion: 2.1 time: 0.342773 Aug 27 04:34:55.269405 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 410/829] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:54 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:55.274379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b155560-af93-4165-9ab1-4ee51d490738 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:55.274995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b155560-af93-4165-9ab1-4ee51d490738 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:55.377193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b155560-af93-4165-9ab1-4ee51d490738 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:55.387824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b155560-af93-4165-9ab1-4ee51d490738 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:55.389616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b155560-af93-4165-9ab1-4ee51d490738 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:55.391269 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b155560-af93-4165-9ab1-4ee51d490738 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1261 microversion: 2.25 time: 0.129086 Aug 27 04:34:55.392454 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 411/830] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:55 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1261 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:55.400720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbaf996f-b710-4c35-81b5-d01edcc86cc2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:55.401508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bbaf996f-b710-4c35-81b5-d01edcc86cc2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:55.412772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbaf996f-b710-4c35-81b5-d01edcc86cc2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:55.413721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbaf996f-b710-4c35-81b5-d01edcc86cc2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:55.414374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbaf996f-b710-4c35-81b5-d01edcc86cc2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:55.415289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbaf996f-b710-4c35-81b5-d01edcc86cc2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:55.415904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbaf996f-b710-4c35-81b5-d01edcc86cc2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:55.417189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbaf996f-b710-4c35-81b5-d01edcc86cc2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:55.573505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bbaf996f-b710-4c35-81b5-d01edcc86cc2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:55.584614 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bbaf996f-b710-4c35-81b5-d01edcc86cc2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1292 microversion: 2.1 time: 0.188585 Aug 27 04:34:55.592942 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 412/831] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:55 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1292 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:55.823970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-00db7158-e031-48e9-a329-c938e495d22f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:55.824949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-00db7158-e031-48e9-a329-c938e495d22f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:55.839463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00db7158-e031-48e9-a329-c938e495d22f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:55.840481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00db7158-e031-48e9-a329-c938e495d22f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:55.843419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00db7158-e031-48e9-a329-c938e495d22f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:55.846578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00db7158-e031-48e9-a329-c938e495d22f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:55.847799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00db7158-e031-48e9-a329-c938e495d22f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:55.848434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00db7158-e031-48e9-a329-c938e495d22f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:56.123895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6a751e62-fe80-4019-ac93-7f3fde49c48f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:56.134504 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a751e62-fe80-4019-ac93-7f3fde49c48f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1470 microversion: 2.1 time: 1.017476 Aug 27 04:34:56.137267 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 420/832] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:55 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1470 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:56.149902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-95cdeea6-2f8b-44d8-a57f-0b31529535c8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f22031d30>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:56.280572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-00db7158-e031-48e9-a329-c938e495d22f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:56.293028 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-00db7158-e031-48e9-a329-c938e495d22f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1556 microversion: 2.1 time: 0.472080 Aug 27 04:34:56.294602 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-95cdeea6-2f8b-44d8-a57f-0b31529535c8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.148675 Aug 27 04:34:56.295161 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 421/833] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:34:56 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:56.296069 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 413/834] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:55 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1556 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:56.314284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-296c9710-c21b-402c-bfc8-97f8b38f107d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:56.315274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-296c9710-c21b-402c-bfc8-97f8b38f107d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:56.325374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53e237fe-2d09-4334-8953-467c94d6f5d9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:56.328330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-296c9710-c21b-402c-bfc8-97f8b38f107d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:56.328926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-296c9710-c21b-402c-bfc8-97f8b38f107d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:56.329452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-296c9710-c21b-402c-bfc8-97f8b38f107d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:56.329652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-53e237fe-2d09-4334-8953-467c94d6f5d9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:56.330418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-296c9710-c21b-402c-bfc8-97f8b38f107d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:56.330937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-296c9710-c21b-402c-bfc8-97f8b38f107d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:56.331726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-296c9710-c21b-402c-bfc8-97f8b38f107d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:56.340099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53e237fe-2d09-4334-8953-467c94d6f5d9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:56.340645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53e237fe-2d09-4334-8953-467c94d6f5d9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:56.341159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53e237fe-2d09-4334-8953-467c94d6f5d9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:56.341892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53e237fe-2d09-4334-8953-467c94d6f5d9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:56.342356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53e237fe-2d09-4334-8953-467c94d6f5d9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:56.342781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53e237fe-2d09-4334-8953-467c94d6f5d9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:56.460670 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-53e237fe-2d09-4334-8953-467c94d6f5d9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145594 Aug 27 04:34:56.472161 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 414/835] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 04:34:56 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:56.490539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dd34f499-e72b-42e4-9264-be213e295094 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:56.491264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dd34f499-e72b-42e4-9264-be213e295094 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:56.504775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd34f499-e72b-42e4-9264-be213e295094 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:56.505623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd34f499-e72b-42e4-9264-be213e295094 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:56.506304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd34f499-e72b-42e4-9264-be213e295094 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:56.507964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd34f499-e72b-42e4-9264-be213e295094 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:56.514371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd34f499-e72b-42e4-9264-be213e295094 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:56.515484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd34f499-e72b-42e4-9264-be213e295094 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:56.703380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dd34f499-e72b-42e4-9264-be213e295094 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:56.721592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dd34f499-e72b-42e4-9264-be213e295094 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:56.725848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dd34f499-e72b-42e4-9264-be213e295094 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:56.727446 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dd34f499-e72b-42e4-9264-be213e295094 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1265 microversion: 2.25 time: 0.253175 Aug 27 04:34:56.728177 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 415/836] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:56 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:56.737685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf09c56b-e7ae-4577-a5d7-332daac024fe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:56.738602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf09c56b-e7ae-4577-a5d7-332daac024fe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:56.745829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf09c56b-e7ae-4577-a5d7-332daac024fe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:56.746533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf09c56b-e7ae-4577-a5d7-332daac024fe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:56.747467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf09c56b-e7ae-4577-a5d7-332daac024fe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:56.748606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf09c56b-e7ae-4577-a5d7-332daac024fe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:56.749234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf09c56b-e7ae-4577-a5d7-332daac024fe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:56.749822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf09c56b-e7ae-4577-a5d7-332daac024fe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:56.889623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf09c56b-e7ae-4577-a5d7-332daac024fe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:56.903362 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf09c56b-e7ae-4577-a5d7-332daac024fe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1280 microversion: 2.1 time: 0.171059 Aug 27 04:34:56.905184 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 416/837] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:56 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1280 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:56.996829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-296c9710-c21b-402c-bfc8-97f8b38f107d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:57.009239 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-296c9710-c21b-402c-bfc8-97f8b38f107d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1316 microversion: 2.1 time: 0.712652 Aug 27 04:34:57.022427 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 422/838] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:56 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1316 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:57.170214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e583665-427f-4eb4-8647-7633a14898ef tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:57.173386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e583665-427f-4eb4-8647-7633a14898ef tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:57.192151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e583665-427f-4eb4-8647-7633a14898ef tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:57.194443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e583665-427f-4eb4-8647-7633a14898ef tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:57.194968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e583665-427f-4eb4-8647-7633a14898ef tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:57.202992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e583665-427f-4eb4-8647-7633a14898ef tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:57.203633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e583665-427f-4eb4-8647-7633a14898ef tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:57.205716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e583665-427f-4eb4-8647-7633a14898ef tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:57.315151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cf40f590-c161-42cf-b0b6-6a7a56fc06ff tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f22099430>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:57.424495 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cf40f590-c161-42cf-b0b6-6a7a56fc06ff tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.113090 Aug 27 04:34:57.425963 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 423/839] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:34:57 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:57.553887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-19c3f2f1-d613-40f2-837a-a5abb6be5f56 req-9cb3cc0f-69cf-4c7d-9277-186770e5e7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5312348f-2393-47a9-a02f-c5747efc16ba", "tag": "3d2ce8ba-1ee0-472e-aac0-d92d75c607e8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:57.575617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-19c3f2f1-d613-40f2-837a-a5abb6be5f56 req-9cb3cc0f-69cf-4c7d-9277-186770e5e7e0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:57.576106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-19c3f2f1-d613-40f2-837a-a5abb6be5f56 req-9cb3cc0f-69cf-4c7d-9277-186770e5e7e0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:57.576558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-19c3f2f1-d613-40f2-837a-a5abb6be5f56 req-9cb3cc0f-69cf-4c7d-9277-186770e5e7e0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:57.615297 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-19c3f2f1-d613-40f2-837a-a5abb6be5f56 req-9cb3cc0f-69cf-4c7d-9277-186770e5e7e0 service nova] Creating event network-changed:3d2ce8ba-1ee0-472e-aac0-d92d75c607e8 for instance 5312348f-2393-47a9-a02f-c5747efc16ba on n-h2-854823-1 Aug 27 04:34:57.629266 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-19c3f2f1-d613-40f2-837a-a5abb6be5f56 req-9cb3cc0f-69cf-4c7d-9277-186770e5e7e0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079531 Aug 27 04:34:57.629887 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 424/840] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:34:57.751860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2d8d1f18-2475-458a-93b9-5b63d608fa17 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:57.752620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2d8d1f18-2475-458a-93b9-5b63d608fa17 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:57.763547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d8d1f18-2475-458a-93b9-5b63d608fa17 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:57.764048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d8d1f18-2475-458a-93b9-5b63d608fa17 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:57.764488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d8d1f18-2475-458a-93b9-5b63d608fa17 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:57.765271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d8d1f18-2475-458a-93b9-5b63d608fa17 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:57.765688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d8d1f18-2475-458a-93b9-5b63d608fa17 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:57.770117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d8d1f18-2475-458a-93b9-5b63d608fa17 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:57.923306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2d8d1f18-2475-458a-93b9-5b63d608fa17 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:57.932708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2d8d1f18-2475-458a-93b9-5b63d608fa17 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:57.940820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2d8d1f18-2475-458a-93b9-5b63d608fa17 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:57.948374 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2d8d1f18-2475-458a-93b9-5b63d608fa17 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1313 microversion: 2.25 time: 0.202137 Aug 27 04:34:57.955574 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 425/841] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:57 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:57.961369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f9dbcb9c-392a-4487-a210-ebd5db89c8d3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:57.980029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f9dbcb9c-392a-4487-a210-ebd5db89c8d3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:57.998532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e583665-427f-4eb4-8647-7633a14898ef tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:58.003847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9dbcb9c-392a-4487-a210-ebd5db89c8d3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:58.006353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9dbcb9c-392a-4487-a210-ebd5db89c8d3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:58.009399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9dbcb9c-392a-4487-a210-ebd5db89c8d3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:58.010408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9dbcb9c-392a-4487-a210-ebd5db89c8d3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:58.011085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9dbcb9c-392a-4487-a210-ebd5db89c8d3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:58.014153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9dbcb9c-392a-4487-a210-ebd5db89c8d3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:58.028432 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e583665-427f-4eb4-8647-7633a14898ef tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1470 microversion: 2.1 time: 0.872232 Aug 27 04:34:58.046790 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 417/842] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:57 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1470 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:58.057440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d50ef787-cbba-4612-bc04-20e12688418a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:58.058486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d50ef787-cbba-4612-bc04-20e12688418a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:58.070340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d50ef787-cbba-4612-bc04-20e12688418a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:58.071081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d50ef787-cbba-4612-bc04-20e12688418a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:58.071760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d50ef787-cbba-4612-bc04-20e12688418a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:58.072926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d50ef787-cbba-4612-bc04-20e12688418a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:58.073772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d50ef787-cbba-4612-bc04-20e12688418a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:58.074434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d50ef787-cbba-4612-bc04-20e12688418a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:58.271524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f9dbcb9c-392a-4487-a210-ebd5db89c8d3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:58.290655 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f9dbcb9c-392a-4487-a210-ebd5db89c8d3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1280 microversion: 2.1 time: 0.331902 Aug 27 04:34:58.294026 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 426/843] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:57 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1280 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:58.439138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-230dc31f-f92b-4645-ad19-b457e316b621 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f22099f70>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:58.529491 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-230dc31f-f92b-4645-ad19-b457e316b621 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.094097 Aug 27 04:34:58.530373 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 427/844] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:34:58 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:58.874660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d50ef787-cbba-4612-bc04-20e12688418a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:58.889011 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d50ef787-cbba-4612-bc04-20e12688418a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1316 microversion: 2.1 time: 0.840513 Aug 27 04:34:58.907626 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 418/845] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:58 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1316 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:58.978683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4228943d-f6f7-412f-bfc2-3a09e5d346e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:58.979540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4228943d-f6f7-412f-bfc2-3a09e5d346e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:58.989167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=11,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:34:59.015036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4228943d-f6f7-412f-bfc2-3a09e5d346e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:59.017496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4228943d-f6f7-412f-bfc2-3a09e5d346e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:59.018027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4228943d-f6f7-412f-bfc2-3a09e5d346e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:59.021454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4228943d-f6f7-412f-bfc2-3a09e5d346e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:59.024157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4228943d-f6f7-412f-bfc2-3a09e5d346e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:59.026637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4228943d-f6f7-412f-bfc2-3a09e5d346e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:59.053985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d92600c8-3a43-412d-98c9-55c68efa3445 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:59.054922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d92600c8-3a43-412d-98c9-55c68efa3445 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:59.070068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d92600c8-3a43-412d-98c9-55c68efa3445 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:59.073203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d92600c8-3a43-412d-98c9-55c68efa3445 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:59.076369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d92600c8-3a43-412d-98c9-55c68efa3445 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:59.078867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d92600c8-3a43-412d-98c9-55c68efa3445 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:59.080975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d92600c8-3a43-412d-98c9-55c68efa3445 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:59.081655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d92600c8-3a43-412d-98c9-55c68efa3445 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:59.533160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4228943d-f6f7-412f-bfc2-3a09e5d346e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:59.546891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4228943d-f6f7-412f-bfc2-3a09e5d346e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:59.549504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4228943d-f6f7-412f-bfc2-3a09e5d346e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:59.552870 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4228943d-f6f7-412f-bfc2-3a09e5d346e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1319 microversion: 2.25 time: 0.577525 Aug 27 04:34:59.565496 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 428/846] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:34:58 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:59.577898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-be4783cf-8572-466d-9964-e1b3ab8e7854 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:59.579708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-be4783cf-8572-466d-9964-e1b3ab8e7854 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:34:59.589670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be4783cf-8572-466d-9964-e1b3ab8e7854 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:59.590436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be4783cf-8572-466d-9964-e1b3ab8e7854 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:59.592522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be4783cf-8572-466d-9964-e1b3ab8e7854 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:59.594188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be4783cf-8572-466d-9964-e1b3ab8e7854 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:34:59.594964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be4783cf-8572-466d-9964-e1b3ab8e7854 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:34:59.595565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be4783cf-8572-466d-9964-e1b3ab8e7854 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:34:59.871898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d92600c8-3a43-412d-98c9-55c68efa3445 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:59.885219 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d92600c8-3a43-412d-98c9-55c68efa3445 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1470 microversion: 2.1 time: 0.835914 Aug 27 04:34:59.886869 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 419/847] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:59 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1470 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:59.901516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8b816fc-461a-46e6-99e6-4b9adbfdaa37 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21ca9af0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:00.039473 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8b816fc-461a-46e6-99e6-4b9adbfdaa37 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.151167 Aug 27 04:35:00.040498 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 420/848] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:34:59 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:00.049221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-42828003-a4ab-4378-acad-eb6f546365a2 req-c058c1a6-7398-40e5-aed2-c0793b773e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce113bc-c89f-4752-817e-f3addff689b2", "tag": "8f6bbf7a-d8a5-4aa0-bbfa-2912f98e51de"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:00.073126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42828003-a4ab-4378-acad-eb6f546365a2 req-c058c1a6-7398-40e5-aed2-c0793b773e5b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:00.074478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42828003-a4ab-4378-acad-eb6f546365a2 req-c058c1a6-7398-40e5-aed2-c0793b773e5b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:00.076857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42828003-a4ab-4378-acad-eb6f546365a2 req-c058c1a6-7398-40e5-aed2-c0793b773e5b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:00.093672 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-42828003-a4ab-4378-acad-eb6f546365a2 req-c058c1a6-7398-40e5-aed2-c0793b773e5b service nova] Creating event network-changed:8f6bbf7a-d8a5-4aa0-bbfa-2912f98e51de for instance 3ce113bc-c89f-4752-817e-f3addff689b2 on n-h1-854823-1 Aug 27 04:35:00.101621 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-42828003-a4ab-4378-acad-eb6f546365a2 req-c058c1a6-7398-40e5-aed2-c0793b773e5b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057476 Aug 27 04:35:00.102566 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 421/849] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:00.110452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86a226b1-e60e-43f4-a393-fbdf94de7545 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:00.111565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86a226b1-e60e-43f4-a393-fbdf94de7545 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:00.134562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a226b1-e60e-43f4-a393-fbdf94de7545 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:00.135434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a226b1-e60e-43f4-a393-fbdf94de7545 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:00.136507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a226b1-e60e-43f4-a393-fbdf94de7545 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:00.137524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a226b1-e60e-43f4-a393-fbdf94de7545 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:00.138499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a226b1-e60e-43f4-a393-fbdf94de7545 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:00.139106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a226b1-e60e-43f4-a393-fbdf94de7545 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:00.656465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86a226b1-e60e-43f4-a393-fbdf94de7545 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:00.684002 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86a226b1-e60e-43f4-a393-fbdf94de7545 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1316 microversion: 2.1 time: 0.579814 Aug 27 04:35:00.685992 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 422/850] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:00 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:00.710297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae41ca7c-5f46-4f03-b9ba-f5e9d652c2e0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:00.712182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae41ca7c-5f46-4f03-b9ba-f5e9d652c2e0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:00.727448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae41ca7c-5f46-4f03-b9ba-f5e9d652c2e0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:00.736839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae41ca7c-5f46-4f03-b9ba-f5e9d652c2e0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:00.738990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae41ca7c-5f46-4f03-b9ba-f5e9d652c2e0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:00.741935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae41ca7c-5f46-4f03-b9ba-f5e9d652c2e0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:00.743703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae41ca7c-5f46-4f03-b9ba-f5e9d652c2e0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:00.746157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae41ca7c-5f46-4f03-b9ba-f5e9d652c2e0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:00.879330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-be4783cf-8572-466d-9964-e1b3ab8e7854 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:00.898389 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-be4783cf-8572-466d-9964-e1b3ab8e7854 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1322 microversion: 2.1 time: 1.321886 Aug 27 04:35:00.899364 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 429/851] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:34:59 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1322 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:00.919818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-80a22b33-a225-404e-9fff-49909e0a6567 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:00.921069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-80a22b33-a225-404e-9fff-49909e0a6567 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:00.932062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80a22b33-a225-404e-9fff-49909e0a6567 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:00.935095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80a22b33-a225-404e-9fff-49909e0a6567 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:00.935553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80a22b33-a225-404e-9fff-49909e0a6567 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:00.938363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80a22b33-a225-404e-9fff-49909e0a6567 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:00.941655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80a22b33-a225-404e-9fff-49909e0a6567 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:00.943211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80a22b33-a225-404e-9fff-49909e0a6567 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:01.244841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ae41ca7c-5f46-4f03-b9ba-f5e9d652c2e0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:01.257955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ae41ca7c-5f46-4f03-b9ba-f5e9d652c2e0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:01.262320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ae41ca7c-5f46-4f03-b9ba-f5e9d652c2e0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:01.263606 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae41ca7c-5f46-4f03-b9ba-f5e9d652c2e0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1361 microversion: 2.25 time: 0.576286 Aug 27 04:35:01.294275 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 423/852] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:00 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1361 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:01.300614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e29e1bbb-3b48-4874-bdcb-b397794ab6b6 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21b6ab80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:01.358480 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e29e1bbb-3b48-4874-bdcb-b397794ab6b6 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.063467 Aug 27 04:35:01.367266 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 424/853] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:35:01 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:01.626376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-80a22b33-a225-404e-9fff-49909e0a6567 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:01.634935 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-80a22b33-a225-404e-9fff-49909e0a6567 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.719569 Aug 27 04:35:01.635528 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 430/854] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:00 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:01.711201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a985902-b7ba-477d-9f5c-2d66c8301754 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:01.711820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a985902-b7ba-477d-9f5c-2d66c8301754 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:01.721133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a985902-b7ba-477d-9f5c-2d66c8301754 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:01.721683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a985902-b7ba-477d-9f5c-2d66c8301754 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:01.722113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a985902-b7ba-477d-9f5c-2d66c8301754 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:01.724079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a985902-b7ba-477d-9f5c-2d66c8301754 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:01.724901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a985902-b7ba-477d-9f5c-2d66c8301754 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:01.726956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a985902-b7ba-477d-9f5c-2d66c8301754 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:01.927091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8f75e161-4519-4225-bd40-a3370073f19e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:01.927704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8f75e161-4519-4225-bd40-a3370073f19e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:01.935849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f75e161-4519-4225-bd40-a3370073f19e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:01.936354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f75e161-4519-4225-bd40-a3370073f19e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:01.942986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f75e161-4519-4225-bd40-a3370073f19e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:01.947055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f75e161-4519-4225-bd40-a3370073f19e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:01.947560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f75e161-4519-4225-bd40-a3370073f19e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:01.948011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f75e161-4519-4225-bd40-a3370073f19e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:02.023859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a985902-b7ba-477d-9f5c-2d66c8301754 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:02.033183 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a985902-b7ba-477d-9f5c-2d66c8301754 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1316 microversion: 2.1 time: 0.327722 Aug 27 04:35:02.040818 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 425/855] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:01 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:02.314563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40d6f908-781c-4602-b1d6-7805f733b514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:02.321876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40d6f908-781c-4602-b1d6-7805f733b514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:02.339442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d6f908-781c-4602-b1d6-7805f733b514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:02.340231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d6f908-781c-4602-b1d6-7805f733b514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:02.341003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d6f908-781c-4602-b1d6-7805f733b514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:02.342152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d6f908-781c-4602-b1d6-7805f733b514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:02.342870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d6f908-781c-4602-b1d6-7805f733b514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:02.343789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d6f908-781c-4602-b1d6-7805f733b514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:02.564115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40d6f908-781c-4602-b1d6-7805f733b514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:02.575626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40d6f908-781c-4602-b1d6-7805f733b514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:02.577730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40d6f908-781c-4602-b1d6-7805f733b514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:02.579219 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40d6f908-781c-4602-b1d6-7805f733b514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1361 microversion: 2.25 time: 0.276484 Aug 27 04:35:02.580327 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 426/856] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:02 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:02.592163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b66d0499-4f4c-41d6-a69c-0bf326ace200 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21baa8b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:02.679779 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b66d0499-4f4c-41d6-a69c-0bf326ace200 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.098046 Aug 27 04:35:02.680515 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 427/857] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:35:02 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:02.694366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-083035b9-c9ac-4f27-bcd3-6579dd905c12 req-a49de291-4260-477d-ac19-22cc4a05c1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b24aa3a-1603-40d1-a619-bc29521e61eb", "tag": "ced761b5-a492-4017-af6f-bc2b52bc544d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:02.709863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-083035b9-c9ac-4f27-bcd3-6579dd905c12 req-a49de291-4260-477d-ac19-22cc4a05c1e2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:02.711339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-083035b9-c9ac-4f27-bcd3-6579dd905c12 req-a49de291-4260-477d-ac19-22cc4a05c1e2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:02.712394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-083035b9-c9ac-4f27-bcd3-6579dd905c12 req-a49de291-4260-477d-ac19-22cc4a05c1e2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:02.725881 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-083035b9-c9ac-4f27-bcd3-6579dd905c12 req-a49de291-4260-477d-ac19-22cc4a05c1e2 service nova] Creating event network-changed:ced761b5-a492-4017-af6f-bc2b52bc544d for instance 7b24aa3a-1603-40d1-a619-bc29521e61eb on n-h1-854823-1 Aug 27 04:35:02.730860 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-083035b9-c9ac-4f27-bcd3-6579dd905c12 req-a49de291-4260-477d-ac19-22cc4a05c1e2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048182 Aug 27 04:35:02.732006 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 428/858] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:02.738189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d3b4de30-4120-4f97-8734-a92b0b62bd9c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:02.738990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d3b4de30-4120-4f97-8734-a92b0b62bd9c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:02.746512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3b4de30-4120-4f97-8734-a92b0b62bd9c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:02.746512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3b4de30-4120-4f97-8734-a92b0b62bd9c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:02.746686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3b4de30-4120-4f97-8734-a92b0b62bd9c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:02.747940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3b4de30-4120-4f97-8734-a92b0b62bd9c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:02.747940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3b4de30-4120-4f97-8734-a92b0b62bd9c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:02.748262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3b4de30-4120-4f97-8734-a92b0b62bd9c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:02.938636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3b4de30-4120-4f97-8734-a92b0b62bd9c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:02.960386 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d3b4de30-4120-4f97-8734-a92b0b62bd9c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.226550 Aug 27 04:35:02.961374 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 429/859] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:02 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:03.150506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8f75e161-4519-4225-bd40-a3370073f19e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:03.161093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29795b6b-ad5e-4972-a06c-7a225ade2dc7 tempest-FlavorsV255TestJSON-959790900 tempest-FlavorsV255TestJSON-959790900-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-895626276", "id": 988822652, "os-flavor-access:is_public": "True"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:03.174188 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8f75e161-4519-4225-bd40-a3370073f19e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1322 microversion: 2.1 time: 1.252762 Aug 27 04:35:03.175120 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 431/860] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:01 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1322 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:03.197606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8caf724f-ebb3-4251-a23b-ecb8c4945894 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:03.198450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8caf724f-ebb3-4251-a23b-ecb8c4945894 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:03.212799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8caf724f-ebb3-4251-a23b-ecb8c4945894 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:03.213457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8caf724f-ebb3-4251-a23b-ecb8c4945894 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:03.213865 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29795b6b-ad5e-4972-a06c-7a225ade2dc7 tempest-FlavorsV255TestJSON-959790900 tempest-FlavorsV255TestJSON-959790900-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.250174 Aug 27 04:35:03.214416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8caf724f-ebb3-4251-a23b-ecb8c4945894 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:03.215394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8caf724f-ebb3-4251-a23b-ecb8c4945894 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:03.216156 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 430/861] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 04:35:02 2022] POST /compute/v2.1/flavors => generated 445 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:35:03.221277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8caf724f-ebb3-4251-a23b-ecb8c4945894 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:03.221984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8caf724f-ebb3-4251-a23b-ecb8c4945894 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:03.386374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-970f9dad-7c66-4aa8-82b0-86535b740f38 tempest-FlavorsV255TestJSON-1408985789 tempest-FlavorsV255TestJSON-1408985789-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:03.398959 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-970f9dad-7c66-4aa8-82b0-86535b740f38 tempest-FlavorsV255TestJSON-1408985789 tempest-FlavorsV255TestJSON-1408985789-project] 10.222.0.79 "GET /compute/v2.1/flavors/988822652" status: 200 len: 445 microversion: 2.55 time: 0.170706 Aug 27 04:35:03.400222 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 431/862] 10.222.0.79 () {60 vars in 1196 bytes} [Sat Aug 27 04:35:03 2022] GET /compute/v2.1/flavors/988822652 => generated 445 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:35:03.414724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90fdac95-4d84-4992-bcb6-a958522d67d1 tempest-FlavorsV255TestJSON-959790900 tempest-FlavorsV255TestJSON-959790900-project-admin] Action: 'update', calling method: .version_select at 0x7f1f2396e160>, body: {"flavor": {"description": "new"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:03.493437 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90fdac95-4d84-4992-bcb6-a958522d67d1 tempest-FlavorsV255TestJSON-959790900 tempest-FlavorsV255TestJSON-959790900-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/988822652" status: 200 len: 446 microversion: 2.55 time: 0.082388 Aug 27 04:35:03.494874 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 432/863] 10.222.0.79 () {62 vars in 1216 bytes} [Sat Aug 27 04:35:03 2022] PUT /compute/v2.1/flavors/988822652 => generated 446 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:35:03.508902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6d8f3ca-ddae-45cc-a654-b988a3c82f76 tempest-FlavorsV255TestJSON-1408985789 tempest-FlavorsV255TestJSON-1408985789-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:03.562097 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6d8f3ca-ddae-45cc-a654-b988a3c82f76 tempest-FlavorsV255TestJSON-1408985789 tempest-FlavorsV255TestJSON-1408985789-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.057875 Aug 27 04:35:03.563739 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 433/864] 10.222.0.79 () {60 vars in 1187 bytes} [Sat Aug 27 04:35:03 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:35:03.575570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8caf724f-ebb3-4251-a23b-ecb8c4945894 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:03.598782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84a2a17a-1028-4f5e-9238-349b5aabff8c tempest-FlavorsV255TestJSON-1408985789 tempest-FlavorsV255TestJSON-1408985789-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:03.600293 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8caf724f-ebb3-4251-a23b-ecb8c4945894 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1316 microversion: 2.1 time: 0.410177 Aug 27 04:35:03.600916 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 432/865] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:03 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:03.619074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e1fd1252-a327-4d04-85d9-063025a9737b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:03.619727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e1fd1252-a327-4d04-85d9-063025a9737b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:03.639630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1fd1252-a327-4d04-85d9-063025a9737b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:03.644014 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-84a2a17a-1028-4f5e-9238-349b5aabff8c tempest-FlavorsV255TestJSON-1408985789 tempest-FlavorsV255TestJSON-1408985789-project] 10.222.0.79 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.056811 Aug 27 04:35:03.644915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1fd1252-a327-4d04-85d9-063025a9737b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:03.645603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1fd1252-a327-4d04-85d9-063025a9737b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:03.646694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1fd1252-a327-4d04-85d9-063025a9737b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:03.647344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1fd1252-a327-4d04-85d9-063025a9737b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:03.647962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1fd1252-a327-4d04-85d9-063025a9737b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:03.653616 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 434/866] 10.222.0.79 () {60 vars in 1166 bytes} [Sat Aug 27 04:35:03 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:03.666817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-266eddef-635b-4324-a458-db25410dbde8 tempest-FlavorsV255TestJSON-959790900 tempest-FlavorsV255TestJSON-959790900-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:03.696324 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-266eddef-635b-4324-a458-db25410dbde8 tempest-FlavorsV255TestJSON-959790900 tempest-FlavorsV255TestJSON-959790900-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/988822652" status: 202 len: 0 microversion: 2.55 time: 0.036352 Aug 27 04:35:03.701596 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 435/867] 10.222.0.79 () {60 vars in 1199 bytes} [Sat Aug 27 04:35:03 2022] DELETE /compute/v2.1/flavors/988822652 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:35:03.708489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1dd5dd16-82a1-4c27-b193-01bf31566ef7 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21b50d30>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:03.772938 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1dd5dd16-82a1-4c27-b193-01bf31566ef7 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.070050 Aug 27 04:35:03.779936 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 436/868] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:35:03 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:03.779936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fee208e4-5f98-4d43-a5da-dff991045948 tempest-FlavorsV255TestJSON-959790900 tempest-FlavorsV255TestJSON-959790900-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:03.812910 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fee208e4-5f98-4d43-a5da-dff991045948 tempest-FlavorsV255TestJSON-959790900 tempest-FlavorsV255TestJSON-959790900-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.037551 Aug 27 04:35:03.829967 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 437/869] 10.222.0.79 () {60 vars in 1187 bytes} [Sat Aug 27 04:35:03 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:03.836157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8790a2da-3269-47a6-9be5-84aebc7a1a8a req-4e50a63f-28a1-4ac9-a21b-b63444e6d400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5312348f-2393-47a9-a02f-c5747efc16ba", "name": "network-vif-plugged", "status": "completed", "tag": "3d2ce8ba-1ee0-472e-aac0-d92d75c607e8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:03.852921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8790a2da-3269-47a6-9be5-84aebc7a1a8a req-4e50a63f-28a1-4ac9-a21b-b63444e6d400 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:03.853403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8790a2da-3269-47a6-9be5-84aebc7a1a8a req-4e50a63f-28a1-4ac9-a21b-b63444e6d400 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:03.853879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8790a2da-3269-47a6-9be5-84aebc7a1a8a req-4e50a63f-28a1-4ac9-a21b-b63444e6d400 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:03.878055 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8790a2da-3269-47a6-9be5-84aebc7a1a8a req-4e50a63f-28a1-4ac9-a21b-b63444e6d400 service nova] Creating event network-vif-plugged:3d2ce8ba-1ee0-472e-aac0-d92d75c607e8 for instance 5312348f-2393-47a9-a02f-c5747efc16ba on n-h2-854823-1 Aug 27 04:35:03.885124 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8790a2da-3269-47a6-9be5-84aebc7a1a8a req-4e50a63f-28a1-4ac9-a21b-b63444e6d400 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053750 Aug 27 04:35:03.885917 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 438/870] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:03.985082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53665ec7-b2a1-48f4-9d6f-879d2095f913 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:03.986024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-53665ec7-b2a1-48f4-9d6f-879d2095f913 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:04.007511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e1fd1252-a327-4d04-85d9-063025a9737b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:04.014204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53665ec7-b2a1-48f4-9d6f-879d2095f913 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:04.015230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53665ec7-b2a1-48f4-9d6f-879d2095f913 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:04.015702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53665ec7-b2a1-48f4-9d6f-879d2095f913 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:04.017607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53665ec7-b2a1-48f4-9d6f-879d2095f913 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:04.019766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53665ec7-b2a1-48f4-9d6f-879d2095f913 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:04.020223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53665ec7-b2a1-48f4-9d6f-879d2095f913 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:04.028587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e1fd1252-a327-4d04-85d9-063025a9737b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:04.030654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e1fd1252-a327-4d04-85d9-063025a9737b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:04.034205 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e1fd1252-a327-4d04-85d9-063025a9737b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1361 microversion: 2.25 time: 0.430312 Aug 27 04:35:04.035327 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 433/871] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:03 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1361 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:04.204403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-749cf054-ccb8-44ee-9b4c-4d8be2c5e29e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:04.205443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-749cf054-ccb8-44ee-9b4c-4d8be2c5e29e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:04.220182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-749cf054-ccb8-44ee-9b4c-4d8be2c5e29e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:04.225112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-749cf054-ccb8-44ee-9b4c-4d8be2c5e29e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:04.225902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-749cf054-ccb8-44ee-9b4c-4d8be2c5e29e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:04.227447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-749cf054-ccb8-44ee-9b4c-4d8be2c5e29e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:04.229154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-749cf054-ccb8-44ee-9b4c-4d8be2c5e29e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:04.234260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-749cf054-ccb8-44ee-9b4c-4d8be2c5e29e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:04.259312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-53665ec7-b2a1-48f4-9d6f-879d2095f913 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:04.273987 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-53665ec7-b2a1-48f4-9d6f-879d2095f913 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.293871 Aug 27 04:35:04.277798 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 439/872] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:03 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:04.437514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-749cf054-ccb8-44ee-9b4c-4d8be2c5e29e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:04.447057 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-749cf054-ccb8-44ee-9b4c-4d8be2c5e29e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1322 microversion: 2.1 time: 0.247997 Aug 27 04:35:04.447890 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 434/873] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:04 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:04.650739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c6e9652a-df11-4b91-bd0e-4434ea6f9d31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:04.651547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c6e9652a-df11-4b91-bd0e-4434ea6f9d31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:04.664714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6e9652a-df11-4b91-bd0e-4434ea6f9d31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:04.665598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6e9652a-df11-4b91-bd0e-4434ea6f9d31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:04.666637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6e9652a-df11-4b91-bd0e-4434ea6f9d31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:04.667826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6e9652a-df11-4b91-bd0e-4434ea6f9d31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:04.668671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6e9652a-df11-4b91-bd0e-4434ea6f9d31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:04.669237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6e9652a-df11-4b91-bd0e-4434ea6f9d31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:04.792895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-74d80465-0412-41ab-951d-d169df1f1780 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f22099670>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:04.847283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:04.894141 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-74d80465-0412-41ab-951d-d169df1f1780 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.110736 Aug 27 04:35:04.895713 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 435/874] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:35:04 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:04.916013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c6e9652a-df11-4b91-bd0e-4434ea6f9d31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:04.927792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=22 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:04.931618 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c6e9652a-df11-4b91-bd0e-4434ea6f9d31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1316 microversion: 2.1 time: 0.309518 Aug 27 04:35:04.932898 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 440/875] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:04 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:04.937570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-39d7b306-6955-484b-8df8-007a020bff94 req-b08ae30b-2c20-43c7-9c92-cf738dd59f79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993886de-4066-4da7-9768-ad92fdea6cc2", "tag": "fe518eb7-32a5-415b-a705-ace010eb9348"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:04.960969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-39d7b306-6955-484b-8df8-007a020bff94 req-b08ae30b-2c20-43c7-9c92-cf738dd59f79 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:04.961882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-39d7b306-6955-484b-8df8-007a020bff94 req-b08ae30b-2c20-43c7-9c92-cf738dd59f79 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:04.962947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-39d7b306-6955-484b-8df8-007a020bff94 req-b08ae30b-2c20-43c7-9c92-cf738dd59f79 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:04.979572 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-39d7b306-6955-484b-8df8-007a020bff94 req-b08ae30b-2c20-43c7-9c92-cf738dd59f79 service nova] Creating event network-changed:fe518eb7-32a5-415b-a705-ace010eb9348 for instance 993886de-4066-4da7-9768-ad92fdea6cc2 on n-h1-854823-1 Aug 27 04:35:04.990864 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-39d7b306-6955-484b-8df8-007a020bff94 req-b08ae30b-2c20-43c7-9c92-cf738dd59f79 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062877 Aug 27 04:35:04.992069 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 436/876] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:05.068907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7341d0c-bffc-4657-9400-2c4c6fcb29c8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:05.069573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7341d0c-bffc-4657-9400-2c4c6fcb29c8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:05.076562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7341d0c-bffc-4657-9400-2c4c6fcb29c8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:05.078004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7341d0c-bffc-4657-9400-2c4c6fcb29c8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:05.078447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7341d0c-bffc-4657-9400-2c4c6fcb29c8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:05.079156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7341d0c-bffc-4657-9400-2c4c6fcb29c8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:05.079607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7341d0c-bffc-4657-9400-2c4c6fcb29c8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:05.080023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7341d0c-bffc-4657-9400-2c4c6fcb29c8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:05.100584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:05.290983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7341d0c-bffc-4657-9400-2c4c6fcb29c8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:05.299642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9b82a8af-0a90-4c5b-9454-fdde5532651e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:05.301033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9b82a8af-0a90-4c5b-9454-fdde5532651e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:05.301870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7341d0c-bffc-4657-9400-2c4c6fcb29c8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:05.303616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7341d0c-bffc-4657-9400-2c4c6fcb29c8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:05.306059 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7341d0c-bffc-4657-9400-2c4c6fcb29c8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1361 microversion: 2.25 time: 0.241748 Aug 27 04:35:05.314706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b82a8af-0a90-4c5b-9454-fdde5532651e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:05.315211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b82a8af-0a90-4c5b-9454-fdde5532651e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:05.315651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b82a8af-0a90-4c5b-9454-fdde5532651e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:05.316918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b82a8af-0a90-4c5b-9454-fdde5532651e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:05.318634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b82a8af-0a90-4c5b-9454-fdde5532651e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:05.319109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b82a8af-0a90-4c5b-9454-fdde5532651e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:05.323693 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 441/877] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:05 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:05.341087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:05.469882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e336180e-52a5-48fd-b56d-c6ff6b6161a2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:05.470412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e336180e-52a5-48fd-b56d-c6ff6b6161a2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:05.485991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:05.489052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e336180e-52a5-48fd-b56d-c6ff6b6161a2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:05.489916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e336180e-52a5-48fd-b56d-c6ff6b6161a2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:05.490537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e336180e-52a5-48fd-b56d-c6ff6b6161a2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:05.491420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e336180e-52a5-48fd-b56d-c6ff6b6161a2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:05.492061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e336180e-52a5-48fd-b56d-c6ff6b6161a2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:05.493249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e336180e-52a5-48fd-b56d-c6ff6b6161a2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:05.600190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9b82a8af-0a90-4c5b-9454-fdde5532651e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:05.611399 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9b82a8af-0a90-4c5b-9454-fdde5532651e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.315719 Aug 27 04:35:05.612711 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 437/878] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:05 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:05.767803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e336180e-52a5-48fd-b56d-c6ff6b6161a2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:05.784004 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e336180e-52a5-48fd-b56d-c6ff6b6161a2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1322 microversion: 2.1 time: 0.318121 Aug 27 04:35:05.788838 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 442/879] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:05 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:05.909749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c4aab2b2-33a9-4ed0-90c6-4224eb840adf tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f22031b80>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:05.956569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4631d17e-22d4-48a0-a328-f6edb80ff40f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:05.958083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4631d17e-22d4-48a0-a328-f6edb80ff40f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:05.960723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=6,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:05.968230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4631d17e-22d4-48a0-a328-f6edb80ff40f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:05.969567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4631d17e-22d4-48a0-a328-f6edb80ff40f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:05.971148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4631d17e-22d4-48a0-a328-f6edb80ff40f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:05.972246 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c4aab2b2-33a9-4ed0-90c6-4224eb840adf tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.066229 Aug 27 04:35:05.973367 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 438/880] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:35:05 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:05.976696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4631d17e-22d4-48a0-a328-f6edb80ff40f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:05.977460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4631d17e-22d4-48a0-a328-f6edb80ff40f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:05.979311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4631d17e-22d4-48a0-a328-f6edb80ff40f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:06.163286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4631d17e-22d4-48a0-a328-f6edb80ff40f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:06.176580 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4631d17e-22d4-48a0-a328-f6edb80ff40f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1466 microversion: 2.1 time: 0.221612 Aug 27 04:35:06.176580 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 443/881] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:05 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1466 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:06.196258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d63bf116-4302-48d6-af43-9c55fa7d6332 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:06.197073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d63bf116-4302-48d6-af43-9c55fa7d6332 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:06.203466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d63bf116-4302-48d6-af43-9c55fa7d6332 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:06.203958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d63bf116-4302-48d6-af43-9c55fa7d6332 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:06.204390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d63bf116-4302-48d6-af43-9c55fa7d6332 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:06.205185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d63bf116-4302-48d6-af43-9c55fa7d6332 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:06.205643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d63bf116-4302-48d6-af43-9c55fa7d6332 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:06.206065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d63bf116-4302-48d6-af43-9c55fa7d6332 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:06.331588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c1aad23-d39f-45ea-8dc8-45fe055b0434 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:06.332313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c1aad23-d39f-45ea-8dc8-45fe055b0434 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:06.339589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c1aad23-d39f-45ea-8dc8-45fe055b0434 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:06.340326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c1aad23-d39f-45ea-8dc8-45fe055b0434 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:06.345049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c1aad23-d39f-45ea-8dc8-45fe055b0434 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:06.346012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c1aad23-d39f-45ea-8dc8-45fe055b0434 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:06.346538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c1aad23-d39f-45ea-8dc8-45fe055b0434 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:06.347038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c1aad23-d39f-45ea-8dc8-45fe055b0434 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:06.367712 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d63bf116-4302-48d6-af43-9c55fa7d6332 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1617 microversion: 2.1 time: 0.175215 Aug 27 04:35:06.373143 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 439/882] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:06 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1617 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:06.542976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c1aad23-d39f-45ea-8dc8-45fe055b0434 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:06.560356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c1aad23-d39f-45ea-8dc8-45fe055b0434 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:06.562566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-400352634", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f5b4d765-c03c-44a6-8346-c3bfd70f997b"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:06.563147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c1aad23-d39f-45ea-8dc8-45fe055b0434 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:06.564302 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c1aad23-d39f-45ea-8dc8-45fe055b0434 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1361 microversion: 2.25 time: 0.237500 Aug 27 04:35:06.586111 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 444/883] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:06 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:06.630081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:35:06.635941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1770d02-9b67-4b10-85a7-649dc9cb7a1a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:06.636811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c1770d02-9b67-4b10-85a7-649dc9cb7a1a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:06.644245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1770d02-9b67-4b10-85a7-649dc9cb7a1a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:06.645384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1770d02-9b67-4b10-85a7-649dc9cb7a1a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:06.646085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1770d02-9b67-4b10-85a7-649dc9cb7a1a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:06.646848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1770d02-9b67-4b10-85a7-649dc9cb7a1a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:06.647467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1770d02-9b67-4b10-85a7-649dc9cb7a1a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:06.648007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1770d02-9b67-4b10-85a7-649dc9cb7a1a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:06.835114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c1770d02-9b67-4b10-85a7-649dc9cb7a1a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:06.850078 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c1770d02-9b67-4b10-85a7-649dc9cb7a1a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.214890 Aug 27 04:35:06.850078 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 445/884] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:06 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:06.860392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da299bca-d269-4923-b338-e6dee6d3f75c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:06.861048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da299bca-d269-4923-b338-e6dee6d3f75c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:06.873590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da299bca-d269-4923-b338-e6dee6d3f75c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:06.874166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da299bca-d269-4923-b338-e6dee6d3f75c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:06.874619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da299bca-d269-4923-b338-e6dee6d3f75c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:06.875339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da299bca-d269-4923-b338-e6dee6d3f75c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:06.876062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da299bca-d269-4923-b338-e6dee6d3f75c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:06.880434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da299bca-d269-4923-b338-e6dee6d3f75c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:07.054827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da299bca-d269-4923-b338-e6dee6d3f75c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:07.066530 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da299bca-d269-4923-b338-e6dee6d3f75c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1322 microversion: 2.1 time: 0.215296 Aug 27 04:35:07.081489 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 446/885] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:06 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:07.101681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-213a979d-8a90-49d2-be95-6ce2221249ab tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21c2df70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:07.177571 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-213a979d-8a90-49d2-be95-6ce2221249ab tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1412 microversion: 2.1 time: 0.093230 Aug 27 04:35:07.178480 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 447/886] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:35:07 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:07.362925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:35:07.363602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:35:07.363854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:35:07.364272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:35:07.364721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:35:07.378375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:07.380590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:07.381471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:07.382730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:07.383513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:07.384126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:07.414403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for project d7dca616f36142eda0aa064091b0e7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:35:07.420421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Getting quotas for user cc8cb8eea83f45c1bb06328e31c960e7 and project d7dca616f36142eda0aa064091b0e7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:35:07.438034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:35:07.442836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:35:07.505709 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-18be5991-cc11-4c08-aa93-6fa179cd2628 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.948922 Aug 27 04:35:07.506350 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 440/887] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:35:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:35:07.518598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e30c062d-a1e2-4808-a445-d3b059cbddfe tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:07.520052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e30c062d-a1e2-4808-a445-d3b059cbddfe tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:07.593008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e3bcb9be-f373-488c-b089-9c9f57b4e2a6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:07.593626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e3bcb9be-f373-488c-b089-9c9f57b4e2a6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:07.602556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3bcb9be-f373-488c-b089-9c9f57b4e2a6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:07.603557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e30c062d-a1e2-4808-a445-d3b059cbddfe tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:07.606141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3bcb9be-f373-488c-b089-9c9f57b4e2a6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:07.607698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3bcb9be-f373-488c-b089-9c9f57b4e2a6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:07.609344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3bcb9be-f373-488c-b089-9c9f57b4e2a6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:07.611195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3bcb9be-f373-488c-b089-9c9f57b4e2a6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:07.612515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3bcb9be-f373-488c-b089-9c9f57b4e2a6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:07.614782 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e30c062d-a1e2-4808-a445-d3b059cbddfe tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1216 microversion: 2.1 time: 0.099377 Aug 27 04:35:07.618300 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 448/888] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:07 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1216 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:07.837741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e3bcb9be-f373-488c-b089-9c9f57b4e2a6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:07.849137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e3bcb9be-f373-488c-b089-9c9f57b4e2a6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:07.850896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e3bcb9be-f373-488c-b089-9c9f57b4e2a6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:07.853167 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e3bcb9be-f373-488c-b089-9c9f57b4e2a6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1361 microversion: 2.25 time: 0.264119 Aug 27 04:35:07.854463 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 441/889] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:07 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:35:07.875299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-91c1e070-3dd8-46c7-bdac-d665dc78be61 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:07.877263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-91c1e070-3dd8-46c7-bdac-d665dc78be61 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:07.883803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91c1e070-3dd8-46c7-bdac-d665dc78be61 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:07.884233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91c1e070-3dd8-46c7-bdac-d665dc78be61 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:07.884774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91c1e070-3dd8-46c7-bdac-d665dc78be61 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:07.885645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91c1e070-3dd8-46c7-bdac-d665dc78be61 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:07.886253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91c1e070-3dd8-46c7-bdac-d665dc78be61 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:07.886826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91c1e070-3dd8-46c7-bdac-d665dc78be61 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.065618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-91c1e070-3dd8-46c7-bdac-d665dc78be61 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:08.070840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb44368a-4104-4e2b-9f1d-add38ce854b5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Calling method '.version_select at 0x7f1f21dd74c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.077010 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-91c1e070-3dd8-46c7-bdac-d665dc78be61 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.205451 Aug 27 04:35:08.077591 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 442/890] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:07 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:08.087005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb44368a-4104-4e2b-9f1d-add38ce854b5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.087675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb44368a-4104-4e2b-9f1d-add38ce854b5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.088126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb44368a-4104-4e2b-9f1d-add38ce854b5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.093324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3b5cc46d-1bad-47d2-8a03-cc1d8ed07cbe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.094168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3b5cc46d-1bad-47d2-8a03-cc1d8ed07cbe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:08.101337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b5cc46d-1bad-47d2-8a03-cc1d8ed07cbe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.102112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b5cc46d-1bad-47d2-8a03-cc1d8ed07cbe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.102558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b5cc46d-1bad-47d2-8a03-cc1d8ed07cbe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.103310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b5cc46d-1bad-47d2-8a03-cc1d8ed07cbe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.103774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b5cc46d-1bad-47d2-8a03-cc1d8ed07cbe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.104205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b5cc46d-1bad-47d2-8a03-cc1d8ed07cbe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.105459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb44368a-4104-4e2b-9f1d-add38ce854b5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.105952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb44368a-4104-4e2b-9f1d-add38ce854b5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.106386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb44368a-4104-4e2b-9f1d-add38ce854b5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.117338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb44368a-4104-4e2b-9f1d-add38ce854b5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.117824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb44368a-4104-4e2b-9f1d-add38ce854b5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.118258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb44368a-4104-4e2b-9f1d-add38ce854b5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.124220 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cb44368a-4104-4e2b-9f1d-add38ce854b5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.254366 Aug 27 04:35:08.125143 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 449/891] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:35:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:08.137210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d12d070-b111-46b2-ae25-a9aea6dd77d3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Calling method '.version_select at 0x7f1f21d49dc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.139255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d12d070-b111-46b2-ae25-a9aea6dd77d3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.140142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d12d070-b111-46b2-ae25-a9aea6dd77d3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.140631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d12d070-b111-46b2-ae25-a9aea6dd77d3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.156433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d12d070-b111-46b2-ae25-a9aea6dd77d3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.156973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d12d070-b111-46b2-ae25-a9aea6dd77d3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.157404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d12d070-b111-46b2-ae25-a9aea6dd77d3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.168170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d12d070-b111-46b2-ae25-a9aea6dd77d3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.168688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d12d070-b111-46b2-ae25-a9aea6dd77d3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.169120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d12d070-b111-46b2-ae25-a9aea6dd77d3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.176134 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d12d070-b111-46b2-ae25-a9aea6dd77d3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.042094 Aug 27 04:35:08.177596 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 450/892] 10.222.0.79 () {58 vars in 1167 bytes} [Sat Aug 27 04:35:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:08.192750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4657c61a-354d-450a-8812-b0304cf4ea13 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Calling method '.version_select at 0x7f1f21c2d820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.194581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657c61a-354d-450a-8812-b0304cf4ea13 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.195063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657c61a-354d-450a-8812-b0304cf4ea13 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.195495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657c61a-354d-450a-8812-b0304cf4ea13 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.209665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657c61a-354d-450a-8812-b0304cf4ea13 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.210151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657c61a-354d-450a-8812-b0304cf4ea13 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.210567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657c61a-354d-450a-8812-b0304cf4ea13 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.221717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657c61a-354d-450a-8812-b0304cf4ea13 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.222244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657c61a-354d-450a-8812-b0304cf4ea13 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.222709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657c61a-354d-450a-8812-b0304cf4ea13 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.228800 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4657c61a-354d-450a-8812-b0304cf4ea13 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.040757 Aug 27 04:35:08.229414 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 451/893] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:35:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:08.237925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7c16a92-cd18-4c23-9c4e-3bb14e0bb613 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21b12dc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.247860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3b5cc46d-1bad-47d2-8a03-cc1d8ed07cbe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:08.256917 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3b5cc46d-1bad-47d2-8a03-cc1d8ed07cbe tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1322 microversion: 2.1 time: 0.168477 Aug 27 04:35:08.257588 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 443/894] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:08 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:08.262018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7d51c88a-32cc-49d7-a5cc-e73d3a5de8c3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Calling method '.version_select at 0x7f1f22081ee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.264088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d51c88a-32cc-49d7-a5cc-e73d3a5de8c3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.264751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d51c88a-32cc-49d7-a5cc-e73d3a5de8c3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.265200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d51c88a-32cc-49d7-a5cc-e73d3a5de8c3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.283179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d51c88a-32cc-49d7-a5cc-e73d3a5de8c3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.283617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d51c88a-32cc-49d7-a5cc-e73d3a5de8c3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.284168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d51c88a-32cc-49d7-a5cc-e73d3a5de8c3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.289387 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7c16a92-cd18-4c23-9c4e-3bb14e0bb613 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1421 microversion: 2.1 time: 0.055947 Aug 27 04:35:08.290115 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 452/895] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:35:08 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1421 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:08.292177 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7d51c88a-32cc-49d7-a5cc-e73d3a5de8c3 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.033275 Aug 27 04:35:08.292881 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 444/896] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:35:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:08.305281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-17c60032-589a-400f-a975-672bc349c78f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21fc9940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.309097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6f950a8c-6c0c-4080-bb86-8a866d1fdd44 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Calling method '.version_select at 0x7f1f22045ee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.312740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f950a8c-6c0c-4080-bb86-8a866d1fdd44 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.313307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f950a8c-6c0c-4080-bb86-8a866d1fdd44 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.313704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f950a8c-6c0c-4080-bb86-8a866d1fdd44 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.330297 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6f950a8c-6c0c-4080-bb86-8a866d1fdd44 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.025120 Aug 27 04:35:08.330905 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 445/897] 10.222.0.79 () {58 vars in 1179 bytes} [Sat Aug 27 04:35:08 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:08.342307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d754937b-d9f9-45da-8c96-35054e25c812 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Calling method '.version_select at 0x7f1f223b6550>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.344112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d754937b-d9f9-45da-8c96-35054e25c812 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.344649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d754937b-d9f9-45da-8c96-35054e25c812 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.345116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d754937b-d9f9-45da-8c96-35054e25c812 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.351083 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-17c60032-589a-400f-a975-672bc349c78f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 200 len: 1421 microversion: 2.1 time: 0.050613 Aug 27 04:35:08.351641 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 453/898] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:35:08 2022] GET /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 1421 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:08.359326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d754937b-d9f9-45da-8c96-35054e25c812 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.359816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d754937b-d9f9-45da-8c96-35054e25c812 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.360254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d754937b-d9f9-45da-8c96-35054e25c812 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.365286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-51f25d34-0ebf-4078-9907-f9bfc2f72444 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21c2d700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.370954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d754937b-d9f9-45da-8c96-35054e25c812 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.371433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d754937b-d9f9-45da-8c96-35054e25c812 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.371943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d754937b-d9f9-45da-8c96-35054e25c812 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.377905 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d754937b-d9f9-45da-8c96-35054e25c812 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.039148 Aug 27 04:35:08.383727 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 446/899] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:35:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:08.388255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6da646b2-9c1c-4ab6-9e86-5d9246222ba6 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Calling method '.version_select at 0x7f1f22104040>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.390091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6da646b2-9c1c-4ab6-9e86-5d9246222ba6 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.390661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6da646b2-9c1c-4ab6-9e86-5d9246222ba6 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.391036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6da646b2-9c1c-4ab6-9e86-5d9246222ba6 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.405793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6da646b2-9c1c-4ab6-9e86-5d9246222ba6 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.405793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6da646b2-9c1c-4ab6-9e86-5d9246222ba6 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.406218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6da646b2-9c1c-4ab6-9e86-5d9246222ba6 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.412803 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6da646b2-9c1c-4ab6-9e86-5d9246222ba6 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.027927 Aug 27 04:35:08.413389 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 447/900] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:35:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:08.426923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7e01a2a3-910c-4054-9638-d72bbe7b51e5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Calling method '.version_select at 0x7f1f221040d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.428751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e01a2a3-910c-4054-9638-d72bbe7b51e5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.429235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e01a2a3-910c-4054-9638-d72bbe7b51e5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.429677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e01a2a3-910c-4054-9638-d72bbe7b51e5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.442640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e01a2a3-910c-4054-9638-d72bbe7b51e5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.443121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e01a2a3-910c-4054-9638-d72bbe7b51e5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.443555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e01a2a3-910c-4054-9638-d72bbe7b51e5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.449853 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7e01a2a3-910c-4054-9638-d72bbe7b51e5 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.027042 Aug 27 04:35:08.450464 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 448/901] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:35:08 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:08.463750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d11f5654-02a2-4961-bd0c-36c81b6326e9 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Calling method '.version_select at 0x7f1f22081af0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.465596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d11f5654-02a2-4961-bd0c-36c81b6326e9 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.466078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d11f5654-02a2-4961-bd0c-36c81b6326e9 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.466507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d11f5654-02a2-4961-bd0c-36c81b6326e9 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.479143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d11f5654-02a2-4961-bd0c-36c81b6326e9 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.479635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d11f5654-02a2-4961-bd0c-36c81b6326e9 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.480068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d11f5654-02a2-4961-bd0c-36c81b6326e9 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.490434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d11f5654-02a2-4961-bd0c-36c81b6326e9 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.490888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d11f5654-02a2-4961-bd0c-36c81b6326e9 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.491356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d11f5654-02a2-4961-bd0c-36c81b6326e9 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.516446 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d11f5654-02a2-4961-bd0c-36c81b6326e9 tempest-HypervisorAdminTestJSON-117536319 tempest-HypervisorAdminTestJSON-117536319-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.055858 Aug 27 04:35:08.517093 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 449/902] 10.222.0.79 () {58 vars in 1173 bytes} [Sat Aug 27 04:35:08 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:08.637664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d9d6cf90-785e-490d-a6e7-aa60865634d9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.638636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d9d6cf90-785e-490d-a6e7-aa60865634d9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:08.646898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9d6cf90-785e-490d-a6e7-aa60865634d9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.647467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9d6cf90-785e-490d-a6e7-aa60865634d9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.648233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9d6cf90-785e-490d-a6e7-aa60865634d9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.649108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9d6cf90-785e-490d-a6e7-aa60865634d9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.649637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9d6cf90-785e-490d-a6e7-aa60865634d9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.650134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9d6cf90-785e-490d-a6e7-aa60865634d9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.715267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d9d6cf90-785e-490d-a6e7-aa60865634d9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:08.724084 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d9d6cf90-785e-490d-a6e7-aa60865634d9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1220 microversion: 2.1 time: 0.090710 Aug 27 04:35:08.724694 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 450/903] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:08 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:08.877030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1fbb1e7d-798e-4eaa-895f-6a551cd78116 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.877793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1fbb1e7d-798e-4eaa-895f-6a551cd78116 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:08.885202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fbb1e7d-798e-4eaa-895f-6a551cd78116 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.886021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fbb1e7d-798e-4eaa-895f-6a551cd78116 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.886528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fbb1e7d-798e-4eaa-895f-6a551cd78116 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.887297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fbb1e7d-798e-4eaa-895f-6a551cd78116 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.887823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fbb1e7d-798e-4eaa-895f-6a551cd78116 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.888316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fbb1e7d-798e-4eaa-895f-6a551cd78116 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.958068 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-51f25d34-0ebf-4078-9907-f9bfc2f72444 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 204 len: 0 microversion: 2.1 time: 0.597038 Aug 27 04:35:08.958846 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 454/904] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:08 2022] DELETE /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:35:08.967512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94e459a4-3b4e-44be-ab53-0ad2dadf2478 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.968270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94e459a4-3b4e-44be-ab53-0ad2dadf2478 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:08.975497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94e459a4-3b4e-44be-ab53-0ad2dadf2478 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.976067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94e459a4-3b4e-44be-ab53-0ad2dadf2478 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.976644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94e459a4-3b4e-44be-ab53-0ad2dadf2478 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:08.977408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94e459a4-3b4e-44be-ab53-0ad2dadf2478 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:08.977863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94e459a4-3b4e-44be-ab53-0ad2dadf2478 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:08.978284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94e459a4-3b4e-44be-ab53-0ad2dadf2478 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:09.013351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94e459a4-3b4e-44be-ab53-0ad2dadf2478 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:35:09.045538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1fbb1e7d-798e-4eaa-895f-6a551cd78116 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:09.056470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1fbb1e7d-798e-4eaa-895f-6a551cd78116 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:09.057965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1fbb1e7d-798e-4eaa-895f-6a551cd78116 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:09.059083 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1fbb1e7d-798e-4eaa-895f-6a551cd78116 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1361 microversion: 2.25 time: 0.187295 Aug 27 04:35:09.059644 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 451/905] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:08 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:35:09.097170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7659472-3946-4faa-a943-731a37cb6e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:09.098159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c7659472-3946-4faa-a943-731a37cb6e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:09.105290 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94e459a4-3b4e-44be-ab53-0ad2dadf2478 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9" status: 204 len: 0 microversion: 2.1 time: 0.141207 Aug 27 04:35:09.106116 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 455/906] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:35:08 2022] DELETE /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:35:09.109601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7659472-3946-4faa-a943-731a37cb6e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:09.110054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7659472-3946-4faa-a943-731a37cb6e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:09.112228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7659472-3946-4faa-a943-731a37cb6e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:09.113005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7659472-3946-4faa-a943-731a37cb6e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:09.115038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7659472-3946-4faa-a943-731a37cb6e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:09.115731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7659472-3946-4faa-a943-731a37cb6e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:09.241381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1223821991", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1a71fb22-9573-440e-a3b4-857cf66da6ea"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:09.305649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] validate_networks() for [('1a71fb22-9573-440e-a3b4-857cf66da6ea', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:35:09.469449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c7659472-3946-4faa-a943-731a37cb6e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:09.485322 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7659472-3946-4faa-a943-731a37cb6e97 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.391960 Aug 27 04:35:09.499688 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 452/907] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:09 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:09.499688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8d0e3de7-9a88-418d-93b3-70cd0e9d15c9 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:09.499688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8d0e3de7-9a88-418d-93b3-70cd0e9d15c9 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:09.507687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d0e3de7-9a88-418d-93b3-70cd0e9d15c9 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:09.508569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d0e3de7-9a88-418d-93b3-70cd0e9d15c9 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:09.509346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d0e3de7-9a88-418d-93b3-70cd0e9d15c9 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:09.510266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d0e3de7-9a88-418d-93b3-70cd0e9d15c9 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:09.510914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d0e3de7-9a88-418d-93b3-70cd0e9d15c9 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:09.511679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d0e3de7-9a88-418d-93b3-70cd0e9d15c9 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:09.677551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8d0e3de7-9a88-418d-93b3-70cd0e9d15c9 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:09.686445 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8d0e3de7-9a88-418d-93b3-70cd0e9d15c9 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1322 microversion: 2.1 time: 0.198403 Aug 27 04:35:09.687008 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 453/908] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:09 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:09.691525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-f233c600-45f5-493e-8810-ea443c7b2583 req-25de4e05-f6a4-4910-a2de-e97cf1f0f7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b24aa3a-1603-40d1-a619-bc29521e61eb", "name": "network-vif-plugged", "status": "completed", "tag": "ced761b5-a492-4017-af6f-bc2b52bc544d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:09.700773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f233c600-45f5-493e-8810-ea443c7b2583 req-25de4e05-f6a4-4910-a2de-e97cf1f0f7b5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:09.701256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f233c600-45f5-493e-8810-ea443c7b2583 req-25de4e05-f6a4-4910-a2de-e97cf1f0f7b5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:09.701712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f233c600-45f5-493e-8810-ea443c7b2583 req-25de4e05-f6a4-4910-a2de-e97cf1f0f7b5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:09.713722 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f233c600-45f5-493e-8810-ea443c7b2583 req-25de4e05-f6a4-4910-a2de-e97cf1f0f7b5 service nova] Creating event network-vif-plugged:ced761b5-a492-4017-af6f-bc2b52bc544d for instance 7b24aa3a-1603-40d1-a619-bc29521e61eb on n-h1-854823-1 Aug 27 04:35:09.719968 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-f233c600-45f5-493e-8810-ea443c7b2583 req-25de4e05-f6a4-4910-a2de-e97cf1f0f7b5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031754 Aug 27 04:35:09.720741 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 454/909] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:09.745915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-69dc84c2-433d-4f9e-a4f1-c30fe863918b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:09.746599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-69dc84c2-433d-4f9e-a4f1-c30fe863918b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:09.753256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69dc84c2-433d-4f9e-a4f1-c30fe863918b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:09.753986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69dc84c2-433d-4f9e-a4f1-c30fe863918b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:09.754554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69dc84c2-433d-4f9e-a4f1-c30fe863918b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:09.755281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69dc84c2-433d-4f9e-a4f1-c30fe863918b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:09.755745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69dc84c2-433d-4f9e-a4f1-c30fe863918b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:09.756169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69dc84c2-433d-4f9e-a4f1-c30fe863918b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:09.824088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-69dc84c2-433d-4f9e-a4f1-c30fe863918b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:09.832748 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-69dc84c2-433d-4f9e-a4f1-c30fe863918b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1220 microversion: 2.1 time: 0.090407 Aug 27 04:35:09.833620 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 455/910] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:09 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:09.884566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:35:09.885054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:35:09.885595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:35:09.886104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:35:09.886513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:35:09.896411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:09.896968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:09.897390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:09.898146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:09.898601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:09.899029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:09.917281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Getting quotas for project 67b207b502d846718f9d72f62d1d034c. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:35:09.922776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Getting quotas for user daa3b03c362d4032bd17ebfeccdcdb83 and project 67b207b502d846718f9d72f62d1d034c. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:35:09.935321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:35:09.938297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:35:09.990898 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d354ba6-1e9c-45f1-a654-f2acccd22c98 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753626 Aug 27 04:35:09.992182 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 456/911] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:35:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:35:10.003306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2de1cb38-706a-459e-be9c-b928b786ce84 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:10.004641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2de1cb38-706a-459e-be9c-b928b786ce84 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:10.061327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2de1cb38-706a-459e-be9c-b928b786ce84 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:10.079013 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2de1cb38-706a-459e-be9c-b928b786ce84 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1208 microversion: 2.1 time: 0.078537 Aug 27 04:35:10.079901 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 456/912] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:09 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1208 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:10.092510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57fce246-c512-430f-bc7f-02b233739eab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:10.092510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57fce246-c512-430f-bc7f-02b233739eab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:10.106035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57fce246-c512-430f-bc7f-02b233739eab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:10.106629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57fce246-c512-430f-bc7f-02b233739eab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:10.106948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57fce246-c512-430f-bc7f-02b233739eab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:10.107664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57fce246-c512-430f-bc7f-02b233739eab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:10.108120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57fce246-c512-430f-bc7f-02b233739eab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:10.108746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57fce246-c512-430f-bc7f-02b233739eab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:10.257784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57fce246-c512-430f-bc7f-02b233739eab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:10.268093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57fce246-c512-430f-bc7f-02b233739eab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:10.269909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57fce246-c512-430f-bc7f-02b233739eab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:10.271034 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57fce246-c512-430f-bc7f-02b233739eab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1361 microversion: 2.25 time: 0.192700 Aug 27 04:35:10.273866 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 457/913] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:10 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:35:10.509585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-38c5aec9-d25e-4194-a975-44bb879df47d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:10.510566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-38c5aec9-d25e-4194-a975-44bb879df47d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:10.518642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38c5aec9-d25e-4194-a975-44bb879df47d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:10.520263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38c5aec9-d25e-4194-a975-44bb879df47d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:10.521070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38c5aec9-d25e-4194-a975-44bb879df47d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:10.521978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38c5aec9-d25e-4194-a975-44bb879df47d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:10.522642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38c5aec9-d25e-4194-a975-44bb879df47d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:10.523260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38c5aec9-d25e-4194-a975-44bb879df47d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:10.708154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-baf0a073-7efe-4648-8b2a-34165b37c16b tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:10.709119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-baf0a073-7efe-4648-8b2a-34165b37c16b tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:10.716161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-baf0a073-7efe-4648-8b2a-34165b37c16b tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:10.716913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-baf0a073-7efe-4648-8b2a-34165b37c16b tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:10.717668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-baf0a073-7efe-4648-8b2a-34165b37c16b tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:10.718897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-baf0a073-7efe-4648-8b2a-34165b37c16b tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:10.719512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-baf0a073-7efe-4648-8b2a-34165b37c16b tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:10.720949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-baf0a073-7efe-4648-8b2a-34165b37c16b tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:10.834882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-38c5aec9-d25e-4194-a975-44bb879df47d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:10.844641 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-38c5aec9-d25e-4194-a975-44bb879df47d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.339191 Aug 27 04:35:10.845395 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 457/914] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:10 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:10.858923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-96bf8acb-fae6-4869-9a32-f04d569f92b8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:10.859658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-96bf8acb-fae6-4869-9a32-f04d569f92b8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:10.866780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96bf8acb-fae6-4869-9a32-f04d569f92b8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:10.867379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96bf8acb-fae6-4869-9a32-f04d569f92b8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:10.867820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96bf8acb-fae6-4869-9a32-f04d569f92b8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:10.868557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96bf8acb-fae6-4869-9a32-f04d569f92b8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:10.869067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96bf8acb-fae6-4869-9a32-f04d569f92b8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:10.870137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96bf8acb-fae6-4869-9a32-f04d569f92b8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:10.913755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-baf0a073-7efe-4648-8b2a-34165b37c16b tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:10.935391 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-baf0a073-7efe-4648-8b2a-34165b37c16b tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1322 microversion: 2.1 time: 0.231981 Aug 27 04:35:10.949678 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 458/915] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:10 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:11.001465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-96bf8acb-fae6-4869-9a32-f04d569f92b8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:11.012663 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-96bf8acb-fae6-4869-9a32-f04d569f92b8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1268 microversion: 2.1 time: 0.162474 Aug 27 04:35:11.027730 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 458/916] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:10 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:11.107504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a71816c-175f-4a06-aff0-6d505545f830 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:11.109368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a71816c-175f-4a06-aff0-6d505545f830 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:11.121028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a71816c-175f-4a06-aff0-6d505545f830 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:11.122157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a71816c-175f-4a06-aff0-6d505545f830 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:11.123198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a71816c-175f-4a06-aff0-6d505545f830 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:11.124823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a71816c-175f-4a06-aff0-6d505545f830 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:11.126096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a71816c-175f-4a06-aff0-6d505545f830 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:11.127034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a71816c-175f-4a06-aff0-6d505545f830 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:11.249595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a71816c-175f-4a06-aff0-6d505545f830 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:11.266040 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a71816c-175f-4a06-aff0-6d505545f830 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1260 microversion: 2.1 time: 0.164707 Aug 27 04:35:11.282160 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 459/917] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:11 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:11.293957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f6c6107c-a5c0-4864-8a17-7b7f7a7c6113 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:11.304230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f6c6107c-a5c0-4864-8a17-7b7f7a7c6113 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:11.319956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6c6107c-a5c0-4864-8a17-7b7f7a7c6113 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:11.322463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6c6107c-a5c0-4864-8a17-7b7f7a7c6113 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:11.323360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6c6107c-a5c0-4864-8a17-7b7f7a7c6113 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:11.326244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6c6107c-a5c0-4864-8a17-7b7f7a7c6113 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:11.330471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6c6107c-a5c0-4864-8a17-7b7f7a7c6113 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:11.331066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6c6107c-a5c0-4864-8a17-7b7f7a7c6113 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:11.345084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:11.694479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f6c6107c-a5c0-4864-8a17-7b7f7a7c6113 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:11.708670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f6c6107c-a5c0-4864-8a17-7b7f7a7c6113 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:11.711905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f6c6107c-a5c0-4864-8a17-7b7f7a7c6113 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:11.715160 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f6c6107c-a5c0-4864-8a17-7b7f7a7c6113 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1361 microversion: 2.25 time: 0.423781 Aug 27 04:35:11.718315 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 459/918] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:11 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1361 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:11.856655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f4710a76-6124-4550-aa83-34896cc9e148 req-057f20fa-349a-4ad9-968c-dbaa8d769575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503a7b07-108a-45d6-937d-f9cd43ef66a9", "name": "network-vif-unplugged", "status": "completed", "tag": "f2ee1ea2-3d38-4835-832c-5a7d94cd01a8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:11.869433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0a49dce9-7013-4494-a69b-bfdf1d8e265c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:11.869782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f4710a76-6124-4550-aa83-34896cc9e148 req-057f20fa-349a-4ad9-968c-dbaa8d769575 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:11.870281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0a49dce9-7013-4494-a69b-bfdf1d8e265c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:11.879926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a49dce9-7013-4494-a69b-bfdf1d8e265c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:11.880793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a49dce9-7013-4494-a69b-bfdf1d8e265c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:11.881572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a49dce9-7013-4494-a69b-bfdf1d8e265c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:11.882868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a49dce9-7013-4494-a69b-bfdf1d8e265c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:11.883281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f4710a76-6124-4550-aa83-34896cc9e148 req-057f20fa-349a-4ad9-968c-dbaa8d769575 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:11.883803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f4710a76-6124-4550-aa83-34896cc9e148 req-057f20fa-349a-4ad9-968c-dbaa8d769575 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:11.884430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a49dce9-7013-4494-a69b-bfdf1d8e265c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:11.885257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a49dce9-7013-4494-a69b-bfdf1d8e265c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:11.922806 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f4710a76-6124-4550-aa83-34896cc9e148 req-057f20fa-349a-4ad9-968c-dbaa8d769575 service nova] Creating event network-vif-unplugged:f2ee1ea2-3d38-4835-832c-5a7d94cd01a8 for instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 on n-h2-854823-1 Aug 27 04:35:11.939054 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f4710a76-6124-4550-aa83-34896cc9e148 req-057f20fa-349a-4ad9-968c-dbaa8d769575 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086912 Aug 27 04:35:11.948277 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 460/919] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:11.962033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90ff6a7f-b95d-4dd7-914f-32bf18379f3e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:11.963100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90ff6a7f-b95d-4dd7-914f-32bf18379f3e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:11.971608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90ff6a7f-b95d-4dd7-914f-32bf18379f3e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:11.972982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90ff6a7f-b95d-4dd7-914f-32bf18379f3e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:11.974206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90ff6a7f-b95d-4dd7-914f-32bf18379f3e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:11.975315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90ff6a7f-b95d-4dd7-914f-32bf18379f3e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:11.975994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90ff6a7f-b95d-4dd7-914f-32bf18379f3e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:11.976945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90ff6a7f-b95d-4dd7-914f-32bf18379f3e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.266021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-90ff6a7f-b95d-4dd7-914f-32bf18379f3e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:12.266640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0a49dce9-7013-4494-a69b-bfdf1d8e265c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:12.277007 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90ff6a7f-b95d-4dd7-914f-32bf18379f3e tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1322 microversion: 2.1 time: 0.320934 Aug 27 04:35:12.277187 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0a49dce9-7013-4494-a69b-bfdf1d8e265c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.413509 Aug 27 04:35:12.278335 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 461/920] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:11 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:12.282049 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 460/921] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:11 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:12.284383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81113445-a378-4450-b5ae-d72970ae88be tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:12.285818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-81113445-a378-4450-b5ae-d72970ae88be tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:12.292149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81113445-a378-4450-b5ae-d72970ae88be tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.292706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81113445-a378-4450-b5ae-d72970ae88be tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.293711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81113445-a378-4450-b5ae-d72970ae88be tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.294935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81113445-a378-4450-b5ae-d72970ae88be tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.295717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81113445-a378-4450-b5ae-d72970ae88be tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.296364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81113445-a378-4450-b5ae-d72970ae88be tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.412305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-81113445-a378-4450-b5ae-d72970ae88be tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:12.423544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:12.447852 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-81113445-a378-4450-b5ae-d72970ae88be tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1268 microversion: 2.1 time: 0.168011 Aug 27 04:35:12.450151 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 462/922] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:12 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:12.464128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59227955-8ae9-43d2-8f68-d1a1b626e448 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:12.465050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59227955-8ae9-43d2-8f68-d1a1b626e448 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:12.483971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Calling method '.version_select at 0x7f1f223b6550>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:12.487563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59227955-8ae9-43d2-8f68-d1a1b626e448 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.489899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.490562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.490929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59227955-8ae9-43d2-8f68-d1a1b626e448 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.492400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.492975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59227955-8ae9-43d2-8f68-d1a1b626e448 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.493946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59227955-8ae9-43d2-8f68-d1a1b626e448 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.501805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59227955-8ae9-43d2-8f68-d1a1b626e448 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.502593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59227955-8ae9-43d2-8f68-d1a1b626e448 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.511842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.513016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.513617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.576277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.576839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.577313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.600580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.603871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.604664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.651878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-59227955-8ae9-43d2-8f68-d1a1b626e448 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:12.661893 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59227955-8ae9-43d2-8f68-d1a1b626e448 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1266 microversion: 2.1 time: 0.208688 Aug 27 04:35:12.668722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.669499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.669906 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 463/923] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:12 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:12.671180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.677931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-438aeae0-8b5a-44b9-a7df-dc4d1dedafab req-e008c8ba-3401-4b50-aa8a-8395b0e09594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503a7b07-108a-45d6-937d-f9cd43ef66a9", "name": "network-vif-deleted", "tag": "f2ee1ea2-3d38-4835-832c-5a7d94cd01a8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:12.686678 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5cd8a4f9-965b-4a48-942e-eccc6d2fc45f tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2940 microversion: 2.53 time: 0.403248 Aug 27 04:35:12.690374 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 461/924] 10.222.0.79 () {60 vars in 1243 bytes} [Sat Aug 27 04:35:12 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2940 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:12.703546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-438aeae0-8b5a-44b9-a7df-dc4d1dedafab req-e008c8ba-3401-4b50-aa8a-8395b0e09594 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.704035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-438aeae0-8b5a-44b9-a7df-dc4d1dedafab req-e008c8ba-3401-4b50-aa8a-8395b0e09594 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.704517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-438aeae0-8b5a-44b9-a7df-dc4d1dedafab req-e008c8ba-3401-4b50-aa8a-8395b0e09594 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.706882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Calling method '.version_select at 0x7f1f2228b5e0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:12.711661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.712489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.713333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.736744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.737821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.738401 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-438aeae0-8b5a-44b9-a7df-dc4d1dedafab req-e008c8ba-3401-4b50-aa8a-8395b0e09594 service nova] Creating event network-vif-deleted:f2ee1ea2-3d38-4835-832c-5a7d94cd01a8 for instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 on n-h2-854823-1 Aug 27 04:35:12.738948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.745689 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-438aeae0-8b5a-44b9-a7df-dc4d1dedafab req-e008c8ba-3401-4b50-aa8a-8395b0e09594 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074501 Aug 27 04:35:12.746316 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 464/925] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:12.757431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99e23df3-aa17-443c-ad27-3f7247aee512 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:12.758167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99e23df3-aa17-443c-ad27-3f7247aee512 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:12.767597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99e23df3-aa17-443c-ad27-3f7247aee512 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.768102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99e23df3-aa17-443c-ad27-3f7247aee512 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.768682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99e23df3-aa17-443c-ad27-3f7247aee512 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.769529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99e23df3-aa17-443c-ad27-3f7247aee512 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.769999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99e23df3-aa17-443c-ad27-3f7247aee512 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.770763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99e23df3-aa17-443c-ad27-3f7247aee512 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.789070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.789807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.790569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.804078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.804848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.805480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.852951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.853474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.853923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.860907 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7fa1e344-d371-49ff-8c8a-adf896959e8b tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1634 microversion: 2.53 time: 0.160145 Aug 27 04:35:12.861491 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 462/926] 10.222.0.79 () {60 vars in 1222 bytes} [Sat Aug 27 04:35:12 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1634 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:12.873960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-32b9e760-f186-4a08-af66-328f2dfa69a1 tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Calling method '.version_select at 0x7f1f2205dee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:12.878078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32b9e760-f186-4a08-af66-328f2dfa69a1 tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.879329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32b9e760-f186-4a08-af66-328f2dfa69a1 tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.879780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32b9e760-f186-4a08-af66-328f2dfa69a1 tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.896883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32b9e760-f186-4a08-af66-328f2dfa69a1 tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:12.897642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32b9e760-f186-4a08-af66-328f2dfa69a1 tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:12.898281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32b9e760-f186-4a08-af66-328f2dfa69a1 tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:12.905346 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-32b9e760-f186-4a08-af66-328f2dfa69a1 tempest-HypervisorAdminV253TestBase-2032713050 tempest-HypervisorAdminV253TestBase-2032713050-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/6ac06b4a-497f-4f7f-b675-fb9a435124df" status: 200 len: 791 microversion: 2.53 time: 0.035275 Aug 27 04:35:12.906102 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 463/927] 10.222.0.79 () {60 vars in 1298 bytes} [Sat Aug 27 04:35:12 2022] GET /compute/v2.1/os-hypervisors/6ac06b4a-497f-4f7f-b675-fb9a435124df => generated 791 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:35:13.148289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99e23df3-aa17-443c-ad27-3f7247aee512 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:13.158957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99e23df3-aa17-443c-ad27-3f7247aee512 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:13.161636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99e23df3-aa17-443c-ad27-3f7247aee512 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:13.162970 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99e23df3-aa17-443c-ad27-3f7247aee512 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1361 microversion: 2.25 time: 0.412122 Aug 27 04:35:13.163526 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 465/928] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:12 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1361 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:13.307373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ac1f2d7b-b794-48f9-8968-014e522d63de tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:13.308301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ac1f2d7b-b794-48f9-8968-014e522d63de tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:13.314870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d3ec77d7-dfa5-44a2-8d8f-1dd1d3668b90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:13.316722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d3ec77d7-dfa5-44a2-8d8f-1dd1d3668b90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:13.323128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac1f2d7b-b794-48f9-8968-014e522d63de tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:13.323627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac1f2d7b-b794-48f9-8968-014e522d63de tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:13.323893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ec77d7-dfa5-44a2-8d8f-1dd1d3668b90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:13.324225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac1f2d7b-b794-48f9-8968-014e522d63de tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:13.325246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac1f2d7b-b794-48f9-8968-014e522d63de tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:13.325896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac1f2d7b-b794-48f9-8968-014e522d63de tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:13.326555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac1f2d7b-b794-48f9-8968-014e522d63de tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:13.334254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ec77d7-dfa5-44a2-8d8f-1dd1d3668b90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:13.339732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ec77d7-dfa5-44a2-8d8f-1dd1d3668b90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:13.340671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ec77d7-dfa5-44a2-8d8f-1dd1d3668b90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:13.341244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ec77d7-dfa5-44a2-8d8f-1dd1d3668b90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:13.341925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ec77d7-dfa5-44a2-8d8f-1dd1d3668b90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:13.578840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac1f2d7b-b794-48f9-8968-014e522d63de tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:13.597169 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ac1f2d7b-b794-48f9-8968-014e522d63de tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1471 microversion: 2.1 time: 0.291027 Aug 27 04:35:13.598206 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 464/929] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:13 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1471 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:13.623194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ddc484c5-ba82-4224-90db-f82f930ee2f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:13.625974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ddc484c5-ba82-4224-90db-f82f930ee2f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:13.651841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:13.657067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddc484c5-ba82-4224-90db-f82f930ee2f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:13.657590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddc484c5-ba82-4224-90db-f82f930ee2f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:13.658043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddc484c5-ba82-4224-90db-f82f930ee2f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:13.658807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddc484c5-ba82-4224-90db-f82f930ee2f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:13.659268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddc484c5-ba82-4224-90db-f82f930ee2f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:13.664394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddc484c5-ba82-4224-90db-f82f930ee2f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:13.777380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3ec77d7-dfa5-44a2-8d8f-1dd1d3668b90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:13.787103 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d3ec77d7-dfa5-44a2-8d8f-1dd1d3668b90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.476236 Aug 27 04:35:13.787697 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 466/930] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:13 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:13.797584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8138d82a-4d85-4cdc-81fa-38c844b52b4c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:13.798469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8138d82a-4d85-4cdc-81fa-38c844b52b4c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:13.806317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8138d82a-4d85-4cdc-81fa-38c844b52b4c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:13.807439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8138d82a-4d85-4cdc-81fa-38c844b52b4c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:13.807883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8138d82a-4d85-4cdc-81fa-38c844b52b4c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:13.808628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8138d82a-4d85-4cdc-81fa-38c844b52b4c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:13.809362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8138d82a-4d85-4cdc-81fa-38c844b52b4c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:13.809810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8138d82a-4d85-4cdc-81fa-38c844b52b4c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:13.828469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ddc484c5-ba82-4224-90db-f82f930ee2f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:13.846028 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ddc484c5-ba82-4224-90db-f82f930ee2f8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1274 microversion: 2.1 time: 0.245955 Aug 27 04:35:13.847353 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 465/931] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:13 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1274 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:13.866779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a4bbf515-29a1-45e5-b553-7d3f49ea73a8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:13.867772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a4bbf515-29a1-45e5-b553-7d3f49ea73a8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:13.868404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8138d82a-4d85-4cdc-81fa-38c844b52b4c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:13.878232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4bbf515-29a1-45e5-b553-7d3f49ea73a8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:13.879472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4bbf515-29a1-45e5-b553-7d3f49ea73a8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:13.879921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4bbf515-29a1-45e5-b553-7d3f49ea73a8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:13.880656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4bbf515-29a1-45e5-b553-7d3f49ea73a8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:13.881116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4bbf515-29a1-45e5-b553-7d3f49ea73a8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:13.881541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4bbf515-29a1-45e5-b553-7d3f49ea73a8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8138d82a-4d85-4cdc-81fa-38c844b52b4c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Request method failure captured: Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb/diagnostics HTTP/1.1 Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ7nw4TslZlhYJcjyqmefHHatPt3u8wolXpBP3qle0n-GlkcckR_0ag9qh_D75E0n79vPwsY8OP1yPrPjeYaHAlstDIuGY0I9nnr5Bz2ofLxB4JyjvF_1XNxmQZEyXpZcYKDTMXxNo4VKvA5_IObQO_UEblMobqqDLP4f0zTIxEhYio Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 4885bb6c973a4e628d038f5e21461722 Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-392986572 Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:35:13.885438 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:35:13.886846 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4885bb6c973a4e628d038f5e21461722"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4885bb6c973a4e628d038f5e21461722"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4885bb6c973a4e628d038f5e21461722"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4885bb6c973a4e628d038f5e21461722"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:35:13.886846 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-392986572 Aug 27 04:35:13.886846 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 4885bb6c973a4e628d038f5e21461722 Aug 27 04:35:13.886846 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-392986572 Aug 27 04:35:13.886846 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerDiagnosticsNegativeTest-392986572-project Aug 27 04:35:13.886846 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:35:13.886846 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:35:13.886846 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 131b6d978c0d4fe0b4e6bb36b5d9d68d Aug 27 04:35:13.886846 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-392986572-project Aug 27 04:35:13.886846 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:35:13.886846 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'server_id': '7b24aa3a-1603-40d1-a619-bc29521e61eb'} Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:35:13.887566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 04:35:13.888813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:13.891907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8138d82a-4d85-4cdc-81fa-38c844b52b4c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:35:13.893169 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8138d82a-4d85-4cdc-81fa-38c844b52b4c tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.103902 Aug 27 04:35:13.894287 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 467/932] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:35:13 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb/diagnostics => generated 117 bytes in 106 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:35:13.906275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c2c8165-0461-43ba-8058-705d55f45aff tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:13.907061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c2c8165-0461-43ba-8058-705d55f45aff tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:13.924096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c2c8165-0461-43ba-8058-705d55f45aff tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:13.924935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c2c8165-0461-43ba-8058-705d55f45aff tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:13.926113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c2c8165-0461-43ba-8058-705d55f45aff tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:13.927050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c2c8165-0461-43ba-8058-705d55f45aff tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:13.927696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c2c8165-0461-43ba-8058-705d55f45aff tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:13.928312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c2c8165-0461-43ba-8058-705d55f45aff tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:13.959323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c2c8165-0461-43ba-8058-705d55f45aff tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:35:14.096860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a4bbf515-29a1-45e5-b553-7d3f49ea73a8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:14.103972 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c2c8165-0461-43ba-8058-705d55f45aff tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 204 len: 0 microversion: 2.1 time: 0.201401 Aug 27 04:35:14.106021 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 468/933] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:35:13 2022] DELETE /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:35:14.113864 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a4bbf515-29a1-45e5-b553-7d3f49ea73a8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1308 microversion: 2.1 time: 0.263624 Aug 27 04:35:14.115015 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 466/934] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:13 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1308 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:14.116378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-fe830e9e-c395-486e-a7aa-11b40ec17ed5 req-9f53b439-158e-43ca-bff3-2e42f304460d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993886de-4066-4da7-9768-ad92fdea6cc2", "name": "network-vif-plugged", "status": "completed", "tag": "fe518eb7-32a5-415b-a705-ace010eb9348"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:14.120826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5aafec48-6e4d-4797-a6f1-ba27b8d3c27a tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:14.121636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5aafec48-6e4d-4797-a6f1-ba27b8d3c27a tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:14.130591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5aafec48-6e4d-4797-a6f1-ba27b8d3c27a tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:14.131305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5aafec48-6e4d-4797-a6f1-ba27b8d3c27a tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:14.131758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5aafec48-6e4d-4797-a6f1-ba27b8d3c27a tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:14.132670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5aafec48-6e4d-4797-a6f1-ba27b8d3c27a tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:14.133150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5aafec48-6e4d-4797-a6f1-ba27b8d3c27a tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:14.133569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5aafec48-6e4d-4797-a6f1-ba27b8d3c27a tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:14.143724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fe830e9e-c395-486e-a7aa-11b40ec17ed5 req-9f53b439-158e-43ca-bff3-2e42f304460d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:14.145122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fe830e9e-c395-486e-a7aa-11b40ec17ed5 req-9f53b439-158e-43ca-bff3-2e42f304460d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:14.145785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fe830e9e-c395-486e-a7aa-11b40ec17ed5 req-9f53b439-158e-43ca-bff3-2e42f304460d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:14.159856 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-fe830e9e-c395-486e-a7aa-11b40ec17ed5 req-9f53b439-158e-43ca-bff3-2e42f304460d service nova] Creating event network-vif-plugged:fe518eb7-32a5-415b-a705-ace010eb9348 for instance 993886de-4066-4da7-9768-ad92fdea6cc2 on n-h1-854823-1 Aug 27 04:35:14.165627 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-fe830e9e-c395-486e-a7aa-11b40ec17ed5 req-9f53b439-158e-43ca-bff3-2e42f304460d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057966 Aug 27 04:35:14.170393 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 469/935] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:14.188652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5a534bd-f393-491b-a5c1-79b2736def51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:14.189690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5a534bd-f393-491b-a5c1-79b2736def51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:14.197925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5a534bd-f393-491b-a5c1-79b2736def51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:14.198586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5a534bd-f393-491b-a5c1-79b2736def51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:14.199263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5a534bd-f393-491b-a5c1-79b2736def51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:14.200231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5a534bd-f393-491b-a5c1-79b2736def51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:14.200935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5a534bd-f393-491b-a5c1-79b2736def51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:14.201576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5a534bd-f393-491b-a5c1-79b2736def51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:14.316663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5aafec48-6e4d-4797-a6f1-ba27b8d3c27a tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:14.330577 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5aafec48-6e4d-4797-a6f1-ba27b8d3c27a tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1477 microversion: 2.1 time: 0.213617 Aug 27 04:35:14.332777 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 467/936] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:14 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1477 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:14.807712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bddf1ab8-ef0e-42f1-b40b-2eade0d2f452 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:14.808337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bddf1ab8-ef0e-42f1-b40b-2eade0d2f452 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:14.820719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bddf1ab8-ef0e-42f1-b40b-2eade0d2f452 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:14.821277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bddf1ab8-ef0e-42f1-b40b-2eade0d2f452 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:14.821810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bddf1ab8-ef0e-42f1-b40b-2eade0d2f452 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:14.822541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bddf1ab8-ef0e-42f1-b40b-2eade0d2f452 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:14.823036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bddf1ab8-ef0e-42f1-b40b-2eade0d2f452 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:14.823466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bddf1ab8-ef0e-42f1-b40b-2eade0d2f452 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:14.857105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c5a534bd-f393-491b-a5c1-79b2736def51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:14.871038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c5a534bd-f393-491b-a5c1-79b2736def51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:14.873615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c5a534bd-f393-491b-a5c1-79b2736def51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:14.877949 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5a534bd-f393-491b-a5c1-79b2736def51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1361 microversion: 2.25 time: 0.694404 Aug 27 04:35:14.879714 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 470/937] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:14 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1361 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:14.885880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0cc21acf-8f69-4723-a468-a0966b0b6320 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:14.886766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0cc21acf-8f69-4723-a468-a0966b0b6320 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:14.906558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cc21acf-8f69-4723-a468-a0966b0b6320 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:14.911109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cc21acf-8f69-4723-a468-a0966b0b6320 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:14.911589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cc21acf-8f69-4723-a468-a0966b0b6320 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:14.912357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cc21acf-8f69-4723-a468-a0966b0b6320 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:14.915263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cc21acf-8f69-4723-a468-a0966b0b6320 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:14.915934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cc21acf-8f69-4723-a468-a0966b0b6320 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:15.044044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bddf1ab8-ef0e-42f1-b40b-2eade0d2f452 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:15.054310 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bddf1ab8-ef0e-42f1-b40b-2eade0d2f452 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.250901 Aug 27 04:35:15.055913 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 468/938] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:14 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:15.135049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8bdb16e2-3f7e-48f5-8bed-3c37c0fa0a3c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:15.137530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8bdb16e2-3f7e-48f5-8bed-3c37c0fa0a3c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:15.144858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bdb16e2-3f7e-48f5-8bed-3c37c0fa0a3c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:15.145618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bdb16e2-3f7e-48f5-8bed-3c37c0fa0a3c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:15.146235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bdb16e2-3f7e-48f5-8bed-3c37c0fa0a3c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:15.147108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bdb16e2-3f7e-48f5-8bed-3c37c0fa0a3c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:15.148598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bdb16e2-3f7e-48f5-8bed-3c37c0fa0a3c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:15.149198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bdb16e2-3f7e-48f5-8bed-3c37c0fa0a3c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:15.246496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0cc21acf-8f69-4723-a468-a0966b0b6320 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:15.270869 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0cc21acf-8f69-4723-a468-a0966b0b6320 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1316 microversion: 2.1 time: 0.389545 Aug 27 04:35:15.286022 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 471/939] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:14 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:15.326014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8bdb16e2-3f7e-48f5-8bed-3c37c0fa0a3c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:15.339223 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8bdb16e2-3f7e-48f5-8bed-3c37c0fa0a3c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1308 microversion: 2.1 time: 0.208134 Aug 27 04:35:15.342705 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 469/940] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:15 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1308 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:15.352893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd1fcb4f-056b-4807-a3f3-383506eea9b1 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:15.353581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd1fcb4f-056b-4807-a3f3-383506eea9b1 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:15.362288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd1fcb4f-056b-4807-a3f3-383506eea9b1 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:15.362846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd1fcb4f-056b-4807-a3f3-383506eea9b1 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:15.365119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd1fcb4f-056b-4807-a3f3-383506eea9b1 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:15.365977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd1fcb4f-056b-4807-a3f3-383506eea9b1 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:15.366567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd1fcb4f-056b-4807-a3f3-383506eea9b1 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:15.367568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd1fcb4f-056b-4807-a3f3-383506eea9b1 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:15.508885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-35978530-b595-44a0-9bbd-e5061b0add76 req-78b1014c-ce39-4f46-b640-cb488849df18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a6657e-24e5-4825-9bf0-4f7b0503fa01", "tag": "127900a1-4e2f-4ae6-bf1f-f21d1cafdbba"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:15.528463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-35978530-b595-44a0-9bbd-e5061b0add76 req-78b1014c-ce39-4f46-b640-cb488849df18 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:15.529001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-35978530-b595-44a0-9bbd-e5061b0add76 req-78b1014c-ce39-4f46-b640-cb488849df18 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:15.529433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-35978530-b595-44a0-9bbd-e5061b0add76 req-78b1014c-ce39-4f46-b640-cb488849df18 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:15.545498 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-35978530-b595-44a0-9bbd-e5061b0add76 req-78b1014c-ce39-4f46-b640-cb488849df18 service nova] Creating event network-changed:127900a1-4e2f-4ae6-bf1f-f21d1cafdbba for instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 on n-h2-854823-1 Aug 27 04:35:15.551155 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-35978530-b595-44a0-9bbd-e5061b0add76 req-78b1014c-ce39-4f46-b640-cb488849df18 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045200 Aug 27 04:35:15.551936 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 470/941] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:15.778320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bd1fcb4f-056b-4807-a3f3-383506eea9b1 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:15.789552 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd1fcb4f-056b-4807-a3f3-383506eea9b1 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1477 microversion: 2.1 time: 0.440684 Aug 27 04:35:15.801416 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 472/942] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:15 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1477 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:15.905191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-10a6aa29-61e9-4b5e-a1a1-d94d2c525be0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:15.906346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-10a6aa29-61e9-4b5e-a1a1-d94d2c525be0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:15.916207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10a6aa29-61e9-4b5e-a1a1-d94d2c525be0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:15.916843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10a6aa29-61e9-4b5e-a1a1-d94d2c525be0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:15.918001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10a6aa29-61e9-4b5e-a1a1-d94d2c525be0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:15.918293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10a6aa29-61e9-4b5e-a1a1-d94d2c525be0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:15.918963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10a6aa29-61e9-4b5e-a1a1-d94d2c525be0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:15.919631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10a6aa29-61e9-4b5e-a1a1-d94d2c525be0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:16.075284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47670c79-47db-40ec-a73d-236c06e7e388 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:16.076547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47670c79-47db-40ec-a73d-236c06e7e388 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:16.084710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47670c79-47db-40ec-a73d-236c06e7e388 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:16.085556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47670c79-47db-40ec-a73d-236c06e7e388 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:16.086150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47670c79-47db-40ec-a73d-236c06e7e388 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:16.087085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47670c79-47db-40ec-a73d-236c06e7e388 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:16.087755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47670c79-47db-40ec-a73d-236c06e7e388 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:16.088337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47670c79-47db-40ec-a73d-236c06e7e388 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:16.161312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10a6aa29-61e9-4b5e-a1a1-d94d2c525be0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:16.171481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10a6aa29-61e9-4b5e-a1a1-d94d2c525be0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:16.173233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10a6aa29-61e9-4b5e-a1a1-d94d2c525be0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:16.174494 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-10a6aa29-61e9-4b5e-a1a1-d94d2c525be0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1361 microversion: 2.25 time: 0.273849 Aug 27 04:35:16.175173 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 471/943] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:15 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:16.294164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1bec6b93-2c31-4ad4-9b5e-0443877fdee9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:16.294956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1bec6b93-2c31-4ad4-9b5e-0443877fdee9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:16.302202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1bec6b93-2c31-4ad4-9b5e-0443877fdee9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:16.305127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1bec6b93-2c31-4ad4-9b5e-0443877fdee9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:16.305608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1bec6b93-2c31-4ad4-9b5e-0443877fdee9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:16.306329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1bec6b93-2c31-4ad4-9b5e-0443877fdee9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:16.306786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1bec6b93-2c31-4ad4-9b5e-0443877fdee9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:16.307211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1bec6b93-2c31-4ad4-9b5e-0443877fdee9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:16.443355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47670c79-47db-40ec-a73d-236c06e7e388 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:16.452264 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47670c79-47db-40ec-a73d-236c06e7e388 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.380875 Aug 27 04:35:16.453011 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 473/944] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:16 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:16.469986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6802f45d-223e-4164-b249-fbfef41afa85 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:16.473315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6802f45d-223e-4164-b249-fbfef41afa85 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:16.481218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6802f45d-223e-4164-b249-fbfef41afa85 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:16.482036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6802f45d-223e-4164-b249-fbfef41afa85 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:16.483330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6802f45d-223e-4164-b249-fbfef41afa85 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:16.485739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6802f45d-223e-4164-b249-fbfef41afa85 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:16.486437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6802f45d-223e-4164-b249-fbfef41afa85 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:16.487105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6802f45d-223e-4164-b249-fbfef41afa85 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:16.540422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1bec6b93-2c31-4ad4-9b5e-0443877fdee9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:16.549397 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1bec6b93-2c31-4ad4-9b5e-0443877fdee9 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1316 microversion: 2.1 time: 0.258952 Aug 27 04:35:16.568590 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 472/945] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:16 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:16.772246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6802f45d-223e-4164-b249-fbfef41afa85 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:16.787391 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6802f45d-223e-4164-b249-fbfef41afa85 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1308 microversion: 2.1 time: 0.320659 Aug 27 04:35:16.787998 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 474/946] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:16 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1308 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:16.811226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-18f7e53c-7d96-4699-8fec-dfe1885e65f2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:16.812252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-18f7e53c-7d96-4699-8fec-dfe1885e65f2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:16.819189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18f7e53c-7d96-4699-8fec-dfe1885e65f2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:16.819773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18f7e53c-7d96-4699-8fec-dfe1885e65f2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:16.820467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18f7e53c-7d96-4699-8fec-dfe1885e65f2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:16.821289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18f7e53c-7d96-4699-8fec-dfe1885e65f2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:16.821969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18f7e53c-7d96-4699-8fec-dfe1885e65f2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:16.822841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18f7e53c-7d96-4699-8fec-dfe1885e65f2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.107177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-18f7e53c-7d96-4699-8fec-dfe1885e65f2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:17.116673 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-18f7e53c-7d96-4699-8fec-dfe1885e65f2 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1477 microversion: 2.1 time: 0.309229 Aug 27 04:35:17.119766 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 473/947] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:16 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1477 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:17.198216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b6f650a-cc20-4011-a914-edafb7e9d5c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:17.198982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b6f650a-cc20-4011-a914-edafb7e9d5c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:17.212236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b6f650a-cc20-4011-a914-edafb7e9d5c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:17.212910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b6f650a-cc20-4011-a914-edafb7e9d5c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:17.213605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b6f650a-cc20-4011-a914-edafb7e9d5c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.214571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b6f650a-cc20-4011-a914-edafb7e9d5c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:17.215238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b6f650a-cc20-4011-a914-edafb7e9d5c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:17.215872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b6f650a-cc20-4011-a914-edafb7e9d5c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.304796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-f51660e0-32c2-4244-a86b-bde073b7b4f6 req-aef8eb94-a9a1-423a-a2d2-6633cceb6405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b24aa3a-1603-40d1-a619-bc29521e61eb", "name": "network-vif-deleted", "tag": "ced761b5-a492-4017-af6f-bc2b52bc544d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:17.315248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f51660e0-32c2-4244-a86b-bde073b7b4f6 req-aef8eb94-a9a1-423a-a2d2-6633cceb6405 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:17.315736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f51660e0-32c2-4244-a86b-bde073b7b4f6 req-aef8eb94-a9a1-423a-a2d2-6633cceb6405 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:17.316195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f51660e0-32c2-4244-a86b-bde073b7b4f6 req-aef8eb94-a9a1-423a-a2d2-6633cceb6405 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.320517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:17.343821 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f51660e0-32c2-4244-a86b-bde073b7b4f6 req-aef8eb94-a9a1-423a-a2d2-6633cceb6405 service nova] Creating event network-vif-deleted:ced761b5-a492-4017-af6f-bc2b52bc544d for instance 7b24aa3a-1603-40d1-a619-bc29521e61eb on n-h1-854823-1 Aug 27 04:35:17.359119 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-f51660e0-32c2-4244-a86b-bde073b7b4f6 req-aef8eb94-a9a1-423a-a2d2-6633cceb6405 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057886 Aug 27 04:35:17.360104 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 474/948] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:17.477507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b6f650a-cc20-4011-a914-edafb7e9d5c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:17.482410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-350108a0-5122-4ee7-9427-a8f9312087b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:17.483473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-350108a0-5122-4ee7-9427-a8f9312087b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:17.486451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:17.494787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b6f650a-cc20-4011-a914-edafb7e9d5c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:17.495440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-350108a0-5122-4ee7-9427-a8f9312087b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:17.496241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b6f650a-cc20-4011-a914-edafb7e9d5c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:17.496461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-350108a0-5122-4ee7-9427-a8f9312087b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:17.497272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-350108a0-5122-4ee7-9427-a8f9312087b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.497450 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b6f650a-cc20-4011-a914-edafb7e9d5c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1557 microversion: 2.25 time: 0.303429 Aug 27 04:35:17.498028 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 475/949] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:17 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1557 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:17.498584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-350108a0-5122-4ee7-9427-a8f9312087b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:17.499549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-350108a0-5122-4ee7-9427-a8f9312087b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:17.500299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-350108a0-5122-4ee7-9427-a8f9312087b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.527563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05965b63-3ff9-4be1-8ec7-41a70969761a tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:17.528210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05965b63-3ff9-4be1-8ec7-41a70969761a tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:17.537536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05965b63-3ff9-4be1-8ec7-41a70969761a tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:17.538290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05965b63-3ff9-4be1-8ec7-41a70969761a tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:17.538818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05965b63-3ff9-4be1-8ec7-41a70969761a tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.539580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05965b63-3ff9-4be1-8ec7-41a70969761a tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:17.545031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05965b63-3ff9-4be1-8ec7-41a70969761a tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:17.545731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05965b63-3ff9-4be1-8ec7-41a70969761a tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.663738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-350108a0-5122-4ee7-9427-a8f9312087b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:17.671582 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-350108a0-5122-4ee7-9427-a8f9312087b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.194585 Aug 27 04:35:17.672161 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 475/950] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:17 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:17.697545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-145de5b3-259e-488e-af8f-65dd66df192d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:17.699775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-145de5b3-259e-488e-af8f-65dd66df192d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:17.706204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-145de5b3-259e-488e-af8f-65dd66df192d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:17.707364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-145de5b3-259e-488e-af8f-65dd66df192d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:17.708038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-145de5b3-259e-488e-af8f-65dd66df192d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.709018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-145de5b3-259e-488e-af8f-65dd66df192d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:17.710084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-145de5b3-259e-488e-af8f-65dd66df192d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:17.710351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-145de5b3-259e-488e-af8f-65dd66df192d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.866119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-145de5b3-259e-488e-af8f-65dd66df192d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:17.876123 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-145de5b3-259e-488e-af8f-65dd66df192d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1316 microversion: 2.1 time: 0.189338 Aug 27 04:35:17.888552 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 476/951] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:17 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:17.888552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d743d89d-0d48-4eee-b35f-d385285eeab2 req-6a6a2ad7-6ff0-4dfa-a0ce-58c4a41b2259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf9e280-2f92-4e36-8ba7-30aabc0b3108", "tag": "5824b24a-2e82-4209-b0e1-ff375cca9ebf"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:17.892152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d743d89d-0d48-4eee-b35f-d385285eeab2 req-6a6a2ad7-6ff0-4dfa-a0ce-58c4a41b2259 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:17.892668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d743d89d-0d48-4eee-b35f-d385285eeab2 req-6a6a2ad7-6ff0-4dfa-a0ce-58c4a41b2259 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:17.893114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d743d89d-0d48-4eee-b35f-d385285eeab2 req-6a6a2ad7-6ff0-4dfa-a0ce-58c4a41b2259 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.905274 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d743d89d-0d48-4eee-b35f-d385285eeab2 req-6a6a2ad7-6ff0-4dfa-a0ce-58c4a41b2259 service nova] Creating event network-changed:5824b24a-2e82-4209-b0e1-ff375cca9ebf for instance 6cf9e280-2f92-4e36-8ba7-30aabc0b3108 on n-h1-854823-1 Aug 27 04:35:17.911003 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d743d89d-0d48-4eee-b35f-d385285eeab2 req-6a6a2ad7-6ff0-4dfa-a0ce-58c4a41b2259 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032485 Aug 27 04:35:17.911548 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 477/952] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:17.916706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e565c5c2-a791-420e-ba21-29aee811dff2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:17.917414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e565c5c2-a791-420e-ba21-29aee811dff2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:17.924304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e565c5c2-a791-420e-ba21-29aee811dff2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:17.924970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e565c5c2-a791-420e-ba21-29aee811dff2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:17.925819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e565c5c2-a791-420e-ba21-29aee811dff2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.926583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e565c5c2-a791-420e-ba21-29aee811dff2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:17.927180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e565c5c2-a791-420e-ba21-29aee811dff2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:17.927468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e565c5c2-a791-420e-ba21-29aee811dff2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.941069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-05965b63-3ff9-4be1-8ec7-41a70969761a tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 993886de-4066-4da7-9768-ad92fdea6cc2 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:18.007299 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05965b63-3ff9-4be1-8ec7-41a70969761a tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 2049 microversion: 2.25 time: 0.470701 Aug 27 04:35:18.008309 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 476/953] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:17 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 2049 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:18.044271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f94e57d-64f1-4a39-b1cd-847e616f98c2 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:18.046521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f94e57d-64f1-4a39-b1cd-847e616f98c2 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:18.063416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f94e57d-64f1-4a39-b1cd-847e616f98c2 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.064467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f94e57d-64f1-4a39-b1cd-847e616f98c2 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.065313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f94e57d-64f1-4a39-b1cd-847e616f98c2 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:18.067321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f94e57d-64f1-4a39-b1cd-847e616f98c2 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.068051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f94e57d-64f1-4a39-b1cd-847e616f98c2 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.068735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f94e57d-64f1-4a39-b1cd-847e616f98c2 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:18.113361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e565c5c2-a791-420e-ba21-29aee811dff2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:18.121215 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e565c5c2-a791-420e-ba21-29aee811dff2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1308 microversion: 2.1 time: 0.208474 Aug 27 04:35:18.121820 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 478/954] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:17 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:18.140737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-901f1e80-4ca7-44ad-a2cb-f32b4d76d8e3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:18.141613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-901f1e80-4ca7-44ad-a2cb-f32b4d76d8e3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:18.148687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-901f1e80-4ca7-44ad-a2cb-f32b4d76d8e3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.149426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-901f1e80-4ca7-44ad-a2cb-f32b4d76d8e3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.149869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-901f1e80-4ca7-44ad-a2cb-f32b4d76d8e3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:18.150591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-901f1e80-4ca7-44ad-a2cb-f32b4d76d8e3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.151055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-901f1e80-4ca7-44ad-a2cb-f32b4d76d8e3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.151663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-901f1e80-4ca7-44ad-a2cb-f32b4d76d8e3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:18.193408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-901f1e80-4ca7-44ad-a2cb-f32b4d76d8e3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.193902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-901f1e80-4ca7-44ad-a2cb-f32b4d76d8e3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.194338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-901f1e80-4ca7-44ad-a2cb-f32b4d76d8e3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:18.194789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-901f1e80-4ca7-44ad-a2cb-f32b4d76d8e3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lazy-loading 'fault' on Instance uuid 7b24aa3a-1603-40d1-a619-bc29521e61eb {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:18.236812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-901f1e80-4ca7-44ad-a2cb-f32b4d76d8e3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:18.245326 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-901f1e80-4ca7-44ad-a2cb-f32b4d76d8e3 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1312 microversion: 2.1 time: 0.108413 Aug 27 04:35:18.245920 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 479/955] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:18 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:18.630481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-5f94e57d-64f1-4a39-b1cd-847e616f98c2 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 993886de-4066-4da7-9768-ad92fdea6cc2 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:18.650245 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f94e57d-64f1-4a39-b1cd-847e616f98c2 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 2049 microversion: 2.25 time: 0.623651 Aug 27 04:35:18.651210 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 477/956] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:18 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 2049 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:18.679853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-03736c2d-e241-42a7-bc2c-4e2b4b620b1b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:18.684359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03736c2d-e241-42a7-bc2c-4e2b4b620b1b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.685119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03736c2d-e241-42a7-bc2c-4e2b4b620b1b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.685735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03736c2d-e241-42a7-bc2c-4e2b4b620b1b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:18.686767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03736c2d-e241-42a7-bc2c-4e2b4b620b1b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.687427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03736c2d-e241-42a7-bc2c-4e2b4b620b1b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.693675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ced839e2-04ff-4afb-80af-e4b9e209f42b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:18.694538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ced839e2-04ff-4afb-80af-e4b9e209f42b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:18.700112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03736c2d-e241-42a7-bc2c-4e2b4b620b1b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:18.706315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced839e2-04ff-4afb-80af-e4b9e209f42b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.709514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced839e2-04ff-4afb-80af-e4b9e209f42b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.710207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced839e2-04ff-4afb-80af-e4b9e209f42b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:18.710958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced839e2-04ff-4afb-80af-e4b9e209f42b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.711425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced839e2-04ff-4afb-80af-e4b9e209f42b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.711859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced839e2-04ff-4afb-80af-e4b9e209f42b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:18.783750 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-03736c2d-e241-42a7-bc2c-4e2b4b620b1b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.111421 Aug 27 04:35:18.794893 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 480/957] 10.222.0.79 () {60 vars in 1217 bytes} [Sat Aug 27 04:35:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:35:18.803819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f37aa62d-0b03-4552-ae36-61755528e561 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:18.804356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f37aa62d-0b03-4552-ae36-61755528e561 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:18.822829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f37aa62d-0b03-4552-ae36-61755528e561 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.823351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f37aa62d-0b03-4552-ae36-61755528e561 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.823818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f37aa62d-0b03-4552-ae36-61755528e561 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:18.824474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f37aa62d-0b03-4552-ae36-61755528e561 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.824959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f37aa62d-0b03-4552-ae36-61755528e561 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.826129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f37aa62d-0b03-4552-ae36-61755528e561 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:18.976030 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f37aa62d-0b03-4552-ae36-61755528e561 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2/action" status: 202 len: 0 microversion: 2.25 time: 0.176408 Aug 27 04:35:18.977253 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 481/958] 10.222.0.79 () {62 vars in 1319 bytes} [Sat Aug 27 04:35:18 2022] POST /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:35:18.985094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-49350998-b1c6-46e2-bce2-1b5f6d6f8c52 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:18.985895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-49350998-b1c6-46e2-bce2-1b5f6d6f8c52 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:18.994884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49350998-b1c6-46e2-bce2-1b5f6d6f8c52 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.995400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49350998-b1c6-46e2-bce2-1b5f6d6f8c52 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.995845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49350998-b1c6-46e2-bce2-1b5f6d6f8c52 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:18.996638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49350998-b1c6-46e2-bce2-1b5f6d6f8c52 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.997261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49350998-b1c6-46e2-bce2-1b5f6d6f8c52 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.997701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49350998-b1c6-46e2-bce2-1b5f6d6f8c52 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:19.037935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ced839e2-04ff-4afb-80af-e4b9e209f42b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:19.040291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:19.048058 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ced839e2-04ff-4afb-80af-e4b9e209f42b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.358770 Aug 27 04:35:19.062507 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 478/959] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:18 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:19.068399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05ceaab2-1454-4e7c-9716-b413ff81180d tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:19.069342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05ceaab2-1454-4e7c-9716-b413ff81180d tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:19.077616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05ceaab2-1454-4e7c-9716-b413ff81180d tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:19.078467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05ceaab2-1454-4e7c-9716-b413ff81180d tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:19.079210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05ceaab2-1454-4e7c-9716-b413ff81180d tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:19.080160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05ceaab2-1454-4e7c-9716-b413ff81180d tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:19.081050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05ceaab2-1454-4e7c-9716-b413ff81180d tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:19.082755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05ceaab2-1454-4e7c-9716-b413ff81180d tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:19.171637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-49350998-b1c6-46e2-bce2-1b5f6d6f8c52 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:19.181447 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-49350998-b1c6-46e2-bce2-1b5f6d6f8c52 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1316 microversion: 2.1 time: 0.202148 Aug 27 04:35:19.182476 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 482/960] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:18 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:19.187526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8a7128cc-f62a-40da-ab29-9a2e3fb7c324 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:19.188396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8a7128cc-f62a-40da-ab29-9a2e3fb7c324 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:19.195423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a7128cc-f62a-40da-ab29-9a2e3fb7c324 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:19.196346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a7128cc-f62a-40da-ab29-9a2e3fb7c324 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:19.196843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a7128cc-f62a-40da-ab29-9a2e3fb7c324 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:19.197550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a7128cc-f62a-40da-ab29-9a2e3fb7c324 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:19.198009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a7128cc-f62a-40da-ab29-9a2e3fb7c324 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:19.198724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a7128cc-f62a-40da-ab29-9a2e3fb7c324 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:19.328642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-05ceaab2-1454-4e7c-9716-b413ff81180d tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 993886de-4066-4da7-9768-ad92fdea6cc2 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:19.352885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8a7128cc-f62a-40da-ab29-9a2e3fb7c324 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:19.361706 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05ceaab2-1454-4e7c-9716-b413ff81180d tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 2054 microversion: 2.25 time: 0.294123 Aug 27 04:35:19.362360 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 479/961] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:19 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 2054 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:19.366123 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8a7128cc-f62a-40da-ab29-9a2e3fb7c324 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1308 microversion: 2.1 time: 0.182319 Aug 27 04:35:19.367310 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 483/962] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:19 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1308 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:19.385304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-531a8945-cb85-4822-97f6-ce75f55579df tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:19.386268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-531a8945-cb85-4822-97f6-ce75f55579df tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:19.392800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:19.395379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531a8945-cb85-4822-97f6-ce75f55579df tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:19.396190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531a8945-cb85-4822-97f6-ce75f55579df tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:19.396866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531a8945-cb85-4822-97f6-ce75f55579df tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:19.397901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531a8945-cb85-4822-97f6-ce75f55579df tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:19.398632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531a8945-cb85-4822-97f6-ce75f55579df tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:19.399260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531a8945-cb85-4822-97f6-ce75f55579df tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:19.440439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531a8945-cb85-4822-97f6-ce75f55579df tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:19.441883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531a8945-cb85-4822-97f6-ce75f55579df tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:19.442534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531a8945-cb85-4822-97f6-ce75f55579df tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:19.443191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-531a8945-cb85-4822-97f6-ce75f55579df tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lazy-loading 'fault' on Instance uuid 7b24aa3a-1603-40d1-a619-bc29521e61eb {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:19.514147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-531a8945-cb85-4822-97f6-ce75f55579df tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:19.524725 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-531a8945-cb85-4822-97f6-ce75f55579df tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1312 microversion: 2.1 time: 0.150131 Aug 27 04:35:19.526534 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 480/963] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:19 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:20.070421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a6fe87b-91b5-4e3e-8cf4-73f5850e1105 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:20.071923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a6fe87b-91b5-4e3e-8cf4-73f5850e1105 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:20.075068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:20.084052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a6fe87b-91b5-4e3e-8cf4-73f5850e1105 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:20.084931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a6fe87b-91b5-4e3e-8cf4-73f5850e1105 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:20.085579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a6fe87b-91b5-4e3e-8cf4-73f5850e1105 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:20.086622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a6fe87b-91b5-4e3e-8cf4-73f5850e1105 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:20.087238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a6fe87b-91b5-4e3e-8cf4-73f5850e1105 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:20.087822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a6fe87b-91b5-4e3e-8cf4-73f5850e1105 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:20.205387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30dc481a-6836-404c-aa6f-db2a59360ac4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:20.206662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-30dc481a-6836-404c-aa6f-db2a59360ac4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:20.212659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:20.214361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:20.216315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30dc481a-6836-404c-aa6f-db2a59360ac4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:20.216878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30dc481a-6836-404c-aa6f-db2a59360ac4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:20.217468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30dc481a-6836-404c-aa6f-db2a59360ac4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:20.218328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30dc481a-6836-404c-aa6f-db2a59360ac4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:20.218968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30dc481a-6836-404c-aa6f-db2a59360ac4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:20.220128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30dc481a-6836-404c-aa6f-db2a59360ac4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:20.238455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6a6fe87b-91b5-4e3e-8cf4-73f5850e1105 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:20.255000 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a6fe87b-91b5-4e3e-8cf4-73f5850e1105 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.188203 Aug 27 04:35:20.270914 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 484/964] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:20 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:20.387970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c9d2f29f-7de2-412c-8b72-a91455309e64 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:20.388727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c9d2f29f-7de2-412c-8b72-a91455309e64 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:20.401109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9d2f29f-7de2-412c-8b72-a91455309e64 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:20.401617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9d2f29f-7de2-412c-8b72-a91455309e64 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:20.405537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9d2f29f-7de2-412c-8b72-a91455309e64 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:20.406495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9d2f29f-7de2-412c-8b72-a91455309e64 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:20.406959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9d2f29f-7de2-412c-8b72-a91455309e64 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:20.408809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9d2f29f-7de2-412c-8b72-a91455309e64 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:20.514126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-30dc481a-6836-404c-aa6f-db2a59360ac4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:20.536242 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-30dc481a-6836-404c-aa6f-db2a59360ac4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1316 microversion: 2.1 time: 0.330951 Aug 27 04:35:20.537550 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 481/965] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:20 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1316 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:20.553252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7a3738f-9802-4c8e-b4f1-293ed097b51c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:20.557166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7a3738f-9802-4c8e-b4f1-293ed097b51c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:20.573751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a3738f-9802-4c8e-b4f1-293ed097b51c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:20.577518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a3738f-9802-4c8e-b4f1-293ed097b51c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:20.578763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a3738f-9802-4c8e-b4f1-293ed097b51c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:20.578953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-c9d2f29f-7de2-412c-8b72-a91455309e64 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 993886de-4066-4da7-9768-ad92fdea6cc2 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:20.580794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a3738f-9802-4c8e-b4f1-293ed097b51c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:20.583176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a3738f-9802-4c8e-b4f1-293ed097b51c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:20.585400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a3738f-9802-4c8e-b4f1-293ed097b51c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:20.603570 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c9d2f29f-7de2-412c-8b72-a91455309e64 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 2054 microversion: 2.25 time: 0.218226 Aug 27 04:35:20.616553 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 485/966] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:20 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 2054 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:35:20.616553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-422b82bb-1d76-42a4-830c-de4e640bbbbf tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:20.616553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-422b82bb-1d76-42a4-830c-de4e640bbbbf tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:20.620153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-422b82bb-1d76-42a4-830c-de4e640bbbbf tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:20.626148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-422b82bb-1d76-42a4-830c-de4e640bbbbf tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:20.626148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-422b82bb-1d76-42a4-830c-de4e640bbbbf tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:20.626148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-422b82bb-1d76-42a4-830c-de4e640bbbbf tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:20.626148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-422b82bb-1d76-42a4-830c-de4e640bbbbf tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:20.626637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-422b82bb-1d76-42a4-830c-de4e640bbbbf tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:20.666320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-422b82bb-1d76-42a4-830c-de4e640bbbbf tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:20.666941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-422b82bb-1d76-42a4-830c-de4e640bbbbf tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:20.667639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-422b82bb-1d76-42a4-830c-de4e640bbbbf tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:20.668194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-422b82bb-1d76-42a4-830c-de4e640bbbbf tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lazy-loading 'fault' on Instance uuid 7b24aa3a-1603-40d1-a619-bc29521e61eb {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:20.739380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-422b82bb-1d76-42a4-830c-de4e640bbbbf tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:20.752200 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-422b82bb-1d76-42a4-830c-de4e640bbbbf tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1312 microversion: 2.1 time: 0.144908 Aug 27 04:35:20.753090 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 486/967] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:20 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1312 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:20.862050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-4f310ef9-0f9a-45c3-962e-47bd1f648100 req-ee9db79e-0410-4a28-ab11-08524ac4dfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a6657e-24e5-4825-9bf0-4f7b0503fa01", "name": "network-vif-plugged", "status": "completed", "tag": "127900a1-4e2f-4ae6-bf1f-f21d1cafdbba"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:20.889956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4f310ef9-0f9a-45c3-962e-47bd1f648100 req-ee9db79e-0410-4a28-ab11-08524ac4dfd4 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:20.890550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4f310ef9-0f9a-45c3-962e-47bd1f648100 req-ee9db79e-0410-4a28-ab11-08524ac4dfd4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:20.891063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4f310ef9-0f9a-45c3-962e-47bd1f648100 req-ee9db79e-0410-4a28-ab11-08524ac4dfd4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:20.907992 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-4f310ef9-0f9a-45c3-962e-47bd1f648100 req-ee9db79e-0410-4a28-ab11-08524ac4dfd4 service nova] Creating event network-vif-plugged:127900a1-4e2f-4ae6-bf1f-f21d1cafdbba for instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 on n-h2-854823-1 Aug 27 04:35:20.915324 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-4f310ef9-0f9a-45c3-962e-47bd1f648100 req-ee9db79e-0410-4a28-ab11-08524ac4dfd4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059335 Aug 27 04:35:20.916426 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 487/968] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:20.988253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7a3738f-9802-4c8e-b4f1-293ed097b51c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:20.999798 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7a3738f-9802-4c8e-b4f1-293ed097b51c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1308 microversion: 2.1 time: 0.459936 Aug 27 04:35:21.001367 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 482/969] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:20 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1308 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:21.278905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b35a3b54-112e-4c82-b1f0-1e41244cc7b9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:21.280353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b35a3b54-112e-4c82-b1f0-1e41244cc7b9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:21.289712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b35a3b54-112e-4c82-b1f0-1e41244cc7b9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:21.290763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b35a3b54-112e-4c82-b1f0-1e41244cc7b9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:21.291422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b35a3b54-112e-4c82-b1f0-1e41244cc7b9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:21.292356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b35a3b54-112e-4c82-b1f0-1e41244cc7b9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:21.293190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b35a3b54-112e-4c82-b1f0-1e41244cc7b9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:21.293846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b35a3b54-112e-4c82-b1f0-1e41244cc7b9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:21.477451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b35a3b54-112e-4c82-b1f0-1e41244cc7b9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:21.488369 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b35a3b54-112e-4c82-b1f0-1e41244cc7b9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.213472 Aug 27 04:35:21.488945 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 488/970] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:21 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:21.557696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cbf065e6-9ccf-4ac2-b372-07e80d5b33a0 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:21.558878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cbf065e6-9ccf-4ac2-b372-07e80d5b33a0 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:21.565420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbf065e6-9ccf-4ac2-b372-07e80d5b33a0 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:21.566784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbf065e6-9ccf-4ac2-b372-07e80d5b33a0 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:21.567221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbf065e6-9ccf-4ac2-b372-07e80d5b33a0 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:21.568006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbf065e6-9ccf-4ac2-b372-07e80d5b33a0 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:21.568467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbf065e6-9ccf-4ac2-b372-07e80d5b33a0 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:21.568931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbf065e6-9ccf-4ac2-b372-07e80d5b33a0 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:21.634674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-09ee3096-0bdd-476b-b00f-6cd610e8e088 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:21.635387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-09ee3096-0bdd-476b-b00f-6cd610e8e088 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:21.642459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ee3096-0bdd-476b-b00f-6cd610e8e088 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:21.643142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ee3096-0bdd-476b-b00f-6cd610e8e088 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:21.643811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ee3096-0bdd-476b-b00f-6cd610e8e088 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:21.645079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ee3096-0bdd-476b-b00f-6cd610e8e088 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:21.645726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ee3096-0bdd-476b-b00f-6cd610e8e088 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:21.646466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ee3096-0bdd-476b-b00f-6cd610e8e088 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:21.810755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cbf065e6-9ccf-4ac2-b372-07e80d5b33a0 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:21.819621 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cbf065e6-9ccf-4ac2-b372-07e80d5b33a0 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1316 microversion: 2.1 time: 0.265616 Aug 27 04:35:21.820223 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 483/971] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:21 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:21.832798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-826817d3-77df-4159-bff9-1ad497c70461 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:21.832798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-826817d3-77df-4159-bff9-1ad497c70461 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:21.841437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-09ee3096-0bdd-476b-b00f-6cd610e8e088 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 993886de-4066-4da7-9768-ad92fdea6cc2 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:21.841714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-826817d3-77df-4159-bff9-1ad497c70461 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:21.846513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-826817d3-77df-4159-bff9-1ad497c70461 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:21.847137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-826817d3-77df-4159-bff9-1ad497c70461 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:21.847905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-826817d3-77df-4159-bff9-1ad497c70461 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:21.848386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-826817d3-77df-4159-bff9-1ad497c70461 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:21.848853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-826817d3-77df-4159-bff9-1ad497c70461 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:21.858233 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-09ee3096-0bdd-476b-b00f-6cd610e8e088 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 2034 microversion: 2.25 time: 0.228256 Aug 27 04:35:21.858906 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 489/972] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:21 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 2034 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:35:21.887974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0c24fa08-7ce9-41b1-bb44-e251ea8bfb9c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854823-1", "block_migration": "auto"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:21.890856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0c24fa08-7ce9-41b1-bb44-e251ea8bfb9c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:21.898183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c24fa08-7ce9-41b1-bb44-e251ea8bfb9c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:21.898681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c24fa08-7ce9-41b1-bb44-e251ea8bfb9c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:21.899391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c24fa08-7ce9-41b1-bb44-e251ea8bfb9c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:21.900269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c24fa08-7ce9-41b1-bb44-e251ea8bfb9c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:21.900915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c24fa08-7ce9-41b1-bb44-e251ea8bfb9c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:21.907365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c24fa08-7ce9-41b1-bb44-e251ea8bfb9c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:21.915653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-826817d3-77df-4159-bff9-1ad497c70461 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:21.916244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-826817d3-77df-4159-bff9-1ad497c70461 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:21.916813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-826817d3-77df-4159-bff9-1ad497c70461 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:21.917633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-826817d3-77df-4159-bff9-1ad497c70461 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lazy-loading 'fault' on Instance uuid 7b24aa3a-1603-40d1-a619-bc29521e61eb {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:21.938901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-0c24fa08-7ce9-41b1-bb44-e251ea8bfb9c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'flavor' on Instance uuid 993886de-4066-4da7-9768-ad92fdea6cc2 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:21.956834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0c24fa08-7ce9-41b1-bb44-e251ea8bfb9c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Going to try to live migrate instance to n-h2-854823-1 {{(pid=128870) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:35:21.961170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:21.978343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-826817d3-77df-4159-bff9-1ad497c70461 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131b6d978c0d4fe0b4e6bb36b5d9d68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4885bb6c973a4e628d038f5e21461722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:21.999328 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-826817d3-77df-4159-bff9-1ad497c70461 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 200 len: 1312 microversion: 2.1 time: 0.177912 Aug 27 04:35:22.001095 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 484/973] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:21 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:22.031274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a79d91e-d9d9-472a-be2c-fd56c21c7a26 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:22.032192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a79d91e-d9d9-472a-be2c-fd56c21c7a26 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:22.044095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a79d91e-d9d9-472a-be2c-fd56c21c7a26 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:22.044658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a79d91e-d9d9-472a-be2c-fd56c21c7a26 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:22.045076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a79d91e-d9d9-472a-be2c-fd56c21c7a26 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:22.047103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a79d91e-d9d9-472a-be2c-fd56c21c7a26 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:22.047533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a79d91e-d9d9-472a-be2c-fd56c21c7a26 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:22.048336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a79d91e-d9d9-472a-be2c-fd56c21c7a26 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:22.542343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a79d91e-d9d9-472a-be2c-fd56c21c7a26 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:22.558517 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a79d91e-d9d9-472a-be2c-fd56c21c7a26 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1308 microversion: 2.1 time: 0.530901 Aug 27 04:35:22.560112 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 485/974] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:22 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1308 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:22.569060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf6189c4-e66e-4df2-9162-6833028de55b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:22.569986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf6189c4-e66e-4df2-9162-6833028de55b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:22.581985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf6189c4-e66e-4df2-9162-6833028de55b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:22.582693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf6189c4-e66e-4df2-9162-6833028de55b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:22.583544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf6189c4-e66e-4df2-9162-6833028de55b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:22.585059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf6189c4-e66e-4df2-9162-6833028de55b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:22.585756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf6189c4-e66e-4df2-9162-6833028de55b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:22.586375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf6189c4-e66e-4df2-9162-6833028de55b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:22.983385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bf6189c4-e66e-4df2-9162-6833028de55b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:22.992897 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf6189c4-e66e-4df2-9162-6833028de55b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1475 microversion: 2.1 time: 0.431063 Aug 27 04:35:22.993543 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 486/975] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:22 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1475 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:23.008154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8eceeb0-68ee-4fb4-98db-837d765eb37f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:23.017121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8eceeb0-68ee-4fb4-98db-837d765eb37f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:23.023834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8eceeb0-68ee-4fb4-98db-837d765eb37f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:23.024706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8eceeb0-68ee-4fb4-98db-837d765eb37f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:23.025238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8eceeb0-68ee-4fb4-98db-837d765eb37f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:23.025976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8eceeb0-68ee-4fb4-98db-837d765eb37f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:23.032676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8eceeb0-68ee-4fb4-98db-837d765eb37f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:23.033362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8eceeb0-68ee-4fb4-98db-837d765eb37f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:23.295247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8eceeb0-68ee-4fb4-98db-837d765eb37f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:23.304296 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8eceeb0-68ee-4fb4-98db-837d765eb37f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1316 microversion: 2.1 time: 0.307216 Aug 27 04:35:23.304930 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 487/976] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:22 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:23.309925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e0c14c8e-2c3e-44ca-9e73-5273e4bec5c8 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:23.310853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e0c14c8e-2c3e-44ca-9e73-5273e4bec5c8 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] [instance: 7b24aa3a-1603-40d1-a619-bc29521e61eb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:23.322675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0c14c8e-2c3e-44ca-9e73-5273e4bec5c8 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:23.323503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0c14c8e-2c3e-44ca-9e73-5273e4bec5c8 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:23.324159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0c14c8e-2c3e-44ca-9e73-5273e4bec5c8 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:23.325131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0c14c8e-2c3e-44ca-9e73-5273e4bec5c8 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:23.325794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0c14c8e-2c3e-44ca-9e73-5273e4bec5c8 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:23.326867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0c14c8e-2c3e-44ca-9e73-5273e4bec5c8 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:23.355754 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e0c14c8e-2c3e-44ca-9e73-5273e4bec5c8 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] HTTP exception thrown: Instance 7b24aa3a-1603-40d1-a619-bc29521e61eb could not be found. Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e0c14c8e-2c3e-44ca-9e73-5273e4bec5c8 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Request method failure captured: Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb HTTP/1.1 Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ7nw4TslZlhYJcjyqmefHHatPt3u8wolXpBP3qle0n-GlkcckR_0ag9qh_D75E0n79vPwsY8OP1yPrPjeYaHAlstDIuGY0I9nnr5Bz2ofLxB4JyjvF_1XNxmQZEyXpZcYKDTMXxNo4VKvA5_IObQO_UEblMobqqDLP4f0zTIxEhYio Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 4885bb6c973a4e628d038f5e21461722 Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-392986572 Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:35:23.358187 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:35:23.359886 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4885bb6c973a4e628d038f5e21461722"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4885bb6c973a4e628d038f5e21461722"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4885bb6c973a4e628d038f5e21461722"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4885bb6c973a4e628d038f5e21461722"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:35:23.359886 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-392986572 Aug 27 04:35:23.359886 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 4885bb6c973a4e628d038f5e21461722 Aug 27 04:35:23.359886 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-392986572 Aug 27 04:35:23.359886 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerDiagnosticsNegativeTest-392986572-project Aug 27 04:35:23.359886 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:35:23.359886 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:35:23.359886 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 131b6d978c0d4fe0b4e6bb36b5d9d68d Aug 27 04:35:23.359886 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-392986572-project Aug 27 04:35:23.359886 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:35:23.359886 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 7b24aa3a-1603-40d1-a619-bc29521e61eb could not be found. Aug 27 04:35:23.359886 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '7b24aa3a-1603-40d1-a619-bc29521e61eb'} Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b24aa3a-1603-40d1-a619-bc29521e61eb could not be found. Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:35:23.360822 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b24aa3a-1603-40d1-a619-bc29521e61eb could not be found. Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b24aa3a-1603-40d1-a619-bc29521e61eb could not be found. Aug 27 04:35:23.362339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:23.364169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e0c14c8e-2c3e-44ca-9e73-5273e4bec5c8 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] Returning 404 to user: Instance 7b24aa3a-1603-40d1-a619-bc29521e61eb could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:35:23.364169 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e0c14c8e-2c3e-44ca-9e73-5273e4bec5c8 tempest-ServerDiagnosticsNegativeTest-392986572 tempest-ServerDiagnosticsNegativeTest-392986572-project] 10.222.0.79 "GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb" status: 404 len: 111 microversion: 2.1 time: 0.054722 Aug 27 04:35:23.364169 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 488/977] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:23 2022] GET /compute/v2.1/servers/7b24aa3a-1603-40d1-a619-bc29521e61eb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:35:23.588333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e0575f4-aa3c-4400-b1bc-9d048b3ac218 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:23.589664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e0575f4-aa3c-4400-b1bc-9d048b3ac218 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:23.611889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e0575f4-aa3c-4400-b1bc-9d048b3ac218 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:23.613192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e0575f4-aa3c-4400-b1bc-9d048b3ac218 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:23.613655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e0575f4-aa3c-4400-b1bc-9d048b3ac218 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:23.617400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e0575f4-aa3c-4400-b1bc-9d048b3ac218 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:23.617902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e0575f4-aa3c-4400-b1bc-9d048b3ac218 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:23.618356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e0575f4-aa3c-4400-b1bc-9d048b3ac218 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:23.921794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4e0575f4-aa3c-4400-b1bc-9d048b3ac218 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:23.935926 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e0575f4-aa3c-4400-b1bc-9d048b3ac218 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1487 microversion: 2.1 time: 0.352767 Aug 27 04:35:23.936508 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 489/978] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:23 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1487 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:23.959698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-04b89962-468f-43f2-b195-924f58229dfd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:23.970122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04b89962-468f-43f2-b195-924f58229dfd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:23.970836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04b89962-468f-43f2-b195-924f58229dfd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:23.981277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04b89962-468f-43f2-b195-924f58229dfd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:23.989601 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0c24fa08-7ce9-41b1-bb44-e251ea8bfb9c tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2/action" status: 202 len: 0 microversion: 2.25 time: 2.105208 Aug 27 04:35:23.992191 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 490/979] 10.222.0.79 () {62 vars in 1319 bytes} [Sat Aug 27 04:35:21 2022] POST /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2/action => generated 0 bytes in 2109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:35:24.003828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-61a7b148-20a1-4519-8079-2159b65d3921 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:24.004890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-61a7b148-20a1-4519-8079-2159b65d3921 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:24.017658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61a7b148-20a1-4519-8079-2159b65d3921 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:24.019720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61a7b148-20a1-4519-8079-2159b65d3921 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:24.020712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61a7b148-20a1-4519-8079-2159b65d3921 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:24.021478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61a7b148-20a1-4519-8079-2159b65d3921 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:24.023163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61a7b148-20a1-4519-8079-2159b65d3921 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:24.023671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61a7b148-20a1-4519-8079-2159b65d3921 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:24.109907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-04b89962-468f-43f2-b195-924f58229dfd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Going to try to stop instance {{(pid=128869) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 04:35:24.198807 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-04b89962-468f-43f2-b195-924f58229dfd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "POST /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01/action" status: 202 len: 0 microversion: 2.1 time: 0.242636 Aug 27 04:35:24.202064 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 490/980] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:35:23 2022] POST /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:35:24.217685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9dd23c91-0a2f-45b0-8929-d3ae42536524 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:24.219834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9dd23c91-0a2f-45b0-8929-d3ae42536524 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:24.231824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dd23c91-0a2f-45b0-8929-d3ae42536524 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:24.232826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dd23c91-0a2f-45b0-8929-d3ae42536524 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:24.233967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dd23c91-0a2f-45b0-8929-d3ae42536524 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:24.235192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dd23c91-0a2f-45b0-8929-d3ae42536524 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:24.235888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dd23c91-0a2f-45b0-8929-d3ae42536524 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:24.236621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dd23c91-0a2f-45b0-8929-d3ae42536524 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:24.387888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-61a7b148-20a1-4519-8079-2159b65d3921 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:24.399792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9dd23c91-0a2f-45b0-8929-d3ae42536524 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:24.417313 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9dd23c91-0a2f-45b0-8929-d3ae42536524 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1472 microversion: 2.1 time: 0.211678 Aug 27 04:35:24.418935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-61a7b148-20a1-4519-8079-2159b65d3921 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:24.421586 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 491/981] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:24 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1472 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:24.425085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-61a7b148-20a1-4519-8079-2159b65d3921 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:24.429614 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-61a7b148-20a1-4519-8079-2159b65d3921 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1567 microversion: 2.25 time: 0.432529 Aug 27 04:35:24.432155 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 491/982] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:23 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1567 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:24.435523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-44d58128-fe42-4d83-b593-fe41e68fa93c req-cd058669-27fb-481a-a910-edd1c68f26d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf9e280-2f92-4e36-8ba7-30aabc0b3108", "name": "network-vif-plugged", "status": "completed", "tag": "5824b24a-2e82-4209-b0e1-ff375cca9ebf"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:24.447577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-30a88b51-0680-43dd-87ac-ee477dc3f5e5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:24.448552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-30a88b51-0680-43dd-87ac-ee477dc3f5e5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:24.459800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-44d58128-fe42-4d83-b593-fe41e68fa93c req-cd058669-27fb-481a-a910-edd1c68f26d5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:24.465213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-44d58128-fe42-4d83-b593-fe41e68fa93c req-cd058669-27fb-481a-a910-edd1c68f26d5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:24.467954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-44d58128-fe42-4d83-b593-fe41e68fa93c req-cd058669-27fb-481a-a910-edd1c68f26d5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:24.470067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30a88b51-0680-43dd-87ac-ee477dc3f5e5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:24.472882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30a88b51-0680-43dd-87ac-ee477dc3f5e5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:24.476992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30a88b51-0680-43dd-87ac-ee477dc3f5e5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:24.478188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30a88b51-0680-43dd-87ac-ee477dc3f5e5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:24.478891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30a88b51-0680-43dd-87ac-ee477dc3f5e5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:24.479567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30a88b51-0680-43dd-87ac-ee477dc3f5e5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:24.503866 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-44d58128-fe42-4d83-b593-fe41e68fa93c req-cd058669-27fb-481a-a910-edd1c68f26d5 service nova] Creating event network-vif-plugged:5824b24a-2e82-4209-b0e1-ff375cca9ebf for instance 6cf9e280-2f92-4e36-8ba7-30aabc0b3108 on n-h1-854823-1 Aug 27 04:35:24.515561 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-44d58128-fe42-4d83-b593-fe41e68fa93c req-cd058669-27fb-481a-a910-edd1c68f26d5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091642 Aug 27 04:35:24.517112 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 492/983] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:24.528811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13a639b7-08ba-4fba-ad45-565caf164423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:24.533376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13a639b7-08ba-4fba-ad45-565caf164423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:24.548957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13a639b7-08ba-4fba-ad45-565caf164423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:24.550618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13a639b7-08ba-4fba-ad45-565caf164423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:24.553597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13a639b7-08ba-4fba-ad45-565caf164423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:24.554777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13a639b7-08ba-4fba-ad45-565caf164423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:24.555377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13a639b7-08ba-4fba-ad45-565caf164423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:24.557044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13a639b7-08ba-4fba-ad45-565caf164423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:24.773680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13a639b7-08ba-4fba-ad45-565caf164423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:24.786453 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13a639b7-08ba-4fba-ad45-565caf164423 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1316 microversion: 2.1 time: 0.265850 Aug 27 04:35:24.787787 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 493/984] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:24 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:24.882228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-30a88b51-0680-43dd-87ac-ee477dc3f5e5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:24.895145 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-30a88b51-0680-43dd-87ac-ee477dc3f5e5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.461550 Aug 27 04:35:24.896965 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 492/985] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:24 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:25.455960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e84154b-3626-4207-8976-798e20357909 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:25.457158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e84154b-3626-4207-8976-798e20357909 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:25.459696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4b644dc4-0e27-44ee-973d-341ad5f4e2fd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:25.460324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4b644dc4-0e27-44ee-973d-341ad5f4e2fd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:25.464912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e84154b-3626-4207-8976-798e20357909 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:25.465900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e84154b-3626-4207-8976-798e20357909 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:25.466592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e84154b-3626-4207-8976-798e20357909 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:25.467319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e84154b-3626-4207-8976-798e20357909 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:25.467967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e84154b-3626-4207-8976-798e20357909 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:25.468546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e84154b-3626-4207-8976-798e20357909 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:25.476441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b644dc4-0e27-44ee-973d-341ad5f4e2fd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:25.477329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b644dc4-0e27-44ee-973d-341ad5f4e2fd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:25.478259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b644dc4-0e27-44ee-973d-341ad5f4e2fd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:25.479229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b644dc4-0e27-44ee-973d-341ad5f4e2fd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:25.479929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b644dc4-0e27-44ee-973d-341ad5f4e2fd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:25.480628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b644dc4-0e27-44ee-973d-341ad5f4e2fd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:25.656261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e84154b-3626-4207-8976-798e20357909 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:25.668000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:25.676284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e84154b-3626-4207-8976-798e20357909 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:25.679231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e84154b-3626-4207-8976-798e20357909 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:25.681733 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e84154b-3626-4207-8976-798e20357909 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1567 microversion: 2.25 time: 0.229343 Aug 27 04:35:25.682412 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 494/986] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:25 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:25.811602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d043a1b3-293e-45b8-bf9f-7e4cd58c3e99 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:25.812332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d043a1b3-293e-45b8-bf9f-7e4cd58c3e99 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:25.819724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d043a1b3-293e-45b8-bf9f-7e4cd58c3e99 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:25.820331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d043a1b3-293e-45b8-bf9f-7e4cd58c3e99 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:25.821007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d043a1b3-293e-45b8-bf9f-7e4cd58c3e99 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:25.821738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d043a1b3-293e-45b8-bf9f-7e4cd58c3e99 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:25.822197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d043a1b3-293e-45b8-bf9f-7e4cd58c3e99 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:25.822624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d043a1b3-293e-45b8-bf9f-7e4cd58c3e99 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:25.964663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d043a1b3-293e-45b8-bf9f-7e4cd58c3e99 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:25.977222 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d043a1b3-293e-45b8-bf9f-7e4cd58c3e99 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1316 microversion: 2.1 time: 0.169242 Aug 27 04:35:25.978972 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 495/987] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:25 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:25.997400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-10ba5f54-497f-406c-bee3-d0d7cf7c5036 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:25.999600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-10ba5f54-497f-406c-bee3-d0d7cf7c5036 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:26.010308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10ba5f54-497f-406c-bee3-d0d7cf7c5036 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:26.011264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10ba5f54-497f-406c-bee3-d0d7cf7c5036 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:26.012036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10ba5f54-497f-406c-bee3-d0d7cf7c5036 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:26.013117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10ba5f54-497f-406c-bee3-d0d7cf7c5036 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:26.013913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10ba5f54-497f-406c-bee3-d0d7cf7c5036 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:26.014552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10ba5f54-497f-406c-bee3-d0d7cf7c5036 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:26.104776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4b644dc4-0e27-44ee-973d-341ad5f4e2fd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:26.123871 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4b644dc4-0e27-44ee-973d-341ad5f4e2fd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1472 microversion: 2.1 time: 0.668406 Aug 27 04:35:26.126178 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 493/988] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:25 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1472 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:26.227521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-10ba5f54-497f-406c-bee3-d0d7cf7c5036 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:26.236671 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-10ba5f54-497f-406c-bee3-d0d7cf7c5036 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.255732 Aug 27 04:35:26.237339 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 496/989] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:25 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:26.628868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ca2cc8e4-6299-4c08-875e-aadee9be4c2e req-b05444bd-9087-47d6-b23d-10b4f9a538c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011ab45e-31fa-4ba7-b135-d222e7a725ca", "name": "network-vif-unplugged", "status": "completed", "tag": "3b944205-dafa-4b20-992c-6ddf5b0ca271"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:26.649289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ca2cc8e4-6299-4c08-875e-aadee9be4c2e req-b05444bd-9087-47d6-b23d-10b4f9a538c6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:26.650154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ca2cc8e4-6299-4c08-875e-aadee9be4c2e req-b05444bd-9087-47d6-b23d-10b4f9a538c6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:26.650901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ca2cc8e4-6299-4c08-875e-aadee9be4c2e req-b05444bd-9087-47d6-b23d-10b4f9a538c6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:26.670489 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ca2cc8e4-6299-4c08-875e-aadee9be4c2e req-b05444bd-9087-47d6-b23d-10b4f9a538c6 service nova] Creating event network-vif-unplugged:3b944205-dafa-4b20-992c-6ddf5b0ca271 for instance 011ab45e-31fa-4ba7-b135-d222e7a725ca on n-h1-854823-1 Aug 27 04:35:26.680237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-ca2cc8e4-6299-4c08-875e-aadee9be4c2e req-b05444bd-9087-47d6-b23d-10b4f9a538c6 service nova] Instance 011ab45e-31fa-4ba7-b135-d222e7a725ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:35:26.688390 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ca2cc8e4-6299-4c08-875e-aadee9be4c2e req-b05444bd-9087-47d6-b23d-10b4f9a538c6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064230 Aug 27 04:35:26.689971 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 494/990] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:26.706940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9011028a-61c2-4148-af82-85b63cf882ad tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:26.707503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9011028a-61c2-4148-af82-85b63cf882ad tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:26.719822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9011028a-61c2-4148-af82-85b63cf882ad tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:26.721556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9011028a-61c2-4148-af82-85b63cf882ad tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:26.723986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9011028a-61c2-4148-af82-85b63cf882ad tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:26.729024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9011028a-61c2-4148-af82-85b63cf882ad tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:26.733091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9011028a-61c2-4148-af82-85b63cf882ad tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:26.733816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9011028a-61c2-4148-af82-85b63cf882ad tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:26.999763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c24d9e32-e95c-45bd-a803-0f3167e3edd6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:27.000986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c24d9e32-e95c-45bd-a803-0f3167e3edd6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:27.017284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c24d9e32-e95c-45bd-a803-0f3167e3edd6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:27.017796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c24d9e32-e95c-45bd-a803-0f3167e3edd6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:27.019529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c24d9e32-e95c-45bd-a803-0f3167e3edd6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:27.022020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c24d9e32-e95c-45bd-a803-0f3167e3edd6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:27.023765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c24d9e32-e95c-45bd-a803-0f3167e3edd6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:27.028036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c24d9e32-e95c-45bd-a803-0f3167e3edd6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:27.051472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9011028a-61c2-4148-af82-85b63cf882ad tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:27.073711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9011028a-61c2-4148-af82-85b63cf882ad tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:27.075763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9011028a-61c2-4148-af82-85b63cf882ad tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:27.077224 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9011028a-61c2-4148-af82-85b63cf882ad tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1567 microversion: 2.25 time: 0.375485 Aug 27 04:35:27.080715 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 497/991] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:26 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1567 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:27.155685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46e643ca-494d-42e5-a597-aa2f657b57b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:27.156880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46e643ca-494d-42e5-a597-aa2f657b57b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:27.187138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46e643ca-494d-42e5-a597-aa2f657b57b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:27.189481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46e643ca-494d-42e5-a597-aa2f657b57b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:27.219947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46e643ca-494d-42e5-a597-aa2f657b57b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:27.224981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46e643ca-494d-42e5-a597-aa2f657b57b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:27.232098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46e643ca-494d-42e5-a597-aa2f657b57b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:27.244148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46e643ca-494d-42e5-a597-aa2f657b57b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:27.585836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46e643ca-494d-42e5-a597-aa2f657b57b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:27.594700 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46e643ca-494d-42e5-a597-aa2f657b57b8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1472 microversion: 2.1 time: 0.451063 Aug 27 04:35:27.611474 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 498/992] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:27 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1472 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:27.618734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-efcf0239-2666-435a-9e8b-3026133e1d6f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:27.619222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-efcf0239-2666-435a-9e8b-3026133e1d6f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:27.626494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efcf0239-2666-435a-9e8b-3026133e1d6f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:27.627679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efcf0239-2666-435a-9e8b-3026133e1d6f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:27.628333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efcf0239-2666-435a-9e8b-3026133e1d6f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:27.629383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efcf0239-2666-435a-9e8b-3026133e1d6f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:27.630311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efcf0239-2666-435a-9e8b-3026133e1d6f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:27.631025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efcf0239-2666-435a-9e8b-3026133e1d6f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:27.725898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c24d9e32-e95c-45bd-a803-0f3167e3edd6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:27.735637 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c24d9e32-e95c-45bd-a803-0f3167e3edd6 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1316 microversion: 2.1 time: 0.739962 Aug 27 04:35:27.736239 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 495/993] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:26 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1316 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:28.033081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-efcf0239-2666-435a-9e8b-3026133e1d6f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:28.041833 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-efcf0239-2666-435a-9e8b-3026133e1d6f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.429032 Aug 27 04:35:28.042427 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 499/994] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:27 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:28.103988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f2cd0779-d7d0-40ce-8ee3-16c4b37c6163 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:28.104687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f2cd0779-d7d0-40ce-8ee3-16c4b37c6163 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:28.114581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2cd0779-d7d0-40ce-8ee3-16c4b37c6163 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:28.115278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2cd0779-d7d0-40ce-8ee3-16c4b37c6163 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:28.115922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2cd0779-d7d0-40ce-8ee3-16c4b37c6163 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:28.117062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2cd0779-d7d0-40ce-8ee3-16c4b37c6163 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:28.117759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2cd0779-d7d0-40ce-8ee3-16c4b37c6163 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:28.119040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2cd0779-d7d0-40ce-8ee3-16c4b37c6163 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:28.623219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75ddbe49-09d8-48a5-a7e8-f3539f361d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:28.624440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75ddbe49-09d8-48a5-a7e8-f3539f361d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:28.635165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f2cd0779-d7d0-40ce-8ee3-16c4b37c6163 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:28.646225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f2cd0779-d7d0-40ce-8ee3-16c4b37c6163 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:28.647731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75ddbe49-09d8-48a5-a7e8-f3539f361d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:28.649431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f2cd0779-d7d0-40ce-8ee3-16c4b37c6163 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:28.651050 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f2cd0779-d7d0-40ce-8ee3-16c4b37c6163 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1567 microversion: 2.25 time: 0.553120 Aug 27 04:35:28.651678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75ddbe49-09d8-48a5-a7e8-f3539f361d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:28.651849 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 496/995] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:28 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1567 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:28.653682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75ddbe49-09d8-48a5-a7e8-f3539f361d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:28.656691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75ddbe49-09d8-48a5-a7e8-f3539f361d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:28.658378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75ddbe49-09d8-48a5-a7e8-f3539f361d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:28.663050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75ddbe49-09d8-48a5-a7e8-f3539f361d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:28.760748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3a25464f-41d7-4bfe-ae2d-41e53a9409c4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:28.764896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3a25464f-41d7-4bfe-ae2d-41e53a9409c4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:28.768235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:28.786671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a25464f-41d7-4bfe-ae2d-41e53a9409c4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:28.793627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a25464f-41d7-4bfe-ae2d-41e53a9409c4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:28.796040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a25464f-41d7-4bfe-ae2d-41e53a9409c4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:28.797135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a25464f-41d7-4bfe-ae2d-41e53a9409c4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:28.800727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a25464f-41d7-4bfe-ae2d-41e53a9409c4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:28.803577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a25464f-41d7-4bfe-ae2d-41e53a9409c4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.131084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3a25464f-41d7-4bfe-ae2d-41e53a9409c4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:29.142571 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3a25464f-41d7-4bfe-ae2d-41e53a9409c4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1316 microversion: 2.1 time: 0.385653 Aug 27 04:35:29.146675 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 497/996] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:28 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:29.279048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75ddbe49-09d8-48a5-a7e8-f3539f361d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:29.291007 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75ddbe49-09d8-48a5-a7e8-f3539f361d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1469 microversion: 2.1 time: 0.675056 Aug 27 04:35:29.293883 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 500/997] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:28 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1469 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:29.313588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5bfc7d7c-ddb0-4e17-bc52-eb06dce7ae2a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:29.314235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5bfc7d7c-ddb0-4e17-bc52-eb06dce7ae2a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:29.325745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bfc7d7c-ddb0-4e17-bc52-eb06dce7ae2a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.326254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bfc7d7c-ddb0-4e17-bc52-eb06dce7ae2a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.328338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bfc7d7c-ddb0-4e17-bc52-eb06dce7ae2a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.329116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bfc7d7c-ddb0-4e17-bc52-eb06dce7ae2a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.329594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bfc7d7c-ddb0-4e17-bc52-eb06dce7ae2a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.330027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bfc7d7c-ddb0-4e17-bc52-eb06dce7ae2a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.431633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1482559566", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:29.527780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:35:29.634406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5bfc7d7c-ddb0-4e17-bc52-eb06dce7ae2a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:29.643182 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5bfc7d7c-ddb0-4e17-bc52-eb06dce7ae2a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.341394 Aug 27 04:35:29.651083 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 501/998] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:29 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:29.656795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69092e56-84db-40ea-9ed8-f3d72dd64777 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:29.661427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69092e56-84db-40ea-9ed8-f3d72dd64777 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:29.675995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69092e56-84db-40ea-9ed8-f3d72dd64777 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.681469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69092e56-84db-40ea-9ed8-f3d72dd64777 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.682131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69092e56-84db-40ea-9ed8-f3d72dd64777 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.683011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69092e56-84db-40ea-9ed8-f3d72dd64777 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.684998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69092e56-84db-40ea-9ed8-f3d72dd64777 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.685682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69092e56-84db-40ea-9ed8-f3d72dd64777 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.806549 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69092e56-84db-40ea-9ed8-f3d72dd64777 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "POST /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca/action" status: 204 len: 0 microversion: 2.1 time: 0.153890 Aug 27 04:35:29.807269 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 502/999] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:35:29 2022] POST /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca/action => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:35:29.813903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7db84e99-ff2e-4c5f-a2df-bbe6d2c026a1 req-4b4a6960-8032-4a38-882f-7f5c12deefb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993886de-4066-4da7-9768-ad92fdea6cc2", "name": "network-vif-unplugged", "status": "completed", "tag": "fe518eb7-32a5-415b-a705-ace010eb9348"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:29.827936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7db84e99-ff2e-4c5f-a2df-bbe6d2c026a1 req-4b4a6960-8032-4a38-882f-7f5c12deefb2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.829610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7db84e99-ff2e-4c5f-a2df-bbe6d2c026a1 req-4b4a6960-8032-4a38-882f-7f5c12deefb2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.830055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7db84e99-ff2e-4c5f-a2df-bbe6d2c026a1 req-4b4a6960-8032-4a38-882f-7f5c12deefb2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.866742 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7db84e99-ff2e-4c5f-a2df-bbe6d2c026a1 req-4b4a6960-8032-4a38-882f-7f5c12deefb2 service nova] Creating event network-vif-unplugged:fe518eb7-32a5-415b-a705-ace010eb9348 for instance 993886de-4066-4da7-9768-ad92fdea6cc2 on n-h1-854823-1 Aug 27 04:35:29.880027 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7db84e99-ff2e-4c5f-a2df-bbe6d2c026a1 req-4b4a6960-8032-4a38-882f-7f5c12deefb2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064765 Aug 27 04:35:29.881088 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 503/1000] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:29.886255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-533cc1db-b297-4adc-91af-6b4d498c7e41 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:29.886951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-533cc1db-b297-4adc-91af-6b4d498c7e41 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:29.899863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-533cc1db-b297-4adc-91af-6b4d498c7e41 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.900650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-533cc1db-b297-4adc-91af-6b4d498c7e41 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.901518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-533cc1db-b297-4adc-91af-6b4d498c7e41 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.902542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-533cc1db-b297-4adc-91af-6b4d498c7e41 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.903444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-533cc1db-b297-4adc-91af-6b4d498c7e41 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.904255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-533cc1db-b297-4adc-91af-6b4d498c7e41 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.917102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:35:29.918177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:35:29.918903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:35:29.919553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:35:29.920250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:35:29.935826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.936432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.944939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.948680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.948680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.948680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.985576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Getting quotas for project 3873cb4810d840ac93518952196fd52b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:35:30.011944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Getting quotas for user 23eec6b7eb8b4ad897873c027e095b8d and project 3873cb4810d840ac93518952196fd52b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:35:30.047616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:35:30.052208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:35:30.186866 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9f61be76-ff37-4190-824e-eeae38703c9e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.038811 Aug 27 04:35:30.190355 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 498/1001] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:35:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:35:30.207895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7a9b409-37ac-42cb-8bc9-f11b6edc927c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:30.208520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c7a9b409-37ac-42cb-8bc9-f11b6edc927c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:30.238064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7a9b409-37ac-42cb-8bc9-f11b6edc927c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:30.238567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7a9b409-37ac-42cb-8bc9-f11b6edc927c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:30.239000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7a9b409-37ac-42cb-8bc9-f11b6edc927c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:30.239705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7a9b409-37ac-42cb-8bc9-f11b6edc927c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:30.240161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7a9b409-37ac-42cb-8bc9-f11b6edc927c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:30.240606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7a9b409-37ac-42cb-8bc9-f11b6edc927c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:30.423349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-533cc1db-b297-4adc-91af-6b4d498c7e41 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:30.435168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-533cc1db-b297-4adc-91af-6b4d498c7e41 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:30.438184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-533cc1db-b297-4adc-91af-6b4d498c7e41 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:30.440831 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-533cc1db-b297-4adc-91af-6b4d498c7e41 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1567 microversion: 2.25 time: 0.558386 Aug 27 04:35:30.461497 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 504/1002] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:29 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1567 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:30.469049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d3ada0b3-b1bb-4688-8cbe-cf485eca283f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:30.469668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d3ada0b3-b1bb-4688-8cbe-cf485eca283f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:30.478202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ada0b3-b1bb-4688-8cbe-cf485eca283f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:30.478780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ada0b3-b1bb-4688-8cbe-cf485eca283f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:30.479530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ada0b3-b1bb-4688-8cbe-cf485eca283f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:30.480814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ada0b3-b1bb-4688-8cbe-cf485eca283f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:30.481874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ada0b3-b1bb-4688-8cbe-cf485eca283f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:30.482704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ada0b3-b1bb-4688-8cbe-cf485eca283f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:30.656461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3ada0b3-b1bb-4688-8cbe-cf485eca283f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:30.667493 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d3ada0b3-b1bb-4688-8cbe-cf485eca283f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1466 microversion: 2.1 time: 0.204740 Aug 27 04:35:30.668262 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 505/1003] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:30 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1466 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:30.672918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1013524322", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:30.742077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:35:30.990581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:35:30.991519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:35:30.992255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:35:30.994635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:35:30.996202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:35:31.017021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:31.017531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:31.018046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:31.019103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:31.019445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:31.020439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:31.041883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Getting quotas for project 3873cb4810d840ac93518952196fd52b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:35:31.047149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Getting quotas for user 23eec6b7eb8b4ad897873c027e095b8d and project 3873cb4810d840ac93518952196fd52b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:35:31.066187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:35:31.068921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:35:31.122204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c7a9b409-37ac-42cb-8bc9-f11b6edc927c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:31.134527 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7a9b409-37ac-42cb-8bc9-f11b6edc927c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1469 microversion: 2.1 time: 0.931064 Aug 27 04:35:31.138269 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-872cf609-ce30-422f-99fd-bc02667b11e8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.469063 Aug 27 04:35:31.138761 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 499/1004] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:30 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1469 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:31.144059 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 506/1005] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:35:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:35:31.150991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dce2cd56-f20a-4819-8b89-8b4093588127 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:31.152049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dce2cd56-f20a-4819-8b89-8b4093588127 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:31.165847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7012c006-f2e7-4860-aa8f-751ecd7d2111 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:31.171975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7012c006-f2e7-4860-aa8f-751ecd7d2111 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:31.179848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dce2cd56-f20a-4819-8b89-8b4093588127 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:31.181202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dce2cd56-f20a-4819-8b89-8b4093588127 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:31.185892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dce2cd56-f20a-4819-8b89-8b4093588127 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:31.187748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dce2cd56-f20a-4819-8b89-8b4093588127 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:31.189407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dce2cd56-f20a-4819-8b89-8b4093588127 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:31.190162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7012c006-f2e7-4860-aa8f-751ecd7d2111 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:31.191404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dce2cd56-f20a-4819-8b89-8b4093588127 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:31.192046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7012c006-f2e7-4860-aa8f-751ecd7d2111 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:31.193032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7012c006-f2e7-4860-aa8f-751ecd7d2111 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:31.198288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7012c006-f2e7-4860-aa8f-751ecd7d2111 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:31.199013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7012c006-f2e7-4860-aa8f-751ecd7d2111 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:31.199649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7012c006-f2e7-4860-aa8f-751ecd7d2111 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:31.420565 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7012c006-f2e7-4860-aa8f-751ecd7d2111 tempest-ServersOnMultiNodesTest-615199068 tempest-ServersOnMultiNodesTest-615199068-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1617 microversion: 2.1 time: 0.274716 Aug 27 04:35:31.422165 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 507/1006] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:31 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1617 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:31.426984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2717d39a-aa6c-4ec1-b593-d475e7b59f45 req-a1f32ec1-6e00-40f0-afa3-e0951fa6088e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011ab45e-31fa-4ba7-b135-d222e7a725ca", "name": "network-vif-plugged", "status": "completed", "tag": "3b944205-dafa-4b20-992c-6ddf5b0ca271"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:31.444165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2717d39a-aa6c-4ec1-b593-d475e7b59f45 req-a1f32ec1-6e00-40f0-afa3-e0951fa6088e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:31.447471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2717d39a-aa6c-4ec1-b593-d475e7b59f45 req-a1f32ec1-6e00-40f0-afa3-e0951fa6088e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:31.448169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2717d39a-aa6c-4ec1-b593-d475e7b59f45 req-a1f32ec1-6e00-40f0-afa3-e0951fa6088e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:31.476094 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2717d39a-aa6c-4ec1-b593-d475e7b59f45 req-a1f32ec1-6e00-40f0-afa3-e0951fa6088e service nova] Creating event network-vif-plugged:3b944205-dafa-4b20-992c-6ddf5b0ca271 for instance 011ab45e-31fa-4ba7-b135-d222e7a725ca on n-h1-854823-1 Aug 27 04:35:31.492565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-2717d39a-aa6c-4ec1-b593-d475e7b59f45 req-a1f32ec1-6e00-40f0-afa3-e0951fa6088e service nova] Instance 011ab45e-31fa-4ba7-b135-d222e7a725ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:35:31.505669 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2717d39a-aa6c-4ec1-b593-d475e7b59f45 req-a1f32ec1-6e00-40f0-afa3-e0951fa6088e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082338 Aug 27 04:35:31.506386 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 508/1007] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:31.512454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70eaec46-f282-404b-b670-055f82c6b6da tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:31.519239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-70eaec46-f282-404b-b670-055f82c6b6da tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:31.650455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-70eaec46-f282-404b-b670-055f82c6b6da tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:31.664029 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-70eaec46-f282-404b-b670-055f82c6b6da tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1214 microversion: 2.1 time: 0.153343 Aug 27 04:35:31.666170 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 509/1008] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:31 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:31.676919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50c2d0fa-73e3-4d21-855f-cd992c0e387f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:31.677850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50c2d0fa-73e3-4d21-855f-cd992c0e387f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:31.710309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50c2d0fa-73e3-4d21-855f-cd992c0e387f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:31.710825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50c2d0fa-73e3-4d21-855f-cd992c0e387f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:31.711267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50c2d0fa-73e3-4d21-855f-cd992c0e387f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:31.711990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50c2d0fa-73e3-4d21-855f-cd992c0e387f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:31.712454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50c2d0fa-73e3-4d21-855f-cd992c0e387f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:31.717167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50c2d0fa-73e3-4d21-855f-cd992c0e387f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:31.762821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dce2cd56-f20a-4819-8b89-8b4093588127 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:31.771964 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dce2cd56-f20a-4819-8b89-8b4093588127 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.631808 Aug 27 04:35:31.784924 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 500/1009] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:31 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:31.788297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9ecb827b-0216-4001-9f8f-cdfe939a20d3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:31.791030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9ecb827b-0216-4001-9f8f-cdfe939a20d3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:31.800947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50c2d0fa-73e3-4d21-855f-cd992c0e387f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:35:31.804455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ecb827b-0216-4001-9f8f-cdfe939a20d3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:31.816830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ecb827b-0216-4001-9f8f-cdfe939a20d3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:31.817469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ecb827b-0216-4001-9f8f-cdfe939a20d3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:31.818195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ecb827b-0216-4001-9f8f-cdfe939a20d3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:31.818733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ecb827b-0216-4001-9f8f-cdfe939a20d3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:31.819196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ecb827b-0216-4001-9f8f-cdfe939a20d3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:31.943830 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50c2d0fa-73e3-4d21-855f-cd992c0e387f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 204 len: 0 microversion: 2.1 time: 0.275697 Aug 27 04:35:31.948258 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 510/1010] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:35:31 2022] DELETE /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:35:31.960062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7533c2ce-1346-48b0-8341-144f1391ef75 req-b8eafcb3-0a61-488a-93bf-72fb25d6a50c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993886de-4066-4da7-9768-ad92fdea6cc2", "tag": "fe518eb7-32a5-415b-a705-ace010eb9348"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:31.970930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7533c2ce-1346-48b0-8341-144f1391ef75 req-b8eafcb3-0a61-488a-93bf-72fb25d6a50c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:31.970930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7533c2ce-1346-48b0-8341-144f1391ef75 req-b8eafcb3-0a61-488a-93bf-72fb25d6a50c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:31.970930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7533c2ce-1346-48b0-8341-144f1391ef75 req-b8eafcb3-0a61-488a-93bf-72fb25d6a50c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:31.981216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:31.990138 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7533c2ce-1346-48b0-8341-144f1391ef75 req-b8eafcb3-0a61-488a-93bf-72fb25d6a50c service nova] Creating event network-changed:fe518eb7-32a5-415b-a705-ace010eb9348 for instance 993886de-4066-4da7-9768-ad92fdea6cc2 on n-h1-854823-1 Aug 27 04:35:31.996494 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7533c2ce-1346-48b0-8341-144f1391ef75 req-b8eafcb3-0a61-488a-93bf-72fb25d6a50c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046700 Aug 27 04:35:31.997588 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 511/1011] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:32.005246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-17908769-6c59-458b-8d3b-0e4308183b5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:32.005967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-17908769-6c59-458b-8d3b-0e4308183b5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:32.013351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17908769-6c59-458b-8d3b-0e4308183b5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:32.014662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17908769-6c59-458b-8d3b-0e4308183b5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:32.014662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17908769-6c59-458b-8d3b-0e4308183b5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:32.025542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17908769-6c59-458b-8d3b-0e4308183b5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:32.028440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17908769-6c59-458b-8d3b-0e4308183b5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:32.029631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17908769-6c59-458b-8d3b-0e4308183b5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:32.100787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9ecb827b-0216-4001-9f8f-cdfe939a20d3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:32.114164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9ecb827b-0216-4001-9f8f-cdfe939a20d3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:32.115668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9ecb827b-0216-4001-9f8f-cdfe939a20d3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:32.117190 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9ecb827b-0216-4001-9f8f-cdfe939a20d3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1567 microversion: 2.25 time: 0.338312 Aug 27 04:35:32.118827 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 501/1012] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:31 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1567 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:32.160693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-765b9fc7-ea62-49b4-9b46-f07fa644e159 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:32.162183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-765b9fc7-ea62-49b4-9b46-f07fa644e159 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:32.169486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-765b9fc7-ea62-49b4-9b46-f07fa644e159 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:32.170214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-765b9fc7-ea62-49b4-9b46-f07fa644e159 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:32.170848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-765b9fc7-ea62-49b4-9b46-f07fa644e159 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:32.171979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-765b9fc7-ea62-49b4-9b46-f07fa644e159 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:32.172669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-765b9fc7-ea62-49b4-9b46-f07fa644e159 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:32.173429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-765b9fc7-ea62-49b4-9b46-f07fa644e159 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:32.210289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-17908769-6c59-458b-8d3b-0e4308183b5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:32.218432 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-17908769-6c59-458b-8d3b-0e4308183b5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1472 microversion: 2.1 time: 0.219650 Aug 27 04:35:32.220348 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 512/1013] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:31 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:32.480702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-765b9fc7-ea62-49b4-9b46-f07fa644e159 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:32.489409 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-765b9fc7-ea62-49b4-9b46-f07fa644e159 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1469 microversion: 2.1 time: 0.333341 Aug 27 04:35:32.493435 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 502/1014] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:32 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1469 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:32.688713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ab12ffa-5c8d-4bb0-8aff-84ffa5828839 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:32.690058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ab12ffa-5c8d-4bb0-8aff-84ffa5828839 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:32.700889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ab12ffa-5c8d-4bb0-8aff-84ffa5828839 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:32.701761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ab12ffa-5c8d-4bb0-8aff-84ffa5828839 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:32.702423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ab12ffa-5c8d-4bb0-8aff-84ffa5828839 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:32.703439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ab12ffa-5c8d-4bb0-8aff-84ffa5828839 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:32.704300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ab12ffa-5c8d-4bb0-8aff-84ffa5828839 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:32.706042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ab12ffa-5c8d-4bb0-8aff-84ffa5828839 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:32.797861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f6fcf726-69e1-48dd-b6db-1e11a9182137 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:32.798482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f6fcf726-69e1-48dd-b6db-1e11a9182137 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:32.805357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6fcf726-69e1-48dd-b6db-1e11a9182137 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:32.816046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6fcf726-69e1-48dd-b6db-1e11a9182137 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:32.816812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6fcf726-69e1-48dd-b6db-1e11a9182137 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:32.817567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6fcf726-69e1-48dd-b6db-1e11a9182137 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:32.818031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6fcf726-69e1-48dd-b6db-1e11a9182137 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:32.818462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6fcf726-69e1-48dd-b6db-1e11a9182137 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:32.823773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ab12ffa-5c8d-4bb0-8aff-84ffa5828839 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:32.841853 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ab12ffa-5c8d-4bb0-8aff-84ffa5828839 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1266 microversion: 2.1 time: 0.157884 Aug 27 04:35:32.844921 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 513/1015] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:32 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:33.108240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f6fcf726-69e1-48dd-b6db-1e11a9182137 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:33.122491 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f6fcf726-69e1-48dd-b6db-1e11a9182137 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.328453 Aug 27 04:35:33.129182 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 503/1016] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:32 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:33.158741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3dda1480-ae20-49cb-8472-f0263b7d936c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:33.159246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3dda1480-ae20-49cb-8472-f0263b7d936c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:33.166813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dda1480-ae20-49cb-8472-f0263b7d936c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:33.167543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dda1480-ae20-49cb-8472-f0263b7d936c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:33.168158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dda1480-ae20-49cb-8472-f0263b7d936c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:33.170047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dda1480-ae20-49cb-8472-f0263b7d936c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:33.171042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dda1480-ae20-49cb-8472-f0263b7d936c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:33.171893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dda1480-ae20-49cb-8472-f0263b7d936c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:33.260786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-db53e8f3-269b-4103-a3a7-f4c85288f4ab tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:33.262394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-db53e8f3-269b-4103-a3a7-f4c85288f4ab tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:33.266580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:33.273836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db53e8f3-269b-4103-a3a7-f4c85288f4ab tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:33.274996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db53e8f3-269b-4103-a3a7-f4c85288f4ab tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:33.275625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db53e8f3-269b-4103-a3a7-f4c85288f4ab tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:33.277185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db53e8f3-269b-4103-a3a7-f4c85288f4ab tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:33.277820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db53e8f3-269b-4103-a3a7-f4c85288f4ab tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:33.278429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db53e8f3-269b-4103-a3a7-f4c85288f4ab tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:33.544819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3dda1480-ae20-49cb-8472-f0263b7d936c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:33.554356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3dda1480-ae20-49cb-8472-f0263b7d936c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:33.555798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3dda1480-ae20-49cb-8472-f0263b7d936c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:33.564366 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3dda1480-ae20-49cb-8472-f0263b7d936c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1567 microversion: 2.25 time: 0.409501 Aug 27 04:35:33.565049 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 514/1017] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:33 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1567 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:33.578449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-db53e8f3-269b-4103-a3a7-f4c85288f4ab tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:33.582379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34c4f9f5-5a56-440b-a153-144cd63e9bf6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:33.583221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34c4f9f5-5a56-440b-a153-144cd63e9bf6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:33.589222 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-db53e8f3-269b-4103-a3a7-f4c85288f4ab tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1472 microversion: 2.1 time: 0.334335 Aug 27 04:35:33.589818 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 504/1018] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:33 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1472 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:33.594011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34c4f9f5-5a56-440b-a153-144cd63e9bf6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:33.594937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34c4f9f5-5a56-440b-a153-144cd63e9bf6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:33.595882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34c4f9f5-5a56-440b-a153-144cd63e9bf6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:33.597251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34c4f9f5-5a56-440b-a153-144cd63e9bf6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:33.597764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34c4f9f5-5a56-440b-a153-144cd63e9bf6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:33.598537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34c4f9f5-5a56-440b-a153-144cd63e9bf6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:33.663086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1392815923", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "e70262b8-a762-4feb-8fb3-236b3c41daf8"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:33.729385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] validate_networks() for [('e70262b8-a762-4feb-8fb3-236b3c41daf8', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:35:33.899179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34c4f9f5-5a56-440b-a153-144cd63e9bf6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:33.913048 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34c4f9f5-5a56-440b-a153-144cd63e9bf6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1469 microversion: 2.1 time: 0.343823 Aug 27 04:35:33.915643 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 515/1019] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:33 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1469 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:33.927455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d166d51c-2be7-4dc0-a6a5-15ad23208e56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:33.928242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d166d51c-2be7-4dc0-a6a5-15ad23208e56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:33.945360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d166d51c-2be7-4dc0-a6a5-15ad23208e56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:33.947040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d166d51c-2be7-4dc0-a6a5-15ad23208e56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:33.950293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d166d51c-2be7-4dc0-a6a5-15ad23208e56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:33.952253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d166d51c-2be7-4dc0-a6a5-15ad23208e56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:33.955149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d166d51c-2be7-4dc0-a6a5-15ad23208e56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:33.956983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d166d51c-2be7-4dc0-a6a5-15ad23208e56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:34.076913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d166d51c-2be7-4dc0-a6a5-15ad23208e56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:34.089389 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d166d51c-2be7-4dc0-a6a5-15ad23208e56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1284 microversion: 2.1 time: 0.172488 Aug 27 04:35:34.090656 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 516/1020] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:33 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:34.145680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f560c097-ca71-4c15-87d7-31342cc5cafb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:34.146717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f560c097-ca71-4c15-87d7-31342cc5cafb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:34.155956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:34.157679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f560c097-ca71-4c15-87d7-31342cc5cafb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:34.158276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f560c097-ca71-4c15-87d7-31342cc5cafb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:34.158808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f560c097-ca71-4c15-87d7-31342cc5cafb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:34.161245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f560c097-ca71-4c15-87d7-31342cc5cafb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:34.163405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f560c097-ca71-4c15-87d7-31342cc5cafb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:34.164059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f560c097-ca71-4c15-87d7-31342cc5cafb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:34.529918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f560c097-ca71-4c15-87d7-31342cc5cafb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:34.542790 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f560c097-ca71-4c15-87d7-31342cc5cafb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.400601 Aug 27 04:35:34.554539 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 517/1021] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:34 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:34.589399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79881c52-2e2e-4f14-af83-0d0ee52e1790 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:34.590256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-79881c52-2e2e-4f14-af83-0d0ee52e1790 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:34.602606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79881c52-2e2e-4f14-af83-0d0ee52e1790 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:34.603626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79881c52-2e2e-4f14-af83-0d0ee52e1790 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:34.605145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79881c52-2e2e-4f14-af83-0d0ee52e1790 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:34.612882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79881c52-2e2e-4f14-af83-0d0ee52e1790 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:34.613622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79881c52-2e2e-4f14-af83-0d0ee52e1790 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:34.614175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79881c52-2e2e-4f14-af83-0d0ee52e1790 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:35.014246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-79881c52-2e2e-4f14-af83-0d0ee52e1790 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:35.028883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-79881c52-2e2e-4f14-af83-0d0ee52e1790 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:35.031906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-79881c52-2e2e-4f14-af83-0d0ee52e1790 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:35.034369 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-79881c52-2e2e-4f14-af83-0d0ee52e1790 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1567 microversion: 2.25 time: 0.449521 Aug 27 04:35:35.035110 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 518/1022] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:34 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1567 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:35:35.053253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7db0476a-fda0-4948-9c48-e6c27a8cf98f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:35.054464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7db0476a-fda0-4948-9c48-e6c27a8cf98f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:35.062626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7db0476a-fda0-4948-9c48-e6c27a8cf98f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:35.063378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7db0476a-fda0-4948-9c48-e6c27a8cf98f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:35.064198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7db0476a-fda0-4948-9c48-e6c27a8cf98f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:35.065170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7db0476a-fda0-4948-9c48-e6c27a8cf98f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:35.066363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7db0476a-fda0-4948-9c48-e6c27a8cf98f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:35.066991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7db0476a-fda0-4948-9c48-e6c27a8cf98f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:35.153521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:35:35.157250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:35:35.161105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:35:35.167674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:35:35.168403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:35:35.194224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:35.195095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:35.196560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:35.199863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:35.202819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:35.203869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:35.248664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Getting quotas for project 67b142dea11c4e7d921bbb7dd5e543be. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:35:35.259724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Getting quotas for user 8213929124384914aebc5e05572cc1ed and project 67b142dea11c4e7d921bbb7dd5e543be. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:35:35.281632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:35:35.284938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:35:35.361328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7db0476a-fda0-4948-9c48-e6c27a8cf98f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:35.363276 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2ad2132c-b640-4a45-8e84-84798c92340a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.772396 Aug 27 04:35:35.364453 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 505/1023] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:35:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:35:35.371232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53fa2aa8-4b95-4c87-a73e-0f1c8b0ec39d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:35.371825 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7db0476a-fda0-4948-9c48-e6c27a8cf98f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1472 microversion: 2.1 time: 0.334176 Aug 27 04:35:35.372368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-53fa2aa8-4b95-4c87-a73e-0f1c8b0ec39d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:35.394901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53fa2aa8-4b95-4c87-a73e-0f1c8b0ec39d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:35.397275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53fa2aa8-4b95-4c87-a73e-0f1c8b0ec39d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:35.399669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53fa2aa8-4b95-4c87-a73e-0f1c8b0ec39d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:35.400973 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 519/1024] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:35 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1472 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:35.401781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53fa2aa8-4b95-4c87-a73e-0f1c8b0ec39d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:35.402297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53fa2aa8-4b95-4c87-a73e-0f1c8b0ec39d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:35.402740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53fa2aa8-4b95-4c87-a73e-0f1c8b0ec39d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:35.433088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a451a66-1c9d-436f-87a6-be5ca8c5e0c1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:35.436073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a451a66-1c9d-436f-87a6-be5ca8c5e0c1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:35.457984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a451a66-1c9d-436f-87a6-be5ca8c5e0c1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:35.458603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a451a66-1c9d-436f-87a6-be5ca8c5e0c1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:35.459744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a451a66-1c9d-436f-87a6-be5ca8c5e0c1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:35.460772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a451a66-1c9d-436f-87a6-be5ca8c5e0c1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:35.463144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a451a66-1c9d-436f-87a6-be5ca8c5e0c1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:35.465019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a451a66-1c9d-436f-87a6-be5ca8c5e0c1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:35.648657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1a451a66-1c9d-436f-87a6-be5ca8c5e0c1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:35.665997 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a451a66-1c9d-436f-87a6-be5ca8c5e0c1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1272 microversion: 2.1 time: 0.262323 Aug 27 04:35:35.673670 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 520/1025] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:35 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1272 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:35.689162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2d23dd6c-abb3-44c6-9441-17cb6b471dfe tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:35.689931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2d23dd6c-abb3-44c6-9441-17cb6b471dfe tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:35.800518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2d23dd6c-abb3-44c6-9441-17cb6b471dfe tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:35.810302 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2d23dd6c-abb3-44c6-9441-17cb6b471dfe tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1211 microversion: 2.1 time: 0.135226 Aug 27 04:35:35.811035 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 521/1026] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:35 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1211 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:35.831974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bc9ba4b-9190-4f7b-8d9c-2333bc88c171 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:35.832840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6bc9ba4b-9190-4f7b-8d9c-2333bc88c171 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:35.843536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bc9ba4b-9190-4f7b-8d9c-2333bc88c171 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:35.844144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bc9ba4b-9190-4f7b-8d9c-2333bc88c171 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:35.844785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bc9ba4b-9190-4f7b-8d9c-2333bc88c171 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:35.845431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bc9ba4b-9190-4f7b-8d9c-2333bc88c171 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:35.845961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bc9ba4b-9190-4f7b-8d9c-2333bc88c171 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:35.852251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bc9ba4b-9190-4f7b-8d9c-2333bc88c171 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:35.971101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53fa2aa8-4b95-4c87-a73e-0f1c8b0ec39d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:35.983561 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-53fa2aa8-4b95-4c87-a73e-0f1c8b0ec39d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1461 microversion: 2.1 time: 0.616328 Aug 27 04:35:35.985483 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 506/1027] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:35 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1461 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:35.997510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e87bb5fd-e6bc-42e0-b1d1-5b62382ecc36 req-834ac476-7e60-4472-87b9-09da9837e34e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "577250c7-f1ee-4541-b83e-131d0e21efea", "tag": "d4d0324a-726b-4962-b7dd-c7fd914520fe"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:36.021306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e87bb5fd-e6bc-42e0-b1d1-5b62382ecc36 req-834ac476-7e60-4472-87b9-09da9837e34e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:36.024302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e87bb5fd-e6bc-42e0-b1d1-5b62382ecc36 req-834ac476-7e60-4472-87b9-09da9837e34e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:36.025962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e87bb5fd-e6bc-42e0-b1d1-5b62382ecc36 req-834ac476-7e60-4472-87b9-09da9837e34e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:36.060712 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e87bb5fd-e6bc-42e0-b1d1-5b62382ecc36 req-834ac476-7e60-4472-87b9-09da9837e34e service nova] Creating event network-changed:d4d0324a-726b-4962-b7dd-c7fd914520fe for instance 577250c7-f1ee-4541-b83e-131d0e21efea on n-h2-854823-1 Aug 27 04:35:36.070494 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e87bb5fd-e6bc-42e0-b1d1-5b62382ecc36 req-834ac476-7e60-4472-87b9-09da9837e34e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083401 Aug 27 04:35:36.076930 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 507/1028] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:36.086951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-321e76ed-4228-4053-b396-90c99269d059 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:36.088038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-321e76ed-4228-4053-b396-90c99269d059 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:36.109805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-321e76ed-4228-4053-b396-90c99269d059 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:36.111428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-321e76ed-4228-4053-b396-90c99269d059 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:36.113130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-321e76ed-4228-4053-b396-90c99269d059 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:36.115058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-321e76ed-4228-4053-b396-90c99269d059 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:36.115997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-321e76ed-4228-4053-b396-90c99269d059 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:36.117019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-321e76ed-4228-4053-b396-90c99269d059 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:36.123723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:36.205202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6bc9ba4b-9190-4f7b-8d9c-2333bc88c171 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:36.245409 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6bc9ba4b-9190-4f7b-8d9c-2333bc88c171 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.433010 Aug 27 04:35:36.284759 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 522/1029] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:35 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:36.292775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c5d4bbd-c0c7-49bd-b0e6-6f900101ea95 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:36.293699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c5d4bbd-c0c7-49bd-b0e6-6f900101ea95 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:36.304040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c5d4bbd-c0c7-49bd-b0e6-6f900101ea95 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:36.304864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c5d4bbd-c0c7-49bd-b0e6-6f900101ea95 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:36.305466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c5d4bbd-c0c7-49bd-b0e6-6f900101ea95 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:36.306437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c5d4bbd-c0c7-49bd-b0e6-6f900101ea95 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:36.307118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c5d4bbd-c0c7-49bd-b0e6-6f900101ea95 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:36.307703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c5d4bbd-c0c7-49bd-b0e6-6f900101ea95 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:36.707139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c5d4bbd-c0c7-49bd-b0e6-6f900101ea95 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:36.729066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c5d4bbd-c0c7-49bd-b0e6-6f900101ea95 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:36.740145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c5d4bbd-c0c7-49bd-b0e6-6f900101ea95 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:36.744176 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c5d4bbd-c0c7-49bd-b0e6-6f900101ea95 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1567 microversion: 2.25 time: 0.457105 Aug 27 04:35:36.762152 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 523/1030] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:36 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1567 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:36.778898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cb2814a-0de8-4b5a-9e5c-78c5701933c8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:36.782444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2cb2814a-0de8-4b5a-9e5c-78c5701933c8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:36.796792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb2814a-0de8-4b5a-9e5c-78c5701933c8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:36.798538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb2814a-0de8-4b5a-9e5c-78c5701933c8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:36.800505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb2814a-0de8-4b5a-9e5c-78c5701933c8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:36.802256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb2814a-0de8-4b5a-9e5c-78c5701933c8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:36.805874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb2814a-0de8-4b5a-9e5c-78c5701933c8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:36.813929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb2814a-0de8-4b5a-9e5c-78c5701933c8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:36.880112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb2814a-0de8-4b5a-9e5c-78c5701933c8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:36.880993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb2814a-0de8-4b5a-9e5c-78c5701933c8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:36.881831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb2814a-0de8-4b5a-9e5c-78c5701933c8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:36.882509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-2cb2814a-0de8-4b5a-9e5c-78c5701933c8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lazy-loading 'fault' on Instance uuid 6cf9e280-2f92-4e36-8ba7-30aabc0b3108 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:37.005700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2cb2814a-0de8-4b5a-9e5c-78c5701933c8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:37.019165 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2cb2814a-0de8-4b5a-9e5c-78c5701933c8 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1306 microversion: 2.1 time: 0.254689 Aug 27 04:35:37.021857 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 524/1031] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:36 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1306 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:37.037845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-72ee5cd8-287c-4693-9e76-2ea8041fd14a req-5cfffdc3-f1f6-4303-b9af-bb84d243433e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf9e280-2f92-4e36-8ba7-30aabc0b3108", "name": "network-vif-deleted", "tag": "5824b24a-2e82-4209-b0e1-ff375cca9ebf"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:37.065806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-72ee5cd8-287c-4693-9e76-2ea8041fd14a req-5cfffdc3-f1f6-4303-b9af-bb84d243433e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:37.066532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-72ee5cd8-287c-4693-9e76-2ea8041fd14a req-5cfffdc3-f1f6-4303-b9af-bb84d243433e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:37.067781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-72ee5cd8-287c-4693-9e76-2ea8041fd14a req-5cfffdc3-f1f6-4303-b9af-bb84d243433e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:37.100079 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-72ee5cd8-287c-4693-9e76-2ea8041fd14a req-5cfffdc3-f1f6-4303-b9af-bb84d243433e service nova] Creating event network-vif-deleted:5824b24a-2e82-4209-b0e1-ff375cca9ebf for instance 6cf9e280-2f92-4e36-8ba7-30aabc0b3108 on n-h1-854823-1 Aug 27 04:35:37.109645 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-72ee5cd8-287c-4693-9e76-2ea8041fd14a req-5cfffdc3-f1f6-4303-b9af-bb84d243433e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086251 Aug 27 04:35:37.111735 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 525/1032] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:37.129393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c41fd03d-7f14-4655-b943-05f7ac06dde8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:37.133750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c41fd03d-7f14-4655-b943-05f7ac06dde8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:37.148289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c41fd03d-7f14-4655-b943-05f7ac06dde8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:37.149734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c41fd03d-7f14-4655-b943-05f7ac06dde8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:37.151739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c41fd03d-7f14-4655-b943-05f7ac06dde8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:37.152998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c41fd03d-7f14-4655-b943-05f7ac06dde8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:37.153498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c41fd03d-7f14-4655-b943-05f7ac06dde8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:37.153964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c41fd03d-7f14-4655-b943-05f7ac06dde8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:37.264694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-321e76ed-4228-4053-b396-90c99269d059 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:37.279070 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-321e76ed-4228-4053-b396-90c99269d059 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1461 microversion: 2.1 time: 1.200732 Aug 27 04:35:37.285599 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 508/1033] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:36 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1461 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:37.292129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-144cf91b-d5a2-4d8e-ab1c-778ee26fb872 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:37.297763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-144cf91b-d5a2-4d8e-ab1c-778ee26fb872 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:37.317923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-144cf91b-d5a2-4d8e-ab1c-778ee26fb872 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:37.318887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-144cf91b-d5a2-4d8e-ab1c-778ee26fb872 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:37.319121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-144cf91b-d5a2-4d8e-ab1c-778ee26fb872 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:37.319958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-144cf91b-d5a2-4d8e-ab1c-778ee26fb872 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:37.322034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-144cf91b-d5a2-4d8e-ab1c-778ee26fb872 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:37.322581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-144cf91b-d5a2-4d8e-ab1c-778ee26fb872 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:37.328723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c41fd03d-7f14-4655-b943-05f7ac06dde8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:37.340300 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c41fd03d-7f14-4655-b943-05f7ac06dde8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1272 microversion: 2.1 time: 0.225981 Aug 27 04:35:37.344373 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 526/1034] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:37 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1272 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:37.357049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da45362c-767f-4381-934c-f91c4e54b06e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:37.358015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da45362c-767f-4381-934c-f91c4e54b06e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:37.368782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da45362c-767f-4381-934c-f91c4e54b06e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:37.370321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da45362c-767f-4381-934c-f91c4e54b06e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:37.371738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da45362c-767f-4381-934c-f91c4e54b06e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:37.374840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da45362c-767f-4381-934c-f91c4e54b06e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:37.375966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da45362c-767f-4381-934c-f91c4e54b06e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:37.376646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da45362c-767f-4381-934c-f91c4e54b06e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:37.488432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-144cf91b-d5a2-4d8e-ab1c-778ee26fb872 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:37.496915 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-144cf91b-d5a2-4d8e-ab1c-778ee26fb872 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1263 microversion: 2.1 time: 0.209546 Aug 27 04:35:37.500210 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 509/1035] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:37 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1263 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:37.511490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9225956b-b6cd-4194-b6ad-f675013cab34 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Action: 'create', calling method: .version_select at 0x7f1f25e9bb80>, body: {"keypair": {"name": "tempest-keypair-1229991437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTa+jSNGe28LTNR3/0o5dnNZw5dakBsGpEnwy4/SUBqrRewp0CqWKmz81PIbo7tZzIRFY1elJbXDpvi5tiOu/7o+Lsh7zL7xj8L0oUrC8GU+2CQ7sjAxflZBuWLnZ2cUA=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:37.546728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-9225956b-b6cd-4194-b6ad-f675013cab34 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Getting quotas for project abfa50b6f05c4413b2a96f2490ac43a1. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:35:37.563159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-9225956b-b6cd-4194-b6ad-f675013cab34 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Getting quotas for user 7e6454ced7834bbdaeee89ccef19f510 and project abfa50b6f05c4413b2a96f2490ac43a1. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:35:37.582746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da45362c-767f-4381-934c-f91c4e54b06e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:37.591595 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da45362c-767f-4381-934c-f91c4e54b06e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.245469 Aug 27 04:35:37.592566 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 527/1036] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:37 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:37.635190 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9225956b-b6cd-4194-b6ad-f675013cab34 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133498 Aug 27 04:35:37.636118 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 510/1037] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:35:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:37.780585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3966c9d-c9be-49d9-8731-7319c9242d94 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:37.781676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b3966c9d-c9be-49d9-8731-7319c9242d94 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:37.789121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3966c9d-c9be-49d9-8731-7319c9242d94 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:37.789925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3966c9d-c9be-49d9-8731-7319c9242d94 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:37.790671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3966c9d-c9be-49d9-8731-7319c9242d94 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:37.791707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3966c9d-c9be-49d9-8731-7319c9242d94 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:37.792351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3966c9d-c9be-49d9-8731-7319c9242d94 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:37.794124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3966c9d-c9be-49d9-8731-7319c9242d94 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:37.996363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b3966c9d-c9be-49d9-8731-7319c9242d94 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:38.005571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b3966c9d-c9be-49d9-8731-7319c9242d94 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:38.007085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b3966c9d-c9be-49d9-8731-7319c9242d94 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:38.008555 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3966c9d-c9be-49d9-8731-7319c9242d94 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1567 microversion: 2.25 time: 0.233064 Aug 27 04:35:38.009187 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 528/1038] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:37 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:38.050091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0ae152e7-9907-4384-9000-8beb691b2136 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:38.050736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0ae152e7-9907-4384-9000-8beb691b2136 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:38.060461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ae152e7-9907-4384-9000-8beb691b2136 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:38.061497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ae152e7-9907-4384-9000-8beb691b2136 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:38.062930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ae152e7-9907-4384-9000-8beb691b2136 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:38.064007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ae152e7-9907-4384-9000-8beb691b2136 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:38.065935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ae152e7-9907-4384-9000-8beb691b2136 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:38.066543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ae152e7-9907-4384-9000-8beb691b2136 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:38.142671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ae152e7-9907-4384-9000-8beb691b2136 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:38.143803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ae152e7-9907-4384-9000-8beb691b2136 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:38.144855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ae152e7-9907-4384-9000-8beb691b2136 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:38.145337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-0ae152e7-9907-4384-9000-8beb691b2136 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lazy-loading 'fault' on Instance uuid 6cf9e280-2f92-4e36-8ba7-30aabc0b3108 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:38.212058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0ae152e7-9907-4384-9000-8beb691b2136 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:38.222646 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0ae152e7-9907-4384-9000-8beb691b2136 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 200 len: 1306 microversion: 2.1 time: 0.183141 Aug 27 04:35:38.225015 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 511/1039] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:38 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 1306 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:38.372271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-afc4c8be-3df2-4adf-b535-9d930202d8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:38.374015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-afc4c8be-3df2-4adf-b535-9d930202d8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:38.382270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc4c8be-3df2-4adf-b535-9d930202d8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:38.382855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc4c8be-3df2-4adf-b535-9d930202d8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:38.383362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc4c8be-3df2-4adf-b535-9d930202d8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:38.383981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc4c8be-3df2-4adf-b535-9d930202d8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:38.384434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc4c8be-3df2-4adf-b535-9d930202d8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:38.384964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc4c8be-3df2-4adf-b535-9d930202d8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:38.528356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8d3c003f-b88c-4b4f-9010-c43749dd0694 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:38.529028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8d3c003f-b88c-4b4f-9010-c43749dd0694 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:38.538328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d3c003f-b88c-4b4f-9010-c43749dd0694 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:38.538848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d3c003f-b88c-4b4f-9010-c43749dd0694 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:38.539383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d3c003f-b88c-4b4f-9010-c43749dd0694 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:38.540481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d3c003f-b88c-4b4f-9010-c43749dd0694 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:38.540992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d3c003f-b88c-4b4f-9010-c43749dd0694 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:38.541452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d3c003f-b88c-4b4f-9010-c43749dd0694 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:38.632686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-afc4c8be-3df2-4adf-b535-9d930202d8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:38.636628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:38.642446 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-afc4c8be-3df2-4adf-b535-9d930202d8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1314 microversion: 2.1 time: 0.277114 Aug 27 04:35:38.643683 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 529/1040] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:38 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:38.650182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff4765f0-eac0-4aa1-88d6-30bd049a4ae5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:38.651018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ff4765f0-eac0-4aa1-88d6-30bd049a4ae5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:38.659398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff4765f0-eac0-4aa1-88d6-30bd049a4ae5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:38.660028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff4765f0-eac0-4aa1-88d6-30bd049a4ae5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:38.660585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff4765f0-eac0-4aa1-88d6-30bd049a4ae5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:38.661389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff4765f0-eac0-4aa1-88d6-30bd049a4ae5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:38.662071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff4765f0-eac0-4aa1-88d6-30bd049a4ae5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:38.662849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff4765f0-eac0-4aa1-88d6-30bd049a4ae5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:38.699709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8d3c003f-b88c-4b4f-9010-c43749dd0694 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:38.711873 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8d3c003f-b88c-4b4f-9010-c43749dd0694 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1269 microversion: 2.1 time: 0.188465 Aug 27 04:35:38.712471 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 512/1041] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:38 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1269 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:38.974371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ff4765f0-eac0-4aa1-88d6-30bd049a4ae5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:38.983655 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff4765f0-eac0-4aa1-88d6-30bd049a4ae5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.338682 Aug 27 04:35:38.984484 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 530/1042] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:38 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:39.034509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-de20c1a4-3a1a-490c-b123-05c680a4febc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:39.035303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-de20c1a4-3a1a-490c-b123-05c680a4febc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:39.044184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de20c1a4-3a1a-490c-b123-05c680a4febc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:39.044861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de20c1a4-3a1a-490c-b123-05c680a4febc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:39.045419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de20c1a4-3a1a-490c-b123-05c680a4febc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:39.046580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de20c1a4-3a1a-490c-b123-05c680a4febc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:39.048311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de20c1a4-3a1a-490c-b123-05c680a4febc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:39.048998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de20c1a4-3a1a-490c-b123-05c680a4febc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:39.244298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e373d080-6a2a-47e4-8dce-dcf89cfa0b13 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:39.245199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e373d080-6a2a-47e4-8dce-dcf89cfa0b13 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6cf9e280-2f92-4e36-8ba7-30aabc0b3108] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:39.253046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e373d080-6a2a-47e4-8dce-dcf89cfa0b13 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:39.253551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e373d080-6a2a-47e4-8dce-dcf89cfa0b13 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:39.253987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e373d080-6a2a-47e4-8dce-dcf89cfa0b13 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:39.254949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e373d080-6a2a-47e4-8dce-dcf89cfa0b13 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:39.255888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e373d080-6a2a-47e4-8dce-dcf89cfa0b13 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:39.256643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e373d080-6a2a-47e4-8dce-dcf89cfa0b13 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:39.273284 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e373d080-6a2a-47e4-8dce-dcf89cfa0b13 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] HTTP exception thrown: Instance 6cf9e280-2f92-4e36-8ba7-30aabc0b3108 could not be found. Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e373d080-6a2a-47e4-8dce-dcf89cfa0b13 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Request method failure captured: Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 HTTP/1.1 Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5vZmCQoTpWfO2nVvghaAr6WQ7l0jSxgrsDU_f5pBjkwZR9vYzn-WSBKnKYlb4QrTThFlKQoSD6qMOG1RMxxH3EEGYmrkKAGkNv2QjvxwduOHa8oaP9JROieKflk83mA1Krxt2a8kMGRYbNuKy9a5hu87qF_uDiIUT5j6ZdX0CisgE Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:35:39.276739 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:35:39.278561 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:35:39.278561 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:39.278561 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:35:39.278561 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:39.278561 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:35:39.278561 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:35:39.278561 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:35:39.278561 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cc8cb8eea83f45c1bb06328e31c960e7 Aug 27 04:35:39.278561 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:35:39.278561 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:35:39.278561 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 6cf9e280-2f92-4e36-8ba7-30aabc0b3108 could not be found. Aug 27 04:35:39.278561 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '6cf9e280-2f92-4e36-8ba7-30aabc0b3108'} Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf9e280-2f92-4e36-8ba7-30aabc0b3108 could not be found. Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:35:39.280043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf9e280-2f92-4e36-8ba7-30aabc0b3108 could not be found. Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf9e280-2f92-4e36-8ba7-30aabc0b3108 could not be found. Aug 27 04:35:39.281967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:39.284817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e373d080-6a2a-47e4-8dce-dcf89cfa0b13 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Returning 404 to user: Instance 6cf9e280-2f92-4e36-8ba7-30aabc0b3108 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:35:39.285874 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e373d080-6a2a-47e4-8dce-dcf89cfa0b13 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108" status: 404 len: 111 microversion: 2.1 time: 0.045655 Aug 27 04:35:39.286649 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 531/1043] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:39 2022] GET /compute/v2.1/servers/6cf9e280-2f92-4e36-8ba7-30aabc0b3108 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:35:39.294890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-100c7983-7f48-4409-a259-983a0814e445 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:39.295622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-100c7983-7f48-4409-a259-983a0814e445 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:39.303895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-100c7983-7f48-4409-a259-983a0814e445 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:39.304484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-100c7983-7f48-4409-a259-983a0814e445 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:39.305062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-100c7983-7f48-4409-a259-983a0814e445 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:39.306538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-100c7983-7f48-4409-a259-983a0814e445 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:39.307064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-100c7983-7f48-4409-a259-983a0814e445 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:39.307560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-100c7983-7f48-4409-a259-983a0814e445 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:39.340889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-100c7983-7f48-4409-a259-983a0814e445 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:35:39.456150 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-100c7983-7f48-4409-a259-983a0814e445 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 204 len: 0 microversion: 2.1 time: 0.164199 Aug 27 04:35:39.460559 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 532/1044] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:35:39 2022] DELETE /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:35:39.467398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b93e1a0-e009-4e84-82fc-811c98c0d268 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:39.468177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b93e1a0-e009-4e84-82fc-811c98c0d268 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:39.479373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b93e1a0-e009-4e84-82fc-811c98c0d268 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:39.480676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b93e1a0-e009-4e84-82fc-811c98c0d268 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:39.481454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b93e1a0-e009-4e84-82fc-811c98c0d268 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:39.483309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b93e1a0-e009-4e84-82fc-811c98c0d268 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:39.484181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b93e1a0-e009-4e84-82fc-811c98c0d268 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:39.488044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b93e1a0-e009-4e84-82fc-811c98c0d268 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:39.500743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-de20c1a4-3a1a-490c-b123-05c680a4febc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:39.519989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-de20c1a4-3a1a-490c-b123-05c680a4febc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:39.521978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-de20c1a4-3a1a-490c-b123-05c680a4febc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:39.523564 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-de20c1a4-3a1a-490c-b123-05c680a4febc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1567 microversion: 2.25 time: 0.494791 Aug 27 04:35:39.547763 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 513/1045] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:39 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1567 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:39.663475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ffc56049-2f11-48e7-ac1b-c3b4e1703152 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:39.664113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ffc56049-2f11-48e7-ac1b-c3b4e1703152 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:39.673068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc56049-2f11-48e7-ac1b-c3b4e1703152 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:39.673787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc56049-2f11-48e7-ac1b-c3b4e1703152 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:39.674687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc56049-2f11-48e7-ac1b-c3b4e1703152 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:39.677652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc56049-2f11-48e7-ac1b-c3b4e1703152 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:39.678321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc56049-2f11-48e7-ac1b-c3b4e1703152 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:39.678935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc56049-2f11-48e7-ac1b-c3b4e1703152 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:39.769167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b93e1a0-e009-4e84-82fc-811c98c0d268 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:39.781624 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b93e1a0-e009-4e84-82fc-811c98c0d268 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1472 microversion: 2.1 time: 0.318905 Aug 27 04:35:39.782761 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 533/1046] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:39 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1472 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:39.802555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b6fa644d-942e-4763-9f28-5e522a53b01d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:39.803311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b6fa644d-942e-4763-9f28-5e522a53b01d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:39.810807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6fa644d-942e-4763-9f28-5e522a53b01d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:39.811392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6fa644d-942e-4763-9f28-5e522a53b01d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:39.811893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6fa644d-942e-4763-9f28-5e522a53b01d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:39.812696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6fa644d-942e-4763-9f28-5e522a53b01d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:39.813227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6fa644d-942e-4763-9f28-5e522a53b01d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:39.813719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6fa644d-942e-4763-9f28-5e522a53b01d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:40.007059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ffc56049-2f11-48e7-ac1b-c3b4e1703152 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:40.020080 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ffc56049-2f11-48e7-ac1b-c3b4e1703152 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1314 microversion: 2.1 time: 0.359564 Aug 27 04:35:40.023887 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 514/1047] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:39 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:40.027035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b6fa644d-942e-4763-9f28-5e522a53b01d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:40.040604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2764e124-44e6-400c-a324-7298a13e2cc9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:40.042397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2764e124-44e6-400c-a324-7298a13e2cc9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:40.048473 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b6fa644d-942e-4763-9f28-5e522a53b01d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1311 microversion: 2.1 time: 0.244517 Aug 27 04:35:40.050418 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 534/1048] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:39 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1311 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:40.070221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2764e124-44e6-400c-a324-7298a13e2cc9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:40.070985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2764e124-44e6-400c-a324-7298a13e2cc9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:40.071432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2764e124-44e6-400c-a324-7298a13e2cc9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:40.072152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2764e124-44e6-400c-a324-7298a13e2cc9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:40.072648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2764e124-44e6-400c-a324-7298a13e2cc9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:40.073631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2764e124-44e6-400c-a324-7298a13e2cc9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:40.163276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7154d7eb-b976-43eb-9370-3e7ab9944660 req-7c74ffde-8572-4eb8-a16d-e576daae5cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9f7532-3523-4bb1-a4a2-94349c6d6987", "tag": "4cb160f5-11d2-482c-a21f-4f0aea664bef"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:40.178499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7154d7eb-b976-43eb-9370-3e7ab9944660 req-7c74ffde-8572-4eb8-a16d-e576daae5cd2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:40.178900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7154d7eb-b976-43eb-9370-3e7ab9944660 req-7c74ffde-8572-4eb8-a16d-e576daae5cd2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:40.179326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7154d7eb-b976-43eb-9370-3e7ab9944660 req-7c74ffde-8572-4eb8-a16d-e576daae5cd2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:40.194113 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7154d7eb-b976-43eb-9370-3e7ab9944660 req-7c74ffde-8572-4eb8-a16d-e576daae5cd2 service nova] Creating event network-changed:4cb160f5-11d2-482c-a21f-4f0aea664bef for instance 3d9f7532-3523-4bb1-a4a2-94349c6d6987 on n-h2-854823-1 Aug 27 04:35:40.199033 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7154d7eb-b976-43eb-9370-3e7ab9944660 req-7c74ffde-8572-4eb8-a16d-e576daae5cd2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040356 Aug 27 04:35:40.199969 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 535/1049] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:40.276234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2dabc33e-183d-4a53-9441-e913553d5722 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Calling method '.version_select at 0x7f1f21a62940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:40.280150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dabc33e-183d-4a53-9441-e913553d5722 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:40.280881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dabc33e-183d-4a53-9441-e913553d5722 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:40.281371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dabc33e-183d-4a53-9441-e913553d5722 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:40.292038 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2dabc33e-183d-4a53-9441-e913553d5722 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.019961 Aug 27 04:35:40.293012 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 536/1050] 10.222.0.79 () {58 vars in 1143 bytes} [Sat Aug 27 04:35:40 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:40.312337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8bb61a94-74a8-493f-ad21-ee3aac90048c tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:40.319936 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8bb61a94-74a8-493f-ad21-ee3aac90048c tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012027 Aug 27 04:35:40.320507 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 537/1051] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:35:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:40.332391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69d1d812-a2c5-4ee0-bb81-41026e618232 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1836291313", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:40.350443 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69d1d812-a2c5-4ee0-bb81-41026e618232 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.022348 Aug 27 04:35:40.357355 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 538/1052] 10.222.0.79 () {60 vars in 1146 bytes} [Sat Aug 27 04:35:40 2022] POST /compute/v2.1/flavors => generated 499 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:40.362415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-19092abe-1688-4d7b-9308-bf345fc3befb tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:40.372274 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-19092abe-1688-4d7b-9308-bf345fc3befb tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013496 Aug 27 04:35:40.378049 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 539/1053] 10.222.0.79 () {58 vars in 1182 bytes} [Sat Aug 27 04:35:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:35:40.381653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2764e124-44e6-400c-a324-7298a13e2cc9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:40.399854 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2764e124-44e6-400c-a324-7298a13e2cc9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.377400 Aug 27 04:35:40.413487 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 515/1054] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:40 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:40.504244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-599539853", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "919800fe-1d2c-4a01-8922-75552dca4a0c"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:40.554579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fb78ca16-412a-4c95-bedb-9a6c5375e5dd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:40.555192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fb78ca16-412a-4c95-bedb-9a6c5375e5dd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:40.557906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:35:40.561831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb78ca16-412a-4c95-bedb-9a6c5375e5dd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:40.562321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb78ca16-412a-4c95-bedb-9a6c5375e5dd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:40.562753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb78ca16-412a-4c95-bedb-9a6c5375e5dd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:40.563453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb78ca16-412a-4c95-bedb-9a6c5375e5dd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:40.563902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb78ca16-412a-4c95-bedb-9a6c5375e5dd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:40.564380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb78ca16-412a-4c95-bedb-9a6c5375e5dd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:40.865436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:35:40.865726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:35:40.866198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:35:40.866772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:35:40.867281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:35:40.876404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:40.876999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:40.877476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:40.879128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:40.879593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:40.880022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:40.897870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Getting quotas for project abfa50b6f05c4413b2a96f2490ac43a1. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:35:40.902738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Getting quotas for user 7e6454ced7834bbdaeee89ccef19f510 and project abfa50b6f05c4413b2a96f2490ac43a1. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:35:40.916186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:35:40.918633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:35:40.968285 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f02db419-c9d3-4b5e-8a51-7038c4a291a1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.468688 Aug 27 04:35:40.969297 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 540/1055] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:35:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:35:40.974786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d42f53f-c0ab-4705-806e-b2e454d52bb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:40.975660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d42f53f-c0ab-4705-806e-b2e454d52bb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:40.982489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d42f53f-c0ab-4705-806e-b2e454d52bb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:40.983193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d42f53f-c0ab-4705-806e-b2e454d52bb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:40.983788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d42f53f-c0ab-4705-806e-b2e454d52bb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:40.984725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d42f53f-c0ab-4705-806e-b2e454d52bb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:40.985339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d42f53f-c0ab-4705-806e-b2e454d52bb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:40.985957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d42f53f-c0ab-4705-806e-b2e454d52bb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:41.247542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d42f53f-c0ab-4705-806e-b2e454d52bb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:41.263559 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d42f53f-c0ab-4705-806e-b2e454d52bb4 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1472 microversion: 2.1 time: 0.292622 Aug 27 04:35:41.277469 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 541/1056] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:40 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1472 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:41.285634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49d808f0-b7ea-4a17-a386-a1ddd1ca2bd7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:41.286653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-49d808f0-b7ea-4a17-a386-a1ddd1ca2bd7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:41.403461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49d808f0-b7ea-4a17-a386-a1ddd1ca2bd7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:41.417063 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49d808f0-b7ea-4a17-a386-a1ddd1ca2bd7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1278 microversion: 2.1 time: 0.137596 Aug 27 04:35:41.420032 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 542/1057] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:41 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1278 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:41.431530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fb78ca16-412a-4c95-bedb-9a6c5375e5dd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:41.446112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fb78ca16-412a-4c95-bedb-9a6c5375e5dd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:41.448000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e0dddfc6-8125-435a-8d20-c45d1f6409fa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:41.448912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e0dddfc6-8125-435a-8d20-c45d1f6409fa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:41.453805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fb78ca16-412a-4c95-bedb-9a6c5375e5dd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:41.454885 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fb78ca16-412a-4c95-bedb-9a6c5375e5dd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1567 microversion: 2.25 time: 0.905351 Aug 27 04:35:41.468553 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 516/1058] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:40 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1567 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:41.468799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0dddfc6-8125-435a-8d20-c45d1f6409fa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:41.468799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0dddfc6-8125-435a-8d20-c45d1f6409fa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:41.468799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0dddfc6-8125-435a-8d20-c45d1f6409fa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:41.468799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0dddfc6-8125-435a-8d20-c45d1f6409fa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:41.469134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0dddfc6-8125-435a-8d20-c45d1f6409fa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:41.469134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0dddfc6-8125-435a-8d20-c45d1f6409fa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:41.485591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e5e3101e-5ecd-4a61-89ac-12bc45c010ec tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:41.486228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e5e3101e-5ecd-4a61-89ac-12bc45c010ec tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:41.493883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5e3101e-5ecd-4a61-89ac-12bc45c010ec tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:41.495034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5e3101e-5ecd-4a61-89ac-12bc45c010ec tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:41.495487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5e3101e-5ecd-4a61-89ac-12bc45c010ec tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:41.496505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5e3101e-5ecd-4a61-89ac-12bc45c010ec tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:41.497142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5e3101e-5ecd-4a61-89ac-12bc45c010ec tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:41.497871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5e3101e-5ecd-4a61-89ac-12bc45c010ec tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:41.828716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e0dddfc6-8125-435a-8d20-c45d1f6409fa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:41.842728 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e0dddfc6-8125-435a-8d20-c45d1f6409fa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1314 microversion: 2.1 time: 0.419265 Aug 27 04:35:41.843675 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 543/1059] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:41 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:41.849067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7af2725f-e846-4174-ad1e-bc49a5372cbe tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:41.849702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7af2725f-e846-4174-ad1e-bc49a5372cbe tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:41.856654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7af2725f-e846-4174-ad1e-bc49a5372cbe tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:41.857152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7af2725f-e846-4174-ad1e-bc49a5372cbe tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:41.857591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7af2725f-e846-4174-ad1e-bc49a5372cbe tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:41.858327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7af2725f-e846-4174-ad1e-bc49a5372cbe tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:41.858733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7af2725f-e846-4174-ad1e-bc49a5372cbe tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:41.859340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7af2725f-e846-4174-ad1e-bc49a5372cbe tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:42.031503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e5e3101e-5ecd-4a61-89ac-12bc45c010ec tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:42.065304 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e5e3101e-5ecd-4a61-89ac-12bc45c010ec tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1311 microversion: 2.1 time: 0.601991 Aug 27 04:35:42.067295 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 517/1060] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:41 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1311 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:42.086943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-fce8c88e-c5d0-4616-8269-9378dd02fe53 req-815b0330-9230-4e2d-b14e-f989ca0f6cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5312348f-2393-47a9-a02f-c5747efc16ba", "name": "network-vif-deleted", "tag": "3d2ce8ba-1ee0-472e-aac0-d92d75c607e8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:42.103713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fce8c88e-c5d0-4616-8269-9378dd02fe53 req-815b0330-9230-4e2d-b14e-f989ca0f6cb7 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:42.104457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fce8c88e-c5d0-4616-8269-9378dd02fe53 req-815b0330-9230-4e2d-b14e-f989ca0f6cb7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:42.105257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fce8c88e-c5d0-4616-8269-9378dd02fe53 req-815b0330-9230-4e2d-b14e-f989ca0f6cb7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:42.149352 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-fce8c88e-c5d0-4616-8269-9378dd02fe53 req-815b0330-9230-4e2d-b14e-f989ca0f6cb7 service nova] Creating event network-vif-deleted:3d2ce8ba-1ee0-472e-aac0-d92d75c607e8 for instance 5312348f-2393-47a9-a02f-c5747efc16ba on n-h2-854823-1 Aug 27 04:35:42.153744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7af2725f-e846-4174-ad1e-bc49a5372cbe tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:42.167648 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7af2725f-e846-4174-ad1e-bc49a5372cbe tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.322775 Aug 27 04:35:42.170599 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 544/1061] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:41 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:42.186059 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-fce8c88e-c5d0-4616-8269-9378dd02fe53 req-815b0330-9230-4e2d-b14e-f989ca0f6cb7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117252 Aug 27 04:35:42.187384 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 518/1062] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:42.240137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-799ec059-5ef6-4547-a322-3fdeef66076c req-08ee3e14-5ccb-4cc9-b67e-f462caf77823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e6b1d8-56bd-49dd-952f-758425633218", "tag": "e2dd7cd4-c5d5-4ad2-80a1-6b887249437f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:42.263367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-799ec059-5ef6-4547-a322-3fdeef66076c req-08ee3e14-5ccb-4cc9-b67e-f462caf77823 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:42.274402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-799ec059-5ef6-4547-a322-3fdeef66076c req-08ee3e14-5ccb-4cc9-b67e-f462caf77823 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:42.276754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-799ec059-5ef6-4547-a322-3fdeef66076c req-08ee3e14-5ccb-4cc9-b67e-f462caf77823 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:42.290113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-48bc7f8f-fa60-464b-a080-ec400d437f8d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:42.290919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-48bc7f8f-fa60-464b-a080-ec400d437f8d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:42.303371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48bc7f8f-fa60-464b-a080-ec400d437f8d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:42.303877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48bc7f8f-fa60-464b-a080-ec400d437f8d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:42.304310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48bc7f8f-fa60-464b-a080-ec400d437f8d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:42.305061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48bc7f8f-fa60-464b-a080-ec400d437f8d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:42.305520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48bc7f8f-fa60-464b-a080-ec400d437f8d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:42.305944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48bc7f8f-fa60-464b-a080-ec400d437f8d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:42.325532 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-799ec059-5ef6-4547-a322-3fdeef66076c req-08ee3e14-5ccb-4cc9-b67e-f462caf77823 service nova] Creating event network-changed:e2dd7cd4-c5d5-4ad2-80a1-6b887249437f for instance c0e6b1d8-56bd-49dd-952f-758425633218 on n-h1-854823-1 Aug 27 04:35:42.333710 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-799ec059-5ef6-4547-a322-3fdeef66076c req-08ee3e14-5ccb-4cc9-b67e-f462caf77823 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098949 Aug 27 04:35:42.334930 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 545/1063] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:42.382249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48bc7f8f-fa60-464b-a080-ec400d437f8d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:42.382759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48bc7f8f-fa60-464b-a080-ec400d437f8d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:42.383320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48bc7f8f-fa60-464b-a080-ec400d437f8d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:42.383921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-48bc7f8f-fa60-464b-a080-ec400d437f8d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lazy-loading 'fault' on Instance uuid 5312348f-2393-47a9-a02f-c5747efc16ba {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:42.440303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57e5c98c-2438-471e-9a74-9c43a945a916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:42.441222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57e5c98c-2438-471e-9a74-9c43a945a916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:42.449580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57e5c98c-2438-471e-9a74-9c43a945a916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:42.450071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57e5c98c-2438-471e-9a74-9c43a945a916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:42.450960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57e5c98c-2438-471e-9a74-9c43a945a916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:42.451873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57e5c98c-2438-471e-9a74-9c43a945a916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:42.452880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57e5c98c-2438-471e-9a74-9c43a945a916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:42.453769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57e5c98c-2438-471e-9a74-9c43a945a916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:42.524204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-48bc7f8f-fa60-464b-a080-ec400d437f8d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:42.535688 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-48bc7f8f-fa60-464b-a080-ec400d437f8d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 200 len: 1306 microversion: 2.1 time: 0.250277 Aug 27 04:35:42.536278 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 519/1064] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:42 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 1306 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:42.544763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5b8ce19a-109e-4c1c-93a7-3cdc2104eb67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:42.545626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5b8ce19a-109e-4c1c-93a7-3cdc2104eb67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:42.551759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57e5c98c-2438-471e-9a74-9c43a945a916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:42.553162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b8ce19a-109e-4c1c-93a7-3cdc2104eb67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:42.553824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b8ce19a-109e-4c1c-93a7-3cdc2104eb67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:42.554427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b8ce19a-109e-4c1c-93a7-3cdc2104eb67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:42.555596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b8ce19a-109e-4c1c-93a7-3cdc2104eb67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:42.556216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b8ce19a-109e-4c1c-93a7-3cdc2104eb67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:42.566174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b8ce19a-109e-4c1c-93a7-3cdc2104eb67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:42.572987 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57e5c98c-2438-471e-9a74-9c43a945a916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1330 microversion: 2.1 time: 0.137375 Aug 27 04:35:42.573669 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 546/1065] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:42 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1330 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:42.866942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c8e49b8-d5ff-4b87-b385-8f4260a2530b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:42.868211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4c8e49b8-d5ff-4b87-b385-8f4260a2530b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:42.876753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c8e49b8-d5ff-4b87-b385-8f4260a2530b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:42.878590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c8e49b8-d5ff-4b87-b385-8f4260a2530b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:42.879923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c8e49b8-d5ff-4b87-b385-8f4260a2530b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:42.881102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c8e49b8-d5ff-4b87-b385-8f4260a2530b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:42.882069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c8e49b8-d5ff-4b87-b385-8f4260a2530b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:42.882673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c8e49b8-d5ff-4b87-b385-8f4260a2530b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.097758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c8e49b8-d5ff-4b87-b385-8f4260a2530b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:43.115952 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c8e49b8-d5ff-4b87-b385-8f4260a2530b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1314 microversion: 2.1 time: 0.253517 Aug 27 04:35:43.132909 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 547/1066] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:42 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:43.132909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ed6a78e-fd9c-4f57-b52d-cae78c97954f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:43.132909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ed6a78e-fd9c-4f57-b52d-cae78c97954f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:43.139217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ed6a78e-fd9c-4f57-b52d-cae78c97954f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.139640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ed6a78e-fd9c-4f57-b52d-cae78c97954f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.140226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ed6a78e-fd9c-4f57-b52d-cae78c97954f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.141226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ed6a78e-fd9c-4f57-b52d-cae78c97954f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.141784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ed6a78e-fd9c-4f57-b52d-cae78c97954f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.142493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ed6a78e-fd9c-4f57-b52d-cae78c97954f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.167993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5b8ce19a-109e-4c1c-93a7-3cdc2104eb67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:43.178101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5b8ce19a-109e-4c1c-93a7-3cdc2104eb67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:43.193370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5b8ce19a-109e-4c1c-93a7-3cdc2104eb67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:43.196827 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5b8ce19a-109e-4c1c-93a7-3cdc2104eb67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1542 microversion: 2.25 time: 0.659302 Aug 27 04:35:43.213416 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 520/1067] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:42 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1542 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:43.231751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ec4423bd-fd06-4252-9855-89cb74e684c0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:43.233933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ec4423bd-fd06-4252-9855-89cb74e684c0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:43.247187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec4423bd-fd06-4252-9855-89cb74e684c0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.247995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec4423bd-fd06-4252-9855-89cb74e684c0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.248877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec4423bd-fd06-4252-9855-89cb74e684c0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.249830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec4423bd-fd06-4252-9855-89cb74e684c0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.250567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec4423bd-fd06-4252-9855-89cb74e684c0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.251216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec4423bd-fd06-4252-9855-89cb74e684c0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.313090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ed6a78e-fd9c-4f57-b52d-cae78c97954f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:43.333587 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ed6a78e-fd9c-4f57-b52d-cae78c97954f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1311 microversion: 2.1 time: 0.207505 Aug 27 04:35:43.334478 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 548/1068] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:43 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1311 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:43.339855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0399ea5f-ce27-407c-a910-0f749f08c485 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '.version_select at 0x7f1f21fc9700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:43.344432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0399ea5f-ce27-407c-a910-0f749f08c485 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.345180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0399ea5f-ce27-407c-a910-0f749f08c485 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.345797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0399ea5f-ce27-407c-a910-0f749f08c485 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.357747 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0399ea5f-ce27-407c-a910-0f749f08c485 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.021928 Aug 27 04:35:43.364841 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 549/1069] 10.222.0.79 () {60 vars in 1184 bytes} [Sat Aug 27 04:35:43 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:43.374606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-490c7f1b-d931-4c73-8d65-b080e6acf6ee tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:43.376332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-490c7f1b-d931-4c73-8d65-b080e6acf6ee tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:43.383094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-490c7f1b-d931-4c73-8d65-b080e6acf6ee tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.383586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-490c7f1b-d931-4c73-8d65-b080e6acf6ee tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.384025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-490c7f1b-d931-4c73-8d65-b080e6acf6ee tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.384902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-490c7f1b-d931-4c73-8d65-b080e6acf6ee tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.385495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-490c7f1b-d931-4c73-8d65-b080e6acf6ee tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.385953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-490c7f1b-d931-4c73-8d65-b080e6acf6ee tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.595244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-490c7f1b-d931-4c73-8d65-b080e6acf6ee tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 993886de-4066-4da7-9768-ad92fdea6cc2 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:43.609994 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-490c7f1b-d931-4c73-8d65-b080e6acf6ee tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 2034 microversion: 2.25 time: 0.239669 Aug 27 04:35:43.610698 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 550/1070] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:43 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 2034 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:43.615505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9dbfa910-b62a-471f-941e-d3651026f49f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:43.616225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9dbfa910-b62a-471f-941e-d3651026f49f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 5312348f-2393-47a9-a02f-c5747efc16ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:43.622586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbfa910-b62a-471f-941e-d3651026f49f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.623198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbfa910-b62a-471f-941e-d3651026f49f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.623696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbfa910-b62a-471f-941e-d3651026f49f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.624676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbfa910-b62a-471f-941e-d3651026f49f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.625547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbfa910-b62a-471f-941e-d3651026f49f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.626001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbfa910-b62a-471f-941e-d3651026f49f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.644097 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9dbfa910-b62a-471f-941e-d3651026f49f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] HTTP exception thrown: Instance 5312348f-2393-47a9-a02f-c5747efc16ba could not be found. Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9dbfa910-b62a-471f-941e-d3651026f49f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Request method failure captured: Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba HTTP/1.1 Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5vZmCQoTpWfO2nVvghaAr6WQ7l0jSxgrsDU_f5pBjkwZR9vYzn-WSBKnKYlb4QrTThFlKQoSD6qMOG1RMxxH3EEGYmrkKAGkNv2QjvxwduOHa8oaP9JROieKflk83mA1Krxt2a8kMGRYbNuKy9a5hu87qF_uDiIUT5j6ZdX0CisgE Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:35:43.646334 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:35:43.647964 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:35:43.647964 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:43.647964 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:35:43.647964 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:43.647964 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:35:43.647964 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:35:43.647964 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:35:43.647964 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cc8cb8eea83f45c1bb06328e31c960e7 Aug 27 04:35:43.647964 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:35:43.647964 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:35:43.647964 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 5312348f-2393-47a9-a02f-c5747efc16ba could not be found. Aug 27 04:35:43.647964 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '5312348f-2393-47a9-a02f-c5747efc16ba'} Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5312348f-2393-47a9-a02f-c5747efc16ba could not be found. Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:35:43.648758 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5312348f-2393-47a9-a02f-c5747efc16ba could not be found. Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5312348f-2393-47a9-a02f-c5747efc16ba could not be found. Aug 27 04:35:43.650762 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:43.652579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9dbfa910-b62a-471f-941e-d3651026f49f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Returning 404 to user: Instance 5312348f-2393-47a9-a02f-c5747efc16ba could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:35:43.652579 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9dbfa910-b62a-471f-941e-d3651026f49f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba" status: 404 len: 111 microversion: 2.1 time: 0.036060 Aug 27 04:35:43.652579 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 551/1071] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:43 2022] GET /compute/v2.1/servers/5312348f-2393-47a9-a02f-c5747efc16ba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:35:43.654882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef1a5dbf-e37f-4d3d-a16c-45d0015f11bf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:43.655519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef1a5dbf-e37f-4d3d-a16c-45d0015f11bf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:43.661754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1a5dbf-e37f-4d3d-a16c-45d0015f11bf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.662247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1a5dbf-e37f-4d3d-a16c-45d0015f11bf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.662684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1a5dbf-e37f-4d3d-a16c-45d0015f11bf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.663391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1a5dbf-e37f-4d3d-a16c-45d0015f11bf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.663850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1a5dbf-e37f-4d3d-a16c-45d0015f11bf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.664274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1a5dbf-e37f-4d3d-a16c-45d0015f11bf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.731041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef1a5dbf-e37f-4d3d-a16c-45d0015f11bf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:43.739941 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef1a5dbf-e37f-4d3d-a16c-45d0015f11bf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1336 microversion: 2.1 time: 0.090535 Aug 27 04:35:43.740552 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 552/1072] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:43 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1336 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:43.753375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d4d57ec-7ce3-49ba-9af8-01ae186ae938 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Action: 'create', calling method: .version_select at 0x7f1f22073af0>, body: {"keypair": {"name": "tempest-keypair-1193405832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhdRPipbgB/lSl9x49066zSd6M8ZO/d3Z6Obo1H86Xh/NtxclAveDyWVoCT4lQj3xq64JdNEl/O6Fc2+AEdfSqyQMmC94HGRjjgE8DZZWDehaO4veKnxAaDGDTizVvWxQ=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:43.762512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7d4d57ec-7ce3-49ba-9af8-01ae186ae938 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Getting quotas for project 002ba94e9b364c3e8784927de5770ed1. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:35:43.764155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:43.769534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7d4d57ec-7ce3-49ba-9af8-01ae186ae938 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Getting quotas for user 1d3d23499c474adaa7fe3a2260f5ec36 and project 002ba94e9b364c3e8784927de5770ed1. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:35:43.811881 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d4d57ec-7ce3-49ba-9af8-01ae186ae938 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.070146 Aug 27 04:35:43.812808 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 553/1073] 10.222.0.79 () {62 vars in 1200 bytes} [Sat Aug 27 04:35:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 04:35:43.818374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e7342bf7-48bc-486a-b239-76052800fa78 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:43.818807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e7342bf7-48bc-486a-b239-76052800fa78 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:43.825208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7342bf7-48bc-486a-b239-76052800fa78 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.825703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7342bf7-48bc-486a-b239-76052800fa78 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.826171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7342bf7-48bc-486a-b239-76052800fa78 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.826889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7342bf7-48bc-486a-b239-76052800fa78 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.827505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7342bf7-48bc-486a-b239-76052800fa78 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.827944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7342bf7-48bc-486a-b239-76052800fa78 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.833765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:43.863126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e7342bf7-48bc-486a-b239-76052800fa78 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:35:43.960076 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e7342bf7-48bc-486a-b239-76052800fa78 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 204 len: 0 microversion: 2.1 time: 0.145844 Aug 27 04:35:43.964488 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 554/1074] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:35:43 2022] DELETE /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:35:43.972588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed7b9c2c-8f87-4ca9-82b5-382fa8166ac7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:43.973938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ed7b9c2c-8f87-4ca9-82b5-382fa8166ac7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:43.980170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7b9c2c-8f87-4ca9-82b5-382fa8166ac7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.980731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7b9c2c-8f87-4ca9-82b5-382fa8166ac7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.981225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7b9c2c-8f87-4ca9-82b5-382fa8166ac7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.982018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7b9c2c-8f87-4ca9-82b5-382fa8166ac7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.982971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7b9c2c-8f87-4ca9-82b5-382fa8166ac7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.983229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7b9c2c-8f87-4ca9-82b5-382fa8166ac7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.984928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ec4423bd-fd06-4252-9855-89cb74e684c0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:44.006463 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ec4423bd-fd06-4252-9855-89cb74e684c0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.789430 Aug 27 04:35:44.008398 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 521/1075] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:43 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:44.140152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1d7959bd-a4b1-467d-a79f-24ee977deb83 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:44.140908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1d7959bd-a4b1-467d-a79f-24ee977deb83 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:44.148993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d7959bd-a4b1-467d-a79f-24ee977deb83 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:44.149757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d7959bd-a4b1-467d-a79f-24ee977deb83 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:44.150652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d7959bd-a4b1-467d-a79f-24ee977deb83 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:44.151579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d7959bd-a4b1-467d-a79f-24ee977deb83 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:44.152518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d7959bd-a4b1-467d-a79f-24ee977deb83 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:44.153195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d7959bd-a4b1-467d-a79f-24ee977deb83 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:44.183433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed7b9c2c-8f87-4ca9-82b5-382fa8166ac7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:44.194322 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ed7b9c2c-8f87-4ca9-82b5-382fa8166ac7 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1473 microversion: 2.1 time: 0.227585 Aug 27 04:35:44.194911 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 555/1076] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:43 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1473 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:44.358195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30b43862-c29e-4576-8836-494e3061bcf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:44.358906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-30b43862-c29e-4576-8836-494e3061bcf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:44.368579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b43862-c29e-4576-8836-494e3061bcf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:44.369161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b43862-c29e-4576-8836-494e3061bcf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:44.369791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b43862-c29e-4576-8836-494e3061bcf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:44.370667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b43862-c29e-4576-8836-494e3061bcf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:44.371254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b43862-c29e-4576-8836-494e3061bcf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:44.371845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b43862-c29e-4576-8836-494e3061bcf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:44.532481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1d7959bd-a4b1-467d-a79f-24ee977deb83 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:44.541817 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1d7959bd-a4b1-467d-a79f-24ee977deb83 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1314 microversion: 2.1 time: 0.406293 Aug 27 04:35:44.542535 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 522/1077] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:44 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:44.558720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-30b43862-c29e-4576-8836-494e3061bcf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:44.567505 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-30b43862-c29e-4576-8836-494e3061bcf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1311 microversion: 2.1 time: 0.216466 Aug 27 04:35:44.568100 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 556/1078] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:44 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1311 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:44.763741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e00eadf9-6881-47c1-b699-392ea24221cb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:44.764515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e00eadf9-6881-47c1-b699-392ea24221cb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:44.772770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e00eadf9-6881-47c1-b699-392ea24221cb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:44.773371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e00eadf9-6881-47c1-b699-392ea24221cb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:44.773914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e00eadf9-6881-47c1-b699-392ea24221cb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:44.774660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e00eadf9-6881-47c1-b699-392ea24221cb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:44.775134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e00eadf9-6881-47c1-b699-392ea24221cb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:44.775567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e00eadf9-6881-47c1-b699-392ea24221cb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:45.022092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e00eadf9-6881-47c1-b699-392ea24221cb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:45.031995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca77e656-eea5-4b64-ae99-cb92da16cb2e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:45.032523 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e00eadf9-6881-47c1-b699-392ea24221cb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1378 microversion: 2.1 time: 0.272746 Aug 27 04:35:45.032816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca77e656-eea5-4b64-ae99-cb92da16cb2e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:45.033073 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 523/1079] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:44 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1378 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:45.055500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca77e656-eea5-4b64-ae99-cb92da16cb2e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:45.055756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca77e656-eea5-4b64-ae99-cb92da16cb2e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:45.056021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca77e656-eea5-4b64-ae99-cb92da16cb2e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:45.057372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca77e656-eea5-4b64-ae99-cb92da16cb2e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:45.057670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca77e656-eea5-4b64-ae99-cb92da16cb2e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:45.058100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca77e656-eea5-4b64-ae99-cb92da16cb2e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:45.220631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2b8a6337-efd2-4c37-b5cf-a09d2362ff6e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:45.221435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2b8a6337-efd2-4c37-b5cf-a09d2362ff6e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:45.225473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:45.230914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b8a6337-efd2-4c37-b5cf-a09d2362ff6e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:45.231494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b8a6337-efd2-4c37-b5cf-a09d2362ff6e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:45.232261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b8a6337-efd2-4c37-b5cf-a09d2362ff6e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:45.232831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b8a6337-efd2-4c37-b5cf-a09d2362ff6e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:45.233653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b8a6337-efd2-4c37-b5cf-a09d2362ff6e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:45.234625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b8a6337-efd2-4c37-b5cf-a09d2362ff6e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:45.288988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca77e656-eea5-4b64-ae99-cb92da16cb2e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:45.298906 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca77e656-eea5-4b64-ae99-cb92da16cb2e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.272560 Aug 27 04:35:45.301204 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 557/1080] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:45 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:45.388076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2b8a6337-efd2-4c37-b5cf-a09d2362ff6e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:45.398179 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2b8a6337-efd2-4c37-b5cf-a09d2362ff6e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1473 microversion: 2.1 time: 0.182934 Aug 27 04:35:45.399170 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 524/1081] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:45 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1473 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:45.477542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-20cb439e-3408-48c1-ae54-77edd5160eab req-465f0bc4-97ed-49fd-85e1-5795e0f5c6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577250c7-f1ee-4541-b83e-131d0e21efea", "name": "network-vif-plugged", "status": "completed", "tag": "d4d0324a-726b-4962-b7dd-c7fd914520fe"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:45.491167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-20cb439e-3408-48c1-ae54-77edd5160eab req-465f0bc4-97ed-49fd-85e1-5795e0f5c6d2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:45.491693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-20cb439e-3408-48c1-ae54-77edd5160eab req-465f0bc4-97ed-49fd-85e1-5795e0f5c6d2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:45.492267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-20cb439e-3408-48c1-ae54-77edd5160eab req-465f0bc4-97ed-49fd-85e1-5795e0f5c6d2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:45.506299 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-20cb439e-3408-48c1-ae54-77edd5160eab req-465f0bc4-97ed-49fd-85e1-5795e0f5c6d2 service nova] Creating event network-vif-plugged:d4d0324a-726b-4962-b7dd-c7fd914520fe for instance 577250c7-f1ee-4541-b83e-131d0e21efea on n-h2-854823-1 Aug 27 04:35:45.520577 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-20cb439e-3408-48c1-ae54-77edd5160eab req-465f0bc4-97ed-49fd-85e1-5795e0f5c6d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047612 Aug 27 04:35:45.521201 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 558/1082] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:45.565768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c5e4fc0-2dc5-4d2a-83b2-af1319c8df30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:45.567087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8c5e4fc0-2dc5-4d2a-83b2-af1319c8df30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:45.573796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c5e4fc0-2dc5-4d2a-83b2-af1319c8df30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:45.574557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c5e4fc0-2dc5-4d2a-83b2-af1319c8df30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:45.575085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c5e4fc0-2dc5-4d2a-83b2-af1319c8df30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:45.576130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c5e4fc0-2dc5-4d2a-83b2-af1319c8df30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:45.577084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c5e4fc0-2dc5-4d2a-83b2-af1319c8df30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:45.577591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c5e4fc0-2dc5-4d2a-83b2-af1319c8df30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:45.590235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-432f3b95-4cac-478b-9271-e0f9376c0892 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:45.590925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-432f3b95-4cac-478b-9271-e0f9376c0892 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:45.597775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-432f3b95-4cac-478b-9271-e0f9376c0892 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:45.598324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-432f3b95-4cac-478b-9271-e0f9376c0892 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:45.598931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-432f3b95-4cac-478b-9271-e0f9376c0892 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:45.599791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-432f3b95-4cac-478b-9271-e0f9376c0892 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:45.600252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-432f3b95-4cac-478b-9271-e0f9376c0892 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:45.600704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-432f3b95-4cac-478b-9271-e0f9376c0892 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:45.723358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8c5e4fc0-2dc5-4d2a-83b2-af1319c8df30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:45.726955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:45.731965 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8c5e4fc0-2dc5-4d2a-83b2-af1319c8df30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1314 microversion: 2.1 time: 0.171164 Aug 27 04:35:45.732743 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 525/1083] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:45 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:45.813916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-432f3b95-4cac-478b-9271-e0f9376c0892 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:45.822600 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-432f3b95-4cac-478b-9271-e0f9376c0892 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1311 microversion: 2.1 time: 0.237018 Aug 27 04:35:45.823215 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 559/1084] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:45 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1311 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:46.010574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1540435891", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "f6f5b09f-74c4-46ac-874b-9207e349b51e"}], "security_groups": [{"name": "tempest-securitygroup--1278511357"}], "key_name": "tempest-keypair-1193405832", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:46.054638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f05e2a5-bfa9-435b-92fe-7b1edfc33312 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:46.055512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6f05e2a5-bfa9-435b-92fe-7b1edfc33312 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:46.061625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f05e2a5-bfa9-435b-92fe-7b1edfc33312 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.062117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f05e2a5-bfa9-435b-92fe-7b1edfc33312 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.062556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f05e2a5-bfa9-435b-92fe-7b1edfc33312 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:46.063262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f05e2a5-bfa9-435b-92fe-7b1edfc33312 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.063718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f05e2a5-bfa9-435b-92fe-7b1edfc33312 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.064143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f05e2a5-bfa9-435b-92fe-7b1edfc33312 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:46.122075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] validate_networks() for [('f6f5b09f-74c4-46ac-874b-9207e349b51e', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:35:46.195513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6f05e2a5-bfa9-435b-92fe-7b1edfc33312 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:46.203338 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6f05e2a5-bfa9-435b-92fe-7b1edfc33312 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1378 microversion: 2.1 time: 0.152597 Aug 27 04:35:46.203921 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 560/1085] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:46 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1378 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:46.321942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ef00917-55a6-4d8b-a57d-b7086096294c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:46.322550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ef00917-55a6-4d8b-a57d-b7086096294c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:46.328763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ef00917-55a6-4d8b-a57d-b7086096294c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.329253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ef00917-55a6-4d8b-a57d-b7086096294c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.329684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ef00917-55a6-4d8b-a57d-b7086096294c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:46.330380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ef00917-55a6-4d8b-a57d-b7086096294c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.331523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ef00917-55a6-4d8b-a57d-b7086096294c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.331942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ef00917-55a6-4d8b-a57d-b7086096294c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:46.468891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ef00917-55a6-4d8b-a57d-b7086096294c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:46.480228 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ef00917-55a6-4d8b-a57d-b7086096294c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.162011 Aug 27 04:35:46.481083 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 561/1086] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:46 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:46.498879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6a22890-7193-47c3-9095-48394bc02e31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:46.499488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6a22890-7193-47c3-9095-48394bc02e31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:46.505948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a22890-7193-47c3-9095-48394bc02e31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.506659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a22890-7193-47c3-9095-48394bc02e31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.507106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a22890-7193-47c3-9095-48394bc02e31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:46.507807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a22890-7193-47c3-9095-48394bc02e31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.508260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a22890-7193-47c3-9095-48394bc02e31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.509042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a22890-7193-47c3-9095-48394bc02e31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:46.608056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:35:46.608604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:35:46.608985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:35:46.609403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:35:46.610611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:35:46.621589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.622314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.622849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:46.623701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.624443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.625115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:46.645406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Getting quotas for project 002ba94e9b364c3e8784927de5770ed1. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:35:46.647912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d6a22890-7193-47c3-9095-48394bc02e31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:46.654079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Getting quotas for user 1d3d23499c474adaa7fe3a2260f5ec36 and project 002ba94e9b364c3e8784927de5770ed1. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:35:46.659858 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6a22890-7193-47c3-9095-48394bc02e31 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1473 microversion: 2.1 time: 0.164706 Aug 27 04:35:46.660470 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 562/1087] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:46 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1473 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:46.669196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:35:46.671693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:35:46.720920 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-35733656-ea9e-4b4f-959e-23051799d06b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 0.714424 Aug 27 04:35:46.721519 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 526/1088] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 04:35:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:35:46.734466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c61d092-2b5c-4f7c-a373-a477619b2acc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:46.735251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4c61d092-2b5c-4f7c-a373-a477619b2acc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:46.766110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3ce4c022-6881-4a1e-bb0e-7fb21ae7029e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:46.766850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3ce4c022-6881-4a1e-bb0e-7fb21ae7029e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:46.774467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ce4c022-6881-4a1e-bb0e-7fb21ae7029e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.775203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ce4c022-6881-4a1e-bb0e-7fb21ae7029e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.775825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ce4c022-6881-4a1e-bb0e-7fb21ae7029e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:46.776737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ce4c022-6881-4a1e-bb0e-7fb21ae7029e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.777348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ce4c022-6881-4a1e-bb0e-7fb21ae7029e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.777927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ce4c022-6881-4a1e-bb0e-7fb21ae7029e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:46.792478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c61d092-2b5c-4f7c-a373-a477619b2acc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:46.800973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c61d092-2b5c-4f7c-a373-a477619b2acc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:46.802678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c61d092-2b5c-4f7c-a373-a477619b2acc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:46.803998 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c61d092-2b5c-4f7c-a373-a477619b2acc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1286 microversion: 2.25 time: 0.075094 Aug 27 04:35:46.805203 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 563/1089] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:46 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:46.843214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6989f2c-39e7-4578-b2a6-fbd3dd8bf68b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:46.844749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6989f2c-39e7-4578-b2a6-fbd3dd8bf68b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:46.851365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6989f2c-39e7-4578-b2a6-fbd3dd8bf68b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.851866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6989f2c-39e7-4578-b2a6-fbd3dd8bf68b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.852298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6989f2c-39e7-4578-b2a6-fbd3dd8bf68b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:46.853040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6989f2c-39e7-4578-b2a6-fbd3dd8bf68b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.853688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6989f2c-39e7-4578-b2a6-fbd3dd8bf68b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.854119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6989f2c-39e7-4578-b2a6-fbd3dd8bf68b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:47.003547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a6989f2c-39e7-4578-b2a6-fbd3dd8bf68b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:47.003865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3ce4c022-6881-4a1e-bb0e-7fb21ae7029e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:47.012190 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6989f2c-39e7-4578-b2a6-fbd3dd8bf68b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1311 microversion: 2.1 time: 0.172822 Aug 27 04:35:47.013426 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3ce4c022-6881-4a1e-bb0e-7fb21ae7029e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1314 microversion: 2.1 time: 0.255059 Aug 27 04:35:47.027038 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 527/1090] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:46 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:47.027319 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 564/1091] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:46 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1311 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:47.224958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b86b37f1-1c40-4464-8b9c-9f39c923d953 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:47.227391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b86b37f1-1c40-4464-8b9c-9f39c923d953 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:47.240692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b86b37f1-1c40-4464-8b9c-9f39c923d953 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:47.241988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b86b37f1-1c40-4464-8b9c-9f39c923d953 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:47.242607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b86b37f1-1c40-4464-8b9c-9f39c923d953 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:47.243685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b86b37f1-1c40-4464-8b9c-9f39c923d953 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:47.244365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b86b37f1-1c40-4464-8b9c-9f39c923d953 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:47.244995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b86b37f1-1c40-4464-8b9c-9f39c923d953 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:47.422212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a6942f92-edc2-469c-a3d6-ed7b23130fb5 req-b61cbafc-9e4c-4095-9f49-88275bc02043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07", "name": "network-vif-deleted", "tag": "b63bbe54-1556-4795-9da0-3334f115da65"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:47.442152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a6942f92-edc2-469c-a3d6-ed7b23130fb5 req-b61cbafc-9e4c-4095-9f49-88275bc02043 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:47.442636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a6942f92-edc2-469c-a3d6-ed7b23130fb5 req-b61cbafc-9e4c-4095-9f49-88275bc02043 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:47.444989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a6942f92-edc2-469c-a3d6-ed7b23130fb5 req-b61cbafc-9e4c-4095-9f49-88275bc02043 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:47.500714 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a6942f92-edc2-469c-a3d6-ed7b23130fb5 req-b61cbafc-9e4c-4095-9f49-88275bc02043 service nova] Creating event network-vif-deleted:b63bbe54-1556-4795-9da0-3334f115da65 for instance 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 on n-h2-854823-1 Aug 27 04:35:47.520878 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a6942f92-edc2-469c-a3d6-ed7b23130fb5 req-b61cbafc-9e4c-4095-9f49-88275bc02043 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102164 Aug 27 04:35:47.522991 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 565/1092] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:47.536649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20b79f7b-56a5-4b4c-9de2-e0db1d0e9b6e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:47.538194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20b79f7b-56a5-4b4c-9de2-e0db1d0e9b6e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:47.555190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20b79f7b-56a5-4b4c-9de2-e0db1d0e9b6e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:47.556123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20b79f7b-56a5-4b4c-9de2-e0db1d0e9b6e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:47.557002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20b79f7b-56a5-4b4c-9de2-e0db1d0e9b6e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:47.559569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20b79f7b-56a5-4b4c-9de2-e0db1d0e9b6e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:47.560124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20b79f7b-56a5-4b4c-9de2-e0db1d0e9b6e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:47.561254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20b79f7b-56a5-4b4c-9de2-e0db1d0e9b6e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:47.772310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b86b37f1-1c40-4464-8b9c-9f39c923d953 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:47.782271 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b86b37f1-1c40-4464-8b9c-9f39c923d953 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1378 microversion: 2.1 time: 0.561598 Aug 27 04:35:47.801991 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 528/1093] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:47 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1378 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:47.807663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b80ad9c9-d727-4ddf-af59-74e973a6912e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:47.808280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b80ad9c9-d727-4ddf-af59-74e973a6912e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:47.835771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b80ad9c9-d727-4ddf-af59-74e973a6912e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:47.836280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b80ad9c9-d727-4ddf-af59-74e973a6912e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:47.851002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b80ad9c9-d727-4ddf-af59-74e973a6912e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:47.851921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b80ad9c9-d727-4ddf-af59-74e973a6912e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:47.852418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b80ad9c9-d727-4ddf-af59-74e973a6912e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:47.852902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b80ad9c9-d727-4ddf-af59-74e973a6912e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:47.920601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b80ad9c9-d727-4ddf-af59-74e973a6912e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:47.921090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b80ad9c9-d727-4ddf-af59-74e973a6912e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:47.921540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b80ad9c9-d727-4ddf-af59-74e973a6912e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:47.921990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-b80ad9c9-d727-4ddf-af59-74e973a6912e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lazy-loading 'fault' on Instance uuid 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:48.005526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-20b79f7b-56a5-4b4c-9de2-e0db1d0e9b6e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:48.023009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b80ad9c9-d727-4ddf-af59-74e973a6912e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:48.025539 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20b79f7b-56a5-4b4c-9de2-e0db1d0e9b6e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.501152 Aug 27 04:35:48.031725 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 566/1094] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:47 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:48.038153 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b80ad9c9-d727-4ddf-af59-74e973a6912e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 200 len: 1307 microversion: 2.1 time: 0.234294 Aug 27 04:35:48.038772 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 529/1095] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:47 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 1307 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:48.042900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be920b9f-e24a-40c6-b1da-2dbb4a38925a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:48.043801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-be920b9f-e24a-40c6-b1da-2dbb4a38925a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:48.057216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be920b9f-e24a-40c6-b1da-2dbb4a38925a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:48.061434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be920b9f-e24a-40c6-b1da-2dbb4a38925a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:48.062473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be920b9f-e24a-40c6-b1da-2dbb4a38925a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:48.064923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-39b89944-131d-4ba3-bf0e-dfaf79b166bd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:48.065659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-39b89944-131d-4ba3-bf0e-dfaf79b166bd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:48.067135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be920b9f-e24a-40c6-b1da-2dbb4a38925a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:48.067865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be920b9f-e24a-40c6-b1da-2dbb4a38925a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:48.068617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be920b9f-e24a-40c6-b1da-2dbb4a38925a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:48.071957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39b89944-131d-4ba3-bf0e-dfaf79b166bd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:48.072450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39b89944-131d-4ba3-bf0e-dfaf79b166bd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:48.072912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39b89944-131d-4ba3-bf0e-dfaf79b166bd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:48.073625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39b89944-131d-4ba3-bf0e-dfaf79b166bd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:48.074091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39b89944-131d-4ba3-bf0e-dfaf79b166bd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:48.074521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39b89944-131d-4ba3-bf0e-dfaf79b166bd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:48.176167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be920b9f-e24a-40c6-b1da-2dbb4a38925a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:48.186343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be920b9f-e24a-40c6-b1da-2dbb4a38925a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:48.187910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be920b9f-e24a-40c6-b1da-2dbb4a38925a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:48.190758 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be920b9f-e24a-40c6-b1da-2dbb4a38925a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1338 microversion: 2.25 time: 0.156294 Aug 27 04:35:48.191554 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 567/1096] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:48 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1338 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:48.197638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e806dfda-3f30-4b87-9704-99f8aed1ef1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:48.198277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e806dfda-3f30-4b87-9704-99f8aed1ef1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:48.206975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e806dfda-3f30-4b87-9704-99f8aed1ef1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:48.207477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e806dfda-3f30-4b87-9704-99f8aed1ef1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:48.208266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e806dfda-3f30-4b87-9704-99f8aed1ef1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:48.209437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e806dfda-3f30-4b87-9704-99f8aed1ef1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:48.209965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e806dfda-3f30-4b87-9704-99f8aed1ef1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:48.211248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e806dfda-3f30-4b87-9704-99f8aed1ef1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:48.370132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e806dfda-3f30-4b87-9704-99f8aed1ef1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:48.379069 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e806dfda-3f30-4b87-9704-99f8aed1ef1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1314 microversion: 2.1 time: 0.185442 Aug 27 04:35:48.380649 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 568/1097] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:48 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:48.424556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-39b89944-131d-4ba3-bf0e-dfaf79b166bd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:48.433366 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-39b89944-131d-4ba3-bf0e-dfaf79b166bd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1311 microversion: 2.1 time: 0.390592 Aug 27 04:35:48.444947 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 530/1098] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:48 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1311 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:48.808062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cc99d3d-416e-4076-92a6-2f793c5dea16 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:48.809505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2cc99d3d-416e-4076-92a6-2f793c5dea16 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:48.826486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cc99d3d-416e-4076-92a6-2f793c5dea16 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:48.827215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cc99d3d-416e-4076-92a6-2f793c5dea16 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:48.827858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cc99d3d-416e-4076-92a6-2f793c5dea16 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:48.828914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cc99d3d-416e-4076-92a6-2f793c5dea16 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:48.829556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cc99d3d-416e-4076-92a6-2f793c5dea16 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:48.830228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cc99d3d-416e-4076-92a6-2f793c5dea16 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.060377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-83bb1625-92d5-4289-8bee-3bed90ccf6f0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:49.061036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-83bb1625-92d5-4289-8bee-3bed90ccf6f0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:49.064791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:49.069367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83bb1625-92d5-4289-8bee-3bed90ccf6f0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.070120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83bb1625-92d5-4289-8bee-3bed90ccf6f0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.070733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83bb1625-92d5-4289-8bee-3bed90ccf6f0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.071615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83bb1625-92d5-4289-8bee-3bed90ccf6f0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.072234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83bb1625-92d5-4289-8bee-3bed90ccf6f0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.072882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83bb1625-92d5-4289-8bee-3bed90ccf6f0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.289215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2cc99d3d-416e-4076-92a6-2f793c5dea16 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:49.297718 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2cc99d3d-416e-4076-92a6-2f793c5dea16 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1378 microversion: 2.1 time: 0.493914 Aug 27 04:35:49.298314 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 569/1099] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:48 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1378 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:49.303181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2af1a33b-dcca-40f6-87c3-d2a2a441f95b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:49.303792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2af1a33b-dcca-40f6-87c3-d2a2a441f95b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:49.315331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2af1a33b-dcca-40f6-87c3-d2a2a441f95b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.315744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2af1a33b-dcca-40f6-87c3-d2a2a441f95b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.316422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2af1a33b-dcca-40f6-87c3-d2a2a441f95b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.317025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2af1a33b-dcca-40f6-87c3-d2a2a441f95b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.317519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2af1a33b-dcca-40f6-87c3-d2a2a441f95b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.317947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2af1a33b-dcca-40f6-87c3-d2a2a441f95b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.334110 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-2af1a33b-dcca-40f6-87c3-d2a2a441f95b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] HTTP exception thrown: Instance 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 could not be found. Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2af1a33b-dcca-40f6-87c3-d2a2a441f95b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Request method failure captured: Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 HTTP/1.1 Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5vZmCQoTpWfO2nVvghaAr6WQ7l0jSxgrsDU_f5pBjkwZR9vYzn-WSBKnKYlb4QrTThFlKQoSD6qMOG1RMxxH3EEGYmrkKAGkNv2QjvxwduOHa8oaP9JROieKflk83mA1Krxt2a8kMGRYbNuKy9a5hu87qF_uDiIUT5j6ZdX0CisgE Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:35:49.335930 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:35:49.337586 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:35:49.337586 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:49.337586 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:35:49.337586 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:49.337586 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:35:49.337586 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:35:49.337586 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:35:49.337586 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cc8cb8eea83f45c1bb06328e31c960e7 Aug 27 04:35:49.337586 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:35:49.337586 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:35:49.337586 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 could not be found. Aug 27 04:35:49.337586 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07'} Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 could not be found. Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:35:49.342605 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 could not be found. Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 could not be found. Aug 27 04:35:49.344074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:49.345373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2af1a33b-dcca-40f6-87c3-d2a2a441f95b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Returning 404 to user: Instance 1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:35:49.345373 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2af1a33b-dcca-40f6-87c3-d2a2a441f95b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07" status: 404 len: 111 microversion: 2.1 time: 0.037828 Aug 27 04:35:49.345373 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 570/1100] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:49 2022] GET /compute/v2.1/servers/1cfc695b-7c2f-4ad8-adf7-3aa4dcfa4b07 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:35:49.346069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec86a4bd-efb3-44d5-bac0-18033e86db80 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:49.347273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec86a4bd-efb3-44d5-bac0-18033e86db80 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:49.354091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec86a4bd-efb3-44d5-bac0-18033e86db80 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.354746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec86a4bd-efb3-44d5-bac0-18033e86db80 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.355012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec86a4bd-efb3-44d5-bac0-18033e86db80 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.355862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec86a4bd-efb3-44d5-bac0-18033e86db80 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.356892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec86a4bd-efb3-44d5-bac0-18033e86db80 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.357711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec86a4bd-efb3-44d5-bac0-18033e86db80 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.420035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-83bb1625-92d5-4289-8bee-3bed90ccf6f0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:49.433057 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-83bb1625-92d5-4289-8bee-3bed90ccf6f0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.376501 Aug 27 04:35:49.433362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec86a4bd-efb3-44d5-bac0-18033e86db80 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:49.433870 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 531/1101] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:49 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:49.438686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9dbeac83-5a0e-4ee9-9989-4769849bb8d5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:49.439493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9dbeac83-5a0e-4ee9-9989-4769849bb8d5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:49.447030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dbeac83-5a0e-4ee9-9989-4769849bb8d5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.449587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dbeac83-5a0e-4ee9-9989-4769849bb8d5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.450035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dbeac83-5a0e-4ee9-9989-4769849bb8d5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.450792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dbeac83-5a0e-4ee9-9989-4769849bb8d5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.451254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dbeac83-5a0e-4ee9-9989-4769849bb8d5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.451678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dbeac83-5a0e-4ee9-9989-4769849bb8d5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.454094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec86a4bd-efb3-44d5-bac0-18033e86db80 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:49.456166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec86a4bd-efb3-44d5-bac0-18033e86db80 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:49.457320 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec86a4bd-efb3-44d5-bac0-18033e86db80 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1344 microversion: 2.25 time: 0.115932 Aug 27 04:35:49.458111 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 571/1102] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:49 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:49.473003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf6f83ac-9c48-4aa9-88ea-36500d0e8748 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:49.473818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf6f83ac-9c48-4aa9-88ea-36500d0e8748 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:49.480447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf6f83ac-9c48-4aa9-88ea-36500d0e8748 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.481019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf6f83ac-9c48-4aa9-88ea-36500d0e8748 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.481618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf6f83ac-9c48-4aa9-88ea-36500d0e8748 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.482347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf6f83ac-9c48-4aa9-88ea-36500d0e8748 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.482905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf6f83ac-9c48-4aa9-88ea-36500d0e8748 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.483326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf6f83ac-9c48-4aa9-88ea-36500d0e8748 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.488892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:49.503637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9dbeac83-5a0e-4ee9-9989-4769849bb8d5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:35:49.656374 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9dbeac83-5a0e-4ee9-9989-4769849bb8d5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d" status: 204 len: 0 microversion: 2.1 time: 0.220298 Aug 27 04:35:49.661075 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 532/1103] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:35:49 2022] DELETE /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:35:49.667737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-26c34225-942d-4612-bc31-d02b23866df9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:49.668754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-26c34225-942d-4612-bc31-d02b23866df9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:49.682955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bf6f83ac-9c48-4aa9-88ea-36500d0e8748 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:49.694177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26c34225-942d-4612-bc31-d02b23866df9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.694916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26c34225-942d-4612-bc31-d02b23866df9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.695521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26c34225-942d-4612-bc31-d02b23866df9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.696640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26c34225-942d-4612-bc31-d02b23866df9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.697249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26c34225-942d-4612-bc31-d02b23866df9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.697828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26c34225-942d-4612-bc31-d02b23866df9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.713926 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf6f83ac-9c48-4aa9-88ea-36500d0e8748 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1314 microversion: 2.1 time: 0.254982 Aug 27 04:35:49.714518 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 572/1104] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:49 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:49.719811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b7b86634-b877-4d22-891f-4219d7e4561f req-e8eb5a3b-0845-4979-8b69-0b038ad2976c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7984297a-0070-487d-83cb-a4e4d97aa5ba", "tag": "9bf4e91c-b1ee-46b0-ab4c-5e3b87d4673b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:49.729868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b7b86634-b877-4d22-891f-4219d7e4561f req-e8eb5a3b-0845-4979-8b69-0b038ad2976c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.730359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b7b86634-b877-4d22-891f-4219d7e4561f req-e8eb5a3b-0845-4979-8b69-0b038ad2976c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.730797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b7b86634-b877-4d22-891f-4219d7e4561f req-e8eb5a3b-0845-4979-8b69-0b038ad2976c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.750620 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b7b86634-b877-4d22-891f-4219d7e4561f req-e8eb5a3b-0845-4979-8b69-0b038ad2976c service nova] Creating event network-changed:9bf4e91c-b1ee-46b0-ab4c-5e3b87d4673b for instance 7984297a-0070-487d-83cb-a4e4d97aa5ba on n-h1-854823-1 Aug 27 04:35:49.757309 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b7b86634-b877-4d22-891f-4219d7e4561f req-e8eb5a3b-0845-4979-8b69-0b038ad2976c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040862 Aug 27 04:35:49.758096 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 573/1105] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:49.763551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2d9f1fc9-811d-4295-b80d-c7706c28a82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:49.764418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2d9f1fc9-811d-4295-b80d-c7706c28a82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:49.772310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d9f1fc9-811d-4295-b80d-c7706c28a82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.773011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d9f1fc9-811d-4295-b80d-c7706c28a82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.773647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d9f1fc9-811d-4295-b80d-c7706c28a82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.774543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d9f1fc9-811d-4295-b80d-c7706c28a82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.775163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d9f1fc9-811d-4295-b80d-c7706c28a82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.775746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d9f1fc9-811d-4295-b80d-c7706c28a82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.804744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2d9f1fc9-811d-4295-b80d-c7706c28a82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:35:49.895732 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2d9f1fc9-811d-4295-b80d-c7706c28a82f tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 204 len: 0 microversion: 2.1 time: 0.136089 Aug 27 04:35:49.897587 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 574/1106] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:35:49 2022] DELETE /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:35:49.907249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-410ce636-7398-4929-980c-537d5cecaae5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:49.908369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-410ce636-7398-4929-980c-537d5cecaae5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:49.915685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-410ce636-7398-4929-980c-537d5cecaae5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.916176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-410ce636-7398-4929-980c-537d5cecaae5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.917063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-410ce636-7398-4929-980c-537d5cecaae5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:49.917377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-410ce636-7398-4929-980c-537d5cecaae5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:49.917893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-410ce636-7398-4929-980c-537d5cecaae5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:49.918818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-410ce636-7398-4929-980c-537d5cecaae5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:50.069702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-410ce636-7398-4929-980c-537d5cecaae5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:50.079344 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-410ce636-7398-4929-980c-537d5cecaae5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d" status: 200 len: 1475 microversion: 2.1 time: 0.176993 Aug 27 04:35:50.080458 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 575/1107] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:49 2022] GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d => generated 1475 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:50.263311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-26c34225-942d-4612-bc31-d02b23866df9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:50.273085 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-26c34225-942d-4612-bc31-d02b23866df9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1311 microversion: 2.1 time: 0.610424 Aug 27 04:35:50.273670 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 533/1108] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:49 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1311 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:50.319541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-424642d0-1cbc-43a8-b3f2-825ef259a965 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:50.320150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-424642d0-1cbc-43a8-b3f2-825ef259a965 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:50.326716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424642d0-1cbc-43a8-b3f2-825ef259a965 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:50.327597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424642d0-1cbc-43a8-b3f2-825ef259a965 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:50.328062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424642d0-1cbc-43a8-b3f2-825ef259a965 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:50.329140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424642d0-1cbc-43a8-b3f2-825ef259a965 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:50.329800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424642d0-1cbc-43a8-b3f2-825ef259a965 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:50.331005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424642d0-1cbc-43a8-b3f2-825ef259a965 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:50.463078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-34854271-5a1d-4f57-aa7e-d8863bf4a6b6 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:50.464734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-34854271-5a1d-4f57-aa7e-d8863bf4a6b6 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:50.480328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34854271-5a1d-4f57-aa7e-d8863bf4a6b6 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:50.481526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34854271-5a1d-4f57-aa7e-d8863bf4a6b6 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:50.482566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34854271-5a1d-4f57-aa7e-d8863bf4a6b6 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:50.483713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34854271-5a1d-4f57-aa7e-d8863bf4a6b6 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:50.484492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34854271-5a1d-4f57-aa7e-d8863bf4a6b6 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:50.485216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34854271-5a1d-4f57-aa7e-d8863bf4a6b6 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:50.516901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-424642d0-1cbc-43a8-b3f2-825ef259a965 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:50.527153 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-424642d0-1cbc-43a8-b3f2-825ef259a965 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1378 microversion: 2.1 time: 0.212943 Aug 27 04:35:50.528843 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 576/1109] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:50 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1378 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:50.533914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a219ee8-2d28-42b4-a40b-7312e96416e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:50.541997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a219ee8-2d28-42b4-a40b-7312e96416e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:50.544793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a219ee8-2d28-42b4-a40b-7312e96416e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:50.546762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a219ee8-2d28-42b4-a40b-7312e96416e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:50.547220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a219ee8-2d28-42b4-a40b-7312e96416e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:50.548043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a219ee8-2d28-42b4-a40b-7312e96416e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:50.548414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a219ee8-2d28-42b4-a40b-7312e96416e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:50.549446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a219ee8-2d28-42b4-a40b-7312e96416e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:50.657086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-34854271-5a1d-4f57-aa7e-d8863bf4a6b6 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:50.667480 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-34854271-5a1d-4f57-aa7e-d8863bf4a6b6 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.216295 Aug 27 04:35:50.668079 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 534/1110] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:50 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:50.711977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a219ee8-2d28-42b4-a40b-7312e96416e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:50.722512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a219ee8-2d28-42b4-a40b-7312e96416e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:50.724046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a219ee8-2d28-42b4-a40b-7312e96416e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:50.725285 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a219ee8-2d28-42b4-a40b-7312e96416e8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 0.195419 Aug 27 04:35:50.725940 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 577/1111] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:50 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:50.734731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1b0c1873-3278-41b2-9046-d18bd3b6e6cd tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:50.735359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1b0c1873-3278-41b2-9046-d18bd3b6e6cd tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:50.741802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b0c1873-3278-41b2-9046-d18bd3b6e6cd tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:50.742286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b0c1873-3278-41b2-9046-d18bd3b6e6cd tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:50.742716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b0c1873-3278-41b2-9046-d18bd3b6e6cd tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:50.743419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b0c1873-3278-41b2-9046-d18bd3b6e6cd tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:50.743851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b0c1873-3278-41b2-9046-d18bd3b6e6cd tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:50.744273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b0c1873-3278-41b2-9046-d18bd3b6e6cd tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:50.876661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1b0c1873-3278-41b2-9046-d18bd3b6e6cd tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:50.886468 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1b0c1873-3278-41b2-9046-d18bd3b6e6cd tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1314 microversion: 2.1 time: 0.155669 Aug 27 04:35:50.887164 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 535/1112] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:50 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:51.101268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d8d0896-a5e9-48ff-966c-f817e99bad5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:51.101981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d8d0896-a5e9-48ff-966c-f817e99bad5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:51.104903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:51.111414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d8d0896-a5e9-48ff-966c-f817e99bad5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:51.112580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d8d0896-a5e9-48ff-966c-f817e99bad5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:51.113254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d8d0896-a5e9-48ff-966c-f817e99bad5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:51.116308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d8d0896-a5e9-48ff-966c-f817e99bad5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:51.117403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d8d0896-a5e9-48ff-966c-f817e99bad5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:51.119121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d8d0896-a5e9-48ff-966c-f817e99bad5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:51.251997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1fd3e86e-7c33-4a79-8ff9-6c66df281065 req-00ba88ef-65ad-4c89-a5fb-e726d25b9a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e6b1d8-56bd-49dd-952f-758425633218", "name": "network-vif-plugged", "status": "completed", "tag": "e2dd7cd4-c5d5-4ad2-80a1-6b887249437f"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:51.274888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1fd3e86e-7c33-4a79-8ff9-6c66df281065 req-00ba88ef-65ad-4c89-a5fb-e726d25b9a3f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:51.278359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1fd3e86e-7c33-4a79-8ff9-6c66df281065 req-00ba88ef-65ad-4c89-a5fb-e726d25b9a3f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:51.279501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1fd3e86e-7c33-4a79-8ff9-6c66df281065 req-00ba88ef-65ad-4c89-a5fb-e726d25b9a3f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:51.305687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d8d0896-a5e9-48ff-966c-f817e99bad5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:51.311170 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1fd3e86e-7c33-4a79-8ff9-6c66df281065 req-00ba88ef-65ad-4c89-a5fb-e726d25b9a3f service nova] Creating event network-vif-plugged:e2dd7cd4-c5d5-4ad2-80a1-6b887249437f for instance c0e6b1d8-56bd-49dd-952f-758425633218 on n-h1-854823-1 Aug 27 04:35:51.314122 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d8d0896-a5e9-48ff-966c-f817e99bad5b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d" status: 200 len: 1475 microversion: 2.1 time: 0.216653 Aug 27 04:35:51.315264 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 578/1113] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:51 2022] GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d => generated 1475 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:51.332110 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1fd3e86e-7c33-4a79-8ff9-6c66df281065 req-00ba88ef-65ad-4c89-a5fb-e726d25b9a3f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089816 Aug 27 04:35:51.332948 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 536/1114] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:51.352409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98a96ce2-256e-4334-8411-d5452de3a6d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:51.353386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98a96ce2-256e-4334-8411-d5452de3a6d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:51.364627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a96ce2-256e-4334-8411-d5452de3a6d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:51.365340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a96ce2-256e-4334-8411-d5452de3a6d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:51.365957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a96ce2-256e-4334-8411-d5452de3a6d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:51.366840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a96ce2-256e-4334-8411-d5452de3a6d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:51.367635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a96ce2-256e-4334-8411-d5452de3a6d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:51.368383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a96ce2-256e-4334-8411-d5452de3a6d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:51.548040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8b68d75-6b1a-490f-95e2-6a88f7c25a1b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:51.549057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a8b68d75-6b1a-490f-95e2-6a88f7c25a1b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:51.555236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8b68d75-6b1a-490f-95e2-6a88f7c25a1b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:51.555928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8b68d75-6b1a-490f-95e2-6a88f7c25a1b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:51.556416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8b68d75-6b1a-490f-95e2-6a88f7c25a1b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:51.557303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8b68d75-6b1a-490f-95e2-6a88f7c25a1b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:51.557925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8b68d75-6b1a-490f-95e2-6a88f7c25a1b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:51.558638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8b68d75-6b1a-490f-95e2-6a88f7c25a1b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:51.595374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-98a96ce2-256e-4334-8411-d5452de3a6d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:51.606115 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-98a96ce2-256e-4334-8411-d5452de3a6d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1311 microversion: 2.1 time: 0.271786 Aug 27 04:35:51.606959 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 537/1115] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:51 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1311 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:51.689416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d4264673-ab97-4c43-92bd-2bb26a0076bc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:51.691240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d4264673-ab97-4c43-92bd-2bb26a0076bc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:51.698428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4264673-ab97-4c43-92bd-2bb26a0076bc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:51.699136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4264673-ab97-4c43-92bd-2bb26a0076bc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:51.699733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4264673-ab97-4c43-92bd-2bb26a0076bc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:51.700733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4264673-ab97-4c43-92bd-2bb26a0076bc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:51.701353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4264673-ab97-4c43-92bd-2bb26a0076bc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:51.701931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4264673-ab97-4c43-92bd-2bb26a0076bc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:51.702699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8b68d75-6b1a-490f-95e2-6a88f7c25a1b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:51.711514 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8b68d75-6b1a-490f-95e2-6a88f7c25a1b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1378 microversion: 2.1 time: 0.167804 Aug 27 04:35:51.712877 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 579/1116] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:51 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1378 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:51.749953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1751b90a-31cc-4aa6-9bf5-7dd8be0f2892 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:51.750914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1751b90a-31cc-4aa6-9bf5-7dd8be0f2892 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:51.757822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1751b90a-31cc-4aa6-9bf5-7dd8be0f2892 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:51.758526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1751b90a-31cc-4aa6-9bf5-7dd8be0f2892 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:51.758964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1751b90a-31cc-4aa6-9bf5-7dd8be0f2892 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:51.761384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1751b90a-31cc-4aa6-9bf5-7dd8be0f2892 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:51.761858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1751b90a-31cc-4aa6-9bf5-7dd8be0f2892 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:51.762291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1751b90a-31cc-4aa6-9bf5-7dd8be0f2892 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:51.907648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1751b90a-31cc-4aa6-9bf5-7dd8be0f2892 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:51.917469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1751b90a-31cc-4aa6-9bf5-7dd8be0f2892 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:51.918937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1751b90a-31cc-4aa6-9bf5-7dd8be0f2892 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:51.920063 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1751b90a-31cc-4aa6-9bf5-7dd8be0f2892 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 0.174404 Aug 27 04:35:51.920714 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 580/1117] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:51 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:51.933642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d4264673-ab97-4c43-92bd-2bb26a0076bc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:51.942953 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d4264673-ab97-4c43-92bd-2bb26a0076bc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.258147 Aug 27 04:35:51.943436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5331052f-00e3-41e5-a8c3-f47f6b9d2484 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:51.944679 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 538/1118] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:51 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:51.944856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5331052f-00e3-41e5-a8c3-f47f6b9d2484 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:51.951143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5331052f-00e3-41e5-a8c3-f47f6b9d2484 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:51.951712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5331052f-00e3-41e5-a8c3-f47f6b9d2484 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:51.952380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5331052f-00e3-41e5-a8c3-f47f6b9d2484 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:51.953205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5331052f-00e3-41e5-a8c3-f47f6b9d2484 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:51.953738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5331052f-00e3-41e5-a8c3-f47f6b9d2484 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:51.954244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5331052f-00e3-41e5-a8c3-f47f6b9d2484 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:52.133750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-bb4670db-d2cd-43c0-be65-bae01b2865c4 req-44dc8b4a-fa80-4844-b935-8fd35e7c60fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c0f478e-9899-40b9-b4fc-c937daf213fd", "name": "network-vif-deleted", "tag": "00cbdba8-58fb-4799-910c-9bb07b2bd780"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:52.167613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bb4670db-d2cd-43c0-be65-bae01b2865c4 req-44dc8b4a-fa80-4844-b935-8fd35e7c60fe service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:52.168394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bb4670db-d2cd-43c0-be65-bae01b2865c4 req-44dc8b4a-fa80-4844-b935-8fd35e7c60fe service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:52.170673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bb4670db-d2cd-43c0-be65-bae01b2865c4 req-44dc8b4a-fa80-4844-b935-8fd35e7c60fe service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:52.197517 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-bb4670db-d2cd-43c0-be65-bae01b2865c4 req-44dc8b4a-fa80-4844-b935-8fd35e7c60fe service nova] Creating event network-vif-deleted:00cbdba8-58fb-4799-910c-9bb07b2bd780 for instance 4c0f478e-9899-40b9-b4fc-c937daf213fd on n-h2-854823-1 Aug 27 04:35:52.218120 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-bb4670db-d2cd-43c0-be65-bae01b2865c4 req-44dc8b4a-fa80-4844-b935-8fd35e7c60fe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075997 Aug 27 04:35:52.222015 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 539/1119] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:52.271417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5331052f-00e3-41e5-a8c3-f47f6b9d2484 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:52.279985 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5331052f-00e3-41e5-a8c3-f47f6b9d2484 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1314 microversion: 2.1 time: 0.354183 Aug 27 04:35:52.285726 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 581/1120] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:51 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:52.336983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f6bd532d-f272-4cf8-9fd7-410505b15f95 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:52.338518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f6bd532d-f272-4cf8-9fd7-410505b15f95 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:52.346494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6bd532d-f272-4cf8-9fd7-410505b15f95 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:52.347412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6bd532d-f272-4cf8-9fd7-410505b15f95 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:52.348044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6bd532d-f272-4cf8-9fd7-410505b15f95 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:52.350828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6bd532d-f272-4cf8-9fd7-410505b15f95 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:52.351631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6bd532d-f272-4cf8-9fd7-410505b15f95 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:52.352268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6bd532d-f272-4cf8-9fd7-410505b15f95 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:52.438895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-194818e4-08df-4a62-853d-c960b2be3255 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9a4584e-39ae-414c-af1b-33f8331e502b"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:52.442328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-194818e4-08df-4a62-853d-c960b2be3255 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:52.448925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-194818e4-08df-4a62-853d-c960b2be3255 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:52.449941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-194818e4-08df-4a62-853d-c960b2be3255 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:52.451222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-194818e4-08df-4a62-853d-c960b2be3255 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:52.452183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-194818e4-08df-4a62-853d-c960b2be3255 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:52.452907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-194818e4-08df-4a62-853d-c960b2be3255 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:52.453575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-194818e4-08df-4a62-853d-c960b2be3255 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:52.571185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f6bd532d-f272-4cf8-9fd7-410505b15f95 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:52.583320 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f6bd532d-f272-4cf8-9fd7-410505b15f95 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d" status: 200 len: 1475 microversion: 2.1 time: 0.250468 Aug 27 04:35:52.584371 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 540/1121] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:52 2022] GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d => generated 1475 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:52.626855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-88b2cbe7-6ede-433b-bade-149e904db937 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:52.628665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-88b2cbe7-6ede-433b-bade-149e904db937 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:52.644327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88b2cbe7-6ede-433b-bade-149e904db937 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:52.645121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88b2cbe7-6ede-433b-bade-149e904db937 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:52.645722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88b2cbe7-6ede-433b-bade-149e904db937 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:52.646633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88b2cbe7-6ede-433b-bade-149e904db937 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:52.647264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88b2cbe7-6ede-433b-bade-149e904db937 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:52.647694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88b2cbe7-6ede-433b-bade-149e904db937 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:52.806871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-88b2cbe7-6ede-433b-bade-149e904db937 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:52.816776 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-88b2cbe7-6ede-433b-bade-149e904db937 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1311 microversion: 2.1 time: 0.194132 Aug 27 04:35:52.817379 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 541/1122] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:52 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1311 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:52.822118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-90e39cfb-ecc1-4798-99af-69c74ddb9095 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:52.822730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-90e39cfb-ecc1-4798-99af-69c74ddb9095 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:52.828917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90e39cfb-ecc1-4798-99af-69c74ddb9095 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:52.829435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90e39cfb-ecc1-4798-99af-69c74ddb9095 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:52.829964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90e39cfb-ecc1-4798-99af-69c74ddb9095 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:52.831365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90e39cfb-ecc1-4798-99af-69c74ddb9095 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:52.831997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90e39cfb-ecc1-4798-99af-69c74ddb9095 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:52.832428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90e39cfb-ecc1-4798-99af-69c74ddb9095 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:52.851706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:52.970397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-90e39cfb-ecc1-4798-99af-69c74ddb9095 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:52.979223 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-90e39cfb-ecc1-4798-99af-69c74ddb9095 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1378 microversion: 2.1 time: 0.160589 Aug 27 04:35:52.979819 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 542/1123] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:52 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1378 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:52.990280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e51eff1-566c-447e-b301-ec256e60540f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:52.990280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4e51eff1-566c-447e-b301-ec256e60540f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:52.991989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e51eff1-566c-447e-b301-ec256e60540f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:52.992576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e51eff1-566c-447e-b301-ec256e60540f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:52.993021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e51eff1-566c-447e-b301-ec256e60540f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:52.993745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e51eff1-566c-447e-b301-ec256e60540f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:52.994205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e51eff1-566c-447e-b301-ec256e60540f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:52.994636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e51eff1-566c-447e-b301-ec256e60540f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:53.130778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4e51eff1-566c-447e-b301-ec256e60540f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:53.139695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4e51eff1-566c-447e-b301-ec256e60540f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:53.141176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4e51eff1-566c-447e-b301-ec256e60540f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:53.142292 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4e51eff1-566c-447e-b301-ec256e60540f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 0.161539 Aug 27 04:35:53.156710 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 543/1124] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:52 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:53.164187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b753e075-4e3e-4f91-bf67-29cfdbcb19d4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:53.164856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b753e075-4e3e-4f91-bf67-29cfdbcb19d4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:53.171597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b753e075-4e3e-4f91-bf67-29cfdbcb19d4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:53.172093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b753e075-4e3e-4f91-bf67-29cfdbcb19d4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:53.172684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b753e075-4e3e-4f91-bf67-29cfdbcb19d4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:53.173534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b753e075-4e3e-4f91-bf67-29cfdbcb19d4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:53.174137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b753e075-4e3e-4f91-bf67-29cfdbcb19d4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:53.174570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b753e075-4e3e-4f91-bf67-29cfdbcb19d4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:53.312321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b753e075-4e3e-4f91-bf67-29cfdbcb19d4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:53.320629 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b753e075-4e3e-4f91-bf67-29cfdbcb19d4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.162576 Aug 27 04:35:53.321196 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 544/1125] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:53 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:53.325598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59c8823a-8377-4bef-a3f4-1b07ea4face1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:53.326141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-59c8823a-8377-4bef-a3f4-1b07ea4face1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:53.332319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59c8823a-8377-4bef-a3f4-1b07ea4face1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:53.332839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59c8823a-8377-4bef-a3f4-1b07ea4face1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:53.333280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59c8823a-8377-4bef-a3f4-1b07ea4face1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:53.334035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59c8823a-8377-4bef-a3f4-1b07ea4face1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:53.334519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59c8823a-8377-4bef-a3f4-1b07ea4face1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:53.334944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59c8823a-8377-4bef-a3f4-1b07ea4face1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:53.463176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-59c8823a-8377-4bef-a3f4-1b07ea4face1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:53.470949 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-59c8823a-8377-4bef-a3f4-1b07ea4face1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1314 microversion: 2.1 time: 0.148762 Aug 27 04:35:53.471572 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 545/1126] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:53 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:53.475939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-c9d280c3-8c86-48f0-bdfa-58721d5c4edc req-395a4dbd-413a-4ff6-9216-ff031936a663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9f7532-3523-4bb1-a4a2-94349c6d6987", "name": "network-vif-plugged", "status": "completed", "tag": "4cb160f5-11d2-482c-a21f-4f0aea664bef"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:53.485313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c9d280c3-8c86-48f0-bdfa-58721d5c4edc req-395a4dbd-413a-4ff6-9216-ff031936a663 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:53.485795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c9d280c3-8c86-48f0-bdfa-58721d5c4edc req-395a4dbd-413a-4ff6-9216-ff031936a663 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:53.486223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c9d280c3-8c86-48f0-bdfa-58721d5c4edc req-395a4dbd-413a-4ff6-9216-ff031936a663 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:53.499170 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-c9d280c3-8c86-48f0-bdfa-58721d5c4edc req-395a4dbd-413a-4ff6-9216-ff031936a663 service nova] Creating event network-vif-plugged:4cb160f5-11d2-482c-a21f-4f0aea664bef for instance 3d9f7532-3523-4bb1-a4a2-94349c6d6987 on n-h2-854823-1 Aug 27 04:35:53.504996 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-c9d280c3-8c86-48f0-bdfa-58721d5c4edc req-395a4dbd-413a-4ff6-9216-ff031936a663 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032227 Aug 27 04:35:53.505589 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 546/1127] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:53.606617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-120b6088-f79c-4114-8f01-45e9406345d2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:53.607338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-120b6088-f79c-4114-8f01-45e9406345d2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:53.614434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-120b6088-f79c-4114-8f01-45e9406345d2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:53.614925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-120b6088-f79c-4114-8f01-45e9406345d2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:53.615366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-120b6088-f79c-4114-8f01-45e9406345d2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:53.616097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-120b6088-f79c-4114-8f01-45e9406345d2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:53.616574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-120b6088-f79c-4114-8f01-45e9406345d2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:53.617007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-120b6088-f79c-4114-8f01-45e9406345d2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:53.746120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-120b6088-f79c-4114-8f01-45e9406345d2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:53.754834 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-120b6088-f79c-4114-8f01-45e9406345d2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d" status: 200 len: 1475 microversion: 2.1 time: 0.153099 Aug 27 04:35:53.755401 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 547/1128] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:53 2022] GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d => generated 1475 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:53.837294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc12e937-53a3-4a0f-ba83-b3b9cb0de7ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:53.837934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bc12e937-53a3-4a0f-ba83-b3b9cb0de7ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:53.844136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc12e937-53a3-4a0f-ba83-b3b9cb0de7ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:53.844655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc12e937-53a3-4a0f-ba83-b3b9cb0de7ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:53.845096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc12e937-53a3-4a0f-ba83-b3b9cb0de7ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:53.846379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc12e937-53a3-4a0f-ba83-b3b9cb0de7ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:53.846882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc12e937-53a3-4a0f-ba83-b3b9cb0de7ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:53.847312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc12e937-53a3-4a0f-ba83-b3b9cb0de7ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:54.150040 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-194818e4-08df-4a62-853d-c960b2be3255 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "POST /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.714987 Aug 27 04:35:54.150828 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 582/1129] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 04:35:52 2022] POST /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33/os-volume_attachments => generated 194 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:54.156949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8ff005f-c6b9-4363-bf8c-61e6bdc3da9d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:54.158872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8ff005f-c6b9-4363-bf8c-61e6bdc3da9d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:54.167066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bc12e937-53a3-4a0f-ba83-b3b9cb0de7ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:54.167664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ff005f-c6b9-4363-bf8c-61e6bdc3da9d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:54.168406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ff005f-c6b9-4363-bf8c-61e6bdc3da9d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:54.170621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ff005f-c6b9-4363-bf8c-61e6bdc3da9d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:54.172367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ff005f-c6b9-4363-bf8c-61e6bdc3da9d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:54.173134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ff005f-c6b9-4363-bf8c-61e6bdc3da9d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:54.174449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ff005f-c6b9-4363-bf8c-61e6bdc3da9d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:54.181256 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bc12e937-53a3-4a0f-ba83-b3b9cb0de7ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1311 microversion: 2.1 time: 0.346020 Aug 27 04:35:54.182234 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 548/1130] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:53 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1311 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:54.188151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5e253ce5-8ca2-4914-b8a4-a6d57fe10a85 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:54.188861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5e253ce5-8ca2-4914-b8a4-a6d57fe10a85 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:54.195371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e253ce5-8ca2-4914-b8a4-a6d57fe10a85 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:54.196102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e253ce5-8ca2-4914-b8a4-a6d57fe10a85 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:54.196596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e253ce5-8ca2-4914-b8a4-a6d57fe10a85 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:54.197314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e253ce5-8ca2-4914-b8a4-a6d57fe10a85 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:54.198130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e253ce5-8ca2-4914-b8a4-a6d57fe10a85 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:54.198468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e253ce5-8ca2-4914-b8a4-a6d57fe10a85 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:54.332563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8ff005f-c6b9-4363-bf8c-61e6bdc3da9d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:54.340646 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8ff005f-c6b9-4363-bf8c-61e6bdc3da9d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1378 microversion: 2.1 time: 0.188308 Aug 27 04:35:54.341238 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 583/1131] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:54 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1378 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:54.345667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2bc6929c-9e74-4eda-8a9f-ae39809f6541 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:54.346793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2bc6929c-9e74-4eda-8a9f-ae39809f6541 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:54.352899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bc6929c-9e74-4eda-8a9f-ae39809f6541 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:54.353397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bc6929c-9e74-4eda-8a9f-ae39809f6541 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:54.353833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bc6929c-9e74-4eda-8a9f-ae39809f6541 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:54.354531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bc6929c-9e74-4eda-8a9f-ae39809f6541 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:54.354992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bc6929c-9e74-4eda-8a9f-ae39809f6541 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:54.355418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bc6929c-9e74-4eda-8a9f-ae39809f6541 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:54.434962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5e253ce5-8ca2-4914-b8a4-a6d57fe10a85 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:54.444331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5e253ce5-8ca2-4914-b8a4-a6d57fe10a85 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:54.445814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5e253ce5-8ca2-4914-b8a4-a6d57fe10a85 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:54.447143 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5e253ce5-8ca2-4914-b8a4-a6d57fe10a85 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 0.263813 Aug 27 04:35:54.447716 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 549/1132] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:54 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:54.492559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-113ba260-f7cc-48d8-acaf-33af3d625dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:54.493572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-113ba260-f7cc-48d8-acaf-33af3d625dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:54.499684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-113ba260-f7cc-48d8-acaf-33af3d625dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:54.500427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-113ba260-f7cc-48d8-acaf-33af3d625dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:54.500666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2bc6929c-9e74-4eda-8a9f-ae39809f6541 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:54.500917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-113ba260-f7cc-48d8-acaf-33af3d625dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:54.501628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-113ba260-f7cc-48d8-acaf-33af3d625dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:54.502660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-113ba260-f7cc-48d8-acaf-33af3d625dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:54.503198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-113ba260-f7cc-48d8-acaf-33af3d625dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:54.516936 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2bc6929c-9e74-4eda-8a9f-ae39809f6541 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1497 microversion: 2.1 time: 0.174597 Aug 27 04:35:54.527986 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 584/1133] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:54 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:54.753711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-113ba260-f7cc-48d8-acaf-33af3d625dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:54.761521 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-113ba260-f7cc-48d8-acaf-33af3d625dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1314 microversion: 2.1 time: 0.273495 Aug 27 04:35:54.774759 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 550/1134] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:54 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:54.779713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c121544e-613d-4c49-9e48-2513dfdcc866 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:54.780011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c121544e-613d-4c49-9e48-2513dfdcc866 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:54.787161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c121544e-613d-4c49-9e48-2513dfdcc866 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:54.787653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c121544e-613d-4c49-9e48-2513dfdcc866 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:54.788222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c121544e-613d-4c49-9e48-2513dfdcc866 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:54.789092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c121544e-613d-4c49-9e48-2513dfdcc866 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:54.789544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c121544e-613d-4c49-9e48-2513dfdcc866 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:54.790153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c121544e-613d-4c49-9e48-2513dfdcc866 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:54.873657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-fcd88ab4-620b-4612-8556-15705c9b990f req-371886de-76b7-4fbf-a0b6-08601937820f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "516299cc-c878-4b8e-bb4d-4247ddbd90cf", "tag": "326c17ad-2ce3-4c6b-854b-aeff6eeb991e"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:54.886228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fcd88ab4-620b-4612-8556-15705c9b990f req-371886de-76b7-4fbf-a0b6-08601937820f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:54.887079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fcd88ab4-620b-4612-8556-15705c9b990f req-371886de-76b7-4fbf-a0b6-08601937820f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:54.887726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fcd88ab4-620b-4612-8556-15705c9b990f req-371886de-76b7-4fbf-a0b6-08601937820f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:54.903010 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-fcd88ab4-620b-4612-8556-15705c9b990f req-371886de-76b7-4fbf-a0b6-08601937820f service nova] Creating event network-changed:326c17ad-2ce3-4c6b-854b-aeff6eeb991e for instance 516299cc-c878-4b8e-bb4d-4247ddbd90cf on n-h1-854823-1 Aug 27 04:35:54.910506 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-fcd88ab4-620b-4612-8556-15705c9b990f req-371886de-76b7-4fbf-a0b6-08601937820f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042549 Aug 27 04:35:54.912069 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 551/1135] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:54.939159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c121544e-613d-4c49-9e48-2513dfdcc866 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:54.946882 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c121544e-613d-4c49-9e48-2513dfdcc866 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d" status: 200 len: 1475 microversion: 2.1 time: 0.175303 Aug 27 04:35:54.947455 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 585/1136] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:54 2022] GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d => generated 1475 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:55.203159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6107714b-d6fc-4a8f-8578-b872bec38cc1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:55.203865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6107714b-d6fc-4a8f-8578-b872bec38cc1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:55.210746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6107714b-d6fc-4a8f-8578-b872bec38cc1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:55.211240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6107714b-d6fc-4a8f-8578-b872bec38cc1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:55.211681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6107714b-d6fc-4a8f-8578-b872bec38cc1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:55.212386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6107714b-d6fc-4a8f-8578-b872bec38cc1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:55.212871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6107714b-d6fc-4a8f-8578-b872bec38cc1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:55.213301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6107714b-d6fc-4a8f-8578-b872bec38cc1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:55.362788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12f2a06e-c5f4-4109-a82b-0e5777682184 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:55.363400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12f2a06e-c5f4-4109-a82b-0e5777682184 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:55.372786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12f2a06e-c5f4-4109-a82b-0e5777682184 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:55.373626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12f2a06e-c5f4-4109-a82b-0e5777682184 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:55.374701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12f2a06e-c5f4-4109-a82b-0e5777682184 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:55.376271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12f2a06e-c5f4-4109-a82b-0e5777682184 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:55.377350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12f2a06e-c5f4-4109-a82b-0e5777682184 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:55.377920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12f2a06e-c5f4-4109-a82b-0e5777682184 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:55.400749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:55.489513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6107714b-d6fc-4a8f-8578-b872bec38cc1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:55.497374 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6107714b-d6fc-4a8f-8578-b872bec38cc1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1311 microversion: 2.1 time: 0.299503 Aug 27 04:35:55.497969 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 552/1137] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:55 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1311 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:55.503590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b88fe50f-f5e8-4ec9-ac3d-9646dc0ecaef tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:55.504199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b88fe50f-f5e8-4ec9-ac3d-9646dc0ecaef tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:55.515297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88fe50f-f5e8-4ec9-ac3d-9646dc0ecaef tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:55.515786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88fe50f-f5e8-4ec9-ac3d-9646dc0ecaef tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:55.516433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88fe50f-f5e8-4ec9-ac3d-9646dc0ecaef tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:55.517380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88fe50f-f5e8-4ec9-ac3d-9646dc0ecaef tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:55.518474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88fe50f-f5e8-4ec9-ac3d-9646dc0ecaef tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:55.519216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88fe50f-f5e8-4ec9-ac3d-9646dc0ecaef tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:55.605947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-12f2a06e-c5f4-4109-a82b-0e5777682184 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:55.614071 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12f2a06e-c5f4-4109-a82b-0e5777682184 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1378 microversion: 2.1 time: 0.255409 Aug 27 04:35:55.626374 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 586/1138] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:55 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1378 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:55.634584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb6b2ca7-a16b-4fe9-b585-15020c6e59c2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:55.635487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fb6b2ca7-a16b-4fe9-b585-15020c6e59c2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:55.642026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb6b2ca7-a16b-4fe9-b585-15020c6e59c2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:55.643422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb6b2ca7-a16b-4fe9-b585-15020c6e59c2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:55.644034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb6b2ca7-a16b-4fe9-b585-15020c6e59c2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:55.644775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb6b2ca7-a16b-4fe9-b585-15020c6e59c2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:55.645509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb6b2ca7-a16b-4fe9-b585-15020c6e59c2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:55.646093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb6b2ca7-a16b-4fe9-b585-15020c6e59c2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:55.670410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b88fe50f-f5e8-4ec9-ac3d-9646dc0ecaef tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:55.682904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b88fe50f-f5e8-4ec9-ac3d-9646dc0ecaef tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:55.686165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b88fe50f-f5e8-4ec9-ac3d-9646dc0ecaef tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:55.687654 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b88fe50f-f5e8-4ec9-ac3d-9646dc0ecaef tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 0.188685 Aug 27 04:35:55.688356 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 553/1139] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:55 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:55.782223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-67f9d9d6-9dac-46ea-90b0-57d8c6d3d757 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:55.782836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-67f9d9d6-9dac-46ea-90b0-57d8c6d3d757 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:55.803875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67f9d9d6-9dac-46ea-90b0-57d8c6d3d757 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:55.804377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67f9d9d6-9dac-46ea-90b0-57d8c6d3d757 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:55.804832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67f9d9d6-9dac-46ea-90b0-57d8c6d3d757 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:55.807659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67f9d9d6-9dac-46ea-90b0-57d8c6d3d757 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:55.808355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67f9d9d6-9dac-46ea-90b0-57d8c6d3d757 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:55.809016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67f9d9d6-9dac-46ea-90b0-57d8c6d3d757 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:55.923373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fb6b2ca7-a16b-4fe9-b585-15020c6e59c2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:55.936520 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fb6b2ca7-a16b-4fe9-b585-15020c6e59c2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 200 len: 1474 microversion: 2.1 time: 0.307376 Aug 27 04:35:55.939065 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 587/1140] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:55 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 1474 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:55.960970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e799e01d-61ed-4097-a9e0-a1cb7ae4a802 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-264518321"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:55.965848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e799e01d-61ed-4097-a9e0-a1cb7ae4a802 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:55.973467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e799e01d-61ed-4097-a9e0-a1cb7ae4a802 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:55.974503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e799e01d-61ed-4097-a9e0-a1cb7ae4a802 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:55.975174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e799e01d-61ed-4097-a9e0-a1cb7ae4a802 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:55.976244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e799e01d-61ed-4097-a9e0-a1cb7ae4a802 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:55.976958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e799e01d-61ed-4097-a9e0-a1cb7ae4a802 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:55.977612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e799e01d-61ed-4097-a9e0-a1cb7ae4a802 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:56.326929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-67f9d9d6-9dac-46ea-90b0-57d8c6d3d757 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:56.346895 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-67f9d9d6-9dac-46ea-90b0-57d8c6d3d757 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1463 microversion: 2.1 time: 0.568345 Aug 27 04:35:56.349840 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 554/1141] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:55 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1463 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:56.359918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2b956c3a-627e-4513-8d6e-f809ba5158cb tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:56.362451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2b956c3a-627e-4513-8d6e-f809ba5158cb tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:56.395638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b956c3a-627e-4513-8d6e-f809ba5158cb tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:56.396049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b956c3a-627e-4513-8d6e-f809ba5158cb tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:56.396850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b956c3a-627e-4513-8d6e-f809ba5158cb tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:56.400415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b956c3a-627e-4513-8d6e-f809ba5158cb tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:56.400967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b956c3a-627e-4513-8d6e-f809ba5158cb tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:56.404711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b956c3a-627e-4513-8d6e-f809ba5158cb tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:56.502864 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e799e01d-61ed-4097-a9e0-a1cb7ae4a802 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "POST /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01/action" status: 202 len: 0 microversion: 2.1 time: 0.542255 Aug 27 04:35:56.510547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b956c3a-627e-4513-8d6e-f809ba5158cb tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:56.516246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b956c3a-627e-4513-8d6e-f809ba5158cb tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:56.517267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b956c3a-627e-4513-8d6e-f809ba5158cb tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:56.518171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-2b956c3a-627e-4513-8d6e-f809ba5158cb tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lazy-loading 'fault' on Instance uuid 6a00035e-e4c1-4f81-87d6-ec313135748d {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:56.524626 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 588/1142] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:35:55 2022] POST /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:35:56.538424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-71ce5114-f893-458d-8457-3edeed550c75 req-60d81547-819c-4300-9fc2-b9ab40c9acdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a00035e-e4c1-4f81-87d6-ec313135748d", "name": "network-vif-deleted", "tag": "2c4b570a-3a24-4896-99c5-f379ade7aa08"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:56.551679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-71ce5114-f893-458d-8457-3edeed550c75 req-60d81547-819c-4300-9fc2-b9ab40c9acdc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:56.552674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-71ce5114-f893-458d-8457-3edeed550c75 req-60d81547-819c-4300-9fc2-b9ab40c9acdc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:56.554747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-71ce5114-f893-458d-8457-3edeed550c75 req-60d81547-819c-4300-9fc2-b9ab40c9acdc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:56.571318 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-71ce5114-f893-458d-8457-3edeed550c75 req-60d81547-819c-4300-9fc2-b9ab40c9acdc service nova] Creating event network-vif-deleted:2c4b570a-3a24-4896-99c5-f379ade7aa08 for instance 6a00035e-e4c1-4f81-87d6-ec313135748d on n-h1-854823-1 Aug 27 04:35:56.577041 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-71ce5114-f893-458d-8457-3edeed550c75 req-60d81547-819c-4300-9fc2-b9ab40c9acdc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050538 Aug 27 04:35:56.583116 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 589/1143] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:56.589180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f007c8c1-b6a6-4a92-8717-f50ee3e91d95 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:56.590091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f007c8c1-b6a6-4a92-8717-f50ee3e91d95 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:56.599492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f007c8c1-b6a6-4a92-8717-f50ee3e91d95 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:56.600194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f007c8c1-b6a6-4a92-8717-f50ee3e91d95 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:56.600879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f007c8c1-b6a6-4a92-8717-f50ee3e91d95 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:56.603334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f007c8c1-b6a6-4a92-8717-f50ee3e91d95 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:56.604737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f007c8c1-b6a6-4a92-8717-f50ee3e91d95 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:56.606089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f007c8c1-b6a6-4a92-8717-f50ee3e91d95 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:56.633942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:56.665079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=22 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:56.694653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2b956c3a-627e-4513-8d6e-f809ba5158cb tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:56.708791 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2b956c3a-627e-4513-8d6e-f809ba5158cb tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d" status: 200 len: 1309 microversion: 2.1 time: 0.350358 Aug 27 04:35:56.709745 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 555/1144] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:56 2022] GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d => generated 1309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:56.718336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-210ed32e-ed1a-4c00-96c3-58f1aa4d607c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25e71670>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:56.796757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=24 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:56.796911 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-210ed32e-ed1a-4c00-96c3-58f1aa4d607c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.085806 Aug 27 04:35:56.812045 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 556/1145] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:35:56 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:56.817527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-05d20a9b-0976-4f16-8500-cb71b72c26b8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:56.818148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-05d20a9b-0976-4f16-8500-cb71b72c26b8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:56.839189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05d20a9b-0976-4f16-8500-cb71b72c26b8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:56.839690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05d20a9b-0976-4f16-8500-cb71b72c26b8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:56.840134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05d20a9b-0976-4f16-8500-cb71b72c26b8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:56.840867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05d20a9b-0976-4f16-8500-cb71b72c26b8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:56.841361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05d20a9b-0976-4f16-8500-cb71b72c26b8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:56.841762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05d20a9b-0976-4f16-8500-cb71b72c26b8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:56.858709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f007c8c1-b6a6-4a92-8717-f50ee3e91d95 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:56.869290 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f007c8c1-b6a6-4a92-8717-f50ee3e91d95 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1463 microversion: 2.1 time: 0.284469 Aug 27 04:35:56.870925 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 590/1146] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:56 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1463 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:56.876569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-903a0338-c3a1-418e-baff-159570fe2ec1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:56.878228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-903a0338-c3a1-418e-baff-159570fe2ec1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:56.884592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-903a0338-c3a1-418e-baff-159570fe2ec1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:56.885387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-903a0338-c3a1-418e-baff-159570fe2ec1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:56.886052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-903a0338-c3a1-418e-baff-159570fe2ec1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:56.886923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-903a0338-c3a1-418e-baff-159570fe2ec1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:56.887515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-903a0338-c3a1-418e-baff-159570fe2ec1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:56.888252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-903a0338-c3a1-418e-baff-159570fe2ec1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.067095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-903a0338-c3a1-418e-baff-159570fe2ec1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:57.074766 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-903a0338-c3a1-418e-baff-159570fe2ec1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1378 microversion: 2.1 time: 0.202662 Aug 27 04:35:57.083863 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 591/1147] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:56 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1378 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:57.088695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65346025-3fbd-47f8-97be-ca56b52169b5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:57.089311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65346025-3fbd-47f8-97be-ca56b52169b5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:57.095417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65346025-3fbd-47f8-97be-ca56b52169b5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.096544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65346025-3fbd-47f8-97be-ca56b52169b5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.096983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65346025-3fbd-47f8-97be-ca56b52169b5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.097687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65346025-3fbd-47f8-97be-ca56b52169b5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.098141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65346025-3fbd-47f8-97be-ca56b52169b5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.098923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65346025-3fbd-47f8-97be-ca56b52169b5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.154176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-05d20a9b-0976-4f16-8500-cb71b72c26b8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:57.163563 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-05d20a9b-0976-4f16-8500-cb71b72c26b8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1494 microversion: 2.1 time: 0.350470 Aug 27 04:35:57.173136 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 557/1148] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:56 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1494 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:57.173136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-91747937", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "577250c7-f1ee-4541-b83e-131d0e21efea"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:57.226643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:35:57.272314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65346025-3fbd-47f8-97be-ca56b52169b5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:57.281759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65346025-3fbd-47f8-97be-ca56b52169b5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:57.283814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65346025-3fbd-47f8-97be-ca56b52169b5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:57.285027 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65346025-3fbd-47f8-97be-ca56b52169b5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 0.200142 Aug 27 04:35:57.285666 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 592/1149] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:57 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:57.377564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd467d69-658b-4a67-9596-0e0dc6b25c2f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:57.378538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd467d69-658b-4a67-9596-0e0dc6b25c2f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:57.384172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:57.386401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd467d69-658b-4a67-9596-0e0dc6b25c2f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.387618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd467d69-658b-4a67-9596-0e0dc6b25c2f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.388074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd467d69-658b-4a67-9596-0e0dc6b25c2f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.389046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd467d69-658b-4a67-9596-0e0dc6b25c2f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.389903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd467d69-658b-4a67-9596-0e0dc6b25c2f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.390558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd467d69-658b-4a67-9596-0e0dc6b25c2f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.556049 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd467d69-658b-4a67-9596-0e0dc6b25c2f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1645 microversion: 2.1 time: 0.268898 Aug 27 04:35:57.569287 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 593/1150] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:57 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1645 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:57.577260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ffc8bb4-14ec-4bf0-923b-9b097398b661 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:57.577962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0ffc8bb4-14ec-4bf0-923b-9b097398b661 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:57.585247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ffc8bb4-14ec-4bf0-923b-9b097398b661 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.585829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ffc8bb4-14ec-4bf0-923b-9b097398b661 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.586349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ffc8bb4-14ec-4bf0-923b-9b097398b661 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.587166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ffc8bb4-14ec-4bf0-923b-9b097398b661 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.587698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ffc8bb4-14ec-4bf0-923b-9b097398b661 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.588201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ffc8bb4-14ec-4bf0-923b-9b097398b661 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.682131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:35:57.682558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:35:57.683021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:35:57.683429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:35:57.683842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:35:57.698125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.698625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.699067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.699807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.707740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.712216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.740702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Getting quotas for project 3873cb4810d840ac93518952196fd52b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:35:57.746791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Getting quotas for user 23eec6b7eb8b4ad897873c027e095b8d and project 3873cb4810d840ac93518952196fd52b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:35:57.761518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:35:57.764092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:35:57.776199 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ffc8bb4-14ec-4bf0-923b-9b097398b661 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1645 microversion: 2.1 time: 0.202271 Aug 27 04:35:57.781756 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 594/1151] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:57 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1645 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:57.802416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5a88367-34f4-49f7-a08e-67dd818fb08e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:57.803264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5a88367-34f4-49f7-a08e-67dd818fb08e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 6a00035e-e4c1-4f81-87d6-ec313135748d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:57.809764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5a88367-34f4-49f7-a08e-67dd818fb08e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.810511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5a88367-34f4-49f7-a08e-67dd818fb08e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.811344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5a88367-34f4-49f7-a08e-67dd818fb08e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.812218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5a88367-34f4-49f7-a08e-67dd818fb08e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.812892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5a88367-34f4-49f7-a08e-67dd818fb08e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.813478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5a88367-34f4-49f7-a08e-67dd818fb08e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.818472 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-45b7659e-6244-4665-a597-67ee354c2f56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653138 Aug 27 04:35:57.819138 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 558/1152] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:35:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:35:57.824463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-902ed706-a91b-43e9-b4f6-80b356d90a5d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:57.830689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-902ed706-a91b-43e9-b4f6-80b356d90a5d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.831421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-902ed706-a91b-43e9-b4f6-80b356d90a5d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.832044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-902ed706-a91b-43e9-b4f6-80b356d90a5d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.832997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-902ed706-a91b-43e9-b4f6-80b356d90a5d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.833633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-902ed706-a91b-43e9-b4f6-80b356d90a5d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.834207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-902ed706-a91b-43e9-b4f6-80b356d90a5d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.836100 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f5a88367-34f4-49f7-a08e-67dd818fb08e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] HTTP exception thrown: Instance 6a00035e-e4c1-4f81-87d6-ec313135748d could not be found. Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5a88367-34f4-49f7-a08e-67dd818fb08e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Request method failure captured: Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d HTTP/1.1 Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5vZmCQoTpWfO2nVvghaAr6WQ7l0jSxgrsDU_f5pBjkwZR9vYzn-WSBKnKYlb4QrTThFlKQoSD6qMOG1RMxxH3EEGYmrkKAGkNv2QjvxwduOHa8oaP9JROieKflk83mA1Krxt2a8kMGRYbNuKy9a5hu87qF_uDiIUT5j6ZdX0CisgE Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:35:57.838276 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:35:57.839933 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:35:57.839933 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:57.839933 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:35:57.839933 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:57.839933 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:35:57.839933 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:35:57.839933 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:35:57.839933 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cc8cb8eea83f45c1bb06328e31c960e7 Aug 27 04:35:57.839933 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:35:57.839933 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:35:57.839933 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 6a00035e-e4c1-4f81-87d6-ec313135748d could not be found. Aug 27 04:35:57.839933 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '6a00035e-e4c1-4f81-87d6-ec313135748d'} Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a00035e-e4c1-4f81-87d6-ec313135748d could not be found. Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:35:57.841427 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a00035e-e4c1-4f81-87d6-ec313135748d could not be found. Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a00035e-e4c1-4f81-87d6-ec313135748d could not be found. Aug 27 04:35:57.843101 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:57.846173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5a88367-34f4-49f7-a08e-67dd818fb08e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Returning 404 to user: Instance 6a00035e-e4c1-4f81-87d6-ec313135748d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:35:57.847244 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5a88367-34f4-49f7-a08e-67dd818fb08e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d" status: 404 len: 111 microversion: 2.1 time: 0.049578 Aug 27 04:35:57.847830 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 595/1153] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:57 2022] GET /compute/v2.1/servers/6a00035e-e4c1-4f81-87d6-ec313135748d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:35:57.858854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5b595f44-616a-4e04-b536-bc5374b94c2c req-ac5f9ef2-8b9c-4e9c-8e96-52099632869d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7984297a-0070-487d-83cb-a4e4d97aa5ba", "name": "network-vif-plugged", "status": "completed", "tag": "9bf4e91c-b1ee-46b0-ab4c-5e3b87d4673b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:57.864319 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-902ed706-a91b-43e9-b4f6-80b356d90a5d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043936 Aug 27 04:35:57.864997 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 559/1154] 10.222.0.79 () {58 vars in 1176 bytes} [Sat Aug 27 04:35:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:57.869620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-42b14f3a-3a75-4d84-896a-d3d0555bf1cf tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f225fec10>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:57.886994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5b595f44-616a-4e04-b536-bc5374b94c2c req-ac5f9ef2-8b9c-4e9c-8e96-52099632869d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.887603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5b595f44-616a-4e04-b536-bc5374b94c2c req-ac5f9ef2-8b9c-4e9c-8e96-52099632869d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.888079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5b595f44-616a-4e04-b536-bc5374b94c2c req-ac5f9ef2-8b9c-4e9c-8e96-52099632869d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.919259 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5b595f44-616a-4e04-b536-bc5374b94c2c req-ac5f9ef2-8b9c-4e9c-8e96-52099632869d service nova] Creating event network-vif-plugged:9bf4e91c-b1ee-46b0-ab4c-5e3b87d4673b for instance 7984297a-0070-487d-83cb-a4e4d97aa5ba on n-h1-854823-1 Aug 27 04:35:57.922163 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-42b14f3a-3a75-4d84-896a-d3d0555bf1cf tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.055948 Aug 27 04:35:57.922870 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 560/1155] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:35:57 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:57.931058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2ca28ae4-8503-45c6-8818-772034493478 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:57.932575 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5b595f44-616a-4e04-b536-bc5374b94c2c req-ac5f9ef2-8b9c-4e9c-8e96-52099632869d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082871 Aug 27 04:35:57.932712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2ca28ae4-8503-45c6-8818-772034493478 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:57.933198 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 596/1156] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:57.938541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6180f0c9-5640-461d-807d-6f4f8f03421b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:57.939276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6180f0c9-5640-461d-807d-6f4f8f03421b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 4c0f478e-9899-40b9-b4fc-c937daf213fd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:57.946142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6180f0c9-5640-461d-807d-6f4f8f03421b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.946633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6180f0c9-5640-461d-807d-6f4f8f03421b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.947696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6180f0c9-5640-461d-807d-6f4f8f03421b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.948411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6180f0c9-5640-461d-807d-6f4f8f03421b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.948903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6180f0c9-5640-461d-807d-6f4f8f03421b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.949334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6180f0c9-5640-461d-807d-6f4f8f03421b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.965089 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6180f0c9-5640-461d-807d-6f4f8f03421b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] HTTP exception thrown: Instance 4c0f478e-9899-40b9-b4fc-c937daf213fd could not be found. Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6180f0c9-5640-461d-807d-6f4f8f03421b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Request method failure captured: Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd HTTP/1.1 Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5vZmCQoTpWfO2nVvghaAr6WQ7l0jSxgrsDU_f5pBjkwZR9vYzn-WSBKnKYlb4QrTThFlKQoSD6qMOG1RMxxH3EEGYmrkKAGkNv2QjvxwduOHa8oaP9JROieKflk83mA1Krxt2a8kMGRYbNuKy9a5hu87qF_uDiIUT5j6ZdX0CisgE Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:35:57.966803 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:35:57.968430 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:35:57.968430 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:57.968430 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:35:57.968430 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:35:57.968430 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:35:57.968430 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:35:57.968430 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:35:57.968430 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cc8cb8eea83f45c1bb06328e31c960e7 Aug 27 04:35:57.968430 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:35:57.968430 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:35:57.968430 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 4c0f478e-9899-40b9-b4fc-c937daf213fd could not be found. Aug 27 04:35:57.968430 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '4c0f478e-9899-40b9-b4fc-c937daf213fd'} Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c0f478e-9899-40b9-b4fc-c937daf213fd could not be found. Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:35:57.969370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c0f478e-9899-40b9-b4fc-c937daf213fd could not be found. Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c0f478e-9899-40b9-b4fc-c937daf213fd could not be found. Aug 27 04:35:57.971422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:35:57.972900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6180f0c9-5640-461d-807d-6f4f8f03421b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Returning 404 to user: Instance 4c0f478e-9899-40b9-b4fc-c937daf213fd could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:35:57.972900 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6180f0c9-5640-461d-807d-6f4f8f03421b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd" status: 404 len: 111 microversion: 2.1 time: 0.033872 Aug 27 04:35:57.972900 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 597/1157] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:57 2022] GET /compute/v2.1/servers/4c0f478e-9899-40b9-b4fc-c937daf213fd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:35:57.980628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0809823-e365-4b2e-bf67-b3a016d4aae1 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854823-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:57.983443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0809823-e365-4b2e-bf67-b3a016d4aae1 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:57.990181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0809823-e365-4b2e-bf67-b3a016d4aae1 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.990682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0809823-e365-4b2e-bf67-b3a016d4aae1 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.991193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0809823-e365-4b2e-bf67-b3a016d4aae1 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:57.991837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0809823-e365-4b2e-bf67-b3a016d4aae1 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:57.992299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0809823-e365-4b2e-bf67-b3a016d4aae1 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:57.992769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0809823-e365-4b2e-bf67-b3a016d4aae1 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:58.003771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2ca28ae4-8503-45c6-8818-772034493478 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:58.011576 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2ca28ae4-8503-45c6-8818-772034493478 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1212 microversion: 2.1 time: 0.086847 Aug 27 04:35:58.025847 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 561/1158] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:57 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1212 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:58.031627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-f0809823-e365-4b2e-bf67-b3a016d4aae1 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lazy-loading 'flavor' on Instance uuid c0e6b1d8-56bd-49dd-952f-758425633218 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:58.032021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2ab9e741-1a40-4abe-a681-b95bcb0fec2c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:58.047331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0809823-e365-4b2e-bf67-b3a016d4aae1 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Going to try to live migrate instance to n-h2-854823-1 {{(pid=128869) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:35:58.084410 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2ab9e741-1a40-4abe-a681-b95bcb0fec2c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/28a4efd2-e7db-480d-a95a-9f3c83eb1358" status: 204 len: 0 microversion: 2.1 time: 0.070043 Aug 27 04:35:58.085322 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 562/1159] 10.222.0.79 () {58 vars in 1266 bytes} [Sat Aug 27 04:35:58 2022] DELETE /compute/v2.1/os-server-groups/28a4efd2-e7db-480d-a95a-9f3c83eb1358 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:35:58.093406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3fc518b4-39f9-4dd4-be15-780f8f90694d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:58.093905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3fc518b4-39f9-4dd4-be15-780f8f90694d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 20337dd0-bb88-4f11-85be-ec44de54c9da] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:58.101431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fc518b4-39f9-4dd4-be15-780f8f90694d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:58.102103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fc518b4-39f9-4dd4-be15-780f8f90694d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:58.102678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fc518b4-39f9-4dd4-be15-780f8f90694d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:58.103246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fc518b4-39f9-4dd4-be15-780f8f90694d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:58.103705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fc518b4-39f9-4dd4-be15-780f8f90694d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:58.104132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fc518b4-39f9-4dd4-be15-780f8f90694d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:58.134120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3fc518b4-39f9-4dd4-be15-780f8f90694d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 20337dd0-bb88-4f11-85be-ec44de54c9da] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:35:58.203402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:58.243562 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3fc518b4-39f9-4dd4-be15-780f8f90694d tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "DELETE /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da" status: 204 len: 0 microversion: 2.1 time: 0.153904 Aug 27 04:35:58.245200 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 563/1160] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:35:58 2022] DELETE /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:35:58.253554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5bb1e69-8d9e-437f-84af-12c7e47cd0d2 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:58.254406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f5bb1e69-8d9e-437f-84af-12c7e47cd0d2 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:58.257661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:58.265677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5bb1e69-8d9e-437f-84af-12c7e47cd0d2 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:58.266193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5bb1e69-8d9e-437f-84af-12c7e47cd0d2 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:58.266623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5bb1e69-8d9e-437f-84af-12c7e47cd0d2 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:58.267333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5bb1e69-8d9e-437f-84af-12c7e47cd0d2 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:58.267843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5bb1e69-8d9e-437f-84af-12c7e47cd0d2 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:58.268273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5bb1e69-8d9e-437f-84af-12c7e47cd0d2 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:58.465282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f5bb1e69-8d9e-437f-84af-12c7e47cd0d2 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:58.474507 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f5bb1e69-8d9e-437f-84af-12c7e47cd0d2 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1378 microversion: 2.1 time: 0.227864 Aug 27 04:35:58.475503 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 564/1161] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:58 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1378 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:58.480921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6e8b1291-105c-4b95-94ba-13dc0a805d6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:58.481652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6e8b1291-105c-4b95-94ba-13dc0a805d6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:58.489257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e8b1291-105c-4b95-94ba-13dc0a805d6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:58.489747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e8b1291-105c-4b95-94ba-13dc0a805d6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:58.490185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e8b1291-105c-4b95-94ba-13dc0a805d6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:58.490910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e8b1291-105c-4b95-94ba-13dc0a805d6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:58.491369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e8b1291-105c-4b95-94ba-13dc0a805d6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:58.491791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e8b1291-105c-4b95-94ba-13dc0a805d6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:58.521903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6e8b1291-105c-4b95-94ba-13dc0a805d6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:35:58.623631 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6e8b1291-105c-4b95-94ba-13dc0a805d6c tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 204 len: 0 microversion: 2.1 time: 0.146134 Aug 27 04:35:58.624221 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 565/1162] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:35:58 2022] DELETE /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:35:58.630475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8ce50760-d067-4483-bba2-4ae95277b748 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:58.631193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8ce50760-d067-4483-bba2-4ae95277b748 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:58.637246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ce50760-d067-4483-bba2-4ae95277b748 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:58.637897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ce50760-d067-4483-bba2-4ae95277b748 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:58.638338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ce50760-d067-4483-bba2-4ae95277b748 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:58.639039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ce50760-d067-4483-bba2-4ae95277b748 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:58.639499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ce50760-d067-4483-bba2-4ae95277b748 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:58.639927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ce50760-d067-4483-bba2-4ae95277b748 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:58.776546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ce50760-d067-4483-bba2-4ae95277b748 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:58.785700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ce50760-d067-4483-bba2-4ae95277b748 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:58.787146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ce50760-d067-4483-bba2-4ae95277b748 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:58.788262 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8ce50760-d067-4483-bba2-4ae95277b748 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 0.162928 Aug 27 04:35:58.788862 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 566/1163] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:58 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:58.793230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dfb3829b-5b13-4558-aabf-13da659eeb36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:58.793841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dfb3829b-5b13-4558-aabf-13da659eeb36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 20337dd0-bb88-4f11-85be-ec44de54c9da] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:58.809696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dfb3829b-5b13-4558-aabf-13da659eeb36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:58.810240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dfb3829b-5b13-4558-aabf-13da659eeb36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:58.810673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dfb3829b-5b13-4558-aabf-13da659eeb36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:58.811372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dfb3829b-5b13-4558-aabf-13da659eeb36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:58.811824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dfb3829b-5b13-4558-aabf-13da659eeb36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:58.812245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dfb3829b-5b13-4558-aabf-13da659eeb36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:58.951829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dfb3829b-5b13-4558-aabf-13da659eeb36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:58.962968 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dfb3829b-5b13-4558-aabf-13da659eeb36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da" status: 200 len: 1475 microversion: 2.1 time: 0.173038 Aug 27 04:35:58.963605 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 567/1164] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:58 2022] GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da => generated 1475 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:58.968643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-75e17009-4f30-4772-ba9b-acc0b71d6e42 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25ebb550>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:59.014805 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-75e17009-4f30-4772-ba9b-acc0b71d6e42 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.050138 Aug 27 04:35:59.015379 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 568/1165] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:35:58 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:59.033927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0d23fe04-336f-4312-a9ce-54b1c2f7d776 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:59.034473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0d23fe04-336f-4312-a9ce-54b1c2f7d776 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:59.040558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d23fe04-336f-4312-a9ce-54b1c2f7d776 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:59.041071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d23fe04-336f-4312-a9ce-54b1c2f7d776 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:59.041511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d23fe04-336f-4312-a9ce-54b1c2f7d776 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:59.042238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d23fe04-336f-4312-a9ce-54b1c2f7d776 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:59.042698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d23fe04-336f-4312-a9ce-54b1c2f7d776 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:59.043133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d23fe04-336f-4312-a9ce-54b1c2f7d776 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:59.105200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0d23fe04-336f-4312-a9ce-54b1c2f7d776 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:59.113145 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0d23fe04-336f-4312-a9ce-54b1c2f7d776 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1216 microversion: 2.1 time: 0.083573 Aug 27 04:35:59.113725 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 569/1166] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:59 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1216 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:59.495405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5e3b76f0-56b3-4ebd-8150-ca8cb306c499 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:59.496027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5e3b76f0-56b3-4ebd-8150-ca8cb306c499 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:59.503902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e3b76f0-56b3-4ebd-8150-ca8cb306c499 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:59.504385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e3b76f0-56b3-4ebd-8150-ca8cb306c499 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:59.504851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e3b76f0-56b3-4ebd-8150-ca8cb306c499 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:59.505552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e3b76f0-56b3-4ebd-8150-ca8cb306c499 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:59.506016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e3b76f0-56b3-4ebd-8150-ca8cb306c499 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:59.506447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e3b76f0-56b3-4ebd-8150-ca8cb306c499 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:59.648490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5e3b76f0-56b3-4ebd-8150-ca8cb306c499 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:59.657443 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5e3b76f0-56b3-4ebd-8150-ca8cb306c499 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1378 microversion: 2.1 time: 0.165880 Aug 27 04:35:59.658269 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 570/1167] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:59 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1378 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:59.813121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-296daf79-63a2-44ef-8f59-efc5715e03c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:59.813777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-296daf79-63a2-44ef-8f59-efc5715e03c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:59.820822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-296daf79-63a2-44ef-8f59-efc5715e03c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:59.821252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-296daf79-63a2-44ef-8f59-efc5715e03c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:59.821874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-296daf79-63a2-44ef-8f59-efc5715e03c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:59.822447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-296daf79-63a2-44ef-8f59-efc5715e03c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:59.823012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-296daf79-63a2-44ef-8f59-efc5715e03c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:59.823424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-296daf79-63a2-44ef-8f59-efc5715e03c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:59.968978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-296daf79-63a2-44ef-8f59-efc5715e03c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:59.978406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-296daf79-63a2-44ef-8f59-efc5715e03c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:59.980409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-296daf79-63a2-44ef-8f59-efc5715e03c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:59.981042 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-296daf79-63a2-44ef-8f59-efc5715e03c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 0.171941 Aug 27 04:35:59.981614 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 571/1168] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:35:59 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:35:59.986292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-20aca194-4504-4d1d-9171-cf6c9167bd36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:59.986837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-20aca194-4504-4d1d-9171-cf6c9167bd36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 20337dd0-bb88-4f11-85be-ec44de54c9da] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:59.993027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20aca194-4504-4d1d-9171-cf6c9167bd36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:59.993532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20aca194-4504-4d1d-9171-cf6c9167bd36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:59.993977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20aca194-4504-4d1d-9171-cf6c9167bd36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:59.994692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20aca194-4504-4d1d-9171-cf6c9167bd36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:59.995147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20aca194-4504-4d1d-9171-cf6c9167bd36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:59.995579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20aca194-4504-4d1d-9171-cf6c9167bd36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:00.151201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-20aca194-4504-4d1d-9171-cf6c9167bd36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:00.160059 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-20aca194-4504-4d1d-9171-cf6c9167bd36 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da" status: 200 len: 1475 microversion: 2.1 time: 0.177422 Aug 27 04:36:00.168388 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 572/1169] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:59 2022] GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da => generated 1475 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:00.168388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-45d1b269-2621-4c35-99f7-8a0a5fccc241 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f22201a60>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:00.210881 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-45d1b269-2621-4c35-99f7-8a0a5fccc241 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.049103 Aug 27 04:36:00.211456 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 573/1170] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:00 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:00.216003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-94f0d493-712d-47a5-988c-3d831bb11481 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:00.216633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-94f0d493-712d-47a5-988c-3d831bb11481 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:00.223294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94f0d493-712d-47a5-988c-3d831bb11481 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:00.223774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94f0d493-712d-47a5-988c-3d831bb11481 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:00.224203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94f0d493-712d-47a5-988c-3d831bb11481 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:00.224920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94f0d493-712d-47a5-988c-3d831bb11481 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:00.225374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94f0d493-712d-47a5-988c-3d831bb11481 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:00.225823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94f0d493-712d-47a5-988c-3d831bb11481 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:00.287704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-94f0d493-712d-47a5-988c-3d831bb11481 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:00.295580 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-94f0d493-712d-47a5-988c-3d831bb11481 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1216 microversion: 2.1 time: 0.083134 Aug 27 04:36:00.296160 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 574/1171] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:00 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1216 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:00.679875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-73ad2255-1b8a-4b80-8665-1013dc79afd8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:00.680491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-73ad2255-1b8a-4b80-8665-1013dc79afd8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:00.688476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73ad2255-1b8a-4b80-8665-1013dc79afd8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:00.689092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73ad2255-1b8a-4b80-8665-1013dc79afd8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:00.690317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73ad2255-1b8a-4b80-8665-1013dc79afd8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:00.691129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73ad2255-1b8a-4b80-8665-1013dc79afd8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:00.691656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73ad2255-1b8a-4b80-8665-1013dc79afd8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:00.692156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73ad2255-1b8a-4b80-8665-1013dc79afd8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:00.841514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-73ad2255-1b8a-4b80-8665-1013dc79afd8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:00.851012 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-73ad2255-1b8a-4b80-8665-1013dc79afd8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1378 microversion: 2.1 time: 0.175009 Aug 27 04:36:00.864583 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 575/1172] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:00 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1378 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:01.006862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7b7ec584-fd57-4370-8a1d-ad8b97b8c050 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:01.007555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7b7ec584-fd57-4370-8a1d-ad8b97b8c050 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:01.021622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b7ec584-fd57-4370-8a1d-ad8b97b8c050 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:01.024561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b7ec584-fd57-4370-8a1d-ad8b97b8c050 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:01.025113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b7ec584-fd57-4370-8a1d-ad8b97b8c050 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:01.026997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b7ec584-fd57-4370-8a1d-ad8b97b8c050 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:01.027469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b7ec584-fd57-4370-8a1d-ad8b97b8c050 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:01.027912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b7ec584-fd57-4370-8a1d-ad8b97b8c050 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:01.608425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b7ec584-fd57-4370-8a1d-ad8b97b8c050 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:01.621077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b7ec584-fd57-4370-8a1d-ad8b97b8c050 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:01.625987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b7ec584-fd57-4370-8a1d-ad8b97b8c050 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:01.631366 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7b7ec584-fd57-4370-8a1d-ad8b97b8c050 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 0.629376 Aug 27 04:36:01.634574 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 576/1173] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:36:00 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:36:01.647978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ce76610e-cc57-4502-915c-2ed895042996 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:01.650053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ce76610e-cc57-4502-915c-2ed895042996 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 20337dd0-bb88-4f11-85be-ec44de54c9da] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:01.664835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce76610e-cc57-4502-915c-2ed895042996 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:01.665357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce76610e-cc57-4502-915c-2ed895042996 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:01.675346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce76610e-cc57-4502-915c-2ed895042996 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:01.677826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce76610e-cc57-4502-915c-2ed895042996 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:01.680392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce76610e-cc57-4502-915c-2ed895042996 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:01.682232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce76610e-cc57-4502-915c-2ed895042996 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:02.275662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ce76610e-cc57-4502-915c-2ed895042996 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:02.287378 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ce76610e-cc57-4502-915c-2ed895042996 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da" status: 200 len: 1475 microversion: 2.1 time: 0.649661 Aug 27 04:36:02.304709 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 577/1174] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:01 2022] GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da => generated 1475 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:02.315795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f8f9a428-c048-4682-a451-55d93bfa2a31 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25e71310>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:02.445698 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f8f9a428-c048-4682-a451-55d93bfa2a31 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.139471 Aug 27 04:36:02.446941 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 578/1175] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:02 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:02.460873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-40d8bfb1-8d00-4f71-85f6-95084be45b68 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:02.461763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-40d8bfb1-8d00-4f71-85f6-95084be45b68 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:02.470035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40d8bfb1-8d00-4f71-85f6-95084be45b68 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:02.471536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40d8bfb1-8d00-4f71-85f6-95084be45b68 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:02.472208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40d8bfb1-8d00-4f71-85f6-95084be45b68 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:02.473234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40d8bfb1-8d00-4f71-85f6-95084be45b68 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:02.473975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40d8bfb1-8d00-4f71-85f6-95084be45b68 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:02.474748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40d8bfb1-8d00-4f71-85f6-95084be45b68 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:02.707577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-40d8bfb1-8d00-4f71-85f6-95084be45b68 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:02.722069 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-40d8bfb1-8d00-4f71-85f6-95084be45b68 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1272 microversion: 2.1 time: 0.273463 Aug 27 04:36:02.723335 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 579/1176] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:02 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1272 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:02.729486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-27a72672-ea21-4f08-9643-6e829eaa9f90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:02.730430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-27a72672-ea21-4f08-9643-6e829eaa9f90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:02.745239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27a72672-ea21-4f08-9643-6e829eaa9f90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:02.745868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27a72672-ea21-4f08-9643-6e829eaa9f90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:02.746401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27a72672-ea21-4f08-9643-6e829eaa9f90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:02.747197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27a72672-ea21-4f08-9643-6e829eaa9f90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:02.747731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27a72672-ea21-4f08-9643-6e829eaa9f90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:02.748275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27a72672-ea21-4f08-9643-6e829eaa9f90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:03.537727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-27a72672-ea21-4f08-9643-6e829eaa9f90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:03.554009 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-27a72672-ea21-4f08-9643-6e829eaa9f90 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1528 microversion: 2.1 time: 0.829276 Aug 27 04:36:03.575530 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 580/1177] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:02 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1528 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:03.580919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-39726aec-6f99-465b-9de9-dcf50e8ecc6c req-d53b94eb-dd40-4e8e-b69e-c3c18eb936a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a6657e-24e5-4825-9bf0-4f7b0503fa01", "name": "network-vif-plugged", "status": "completed", "tag": "127900a1-4e2f-4ae6-bf1f-f21d1cafdbba"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:03.605677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-39726aec-6f99-465b-9de9-dcf50e8ecc6c req-d53b94eb-dd40-4e8e-b69e-c3c18eb936a6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:03.606869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-39726aec-6f99-465b-9de9-dcf50e8ecc6c req-d53b94eb-dd40-4e8e-b69e-c3c18eb936a6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:03.608119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-39726aec-6f99-465b-9de9-dcf50e8ecc6c req-d53b94eb-dd40-4e8e-b69e-c3c18eb936a6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:03.628570 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-39726aec-6f99-465b-9de9-dcf50e8ecc6c req-d53b94eb-dd40-4e8e-b69e-c3c18eb936a6 service nova] Creating event network-vif-plugged:127900a1-4e2f-4ae6-bf1f-f21d1cafdbba for instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 on n-h2-854823-1 Aug 27 04:36:03.634601 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-39726aec-6f99-465b-9de9-dcf50e8ecc6c req-d53b94eb-dd40-4e8e-b69e-c3c18eb936a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057424 Aug 27 04:36:03.636437 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 581/1178] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:03.644168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9495860a-10b3-4c1e-bad6-9336cdd4650e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:03.645275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9495860a-10b3-4c1e-bad6-9336cdd4650e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:03.655315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9495860a-10b3-4c1e-bad6-9336cdd4650e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:03.656666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9495860a-10b3-4c1e-bad6-9336cdd4650e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:03.657508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9495860a-10b3-4c1e-bad6-9336cdd4650e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:03.659177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9495860a-10b3-4c1e-bad6-9336cdd4650e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:03.659900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9495860a-10b3-4c1e-bad6-9336cdd4650e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:03.660854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9495860a-10b3-4c1e-bad6-9336cdd4650e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:03.711460 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0809823-e365-4b2e-bf67-b3a016d4aae1 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218/action" status: 202 len: 0 microversion: 2.1 time: 5.737537 Aug 27 04:36:03.712895 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 598/1179] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:35:57 2022] POST /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218/action => generated 0 bytes in 5740 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:36:03.729938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1de93553-bdc5-40e8-8804-dcf78a804f93 req-63b8f228-b5ba-4dff-b3c7-9cb6b11c1185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20337dd0-bb88-4f11-85be-ec44de54c9da", "name": "network-vif-deleted", "tag": "5387b19f-5d63-4ca8-ab0a-71da1b793383"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:03.741816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:03.797829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1de93553-bdc5-40e8-8804-dcf78a804f93 req-63b8f228-b5ba-4dff-b3c7-9cb6b11c1185 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:03.807336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1de93553-bdc5-40e8-8804-dcf78a804f93 req-63b8f228-b5ba-4dff-b3c7-9cb6b11c1185 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:03.811512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1de93553-bdc5-40e8-8804-dcf78a804f93 req-63b8f228-b5ba-4dff-b3c7-9cb6b11c1185 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:03.900120 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1de93553-bdc5-40e8-8804-dcf78a804f93 req-63b8f228-b5ba-4dff-b3c7-9cb6b11c1185 service nova] Creating event network-vif-deleted:5387b19f-5d63-4ca8-ab0a-71da1b793383 for instance 20337dd0-bb88-4f11-85be-ec44de54c9da on n-h2-854823-1 Aug 27 04:36:03.918648 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1de93553-bdc5-40e8-8804-dcf78a804f93 req-63b8f228-b5ba-4dff-b3c7-9cb6b11c1185 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201076 Aug 27 04:36:03.927463 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 599/1180] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:03.955545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e635c34-d115-446d-baaa-707bf364043a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:03.957589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e635c34-d115-446d-baaa-707bf364043a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 20337dd0-bb88-4f11-85be-ec44de54c9da] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:03.975915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e635c34-d115-446d-baaa-707bf364043a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:03.978147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e635c34-d115-446d-baaa-707bf364043a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:03.980141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e635c34-d115-446d-baaa-707bf364043a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:03.981270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e635c34-d115-446d-baaa-707bf364043a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:03.981895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e635c34-d115-446d-baaa-707bf364043a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:03.988329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e635c34-d115-446d-baaa-707bf364043a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:04.097628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e635c34-d115-446d-baaa-707bf364043a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:04.099825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e635c34-d115-446d-baaa-707bf364043a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:04.101801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e635c34-d115-446d-baaa-707bf364043a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:04.102445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-1e635c34-d115-446d-baaa-707bf364043a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lazy-loading 'fault' on Instance uuid 20337dd0-bb88-4f11-85be-ec44de54c9da {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:36:04.206601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1e635c34-d115-446d-baaa-707bf364043a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:04.214975 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e635c34-d115-446d-baaa-707bf364043a tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da" status: 200 len: 1309 microversion: 2.1 time: 0.284587 Aug 27 04:36:04.223146 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 600/1181] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:03 2022] GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da => generated 1309 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:04.229732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f31c9a2a-d72e-4231-80ee-28e38b3dd8fc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f219aa8b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:04.294256 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f31c9a2a-d72e-4231-80ee-28e38b3dd8fc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.068724 Aug 27 04:36:04.295402 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 601/1182] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:04 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:04.300707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c00befd-60e0-4203-9695-00c6d85bd31e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:04.301551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c00befd-60e0-4203-9695-00c6d85bd31e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:04.308124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c00befd-60e0-4203-9695-00c6d85bd31e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:04.308889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c00befd-60e0-4203-9695-00c6d85bd31e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:04.309493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c00befd-60e0-4203-9695-00c6d85bd31e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:04.310980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c00befd-60e0-4203-9695-00c6d85bd31e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:04.311618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c00befd-60e0-4203-9695-00c6d85bd31e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:04.312217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c00befd-60e0-4203-9695-00c6d85bd31e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:04.496460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c00befd-60e0-4203-9695-00c6d85bd31e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:04.517466 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c00befd-60e0-4203-9695-00c6d85bd31e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1528 microversion: 2.1 time: 0.220649 Aug 27 04:36:04.517975 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 602/1183] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:04 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1528 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:04.545179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b37ad11-4d4b-4b99-b07f-756d5ee2a843 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:04.546042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b37ad11-4d4b-4b99-b07f-756d5ee2a843 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:04.554202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b37ad11-4d4b-4b99-b07f-756d5ee2a843 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:04.555062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b37ad11-4d4b-4b99-b07f-756d5ee2a843 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:04.555743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b37ad11-4d4b-4b99-b07f-756d5ee2a843 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:04.557000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b37ad11-4d4b-4b99-b07f-756d5ee2a843 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:04.558365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b37ad11-4d4b-4b99-b07f-756d5ee2a843 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:04.559206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b37ad11-4d4b-4b99-b07f-756d5ee2a843 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:04.645152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9495860a-10b3-4c1e-bad6-9336cdd4650e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:04.664879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9495860a-10b3-4c1e-bad6-9336cdd4650e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:04.666321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9495860a-10b3-4c1e-bad6-9336cdd4650e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:04.671502 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9495860a-10b3-4c1e-bad6-9336cdd4650e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 1.031931 Aug 27 04:36:04.673493 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 582/1184] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:36:03 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:36:04.679593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-464088ca-94fb-499e-9da3-39d6f3c955c8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:04.680198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-464088ca-94fb-499e-9da3-39d6f3c955c8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:04.689213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-464088ca-94fb-499e-9da3-39d6f3c955c8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:04.695451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-464088ca-94fb-499e-9da3-39d6f3c955c8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:04.695968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-464088ca-94fb-499e-9da3-39d6f3c955c8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:04.696776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-464088ca-94fb-499e-9da3-39d6f3c955c8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:04.697257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-464088ca-94fb-499e-9da3-39d6f3c955c8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:04.697698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-464088ca-94fb-499e-9da3-39d6f3c955c8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:04.759416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b37ad11-4d4b-4b99-b07f-756d5ee2a843 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:04.764224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:04.770462 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b37ad11-4d4b-4b99-b07f-756d5ee2a843 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1504 microversion: 2.1 time: 0.240247 Aug 27 04:36:04.772291 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 603/1185] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:04 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:04.777089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d484a7b8-8713-400e-9d9d-3707ce050534 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:04.802709 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d484a7b8-8713-400e-9d9d-3707ce050534 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/919800fe-1d2c-4a01-8922-75552dca4a0c" status: 202 len: 0 microversion: 2.1 time: 0.029041 Aug 27 04:36:04.803637 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 604/1186] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:36:04 2022] DELETE /compute/v2.1/flavors/919800fe-1d2c-4a01-8922-75552dca4a0c => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:36:04.815025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-918ab658-f315-44b3-8e7c-5786b86625fb tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:04.851396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-464088ca-94fb-499e-9da3-39d6f3c955c8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:04.859471 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-918ab658-f315-44b3-8e7c-5786b86625fb tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050944 Aug 27 04:36:04.863740 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-464088ca-94fb-499e-9da3-39d6f3c955c8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1270 microversion: 2.1 time: 0.187943 Aug 27 04:36:04.864327 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 583/1187] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:04 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:04.878580 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 605/1188] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:36:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:04.881300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:04.883906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:04.891617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:04.893129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:04.893816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:04.894929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:04.895620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:04.896300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:05.090259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:05.106749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Old instance type tempest-test_resize_flavor_-1836291313, new instance type m1.heat {{(pid=128870) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 04:36:05.145043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:36:05.146127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:36:05.147563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:36:05.149478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:36:05.150110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:36:05.241207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-713aaaf0-6a28-48ea-a41a-eb7bae9b8a28 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:05.241890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-713aaaf0-6a28-48ea-a41a-eb7bae9b8a28 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 20337dd0-bb88-4f11-85be-ec44de54c9da] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:05.254255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-713aaaf0-6a28-48ea-a41a-eb7bae9b8a28 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:05.254863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-713aaaf0-6a28-48ea-a41a-eb7bae9b8a28 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:05.255301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-713aaaf0-6a28-48ea-a41a-eb7bae9b8a28 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:05.256066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-713aaaf0-6a28-48ea-a41a-eb7bae9b8a28 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:05.274603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-713aaaf0-6a28-48ea-a41a-eb7bae9b8a28 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:05.274946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-713aaaf0-6a28-48ea-a41a-eb7bae9b8a28 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:05.347314 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-713aaaf0-6a28-48ea-a41a-eb7bae9b8a28 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] HTTP exception thrown: Instance 20337dd0-bb88-4f11-85be-ec44de54c9da could not be found. Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-713aaaf0-6a28-48ea-a41a-eb7bae9b8a28 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Request method failure captured: Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da HTTP/1.1 Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5vZmCQoTpWfO2nVvghaAr6WQ7l0jSxgrsDU_f5pBjkwZR9vYzn-WSBKnKYlb4QrTThFlKQoSD6qMOG1RMxxH3EEGYmrkKAGkNv2QjvxwduOHa8oaP9JROieKflk83mA1Krxt2a8kMGRYbNuKy9a5hu87qF_uDiIUT5j6ZdX0CisgE Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:36:05.349848 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:36:05.351347 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:36:05.351347 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:36:05.351347 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:36:05.351347 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:36:05.351347 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:36:05.351347 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:36:05.351347 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:36:05.351347 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cc8cb8eea83f45c1bb06328e31c960e7 Aug 27 04:36:05.351347 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:36:05.351347 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:36:05.351347 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 20337dd0-bb88-4f11-85be-ec44de54c9da could not be found. Aug 27 04:36:05.351347 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '20337dd0-bb88-4f11-85be-ec44de54c9da'} Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20337dd0-bb88-4f11-85be-ec44de54c9da could not be found. Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:36:05.352150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20337dd0-bb88-4f11-85be-ec44de54c9da could not be found. Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20337dd0-bb88-4f11-85be-ec44de54c9da could not be found. Aug 27 04:36:05.353483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:05.354624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-713aaaf0-6a28-48ea-a41a-eb7bae9b8a28 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Returning 404 to user: Instance 20337dd0-bb88-4f11-85be-ec44de54c9da could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:36:05.354624 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-713aaaf0-6a28-48ea-a41a-eb7bae9b8a28 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da" status: 404 len: 111 microversion: 2.1 time: 0.114954 Aug 27 04:36:05.364942 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 606/1189] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:05 2022] GET /compute/v2.1/servers/20337dd0-bb88-4f11-85be-ec44de54c9da => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:36:05.382910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66557ece-64dd-4de3-a95d-eacdc03af0cf tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21991e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:05.463633 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7e368a83-2f13-42c3-bc5c-25cf5cc2ad55 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "POST /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba/action" status: 202 len: 0 microversion: 2.1 time: 0.587627 Aug 27 04:36:05.474912 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 584/1190] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:36:04 2022] POST /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:36:05.497500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7a446f09-5265-407d-84be-4442bc217170 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:05.498462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7a446f09-5265-407d-84be-4442bc217170 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: 1970d332-d1e0-4a16-a2b7-9c90c909b554] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:05.510054 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66557ece-64dd-4de3-a95d-eacdc03af0cf tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.143728 Aug 27 04:36:05.514433 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 607/1191] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:05 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:05.528153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-617ab6e0-5a24-4adf-a33b-3d5833beb20f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:05.529063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-617ab6e0-5a24-4adf-a33b-3d5833beb20f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:05.535139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a446f09-5265-407d-84be-4442bc217170 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:05.535936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a446f09-5265-407d-84be-4442bc217170 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:05.536681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a446f09-5265-407d-84be-4442bc217170 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:05.537805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a446f09-5265-407d-84be-4442bc217170 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:05.538696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a446f09-5265-407d-84be-4442bc217170 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:05.539288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a446f09-5265-407d-84be-4442bc217170 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:05.566039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-617ab6e0-5a24-4adf-a33b-3d5833beb20f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:05.566562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-617ab6e0-5a24-4adf-a33b-3d5833beb20f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:05.567012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-617ab6e0-5a24-4adf-a33b-3d5833beb20f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:05.581638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-617ab6e0-5a24-4adf-a33b-3d5833beb20f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:05.582416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-617ab6e0-5a24-4adf-a33b-3d5833beb20f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:05.583957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-617ab6e0-5a24-4adf-a33b-3d5833beb20f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:05.599973 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-7a446f09-5265-407d-84be-4442bc217170 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] HTTP exception thrown: Instance 1970d332-d1e0-4a16-a2b7-9c90c909b554 could not be found. Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7a446f09-5265-407d-84be-4442bc217170 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Request method failure captured: Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 HTTP/1.1 Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5vZmCQoTpWfO2nVvghaAr6WQ7l0jSxgrsDU_f5pBjkwZR9vYzn-WSBKnKYlb4QrTThFlKQoSD6qMOG1RMxxH3EEGYmrkKAGkNv2QjvxwduOHa8oaP9JROieKflk83mA1Krxt2a8kMGRYbNuKy9a5hu87qF_uDiIUT5j6ZdX0CisgE Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:36:05.601679 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:36:05.610797 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:36:05.610797 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:36:05.610797 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:36:05.610797 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:36:05.610797 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:36:05.610797 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:36:05.610797 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:36:05.610797 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: cc8cb8eea83f45c1bb06328e31c960e7 Aug 27 04:36:05.610797 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:36:05.610797 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:36:05.610797 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 1970d332-d1e0-4a16-a2b7-9c90c909b554 could not be found. Aug 27 04:36:05.610797 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '1970d332-d1e0-4a16-a2b7-9c90c909b554'} Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1970d332-d1e0-4a16-a2b7-9c90c909b554 could not be found. Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:36:05.612259 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1970d332-d1e0-4a16-a2b7-9c90c909b554 could not be found. Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1970d332-d1e0-4a16-a2b7-9c90c909b554 could not be found. Aug 27 04:36:05.616459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:05.620640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7a446f09-5265-407d-84be-4442bc217170 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Returning 404 to user: Instance 1970d332-d1e0-4a16-a2b7-9c90c909b554 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:36:05.620640 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7a446f09-5265-407d-84be-4442bc217170 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554" status: 404 len: 111 microversion: 2.1 time: 0.129614 Aug 27 04:36:05.629502 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 585/1192] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:05 2022] GET /compute/v2.1/servers/1970d332-d1e0-4a16-a2b7-9c90c909b554 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:36:05.648696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8fb74efb-f555-4f51-a280-7513348101ae tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:05.733005 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8fb74efb-f555-4f51-a280-7513348101ae tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/d75f5344-ce42-41f1-ac8c-29ac8338dd84" status: 204 len: 0 microversion: 2.1 time: 0.101536 Aug 27 04:36:05.736625 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 586/1193] 10.222.0.79 () {58 vars in 1266 bytes} [Sat Aug 27 04:36:05 2022] DELETE /compute/v2.1/os-server-groups/d75f5344-ce42-41f1-ac8c-29ac8338dd84 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:36:05.741404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d9315474-7906-45ee-b654-aa4c93e4b00b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:05.742020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d9315474-7906-45ee-b654-aa4c93e4b00b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:05.755019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9315474-7906-45ee-b654-aa4c93e4b00b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:05.755587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9315474-7906-45ee-b654-aa4c93e4b00b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:05.756087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9315474-7906-45ee-b654-aa4c93e4b00b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:05.756946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9315474-7906-45ee-b654-aa4c93e4b00b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:05.757413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9315474-7906-45ee-b654-aa4c93e4b00b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:05.757839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9315474-7906-45ee-b654-aa4c93e4b00b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:05.863523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-617ab6e0-5a24-4adf-a33b-3d5833beb20f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:05.874608 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-617ab6e0-5a24-4adf-a33b-3d5833beb20f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1537 microversion: 2.1 time: 0.350824 Aug 27 04:36:05.889577 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 608/1194] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:05 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1537 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:05.895057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1120f1c9-f55e-48c2-854c-e92300227392 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:05.895786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1120f1c9-f55e-48c2-854c-e92300227392 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:05.903405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1120f1c9-f55e-48c2-854c-e92300227392 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:05.905567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1120f1c9-f55e-48c2-854c-e92300227392 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:05.906248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1120f1c9-f55e-48c2-854c-e92300227392 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:05.906980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1120f1c9-f55e-48c2-854c-e92300227392 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:05.907787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1120f1c9-f55e-48c2-854c-e92300227392 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:05.908754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1120f1c9-f55e-48c2-854c-e92300227392 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:05.941723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1120f1c9-f55e-48c2-854c-e92300227392 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:36:06.059113 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1120f1c9-f55e-48c2-854c-e92300227392 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 204 len: 0 microversion: 2.1 time: 0.167705 Aug 27 04:36:06.059678 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 609/1195] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:36:05 2022] DELETE /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:36:06.069926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f6d248c0-de56-4e4b-8ad8-e1d4efc336cd req-b7a56e56-5d34-49e7-8607-ee5cb405b301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516299cc-c878-4b8e-bb4d-4247ddbd90cf", "name": "network-vif-plugged", "status": "completed", "tag": "326c17ad-2ce3-4c6b-854b-aeff6eeb991e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:06.082785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f6d248c0-de56-4e4b-8ad8-e1d4efc336cd req-b7a56e56-5d34-49e7-8607-ee5cb405b301 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:06.083579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f6d248c0-de56-4e4b-8ad8-e1d4efc336cd req-b7a56e56-5d34-49e7-8607-ee5cb405b301 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:06.084178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f6d248c0-de56-4e4b-8ad8-e1d4efc336cd req-b7a56e56-5d34-49e7-8607-ee5cb405b301 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:06.101185 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f6d248c0-de56-4e4b-8ad8-e1d4efc336cd req-b7a56e56-5d34-49e7-8607-ee5cb405b301 service nova] Creating event network-vif-plugged:326c17ad-2ce3-4c6b-854b-aeff6eeb991e for instance 516299cc-c878-4b8e-bb4d-4247ddbd90cf on n-h1-854823-1 Aug 27 04:36:06.107810 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f6d248c0-de56-4e4b-8ad8-e1d4efc336cd req-b7a56e56-5d34-49e7-8607-ee5cb405b301 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046456 Aug 27 04:36:06.108729 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 610/1196] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:06.115539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d579e60c-40de-4bd4-a09d-fb19dccf32f4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:06.116744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d579e60c-40de-4bd4-a09d-fb19dccf32f4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:06.132250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d9315474-7906-45ee-b654-aa4c93e4b00b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:06.138651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d579e60c-40de-4bd4-a09d-fb19dccf32f4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:06.140059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d579e60c-40de-4bd4-a09d-fb19dccf32f4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:06.140551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d579e60c-40de-4bd4-a09d-fb19dccf32f4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:06.141608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d579e60c-40de-4bd4-a09d-fb19dccf32f4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:06.142244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d579e60c-40de-4bd4-a09d-fb19dccf32f4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:06.142756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d579e60c-40de-4bd4-a09d-fb19dccf32f4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:06.143625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d9315474-7906-45ee-b654-aa4c93e4b00b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:06.145199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d9315474-7906-45ee-b654-aa4c93e4b00b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:06.146488 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d9315474-7906-45ee-b654-aa4c93e4b00b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 0.409346 Aug 27 04:36:06.147053 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 587/1197] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:36:05 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:36:06.160415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f417970a-ad6f-4a99-8ef3-35bf7271cdaf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:06.172832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f417970a-ad6f-4a99-8ef3-35bf7271cdaf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:06.179671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f417970a-ad6f-4a99-8ef3-35bf7271cdaf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:06.180411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f417970a-ad6f-4a99-8ef3-35bf7271cdaf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:06.183210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f417970a-ad6f-4a99-8ef3-35bf7271cdaf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:06.185071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f417970a-ad6f-4a99-8ef3-35bf7271cdaf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:06.197296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f417970a-ad6f-4a99-8ef3-35bf7271cdaf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:06.198003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f417970a-ad6f-4a99-8ef3-35bf7271cdaf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:06.390475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d579e60c-40de-4bd4-a09d-fb19dccf32f4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:06.401773 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d579e60c-40de-4bd4-a09d-fb19dccf32f4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1504 microversion: 2.1 time: 0.291101 Aug 27 04:36:06.402503 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 611/1198] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:06 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:06.408606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e80e17d9-042b-49af-af8b-4b8808384465 req-5f870967-4c8e-4c89-844a-c3604ca4d88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1970d332-d1e0-4a16-a2b7-9c90c909b554", "name": "network-vif-deleted", "tag": "6bb018be-5665-4f3e-b5ca-7e7c77aba094"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:06.420381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e80e17d9-042b-49af-af8b-4b8808384465 req-5f870967-4c8e-4c89-844a-c3604ca4d88b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:06.421106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e80e17d9-042b-49af-af8b-4b8808384465 req-5f870967-4c8e-4c89-844a-c3604ca4d88b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:06.421986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e80e17d9-042b-49af-af8b-4b8808384465 req-5f870967-4c8e-4c89-844a-c3604ca4d88b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:06.441912 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e80e17d9-042b-49af-af8b-4b8808384465 req-5f870967-4c8e-4c89-844a-c3604ca4d88b service nova] Creating event network-vif-deleted:6bb018be-5665-4f3e-b5ca-7e7c77aba094 for instance 1970d332-d1e0-4a16-a2b7-9c90c909b554 on n-h2-854823-1 Aug 27 04:36:06.464996 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e80e17d9-042b-49af-af8b-4b8808384465 req-5f870967-4c8e-4c89-844a-c3604ca4d88b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060425 Aug 27 04:36:06.466339 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 612/1199] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:06.475174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-326371d4-cda1-4759-8381-cfa964e71e33 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:06.476117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-326371d4-cda1-4759-8381-cfa964e71e33 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:06.486230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326371d4-cda1-4759-8381-cfa964e71e33 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:06.487753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326371d4-cda1-4759-8381-cfa964e71e33 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:06.488687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326371d4-cda1-4759-8381-cfa964e71e33 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:06.490064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326371d4-cda1-4759-8381-cfa964e71e33 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:06.490697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326371d4-cda1-4759-8381-cfa964e71e33 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:06.491517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326371d4-cda1-4759-8381-cfa964e71e33 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:06.682792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-326371d4-cda1-4759-8381-cfa964e71e33 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:06.692800 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-326371d4-cda1-4759-8381-cfa964e71e33 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1470 microversion: 2.1 time: 0.224965 Aug 27 04:36:06.702284 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 613/1200] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:06 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:06.715640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b4f172b-ebde-40f8-8101-a4d3ba728fec tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21941e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:06.802413 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b4f172b-ebde-40f8-8101-a4d3ba728fec tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.097194 Aug 27 04:36:06.811229 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 614/1201] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:06 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:06.900359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-08f7c4fe-1fb3-44ee-b5ca-1e68c674bf5a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:06.901017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-08f7c4fe-1fb3-44ee-b5ca-1e68c674bf5a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:06.909568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08f7c4fe-1fb3-44ee-b5ca-1e68c674bf5a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:06.910432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08f7c4fe-1fb3-44ee-b5ca-1e68c674bf5a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:06.911095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08f7c4fe-1fb3-44ee-b5ca-1e68c674bf5a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:06.912067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08f7c4fe-1fb3-44ee-b5ca-1e68c674bf5a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:06.912847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08f7c4fe-1fb3-44ee-b5ca-1e68c674bf5a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:06.913474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08f7c4fe-1fb3-44ee-b5ca-1e68c674bf5a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:06.943538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f417970a-ad6f-4a99-8ef3-35bf7271cdaf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:06.954103 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f417970a-ad6f-4a99-8ef3-35bf7271cdaf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1312 microversion: 2.1 time: 0.804274 Aug 27 04:36:06.971652 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 588/1202] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:06 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1312 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:07.124738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-08f7c4fe-1fb3-44ee-b5ca-1e68c674bf5a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:07.141828 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-08f7c4fe-1fb3-44ee-b5ca-1e68c674bf5a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1537 microversion: 2.1 time: 0.245495 Aug 27 04:36:07.146835 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 615/1203] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:06 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1537 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:07.226112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cd86eea5-004b-438c-9f87-95f798325f68 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:07.227147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cd86eea5-004b-438c-9f87-95f798325f68 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:07.243402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd86eea5-004b-438c-9f87-95f798325f68 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:07.244917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd86eea5-004b-438c-9f87-95f798325f68 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:07.245563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd86eea5-004b-438c-9f87-95f798325f68 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:07.247862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd86eea5-004b-438c-9f87-95f798325f68 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:07.249099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd86eea5-004b-438c-9f87-95f798325f68 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:07.253090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd86eea5-004b-438c-9f87-95f798325f68 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:07.433531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22327bdd-01f2-4000-a1f7-fc404ab4ff3f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:07.434145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22327bdd-01f2-4000-a1f7-fc404ab4ff3f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:07.443821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22327bdd-01f2-4000-a1f7-fc404ab4ff3f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:07.444321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22327bdd-01f2-4000-a1f7-fc404ab4ff3f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:07.444877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22327bdd-01f2-4000-a1f7-fc404ab4ff3f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:07.445501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22327bdd-01f2-4000-a1f7-fc404ab4ff3f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:07.445965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22327bdd-01f2-4000-a1f7-fc404ab4ff3f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:07.446393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22327bdd-01f2-4000-a1f7-fc404ab4ff3f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:07.651933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22327bdd-01f2-4000-a1f7-fc404ab4ff3f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:07.661932 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22327bdd-01f2-4000-a1f7-fc404ab4ff3f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1504 microversion: 2.1 time: 0.234307 Aug 27 04:36:07.662857 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 616/1204] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:07 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:07.715774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c5f2b62-36ac-461d-91fe-0ac4facef817 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:07.716732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4c5f2b62-36ac-461d-91fe-0ac4facef817 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:07.725684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5f2b62-36ac-461d-91fe-0ac4facef817 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:07.726221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cd86eea5-004b-438c-9f87-95f798325f68 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:07.726404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5f2b62-36ac-461d-91fe-0ac4facef817 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:07.726964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5f2b62-36ac-461d-91fe-0ac4facef817 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:07.727769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5f2b62-36ac-461d-91fe-0ac4facef817 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:07.728313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5f2b62-36ac-461d-91fe-0ac4facef817 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:07.728698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5f2b62-36ac-461d-91fe-0ac4facef817 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:07.741496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cd86eea5-004b-438c-9f87-95f798325f68 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:07.743410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cd86eea5-004b-438c-9f87-95f798325f68 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:07.746597 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cd86eea5-004b-438c-9f87-95f798325f68 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 0.547909 Aug 27 04:36:07.748078 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 589/1205] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:36:07 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:36:07.822281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3863556c-cab9-4a28-9378-8f32109bb4e9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25d8be50>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:07.845726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:07.889712 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3863556c-cab9-4a28-9378-8f32109bb4e9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.073649 Aug 27 04:36:07.889964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c5f2b62-36ac-461d-91fe-0ac4facef817 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:07.891109 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 590/1206] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:07 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:07.899515 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c5f2b62-36ac-461d-91fe-0ac4facef817 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1470 microversion: 2.1 time: 0.188437 Aug 27 04:36:07.911882 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 617/1207] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:07 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1470 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:07.976342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-13b65f81-0cf2-474e-b5f7-5ad6a9efe696 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:07.977417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-13b65f81-0cf2-474e-b5f7-5ad6a9efe696 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:07.991641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13b65f81-0cf2-474e-b5f7-5ad6a9efe696 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:07.992506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13b65f81-0cf2-474e-b5f7-5ad6a9efe696 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:07.992999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13b65f81-0cf2-474e-b5f7-5ad6a9efe696 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:07.993892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13b65f81-0cf2-474e-b5f7-5ad6a9efe696 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:07.994531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13b65f81-0cf2-474e-b5f7-5ad6a9efe696 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:07.994998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13b65f81-0cf2-474e-b5f7-5ad6a9efe696 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:08.013227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:08.167207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e47f540-d9b0-45b7-83de-53246b80c519 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:08.167810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e47f540-d9b0-45b7-83de-53246b80c519 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:08.178805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e47f540-d9b0-45b7-83de-53246b80c519 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:08.179599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e47f540-d9b0-45b7-83de-53246b80c519 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:08.180032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e47f540-d9b0-45b7-83de-53246b80c519 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:08.180769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e47f540-d9b0-45b7-83de-53246b80c519 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:08.181224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e47f540-d9b0-45b7-83de-53246b80c519 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:08.181647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e47f540-d9b0-45b7-83de-53246b80c519 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:08.387695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7e47f540-d9b0-45b7-83de-53246b80c519 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:08.399036 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e47f540-d9b0-45b7-83de-53246b80c519 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1537 microversion: 2.1 time: 0.235581 Aug 27 04:36:08.399630 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 618/1208] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:08 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1537 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:08.422181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-13b65f81-0cf2-474e-b5f7-5ad6a9efe696 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:08.430830 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-13b65f81-0cf2-474e-b5f7-5ad6a9efe696 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1312 microversion: 2.1 time: 0.458540 Aug 27 04:36:08.448128 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 591/1209] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:07 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1312 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:08.522758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-74f7ff61-c44a-4357-aca2-4a0213403440 req-595251d5-f671-4db6-9260-14f3d03ea311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e6b1d8-56bd-49dd-952f-758425633218", "name": "network-vif-unplugged", "status": "completed", "tag": "e2dd7cd4-c5d5-4ad2-80a1-6b887249437f"}, {"name": "network-changed", "server_uuid": "0beb618a-0847-4929-b2e9-27a80f61a7ca", "tag": "0182ba2d-9563-41c7-a16e-8629890f858f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:08.535197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-74f7ff61-c44a-4357-aca2-4a0213403440 req-595251d5-f671-4db6-9260-14f3d03ea311 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:08.535764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-74f7ff61-c44a-4357-aca2-4a0213403440 req-595251d5-f671-4db6-9260-14f3d03ea311 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:08.536444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-74f7ff61-c44a-4357-aca2-4a0213403440 req-595251d5-f671-4db6-9260-14f3d03ea311 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:08.554445 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-74f7ff61-c44a-4357-aca2-4a0213403440 req-595251d5-f671-4db6-9260-14f3d03ea311 service nova] Creating event network-vif-unplugged:e2dd7cd4-c5d5-4ad2-80a1-6b887249437f for instance c0e6b1d8-56bd-49dd-952f-758425633218 on n-h1-854823-1 Aug 27 04:36:08.555222 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-74f7ff61-c44a-4357-aca2-4a0213403440 req-595251d5-f671-4db6-9260-14f3d03ea311 service nova] Creating event network-changed:0182ba2d-9563-41c7-a16e-8629890f858f for instance 0beb618a-0847-4929-b2e9-27a80f61a7ca on n-h2-854823-1 Aug 27 04:36:08.570941 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-74f7ff61-c44a-4357-aca2-4a0213403440 req-595251d5-f671-4db6-9260-14f3d03ea311 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.049502 Aug 27 04:36:08.571791 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 619/1210] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:08.683463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-162db09a-eb2a-4b7d-896b-a907bce90352 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:08.684453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-162db09a-eb2a-4b7d-896b-a907bce90352 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:08.695162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-162db09a-eb2a-4b7d-896b-a907bce90352 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:08.695767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-162db09a-eb2a-4b7d-896b-a907bce90352 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:08.696442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-162db09a-eb2a-4b7d-896b-a907bce90352 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:08.697403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-162db09a-eb2a-4b7d-896b-a907bce90352 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:08.698070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-162db09a-eb2a-4b7d-896b-a907bce90352 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:08.698695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-162db09a-eb2a-4b7d-896b-a907bce90352 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:08.775839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3334578-60c0-41c1-af71-b63689edafc9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:08.778808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3334578-60c0-41c1-af71-b63689edafc9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:08.786187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3334578-60c0-41c1-af71-b63689edafc9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:08.786869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3334578-60c0-41c1-af71-b63689edafc9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:08.787371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3334578-60c0-41c1-af71-b63689edafc9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:08.788153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3334578-60c0-41c1-af71-b63689edafc9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:08.788860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3334578-60c0-41c1-af71-b63689edafc9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:08.789376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3334578-60c0-41c1-af71-b63689edafc9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:08.993637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3334578-60c0-41c1-af71-b63689edafc9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:09.010420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3334578-60c0-41c1-af71-b63689edafc9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:09.012477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3334578-60c0-41c1-af71-b63689edafc9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:09.013908 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3334578-60c0-41c1-af71-b63689edafc9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 0.242335 Aug 27 04:36:09.032652 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 620/1211] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:36:08 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:36:09.033863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-162db09a-eb2a-4b7d-896b-a907bce90352 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:09.039702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75c9b677-dcc7-4b5c-a65a-05d312ffaf8e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21941700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:09.047406 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-162db09a-eb2a-4b7d-896b-a907bce90352 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1504 microversion: 2.1 time: 0.367949 Aug 27 04:36:09.052398 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 592/1212] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:08 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1504 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:09.057217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1a017d55-5899-49d2-a787-3193064341f5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:09.062925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1a017d55-5899-49d2-a787-3193064341f5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:09.074194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a017d55-5899-49d2-a787-3193064341f5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:09.074690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a017d55-5899-49d2-a787-3193064341f5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:09.075135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a017d55-5899-49d2-a787-3193064341f5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:09.075845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a017d55-5899-49d2-a787-3193064341f5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:09.076314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a017d55-5899-49d2-a787-3193064341f5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:09.078696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a017d55-5899-49d2-a787-3193064341f5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:09.109810 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75c9b677-dcc7-4b5c-a65a-05d312ffaf8e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.075708 Aug 27 04:36:09.112168 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 621/1213] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:09 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:09.260008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1a017d55-5899-49d2-a787-3193064341f5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:09.273633 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1a017d55-5899-49d2-a787-3193064341f5 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1470 microversion: 2.1 time: 0.220028 Aug 27 04:36:09.274589 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 593/1214] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:09 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1470 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:09.421171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac28e7a7-daef-4cdb-9fdc-c7ce1e82e7c7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:09.422153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac28e7a7-daef-4cdb-9fdc-c7ce1e82e7c7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:09.429679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac28e7a7-daef-4cdb-9fdc-c7ce1e82e7c7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:09.430320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac28e7a7-daef-4cdb-9fdc-c7ce1e82e7c7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:09.430819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac28e7a7-daef-4cdb-9fdc-c7ce1e82e7c7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:09.431639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac28e7a7-daef-4cdb-9fdc-c7ce1e82e7c7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:09.432272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac28e7a7-daef-4cdb-9fdc-c7ce1e82e7c7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:09.432793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac28e7a7-daef-4cdb-9fdc-c7ce1e82e7c7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:09.456620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e185786d-cc54-4cf7-aa0c-7e2396a1e784 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:09.456620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e185786d-cc54-4cf7-aa0c-7e2396a1e784 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:09.465787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e185786d-cc54-4cf7-aa0c-7e2396a1e784 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:09.477220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e185786d-cc54-4cf7-aa0c-7e2396a1e784 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:09.481977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e185786d-cc54-4cf7-aa0c-7e2396a1e784 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:09.481977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e185786d-cc54-4cf7-aa0c-7e2396a1e784 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:09.481977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e185786d-cc54-4cf7-aa0c-7e2396a1e784 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:09.481977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e185786d-cc54-4cf7-aa0c-7e2396a1e784 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:09.641839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac28e7a7-daef-4cdb-9fdc-c7ce1e82e7c7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:09.657161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e185786d-cc54-4cf7-aa0c-7e2396a1e784 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:09.657402 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac28e7a7-daef-4cdb-9fdc-c7ce1e82e7c7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1537 microversion: 2.1 time: 0.240499 Aug 27 04:36:09.658402 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 622/1215] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:09 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1537 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:09.667432 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e185786d-cc54-4cf7-aa0c-7e2396a1e784 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1312 microversion: 2.1 time: 0.215387 Aug 27 04:36:09.669050 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 594/1216] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:09 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1312 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:10.040493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5895d69-1dfe-48e5-b4ef-bfa10eb14cba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:10.042634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b5895d69-1dfe-48e5-b4ef-bfa10eb14cba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:10.051702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5895d69-1dfe-48e5-b4ef-bfa10eb14cba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:10.052624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5895d69-1dfe-48e5-b4ef-bfa10eb14cba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:10.053303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5895d69-1dfe-48e5-b4ef-bfa10eb14cba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:10.054974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5895d69-1dfe-48e5-b4ef-bfa10eb14cba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:10.056180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5895d69-1dfe-48e5-b4ef-bfa10eb14cba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:10.056889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5895d69-1dfe-48e5-b4ef-bfa10eb14cba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:10.083234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6446591f-3196-4520-aa5a-16919e3cf89d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:10.083234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6446591f-3196-4520-aa5a-16919e3cf89d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:10.094722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6446591f-3196-4520-aa5a-16919e3cf89d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:10.095334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6446591f-3196-4520-aa5a-16919e3cf89d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:10.095792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6446591f-3196-4520-aa5a-16919e3cf89d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:10.096520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6446591f-3196-4520-aa5a-16919e3cf89d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:10.097017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6446591f-3196-4520-aa5a-16919e3cf89d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:10.097450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6446591f-3196-4520-aa5a-16919e3cf89d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:10.245099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5895d69-1dfe-48e5-b4ef-bfa10eb14cba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:10.259886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5895d69-1dfe-48e5-b4ef-bfa10eb14cba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:10.261817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5895d69-1dfe-48e5-b4ef-bfa10eb14cba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:10.263361 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5895d69-1dfe-48e5-b4ef-bfa10eb14cba tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 0.228335 Aug 27 04:36:10.276556 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 623/1217] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:36:10 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:36:10.285535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f9726de-4166-4d12-a105-53dec4d7a608 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21941940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:10.339882 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f9726de-4166-4d12-a105-53dec4d7a608 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.065779 Aug 27 04:36:10.341146 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 624/1218] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:10 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:10.346951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee0e0ff1-ecfd-4541-98a9-394ae2ca126e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:10.347914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee0e0ff1-ecfd-4541-98a9-394ae2ca126e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:10.354922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0e0ff1-ecfd-4541-98a9-394ae2ca126e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:10.355855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0e0ff1-ecfd-4541-98a9-394ae2ca126e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:10.356859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0e0ff1-ecfd-4541-98a9-394ae2ca126e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:10.357833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0e0ff1-ecfd-4541-98a9-394ae2ca126e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:10.358488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0e0ff1-ecfd-4541-98a9-394ae2ca126e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:10.359083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0e0ff1-ecfd-4541-98a9-394ae2ca126e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:10.400254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6446591f-3196-4520-aa5a-16919e3cf89d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:10.410240 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6446591f-3196-4520-aa5a-16919e3cf89d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1504 microversion: 2.1 time: 0.333198 Aug 27 04:36:10.412907 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 595/1219] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:10 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:10.558147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee0e0ff1-ecfd-4541-98a9-394ae2ca126e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:10.571172 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee0e0ff1-ecfd-4541-98a9-394ae2ca126e tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1470 microversion: 2.1 time: 0.228612 Aug 27 04:36:10.572854 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 625/1220] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:10 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1470 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:10.603533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-6d541e1f-e3a6-43a6-b9ed-195e4795b311 req-7e377b55-fb8b-40bf-881d-304de7f801df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e6b1d8-56bd-49dd-952f-758425633218", "tag": "e2dd7cd4-c5d5-4ad2-80a1-6b887249437f"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:10.615942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6d541e1f-e3a6-43a6-b9ed-195e4795b311 req-7e377b55-fb8b-40bf-881d-304de7f801df service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:10.616467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6d541e1f-e3a6-43a6-b9ed-195e4795b311 req-7e377b55-fb8b-40bf-881d-304de7f801df service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:10.616899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6d541e1f-e3a6-43a6-b9ed-195e4795b311 req-7e377b55-fb8b-40bf-881d-304de7f801df service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:10.645682 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-6d541e1f-e3a6-43a6-b9ed-195e4795b311 req-7e377b55-fb8b-40bf-881d-304de7f801df service nova] Creating event network-changed:e2dd7cd4-c5d5-4ad2-80a1-6b887249437f for instance c0e6b1d8-56bd-49dd-952f-758425633218 on n-h1-854823-1 Aug 27 04:36:10.658146 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-6d541e1f-e3a6-43a6-b9ed-195e4795b311 req-7e377b55-fb8b-40bf-881d-304de7f801df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058110 Aug 27 04:36:10.658964 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 596/1221] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:10.693913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d72c0f68-4a14-4a0c-81c0-1672a0ec088a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:10.694535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d72c0f68-4a14-4a0c-81c0-1672a0ec088a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:10.695240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d31f3f46-33be-4106-8133-c3de1c62219f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:10.695949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d31f3f46-33be-4106-8133-c3de1c62219f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:10.704770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d72c0f68-4a14-4a0c-81c0-1672a0ec088a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:10.705269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d72c0f68-4a14-4a0c-81c0-1672a0ec088a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:10.705702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d72c0f68-4a14-4a0c-81c0-1672a0ec088a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:10.706409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d72c0f68-4a14-4a0c-81c0-1672a0ec088a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:10.706863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d72c0f68-4a14-4a0c-81c0-1672a0ec088a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:10.707285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d72c0f68-4a14-4a0c-81c0-1672a0ec088a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:10.710460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d31f3f46-33be-4106-8133-c3de1c62219f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:10.710975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d31f3f46-33be-4106-8133-c3de1c62219f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:10.711443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d31f3f46-33be-4106-8133-c3de1c62219f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:10.712177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d31f3f46-33be-4106-8133-c3de1c62219f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:10.712672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d31f3f46-33be-4106-8133-c3de1c62219f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:10.713110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d31f3f46-33be-4106-8133-c3de1c62219f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:10.929930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d72c0f68-4a14-4a0c-81c0-1672a0ec088a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:10.944145 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d72c0f68-4a14-4a0c-81c0-1672a0ec088a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1537 microversion: 2.1 time: 0.256458 Aug 27 04:36:10.945015 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 626/1222] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:10 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1537 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:11.084689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d31f3f46-33be-4106-8133-c3de1c62219f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:11.093670 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d31f3f46-33be-4106-8133-c3de1c62219f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1312 microversion: 2.1 time: 0.402428 Aug 27 04:36:11.094354 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 597/1223] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:10 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1312 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:11.289135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-91c1c594-33c9-48e6-81ba-5385208991df tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:11.292301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-91c1c594-33c9-48e6-81ba-5385208991df tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:11.304651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c1c594-33c9-48e6-81ba-5385208991df tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:11.318302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c1c594-33c9-48e6-81ba-5385208991df tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:11.318760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c1c594-33c9-48e6-81ba-5385208991df tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:11.319517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c1c594-33c9-48e6-81ba-5385208991df tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:11.319976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c1c594-33c9-48e6-81ba-5385208991df tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:11.320473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c1c594-33c9-48e6-81ba-5385208991df tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:11.355508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1eb1bbea-6ec3-49d4-850a-a6c14e67a7d0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25d21c10>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:11.408155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:11.431739 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1eb1bbea-6ec3-49d4-850a-a6c14e67a7d0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.080207 Aug 27 04:36:11.432339 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 598/1224] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:11 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:11.454032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-75fff0d7-5100-45ef-b9cd-5ae6523d998d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:11.455171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-75fff0d7-5100-45ef-b9cd-5ae6523d998d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:11.516187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75fff0d7-5100-45ef-b9cd-5ae6523d998d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:11.520631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75fff0d7-5100-45ef-b9cd-5ae6523d998d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:11.527035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75fff0d7-5100-45ef-b9cd-5ae6523d998d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:11.528132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75fff0d7-5100-45ef-b9cd-5ae6523d998d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:11.531281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75fff0d7-5100-45ef-b9cd-5ae6523d998d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:11.534040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75fff0d7-5100-45ef-b9cd-5ae6523d998d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:11.732245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-91c1c594-33c9-48e6-81ba-5385208991df tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:11.744105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-91c1c594-33c9-48e6-81ba-5385208991df tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:11.753259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-91c1c594-33c9-48e6-81ba-5385208991df tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:11.763554 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-91c1c594-33c9-48e6-81ba-5385208991df tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1412 microversion: 2.25 time: 0.479068 Aug 27 04:36:11.777489 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 627/1225] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:36:11 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1412 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:36:11.784436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-895e02a7-d63e-4364-a74f-49cd56c6ad9b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:11.785791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-895e02a7-d63e-4364-a74f-49cd56c6ad9b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:11.793182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-895e02a7-d63e-4364-a74f-49cd56c6ad9b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:11.794157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-895e02a7-d63e-4364-a74f-49cd56c6ad9b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:11.794892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-895e02a7-d63e-4364-a74f-49cd56c6ad9b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:11.796160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-895e02a7-d63e-4364-a74f-49cd56c6ad9b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:11.797151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-895e02a7-d63e-4364-a74f-49cd56c6ad9b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:11.797788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-895e02a7-d63e-4364-a74f-49cd56c6ad9b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:11.854466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-895e02a7-d63e-4364-a74f-49cd56c6ad9b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:11.856966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-895e02a7-d63e-4364-a74f-49cd56c6ad9b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:11.857891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-895e02a7-d63e-4364-a74f-49cd56c6ad9b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:11.862645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-895e02a7-d63e-4364-a74f-49cd56c6ad9b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lazy-loading 'fault' on Instance uuid f5b4d765-c03c-44a6-8346-c3bfd70f997b {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:36:11.944763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-75fff0d7-5100-45ef-b9cd-5ae6523d998d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:11.959122 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-75fff0d7-5100-45ef-b9cd-5ae6523d998d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1504 microversion: 2.1 time: 0.511142 Aug 27 04:36:11.959615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-895e02a7-d63e-4364-a74f-49cd56c6ad9b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8cb8eea83f45c1bb06328e31c960e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dca616f36142eda0aa064091b0e7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:11.959780 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 599/1226] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:11 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1504 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:11.968730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e1dcec7-bd49-4f5f-bdbe-fd2817e909e0 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:11.972155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e1dcec7-bd49-4f5f-bdbe-fd2817e909e0 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:11.980932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e1dcec7-bd49-4f5f-bdbe-fd2817e909e0 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:11.981939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e1dcec7-bd49-4f5f-bdbe-fd2817e909e0 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:11.982977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e1dcec7-bd49-4f5f-bdbe-fd2817e909e0 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:11.984039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e1dcec7-bd49-4f5f-bdbe-fd2817e909e0 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:11.984716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e1dcec7-bd49-4f5f-bdbe-fd2817e909e0 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:11.986347 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-895e02a7-d63e-4364-a74f-49cd56c6ad9b tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 200 len: 1306 microversion: 2.1 time: 0.206017 Aug 27 04:36:11.999565 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 628/1227] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:11 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 1306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:11.999565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ac969c0-0847-4895-8253-f65384287252 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:11.999565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ac969c0-0847-4895-8253-f65384287252 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:12.003328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e1dcec7-bd49-4f5f-bdbe-fd2817e909e0 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:12.006809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac969c0-0847-4895-8253-f65384287252 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:12.007317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac969c0-0847-4895-8253-f65384287252 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:12.007756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac969c0-0847-4895-8253-f65384287252 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:12.010058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac969c0-0847-4895-8253-f65384287252 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:12.010769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac969c0-0847-4895-8253-f65384287252 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:12.011212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac969c0-0847-4895-8253-f65384287252 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:12.082604 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e1dcec7-bd49-4f5f-bdbe-fd2817e909e0 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121757 Aug 27 04:36:12.089796 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 600/1228] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:36:11 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:12.095987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf9a09b8-3c2c-4667-9845-790877530ef3 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:12.097350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bf9a09b8-3c2c-4667-9845-790877530ef3 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:12.111952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf9a09b8-3c2c-4667-9845-790877530ef3 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:12.112826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf9a09b8-3c2c-4667-9845-790877530ef3 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:12.113543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf9a09b8-3c2c-4667-9845-790877530ef3 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:12.114515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf9a09b8-3c2c-4667-9845-790877530ef3 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:12.115922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf9a09b8-3c2c-4667-9845-790877530ef3 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:12.116608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf9a09b8-3c2c-4667-9845-790877530ef3 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:12.223136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ac969c0-0847-4895-8253-f65384287252 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:12.238485 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ac969c0-0847-4895-8253-f65384287252 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1537 microversion: 2.1 time: 0.250151 Aug 27 04:36:12.239598 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 629/1229] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:11 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1537 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:12.258797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8cfb2138-3493-4cc3-8a6d-5860ed4827a5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:12.259852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8cfb2138-3493-4cc3-8a6d-5860ed4827a5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:12.268471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cfb2138-3493-4cc3-8a6d-5860ed4827a5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:12.269549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cfb2138-3493-4cc3-8a6d-5860ed4827a5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:12.270976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cfb2138-3493-4cc3-8a6d-5860ed4827a5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:12.272214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cfb2138-3493-4cc3-8a6d-5860ed4827a5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:12.273835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cfb2138-3493-4cc3-8a6d-5860ed4827a5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:12.274953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cfb2138-3493-4cc3-8a6d-5860ed4827a5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:12.335386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-bf9a09b8-3c2c-4667-9845-790877530ef3 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lazy-loading 'services' on Instance uuid a359715d-5ce1-4edd-8d94-3bba4d560d33 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:36:12.405041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:12.532943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8cfb2138-3493-4cc3-8a6d-5860ed4827a5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:12.548271 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8cfb2138-3493-4cc3-8a6d-5860ed4827a5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1312 microversion: 2.1 time: 0.307280 Aug 27 04:36:12.549370 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 630/1230] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:12 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1312 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:12.573944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a160322-041f-46cb-a1be-3eae4875d4e2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21977c10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:12.600507 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bf9a09b8-3c2c-4667-9845-790877530ef3 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33/os-volume_attachments/e9a4584e-39ae-414c-af1b-33f8331e502b" status: 202 len: 0 microversion: 2.1 time: 0.508957 Aug 27 04:36:12.601192 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 601/1231] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 04:36:12 2022] DELETE /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33/os-volume_attachments/e9a4584e-39ae-414c-af1b-33f8331e502b => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:36:12.634208 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a160322-041f-46cb-a1be-3eae4875d4e2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.073257 Aug 27 04:36:12.635137 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 631/1232] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:12 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:12.703763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1691f1f1-e7fa-4294-a56d-78dcd20e0bee req-14cc10e2-264c-4357-ad26-7b432b7dffd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b4d765-c03c-44a6-8346-c3bfd70f997b", "name": "network-vif-deleted", "tag": "5e84d3c2-2f47-4c2a-86e7-1658be29f5c9"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:12.715725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1691f1f1-e7fa-4294-a56d-78dcd20e0bee req-14cc10e2-264c-4357-ad26-7b432b7dffd9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:12.716208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1691f1f1-e7fa-4294-a56d-78dcd20e0bee req-14cc10e2-264c-4357-ad26-7b432b7dffd9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:12.716845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1691f1f1-e7fa-4294-a56d-78dcd20e0bee req-14cc10e2-264c-4357-ad26-7b432b7dffd9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:12.729146 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1691f1f1-e7fa-4294-a56d-78dcd20e0bee req-14cc10e2-264c-4357-ad26-7b432b7dffd9 service nova] Creating event network-vif-deleted:5e84d3c2-2f47-4c2a-86e7-1658be29f5c9 for instance f5b4d765-c03c-44a6-8346-c3bfd70f997b on n-h1-854823-1 Aug 27 04:36:12.733951 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1691f1f1-e7fa-4294-a56d-78dcd20e0bee req-14cc10e2-264c-4357-ad26-7b432b7dffd9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036770 Aug 27 04:36:12.734726 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 602/1233] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:12.791739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8df65fc2-b8c8-4e05-b729-fadfe3f3911e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:12.799212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8df65fc2-b8c8-4e05-b729-fadfe3f3911e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:12.813859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8df65fc2-b8c8-4e05-b729-fadfe3f3911e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:12.819756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8df65fc2-b8c8-4e05-b729-fadfe3f3911e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:12.820424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8df65fc2-b8c8-4e05-b729-fadfe3f3911e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:12.821455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8df65fc2-b8c8-4e05-b729-fadfe3f3911e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:12.822922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8df65fc2-b8c8-4e05-b729-fadfe3f3911e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:12.823479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8df65fc2-b8c8-4e05-b729-fadfe3f3911e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:12.988217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2b618e40-81e4-4bb1-9a89-23ae038cbc40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:12.988490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2b618e40-81e4-4bb1-9a89-23ae038cbc40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:13.007749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b618e40-81e4-4bb1-9a89-23ae038cbc40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:13.008295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b618e40-81e4-4bb1-9a89-23ae038cbc40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:13.008785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b618e40-81e4-4bb1-9a89-23ae038cbc40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:13.009522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b618e40-81e4-4bb1-9a89-23ae038cbc40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:13.009984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b618e40-81e4-4bb1-9a89-23ae038cbc40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:13.010930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b618e40-81e4-4bb1-9a89-23ae038cbc40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:13.177137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8df65fc2-b8c8-4e05-b729-fadfe3f3911e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:13.202293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8df65fc2-b8c8-4e05-b729-fadfe3f3911e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:13.210769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8df65fc2-b8c8-4e05-b729-fadfe3f3911e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:13.213469 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8df65fc2-b8c8-4e05-b729-fadfe3f3911e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1609 microversion: 2.25 time: 0.427130 Aug 27 04:36:13.214801 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 632/1234] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:36:12 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1609 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:36:13.217341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2b618e40-81e4-4bb1-9a89-23ae038cbc40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:13.225255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8261fd3-57b3-4278-8fee-4c44b88d8df2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:13.226230 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2b618e40-81e4-4bb1-9a89-23ae038cbc40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1504 microversion: 2.1 time: 0.243833 Aug 27 04:36:13.226803 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 603/1235] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:12 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:13.227397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b8261fd3-57b3-4278-8fee-4c44b88d8df2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] [instance: f5b4d765-c03c-44a6-8346-c3bfd70f997b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:13.238904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8261fd3-57b3-4278-8fee-4c44b88d8df2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:13.239780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8261fd3-57b3-4278-8fee-4c44b88d8df2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:13.240571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8261fd3-57b3-4278-8fee-4c44b88d8df2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:13.241822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8261fd3-57b3-4278-8fee-4c44b88d8df2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:13.242434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b42cdbaa-0d31-413d-a76d-63eedbc49be3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:13.242666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8261fd3-57b3-4278-8fee-4c44b88d8df2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:13.243409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8261fd3-57b3-4278-8fee-4c44b88d8df2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:13.244067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b42cdbaa-0d31-413d-a76d-63eedbc49be3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:13.252026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b42cdbaa-0d31-413d-a76d-63eedbc49be3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:13.252922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b42cdbaa-0d31-413d-a76d-63eedbc49be3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:13.254038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b42cdbaa-0d31-413d-a76d-63eedbc49be3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:13.255064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b42cdbaa-0d31-413d-a76d-63eedbc49be3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:13.255672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b42cdbaa-0d31-413d-a76d-63eedbc49be3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:13.256514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b42cdbaa-0d31-413d-a76d-63eedbc49be3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:13.277887 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b8261fd3-57b3-4278-8fee-4c44b88d8df2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] HTTP exception thrown: Instance f5b4d765-c03c-44a6-8346-c3bfd70f997b could not be found. Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8261fd3-57b3-4278-8fee-4c44b88d8df2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Request method failure captured: Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b HTTP/1.1 Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5vZmCQoTpWfO2nVvghaAr6WQ7l0jSxgrsDU_f5pBjkwZR9vYzn-WSBKnKYlb4QrTThFlKQoSD6qMOG1RMxxH3EEGYmrkKAGkNv2QjvxwduOHa8oaP9JROieKflk83mA1Krxt2a8kMGRYbNuKy9a5hu87qF_uDiIUT5j6ZdX0CisgE Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:36:13.280017 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:36:13.281604 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7dca616f36142eda0aa064091b0e7c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:36:13.281604 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:36:13.281604 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d7dca616f36142eda0aa064091b0e7c6 Aug 27 04:36:13.281604 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2030000176 Aug 27 04:36:13.281604 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:36:13.281604 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:36:13.281604 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:36:13.281604 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cc8cb8eea83f45c1bb06328e31c960e7 Aug 27 04:36:13.281604 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersOnMultiNodesTest-2030000176-project Aug 27 04:36:13.281604 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:36:13.281604 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance f5b4d765-c03c-44a6-8346-c3bfd70f997b could not be found. Aug 27 04:36:13.281604 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'f5b4d765-c03c-44a6-8346-c3bfd70f997b'} Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b4d765-c03c-44a6-8346-c3bfd70f997b could not be found. Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:36:13.282398 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b4d765-c03c-44a6-8346-c3bfd70f997b could not be found. Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b4d765-c03c-44a6-8346-c3bfd70f997b could not be found. Aug 27 04:36:13.288258 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:13.290550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8261fd3-57b3-4278-8fee-4c44b88d8df2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] Returning 404 to user: Instance f5b4d765-c03c-44a6-8346-c3bfd70f997b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:36:13.290550 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b8261fd3-57b3-4278-8fee-4c44b88d8df2 tempest-ServersOnMultiNodesTest-2030000176 tempest-ServersOnMultiNodesTest-2030000176-project] 10.222.0.79 "GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b" status: 404 len: 111 microversion: 2.1 time: 0.065060 Aug 27 04:36:13.290550 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 633/1236] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:13 2022] GET /compute/v2.1/servers/f5b4d765-c03c-44a6-8346-c3bfd70f997b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:36:13.291508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e02b14b9-9624-4123-8d3a-c7ee7fdc28fa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:13.291508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e02b14b9-9624-4123-8d3a-c7ee7fdc28fa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:13.303197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e02b14b9-9624-4123-8d3a-c7ee7fdc28fa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:13.303681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e02b14b9-9624-4123-8d3a-c7ee7fdc28fa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:13.304113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e02b14b9-9624-4123-8d3a-c7ee7fdc28fa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:13.309941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e02b14b9-9624-4123-8d3a-c7ee7fdc28fa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:13.311231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e02b14b9-9624-4123-8d3a-c7ee7fdc28fa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:13.320602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e02b14b9-9624-4123-8d3a-c7ee7fdc28fa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:13.395886 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b42cdbaa-0d31-413d-a76d-63eedbc49be3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.158086 Aug 27 04:36:13.400791 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 604/1237] 10.222.0.79 () {60 vars in 1316 bytes} [Sat Aug 27 04:36:13 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:36:13.520105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e02b14b9-9624-4123-8d3a-c7ee7fdc28fa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:13.530254 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e02b14b9-9624-4123-8d3a-c7ee7fdc28fa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1537 microversion: 2.1 time: 0.246663 Aug 27 04:36:13.530843 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 634/1238] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:13 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1537 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:13.571643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b3b90c1f-720d-468c-bf99-094b35078f1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:13.571767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b3b90c1f-720d-468c-bf99-094b35078f1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:13.581356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3b90c1f-720d-468c-bf99-094b35078f1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:13.581858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3b90c1f-720d-468c-bf99-094b35078f1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:13.582294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3b90c1f-720d-468c-bf99-094b35078f1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:13.583589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3b90c1f-720d-468c-bf99-094b35078f1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:13.584336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3b90c1f-720d-468c-bf99-094b35078f1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:13.584793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3b90c1f-720d-468c-bf99-094b35078f1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:13.651208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d3fc759-eb47-4851-baba-66c084bb5beb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f2197b700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:13.732309 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d3fc759-eb47-4851-baba-66c084bb5beb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.085592 Aug 27 04:36:13.733256 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 635/1239] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:13 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:14.148377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b3b90c1f-720d-468c-bf99-094b35078f1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:14.166052 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b3b90c1f-720d-468c-bf99-094b35078f1e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1312 microversion: 2.1 time: 0.599872 Aug 27 04:36:14.167475 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 605/1240] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:13 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1312 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:14.248150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ae7de12-0636-49c3-8b49-81673fab8b23 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:14.249180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ae7de12-0636-49c3-8b49-81673fab8b23 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:14.259981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7de12-0636-49c3-8b49-81673fab8b23 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:14.263886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7de12-0636-49c3-8b49-81673fab8b23 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:14.277883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7de12-0636-49c3-8b49-81673fab8b23 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:14.283720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7de12-0636-49c3-8b49-81673fab8b23 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:14.287121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7de12-0636-49c3-8b49-81673fab8b23 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:14.288518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7de12-0636-49c3-8b49-81673fab8b23 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:14.557962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-23da7058-0389-49a8-b8da-b0ce370b1244 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:14.558400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-23da7058-0389-49a8-b8da-b0ce370b1244 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:14.570317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23da7058-0389-49a8-b8da-b0ce370b1244 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:14.570818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23da7058-0389-49a8-b8da-b0ce370b1244 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:14.571484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23da7058-0389-49a8-b8da-b0ce370b1244 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:14.572467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23da7058-0389-49a8-b8da-b0ce370b1244 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:14.573359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23da7058-0389-49a8-b8da-b0ce370b1244 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:14.574021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23da7058-0389-49a8-b8da-b0ce370b1244 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:14.666578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ae7de12-0636-49c3-8b49-81673fab8b23 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:14.681760 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ae7de12-0636-49c3-8b49-81673fab8b23 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1504 microversion: 2.1 time: 0.438267 Aug 27 04:36:14.683237 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 636/1241] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:14 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1504 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:14.747341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf3c60da-97bd-440f-8c60-cf6d318ce851 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f2197bca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:14.839784 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf3c60da-97bd-440f-8c60-cf6d318ce851 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.096459 Aug 27 04:36:14.840867 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 637/1242] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:14 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:15.195415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa2912a5-035f-43d8-b40b-fe14886ab966 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:15.196069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aa2912a5-035f-43d8-b40b-fe14886ab966 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:15.210282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa2912a5-035f-43d8-b40b-fe14886ab966 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:15.211146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa2912a5-035f-43d8-b40b-fe14886ab966 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:15.212887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa2912a5-035f-43d8-b40b-fe14886ab966 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:15.214647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa2912a5-035f-43d8-b40b-fe14886ab966 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:15.215609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa2912a5-035f-43d8-b40b-fe14886ab966 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:15.216290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa2912a5-035f-43d8-b40b-fe14886ab966 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:15.227600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-23da7058-0389-49a8-b8da-b0ce370b1244 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:15.236776 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-23da7058-0389-49a8-b8da-b0ce370b1244 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1537 microversion: 2.1 time: 0.682821 Aug 27 04:36:15.240270 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 606/1243] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:14 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1537 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:15.413573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aa2912a5-035f-43d8-b40b-fe14886ab966 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:15.422616 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa2912a5-035f-43d8-b40b-fe14886ab966 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1312 microversion: 2.1 time: 0.238862 Aug 27 04:36:15.425902 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 638/1244] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:15 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1312 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:15.704579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bbebd1f1-1021-4a97-aeba-eda4a1188e3d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:15.705823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bbebd1f1-1021-4a97-aeba-eda4a1188e3d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:15.715762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbebd1f1-1021-4a97-aeba-eda4a1188e3d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:15.716454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbebd1f1-1021-4a97-aeba-eda4a1188e3d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:15.718773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbebd1f1-1021-4a97-aeba-eda4a1188e3d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:15.721393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbebd1f1-1021-4a97-aeba-eda4a1188e3d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:15.723200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbebd1f1-1021-4a97-aeba-eda4a1188e3d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:15.725083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbebd1f1-1021-4a97-aeba-eda4a1188e3d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:15.856996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a148d9b-fc6f-4d7a-aa40-0ac93475af73 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f218d9160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:15.936062 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a148d9b-fc6f-4d7a-aa40-0ac93475af73 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.071415 Aug 27 04:36:15.937214 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 639/1245] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:15 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:16.286646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53f72b25-c259-4924-822e-a4ebe969a870 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:16.287679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-53f72b25-c259-4924-822e-a4ebe969a870 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:16.306382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53f72b25-c259-4924-822e-a4ebe969a870 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:16.306887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53f72b25-c259-4924-822e-a4ebe969a870 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:16.307723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53f72b25-c259-4924-822e-a4ebe969a870 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:16.308053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53f72b25-c259-4924-822e-a4ebe969a870 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:16.308508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53f72b25-c259-4924-822e-a4ebe969a870 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:16.308960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53f72b25-c259-4924-822e-a4ebe969a870 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:16.409401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bbebd1f1-1021-4a97-aeba-eda4a1188e3d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:16.440372 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bbebd1f1-1021-4a97-aeba-eda4a1188e3d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1504 microversion: 2.1 time: 0.734143 Aug 27 04:36:16.465632 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 607/1246] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:15 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1504 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:16.486290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef3bec01-e6b4-4619-a5ae-c93a61c8b5f0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:16.487826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ef3bec01-e6b4-4619-a5ae-c93a61c8b5f0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:16.500212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef3bec01-e6b4-4619-a5ae-c93a61c8b5f0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:16.502087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef3bec01-e6b4-4619-a5ae-c93a61c8b5f0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:16.503117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef3bec01-e6b4-4619-a5ae-c93a61c8b5f0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:16.504734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef3bec01-e6b4-4619-a5ae-c93a61c8b5f0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:16.505904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef3bec01-e6b4-4619-a5ae-c93a61c8b5f0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:16.507457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef3bec01-e6b4-4619-a5ae-c93a61c8b5f0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:16.638993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-53f72b25-c259-4924-822e-a4ebe969a870 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:16.649813 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-53f72b25-c259-4924-822e-a4ebe969a870 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1542 microversion: 2.1 time: 0.367659 Aug 27 04:36:16.651262 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 640/1247] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:16 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1542 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:16.935522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-fa1c8ff7-a0d4-4e81-a96f-7c960065a1bc req-1ead2068-33d1-4859-89d0-058aafea3b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0beb618a-0847-4929-b2e9-27a80f61a7ca", "name": "network-vif-plugged", "status": "completed", "tag": "0182ba2d-9563-41c7-a16e-8629890f858f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:16.960555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fa1c8ff7-a0d4-4e81-a96f-7c960065a1bc req-1ead2068-33d1-4859-89d0-058aafea3b2e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:16.961285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fa1c8ff7-a0d4-4e81-a96f-7c960065a1bc req-1ead2068-33d1-4859-89d0-058aafea3b2e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:16.962009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fa1c8ff7-a0d4-4e81-a96f-7c960065a1bc req-1ead2068-33d1-4859-89d0-058aafea3b2e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:16.978843 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-fa1c8ff7-a0d4-4e81-a96f-7c960065a1bc req-1ead2068-33d1-4859-89d0-058aafea3b2e service nova] Creating event network-vif-plugged:0182ba2d-9563-41c7-a16e-8629890f858f for instance 0beb618a-0847-4929-b2e9-27a80f61a7ca on n-h2-854823-1 Aug 27 04:36:16.985631 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-fa1c8ff7-a0d4-4e81-a96f-7c960065a1bc req-1ead2068-33d1-4859-89d0-058aafea3b2e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056911 Aug 27 04:36:16.987462 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 641/1248] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:16.994400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-171842d4-5df7-4565-9b55-7f421d11163e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f218d9c10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:17.065286 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-171842d4-5df7-4565-9b55-7f421d11163e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.076189 Aug 27 04:36:17.067134 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 642/1249] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:16 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:17.163800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef3bec01-e6b4-4619-a5ae-c93a61c8b5f0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:17.176699 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ef3bec01-e6b4-4619-a5ae-c93a61c8b5f0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1312 microversion: 2.1 time: 0.709363 Aug 27 04:36:17.182425 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 608/1250] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:16 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1312 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:17.303932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b6dd4d96-a57c-49ea-bfc6-f82eaca61eb8 req-2a3e4016-c1a3-405b-bc90-4038867cb2ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "516299cc-c878-4b8e-bb4d-4247ddbd90cf", "tag": "326c17ad-2ce3-4c6b-854b-aeff6eeb991e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:17.342994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b6dd4d96-a57c-49ea-bfc6-f82eaca61eb8 req-2a3e4016-c1a3-405b-bc90-4038867cb2ae service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:17.349162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b6dd4d96-a57c-49ea-bfc6-f82eaca61eb8 req-2a3e4016-c1a3-405b-bc90-4038867cb2ae service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:17.349985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b6dd4d96-a57c-49ea-bfc6-f82eaca61eb8 req-2a3e4016-c1a3-405b-bc90-4038867cb2ae service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:17.378428 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b6dd4d96-a57c-49ea-bfc6-f82eaca61eb8 req-2a3e4016-c1a3-405b-bc90-4038867cb2ae service nova] Creating event network-changed:326c17ad-2ce3-4c6b-854b-aeff6eeb991e for instance 516299cc-c878-4b8e-bb4d-4247ddbd90cf on n-h1-854823-1 Aug 27 04:36:17.398764 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b6dd4d96-a57c-49ea-bfc6-f82eaca61eb8 req-2a3e4016-c1a3-405b-bc90-4038867cb2ae service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100398 Aug 27 04:36:17.403209 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 643/1251] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:17.487014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5d27f7a6-3def-4101-a2fb-d7e60eb18517 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:17.487385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5d27f7a6-3def-4101-a2fb-d7e60eb18517 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:17.505921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d27f7a6-3def-4101-a2fb-d7e60eb18517 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:17.506400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d27f7a6-3def-4101-a2fb-d7e60eb18517 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:17.507153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d27f7a6-3def-4101-a2fb-d7e60eb18517 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:17.508076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d27f7a6-3def-4101-a2fb-d7e60eb18517 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:17.508767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d27f7a6-3def-4101-a2fb-d7e60eb18517 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:17.509360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d27f7a6-3def-4101-a2fb-d7e60eb18517 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:17.694113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25a1fd1e-edbd-4362-a6fc-4b2a0fcb67c0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:17.695077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25a1fd1e-edbd-4362-a6fc-4b2a0fcb67c0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:17.698427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:17.731841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25a1fd1e-edbd-4362-a6fc-4b2a0fcb67c0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:17.732339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25a1fd1e-edbd-4362-a6fc-4b2a0fcb67c0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:17.749265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25a1fd1e-edbd-4362-a6fc-4b2a0fcb67c0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:17.752999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25a1fd1e-edbd-4362-a6fc-4b2a0fcb67c0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:17.754777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25a1fd1e-edbd-4362-a6fc-4b2a0fcb67c0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:17.756292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25a1fd1e-edbd-4362-a6fc-4b2a0fcb67c0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:17.979054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25a1fd1e-edbd-4362-a6fc-4b2a0fcb67c0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:17.987963 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25a1fd1e-edbd-4362-a6fc-4b2a0fcb67c0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1542 microversion: 2.1 time: 0.298116 Aug 27 04:36:17.989770 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 644/1252] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:17 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1542 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:18.089764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5d27f7a6-3def-4101-a2fb-d7e60eb18517 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:18.102516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1953b1a2-f389-41db-808b-3913e9c99470 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21969700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:18.108232 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5d27f7a6-3def-4101-a2fb-d7e60eb18517 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1504 microversion: 2.1 time: 0.626765 Aug 27 04:36:18.113621 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 609/1253] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:17 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1504 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:18.206481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ffc798f5-acec-4d1d-8ea1-d94d7dcee342 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:18.211398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ffc798f5-acec-4d1d-8ea1-d94d7dcee342 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:18.215540 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1953b1a2-f389-41db-808b-3913e9c99470 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1411 microversion: 2.1 time: 0.133875 Aug 27 04:36:18.216670 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 645/1254] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:18 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1411 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:18.224473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc798f5-acec-4d1d-8ea1-d94d7dcee342 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:18.227150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc798f5-acec-4d1d-8ea1-d94d7dcee342 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:18.227831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc798f5-acec-4d1d-8ea1-d94d7dcee342 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:18.228772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc798f5-acec-4d1d-8ea1-d94d7dcee342 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:18.229411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc798f5-acec-4d1d-8ea1-d94d7dcee342 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:18.231155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc798f5-acec-4d1d-8ea1-d94d7dcee342 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:18.690360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ffc798f5-acec-4d1d-8ea1-d94d7dcee342 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:18.704587 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ffc798f5-acec-4d1d-8ea1-d94d7dcee342 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1312 microversion: 2.1 time: 0.502748 Aug 27 04:36:18.705651 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 610/1255] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:18 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1312 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:19.012828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3ed52f94-18dc-4673-8854-a07dfd1f01a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:19.013633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3ed52f94-18dc-4673-8854-a07dfd1f01a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:19.022234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ed52f94-18dc-4673-8854-a07dfd1f01a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:19.023482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ed52f94-18dc-4673-8854-a07dfd1f01a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:19.024143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ed52f94-18dc-4673-8854-a07dfd1f01a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:19.025188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ed52f94-18dc-4673-8854-a07dfd1f01a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:19.026101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ed52f94-18dc-4673-8854-a07dfd1f01a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:19.026769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ed52f94-18dc-4673-8854-a07dfd1f01a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:19.136472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b4f53330-990a-4191-982f-5e6f6cb5df4d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:19.138792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b4f53330-990a-4191-982f-5e6f6cb5df4d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:19.147642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:19.152396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4f53330-990a-4191-982f-5e6f6cb5df4d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:19.152396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4f53330-990a-4191-982f-5e6f6cb5df4d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:19.152396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4f53330-990a-4191-982f-5e6f6cb5df4d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:19.152971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4f53330-990a-4191-982f-5e6f6cb5df4d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:19.153661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4f53330-990a-4191-982f-5e6f6cb5df4d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:19.154251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4f53330-990a-4191-982f-5e6f6cb5df4d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:19.217602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3ed52f94-18dc-4673-8854-a07dfd1f01a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:19.226984 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3ed52f94-18dc-4673-8854-a07dfd1f01a6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1542 microversion: 2.1 time: 0.220061 Aug 27 04:36:19.228018 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 646/1256] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:19 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1542 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:19.232710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ca35cb7-a95b-44de-95d1-4891c4aeab0e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21969b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:19.286094 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ca35cb7-a95b-44de-95d1-4891c4aeab0e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1420 microversion: 2.1 time: 0.056759 Aug 27 04:36:19.287141 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 647/1257] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:19 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:19.301336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-caa1d2e6-6527-45da-a428-72ddd11e1b84 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f2198cdc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:19.370763 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-caa1d2e6-6527-45da-a428-72ddd11e1b84 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 200 len: 1420 microversion: 2.1 time: 0.073834 Aug 27 04:36:19.373942 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 648/1258] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:19 2022] GET /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:19.387882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca972db3-f75b-4d76-bcf3-cc09ac68e6e5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21969f70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:19.745497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b4f53330-990a-4191-982f-5e6f6cb5df4d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:19.763878 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b4f53330-990a-4191-982f-5e6f6cb5df4d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1504 microversion: 2.1 time: 0.632384 Aug 27 04:36:19.779546 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 611/1259] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:19 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1504 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:19.790445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e47aa4df-4c8f-4930-bfad-39c87bb8eb42 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:19.796107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e47aa4df-4c8f-4930-bfad-39c87bb8eb42 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:19.817732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e47aa4df-4c8f-4930-bfad-39c87bb8eb42 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:19.818303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e47aa4df-4c8f-4930-bfad-39c87bb8eb42 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:19.818748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e47aa4df-4c8f-4930-bfad-39c87bb8eb42 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:19.819859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e47aa4df-4c8f-4930-bfad-39c87bb8eb42 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:19.835149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e47aa4df-4c8f-4930-bfad-39c87bb8eb42 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:19.836151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e47aa4df-4c8f-4930-bfad-39c87bb8eb42 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:20.151770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e47aa4df-4c8f-4930-bfad-39c87bb8eb42 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:20.175555 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e47aa4df-4c8f-4930-bfad-39c87bb8eb42 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1462 microversion: 2.1 time: 0.393031 Aug 27 04:36:20.180224 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 612/1260] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:19 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1462 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:20.443690 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca972db3-f75b-4d76-bcf3-cc09ac68e6e5 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 204 len: 0 microversion: 2.1 time: 1.059762 Aug 27 04:36:20.445175 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 649/1261] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:19 2022] DELETE /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 0 bytes in 1062 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:36:20.463547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20d44df8-4e21-4ffd-a3b1-c17ec9f292b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:20.464756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20d44df8-4e21-4ffd-a3b1-c17ec9f292b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:20.483962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d44df8-4e21-4ffd-a3b1-c17ec9f292b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:20.485706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d44df8-4e21-4ffd-a3b1-c17ec9f292b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:20.486328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d44df8-4e21-4ffd-a3b1-c17ec9f292b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:20.487293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d44df8-4e21-4ffd-a3b1-c17ec9f292b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:20.487911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d44df8-4e21-4ffd-a3b1-c17ec9f292b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:20.489044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d44df8-4e21-4ffd-a3b1-c17ec9f292b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:20.523264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-967f5fa2-7b79-4412-8f97-203e45056967 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:20.529705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-967f5fa2-7b79-4412-8f97-203e45056967 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Searching by: {'deleted': False, 'project_id': 'e2b4561778144af183ba4618672064e0'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:36:20.542313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-967f5fa2-7b79-4412-8f97-203e45056967 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:20.545905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-967f5fa2-7b79-4412-8f97-203e45056967 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:20.546360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-967f5fa2-7b79-4412-8f97-203e45056967 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:20.547156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-967f5fa2-7b79-4412-8f97-203e45056967 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:20.547624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-967f5fa2-7b79-4412-8f97-203e45056967 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:20.548119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-967f5fa2-7b79-4412-8f97-203e45056967 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:20.671507 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-967f5fa2-7b79-4412-8f97-203e45056967 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.466145 Aug 27 04:36:20.672446 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 613/1262] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:36:20 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:36:20.677949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4181f869-db26-4c34-a75a-0406b86aaa5d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:20.678450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4181f869-db26-4c34-a75a-0406b86aaa5d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:20.684670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4181f869-db26-4c34-a75a-0406b86aaa5d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:20.685396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4181f869-db26-4c34-a75a-0406b86aaa5d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:20.686052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4181f869-db26-4c34-a75a-0406b86aaa5d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:20.686951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4181f869-db26-4c34-a75a-0406b86aaa5d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:20.687600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4181f869-db26-4c34-a75a-0406b86aaa5d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:20.688190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4181f869-db26-4c34-a75a-0406b86aaa5d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:20.722142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4181f869-db26-4c34-a75a-0406b86aaa5d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:36:20.778819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-20d44df8-4e21-4ffd-a3b1-c17ec9f292b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:20.791382 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20d44df8-4e21-4ffd-a3b1-c17ec9f292b4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1542 microversion: 2.1 time: 0.344908 Aug 27 04:36:20.794167 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 650/1263] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:20 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1542 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:20.812229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4d194c4b-18d9-4b93-9a23-370e7bd4989e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:20.820715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4d194c4b-18d9-4b93-9a23-370e7bd4989e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:20.846977 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4181f869-db26-4c34-a75a-0406b86aaa5d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 204 len: 0 microversion: 2.1 time: 0.171860 Aug 27 04:36:20.849096 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 614/1264] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:36:20 2022] DELETE /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:36:20.849554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d194c4b-18d9-4b93-9a23-370e7bd4989e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:20.851120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d194c4b-18d9-4b93-9a23-370e7bd4989e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:20.851946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d194c4b-18d9-4b93-9a23-370e7bd4989e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:20.853626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d194c4b-18d9-4b93-9a23-370e7bd4989e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:20.854323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d194c4b-18d9-4b93-9a23-370e7bd4989e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:20.855007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d194c4b-18d9-4b93-9a23-370e7bd4989e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:20.855509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8b583cb0-38df-43df-a4ee-7156147884e8 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:20.865463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8b583cb0-38df-43df-a4ee-7156147884e8 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Searching by: {'deleted': False} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:36:20.871753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b583cb0-38df-43df-a4ee-7156147884e8 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:20.872249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b583cb0-38df-43df-a4ee-7156147884e8 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:20.872798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b583cb0-38df-43df-a4ee-7156147884e8 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:20.874099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b583cb0-38df-43df-a4ee-7156147884e8 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:20.874816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b583cb0-38df-43df-a4ee-7156147884e8 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:20.882185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b583cb0-38df-43df-a4ee-7156147884e8 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:20.917382 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4d194c4b-18d9-4b93-9a23-370e7bd4989e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119774 Aug 27 04:36:20.917964 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 651/1265] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:36:20 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:36:20.926165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f4739ac6-04cd-4302-aec3-a1300dbcb862 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:20.926165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f4739ac6-04cd-4302-aec3-a1300dbcb862 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:20.943156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4739ac6-04cd-4302-aec3-a1300dbcb862 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:20.944190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4739ac6-04cd-4302-aec3-a1300dbcb862 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:20.944667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4739ac6-04cd-4302-aec3-a1300dbcb862 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:20.945452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4739ac6-04cd-4302-aec3-a1300dbcb862 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:20.945911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4739ac6-04cd-4302-aec3-a1300dbcb862 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:20.946402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4739ac6-04cd-4302-aec3-a1300dbcb862 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:21.123972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-8b583cb0-38df-43df-a4ee-7156147884e8 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:36:21.254992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f4739ac6-04cd-4302-aec3-a1300dbcb862 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:21.263645 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f4739ac6-04cd-4302-aec3-a1300dbcb862 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1494 microversion: 2.1 time: 0.344584 Aug 27 04:36:21.264981 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 652/1266] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:20 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1494 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:21.279269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6427244c-2915-4ce4-ad65-12c452472d7d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:21.284149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b583cb0-38df-43df-a4ee-7156147884e8 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:21.284322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6427244c-2915-4ce4-ad65-12c452472d7d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:21.285096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b583cb0-38df-43df-a4ee-7156147884e8 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:21.285904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b583cb0-38df-43df-a4ee-7156147884e8 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:21.293500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6427244c-2915-4ce4-ad65-12c452472d7d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:21.293994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6427244c-2915-4ce4-ad65-12c452472d7d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:21.294448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6427244c-2915-4ce4-ad65-12c452472d7d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:21.295143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6427244c-2915-4ce4-ad65-12c452472d7d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:21.295919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6427244c-2915-4ce4-ad65-12c452472d7d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:21.296347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6427244c-2915-4ce4-ad65-12c452472d7d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:21.330974 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6427244c-2915-4ce4-ad65-12c452472d7d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064512 Aug 27 04:36:21.331567 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 653/1267] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:36:21 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:36:21.336815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2045580070", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1a71fb22-9573-440e-a3b4-857cf66da6ea"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:21.425318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] validate_networks() for [('1a71fb22-9573-440e-a3b4-857cf66da6ea', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:36:21.739408 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8b583cb0-38df-43df-a4ee-7156147884e8 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21737 microversion: 2.1 time: 0.888604 Aug 27 04:36:21.740158 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 615/1268] 10.222.0.79 () {58 vars in 1171 bytes} [Sat Aug 27 04:36:20 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 21737 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:36:21.745243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ee58d8d7-8558-4d79-b0ca-9182b8be909e tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '.version_select at 0x7f1f21a2c3a0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:21.749023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee58d8d7-8558-4d79-b0ca-9182b8be909e tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:21.749506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee58d8d7-8558-4d79-b0ca-9182b8be909e tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:21.750185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee58d8d7-8558-4d79-b0ca-9182b8be909e tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:21.761651 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ee58d8d7-8558-4d79-b0ca-9182b8be909e tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 2345 microversion: 2.1 time: 0.020217 Aug 27 04:36:21.771486 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 616/1269] 10.222.0.79 () {58 vars in 1143 bytes} [Sat Aug 27 04:36:21 2022] GET /compute/v2.1/os-migrations => generated 2345 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:21.771486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0458556a-a11c-4d7d-8789-6b731535d7ed tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:21.771486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0458556a-a11c-4d7d-8789-6b731535d7ed tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:21.775237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0458556a-a11c-4d7d-8789-6b731535d7ed tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:21.775709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0458556a-a11c-4d7d-8789-6b731535d7ed tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:21.776459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0458556a-a11c-4d7d-8789-6b731535d7ed tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:21.777199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0458556a-a11c-4d7d-8789-6b731535d7ed tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:21.777652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0458556a-a11c-4d7d-8789-6b731535d7ed tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:21.778070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0458556a-a11c-4d7d-8789-6b731535d7ed tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:21.807705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0458556a-a11c-4d7d-8789-6b731535d7ed tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:36:21.822978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:21.892628 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0458556a-a11c-4d7d-8789-6b731535d7ed tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 204 len: 0 microversion: 2.1 time: 0.128243 Aug 27 04:36:21.893766 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 617/1270] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:36:21 2022] DELETE /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:36:21.899359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-20842a08-fd14-49d5-a737-fc4caa28499a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:21.900077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-20842a08-fd14-49d5-a737-fc4caa28499a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:21.906407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20842a08-fd14-49d5-a737-fc4caa28499a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:21.906909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20842a08-fd14-49d5-a737-fc4caa28499a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:21.907382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20842a08-fd14-49d5-a737-fc4caa28499a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:21.908190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20842a08-fd14-49d5-a737-fc4caa28499a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:21.908683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20842a08-fd14-49d5-a737-fc4caa28499a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:21.909224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20842a08-fd14-49d5-a737-fc4caa28499a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:22.058345 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-20842a08-fd14-49d5-a737-fc4caa28499a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1645 microversion: 2.1 time: 0.162961 Aug 27 04:36:22.058946 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 618/1271] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:21 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1645 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:22.067216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0fb8b4ee-fc44-4c3a-b754-7e35d49f5789 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:22.070543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0fb8b4ee-fc44-4c3a-b754-7e35d49f5789 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Searching by: {'deleted': False, 'project_id': 'e2b4561778144af183ba4618672064e0'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:36:22.089099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fb8b4ee-fc44-4c3a-b754-7e35d49f5789 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:22.089594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fb8b4ee-fc44-4c3a-b754-7e35d49f5789 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:22.090151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fb8b4ee-fc44-4c3a-b754-7e35d49f5789 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:22.090957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fb8b4ee-fc44-4c3a-b754-7e35d49f5789 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:22.091425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fb8b4ee-fc44-4c3a-b754-7e35d49f5789 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:22.091850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fb8b4ee-fc44-4c3a-b754-7e35d49f5789 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:22.122262 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0fb8b4ee-fc44-4c3a-b754-7e35d49f5789 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?tenant_id=3873cb4810d840ac93518952196fd52b" status: 200 len: 15 microversion: 2.1 time: 0.062195 Aug 27 04:36:22.122857 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 619/1272] 10.222.0.79 () {58 vars in 1231 bytes} [Sat Aug 27 04:36:22 2022] GET /compute/v2.1/servers/detail?tenant_id=3873cb4810d840ac93518952196fd52b => generated 15 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:36:22.142825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b9a91a37-b2da-43f6-90cf-0fb134be0b49 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:22.144025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b9a91a37-b2da-43f6-90cf-0fb134be0b49 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:22.150442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9a91a37-b2da-43f6-90cf-0fb134be0b49 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:22.151241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9a91a37-b2da-43f6-90cf-0fb134be0b49 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:22.151848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9a91a37-b2da-43f6-90cf-0fb134be0b49 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:22.152800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9a91a37-b2da-43f6-90cf-0fb134be0b49 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:22.153484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9a91a37-b2da-43f6-90cf-0fb134be0b49 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:22.154084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9a91a37-b2da-43f6-90cf-0fb134be0b49 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:22.321281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b9a91a37-b2da-43f6-90cf-0fb134be0b49 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:22.330259 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b9a91a37-b2da-43f6-90cf-0fb134be0b49 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1542 microversion: 2.1 time: 0.191458 Aug 27 04:36:22.331162 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 620/1273] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:22 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1542 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:22.335785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0e2a53d4-1d89-4018-960b-789c0098e6e1 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:22.336399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0e2a53d4-1d89-4018-960b-789c0098e6e1 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:22.345392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e2a53d4-1d89-4018-960b-789c0098e6e1 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:22.345887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e2a53d4-1d89-4018-960b-789c0098e6e1 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:22.347198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e2a53d4-1d89-4018-960b-789c0098e6e1 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:22.347996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e2a53d4-1d89-4018-960b-789c0098e6e1 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:22.348369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e2a53d4-1d89-4018-960b-789c0098e6e1 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:22.348827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e2a53d4-1d89-4018-960b-789c0098e6e1 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:22.420509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:36:22.421127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:36:22.421414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:36:22.421818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:36:22.422222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:36:22.439210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:22.439807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:22.440469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:22.441554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:22.442329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:22.442837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:22.470999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Getting quotas for project 67b207b502d846718f9d72f62d1d034c. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:36:22.486541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Getting quotas for user daa3b03c362d4032bd17ebfeccdcdb83 and project 67b207b502d846718f9d72f62d1d034c. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:36:22.499280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:36:22.502856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:36:22.527162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0e2a53d4-1d89-4018-960b-789c0098e6e1 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:22.547323 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0e2a53d4-1d89-4018-960b-789c0098e6e1 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1682 microversion: 2.1 time: 0.211726 Aug 27 04:36:22.552622 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 621/1274] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:22 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:22.560761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cbbcb98d-c118-4562-baa3-5258137799b6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:22.568220 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e70264b-1951-4893-ab20-c1d592ec6112 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.235150 Aug 27 04:36:22.569734 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 654/1275] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:36:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:36:22.575495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cbbcb98d-c118-4562-baa3-5258137799b6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Searching by: {'tenant_id': '3873cb4810d840ac93518952196fd52b', 'deleted': False} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:36:22.580561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1944819475", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "e70262b8-a762-4feb-8fb3-236b3c41daf8"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:22.601606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbbcb98d-c118-4562-baa3-5258137799b6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:22.602188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbbcb98d-c118-4562-baa3-5258137799b6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:22.602706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbbcb98d-c118-4562-baa3-5258137799b6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:22.603921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbbcb98d-c118-4562-baa3-5258137799b6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:22.604058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbbcb98d-c118-4562-baa3-5258137799b6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:22.604500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbbcb98d-c118-4562-baa3-5258137799b6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:22.664086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-cbbcb98d-c118-4562-baa3-5258137799b6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:36:22.704434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] validate_networks() for [('e70262b8-a762-4feb-8fb3-236b3c41daf8', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:36:22.849533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbbcb98d-c118-4562-baa3-5258137799b6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:22.853622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbbcb98d-c118-4562-baa3-5258137799b6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:22.854283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbbcb98d-c118-4562-baa3-5258137799b6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:23.268478 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cbbcb98d-c118-4562-baa3-5258137799b6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3873cb4810d840ac93518952196fd52b" status: 200 len: 4824 microversion: 2.1 time: 0.714521 Aug 27 04:36:23.269911 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 622/1276] 10.222.0.79 () {58 vars in 1257 bytes} [Sat Aug 27 04:36:22 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3873cb4810d840ac93518952196fd52b => generated 4824 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:23.274862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-23f24c48-6ccf-4a25-a85a-025ac8f28f06 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:23.277818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-23f24c48-6ccf-4a25-a85a-025ac8f28f06 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:23.362099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-23f24c48-6ccf-4a25-a85a-025ac8f28f06 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:23.377667 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-23f24c48-6ccf-4a25-a85a-025ac8f28f06 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1208 microversion: 2.1 time: 0.106423 Aug 27 04:36:23.378546 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 623/1277] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:23 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1208 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:23.383456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-836b685d-e95b-43ac-9e1a-8cb0f5bbc0f6 req-e28f134e-9a15-4c99-aba8-468b38b184b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a6657e-24e5-4825-9bf0-4f7b0503fa01", "name": "network-vif-unplugged", "status": "completed", "tag": "127900a1-4e2f-4ae6-bf1f-f21d1cafdbba"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:23.396020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-836b685d-e95b-43ac-9e1a-8cb0f5bbc0f6 req-e28f134e-9a15-4c99-aba8-468b38b184b2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:23.396990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-836b685d-e95b-43ac-9e1a-8cb0f5bbc0f6 req-e28f134e-9a15-4c99-aba8-468b38b184b2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:23.397475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-836b685d-e95b-43ac-9e1a-8cb0f5bbc0f6 req-e28f134e-9a15-4c99-aba8-468b38b184b2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:23.412231 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-836b685d-e95b-43ac-9e1a-8cb0f5bbc0f6 req-e28f134e-9a15-4c99-aba8-468b38b184b2 service nova] Creating event network-vif-unplugged:127900a1-4e2f-4ae6-bf1f-f21d1cafdbba for instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 on n-h2-854823-1 Aug 27 04:36:23.417714 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-836b685d-e95b-43ac-9e1a-8cb0f5bbc0f6 req-e28f134e-9a15-4c99-aba8-468b38b184b2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037669 Aug 27 04:36:23.418582 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 624/1278] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:23.425417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-af832b3c-b7ba-452d-b670-9f6cdd478525 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:23.431779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-af832b3c-b7ba-452d-b670-9f6cdd478525 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Searching by: {'tenant_id': 'e2b4561778144af183ba4618672064e0', 'deleted': False} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:36:23.438005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af832b3c-b7ba-452d-b670-9f6cdd478525 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:23.438561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af832b3c-b7ba-452d-b670-9f6cdd478525 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:23.439367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af832b3c-b7ba-452d-b670-9f6cdd478525 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:23.440122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af832b3c-b7ba-452d-b670-9f6cdd478525 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:23.440612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af832b3c-b7ba-452d-b670-9f6cdd478525 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:23.441338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af832b3c-b7ba-452d-b670-9f6cdd478525 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:23.484737 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-af832b3c-b7ba-452d-b670-9f6cdd478525 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e2b4561778144af183ba4618672064e0" status: 200 len: 15 microversion: 2.1 time: 0.063752 Aug 27 04:36:23.501464 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 625/1279] 10.222.0.79 () {58 vars in 1257 bytes} [Sat Aug 27 04:36:23 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e2b4561778144af183ba4618672064e0 => generated 15 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:36:23.506688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f311ba06-3bac-44eb-a9b3-dd6670c0d1f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:23.507653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f311ba06-3bac-44eb-a9b3-dd6670c0d1f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:23.514243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f311ba06-3bac-44eb-a9b3-dd6670c0d1f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:23.514959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f311ba06-3bac-44eb-a9b3-dd6670c0d1f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:23.515549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f311ba06-3bac-44eb-a9b3-dd6670c0d1f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:23.516491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f311ba06-3bac-44eb-a9b3-dd6670c0d1f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:23.517686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f311ba06-3bac-44eb-a9b3-dd6670c0d1f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:23.518296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f311ba06-3bac-44eb-a9b3-dd6670c0d1f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:23.908906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:36:23.909383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:36:23.909937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:36:23.910490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:36:23.910999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:36:23.937811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:23.940733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f311ba06-3bac-44eb-a9b3-dd6670c0d1f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:23.948428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:23.950472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:23.951404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:23.952981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:23.953186 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f311ba06-3bac-44eb-a9b3-dd6670c0d1f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1542 microversion: 2.1 time: 0.450254 Aug 27 04:36:23.953780 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 626/1280] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:23 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1542 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:23.955806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:23.974168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2fd7aa30-d483-4d0f-a3be-c044de68b8aa tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:23.988706 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2fd7aa30-d483-4d0f-a3be-c044de68b8aa tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.021632 Aug 27 04:36:24.004175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Getting quotas for project 67b142dea11c4e7d921bbb7dd5e543be. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:36:24.009298 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 627/1281] 10.222.0.79 () {58 vars in 1189 bytes} [Sat Aug 27 04:36:23 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:36:24.011095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Getting quotas for user 8213929124384914aebc5e05572cc1ed and project 67b142dea11c4e7d921bbb7dd5e543be. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:36:24.019788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99035991-3605-4e4e-9ac2-d1467eca7163 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:24.020411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-99035991-3605-4e4e-9ac2-d1467eca7163 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:24.026507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:36:24.030032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:36:24.039098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99035991-3605-4e4e-9ac2-d1467eca7163 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:24.039650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99035991-3605-4e4e-9ac2-d1467eca7163 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:24.040089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99035991-3605-4e4e-9ac2-d1467eca7163 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:24.040822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99035991-3605-4e4e-9ac2-d1467eca7163 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:24.043270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99035991-3605-4e4e-9ac2-d1467eca7163 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:24.043736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99035991-3605-4e4e-9ac2-d1467eca7163 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:24.115584 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f2d05a1-3b53-4e25-b624-43c781eb1f36 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.543692 Aug 27 04:36:24.116170 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 655/1282] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:36:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:36:24.131183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-42c46438-ebb4-4f48-b302-b9c4bc97039c req-f081db49-d135-4df7-8067-b52d502a49db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a6657e-24e5-4825-9bf0-4f7b0503fa01", "name": "network-vif-deleted", "tag": "127900a1-4e2f-4ae6-bf1f-f21d1cafdbba"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:24.168948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42c46438-ebb4-4f48-b302-b9c4bc97039c req-f081db49-d135-4df7-8067-b52d502a49db service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:24.169341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42c46438-ebb4-4f48-b302-b9c4bc97039c req-f081db49-d135-4df7-8067-b52d502a49db service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:24.169772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42c46438-ebb4-4f48-b302-b9c4bc97039c req-f081db49-d135-4df7-8067-b52d502a49db service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:24.182656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:24.203093 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-42c46438-ebb4-4f48-b302-b9c4bc97039c req-f081db49-d135-4df7-8067-b52d502a49db service nova] Creating event network-vif-deleted:127900a1-4e2f-4ae6-bf1f-f21d1cafdbba for instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 on n-h2-854823-1 Aug 27 04:36:24.215325 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-42c46438-ebb4-4f48-b302-b9c4bc97039c req-f081db49-d135-4df7-8067-b52d502a49db service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097566 Aug 27 04:36:24.217503 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 656/1283] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:24.232516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb222ddb-f533-4874-b0ee-cdad7e221ed7 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:24.235416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb222ddb-f533-4874-b0ee-cdad7e221ed7 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:24.260389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb222ddb-f533-4874-b0ee-cdad7e221ed7 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:24.260943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb222ddb-f533-4874-b0ee-cdad7e221ed7 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:24.261380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb222ddb-f533-4874-b0ee-cdad7e221ed7 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:24.262154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb222ddb-f533-4874-b0ee-cdad7e221ed7 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:24.262608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb222ddb-f533-4874-b0ee-cdad7e221ed7 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:24.263027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb222ddb-f533-4874-b0ee-cdad7e221ed7 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:24.417392 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb222ddb-f533-4874-b0ee-cdad7e221ed7 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea/action" status: 202 len: 0 microversion: 2.1 time: 0.198355 Aug 27 04:36:24.421701 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 657/1284] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:36:24 2022] POST /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:36:24.429092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29a0672a-50a4-4675-bb6c-c97b12ea179c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:24.429711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29a0672a-50a4-4675-bb6c-c97b12ea179c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:24.525515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-99035991-3605-4e4e-9ac2-d1467eca7163 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:24.539828 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-99035991-3605-4e4e-9ac2-d1467eca7163 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1682 microversion: 2.1 time: 0.524193 Aug 27 04:36:24.548450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29a0672a-50a4-4675-bb6c-c97b12ea179c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:24.554031 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 628/1285] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:24 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1682 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:24.557656 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29a0672a-50a4-4675-bb6c-c97b12ea179c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1211 microversion: 2.1 time: 0.134374 Aug 27 04:36:24.566996 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 658/1286] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:24 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1211 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:24.572408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-965da10a-bd76-4375-bab2-6b2a248407c4 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:24.578063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-965da10a-bd76-4375-bab2-6b2a248407c4 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:24.578641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-152506d0-2c0e-4149-9b53-48f0e34f6ce7 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:24.579820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-152506d0-2c0e-4149-9b53-48f0e34f6ce7 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:24.584985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-965da10a-bd76-4375-bab2-6b2a248407c4 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '3873cb4810d840ac93518952196fd52b'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:36:24.592295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-152506d0-2c0e-4149-9b53-48f0e34f6ce7 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:24.592818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-152506d0-2c0e-4149-9b53-48f0e34f6ce7 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:24.593256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-152506d0-2c0e-4149-9b53-48f0e34f6ce7 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:24.600093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-965da10a-bd76-4375-bab2-6b2a248407c4 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:24.600942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-965da10a-bd76-4375-bab2-6b2a248407c4 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:24.601615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-965da10a-bd76-4375-bab2-6b2a248407c4 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:24.602558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-965da10a-bd76-4375-bab2-6b2a248407c4 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:24.603252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-965da10a-bd76-4375-bab2-6b2a248407c4 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:24.603887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-965da10a-bd76-4375-bab2-6b2a248407c4 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:24.607078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-152506d0-2c0e-4149-9b53-48f0e34f6ce7 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:24.611259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-152506d0-2c0e-4149-9b53-48f0e34f6ce7 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:24.611709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-152506d0-2c0e-4149-9b53-48f0e34f6ce7 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:24.712762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-965da10a-bd76-4375-bab2-6b2a248407c4 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:36:24.789570 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-965da10a-bd76-4375-bab2-6b2a248407c4 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.220991 Aug 27 04:36:24.790419 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 659/1287] 10.222.0.79 () {58 vars in 1150 bytes} [Sat Aug 27 04:36:24 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:24.810803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a09f737-21f2-4c64-b209-8c53adcfc038 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:24.814960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a09f737-21f2-4c64-b209-8c53adcfc038 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:24.831362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a09f737-21f2-4c64-b209-8c53adcfc038 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:24.834203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a09f737-21f2-4c64-b209-8c53adcfc038 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:24.835699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a09f737-21f2-4c64-b209-8c53adcfc038 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:24.837524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a09f737-21f2-4c64-b209-8c53adcfc038 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:24.838225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a09f737-21f2-4c64-b209-8c53adcfc038 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:24.838871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a09f737-21f2-4c64-b209-8c53adcfc038 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:24.979019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-152506d0-2c0e-4149-9b53-48f0e34f6ce7 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:24.999284 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a09f737-21f2-4c64-b209-8c53adcfc038 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea/action" status: 202 len: 0 microversion: 2.1 time: 0.199852 Aug 27 04:36:25.001875 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 660/1288] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:36:24 2022] POST /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:36:25.007528 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-152506d0-2c0e-4149-9b53-48f0e34f6ce7 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1260 microversion: 2.1 time: 0.442013 Aug 27 04:36:25.010029 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 629/1289] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:24 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1260 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:25.011394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1e75ad0-8e0e-410e-98c2-ec703bd64d08 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:25.018598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1e75ad0-8e0e-410e-98c2-ec703bd64d08 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:25.019176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c6b6ab50-3658-4082-915d-6c2771447521 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:25.020001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c6b6ab50-3658-4082-915d-6c2771447521 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:25.051835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1e75ad0-8e0e-410e-98c2-ec703bd64d08 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:25.052479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1e75ad0-8e0e-410e-98c2-ec703bd64d08 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:25.057042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6b6ab50-3658-4082-915d-6c2771447521 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:25.057504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1e75ad0-8e0e-410e-98c2-ec703bd64d08 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:25.058037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6b6ab50-3658-4082-915d-6c2771447521 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:25.058276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1e75ad0-8e0e-410e-98c2-ec703bd64d08 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:25.058755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1e75ad0-8e0e-410e-98c2-ec703bd64d08 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:25.060452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6b6ab50-3658-4082-915d-6c2771447521 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:25.061477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6b6ab50-3658-4082-915d-6c2771447521 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:25.067019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6b6ab50-3658-4082-915d-6c2771447521 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:25.067492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1e75ad0-8e0e-410e-98c2-ec703bd64d08 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:25.068043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6b6ab50-3658-4082-915d-6c2771447521 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:25.474566 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c6b6ab50-3658-4082-915d-6c2771447521 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1614 microversion: 2.1 time: 0.461811 Aug 27 04:36:25.493123 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 630/1290] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:25 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1614 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:25.526292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a42648be-4816-4053-999a-c5d8c4f5fe07 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:25.528458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a42648be-4816-4053-999a-c5d8c4f5fe07 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:25.536752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42648be-4816-4053-999a-c5d8c4f5fe07 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:25.537675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42648be-4816-4053-999a-c5d8c4f5fe07 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:25.547646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42648be-4816-4053-999a-c5d8c4f5fe07 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:25.552942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42648be-4816-4053-999a-c5d8c4f5fe07 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:25.555992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42648be-4816-4053-999a-c5d8c4f5fe07 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:25.556880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42648be-4816-4053-999a-c5d8c4f5fe07 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:25.603178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1e75ad0-8e0e-410e-98c2-ec703bd64d08 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:25.644654 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1e75ad0-8e0e-410e-98c2-ec703bd64d08 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1542 microversion: 2.1 time: 0.641321 Aug 27 04:36:25.645368 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 661/1291] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:25 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1542 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:25.661527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40f20dd0-377f-4539-8d8e-391388e98420 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:25.665189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40f20dd0-377f-4539-8d8e-391388e98420 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:25.691804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40f20dd0-377f-4539-8d8e-391388e98420 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:25.700744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40f20dd0-377f-4539-8d8e-391388e98420 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:25.702837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40f20dd0-377f-4539-8d8e-391388e98420 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:25.706376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40f20dd0-377f-4539-8d8e-391388e98420 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:25.707491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40f20dd0-377f-4539-8d8e-391388e98420 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:25.712235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40f20dd0-377f-4539-8d8e-391388e98420 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:25.975571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40f20dd0-377f-4539-8d8e-391388e98420 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:25.994179 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40f20dd0-377f-4539-8d8e-391388e98420 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1614 microversion: 2.1 time: 0.347202 Aug 27 04:36:25.995160 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 662/1292] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:25 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1614 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:26.004356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-063abace-9294-4cbf-8961-d164a2051d30 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:26.007103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-063abace-9294-4cbf-8961-d164a2051d30 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:26.053284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-063abace-9294-4cbf-8961-d164a2051d30 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:26.054959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-063abace-9294-4cbf-8961-d164a2051d30 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:26.059977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-063abace-9294-4cbf-8961-d164a2051d30 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:26.061091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-063abace-9294-4cbf-8961-d164a2051d30 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:26.064865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-063abace-9294-4cbf-8961-d164a2051d30 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:26.065404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-063abace-9294-4cbf-8961-d164a2051d30 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:26.184591 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a42648be-4816-4053-999a-c5d8c4f5fe07 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1614 microversion: 2.1 time: 0.683133 Aug 27 04:36:26.185186 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 631/1293] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:25 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1614 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:26.196264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-79730121-c7e4-4ec6-8150-e59289940282 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:26.199040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-79730121-c7e4-4ec6-8150-e59289940282 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:26.228241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79730121-c7e4-4ec6-8150-e59289940282 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:26.228812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79730121-c7e4-4ec6-8150-e59289940282 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:26.231041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79730121-c7e4-4ec6-8150-e59289940282 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:26.231903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79730121-c7e4-4ec6-8150-e59289940282 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:26.234573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79730121-c7e4-4ec6-8150-e59289940282 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:26.239362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79730121-c7e4-4ec6-8150-e59289940282 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:26.281418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-063abace-9294-4cbf-8961-d164a2051d30 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:26.295802 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-063abace-9294-4cbf-8961-d164a2051d30 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1207 microversion: 2.1 time: 0.296736 Aug 27 04:36:26.314968 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 663/1294] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:25 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1207 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:26.321243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-700a5894-45b2-4b43-9861-822e1f6850e6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:26.332115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-700a5894-45b2-4b43-9861-822e1f6850e6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Searching by: {'host': 'n-h2-854823-1', 'deleted': False} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:36:26.345291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-700a5894-45b2-4b43-9861-822e1f6850e6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:26.346057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-700a5894-45b2-4b43-9861-822e1f6850e6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:26.346682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-700a5894-45b2-4b43-9861-822e1f6850e6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:26.356170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-700a5894-45b2-4b43-9861-822e1f6850e6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:26.357124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-700a5894-45b2-4b43-9861-822e1f6850e6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:26.362539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-700a5894-45b2-4b43-9861-822e1f6850e6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:26.602064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-79730121-c7e4-4ec6-8150-e59289940282 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:26.616887 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-79730121-c7e4-4ec6-8150-e59289940282 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1266 microversion: 2.1 time: 0.430481 Aug 27 04:36:26.636360 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 632/1295] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:26 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1266 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:26.648358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1d77ed3c-ecf6-4197-86ab-9647e0e52243 req-0602347c-ed49-4609-bb82-e74600221b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a359715d-5ce1-4edd-8d94-3bba4d560d33", "name": "network-vif-deleted", "tag": "fb2c924b-d280-4f1a-85fa-1bff5b9d0c84"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:26.667761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1d77ed3c-ecf6-4197-86ab-9647e0e52243 req-0602347c-ed49-4609-bb82-e74600221b31 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:26.669004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1d77ed3c-ecf6-4197-86ab-9647e0e52243 req-0602347c-ed49-4609-bb82-e74600221b31 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:26.673603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1d77ed3c-ecf6-4197-86ab-9647e0e52243 req-0602347c-ed49-4609-bb82-e74600221b31 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:26.706025 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1d77ed3c-ecf6-4197-86ab-9647e0e52243 req-0602347c-ed49-4609-bb82-e74600221b31 service nova] Creating event network-vif-deleted:fb2c924b-d280-4f1a-85fa-1bff5b9d0c84 for instance a359715d-5ce1-4edd-8d94-3bba4d560d33 on n-h1-854823-1 Aug 27 04:36:26.708715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-700a5894-45b2-4b43-9861-822e1f6850e6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:36:26.721607 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1d77ed3c-ecf6-4197-86ab-9647e0e52243 req-0602347c-ed49-4609-bb82-e74600221b31 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083217 Aug 27 04:36:26.722809 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 633/1296] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:26.734811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-05e8cd01-9ea6-4673-86cd-604e04ee50c8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:26.736102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-05e8cd01-9ea6-4673-86cd-604e04ee50c8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:26.747150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05e8cd01-9ea6-4673-86cd-604e04ee50c8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:26.747679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05e8cd01-9ea6-4673-86cd-604e04ee50c8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:26.748145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05e8cd01-9ea6-4673-86cd-604e04ee50c8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:26.749216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05e8cd01-9ea6-4673-86cd-604e04ee50c8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:26.780019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05e8cd01-9ea6-4673-86cd-604e04ee50c8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:26.780382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05e8cd01-9ea6-4673-86cd-604e04ee50c8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:26.889015 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-700a5894-45b2-4b43-9861-822e1f6850e6 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "GET /compute/v2.1/servers?host=n-h2-854823-1&all_tenants=1" status: 200 len: 2307 microversion: 2.1 time: 0.572573 Aug 27 04:36:26.890171 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 664/1297] 10.222.0.79 () {58 vars in 1190 bytes} [Sat Aug 27 04:36:26 2022] GET /compute/v2.1/servers?host=n-h2-854823-1&all_tenants=1 => generated 2307 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:26.909823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26157780-40ee-4cc0-9cc4-64b3d9c97fab tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:26.947761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26157780-40ee-4cc0-9cc4-64b3d9c97fab tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:36:26.976489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26157780-40ee-4cc0-9cc4-64b3d9c97fab tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:26.980789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26157780-40ee-4cc0-9cc4-64b3d9c97fab tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:26.984943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26157780-40ee-4cc0-9cc4-64b3d9c97fab tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:26.987028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26157780-40ee-4cc0-9cc4-64b3d9c97fab tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:26.990829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26157780-40ee-4cc0-9cc4-64b3d9c97fab tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:26.991501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26157780-40ee-4cc0-9cc4-64b3d9c97fab tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:27.092739 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26157780-40ee-4cc0-9cc4-64b3d9c97fab tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.186494 Aug 27 04:36:27.097036 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 665/1298] 10.222.0.79 () {58 vars in 1196 bytes} [Sat Aug 27 04:36:26 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:36:27.102545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f42d25d8-5b7a-4dfe-a8bc-e409caba390f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:27.103457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f42d25d8-5b7a-4dfe-a8bc-e409caba390f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:27.119240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42d25d8-5b7a-4dfe-a8bc-e409caba390f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:27.141128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42d25d8-5b7a-4dfe-a8bc-e409caba390f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:27.145133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42d25d8-5b7a-4dfe-a8bc-e409caba390f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:27.146149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42d25d8-5b7a-4dfe-a8bc-e409caba390f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:27.147478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42d25d8-5b7a-4dfe-a8bc-e409caba390f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:27.151339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42d25d8-5b7a-4dfe-a8bc-e409caba390f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:27.229884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42d25d8-5b7a-4dfe-a8bc-e409caba390f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:27.232330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42d25d8-5b7a-4dfe-a8bc-e409caba390f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:27.232927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42d25d8-5b7a-4dfe-a8bc-e409caba390f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:27.234574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-f42d25d8-5b7a-4dfe-a8bc-e409caba390f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lazy-loading 'fault' on Instance uuid a359715d-5ce1-4edd-8d94-3bba4d560d33 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:36:27.346835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f42d25d8-5b7a-4dfe-a8bc-e409caba390f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2523cdbb4f3444afb648340a73e85025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c5a62d0711490081fe3d1e1fa0a1fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:27.370871 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f42d25d8-5b7a-4dfe-a8bc-e409caba390f tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 200 len: 1331 microversion: 2.1 time: 0.272362 Aug 27 04:36:27.372078 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 666/1299] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:27 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 1331 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:27.377833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-516e5f25-6ea1-4cd1-969c-7d0715ab2d05 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:27.380368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-516e5f25-6ea1-4cd1-969c-7d0715ab2d05 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:27.387795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516e5f25-6ea1-4cd1-969c-7d0715ab2d05 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:27.388736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516e5f25-6ea1-4cd1-969c-7d0715ab2d05 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:27.389325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516e5f25-6ea1-4cd1-969c-7d0715ab2d05 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:27.390814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516e5f25-6ea1-4cd1-969c-7d0715ab2d05 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:27.391564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516e5f25-6ea1-4cd1-969c-7d0715ab2d05 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:27.392765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516e5f25-6ea1-4cd1-969c-7d0715ab2d05 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:27.513170 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-516e5f25-6ea1-4cd1-969c-7d0715ab2d05 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea/action" status: 202 len: 0 microversion: 2.1 time: 0.138864 Aug 27 04:36:27.514456 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 667/1300] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:36:27 2022] POST /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:36:27.521196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f78f01fb-2325-43ac-b991-383c5d2d5dbd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:27.522751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f78f01fb-2325-43ac-b991-383c5d2d5dbd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:27.531465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f78f01fb-2325-43ac-b991-383c5d2d5dbd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:27.533350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f78f01fb-2325-43ac-b991-383c5d2d5dbd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:27.533948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f78f01fb-2325-43ac-b991-383c5d2d5dbd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:27.535001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f78f01fb-2325-43ac-b991-383c5d2d5dbd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:27.535673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f78f01fb-2325-43ac-b991-383c5d2d5dbd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:27.536274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f78f01fb-2325-43ac-b991-383c5d2d5dbd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:27.739395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f78f01fb-2325-43ac-b991-383c5d2d5dbd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:27.797108 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f78f01fb-2325-43ac-b991-383c5d2d5dbd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1281 microversion: 2.1 time: 0.281301 Aug 27 04:36:27.798773 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 668/1301] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:27 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1281 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:27.811853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71228424-9f42-4121-865e-14501cc9b5c0"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:27.833272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:27.853877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:27.855558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:27.856177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:27.859876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:27.861846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:27.862635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:28.108595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:28.140050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:36:28.143493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:36:28.143987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:36:28.144459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:36:28.144896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:36:28.265828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:28.279659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-05e8cd01-9ea6-4673-86cd-604e04ee50c8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:28.290928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:28.291437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:28.291874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:28.292975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:28.293222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:28.293717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:28.303392 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-05e8cd01-9ea6-4673-86cd-604e04ee50c8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1542 microversion: 2.1 time: 1.578141 Aug 27 04:36:28.322824 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 634/1302] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:26 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1542 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:28.332401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e3987fe3-d310-4fb5-9f65-80352decc27b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:28.333287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e3987fe3-d310-4fb5-9f65-80352decc27b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:28.339254 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b8f7133-4cad-469d-b799-a50c08f644b3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "POST /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea/action" status: 202 len: 1067 microversion: 2.1 time: 0.537865 Aug 27 04:36:28.352924 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 669/1303] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:36:27 2022] POST /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea/action => generated 1067 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 04:36:28.356356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3987fe3-d310-4fb5-9f65-80352decc27b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:28.357609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3987fe3-d310-4fb5-9f65-80352decc27b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:28.358225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3987fe3-d310-4fb5-9f65-80352decc27b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:28.359119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3987fe3-d310-4fb5-9f65-80352decc27b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:28.359878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3987fe3-d310-4fb5-9f65-80352decc27b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:28.360611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3987fe3-d310-4fb5-9f65-80352decc27b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:28.441140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-843777021", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "77750c63-f69a-4025-8b95-db23cc8eae7f"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:28.567502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] validate_networks() for [('77750c63-f69a-4025-8b95-db23cc8eae7f', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:36:28.648022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e3987fe3-d310-4fb5-9f65-80352decc27b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:28.658897 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e3987fe3-d310-4fb5-9f65-80352decc27b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1266 microversion: 2.1 time: 0.334579 Aug 27 04:36:28.659751 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 635/1304] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:28 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:28.666481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-de74b22d-f366-4da4-9b82-2d99dd237be5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:28.669362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-de74b22d-f366-4da4-9b82-2d99dd237be5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:28.682126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de74b22d-f366-4da4-9b82-2d99dd237be5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:28.682661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de74b22d-f366-4da4-9b82-2d99dd237be5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:28.683149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de74b22d-f366-4da4-9b82-2d99dd237be5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:28.684243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de74b22d-f366-4da4-9b82-2d99dd237be5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:28.685249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de74b22d-f366-4da4-9b82-2d99dd237be5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:28.685696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de74b22d-f366-4da4-9b82-2d99dd237be5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:29.034895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:36:29.035895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:36:29.036569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:36:29.037298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:36:29.037855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:36:29.050977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:29.051688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:29.052274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:29.053262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:29.054518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:29.055109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:29.084884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Getting quotas for project a5e2ae48d5764048b5ad189114755aa8. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:36:29.095491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Getting quotas for user 307981144d4141ed9d609d88ea2e954e and project a5e2ae48d5764048b5ad189114755aa8. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:36:29.123602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:36:29.130168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:36:29.209195 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e53edf8-a5e1-4356-8695-dd1840b1e791 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867626 Aug 27 04:36:29.211249 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 670/1305] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:36:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:36:29.233248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c25c0c3-0ccc-43f8-8df2-0587199579a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:29.238106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c25c0c3-0ccc-43f8-8df2-0587199579a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:29.257242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c25c0c3-0ccc-43f8-8df2-0587199579a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:29.262632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c25c0c3-0ccc-43f8-8df2-0587199579a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:29.263372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c25c0c3-0ccc-43f8-8df2-0587199579a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:29.264281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c25c0c3-0ccc-43f8-8df2-0587199579a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:29.265197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c25c0c3-0ccc-43f8-8df2-0587199579a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:29.267801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c25c0c3-0ccc-43f8-8df2-0587199579a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:29.292058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-de74b22d-f366-4da4-9b82-2d99dd237be5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:29.302440 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8c25c0c3-0ccc-43f8-8df2-0587199579a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] HTTP exception thrown: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c25c0c3-0ccc-43f8-8df2-0587199579a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Request method failure captured: Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 HTTP/1.1 Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5nKo8I1Xr9dGc_EatXmBAznbuzk-v1HeD7PJLBflnEZWOvYbZlNVTbGW58GTjp0Bggi52KJbJ58Af600jRuXImOhf_9Tg9v4ar6Q65MrRQCjN9a0R8tSmhiKKeo3e67IYihRBQIgSW96cF9Kf1Ge2OaVFi4x13ZHJsdciXyXWC0Q0 Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 21c5a62d0711490081fe3d1e1fa0a1fb Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-508786321 Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:36:29.304877 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:36:29.306309 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/21c5a62d0711490081fe3d1e1fa0a1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_21c5a62d0711490081fe3d1e1fa0a1fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/21c5a62d0711490081fe3d1e1fa0a1fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/21c5a62d0711490081fe3d1e1fa0a1fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:36:29.306309 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-508786321 Aug 27 04:36:29.306309 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 21c5a62d0711490081fe3d1e1fa0a1fb Aug 27 04:36:29.306309 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-508786321 Aug 27 04:36:29.306309 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachSCSIVolumeTestJSON-508786321-project Aug 27 04:36:29.306309 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:36:29.306309 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:36:29.306309 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 2523cdbb4f3444afb648340a73e85025 Aug 27 04:36:29.306309 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-508786321-project Aug 27 04:36:29.306309 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:36:29.306309 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:29.306309 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'a359715d-5ce1-4edd-8d94-3bba4d560d33'} Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:36:29.307122 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:29.308482 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:29.310885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c25c0c3-0ccc-43f8-8df2-0587199579a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Returning 404 to user: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:36:29.311890 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8c25c0c3-0ccc-43f8-8df2-0587199579a4 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 404 len: 111 microversion: 2.1 time: 0.089733 Aug 27 04:36:29.312624 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 671/1306] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:29 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:36:29.317951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9023c79-8710-4e34-927c-19ff79485614 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:29.318533 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-de74b22d-f366-4da4-9b82-2d99dd237be5 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1471 microversion: 2.1 time: 0.655572 Aug 27 04:36:29.318954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9023c79-8710-4e34-927c-19ff79485614 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:29.325186 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 636/1307] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:28 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1471 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:29.328681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023c79-8710-4e34-927c-19ff79485614 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:29.329888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023c79-8710-4e34-927c-19ff79485614 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:29.330750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023c79-8710-4e34-927c-19ff79485614 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:29.332080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023c79-8710-4e34-927c-19ff79485614 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:29.332789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023c79-8710-4e34-927c-19ff79485614 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:29.333372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023c79-8710-4e34-927c-19ff79485614 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:29.341784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e57af422-9d09-42a6-b770-51505fb49d61 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:29.342565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e57af422-9d09-42a6-b770-51505fb49d61 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:29.435286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e57af422-9d09-42a6-b770-51505fb49d61 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:29.443008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9023c79-8710-4e34-927c-19ff79485614 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:29.444488 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e57af422-9d09-42a6-b770-51505fb49d61 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1224 microversion: 2.1 time: 0.117666 Aug 27 04:36:29.449513 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 637/1308] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:29 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1224 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:29.452426 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9023c79-8710-4e34-927c-19ff79485614 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1269 microversion: 2.1 time: 0.138179 Aug 27 04:36:29.455895 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 672/1309] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:29 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1269 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:29.465993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d757b76c-5d7f-4140-9c92-dd102829685e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '.version_select at 0x7f1f21760dc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:29.473173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7c417808-c121-4840-acd4-5645f61fddb4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da985ca6-f98a-4ff6-9ae4-e90b8be7d8b1"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:29.475941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7c417808-c121-4840-acd4-5645f61fddb4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:29.484579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c417808-c121-4840-acd4-5645f61fddb4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:29.485306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c417808-c121-4840-acd4-5645f61fddb4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:29.486839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c417808-c121-4840-acd4-5645f61fddb4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:29.488424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:29.488718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c417808-c121-4840-acd4-5645f61fddb4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:29.492634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c417808-c121-4840-acd4-5645f61fddb4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:29.492634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c417808-c121-4840-acd4-5645f61fddb4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:29.495644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:29.534573 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d757b76c-5d7f-4140-9c92-dd102829685e tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1623762787" status: 202 len: 0 microversion: 2.1 time: 0.079150 Aug 27 04:36:29.545539 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 673/1310] 10.222.0.79 () {58 vars in 1221 bytes} [Sat Aug 27 04:36:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1623762787 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:36:29.560370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af474b80-b4c0-4c15-a68c-0fc345b857f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:29.561894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af474b80-b4c0-4c15-a68c-0fc345b857f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:29.583809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af474b80-b4c0-4c15-a68c-0fc345b857f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:29.587198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af474b80-b4c0-4c15-a68c-0fc345b857f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:29.601817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af474b80-b4c0-4c15-a68c-0fc345b857f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:29.602702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af474b80-b4c0-4c15-a68c-0fc345b857f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:29.603194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af474b80-b4c0-4c15-a68c-0fc345b857f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:29.604793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af474b80-b4c0-4c15-a68c-0fc345b857f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:29.927701 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7c417808-c121-4840-acd4-5645f61fddb4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "POST /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.476297 Aug 27 04:36:29.928778 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 638/1311] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 04:36:29 2022] POST /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments => generated 194 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:29.949970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-20e1d041-3d99-4edb-9d3a-a797154a6da2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:29.956055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-20e1d041-3d99-4edb-9d3a-a797154a6da2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:29.983931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20e1d041-3d99-4edb-9d3a-a797154a6da2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:29.986501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20e1d041-3d99-4edb-9d3a-a797154a6da2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:29.986954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20e1d041-3d99-4edb-9d3a-a797154a6da2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:29.990892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20e1d041-3d99-4edb-9d3a-a797154a6da2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:29.992832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20e1d041-3d99-4edb-9d3a-a797154a6da2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:29.993283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20e1d041-3d99-4edb-9d3a-a797154a6da2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:30.003025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af474b80-b4c0-4c15-a68c-0fc345b857f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:30.017955 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af474b80-b4c0-4c15-a68c-0fc345b857f9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1542 microversion: 2.1 time: 0.469070 Aug 27 04:36:30.021753 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 674/1312] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:29 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1542 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:30.351901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b459536a-9ce5-4370-9a85-0c5799acded0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:30.352641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b459536a-9ce5-4370-9a85-0c5799acded0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:30.365895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b459536a-9ce5-4370-9a85-0c5799acded0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:30.366400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b459536a-9ce5-4370-9a85-0c5799acded0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:30.366852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b459536a-9ce5-4370-9a85-0c5799acded0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:30.367558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b459536a-9ce5-4370-9a85-0c5799acded0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:30.368017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b459536a-9ce5-4370-9a85-0c5799acded0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:30.368441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b459536a-9ce5-4370-9a85-0c5799acded0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:30.690177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-20e1d041-3d99-4edb-9d3a-a797154a6da2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:30.701148 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-20e1d041-3d99-4edb-9d3a-a797154a6da2 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1308 microversion: 2.1 time: 0.770221 Aug 27 04:36:30.705176 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 639/1313] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:29 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1308 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:30.721263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-90512c76-5bbf-4919-a712-897772d498f0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:30.723440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-90512c76-5bbf-4919-a712-897772d498f0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:30.743279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90512c76-5bbf-4919-a712-897772d498f0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:30.743982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90512c76-5bbf-4919-a712-897772d498f0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:30.745236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90512c76-5bbf-4919-a712-897772d498f0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:30.748293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90512c76-5bbf-4919-a712-897772d498f0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:30.749377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90512c76-5bbf-4919-a712-897772d498f0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:30.750551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90512c76-5bbf-4919-a712-897772d498f0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:30.789134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b459536a-9ce5-4370-9a85-0c5799acded0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:30.804002 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b459536a-9ce5-4370-9a85-0c5799acded0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1471 microversion: 2.1 time: 0.455307 Aug 27 04:36:30.818656 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 675/1314] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:30 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1471 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:30.837552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f15d7cd1-b397-47e2-afdc-98356db87af2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:30.839532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f15d7cd1-b397-47e2-afdc-98356db87af2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:30.852585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f15d7cd1-b397-47e2-afdc-98356db87af2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:30.859802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f15d7cd1-b397-47e2-afdc-98356db87af2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:30.860516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f15d7cd1-b397-47e2-afdc-98356db87af2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:30.861809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f15d7cd1-b397-47e2-afdc-98356db87af2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:30.862715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f15d7cd1-b397-47e2-afdc-98356db87af2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:30.863300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f15d7cd1-b397-47e2-afdc-98356db87af2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:31.041615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f15d7cd1-b397-47e2-afdc-98356db87af2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:31.053285 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f15d7cd1-b397-47e2-afdc-98356db87af2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.233931 Aug 27 04:36:31.054320 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 676/1315] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:30 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:31.061464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7999ca17-a22b-4162-a970-e6080a535b07 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:31.062296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7999ca17-a22b-4162-a970-e6080a535b07 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:31.072502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7999ca17-a22b-4162-a970-e6080a535b07 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:31.073274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7999ca17-a22b-4162-a970-e6080a535b07 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:31.074775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7999ca17-a22b-4162-a970-e6080a535b07 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:31.076283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7999ca17-a22b-4162-a970-e6080a535b07 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:31.077102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7999ca17-a22b-4162-a970-e6080a535b07 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:31.077788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7999ca17-a22b-4162-a970-e6080a535b07 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:31.093457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-90512c76-5bbf-4919-a712-897772d498f0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:31.119602 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-90512c76-5bbf-4919-a712-897772d498f0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1276 microversion: 2.1 time: 0.412609 Aug 27 04:36:31.120655 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 640/1316] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:30 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1276 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:31.286374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7999ca17-a22b-4162-a970-e6080a535b07 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:31.298293 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7999ca17-a22b-4162-a970-e6080a535b07 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1542 microversion: 2.1 time: 0.239470 Aug 27 04:36:31.320928 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 677/1317] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:31 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1542 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:31.727648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-70cf6c00-2183-4b8b-bb71-afd7f4ffee6d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:31.728277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-70cf6c00-2183-4b8b-bb71-afd7f4ffee6d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:31.745261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70cf6c00-2183-4b8b-bb71-afd7f4ffee6d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:31.745894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70cf6c00-2183-4b8b-bb71-afd7f4ffee6d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:31.746349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70cf6c00-2183-4b8b-bb71-afd7f4ffee6d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:31.747724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70cf6c00-2183-4b8b-bb71-afd7f4ffee6d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:31.748196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70cf6c00-2183-4b8b-bb71-afd7f4ffee6d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:31.748658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70cf6c00-2183-4b8b-bb71-afd7f4ffee6d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:31.829637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e538b44-ac0a-4d08-828f-580356a614a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:31.832631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e538b44-ac0a-4d08-828f-580356a614a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:31.852669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e538b44-ac0a-4d08-828f-580356a614a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:31.855217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e538b44-ac0a-4d08-828f-580356a614a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:31.856695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e538b44-ac0a-4d08-828f-580356a614a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:31.858713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e538b44-ac0a-4d08-828f-580356a614a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:31.859413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e538b44-ac0a-4d08-828f-580356a614a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:31.860880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e538b44-ac0a-4d08-828f-580356a614a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:32.421270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-70cf6c00-2183-4b8b-bb71-afd7f4ffee6d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:32.436724 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-70cf6c00-2183-4b8b-bb71-afd7f4ffee6d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1308 microversion: 2.1 time: 0.711456 Aug 27 04:36:32.439506 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 641/1318] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:31 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1308 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:32.454311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-fe981453-3f83-4d8f-a032-fa1e787f676f req-0c39521a-3f0c-4a22-9574-aad5e33127fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88460469-e163-4ebf-8076-73ddf76e72ad", "tag": "218b43e2-66f7-4ab7-bc63-d7caa2c9c4ef"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:32.474741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fe981453-3f83-4d8f-a032-fa1e787f676f req-0c39521a-3f0c-4a22-9574-aad5e33127fa service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:32.484479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fe981453-3f83-4d8f-a032-fa1e787f676f req-0c39521a-3f0c-4a22-9574-aad5e33127fa service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:32.486458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fe981453-3f83-4d8f-a032-fa1e787f676f req-0c39521a-3f0c-4a22-9574-aad5e33127fa service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:32.526609 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-fe981453-3f83-4d8f-a032-fa1e787f676f req-0c39521a-3f0c-4a22-9574-aad5e33127fa service nova] Creating event network-changed:218b43e2-66f7-4ab7-bc63-d7caa2c9c4ef for instance 88460469-e163-4ebf-8076-73ddf76e72ad on n-h1-854823-1 Aug 27 04:36:32.533745 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-fe981453-3f83-4d8f-a032-fa1e787f676f req-0c39521a-3f0c-4a22-9574-aad5e33127fa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091983 Aug 27 04:36:32.541469 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 642/1319] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:32.551658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1948da92-3ec3-4e21-bae6-752103b443a6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:32.562926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1948da92-3ec3-4e21-bae6-752103b443a6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:32.571200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1948da92-3ec3-4e21-bae6-752103b443a6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:32.573173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1948da92-3ec3-4e21-bae6-752103b443a6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:32.573643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1948da92-3ec3-4e21-bae6-752103b443a6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:32.574985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1948da92-3ec3-4e21-bae6-752103b443a6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:32.574985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1948da92-3ec3-4e21-bae6-752103b443a6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:32.575406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1948da92-3ec3-4e21-bae6-752103b443a6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:32.833284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e538b44-ac0a-4d08-828f-580356a614a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:32.852517 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e538b44-ac0a-4d08-828f-580356a614a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1471 microversion: 2.1 time: 1.026638 Aug 27 04:36:32.862100 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 678/1320] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:31 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1471 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:32.880346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a671c86-b720-4af3-bd98-375688d0100c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:32.881258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5a671c86-b720-4af3-bd98-375688d0100c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:32.916333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a671c86-b720-4af3-bd98-375688d0100c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:32.922260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a671c86-b720-4af3-bd98-375688d0100c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:32.923357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a671c86-b720-4af3-bd98-375688d0100c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:32.924393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a671c86-b720-4af3-bd98-375688d0100c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:32.925131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a671c86-b720-4af3-bd98-375688d0100c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:32.925586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a671c86-b720-4af3-bd98-375688d0100c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:33.151056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5a671c86-b720-4af3-bd98-375688d0100c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:33.168189 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5a671c86-b720-4af3-bd98-375688d0100c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1282 microversion: 2.1 time: 0.304400 Aug 27 04:36:33.168838 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 679/1321] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:32 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1282 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:33.174697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a5ec2a76-41ea-4d00-8ba1-3a05bcf23414 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:33.175539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a5ec2a76-41ea-4d00-8ba1-3a05bcf23414 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:33.190778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ec2a76-41ea-4d00-8ba1-3a05bcf23414 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:33.192057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ec2a76-41ea-4d00-8ba1-3a05bcf23414 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:33.196422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ec2a76-41ea-4d00-8ba1-3a05bcf23414 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:33.197464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ec2a76-41ea-4d00-8ba1-3a05bcf23414 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:33.197953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ec2a76-41ea-4d00-8ba1-3a05bcf23414 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:33.198384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ec2a76-41ea-4d00-8ba1-3a05bcf23414 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:33.251590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1948da92-3ec3-4e21-bae6-752103b443a6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:33.260685 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1948da92-3ec3-4e21-bae6-752103b443a6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.717324 Aug 27 04:36:33.262060 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 643/1322] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:32 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:33.462091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-277c9ed7-9b58-4f30-b14f-d59649960cd8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:33.464650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-277c9ed7-9b58-4f30-b14f-d59649960cd8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:33.486183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=10 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:33.488487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-277c9ed7-9b58-4f30-b14f-d59649960cd8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:33.489118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-277c9ed7-9b58-4f30-b14f-d59649960cd8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:33.489699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-277c9ed7-9b58-4f30-b14f-d59649960cd8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:33.492055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-277c9ed7-9b58-4f30-b14f-d59649960cd8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:33.492816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-277c9ed7-9b58-4f30-b14f-d59649960cd8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:33.493412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-277c9ed7-9b58-4f30-b14f-d59649960cd8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:33.558361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a5ec2a76-41ea-4d00-8ba1-3a05bcf23414 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:33.567144 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a5ec2a76-41ea-4d00-8ba1-3a05bcf23414 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1542 microversion: 2.1 time: 0.397046 Aug 27 04:36:33.570404 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 680/1323] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:33 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1542 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:33.737559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-277c9ed7-9b58-4f30-b14f-d59649960cd8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:33.746831 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-277c9ed7-9b58-4f30-b14f-d59649960cd8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1308 microversion: 2.1 time: 0.291009 Aug 27 04:36:33.748236 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 644/1324] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:33 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1308 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:33.884807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9be8c4f9-367d-496b-ba65-6a3b1e5ac931 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:33.885605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9be8c4f9-367d-496b-ba65-6a3b1e5ac931 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:33.894223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9be8c4f9-367d-496b-ba65-6a3b1e5ac931 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:33.894729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9be8c4f9-367d-496b-ba65-6a3b1e5ac931 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:33.895474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9be8c4f9-367d-496b-ba65-6a3b1e5ac931 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:33.896031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9be8c4f9-367d-496b-ba65-6a3b1e5ac931 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:33.896494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9be8c4f9-367d-496b-ba65-6a3b1e5ac931 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:33.896980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9be8c4f9-367d-496b-ba65-6a3b1e5ac931 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:34.046670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9be8c4f9-367d-496b-ba65-6a3b1e5ac931 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:34.054792 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9be8c4f9-367d-496b-ba65-6a3b1e5ac931 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1471 microversion: 2.1 time: 0.174193 Aug 27 04:36:34.067154 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 681/1325] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:33 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:34.191925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-29442ef4-5877-452c-9cd5-c8e06c22b0a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:34.192721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-29442ef4-5877-452c-9cd5-c8e06c22b0a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:34.199632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29442ef4-5877-452c-9cd5-c8e06c22b0a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:34.200117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29442ef4-5877-452c-9cd5-c8e06c22b0a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:34.200585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29442ef4-5877-452c-9cd5-c8e06c22b0a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:34.201358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29442ef4-5877-452c-9cd5-c8e06c22b0a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:34.201815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29442ef4-5877-452c-9cd5-c8e06c22b0a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:34.202241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29442ef4-5877-452c-9cd5-c8e06c22b0a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:34.282663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed7fc602-a6e8-4308-a8a3-7cb7761514a5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:34.283519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ed7fc602-a6e8-4308-a8a3-7cb7761514a5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:34.290193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7fc602-a6e8-4308-a8a3-7cb7761514a5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:34.290788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7fc602-a6e8-4308-a8a3-7cb7761514a5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:34.291276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7fc602-a6e8-4308-a8a3-7cb7761514a5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:34.292044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7fc602-a6e8-4308-a8a3-7cb7761514a5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:34.292817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7fc602-a6e8-4308-a8a3-7cb7761514a5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:34.293470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed7fc602-a6e8-4308-a8a3-7cb7761514a5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:34.337798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-29442ef4-5877-452c-9cd5-c8e06c22b0a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:34.346069 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-29442ef4-5877-452c-9cd5-c8e06c22b0a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.158619 Aug 27 04:36:34.347291 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 645/1326] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:34 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:34.442021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed7fc602-a6e8-4308-a8a3-7cb7761514a5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:34.453234 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ed7fc602-a6e8-4308-a8a3-7cb7761514a5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.174666 Aug 27 04:36:34.454725 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 682/1327] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:34 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:34.570254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-db88fc52-1bf7-435f-9443-90d3622748dc req-ac8da49e-7482-4259-b58c-20ea9bbc8578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea1e00b-093a-4ed1-9640-a2a775d92433", "tag": "d062da01-c364-4876-b2fb-050be39ee311"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:34.580273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-db88fc52-1bf7-435f-9443-90d3622748dc req-ac8da49e-7482-4259-b58c-20ea9bbc8578 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:34.580874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-db88fc52-1bf7-435f-9443-90d3622748dc req-ac8da49e-7482-4259-b58c-20ea9bbc8578 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:34.581380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-db88fc52-1bf7-435f-9443-90d3622748dc req-ac8da49e-7482-4259-b58c-20ea9bbc8578 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:34.587914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e64e517-1587-4b1f-abd0-6b35a3758290 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:34.588590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e64e517-1587-4b1f-abd0-6b35a3758290 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:34.593590 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-db88fc52-1bf7-435f-9443-90d3622748dc req-ac8da49e-7482-4259-b58c-20ea9bbc8578 service nova] Creating event network-changed:d062da01-c364-4876-b2fb-050be39ee311 for instance 4ea1e00b-093a-4ed1-9640-a2a775d92433 on n-h1-854823-1 Aug 27 04:36:34.595120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e64e517-1587-4b1f-abd0-6b35a3758290 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:34.595621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e64e517-1587-4b1f-abd0-6b35a3758290 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:34.596059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e64e517-1587-4b1f-abd0-6b35a3758290 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:34.596803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e64e517-1587-4b1f-abd0-6b35a3758290 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:34.597266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e64e517-1587-4b1f-abd0-6b35a3758290 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:34.597694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e64e517-1587-4b1f-abd0-6b35a3758290 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:34.598514 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-db88fc52-1bf7-435f-9443-90d3622748dc req-ac8da49e-7482-4259-b58c-20ea9bbc8578 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031955 Aug 27 04:36:34.599453 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 646/1328] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:34.745509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7e64e517-1587-4b1f-abd0-6b35a3758290 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:34.757310 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e64e517-1587-4b1f-abd0-6b35a3758290 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1542 microversion: 2.1 time: 0.173356 Aug 27 04:36:34.757910 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 683/1329] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:34 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1542 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:34.769420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7ec873d9-857e-47d0-8b80-3ca7a81a1706 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:34.770202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7ec873d9-857e-47d0-8b80-3ca7a81a1706 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:34.777343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ec873d9-857e-47d0-8b80-3ca7a81a1706 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:34.778174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ec873d9-857e-47d0-8b80-3ca7a81a1706 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:34.778689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ec873d9-857e-47d0-8b80-3ca7a81a1706 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:34.779504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ec873d9-857e-47d0-8b80-3ca7a81a1706 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:34.780032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ec873d9-857e-47d0-8b80-3ca7a81a1706 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:34.780569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ec873d9-857e-47d0-8b80-3ca7a81a1706 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:34.931486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7ec873d9-857e-47d0-8b80-3ca7a81a1706 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:34.940207 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7ec873d9-857e-47d0-8b80-3ca7a81a1706 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1308 microversion: 2.1 time: 0.175265 Aug 27 04:36:34.941041 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 647/1330] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:34 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:35.076660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23e8b3b2-4160-4f95-9e11-4bc7d341965f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:35.077404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-23e8b3b2-4160-4f95-9e11-4bc7d341965f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:35.084711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e8b3b2-4160-4f95-9e11-4bc7d341965f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:35.085206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e8b3b2-4160-4f95-9e11-4bc7d341965f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:35.085647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e8b3b2-4160-4f95-9e11-4bc7d341965f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:35.086357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e8b3b2-4160-4f95-9e11-4bc7d341965f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:35.086818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e8b3b2-4160-4f95-9e11-4bc7d341965f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:35.087243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23e8b3b2-4160-4f95-9e11-4bc7d341965f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:35.237981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-23e8b3b2-4160-4f95-9e11-4bc7d341965f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:35.247022 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23e8b3b2-4160-4f95-9e11-4bc7d341965f tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1471 microversion: 2.1 time: 0.174058 Aug 27 04:36:35.247715 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 684/1331] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:35 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:35.367504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fdde9ced-c0b3-4f13-8426-f476546bfd4a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:35.368064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fdde9ced-c0b3-4f13-8426-f476546bfd4a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:35.375204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdde9ced-c0b3-4f13-8426-f476546bfd4a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:35.375756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdde9ced-c0b3-4f13-8426-f476546bfd4a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:35.376184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdde9ced-c0b3-4f13-8426-f476546bfd4a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:35.376913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdde9ced-c0b3-4f13-8426-f476546bfd4a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:35.377363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdde9ced-c0b3-4f13-8426-f476546bfd4a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:35.377780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdde9ced-c0b3-4f13-8426-f476546bfd4a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:35.475140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37fdc7a0-8f3d-409f-8241-3d5ca6f1257f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:35.475876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37fdc7a0-8f3d-409f-8241-3d5ca6f1257f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:35.486663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37fdc7a0-8f3d-409f-8241-3d5ca6f1257f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:35.487276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37fdc7a0-8f3d-409f-8241-3d5ca6f1257f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:35.488677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37fdc7a0-8f3d-409f-8241-3d5ca6f1257f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:35.489471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37fdc7a0-8f3d-409f-8241-3d5ca6f1257f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:35.492222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37fdc7a0-8f3d-409f-8241-3d5ca6f1257f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:35.492766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37fdc7a0-8f3d-409f-8241-3d5ca6f1257f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:35.529866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fdde9ced-c0b3-4f13-8426-f476546bfd4a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:35.539716 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fdde9ced-c0b3-4f13-8426-f476546bfd4a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.175898 Aug 27 04:36:35.540887 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 648/1332] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:35 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:35.666532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-37fdc7a0-8f3d-409f-8241-3d5ca6f1257f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:35.674753 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37fdc7a0-8f3d-409f-8241-3d5ca6f1257f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.203569 Aug 27 04:36:35.675441 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 685/1333] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:35 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:35.778578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8a5a3264-3c96-442c-bd6e-1f5619be74da tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:35.779353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8a5a3264-3c96-442c-bd6e-1f5619be74da tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:35.786240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a5a3264-3c96-442c-bd6e-1f5619be74da tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:35.786741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a5a3264-3c96-442c-bd6e-1f5619be74da tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:35.787184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a5a3264-3c96-442c-bd6e-1f5619be74da tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:35.787888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a5a3264-3c96-442c-bd6e-1f5619be74da tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:35.788367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a5a3264-3c96-442c-bd6e-1f5619be74da tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:35.788805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a5a3264-3c96-442c-bd6e-1f5619be74da tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:35.935806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8a5a3264-3c96-442c-bd6e-1f5619be74da tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:35.944490 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8a5a3264-3c96-442c-bd6e-1f5619be74da tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1542 microversion: 2.1 time: 0.169795 Aug 27 04:36:35.945157 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 649/1334] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:35 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1542 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:35.961251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-494d920b-a9ec-439e-8afc-a9ba9e7acdc3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:35.962168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-494d920b-a9ec-439e-8afc-a9ba9e7acdc3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:35.969996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-494d920b-a9ec-439e-8afc-a9ba9e7acdc3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:35.970529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-494d920b-a9ec-439e-8afc-a9ba9e7acdc3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:35.970964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-494d920b-a9ec-439e-8afc-a9ba9e7acdc3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:35.971705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-494d920b-a9ec-439e-8afc-a9ba9e7acdc3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:35.972161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-494d920b-a9ec-439e-8afc-a9ba9e7acdc3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:35.972649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-494d920b-a9ec-439e-8afc-a9ba9e7acdc3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:36.126388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-494d920b-a9ec-439e-8afc-a9ba9e7acdc3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:36.129378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:36.137016 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-494d920b-a9ec-439e-8afc-a9ba9e7acdc3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1308 microversion: 2.1 time: 0.180120 Aug 27 04:36:36.137851 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 686/1335] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:35 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:36.272268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fe584f89-1421-4422-be50-9bbfc343fd0d tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:36.273592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fe584f89-1421-4422-be50-9bbfc343fd0d tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:36.279435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:36.281341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe584f89-1421-4422-be50-9bbfc343fd0d tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:36.282466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe584f89-1421-4422-be50-9bbfc343fd0d tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:36.282907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe584f89-1421-4422-be50-9bbfc343fd0d tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:36.283621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe584f89-1421-4422-be50-9bbfc343fd0d tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:36.284074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe584f89-1421-4422-be50-9bbfc343fd0d tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:36.284501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe584f89-1421-4422-be50-9bbfc343fd0d tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:36.568418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78c79527-506c-429b-aae7-21fd7607355f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:36.568971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78c79527-506c-429b-aae7-21fd7607355f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:36.587147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78c79527-506c-429b-aae7-21fd7607355f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:36.589598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78c79527-506c-429b-aae7-21fd7607355f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:36.591422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78c79527-506c-429b-aae7-21fd7607355f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:36.592992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78c79527-506c-429b-aae7-21fd7607355f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:36.593460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78c79527-506c-429b-aae7-21fd7607355f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:36.593888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78c79527-506c-429b-aae7-21fd7607355f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:36.773956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fe584f89-1421-4422-be50-9bbfc343fd0d tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:36.789008 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fe584f89-1421-4422-be50-9bbfc343fd0d tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1471 microversion: 2.1 time: 0.522722 Aug 27 04:36:36.789888 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 650/1336] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:36 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1471 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:36.795854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-30d03ef1-d066-4f5f-b140-3fb16daef7c1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:36.797038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-30d03ef1-d066-4f5f-b140-3fb16daef7c1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:36.804572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30d03ef1-d066-4f5f-b140-3fb16daef7c1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:36.805366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30d03ef1-d066-4f5f-b140-3fb16daef7c1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:36.805855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30d03ef1-d066-4f5f-b140-3fb16daef7c1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:36.806615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30d03ef1-d066-4f5f-b140-3fb16daef7c1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:36.807076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30d03ef1-d066-4f5f-b140-3fb16daef7c1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:36.807695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30d03ef1-d066-4f5f-b140-3fb16daef7c1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:36.846342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-78c79527-506c-429b-aae7-21fd7607355f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:36.856312 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78c79527-506c-429b-aae7-21fd7607355f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.293894 Aug 27 04:36:36.857557 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 687/1337] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:36 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:36.967545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dcb8227d-4f91-46d6-b125-9da839affa30 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:36.968239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dcb8227d-4f91-46d6-b125-9da839affa30 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:36.986809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcb8227d-4f91-46d6-b125-9da839affa30 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:36.987444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcb8227d-4f91-46d6-b125-9da839affa30 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:36.987871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcb8227d-4f91-46d6-b125-9da839affa30 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:36.988652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcb8227d-4f91-46d6-b125-9da839affa30 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:36.989114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcb8227d-4f91-46d6-b125-9da839affa30 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:36.989544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcb8227d-4f91-46d6-b125-9da839affa30 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:37.020004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-30d03ef1-d066-4f5f-b140-3fb16daef7c1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:37.029008 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-30d03ef1-d066-4f5f-b140-3fb16daef7c1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.237942 Aug 27 04:36:37.032953 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 651/1338] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:36 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:37.159184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a4d889d1-2e53-48a3-ac3b-c26cbc5434fd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:37.160158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a4d889d1-2e53-48a3-ac3b-c26cbc5434fd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:37.167814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4d889d1-2e53-48a3-ac3b-c26cbc5434fd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:37.168648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4d889d1-2e53-48a3-ac3b-c26cbc5434fd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:37.169262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4d889d1-2e53-48a3-ac3b-c26cbc5434fd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:37.170179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4d889d1-2e53-48a3-ac3b-c26cbc5434fd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:37.174888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4d889d1-2e53-48a3-ac3b-c26cbc5434fd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:37.175638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4d889d1-2e53-48a3-ac3b-c26cbc5434fd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:37.242578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dcb8227d-4f91-46d6-b125-9da839affa30 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:37.256302 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dcb8227d-4f91-46d6-b125-9da839affa30 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1542 microversion: 2.1 time: 0.292376 Aug 27 04:36:37.273848 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 688/1339] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:36 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1542 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:37.287626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c2e7bdd4-317c-4051-91fe-a7e463e72d3f req-f96f7480-b0ee-4b77-b3c2-3b61468f0e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6aa77e-f369-461e-9cf6-d9bd0dad016b", "tag": "134f0809-a07c-4cc3-8067-54f430a3368d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:37.313429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c2e7bdd4-317c-4051-91fe-a7e463e72d3f req-f96f7480-b0ee-4b77-b3c2-3b61468f0e35 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:37.314042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c2e7bdd4-317c-4051-91fe-a7e463e72d3f req-f96f7480-b0ee-4b77-b3c2-3b61468f0e35 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:37.314533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c2e7bdd4-317c-4051-91fe-a7e463e72d3f req-f96f7480-b0ee-4b77-b3c2-3b61468f0e35 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:37.421834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a4d889d1-2e53-48a3-ac3b-c26cbc5434fd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:37.431636 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a4d889d1-2e53-48a3-ac3b-c26cbc5434fd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1308 microversion: 2.1 time: 0.277524 Aug 27 04:36:37.433010 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 652/1340] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:37 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1308 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:37.563673 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c2e7bdd4-317c-4051-91fe-a7e463e72d3f req-f96f7480-b0ee-4b77-b3c2-3b61468f0e35 service nova] Creating event network-changed:134f0809-a07c-4cc3-8067-54f430a3368d for instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b on n-h1-854823-1 Aug 27 04:36:37.568698 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c2e7bdd4-317c-4051-91fe-a7e463e72d3f req-f96f7480-b0ee-4b77-b3c2-3b61468f0e35 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292327 Aug 27 04:36:37.569316 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 689/1341] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:37.810064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a0fae72-fe20-4f0d-a882-83afd68077ef tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:37.812049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a0fae72-fe20-4f0d-a882-83afd68077ef tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:37.830527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a0fae72-fe20-4f0d-a882-83afd68077ef tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:37.831022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a0fae72-fe20-4f0d-a882-83afd68077ef tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:37.831456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a0fae72-fe20-4f0d-a882-83afd68077ef tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:37.832168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a0fae72-fe20-4f0d-a882-83afd68077ef tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:37.837163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a0fae72-fe20-4f0d-a882-83afd68077ef tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:37.837370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a0fae72-fe20-4f0d-a882-83afd68077ef tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:37.880774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28e02446-118b-44e1-bf49-1f80aedcc499 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:37.881251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-28e02446-118b-44e1-bf49-1f80aedcc499 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:37.910496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28e02446-118b-44e1-bf49-1f80aedcc499 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:37.914080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28e02446-118b-44e1-bf49-1f80aedcc499 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:37.915262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28e02446-118b-44e1-bf49-1f80aedcc499 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:37.916763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28e02446-118b-44e1-bf49-1f80aedcc499 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:37.919301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28e02446-118b-44e1-bf49-1f80aedcc499 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:37.920935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28e02446-118b-44e1-bf49-1f80aedcc499 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:38.324173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-28e02446-118b-44e1-bf49-1f80aedcc499 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:38.351198 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-28e02446-118b-44e1-bf49-1f80aedcc499 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.471903 Aug 27 04:36:38.353201 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 690/1342] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:37 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:38.365937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-584ec82e-7146-4704-bfdb-801287b63c59 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:38.375850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-584ec82e-7146-4704-bfdb-801287b63c59 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:38.394265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-584ec82e-7146-4704-bfdb-801287b63c59 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:38.395072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-584ec82e-7146-4704-bfdb-801287b63c59 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:38.395678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-584ec82e-7146-4704-bfdb-801287b63c59 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:38.396608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-584ec82e-7146-4704-bfdb-801287b63c59 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:38.397236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-584ec82e-7146-4704-bfdb-801287b63c59 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:38.397988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-584ec82e-7146-4704-bfdb-801287b63c59 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:38.410076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6a0fae72-fe20-4f0d-a882-83afd68077ef tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:38.439186 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a0fae72-fe20-4f0d-a882-83afd68077ef tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1471 microversion: 2.1 time: 0.623147 Aug 27 04:36:38.439885 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 653/1343] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:37 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1471 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:38.456996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1a2f5680-8184-4e45-a40b-35fd5541294a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:38.457637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1a2f5680-8184-4e45-a40b-35fd5541294a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:38.467669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a2f5680-8184-4e45-a40b-35fd5541294a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:38.468175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a2f5680-8184-4e45-a40b-35fd5541294a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:38.468814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a2f5680-8184-4e45-a40b-35fd5541294a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:38.470725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a2f5680-8184-4e45-a40b-35fd5541294a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:38.471256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a2f5680-8184-4e45-a40b-35fd5541294a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:38.471696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a2f5680-8184-4e45-a40b-35fd5541294a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:38.606028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-584ec82e-7146-4704-bfdb-801287b63c59 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:38.614644 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-584ec82e-7146-4704-bfdb-801287b63c59 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.259049 Aug 27 04:36:38.615695 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 691/1344] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:38 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:38.620923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b14f80c-3376-4621-8564-d85589d40457 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:38.621593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b14f80c-3376-4621-8564-d85589d40457 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:38.628704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b14f80c-3376-4621-8564-d85589d40457 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:38.629408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b14f80c-3376-4621-8564-d85589d40457 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:38.629847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b14f80c-3376-4621-8564-d85589d40457 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:38.630564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b14f80c-3376-4621-8564-d85589d40457 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:38.631020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b14f80c-3376-4621-8564-d85589d40457 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:38.631446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b14f80c-3376-4621-8564-d85589d40457 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:38.646533 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-5b14f80c-3376-4621-8564-d85589d40457 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] HTTP exception thrown: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b14f80c-3376-4621-8564-d85589d40457 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Request method failure captured: Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 HTTP/1.1 Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ5nKo8I1Xr9dGc_EatXmBAznbuzk-v1HeD7PJLBflnEZWOvYbZlNVTbGW58GTjp0Bggi52KJbJ58Af600jRuXImOhf_9Tg9v4ar6Q65MrRQCjN9a0R8tSmhiKKeo3e67IYihRBQIgSW96cF9Kf1Ge2OaVFi4x13ZHJsdciXyXWC0Q0 Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 21c5a62d0711490081fe3d1e1fa0a1fb Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-508786321 Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:36:38.648261 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:36:38.649912 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/21c5a62d0711490081fe3d1e1fa0a1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_21c5a62d0711490081fe3d1e1fa0a1fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/21c5a62d0711490081fe3d1e1fa0a1fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/21c5a62d0711490081fe3d1e1fa0a1fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:36:38.649912 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-508786321 Aug 27 04:36:38.649912 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 21c5a62d0711490081fe3d1e1fa0a1fb Aug 27 04:36:38.649912 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-508786321 Aug 27 04:36:38.649912 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachSCSIVolumeTestJSON-508786321-project Aug 27 04:36:38.649912 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:36:38.649912 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:36:38.649912 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 2523cdbb4f3444afb648340a73e85025 Aug 27 04:36:38.649912 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-508786321-project Aug 27 04:36:38.649912 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:36:38.649912 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:38.649912 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'a359715d-5ce1-4edd-8d94-3bba4d560d33'} Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:36:38.650799 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:38.652968 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:38.655705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b14f80c-3376-4621-8564-d85589d40457 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Returning 404 to user: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:36:38.657183 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b14f80c-3376-4621-8564-d85589d40457 tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 404 len: 111 microversion: 2.1 time: 0.039562 Aug 27 04:36:38.657761 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 692/1345] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:36:38 2022] DELETE /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:36:38.663037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da247cc3-f79f-4bdc-9289-f1e406723ca3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:38.663731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da247cc3-f79f-4bdc-9289-f1e406723ca3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:38.669809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da247cc3-f79f-4bdc-9289-f1e406723ca3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:38.670489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da247cc3-f79f-4bdc-9289-f1e406723ca3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:38.670993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da247cc3-f79f-4bdc-9289-f1e406723ca3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:38.671788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da247cc3-f79f-4bdc-9289-f1e406723ca3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:38.673049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da247cc3-f79f-4bdc-9289-f1e406723ca3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:38.673585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da247cc3-f79f-4bdc-9289-f1e406723ca3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:38.753754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1a2f5680-8184-4e45-a40b-35fd5541294a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:38.771913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:38.777785 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1a2f5680-8184-4e45-a40b-35fd5541294a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1541 microversion: 2.1 time: 0.331877 Aug 27 04:36:38.778385 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 654/1346] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:38 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1541 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:38.783764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bfe464ca-8cdb-4301-af74-5f1b6b82ff6d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:38.784385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bfe464ca-8cdb-4301-af74-5f1b6b82ff6d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] [instance: a359715d-5ce1-4edd-8d94-3bba4d560d33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:38.790912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe464ca-8cdb-4301-af74-5f1b6b82ff6d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:38.791395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe464ca-8cdb-4301-af74-5f1b6b82ff6d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:38.791827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe464ca-8cdb-4301-af74-5f1b6b82ff6d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:38.793143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe464ca-8cdb-4301-af74-5f1b6b82ff6d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:38.793723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe464ca-8cdb-4301-af74-5f1b6b82ff6d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:38.794240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe464ca-8cdb-4301-af74-5f1b6b82ff6d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:38.813561 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-bfe464ca-8cdb-4301-af74-5f1b6b82ff6d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] HTTP exception thrown: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bfe464ca-8cdb-4301-af74-5f1b6b82ff6d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Request method failure captured: Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 HTTP/1.1 Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ5nKo8I1Xr9dGc_EatXmBAznbuzk-v1HeD7PJLBflnEZWOvYbZlNVTbGW58GTjp0Bggi52KJbJ58Af600jRuXImOhf_9Tg9v4ar6Q65MrRQCjN9a0R8tSmhiKKeo3e67IYihRBQIgSW96cF9Kf1Ge2OaVFi4x13ZHJsdciXyXWC0Q0 Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 21c5a62d0711490081fe3d1e1fa0a1fb Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-508786321 Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:36:38.815076 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:36:38.816884 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/21c5a62d0711490081fe3d1e1fa0a1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_21c5a62d0711490081fe3d1e1fa0a1fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/21c5a62d0711490081fe3d1e1fa0a1fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/21c5a62d0711490081fe3d1e1fa0a1fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:36:38.816884 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-508786321 Aug 27 04:36:38.816884 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 21c5a62d0711490081fe3d1e1fa0a1fb Aug 27 04:36:38.816884 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-508786321 Aug 27 04:36:38.816884 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AttachSCSIVolumeTestJSON-508786321-project Aug 27 04:36:38.816884 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:36:38.816884 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:36:38.816884 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 2523cdbb4f3444afb648340a73e85025 Aug 27 04:36:38.816884 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-508786321-project Aug 27 04:36:38.816884 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:36:38.816884 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:38.816884 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'a359715d-5ce1-4edd-8d94-3bba4d560d33'} Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:36:38.817958 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. Aug 27 04:36:38.819452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:38.820927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bfe464ca-8cdb-4301-af74-5f1b6b82ff6d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] Returning 404 to user: Instance a359715d-5ce1-4edd-8d94-3bba4d560d33 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:36:38.827498 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bfe464ca-8cdb-4301-af74-5f1b6b82ff6d tempest-AttachSCSIVolumeTestJSON-508786321 tempest-AttachSCSIVolumeTestJSON-508786321-project] 10.222.0.79 "GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33" status: 404 len: 111 microversion: 2.1 time: 0.047970 Aug 27 04:36:38.828316 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 655/1347] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:38 2022] GET /compute/v2.1/servers/a359715d-5ce1-4edd-8d94-3bba4d560d33 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:36:38.837248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da247cc3-f79f-4bdc-9289-f1e406723ca3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:38.846705 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da247cc3-f79f-4bdc-9289-f1e406723ca3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1308 microversion: 2.1 time: 0.187588 Aug 27 04:36:38.847481 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 693/1348] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:38 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:39.378935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e358dbd-5b07-447a-a4c1-8e8ed6a7172b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:39.379658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e358dbd-5b07-447a-a4c1-8e8ed6a7172b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:39.387118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e358dbd-5b07-447a-a4c1-8e8ed6a7172b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:39.394419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e358dbd-5b07-447a-a4c1-8e8ed6a7172b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:39.394990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e358dbd-5b07-447a-a4c1-8e8ed6a7172b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:39.395811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e358dbd-5b07-447a-a4c1-8e8ed6a7172b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:39.396345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e358dbd-5b07-447a-a4c1-8e8ed6a7172b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:39.396903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e358dbd-5b07-447a-a4c1-8e8ed6a7172b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:39.444681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:39.460315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f9488eb7-4bf7-45d1-ab16-a920e30151a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:39.461096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f9488eb7-4bf7-45d1-ab16-a920e30151a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:39.463510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:39.464570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=20 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:39.471080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9488eb7-4bf7-45d1-ab16-a920e30151a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:39.471573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9488eb7-4bf7-45d1-ab16-a920e30151a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:39.472010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9488eb7-4bf7-45d1-ab16-a920e30151a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:39.472749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9488eb7-4bf7-45d1-ab16-a920e30151a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:39.473203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9488eb7-4bf7-45d1-ab16-a920e30151a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:39.473631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9488eb7-4bf7-45d1-ab16-a920e30151a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:39.611696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f9488eb7-4bf7-45d1-ab16-a920e30151a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:39.615241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9e358dbd-5b07-447a-a4c1-8e8ed6a7172b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:39.619876 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f9488eb7-4bf7-45d1-ab16-a920e30151a7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1471 microversion: 2.1 time: 0.163437 Aug 27 04:36:39.620893 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 694/1349] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:39 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:39.626053 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e358dbd-5b07-447a-a4c1-8e8ed6a7172b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.250295 Aug 27 04:36:39.626756 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 656/1350] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:39 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:39.644939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52094448-2f2a-4167-93ba-016061c8f950 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:39.645555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-52094448-2f2a-4167-93ba-016061c8f950 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:39.651705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52094448-2f2a-4167-93ba-016061c8f950 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:39.652499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52094448-2f2a-4167-93ba-016061c8f950 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:39.652964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52094448-2f2a-4167-93ba-016061c8f950 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:39.653671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52094448-2f2a-4167-93ba-016061c8f950 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:39.654131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52094448-2f2a-4167-93ba-016061c8f950 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:39.654587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52094448-2f2a-4167-93ba-016061c8f950 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:39.800247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5f792972-d646-41f1-83ac-2d7ce19ce916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:39.801096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5f792972-d646-41f1-83ac-2d7ce19ce916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:39.810033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f792972-d646-41f1-83ac-2d7ce19ce916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:39.810876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f792972-d646-41f1-83ac-2d7ce19ce916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:39.811417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f792972-d646-41f1-83ac-2d7ce19ce916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:39.813820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f792972-d646-41f1-83ac-2d7ce19ce916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:39.824311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f792972-d646-41f1-83ac-2d7ce19ce916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:39.825506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f792972-d646-41f1-83ac-2d7ce19ce916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:39.854011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52094448-2f2a-4167-93ba-016061c8f950 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:39.864773 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52094448-2f2a-4167-93ba-016061c8f950 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.226562 Aug 27 04:36:39.865723 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 695/1351] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:39 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:39.870598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c87879df-ac06-4086-884e-15c51f525eca tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:39.871289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c87879df-ac06-4086-884e-15c51f525eca tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:39.878662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c87879df-ac06-4086-884e-15c51f525eca tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:39.879205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c87879df-ac06-4086-884e-15c51f525eca tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:39.879646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c87879df-ac06-4086-884e-15c51f525eca tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:39.880391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c87879df-ac06-4086-884e-15c51f525eca tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:39.880886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c87879df-ac06-4086-884e-15c51f525eca tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:39.881303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c87879df-ac06-4086-884e-15c51f525eca tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:40.053544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c87879df-ac06-4086-884e-15c51f525eca tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:40.063425 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c87879df-ac06-4086-884e-15c51f525eca tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1308 microversion: 2.1 time: 0.196331 Aug 27 04:36:40.067629 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 696/1352] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:39 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:40.069284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5f792972-d646-41f1-83ac-2d7ce19ce916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:40.075155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-18a12284-5c93-4e5d-877e-e78d2ef4be28 req-15d27033-a624-4d28-a945-d46ce7386514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88460469-e163-4ebf-8076-73ddf76e72ad", "name": "network-vif-plugged", "status": "completed", "tag": "218b43e2-66f7-4ab7-bc63-d7caa2c9c4ef"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:40.080564 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5f792972-d646-41f1-83ac-2d7ce19ce916 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1541 microversion: 2.1 time: 0.283281 Aug 27 04:36:40.081558 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 657/1353] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:39 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1541 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:40.086589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-18a12284-5c93-4e5d-877e-e78d2ef4be28 req-15d27033-a624-4d28-a945-d46ce7386514 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:40.087274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-18a12284-5c93-4e5d-877e-e78d2ef4be28 req-15d27033-a624-4d28-a945-d46ce7386514 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:40.088039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-18a12284-5c93-4e5d-877e-e78d2ef4be28 req-15d27033-a624-4d28-a945-d46ce7386514 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:40.102403 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-18a12284-5c93-4e5d-877e-e78d2ef4be28 req-15d27033-a624-4d28-a945-d46ce7386514 service nova] Creating event network-vif-plugged:218b43e2-66f7-4ab7-bc63-d7caa2c9c4ef for instance 88460469-e163-4ebf-8076-73ddf76e72ad on n-h1-854823-1 Aug 27 04:36:40.108965 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-18a12284-5c93-4e5d-877e-e78d2ef4be28 req-15d27033-a624-4d28-a945-d46ce7386514 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039073 Aug 27 04:36:40.110908 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 697/1354] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:40.642364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-10d6a515-7abb-47af-84dc-506440a36dee tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:40.642989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-10d6a515-7abb-47af-84dc-506440a36dee tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:40.650190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10d6a515-7abb-47af-84dc-506440a36dee tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:40.650674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10d6a515-7abb-47af-84dc-506440a36dee tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:40.651116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22c34508-dee0-4b4b-8717-d07efe44ac07 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:40.651595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10d6a515-7abb-47af-84dc-506440a36dee tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:40.651821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10d6a515-7abb-47af-84dc-506440a36dee tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:40.652065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22c34508-dee0-4b4b-8717-d07efe44ac07 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:40.652285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10d6a515-7abb-47af-84dc-506440a36dee tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:40.652749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10d6a515-7abb-47af-84dc-506440a36dee tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:40.658924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22c34508-dee0-4b4b-8717-d07efe44ac07 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:40.659529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22c34508-dee0-4b4b-8717-d07efe44ac07 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:40.659981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22c34508-dee0-4b4b-8717-d07efe44ac07 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:40.660723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22c34508-dee0-4b4b-8717-d07efe44ac07 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:40.661383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22c34508-dee0-4b4b-8717-d07efe44ac07 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:40.661811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22c34508-dee0-4b4b-8717-d07efe44ac07 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:40.810158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22c34508-dee0-4b4b-8717-d07efe44ac07 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:40.818822 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22c34508-dee0-4b4b-8717-d07efe44ac07 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.173525 Aug 27 04:36:40.833544 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 698/1355] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:40 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:40.890972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca637a61-1c70-45fe-ad70-4854de57fab6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:40.891838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca637a61-1c70-45fe-ad70-4854de57fab6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:40.905871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca637a61-1c70-45fe-ad70-4854de57fab6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:40.906896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca637a61-1c70-45fe-ad70-4854de57fab6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:40.907372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca637a61-1c70-45fe-ad70-4854de57fab6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:40.916998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca637a61-1c70-45fe-ad70-4854de57fab6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:40.918618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca637a61-1c70-45fe-ad70-4854de57fab6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:40.919539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca637a61-1c70-45fe-ad70-4854de57fab6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:41.323311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca637a61-1c70-45fe-ad70-4854de57fab6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:41.334796 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca637a61-1c70-45fe-ad70-4854de57fab6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.449650 Aug 27 04:36:41.336612 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 699/1356] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:40 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:41.343491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49f150c2-9b9f-4bf3-9ae8-f6e2abc8ac67 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:41.345080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-49f150c2-9b9f-4bf3-9ae8-f6e2abc8ac67 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:41.354183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49f150c2-9b9f-4bf3-9ae8-f6e2abc8ac67 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:41.355142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49f150c2-9b9f-4bf3-9ae8-f6e2abc8ac67 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:41.356304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49f150c2-9b9f-4bf3-9ae8-f6e2abc8ac67 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:41.357634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49f150c2-9b9f-4bf3-9ae8-f6e2abc8ac67 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:41.358253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49f150c2-9b9f-4bf3-9ae8-f6e2abc8ac67 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:41.358837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49f150c2-9b9f-4bf3-9ae8-f6e2abc8ac67 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:41.475775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10d6a515-7abb-47af-84dc-506440a36dee tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:41.487560 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-10d6a515-7abb-47af-84dc-506440a36dee tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1471 microversion: 2.1 time: 0.849074 Aug 27 04:36:41.489889 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 658/1357] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:40 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1471 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:41.515372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-65e3fc21-d744-412c-88ef-dbf2e361aa66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:41.516719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-65e3fc21-d744-412c-88ef-dbf2e361aa66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:41.520896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49f150c2-9b9f-4bf3-9ae8-f6e2abc8ac67 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:41.523741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65e3fc21-d744-412c-88ef-dbf2e361aa66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:41.524461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65e3fc21-d744-412c-88ef-dbf2e361aa66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:41.524947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65e3fc21-d744-412c-88ef-dbf2e361aa66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:41.525827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65e3fc21-d744-412c-88ef-dbf2e361aa66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:41.526458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65e3fc21-d744-412c-88ef-dbf2e361aa66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:41.526890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65e3fc21-d744-412c-88ef-dbf2e361aa66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:41.531029 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49f150c2-9b9f-4bf3-9ae8-f6e2abc8ac67 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1308 microversion: 2.1 time: 0.193162 Aug 27 04:36:41.533158 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 700/1358] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:41 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1308 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:41.842518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f646c8c9-0e13-4ae5-8c43-12f9983c141a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:41.859394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f646c8c9-0e13-4ae5-8c43-12f9983c141a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:41.876076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f646c8c9-0e13-4ae5-8c43-12f9983c141a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:41.881254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f646c8c9-0e13-4ae5-8c43-12f9983c141a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:41.881915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f646c8c9-0e13-4ae5-8c43-12f9983c141a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:41.882840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f646c8c9-0e13-4ae5-8c43-12f9983c141a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:41.883489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f646c8c9-0e13-4ae5-8c43-12f9983c141a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:41.884229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f646c8c9-0e13-4ae5-8c43-12f9983c141a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:42.068836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f646c8c9-0e13-4ae5-8c43-12f9983c141a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:42.080125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-65e3fc21-d744-412c-88ef-dbf2e361aa66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:42.090498 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-65e3fc21-d744-412c-88ef-dbf2e361aa66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1541 microversion: 2.1 time: 0.598891 Aug 27 04:36:42.092057 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 659/1359] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:41 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1541 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:42.095580 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f646c8c9-0e13-4ae5-8c43-12f9983c141a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.253580 Aug 27 04:36:42.108160 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 701/1360] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:41 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:42.360280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-69ceb5be-fbf1-4c8b-8301-940e5e067048 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:42.360925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-69ceb5be-fbf1-4c8b-8301-940e5e067048 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:42.367045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69ceb5be-fbf1-4c8b-8301-940e5e067048 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:42.367555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69ceb5be-fbf1-4c8b-8301-940e5e067048 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:42.368012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69ceb5be-fbf1-4c8b-8301-940e5e067048 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:42.368770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69ceb5be-fbf1-4c8b-8301-940e5e067048 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:42.369233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69ceb5be-fbf1-4c8b-8301-940e5e067048 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:42.369667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69ceb5be-fbf1-4c8b-8301-940e5e067048 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:42.513096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba1e8acc-060e-4401-8ba9-0fd705247668 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:42.514237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba1e8acc-060e-4401-8ba9-0fd705247668 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:42.527263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1e8acc-060e-4401-8ba9-0fd705247668 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:42.528085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1e8acc-060e-4401-8ba9-0fd705247668 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:42.529252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1e8acc-060e-4401-8ba9-0fd705247668 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:42.530728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1e8acc-060e-4401-8ba9-0fd705247668 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:42.531875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1e8acc-060e-4401-8ba9-0fd705247668 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:42.532590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1e8acc-060e-4401-8ba9-0fd705247668 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:42.808066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-69ceb5be-fbf1-4c8b-8301-940e5e067048 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:42.827533 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-69ceb5be-fbf1-4c8b-8301-940e5e067048 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.471640 Aug 27 04:36:42.828244 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 660/1361] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:42 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:42.835037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e139713d-e453-4353-8ca9-ccb2c4348e97 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:42.836143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e139713d-e453-4353-8ca9-ccb2c4348e97 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:42.843742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e139713d-e453-4353-8ca9-ccb2c4348e97 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:42.844692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e139713d-e453-4353-8ca9-ccb2c4348e97 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:42.845209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e139713d-e453-4353-8ca9-ccb2c4348e97 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:42.846038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e139713d-e453-4353-8ca9-ccb2c4348e97 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:42.846616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e139713d-e453-4353-8ca9-ccb2c4348e97 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:42.847177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e139713d-e453-4353-8ca9-ccb2c4348e97 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:43.002452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba1e8acc-060e-4401-8ba9-0fd705247668 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:43.011279 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba1e8acc-060e-4401-8ba9-0fd705247668 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1471 microversion: 2.1 time: 0.503614 Aug 27 04:36:43.011966 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 702/1362] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:42 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1471 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:43.069161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e139713d-e453-4353-8ca9-ccb2c4348e97 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:43.078979 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e139713d-e453-4353-8ca9-ccb2c4348e97 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1308 microversion: 2.1 time: 0.248794 Aug 27 04:36:43.079811 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 661/1363] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:42 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1308 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:43.123958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b07093ae-640c-478e-9517-b7dbaacdefd1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:43.124501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-51f692c4-9390-44ed-aff0-5cf60be32039 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:43.126016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-51f692c4-9390-44ed-aff0-5cf60be32039 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:43.126658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b07093ae-640c-478e-9517-b7dbaacdefd1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:43.138622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b07093ae-640c-478e-9517-b7dbaacdefd1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:43.141895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b07093ae-640c-478e-9517-b7dbaacdefd1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:43.142560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b07093ae-640c-478e-9517-b7dbaacdefd1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:43.143882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51f692c4-9390-44ed-aff0-5cf60be32039 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:43.144918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b07093ae-640c-478e-9517-b7dbaacdefd1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:43.145543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b07093ae-640c-478e-9517-b7dbaacdefd1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:43.146204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51f692c4-9390-44ed-aff0-5cf60be32039 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:43.146798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b07093ae-640c-478e-9517-b7dbaacdefd1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:43.147397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51f692c4-9390-44ed-aff0-5cf60be32039 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:43.149613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51f692c4-9390-44ed-aff0-5cf60be32039 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:43.155933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51f692c4-9390-44ed-aff0-5cf60be32039 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:43.156728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51f692c4-9390-44ed-aff0-5cf60be32039 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:43.460975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b07093ae-640c-478e-9517-b7dbaacdefd1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:43.469676 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b07093ae-640c-478e-9517-b7dbaacdefd1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.352267 Aug 27 04:36:43.470544 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 662/1364] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:43 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:43.569057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-51f692c4-9390-44ed-aff0-5cf60be32039 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:43.577337 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-51f692c4-9390-44ed-aff0-5cf60be32039 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1541 microversion: 2.1 time: 0.467564 Aug 27 04:36:43.577925 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 703/1365] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:43 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1541 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:43.851603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-82c9c5e1-6895-42f0-af5d-c7e0c196a7b0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:43.853112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-82c9c5e1-6895-42f0-af5d-c7e0c196a7b0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:43.862191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82c9c5e1-6895-42f0-af5d-c7e0c196a7b0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:43.862833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82c9c5e1-6895-42f0-af5d-c7e0c196a7b0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:43.863458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82c9c5e1-6895-42f0-af5d-c7e0c196a7b0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:43.864415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82c9c5e1-6895-42f0-af5d-c7e0c196a7b0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:43.864910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82c9c5e1-6895-42f0-af5d-c7e0c196a7b0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:43.865337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82c9c5e1-6895-42f0-af5d-c7e0c196a7b0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:43.916916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-60c6e7ab-3749-4bd7-a950-09e90cdc721f req-fe14f4ea-d700-4198-a2db-635bb6243d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea1e00b-093a-4ed1-9640-a2a775d92433", "name": "network-vif-plugged", "status": "completed", "tag": "d062da01-c364-4876-b2fb-050be39ee311"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:43.930267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-60c6e7ab-3749-4bd7-a950-09e90cdc721f req-fe14f4ea-d700-4198-a2db-635bb6243d88 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:43.932209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-60c6e7ab-3749-4bd7-a950-09e90cdc721f req-fe14f4ea-d700-4198-a2db-635bb6243d88 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:43.932761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-60c6e7ab-3749-4bd7-a950-09e90cdc721f req-fe14f4ea-d700-4198-a2db-635bb6243d88 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:43.945189 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-60c6e7ab-3749-4bd7-a950-09e90cdc721f req-fe14f4ea-d700-4198-a2db-635bb6243d88 service nova] Creating event network-vif-plugged:d062da01-c364-4876-b2fb-050be39ee311 for instance 4ea1e00b-093a-4ed1-9640-a2a775d92433 on n-h1-854823-1 Aug 27 04:36:43.951116 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-60c6e7ab-3749-4bd7-a950-09e90cdc721f req-fe14f4ea-d700-4198-a2db-635bb6243d88 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038548 Aug 27 04:36:43.952285 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 704/1366] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:44.039451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-82c9c5e1-6895-42f0-af5d-c7e0c196a7b0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:44.046520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c82473b1-025c-438f-b601-92d0194682c6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:44.047865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c82473b1-025c-438f-b601-92d0194682c6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:44.054987 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-82c9c5e1-6895-42f0-af5d-c7e0c196a7b0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.207768 Aug 27 04:36:44.056336 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 663/1367] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:43 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:44.058150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c82473b1-025c-438f-b601-92d0194682c6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:44.058758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c82473b1-025c-438f-b601-92d0194682c6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:44.059689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c82473b1-025c-438f-b601-92d0194682c6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:44.061041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c82473b1-025c-438f-b601-92d0194682c6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:44.062304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c82473b1-025c-438f-b601-92d0194682c6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:44.063046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c82473b1-025c-438f-b601-92d0194682c6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:44.101503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bef3ed28-23f9-4e96-b673-5f03c7c635ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:44.102282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bef3ed28-23f9-4e96-b673-5f03c7c635ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:44.111333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bef3ed28-23f9-4e96-b673-5f03c7c635ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:44.112443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bef3ed28-23f9-4e96-b673-5f03c7c635ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:44.113139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bef3ed28-23f9-4e96-b673-5f03c7c635ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:44.114299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bef3ed28-23f9-4e96-b673-5f03c7c635ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:44.115181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bef3ed28-23f9-4e96-b673-5f03c7c635ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:44.115871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bef3ed28-23f9-4e96-b673-5f03c7c635ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:44.306393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bef3ed28-23f9-4e96-b673-5f03c7c635ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:44.314684 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bef3ed28-23f9-4e96-b673-5f03c7c635ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1488 microversion: 2.1 time: 0.217901 Aug 27 04:36:44.315265 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 664/1368] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:44 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1488 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:44.335594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6e97c651-88b2-4bed-a0f5-f607ec9b6ff9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:44.336134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6e97c651-88b2-4bed-a0f5-f607ec9b6ff9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:44.342389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e97c651-88b2-4bed-a0f5-f607ec9b6ff9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:44.342883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e97c651-88b2-4bed-a0f5-f607ec9b6ff9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:44.343320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e97c651-88b2-4bed-a0f5-f607ec9b6ff9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:44.344621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e97c651-88b2-4bed-a0f5-f607ec9b6ff9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:44.345086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e97c651-88b2-4bed-a0f5-f607ec9b6ff9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:44.345511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e97c651-88b2-4bed-a0f5-f607ec9b6ff9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:44.370533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c82473b1-025c-438f-b601-92d0194682c6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:44.370776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-6e97c651-88b2-4bed-a0f5-f607ec9b6ff9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lazy-loading 'flavor' on Instance uuid 88460469-e163-4ebf-8076-73ddf76e72ad {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:36:44.379369 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c82473b1-025c-438f-b601-92d0194682c6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1471 microversion: 2.1 time: 0.348837 Aug 27 04:36:44.380054 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 705/1369] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:44 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1471 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:44.478376 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6e97c651-88b2-4bed-a0f5-f607ec9b6ff9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "POST /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad/action" status: 202 len: 0 microversion: 2.1 time: 0.146341 Aug 27 04:36:44.482043 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 665/1370] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:36:44 2022] POST /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:36:44.487205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01cfa94f-6045-4f33-8d5c-5f48c59af18a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:44.487831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01cfa94f-6045-4f33-8d5c-5f48c59af18a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:44.490713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a152f1ec-b0ab-49ee-b713-f589e13e03e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:44.491428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a152f1ec-b0ab-49ee-b713-f589e13e03e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:44.494064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01cfa94f-6045-4f33-8d5c-5f48c59af18a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:44.494750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01cfa94f-6045-4f33-8d5c-5f48c59af18a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:44.495194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01cfa94f-6045-4f33-8d5c-5f48c59af18a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:44.495908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01cfa94f-6045-4f33-8d5c-5f48c59af18a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:44.496364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01cfa94f-6045-4f33-8d5c-5f48c59af18a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:44.496984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01cfa94f-6045-4f33-8d5c-5f48c59af18a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:44.498426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a152f1ec-b0ab-49ee-b713-f589e13e03e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:44.498914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a152f1ec-b0ab-49ee-b713-f589e13e03e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:44.499526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a152f1ec-b0ab-49ee-b713-f589e13e03e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:44.501201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a152f1ec-b0ab-49ee-b713-f589e13e03e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:44.502044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a152f1ec-b0ab-49ee-b713-f589e13e03e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:44.502171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a152f1ec-b0ab-49ee-b713-f589e13e03e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:44.523099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:44.640624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a152f1ec-b0ab-49ee-b713-f589e13e03e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:44.648327 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a152f1ec-b0ab-49ee-b713-f589e13e03e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.161748 Aug 27 04:36:44.648920 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 666/1371] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:44 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:44.653952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0b98587-b07f-4936-8490-1738fac4753e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:44.654562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c0b98587-b07f-4936-8490-1738fac4753e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:44.663082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0b98587-b07f-4936-8490-1738fac4753e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:44.663892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0b98587-b07f-4936-8490-1738fac4753e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:44.664513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0b98587-b07f-4936-8490-1738fac4753e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:44.665252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0b98587-b07f-4936-8490-1738fac4753e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:44.665711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0b98587-b07f-4936-8490-1738fac4753e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:44.666139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0b98587-b07f-4936-8490-1738fac4753e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:44.715877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01cfa94f-6045-4f33-8d5c-5f48c59af18a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:44.724179 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01cfa94f-6045-4f33-8d5c-5f48c59af18a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1496 microversion: 2.1 time: 0.240778 Aug 27 04:36:44.724787 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 706/1372] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:44 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1496 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:44.802055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c0b98587-b07f-4936-8490-1738fac4753e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:44.809938 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c0b98587-b07f-4936-8490-1738fac4753e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1541 microversion: 2.1 time: 0.160036 Aug 27 04:36:44.810515 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 667/1373] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:44 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1541 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:45.075298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1629aa47-8441-49fc-a11d-4c93834f8ead tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:45.075949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1629aa47-8441-49fc-a11d-4c93834f8ead tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:45.083613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1629aa47-8441-49fc-a11d-4c93834f8ead tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:45.084238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1629aa47-8441-49fc-a11d-4c93834f8ead tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:45.084706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1629aa47-8441-49fc-a11d-4c93834f8ead tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:45.085412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1629aa47-8441-49fc-a11d-4c93834f8ead tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:45.085868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1629aa47-8441-49fc-a11d-4c93834f8ead tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:45.086320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1629aa47-8441-49fc-a11d-4c93834f8ead tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:45.308497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1629aa47-8441-49fc-a11d-4c93834f8ead tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:45.319021 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1629aa47-8441-49fc-a11d-4c93834f8ead tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.247568 Aug 27 04:36:45.319929 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 707/1374] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:45 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:45.400760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-adb25caf-f3c6-42e1-a299-1d97edf82654 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:45.401496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-adb25caf-f3c6-42e1-a299-1d97edf82654 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:45.408836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adb25caf-f3c6-42e1-a299-1d97edf82654 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:45.409537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adb25caf-f3c6-42e1-a299-1d97edf82654 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:45.409984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adb25caf-f3c6-42e1-a299-1d97edf82654 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:45.410705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adb25caf-f3c6-42e1-a299-1d97edf82654 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:45.411169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adb25caf-f3c6-42e1-a299-1d97edf82654 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:45.411602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adb25caf-f3c6-42e1-a299-1d97edf82654 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:45.598961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-adb25caf-f3c6-42e1-a299-1d97edf82654 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:45.606731 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-adb25caf-f3c6-42e1-a299-1d97edf82654 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1471 microversion: 2.1 time: 0.209821 Aug 27 04:36:45.607302 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 668/1375] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:45 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1471 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:45.669938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f9acc2cc-3623-43e8-9f29-6fad2e0a2970 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:45.670568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f9acc2cc-3623-43e8-9f29-6fad2e0a2970 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:45.677347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9acc2cc-3623-43e8-9f29-6fad2e0a2970 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:45.677838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9acc2cc-3623-43e8-9f29-6fad2e0a2970 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:45.678274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9acc2cc-3623-43e8-9f29-6fad2e0a2970 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:45.679062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9acc2cc-3623-43e8-9f29-6fad2e0a2970 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:45.679423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9acc2cc-3623-43e8-9f29-6fad2e0a2970 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:45.679845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9acc2cc-3623-43e8-9f29-6fad2e0a2970 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:45.753558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-522f3f7c-f610-40ec-905d-1c872a64effb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:45.753961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-522f3f7c-f610-40ec-905d-1c872a64effb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:45.760256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-522f3f7c-f610-40ec-905d-1c872a64effb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:45.760800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-522f3f7c-f610-40ec-905d-1c872a64effb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:45.761551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-522f3f7c-f610-40ec-905d-1c872a64effb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:45.762263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-522f3f7c-f610-40ec-905d-1c872a64effb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:45.762718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-522f3f7c-f610-40ec-905d-1c872a64effb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:45.763312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-522f3f7c-f610-40ec-905d-1c872a64effb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:45.905695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f9acc2cc-3623-43e8-9f29-6fad2e0a2970 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:45.915571 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f9acc2cc-3623-43e8-9f29-6fad2e0a2970 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.249459 Aug 27 04:36:45.916175 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 708/1376] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:45 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:45.918200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-522f3f7c-f610-40ec-905d-1c872a64effb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:45.921587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c649239-e1d8-4a5e-964f-e8034e04ab64 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:45.923031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4c649239-e1d8-4a5e-964f-e8034e04ab64 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:45.931132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c649239-e1d8-4a5e-964f-e8034e04ab64 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:45.931981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c649239-e1d8-4a5e-964f-e8034e04ab64 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:45.932225 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-522f3f7c-f610-40ec-905d-1c872a64effb tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1496 microversion: 2.1 time: 0.183695 Aug 27 04:36:45.932419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c649239-e1d8-4a5e-964f-e8034e04ab64 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:45.933187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c649239-e1d8-4a5e-964f-e8034e04ab64 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:45.933698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c649239-e1d8-4a5e-964f-e8034e04ab64 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:45.934406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c649239-e1d8-4a5e-964f-e8034e04ab64 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:45.934580 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 669/1377] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:45 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1496 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:45.987409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-0628469b-fd80-4a10-83cb-6d8566c6e6ce req-f06483fc-6f67-4a28-97b1-ee2a87d33f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7984297a-0070-487d-83cb-a4e4d97aa5ba", "name": "network-vif-unplugged", "status": "completed", "tag": "9bf4e91c-b1ee-46b0-ab4c-5e3b87d4673b"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:45.996633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0628469b-fd80-4a10-83cb-6d8566c6e6ce req-f06483fc-6f67-4a28-97b1-ee2a87d33f2f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:45.997129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0628469b-fd80-4a10-83cb-6d8566c6e6ce req-f06483fc-6f67-4a28-97b1-ee2a87d33f2f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:45.997583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0628469b-fd80-4a10-83cb-6d8566c6e6ce req-f06483fc-6f67-4a28-97b1-ee2a87d33f2f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:46.013966 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-0628469b-fd80-4a10-83cb-6d8566c6e6ce req-f06483fc-6f67-4a28-97b1-ee2a87d33f2f service nova] Creating event network-vif-unplugged:9bf4e91c-b1ee-46b0-ab4c-5e3b87d4673b for instance 7984297a-0070-487d-83cb-a4e4d97aa5ba on n-h1-854823-1 Aug 27 04:36:46.016261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:46.020287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-0628469b-fd80-4a10-83cb-6d8566c6e6ce req-f06483fc-6f67-4a28-97b1-ee2a87d33f2f service nova] Instance 7984297a-0070-487d-83cb-a4e4d97aa5ba is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:36:46.029214 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-0628469b-fd80-4a10-83cb-6d8566c6e6ce req-f06483fc-6f67-4a28-97b1-ee2a87d33f2f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046838 Aug 27 04:36:46.030206 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 670/1378] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:36:46.240951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c649239-e1d8-4a5e-964f-e8034e04ab64 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:46.272149 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c649239-e1d8-4a5e-964f-e8034e04ab64 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1541 microversion: 2.1 time: 0.354889 Aug 27 04:36:46.284643 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 709/1379] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:45 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1541 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:46.343124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b44da6e3-265a-4f0d-9395-5cfba50ee0d5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:46.344386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b44da6e3-265a-4f0d-9395-5cfba50ee0d5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:46.354547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b44da6e3-265a-4f0d-9395-5cfba50ee0d5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:46.355233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b44da6e3-265a-4f0d-9395-5cfba50ee0d5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:46.355771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b44da6e3-265a-4f0d-9395-5cfba50ee0d5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:46.356766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b44da6e3-265a-4f0d-9395-5cfba50ee0d5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:46.357392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b44da6e3-265a-4f0d-9395-5cfba50ee0d5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:46.358058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b44da6e3-265a-4f0d-9395-5cfba50ee0d5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:46.681360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f707012-d126-4638-a7de-50f3ade4fd93 tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8408bdf8-855d-469c-88ff-8fab10d865f5"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:46.683799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f707012-d126-4638-a7de-50f3ade4fd93 tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:46.690682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f707012-d126-4638-a7de-50f3ade4fd93 tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:46.691180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f707012-d126-4638-a7de-50f3ade4fd93 tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:46.691742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f707012-d126-4638-a7de-50f3ade4fd93 tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:46.692452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f707012-d126-4638-a7de-50f3ade4fd93 tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:46.692934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f707012-d126-4638-a7de-50f3ade4fd93 tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:46.693359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f707012-d126-4638-a7de-50f3ade4fd93 tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:46.919696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b44da6e3-265a-4f0d-9395-5cfba50ee0d5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:46.928258 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b44da6e3-265a-4f0d-9395-5cfba50ee0d5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.590264 Aug 27 04:36:46.929016 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 671/1380] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:46 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:46.934114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eeea01eb-a249-41f5-9679-f4c510558f72 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:46.934889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eeea01eb-a249-41f5-9679-f4c510558f72 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:46.941817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eeea01eb-a249-41f5-9679-f4c510558f72 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:46.942576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eeea01eb-a249-41f5-9679-f4c510558f72 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:46.943122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eeea01eb-a249-41f5-9679-f4c510558f72 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:46.943947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eeea01eb-a249-41f5-9679-f4c510558f72 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:46.944518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eeea01eb-a249-41f5-9679-f4c510558f72 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:46.945100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eeea01eb-a249-41f5-9679-f4c510558f72 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:47.038882 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9f707012-d126-4638-a7de-50f3ade4fd93 tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] HTTP exception thrown: Volume 8408bdf8-855d-469c-88ff-8fab10d865f5 could not be found. Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f707012-d126-4638-a7de-50f3ade4fd93 tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Request method failure captured: Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: request: PUT /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments/da985ca6-f98a-4ff6-9ae4-e90b8be7d8b1 HTTP/1.1 Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 74 Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ7QwVao2Xs9VPzkeVIzRVt0U3JEj1bsT0ks7oUrWSTPOaT7kgWJuVUoiuYFykaYDpLUUxAlAAFnlfrtAq9TEkAwnfqh6xHt4LS2ImEJsrCdvAEd5Hzpf9yZJUERyhJDMut5wOxSHhmFh8BLY6Ru6znM8nZSV9x7xzxWscWKTaaRELs Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 95aaca20cfaf4ffd94b6c74b19923b12 Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesAdminNegativeTest-1457151031 Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:36:47.070708 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:36:47.072482 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/95aaca20cfaf4ffd94b6c74b19923b12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_95aaca20cfaf4ffd94b6c74b19923b12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/95aaca20cfaf4ffd94b6c74b19923b12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/95aaca20cfaf4ffd94b6c74b19923b12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:36:47.072482 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesAdminNegativeTest-1457151031 Aug 27 04:36:47.072482 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 95aaca20cfaf4ffd94b6c74b19923b12 Aug 27 04:36:47.072482 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1457151031 Aug 27 04:36:47.072482 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-VolumesAdminNegativeTest-1457151031-project-admin Aug 27 04:36:47.072482 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:36:47.072482 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:36:47.072482 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: fce48af2a1fc46a5a41d0dd299adec26 Aug 27 04:36:47.072482 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesAdminNegativeTest-1457151031-project-admin Aug 27 04:36:47.072482 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:36:47.072482 n-d-854823-1 devstack@n-api.service[128869]: {"volumeAttachment": {"volumeId": "8408bdf8-855d-469c-88ff-8fab10d865f5"}} Aug 27 04:36:47.072482 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:36:47.072482 n-d-854823-1 devstack@n-api.service[128869]: exception: Volume 8408bdf8-855d-469c-88ff-8fab10d865f5 could not be found. Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'server_id': '3ce113bc-c89f-4752-817e-f3addff689b2', 'id': 'da985ca6-f98a-4ff6-9ae4-e90b8be7d8b1', 'body': {'volumeAttachment': {'volumeId': '8408bdf8-855d-469c-88ff-8fab10d865f5'}}} Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:36:47.073718 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8408bdf8-855d-469c-88ff-8fab10d865f5 could not be found. (HTTP 404) (Request-ID: req-dd73c999-8cf2-49b3-b948-e51f29d9860b) Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 04:36:47.074904 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8408bdf8-855d-469c-88ff-8fab10d865f5 could not be found. Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:36:47.076165 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 8408bdf8-855d-469c-88ff-8fab10d865f5 could not be found. Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8408bdf8-855d-469c-88ff-8fab10d865f5 could not be found. Aug 27 04:36:47.077516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:47.079583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f707012-d126-4638-a7de-50f3ade4fd93 tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Returning 400 to user: Volume 8408bdf8-855d-469c-88ff-8fab10d865f5 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:36:47.079583 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f707012-d126-4638-a7de-50f3ade4fd93 tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] 10.222.0.79 "PUT /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments/da985ca6-f98a-4ff6-9ae4-e90b8be7d8b1" status: 400 len: 107 microversion: 2.1 time: 0.532263 Aug 27 04:36:47.079583 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 710/1381] 10.222.0.79 () {60 vars in 1433 bytes} [Sat Aug 27 04:36:46 2022] PUT /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments/da985ca6-f98a-4ff6-9ae4-e90b8be7d8b1 => generated 107 bytes in 534 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:36:47.080780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90e42cb1-d362-440c-abdd-b83e7c0d7688 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:47.081230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90e42cb1-d362-440c-abdd-b83e7c0d7688 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:47.092998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90e42cb1-d362-440c-abdd-b83e7c0d7688 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:47.094351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90e42cb1-d362-440c-abdd-b83e7c0d7688 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:47.094351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90e42cb1-d362-440c-abdd-b83e7c0d7688 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:47.095135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90e42cb1-d362-440c-abdd-b83e7c0d7688 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:47.095449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90e42cb1-d362-440c-abdd-b83e7c0d7688 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:47.095924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90e42cb1-d362-440c-abdd-b83e7c0d7688 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:47.164820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eeea01eb-a249-41f5-9679-f4c510558f72 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:47.184880 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eeea01eb-a249-41f5-9679-f4c510558f72 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1477 microversion: 2.1 time: 0.247205 Aug 27 04:36:47.184880 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 672/1382] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:46 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1477 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:47.184880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e510edb-f093-4b4e-9277-adc4679c07aa tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:47.194144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e510edb-f093-4b4e-9277-adc4679c07aa tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:47.204244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e510edb-f093-4b4e-9277-adc4679c07aa tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:47.204921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e510edb-f093-4b4e-9277-adc4679c07aa tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:47.205625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e510edb-f093-4b4e-9277-adc4679c07aa tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:47.206515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e510edb-f093-4b4e-9277-adc4679c07aa tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:47.208100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e510edb-f093-4b4e-9277-adc4679c07aa tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:47.209577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e510edb-f093-4b4e-9277-adc4679c07aa tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:47.304094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-90e42cb1-d362-440c-abdd-b83e7c0d7688 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:47.312608 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90e42cb1-d362-440c-abdd-b83e7c0d7688 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.238595 Aug 27 04:36:47.313634 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 711/1383] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:47 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:47.322843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e5603eae-7288-4a97-9c5b-ceff071c6cda tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:47.324776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e5603eae-7288-4a97-9c5b-ceff071c6cda tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:47.339531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5603eae-7288-4a97-9c5b-ceff071c6cda tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:47.340043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5603eae-7288-4a97-9c5b-ceff071c6cda tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:47.340517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5603eae-7288-4a97-9c5b-ceff071c6cda tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:47.341275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5603eae-7288-4a97-9c5b-ceff071c6cda tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:47.341881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5603eae-7288-4a97-9c5b-ceff071c6cda tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:47.342329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5603eae-7288-4a97-9c5b-ceff071c6cda tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:47.488691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-e5603eae-7288-4a97-9c5b-ceff071c6cda tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lazy-loading 'services' on Instance uuid 3ce113bc-c89f-4752-817e-f3addff689b2 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:36:47.535685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9e510edb-f093-4b4e-9277-adc4679c07aa tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:47.547574 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e510edb-f093-4b4e-9277-adc4679c07aa tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1496 microversion: 2.1 time: 0.367750 Aug 27 04:36:47.548381 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 673/1384] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:47 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1496 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:47.553936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7944491c-109c-4c2e-9cd4-ee94e7734389 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:47.555497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7944491c-109c-4c2e-9cd4-ee94e7734389 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:47.566564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7944491c-109c-4c2e-9cd4-ee94e7734389 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:47.567355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7944491c-109c-4c2e-9cd4-ee94e7734389 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:47.568058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7944491c-109c-4c2e-9cd4-ee94e7734389 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:47.569058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7944491c-109c-4c2e-9cd4-ee94e7734389 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:47.570784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7944491c-109c-4c2e-9cd4-ee94e7734389 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:47.572254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7944491c-109c-4c2e-9cd4-ee94e7734389 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:47.631403 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e5603eae-7288-4a97-9c5b-ceff071c6cda tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments/da985ca6-f98a-4ff6-9ae4-e90b8be7d8b1" status: 202 len: 0 microversion: 2.1 time: 0.316359 Aug 27 04:36:47.633207 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 712/1385] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 04:36:47 2022] DELETE /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments/da985ca6-f98a-4ff6-9ae4-e90b8be7d8b1 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:36:47.647960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd25c280-bc4e-44e8-8df0-39fd28c305c3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:47.650841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd25c280-bc4e-44e8-8df0-39fd28c305c3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:47.658750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd25c280-bc4e-44e8-8df0-39fd28c305c3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:47.659248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd25c280-bc4e-44e8-8df0-39fd28c305c3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:47.659688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd25c280-bc4e-44e8-8df0-39fd28c305c3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:47.660403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd25c280-bc4e-44e8-8df0-39fd28c305c3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:47.660927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd25c280-bc4e-44e8-8df0-39fd28c305c3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:47.661359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd25c280-bc4e-44e8-8df0-39fd28c305c3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:47.695280 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd25c280-bc4e-44e8-8df0-39fd28c305c3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056924 Aug 27 04:36:47.696280 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 713/1386] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:36:47 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:36:47.737663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7944491c-109c-4c2e-9cd4-ee94e7734389 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:47.745982 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7944491c-109c-4c2e-9cd4-ee94e7734389 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1473 microversion: 2.1 time: 0.195786 Aug 27 04:36:47.746684 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 674/1387] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:47 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1473 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:47.952223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd076fd4-fbda-478f-a586-1361307f1696 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:47.953025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd076fd4-fbda-478f-a586-1361307f1696 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:47.959769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd076fd4-fbda-478f-a586-1361307f1696 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:47.960221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd076fd4-fbda-478f-a586-1361307f1696 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:47.961258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd076fd4-fbda-478f-a586-1361307f1696 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:47.961992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd076fd4-fbda-478f-a586-1361307f1696 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:47.962574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd076fd4-fbda-478f-a586-1361307f1696 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:47.963051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd076fd4-fbda-478f-a586-1361307f1696 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:48.203936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2610f7e2-54d6-4cae-8113-c5c1b89d3dff tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:48.204583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2610f7e2-54d6-4cae-8113-c5c1b89d3dff tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:48.211294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd076fd4-fbda-478f-a586-1361307f1696 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:48.215628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2610f7e2-54d6-4cae-8113-c5c1b89d3dff tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:48.215949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2610f7e2-54d6-4cae-8113-c5c1b89d3dff tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:48.216772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2610f7e2-54d6-4cae-8113-c5c1b89d3dff tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:48.218431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2610f7e2-54d6-4cae-8113-c5c1b89d3dff tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:48.221108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2610f7e2-54d6-4cae-8113-c5c1b89d3dff tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:48.221551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2610f7e2-54d6-4cae-8113-c5c1b89d3dff tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:48.236772 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd076fd4-fbda-478f-a586-1361307f1696 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.287256 Aug 27 04:36:48.237617 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 714/1388] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:47 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:48.264637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-31854124-fb88-4bc3-8e2f-9f71edb748f4 req-a14a6867-174c-463a-adc3-33dfc46568cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6aa77e-f369-461e-9cf6-d9bd0dad016b", "name": "network-vif-plugged", "status": "completed", "tag": "134f0809-a07c-4cc3-8067-54f430a3368d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:48.279575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-31854124-fb88-4bc3-8e2f-9f71edb748f4 req-a14a6867-174c-463a-adc3-33dfc46568cb service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:48.280163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-31854124-fb88-4bc3-8e2f-9f71edb748f4 req-a14a6867-174c-463a-adc3-33dfc46568cb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:48.280690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-31854124-fb88-4bc3-8e2f-9f71edb748f4 req-a14a6867-174c-463a-adc3-33dfc46568cb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:48.309995 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-31854124-fb88-4bc3-8e2f-9f71edb748f4 req-a14a6867-174c-463a-adc3-33dfc46568cb service nova] Creating event network-vif-plugged:134f0809-a07c-4cc3-8067-54f430a3368d for instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b on n-h1-854823-1 Aug 27 04:36:48.316172 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-31854124-fb88-4bc3-8e2f-9f71edb748f4 req-a14a6867-174c-463a-adc3-33dfc46568cb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065951 Aug 27 04:36:48.317922 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 715/1389] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:48.336113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d377b604-47b9-4c80-95d3-11228e4ec015 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:48.337694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d377b604-47b9-4c80-95d3-11228e4ec015 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:48.350071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d377b604-47b9-4c80-95d3-11228e4ec015 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:48.350887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d377b604-47b9-4c80-95d3-11228e4ec015 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:48.351567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d377b604-47b9-4c80-95d3-11228e4ec015 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:48.352545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d377b604-47b9-4c80-95d3-11228e4ec015 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:48.353258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d377b604-47b9-4c80-95d3-11228e4ec015 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:48.353927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d377b604-47b9-4c80-95d3-11228e4ec015 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:48.421501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2610f7e2-54d6-4cae-8113-c5c1b89d3dff tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:48.430373 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2610f7e2-54d6-4cae-8113-c5c1b89d3dff tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1477 microversion: 2.1 time: 0.231809 Aug 27 04:36:48.430882 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 675/1390] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:48 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1477 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:48.568979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7e0d7f90-77e0-41e7-83e2-20687f8c9a96 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:48.569596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7e0d7f90-77e0-41e7-83e2-20687f8c9a96 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:48.575906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e0d7f90-77e0-41e7-83e2-20687f8c9a96 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:48.576396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e0d7f90-77e0-41e7-83e2-20687f8c9a96 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:48.576859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e0d7f90-77e0-41e7-83e2-20687f8c9a96 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:48.577565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e0d7f90-77e0-41e7-83e2-20687f8c9a96 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:48.578031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e0d7f90-77e0-41e7-83e2-20687f8c9a96 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:48.579110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e0d7f90-77e0-41e7-83e2-20687f8c9a96 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:48.726824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7e0d7f90-77e0-41e7-83e2-20687f8c9a96 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:48.736202 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7e0d7f90-77e0-41e7-83e2-20687f8c9a96 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1496 microversion: 2.1 time: 0.171018 Aug 27 04:36:48.737250 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 676/1391] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:48 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1496 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:48.742869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ebe016ac-33ba-4342-8844-5377dfb030f0 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:48.746488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ebe016ac-33ba-4342-8844-5377dfb030f0 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:48.756449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebe016ac-33ba-4342-8844-5377dfb030f0 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:48.757111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebe016ac-33ba-4342-8844-5377dfb030f0 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:48.757651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebe016ac-33ba-4342-8844-5377dfb030f0 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:48.758463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebe016ac-33ba-4342-8844-5377dfb030f0 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:48.759171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebe016ac-33ba-4342-8844-5377dfb030f0 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:48.759699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebe016ac-33ba-4342-8844-5377dfb030f0 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:48.795448 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ebe016ac-33ba-4342-8844-5377dfb030f0 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056892 Aug 27 04:36:48.796403 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 677/1392] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:36:48 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:48.802529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f8682808-baf2-4c63-bb3b-918cd6cf840b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:48.803595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f8682808-baf2-4c63-bb3b-918cd6cf840b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:48.811077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8682808-baf2-4c63-bb3b-918cd6cf840b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:48.812384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8682808-baf2-4c63-bb3b-918cd6cf840b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:48.813715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8682808-baf2-4c63-bb3b-918cd6cf840b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:48.815323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8682808-baf2-4c63-bb3b-918cd6cf840b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:48.815956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8682808-baf2-4c63-bb3b-918cd6cf840b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:48.816571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8682808-baf2-4c63-bb3b-918cd6cf840b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:48.906992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d377b604-47b9-4c80-95d3-11228e4ec015 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:48.916150 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d377b604-47b9-4c80-95d3-11228e4ec015 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.586007 Aug 27 04:36:48.916785 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 716/1393] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:48 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:49.043373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f8682808-baf2-4c63-bb3b-918cd6cf840b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:49.055100 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f8682808-baf2-4c63-bb3b-918cd6cf840b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1473 microversion: 2.1 time: 0.257283 Aug 27 04:36:49.056651 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 678/1394] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:48 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1473 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:49.259290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8dbe0bb2-9c12-48df-932d-867c0f71bfa9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:49.260135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8dbe0bb2-9c12-48df-932d-867c0f71bfa9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:49.267670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dbe0bb2-9c12-48df-932d-867c0f71bfa9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:49.268271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dbe0bb2-9c12-48df-932d-867c0f71bfa9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:49.268836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dbe0bb2-9c12-48df-932d-867c0f71bfa9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:49.269700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dbe0bb2-9c12-48df-932d-867c0f71bfa9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:49.270183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dbe0bb2-9c12-48df-932d-867c0f71bfa9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:49.270680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dbe0bb2-9c12-48df-932d-867c0f71bfa9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:49.427100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8dbe0bb2-9c12-48df-932d-867c0f71bfa9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:49.434737 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8dbe0bb2-9c12-48df-932d-867c0f71bfa9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.179325 Aug 27 04:36:49.449585 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 717/1395] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:49 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:49.452407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae0bff16-96b0-4a31-a900-7b2f0402f5d8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:49.453671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ae0bff16-96b0-4a31-a900-7b2f0402f5d8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:49.462723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0bff16-96b0-4a31-a900-7b2f0402f5d8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:49.463482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0bff16-96b0-4a31-a900-7b2f0402f5d8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:49.464287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0bff16-96b0-4a31-a900-7b2f0402f5d8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:49.465735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0bff16-96b0-4a31-a900-7b2f0402f5d8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:49.466359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0bff16-96b0-4a31-a900-7b2f0402f5d8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:49.466970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0bff16-96b0-4a31-a900-7b2f0402f5d8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:49.618274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ae0bff16-96b0-4a31-a900-7b2f0402f5d8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:49.626413 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ae0bff16-96b0-4a31-a900-7b2f0402f5d8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1477 microversion: 2.1 time: 0.178236 Aug 27 04:36:49.626996 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 679/1396] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:49 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1477 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:49.759274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2340373b-05e2-4f46-9275-13bcd5272e7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:49.760024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2340373b-05e2-4f46-9275-13bcd5272e7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:49.766611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2340373b-05e2-4f46-9275-13bcd5272e7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:49.767190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2340373b-05e2-4f46-9275-13bcd5272e7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:49.767629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2340373b-05e2-4f46-9275-13bcd5272e7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:49.768330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2340373b-05e2-4f46-9275-13bcd5272e7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:49.768819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2340373b-05e2-4f46-9275-13bcd5272e7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:49.769242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2340373b-05e2-4f46-9275-13bcd5272e7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:49.807403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0e01b1be-24e4-405a-94be-1309987b9468 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:49.810032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0e01b1be-24e4-405a-94be-1309987b9468 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:49.816576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e01b1be-24e4-405a-94be-1309987b9468 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:49.817020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e01b1be-24e4-405a-94be-1309987b9468 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:49.817458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e01b1be-24e4-405a-94be-1309987b9468 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:49.818331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e01b1be-24e4-405a-94be-1309987b9468 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:49.818795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e01b1be-24e4-405a-94be-1309987b9468 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:49.819227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e01b1be-24e4-405a-94be-1309987b9468 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:49.867482 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0e01b1be-24e4-405a-94be-1309987b9468 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063636 Aug 27 04:36:49.868658 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 680/1397] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:36:49 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:36:49.939419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2340373b-05e2-4f46-9275-13bcd5272e7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:49.942534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3bc6bedb-325c-42eb-8bd2-7765a2c380cc tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:49.943305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3bc6bedb-325c-42eb-8bd2-7765a2c380cc tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:49.954793 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2340373b-05e2-4f46-9275-13bcd5272e7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1496 microversion: 2.1 time: 0.199151 Aug 27 04:36:49.955897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3bc6bedb-325c-42eb-8bd2-7765a2c380cc tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:49.956466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3bc6bedb-325c-42eb-8bd2-7765a2c380cc tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:49.957010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3bc6bedb-325c-42eb-8bd2-7765a2c380cc tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:49.957809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3bc6bedb-325c-42eb-8bd2-7765a2c380cc tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:49.959807 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 718/1398] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:49 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1496 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:49.966856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3bc6bedb-325c-42eb-8bd2-7765a2c380cc tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:49.967585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3bc6bedb-325c-42eb-8bd2-7765a2c380cc tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:50.079053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c544994-949f-494c-b6f1-cfed6615c384 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:50.079673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c544994-949f-494c-b6f1-cfed6615c384 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:50.085920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c544994-949f-494c-b6f1-cfed6615c384 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:50.086941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c544994-949f-494c-b6f1-cfed6615c384 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:50.087720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c544994-949f-494c-b6f1-cfed6615c384 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:50.088643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c544994-949f-494c-b6f1-cfed6615c384 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:50.089392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c544994-949f-494c-b6f1-cfed6615c384 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:50.090104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c544994-949f-494c-b6f1-cfed6615c384 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:50.182121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3bc6bedb-325c-42eb-8bd2-7765a2c380cc tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:50.192012 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3bc6bedb-325c-42eb-8bd2-7765a2c380cc tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.254283 Aug 27 04:36:50.205682 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 681/1399] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:49 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:50.230744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c544994-949f-494c-b6f1-cfed6615c384 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:50.239609 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c544994-949f-494c-b6f1-cfed6615c384 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1473 microversion: 2.1 time: 0.165361 Aug 27 04:36:50.240179 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 719/1400] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:50 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:50.341565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-911d7be0-e90f-42ac-93c0-3235e81df636 req-ff7cc7f0-4e42-474a-9901-25514a8d9c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577250c7-f1ee-4541-b83e-131d0e21efea", "name": "network-vif-unplugged", "status": "completed", "tag": "d4d0324a-726b-4962-b7dd-c7fd914520fe"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:50.351320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-911d7be0-e90f-42ac-93c0-3235e81df636 req-ff7cc7f0-4e42-474a-9901-25514a8d9c64 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:50.351803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-911d7be0-e90f-42ac-93c0-3235e81df636 req-ff7cc7f0-4e42-474a-9901-25514a8d9c64 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:50.352233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-911d7be0-e90f-42ac-93c0-3235e81df636 req-ff7cc7f0-4e42-474a-9901-25514a8d9c64 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:50.364471 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-911d7be0-e90f-42ac-93c0-3235e81df636 req-ff7cc7f0-4e42-474a-9901-25514a8d9c64 service nova] Creating event network-vif-unplugged:d4d0324a-726b-4962-b7dd-c7fd914520fe for instance 577250c7-f1ee-4541-b83e-131d0e21efea on n-h2-854823-1 Aug 27 04:36:50.369783 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-911d7be0-e90f-42ac-93c0-3235e81df636 req-ff7cc7f0-4e42-474a-9901-25514a8d9c64 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031863 Aug 27 04:36:50.370789 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 682/1401] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:50.457408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-934137df-7ca6-4419-9e80-63df88726a33 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:50.458643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-934137df-7ca6-4419-9e80-63df88726a33 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:50.465544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-934137df-7ca6-4419-9e80-63df88726a33 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:50.466041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-934137df-7ca6-4419-9e80-63df88726a33 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:50.466484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-934137df-7ca6-4419-9e80-63df88726a33 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:50.467189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-934137df-7ca6-4419-9e80-63df88726a33 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:50.467652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-934137df-7ca6-4419-9e80-63df88726a33 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:50.468078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-934137df-7ca6-4419-9e80-63df88726a33 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:50.638895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-934137df-7ca6-4419-9e80-63df88726a33 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:50.650171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eee0e128-a2b4-42fc-a7a6-fed83596227c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:50.652900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eee0e128-a2b4-42fc-a7a6-fed83596227c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:50.661827 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-934137df-7ca6-4419-9e80-63df88726a33 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1311 microversion: 2.1 time: 0.208700 Aug 27 04:36:50.665994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eee0e128-a2b4-42fc-a7a6-fed83596227c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:50.667462 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 720/1402] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:50 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1311 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:50.668347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eee0e128-a2b4-42fc-a7a6-fed83596227c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:50.669066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eee0e128-a2b4-42fc-a7a6-fed83596227c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:50.670415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eee0e128-a2b4-42fc-a7a6-fed83596227c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:50.671103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eee0e128-a2b4-42fc-a7a6-fed83596227c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:50.671805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eee0e128-a2b4-42fc-a7a6-fed83596227c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:50.883815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eee0e128-a2b4-42fc-a7a6-fed83596227c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:50.888115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e5cd2d0-b0bb-47da-a341-331391367bb7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:50.898731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e5cd2d0-b0bb-47da-a341-331391367bb7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:50.906161 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eee0e128-a2b4-42fc-a7a6-fed83596227c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1477 microversion: 2.1 time: 0.261789 Aug 27 04:36:50.907743 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 683/1403] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:50 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1477 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:50.910768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5cd2d0-b0bb-47da-a341-331391367bb7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:50.911246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5cd2d0-b0bb-47da-a341-331391367bb7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:50.911842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5cd2d0-b0bb-47da-a341-331391367bb7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:50.913195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5cd2d0-b0bb-47da-a341-331391367bb7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:50.913858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5cd2d0-b0bb-47da-a341-331391367bb7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:50.914452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5cd2d0-b0bb-47da-a341-331391367bb7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:50.975824 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e5cd2d0-b0bb-47da-a341-331391367bb7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098678 Aug 27 04:36:50.977808 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 721/1404] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:36:50 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:50.980881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a81393bf-884c-4e18-9f7f-873205455564 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:50.981735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a81393bf-884c-4e18-9f7f-873205455564 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:50.990731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a81393bf-884c-4e18-9f7f-873205455564 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:50.991238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a81393bf-884c-4e18-9f7f-873205455564 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:50.991681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a81393bf-884c-4e18-9f7f-873205455564 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:50.992394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a81393bf-884c-4e18-9f7f-873205455564 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:50.992933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a81393bf-884c-4e18-9f7f-873205455564 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:50.993360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a81393bf-884c-4e18-9f7f-873205455564 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:51.141282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a81393bf-884c-4e18-9f7f-873205455564 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:51.151782 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a81393bf-884c-4e18-9f7f-873205455564 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 200 len: 1479 microversion: 2.1 time: 0.175117 Aug 27 04:36:51.167920 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 684/1405] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:50 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 1479 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:51.177995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f240847e-5826-48a8-803d-3db0708d1d1a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-977516535"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:51.182516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f240847e-5826-48a8-803d-3db0708d1d1a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:51.189677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:51.192281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f240847e-5826-48a8-803d-3db0708d1d1a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:51.200586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f240847e-5826-48a8-803d-3db0708d1d1a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:51.202429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f240847e-5826-48a8-803d-3db0708d1d1a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:51.213377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2fc144ad-af8e-4e67-bb3f-314509fd91d3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:51.215552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2fc144ad-af8e-4e67-bb3f-314509fd91d3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:51.223022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f240847e-5826-48a8-803d-3db0708d1d1a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:51.224185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f240847e-5826-48a8-803d-3db0708d1d1a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:51.224862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f240847e-5826-48a8-803d-3db0708d1d1a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:51.231545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fc144ad-af8e-4e67-bb3f-314509fd91d3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:51.233118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fc144ad-af8e-4e67-bb3f-314509fd91d3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:51.235052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fc144ad-af8e-4e67-bb3f-314509fd91d3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:51.237632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fc144ad-af8e-4e67-bb3f-314509fd91d3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:51.238127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fc144ad-af8e-4e67-bb3f-314509fd91d3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:51.242081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fc144ad-af8e-4e67-bb3f-314509fd91d3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:51.494623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2fc144ad-af8e-4e67-bb3f-314509fd91d3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:51.498702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:51.504363 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2fc144ad-af8e-4e67-bb3f-314509fd91d3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.294758 Aug 27 04:36:51.505016 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 685/1406] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:51 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:51.524267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0080cbdc-1e8e-4529-afeb-8f9cbb54ab3b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:51.524924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0080cbdc-1e8e-4529-afeb-8f9cbb54ab3b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:51.531607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0080cbdc-1e8e-4529-afeb-8f9cbb54ab3b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:51.532522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0080cbdc-1e8e-4529-afeb-8f9cbb54ab3b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:51.533255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0080cbdc-1e8e-4529-afeb-8f9cbb54ab3b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:51.534300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0080cbdc-1e8e-4529-afeb-8f9cbb54ab3b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:51.534991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0080cbdc-1e8e-4529-afeb-8f9cbb54ab3b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:51.535448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0080cbdc-1e8e-4529-afeb-8f9cbb54ab3b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:51.575410 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f240847e-5826-48a8-803d-3db0708d1d1a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "POST /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad/action" status: 202 len: 0 microversion: 2.1 time: 0.405212 Aug 27 04:36:51.576434 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 722/1407] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:36:51 2022] POST /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:36:51.589523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-08b4f38a-1282-4adf-af83-6832fbf5462e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f2199fe50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:51.658060 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-08b4f38a-1282-4adf-af83-6832fbf5462e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.073680 Aug 27 04:36:51.659411 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 723/1408] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:51 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:51.686339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-00fa8f74-93a8-4aae-b9aa-d9116f9efc7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:51.688024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-00fa8f74-93a8-4aae-b9aa-d9116f9efc7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:51.694940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00fa8f74-93a8-4aae-b9aa-d9116f9efc7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:51.713816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00fa8f74-93a8-4aae-b9aa-d9116f9efc7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:51.715733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00fa8f74-93a8-4aae-b9aa-d9116f9efc7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:51.718519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00fa8f74-93a8-4aae-b9aa-d9116f9efc7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:51.720453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00fa8f74-93a8-4aae-b9aa-d9116f9efc7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:51.720939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00fa8f74-93a8-4aae-b9aa-d9116f9efc7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:51.975974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-00fa8f74-93a8-4aae-b9aa-d9116f9efc7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:51.988202 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-00fa8f74-93a8-4aae-b9aa-d9116f9efc7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1494 microversion: 2.1 time: 0.305539 Aug 27 04:36:52.004767 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 724/1409] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:51 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1494 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:52.015636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a41dfa2-6fba-4aa8-8743-cae6b85b4a66 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:52.016283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a41dfa2-6fba-4aa8-8743-cae6b85b4a66 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:52.028778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a41dfa2-6fba-4aa8-8743-cae6b85b4a66 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.029894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a41dfa2-6fba-4aa8-8743-cae6b85b4a66 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.030334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a41dfa2-6fba-4aa8-8743-cae6b85b4a66 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.032306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a41dfa2-6fba-4aa8-8743-cae6b85b4a66 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.033084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0080cbdc-1e8e-4529-afeb-8f9cbb54ab3b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:52.034511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a41dfa2-6fba-4aa8-8743-cae6b85b4a66 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.035406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a41dfa2-6fba-4aa8-8743-cae6b85b4a66 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.046142 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0080cbdc-1e8e-4529-afeb-8f9cbb54ab3b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1470 microversion: 2.1 time: 0.525271 Aug 27 04:36:52.048459 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 686/1410] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:51 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1470 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:52.068427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7257156e-25ce-445b-99ed-7087c630e2a8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:52.075129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7257156e-25ce-445b-99ed-7087c630e2a8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:52.092447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7257156e-25ce-445b-99ed-7087c630e2a8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.094978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7257156e-25ce-445b-99ed-7087c630e2a8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.095754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7257156e-25ce-445b-99ed-7087c630e2a8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.098478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7257156e-25ce-445b-99ed-7087c630e2a8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.100780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7257156e-25ce-445b-99ed-7087c630e2a8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.101911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7257156e-25ce-445b-99ed-7087c630e2a8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.209025 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7257156e-25ce-445b-99ed-7087c630e2a8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158954 Aug 27 04:36:52.219464 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 687/1411] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:36:52 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:52.224723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e6611b3-f123-4c68-aac7-c626a60ad6c7 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:52.225572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e6611b3-f123-4c68-aac7-c626a60ad6c7 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:52.230947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a41dfa2-6fba-4aa8-8743-cae6b85b4a66 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:52.238357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e6611b3-f123-4c68-aac7-c626a60ad6c7 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.238898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e6611b3-f123-4c68-aac7-c626a60ad6c7 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.239342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e6611b3-f123-4c68-aac7-c626a60ad6c7 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.240064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e6611b3-f123-4c68-aac7-c626a60ad6c7 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.242419 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a41dfa2-6fba-4aa8-8743-cae6b85b4a66 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1477 microversion: 2.1 time: 0.235282 Aug 27 04:36:52.243093 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 725/1412] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:52 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1477 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:52.243967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e6611b3-f123-4c68-aac7-c626a60ad6c7 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.244455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e6611b3-f123-4c68-aac7-c626a60ad6c7 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.249077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:52.260975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:52.261638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:52.276183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.283851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.284813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.287483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.288475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.289688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.356304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.356859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.357302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.358048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.358513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.359280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.398751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Getting quotas for project abfa50b6f05c4413b2a96f2490ac43a1. Resources: {'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:36:52.404105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Getting quotas for user 7e6454ced7834bbdaeee89ccef19f510 and project abfa50b6f05c4413b2a96f2490ac43a1. Resources: {'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:36:52.562298 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83a76910-cd46-4ec0-905a-de9ede7fd303 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "POST /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba/action" status: 202 len: 0 microversion: 2.1 time: 0.317744 Aug 27 04:36:52.563509 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 726/1413] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:36:52 2022] POST /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:36:52.570842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-62f12399-19e1-4b5b-84f5-53b8912c114f req-28e0dc61-ab2e-495a-b597-b63ac857b9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577250c7-f1ee-4541-b83e-131d0e21efea", "name": "network-vif-plugged", "status": "completed", "tag": "d4d0324a-726b-4962-b7dd-c7fd914520fe"}, {"server_uuid": "7984297a-0070-487d-83cb-a4e4d97aa5ba", "name": "network-vif-plugged", "status": "completed", "tag": "9bf4e91c-b1ee-46b0-ab4c-5e3b87d4673b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:52.577941 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e6611b3-f123-4c68-aac7-c626a60ad6c7 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1645 microversion: 2.1 time: 0.356954 Aug 27 04:36:52.583546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-62f12399-19e1-4b5b-84f5-53b8912c114f req-28e0dc61-ab2e-495a-b597-b63ac857b9d3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.584315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-62f12399-19e1-4b5b-84f5-53b8912c114f req-28e0dc61-ab2e-495a-b597-b63ac857b9d3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.584770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-62f12399-19e1-4b5b-84f5-53b8912c114f req-28e0dc61-ab2e-495a-b597-b63ac857b9d3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.593951 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 688/1414] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:52 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1645 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:52.603293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-acf68bc0-078b-4d77-933b-37a8e0e022aa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:52.604377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-acf68bc0-078b-4d77-933b-37a8e0e022aa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:52.606420 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-62f12399-19e1-4b5b-84f5-53b8912c114f req-28e0dc61-ab2e-495a-b597-b63ac857b9d3 service nova] Creating event network-vif-plugged:d4d0324a-726b-4962-b7dd-c7fd914520fe for instance 577250c7-f1ee-4541-b83e-131d0e21efea on n-h2-854823-1 Aug 27 04:36:52.607014 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-62f12399-19e1-4b5b-84f5-53b8912c114f req-28e0dc61-ab2e-495a-b597-b63ac857b9d3 service nova] Creating event network-vif-plugged:9bf4e91c-b1ee-46b0-ab4c-5e3b87d4673b for instance 7984297a-0070-487d-83cb-a4e4d97aa5ba on n-h1-854823-1 Aug 27 04:36:52.612629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-acf68bc0-078b-4d77-933b-37a8e0e022aa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.613398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-acf68bc0-078b-4d77-933b-37a8e0e022aa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.613555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-62f12399-19e1-4b5b-84f5-53b8912c114f req-28e0dc61-ab2e-495a-b597-b63ac857b9d3 service nova] Instance 7984297a-0070-487d-83cb-a4e4d97aa5ba is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:36:52.614207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-acf68bc0-078b-4d77-933b-37a8e0e022aa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.615129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-acf68bc0-078b-4d77-933b-37a8e0e022aa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.615779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-acf68bc0-078b-4d77-933b-37a8e0e022aa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.616452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-acf68bc0-078b-4d77-933b-37a8e0e022aa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.627080 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-62f12399-19e1-4b5b-84f5-53b8912c114f req-28e0dc61-ab2e-495a-b597-b63ac857b9d3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062227 Aug 27 04:36:52.628073 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 727/1415] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:52.633894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6683fc9-5525-4cdb-89a5-b4aa0ac8596f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:52.634683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e6683fc9-5525-4cdb-89a5-b4aa0ac8596f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:52.642516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6683fc9-5525-4cdb-89a5-b4aa0ac8596f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.643124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6683fc9-5525-4cdb-89a5-b4aa0ac8596f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.643644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6683fc9-5525-4cdb-89a5-b4aa0ac8596f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.644636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6683fc9-5525-4cdb-89a5-b4aa0ac8596f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.645845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6683fc9-5525-4cdb-89a5-b4aa0ac8596f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.646352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6683fc9-5525-4cdb-89a5-b4aa0ac8596f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.831475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e6683fc9-5525-4cdb-89a5-b4aa0ac8596f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:52.840135 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6683fc9-5525-4cdb-89a5-b4aa0ac8596f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1469 microversion: 2.1 time: 0.210716 Aug 27 04:36:52.840987 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 728/1416] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:52 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1469 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:52.856477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca24c0d2-9a9d-429e-9f52-11bd75ffe790 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:52.857447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca24c0d2-9a9d-429e-9f52-11bd75ffe790 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:52.865492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca24c0d2-9a9d-429e-9f52-11bd75ffe790 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.866270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca24c0d2-9a9d-429e-9f52-11bd75ffe790 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.866775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca24c0d2-9a9d-429e-9f52-11bd75ffe790 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.867551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca24c0d2-9a9d-429e-9f52-11bd75ffe790 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:52.868279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca24c0d2-9a9d-429e-9f52-11bd75ffe790 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:52.868890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca24c0d2-9a9d-429e-9f52-11bd75ffe790 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:52.887342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-acf68bc0-078b-4d77-933b-37a8e0e022aa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:52.904571 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-acf68bc0-078b-4d77-933b-37a8e0e022aa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1324 microversion: 2.1 time: 0.305526 Aug 27 04:36:52.906319 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 689/1417] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:52 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:52.911962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f3e94709-c5f0-4f71-ba71-ace65363f67d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25d8b670>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:52.974203 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f3e94709-c5f0-4f71-ba71-ace65363f67d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.066483 Aug 27 04:36:52.983332 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 690/1418] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:52 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:53.106509 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca24c0d2-9a9d-429e-9f52-11bd75ffe790 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1645 microversion: 2.1 time: 0.261580 Aug 27 04:36:53.120560 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 729/1419] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:52 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1645 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:53.133862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-af69cdea-1560-4f5d-b7eb-0f7ce9f19daa tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:53.143669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af69cdea-1560-4f5d-b7eb-0f7ce9f19daa tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:53.144840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af69cdea-1560-4f5d-b7eb-0f7ce9f19daa tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:53.145276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af69cdea-1560-4f5d-b7eb-0f7ce9f19daa tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:53.146036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af69cdea-1560-4f5d-b7eb-0f7ce9f19daa tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:53.146692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af69cdea-1560-4f5d-b7eb-0f7ce9f19daa tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:53.147300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af69cdea-1560-4f5d-b7eb-0f7ce9f19daa tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:53.190922 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-af69cdea-1560-4f5d-b7eb-0f7ce9f19daa tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.065889 Aug 27 04:36:53.198367 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 691/1420] 10.222.0.79 () {58 vars in 1176 bytes} [Sat Aug 27 04:36:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:53.204304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26a13b83-ace0-430d-bdf8-e1daef1baa79 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:53.204981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26a13b83-ace0-430d-bdf8-e1daef1baa79 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:53.215084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26a13b83-ace0-430d-bdf8-e1daef1baa79 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:53.215514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26a13b83-ace0-430d-bdf8-e1daef1baa79 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:53.215941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26a13b83-ace0-430d-bdf8-e1daef1baa79 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:53.216713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26a13b83-ace0-430d-bdf8-e1daef1baa79 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:53.217168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26a13b83-ace0-430d-bdf8-e1daef1baa79 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:53.217614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26a13b83-ace0-430d-bdf8-e1daef1baa79 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:53.244545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-922b8e69-82e8-4bb9-99bc-51a1d2dc7194 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:53.247924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-922b8e69-82e8-4bb9-99bc-51a1d2dc7194 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:53.269067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-922b8e69-82e8-4bb9-99bc-51a1d2dc7194 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:53.269666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-922b8e69-82e8-4bb9-99bc-51a1d2dc7194 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:53.270114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-922b8e69-82e8-4bb9-99bc-51a1d2dc7194 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:53.270838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-922b8e69-82e8-4bb9-99bc-51a1d2dc7194 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:53.272904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-922b8e69-82e8-4bb9-99bc-51a1d2dc7194 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:53.273388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-922b8e69-82e8-4bb9-99bc-51a1d2dc7194 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:53.323262 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-922b8e69-82e8-4bb9-99bc-51a1d2dc7194 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087367 Aug 27 04:36:53.323960 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26a13b83-ace0-430d-bdf8-e1daef1baa79 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433/action" status: 202 len: 0 microversion: 2.1 time: 0.124058 Aug 27 04:36:53.324726 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 692/1421] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:36:53 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:53.328753 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 730/1422] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:36:53 2022] POST /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:36:53.332617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-153c2dd0-e297-4758-927c-5c5e0b36d49b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:53.333559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-153c2dd0-e297-4758-927c-5c5e0b36d49b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:53.341037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6cf1db19-04b2-47fc-bbae-59a3813df534 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:53.342382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6cf1db19-04b2-47fc-bbae-59a3813df534 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:53.349181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-153c2dd0-e297-4758-927c-5c5e0b36d49b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:53.349981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-153c2dd0-e297-4758-927c-5c5e0b36d49b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:53.350276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf1db19-04b2-47fc-bbae-59a3813df534 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:53.350823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf1db19-04b2-47fc-bbae-59a3813df534 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:53.351292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf1db19-04b2-47fc-bbae-59a3813df534 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:53.351945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-153c2dd0-e297-4758-927c-5c5e0b36d49b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:53.352080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf1db19-04b2-47fc-bbae-59a3813df534 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:53.353632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf1db19-04b2-47fc-bbae-59a3813df534 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:53.354153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf1db19-04b2-47fc-bbae-59a3813df534 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:53.357811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-153c2dd0-e297-4758-927c-5c5e0b36d49b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:53.358937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-153c2dd0-e297-4758-927c-5c5e0b36d49b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:53.359895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-153c2dd0-e297-4758-927c-5c5e0b36d49b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:53.560839 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6cf1db19-04b2-47fc-bbae-59a3813df534 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1650 microversion: 2.1 time: 0.230298 Aug 27 04:36:53.561549 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 731/1423] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:53 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1650 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:53.585009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-153c2dd0-e297-4758-927c-5c5e0b36d49b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:53.597178 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-153c2dd0-e297-4758-927c-5c5e0b36d49b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1477 microversion: 2.1 time: 0.270824 Aug 27 04:36:53.598602 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 693/1424] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:53 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1477 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:53.862907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1095af1-9fdf-465c-8f93-9210649d19db tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:53.864994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1095af1-9fdf-465c-8f93-9210649d19db tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:53.872136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1095af1-9fdf-465c-8f93-9210649d19db tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:53.873613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1095af1-9fdf-465c-8f93-9210649d19db tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:53.874463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1095af1-9fdf-465c-8f93-9210649d19db tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:53.875799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1095af1-9fdf-465c-8f93-9210649d19db tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:53.876793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1095af1-9fdf-465c-8f93-9210649d19db tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:53.877532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1095af1-9fdf-465c-8f93-9210649d19db tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:53.927565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f81ee9a9-e784-46e3-b6fe-584b9cf3a351 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:53.928494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f81ee9a9-e784-46e3-b6fe-584b9cf3a351 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:53.937543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f81ee9a9-e784-46e3-b6fe-584b9cf3a351 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:53.938403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f81ee9a9-e784-46e3-b6fe-584b9cf3a351 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:53.939112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f81ee9a9-e784-46e3-b6fe-584b9cf3a351 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:53.940062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f81ee9a9-e784-46e3-b6fe-584b9cf3a351 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:53.940781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f81ee9a9-e784-46e3-b6fe-584b9cf3a351 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:53.941441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f81ee9a9-e784-46e3-b6fe-584b9cf3a351 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:54.110515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1095af1-9fdf-465c-8f93-9210649d19db tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:54.118598 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1095af1-9fdf-465c-8f93-9210649d19db tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1469 microversion: 2.1 time: 0.260651 Aug 27 04:36:54.120302 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 732/1425] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:53 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1469 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:54.133400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c1a8ecd-e804-43f6-ab11-89fa70ca3d63 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f2199fca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:54.200866 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c1a8ecd-e804-43f6-ab11-89fa70ca3d63 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.079027 Aug 27 04:36:54.209090 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 733/1426] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:54 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:54.337469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-21be1578-6731-4530-a7de-7a94525740bf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:54.341124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-21be1578-6731-4530-a7de-7a94525740bf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:54.354431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21be1578-6731-4530-a7de-7a94525740bf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:54.355399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21be1578-6731-4530-a7de-7a94525740bf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:54.356063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21be1578-6731-4530-a7de-7a94525740bf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:54.361529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21be1578-6731-4530-a7de-7a94525740bf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:54.362022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21be1578-6731-4530-a7de-7a94525740bf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:54.362473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21be1578-6731-4530-a7de-7a94525740bf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:54.436759 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-21be1578-6731-4530-a7de-7a94525740bf tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103572 Aug 27 04:36:54.445471 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 734/1427] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:36:54 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:54.583451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26158192-abfd-4c03-a25f-d6d6a32ddacf tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:54.584108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26158192-abfd-4c03-a25f-d6d6a32ddacf tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:54.607588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26158192-abfd-4c03-a25f-d6d6a32ddacf tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:54.611607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26158192-abfd-4c03-a25f-d6d6a32ddacf tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:54.612294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26158192-abfd-4c03-a25f-d6d6a32ddacf tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:54.615812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26158192-abfd-4c03-a25f-d6d6a32ddacf tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:54.617084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26158192-abfd-4c03-a25f-d6d6a32ddacf tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:54.617709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26158192-abfd-4c03-a25f-d6d6a32ddacf tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:54.650354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f81ee9a9-e784-46e3-b6fe-584b9cf3a351 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:54.664658 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f81ee9a9-e784-46e3-b6fe-584b9cf3a351 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1520 microversion: 2.1 time: 0.735535 Aug 27 04:36:54.665316 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 694/1428] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:53 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1520 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:36:54.670300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-80228372-1f1b-47d5-b193-ad46502db611 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:54.675849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-80228372-1f1b-47d5-b193-ad46502db611 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:54.683654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80228372-1f1b-47d5-b193-ad46502db611 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:54.689256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80228372-1f1b-47d5-b193-ad46502db611 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:54.692379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80228372-1f1b-47d5-b193-ad46502db611 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:54.693419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80228372-1f1b-47d5-b193-ad46502db611 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:54.694311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80228372-1f1b-47d5-b193-ad46502db611 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:54.694974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80228372-1f1b-47d5-b193-ad46502db611 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:54.849199 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26158192-abfd-4c03-a25f-d6d6a32ddacf tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1630 microversion: 2.1 time: 0.269735 Aug 27 04:36:54.851465 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 735/1429] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:54 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1630 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:54.857410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78b49a9c-728b-46de-a8c1-8f4e8ca4c5b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:54.858498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78b49a9c-728b-46de-a8c1-8f4e8ca4c5b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:54.865589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b49a9c-728b-46de-a8c1-8f4e8ca4c5b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:54.866713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b49a9c-728b-46de-a8c1-8f4e8ca4c5b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:54.867454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b49a9c-728b-46de-a8c1-8f4e8ca4c5b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:54.868612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b49a9c-728b-46de-a8c1-8f4e8ca4c5b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:54.869333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b49a9c-728b-46de-a8c1-8f4e8ca4c5b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:54.870087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b49a9c-728b-46de-a8c1-8f4e8ca4c5b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:55.061108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-78b49a9c-728b-46de-a8c1-8f4e8ca4c5b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:55.064333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:55.066726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-80228372-1f1b-47d5-b193-ad46502db611 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:55.071903 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78b49a9c-728b-46de-a8c1-8f4e8ca4c5b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1520 microversion: 2.1 time: 0.218768 Aug 27 04:36:55.072556 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 736/1430] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:54 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:55.080854 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-80228372-1f1b-47d5-b193-ad46502db611 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1463 microversion: 2.1 time: 0.414198 Aug 27 04:36:55.081889 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 695/1431] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:54 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1463 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:55.092419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e9dd8c9-cd1f-4019-a61d-214a1700b5a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1288404670", "metadata": {"": ""}}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e9dd8c9-cd1f-4019-a61d-214a1700b5a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Request method failure captured: Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b/action HTTP/1.1 Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 107 Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ9LzeqYV4BUCc_CXZKyCgJDhuJ0n2D010QQ784od245BsR3bxLb1sHxDrLyEr4O_qgJBjYkRUAA_KGuy_0GWIipzEN4V-LZRqsnqytvO99DPzpj2LnZgNSzlNtzQSnXwwcHdsJTzPP1AoM-PSJ_QnZrIKpvFlmfCiSUn_wXkMGZoYs Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:36:55.098918 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:36:55.100359 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:36:55.100359 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:36:55.100359 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:36:55.100359 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:36:55.100359 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:36:55.100359 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:36:55.100359 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:36:55.100359 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 307981144d4141ed9d609d88ea2e954e Aug 27 04:36:55.100359 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:36:55.100359 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:36:55.100359 n-d-854823-1 devstack@n-api.service[128870]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1288404670", "metadata": {"": ""}}} Aug 27 04:36:55.100359 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '1f6aa77e-f369-461e-9cf6-d9bd0dad016b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1288404670', 'metadata': {'': ''}}}} Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'': ''} Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:55.101655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:55.103049 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:55.104775 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:55.104775 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:55.104775 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:36:55.104775 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:36:55.104775 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:36:55.104775 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:55.104775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e9dd8c9-cd1f-4019-a61d-214a1700b5a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:36:55.107486 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4e9dd8c9-cd1f-4019-a61d-214a1700b5a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "POST /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b/action" status: 400 len: 170 microversion: 2.1 time: 0.012036 Aug 27 04:36:55.110473 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 696/1432] 10.222.0.79 () {60 vars in 1279 bytes} [Sat Aug 27 04:36:55 2022] POST /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b/action => generated 170 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:36:55.112181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5210d25c-b6b2-4e36-a66a-e1bea89ad3dd tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854823-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:55.117791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5210d25c-b6b2-4e36-a66a-e1bea89ad3dd tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:55.122511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c00317dd-a44f-4dc7-afa0-c7924c1d9041 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:55.124423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c00317dd-a44f-4dc7-afa0-c7924c1d9041 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:55.127212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5210d25c-b6b2-4e36-a66a-e1bea89ad3dd tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:55.127827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5210d25c-b6b2-4e36-a66a-e1bea89ad3dd tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:55.128253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5210d25c-b6b2-4e36-a66a-e1bea89ad3dd tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:55.129051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5210d25c-b6b2-4e36-a66a-e1bea89ad3dd tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:55.129515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5210d25c-b6b2-4e36-a66a-e1bea89ad3dd tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:55.130387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5210d25c-b6b2-4e36-a66a-e1bea89ad3dd tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:55.143254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c00317dd-a44f-4dc7-afa0-c7924c1d9041 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:55.143764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c00317dd-a44f-4dc7-afa0-c7924c1d9041 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:55.144210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c00317dd-a44f-4dc7-afa0-c7924c1d9041 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:55.146858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c00317dd-a44f-4dc7-afa0-c7924c1d9041 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:55.147343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c00317dd-a44f-4dc7-afa0-c7924c1d9041 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:55.147779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c00317dd-a44f-4dc7-afa0-c7924c1d9041 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:55.165743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-5210d25c-b6b2-4e36-a66a-e1bea89ad3dd tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lazy-loading 'flavor' on Instance uuid 4ea1e00b-093a-4ed1-9640-a2a775d92433 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:36:55.184427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5210d25c-b6b2-4e36-a66a-e1bea89ad3dd tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Going to try to live migrate instance to n-h2-854823-1 {{(pid=128869) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:36:55.475297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c00317dd-a44f-4dc7-afa0-c7924c1d9041 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:55.499276 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c00317dd-a44f-4dc7-afa0-c7924c1d9041 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1463 microversion: 2.1 time: 0.387128 Aug 27 04:36:55.513882 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 697/1433] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:55 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1463 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:55.525126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0ab670d6-f159-42b2-9f4c-752f046e5bb1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:55.526372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0ab670d6-f159-42b2-9f4c-752f046e5bb1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:55.534041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ab670d6-f159-42b2-9f4c-752f046e5bb1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:55.534516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ab670d6-f159-42b2-9f4c-752f046e5bb1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:55.535008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ab670d6-f159-42b2-9f4c-752f046e5bb1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:55.535828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ab670d6-f159-42b2-9f4c-752f046e5bb1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:55.536413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ab670d6-f159-42b2-9f4c-752f046e5bb1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:55.536943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ab670d6-f159-42b2-9f4c-752f046e5bb1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:55.785218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0ab670d6-f159-42b2-9f4c-752f046e5bb1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:55.810145 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0ab670d6-f159-42b2-9f4c-752f046e5bb1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1520 microversion: 2.1 time: 0.294699 Aug 27 04:36:55.810737 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 698/1434] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:55 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:55.836855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3cf20561-7ca7-4fbf-9f49-5a97d787ca32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:55.837582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3cf20561-7ca7-4fbf-9f49-5a97d787ca32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:55.843868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cf20561-7ca7-4fbf-9f49-5a97d787ca32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:55.844390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cf20561-7ca7-4fbf-9f49-5a97d787ca32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:55.844878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cf20561-7ca7-4fbf-9f49-5a97d787ca32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:55.845602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cf20561-7ca7-4fbf-9f49-5a97d787ca32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:55.846067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cf20561-7ca7-4fbf-9f49-5a97d787ca32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:55.846501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cf20561-7ca7-4fbf-9f49-5a97d787ca32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:56.297267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3cf20561-7ca7-4fbf-9f49-5a97d787ca32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:56.311644 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3cf20561-7ca7-4fbf-9f49-5a97d787ca32 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1469 microversion: 2.1 time: 0.493567 Aug 27 04:36:56.315682 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 699/1435] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:55 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1469 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:56.329836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e118e867-376c-496a-b2ea-84c057f3ee37 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25e710d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:56.409276 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e118e867-376c-496a-b2ea-84c057f3ee37 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.089367 Aug 27 04:36:56.412981 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 700/1436] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:56 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:56.421693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-de355877-a43f-4d73-8a49-935333696bd4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:56.425059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-de355877-a43f-4d73-8a49-935333696bd4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:56.433138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de355877-a43f-4d73-8a49-935333696bd4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:56.433947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de355877-a43f-4d73-8a49-935333696bd4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:56.434557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de355877-a43f-4d73-8a49-935333696bd4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:56.435474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de355877-a43f-4d73-8a49-935333696bd4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:56.436142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de355877-a43f-4d73-8a49-935333696bd4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:56.436827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de355877-a43f-4d73-8a49-935333696bd4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:56.513734 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-de355877-a43f-4d73-8a49-935333696bd4 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099318 Aug 27 04:36:56.515327 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 701/1437] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:36:56 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:56.536003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71228424-9f42-4121-865e-14501cc9b5c0"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:56.538991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:56.542173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:56.547384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:56.549464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:56.550688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:56.554579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:56.554579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:56.555433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:56.663204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:36:56.663976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:36:56.664698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:36:56.665309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:36:56.666056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:36:56.808823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:56.842704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:56.847666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:56.848451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:56.849582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:56.850583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:56.851027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:56.987455 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d0ea1b49-b074-4de1-b768-565abec84dab tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "POST /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea/action" status: 202 len: 1067 microversion: 2.1 time: 0.470435 Aug 27 04:36:56.994277 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 702/1438] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:36:56 2022] POST /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea/action => generated 1067 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 04:36:56.999296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ad96a477-7a0b-42a7-9ee7-b50c3016dd98 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:57.005390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ad96a477-7a0b-42a7-9ee7-b50c3016dd98 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:57.054558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad96a477-7a0b-42a7-9ee7-b50c3016dd98 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:57.056368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad96a477-7a0b-42a7-9ee7-b50c3016dd98 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:57.057037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad96a477-7a0b-42a7-9ee7-b50c3016dd98 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:57.060474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad96a477-7a0b-42a7-9ee7-b50c3016dd98 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:57.064173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad96a477-7a0b-42a7-9ee7-b50c3016dd98 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:57.065074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad96a477-7a0b-42a7-9ee7-b50c3016dd98 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:57.623786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ad96a477-7a0b-42a7-9ee7-b50c3016dd98 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:57.634012 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ad96a477-7a0b-42a7-9ee7-b50c3016dd98 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1520 microversion: 2.1 time: 0.638551 Aug 27 04:36:57.634593 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 703/1439] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:56 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1520 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:57.646818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c3b92e4c-af57-40bc-8622-d4bfd1f30243 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:57.647442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c3b92e4c-af57-40bc-8622-d4bfd1f30243 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:57.659239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3b92e4c-af57-40bc-8622-d4bfd1f30243 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:57.659978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3b92e4c-af57-40bc-8622-d4bfd1f30243 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:57.660492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3b92e4c-af57-40bc-8622-d4bfd1f30243 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:57.661370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3b92e4c-af57-40bc-8622-d4bfd1f30243 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:57.661925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3b92e4c-af57-40bc-8622-d4bfd1f30243 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:57.662487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3b92e4c-af57-40bc-8622-d4bfd1f30243 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:58.026602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c3b92e4c-af57-40bc-8622-d4bfd1f30243 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:58.034710 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c3b92e4c-af57-40bc-8622-d4bfd1f30243 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.399088 Aug 27 04:36:58.045237 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 704/1440] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:57 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:58.051281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7e2dcfd3-e2b8-477c-9058-3def6397c42f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:58.052584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7e2dcfd3-e2b8-477c-9058-3def6397c42f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:58.069270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e2dcfd3-e2b8-477c-9058-3def6397c42f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:58.069941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e2dcfd3-e2b8-477c-9058-3def6397c42f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:58.070459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e2dcfd3-e2b8-477c-9058-3def6397c42f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:58.071263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e2dcfd3-e2b8-477c-9058-3def6397c42f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:58.073431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e2dcfd3-e2b8-477c-9058-3def6397c42f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:58.077103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e2dcfd3-e2b8-477c-9058-3def6397c42f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:58.314459 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5210d25c-b6b2-4e36-a66a-e1bea89ad3dd tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433/action" status: 202 len: 0 microversion: 2.1 time: 3.240232 Aug 27 04:36:58.316949 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 737/1441] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:36:55 2022] POST /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433/action => generated 0 bytes in 3244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:36:58.323586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2077f72-6508-4336-9987-018601ea4559 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21a73790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:58.408390 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2077f72-6508-4336-9987-018601ea4559 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.089326 Aug 27 04:36:58.410368 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 738/1442] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:58 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:58.429291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46ba057c-3536-4eed-8bd8-53c5e85e4b5e tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:58.432186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46ba057c-3536-4eed-8bd8-53c5e85e4b5e tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:58.439761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7e2dcfd3-e2b8-477c-9058-3def6397c42f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:58.441412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46ba057c-3536-4eed-8bd8-53c5e85e4b5e tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:58.442152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46ba057c-3536-4eed-8bd8-53c5e85e4b5e tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:58.443017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46ba057c-3536-4eed-8bd8-53c5e85e4b5e tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:58.444224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46ba057c-3536-4eed-8bd8-53c5e85e4b5e tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:58.444919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46ba057c-3536-4eed-8bd8-53c5e85e4b5e tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:58.445554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46ba057c-3536-4eed-8bd8-53c5e85e4b5e tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:58.456710 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7e2dcfd3-e2b8-477c-9058-3def6397c42f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1469 microversion: 2.1 time: 0.410184 Aug 27 04:36:58.470672 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 705/1443] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:58 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1469 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:58.485665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9b8da0b2-2bbf-4546-91dd-0836d7c604b4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1513126486", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:58.488846 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46ba057c-3536-4eed-8bd8-53c5e85e4b5e tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069892 Aug 27 04:36:58.490041 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 739/1444] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:36:58 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9b8da0b2-2bbf-4546-91dd-0836d7c604b4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Request method failure captured: Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b/action HTTP/1.1 Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 619 Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ9LzeqYV4BUCc_CXZKyCgJDhuJ0n2D010QQ784od245BsR3bxLb1sHxDrLyEr4O_qgJBjYkRUAA_KGuy_0GWIipzEN4V-LZRqsnqytvO99DPzpj2LnZgNSzlNtzQSnXwwcHdsJTzPP1AoM-PSJ_QnZrIKpvFlmfCiSUn_wXkMGZoYs Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:36:58.495149 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:36:58.496859 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:36:58.496859 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:36:58.496859 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:36:58.496859 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:36:58.496859 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:36:58.496859 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:36:58.496859 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:36:58.496859 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 307981144d4141ed9d609d88ea2e954e Aug 27 04:36:58.496859 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:36:58.496859 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:36:58.497637 n-d-854823-1 devstack@n-api.service[128870]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1513126486", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 27 04:36:58.497637 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:36:58.497637 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:36:58.497919 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '1f6aa77e-f369-461e-9cf6-d9bd0dad016b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1513126486', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 27 04:36:58.497919 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:36:58.497919 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:58.497919 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:36:58.497919 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:36:58.497919 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:36:58.497919 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:36:58.497919 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:36:58.497919 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:58.497919 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 27 04:36:58.497919 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:36:58.498762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:36:58.500949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:36:58.500949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:36:58.500949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:36:58.500949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:36:58.500949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:36:58.500949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:36:58.500949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:36:58.500949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:36:58.500949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:58.500949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:58.500949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:58.500949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:58.501858 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:58.501858 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:58.501858 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:36:58.501858 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:36:58.501858 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:36:58.501858 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:36:58.503139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9b8da0b2-2bbf-4546-91dd-0836d7c604b4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:36:58.504199 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9b8da0b2-2bbf-4546-91dd-0836d7c604b4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "POST /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b/action" status: 400 len: 938 microversion: 2.1 time: 0.032469 Aug 27 04:36:58.505232 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 706/1445] 10.222.0.79 () {60 vars in 1279 bytes} [Sat Aug 27 04:36:58 2022] POST /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b/action => generated 938 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:36:58.516031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-46098517-9323-4d7e-9775-63adb8514998 req-f54d0c7e-03be-4876-9be1-1c01051ccdd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88460469-e163-4ebf-8076-73ddf76e72ad", "name": "network-vif-plugged", "status": "completed", "tag": "218b43e2-66f7-4ab7-bc63-d7caa2c9c4ef"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:58.519733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b88a023c-1dbb-4d16-8426-7b3dc89c8eb6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:58.520699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b88a023c-1dbb-4d16-8426-7b3dc89c8eb6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:58.528981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88a023c-1dbb-4d16-8426-7b3dc89c8eb6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:58.529752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88a023c-1dbb-4d16-8426-7b3dc89c8eb6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:58.529893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-46098517-9323-4d7e-9775-63adb8514998 req-f54d0c7e-03be-4876-9be1-1c01051ccdd7 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:58.530495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88a023c-1dbb-4d16-8426-7b3dc89c8eb6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:58.530646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-46098517-9323-4d7e-9775-63adb8514998 req-f54d0c7e-03be-4876-9be1-1c01051ccdd7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:58.531178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-46098517-9323-4d7e-9775-63adb8514998 req-f54d0c7e-03be-4876-9be1-1c01051ccdd7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:58.531844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88a023c-1dbb-4d16-8426-7b3dc89c8eb6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:58.532463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88a023c-1dbb-4d16-8426-7b3dc89c8eb6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:58.533082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88a023c-1dbb-4d16-8426-7b3dc89c8eb6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:58.554550 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-46098517-9323-4d7e-9775-63adb8514998 req-f54d0c7e-03be-4876-9be1-1c01051ccdd7 service nova] Creating event network-vif-plugged:218b43e2-66f7-4ab7-bc63-d7caa2c9c4ef for instance 88460469-e163-4ebf-8076-73ddf76e72ad on n-h1-854823-1 Aug 27 04:36:58.560246 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-46098517-9323-4d7e-9775-63adb8514998 req-f54d0c7e-03be-4876-9be1-1c01051ccdd7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068795 Aug 27 04:36:58.565020 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 740/1446] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:58.570468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-284daaa8-8811-4706-ae49-81684022aecb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:58.571566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-284daaa8-8811-4706-ae49-81684022aecb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:58.579380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-284daaa8-8811-4706-ae49-81684022aecb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:58.580054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-284daaa8-8811-4706-ae49-81684022aecb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:58.580716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-284daaa8-8811-4706-ae49-81684022aecb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:58.581718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-284daaa8-8811-4706-ae49-81684022aecb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:58.582455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-284daaa8-8811-4706-ae49-81684022aecb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:58.583032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-284daaa8-8811-4706-ae49-81684022aecb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:58.586189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:58.775603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-284daaa8-8811-4706-ae49-81684022aecb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:58.793298 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-284daaa8-8811-4706-ae49-81684022aecb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1520 microversion: 2.1 time: 0.226414 Aug 27 04:36:58.812685 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 741/1447] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:58 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:58.820019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4bd82931-95f9-4ca2-87fa-61ac013c9952 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:58.821458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4bd82931-95f9-4ca2-87fa-61ac013c9952 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:58.829518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd82931-95f9-4ca2-87fa-61ac013c9952 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:58.830556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd82931-95f9-4ca2-87fa-61ac013c9952 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:58.831911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd82931-95f9-4ca2-87fa-61ac013c9952 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:58.832918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd82931-95f9-4ca2-87fa-61ac013c9952 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:58.833533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd82931-95f9-4ca2-87fa-61ac013c9952 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:58.834120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd82931-95f9-4ca2-87fa-61ac013c9952 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:58.954873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b88a023c-1dbb-4d16-8426-7b3dc89c8eb6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:58.969115 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b88a023c-1dbb-4d16-8426-7b3dc89c8eb6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1504 microversion: 2.1 time: 0.460397 Aug 27 04:36:58.971520 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 707/1448] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:58 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1504 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:59.059500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4bd82931-95f9-4ca2-87fa-61ac013c9952 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:59.071460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a9dea8b-3108-4c97-b11f-92c107c04ac7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:59.072337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a9dea8b-3108-4c97-b11f-92c107c04ac7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:59.073519 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4bd82931-95f9-4ca2-87fa-61ac013c9952 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1520 microversion: 2.1 time: 0.256069 Aug 27 04:36:59.074957 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 742/1449] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:58 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:59.080702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a9dea8b-3108-4c97-b11f-92c107c04ac7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:59.081368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a9dea8b-3108-4c97-b11f-92c107c04ac7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:59.081864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a9dea8b-3108-4c97-b11f-92c107c04ac7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:59.082622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a9dea8b-3108-4c97-b11f-92c107c04ac7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:59.083090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a9dea8b-3108-4c97-b11f-92c107c04ac7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:59.083525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a9dea8b-3108-4c97-b11f-92c107c04ac7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:59.105855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36322b95-c853-4c75-b7d7-fa7a4c272c62 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36322b95-c853-4c75-b7d7-fa7a4c272c62 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Request method failure captured: Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b/action HTTP/1.1 Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 285 Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ9LzeqYV4BUCc_CXZKyCgJDhuJ0n2D010QQ784od245BsR3bxLb1sHxDrLyEr4O_qgJBjYkRUAA_KGuy_0GWIipzEN4V-LZRqsnqytvO99DPzpj2LnZgNSzlNtzQSnXwwcHdsJTzPP1AoM-PSJ_QnZrIKpvFlmfCiSUn_wXkMGZoYs Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:36:59.113169 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:36:59.114686 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:36:59.114686 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:36:59.114686 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:36:59.114686 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:36:59.114686 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:36:59.114686 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:36:59.114686 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:36:59.114686 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 307981144d4141ed9d609d88ea2e954e Aug 27 04:36:59.114686 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:36:59.114686 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:36:59.114686 n-d-854823-1 devstack@n-api.service[128869]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 04:36:59.115392 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:36:59.115392 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:36:59.115392 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '1f6aa77e-f369-461e-9cf6-d9bd0dad016b', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 04:36:59.115392 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:36:59.115392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:59.115392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:36:59.115392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:36:59.115392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:36:59.115392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:36:59.115392 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:36:59.116075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:36:59.117378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:36:59.117378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:36:59.117378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:36:59.117378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:36:59.117378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:36:59.117378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:59.117378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:36:59.117378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:59.117378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:36:59.117378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:36:59.117378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:36:59.117378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:36:59.117378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:36:59.118194 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:36:59.118194 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:36:59.118194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36322b95-c853-4c75-b7d7-fa7a4c272c62 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:36:59.118194 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36322b95-c853-4c75-b7d7-fa7a4c272c62 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "POST /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b/action" status: 400 len: 619 microversion: 2.1 time: 0.017200 Aug 27 04:36:59.119933 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 743/1450] 10.222.0.79 () {60 vars in 1279 bytes} [Sat Aug 27 04:36:59 2022] POST /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b/action => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:36:59.128427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-acbab231-f115-488b-8ac3-c18d52125505 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:59.129086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-acbab231-f115-488b-8ac3-c18d52125505 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:59.149425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acbab231-f115-488b-8ac3-c18d52125505 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:59.149836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acbab231-f115-488b-8ac3-c18d52125505 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:59.150359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acbab231-f115-488b-8ac3-c18d52125505 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:59.151232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acbab231-f115-488b-8ac3-c18d52125505 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:59.151719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acbab231-f115-488b-8ac3-c18d52125505 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:59.152136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acbab231-f115-488b-8ac3-c18d52125505 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:59.333006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-acbab231-f115-488b-8ac3-c18d52125505 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:59.344797 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-acbab231-f115-488b-8ac3-c18d52125505 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1520 microversion: 2.1 time: 0.222363 Aug 27 04:36:59.346435 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 744/1451] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:59 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:59.369778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e88d029-28fa-42e0-837a-4d9cc4a8fcd6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:59.370420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e88d029-28fa-42e0-837a-4d9cc4a8fcd6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:59.377230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e88d029-28fa-42e0-837a-4d9cc4a8fcd6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:59.377728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e88d029-28fa-42e0-837a-4d9cc4a8fcd6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:59.378189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e88d029-28fa-42e0-837a-4d9cc4a8fcd6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:59.378911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e88d029-28fa-42e0-837a-4d9cc4a8fcd6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:59.379380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e88d029-28fa-42e0-837a-4d9cc4a8fcd6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:59.379789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e88d029-28fa-42e0-837a-4d9cc4a8fcd6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:59.539076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7e88d029-28fa-42e0-837a-4d9cc4a8fcd6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:59.549200 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e88d029-28fa-42e0-837a-4d9cc4a8fcd6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1520 microversion: 2.1 time: 0.183930 Aug 27 04:36:59.565067 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 745/1452] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:59 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:59.570333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bad4cc4b-84b1-4a2a-bf63-6b98d0fbed80 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21ca9700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:59.625576 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bad4cc4b-84b1-4a2a-bf63-6b98d0fbed80 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.059272 Aug 27 04:36:59.626909 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 746/1453] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:36:59 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:59.632059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5cde5219-9648-47c6-b214-ffdaa29c7f40 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:59.632945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5cde5219-9648-47c6-b214-ffdaa29c7f40 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:59.639602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cde5219-9648-47c6-b214-ffdaa29c7f40 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:59.640124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cde5219-9648-47c6-b214-ffdaa29c7f40 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:59.641141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cde5219-9648-47c6-b214-ffdaa29c7f40 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:59.641846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cde5219-9648-47c6-b214-ffdaa29c7f40 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:59.642303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cde5219-9648-47c6-b214-ffdaa29c7f40 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:59.642726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cde5219-9648-47c6-b214-ffdaa29c7f40 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:59.811076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5cde5219-9648-47c6-b214-ffdaa29c7f40 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:59.815133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6a9dea8b-3108-4c97-b11f-92c107c04ac7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:59.820264 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5cde5219-9648-47c6-b214-ffdaa29c7f40 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1535 microversion: 2.1 time: 0.192052 Aug 27 04:36:59.821577 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 747/1454] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:59 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1535 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:59.826441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8445d62-c5f6-4a01-8873-d4fc58dae341 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:59.829727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8445d62-c5f6-4a01-8873-d4fc58dae341 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:59.835896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8445d62-c5f6-4a01-8873-d4fc58dae341 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:59.836395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8445d62-c5f6-4a01-8873-d4fc58dae341 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:59.836874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8445d62-c5f6-4a01-8873-d4fc58dae341 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:59.837535 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a9dea8b-3108-4c97-b11f-92c107c04ac7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.771015 Aug 27 04:36:59.837642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8445d62-c5f6-4a01-8873-d4fc58dae341 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:59.838033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8445d62-c5f6-4a01-8873-d4fc58dae341 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:59.838741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8445d62-c5f6-4a01-8873-d4fc58dae341 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:59.849289 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 708/1455] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:59 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:59.860100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b630cfa0-2bd1-41f0-80fb-4fd57567a40a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1213449682"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:59.863515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b630cfa0-2bd1-41f0-80fb-4fd57567a40a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:36:59.871765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b630cfa0-2bd1-41f0-80fb-4fd57567a40a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:59.876273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b630cfa0-2bd1-41f0-80fb-4fd57567a40a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:59.877029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b630cfa0-2bd1-41f0-80fb-4fd57567a40a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:59.877787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b630cfa0-2bd1-41f0-80fb-4fd57567a40a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:36:59.878258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b630cfa0-2bd1-41f0-80fb-4fd57567a40a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:36:59.879241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b630cfa0-2bd1-41f0-80fb-4fd57567a40a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:36:59.888354 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8445d62-c5f6-4a01-8873-d4fc58dae341 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065560 Aug 27 04:36:59.889459 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 748/1456] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:36:59 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:36:59.996160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-101bad44-fce1-40dd-aebc-abc9b891a632 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:59.996827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-101bad44-fce1-40dd-aebc-abc9b891a632 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:00.007921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-101bad44-fce1-40dd-aebc-abc9b891a632 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:00.008421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-101bad44-fce1-40dd-aebc-abc9b891a632 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:00.013028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-101bad44-fce1-40dd-aebc-abc9b891a632 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:00.017015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-101bad44-fce1-40dd-aebc-abc9b891a632 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:00.018850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-101bad44-fce1-40dd-aebc-abc9b891a632 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:00.019812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-101bad44-fce1-40dd-aebc-abc9b891a632 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:00.196931 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b630cfa0-2bd1-41f0-80fb-4fd57567a40a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "POST /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b/action" status: 202 len: 0 microversion: 2.1 time: 0.343636 Aug 27 04:37:00.198652 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 709/1457] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:36:59 2022] POST /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:37:00.225678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-782497281", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "4532faea-b9fd-47c3-9050-64f8d20fc37c"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:00.295741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] validate_networks() for [('4532faea-b9fd-47c3-9050-64f8d20fc37c', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:37:00.323673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-101bad44-fce1-40dd-aebc-abc9b891a632 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:00.334135 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-101bad44-fce1-40dd-aebc-abc9b891a632 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1504 microversion: 2.1 time: 0.343826 Aug 27 04:37:00.336006 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 749/1458] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:36:59 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:00.342219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e86ac52-3947-4d7f-b8cc-ddbe06e1f4ae tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-701955596"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:00.345582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e86ac52-3947-4d7f-b8cc-ddbe06e1f4ae tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:00.352499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e86ac52-3947-4d7f-b8cc-ddbe06e1f4ae tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:00.353025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e86ac52-3947-4d7f-b8cc-ddbe06e1f4ae tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:00.353466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e86ac52-3947-4d7f-b8cc-ddbe06e1f4ae tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:00.354189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e86ac52-3947-4d7f-b8cc-ddbe06e1f4ae tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:00.354707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e86ac52-3947-4d7f-b8cc-ddbe06e1f4ae tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:00.355135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e86ac52-3947-4d7f-b8cc-ddbe06e1f4ae tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:00.394869 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1e86ac52-3947-4d7f-b8cc-ddbe06e1f4ae tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] HTTP exception thrown: Cannot 'createImage' instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b while it is in task_state image_snapshot Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e86ac52-3947-4d7f-b8cc-ddbe06e1f4ae tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Request method failure captured: Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b/action HTTP/1.1 Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 84 Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ9LzeqYV4BUCc_CXZKyCgJDhuJ0n2D010QQ784od245BsR3bxLb1sHxDrLyEr4O_qgJBjYkRUAA_KGuy_0GWIipzEN4V-LZRqsnqytvO99DPzpj2LnZgNSzlNtzQSnXwwcHdsJTzPP1AoM-PSJ_QnZrIKpvFlmfCiSUn_wXkMGZoYs Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:37:00.396640 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:37:00.398114 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:00.398114 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:37:00.398114 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:37:00.398114 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:37:00.398114 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:37:00.398114 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:37:00.398114 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:37:00.398114 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 307981144d4141ed9d609d88ea2e954e Aug 27 04:37:00.398114 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:37:00.398114 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:37:00.398114 n-d-854823-1 devstack@n-api.service[128869]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-701955596"}} Aug 27 04:37:00.398114 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: exception: Cannot 'createImage' instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b while it is in task_state image_snapshot Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '1f6aa77e-f369-461e-9cf6-d9bd0dad016b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-701955596'}}} Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b in task_state image_snapshot. Cannot snapshot while the instance is in this state. Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:00.398866 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b while it is in task_state image_snapshot Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b while it is in task_state image_snapshot Aug 27 04:37:00.400065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:00.417526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e86ac52-3947-4d7f-b8cc-ddbe06e1f4ae tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Returning 409 to user: Cannot 'createImage' instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b while it is in task_state image_snapshot {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:00.421981 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e86ac52-3947-4d7f-b8cc-ddbe06e1f4ae tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "POST /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b/action" status: 409 len: 159 microversion: 2.1 time: 0.084050 Aug 27 04:37:00.427609 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 750/1459] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:37:00 2022] POST /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b/action => generated 159 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:37:00.442288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-306980cd-ec0f-4244-93f4-0ea2b205caef tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '.version_select at 0x7f1f219735e0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:00.600094 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-306980cd-ec0f-4244-93f4-0ea2b205caef tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "DELETE /compute/v2.1/images/b40ae0cd-c940-4e17-9d1d-cfd94c0a7658" status: 204 len: 0 microversion: 2.1 time: 0.169541 Aug 27 04:37:00.600776 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 751/1460] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:00 2022] DELETE /compute/v2.1/images/b40ae0cd-c940-4e17-9d1d-cfd94c0a7658 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:00.607425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-842490ea-a362-489b-8223-f539f9c01f8e req-370d1f19-59ef-4d1d-8e22-28611a618f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7984297a-0070-487d-83cb-a4e4d97aa5ba", "name": "network-vif-unplugged", "status": "completed", "tag": "9bf4e91c-b1ee-46b0-ab4c-5e3b87d4673b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:00.625240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-842490ea-a362-489b-8223-f539f9c01f8e req-370d1f19-59ef-4d1d-8e22-28611a618f7a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:00.629474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-842490ea-a362-489b-8223-f539f9c01f8e req-370d1f19-59ef-4d1d-8e22-28611a618f7a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:00.629474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-842490ea-a362-489b-8223-f539f9c01f8e req-370d1f19-59ef-4d1d-8e22-28611a618f7a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:00.659317 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-842490ea-a362-489b-8223-f539f9c01f8e req-370d1f19-59ef-4d1d-8e22-28611a618f7a service nova] Creating event network-vif-unplugged:9bf4e91c-b1ee-46b0-ab4c-5e3b87d4673b for instance 7984297a-0070-487d-83cb-a4e4d97aa5ba on n-h1-854823-1 Aug 27 04:37:00.669761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-842490ea-a362-489b-8223-f539f9c01f8e req-370d1f19-59ef-4d1d-8e22-28611a618f7a service nova] Instance 7984297a-0070-487d-83cb-a4e4d97aa5ba is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:37:00.681932 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-842490ea-a362-489b-8223-f539f9c01f8e req-370d1f19-59ef-4d1d-8e22-28611a618f7a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079635 Aug 27 04:37:00.684868 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 752/1461] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:00.698901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a71be879-e640-4870-bce1-9127f8488ddf tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:00.701743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a71be879-e640-4870-bce1-9127f8488ddf tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:00.727763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a71be879-e640-4870-bce1-9127f8488ddf tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:00.732587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a71be879-e640-4870-bce1-9127f8488ddf tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:00.733716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a71be879-e640-4870-bce1-9127f8488ddf tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:00.738303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a71be879-e640-4870-bce1-9127f8488ddf tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:00.740494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a71be879-e640-4870-bce1-9127f8488ddf tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:00.743452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a71be879-e640-4870-bce1-9127f8488ddf tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:01.001258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a71be879-e640-4870-bce1-9127f8488ddf tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:01.012164 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a71be879-e640-4870-bce1-9127f8488ddf tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1532 microversion: 2.1 time: 0.325372 Aug 27 04:37:01.027797 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 753/1462] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:00 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1532 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:01.036348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbdbb14e-5f3c-45cc-8223-2dd660d64cb7 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f2199c4c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:01.174498 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbdbb14e-5f3c-45cc-8223-2dd660d64cb7 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.145660 Aug 27 04:37:01.175803 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 754/1463] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:01 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:01.192628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9f5e527-528c-4b9f-acd1-8a158464673c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:01.193604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9f5e527-528c-4b9f-acd1-8a158464673c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:01.208116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9f5e527-528c-4b9f-acd1-8a158464673c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:01.209043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9f5e527-528c-4b9f-acd1-8a158464673c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:01.209917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9f5e527-528c-4b9f-acd1-8a158464673c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:01.210981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9f5e527-528c-4b9f-acd1-8a158464673c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:01.211652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9f5e527-528c-4b9f-acd1-8a158464673c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:01.212241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9f5e527-528c-4b9f-acd1-8a158464673c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:01.361872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:37:01.362384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:37:01.362754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:37:01.363157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:37:01.363569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:37:01.384462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:01.385129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:01.386918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:01.390025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:01.390739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:01.393329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:01.410953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9f5e527-528c-4b9f-acd1-8a158464673c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:01.424845 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9f5e527-528c-4b9f-acd1-8a158464673c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1535 microversion: 2.1 time: 0.242704 Aug 27 04:37:01.425739 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 755/1464] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:01 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1535 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:01.466269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Getting quotas for project 8747bb92a41f4edd9b6a0cd832ce6112. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:37:01.472388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Getting quotas for user b6726e43aff14d27916835154cbfdf1d and project 8747bb92a41f4edd9b6a0cd832ce6112. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:37:01.509305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:37:01.512003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:37:01.533541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-746339429", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "3045fa03-f348-4c29-a5c4-f817e8f7627d"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:01.635769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] validate_networks() for [('3045fa03-f348-4c29-a5c4-f817e8f7627d', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:37:01.668575 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6dd581a5-5cd5-4aef-983b-6ac1ecc640de tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466616 Aug 27 04:37:01.681693 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 710/1465] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:37:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:37:01.692653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b65ede89-898f-4631-84bb-38f5794d9618 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:01.696204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b65ede89-898f-4631-84bb-38f5794d9618 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:01.717585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b65ede89-898f-4631-84bb-38f5794d9618 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:01.718921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b65ede89-898f-4631-84bb-38f5794d9618 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:01.719574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b65ede89-898f-4631-84bb-38f5794d9618 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:01.720505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b65ede89-898f-4631-84bb-38f5794d9618 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:01.726824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b65ede89-898f-4631-84bb-38f5794d9618 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:01.727650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b65ede89-898f-4631-84bb-38f5794d9618 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:02.167354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b65ede89-898f-4631-84bb-38f5794d9618 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:02.182183 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b65ede89-898f-4631-84bb-38f5794d9618 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.498583 Aug 27 04:37:02.183091 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 711/1466] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:01 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:02.196772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fdd530c8-0b17-43bf-8940-6148d2ea36d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:02.197659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fdd530c8-0b17-43bf-8940-6148d2ea36d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:02.212228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdd530c8-0b17-43bf-8940-6148d2ea36d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:02.214853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdd530c8-0b17-43bf-8940-6148d2ea36d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:02.215527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdd530c8-0b17-43bf-8940-6148d2ea36d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:02.218334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdd530c8-0b17-43bf-8940-6148d2ea36d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:02.219610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdd530c8-0b17-43bf-8940-6148d2ea36d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:02.220218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdd530c8-0b17-43bf-8940-6148d2ea36d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:02.384128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:02.404302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:37:02.405074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:37:02.405865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:37:02.406776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:37:02.407288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:37:02.423435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:02.424824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:02.425566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:02.426769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:02.427595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:02.428283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:02.453798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Getting quotas for project 98283183679c42029b0ca02db8762ed4. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:37:02.463437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Getting quotas for user 8852be5166774a5e870512f289cf0aa6 and project 98283183679c42029b0ca02db8762ed4. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:37:02.476847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fdd530c8-0b17-43bf-8940-6148d2ea36d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:02.488074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:37:02.491493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:37:02.505719 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fdd530c8-0b17-43bf-8940-6148d2ea36d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1504 microversion: 2.1 time: 0.321059 Aug 27 04:37:02.506651 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 712/1467] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:02 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:02.514083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ec58e49a-27a0-489f-a270-f8359ce64cba req-bdbca0c9-2558-4033-bd8c-9d52d1ad4d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea1e00b-093a-4ed1-9640-a2a775d92433", "name": "network-vif-unplugged", "status": "completed", "tag": "d062da01-c364-4876-b2fb-050be39ee311"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:02.528950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ec58e49a-27a0-489f-a270-f8359ce64cba req-bdbca0c9-2558-4033-bd8c-9d52d1ad4d0c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:02.530150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ec58e49a-27a0-489f-a270-f8359ce64cba req-bdbca0c9-2558-4033-bd8c-9d52d1ad4d0c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:02.531540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ec58e49a-27a0-489f-a270-f8359ce64cba req-bdbca0c9-2558-4033-bd8c-9d52d1ad4d0c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:02.588501 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ec58e49a-27a0-489f-a270-f8359ce64cba req-bdbca0c9-2558-4033-bd8c-9d52d1ad4d0c service nova] Creating event network-vif-unplugged:d062da01-c364-4876-b2fb-050be39ee311 for instance 4ea1e00b-093a-4ed1-9640-a2a775d92433 on n-h1-854823-1 Aug 27 04:37:02.615809 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ec58e49a-27a0-489f-a270-f8359ce64cba req-bdbca0c9-2558-4033-bd8c-9d52d1ad4d0c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104021 Aug 27 04:37:02.619156 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 713/1468] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:02.629104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c5826c55-fce1-4555-9a88-5b766daeedd7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:02.629469 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e33fc9f-23c0-4b3b-96b1-cf5327711df4 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.191240 Aug 27 04:37:02.631757 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 756/1469] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:37:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:37:02.644944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc22cdc7-6542-4eda-9db6-164ec5d1e635 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:02.645094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c5826c55-fce1-4555-9a88-5b766daeedd7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:02.645914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc22cdc7-6542-4eda-9db6-164ec5d1e635 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:02.657458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc22cdc7-6542-4eda-9db6-164ec5d1e635 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:02.658190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc22cdc7-6542-4eda-9db6-164ec5d1e635 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:02.658797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc22cdc7-6542-4eda-9db6-164ec5d1e635 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:02.659740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc22cdc7-6542-4eda-9db6-164ec5d1e635 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:02.660471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc22cdc7-6542-4eda-9db6-164ec5d1e635 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:02.661133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc22cdc7-6542-4eda-9db6-164ec5d1e635 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:02.790665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c5826c55-fce1-4555-9a88-5b766daeedd7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:02.804694 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c5826c55-fce1-4555-9a88-5b766daeedd7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1217 microversion: 2.1 time: 0.180186 Aug 27 04:37:02.805580 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 714/1470] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:02 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:02.811517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7f70b242-950c-42a2-9f99-3fc4d30729c3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25ed6a60>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:02.901140 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7f70b242-950c-42a2-9f99-3fc4d30729c3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.089244 Aug 27 04:37:02.904786 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 715/1471] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:02 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:02.912906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b9c0e379-86ac-42b1-8ae1-2d29ffc037ed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:02.917045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b9c0e379-86ac-42b1-8ae1-2d29ffc037ed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:02.927437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9c0e379-86ac-42b1-8ae1-2d29ffc037ed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:02.928065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9c0e379-86ac-42b1-8ae1-2d29ffc037ed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:02.928615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9c0e379-86ac-42b1-8ae1-2d29ffc037ed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:02.929512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9c0e379-86ac-42b1-8ae1-2d29ffc037ed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:02.930104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9c0e379-86ac-42b1-8ae1-2d29ffc037ed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:02.930610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9c0e379-86ac-42b1-8ae1-2d29ffc037ed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:02.987152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cc22cdc7-6542-4eda-9db6-164ec5d1e635 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:03.007651 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc22cdc7-6542-4eda-9db6-164ec5d1e635 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1532 microversion: 2.1 time: 0.368845 Aug 27 04:37:03.010466 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 757/1472] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:02 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1532 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:03.037929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9c584a9-6712-4a72-a1f5-505cd77ffe63 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:03.038560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9c584a9-6712-4a72-a1f5-505cd77ffe63 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:03.191649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b9c0e379-86ac-42b1-8ae1-2d29ffc037ed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:03.224897 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b9c0e379-86ac-42b1-8ae1-2d29ffc037ed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1535 microversion: 2.1 time: 0.315290 Aug 27 04:37:03.226408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9c584a9-6712-4a72-a1f5-505cd77ffe63 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:03.227145 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 716/1473] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:02 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1535 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:03.236786 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9c584a9-6712-4a72-a1f5-505cd77ffe63 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1231 microversion: 2.1 time: 0.212184 Aug 27 04:37:03.237394 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 758/1474] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:03 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1231 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:03.248456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bb433974-eb00-495b-8fb7-c46d124adf38 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:03.249134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bb433974-eb00-495b-8fb7-c46d124adf38 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:03.268194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb433974-eb00-495b-8fb7-c46d124adf38 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:03.285772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb433974-eb00-495b-8fb7-c46d124adf38 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:03.288897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb433974-eb00-495b-8fb7-c46d124adf38 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:03.289858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb433974-eb00-495b-8fb7-c46d124adf38 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:03.291873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb433974-eb00-495b-8fb7-c46d124adf38 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:03.292513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb433974-eb00-495b-8fb7-c46d124adf38 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:03.528177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-71677838-f218-492d-81d2-5b2049508f72 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:03.528999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-71677838-f218-492d-81d2-5b2049508f72 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:03.539124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71677838-f218-492d-81d2-5b2049508f72 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:03.539893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71677838-f218-492d-81d2-5b2049508f72 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:03.541481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71677838-f218-492d-81d2-5b2049508f72 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:03.542412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71677838-f218-492d-81d2-5b2049508f72 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:03.543222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71677838-f218-492d-81d2-5b2049508f72 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:03.543988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71677838-f218-492d-81d2-5b2049508f72 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:03.551966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:03.628085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bb433974-eb00-495b-8fb7-c46d124adf38 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:03.642330 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bb433974-eb00-495b-8fb7-c46d124adf38 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.410255 Aug 27 04:37:03.642873 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 717/1475] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:03 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:03.754837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71677838-f218-492d-81d2-5b2049508f72 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:03.764176 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-71677838-f218-492d-81d2-5b2049508f72 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1504 microversion: 2.1 time: 0.240532 Aug 27 04:37:03.793036 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 759/1476] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:03 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:03.836815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-75c15fdf-e109-4b71-a5fe-65b9b78f61d8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:03.838996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-75c15fdf-e109-4b71-a5fe-65b9b78f61d8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:03.851814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75c15fdf-e109-4b71-a5fe-65b9b78f61d8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:03.852800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75c15fdf-e109-4b71-a5fe-65b9b78f61d8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:03.853537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75c15fdf-e109-4b71-a5fe-65b9b78f61d8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:03.854567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75c15fdf-e109-4b71-a5fe-65b9b78f61d8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:03.855121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75c15fdf-e109-4b71-a5fe-65b9b78f61d8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:03.855667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75c15fdf-e109-4b71-a5fe-65b9b78f61d8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:03.926461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8d83e42-2483-4bb6-996a-e8aed49eb4fc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21a233a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:03.968767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-75c15fdf-e109-4b71-a5fe-65b9b78f61d8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:03.981214 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-75c15fdf-e109-4b71-a5fe-65b9b78f61d8 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1269 microversion: 2.1 time: 0.154715 Aug 27 04:37:03.982801 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 718/1477] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:03 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:04.002239 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8d83e42-2483-4bb6-996a-e8aed49eb4fc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.087223 Aug 27 04:37:04.009597 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 760/1478] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:03 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:04.034370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9765484b-17b9-4799-86a7-79b91804253b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:04.035029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9765484b-17b9-4799-86a7-79b91804253b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:04.047474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9765484b-17b9-4799-86a7-79b91804253b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:04.047970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9765484b-17b9-4799-86a7-79b91804253b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:04.048414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9765484b-17b9-4799-86a7-79b91804253b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:04.049279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9765484b-17b9-4799-86a7-79b91804253b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:04.049747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9765484b-17b9-4799-86a7-79b91804253b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:04.050198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9765484b-17b9-4799-86a7-79b91804253b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:04.233234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9765484b-17b9-4799-86a7-79b91804253b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:04.243801 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9765484b-17b9-4799-86a7-79b91804253b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1532 microversion: 2.1 time: 0.214318 Aug 27 04:37:04.244957 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 719/1479] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:04 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1532 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:04.264075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d3cf798d-2e6d-4ac2-93c8-a504c00133fe tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:04.264671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-01e7f9ce-bc8b-421f-ad3a-fd1b00804bf9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:04.264941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d3cf798d-2e6d-4ac2-93c8-a504c00133fe tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:04.266286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-01e7f9ce-bc8b-421f-ad3a-fd1b00804bf9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:04.273176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01e7f9ce-bc8b-421f-ad3a-fd1b00804bf9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:04.273945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01e7f9ce-bc8b-421f-ad3a-fd1b00804bf9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:04.274545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01e7f9ce-bc8b-421f-ad3a-fd1b00804bf9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:04.275425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3cf798d-2e6d-4ac2-93c8-a504c00133fe tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:04.275597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01e7f9ce-bc8b-421f-ad3a-fd1b00804bf9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:04.276133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3cf798d-2e6d-4ac2-93c8-a504c00133fe tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:04.276398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01e7f9ce-bc8b-421f-ad3a-fd1b00804bf9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:04.276865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3cf798d-2e6d-4ac2-93c8-a504c00133fe tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:04.277178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01e7f9ce-bc8b-421f-ad3a-fd1b00804bf9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:04.278197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3cf798d-2e6d-4ac2-93c8-a504c00133fe tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:04.284231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3cf798d-2e6d-4ac2-93c8-a504c00133fe tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:04.284231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3cf798d-2e6d-4ac2-93c8-a504c00133fe tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:04.358053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-01e7f9ce-bc8b-421f-ad3a-fd1b00804bf9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:04.366842 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-01e7f9ce-bc8b-421f-ad3a-fd1b00804bf9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1283 microversion: 2.1 time: 0.108307 Aug 27 04:37:04.367468 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 720/1480] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:04 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1283 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:04.529422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3cf798d-2e6d-4ac2-93c8-a504c00133fe tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:04.543713 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d3cf798d-2e6d-4ac2-93c8-a504c00133fe tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1535 microversion: 2.1 time: 0.300383 Aug 27 04:37:04.560780 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 761/1481] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:04 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1535 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:04.661297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-861220a7-c445-4d4a-b973-b2a78b9f62fa req-b7fc6969-20bd-48a1-872b-ea9770c02614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea1e00b-093a-4ed1-9640-a2a775d92433", "tag": "d062da01-c364-4876-b2fb-050be39ee311"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:04.663542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2abaa305-5455-461e-9206-fd6bba8c41d9 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:04.664241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2abaa305-5455-461e-9206-fd6bba8c41d9 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:04.679071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abaa305-5455-461e-9206-fd6bba8c41d9 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:04.679569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abaa305-5455-461e-9206-fd6bba8c41d9 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:04.680008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abaa305-5455-461e-9206-fd6bba8c41d9 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:04.683184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abaa305-5455-461e-9206-fd6bba8c41d9 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:04.683691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abaa305-5455-461e-9206-fd6bba8c41d9 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:04.684130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abaa305-5455-461e-9206-fd6bba8c41d9 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:04.709105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-861220a7-c445-4d4a-b973-b2a78b9f62fa req-b7fc6969-20bd-48a1-872b-ea9770c02614 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:04.709917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-861220a7-c445-4d4a-b973-b2a78b9f62fa req-b7fc6969-20bd-48a1-872b-ea9770c02614 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:04.713221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-861220a7-c445-4d4a-b973-b2a78b9f62fa req-b7fc6969-20bd-48a1-872b-ea9770c02614 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:04.757760 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-861220a7-c445-4d4a-b973-b2a78b9f62fa req-b7fc6969-20bd-48a1-872b-ea9770c02614 service nova] Creating event network-changed:d062da01-c364-4876-b2fb-050be39ee311 for instance 4ea1e00b-093a-4ed1-9640-a2a775d92433 on n-h1-854823-1 Aug 27 04:37:04.806394 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-861220a7-c445-4d4a-b973-b2a78b9f62fa req-b7fc6969-20bd-48a1-872b-ea9770c02614 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149052 Aug 27 04:37:04.818413 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 721/1482] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:04.828246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5120438a-b8b3-49b5-b1f3-3abde0e660be tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:04.829532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5120438a-b8b3-49b5-b1f3-3abde0e660be tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:04.839044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5120438a-b8b3-49b5-b1f3-3abde0e660be tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:04.839789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5120438a-b8b3-49b5-b1f3-3abde0e660be tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:04.840663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5120438a-b8b3-49b5-b1f3-3abde0e660be tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:04.841624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5120438a-b8b3-49b5-b1f3-3abde0e660be tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:04.842300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5120438a-b8b3-49b5-b1f3-3abde0e660be tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:04.843757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5120438a-b8b3-49b5-b1f3-3abde0e660be tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:05.003276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2abaa305-5455-461e-9206-fd6bba8c41d9 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:05.045081 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2abaa305-5455-461e-9206-fd6bba8c41d9 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.384864 Aug 27 04:37:05.047514 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 762/1483] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:04 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:05.054290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5780352-f9f2-40bb-b517-660af75afe2f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:05.055233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5780352-f9f2-40bb-b517-660af75afe2f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:05.074320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5780352-f9f2-40bb-b517-660af75afe2f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:05.075239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5780352-f9f2-40bb-b517-660af75afe2f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:05.075923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5780352-f9f2-40bb-b517-660af75afe2f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:05.078745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5780352-f9f2-40bb-b517-660af75afe2f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:05.079526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5780352-f9f2-40bb-b517-660af75afe2f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:05.080191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5780352-f9f2-40bb-b517-660af75afe2f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:05.202188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f5780352-f9f2-40bb-b517-660af75afe2f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:05.224355 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5780352-f9f2-40bb-b517-660af75afe2f tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1275 microversion: 2.1 time: 0.172750 Aug 27 04:37:05.225108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5120438a-b8b3-49b5-b1f3-3abde0e660be tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:05.227473 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 763/1484] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:05 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1275 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:05.242654 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5120438a-b8b3-49b5-b1f3-3abde0e660be tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1504 microversion: 2.1 time: 0.422376 Aug 27 04:37:05.245916 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 722/1485] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:04 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:05.264248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cdffe3c8-9d2c-4eeb-8860-a3882d38398b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f2199c8b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:05.271769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c5499a3b-68f8-4148-bba0-d947c1737144 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:05.275106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c5499a3b-68f8-4148-bba0-d947c1737144 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:05.287679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5499a3b-68f8-4148-bba0-d947c1737144 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:05.293473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5499a3b-68f8-4148-bba0-d947c1737144 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:05.296987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5499a3b-68f8-4148-bba0-d947c1737144 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:05.298611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5499a3b-68f8-4148-bba0-d947c1737144 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:05.301497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5499a3b-68f8-4148-bba0-d947c1737144 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:05.303488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5499a3b-68f8-4148-bba0-d947c1737144 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:05.373684 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cdffe3c8-9d2c-4eeb-8860-a3882d38398b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.142920 Aug 27 04:37:05.375865 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 764/1486] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:05 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:05.392899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-daf9afad-4f0e-4e36-9197-fb9747d4c6a6 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:05.394730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-daf9afad-4f0e-4e36-9197-fb9747d4c6a6 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:05.396104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:05.403114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-daf9afad-4f0e-4e36-9197-fb9747d4c6a6 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:05.407663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-daf9afad-4f0e-4e36-9197-fb9747d4c6a6 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:05.409127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-daf9afad-4f0e-4e36-9197-fb9747d4c6a6 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:05.409899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-daf9afad-4f0e-4e36-9197-fb9747d4c6a6 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:05.410376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-daf9afad-4f0e-4e36-9197-fb9747d4c6a6 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:05.410805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-daf9afad-4f0e-4e36-9197-fb9747d4c6a6 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:05.519961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-daf9afad-4f0e-4e36-9197-fb9747d4c6a6 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:05.530116 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-daf9afad-4f0e-4e36-9197-fb9747d4c6a6 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1283 microversion: 2.1 time: 0.142457 Aug 27 04:37:05.532580 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 765/1487] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:05 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1283 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:05.576087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e88fc574-a530-459e-a558-4b7f073ad904 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:05.577135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e88fc574-a530-459e-a558-4b7f073ad904 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:05.599431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88fc574-a530-459e-a558-4b7f073ad904 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:05.600320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88fc574-a530-459e-a558-4b7f073ad904 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:05.601953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88fc574-a530-459e-a558-4b7f073ad904 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:05.604861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88fc574-a530-459e-a558-4b7f073ad904 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:05.605649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88fc574-a530-459e-a558-4b7f073ad904 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:05.607246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88fc574-a530-459e-a558-4b7f073ad904 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:05.921861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e88fc574-a530-459e-a558-4b7f073ad904 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:05.940977 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e88fc574-a530-459e-a558-4b7f073ad904 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1535 microversion: 2.1 time: 0.371006 Aug 27 04:37:05.942768 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 766/1488] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:05 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1535 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:06.018046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c5499a3b-68f8-4148-bba0-d947c1737144 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:06.026466 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c5499a3b-68f8-4148-bba0-d947c1737144 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1538 microversion: 2.1 time: 0.758742 Aug 27 04:37:06.036956 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 723/1489] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:05 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1538 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:06.070721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b1dec09-783b-4dcc-a31f-8337745bbcc6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:06.076005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b1dec09-783b-4dcc-a31f-8337745bbcc6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:06.096704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b1dec09-783b-4dcc-a31f-8337745bbcc6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:06.097530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b1dec09-783b-4dcc-a31f-8337745bbcc6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:06.098163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b1dec09-783b-4dcc-a31f-8337745bbcc6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:06.100067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b1dec09-783b-4dcc-a31f-8337745bbcc6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:06.101252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b1dec09-783b-4dcc-a31f-8337745bbcc6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:06.101693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b1dec09-783b-4dcc-a31f-8337745bbcc6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:06.270273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f3250d06-6cc6-43f5-a3f4-4e1c5bc23489 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:06.270908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f3250d06-6cc6-43f5-a3f4-4e1c5bc23489 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:06.281572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3250d06-6cc6-43f5-a3f4-4e1c5bc23489 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:06.282568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3250d06-6cc6-43f5-a3f4-4e1c5bc23489 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:06.283186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3250d06-6cc6-43f5-a3f4-4e1c5bc23489 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:06.284795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3250d06-6cc6-43f5-a3f4-4e1c5bc23489 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:06.285519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3250d06-6cc6-43f5-a3f4-4e1c5bc23489 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:06.286421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3250d06-6cc6-43f5-a3f4-4e1c5bc23489 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:06.347047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b1dec09-783b-4dcc-a31f-8337745bbcc6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:06.361853 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b1dec09-783b-4dcc-a31f-8337745bbcc6 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.296475 Aug 27 04:37:06.365184 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 767/1490] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:06 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:06.373637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6678753-3355-44d7-8519-8832914757ed tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:06.374865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e6678753-3355-44d7-8519-8832914757ed tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:06.382966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6678753-3355-44d7-8519-8832914757ed tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:06.384116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6678753-3355-44d7-8519-8832914757ed tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:06.384856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6678753-3355-44d7-8519-8832914757ed tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:06.385796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6678753-3355-44d7-8519-8832914757ed tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:06.386458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6678753-3355-44d7-8519-8832914757ed tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:06.387076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6678753-3355-44d7-8519-8832914757ed tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:06.639542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e6678753-3355-44d7-8519-8832914757ed tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:06.648487 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6678753-3355-44d7-8519-8832914757ed tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1504 microversion: 2.1 time: 0.281562 Aug 27 04:37:06.649346 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 768/1491] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:06 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:06.654155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-831c391b-d5dc-4b1b-87de-c1e145c6959a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21ad1940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:06.745018 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-831c391b-d5dc-4b1b-87de-c1e145c6959a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.093791 Aug 27 04:37:06.747495 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 769/1492] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:06 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:06.752893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ecdd6a1f-7bb7-43b1-a3b4-c35f1f0bfe88 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:06.753796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ecdd6a1f-7bb7-43b1-a3b4-c35f1f0bfe88 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:06.765871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdd6a1f-7bb7-43b1-a3b4-c35f1f0bfe88 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:06.767669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdd6a1f-7bb7-43b1-a3b4-c35f1f0bfe88 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:06.768755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdd6a1f-7bb7-43b1-a3b4-c35f1f0bfe88 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:06.769943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdd6a1f-7bb7-43b1-a3b4-c35f1f0bfe88 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:06.770604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdd6a1f-7bb7-43b1-a3b4-c35f1f0bfe88 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:06.771230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdd6a1f-7bb7-43b1-a3b4-c35f1f0bfe88 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:06.912605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ecdd6a1f-7bb7-43b1-a3b4-c35f1f0bfe88 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:06.926831 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ecdd6a1f-7bb7-43b1-a3b4-c35f1f0bfe88 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1289 microversion: 2.1 time: 0.177763 Aug 27 04:37:06.929240 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 770/1493] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:06 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1289 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:06.965161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54fa39fb-648b-494c-89b8-b1d24baae14d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:06.966348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-54fa39fb-648b-494c-89b8-b1d24baae14d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:06.986659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54fa39fb-648b-494c-89b8-b1d24baae14d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:06.987430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54fa39fb-648b-494c-89b8-b1d24baae14d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:06.988089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54fa39fb-648b-494c-89b8-b1d24baae14d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:06.990354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54fa39fb-648b-494c-89b8-b1d24baae14d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:06.992020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f3250d06-6cc6-43f5-a3f4-4e1c5bc23489 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:06.992287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54fa39fb-648b-494c-89b8-b1d24baae14d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:06.993024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54fa39fb-648b-494c-89b8-b1d24baae14d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:07.003373 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f3250d06-6cc6-43f5-a3f4-4e1c5bc23489 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1317 microversion: 2.1 time: 0.737780 Aug 27 04:37:07.014075 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 724/1494] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:06 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1317 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:07.057009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-38e70e5e-c3f2-4b42-ad26-cd613ae9bbe4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:07.058558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-38e70e5e-c3f2-4b42-ad26-cd613ae9bbe4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:07.092037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38e70e5e-c3f2-4b42-ad26-cd613ae9bbe4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:07.105272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38e70e5e-c3f2-4b42-ad26-cd613ae9bbe4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:07.107278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38e70e5e-c3f2-4b42-ad26-cd613ae9bbe4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:07.118336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38e70e5e-c3f2-4b42-ad26-cd613ae9bbe4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:07.120648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38e70e5e-c3f2-4b42-ad26-cd613ae9bbe4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:07.126633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38e70e5e-c3f2-4b42-ad26-cd613ae9bbe4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:07.238301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-54fa39fb-648b-494c-89b8-b1d24baae14d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:07.248480 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-54fa39fb-648b-494c-89b8-b1d24baae14d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1528 microversion: 2.1 time: 0.288303 Aug 27 04:37:07.250042 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 771/1495] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:06 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1528 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:07.275561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f958d133-d72c-4ad2-bdc1-cfb790b6ab36 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:07.277071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f958d133-d72c-4ad2-bdc1-cfb790b6ab36 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:07.292898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f958d133-d72c-4ad2-bdc1-cfb790b6ab36 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:07.293407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f958d133-d72c-4ad2-bdc1-cfb790b6ab36 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:07.293944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f958d133-d72c-4ad2-bdc1-cfb790b6ab36 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:07.305052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f958d133-d72c-4ad2-bdc1-cfb790b6ab36 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:07.305756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f958d133-d72c-4ad2-bdc1-cfb790b6ab36 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:07.306402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f958d133-d72c-4ad2-bdc1-cfb790b6ab36 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:07.517069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f958d133-d72c-4ad2-bdc1-cfb790b6ab36 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:07.520724 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f958d133-d72c-4ad2-bdc1-cfb790b6ab36 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1528 microversion: 2.1 time: 0.252131 Aug 27 04:37:07.522581 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 772/1496] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:07 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1528 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:07.527565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-380b03b7-f790-440d-a316-70a1987907a8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:07.528114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-380b03b7-f790-440d-a316-70a1987907a8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:07.535097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-380b03b7-f790-440d-a316-70a1987907a8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:07.535805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-380b03b7-f790-440d-a316-70a1987907a8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:07.537224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-380b03b7-f790-440d-a316-70a1987907a8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:07.538479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-380b03b7-f790-440d-a316-70a1987907a8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:07.538588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-380b03b7-f790-440d-a316-70a1987907a8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:07.539008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-380b03b7-f790-440d-a316-70a1987907a8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:07.717935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-380b03b7-f790-440d-a316-70a1987907a8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:07.730421 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-380b03b7-f790-440d-a316-70a1987907a8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.206682 Aug 27 04:37:07.731657 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 773/1497] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:07 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:07.737564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6651244b-e856-4e7f-b07c-0452041aed58 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:07.745456 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6651244b-e856-4e7f-b07c-0452041aed58 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] HTTP exception thrown: Flavor 919800fe-1d2c-4a01-8922-75552dca4a0c could not be found. Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6651244b-e856-4e7f-b07c-0452041aed58 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Request method failure captured: Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/flavors/919800fe-1d2c-4a01-8922-75552dca4a0c HTTP/1.1 Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ6Cp4eMheh6Ay72qL1diTem0waweJhzfpNq1BXfQGmJQdraCmSitogYonMpDYBihFqybK9kBG4euOK3XoO9BZPa-F6SDJU8D_hTmbT3ZKqibJr0VKBRUWfh1b7jsEX26yo1Bnzl9G5jDAVcOpun3Kia4f82Wv9qOMVlQI0l_KK7u9g Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: c24f008b1e264b1eb9f445a75a9eb777 Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-MigrationsAdminTest-239546011 Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:37:07.773221 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:37:07.774903 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c24f008b1e264b1eb9f445a75a9eb777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c24f008b1e264b1eb9f445a75a9eb777"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c24f008b1e264b1eb9f445a75a9eb777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c24f008b1e264b1eb9f445a75a9eb777"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:07.774903 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-MigrationsAdminTest-239546011 Aug 27 04:37:07.774903 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: c24f008b1e264b1eb9f445a75a9eb777 Aug 27 04:37:07.774903 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-MigrationsAdminTest-239546011 Aug 27 04:37:07.774903 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-MigrationsAdminTest-239546011-project-admin Aug 27 04:37:07.774903 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:37:07.774903 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:37:07.774903 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: ce16e77bed80442e8bcdbd3a1712fbe8 Aug 27 04:37:07.774903 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-MigrationsAdminTest-239546011-project-admin Aug 27 04:37:07.774903 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:37:07.774903 n-d-854823-1 devstack@n-api.service[128869]: exception: Flavor 919800fe-1d2c-4a01-8922-75552dca4a0c could not be found. Aug 27 04:37:07.774903 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '919800fe-1d2c-4a01-8922-75552dca4a0c'} Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 919800fe-1d2c-4a01-8922-75552dca4a0c could not be found. Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:07.776015 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 919800fe-1d2c-4a01-8922-75552dca4a0c could not be found. Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 919800fe-1d2c-4a01-8922-75552dca4a0c could not be found. Aug 27 04:37:07.777701 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:07.780322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6651244b-e856-4e7f-b07c-0452041aed58 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Returning 404 to user: Flavor 919800fe-1d2c-4a01-8922-75552dca4a0c could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:07.783544 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6651244b-e856-4e7f-b07c-0452041aed58 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/919800fe-1d2c-4a01-8922-75552dca4a0c" status: 404 len: 109 microversion: 2.1 time: 0.050498 Aug 27 04:37:07.784358 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 774/1498] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:37:07 2022] DELETE /compute/v2.1/flavors/919800fe-1d2c-4a01-8922-75552dca4a0c => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:37:07.791678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a05fa9b-9292-43d4-980e-427249a0889c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:07.792565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a05fa9b-9292-43d4-980e-427249a0889c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:07.802131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a05fa9b-9292-43d4-980e-427249a0889c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:07.802891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a05fa9b-9292-43d4-980e-427249a0889c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:07.803607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a05fa9b-9292-43d4-980e-427249a0889c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:07.804576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a05fa9b-9292-43d4-980e-427249a0889c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:07.805200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a05fa9b-9292-43d4-980e-427249a0889c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:07.805822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a05fa9b-9292-43d4-980e-427249a0889c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:08.090201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a05fa9b-9292-43d4-980e-427249a0889c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:08.101965 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a05fa9b-9292-43d4-980e-427249a0889c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1504 microversion: 2.1 time: 0.315764 Aug 27 04:37:08.102852 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 775/1499] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:07 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:08.111589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d5df3ef-dcbd-4e3e-81d3-8e10fea028fe tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f2197b700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:08.171939 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d5df3ef-dcbd-4e3e-81d3-8e10fea028fe tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.067997 Aug 27 04:37:08.173157 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 776/1500] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:08 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:08.178130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e3cc09e-5261-42f1-9a90-bbb6389f54b0 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:08.178791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e3cc09e-5261-42f1-9a90-bbb6389f54b0 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:08.185155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e3cc09e-5261-42f1-9a90-bbb6389f54b0 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:08.185662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e3cc09e-5261-42f1-9a90-bbb6389f54b0 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:08.186139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e3cc09e-5261-42f1-9a90-bbb6389f54b0 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:08.187065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e3cc09e-5261-42f1-9a90-bbb6389f54b0 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:08.187523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e3cc09e-5261-42f1-9a90-bbb6389f54b0 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:08.188101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e3cc09e-5261-42f1-9a90-bbb6389f54b0 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:08.303265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-38e70e5e-c3f2-4b42-ad26-cd613ae9bbe4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:08.315091 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-38e70e5e-c3f2-4b42-ad26-cd613ae9bbe4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1538 microversion: 2.1 time: 1.263840 Aug 27 04:37:08.322892 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 725/1501] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:07 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1538 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:08.335544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1199918751", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:08.445215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:37:08.481926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7e3cc09e-5261-42f1-9a90-bbb6389f54b0 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:08.486176 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e3cc09e-5261-42f1-9a90-bbb6389f54b0 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1331 microversion: 2.1 time: 0.311697 Aug 27 04:37:08.487079 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 777/1502] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:08 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1331 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:08.491784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b620ee8-fdd8-4ff2-9c33-fcd461792559 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:08.492392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b620ee8-fdd8-4ff2-9c33-fcd461792559 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:08.506402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b620ee8-fdd8-4ff2-9c33-fcd461792559 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:08.506896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b620ee8-fdd8-4ff2-9c33-fcd461792559 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:08.507332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b620ee8-fdd8-4ff2-9c33-fcd461792559 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:08.508045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b620ee8-fdd8-4ff2-9c33-fcd461792559 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:08.508503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b620ee8-fdd8-4ff2-9c33-fcd461792559 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:08.508980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b620ee8-fdd8-4ff2-9c33-fcd461792559 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:08.677147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b620ee8-fdd8-4ff2-9c33-fcd461792559 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:08.701694 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b620ee8-fdd8-4ff2-9c33-fcd461792559 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1317 microversion: 2.1 time: 0.208672 Aug 27 04:37:08.720343 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 778/1503] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:08 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:08.754392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a54d7f2-ccd7-4d0b-a61f-c40df2023089 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:08.755037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a54d7f2-ccd7-4d0b-a61f-c40df2023089 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:08.761251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a54d7f2-ccd7-4d0b-a61f-c40df2023089 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:08.761798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a54d7f2-ccd7-4d0b-a61f-c40df2023089 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:08.762232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a54d7f2-ccd7-4d0b-a61f-c40df2023089 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:08.763005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a54d7f2-ccd7-4d0b-a61f-c40df2023089 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:08.763489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a54d7f2-ccd7-4d0b-a61f-c40df2023089 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:08.764094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a54d7f2-ccd7-4d0b-a61f-c40df2023089 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:08.934044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a54d7f2-ccd7-4d0b-a61f-c40df2023089 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:08.943656 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a54d7f2-ccd7-4d0b-a61f-c40df2023089 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.194979 Aug 27 04:37:08.944247 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 779/1504] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:08 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:09.126600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14f46744-f2af-4d4a-b2c1-e4f554f2e1ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:09.127146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14f46744-f2af-4d4a-b2c1-e4f554f2e1ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:09.133747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14f46744-f2af-4d4a-b2c1-e4f554f2e1ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:09.134228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14f46744-f2af-4d4a-b2c1-e4f554f2e1ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:09.134660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14f46744-f2af-4d4a-b2c1-e4f554f2e1ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:09.135399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14f46744-f2af-4d4a-b2c1-e4f554f2e1ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:09.135840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14f46744-f2af-4d4a-b2c1-e4f554f2e1ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:09.136256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14f46744-f2af-4d4a-b2c1-e4f554f2e1ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:09.150748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:37:09.151070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:37:09.151588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:37:09.152229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:37:09.152555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:37:09.164067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:09.164901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:09.165777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:09.167612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:09.168348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:09.168998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:09.189995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Getting quotas for project abfa50b6f05c4413b2a96f2490ac43a1. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:37:09.196941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Getting quotas for user 7e6454ced7834bbdaeee89ccef19f510 and project abfa50b6f05c4413b2a96f2490ac43a1. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:37:09.219812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:37:09.222679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:37:09.306889 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cafebad2-0a81-4f06-ab64-c8b51a61b677 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982422 Aug 27 04:37:09.308816 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 726/1505] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:37:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:37:09.315201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7e42f2ab-94ff-494e-a25f-df0b6b987176 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25e4adc0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:09.413976 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7e42f2ab-94ff-494e-a25f-df0b6b987176 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.102273 Aug 27 04:37:09.422404 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 727/1506] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:09 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:09.428844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-df285311-6031-4cb4-a3ec-0030a958ddf8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:09.429745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-df285311-6031-4cb4-a3ec-0030a958ddf8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:09.432134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14f46744-f2af-4d4a-b2c1-e4f554f2e1ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:09.434738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:09.449638 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14f46744-f2af-4d4a-b2c1-e4f554f2e1ef tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1504 microversion: 2.1 time: 0.329752 Aug 27 04:37:09.463373 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 780/1507] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:09 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:09.463373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8902a117-7def-40e7-8a6a-1c7e95af54af tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:09.463373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8902a117-7def-40e7-8a6a-1c7e95af54af tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:09.465853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8902a117-7def-40e7-8a6a-1c7e95af54af tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:09.467443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8902a117-7def-40e7-8a6a-1c7e95af54af tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:09.468413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8902a117-7def-40e7-8a6a-1c7e95af54af tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:09.469171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8902a117-7def-40e7-8a6a-1c7e95af54af tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:09.469626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8902a117-7def-40e7-8a6a-1c7e95af54af tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:09.470050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8902a117-7def-40e7-8a6a-1c7e95af54af tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:09.562794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-df285311-6031-4cb4-a3ec-0030a958ddf8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:09.574685 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-df285311-6031-4cb4-a3ec-0030a958ddf8 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1213 microversion: 2.1 time: 0.147707 Aug 27 04:37:09.575352 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 728/1508] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:09 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1213 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:09.587181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb4d4e95-7916-4d40-b5c2-9e329e69457d tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:09.589096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eb4d4e95-7916-4d40-b5c2-9e329e69457d tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:09.609360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb4d4e95-7916-4d40-b5c2-9e329e69457d tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:09.610389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb4d4e95-7916-4d40-b5c2-9e329e69457d tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:09.611005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb4d4e95-7916-4d40-b5c2-9e329e69457d tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:09.611679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb4d4e95-7916-4d40-b5c2-9e329e69457d tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:09.612199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb4d4e95-7916-4d40-b5c2-9e329e69457d tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:09.612664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb4d4e95-7916-4d40-b5c2-9e329e69457d tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:09.665652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:09.788986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8902a117-7def-40e7-8a6a-1c7e95af54af tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:09.800446 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8902a117-7def-40e7-8a6a-1c7e95af54af tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1538 microversion: 2.1 time: 0.346940 Aug 27 04:37:09.815468 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 781/1509] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:09 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1538 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:09.828635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-843eea7f-0e30-49f8-86de-032c13a73a22 req-77e3bf1a-f4ac-4cbf-b982-7716665dcbcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4587847a-63e5-46b3-a643-6643f65a5052", "tag": "e75f6944-2f19-47fd-9ee7-c9527f987d75"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:09.839529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-843eea7f-0e30-49f8-86de-032c13a73a22 req-77e3bf1a-f4ac-4cbf-b982-7716665dcbcd service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:09.840271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-843eea7f-0e30-49f8-86de-032c13a73a22 req-77e3bf1a-f4ac-4cbf-b982-7716665dcbcd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:09.841102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-843eea7f-0e30-49f8-86de-032c13a73a22 req-77e3bf1a-f4ac-4cbf-b982-7716665dcbcd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:09.855208 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-843eea7f-0e30-49f8-86de-032c13a73a22 req-77e3bf1a-f4ac-4cbf-b982-7716665dcbcd service nova] Creating event network-changed:e75f6944-2f19-47fd-9ee7-c9527f987d75 for instance 4587847a-63e5-46b3-a643-6643f65a5052 on n-h2-854823-1 Aug 27 04:37:09.861365 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-843eea7f-0e30-49f8-86de-032c13a73a22 req-77e3bf1a-f4ac-4cbf-b982-7716665dcbcd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045006 Aug 27 04:37:09.862589 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 782/1510] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:09.868282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c24fe11-a339-4a5c-a903-ecc7f4565cec tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:09.870023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c24fe11-a339-4a5c-a903-ecc7f4565cec tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:09.878162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c24fe11-a339-4a5c-a903-ecc7f4565cec tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:09.878829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c24fe11-a339-4a5c-a903-ecc7f4565cec tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:09.879493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c24fe11-a339-4a5c-a903-ecc7f4565cec tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:09.880493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c24fe11-a339-4a5c-a903-ecc7f4565cec tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:09.881364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c24fe11-a339-4a5c-a903-ecc7f4565cec tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:09.881952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c24fe11-a339-4a5c-a903-ecc7f4565cec tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:10.128133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c24fe11-a339-4a5c-a903-ecc7f4565cec tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:10.144053 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c24fe11-a339-4a5c-a903-ecc7f4565cec tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1317 microversion: 2.1 time: 0.279984 Aug 27 04:37:10.145323 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 783/1511] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:09 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:10.152426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3dbb80aa-5c66-4a2c-8397-f9fd361a8899 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:10.153823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3dbb80aa-5c66-4a2c-8397-f9fd361a8899 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:10.162577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dbb80aa-5c66-4a2c-8397-f9fd361a8899 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:10.163631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dbb80aa-5c66-4a2c-8397-f9fd361a8899 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:10.167235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dbb80aa-5c66-4a2c-8397-f9fd361a8899 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:10.168546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dbb80aa-5c66-4a2c-8397-f9fd361a8899 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:10.169309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dbb80aa-5c66-4a2c-8397-f9fd361a8899 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:10.170070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dbb80aa-5c66-4a2c-8397-f9fd361a8899 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:10.248329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb4d4e95-7916-4d40-b5c2-9e329e69457d tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:10.263207 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb4d4e95-7916-4d40-b5c2-9e329e69457d tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1331 microversion: 2.1 time: 0.686695 Aug 27 04:37:10.265564 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 729/1512] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:09 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1331 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:10.279895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-980e69db-1e67-46fb-b089-a06dedbc1bfd req-fb769f14-48db-4f29-834d-c7f3a323d702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6aa77e-f369-461e-9cf6-d9bd0dad016b", "name": "network-vif-plugged", "status": "completed", "tag": "134f0809-a07c-4cc3-8067-54f430a3368d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:10.305707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-980e69db-1e67-46fb-b089-a06dedbc1bfd req-fb769f14-48db-4f29-834d-c7f3a323d702 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:10.307088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-980e69db-1e67-46fb-b089-a06dedbc1bfd req-fb769f14-48db-4f29-834d-c7f3a323d702 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:10.308189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-980e69db-1e67-46fb-b089-a06dedbc1bfd req-fb769f14-48db-4f29-834d-c7f3a323d702 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:10.331395 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-980e69db-1e67-46fb-b089-a06dedbc1bfd req-fb769f14-48db-4f29-834d-c7f3a323d702 service nova] Creating event network-vif-plugged:134f0809-a07c-4cc3-8067-54f430a3368d for instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b on n-h1-854823-1 Aug 27 04:37:10.352596 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-980e69db-1e67-46fb-b089-a06dedbc1bfd req-fb769f14-48db-4f29-834d-c7f3a323d702 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082662 Aug 27 04:37:10.355717 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 730/1513] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:10.444385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2dd36507-41f1-4f3f-b418-b9a8249ebd6b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25e71ee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:10.518518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3dbb80aa-5c66-4a2c-8397-f9fd361a8899 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:10.526430 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3dbb80aa-5c66-4a2c-8397-f9fd361a8899 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.379420 Aug 27 04:37:10.527015 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 784/1514] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:10 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:10.535527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97764168-d8c4-4791-ab56-5afc0d8205a4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:10.536138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97764168-d8c4-4791-ab56-5afc0d8205a4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:10.554157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97764168-d8c4-4791-ab56-5afc0d8205a4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:10.554882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97764168-d8c4-4791-ab56-5afc0d8205a4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:10.555490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97764168-d8c4-4791-ab56-5afc0d8205a4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:10.556355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97764168-d8c4-4791-ab56-5afc0d8205a4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:10.557018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97764168-d8c4-4791-ab56-5afc0d8205a4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:10.557602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97764168-d8c4-4791-ab56-5afc0d8205a4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:10.557980 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2dd36507-41f1-4f3f-b418-b9a8249ebd6b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.124443 Aug 27 04:37:10.559138 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 731/1515] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:10 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:10.598383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-41aeafd9-9e46-4594-9321-60112c866f3a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:10.599434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-41aeafd9-9e46-4594-9321-60112c866f3a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:10.613313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41aeafd9-9e46-4594-9321-60112c866f3a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:10.619730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41aeafd9-9e46-4594-9321-60112c866f3a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:10.620664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41aeafd9-9e46-4594-9321-60112c866f3a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:10.621882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41aeafd9-9e46-4594-9321-60112c866f3a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:10.622496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41aeafd9-9e46-4594-9321-60112c866f3a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:10.622990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41aeafd9-9e46-4594-9321-60112c866f3a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:10.761079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97764168-d8c4-4791-ab56-5afc0d8205a4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:10.773227 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97764168-d8c4-4791-ab56-5afc0d8205a4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1504 microversion: 2.1 time: 0.244934 Aug 27 04:37:10.774471 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 785/1516] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:10 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:10.808604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-41aeafd9-9e46-4594-9321-60112c866f3a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:10.819385 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-41aeafd9-9e46-4594-9321-60112c866f3a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1209 microversion: 2.1 time: 0.226162 Aug 27 04:37:10.834974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f499024-af2d-4878-a1d5-5c4acc51a953 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:10.834974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3f499024-af2d-4878-a1d5-5c4acc51a953 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:10.836311 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 732/1517] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:10 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1209 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:10.848711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f499024-af2d-4878-a1d5-5c4acc51a953 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:10.849479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f499024-af2d-4878-a1d5-5c4acc51a953 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:10.850094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f499024-af2d-4878-a1d5-5c4acc51a953 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:10.851072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f499024-af2d-4878-a1d5-5c4acc51a953 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:10.851694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f499024-af2d-4878-a1d5-5c4acc51a953 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:10.852295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f499024-af2d-4878-a1d5-5c4acc51a953 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:11.049842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f499024-af2d-4878-a1d5-5c4acc51a953 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:11.060076 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f499024-af2d-4878-a1d5-5c4acc51a953 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1538 microversion: 2.1 time: 0.240739 Aug 27 04:37:11.066171 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 786/1518] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:10 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1538 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:11.167525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb5dd666-9f74-4ea8-87b8-c5281f580442 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:11.168785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eb5dd666-9f74-4ea8-87b8-c5281f580442 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:11.179257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb5dd666-9f74-4ea8-87b8-c5281f580442 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:11.179871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb5dd666-9f74-4ea8-87b8-c5281f580442 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:11.180619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb5dd666-9f74-4ea8-87b8-c5281f580442 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:11.181563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb5dd666-9f74-4ea8-87b8-c5281f580442 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:11.182317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb5dd666-9f74-4ea8-87b8-c5281f580442 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:11.182947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb5dd666-9f74-4ea8-87b8-c5281f580442 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:11.293777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f84a6b5-232a-4af1-8028-7ca7628f6c11 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:11.294394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f84a6b5-232a-4af1-8028-7ca7628f6c11 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:11.309533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f84a6b5-232a-4af1-8028-7ca7628f6c11 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:11.309533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f84a6b5-232a-4af1-8028-7ca7628f6c11 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:11.309873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f84a6b5-232a-4af1-8028-7ca7628f6c11 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:11.310382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f84a6b5-232a-4af1-8028-7ca7628f6c11 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:11.310836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f84a6b5-232a-4af1-8028-7ca7628f6c11 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:11.311736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f84a6b5-232a-4af1-8028-7ca7628f6c11 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:11.503962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f84a6b5-232a-4af1-8028-7ca7628f6c11 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:11.535581 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f84a6b5-232a-4af1-8028-7ca7628f6c11 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1331 microversion: 2.1 time: 0.245866 Aug 27 04:37:11.536574 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 787/1519] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:11 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1331 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:11.554999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-61579cbc-82fe-433c-8df0-3c7088bffc6e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:11.555665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-61579cbc-82fe-433c-8df0-3c7088bffc6e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:11.562805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61579cbc-82fe-433c-8df0-3c7088bffc6e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:11.563442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61579cbc-82fe-433c-8df0-3c7088bffc6e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:11.563901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61579cbc-82fe-433c-8df0-3c7088bffc6e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:11.564658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61579cbc-82fe-433c-8df0-3c7088bffc6e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:11.565132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61579cbc-82fe-433c-8df0-3c7088bffc6e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:11.565560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61579cbc-82fe-433c-8df0-3c7088bffc6e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:11.690974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb5dd666-9f74-4ea8-87b8-c5281f580442 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:11.699510 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb5dd666-9f74-4ea8-87b8-c5281f580442 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1317 microversion: 2.1 time: 0.535953 Aug 27 04:37:11.703711 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 733/1520] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:11 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:11.719943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a76ddb4e-df83-425c-a8b4-b3cac7688998 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f2174b9d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:11.774188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-61579cbc-82fe-433c-8df0-3c7088bffc6e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:11.788691 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-61579cbc-82fe-433c-8df0-3c7088bffc6e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.235303 Aug 27 04:37:11.793645 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 788/1521] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:11 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:11.810990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6dc3ab0-1d8c-4fb1-91b1-218eb179d1e5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:11.814551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6dc3ab0-1d8c-4fb1-91b1-218eb179d1e5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:11.829383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6dc3ab0-1d8c-4fb1-91b1-218eb179d1e5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:11.830185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6dc3ab0-1d8c-4fb1-91b1-218eb179d1e5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:11.831254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6dc3ab0-1d8c-4fb1-91b1-218eb179d1e5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:11.832190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6dc3ab0-1d8c-4fb1-91b1-218eb179d1e5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:11.833151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6dc3ab0-1d8c-4fb1-91b1-218eb179d1e5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:11.833736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6dc3ab0-1d8c-4fb1-91b1-218eb179d1e5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:11.852159 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a76ddb4e-df83-425c-a8b4-b3cac7688998 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.144837 Aug 27 04:37:11.855018 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 734/1522] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:11 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:11.867229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-22424877-f93a-4546-94d0-1eda014015e3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:11.868146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-22424877-f93a-4546-94d0-1eda014015e3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:11.880795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22424877-f93a-4546-94d0-1eda014015e3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:11.885538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22424877-f93a-4546-94d0-1eda014015e3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:11.886824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22424877-f93a-4546-94d0-1eda014015e3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:11.887916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22424877-f93a-4546-94d0-1eda014015e3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:11.888511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22424877-f93a-4546-94d0-1eda014015e3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:11.889069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22424877-f93a-4546-94d0-1eda014015e3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:12.005626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-22424877-f93a-4546-94d0-1eda014015e3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:12.014072 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-22424877-f93a-4546-94d0-1eda014015e3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1273 microversion: 2.1 time: 0.157621 Aug 27 04:37:12.028765 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 735/1523] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:11 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:12.034025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-06259414-1368-41be-b346-9fc6039cbdb5 req-fd555782-d4b9-4f6c-946e-c879277838a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "399bd6c1-40d1-463d-be8a-d63d5e31e32c", "tag": "d5ab4a86-3f84-45fc-bed7-5c705b957f6c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:12.054375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-06259414-1368-41be-b346-9fc6039cbdb5 req-fd555782-d4b9-4f6c-946e-c879277838a6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:12.055154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-06259414-1368-41be-b346-9fc6039cbdb5 req-fd555782-d4b9-4f6c-946e-c879277838a6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:12.055799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-06259414-1368-41be-b346-9fc6039cbdb5 req-fd555782-d4b9-4f6c-946e-c879277838a6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:12.081397 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-06259414-1368-41be-b346-9fc6039cbdb5 req-fd555782-d4b9-4f6c-946e-c879277838a6 service nova] Creating event network-changed:d5ab4a86-3f84-45fc-bed7-5c705b957f6c for instance 399bd6c1-40d1-463d-be8a-d63d5e31e32c on n-h2-854823-1 Aug 27 04:37:12.089205 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-06259414-1368-41be-b346-9fc6039cbdb5 req-fd555782-d4b9-4f6c-946e-c879277838a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058810 Aug 27 04:37:12.090616 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 736/1524] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:12.105159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2d556d49-c140-4c59-9a72-faed8b0152e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:12.106118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2d556d49-c140-4c59-9a72-faed8b0152e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:12.126943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d556d49-c140-4c59-9a72-faed8b0152e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:12.127756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d556d49-c140-4c59-9a72-faed8b0152e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:12.128626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d556d49-c140-4c59-9a72-faed8b0152e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:12.132442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d556d49-c140-4c59-9a72-faed8b0152e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:12.133252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d556d49-c140-4c59-9a72-faed8b0152e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:12.133883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d556d49-c140-4c59-9a72-faed8b0152e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:12.234048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f6dc3ab0-1d8c-4fb1-91b1-218eb179d1e5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:12.250651 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6dc3ab0-1d8c-4fb1-91b1-218eb179d1e5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1504 microversion: 2.1 time: 0.454706 Aug 27 04:37:12.264253 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 789/1525] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:11 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1504 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:12.336926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2d556d49-c140-4c59-9a72-faed8b0152e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:12.347352 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2d556d49-c140-4c59-9a72-faed8b0152e4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1520 microversion: 2.1 time: 0.255188 Aug 27 04:37:12.348568 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 737/1526] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:12 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:12.371614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6f5e6f5-7ee4-4f93-b52d-2d908a9c0c48 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:12.371950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6f5e6f5-7ee4-4f93-b52d-2d908a9c0c48 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:12.383887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6f5e6f5-7ee4-4f93-b52d-2d908a9c0c48 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:12.384397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6f5e6f5-7ee4-4f93-b52d-2d908a9c0c48 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:12.384791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e5744e66-b73d-402d-bef9-76920dc8cd3d req-2f47418d-433c-4662-a0ac-ce20c3a39dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7984297a-0070-487d-83cb-a4e4d97aa5ba", "name": "network-vif-plugged", "status": "completed", "tag": "9bf4e91c-b1ee-46b0-ab4c-5e3b87d4673b"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:12.387774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6f5e6f5-7ee4-4f93-b52d-2d908a9c0c48 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:12.392775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6f5e6f5-7ee4-4f93-b52d-2d908a9c0c48 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:12.393325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6f5e6f5-7ee4-4f93-b52d-2d908a9c0c48 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:12.395809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e5744e66-b73d-402d-bef9-76920dc8cd3d req-2f47418d-433c-4662-a0ac-ce20c3a39dbd service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:12.396322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e5744e66-b73d-402d-bef9-76920dc8cd3d req-2f47418d-433c-4662-a0ac-ce20c3a39dbd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:12.396797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e5744e66-b73d-402d-bef9-76920dc8cd3d req-2f47418d-433c-4662-a0ac-ce20c3a39dbd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:12.399606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6f5e6f5-7ee4-4f93-b52d-2d908a9c0c48 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:12.426339 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e5744e66-b73d-402d-bef9-76920dc8cd3d req-2f47418d-433c-4662-a0ac-ce20c3a39dbd service nova] Creating event network-vif-plugged:9bf4e91c-b1ee-46b0-ab4c-5e3b87d4673b for instance 7984297a-0070-487d-83cb-a4e4d97aa5ba on n-h1-854823-1 Aug 27 04:37:12.440760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6f5e6f5-7ee4-4f93-b52d-2d908a9c0c48 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:37:12.444106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:12.466299 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e5744e66-b73d-402d-bef9-76920dc8cd3d req-2f47418d-433c-4662-a0ac-ce20c3a39dbd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079808 Aug 27 04:37:12.475157 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 738/1527] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:12.547670 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6f5e6f5-7ee4-4f93-b52d-2d908a9c0c48 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 204 len: 0 microversion: 2.1 time: 0.181564 Aug 27 04:37:12.551845 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 790/1528] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:37:12 2022] DELETE /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:12.557561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abe2cec3-649d-4b86-bdae-f3c00985c084 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:12.558538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-abe2cec3-649d-4b86-bdae-f3c00985c084 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:12.562524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7a731ae4-0f99-4b67-80bd-cfeec21a1f4d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:12.564177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7a731ae4-0f99-4b67-80bd-cfeec21a1f4d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:12.571811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:12.577742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a731ae4-0f99-4b67-80bd-cfeec21a1f4d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:12.578511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a731ae4-0f99-4b67-80bd-cfeec21a1f4d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:12.579682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abe2cec3-649d-4b86-bdae-f3c00985c084 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:12.580189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abe2cec3-649d-4b86-bdae-f3c00985c084 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:12.580660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abe2cec3-649d-4b86-bdae-f3c00985c084 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:12.582236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abe2cec3-649d-4b86-bdae-f3c00985c084 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:12.582714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abe2cec3-649d-4b86-bdae-f3c00985c084 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:12.583146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abe2cec3-649d-4b86-bdae-f3c00985c084 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:12.584991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a731ae4-0f99-4b67-80bd-cfeec21a1f4d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:12.586418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a731ae4-0f99-4b67-80bd-cfeec21a1f4d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:12.588045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a731ae4-0f99-4b67-80bd-cfeec21a1f4d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:12.592624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a731ae4-0f99-4b67-80bd-cfeec21a1f4d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:12.773031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7a731ae4-0f99-4b67-80bd-cfeec21a1f4d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:12.782935 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7a731ae4-0f99-4b67-80bd-cfeec21a1f4d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1526 microversion: 2.1 time: 0.229373 Aug 27 04:37:12.783537 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 739/1529] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:12 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1526 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:12.788936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-abe2cec3-649d-4b86-bdae-f3c00985c084 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:12.793111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0629b680-5258-4b2e-8ce5-70bce114f042 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:12.794124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0629b680-5258-4b2e-8ce5-70bce114f042 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:12.798675 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-abe2cec3-649d-4b86-bdae-f3c00985c084 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1331 microversion: 2.1 time: 0.245476 Aug 27 04:37:12.802099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0629b680-5258-4b2e-8ce5-70bce114f042 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:12.802601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0629b680-5258-4b2e-8ce5-70bce114f042 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:12.803048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0629b680-5258-4b2e-8ce5-70bce114f042 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:12.803757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0629b680-5258-4b2e-8ce5-70bce114f042 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:12.804382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0629b680-5258-4b2e-8ce5-70bce114f042 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:12.805509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0629b680-5258-4b2e-8ce5-70bce114f042 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:12.817296 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 791/1530] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:12 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1331 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:12.822586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8543ad5c-5048-4814-b642-dfdb6c5e6ddc tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:12.822921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8543ad5c-5048-4814-b642-dfdb6c5e6ddc tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:12.841442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8543ad5c-5048-4814-b642-dfdb6c5e6ddc tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:12.842645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8543ad5c-5048-4814-b642-dfdb6c5e6ddc tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:12.844089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8543ad5c-5048-4814-b642-dfdb6c5e6ddc tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:12.846638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8543ad5c-5048-4814-b642-dfdb6c5e6ddc tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:12.847353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8543ad5c-5048-4814-b642-dfdb6c5e6ddc tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:12.851251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8543ad5c-5048-4814-b642-dfdb6c5e6ddc tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:13.003080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0629b680-5258-4b2e-8ce5-70bce114f042 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:13.012294 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0629b680-5258-4b2e-8ce5-70bce114f042 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1317 microversion: 2.1 time: 0.225246 Aug 27 04:37:13.013132 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 740/1531] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:12 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:13.025805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef2d697a-610d-499d-8366-17a39ff260f9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25e25ca0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:13.088879 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ef2d697a-610d-499d-8366-17a39ff260f9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.074511 Aug 27 04:37:13.096981 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 741/1532] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:13 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:13.102316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2f7e0680-10f7-48d9-bce1-926dcd7f2ea6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:13.102939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2f7e0680-10f7-48d9-bce1-926dcd7f2ea6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:13.110297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f7e0680-10f7-48d9-bce1-926dcd7f2ea6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:13.111106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f7e0680-10f7-48d9-bce1-926dcd7f2ea6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:13.111745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f7e0680-10f7-48d9-bce1-926dcd7f2ea6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:13.112468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f7e0680-10f7-48d9-bce1-926dcd7f2ea6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:13.112956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f7e0680-10f7-48d9-bce1-926dcd7f2ea6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:13.113563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f7e0680-10f7-48d9-bce1-926dcd7f2ea6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:13.236200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:13.272806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8543ad5c-5048-4814-b642-dfdb6c5e6ddc tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:13.286487 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8543ad5c-5048-4814-b642-dfdb6c5e6ddc tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.467530 Aug 27 04:37:13.289165 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 792/1533] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:12 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:13.296840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18ef57eb-4546-4b57-9778-d8d11e3c4b25 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:13.299098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18ef57eb-4546-4b57-9778-d8d11e3c4b25 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:13.320878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ef57eb-4546-4b57-9778-d8d11e3c4b25 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:13.322668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ef57eb-4546-4b57-9778-d8d11e3c4b25 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:13.326735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ef57eb-4546-4b57-9778-d8d11e3c4b25 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:13.330168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ef57eb-4546-4b57-9778-d8d11e3c4b25 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:13.332544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ef57eb-4546-4b57-9778-d8d11e3c4b25 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:13.332544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ef57eb-4546-4b57-9778-d8d11e3c4b25 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:13.476454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2f7e0680-10f7-48d9-bce1-926dcd7f2ea6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:13.490713 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2f7e0680-10f7-48d9-bce1-926dcd7f2ea6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1313 microversion: 2.1 time: 0.392368 Aug 27 04:37:13.511773 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 742/1534] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:13 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:13.637401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18ef57eb-4546-4b57-9778-d8d11e3c4b25 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:13.648716 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18ef57eb-4546-4b57-9778-d8d11e3c4b25 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1504 microversion: 2.1 time: 0.358306 Aug 27 04:37:13.649638 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 793/1535] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:13 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:13.805118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ed630efc-591c-4c63-952e-25d1329a917d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:13.806135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ed630efc-591c-4c63-952e-25d1329a917d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:13.819230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed630efc-591c-4c63-952e-25d1329a917d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:13.819731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed630efc-591c-4c63-952e-25d1329a917d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:13.820179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed630efc-591c-4c63-952e-25d1329a917d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:13.820923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed630efc-591c-4c63-952e-25d1329a917d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:13.821401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed630efc-591c-4c63-952e-25d1329a917d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:13.821820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed630efc-591c-4c63-952e-25d1329a917d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:13.821940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5e02319-c46a-421e-a306-9e59cce6a008 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:13.822566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5e02319-c46a-421e-a306-9e59cce6a008 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:13.829882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5e02319-c46a-421e-a306-9e59cce6a008 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:13.830373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5e02319-c46a-421e-a306-9e59cce6a008 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:13.830810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5e02319-c46a-421e-a306-9e59cce6a008 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:13.831527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5e02319-c46a-421e-a306-9e59cce6a008 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:13.831983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5e02319-c46a-421e-a306-9e59cce6a008 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:13.832621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5e02319-c46a-421e-a306-9e59cce6a008 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:14.024306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f5e02319-c46a-421e-a306-9e59cce6a008 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:14.035121 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5e02319-c46a-421e-a306-9e59cce6a008 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1331 microversion: 2.1 time: 0.217380 Aug 27 04:37:14.036281 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 794/1536] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:13 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1331 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:14.043551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df7ec8b6-70e7-4462-abd7-54187d4f4462 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:14.053864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-df7ec8b6-70e7-4462-abd7-54187d4f4462 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:14.070496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df7ec8b6-70e7-4462-abd7-54187d4f4462 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:14.071229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df7ec8b6-70e7-4462-abd7-54187d4f4462 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:14.071842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df7ec8b6-70e7-4462-abd7-54187d4f4462 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:14.073805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df7ec8b6-70e7-4462-abd7-54187d4f4462 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:14.074502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df7ec8b6-70e7-4462-abd7-54187d4f4462 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:14.075651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df7ec8b6-70e7-4462-abd7-54187d4f4462 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:14.296559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed630efc-591c-4c63-952e-25d1329a917d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:14.306902 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ed630efc-591c-4c63-952e-25d1329a917d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1526 microversion: 2.1 time: 0.505821 Aug 27 04:37:14.307508 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 743/1537] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:13 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1526 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:14.315042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0fc077ac-e58c-4ed9-a44e-4b4b6e8ff7a4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25ec6940>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:14.410208 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0fc077ac-e58c-4ed9-a44e-4b4b6e8ff7a4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.101628 Aug 27 04:37:14.410985 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 744/1538] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:14 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:14.421947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-df7ec8b6-70e7-4462-abd7-54187d4f4462 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:14.424375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-235df859-04cc-4d4c-8cc3-99177ab13456 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:14.425203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-235df859-04cc-4d4c-8cc3-99177ab13456 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:14.430832 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-df7ec8b6-70e7-4462-abd7-54187d4f4462 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1317 microversion: 2.1 time: 0.392290 Aug 27 04:37:14.432043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-235df859-04cc-4d4c-8cc3-99177ab13456 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:14.432363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-235df859-04cc-4d4c-8cc3-99177ab13456 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:14.432845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-235df859-04cc-4d4c-8cc3-99177ab13456 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:14.433574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-235df859-04cc-4d4c-8cc3-99177ab13456 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:14.434104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-235df859-04cc-4d4c-8cc3-99177ab13456 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:14.434545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-235df859-04cc-4d4c-8cc3-99177ab13456 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:14.434827 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 795/1539] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:14 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:14.531799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-85aa10ef-4243-44f6-ac2d-10886d57ae5a req-723f41ac-b090-4dd3-8032-7b5106a1646a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6aa77e-f369-461e-9cf6-d9bd0dad016b", "name": "network-vif-unplugged", "status": "completed", "tag": "134f0809-a07c-4cc3-8067-54f430a3368d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:14.551861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-85aa10ef-4243-44f6-ac2d-10886d57ae5a req-723f41ac-b090-4dd3-8032-7b5106a1646a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:14.552359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-85aa10ef-4243-44f6-ac2d-10886d57ae5a req-723f41ac-b090-4dd3-8032-7b5106a1646a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:14.556140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-85aa10ef-4243-44f6-ac2d-10886d57ae5a req-723f41ac-b090-4dd3-8032-7b5106a1646a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:14.594809 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-85aa10ef-4243-44f6-ac2d-10886d57ae5a req-723f41ac-b090-4dd3-8032-7b5106a1646a service nova] Creating event network-vif-unplugged:134f0809-a07c-4cc3-8067-54f430a3368d for instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b on n-h1-854823-1 Aug 27 04:37:14.616520 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-85aa10ef-4243-44f6-ac2d-10886d57ae5a req-723f41ac-b090-4dd3-8032-7b5106a1646a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095028 Aug 27 04:37:14.617374 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 796/1540] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:14.623593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da970fe5-023e-4743-865c-4b367bc09dd9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:14.625156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da970fe5-023e-4743-865c-4b367bc09dd9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:14.633533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da970fe5-023e-4743-865c-4b367bc09dd9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:14.634900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da970fe5-023e-4743-865c-4b367bc09dd9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:14.634900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da970fe5-023e-4743-865c-4b367bc09dd9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:14.635330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da970fe5-023e-4743-865c-4b367bc09dd9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:14.635782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da970fe5-023e-4743-865c-4b367bc09dd9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:14.636207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da970fe5-023e-4743-865c-4b367bc09dd9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:14.659836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:14.739391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-235df859-04cc-4d4c-8cc3-99177ab13456 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:14.757552 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-235df859-04cc-4d4c-8cc3-99177ab13456 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.336671 Aug 27 04:37:14.758876 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 745/1541] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:14 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:14.766916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bd897c61-9c3a-43ff-b398-21a296e9f0dc tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:14.767785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bd897c61-9c3a-43ff-b398-21a296e9f0dc tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:14.812136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd897c61-9c3a-43ff-b398-21a296e9f0dc tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:14.814127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd897c61-9c3a-43ff-b398-21a296e9f0dc tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:14.815956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd897c61-9c3a-43ff-b398-21a296e9f0dc tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:14.817536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd897c61-9c3a-43ff-b398-21a296e9f0dc tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:14.818177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd897c61-9c3a-43ff-b398-21a296e9f0dc tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:14.818856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd897c61-9c3a-43ff-b398-21a296e9f0dc tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:14.994679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da970fe5-023e-4743-865c-4b367bc09dd9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:15.011288 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da970fe5-023e-4743-865c-4b367bc09dd9 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1313 microversion: 2.1 time: 0.392312 Aug 27 04:37:15.014753 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 797/1542] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:14 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:15.026888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bd897c61-9c3a-43ff-b398-21a296e9f0dc tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:15.043263 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bd897c61-9c3a-43ff-b398-21a296e9f0dc tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1504 microversion: 2.1 time: 0.276776 Aug 27 04:37:15.044293 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 746/1543] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:14 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:15.065118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a09e0ff-df57-4e3b-a620-c75e3075423e tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:15.066000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a09e0ff-df57-4e3b-a620-c75e3075423e tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:15.074671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a09e0ff-df57-4e3b-a620-c75e3075423e tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:15.076003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a09e0ff-df57-4e3b-a620-c75e3075423e tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:15.076852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a09e0ff-df57-4e3b-a620-c75e3075423e tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:15.079136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a09e0ff-df57-4e3b-a620-c75e3075423e tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:15.079908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a09e0ff-df57-4e3b-a620-c75e3075423e tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:15.080680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a09e0ff-df57-4e3b-a620-c75e3075423e tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:15.285344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-665c3ca8-ebc4-4f4d-bf54-5c6b1cf501af req-83114776-b979-4b2f-82f7-4d2a58bb7427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131", "tag": "024c4406-8d1a-4d0a-8070-35c91fc50f3f"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:15.299784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-665c3ca8-ebc4-4f4d-bf54-5c6b1cf501af req-83114776-b979-4b2f-82f7-4d2a58bb7427 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:15.300287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-665c3ca8-ebc4-4f4d-bf54-5c6b1cf501af req-83114776-b979-4b2f-82f7-4d2a58bb7427 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:15.300763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-665c3ca8-ebc4-4f4d-bf54-5c6b1cf501af req-83114776-b979-4b2f-82f7-4d2a58bb7427 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:15.318524 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-665c3ca8-ebc4-4f4d-bf54-5c6b1cf501af req-83114776-b979-4b2f-82f7-4d2a58bb7427 service nova] Creating event network-changed:024c4406-8d1a-4d0a-8070-35c91fc50f3f for instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 on n-h1-854823-1 Aug 27 04:37:15.328925 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-665c3ca8-ebc4-4f4d-bf54-5c6b1cf501af req-83114776-b979-4b2f-82f7-4d2a58bb7427 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139099 Aug 27 04:37:15.329743 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 747/1544] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:15.331644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a09e0ff-df57-4e3b-a620-c75e3075423e tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:15.353707 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a09e0ff-df57-4e3b-a620-c75e3075423e tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1331 microversion: 2.1 time: 0.292684 Aug 27 04:37:15.354294 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 798/1545] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:15 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1331 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:15.370233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-72f004e2-282b-4206-a0b8-0b3bf8246830 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:15.370960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-72f004e2-282b-4206-a0b8-0b3bf8246830 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:15.396188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72f004e2-282b-4206-a0b8-0b3bf8246830 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:15.396723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72f004e2-282b-4206-a0b8-0b3bf8246830 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:15.397161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72f004e2-282b-4206-a0b8-0b3bf8246830 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:15.397869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72f004e2-282b-4206-a0b8-0b3bf8246830 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:15.398323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72f004e2-282b-4206-a0b8-0b3bf8246830 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:15.398744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72f004e2-282b-4206-a0b8-0b3bf8246830 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:15.425681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-808e9db6-c04f-4b7f-91d0-6e8cc2b2e613 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f2199c670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:15.531596 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-808e9db6-c04f-4b7f-91d0-6e8cc2b2e613 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.109527 Aug 27 04:37:15.532863 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 799/1546] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:15 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:15.537590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12b6825f-0760-4483-b999-ed7036530b72 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:15.540383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12b6825f-0760-4483-b999-ed7036530b72 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:15.555680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12b6825f-0760-4483-b999-ed7036530b72 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:15.556482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12b6825f-0760-4483-b999-ed7036530b72 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:15.556953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12b6825f-0760-4483-b999-ed7036530b72 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:15.557662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12b6825f-0760-4483-b999-ed7036530b72 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:15.558114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12b6825f-0760-4483-b999-ed7036530b72 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:15.558537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12b6825f-0760-4483-b999-ed7036530b72 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:16.248172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-12b6825f-0760-4483-b999-ed7036530b72 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:16.268162 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12b6825f-0760-4483-b999-ed7036530b72 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1317 microversion: 2.1 time: 0.733986 Aug 27 04:37:16.269160 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 800/1547] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:15 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1317 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:16.276238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e25f02d-7b55-4fb1-bf7c-47af90f8d97c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:16.277125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e25f02d-7b55-4fb1-bf7c-47af90f8d97c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:16.292343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e25f02d-7b55-4fb1-bf7c-47af90f8d97c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:16.293267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e25f02d-7b55-4fb1-bf7c-47af90f8d97c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:16.294239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e25f02d-7b55-4fb1-bf7c-47af90f8d97c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:16.295381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e25f02d-7b55-4fb1-bf7c-47af90f8d97c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:16.296109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e25f02d-7b55-4fb1-bf7c-47af90f8d97c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:16.296803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e25f02d-7b55-4fb1-bf7c-47af90f8d97c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:16.350812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-72f004e2-282b-4206-a0b8-0b3bf8246830 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:16.364344 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-72f004e2-282b-4206-a0b8-0b3bf8246830 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1526 microversion: 2.1 time: 1.033005 Aug 27 04:37:16.380443 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 748/1548] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:15 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1526 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:16.386418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5d222ed0-5bfd-4286-83df-03a95a1afaad tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:16.387219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5d222ed0-5bfd-4286-83df-03a95a1afaad tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:16.396112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d222ed0-5bfd-4286-83df-03a95a1afaad tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:16.396942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d222ed0-5bfd-4286-83df-03a95a1afaad tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:16.397610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d222ed0-5bfd-4286-83df-03a95a1afaad tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:16.399236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d222ed0-5bfd-4286-83df-03a95a1afaad tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:16.399953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d222ed0-5bfd-4286-83df-03a95a1afaad tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:16.401151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d222ed0-5bfd-4286-83df-03a95a1afaad tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:16.514471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e25f02d-7b55-4fb1-bf7c-47af90f8d97c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:16.524206 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e25f02d-7b55-4fb1-bf7c-47af90f8d97c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.252940 Aug 27 04:37:16.524969 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 801/1549] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:16 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:16.530697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d9dac6d1-adf1-40ad-8a98-390a3565adbf tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:16.531589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d9dac6d1-adf1-40ad-8a98-390a3565adbf tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:16.537970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9dac6d1-adf1-40ad-8a98-390a3565adbf tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:16.538422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9dac6d1-adf1-40ad-8a98-390a3565adbf tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:16.538851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9dac6d1-adf1-40ad-8a98-390a3565adbf tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:16.539551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9dac6d1-adf1-40ad-8a98-390a3565adbf tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:16.539996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9dac6d1-adf1-40ad-8a98-390a3565adbf tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:16.540610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9dac6d1-adf1-40ad-8a98-390a3565adbf tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:16.725134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d9dac6d1-adf1-40ad-8a98-390a3565adbf tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:16.742723 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d9dac6d1-adf1-40ad-8a98-390a3565adbf tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1504 microversion: 2.1 time: 0.215988 Aug 27 04:37:16.743647 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 802/1550] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:16 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:16.750202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70a3631a-bbd6-4adb-83dc-2c9bebe49993 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:16.750819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-70a3631a-bbd6-4adb-83dc-2c9bebe49993 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:16.757613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70a3631a-bbd6-4adb-83dc-2c9bebe49993 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:16.758360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70a3631a-bbd6-4adb-83dc-2c9bebe49993 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:16.759190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70a3631a-bbd6-4adb-83dc-2c9bebe49993 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:16.760651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70a3631a-bbd6-4adb-83dc-2c9bebe49993 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:16.761283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70a3631a-bbd6-4adb-83dc-2c9bebe49993 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:16.762222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70a3631a-bbd6-4adb-83dc-2c9bebe49993 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:16.798014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5d222ed0-5bfd-4286-83df-03a95a1afaad tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:16.812695 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5d222ed0-5bfd-4286-83df-03a95a1afaad tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1313 microversion: 2.1 time: 0.430784 Aug 27 04:37:16.824966 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 749/1551] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:16 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:16.838171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-76652cff-da4d-41db-a78c-18157c761029 req-202a018f-54f2-492e-9eb4-1864c681696b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6aa77e-f369-461e-9cf6-d9bd0dad016b", "name": "network-vif-deleted", "tag": "134f0809-a07c-4cc3-8067-54f430a3368d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:16.873603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-76652cff-da4d-41db-a78c-18157c761029 req-202a018f-54f2-492e-9eb4-1864c681696b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:16.878549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-76652cff-da4d-41db-a78c-18157c761029 req-202a018f-54f2-492e-9eb4-1864c681696b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:16.879363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-76652cff-da4d-41db-a78c-18157c761029 req-202a018f-54f2-492e-9eb4-1864c681696b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:16.906360 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-76652cff-da4d-41db-a78c-18157c761029 req-202a018f-54f2-492e-9eb4-1864c681696b service nova] Creating event network-vif-deleted:134f0809-a07c-4cc3-8067-54f430a3368d for instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b on n-h1-854823-1 Aug 27 04:37:16.919022 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-76652cff-da4d-41db-a78c-18157c761029 req-202a018f-54f2-492e-9eb4-1864c681696b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088805 Aug 27 04:37:16.919788 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 750/1552] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:16.930005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4cf262c9-dd66-45e8-8bf8-9859583471dd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25e714c0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:17.023224 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4cf262c9-dd66-45e8-8bf8-9859583471dd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.101835 Aug 27 04:37:17.024294 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 751/1553] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:16 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:17.058247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-70a3631a-bbd6-4adb-83dc-2c9bebe49993 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:17.071545 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-70a3631a-bbd6-4adb-83dc-2c9bebe49993 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1331 microversion: 2.1 time: 0.326548 Aug 27 04:37:17.073913 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 803/1554] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:16 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1331 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:17.236766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-f4eafe3f-c85b-49c0-a97f-cdbef0bb5cb2 req-8b10d874-c188-4404-b0d2-eeb2d19c3357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4587847a-63e5-46b3-a643-6643f65a5052", "name": "network-vif-plugged", "status": "completed", "tag": "e75f6944-2f19-47fd-9ee7-c9527f987d75"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:17.252004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f4eafe3f-c85b-49c0-a97f-cdbef0bb5cb2 req-8b10d874-c188-4404-b0d2-eeb2d19c3357 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:17.252862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f4eafe3f-c85b-49c0-a97f-cdbef0bb5cb2 req-8b10d874-c188-4404-b0d2-eeb2d19c3357 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:17.253513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f4eafe3f-c85b-49c0-a97f-cdbef0bb5cb2 req-8b10d874-c188-4404-b0d2-eeb2d19c3357 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:17.287800 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f4eafe3f-c85b-49c0-a97f-cdbef0bb5cb2 req-8b10d874-c188-4404-b0d2-eeb2d19c3357 service nova] Creating event network-vif-plugged:e75f6944-2f19-47fd-9ee7-c9527f987d75 for instance 4587847a-63e5-46b3-a643-6643f65a5052 on n-h2-854823-1 Aug 27 04:37:17.297319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a5b87adb-466b-4091-a5a8-edef7bbf8a22 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:17.299072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a5b87adb-466b-4091-a5a8-edef7bbf8a22 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:17.301971 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-f4eafe3f-c85b-49c0-a97f-cdbef0bb5cb2 req-8b10d874-c188-4404-b0d2-eeb2d19c3357 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067796 Aug 27 04:37:17.302835 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 752/1555] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:17.350235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5b87adb-466b-4091-a5a8-edef7bbf8a22 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:17.350736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5b87adb-466b-4091-a5a8-edef7bbf8a22 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:17.351179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5b87adb-466b-4091-a5a8-edef7bbf8a22 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:17.356700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5b87adb-466b-4091-a5a8-edef7bbf8a22 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:17.370632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5b87adb-466b-4091-a5a8-edef7bbf8a22 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:17.379996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5b87adb-466b-4091-a5a8-edef7bbf8a22 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:17.392091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-22a9cd77-b985-4c97-9e08-84ddd8e50ac0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:17.392974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-22a9cd77-b985-4c97-9e08-84ddd8e50ac0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:17.401620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a9cd77-b985-4c97-9e08-84ddd8e50ac0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:17.402397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a9cd77-b985-4c97-9e08-84ddd8e50ac0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:17.403975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a9cd77-b985-4c97-9e08-84ddd8e50ac0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:17.405007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a9cd77-b985-4c97-9e08-84ddd8e50ac0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:17.407095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a9cd77-b985-4c97-9e08-84ddd8e50ac0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:17.408610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a9cd77-b985-4c97-9e08-84ddd8e50ac0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:17.473677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a9cd77-b985-4c97-9e08-84ddd8e50ac0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:17.474383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a9cd77-b985-4c97-9e08-84ddd8e50ac0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:17.474982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a9cd77-b985-4c97-9e08-84ddd8e50ac0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:17.475711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-22a9cd77-b985-4c97-9e08-84ddd8e50ac0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lazy-loading 'fault' on Instance uuid 1f6aa77e-f369-461e-9cf6-d9bd0dad016b {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:37:17.586966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-22a9cd77-b985-4c97-9e08-84ddd8e50ac0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:17.586966 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-22a9cd77-b985-4c97-9e08-84ddd8e50ac0 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1314 microversion: 2.1 time: 0.178230 Aug 27 04:37:17.586966 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 753/1556] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:17 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:17.586966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a9b114c3-c79e-48f2-a19c-e756aa8d23eb tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:17.588078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a9b114c3-c79e-48f2-a19c-e756aa8d23eb tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:17.597668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9b114c3-c79e-48f2-a19c-e756aa8d23eb tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:17.597668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9b114c3-c79e-48f2-a19c-e756aa8d23eb tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:17.597668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9b114c3-c79e-48f2-a19c-e756aa8d23eb tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:17.597668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9b114c3-c79e-48f2-a19c-e756aa8d23eb tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:17.605562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9b114c3-c79e-48f2-a19c-e756aa8d23eb tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:17.605562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9b114c3-c79e-48f2-a19c-e756aa8d23eb tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:17.695244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a5b87adb-466b-4091-a5a8-edef7bbf8a22 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:17.704911 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a5b87adb-466b-4091-a5a8-edef7bbf8a22 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1317 microversion: 2.1 time: 0.419569 Aug 27 04:37:17.716806 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 804/1557] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:17 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:17.765577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dd0ae895-9149-4dd1-aac3-e7b3f8ee9a64 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:17.766438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dd0ae895-9149-4dd1-aac3-e7b3f8ee9a64 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:17.773024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd0ae895-9149-4dd1-aac3-e7b3f8ee9a64 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:17.773887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd0ae895-9149-4dd1-aac3-e7b3f8ee9a64 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:17.774597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd0ae895-9149-4dd1-aac3-e7b3f8ee9a64 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:17.775556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd0ae895-9149-4dd1-aac3-e7b3f8ee9a64 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:17.776229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd0ae895-9149-4dd1-aac3-e7b3f8ee9a64 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:17.776916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd0ae895-9149-4dd1-aac3-e7b3f8ee9a64 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:17.833587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a9b114c3-c79e-48f2-a19c-e756aa8d23eb tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:17.837531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:17.845621 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a9b114c3-c79e-48f2-a19c-e756aa8d23eb tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.266737 Aug 27 04:37:17.846945 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 754/1558] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:17 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:17.866595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d956197-a14c-42a0-a557-34d928536ac7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:17.867388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9d956197-a14c-42a0-a557-34d928536ac7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:17.878330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d956197-a14c-42a0-a557-34d928536ac7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:17.879026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d956197-a14c-42a0-a557-34d928536ac7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:17.879655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d956197-a14c-42a0-a557-34d928536ac7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:17.880369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d956197-a14c-42a0-a557-34d928536ac7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:17.880957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d956197-a14c-42a0-a557-34d928536ac7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:17.881301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d956197-a14c-42a0-a557-34d928536ac7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:17.931791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dd0ae895-9149-4dd1-aac3-e7b3f8ee9a64 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:17.942068 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dd0ae895-9149-4dd1-aac3-e7b3f8ee9a64 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1479 microversion: 2.1 time: 0.180802 Aug 27 04:37:17.957198 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 805/1559] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:17 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1479 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:17.963920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65563297-6784-46ea-a64e-11bcc6848057 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '.version_select at 0x7f1f21b2e430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:17.968223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65563297-6784-46ea-a64e-11bcc6848057 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:17.969039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65563297-6784-46ea-a64e-11bcc6848057 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:17.969713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65563297-6784-46ea-a64e-11bcc6848057 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:17.981754 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65563297-6784-46ea-a64e-11bcc6848057 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 2728 microversion: 2.1 time: 0.021749 Aug 27 04:37:17.994938 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 806/1560] 10.222.0.79 () {58 vars in 1143 bytes} [Sat Aug 27 04:37:17 2022] GET /compute/v2.1/os-migrations => generated 2728 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:18.001514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7610b511-a709-4ef8-9244-a221eb3b23ee tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:18.002454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7610b511-a709-4ef8-9244-a221eb3b23ee tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:18.009582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7610b511-a709-4ef8-9244-a221eb3b23ee tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:18.010185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7610b511-a709-4ef8-9244-a221eb3b23ee tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:18.010522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7610b511-a709-4ef8-9244-a221eb3b23ee tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:18.011443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7610b511-a709-4ef8-9244-a221eb3b23ee tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:18.012071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7610b511-a709-4ef8-9244-a221eb3b23ee tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:18.012711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7610b511-a709-4ef8-9244-a221eb3b23ee tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:18.045063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9d956197-a14c-42a0-a557-34d928536ac7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:18.055144 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9d956197-a14c-42a0-a557-34d928536ac7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1313 microversion: 2.1 time: 0.206477 Aug 27 04:37:18.062606 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 755/1561] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:17 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:18.068243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-28724b06-78f5-442f-95fb-fe4133613c9a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25ed6550>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:18.116383 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-28724b06-78f5-442f-95fb-fe4133613c9a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1437 microversion: 2.1 time: 0.052601 Aug 27 04:37:18.120581 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 756/1562] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:18 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1437 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:18.128561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9cbe72b6-5403-486e-8125-26d7cc2b4d40 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:18.132247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9cbe72b6-5403-486e-8125-26d7cc2b4d40 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:18.138954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9cbe72b6-5403-486e-8125-26d7cc2b4d40 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:18.140129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9cbe72b6-5403-486e-8125-26d7cc2b4d40 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:18.140602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9cbe72b6-5403-486e-8125-26d7cc2b4d40 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:18.141279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9cbe72b6-5403-486e-8125-26d7cc2b4d40 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:18.141905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9cbe72b6-5403-486e-8125-26d7cc2b4d40 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:18.142507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9cbe72b6-5403-486e-8125-26d7cc2b4d40 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:18.165054 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7610b511-a709-4ef8-9244-a221eb3b23ee tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1630 microversion: 2.1 time: 0.168589 Aug 27 04:37:18.165658 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 807/1563] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:17 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1630 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:18.192616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-166a9288-3d5c-47a1-95fb-ae7bf30a9973 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Action: 'create', calling method: .version_select at 0x7f1f21a80af0>, body: {"keypair": {"name": "tempest-keypair-724225157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbbEblYViGOXViVRNRGJSjNAqi1TFI5bGCYaLSxo7lRs2UJxIIfLHAWtyKdn+SKhXnJCWG3L6XzlD6Bm+tOmJd2neWBibHPm9omRl88jorp7IrAVi/zFjKrTBlC+HS7oA=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:18.209998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-166a9288-3d5c-47a1-95fb-ae7bf30a9973 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Getting quotas for project 67b142dea11c4e7d921bbb7dd5e543be. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:37:18.215846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-166a9288-3d5c-47a1-95fb-ae7bf30a9973 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Getting quotas for user 8213929124384914aebc5e05572cc1ed and project 67b142dea11c4e7d921bbb7dd5e543be. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:37:18.250983 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-166a9288-3d5c-47a1-95fb-ae7bf30a9973 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062087 Aug 27 04:37:18.251661 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 808/1564] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:37:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:37:18.316378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9cbe72b6-5403-486e-8125-26d7cc2b4d40 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:18.327030 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9cbe72b6-5403-486e-8125-26d7cc2b4d40 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1331 microversion: 2.1 time: 0.208445 Aug 27 04:37:18.328768 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 757/1565] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:18 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1331 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:18.585293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78b0d44b-acab-41c9-bb89-24b2ef4da9bb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:18.585858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78b0d44b-acab-41c9-bb89-24b2ef4da9bb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:18.591915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b0d44b-acab-41c9-bb89-24b2ef4da9bb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:18.592441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b0d44b-acab-41c9-bb89-24b2ef4da9bb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:18.593072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b0d44b-acab-41c9-bb89-24b2ef4da9bb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:18.593779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b0d44b-acab-41c9-bb89-24b2ef4da9bb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:18.594231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b0d44b-acab-41c9-bb89-24b2ef4da9bb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:18.594657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b0d44b-acab-41c9-bb89-24b2ef4da9bb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:18.633964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b0d44b-acab-41c9-bb89-24b2ef4da9bb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:18.634441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b0d44b-acab-41c9-bb89-24b2ef4da9bb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:18.634871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78b0d44b-acab-41c9-bb89-24b2ef4da9bb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:18.635318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-78b0d44b-acab-41c9-bb89-24b2ef4da9bb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lazy-loading 'fault' on Instance uuid 1f6aa77e-f369-461e-9cf6-d9bd0dad016b {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:37:18.682073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-78b0d44b-acab-41c9-bb89-24b2ef4da9bb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:18.690971 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78b0d44b-acab-41c9-bb89-24b2ef4da9bb tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1314 microversion: 2.1 time: 0.110235 Aug 27 04:37:18.691655 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 809/1566] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:18 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1314 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:18.729290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2403d4e1-be1e-4523-9635-6a5faba74ff7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:18.730017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2403d4e1-be1e-4523-9635-6a5faba74ff7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:18.737387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2403d4e1-be1e-4523-9635-6a5faba74ff7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:18.738004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2403d4e1-be1e-4523-9635-6a5faba74ff7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:18.738488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2403d4e1-be1e-4523-9635-6a5faba74ff7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:18.739339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2403d4e1-be1e-4523-9635-6a5faba74ff7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:18.739893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2403d4e1-be1e-4523-9635-6a5faba74ff7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:18.740407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2403d4e1-be1e-4523-9635-6a5faba74ff7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:18.886261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f0304b8-e7f4-465c-9ec8-557ca212042c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:18.886887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f0304b8-e7f4-465c-9ec8-557ca212042c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:18.905057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:18.907148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f0304b8-e7f4-465c-9ec8-557ca212042c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:18.908937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f0304b8-e7f4-465c-9ec8-557ca212042c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:18.909563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f0304b8-e7f4-465c-9ec8-557ca212042c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:18.911159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f0304b8-e7f4-465c-9ec8-557ca212042c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:18.913507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f0304b8-e7f4-465c-9ec8-557ca212042c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:18.914932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f0304b8-e7f4-465c-9ec8-557ca212042c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:18.986113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2403d4e1-be1e-4523-9635-6a5faba74ff7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:19.003354 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2403d4e1-be1e-4523-9635-6a5faba74ff7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1317 microversion: 2.1 time: 0.277417 Aug 27 04:37:19.009802 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 758/1567] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:18 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:19.078826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-08dd66be-9f2f-4c67-be58-af171a936ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:19.079455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-08dd66be-9f2f-4c67-be58-af171a936ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:19.085997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08dd66be-9f2f-4c67-be58-af171a936ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:19.086786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08dd66be-9f2f-4c67-be58-af171a936ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:19.087397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08dd66be-9f2f-4c67-be58-af171a936ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:19.088291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08dd66be-9f2f-4c67-be58-af171a936ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:19.088943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08dd66be-9f2f-4c67-be58-af171a936ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:19.089532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08dd66be-9f2f-4c67-be58-af171a936ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:19.107480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f0304b8-e7f4-465c-9ec8-557ca212042c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:19.118749 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f0304b8-e7f4-465c-9ec8-557ca212042c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.247016 Aug 27 04:37:19.120363 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 810/1568] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:18 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:19.133878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be446b6a-68b7-4fef-8724-4393e12f2b32 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f223ebdc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:19.178588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:19.198538 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be446b6a-68b7-4fef-8724-4393e12f2b32 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1446 microversion: 2.1 time: 0.070788 Aug 27 04:37:19.208332 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 811/1569] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:19 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1446 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:19.214312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22b77836-e488-4dea-b559-213d69bf32ca tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f21a66430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:19.276863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-08dd66be-9f2f-4c67-be58-af171a936ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:19.287500 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-08dd66be-9f2f-4c67-be58-af171a936ffc tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1313 microversion: 2.1 time: 0.213057 Aug 27 04:37:19.288825 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 759/1570] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:19 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:19.296213 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22b77836-e488-4dea-b559-213d69bf32ca tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 200 len: 1446 microversion: 2.1 time: 0.086658 Aug 27 04:37:19.305164 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 812/1571] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:19 2022] GET /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 1446 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:19.312196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d12358ee-ecaa-405f-93b9-d69be4c5a726 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25ec6040>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:19.462981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1c2caebb-7bba-410e-9396-00858d746c99 req-5ac8a17e-d60e-42e9-8c08-cb0f866da4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399bd6c1-40d1-463d-be8a-d63d5e31e32c", "name": "network-vif-plugged", "status": "completed", "tag": "d5ab4a86-3f84-45fc-bed7-5c705b957f6c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:19.473673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1c2caebb-7bba-410e-9396-00858d746c99 req-5ac8a17e-d60e-42e9-8c08-cb0f866da4c4 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:19.474170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1c2caebb-7bba-410e-9396-00858d746c99 req-5ac8a17e-d60e-42e9-8c08-cb0f866da4c4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:19.474607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1c2caebb-7bba-410e-9396-00858d746c99 req-5ac8a17e-d60e-42e9-8c08-cb0f866da4c4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:19.486825 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1c2caebb-7bba-410e-9396-00858d746c99 req-5ac8a17e-d60e-42e9-8c08-cb0f866da4c4 service nova] Creating event network-vif-plugged:d5ab4a86-3f84-45fc-bed7-5c705b957f6c for instance 399bd6c1-40d1-463d-be8a-d63d5e31e32c on n-h2-854823-1 Aug 27 04:37:19.491975 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1c2caebb-7bba-410e-9396-00858d746c99 req-5ac8a17e-d60e-42e9-8c08-cb0f866da4c4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165712 Aug 27 04:37:19.492992 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 813/1572] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:19.498610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82dc1783-e780-4828-b17b-e64436ab6059 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:19.500192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-82dc1783-e780-4828-b17b-e64436ab6059 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:19.507972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82dc1783-e780-4828-b17b-e64436ab6059 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:19.508467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82dc1783-e780-4828-b17b-e64436ab6059 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:19.509083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82dc1783-e780-4828-b17b-e64436ab6059 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:19.509635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82dc1783-e780-4828-b17b-e64436ab6059 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:19.510092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82dc1783-e780-4828-b17b-e64436ab6059 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:19.510518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82dc1783-e780-4828-b17b-e64436ab6059 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:19.569056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=16 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:19.783107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-82dc1783-e780-4828-b17b-e64436ab6059 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:19.799148 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-82dc1783-e780-4828-b17b-e64436ab6059 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1331 microversion: 2.1 time: 0.304552 Aug 27 04:37:19.799975 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 814/1573] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:19 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1331 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:19.816353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ace096a2-c9d3-423c-991c-f9251ecac004 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:19.819262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ace096a2-c9d3-423c-991c-f9251ecac004 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:19.828973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace096a2-c9d3-423c-991c-f9251ecac004 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:19.829560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace096a2-c9d3-423c-991c-f9251ecac004 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:19.830059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace096a2-c9d3-423c-991c-f9251ecac004 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:19.831192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace096a2-c9d3-423c-991c-f9251ecac004 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:19.831870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace096a2-c9d3-423c-991c-f9251ecac004 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:19.832442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace096a2-c9d3-423c-991c-f9251ecac004 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:19.866476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace096a2-c9d3-423c-991c-f9251ecac004 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:19.866964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace096a2-c9d3-423c-991c-f9251ecac004 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:19.867399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace096a2-c9d3-423c-991c-f9251ecac004 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:19.867869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-ace096a2-c9d3-423c-991c-f9251ecac004 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lazy-loading 'fault' on Instance uuid 1f6aa77e-f369-461e-9cf6-d9bd0dad016b {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:37:19.917849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ace096a2-c9d3-423c-991c-f9251ecac004 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:19.926954 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ace096a2-c9d3-423c-991c-f9251ecac004 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 200 len: 1314 microversion: 2.1 time: 0.114489 Aug 27 04:37:19.927536 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 815/1574] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:19 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 1314 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:19.955863 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d12358ee-ecaa-405f-93b9-d69be4c5a726 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 204 len: 0 microversion: 2.1 time: 0.647792 Aug 27 04:37:19.956458 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 760/1575] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:19 2022] DELETE /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:19.964957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0288dba9-a3cb-4988-8e45-a1d9a827c1de tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:19.965544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0288dba9-a3cb-4988-8e45-a1d9a827c1de tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:19.972034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0288dba9-a3cb-4988-8e45-a1d9a827c1de tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:19.972707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0288dba9-a3cb-4988-8e45-a1d9a827c1de tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:19.973217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0288dba9-a3cb-4988-8e45-a1d9a827c1de tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:19.973991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0288dba9-a3cb-4988-8e45-a1d9a827c1de tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:19.974910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0288dba9-a3cb-4988-8e45-a1d9a827c1de tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:19.975229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0288dba9-a3cb-4988-8e45-a1d9a827c1de tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:20.025508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d22f136c-1ab3-4c9c-859f-34ec4023bee6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:20.026560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d22f136c-1ab3-4c9c-859f-34ec4023bee6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:20.043452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22f136c-1ab3-4c9c-859f-34ec4023bee6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:20.044264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22f136c-1ab3-4c9c-859f-34ec4023bee6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:20.044828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22f136c-1ab3-4c9c-859f-34ec4023bee6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:20.045627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22f136c-1ab3-4c9c-859f-34ec4023bee6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:20.046175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22f136c-1ab3-4c9c-859f-34ec4023bee6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:20.046700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22f136c-1ab3-4c9c-859f-34ec4023bee6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:20.068102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0288dba9-a3cb-4988-8e45-a1d9a827c1de tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:37:20.178195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:20.222493 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0288dba9-a3cb-4988-8e45-a1d9a827c1de tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 204 len: 0 microversion: 2.1 time: 0.260960 Aug 27 04:37:20.223810 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 816/1576] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:37:19 2022] DELETE /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:20.229397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f29501cc-bfd4-49cc-9eb3-0dc7c415f978 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:20.230879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f29501cc-bfd4-49cc-9eb3-0dc7c415f978 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:20.237662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f29501cc-bfd4-49cc-9eb3-0dc7c415f978 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:20.238393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f29501cc-bfd4-49cc-9eb3-0dc7c415f978 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:20.239027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f29501cc-bfd4-49cc-9eb3-0dc7c415f978 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:20.240188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f29501cc-bfd4-49cc-9eb3-0dc7c415f978 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:20.240849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f29501cc-bfd4-49cc-9eb3-0dc7c415f978 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:20.241431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f29501cc-bfd4-49cc-9eb3-0dc7c415f978 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:20.309287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d22f136c-1ab3-4c9c-859f-34ec4023bee6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:20.323302 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d22f136c-1ab3-4c9c-859f-34ec4023bee6 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1508 microversion: 2.1 time: 0.301177 Aug 27 04:37:20.339603 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 761/1577] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:20 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1508 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:20.347438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-483676362", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "e70262b8-a762-4feb-8fb3-236b3c41daf8"}], "security_groups": [{"name": "tempest-securitygroup--416996938"}], "key_name": "tempest-keypair-724225157", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:20.425944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f29501cc-bfd4-49cc-9eb3-0dc7c415f978 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:20.435913 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f29501cc-bfd4-49cc-9eb3-0dc7c415f978 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.210667 Aug 27 04:37:20.437717 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 817/1578] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:20 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:20.442879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-177f5eec-6210-47fa-91d2-aaf5a1faeb59 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:20.443670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-177f5eec-6210-47fa-91d2-aaf5a1faeb59 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:20.449885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-177f5eec-6210-47fa-91d2-aaf5a1faeb59 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:20.450686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-177f5eec-6210-47fa-91d2-aaf5a1faeb59 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:20.451217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-177f5eec-6210-47fa-91d2-aaf5a1faeb59 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:20.452367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-177f5eec-6210-47fa-91d2-aaf5a1faeb59 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:20.452864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-177f5eec-6210-47fa-91d2-aaf5a1faeb59 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:20.453456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-177f5eec-6210-47fa-91d2-aaf5a1faeb59 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:20.485296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] validate_networks() for [('e70262b8-a762-4feb-8fb3-236b3c41daf8', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:37:20.657661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-177f5eec-6210-47fa-91d2-aaf5a1faeb59 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:20.666305 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-177f5eec-6210-47fa-91d2-aaf5a1faeb59 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1313 microversion: 2.1 time: 0.227261 Aug 27 04:37:20.667428 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 818/1579] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:20 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:20.673209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-713134789", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1a71fb22-9573-440e-a3b4-857cf66da6ea"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:20.733339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] validate_networks() for [('1a71fb22-9573-440e-a3b4-857cf66da6ea', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:37:21.061967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:37:21.062468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:37:21.062870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:37:21.063544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:37:21.063964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:37:21.084176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:21.084961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:21.085590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:21.086521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:21.087160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:21.087754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:21.118296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Getting quotas for project 67b142dea11c4e7d921bbb7dd5e543be. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:37:21.125763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Getting quotas for user 8213929124384914aebc5e05572cc1ed and project 67b142dea11c4e7d921bbb7dd5e543be. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:37:21.142597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:37:21.145919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:37:21.188122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:37:21.188657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:37:21.189059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:37:21.189474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:37:21.189887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:37:21.201723 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-13a5a0a7-5478-474d-ba52-30cee990a95d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.861559 Aug 27 04:37:21.202750 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 762/1580] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:37:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:37:21.203160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:21.203823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:21.204407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:21.205353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:21.205958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:21.206551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:21.207443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2e23a3b1-6ac2-4254-b6df-203af434990c tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:21.208155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2e23a3b1-6ac2-4254-b6df-203af434990c tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:21.215165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e23a3b1-6ac2-4254-b6df-203af434990c tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:21.215659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e23a3b1-6ac2-4254-b6df-203af434990c tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:21.216099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e23a3b1-6ac2-4254-b6df-203af434990c tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:21.216848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e23a3b1-6ac2-4254-b6df-203af434990c tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:21.217307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e23a3b1-6ac2-4254-b6df-203af434990c tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:21.218411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e23a3b1-6ac2-4254-b6df-203af434990c tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:21.232473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Getting quotas for project 67b207b502d846718f9d72f62d1d034c. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:37:21.241721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Getting quotas for user daa3b03c362d4032bd17ebfeccdcdb83 and project 67b207b502d846718f9d72f62d1d034c. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:37:21.259005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:37:21.262268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:37:21.332600 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fcd5a190-6e24-4fac-9042-b5bd6f093c53 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662012 Aug 27 04:37:21.335517 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 819/1581] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:37:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:37:21.351525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5962aaa7-77ee-4f79-8823-199f4bb2988f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:21.353044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5962aaa7-77ee-4f79-8823-199f4bb2988f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:21.365496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5962aaa7-77ee-4f79-8823-199f4bb2988f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:21.366198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5962aaa7-77ee-4f79-8823-199f4bb2988f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:21.366738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5962aaa7-77ee-4f79-8823-199f4bb2988f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:21.367818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5962aaa7-77ee-4f79-8823-199f4bb2988f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:21.369122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5962aaa7-77ee-4f79-8823-199f4bb2988f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:21.369983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5962aaa7-77ee-4f79-8823-199f4bb2988f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:21.397969 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-5962aaa7-77ee-4f79-8823-199f4bb2988f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] HTTP exception thrown: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5962aaa7-77ee-4f79-8823-199f4bb2988f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Request method failure captured: Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b HTTP/1.1 Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ9LzeqYV4BUCc_CXZKyCgJDhuJ0n2D010QQ784od245BsR3bxLb1sHxDrLyEr4O_qgJBjYkRUAA_KGuy_0GWIipzEN4V-LZRqsnqytvO99DPzpj2LnZgNSzlNtzQSnXwwcHdsJTzPP1AoM-PSJ_QnZrIKpvFlmfCiSUn_wXkMGZoYs Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:37:21.400312 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:37:21.401987 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:21.401987 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:37:21.401987 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:37:21.401987 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:37:21.401987 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:37:21.401987 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:37:21.401987 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:37:21.401987 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 307981144d4141ed9d609d88ea2e954e Aug 27 04:37:21.401987 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:37:21.401987 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:37:21.401987 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:37:21.401987 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '1f6aa77e-f369-461e-9cf6-d9bd0dad016b'} Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:21.402967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:37:21.404454 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:21.405990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5962aaa7-77ee-4f79-8823-199f4bb2988f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Returning 404 to user: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:21.406382 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5962aaa7-77ee-4f79-8823-199f4bb2988f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 404 len: 111 microversion: 2.1 time: 0.069739 Aug 27 04:37:21.408184 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 820/1582] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:21 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:37:21.424021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c84a896-f8a9-407f-a399-521c0ead5993 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:21.425036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c84a896-f8a9-407f-a399-521c0ead5993 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:21.439045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2e23a3b1-6ac2-4254-b6df-203af434990c tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:21.448928 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2e23a3b1-6ac2-4254-b6df-203af434990c tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1534 microversion: 2.1 time: 0.244335 Aug 27 04:37:21.469817 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 763/1583] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:21 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1534 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:21.475564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-07d1e1f9-a3d5-473f-b9f1-ff23c56142f0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:21.476192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-07d1e1f9-a3d5-473f-b9f1-ff23c56142f0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:21.496445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c84a896-f8a9-407f-a399-521c0ead5993 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:21.506403 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c84a896-f8a9-407f-a399-521c0ead5993 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1233 microversion: 2.1 time: 0.088376 Aug 27 04:37:21.519580 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 821/1584] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:21 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1233 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:21.519580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-17c4fc6a-2401-4a76-be08-519f823fc26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Action: 'create', calling method: .version_select at 0x7f1f21ad1dc0>, body: {"keypair": {"name": "tempest-keypair-1951530106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7lNhXu1Lxov2JnxvnAm8QTtDfuqiuiKLFzkilb4atHaBnv1ovIL5pbBzpa9vIEp7cC7P/v5ML/1kaWztLVG9lHW8TmEV5DgKgYFU8gS/22WUKaga0EpT4Fnld4G6DQ8w=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:21.537618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-17c4fc6a-2401-4a76-be08-519f823fc26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Getting quotas for project a5e2ae48d5764048b5ad189114755aa8. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:37:21.542921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-17c4fc6a-2401-4a76-be08-519f823fc26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Getting quotas for user 307981144d4141ed9d609d88ea2e954e and project a5e2ae48d5764048b5ad189114755aa8. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:37:21.571617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-07d1e1f9-a3d5-473f-b9f1-ff23c56142f0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:21.582001 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-07d1e1f9-a3d5-473f-b9f1-ff23c56142f0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1207 microversion: 2.1 time: 0.110975 Aug 27 04:37:21.583174 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 764/1585] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:21 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1207 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:21.599985 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-17c4fc6a-2401-4a76-be08-519f823fc26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091045 Aug 27 04:37:21.606772 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 822/1586] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:37:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:21.606772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6abc5f3f-6629-47ed-9e21-cafd99cb1296 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Action: 'create', calling method: .version_select at 0x7f1f21c2da60>, body: {"pool": "b19603a7-e846-4692-9070-1ad63908fb7a"} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:21.621291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-79788a60-cc0e-439c-b655-e4adbed0126e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:21.622875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-79788a60-cc0e-439c-b655-e4adbed0126e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:21.635436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79788a60-cc0e-439c-b655-e4adbed0126e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:21.636228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79788a60-cc0e-439c-b655-e4adbed0126e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:21.637042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79788a60-cc0e-439c-b655-e4adbed0126e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:21.638507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79788a60-cc0e-439c-b655-e4adbed0126e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:21.640042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79788a60-cc0e-439c-b655-e4adbed0126e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:21.641359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79788a60-cc0e-439c-b655-e4adbed0126e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:21.828937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-79788a60-cc0e-439c-b655-e4adbed0126e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:21.839094 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-79788a60-cc0e-439c-b655-e4adbed0126e tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.248937 Aug 27 04:37:21.839694 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 765/1587] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:21 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:21.853356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4590620a-ae4d-4ab2-a5b0-a7c1a74b47b0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:21.854410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4590620a-ae4d-4ab2-a5b0-a7c1a74b47b0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:21.867926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4590620a-ae4d-4ab2-a5b0-a7c1a74b47b0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:21.872655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4590620a-ae4d-4ab2-a5b0-a7c1a74b47b0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:21.873426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4590620a-ae4d-4ab2-a5b0-a7c1a74b47b0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:21.875287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4590620a-ae4d-4ab2-a5b0-a7c1a74b47b0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:21.875918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4590620a-ae4d-4ab2-a5b0-a7c1a74b47b0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:21.876359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4590620a-ae4d-4ab2-a5b0-a7c1a74b47b0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:22.106416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4590620a-ae4d-4ab2-a5b0-a7c1a74b47b0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:22.117293 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4590620a-ae4d-4ab2-a5b0-a7c1a74b47b0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1313 microversion: 2.1 time: 0.274218 Aug 27 04:37:22.118223 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 766/1588] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:21 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:22.523888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-76b6598b-4f3f-4bbf-8069-7a2d6432441a req-40d4ffc6-1319-4a47-9b8f-0a2b80043292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131", "name": "network-vif-plugged", "status": "completed", "tag": "024c4406-8d1a-4d0a-8070-35c91fc50f3f"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:22.568434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-76b6598b-4f3f-4bbf-8069-7a2d6432441a req-40d4ffc6-1319-4a47-9b8f-0a2b80043292 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:22.569798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-76b6598b-4f3f-4bbf-8069-7a2d6432441a req-40d4ffc6-1319-4a47-9b8f-0a2b80043292 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:22.572221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-76b6598b-4f3f-4bbf-8069-7a2d6432441a req-40d4ffc6-1319-4a47-9b8f-0a2b80043292 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:22.591896 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-76b6598b-4f3f-4bbf-8069-7a2d6432441a req-40d4ffc6-1319-4a47-9b8f-0a2b80043292 service nova] Creating event network-vif-plugged:024c4406-8d1a-4d0a-8070-35c91fc50f3f for instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 on n-h1-854823-1 Aug 27 04:37:22.604066 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-76b6598b-4f3f-4bbf-8069-7a2d6432441a req-40d4ffc6-1319-4a47-9b8f-0a2b80043292 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096144 Aug 27 04:37:22.604893 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 767/1589] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:37:22.627253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-55a06c51-62a3-4e47-8924-37e93ba8dba0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:22.629027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-55a06c51-62a3-4e47-8924-37e93ba8dba0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:22.642586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55a06c51-62a3-4e47-8924-37e93ba8dba0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:22.643085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55a06c51-62a3-4e47-8924-37e93ba8dba0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:22.643626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55a06c51-62a3-4e47-8924-37e93ba8dba0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:22.644414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55a06c51-62a3-4e47-8924-37e93ba8dba0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:22.645213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55a06c51-62a3-4e47-8924-37e93ba8dba0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:22.645902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55a06c51-62a3-4e47-8924-37e93ba8dba0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:22.768915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-55a06c51-62a3-4e47-8924-37e93ba8dba0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:22.785355 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-55a06c51-62a3-4e47-8924-37e93ba8dba0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1285 microversion: 2.1 time: 0.178833 Aug 27 04:37:22.790134 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 768/1590] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:22 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:22.808600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5d4bf81e-754b-4449-8e62-7b09ac6caedc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:22.810724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5d4bf81e-754b-4449-8e62-7b09ac6caedc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:22.833004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d4bf81e-754b-4449-8e62-7b09ac6caedc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:22.834058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d4bf81e-754b-4449-8e62-7b09ac6caedc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:22.835587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d4bf81e-754b-4449-8e62-7b09ac6caedc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:22.836574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d4bf81e-754b-4449-8e62-7b09ac6caedc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:22.837164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d4bf81e-754b-4449-8e62-7b09ac6caedc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:22.844898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d4bf81e-754b-4449-8e62-7b09ac6caedc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:23.017835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5d4bf81e-754b-4449-8e62-7b09ac6caedc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:23.027459 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5d4bf81e-754b-4449-8e62-7b09ac6caedc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1259 microversion: 2.1 time: 0.235842 Aug 27 04:37:23.039039 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 769/1591] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:22 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1259 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:23.050208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-80222731-a626-4c1c-881a-5693010449d7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:23.050853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-80222731-a626-4c1c-881a-5693010449d7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:23.060116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80222731-a626-4c1c-881a-5693010449d7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:23.060889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80222731-a626-4c1c-881a-5693010449d7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:23.062914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80222731-a626-4c1c-881a-5693010449d7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:23.063996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80222731-a626-4c1c-881a-5693010449d7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:23.064835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80222731-a626-4c1c-881a-5693010449d7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:23.066173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80222731-a626-4c1c-881a-5693010449d7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:23.299454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-80222731-a626-4c1c-881a-5693010449d7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:23.314615 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-80222731-a626-4c1c-881a-5693010449d7 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.273589 Aug 27 04:37:23.315386 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 770/1592] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:23 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:23.335079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c0edf3d-c904-42d1-a259-e438657005ae tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "a6afcc5d-93c5-4bc5-bb1b-19604acedffa"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:23.338068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1c0edf3d-c904-42d1-a259-e438657005ae tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:23.347058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c0edf3d-c904-42d1-a259-e438657005ae tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:23.347818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c0edf3d-c904-42d1-a259-e438657005ae tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:23.348497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c0edf3d-c904-42d1-a259-e438657005ae tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:23.349384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c0edf3d-c904-42d1-a259-e438657005ae tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:23.350614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c0edf3d-c904-42d1-a259-e438657005ae tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:23.351211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c0edf3d-c904-42d1-a259-e438657005ae tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:23.452769 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-1c0edf3d-c904-42d1-a259-e438657005ae tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] HTTP exception thrown: Volume 5046af7c-f027-4d81-ab1a-74040e85b4f6 could not be found. Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c0edf3d-c904-42d1-a259-e438657005ae tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Request method failure captured: Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: request: PUT /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052/os-volume_attachments/5046af7c-f027-4d81-ab1a-74040e85b4f6 HTTP/1.1 Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 74 Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ7QwVao2Xs9VPzkeVIzRVt0U3JEj1bsT0ks7oUrWSTPOaT7kgWJuVUoiuYFykaYDpLUUxAlAAFnlfrtAq9TEkAwnfqh6xHt4LS2ImEJsrCdvAEd5Hzpf9yZJUERyhJDMut5wOxSHhmFh8BLY6Ru6znM8nZSV9x7xzxWscWKTaaRELs Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 95aaca20cfaf4ffd94b6c74b19923b12 Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-VolumesAdminNegativeTest-1457151031 Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:37:23.456570 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:37:23.458024 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/95aaca20cfaf4ffd94b6c74b19923b12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_95aaca20cfaf4ffd94b6c74b19923b12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/95aaca20cfaf4ffd94b6c74b19923b12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/95aaca20cfaf4ffd94b6c74b19923b12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:23.458024 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-VolumesAdminNegativeTest-1457151031 Aug 27 04:37:23.458024 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 95aaca20cfaf4ffd94b6c74b19923b12 Aug 27 04:37:23.458024 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1457151031 Aug 27 04:37:23.458024 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-VolumesAdminNegativeTest-1457151031-project-admin Aug 27 04:37:23.458024 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:37:23.458024 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:37:23.458024 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: fce48af2a1fc46a5a41d0dd299adec26 Aug 27 04:37:23.458024 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-VolumesAdminNegativeTest-1457151031-project-admin Aug 27 04:37:23.458024 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:37:23.458024 n-d-854823-1 devstack@n-api.service[128870]: {"volumeAttachment": {"volumeId": "a6afcc5d-93c5-4bc5-bb1b-19604acedffa"}} Aug 27 04:37:23.458024 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:37:23.458024 n-d-854823-1 devstack@n-api.service[128870]: exception: Volume 5046af7c-f027-4d81-ab1a-74040e85b4f6 could not be found. Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'server_id': '4587847a-63e5-46b3-a643-6643f65a5052', 'id': '5046af7c-f027-4d81-ab1a-74040e85b4f6', 'body': {'volumeAttachment': {'volumeId': 'a6afcc5d-93c5-4bc5-bb1b-19604acedffa'}}} Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:37:23.458910 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5046af7c-f027-4d81-ab1a-74040e85b4f6 could not be found. (HTTP 404) (Request-ID: req-2211b894-0a52-4b3b-a687-599a9a76d283) Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 04:37:23.460033 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5046af7c-f027-4d81-ab1a-74040e85b4f6 could not be found. Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:23.461392 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5046af7c-f027-4d81-ab1a-74040e85b4f6 could not be found. Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5046af7c-f027-4d81-ab1a-74040e85b4f6 could not be found. Aug 27 04:37:23.462594 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:23.463810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c0edf3d-c904-42d1-a259-e438657005ae tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] Returning 404 to user: Volume 5046af7c-f027-4d81-ab1a-74040e85b4f6 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:23.463810 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1c0edf3d-c904-42d1-a259-e438657005ae tempest-VolumesAdminNegativeTest-1457151031 tempest-VolumesAdminNegativeTest-1457151031-project-admin] 10.222.0.79 "PUT /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052/os-volume_attachments/5046af7c-f027-4d81-ab1a-74040e85b4f6" status: 404 len: 109 microversion: 2.1 time: 0.126921 Aug 27 04:37:23.463810 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 771/1593] 10.222.0.79 () {60 vars in 1433 bytes} [Sat Aug 27 04:37:23 2022] PUT /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052/os-volume_attachments/5046af7c-f027-4d81-ab1a-74040e85b4f6 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:37:23.474465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a9b63bf9-e212-4f4e-ac03-b2aaf9d27f4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:23.475522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a9b63bf9-e212-4f4e-ac03-b2aaf9d27f4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:23.493531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9b63bf9-e212-4f4e-ac03-b2aaf9d27f4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:23.494045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9b63bf9-e212-4f4e-ac03-b2aaf9d27f4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:23.494483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9b63bf9-e212-4f4e-ac03-b2aaf9d27f4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:23.495258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9b63bf9-e212-4f4e-ac03-b2aaf9d27f4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:23.495726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9b63bf9-e212-4f4e-ac03-b2aaf9d27f4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:23.496146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9b63bf9-e212-4f4e-ac03-b2aaf9d27f4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:23.831709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a9b63bf9-e212-4f4e-ac03-b2aaf9d27f4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:23.844815 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a9b63bf9-e212-4f4e-ac03-b2aaf9d27f4f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1313 microversion: 2.1 time: 0.384759 Aug 27 04:37:23.845411 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 772/1594] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:23 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:23.850653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-7bc4b2df-4dca-4ea6-8458-251308ced4c5 req-f7fc3c75-66b5-42cc-b56a-8c6dc38e04e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88460469-e163-4ebf-8076-73ddf76e72ad", "name": "network-vif-deleted", "tag": "218b43e2-66f7-4ab7-bc63-d7caa2c9c4ef"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:23.866763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7bc4b2df-4dca-4ea6-8458-251308ced4c5 req-f7fc3c75-66b5-42cc-b56a-8c6dc38e04e9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:23.868627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7bc4b2df-4dca-4ea6-8458-251308ced4c5 req-f7fc3c75-66b5-42cc-b56a-8c6dc38e04e9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:23.869079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7bc4b2df-4dca-4ea6-8458-251308ced4c5 req-f7fc3c75-66b5-42cc-b56a-8c6dc38e04e9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:23.881818 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-7bc4b2df-4dca-4ea6-8458-251308ced4c5 req-f7fc3c75-66b5-42cc-b56a-8c6dc38e04e9 service nova] Creating event network-vif-deleted:218b43e2-66f7-4ab7-bc63-d7caa2c9c4ef for instance 88460469-e163-4ebf-8076-73ddf76e72ad on n-h1-854823-1 Aug 27 04:37:23.888607 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-7bc4b2df-4dca-4ea6-8458-251308ced4c5 req-f7fc3c75-66b5-42cc-b56a-8c6dc38e04e9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041624 Aug 27 04:37:23.889902 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 773/1595] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:23.895926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-42cfee19-c759-4fad-8435-0c26b9374386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:23.896936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-42cfee19-c759-4fad-8435-0c26b9374386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:23.904308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42cfee19-c759-4fad-8435-0c26b9374386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:23.905092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42cfee19-c759-4fad-8435-0c26b9374386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:23.905724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42cfee19-c759-4fad-8435-0c26b9374386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:23.906708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42cfee19-c759-4fad-8435-0c26b9374386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:23.907382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42cfee19-c759-4fad-8435-0c26b9374386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:23.907975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42cfee19-c759-4fad-8435-0c26b9374386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:24.010531 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6abc5f3f-6629-47ed-9e21-cafd99cb1296 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.408413 Aug 27 04:37:24.011129 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 823/1596] 10.222.0.79 () {60 vars in 1170 bytes} [Sat Aug 27 04:37:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:24.021849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-42cfee19-c759-4fad-8435-0c26b9374386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:24.024207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-791e6060-612e-496b-831f-5139e5de1593 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Action: 'action', calling method: .version_select at 0x7f1f240c5280>, body: {"addFloatingIp": {"address": "172.25.3.221"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:24.027201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-791e6060-612e-496b-831f-5139e5de1593 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:24.035595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791e6060-612e-496b-831f-5139e5de1593 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:24.035843 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-42cfee19-c759-4fad-8435-0c26b9374386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1293 microversion: 2.1 time: 0.144107 Aug 27 04:37:24.036007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791e6060-612e-496b-831f-5139e5de1593 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:24.036460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791e6060-612e-496b-831f-5139e5de1593 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:24.037182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791e6060-612e-496b-831f-5139e5de1593 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:24.037552 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 774/1597] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:23 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1293 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:24.037980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791e6060-612e-496b-831f-5139e5de1593 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:24.038450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791e6060-612e-496b-831f-5139e5de1593 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:24.056619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e3d7e685-3cb6-4ec6-bb63-953a5052656b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:24.057248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e3d7e685-3cb6-4ec6-bb63-953a5052656b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:24.063525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3d7e685-3cb6-4ec6-bb63-953a5052656b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:24.064210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3d7e685-3cb6-4ec6-bb63-953a5052656b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:24.064847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3d7e685-3cb6-4ec6-bb63-953a5052656b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:24.065720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3d7e685-3cb6-4ec6-bb63-953a5052656b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:24.066462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3d7e685-3cb6-4ec6-bb63-953a5052656b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:24.067058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3d7e685-3cb6-4ec6-bb63-953a5052656b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:24.113276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791e6060-612e-496b-831f-5139e5de1593 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "refresh_cache-399bd6c1-40d1-463d-be8a-d63d5e31e32c" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:37:24.113898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791e6060-612e-496b-831f-5139e5de1593 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquired lock "refresh_cache-399bd6c1-40d1-463d-be8a-d63d5e31e32c" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:37:24.191995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e3d7e685-3cb6-4ec6-bb63-953a5052656b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:24.208786 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e3d7e685-3cb6-4ec6-bb63-953a5052656b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1259 microversion: 2.1 time: 0.155882 Aug 27 04:37:24.212192 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 775/1598] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:24 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:24.347623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0a9e3bd7-e2f0-44f5-b772-e339a3fe63db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:24.351086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0a9e3bd7-e2f0-44f5-b772-e339a3fe63db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:24.365980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a9e3bd7-e2f0-44f5-b772-e339a3fe63db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:24.367882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a9e3bd7-e2f0-44f5-b772-e339a3fe63db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:24.375412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a9e3bd7-e2f0-44f5-b772-e339a3fe63db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:24.376478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a9e3bd7-e2f0-44f5-b772-e339a3fe63db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:24.377136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a9e3bd7-e2f0-44f5-b772-e339a3fe63db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:24.379382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a9e3bd7-e2f0-44f5-b772-e339a3fe63db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:24.717555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0a9e3bd7-e2f0-44f5-b772-e339a3fe63db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:24.721009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:24.735675 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0a9e3bd7-e2f0-44f5-b772-e339a3fe63db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.394129 Aug 27 04:37:24.736358 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 776/1599] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:24 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:24.742489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1149269421", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:24.831950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] validate_networks() for [('77750c63-f69a-4025-8b95-db23cc8eae7f', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:37:25.864441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:37:25.865349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:37:25.866358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:37:25.867095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:37:25.867619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:37:25.879815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:25.880637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:25.881294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:25.882584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:25.883450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:25.884126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:25.907270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Getting quotas for project a5e2ae48d5764048b5ad189114755aa8. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:37:25.916770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Getting quotas for user 307981144d4141ed9d609d88ea2e954e and project a5e2ae48d5764048b5ad189114755aa8. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:37:25.933428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:37:25.939111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:37:25.980100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:26.010335 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-335882c5-a126-4d0f-a3be-3d41efcc27c8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.272607 Aug 27 04:37:26.012919 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 777/1600] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:37:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:37:26.019564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-33af172e-262c-4502-a05d-9f6c1fca54a0 req-300d4bbe-c255-4c6e-bf46-fc4563993c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88460469-e163-4ebf-8076-73ddf76e72ad", "name": "network-vif-unplugged", "status": "completed", "tag": "218b43e2-66f7-4ab7-bc63-d7caa2c9c4ef"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:26.048049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-33af172e-262c-4502-a05d-9f6c1fca54a0 req-300d4bbe-c255-4c6e-bf46-fc4563993c1c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:26.048049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-33af172e-262c-4502-a05d-9f6c1fca54a0 req-300d4bbe-c255-4c6e-bf46-fc4563993c1c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:26.048601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-33af172e-262c-4502-a05d-9f6c1fca54a0 req-300d4bbe-c255-4c6e-bf46-fc4563993c1c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:26.086164 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-33af172e-262c-4502-a05d-9f6c1fca54a0 req-300d4bbe-c255-4c6e-bf46-fc4563993c1c service nova] Creating event network-vif-unplugged:218b43e2-66f7-4ab7-bc63-d7caa2c9c4ef for instance 88460469-e163-4ebf-8076-73ddf76e72ad on n-h1-854823-1 Aug 27 04:37:26.097522 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-33af172e-262c-4502-a05d-9f6c1fca54a0 req-300d4bbe-c255-4c6e-bf46-fc4563993c1c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083045 Aug 27 04:37:26.098158 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 778/1601] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:26.112446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f3582188-5962-4fdc-9357-e395e4124b03 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:26.113239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f3582188-5962-4fdc-9357-e395e4124b03 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:26.137124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3582188-5962-4fdc-9357-e395e4124b03 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:26.137639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3582188-5962-4fdc-9357-e395e4124b03 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:26.138079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3582188-5962-4fdc-9357-e395e4124b03 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:26.138803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3582188-5962-4fdc-9357-e395e4124b03 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:26.139295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3582188-5962-4fdc-9357-e395e4124b03 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:26.139717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3582188-5962-4fdc-9357-e395e4124b03 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:26.394604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f3582188-5962-4fdc-9357-e395e4124b03 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:26.410739 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f3582188-5962-4fdc-9357-e395e4124b03 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1463 microversion: 2.1 time: 0.306310 Aug 27 04:37:26.413577 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 779/1602] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:26 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1463 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:26.427546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4c6d4e7-ec7b-42f2-9d18-0932636aacf1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:26.428575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f4c6d4e7-ec7b-42f2-9d18-0932636aacf1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:26.441502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4c6d4e7-ec7b-42f2-9d18-0932636aacf1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:26.442426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4c6d4e7-ec7b-42f2-9d18-0932636aacf1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:26.443035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4c6d4e7-ec7b-42f2-9d18-0932636aacf1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:26.443975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4c6d4e7-ec7b-42f2-9d18-0932636aacf1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:26.444712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4c6d4e7-ec7b-42f2-9d18-0932636aacf1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:26.445596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4c6d4e7-ec7b-42f2-9d18-0932636aacf1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:26.739622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f4c6d4e7-ec7b-42f2-9d18-0932636aacf1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:26.748096 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f4c6d4e7-ec7b-42f2-9d18-0932636aacf1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1358 microversion: 2.1 time: 0.333545 Aug 27 04:37:26.788667 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 780/1603] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:26 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1358 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:26.815430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1fa95c3a-0688-4c0c-8d67-25cdff51461b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:26.816092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1fa95c3a-0688-4c0c-8d67-25cdff51461b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:26.838099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fa95c3a-0688-4c0c-8d67-25cdff51461b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:26.844725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fa95c3a-0688-4c0c-8d67-25cdff51461b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:26.845524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fa95c3a-0688-4c0c-8d67-25cdff51461b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:26.846785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fa95c3a-0688-4c0c-8d67-25cdff51461b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:26.847421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fa95c3a-0688-4c0c-8d67-25cdff51461b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:26.848381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fa95c3a-0688-4c0c-8d67-25cdff51461b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:26.871875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-791e6060-612e-496b-831f-5139e5de1593 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Building network info cache for instance {{(pid=128869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:37:27.221638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1fa95c3a-0688-4c0c-8d67-25cdff51461b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:27.234035 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1fa95c3a-0688-4c0c-8d67-25cdff51461b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1307 microversion: 2.1 time: 0.443866 Aug 27 04:37:27.235223 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 781/1604] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:26 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1307 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:27.242974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-db071720-c8ad-438e-a84c-cb975b127011 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:27.243914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-db071720-c8ad-438e-a84c-cb975b127011 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:27.254025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db071720-c8ad-438e-a84c-cb975b127011 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:27.254931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db071720-c8ad-438e-a84c-cb975b127011 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:27.255788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db071720-c8ad-438e-a84c-cb975b127011 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:27.257171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db071720-c8ad-438e-a84c-cb975b127011 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:27.257698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db071720-c8ad-438e-a84c-cb975b127011 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:27.258299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db071720-c8ad-438e-a84c-cb975b127011 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:27.561751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-db071720-c8ad-438e-a84c-cb975b127011 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:27.577303 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-db071720-c8ad-438e-a84c-cb975b127011 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.339773 Aug 27 04:37:27.578386 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 782/1605] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:27 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:27.595364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-875c3103-8991-4e2d-adcf-eb5e1310e580 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:27.595981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-875c3103-8991-4e2d-adcf-eb5e1310e580 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:27.602040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-875c3103-8991-4e2d-adcf-eb5e1310e580 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:27.607117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-875c3103-8991-4e2d-adcf-eb5e1310e580 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:27.607581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-875c3103-8991-4e2d-adcf-eb5e1310e580 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:27.608883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-875c3103-8991-4e2d-adcf-eb5e1310e580 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:27.609352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-875c3103-8991-4e2d-adcf-eb5e1310e580 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:27.609779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-875c3103-8991-4e2d-adcf-eb5e1310e580 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:27.728161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-875c3103-8991-4e2d-adcf-eb5e1310e580 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:27.749100 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-875c3103-8991-4e2d-adcf-eb5e1310e580 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1277 microversion: 2.1 time: 0.168391 Aug 27 04:37:27.750047 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 783/1606] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:27 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:27.755390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ede901bd-b40e-4b4a-8e5b-545d0caf6eaa tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:27.756025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ede901bd-b40e-4b4a-8e5b-545d0caf6eaa tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:27.762726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ede901bd-b40e-4b4a-8e5b-545d0caf6eaa tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:27.763286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ede901bd-b40e-4b4a-8e5b-545d0caf6eaa tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:27.763909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ede901bd-b40e-4b4a-8e5b-545d0caf6eaa tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:27.765343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ede901bd-b40e-4b4a-8e5b-545d0caf6eaa tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:27.765960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ede901bd-b40e-4b4a-8e5b-545d0caf6eaa tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:27.766544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ede901bd-b40e-4b4a-8e5b-545d0caf6eaa tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:27.942211 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ede901bd-b40e-4b4a-8e5b-545d0caf6eaa tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1614 microversion: 2.1 time: 0.190989 Aug 27 04:37:27.942797 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 784/1607] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:27 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1614 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:27.956390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d29120f7-1922-4ef1-88fa-5358271a8fb9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:27.959260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d29120f7-1922-4ef1-88fa-5358271a8fb9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:27.965505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d29120f7-1922-4ef1-88fa-5358271a8fb9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:27.966225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d29120f7-1922-4ef1-88fa-5358271a8fb9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:27.968041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d29120f7-1922-4ef1-88fa-5358271a8fb9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:27.968961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d29120f7-1922-4ef1-88fa-5358271a8fb9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:27.969578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d29120f7-1922-4ef1-88fa-5358271a8fb9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:27.970188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d29120f7-1922-4ef1-88fa-5358271a8fb9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:28.002409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d29120f7-1922-4ef1-88fa-5358271a8fb9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:37:28.116898 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d29120f7-1922-4ef1-88fa-5358271a8fb9 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 204 len: 0 microversion: 2.1 time: 0.169054 Aug 27 04:37:28.118055 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 785/1608] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:37:27 2022] DELETE /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:28.125889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-c6db70cc-6799-466b-bc76-05d839007670 req-b70425ee-9611-455b-b1c7-caeddc412e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "399bd6c1-40d1-463d-be8a-d63d5e31e32c", "tag": "d5ab4a86-3f84-45fc-bed7-5c705b957f6c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:28.137406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c6db70cc-6799-466b-bc76-05d839007670 req-b70425ee-9611-455b-b1c7-caeddc412e8e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:28.138283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c6db70cc-6799-466b-bc76-05d839007670 req-b70425ee-9611-455b-b1c7-caeddc412e8e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:28.138881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c6db70cc-6799-466b-bc76-05d839007670 req-b70425ee-9611-455b-b1c7-caeddc412e8e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:28.156522 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-c6db70cc-6799-466b-bc76-05d839007670 req-b70425ee-9611-455b-b1c7-caeddc412e8e service nova] Creating event network-changed:d5ab4a86-3f84-45fc-bed7-5c705b957f6c for instance 399bd6c1-40d1-463d-be8a-d63d5e31e32c on n-h2-854823-1 Aug 27 04:37:28.163091 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-c6db70cc-6799-466b-bc76-05d839007670 req-b70425ee-9611-455b-b1c7-caeddc412e8e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043067 Aug 27 04:37:28.164918 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 786/1609] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:28.174212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-230ba3e6-e9fc-4fb4-bf3f-ccc08649e4c6 req-9151b8a6-162b-4522-8596-dce8d239eedf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c1ebbce-7c0d-4f08-a05f-359d0527b76d", "tag": "8348ead6-1b46-443f-99ec-f72deeb2c4f5"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:28.185330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-230ba3e6-e9fc-4fb4-bf3f-ccc08649e4c6 req-9151b8a6-162b-4522-8596-dce8d239eedf service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:28.186356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-230ba3e6-e9fc-4fb4-bf3f-ccc08649e4c6 req-9151b8a6-162b-4522-8596-dce8d239eedf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:28.187103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-230ba3e6-e9fc-4fb4-bf3f-ccc08649e4c6 req-9151b8a6-162b-4522-8596-dce8d239eedf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:28.199884 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-230ba3e6-e9fc-4fb4-bf3f-ccc08649e4c6 req-9151b8a6-162b-4522-8596-dce8d239eedf service nova] Creating event network-changed:8348ead6-1b46-443f-99ec-f72deeb2c4f5 for instance 0c1ebbce-7c0d-4f08-a05f-359d0527b76d on n-h1-854823-1 Aug 27 04:37:28.206633 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-230ba3e6-e9fc-4fb4-bf3f-ccc08649e4c6 req-9151b8a6-162b-4522-8596-dce8d239eedf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038970 Aug 27 04:37:28.211801 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 787/1610] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:28.218559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-11307694-c869-424b-9fa7-80b42a66fc12 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:28.219471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-11307694-c869-424b-9fa7-80b42a66fc12 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:28.226454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11307694-c869-424b-9fa7-80b42a66fc12 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:28.227021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11307694-c869-424b-9fa7-80b42a66fc12 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:28.227375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11307694-c869-424b-9fa7-80b42a66fc12 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:28.228142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11307694-c869-424b-9fa7-80b42a66fc12 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:28.228680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11307694-c869-424b-9fa7-80b42a66fc12 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:28.229286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11307694-c869-424b-9fa7-80b42a66fc12 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:28.334745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-791e6060-612e-496b-831f-5139e5de1593 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Updating instance_info_cache with network_info: [{"id": "d5ab4a86-3f84-45fc-bed7-5c705b957f6c", "address": "fa:16:3e:e8:68:ea", "network": {"id": "3045fa03-f348-4c29-a5c4-f817e8f7627d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-855046663-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "98283183679c42029b0ca02db8762ed4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd5ab4a86-3f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:37:28.359053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791e6060-612e-496b-831f-5139e5de1593 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Releasing lock "refresh_cache-399bd6c1-40d1-463d-be8a-d63d5e31e32c" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:37:28.359986 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-791e6060-612e-496b-831f-5139e5de1593 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action" status: 202 len: 0 microversion: 2.1 time: 4.339856 Aug 27 04:37:28.361193 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 824/1611] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:37:24 2022] POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action => generated 0 bytes in 4342 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Aug 27 04:37:28.366931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-deeefb5a-885a-4332-8df4-6bb13ef19db5 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:28.367589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-deeefb5a-885a-4332-8df4-6bb13ef19db5 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:28.375409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deeefb5a-885a-4332-8df4-6bb13ef19db5 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:28.376797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deeefb5a-885a-4332-8df4-6bb13ef19db5 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:28.377347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deeefb5a-885a-4332-8df4-6bb13ef19db5 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:28.378215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deeefb5a-885a-4332-8df4-6bb13ef19db5 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:28.379072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deeefb5a-885a-4332-8df4-6bb13ef19db5 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:28.379613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deeefb5a-885a-4332-8df4-6bb13ef19db5 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:28.478074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-11307694-c869-424b-9fa7-80b42a66fc12 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:28.484757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-deeefb5a-885a-4332-8df4-6bb13ef19db5 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ce16e77bed80442e8bcdbd3a1712fbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24f008b1e264b1eb9f445a75a9eb777', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:28.484757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-deeefb5a-885a-4332-8df4-6bb13ef19db5 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] flavor_id is None. Assuming migration. {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 04:37:28.484757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-deeefb5a-885a-4332-8df4-6bb13ef19db5 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 04:37:28.493877 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-11307694-c869-424b-9fa7-80b42a66fc12 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1358 microversion: 2.1 time: 0.280369 Aug 27 04:37:28.494837 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 788/1612] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:28 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:28.502928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a883304d-b42f-4e69-9e34-570b161db0a1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:28.503765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a883304d-b42f-4e69-9e34-570b161db0a1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:28.516464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a883304d-b42f-4e69-9e34-570b161db0a1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:28.517023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a883304d-b42f-4e69-9e34-570b161db0a1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:28.517460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a883304d-b42f-4e69-9e34-570b161db0a1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:28.518169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a883304d-b42f-4e69-9e34-570b161db0a1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:28.518625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a883304d-b42f-4e69-9e34-570b161db0a1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:28.521263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a883304d-b42f-4e69-9e34-570b161db0a1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:28.723463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a883304d-b42f-4e69-9e34-570b161db0a1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:28.736793 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a883304d-b42f-4e69-9e34-570b161db0a1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1514 microversion: 2.1 time: 0.236580 Aug 27 04:37:28.737403 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 789/1613] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:28 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:28.753673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-800ae89b-a2f3-4834-8029-122c4f60f3ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:28.754562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-800ae89b-a2f3-4834-8029-122c4f60f3ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:28.761413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-800ae89b-a2f3-4834-8029-122c4f60f3ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:28.761911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-800ae89b-a2f3-4834-8029-122c4f60f3ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:28.762350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-800ae89b-a2f3-4834-8029-122c4f60f3ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:28.763060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-800ae89b-a2f3-4834-8029-122c4f60f3ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:28.766391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-800ae89b-a2f3-4834-8029-122c4f60f3ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:28.766919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-800ae89b-a2f3-4834-8029-122c4f60f3ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:28.854324 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-deeefb5a-885a-4332-8df4-6bb13ef19db5 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131/action" status: 202 len: 0 microversion: 2.1 time: 0.491682 Aug 27 04:37:28.854977 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 825/1614] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:37:28 2022] POST /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:37:28.867822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c50b99c9-1527-4507-b1fe-bf98c4aeafd2 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Action: 'create', calling method: .version_select at 0x7f1f221e5310>, body: {"pool": "b19603a7-e846-4692-9070-1ad63908fb7a"} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:28.935224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-800ae89b-a2f3-4834-8029-122c4f60f3ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:28.943371 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-800ae89b-a2f3-4834-8029-122c4f60f3ef tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1307 microversion: 2.1 time: 0.204449 Aug 27 04:37:28.944247 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 790/1615] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:28 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1307 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:28.949193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-22cad6ec-51aa-4f59-bbc9-4df312a174cf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:28.950055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-22cad6ec-51aa-4f59-bbc9-4df312a174cf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:28.956052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22cad6ec-51aa-4f59-bbc9-4df312a174cf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:28.957283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22cad6ec-51aa-4f59-bbc9-4df312a174cf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:28.957950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22cad6ec-51aa-4f59-bbc9-4df312a174cf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:28.958879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22cad6ec-51aa-4f59-bbc9-4df312a174cf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:28.959525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22cad6ec-51aa-4f59-bbc9-4df312a174cf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:28.960053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22cad6ec-51aa-4f59-bbc9-4df312a174cf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:29.118168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-22cad6ec-51aa-4f59-bbc9-4df312a174cf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:29.127485 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-22cad6ec-51aa-4f59-bbc9-4df312a174cf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1472 microversion: 2.1 time: 0.181894 Aug 27 04:37:29.128082 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 791/1616] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:28 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:29.149011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9f918a48-f51c-4ec9-a922-c283bc356977 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:29.149622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9f918a48-f51c-4ec9-a922-c283bc356977 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:29.157148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f918a48-f51c-4ec9-a922-c283bc356977 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:29.157646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f918a48-f51c-4ec9-a922-c283bc356977 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:29.158087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f918a48-f51c-4ec9-a922-c283bc356977 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:29.158795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f918a48-f51c-4ec9-a922-c283bc356977 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:29.159258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f918a48-f51c-4ec9-a922-c283bc356977 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:29.159686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f918a48-f51c-4ec9-a922-c283bc356977 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:29.229996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9f918a48-f51c-4ec9-a922-c283bc356977 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:29.238429 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9f918a48-f51c-4ec9-a922-c283bc356977 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1283 microversion: 2.1 time: 0.093243 Aug 27 04:37:29.239123 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 792/1617] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:29 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1283 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:29.252402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d1ace638-b66e-4746-9709-640393206aca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:29.253044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d1ace638-b66e-4746-9709-640393206aca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:29.259458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1ace638-b66e-4746-9709-640393206aca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:29.260022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1ace638-b66e-4746-9709-640393206aca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:29.260664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1ace638-b66e-4746-9709-640393206aca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:29.261571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1ace638-b66e-4746-9709-640393206aca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:29.262041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1ace638-b66e-4746-9709-640393206aca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:29.262474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1ace638-b66e-4746-9709-640393206aca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:29.405565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d1ace638-b66e-4746-9709-640393206aca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:29.414022 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d1ace638-b66e-4746-9709-640393206aca tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1472 microversion: 2.1 time: 0.173691 Aug 27 04:37:29.430022 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 793/1618] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:29 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1472 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:29.523363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c47c7b3-4b61-4b1b-8b65-eacd1ff4548e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:29.524387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4c47c7b3-4b61-4b1b-8b65-eacd1ff4548e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:29.540430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c47c7b3-4b61-4b1b-8b65-eacd1ff4548e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:29.541474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c47c7b3-4b61-4b1b-8b65-eacd1ff4548e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:29.541474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c47c7b3-4b61-4b1b-8b65-eacd1ff4548e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:29.542246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c47c7b3-4b61-4b1b-8b65-eacd1ff4548e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:29.542713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c47c7b3-4b61-4b1b-8b65-eacd1ff4548e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:29.543144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c47c7b3-4b61-4b1b-8b65-eacd1ff4548e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:29.578864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:29.738577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4c47c7b3-4b61-4b1b-8b65-eacd1ff4548e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:29.747275 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4c47c7b3-4b61-4b1b-8b65-eacd1ff4548e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1358 microversion: 2.1 time: 0.235106 Aug 27 04:37:29.747887 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 794/1619] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:29 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:29.758661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-452f1c95-6f3a-4583-bc09-a19022e76a84 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:29.759758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-452f1c95-6f3a-4583-bc09-a19022e76a84 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:29.767574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-452f1c95-6f3a-4583-bc09-a19022e76a84 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:29.768093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-452f1c95-6f3a-4583-bc09-a19022e76a84 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:29.768568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-452f1c95-6f3a-4583-bc09-a19022e76a84 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:29.769313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-452f1c95-6f3a-4583-bc09-a19022e76a84 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:29.769773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-452f1c95-6f3a-4583-bc09-a19022e76a84 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:29.770199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-452f1c95-6f3a-4583-bc09-a19022e76a84 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:29.911710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-452f1c95-6f3a-4583-bc09-a19022e76a84 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:29.920518 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-452f1c95-6f3a-4583-bc09-a19022e76a84 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1514 microversion: 2.1 time: 0.165749 Aug 27 04:37:29.932559 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 795/1620] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:29 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:29.964050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e53ac6b7-529f-41ab-a5c8-dc73aa765249 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:29.965032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e53ac6b7-529f-41ab-a5c8-dc73aa765249 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:29.975467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e53ac6b7-529f-41ab-a5c8-dc73aa765249 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:29.976674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e53ac6b7-529f-41ab-a5c8-dc73aa765249 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:29.977324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e53ac6b7-529f-41ab-a5c8-dc73aa765249 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:29.978620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e53ac6b7-529f-41ab-a5c8-dc73aa765249 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:29.979998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e53ac6b7-529f-41ab-a5c8-dc73aa765249 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:29.980719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e53ac6b7-529f-41ab-a5c8-dc73aa765249 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.219199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e53ac6b7-529f-41ab-a5c8-dc73aa765249 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:30.227488 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e53ac6b7-529f-41ab-a5c8-dc73aa765249 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1307 microversion: 2.1 time: 0.267870 Aug 27 04:37:30.241688 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 796/1621] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:29 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1307 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:30.247296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-918c0680-0fec-42c2-8ca5-92d4449aef8b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:30.248007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-918c0680-0fec-42c2-8ca5-92d4449aef8b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:30.256273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-918c0680-0fec-42c2-8ca5-92d4449aef8b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.256813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-918c0680-0fec-42c2-8ca5-92d4449aef8b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.257259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-918c0680-0fec-42c2-8ca5-92d4449aef8b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.257971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-918c0680-0fec-42c2-8ca5-92d4449aef8b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.258454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-918c0680-0fec-42c2-8ca5-92d4449aef8b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.258884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-918c0680-0fec-42c2-8ca5-92d4449aef8b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.442142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-918c0680-0fec-42c2-8ca5-92d4449aef8b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:30.450279 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-918c0680-0fec-42c2-8ca5-92d4449aef8b tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1478 microversion: 2.1 time: 0.207415 Aug 27 04:37:30.451042 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 797/1622] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:30 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1478 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:30.456141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-57614f11-370c-4b4b-9a74-10e12b2a4234 req-a4afc300-4863-40eb-996f-446f060e0f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c35fba-1273-4d50-9b92-f96b93bb1295", "tag": "0e539f18-246d-462f-9c29-7eff0c12d3dd"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:30.465947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-57614f11-370c-4b4b-9a74-10e12b2a4234 req-a4afc300-4863-40eb-996f-446f060e0f61 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.466254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-57614f11-370c-4b4b-9a74-10e12b2a4234 req-a4afc300-4863-40eb-996f-446f060e0f61 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.466688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-57614f11-370c-4b4b-9a74-10e12b2a4234 req-a4afc300-4863-40eb-996f-446f060e0f61 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.479134 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-57614f11-370c-4b4b-9a74-10e12b2a4234 req-a4afc300-4863-40eb-996f-446f060e0f61 service nova] Creating event network-changed:0e539f18-246d-462f-9c29-7eff0c12d3dd for instance b2c35fba-1273-4d50-9b92-f96b93bb1295 on n-h1-854823-1 Aug 27 04:37:30.484172 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-57614f11-370c-4b4b-9a74-10e12b2a4234 req-a4afc300-4863-40eb-996f-446f060e0f61 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031359 Aug 27 04:37:30.484831 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 798/1623] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:30.491173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0927133f-897e-4fd1-b647-b5503a0d25fa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:30.491888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0927133f-897e-4fd1-b647-b5503a0d25fa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:30.499132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0927133f-897e-4fd1-b647-b5503a0d25fa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.499866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0927133f-897e-4fd1-b647-b5503a0d25fa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.500304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0927133f-897e-4fd1-b647-b5503a0d25fa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.501041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0927133f-897e-4fd1-b647-b5503a0d25fa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.501499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0927133f-897e-4fd1-b647-b5503a0d25fa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.501923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0927133f-897e-4fd1-b647-b5503a0d25fa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.638163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0927133f-897e-4fd1-b647-b5503a0d25fa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:30.645894 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0927133f-897e-4fd1-b647-b5503a0d25fa tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1325 microversion: 2.1 time: 0.159140 Aug 27 04:37:30.646486 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 799/1624] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:30 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1325 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:30.651144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a8145dbf-84f0-49d8-b5a1-f43e0a8c00e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:30.651761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a8145dbf-84f0-49d8-b5a1-f43e0a8c00e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:30.657778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8145dbf-84f0-49d8-b5a1-f43e0a8c00e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.658460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8145dbf-84f0-49d8-b5a1-f43e0a8c00e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.658698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8145dbf-84f0-49d8-b5a1-f43e0a8c00e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.659403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8145dbf-84f0-49d8-b5a1-f43e0a8c00e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.659860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8145dbf-84f0-49d8-b5a1-f43e0a8c00e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.660290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8145dbf-84f0-49d8-b5a1-f43e0a8c00e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.671180 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c50b99c9-1527-4507-b1fe-bf98c4aeafd2 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.808867 Aug 27 04:37:30.671854 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 826/1625] 10.222.0.79 () {60 vars in 1170 bytes} [Sat Aug 27 04:37:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:30.683707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.135"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:30.686789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:30.693081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.693506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.693945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.694652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.695115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.696046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.720709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "refresh_cache-399bd6c1-40d1-463d-be8a-d63d5e31e32c" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:37:30.721112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquired lock "refresh_cache-399bd6c1-40d1-463d-be8a-d63d5e31e32c" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:37:30.795056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a8145dbf-84f0-49d8-b5a1-f43e0a8c00e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:30.803388 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a8145dbf-84f0-49d8-b5a1-f43e0a8c00e0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1472 microversion: 2.1 time: 0.155925 Aug 27 04:37:30.803960 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 800/1626] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:30 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1472 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:30.808670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0de1befd-ad58-402d-99ea-a218b0d7bb8c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:30.814442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0de1befd-ad58-402d-99ea-a218b0d7bb8c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:30.820343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0de1befd-ad58-402d-99ea-a218b0d7bb8c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.821898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0de1befd-ad58-402d-99ea-a218b0d7bb8c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.822550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0de1befd-ad58-402d-99ea-a218b0d7bb8c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.823272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0de1befd-ad58-402d-99ea-a218b0d7bb8c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.823727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0de1befd-ad58-402d-99ea-a218b0d7bb8c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.824148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0de1befd-ad58-402d-99ea-a218b0d7bb8c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.958376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0de1befd-ad58-402d-99ea-a218b0d7bb8c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:30.966519 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0de1befd-ad58-402d-99ea-a218b0d7bb8c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1358 microversion: 2.1 time: 0.161489 Aug 27 04:37:30.980176 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 801/1627] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:30 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:30.980176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d1cbec2e-657e-46b7-ae95-48cb1acf0de3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:30.980176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d1cbec2e-657e-46b7-ae95-48cb1acf0de3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:30.980176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1cbec2e-657e-46b7-ae95-48cb1acf0de3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.980672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1cbec2e-657e-46b7-ae95-48cb1acf0de3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.980672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1cbec2e-657e-46b7-ae95-48cb1acf0de3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.981014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1cbec2e-657e-46b7-ae95-48cb1acf0de3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.981569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1cbec2e-657e-46b7-ae95-48cb1acf0de3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.982392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1cbec2e-657e-46b7-ae95-48cb1acf0de3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:31.103932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.135 (920987b1-c8e9-4e81-82e9-e1a5626d0109) with port d5ab4a86-3f84-45fc-bed7-5c705b957f6c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b19603a7-e846-4692-9070-1ad63908fb7a.", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:37:31.104789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Releasing lock "refresh_cache-399bd6c1-40d1-463d-be8a-d63d5e31e32c" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:37:31.105440 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.135 (920987b1-c8e9-4e81-82e9-e1a5626d0109) with port d5ab4a86-3f84-45fc-bed7-5c705b957f6c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b19603a7-e846-4692-9070-1ad63908fb7a. Aug 27 04:37:31.105440 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-742aeff6-38bb-4699-884b-da95ff70d181'] Aug 27 04:37:31.129560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d1cbec2e-657e-46b7-ae95-48cb1acf0de3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Request method failure captured: Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action HTTP/1.1 Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 46 Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ9srsYRSAkk8Iy57Gi-zwEzQi_AHCxhmcaCdwIHaorTcGK7_K12EqJrV63JT4zLOauz97ihkiOY_N4siPSbr8xrGNf2GMqFiPLJHkPQUNz2K8RgwBFzQT26v4jpu4Jvf-h8XF9J6-QLpLUlb8olb-7hIAIn6MrSp8yc0dBTzAxcJe4 Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 98283183679c42029b0ca02db8762ed4 Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:37:31.133676 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:37:31.135337 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/98283183679c42029b0ca02db8762ed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_98283183679c42029b0ca02db8762ed4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/98283183679c42029b0ca02db8762ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/98283183679c42029b0ca02db8762ed4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:31.135337 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:31.135337 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 98283183679c42029b0ca02db8762ed4 Aug 27 04:37:31.135337 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:31.135337 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project Aug 27 04:37:31.135337 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:37:31.135337 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:37:31.135337 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8852be5166774a5e870512f289cf0aa6 Aug 27 04:37:31.135337 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project Aug 27 04:37:31.135337 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:37:31.135337 n-d-854823-1 devstack@n-api.service[128869]: {"addFloatingIp": {"address": "172.25.3.135"}} Aug 27 04:37:31.135337 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: exception: Cannot associate floating IP 172.25.3.135 (920987b1-c8e9-4e81-82e9-e1a5626d0109) with port d5ab4a86-3f84-45fc-bed7-5c705b957f6c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b19603a7-e846-4692-9070-1ad63908fb7a. Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-742aeff6-38bb-4699-884b-da95ff70d181'] Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '399bd6c1-40d1-463d-be8a-d63d5e31e32c', 'body': {'addFloatingIp': {'address': '172.25.3.135'}}} Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:37:31.136148 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:37:31.137501 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.135 (920987b1-c8e9-4e81-82e9-e1a5626d0109) with port d5ab4a86-3f84-45fc-bed7-5c705b957f6c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b19603a7-e846-4692-9070-1ad63908fb7a. Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-742aeff6-38bb-4699-884b-da95ff70d181'] Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.135 (920987b1-c8e9-4e81-82e9-e1a5626d0109) with port d5ab4a86-3f84-45fc-bed7-5c705b957f6c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b19603a7-e846-4692-9070-1ad63908fb7a. Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-742aeff6-38bb-4699-884b-da95ff70d181'] Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:31.138652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.135 (920987b1-c8e9-4e81-82e9-e1a5626d0109) with port d5ab4a86-3f84-45fc-bed7-5c705b957f6c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b19603a7-e846-4692-9070-1ad63908fb7a. Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-742aeff6-38bb-4699-884b-da95ff70d181'] Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:31.139912 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:31.141365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:31.141365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:31.141365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:31.141365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:31.141365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:31.141365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:31.141365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.135 (920987b1-c8e9-4e81-82e9-e1a5626d0109) with port d5ab4a86-3f84-45fc-bed7-5c705b957f6c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b19603a7-e846-4692-9070-1ad63908fb7a. Aug 27 04:37:31.141365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-742aeff6-38bb-4699-884b-da95ff70d181'] Aug 27 04:37:31.141365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:31.141365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Returning 400 to user: Cannot associate floating IP 172.25.3.135 (920987b1-c8e9-4e81-82e9-e1a5626d0109) with port d5ab4a86-3f84-45fc-bed7-5c705b957f6c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b19603a7-e846-4692-9070-1ad63908fb7a. Aug 27 04:37:31.141365 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-742aeff6-38bb-4699-884b-da95ff70d181'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:31.142208 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d2d8a18-72d6-4379-9288-d7601f8c02d9 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action" status: 400 len: 381 microversion: 2.1 time: 0.457049 Aug 27 04:37:31.142299 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d1cbec2e-657e-46b7-ae95-48cb1acf0de3 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1514 microversion: 2.1 time: 0.169064 Aug 27 04:37:31.142299 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 802/1628] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:30 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:31.142487 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 827/1629] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:37:30 2022] POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action => generated 381 bytes in 459 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:37:31.147490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-49ec371b-b33c-4853-822b-07dc2657189d tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '.version_select at 0x7f1f21f7c280>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:31.249018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:31.254839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-680814df-f5d4-4581-acfc-6ceee77eb942 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:31.255677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-680814df-f5d4-4581-acfc-6ceee77eb942 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:31.262829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-680814df-f5d4-4581-acfc-6ceee77eb942 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:31.263374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-680814df-f5d4-4581-acfc-6ceee77eb942 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:31.263818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-680814df-f5d4-4581-acfc-6ceee77eb942 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:31.264600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-680814df-f5d4-4581-acfc-6ceee77eb942 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:31.265001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-680814df-f5d4-4581-acfc-6ceee77eb942 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:31.265626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-680814df-f5d4-4581-acfc-6ceee77eb942 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:31.555864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=16 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:31.664157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-680814df-f5d4-4581-acfc-6ceee77eb942 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:31.675384 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-680814df-f5d4-4581-acfc-6ceee77eb942 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1307 microversion: 2.1 time: 0.426939 Aug 27 04:37:31.676407 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 828/1630] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:31 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1307 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:31.682928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f95a8ef-dee6-4b7b-b70c-5d5807c0721c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:31.683855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f95a8ef-dee6-4b7b-b70c-5d5807c0721c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:31.691359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f95a8ef-dee6-4b7b-b70c-5d5807c0721c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:31.692197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f95a8ef-dee6-4b7b-b70c-5d5807c0721c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:31.692992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f95a8ef-dee6-4b7b-b70c-5d5807c0721c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:31.693956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f95a8ef-dee6-4b7b-b70c-5d5807c0721c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:31.694514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f95a8ef-dee6-4b7b-b70c-5d5807c0721c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:31.695068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f95a8ef-dee6-4b7b-b70c-5d5807c0721c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:32.047354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f95a8ef-dee6-4b7b-b70c-5d5807c0721c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:32.055614 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f95a8ef-dee6-4b7b-b70c-5d5807c0721c tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1478 microversion: 2.1 time: 0.377885 Aug 27 04:37:32.056224 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 829/1631] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:31 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1478 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:32.060988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-689ab7b1-7f4e-40db-b2a1-f42726ccd028 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:32.061599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-689ab7b1-7f4e-40db-b2a1-f42726ccd028 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:32.076839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-689ab7b1-7f4e-40db-b2a1-f42726ccd028 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:32.090115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-689ab7b1-7f4e-40db-b2a1-f42726ccd028 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:32.090861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-689ab7b1-7f4e-40db-b2a1-f42726ccd028 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:32.092637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-689ab7b1-7f4e-40db-b2a1-f42726ccd028 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:32.096169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-689ab7b1-7f4e-40db-b2a1-f42726ccd028 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:32.096882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-689ab7b1-7f4e-40db-b2a1-f42726ccd028 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:32.315886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-689ab7b1-7f4e-40db-b2a1-f42726ccd028 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:32.340364 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-689ab7b1-7f4e-40db-b2a1-f42726ccd028 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1325 microversion: 2.1 time: 0.268399 Aug 27 04:37:32.352567 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 830/1632] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:32 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1325 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:32.360640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7fd242fc-feca-4127-9cf5-f7ffb2271ce7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:32.363016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7fd242fc-feca-4127-9cf5-f7ffb2271ce7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:32.377338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd242fc-feca-4127-9cf5-f7ffb2271ce7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:32.377832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd242fc-feca-4127-9cf5-f7ffb2271ce7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:32.378269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd242fc-feca-4127-9cf5-f7ffb2271ce7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:32.379150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd242fc-feca-4127-9cf5-f7ffb2271ce7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:32.379701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd242fc-feca-4127-9cf5-f7ffb2271ce7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:32.381240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd242fc-feca-4127-9cf5-f7ffb2271ce7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:32.522852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7fd242fc-feca-4127-9cf5-f7ffb2271ce7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:32.531710 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7fd242fc-feca-4127-9cf5-f7ffb2271ce7 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1472 microversion: 2.1 time: 0.189135 Aug 27 04:37:32.532195 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 831/1633] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:32 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1472 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:32.536868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92cc622f-b931-4b7d-b151-515671db28b1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:32.537770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92cc622f-b931-4b7d-b151-515671db28b1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:32.544078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92cc622f-b931-4b7d-b151-515671db28b1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:32.544578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92cc622f-b931-4b7d-b151-515671db28b1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:32.545797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92cc622f-b931-4b7d-b151-515671db28b1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:32.546506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92cc622f-b931-4b7d-b151-515671db28b1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:32.546957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92cc622f-b931-4b7d-b151-515671db28b1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:32.547538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92cc622f-b931-4b7d-b151-515671db28b1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:32.681492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92cc622f-b931-4b7d-b151-515671db28b1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:32.691116 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92cc622f-b931-4b7d-b151-515671db28b1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1358 microversion: 2.1 time: 0.157690 Aug 27 04:37:32.691707 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 832/1634] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:32 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:32.696447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59c8a698-f233-4ae2-bf26-4ee0911a24a7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:32.697210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59c8a698-f233-4ae2-bf26-4ee0911a24a7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:32.708495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59c8a698-f233-4ae2-bf26-4ee0911a24a7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:32.709450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59c8a698-f233-4ae2-bf26-4ee0911a24a7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:32.710140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59c8a698-f233-4ae2-bf26-4ee0911a24a7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:32.711055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59c8a698-f233-4ae2-bf26-4ee0911a24a7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:32.711512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59c8a698-f233-4ae2-bf26-4ee0911a24a7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:32.712232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59c8a698-f233-4ae2-bf26-4ee0911a24a7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:32.869021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-59c8a698-f233-4ae2-bf26-4ee0911a24a7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:32.884519 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59c8a698-f233-4ae2-bf26-4ee0911a24a7 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 200 len: 1514 microversion: 2.1 time: 0.187624 Aug 27 04:37:32.885428 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 833/1635] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:32 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:32.890354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-bd7b4e99-1f43-45b3-8732-60deeef229f0 req-1cc6989c-c31b-4021-9a7b-74adfe818bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bbe5194-aa1d-4db9-aec2-044d247df93a", "tag": "63c68b66-1b81-4c26-befb-1e1ff3daa600"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:32.906245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bd7b4e99-1f43-45b3-8732-60deeef229f0 req-1cc6989c-c31b-4021-9a7b-74adfe818bfe service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:32.907464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bd7b4e99-1f43-45b3-8732-60deeef229f0 req-1cc6989c-c31b-4021-9a7b-74adfe818bfe service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:32.908025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bd7b4e99-1f43-45b3-8732-60deeef229f0 req-1cc6989c-c31b-4021-9a7b-74adfe818bfe service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:32.922471 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-bd7b4e99-1f43-45b3-8732-60deeef229f0 req-1cc6989c-c31b-4021-9a7b-74adfe818bfe service nova] Creating event network-changed:63c68b66-1b81-4c26-befb-1e1ff3daa600 for instance 3bbe5194-aa1d-4db9-aec2-044d247df93a on n-h1-854823-1 Aug 27 04:37:32.929682 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-bd7b4e99-1f43-45b3-8732-60deeef229f0 req-1cc6989c-c31b-4021-9a7b-74adfe818bfe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042785 Aug 27 04:37:32.930978 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 834/1636] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:32.937773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28fbca96-a9e8-4766-94f0-e89aaa50e637 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:32.938480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-28fbca96-a9e8-4766-94f0-e89aaa50e637 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:32.945489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fbca96-a9e8-4766-94f0-e89aaa50e637 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:32.946309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fbca96-a9e8-4766-94f0-e89aaa50e637 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:32.946971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fbca96-a9e8-4766-94f0-e89aaa50e637 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:32.947929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fbca96-a9e8-4766-94f0-e89aaa50e637 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:32.948495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fbca96-a9e8-4766-94f0-e89aaa50e637 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:32.949171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fbca96-a9e8-4766-94f0-e89aaa50e637 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.093200 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-49ec371b-b33c-4853-822b-07dc2657189d tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/920987b1-c8e9-4e81-82e9-e1a5626d0109" status: 202 len: 0 microversion: 2.1 time: 1.949410 Aug 27 04:37:33.093927 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 803/1637] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:37:31 2022] DELETE /compute/v2.1/os-floating-ips/920987b1-c8e9-4e81-82e9-e1a5626d0109 => generated 0 bytes in 1951 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:37:33.099296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-63910a23-70b9-4415-a86c-2b629f928a55 req-be6c998b-a93e-4794-8255-cc70670bb473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4587847a-63e5-46b3-a643-6643f65a5052", "name": "network-vif-deleted", "tag": "e75f6944-2f19-47fd-9ee7-c9527f987d75"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:33.119197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-63910a23-70b9-4415-a86c-2b629f928a55 req-be6c998b-a93e-4794-8255-cc70670bb473 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.126332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-63910a23-70b9-4415-a86c-2b629f928a55 req-be6c998b-a93e-4794-8255-cc70670bb473 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.127041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-63910a23-70b9-4415-a86c-2b629f928a55 req-be6c998b-a93e-4794-8255-cc70670bb473 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.148713 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-63910a23-70b9-4415-a86c-2b629f928a55 req-be6c998b-a93e-4794-8255-cc70670bb473 service nova] Creating event network-vif-deleted:e75f6944-2f19-47fd-9ee7-c9527f987d75 for instance 4587847a-63e5-46b3-a643-6643f65a5052 on n-h2-854823-1 Aug 27 04:37:33.157511 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-63910a23-70b9-4415-a86c-2b629f928a55 req-be6c998b-a93e-4794-8255-cc70670bb473 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061949 Aug 27 04:37:33.158072 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 804/1638] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:33.163109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-94d03b13-fd5c-4de9-9e15-f002f0164396 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:33.163837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-94d03b13-fd5c-4de9-9e15-f002f0164396 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:33.176770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94d03b13-fd5c-4de9-9e15-f002f0164396 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.178520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94d03b13-fd5c-4de9-9e15-f002f0164396 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.179213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94d03b13-fd5c-4de9-9e15-f002f0164396 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.180240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94d03b13-fd5c-4de9-9e15-f002f0164396 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.181371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94d03b13-fd5c-4de9-9e15-f002f0164396 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.182190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94d03b13-fd5c-4de9-9e15-f002f0164396 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.191647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-28fbca96-a9e8-4766-94f0-e89aaa50e637 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:33.200406 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-28fbca96-a9e8-4766-94f0-e89aaa50e637 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1307 microversion: 2.1 time: 0.267944 Aug 27 04:37:33.201046 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 835/1639] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:32 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1307 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:33.225425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f195beb3-00ae-48ed-b5cb-8d4bf9afefa3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:33.226249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f195beb3-00ae-48ed-b5cb-8d4bf9afefa3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:33.233224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f195beb3-00ae-48ed-b5cb-8d4bf9afefa3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.234015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f195beb3-00ae-48ed-b5cb-8d4bf9afefa3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.234652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f195beb3-00ae-48ed-b5cb-8d4bf9afefa3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.235567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f195beb3-00ae-48ed-b5cb-8d4bf9afefa3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.236383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f195beb3-00ae-48ed-b5cb-8d4bf9afefa3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.237232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f195beb3-00ae-48ed-b5cb-8d4bf9afefa3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.362710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-94d03b13-fd5c-4de9-9e15-f002f0164396 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 516299cc-c878-4b8e-bb4d-4247ddbd90cf {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:37:33.380141 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-94d03b13-fd5c-4de9-9e15-f002f0164396 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 2347 microversion: 2.25 time: 0.220849 Aug 27 04:37:33.380768 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 805/1640] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:37:33 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 2347 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:37:33.385743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8cada6ae-8595-452f-9240-945a5b339ee3 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Action: 'action', calling method: .version_select at 0x7f1f240c53a0>, body: {"removeFloatingIp": {"address": "172.25.3.221"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:33.413815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f195beb3-00ae-48ed-b5cb-8d4bf9afefa3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:33.423453 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f195beb3-00ae-48ed-b5cb-8d4bf9afefa3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1478 microversion: 2.1 time: 0.202226 Aug 27 04:37:33.424052 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 836/1641] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:33 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1478 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:33.439430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-81ed9747-c31e-49bc-8556-19a51f9174fa req-4a09c600-7e07-4dda-b058-4a0e957f282b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577250c7-f1ee-4541-b83e-131d0e21efea", "name": "network-vif-unplugged", "status": "completed", "tag": "d4d0324a-726b-4962-b7dd-c7fd914520fe"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:33.448958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-81ed9747-c31e-49bc-8556-19a51f9174fa req-4a09c600-7e07-4dda-b058-4a0e957f282b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.449447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-81ed9747-c31e-49bc-8556-19a51f9174fa req-4a09c600-7e07-4dda-b058-4a0e957f282b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.449886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-81ed9747-c31e-49bc-8556-19a51f9174fa req-4a09c600-7e07-4dda-b058-4a0e957f282b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.454819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:33.463238 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-81ed9747-c31e-49bc-8556-19a51f9174fa req-4a09c600-7e07-4dda-b058-4a0e957f282b service nova] Creating event network-vif-unplugged:d4d0324a-726b-4962-b7dd-c7fd914520fe for instance 577250c7-f1ee-4541-b83e-131d0e21efea on n-h2-854823-1 Aug 27 04:37:33.468406 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-81ed9747-c31e-49bc-8556-19a51f9174fa req-4a09c600-7e07-4dda-b058-4a0e957f282b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042977 Aug 27 04:37:33.469145 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 837/1642] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:33.475413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-08d06916-36cd-4849-b842-9daf5c48ad9f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:33.476127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-08d06916-36cd-4849-b842-9daf5c48ad9f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:33.483815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08d06916-36cd-4849-b842-9daf5c48ad9f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.484617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08d06916-36cd-4849-b842-9daf5c48ad9f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.485423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08d06916-36cd-4849-b842-9daf5c48ad9f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.487372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08d06916-36cd-4849-b842-9daf5c48ad9f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.487626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08d06916-36cd-4849-b842-9daf5c48ad9f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.488038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08d06916-36cd-4849-b842-9daf5c48ad9f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.578563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8cada6ae-8595-452f-9240-945a5b339ee3 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:33.585166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cada6ae-8595-452f-9240-945a5b339ee3 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.585662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cada6ae-8595-452f-9240-945a5b339ee3 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.586102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cada6ae-8595-452f-9240-945a5b339ee3 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.586816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cada6ae-8595-452f-9240-945a5b339ee3 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.587360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cada6ae-8595-452f-9240-945a5b339ee3 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.587790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cada6ae-8595-452f-9240-945a5b339ee3 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.639261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-08d06916-36cd-4849-b842-9daf5c48ad9f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:33.647113 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-08d06916-36cd-4849-b842-9daf5c48ad9f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1325 microversion: 2.1 time: 0.176827 Aug 27 04:37:33.647781 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 838/1643] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:33 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1325 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:33.665263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8202977-d0ea-4b9e-8b0a-6bc1bd7f4d7f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:33.669126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8202977-d0ea-4b9e-8b0a-6bc1bd7f4d7f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.669699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8202977-d0ea-4b9e-8b0a-6bc1bd7f4d7f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.670745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8202977-d0ea-4b9e-8b0a-6bc1bd7f4d7f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.671553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8202977-d0ea-4b9e-8b0a-6bc1bd7f4d7f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.672093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8202977-d0ea-4b9e-8b0a-6bc1bd7f4d7f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.673648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8202977-d0ea-4b9e-8b0a-6bc1bd7f4d7f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.698082 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8202977-d0ea-4b9e-8b0a-6bc1bd7f4d7f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.039017 Aug 27 04:37:33.705692 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 839/1644] 10.222.0.79 () {60 vars in 1217 bytes} [Sat Aug 27 04:37:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:37:33.721924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e37b91c-245a-4ac5-99c0-1480ab928d28 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:33.722703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e37b91c-245a-4ac5-99c0-1480ab928d28 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:33.731123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e37b91c-245a-4ac5-99c0-1480ab928d28 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.731387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e37b91c-245a-4ac5-99c0-1480ab928d28 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.731822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e37b91c-245a-4ac5-99c0-1480ab928d28 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.733242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e37b91c-245a-4ac5-99c0-1480ab928d28 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.733696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e37b91c-245a-4ac5-99c0-1480ab928d28 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.734113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e37b91c-245a-4ac5-99c0-1480ab928d28 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.892025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cada6ae-8595-452f-9240-945a5b339ee3 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "refresh_cache-399bd6c1-40d1-463d-be8a-d63d5e31e32c" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:37:33.892713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cada6ae-8595-452f-9240-945a5b339ee3 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquired lock "refresh_cache-399bd6c1-40d1-463d-be8a-d63d5e31e32c" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:37:33.900602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0e37b91c-245a-4ac5-99c0-1480ab928d28 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:33.911339 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e37b91c-245a-4ac5-99c0-1480ab928d28 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1472 microversion: 2.1 time: 0.204407 Aug 27 04:37:33.924596 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 840/1645] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:33 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1472 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:33.924596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-011cb21a-40eb-46d8-92c1-cca4c6cc9040 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:33.924596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-011cb21a-40eb-46d8-92c1-cca4c6cc9040 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:33.924596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011cb21a-40eb-46d8-92c1-cca4c6cc9040 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.925073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011cb21a-40eb-46d8-92c1-cca4c6cc9040 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.925598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011cb21a-40eb-46d8-92c1-cca4c6cc9040 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.926327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011cb21a-40eb-46d8-92c1-cca4c6cc9040 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.926981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011cb21a-40eb-46d8-92c1-cca4c6cc9040 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.927490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011cb21a-40eb-46d8-92c1-cca4c6cc9040 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:34.133175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-011cb21a-40eb-46d8-92c1-cca4c6cc9040 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:34.142448 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-011cb21a-40eb-46d8-92c1-cca4c6cc9040 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1358 microversion: 2.1 time: 0.228520 Aug 27 04:37:34.156726 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 841/1646] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:33 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:34.161906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-574a1341-faa6-4050-a439-5aad1a427447 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:34.162831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-574a1341-faa6-4050-a439-5aad1a427447 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 4587847a-63e5-46b3-a643-6643f65a5052] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:34.169700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-574a1341-faa6-4050-a439-5aad1a427447 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:34.170794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-574a1341-faa6-4050-a439-5aad1a427447 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:34.171309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-574a1341-faa6-4050-a439-5aad1a427447 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:34.172089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-574a1341-faa6-4050-a439-5aad1a427447 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:34.172805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-574a1341-faa6-4050-a439-5aad1a427447 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:34.173294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-574a1341-faa6-4050-a439-5aad1a427447 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:34.188066 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-574a1341-faa6-4050-a439-5aad1a427447 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] HTTP exception thrown: Instance 4587847a-63e5-46b3-a643-6643f65a5052 could not be found. Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-574a1341-faa6-4050-a439-5aad1a427447 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Request method failure captured: Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 HTTP/1.1 Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ6-D3BYy7IciQDbRayK-28gyGCCgYDPgeyUtepXMExfHdkcGI15HPSbvoBQes_uXTivGJ5TseoWSSFisoiMEzXYzcKTFTrFIRYcIKT70bj369uapC3CZEg1pjf3_WocjCKHZICo8J5nZfj5lNmtw4vf-1Oav92T9XOg3w_TytfIMCg Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8747bb92a41f4edd9b6a0cd832ce6112 Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesAdminNegativeTest-1328002529 Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:37:34.189933 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:37:34.191512 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8747bb92a41f4edd9b6a0cd832ce6112"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8747bb92a41f4edd9b6a0cd832ce6112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8747bb92a41f4edd9b6a0cd832ce6112"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8747bb92a41f4edd9b6a0cd832ce6112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:34.191512 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesAdminNegativeTest-1328002529 Aug 27 04:37:34.191512 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8747bb92a41f4edd9b6a0cd832ce6112 Aug 27 04:37:34.191512 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1328002529 Aug 27 04:37:34.191512 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-VolumesAdminNegativeTest-1328002529-project Aug 27 04:37:34.191512 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:37:34.191512 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:37:34.191512 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: b6726e43aff14d27916835154cbfdf1d Aug 27 04:37:34.191512 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesAdminNegativeTest-1328002529-project Aug 27 04:37:34.191512 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:37:34.191512 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 4587847a-63e5-46b3-a643-6643f65a5052 could not be found. Aug 27 04:37:34.191512 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '4587847a-63e5-46b3-a643-6643f65a5052'} Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4587847a-63e5-46b3-a643-6643f65a5052 could not be found. Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:34.192485 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4587847a-63e5-46b3-a643-6643f65a5052 could not be found. Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4587847a-63e5-46b3-a643-6643f65a5052 could not be found. Aug 27 04:37:34.193905 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:34.196399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-574a1341-faa6-4050-a439-5aad1a427447 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Returning 404 to user: Instance 4587847a-63e5-46b3-a643-6643f65a5052 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:34.197635 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-574a1341-faa6-4050-a439-5aad1a427447 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052" status: 404 len: 111 microversion: 2.1 time: 0.039647 Aug 27 04:37:34.200566 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 842/1647] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:34 2022] GET /compute/v2.1/servers/4587847a-63e5-46b3-a643-6643f65a5052 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:37:34.221135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-017feb60-f80f-4073-89b3-9be18cc32bb8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:34.221748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-017feb60-f80f-4073-89b3-9be18cc32bb8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:34.228521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017feb60-f80f-4073-89b3-9be18cc32bb8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:34.229050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017feb60-f80f-4073-89b3-9be18cc32bb8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:34.229668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017feb60-f80f-4073-89b3-9be18cc32bb8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:34.230595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017feb60-f80f-4073-89b3-9be18cc32bb8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:34.231494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017feb60-f80f-4073-89b3-9be18cc32bb8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:34.232078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017feb60-f80f-4073-89b3-9be18cc32bb8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:34.406800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-017feb60-f80f-4073-89b3-9be18cc32bb8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:34.416651 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-017feb60-f80f-4073-89b3-9be18cc32bb8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1307 microversion: 2.1 time: 0.198603 Aug 27 04:37:34.417497 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 843/1648] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:34 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1307 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:34.457369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc2f6c12-0633-4a46-910c-128f88f3c983 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:34.458416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc2f6c12-0633-4a46-910c-128f88f3c983 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:34.475244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc2f6c12-0633-4a46-910c-128f88f3c983 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:34.476043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc2f6c12-0633-4a46-910c-128f88f3c983 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:34.477484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc2f6c12-0633-4a46-910c-128f88f3c983 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:34.480086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc2f6c12-0633-4a46-910c-128f88f3c983 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:34.480927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc2f6c12-0633-4a46-910c-128f88f3c983 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:34.483550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc2f6c12-0633-4a46-910c-128f88f3c983 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:35.038341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cc2f6c12-0633-4a46-910c-128f88f3c983 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:35.053249 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc2f6c12-0633-4a46-910c-128f88f3c983 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1478 microversion: 2.1 time: 0.610824 Aug 27 04:37:35.054415 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 844/1649] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:34 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1478 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:35.060023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47320997-1aaa-4886-a741-a168e32cc3b6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:35.061565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47320997-1aaa-4886-a741-a168e32cc3b6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:35.067720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:35.072180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47320997-1aaa-4886-a741-a168e32cc3b6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:35.073690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47320997-1aaa-4886-a741-a168e32cc3b6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:35.074318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47320997-1aaa-4886-a741-a168e32cc3b6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:35.075256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47320997-1aaa-4886-a741-a168e32cc3b6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:35.075880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47320997-1aaa-4886-a741-a168e32cc3b6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:35.078716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47320997-1aaa-4886-a741-a168e32cc3b6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:35.548128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47320997-1aaa-4886-a741-a168e32cc3b6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:35.557095 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47320997-1aaa-4886-a741-a168e32cc3b6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1325 microversion: 2.1 time: 0.501327 Aug 27 04:37:35.562609 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 845/1650] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:35 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1325 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:35.579651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c6dcf71-fc1d-4b8c-89e4-5389e3652eed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:35.581611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c6dcf71-fc1d-4b8c-89e4-5389e3652eed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:35.594507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6dcf71-fc1d-4b8c-89e4-5389e3652eed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:35.595407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6dcf71-fc1d-4b8c-89e4-5389e3652eed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:35.596071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6dcf71-fc1d-4b8c-89e4-5389e3652eed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:35.597088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6dcf71-fc1d-4b8c-89e4-5389e3652eed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:35.597793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6dcf71-fc1d-4b8c-89e4-5389e3652eed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:35.598443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6dcf71-fc1d-4b8c-89e4-5389e3652eed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:35.664657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-8cada6ae-8595-452f-9240-945a5b339ee3 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Building network info cache for instance {{(pid=128870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:37:35.894716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:35.926200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=14 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:36.447418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c6dcf71-fc1d-4b8c-89e4-5389e3652eed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:36.459034 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c6dcf71-fc1d-4b8c-89e4-5389e3652eed tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1472 microversion: 2.1 time: 0.894442 Aug 27 04:37:36.485344 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 846/1651] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:35 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1472 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:36.507975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-438ed3db-919a-4e56-83e0-9fa8deb16c91 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:36.512667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-438ed3db-919a-4e56-83e0-9fa8deb16c91 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:36.526563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-438ed3db-919a-4e56-83e0-9fa8deb16c91 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:36.527062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-438ed3db-919a-4e56-83e0-9fa8deb16c91 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:36.527510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-438ed3db-919a-4e56-83e0-9fa8deb16c91 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:36.528217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-438ed3db-919a-4e56-83e0-9fa8deb16c91 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:36.528708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-438ed3db-919a-4e56-83e0-9fa8deb16c91 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:36.529133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-438ed3db-919a-4e56-83e0-9fa8deb16c91 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:36.568736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-8cada6ae-8595-452f-9240-945a5b339ee3 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Updating instance_info_cache with network_info: [{"id": "d5ab4a86-3f84-45fc-bed7-5c705b957f6c", "address": "fa:16:3e:e8:68:ea", "network": {"id": "3045fa03-f348-4c29-a5c4-f817e8f7627d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-855046663-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "98283183679c42029b0ca02db8762ed4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd5ab4a86-3f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:37:36.595482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cada6ae-8595-452f-9240-945a5b339ee3 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Releasing lock "refresh_cache-399bd6c1-40d1-463d-be8a-d63d5e31e32c" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:37:36.596392 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8cada6ae-8595-452f-9240-945a5b339ee3 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action" status: 202 len: 0 microversion: 2.1 time: 3.214392 Aug 27 04:37:36.597822 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 806/1652] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:37:33 2022] POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action => generated 0 bytes in 3216 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 04:37:36.603928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a17e0603-dec8-474f-8bb3-145193b7d058 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:36.604856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a17e0603-dec8-474f-8bb3-145193b7d058 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:36.620120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a17e0603-dec8-474f-8bb3-145193b7d058 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:36.623942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a17e0603-dec8-474f-8bb3-145193b7d058 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:36.624907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a17e0603-dec8-474f-8bb3-145193b7d058 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:36.625864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a17e0603-dec8-474f-8bb3-145193b7d058 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:36.626778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a17e0603-dec8-474f-8bb3-145193b7d058 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:36.627574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a17e0603-dec8-474f-8bb3-145193b7d058 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:36.837993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a17e0603-dec8-474f-8bb3-145193b7d058 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:36.851171 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a17e0603-dec8-474f-8bb3-145193b7d058 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1307 microversion: 2.1 time: 0.252013 Aug 27 04:37:36.865616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-438ed3db-919a-4e56-83e0-9fa8deb16c91 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:36.867458 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 807/1653] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:36 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1307 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:36.869699 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-438ed3db-919a-4e56-83e0-9fa8deb16c91 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1358 microversion: 2.1 time: 0.376936 Aug 27 04:37:36.870594 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 847/1654] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:36 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1358 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:36.874746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d01d057e-00ee-4db3-8a25-09f9015698bf req-aa4fbd85-df56-40d6-9e46-88a1c6f7db7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577250c7-f1ee-4541-b83e-131d0e21efea", "name": "network-vif-plugged", "status": "completed", "tag": "d4d0324a-726b-4962-b7dd-c7fd914520fe"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:36.885869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d01d057e-00ee-4db3-8a25-09f9015698bf req-aa4fbd85-df56-40d6-9e46-88a1c6f7db7b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:36.886301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d01d057e-00ee-4db3-8a25-09f9015698bf req-aa4fbd85-df56-40d6-9e46-88a1c6f7db7b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:36.887375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d01d057e-00ee-4db3-8a25-09f9015698bf req-aa4fbd85-df56-40d6-9e46-88a1c6f7db7b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:36.898927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-622c6370-b59c-4fd0-957f-f888a69742e4 req-68bc4e35-fdd1-4459-93f1-e10e4490bf99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "399bd6c1-40d1-463d-be8a-d63d5e31e32c", "tag": "d5ab4a86-3f84-45fc-bed7-5c705b957f6c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:36.901068 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d01d057e-00ee-4db3-8a25-09f9015698bf req-aa4fbd85-df56-40d6-9e46-88a1c6f7db7b service nova] Creating event network-vif-plugged:d4d0324a-726b-4962-b7dd-c7fd914520fe for instance 577250c7-f1ee-4541-b83e-131d0e21efea on n-h2-854823-1 Aug 27 04:37:36.906529 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d01d057e-00ee-4db3-8a25-09f9015698bf req-aa4fbd85-df56-40d6-9e46-88a1c6f7db7b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037251 Aug 27 04:37:36.908385 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 808/1655] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:36.913837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59a50da6-9880-4e01-8621-14435197e8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:36.914878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-59a50da6-9880-4e01-8621-14435197e8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:36.922663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59a50da6-9880-4e01-8621-14435197e8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:36.923424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59a50da6-9880-4e01-8621-14435197e8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:36.924028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-622c6370-b59c-4fd0-957f-f888a69742e4 req-68bc4e35-fdd1-4459-93f1-e10e4490bf99 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:36.924166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59a50da6-9880-4e01-8621-14435197e8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:36.925164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59a50da6-9880-4e01-8621-14435197e8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:36.925801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59a50da6-9880-4e01-8621-14435197e8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:36.926411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59a50da6-9880-4e01-8621-14435197e8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:36.928252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-622c6370-b59c-4fd0-957f-f888a69742e4 req-68bc4e35-fdd1-4459-93f1-e10e4490bf99 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:36.931201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-622c6370-b59c-4fd0-957f-f888a69742e4 req-68bc4e35-fdd1-4459-93f1-e10e4490bf99 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:36.964093 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-622c6370-b59c-4fd0-957f-f888a69742e4 req-68bc4e35-fdd1-4459-93f1-e10e4490bf99 service nova] Creating event network-changed:d5ab4a86-3f84-45fc-bed7-5c705b957f6c for instance 399bd6c1-40d1-463d-be8a-d63d5e31e32c on n-h2-854823-1 Aug 27 04:37:36.977257 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-622c6370-b59c-4fd0-957f-f888a69742e4 req-68bc4e35-fdd1-4459-93f1-e10e4490bf99 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087651 Aug 27 04:37:36.981005 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 848/1656] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:37.001342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1abf7184-b4b1-4a38-9336-cbee5924c702 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f1ffa76-8e4d-4bab-bdc9-0a7560d30ef4", "device": "/dev/xvdb"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:37.004497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1abf7184-b4b1-4a38-9336-cbee5924c702 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:37.014140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1abf7184-b4b1-4a38-9336-cbee5924c702 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:37.019662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1abf7184-b4b1-4a38-9336-cbee5924c702 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:37.020295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1abf7184-b4b1-4a38-9336-cbee5924c702 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:37.021266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1abf7184-b4b1-4a38-9336-cbee5924c702 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:37.021860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1abf7184-b4b1-4a38-9336-cbee5924c702 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:37.022626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1abf7184-b4b1-4a38-9336-cbee5924c702 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:37.602988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-59a50da6-9880-4e01-8621-14435197e8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:37.611648 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-59a50da6-9880-4e01-8621-14435197e8e0 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1478 microversion: 2.1 time: 0.701816 Aug 27 04:37:37.612255 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 809/1657] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:36 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1478 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:37.616866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0ea6074e-b7bb-444c-88a6-c8dd483f71a4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:37.617568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0ea6074e-b7bb-444c-88a6-c8dd483f71a4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:37.624733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ea6074e-b7bb-444c-88a6-c8dd483f71a4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:37.625156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ea6074e-b7bb-444c-88a6-c8dd483f71a4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:37.625601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ea6074e-b7bb-444c-88a6-c8dd483f71a4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:37.626317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ea6074e-b7bb-444c-88a6-c8dd483f71a4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:37.626772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ea6074e-b7bb-444c-88a6-c8dd483f71a4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:37.627194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ea6074e-b7bb-444c-88a6-c8dd483f71a4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:37.791329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0ea6074e-b7bb-444c-88a6-c8dd483f71a4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:37.799873 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0ea6074e-b7bb-444c-88a6-c8dd483f71a4 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1325 microversion: 2.1 time: 0.186615 Aug 27 04:37:37.800441 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 810/1658] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:37 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1325 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:37.804969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3c717fde-e355-4d42-9b67-962f967c0a32 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '.version_select at 0x7f1f221a7160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:38.744561 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3c717fde-e355-4d42-9b67-962f967c0a32 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/05157dbd-6a91-41e6-b5b6-e1abbee29af6" status: 202 len: 0 microversion: 2.1 time: 0.942992 Aug 27 04:37:38.750903 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 811/1659] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:37:37 2022] DELETE /compute/v2.1/os-floating-ips/05157dbd-6a91-41e6-b5b6-e1abbee29af6 => generated 0 bytes in 950 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:37:38.756193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-502a05d1-d536-400d-bfcf-0b6821422107 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:38.756876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-502a05d1-d536-400d-bfcf-0b6821422107 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:38.764273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-502a05d1-d536-400d-bfcf-0b6821422107 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:38.764984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-502a05d1-d536-400d-bfcf-0b6821422107 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:38.765420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-502a05d1-d536-400d-bfcf-0b6821422107 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:38.766148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-502a05d1-d536-400d-bfcf-0b6821422107 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:38.766604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-502a05d1-d536-400d-bfcf-0b6821422107 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:38.767024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-502a05d1-d536-400d-bfcf-0b6821422107 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:38.997245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-502a05d1-d536-400d-bfcf-0b6821422107 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:39.014231 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-502a05d1-d536-400d-bfcf-0b6821422107 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1477 microversion: 2.1 time: 0.261518 Aug 27 04:37:39.015267 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 812/1660] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:38 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1477 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:39.022423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98af2b81-3079-43e3-b8b4-50cc9f23d380 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:39.023321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98af2b81-3079-43e3-b8b4-50cc9f23d380 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:39.041364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98af2b81-3079-43e3-b8b4-50cc9f23d380 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.042193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98af2b81-3079-43e3-b8b4-50cc9f23d380 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.042703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98af2b81-3079-43e3-b8b4-50cc9f23d380 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.043486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98af2b81-3079-43e3-b8b4-50cc9f23d380 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.045580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98af2b81-3079-43e3-b8b4-50cc9f23d380 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.046033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98af2b81-3079-43e3-b8b4-50cc9f23d380 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.187137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-98af2b81-3079-43e3-b8b4-50cc9f23d380 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:39.195983 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-98af2b81-3079-43e3-b8b4-50cc9f23d380 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1307 microversion: 2.1 time: 0.179333 Aug 27 04:37:39.196738 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 813/1661] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:39 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1307 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:39.212684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-592dc904-7b02-4fa5-a933-0e67bb3c873a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:39.213803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-592dc904-7b02-4fa5-a933-0e67bb3c873a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:39.221116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-592dc904-7b02-4fa5-a933-0e67bb3c873a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.221798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-592dc904-7b02-4fa5-a933-0e67bb3c873a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.222401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-592dc904-7b02-4fa5-a933-0e67bb3c873a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.223231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-592dc904-7b02-4fa5-a933-0e67bb3c873a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.223868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-592dc904-7b02-4fa5-a933-0e67bb3c873a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.224433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-592dc904-7b02-4fa5-a933-0e67bb3c873a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.227573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:39.385945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-592dc904-7b02-4fa5-a933-0e67bb3c873a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:39.393839 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-592dc904-7b02-4fa5-a933-0e67bb3c873a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1358 microversion: 2.1 time: 0.195748 Aug 27 04:37:39.394432 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 814/1662] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:39 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:39.399052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ec434597-756a-406a-8ed8-cc94ed4f6f79 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:39.399670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ec434597-756a-406a-8ed8-cc94ed4f6f79 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:39.412222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec434597-756a-406a-8ed8-cc94ed4f6f79 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.412835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec434597-756a-406a-8ed8-cc94ed4f6f79 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.413365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec434597-756a-406a-8ed8-cc94ed4f6f79 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.414149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec434597-756a-406a-8ed8-cc94ed4f6f79 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.414681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec434597-756a-406a-8ed8-cc94ed4f6f79 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.415321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec434597-756a-406a-8ed8-cc94ed4f6f79 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.552339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ec434597-756a-406a-8ed8-cc94ed4f6f79 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:39.560054 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ec434597-756a-406a-8ed8-cc94ed4f6f79 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1463 microversion: 2.1 time: 0.164679 Aug 27 04:37:39.561378 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 815/1663] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:39 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1463 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:39.565732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d6dd7bf6-8948-431e-9849-d02f333a1a16 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:39.566225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d6dd7bf6-8948-431e-9849-d02f333a1a16 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:39.571762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6dd7bf6-8948-431e-9849-d02f333a1a16 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.572245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6dd7bf6-8948-431e-9849-d02f333a1a16 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.572715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6dd7bf6-8948-431e-9849-d02f333a1a16 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.573402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6dd7bf6-8948-431e-9849-d02f333a1a16 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.573862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6dd7bf6-8948-431e-9849-d02f333a1a16 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.574285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6dd7bf6-8948-431e-9849-d02f333a1a16 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.601365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d6dd7bf6-8948-431e-9849-d02f333a1a16 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:37:39.678861 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d6dd7bf6-8948-431e-9849-d02f333a1a16 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 204 len: 0 microversion: 2.1 time: 0.116320 Aug 27 04:37:39.679489 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 816/1664] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:37:39 2022] DELETE /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:39.684965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf8e97d0-8a52-4507-b773-a7e73b424a27 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Action: 'action', calling method: .version_select at 0x7f1f240c5280>, body: {"addFloatingIp": {"address": ""}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf8e97d0-8a52-4507-b773-a7e73b424a27 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Request method failure captured: Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action HTTP/1.1 Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 34 Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ9srsYRSAkk8Iy57Gi-zwEzQi_AHCxhmcaCdwIHaorTcGK7_K12EqJrV63JT4zLOauz97ihkiOY_N4siPSbr8xrGNf2GMqFiPLJHkPQUNz2K8RgwBFzQT26v4jpu4Jvf-h8XF9J6-QLpLUlb8olb-7hIAIn6MrSp8yc0dBTzAxcJe4 Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 98283183679c42029b0ca02db8762ed4 Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:37:39.689396 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:37:39.691039 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/98283183679c42029b0ca02db8762ed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_98283183679c42029b0ca02db8762ed4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/98283183679c42029b0ca02db8762ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/98283183679c42029b0ca02db8762ed4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:39.691039 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:39.691039 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 98283183679c42029b0ca02db8762ed4 Aug 27 04:37:39.691039 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:39.691039 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project Aug 27 04:37:39.691039 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:37:39.691039 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:37:39.691039 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8852be5166774a5e870512f289cf0aa6 Aug 27 04:37:39.691039 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project Aug 27 04:37:39.691039 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:37:39.691039 n-d-854823-1 devstack@n-api.service[128870]: {"addFloatingIp": {"address": ""}} Aug 27 04:37:39.691039 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:37:39.691039 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '399bd6c1-40d1-463d-be8a-d63d5e31e32c', 'body': {'addFloatingIp': {'address': ''}}} Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi '' Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:39.692064 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:37:39.693754 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:37:39.695202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 04:37:39.695202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:39.695202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf8e97d0-8a52-4507-b773-a7e73b424a27 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:39.695202 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bf8e97d0-8a52-4507-b773-a7e73b424a27 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action" status: 400 len: 142 microversion: 2.1 time: 0.010001 Aug 27 04:37:39.695202 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 817/1665] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:37:39 2022] POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action => generated 142 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:37:39.695849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-15b2c193-c2dc-4cae-9447-012f9493557b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:39.696643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-15b2c193-c2dc-4cae-9447-012f9493557b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:39.703628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15b2c193-c2dc-4cae-9447-012f9493557b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.704109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15b2c193-c2dc-4cae-9447-012f9493557b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.704568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15b2c193-c2dc-4cae-9447-012f9493557b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.705254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15b2c193-c2dc-4cae-9447-012f9493557b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.705706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15b2c193-c2dc-4cae-9447-012f9493557b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.706166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15b2c193-c2dc-4cae-9447-012f9493557b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.837291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-15b2c193-c2dc-4cae-9447-012f9493557b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:39.845187 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-15b2c193-c2dc-4cae-9447-012f9493557b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1325 microversion: 2.1 time: 0.153019 Aug 27 04:37:39.845777 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 818/1666] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:39 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1325 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:39.850167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-b65c8ed9-d9bb-45e1-8a1f-8e533ef5b1f7 req-7144bece-0953-414e-95c2-9aabb744458e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c1ebbce-7c0d-4f08-a05f-359d0527b76d", "name": "network-vif-plugged", "status": "completed", "tag": "8348ead6-1b46-443f-99ec-f72deeb2c4f5"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:39.860120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b65c8ed9-d9bb-45e1-8a1f-8e533ef5b1f7 req-7144bece-0953-414e-95c2-9aabb744458e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.860613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b65c8ed9-d9bb-45e1-8a1f-8e533ef5b1f7 req-7144bece-0953-414e-95c2-9aabb744458e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.861046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b65c8ed9-d9bb-45e1-8a1f-8e533ef5b1f7 req-7144bece-0953-414e-95c2-9aabb744458e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.871844 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b65c8ed9-d9bb-45e1-8a1f-8e533ef5b1f7 req-7144bece-0953-414e-95c2-9aabb744458e service nova] Creating event network-vif-plugged:8348ead6-1b46-443f-99ec-f72deeb2c4f5 for instance 0c1ebbce-7c0d-4f08-a05f-359d0527b76d on n-h1-854823-1 Aug 27 04:37:39.877400 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-b65c8ed9-d9bb-45e1-8a1f-8e533ef5b1f7 req-7144bece-0953-414e-95c2-9aabb744458e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030532 Aug 27 04:37:39.877980 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 819/1667] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:39.882842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1b6ba6a3-1a86-4486-ae05-9a389a3b17af tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:39.885198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1b6ba6a3-1a86-4486-ae05-9a389a3b17af tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:39.891233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b6ba6a3-1a86-4486-ae05-9a389a3b17af tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.891715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b6ba6a3-1a86-4486-ae05-9a389a3b17af tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.892150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b6ba6a3-1a86-4486-ae05-9a389a3b17af tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.892866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b6ba6a3-1a86-4486-ae05-9a389a3b17af tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.893323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b6ba6a3-1a86-4486-ae05-9a389a3b17af tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.893746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b6ba6a3-1a86-4486-ae05-9a389a3b17af tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.968312 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1b6ba6a3-1a86-4486-ae05-9a389a3b17af tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea/action" status: 202 len: 0 microversion: 2.1 time: 0.089045 Aug 27 04:37:39.968893 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 820/1668] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:37:39 2022] POST /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:37:39.973376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b282847d-704e-4429-adb0-5afc329a2aef tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:39.973981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b282847d-704e-4429-adb0-5afc329a2aef tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:39.980150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b282847d-704e-4429-adb0-5afc329a2aef tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.980794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b282847d-704e-4429-adb0-5afc329a2aef tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.981276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b282847d-704e-4429-adb0-5afc329a2aef tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.982046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b282847d-704e-4429-adb0-5afc329a2aef tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.983246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b282847d-704e-4429-adb0-5afc329a2aef tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.983666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b282847d-704e-4429-adb0-5afc329a2aef tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:40.117629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b282847d-704e-4429-adb0-5afc329a2aef tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:40.126257 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b282847d-704e-4429-adb0-5afc329a2aef tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1680 microversion: 2.1 time: 0.156405 Aug 27 04:37:40.126827 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 821/1669] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:39 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:40.132757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:40.133603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:40.140631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:40.141122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:40.141558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:40.142252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:40.142700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:40.143120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:40.170127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "refresh_cache-399bd6c1-40d1-463d-be8a-d63d5e31e32c" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:37:40.170522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquired lock "refresh_cache-399bd6c1-40d1-463d-be8a-d63d5e31e32c" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:37:40.302623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Releasing lock "refresh_cache-399bd6c1-40d1-463d-be8a-d63d5e31e32c" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:37:40.303229 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] HTTP exception thrown: floating IP not found Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Request method failure captured: Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action HTTP/1.1 Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 41 Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ9srsYRSAkk8Iy57Gi-zwEzQi_AHCxhmcaCdwIHaorTcGK7_K12EqJrV63JT4zLOauz97ihkiOY_N4siPSbr8xrGNf2GMqFiPLJHkPQUNz2K8RgwBFzQT26v4jpu4Jvf-h8XF9J6-QLpLUlb8olb-7hIAIn6MrSp8yc0dBTzAxcJe4 Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 98283183679c42029b0ca02db8762ed4 Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:37:40.306664 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:37:40.308347 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/98283183679c42029b0ca02db8762ed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_98283183679c42029b0ca02db8762ed4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/98283183679c42029b0ca02db8762ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/98283183679c42029b0ca02db8762ed4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:40.308347 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:40.308347 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 98283183679c42029b0ca02db8762ed4 Aug 27 04:37:40.308347 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:40.308347 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project Aug 27 04:37:40.308347 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:37:40.308347 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:37:40.308347 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8852be5166774a5e870512f289cf0aa6 Aug 27 04:37:40.308347 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project Aug 27 04:37:40.308347 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:37:40.308347 n-d-854823-1 devstack@n-api.service[128870]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 27 04:37:40.308347 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:37:40.308347 n-d-854823-1 devstack@n-api.service[128870]: exception: floating IP not found Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '399bd6c1-40d1-463d-be8a-d63d5e31e32c', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:40.313971 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 27 04:37:40.315506 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:40.317079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Returning 404 to user: floating IP not found {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:40.317079 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-de5c3522-c4d8-458e-995a-fc16638f7e21 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action" status: 404 len: 67 microversion: 2.1 time: 0.180347 Aug 27 04:37:40.317079 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 822/1670] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:37:40 2022] POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action => generated 67 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:37:40.317079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7579d6e3-3f12-4c28-a3dc-3bf2493cadb1 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:40.317079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7579d6e3-3f12-4c28-a3dc-3bf2493cadb1 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:40.323639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7579d6e3-3f12-4c28-a3dc-3bf2493cadb1 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:40.324197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7579d6e3-3f12-4c28-a3dc-3bf2493cadb1 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:40.324732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7579d6e3-3f12-4c28-a3dc-3bf2493cadb1 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:40.325526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7579d6e3-3f12-4c28-a3dc-3bf2493cadb1 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:40.326625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7579d6e3-3f12-4c28-a3dc-3bf2493cadb1 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:40.327459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7579d6e3-3f12-4c28-a3dc-3bf2493cadb1 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:40.356591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:40.361108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7579d6e3-3f12-4c28-a3dc-3bf2493cadb1 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:40.361592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7579d6e3-3f12-4c28-a3dc-3bf2493cadb1 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:40.362019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7579d6e3-3f12-4c28-a3dc-3bf2493cadb1 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:40.362462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-7579d6e3-3f12-4c28-a3dc-3bf2493cadb1 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lazy-loading 'fault' on Instance uuid 577250c7-f1ee-4541-b83e-131d0e21efea {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:37:40.470716 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7579d6e3-3f12-4c28-a3dc-3bf2493cadb1 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1597 microversion: 2.1 time: 0.159919 Aug 27 04:37:40.471387 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 823/1671] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:40 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:40.476065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8e1f244c-908f-461f-904c-2e815c496c87 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:40.479724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8e1f244c-908f-461f-904c-2e815c496c87 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:40.487256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e1f244c-908f-461f-904c-2e815c496c87 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:40.487819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e1f244c-908f-461f-904c-2e815c496c87 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:40.488337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e1f244c-908f-461f-904c-2e815c496c87 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:40.489143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e1f244c-908f-461f-904c-2e815c496c87 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:40.489606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e1f244c-908f-461f-904c-2e815c496c87 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:40.490043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e1f244c-908f-461f-904c-2e815c496c87 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:40.627675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8e1f244c-908f-461f-904c-2e815c496c87 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:40.635829 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8e1f244c-908f-461f-904c-2e815c496c87 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1477 microversion: 2.1 time: 0.163364 Aug 27 04:37:40.636399 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 824/1672] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:40 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1477 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:40.641243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c4f1c126-13a5-49c4-a594-1522bee105c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:40.642743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c4f1c126-13a5-49c4-a594-1522bee105c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:40.653681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4f1c126-13a5-49c4-a594-1522bee105c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:40.654236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4f1c126-13a5-49c4-a594-1522bee105c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:40.654673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4f1c126-13a5-49c4-a594-1522bee105c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:40.655410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4f1c126-13a5-49c4-a594-1522bee105c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:40.655907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4f1c126-13a5-49c4-a594-1522bee105c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:40.656337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4f1c126-13a5-49c4-a594-1522bee105c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:40.786089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c4f1c126-13a5-49c4-a594-1522bee105c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:40.793757 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c4f1c126-13a5-49c4-a594-1522bee105c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1307 microversion: 2.1 time: 0.156338 Aug 27 04:37:40.794320 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 825/1673] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:40 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:40.799464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-28d44172-b894-4175-8295-c2d688901261 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:40.844544 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-28d44172-b894-4175-8295-c2d688901261 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-28d44172-b894-4175-8295-c2d688901261 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Request method failure captured: Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action HTTP/1.1 Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 44 Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ9srsYRSAkk8Iy57Gi-zwEzQi_AHCxhmcaCdwIHaorTcGK7_K12EqJrV63JT4zLOauz97ihkiOY_N4siPSbr8xrGNf2GMqFiPLJHkPQUNz2K8RgwBFzQT26v4jpu4Jvf-h8XF9J6-QLpLUlb8olb-7hIAIn6MrSp8yc0dBTzAxcJe4 Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 98283183679c42029b0ca02db8762ed4 Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:37:40.846140 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:37:40.847838 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/98283183679c42029b0ca02db8762ed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_98283183679c42029b0ca02db8762ed4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/98283183679c42029b0ca02db8762ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/98283183679c42029b0ca02db8762ed4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:40.847838 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:40.847838 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 98283183679c42029b0ca02db8762ed4 Aug 27 04:37:40.847838 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:40.847838 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project Aug 27 04:37:40.847838 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:37:40.847838 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:37:40.847838 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8852be5166774a5e870512f289cf0aa6 Aug 27 04:37:40.847838 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project Aug 27 04:37:40.847838 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:37:40.847838 n-d-854823-1 devstack@n-api.service[128870]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 27 04:37:40.847838 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:37:40.847838 n-d-854823-1 devstack@n-api.service[128870]: exception: Floating IP not found for address 0.0.0.0. Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '399bd6c1-40d1-463d-be8a-d63d5e31e32c', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:40.848959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 27 04:37:40.850843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:40.852318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-28d44172-b894-4175-8295-c2d688901261 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:40.852318 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-28d44172-b894-4175-8295-c2d688901261 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action" status: 404 len: 88 microversion: 2.1 time: 0.051627 Aug 27 04:37:40.852318 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 826/1674] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:37:40 2022] POST /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c/action => generated 88 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:37:40.852731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7ee80848-f731-445e-a6db-ed0b041dd5a7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:40.853383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7ee80848-f731-445e-a6db-ed0b041dd5a7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:40.861087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ee80848-f731-445e-a6db-ed0b041dd5a7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:40.861573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ee80848-f731-445e-a6db-ed0b041dd5a7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:40.861997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ee80848-f731-445e-a6db-ed0b041dd5a7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:40.862711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ee80848-f731-445e-a6db-ed0b041dd5a7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:40.863163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ee80848-f731-445e-a6db-ed0b041dd5a7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:40.863585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ee80848-f731-445e-a6db-ed0b041dd5a7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:40.997038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7ee80848-f731-445e-a6db-ed0b041dd5a7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:41.006403 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7ee80848-f731-445e-a6db-ed0b041dd5a7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1358 microversion: 2.1 time: 0.157326 Aug 27 04:37:41.016840 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 827/1675] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:40 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:41.030607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-271c460f-cf17-448d-a938-dbdad237f895 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:41.033613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-271c460f-cf17-448d-a938-dbdad237f895 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:41.043914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-271c460f-cf17-448d-a938-dbdad237f895 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.044422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-271c460f-cf17-448d-a938-dbdad237f895 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.045652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-271c460f-cf17-448d-a938-dbdad237f895 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.046376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-271c460f-cf17-448d-a938-dbdad237f895 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.046837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-271c460f-cf17-448d-a938-dbdad237f895 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.047258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-271c460f-cf17-448d-a938-dbdad237f895 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.128821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:41.142118 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-271c460f-cf17-448d-a938-dbdad237f895 tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea/action" status: 202 len: 0 microversion: 2.1 time: 0.123799 Aug 27 04:37:41.145458 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 828/1676] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:37:41 2022] POST /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:37:41.150729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7a7508c6-d25f-4a18-b6ec-9cd38dc43d66 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:41.156447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7a7508c6-d25f-4a18-b6ec-9cd38dc43d66 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:41.162939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a7508c6-d25f-4a18-b6ec-9cd38dc43d66 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.163136 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1abf7184-b4b1-4a38-9336-cbee5924c702 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "POST /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 4.179982 Aug 27 04:37:41.163600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a7508c6-d25f-4a18-b6ec-9cd38dc43d66 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.163992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a7508c6-d25f-4a18-b6ec-9cd38dc43d66 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.170496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a7508c6-d25f-4a18-b6ec-9cd38dc43d66 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.170738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a7508c6-d25f-4a18-b6ec-9cd38dc43d66 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.171188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a7508c6-d25f-4a18-b6ec-9cd38dc43d66 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.176059 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 849/1677] 10.222.0.79 () {62 vars in 1364 bytes} [Sat Aug 27 04:37:36 2022] POST /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments => generated 194 bytes in 4194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:37:41.184129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ecb80df-ef40-46c0-b1c3-d3d3a7eedecd tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:41.185346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6ecb80df-ef40-46c0-b1c3-d3d3a7eedecd tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:41.193636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ecb80df-ef40-46c0-b1c3-d3d3a7eedecd tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.194308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ecb80df-ef40-46c0-b1c3-d3d3a7eedecd tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.194822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ecb80df-ef40-46c0-b1c3-d3d3a7eedecd tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.195631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ecb80df-ef40-46c0-b1c3-d3d3a7eedecd tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.196331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ecb80df-ef40-46c0-b1c3-d3d3a7eedecd tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.196885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ecb80df-ef40-46c0-b1c3-d3d3a7eedecd tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.205598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7a7508c6-d25f-4a18-b6ec-9cd38dc43d66 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:37:41.319875 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7a7508c6-d25f-4a18-b6ec-9cd38dc43d66 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "DELETE /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 204 len: 0 microversion: 2.1 time: 0.173000 Aug 27 04:37:41.321122 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 829/1678] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:37:41 2022] DELETE /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:41.332190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8dcdc4f4-e4cb-41cc-900e-e284d39aa46b tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:41.333045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8dcdc4f4-e4cb-41cc-900e-e284d39aa46b tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:41.339660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dcdc4f4-e4cb-41cc-900e-e284d39aa46b tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.340233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dcdc4f4-e4cb-41cc-900e-e284d39aa46b tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.340883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dcdc4f4-e4cb-41cc-900e-e284d39aa46b tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.342313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dcdc4f4-e4cb-41cc-900e-e284d39aa46b tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.343400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dcdc4f4-e4cb-41cc-900e-e284d39aa46b tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.343400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dcdc4f4-e4cb-41cc-900e-e284d39aa46b tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.366027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ecb80df-ef40-46c0-b1c3-d3d3a7eedecd tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:41.375302 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ecb80df-ef40-46c0-b1c3-d3d3a7eedecd tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1325 microversion: 2.1 time: 0.197148 Aug 27 04:37:41.375905 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 850/1679] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:41 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1325 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:41.380664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d8557d3-a38d-4801-bb4f-d686292e163e tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:41.381613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d8557d3-a38d-4801-bb4f-d686292e163e tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:41.387951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d8557d3-a38d-4801-bb4f-d686292e163e tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.388975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d8557d3-a38d-4801-bb4f-d686292e163e tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.389763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d8557d3-a38d-4801-bb4f-d686292e163e tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.390670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d8557d3-a38d-4801-bb4f-d686292e163e tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.391295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d8557d3-a38d-4801-bb4f-d686292e163e tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.391886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d8557d3-a38d-4801-bb4f-d686292e163e tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.519585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8dcdc4f4-e4cb-41cc-900e-e284d39aa46b tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:41.527830 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8dcdc4f4-e4cb-41cc-900e-e284d39aa46b tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1680 microversion: 2.1 time: 0.202299 Aug 27 04:37:41.528411 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 830/1680] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:41 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1680 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:41.537386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-91fe41ee-e339-4179-a0b8-ee48361c6d1a tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:41.538129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-91fe41ee-e339-4179-a0b8-ee48361c6d1a tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:41.543585 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d8557d3-a38d-4801-bb4f-d686292e163e tempest-ServersAdminTestJSON-1522578448 tempest-ServersAdminTestJSON-1522578448-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1614 microversion: 2.1 time: 0.166367 Aug 27 04:37:41.544186 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 851/1681] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:41 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1614 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:41.547013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91fe41ee-e339-4179-a0b8-ee48361c6d1a tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.547807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91fe41ee-e339-4179-a0b8-ee48361c6d1a tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.548510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91fe41ee-e339-4179-a0b8-ee48361c6d1a tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.549811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91fe41ee-e339-4179-a0b8-ee48361c6d1a tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.550655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91fe41ee-e339-4179-a0b8-ee48361c6d1a tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.551462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91fe41ee-e339-4179-a0b8-ee48361c6d1a tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.565452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a2cb907-5e98-40df-ac66-df28407feadf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:41.566048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a2cb907-5e98-40df-ac66-df28407feadf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:41.573926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a2cb907-5e98-40df-ac66-df28407feadf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.574422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a2cb907-5e98-40df-ac66-df28407feadf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.574860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a2cb907-5e98-40df-ac66-df28407feadf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.575556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a2cb907-5e98-40df-ac66-df28407feadf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.576060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a2cb907-5e98-40df-ac66-df28407feadf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.577243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a2cb907-5e98-40df-ac66-df28407feadf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.602930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a2cb907-5e98-40df-ac66-df28407feadf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:37:41.684426 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a2cb907-5e98-40df-ac66-df28407feadf tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 204 len: 0 microversion: 2.1 time: 0.123340 Aug 27 04:37:41.685087 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 852/1682] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:37:41 2022] DELETE /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:37:41.690673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33f5acfd-92dd-403b-aa64-32b53b44d0b6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:41.691400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33f5acfd-92dd-403b-aa64-32b53b44d0b6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:41.695365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-91fe41ee-e339-4179-a0b8-ee48361c6d1a tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:41.697648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33f5acfd-92dd-403b-aa64-32b53b44d0b6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.698231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33f5acfd-92dd-403b-aa64-32b53b44d0b6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.698678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33f5acfd-92dd-403b-aa64-32b53b44d0b6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.699450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33f5acfd-92dd-403b-aa64-32b53b44d0b6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.699908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33f5acfd-92dd-403b-aa64-32b53b44d0b6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.700337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33f5acfd-92dd-403b-aa64-32b53b44d0b6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.704127 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-91fe41ee-e339-4179-a0b8-ee48361c6d1a tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1540 microversion: 2.1 time: 0.174024 Aug 27 04:37:41.706138 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 831/1683] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:41 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1540 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:41.709502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3be3b899-539a-40b5-8561-cc5a1e211a56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:41.710104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3be3b899-539a-40b5-8561-cc5a1e211a56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:41.716390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3be3b899-539a-40b5-8561-cc5a1e211a56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.716619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3be3b899-539a-40b5-8561-cc5a1e211a56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.716995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3be3b899-539a-40b5-8561-cc5a1e211a56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.717770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3be3b899-539a-40b5-8561-cc5a1e211a56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.718230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3be3b899-539a-40b5-8561-cc5a1e211a56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.718720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3be3b899-539a-40b5-8561-cc5a1e211a56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.722166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:41.843653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33f5acfd-92dd-403b-aa64-32b53b44d0b6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:41.852355 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33f5acfd-92dd-403b-aa64-32b53b44d0b6 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1477 microversion: 2.1 time: 0.165531 Aug 27 04:37:41.853329 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 853/1684] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:41 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1477 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:41.854435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3be3b899-539a-40b5-8561-cc5a1e211a56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:41.861248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1089fe75-df87-427a-a136-f54d8f0287d1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:41.862155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1089fe75-df87-427a-a136-f54d8f0287d1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:41.863596 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3be3b899-539a-40b5-8561-cc5a1e211a56 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1468 microversion: 2.1 time: 0.157825 Aug 27 04:37:41.864570 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 832/1685] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:41 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1468 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:41.875887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1089fe75-df87-427a-a136-f54d8f0287d1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.876610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1089fe75-df87-427a-a136-f54d8f0287d1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.877203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1089fe75-df87-427a-a136-f54d8f0287d1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.878124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1089fe75-df87-427a-a136-f54d8f0287d1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.878578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1089fe75-df87-427a-a136-f54d8f0287d1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.879000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1089fe75-df87-427a-a136-f54d8f0287d1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.893517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e0fe8017-cc06-485a-a047-dc4a66912e2b req-8275505e-abc0-4352-8bdd-24617d45c0ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c35fba-1273-4d50-9b92-f96b93bb1295", "name": "network-vif-plugged", "status": "completed", "tag": "0e539f18-246d-462f-9c29-7eff0c12d3dd"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:41.902953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e0fe8017-cc06-485a-a047-dc4a66912e2b req-8275505e-abc0-4352-8bdd-24617d45c0ce service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.903670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e0fe8017-cc06-485a-a047-dc4a66912e2b req-8275505e-abc0-4352-8bdd-24617d45c0ce service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.904227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e0fe8017-cc06-485a-a047-dc4a66912e2b req-8275505e-abc0-4352-8bdd-24617d45c0ce service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.916208 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e0fe8017-cc06-485a-a047-dc4a66912e2b req-8275505e-abc0-4352-8bdd-24617d45c0ce service nova] Creating event network-vif-plugged:0e539f18-246d-462f-9c29-7eff0c12d3dd for instance b2c35fba-1273-4d50-9b92-f96b93bb1295 on n-h1-854823-1 Aug 27 04:37:41.921880 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e0fe8017-cc06-485a-a047-dc4a66912e2b req-8275505e-abc0-4352-8bdd-24617d45c0ce service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033108 Aug 27 04:37:41.922898 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 833/1686] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:37:42.015279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1089fe75-df87-427a-a136-f54d8f0287d1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:42.022886 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1089fe75-df87-427a-a136-f54d8f0287d1 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1307 microversion: 2.1 time: 0.168315 Aug 27 04:37:42.023451 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 854/1687] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:41 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1307 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:42.032419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e2fb2e19-f7e0-4e59-b756-2a31e592de99 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:42.033186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e2fb2e19-f7e0-4e59-b756-2a31e592de99 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:42.039304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2fb2e19-f7e0-4e59-b756-2a31e592de99 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:42.039785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2fb2e19-f7e0-4e59-b756-2a31e592de99 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:42.040407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2fb2e19-f7e0-4e59-b756-2a31e592de99 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:42.040961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2fb2e19-f7e0-4e59-b756-2a31e592de99 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:42.041419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2fb2e19-f7e0-4e59-b756-2a31e592de99 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:42.041854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2fb2e19-f7e0-4e59-b756-2a31e592de99 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:42.176120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e2fb2e19-f7e0-4e59-b756-2a31e592de99 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:42.183924 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e2fb2e19-f7e0-4e59-b756-2a31e592de99 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1358 microversion: 2.1 time: 0.156383 Aug 27 04:37:42.184500 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 834/1688] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:42 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:42.401957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ced0c7fd-42fc-4a61-890d-b29e0d4b60d9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:42.402568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ced0c7fd-42fc-4a61-890d-b29e0d4b60d9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:42.409781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced0c7fd-42fc-4a61-890d-b29e0d4b60d9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:42.410309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced0c7fd-42fc-4a61-890d-b29e0d4b60d9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:42.410761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced0c7fd-42fc-4a61-890d-b29e0d4b60d9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:42.411527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced0c7fd-42fc-4a61-890d-b29e0d4b60d9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:42.412000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced0c7fd-42fc-4a61-890d-b29e0d4b60d9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:42.412747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced0c7fd-42fc-4a61-890d-b29e0d4b60d9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:42.549997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-19a3419b-b311-4f67-b89a-918b0adf44f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:42.550554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-19a3419b-b311-4f67-b89a-918b0adf44f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:42.557335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19a3419b-b311-4f67-b89a-918b0adf44f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:42.557827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19a3419b-b311-4f67-b89a-918b0adf44f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:42.558264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19a3419b-b311-4f67-b89a-918b0adf44f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:42.558965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19a3419b-b311-4f67-b89a-918b0adf44f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:42.559422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19a3419b-b311-4f67-b89a-918b0adf44f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:42.559841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19a3419b-b311-4f67-b89a-918b0adf44f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:42.707477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-19a3419b-b311-4f67-b89a-918b0adf44f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:42.716767 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-19a3419b-b311-4f67-b89a-918b0adf44f1 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1680 microversion: 2.1 time: 0.170925 Aug 27 04:37:42.730416 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 835/1689] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:42 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:42.734390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ced0c7fd-42fc-4a61-890d-b29e0d4b60d9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:42.738629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-45a438ce-4c8e-4116-b704-193b92a16b98 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:42.739506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-45a438ce-4c8e-4116-b704-193b92a16b98 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:42.746271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45a438ce-4c8e-4116-b704-193b92a16b98 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:42.746631 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ced0c7fd-42fc-4a61-890d-b29e0d4b60d9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1325 microversion: 2.1 time: 0.349340 Aug 27 04:37:42.748580 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 855/1690] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:42 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1325 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:42.748961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45a438ce-4c8e-4116-b704-193b92a16b98 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:42.750762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45a438ce-4c8e-4116-b704-193b92a16b98 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:42.751508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45a438ce-4c8e-4116-b704-193b92a16b98 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:42.751976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45a438ce-4c8e-4116-b704-193b92a16b98 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:42.752414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45a438ce-4c8e-4116-b704-193b92a16b98 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:42.877852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5b07760-7f1b-4995-a82e-6b4c45e1040b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:42.879325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b5b07760-7f1b-4995-a82e-6b4c45e1040b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:42.890144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5b07760-7f1b-4995-a82e-6b4c45e1040b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:42.891047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5b07760-7f1b-4995-a82e-6b4c45e1040b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:42.891970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5b07760-7f1b-4995-a82e-6b4c45e1040b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:42.892913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5b07760-7f1b-4995-a82e-6b4c45e1040b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:42.893696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5b07760-7f1b-4995-a82e-6b4c45e1040b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:42.894311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5b07760-7f1b-4995-a82e-6b4c45e1040b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:42.898156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-45a438ce-4c8e-4116-b704-193b92a16b98 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:42.906299 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-45a438ce-4c8e-4116-b704-193b92a16b98 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1540 microversion: 2.1 time: 0.172531 Aug 27 04:37:42.916569 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 836/1691] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:42 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1540 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:42.916569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-74f41c5a-5f1e-4218-a93d-5c304a6cc019 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:42.916569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-74f41c5a-5f1e-4218-a93d-5c304a6cc019 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:42.920658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74f41c5a-5f1e-4218-a93d-5c304a6cc019 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:42.921679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74f41c5a-5f1e-4218-a93d-5c304a6cc019 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:42.922128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74f41c5a-5f1e-4218-a93d-5c304a6cc019 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:42.922834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74f41c5a-5f1e-4218-a93d-5c304a6cc019 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:42.923293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74f41c5a-5f1e-4218-a93d-5c304a6cc019 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:42.923720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74f41c5a-5f1e-4218-a93d-5c304a6cc019 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:43.077114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-74f41c5a-5f1e-4218-a93d-5c304a6cc019 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:43.087555 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-74f41c5a-5f1e-4218-a93d-5c304a6cc019 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1468 microversion: 2.1 time: 0.178196 Aug 27 04:37:43.088587 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 837/1692] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:42 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1468 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:43.093844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0e6a5e41-808a-4ce2-bbcc-94e9e88e847e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:43.094389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0e6a5e41-808a-4ce2-bbcc-94e9e88e847e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:43.100813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e6a5e41-808a-4ce2-bbcc-94e9e88e847e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:43.101303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e6a5e41-808a-4ce2-bbcc-94e9e88e847e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:43.101939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e6a5e41-808a-4ce2-bbcc-94e9e88e847e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:43.102635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e6a5e41-808a-4ce2-bbcc-94e9e88e847e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:43.103085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e6a5e41-808a-4ce2-bbcc-94e9e88e847e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:43.103500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e6a5e41-808a-4ce2-bbcc-94e9e88e847e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:43.195817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5b07760-7f1b-4995-a82e-6b4c45e1040b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:43.214003 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5b07760-7f1b-4995-a82e-6b4c45e1040b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1477 microversion: 2.1 time: 0.340728 Aug 27 04:37:43.215750 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 856/1693] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:42 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1477 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:43.224232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74ae1ee9-186f-4052-a707-f2a1cc660f28 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:43.229158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74ae1ee9-186f-4052-a707-f2a1cc660f28 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:43.237894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74ae1ee9-186f-4052-a707-f2a1cc660f28 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:43.238371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74ae1ee9-186f-4052-a707-f2a1cc660f28 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:43.238814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74ae1ee9-186f-4052-a707-f2a1cc660f28 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:43.241677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74ae1ee9-186f-4052-a707-f2a1cc660f28 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:43.242207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74ae1ee9-186f-4052-a707-f2a1cc660f28 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:43.245555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74ae1ee9-186f-4052-a707-f2a1cc660f28 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:43.365108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0e6a5e41-808a-4ce2-bbcc-94e9e88e847e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:43.381269 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0e6a5e41-808a-4ce2-bbcc-94e9e88e847e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1307 microversion: 2.1 time: 0.291839 Aug 27 04:37:43.381933 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 838/1694] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:43 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1307 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:43.538747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-74ae1ee9-186f-4052-a707-f2a1cc660f28 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:43.548190 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74ae1ee9-186f-4052-a707-f2a1cc660f28 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1541 microversion: 2.1 time: 0.331139 Aug 27 04:37:43.548825 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 857/1695] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:43 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1541 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:43.569669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b6d25243-68dc-4862-af0e-4116f96617a8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:43.570278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b6d25243-68dc-4862-af0e-4116f96617a8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:43.577246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6d25243-68dc-4862-af0e-4116f96617a8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:43.577809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6d25243-68dc-4862-af0e-4116f96617a8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:43.578319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6d25243-68dc-4862-af0e-4116f96617a8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:43.579150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6d25243-68dc-4862-af0e-4116f96617a8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:43.579693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6d25243-68dc-4862-af0e-4116f96617a8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:43.580228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6d25243-68dc-4862-af0e-4116f96617a8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:43.666738 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b6d25243-68dc-4862-af0e-4116f96617a8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100282 Aug 27 04:37:43.672574 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 839/1696] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 04:37:43 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:43.739329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27a02f3a-66d3-4648-9936-e7b1ef703d9c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:43.739595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-27a02f3a-66d3-4648-9936-e7b1ef703d9c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:43.741646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:43.747279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27a02f3a-66d3-4648-9936-e7b1ef703d9c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:43.747279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27a02f3a-66d3-4648-9936-e7b1ef703d9c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:43.747905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27a02f3a-66d3-4648-9936-e7b1ef703d9c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:43.748823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27a02f3a-66d3-4648-9936-e7b1ef703d9c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:43.749563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27a02f3a-66d3-4648-9936-e7b1ef703d9c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:43.750205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27a02f3a-66d3-4648-9936-e7b1ef703d9c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:43.770906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c06b6f65-2d96-4416-b3b9-ffafdecf6301 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:43.772602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c06b6f65-2d96-4416-b3b9-ffafdecf6301 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:43.781717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c06b6f65-2d96-4416-b3b9-ffafdecf6301 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:43.782717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c06b6f65-2d96-4416-b3b9-ffafdecf6301 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:43.783333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c06b6f65-2d96-4416-b3b9-ffafdecf6301 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:43.784226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c06b6f65-2d96-4416-b3b9-ffafdecf6301 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:43.785104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c06b6f65-2d96-4416-b3b9-ffafdecf6301 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:43.785728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c06b6f65-2d96-4416-b3b9-ffafdecf6301 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:43.855254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-27a02f3a-66d3-4648-9936-e7b1ef703d9c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:43.871998 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-27a02f3a-66d3-4648-9936-e7b1ef703d9c tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1613 microversion: 2.1 time: 0.136883 Aug 27 04:37:43.875371 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 858/1697] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:43 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1613 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:43.930080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79381392-fb81-409b-9566-3ae7ac2cf033 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:43.931125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-79381392-fb81-409b-9566-3ae7ac2cf033 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:43.946282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79381392-fb81-409b-9566-3ae7ac2cf033 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:43.947488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79381392-fb81-409b-9566-3ae7ac2cf033 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:43.948167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79381392-fb81-409b-9566-3ae7ac2cf033 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:43.949176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79381392-fb81-409b-9566-3ae7ac2cf033 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:43.951029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79381392-fb81-409b-9566-3ae7ac2cf033 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:43.958244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79381392-fb81-409b-9566-3ae7ac2cf033 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:44.267340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c06b6f65-2d96-4416-b3b9-ffafdecf6301 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:44.277899 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c06b6f65-2d96-4416-b3b9-ffafdecf6301 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1325 microversion: 2.1 time: 0.512332 Aug 27 04:37:44.283186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-79381392-fb81-409b-9566-3ae7ac2cf033 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:44.292920 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-79381392-fb81-409b-9566-3ae7ac2cf033 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1540 microversion: 2.1 time: 0.367275 Aug 27 04:37:44.293516 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 859/1698] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:43 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1540 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:44.298833 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 840/1699] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:43 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1325 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:44.307592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-49c591b4-9a2d-48a9-882c-4cf2793d0016 req-ad92e689-d635-416a-b8a6-3e04e823cb74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bbe5194-aa1d-4db9-aec2-044d247df93a", "name": "network-vif-plugged", "status": "completed", "tag": "63c68b66-1b81-4c26-befb-1e1ff3daa600"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:44.309220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-5d2c6dfd-73e2-44b2-8aac-f3b616886253 req-505c2326-7b4f-47a9-8f6a-aafeec7601d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce113bc-c89f-4752-817e-f3addff689b2", "name": "network-vif-deleted", "tag": "8f6bbf7a-d8a5-4aa0-bbfa-2912f98e51de"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:44.330735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5d2c6dfd-73e2-44b2-8aac-f3b616886253 req-505c2326-7b4f-47a9-8f6a-aafeec7601d2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:44.331512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5d2c6dfd-73e2-44b2-8aac-f3b616886253 req-505c2326-7b4f-47a9-8f6a-aafeec7601d2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:44.332109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5d2c6dfd-73e2-44b2-8aac-f3b616886253 req-505c2326-7b4f-47a9-8f6a-aafeec7601d2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:44.333331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-49c591b4-9a2d-48a9-882c-4cf2793d0016 req-ad92e689-d635-416a-b8a6-3e04e823cb74 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:44.335183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-49c591b4-9a2d-48a9-882c-4cf2793d0016 req-ad92e689-d635-416a-b8a6-3e04e823cb74 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:44.335822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-49c591b4-9a2d-48a9-882c-4cf2793d0016 req-ad92e689-d635-416a-b8a6-3e04e823cb74 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:44.356517 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-5d2c6dfd-73e2-44b2-8aac-f3b616886253 req-505c2326-7b4f-47a9-8f6a-aafeec7601d2 service nova] Creating event network-vif-deleted:8f6bbf7a-d8a5-4aa0-bbfa-2912f98e51de for instance 3ce113bc-c89f-4752-817e-f3addff689b2 on n-h1-854823-1 Aug 27 04:37:44.359392 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-49c591b4-9a2d-48a9-882c-4cf2793d0016 req-ad92e689-d635-416a-b8a6-3e04e823cb74 service nova] Creating event network-vif-plugged:63c68b66-1b81-4c26-befb-1e1ff3daa600 for instance 3bbe5194-aa1d-4db9-aec2-044d247df93a on n-h1-854823-1 Aug 27 04:37:44.366209 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-49c591b4-9a2d-48a9-882c-4cf2793d0016 req-ad92e689-d635-416a-b8a6-3e04e823cb74 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070230 Aug 27 04:37:44.369518 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 860/1700] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:44.373750 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-5d2c6dfd-73e2-44b2-8aac-f3b616886253 req-505c2326-7b4f-47a9-8f6a-aafeec7601d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070937 Aug 27 04:37:44.375451 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 841/1701] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:44.395604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-896d9603-a1b2-4106-86b0-87b531684be5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:44.397677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-896d9603-a1b2-4106-86b0-87b531684be5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:44.414611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50903255-f5c9-4977-92d8-d04b8eb50536 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:44.416501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50903255-f5c9-4977-92d8-d04b8eb50536 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:44.417210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-896d9603-a1b2-4106-86b0-87b531684be5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:44.417795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-896d9603-a1b2-4106-86b0-87b531684be5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:44.418320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-896d9603-a1b2-4106-86b0-87b531684be5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:44.419264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-896d9603-a1b2-4106-86b0-87b531684be5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:44.419676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-896d9603-a1b2-4106-86b0-87b531684be5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:44.432711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-896d9603-a1b2-4106-86b0-87b531684be5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:44.446125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50903255-f5c9-4977-92d8-d04b8eb50536 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:44.449622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50903255-f5c9-4977-92d8-d04b8eb50536 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:44.453446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50903255-f5c9-4977-92d8-d04b8eb50536 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:44.454434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50903255-f5c9-4977-92d8-d04b8eb50536 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:44.460060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50903255-f5c9-4977-92d8-d04b8eb50536 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:44.462576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50903255-f5c9-4977-92d8-d04b8eb50536 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:44.832185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-896d9603-a1b2-4106-86b0-87b531684be5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:44.846076 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-896d9603-a1b2-4106-86b0-87b531684be5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1477 microversion: 2.1 time: 0.464725 Aug 27 04:37:44.850351 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 842/1702] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:44 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1477 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:44.857967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-06a00f7e-07ce-46c4-bd20-3e2914670d31 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:44.858793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-06a00f7e-07ce-46c4-bd20-3e2914670d31 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:44.866327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06a00f7e-07ce-46c4-bd20-3e2914670d31 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:44.870275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06a00f7e-07ce-46c4-bd20-3e2914670d31 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:44.871041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06a00f7e-07ce-46c4-bd20-3e2914670d31 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:44.871513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06a00f7e-07ce-46c4-bd20-3e2914670d31 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:44.871984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06a00f7e-07ce-46c4-bd20-3e2914670d31 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:44.873408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06a00f7e-07ce-46c4-bd20-3e2914670d31 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:45.285385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-06a00f7e-07ce-46c4-bd20-3e2914670d31 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:45.295272 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-06a00f7e-07ce-46c4-bd20-3e2914670d31 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1487 microversion: 2.1 time: 0.446900 Aug 27 04:37:45.296430 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 843/1703] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:44 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1487 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:45.313384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf7b9d4a-5a5f-4665-bbd2-fb16234358d5 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:45.314419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bf7b9d4a-5a5f-4665-bbd2-fb16234358d5 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:45.331774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d4a-5a5f-4665-bbd2-fb16234358d5 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:45.332511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d4a-5a5f-4665-bbd2-fb16234358d5 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:45.333137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d4a-5a5f-4665-bbd2-fb16234358d5 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:45.334043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d4a-5a5f-4665-bbd2-fb16234358d5 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:45.334650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d4a-5a5f-4665-bbd2-fb16234358d5 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:45.335229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d4a-5a5f-4665-bbd2-fb16234358d5 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:45.341732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50903255-f5c9-4977-92d8-d04b8eb50536 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:45.356940 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50903255-f5c9-4977-92d8-d04b8eb50536 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1468 microversion: 2.1 time: 0.980803 Aug 27 04:37:45.358310 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 861/1704] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:44 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1468 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:45.367212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82c9edb8-32a2-42ae-85ec-4363a9c49552 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:45.368169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-82c9edb8-32a2-42ae-85ec-4363a9c49552 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:45.383855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82c9edb8-32a2-42ae-85ec-4363a9c49552 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:45.384822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82c9edb8-32a2-42ae-85ec-4363a9c49552 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:45.390575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82c9edb8-32a2-42ae-85ec-4363a9c49552 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:45.391732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82c9edb8-32a2-42ae-85ec-4363a9c49552 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:45.392439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82c9edb8-32a2-42ae-85ec-4363a9c49552 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:45.393286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82c9edb8-32a2-42ae-85ec-4363a9c49552 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:45.393517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d4a-5a5f-4665-bbd2-fb16234358d5 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:45.394882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d4a-5a5f-4665-bbd2-fb16234358d5 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:45.395571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf7b9d4a-5a5f-4665-bbd2-fb16234358d5 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:45.396940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-bf7b9d4a-5a5f-4665-bbd2-fb16234358d5 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lazy-loading 'fault' on Instance uuid 3ce113bc-c89f-4752-817e-f3addff689b2 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:37:45.519818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bf7b9d4a-5a5f-4665-bbd2-fb16234358d5 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6726e43aff14d27916835154cbfdf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8747bb92a41f4edd9b6a0cd832ce6112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:45.552815 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bf7b9d4a-5a5f-4665-bbd2-fb16234358d5 tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 200 len: 1330 microversion: 2.1 time: 0.254842 Aug 27 04:37:45.553432 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 844/1705] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:45 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 1330 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:45.586937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e7e45998-6eae-43a1-94fe-bbc7af8a849b tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:45.587571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e7e45998-6eae-43a1-94fe-bbc7af8a849b tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:45.619318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7e45998-6eae-43a1-94fe-bbc7af8a849b tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:45.619739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7e45998-6eae-43a1-94fe-bbc7af8a849b tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:45.620179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7e45998-6eae-43a1-94fe-bbc7af8a849b tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:45.620947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7e45998-6eae-43a1-94fe-bbc7af8a849b tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:45.621450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7e45998-6eae-43a1-94fe-bbc7af8a849b tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:45.621856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7e45998-6eae-43a1-94fe-bbc7af8a849b tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:45.653940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:45.795972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e7e45998-6eae-43a1-94fe-bbc7af8a849b tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:45.813293 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e7e45998-6eae-43a1-94fe-bbc7af8a849b tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1498 microversion: 2.1 time: 0.257650 Aug 27 04:37:45.817359 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 845/1706] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:45 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1498 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:45.834552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-76d2f870-8500-47c5-9b34-d9f3eb9daa15 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1612968699"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:45.837079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-76d2f870-8500-47c5-9b34-d9f3eb9daa15 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:45.849208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76d2f870-8500-47c5-9b34-d9f3eb9daa15 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:45.851322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76d2f870-8500-47c5-9b34-d9f3eb9daa15 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:45.851848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76d2f870-8500-47c5-9b34-d9f3eb9daa15 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:45.865579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76d2f870-8500-47c5-9b34-d9f3eb9daa15 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:45.869877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76d2f870-8500-47c5-9b34-d9f3eb9daa15 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:45.870435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76d2f870-8500-47c5-9b34-d9f3eb9daa15 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:46.054759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-82c9edb8-32a2-42ae-85ec-4363a9c49552 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:46.063916 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-82c9edb8-32a2-42ae-85ec-4363a9c49552 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1325 microversion: 2.1 time: 0.703635 Aug 27 04:37:46.065081 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 862/1707] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:45 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1325 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:46.095492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ccf4891d-bf04-46d9-a488-5cb474d4e49b req-7d31bbd2-28d8-487c-8b01-d778b383bf25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0beb618a-0847-4929-b2e9-27a80f61a7ca", "name": "network-vif-deleted", "tag": "0182ba2d-9563-41c7-a16e-8629890f858f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:46.141147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ccf4891d-bf04-46d9-a488-5cb474d4e49b req-7d31bbd2-28d8-487c-8b01-d778b383bf25 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:46.144927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ccf4891d-bf04-46d9-a488-5cb474d4e49b req-7d31bbd2-28d8-487c-8b01-d778b383bf25 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:46.145409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ccf4891d-bf04-46d9-a488-5cb474d4e49b req-7d31bbd2-28d8-487c-8b01-d778b383bf25 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:46.171892 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ccf4891d-bf04-46d9-a488-5cb474d4e49b req-7d31bbd2-28d8-487c-8b01-d778b383bf25 service nova] Creating event network-vif-deleted:0182ba2d-9563-41c7-a16e-8629890f858f for instance 0beb618a-0847-4929-b2e9-27a80f61a7ca on n-h2-854823-1 Aug 27 04:37:46.178635 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ccf4891d-bf04-46d9-a488-5cb474d4e49b req-7d31bbd2-28d8-487c-8b01-d778b383bf25 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096706 Aug 27 04:37:46.179972 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 863/1708] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:46.190190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a6200f8-19da-427e-a1db-52feb1e3c268 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:46.211527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a6200f8-19da-427e-a1db-52feb1e3c268 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:46.229638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6200f8-19da-427e-a1db-52feb1e3c268 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:46.230579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6200f8-19da-427e-a1db-52feb1e3c268 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:46.231272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6200f8-19da-427e-a1db-52feb1e3c268 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:46.235959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6200f8-19da-427e-a1db-52feb1e3c268 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:46.236893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6200f8-19da-427e-a1db-52feb1e3c268 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:46.237646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6200f8-19da-427e-a1db-52feb1e3c268 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:46.344365 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-76d2f870-8500-47c5-9b34-d9f3eb9daa15 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "POST /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295/action" status: 202 len: 0 microversion: 2.1 time: 0.525711 Aug 27 04:37:46.353892 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 846/1709] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:37:45 2022] POST /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:37:46.380771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f18511ff-ce94-4b9d-ab31-28178b73dcb4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f220318b0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:46.502974 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f18511ff-ce94-4b9d-ab31-28178b73dcb4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283" status: 200 len: 1412 microversion: 2.1 time: 0.134428 Aug 27 04:37:46.507958 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 847/1710] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:46 2022] GET /compute/v2.1/images/c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283 => generated 1412 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:46.531768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-74e374bc-64f3-409e-8285-7b71c94cc7db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:46.532817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-74e374bc-64f3-409e-8285-7b71c94cc7db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:46.548385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74e374bc-64f3-409e-8285-7b71c94cc7db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:46.550717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74e374bc-64f3-409e-8285-7b71c94cc7db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:46.551907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74e374bc-64f3-409e-8285-7b71c94cc7db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:46.554827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74e374bc-64f3-409e-8285-7b71c94cc7db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:46.555486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74e374bc-64f3-409e-8285-7b71c94cc7db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:46.556688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74e374bc-64f3-409e-8285-7b71c94cc7db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:46.612799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74e374bc-64f3-409e-8285-7b71c94cc7db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:46.613668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74e374bc-64f3-409e-8285-7b71c94cc7db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:46.614474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74e374bc-64f3-409e-8285-7b71c94cc7db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:46.615412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-74e374bc-64f3-409e-8285-7b71c94cc7db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lazy-loading 'fault' on Instance uuid 0beb618a-0847-4929-b2e9-27a80f61a7ca {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:37:46.708889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-74e374bc-64f3-409e-8285-7b71c94cc7db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:46.719765 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-74e374bc-64f3-409e-8285-7b71c94cc7db tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 200 len: 1302 microversion: 2.1 time: 0.210524 Aug 27 04:37:46.720648 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 848/1711] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:46 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 1302 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:46.732587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-be7d3fe7-97e1-41a2-9475-66000be0527e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f217943a0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:46.814339 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-be7d3fe7-97e1-41a2-9475-66000be0527e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283" status: 200 len: 1412 microversion: 2.1 time: 0.092846 Aug 27 04:37:46.815475 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 849/1712] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:46 2022] GET /compute/v2.1/images/c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283 => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:46.826689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7a12bd7-63b7-4e8a-89d3-c65c0a6ac7dd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:46.828058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c7a12bd7-63b7-4e8a-89d3-c65c0a6ac7dd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] [instance: 3ce113bc-c89f-4752-817e-f3addff689b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:46.845257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7a12bd7-63b7-4e8a-89d3-c65c0a6ac7dd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:46.845580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7a12bd7-63b7-4e8a-89d3-c65c0a6ac7dd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:46.846083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7a12bd7-63b7-4e8a-89d3-c65c0a6ac7dd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:46.846808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7a12bd7-63b7-4e8a-89d3-c65c0a6ac7dd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:46.847264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7a12bd7-63b7-4e8a-89d3-c65c0a6ac7dd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:46.847700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7a12bd7-63b7-4e8a-89d3-c65c0a6ac7dd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:46.896466 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-c7a12bd7-63b7-4e8a-89d3-c65c0a6ac7dd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] HTTP exception thrown: Instance 3ce113bc-c89f-4752-817e-f3addff689b2 could not be found. Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7a12bd7-63b7-4e8a-89d3-c65c0a6ac7dd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Request method failure captured: Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 HTTP/1.1 Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ6-D3BYy7IciQDbRayK-28gyGCCgYDPgeyUtepXMExfHdkcGI15HPSbvoBQes_uXTivGJ5TseoWSSFisoiMEzXYzcKTFTrFIRYcIKT70bj369uapC3CZEg1pjf3_WocjCKHZICo8J5nZfj5lNmtw4vf-1Oav92T9XOg3w_TytfIMCg Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8747bb92a41f4edd9b6a0cd832ce6112 Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-VolumesAdminNegativeTest-1328002529 Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:37:46.909801 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:37:46.911994 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8747bb92a41f4edd9b6a0cd832ce6112"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8747bb92a41f4edd9b6a0cd832ce6112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8747bb92a41f4edd9b6a0cd832ce6112"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8747bb92a41f4edd9b6a0cd832ce6112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:46.911994 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-VolumesAdminNegativeTest-1328002529 Aug 27 04:37:46.911994 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8747bb92a41f4edd9b6a0cd832ce6112 Aug 27 04:37:46.911994 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1328002529 Aug 27 04:37:46.911994 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-VolumesAdminNegativeTest-1328002529-project Aug 27 04:37:46.911994 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:37:46.911994 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:37:46.911994 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: b6726e43aff14d27916835154cbfdf1d Aug 27 04:37:46.911994 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-VolumesAdminNegativeTest-1328002529-project Aug 27 04:37:46.911994 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:37:46.911994 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 3ce113bc-c89f-4752-817e-f3addff689b2 could not be found. Aug 27 04:37:46.911994 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '3ce113bc-c89f-4752-817e-f3addff689b2'} Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce113bc-c89f-4752-817e-f3addff689b2 could not be found. Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:46.914085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce113bc-c89f-4752-817e-f3addff689b2 could not be found. Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce113bc-c89f-4752-817e-f3addff689b2 could not be found. Aug 27 04:37:46.915455 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:46.918302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7a12bd7-63b7-4e8a-89d3-c65c0a6ac7dd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Returning 404 to user: Instance 3ce113bc-c89f-4752-817e-f3addff689b2 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:46.918302 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7a12bd7-63b7-4e8a-89d3-c65c0a6ac7dd tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2" status: 404 len: 111 microversion: 2.1 time: 0.094831 Aug 27 04:37:46.918302 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 850/1713] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:46 2022] GET /compute/v2.1/servers/3ce113bc-c89f-4752-817e-f3addff689b2 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:37:46.918772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-27e7535d-fd3e-419e-baec-09d051afc317 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f22031ee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:46.940429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a6200f8-19da-427e-a1db-52feb1e3c268 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:46.954886 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a6200f8-19da-427e-a1db-52feb1e3c268 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1477 microversion: 2.1 time: 0.773064 Aug 27 04:37:46.986398 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 864/1714] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:46 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1477 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:47.011221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5e0414c-bec3-4201-a7ed-d923c7c98956 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:47.016858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b5e0414c-bec3-4201-a7ed-d923c7c98956 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:47.038633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e0414c-bec3-4201-a7ed-d923c7c98956 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:47.040158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e0414c-bec3-4201-a7ed-d923c7c98956 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:47.040934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e0414c-bec3-4201-a7ed-d923c7c98956 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:47.042568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e0414c-bec3-4201-a7ed-d923c7c98956 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:47.045125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e0414c-bec3-4201-a7ed-d923c7c98956 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:47.048071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e0414c-bec3-4201-a7ed-d923c7c98956 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:47.119216 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-27e7535d-fd3e-419e-baec-09d051afc317 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/images/c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283" status: 204 len: 0 microversion: 2.1 time: 0.205726 Aug 27 04:37:47.120288 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 851/1715] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:46 2022] DELETE /compute/v2.1/images/c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:47.131435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-33659bd2-c837-41da-94a0-78e8312042eb tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] Calling method '.version_select at 0x7f1f217a4280>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:47.139283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e0414c-bec3-4201-a7ed-d923c7c98956 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:47.140594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e0414c-bec3-4201-a7ed-d923c7c98956 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:47.143560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e0414c-bec3-4201-a7ed-d923c7c98956 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:47.145330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-b5e0414c-bec3-4201-a7ed-d923c7c98956 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lazy-loading 'fault' on Instance uuid 399bd6c1-40d1-463d-be8a-d63d5e31e32c {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:37:47.234984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5e0414c-bec3-4201-a7ed-d923c7c98956 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8852be5166774a5e870512f289cf0aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98283183679c42029b0ca02db8762ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:47.249514 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-33659bd2-c837-41da-94a0-78e8312042eb tempest-VolumesAdminNegativeTest-1328002529 tempest-VolumesAdminNegativeTest-1328002529-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-503247008" status: 202 len: 0 microversion: 2.1 time: 0.127051 Aug 27 04:37:47.250513 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 852/1716] 10.222.0.79 () {58 vars in 1218 bytes} [Sat Aug 27 04:37:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-503247008 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:37:47.263224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a1aa76e3-e08e-42da-b98c-cb9a57d68d7f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:47.272165 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5e0414c-bec3-4201-a7ed-d923c7c98956 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 200 len: 1321 microversion: 2.1 time: 0.281171 Aug 27 04:37:47.287230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a1aa76e3-e08e-42da-b98c-cb9a57d68d7f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:47.296196 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 865/1717] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:46 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:47.321959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1aa76e3-e08e-42da-b98c-cb9a57d68d7f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:47.325942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-950781b4-c3fd-4997-85d0-f35228a1be57 req-d49dd19a-f17d-4053-b958-db203b8f950d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c1ebbce-7c0d-4f08-a05f-359d0527b76d", "tag": "8348ead6-1b46-443f-99ec-f72deeb2c4f5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:47.326522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1aa76e3-e08e-42da-b98c-cb9a57d68d7f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:47.328581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1aa76e3-e08e-42da-b98c-cb9a57d68d7f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:47.333325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1aa76e3-e08e-42da-b98c-cb9a57d68d7f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:47.334348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1aa76e3-e08e-42da-b98c-cb9a57d68d7f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:47.335080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1aa76e3-e08e-42da-b98c-cb9a57d68d7f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:47.376505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-950781b4-c3fd-4997-85d0-f35228a1be57 req-d49dd19a-f17d-4053-b958-db203b8f950d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:47.377035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-950781b4-c3fd-4997-85d0-f35228a1be57 req-d49dd19a-f17d-4053-b958-db203b8f950d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:47.379453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-950781b4-c3fd-4997-85d0-f35228a1be57 req-d49dd19a-f17d-4053-b958-db203b8f950d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:47.432241 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-950781b4-c3fd-4997-85d0-f35228a1be57 req-d49dd19a-f17d-4053-b958-db203b8f950d service nova] Creating event network-changed:8348ead6-1b46-443f-99ec-f72deeb2c4f5 for instance 0c1ebbce-7c0d-4f08-a05f-359d0527b76d on n-h1-854823-1 Aug 27 04:37:47.454116 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-950781b4-c3fd-4997-85d0-f35228a1be57 req-d49dd19a-f17d-4053-b958-db203b8f950d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155571 Aug 27 04:37:47.457295 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 866/1718] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:47.470715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c13a310e-74fb-4acc-9a73-09a18a8b72a0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25e484c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:47.511769 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c13a310e-74fb-4acc-9a73-09a18a8b72a0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] HTTP exception thrown: Image not found. Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c13a310e-74fb-4acc-9a73-09a18a8b72a0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Request method failure captured: Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/images/c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283 HTTP/1.1 Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ7QAK8ZHwjwpIbL1xIl9WfxQp4GVSA65O5iuZ0hlcZ4WGq08KgIhZUUUReVd1eSmKoiiVBis1FWK-SjVd21Fiu9YXRbMJS2wgKDE6Fw2e-gQ_hQ3t2dli8G3vBgi2XrVmYgv_BOxxihOGYVOY1eflDpehZm2M2-N7WjE41u3O_YmnA Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:37:47.538494 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:37:47.540283 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b207b502d846718f9d72f62d1d034c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:47.540283 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesTestJSON-465316353 Aug 27 04:37:47.540283 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:37:47.540283 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:37:47.540283 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesTestJSON-465316353-project Aug 27 04:37:47.540283 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:37:47.540283 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:37:47.540283 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: daa3b03c362d4032bd17ebfeccdcdb83 Aug 27 04:37:47.540283 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesTestJSON-465316353-project Aug 27 04:37:47.540283 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:37:47.540283 n-d-854823-1 devstack@n-api.service[128869]: exception: Image not found. Aug 27 04:37:47.540283 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283'} Aug 27 04:37:47.540283 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:47.540283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283 Aug 27 04:37:47.541493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:37:47.542925 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283 could not be found. Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:37:47.544377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c13a310e-74fb-4acc-9a73-09a18a8b72a0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:47.545745 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c13a310e-74fb-4acc-9a73-09a18a8b72a0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/images/c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283" status: 404 len: 62 microversion: 2.1 time: 0.083610 Aug 27 04:37:47.547888 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 867/1719] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:47 2022] GET /compute/v2.1/images/c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283 => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:37:47.554738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42624a19-65f1-49d9-99f4-a84d2077072e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:47.555559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-42624a19-65f1-49d9-99f4-a84d2077072e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:47.567240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42624a19-65f1-49d9-99f4-a84d2077072e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:47.567732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42624a19-65f1-49d9-99f4-a84d2077072e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:47.568164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42624a19-65f1-49d9-99f4-a84d2077072e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:47.568892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42624a19-65f1-49d9-99f4-a84d2077072e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:47.569346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42624a19-65f1-49d9-99f4-a84d2077072e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:47.569759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42624a19-65f1-49d9-99f4-a84d2077072e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:47.614155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a1aa76e3-e08e-42da-b98c-cb9a57d68d7f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:47.626125 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a1aa76e3-e08e-42da-b98c-cb9a57d68d7f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1521 microversion: 2.1 time: 0.369406 Aug 27 04:37:47.641941 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 853/1720] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:47 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:47.670013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6b8e89ad-aaa6-4d00-bced-fc8ae12e8cda tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:47.673634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6b8e89ad-aaa6-4d00-bced-fc8ae12e8cda tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:47.683510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b8e89ad-aaa6-4d00-bced-fc8ae12e8cda tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:47.684481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b8e89ad-aaa6-4d00-bced-fc8ae12e8cda tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:47.685535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b8e89ad-aaa6-4d00-bced-fc8ae12e8cda tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:47.686445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b8e89ad-aaa6-4d00-bced-fc8ae12e8cda tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:47.687075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b8e89ad-aaa6-4d00-bced-fc8ae12e8cda tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:47.687669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b8e89ad-aaa6-4d00-bced-fc8ae12e8cda tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:47.910204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6b8e89ad-aaa6-4d00-bced-fc8ae12e8cda tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:47.919455 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6b8e89ad-aaa6-4d00-bced-fc8ae12e8cda tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1521 microversion: 2.1 time: 0.270670 Aug 27 04:37:47.920568 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 854/1721] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:47 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:47.925647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b669098b-dff1-4ab7-bbce-09bf7409ac30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:47.926664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b669098b-dff1-4ab7-bbce-09bf7409ac30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 0beb618a-0847-4929-b2e9-27a80f61a7ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:47.933038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b669098b-dff1-4ab7-bbce-09bf7409ac30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:47.935283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b669098b-dff1-4ab7-bbce-09bf7409ac30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:47.935915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b669098b-dff1-4ab7-bbce-09bf7409ac30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:47.937168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b669098b-dff1-4ab7-bbce-09bf7409ac30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:47.937800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b669098b-dff1-4ab7-bbce-09bf7409ac30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:47.938388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b669098b-dff1-4ab7-bbce-09bf7409ac30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:47.957764 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-b669098b-dff1-4ab7-bbce-09bf7409ac30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] HTTP exception thrown: Instance 0beb618a-0847-4929-b2e9-27a80f61a7ca could not be found. Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b669098b-dff1-4ab7-bbce-09bf7409ac30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Request method failure captured: Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca HTTP/1.1 Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ8O559C0M8nIm3Rkl-q_blAaFzgbnkgJzCbEJNcLMAv-nVi8lRFTGXv_ujKg4kEV0S1Nzs_CndRRfjMsFW8kAgB0VcLB-M0v1VDW9xZqsc5XIimDT9Zm4nt_PwWorfPUKRJmiVmYfUftoklGmNOnG2ejRdXxmo_H83qm7-9t0N0I34 Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 3873cb4810d840ac93518952196fd52b Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersAdminTestJSON-958669010 Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:37:47.959615 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:37:47.961375 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3873cb4810d840ac93518952196fd52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3873cb4810d840ac93518952196fd52b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3873cb4810d840ac93518952196fd52b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3873cb4810d840ac93518952196fd52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:47.961375 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersAdminTestJSON-958669010 Aug 27 04:37:47.961375 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 3873cb4810d840ac93518952196fd52b Aug 27 04:37:47.961375 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersAdminTestJSON-958669010 Aug 27 04:37:47.961375 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersAdminTestJSON-958669010-project Aug 27 04:37:47.961375 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:37:47.961375 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:37:47.961375 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 23eec6b7eb8b4ad897873c027e095b8d Aug 27 04:37:47.961375 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersAdminTestJSON-958669010-project Aug 27 04:37:47.961375 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:37:47.961375 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 0beb618a-0847-4929-b2e9-27a80f61a7ca could not be found. Aug 27 04:37:47.961375 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '0beb618a-0847-4929-b2e9-27a80f61a7ca'} Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0beb618a-0847-4929-b2e9-27a80f61a7ca could not be found. Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:47.962271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0beb618a-0847-4929-b2e9-27a80f61a7ca could not be found. Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0beb618a-0847-4929-b2e9-27a80f61a7ca could not be found. Aug 27 04:37:47.963560 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:37:47.966495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b669098b-dff1-4ab7-bbce-09bf7409ac30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Returning 404 to user: Instance 0beb618a-0847-4929-b2e9-27a80f61a7ca could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:47.968357 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b669098b-dff1-4ab7-bbce-09bf7409ac30 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca" status: 404 len: 111 microversion: 2.1 time: 0.046062 Aug 27 04:37:47.969215 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 855/1722] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:47 2022] GET /compute/v2.1/servers/0beb618a-0847-4929-b2e9-27a80f61a7ca => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:37:47.980229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c5b91468-cb2f-45b6-988a-7cf956ed3cd2 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1391581674"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:47.989349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c5b91468-cb2f-45b6-988a-7cf956ed3cd2 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:48.008506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5b91468-cb2f-45b6-988a-7cf956ed3cd2 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:48.009169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5b91468-cb2f-45b6-988a-7cf956ed3cd2 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:48.009723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5b91468-cb2f-45b6-988a-7cf956ed3cd2 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:48.012354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5b91468-cb2f-45b6-988a-7cf956ed3cd2 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:48.012965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5b91468-cb2f-45b6-988a-7cf956ed3cd2 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:48.015908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5b91468-cb2f-45b6-988a-7cf956ed3cd2 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:48.102165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-42624a19-65f1-49d9-99f4-a84d2077072e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:48.110628 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42624a19-65f1-49d9-99f4-a84d2077072e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1499 microversion: 2.1 time: 0.561036 Aug 27 04:37:48.124669 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 868/1723] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:47 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1499 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:48.129813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74cff124-e298-43d2-9cbf-486ab6b62be1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:48.130514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74cff124-e298-43d2-9cbf-486ab6b62be1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:48.137160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cff124-e298-43d2-9cbf-486ab6b62be1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:48.137906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cff124-e298-43d2-9cbf-486ab6b62be1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:48.138533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cff124-e298-43d2-9cbf-486ab6b62be1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:48.139404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cff124-e298-43d2-9cbf-486ab6b62be1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:48.140584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cff124-e298-43d2-9cbf-486ab6b62be1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:48.141198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cff124-e298-43d2-9cbf-486ab6b62be1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:48.169631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74cff124-e298-43d2-9cbf-486ab6b62be1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:37:48.290596 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74cff124-e298-43d2-9cbf-486ab6b62be1 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 204 len: 0 microversion: 2.1 time: 0.163994 Aug 27 04:37:48.292185 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 869/1724] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:37:48 2022] DELETE /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:48.302765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3123fc38-3a97-4b45-8d26-498f6693aff4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:48.304068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3123fc38-3a97-4b45-8d26-498f6693aff4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:48.312943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3123fc38-3a97-4b45-8d26-498f6693aff4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:48.313635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3123fc38-3a97-4b45-8d26-498f6693aff4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:48.314138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3123fc38-3a97-4b45-8d26-498f6693aff4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:48.315208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3123fc38-3a97-4b45-8d26-498f6693aff4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:48.315752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3123fc38-3a97-4b45-8d26-498f6693aff4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:48.316175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3123fc38-3a97-4b45-8d26-498f6693aff4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:48.350581 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c5b91468-cb2f-45b6-988a-7cf956ed3cd2 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "POST /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a/action" status: 202 len: 0 microversion: 2.1 time: 0.379706 Aug 27 04:37:48.352434 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 856/1725] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:37:47 2022] POST /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:37:48.358645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-52e523ab-4c41-477a-8e5c-24e1e8e3280b req-bdb9d893-3f76-481f-89e8-b8b496008211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399bd6c1-40d1-463d-be8a-d63d5e31e32c", "name": "network-vif-deleted", "tag": "d5ab4a86-3f84-45fc-bed7-5c705b957f6c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:48.374996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-52e523ab-4c41-477a-8e5c-24e1e8e3280b req-bdb9d893-3f76-481f-89e8-b8b496008211 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:48.375617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-52e523ab-4c41-477a-8e5c-24e1e8e3280b req-bdb9d893-3f76-481f-89e8-b8b496008211 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:48.376312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-52e523ab-4c41-477a-8e5c-24e1e8e3280b req-bdb9d893-3f76-481f-89e8-b8b496008211 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:48.397569 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-52e523ab-4c41-477a-8e5c-24e1e8e3280b req-bdb9d893-3f76-481f-89e8-b8b496008211 service nova] Creating event network-vif-deleted:d5ab4a86-3f84-45fc-bed7-5c705b957f6c for instance 399bd6c1-40d1-463d-be8a-d63d5e31e32c on n-h2-854823-1 Aug 27 04:37:48.403241 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-52e523ab-4c41-477a-8e5c-24e1e8e3280b req-bdb9d893-3f76-481f-89e8-b8b496008211 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049049 Aug 27 04:37:48.404200 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 857/1726] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:48.411170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d1c73d4c-a610-41d5-93ac-e866f02e4279 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:48.412179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d1c73d4c-a610-41d5-93ac-e866f02e4279 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:48.419076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1c73d4c-a610-41d5-93ac-e866f02e4279 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:48.420230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1c73d4c-a610-41d5-93ac-e866f02e4279 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:48.420926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1c73d4c-a610-41d5-93ac-e866f02e4279 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:48.421823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1c73d4c-a610-41d5-93ac-e866f02e4279 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:48.422464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1c73d4c-a610-41d5-93ac-e866f02e4279 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:48.423048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1c73d4c-a610-41d5-93ac-e866f02e4279 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:48.615311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3123fc38-3a97-4b45-8d26-498f6693aff4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:48.623456 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3123fc38-3a97-4b45-8d26-498f6693aff4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1477 microversion: 2.1 time: 0.329597 Aug 27 04:37:48.625995 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 870/1727] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:48 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1477 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:48.628047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d1c73d4c-a610-41d5-93ac-e866f02e4279 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:48.632634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa0a68f1-a217-4857-ae40-ece8af2bc206 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:48.633539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aa0a68f1-a217-4857-ae40-ece8af2bc206 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] [instance: 399bd6c1-40d1-463d-be8a-d63d5e31e32c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:48.638242 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d1c73d4c-a610-41d5-93ac-e866f02e4279 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1469 microversion: 2.1 time: 0.232376 Aug 27 04:37:48.639394 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 858/1728] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:48 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1469 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:48.641736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa0a68f1-a217-4857-ae40-ece8af2bc206 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:48.642974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa0a68f1-a217-4857-ae40-ece8af2bc206 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:48.643646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa0a68f1-a217-4857-ae40-ece8af2bc206 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:48.644608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa0a68f1-a217-4857-ae40-ece8af2bc206 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:48.645289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa0a68f1-a217-4857-ae40-ece8af2bc206 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:48.645926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa0a68f1-a217-4857-ae40-ece8af2bc206 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:48.646282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2e001e0c-1841-417f-9e9b-6692e4fd0ae1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '.version_select at 0x7f1f2162c4c0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:48.664734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:48.666090 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-aa0a68f1-a217-4857-ae40-ece8af2bc206 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] HTTP exception thrown: Instance 399bd6c1-40d1-463d-be8a-d63d5e31e32c could not be found. Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa0a68f1-a217-4857-ae40-ece8af2bc206 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Request method failure captured: Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c HTTP/1.1 Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ9srsYRSAkk8Iy57Gi-zwEzQi_AHCxhmcaCdwIHaorTcGK7_K12EqJrV63JT4zLOauz97ihkiOY_N4siPSbr8xrGNf2GMqFiPLJHkPQUNz2K8RgwBFzQT26v4jpu4Jvf-h8XF9J6-QLpLUlb8olb-7hIAIn6MrSp8yc0dBTzAxcJe4 Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 98283183679c42029b0ca02db8762ed4 Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:37:48.667801 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:37:48.669445 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/98283183679c42029b0ca02db8762ed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_98283183679c42029b0ca02db8762ed4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/98283183679c42029b0ca02db8762ed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/98283183679c42029b0ca02db8762ed4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:48.669445 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:48.669445 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 98283183679c42029b0ca02db8762ed4 Aug 27 04:37:48.669445 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902 Aug 27 04:37:48.669445 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project Aug 27 04:37:48.669445 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:37:48.669445 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:37:48.669445 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8852be5166774a5e870512f289cf0aa6 Aug 27 04:37:48.669445 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project Aug 27 04:37:48.669445 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:37:48.669445 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 399bd6c1-40d1-463d-be8a-d63d5e31e32c could not be found. Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '399bd6c1-40d1-463d-be8a-d63d5e31e32c'} Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 399bd6c1-40d1-463d-be8a-d63d5e31e32c could not be found. Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:48.670218 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 399bd6c1-40d1-463d-be8a-d63d5e31e32c could not be found. Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 399bd6c1-40d1-463d-be8a-d63d5e31e32c could not be found. Aug 27 04:37:48.672147 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:48.674550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa0a68f1-a217-4857-ae40-ece8af2bc206 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] Returning 404 to user: Instance 399bd6c1-40d1-463d-be8a-d63d5e31e32c could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:48.674550 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa0a68f1-a217-4857-ae40-ece8af2bc206 tempest-FloatingIPsAssociationNegativeTestJSON-833199902 tempest-FloatingIPsAssociationNegativeTestJSON-833199902-project] 10.222.0.79 "GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c" status: 404 len: 111 microversion: 2.1 time: 0.042019 Aug 27 04:37:48.674550 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 871/1729] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:48 2022] GET /compute/v2.1/servers/399bd6c1-40d1-463d-be8a-d63d5e31e32c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:37:48.862164 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2e001e0c-1841-417f-9e9b-6692e4fd0ae1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "DELETE /compute/v2.1/images/5b3c7a65-1b0b-4da3-a4fb-c5990d2a1e7c" status: 204 len: 0 microversion: 2.1 time: 0.220933 Aug 27 04:37:48.863316 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 859/1730] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:48 2022] DELETE /compute/v2.1/images/5b3c7a65-1b0b-4da3-a4fb-c5990d2a1e7c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:48.874824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01d9fc9b-d0de-49d5-8c2f-5dbdf53ba2a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '.version_select at 0x7f1f25cad940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:48.926315 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-01d9fc9b-d0de-49d5-8c2f-5dbdf53ba2a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] HTTP exception thrown: Image not found. Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01d9fc9b-d0de-49d5-8c2f-5dbdf53ba2a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Request method failure captured: Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/images/5b3c7a65-1b0b-4da3-a4fb-c5990d2a1e7c HTTP/1.1 Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ9LzeqYV4BUCc_CXZKyCgJDhuJ0n2D010QQ784od245BsR3bxLb1sHxDrLyEr4O_qgJBjYkRUAA_KGuy_0GWIipzEN4V-LZRqsnqytvO99DPzpj2LnZgNSzlNtzQSnXwwcHdsJTzPP1AoM-PSJ_QnZrIKpvFlmfCiSUn_wXkMGZoYs Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:37:48.928734 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:37:48.930578 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:48.930578 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:37:48.930578 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:37:48.930578 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:37:48.930578 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:37:48.930578 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:37:48.930578 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:37:48.930578 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 307981144d4141ed9d609d88ea2e954e Aug 27 04:37:48.930578 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:37:48.930578 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:37:48.930578 n-d-854823-1 devstack@n-api.service[128869]: exception: Image not found. Aug 27 04:37:48.930578 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '5b3c7a65-1b0b-4da3-a4fb-c5990d2a1e7c'} Aug 27 04:37:48.930578 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:37:48.931633 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5b3c7a65-1b0b-4da3-a4fb-c5990d2a1e7c Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:37:48.933433 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5b3c7a65-1b0b-4da3-a4fb-c5990d2a1e7c could not be found. Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:37:48.935827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:37:48.938745 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:48.941784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01d9fc9b-d0de-49d5-8c2f-5dbdf53ba2a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:48.942693 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01d9fc9b-d0de-49d5-8c2f-5dbdf53ba2a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/images/5b3c7a65-1b0b-4da3-a4fb-c5990d2a1e7c" status: 404 len: 62 microversion: 2.1 time: 0.075030 Aug 27 04:37:48.943472 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 872/1731] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:48 2022] GET /compute/v2.1/images/5b3c7a65-1b0b-4da3-a4fb-c5990d2a1e7c => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:37:48.952823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2a0365cb-c34d-4dbb-8ce6-4a003f5f9a15 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:48.953689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2a0365cb-c34d-4dbb-8ce6-4a003f5f9a15 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:48.962635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a0365cb-c34d-4dbb-8ce6-4a003f5f9a15 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:48.971589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a0365cb-c34d-4dbb-8ce6-4a003f5f9a15 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:48.972310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a0365cb-c34d-4dbb-8ce6-4a003f5f9a15 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:48.973255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a0365cb-c34d-4dbb-8ce6-4a003f5f9a15 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:48.973874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a0365cb-c34d-4dbb-8ce6-4a003f5f9a15 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:48.975053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a0365cb-c34d-4dbb-8ce6-4a003f5f9a15 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:49.131343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d2c4c52-29dc-442f-b9c0-147420977ab8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:49.131952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3d2c4c52-29dc-442f-b9c0-147420977ab8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:49.145436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d2c4c52-29dc-442f-b9c0-147420977ab8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:49.145932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d2c4c52-29dc-442f-b9c0-147420977ab8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:49.146373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d2c4c52-29dc-442f-b9c0-147420977ab8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:49.147083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d2c4c52-29dc-442f-b9c0-147420977ab8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:49.147542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d2c4c52-29dc-442f-b9c0-147420977ab8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:49.147965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d2c4c52-29dc-442f-b9c0-147420977ab8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:49.268870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a0365cb-c34d-4dbb-8ce6-4a003f5f9a15 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:49.284694 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2a0365cb-c34d-4dbb-8ce6-4a003f5f9a15 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1533 microversion: 2.1 time: 0.336056 Aug 27 04:37:49.285945 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 860/1732] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:48 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1533 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:49.527509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d2c4c52-29dc-442f-b9c0-147420977ab8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:49.535914 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d2c4c52-29dc-442f-b9c0-147420977ab8 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1505 microversion: 2.1 time: 0.408284 Aug 27 04:37:49.551131 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 873/1733] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:49 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:49.646390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a2cb7dbd-edf7-4cdb-979e-67c6395c146e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:49.646998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a2cb7dbd-edf7-4cdb-979e-67c6395c146e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:49.663202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2cb7dbd-edf7-4cdb-979e-67c6395c146e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:49.664035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c3ede5f-a680-4b5c-993c-47581eb501ac tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:49.664201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2cb7dbd-edf7-4cdb-979e-67c6395c146e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:49.664948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c3ede5f-a680-4b5c-993c-47581eb501ac tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:49.666017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2cb7dbd-edf7-4cdb-979e-67c6395c146e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:49.667077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2cb7dbd-edf7-4cdb-979e-67c6395c146e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:49.668235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2cb7dbd-edf7-4cdb-979e-67c6395c146e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:49.669175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2cb7dbd-edf7-4cdb-979e-67c6395c146e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:49.677724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c3ede5f-a680-4b5c-993c-47581eb501ac tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:49.677724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c3ede5f-a680-4b5c-993c-47581eb501ac tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:49.682163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c3ede5f-a680-4b5c-993c-47581eb501ac tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:49.683095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c3ede5f-a680-4b5c-993c-47581eb501ac tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:49.683992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c3ede5f-a680-4b5c-993c-47581eb501ac tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:49.684561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c3ede5f-a680-4b5c-993c-47581eb501ac tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:49.967586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c3ede5f-a680-4b5c-993c-47581eb501ac tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:49.979203 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c3ede5f-a680-4b5c-993c-47581eb501ac tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1469 microversion: 2.1 time: 0.319371 Aug 27 04:37:49.980050 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 874/1734] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:49 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1469 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:50.198065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a2cb7dbd-edf7-4cdb-979e-67c6395c146e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:50.206901 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a2cb7dbd-edf7-4cdb-979e-67c6395c146e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1477 microversion: 2.1 time: 0.564531 Aug 27 04:37:50.217041 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 861/1735] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:49 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1477 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:50.318146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf50a45f-10d9-4030-aeca-e5a9a15192b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:50.319276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf50a45f-10d9-4030-aeca-e5a9a15192b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:50.329839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf50a45f-10d9-4030-aeca-e5a9a15192b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:50.330552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf50a45f-10d9-4030-aeca-e5a9a15192b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:50.331176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf50a45f-10d9-4030-aeca-e5a9a15192b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:50.332073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf50a45f-10d9-4030-aeca-e5a9a15192b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:50.332558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf50a45f-10d9-4030-aeca-e5a9a15192b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:50.333002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf50a45f-10d9-4030-aeca-e5a9a15192b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:50.564513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-356a6dca-68cc-4ebd-9bd3-7bd648d506dd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:50.565583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-356a6dca-68cc-4ebd-9bd3-7bd648d506dd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:50.565857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bf50a45f-10d9-4030-aeca-e5a9a15192b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:50.577659 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf50a45f-10d9-4030-aeca-e5a9a15192b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1533 microversion: 2.1 time: 0.273672 Aug 27 04:37:50.578175 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 875/1736] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:50 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1533 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:50.581326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-356a6dca-68cc-4ebd-9bd3-7bd648d506dd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:50.581326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-356a6dca-68cc-4ebd-9bd3-7bd648d506dd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:50.581326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-356a6dca-68cc-4ebd-9bd3-7bd648d506dd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:50.581970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-356a6dca-68cc-4ebd-9bd3-7bd648d506dd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:50.583137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-356a6dca-68cc-4ebd-9bd3-7bd648d506dd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:50.585193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-356a6dca-68cc-4ebd-9bd3-7bd648d506dd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:51.002055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba823320-1b4e-45be-b545-455aaef9ef20 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:51.003284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba823320-1b4e-45be-b545-455aaef9ef20 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:51.014044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba823320-1b4e-45be-b545-455aaef9ef20 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:51.014929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba823320-1b4e-45be-b545-455aaef9ef20 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:51.015591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba823320-1b4e-45be-b545-455aaef9ef20 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:51.020850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba823320-1b4e-45be-b545-455aaef9ef20 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:51.021579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba823320-1b4e-45be-b545-455aaef9ef20 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:51.022234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba823320-1b4e-45be-b545-455aaef9ef20 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:51.038515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-356a6dca-68cc-4ebd-9bd3-7bd648d506dd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:51.055418 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-356a6dca-68cc-4ebd-9bd3-7bd648d506dd tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1505 microversion: 2.1 time: 0.500067 Aug 27 04:37:51.056700 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 862/1737] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:50 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:51.062071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-7cb81d60-5992-4ac4-9b21-0a2de9377cb7 req-638f1a1d-bb9e-4f85-bad8-47803063f327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9f7532-3523-4bb1-a4a2-94349c6d6987", "name": "network-vif-deleted", "tag": "4cb160f5-11d2-482c-a21f-4f0aea664bef"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:51.085797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7cb81d60-5992-4ac4-9b21-0a2de9377cb7 req-638f1a1d-bb9e-4f85-bad8-47803063f327 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:51.086286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7cb81d60-5992-4ac4-9b21-0a2de9377cb7 req-638f1a1d-bb9e-4f85-bad8-47803063f327 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:51.087540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7cb81d60-5992-4ac4-9b21-0a2de9377cb7 req-638f1a1d-bb9e-4f85-bad8-47803063f327 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:51.113170 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-7cb81d60-5992-4ac4-9b21-0a2de9377cb7 req-638f1a1d-bb9e-4f85-bad8-47803063f327 service nova] Creating event network-vif-deleted:4cb160f5-11d2-482c-a21f-4f0aea664bef for instance 3d9f7532-3523-4bb1-a4a2-94349c6d6987 on n-h2-854823-1 Aug 27 04:37:51.118633 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-7cb81d60-5992-4ac4-9b21-0a2de9377cb7 req-638f1a1d-bb9e-4f85-bad8-47803063f327 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060390 Aug 27 04:37:51.119894 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 863/1738] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:51.154522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba823320-1b4e-45be-b545-455aaef9ef20 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:51.175196 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba823320-1b4e-45be-b545-455aaef9ef20 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 200 len: 1427 microversion: 2.1 time: 0.177878 Aug 27 04:37:51.176621 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 876/1739] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:50 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 1427 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:51.236517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0ef4a80a-ebf7-4546-886a-6d545a8a0492 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:51.237669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0ef4a80a-ebf7-4546-886a-6d545a8a0492 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:51.252965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ef4a80a-ebf7-4546-886a-6d545a8a0492 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:51.254825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ef4a80a-ebf7-4546-886a-6d545a8a0492 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:51.255665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ef4a80a-ebf7-4546-886a-6d545a8a0492 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:51.259327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ef4a80a-ebf7-4546-886a-6d545a8a0492 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:51.261261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ef4a80a-ebf7-4546-886a-6d545a8a0492 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:51.265699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ef4a80a-ebf7-4546-886a-6d545a8a0492 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:51.598271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dba9d339-bdbb-454f-ba39-8d4095a6a00e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:51.599601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dba9d339-bdbb-454f-ba39-8d4095a6a00e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:51.614927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dba9d339-bdbb-454f-ba39-8d4095a6a00e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:51.615535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dba9d339-bdbb-454f-ba39-8d4095a6a00e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:51.616079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dba9d339-bdbb-454f-ba39-8d4095a6a00e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:51.616922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dba9d339-bdbb-454f-ba39-8d4095a6a00e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:51.617636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dba9d339-bdbb-454f-ba39-8d4095a6a00e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:51.618413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dba9d339-bdbb-454f-ba39-8d4095a6a00e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:51.831712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0ef4a80a-ebf7-4546-886a-6d545a8a0492 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:51.840355 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0ef4a80a-ebf7-4546-886a-6d545a8a0492 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1477 microversion: 2.1 time: 0.612361 Aug 27 04:37:51.850254 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 864/1740] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:51 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1477 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:51.961121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dba9d339-bdbb-454f-ba39-8d4095a6a00e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:51.971213 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dba9d339-bdbb-454f-ba39-8d4095a6a00e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1533 microversion: 2.1 time: 0.376842 Aug 27 04:37:51.976339 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 877/1741] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:51 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1533 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:52.080242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6bd10591-b9d8-49e8-b33e-1e9f7335298f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:52.080882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6bd10591-b9d8-49e8-b33e-1e9f7335298f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:52.115198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bd10591-b9d8-49e8-b33e-1e9f7335298f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:52.115778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bd10591-b9d8-49e8-b33e-1e9f7335298f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:52.116251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bd10591-b9d8-49e8-b33e-1e9f7335298f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:52.117002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bd10591-b9d8-49e8-b33e-1e9f7335298f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:52.120658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bd10591-b9d8-49e8-b33e-1e9f7335298f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:52.122723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bd10591-b9d8-49e8-b33e-1e9f7335298f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:52.201052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4bbeb489-43d1-4a5a-a4fb-5b148bf0c0aa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:52.201631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4bbeb489-43d1-4a5a-a4fb-5b148bf0c0aa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 3d9f7532-3523-4bb1-a4a2-94349c6d6987] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:52.215760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bbeb489-43d1-4a5a-a4fb-5b148bf0c0aa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:52.216264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bbeb489-43d1-4a5a-a4fb-5b148bf0c0aa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:52.216822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bbeb489-43d1-4a5a-a4fb-5b148bf0c0aa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:52.218540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bbeb489-43d1-4a5a-a4fb-5b148bf0c0aa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:52.220567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bbeb489-43d1-4a5a-a4fb-5b148bf0c0aa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:52.223303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bbeb489-43d1-4a5a-a4fb-5b148bf0c0aa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:52.245611 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4bbeb489-43d1-4a5a-a4fb-5b148bf0c0aa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] HTTP exception thrown: Instance 3d9f7532-3523-4bb1-a4a2-94349c6d6987 could not be found. Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4bbeb489-43d1-4a5a-a4fb-5b148bf0c0aa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Request method failure captured: Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 HTTP/1.1 Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ8O559C0M8nIm3Rkl-q_blAaFzgbnkgJzCbEJNcLMAv-nVi8lRFTGXv_ujKg4kEV0S1Nzs_CndRRfjMsFW8kAgB0VcLB-M0v1VDW9xZqsc5XIimDT9Zm4nt_PwWorfPUKRJmiVmYfUftoklGmNOnG2ejRdXxmo_H83qm7-9t0N0I34 Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 3873cb4810d840ac93518952196fd52b Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersAdminTestJSON-958669010 Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:37:52.247151 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:37:52.248893 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3873cb4810d840ac93518952196fd52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3873cb4810d840ac93518952196fd52b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3873cb4810d840ac93518952196fd52b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3873cb4810d840ac93518952196fd52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:52.248893 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersAdminTestJSON-958669010 Aug 27 04:37:52.248893 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 3873cb4810d840ac93518952196fd52b Aug 27 04:37:52.248893 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersAdminTestJSON-958669010 Aug 27 04:37:52.248893 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersAdminTestJSON-958669010-project Aug 27 04:37:52.248893 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:37:52.248893 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:37:52.248893 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 23eec6b7eb8b4ad897873c027e095b8d Aug 27 04:37:52.248893 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersAdminTestJSON-958669010-project Aug 27 04:37:52.248893 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:37:52.248893 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 3d9f7532-3523-4bb1-a4a2-94349c6d6987 could not be found. Aug 27 04:37:52.248893 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '3d9f7532-3523-4bb1-a4a2-94349c6d6987'} Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9f7532-3523-4bb1-a4a2-94349c6d6987 could not be found. Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:52.250087 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9f7532-3523-4bb1-a4a2-94349c6d6987 could not be found. Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9f7532-3523-4bb1-a4a2-94349c6d6987 could not be found. Aug 27 04:37:52.251707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:52.253125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4bbeb489-43d1-4a5a-a4fb-5b148bf0c0aa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Returning 404 to user: Instance 3d9f7532-3523-4bb1-a4a2-94349c6d6987 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:52.253125 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4bbeb489-43d1-4a5a-a4fb-5b148bf0c0aa tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987" status: 404 len: 111 microversion: 2.1 time: 0.052132 Aug 27 04:37:52.254910 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 878/1742] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:52 2022] GET /compute/v2.1/servers/3d9f7532-3523-4bb1-a4a2-94349c6d6987 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:37:52.267736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a7e61f2-534c-4d9e-a935-22168fbbefe8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:52.279137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a7e61f2-534c-4d9e-a935-22168fbbefe8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:52.291285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7e61f2-534c-4d9e-a935-22168fbbefe8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:52.301435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7e61f2-534c-4d9e-a935-22168fbbefe8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:52.301807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7e61f2-534c-4d9e-a935-22168fbbefe8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:52.302552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7e61f2-534c-4d9e-a935-22168fbbefe8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:52.303015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7e61f2-534c-4d9e-a935-22168fbbefe8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:52.303446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7e61f2-534c-4d9e-a935-22168fbbefe8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:52.355687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a7e61f2-534c-4d9e-a935-22168fbbefe8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:37:52.528365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6bd10591-b9d8-49e8-b33e-1e9f7335298f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:52.549395 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6bd10591-b9d8-49e8-b33e-1e9f7335298f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1505 microversion: 2.1 time: 0.474336 Aug 27 04:37:52.557611 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 865/1743] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:52 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:52.574438 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a7e61f2-534c-4d9e-a935-22168fbbefe8 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "DELETE /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 204 len: 0 microversion: 2.1 time: 0.312242 Aug 27 04:37:52.575604 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 879/1744] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:37:52 2022] DELETE /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:52.588338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-487b2789-2445-48c8-a7a1-2c9384b13390 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:52.589772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-487b2789-2445-48c8-a7a1-2c9384b13390 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:52.604736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-487b2789-2445-48c8-a7a1-2c9384b13390 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:52.605260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-487b2789-2445-48c8-a7a1-2c9384b13390 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:52.605705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-487b2789-2445-48c8-a7a1-2c9384b13390 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:52.606464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-487b2789-2445-48c8-a7a1-2c9384b13390 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:52.610612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-487b2789-2445-48c8-a7a1-2c9384b13390 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:52.611086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-487b2789-2445-48c8-a7a1-2c9384b13390 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:52.649131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:52.866645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f970b235-e08a-4c84-8afa-ab5dc4fb7b62 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:52.868004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f970b235-e08a-4c84-8afa-ab5dc4fb7b62 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:52.882987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f970b235-e08a-4c84-8afa-ab5dc4fb7b62 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:52.882987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f970b235-e08a-4c84-8afa-ab5dc4fb7b62 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:52.883829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f970b235-e08a-4c84-8afa-ab5dc4fb7b62 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:52.885218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f970b235-e08a-4c84-8afa-ab5dc4fb7b62 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:52.886744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f970b235-e08a-4c84-8afa-ab5dc4fb7b62 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:52.887475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f970b235-e08a-4c84-8afa-ab5dc4fb7b62 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:52.910909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-487b2789-2445-48c8-a7a1-2c9384b13390 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:52.925627 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-487b2789-2445-48c8-a7a1-2c9384b13390 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1469 microversion: 2.1 time: 0.343674 Aug 27 04:37:52.927534 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 866/1745] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:52 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1469 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:52.998109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bd62c975-905c-40e7-adc0-d2722f5244a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:52.999807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bd62c975-905c-40e7-adc0-d2722f5244a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:53.006511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd62c975-905c-40e7-adc0-d2722f5244a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:53.008179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd62c975-905c-40e7-adc0-d2722f5244a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:53.008834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd62c975-905c-40e7-adc0-d2722f5244a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:53.009715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd62c975-905c-40e7-adc0-d2722f5244a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:53.010328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd62c975-905c-40e7-adc0-d2722f5244a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:53.010915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd62c975-905c-40e7-adc0-d2722f5244a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:53.175974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f970b235-e08a-4c84-8afa-ab5dc4fb7b62 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:53.184418 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f970b235-e08a-4c84-8afa-ab5dc4fb7b62 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1477 microversion: 2.1 time: 0.321998 Aug 27 04:37:53.189285 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 880/1746] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:52 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1477 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:53.380010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bd62c975-905c-40e7-adc0-d2722f5244a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:53.396271 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bd62c975-905c-40e7-adc0-d2722f5244a3 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1539 microversion: 2.1 time: 0.400615 Aug 27 04:37:53.397755 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 867/1747] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:52 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1539 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:53.579974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c55111e-9193-4f87-9664-c815b7a470ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:53.580631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c55111e-9193-4f87-9664-c815b7a470ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:53.591545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c55111e-9193-4f87-9664-c815b7a470ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:53.592229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c55111e-9193-4f87-9664-c815b7a470ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:53.592506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c55111e-9193-4f87-9664-c815b7a470ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:53.595934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c55111e-9193-4f87-9664-c815b7a470ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:53.597648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c55111e-9193-4f87-9664-c815b7a470ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:53.598737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c55111e-9193-4f87-9664-c815b7a470ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:53.662230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-891bb611-89e7-4406-bb29-31f351e16500 req-b911767b-5102-4fe0-8fcf-0017d1675d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c35fba-1273-4d50-9b92-f96b93bb1295", "name": "network-vif-plugged", "status": "completed", "tag": "0e539f18-246d-462f-9c29-7eff0c12d3dd"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:53.679150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-891bb611-89e7-4406-bb29-31f351e16500 req-b911767b-5102-4fe0-8fcf-0017d1675d55 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:53.685497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-891bb611-89e7-4406-bb29-31f351e16500 req-b911767b-5102-4fe0-8fcf-0017d1675d55 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:53.685831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-891bb611-89e7-4406-bb29-31f351e16500 req-b911767b-5102-4fe0-8fcf-0017d1675d55 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:53.707731 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-891bb611-89e7-4406-bb29-31f351e16500 req-b911767b-5102-4fe0-8fcf-0017d1675d55 service nova] Creating event network-vif-plugged:0e539f18-246d-462f-9c29-7eff0c12d3dd for instance b2c35fba-1273-4d50-9b92-f96b93bb1295 on n-h1-854823-1 Aug 27 04:37:53.715255 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-891bb611-89e7-4406-bb29-31f351e16500 req-b911767b-5102-4fe0-8fcf-0017d1675d55 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056609 Aug 27 04:37:53.716295 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 868/1748] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:53.950339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-35074f87-386a-4d74-8ba9-4ac418781dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:53.954357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-35074f87-386a-4d74-8ba9-4ac418781dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:53.963825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c55111e-9193-4f87-9664-c815b7a470ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:53.965666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35074f87-386a-4d74-8ba9-4ac418781dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:53.966414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35074f87-386a-4d74-8ba9-4ac418781dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:53.969364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35074f87-386a-4d74-8ba9-4ac418781dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:53.970356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35074f87-386a-4d74-8ba9-4ac418781dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:53.970985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35074f87-386a-4d74-8ba9-4ac418781dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:53.971603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35074f87-386a-4d74-8ba9-4ac418781dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:53.984293 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c55111e-9193-4f87-9664-c815b7a470ba tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1505 microversion: 2.1 time: 0.404263 Aug 27 04:37:53.986111 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 881/1749] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:53 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:54.214614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1d87c3a-0270-4a52-a558-5ffcf6e58495 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:54.215746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c1d87c3a-0270-4a52-a558-5ffcf6e58495 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:54.229691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1d87c3a-0270-4a52-a558-5ffcf6e58495 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:54.231582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1d87c3a-0270-4a52-a558-5ffcf6e58495 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:54.233098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1d87c3a-0270-4a52-a558-5ffcf6e58495 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:54.243892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1d87c3a-0270-4a52-a558-5ffcf6e58495 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:54.244862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1d87c3a-0270-4a52-a558-5ffcf6e58495 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:54.245800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1d87c3a-0270-4a52-a558-5ffcf6e58495 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:54.250660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-35074f87-386a-4d74-8ba9-4ac418781dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:54.264419 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-35074f87-386a-4d74-8ba9-4ac418781dad tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1469 microversion: 2.1 time: 0.316302 Aug 27 04:37:54.266258 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 869/1750] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:53 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1469 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:54.419512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e17535fb-ae18-4ab6-958f-3cc7bdf06c29 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:54.420226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e17535fb-ae18-4ab6-958f-3cc7bdf06c29 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:54.433589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e17535fb-ae18-4ab6-958f-3cc7bdf06c29 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:54.434389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e17535fb-ae18-4ab6-958f-3cc7bdf06c29 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:54.438289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e17535fb-ae18-4ab6-958f-3cc7bdf06c29 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:54.439086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e17535fb-ae18-4ab6-958f-3cc7bdf06c29 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:54.439566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e17535fb-ae18-4ab6-958f-3cc7bdf06c29 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:54.440010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e17535fb-ae18-4ab6-958f-3cc7bdf06c29 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:54.673294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e17535fb-ae18-4ab6-958f-3cc7bdf06c29 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:54.687067 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e17535fb-ae18-4ab6-958f-3cc7bdf06c29 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1539 microversion: 2.1 time: 0.271664 Aug 27 04:37:54.705578 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 870/1751] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:54 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1539 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:54.718208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c1d87c3a-0270-4a52-a558-5ffcf6e58495 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:54.726672 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c1d87c3a-0270-4a52-a558-5ffcf6e58495 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1477 microversion: 2.1 time: 0.519444 Aug 27 04:37:54.740175 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 882/1752] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:54 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1477 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:54.958743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8a601f42-1aee-4429-8971-3d9978b386d5 req-8cf477d3-8a80-4b7d-b3b1-3de33dea7adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577250c7-f1ee-4541-b83e-131d0e21efea", "name": "network-vif-deleted", "tag": "d4d0324a-726b-4962-b7dd-c7fd914520fe"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:54.979585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8a601f42-1aee-4429-8971-3d9978b386d5 req-8cf477d3-8a80-4b7d-b3b1-3de33dea7adf service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:54.980069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8a601f42-1aee-4429-8971-3d9978b386d5 req-8cf477d3-8a80-4b7d-b3b1-3de33dea7adf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:54.980499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8a601f42-1aee-4429-8971-3d9978b386d5 req-8cf477d3-8a80-4b7d-b3b1-3de33dea7adf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:55.005215 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8a601f42-1aee-4429-8971-3d9978b386d5 req-8cf477d3-8a80-4b7d-b3b1-3de33dea7adf service nova] Creating event network-vif-deleted:d4d0324a-726b-4962-b7dd-c7fd914520fe for instance 577250c7-f1ee-4541-b83e-131d0e21efea on n-h2-854823-1 Aug 27 04:37:55.009254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe3501e6-e4ae-4cdc-82de-ab7f20f045da tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:55.010443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe3501e6-e4ae-4cdc-82de-ab7f20f045da tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:55.018486 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8a601f42-1aee-4429-8971-3d9978b386d5 req-8cf477d3-8a80-4b7d-b3b1-3de33dea7adf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064246 Aug 27 04:37:55.019108 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 871/1753] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:37:55.020134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe3501e6-e4ae-4cdc-82de-ab7f20f045da tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:55.020992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe3501e6-e4ae-4cdc-82de-ab7f20f045da tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:55.022170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe3501e6-e4ae-4cdc-82de-ab7f20f045da tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:55.023491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe3501e6-e4ae-4cdc-82de-ab7f20f045da tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:55.024861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe3501e6-e4ae-4cdc-82de-ab7f20f045da tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:55.025535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe3501e6-e4ae-4cdc-82de-ab7f20f045da tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:55.295124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e6d2fcf4-677c-454c-a283-5b3d0c848dd3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:55.296720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e6d2fcf4-677c-454c-a283-5b3d0c848dd3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:55.303255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:55.305065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6d2fcf4-677c-454c-a283-5b3d0c848dd3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:55.306021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6d2fcf4-677c-454c-a283-5b3d0c848dd3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:55.306706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6d2fcf4-677c-454c-a283-5b3d0c848dd3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:55.308724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6d2fcf4-677c-454c-a283-5b3d0c848dd3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:55.309534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6d2fcf4-677c-454c-a283-5b3d0c848dd3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:55.310310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6d2fcf4-677c-454c-a283-5b3d0c848dd3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:55.387983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6d2fcf4-677c-454c-a283-5b3d0c848dd3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:55.388481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6d2fcf4-677c-454c-a283-5b3d0c848dd3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:55.390129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6d2fcf4-677c-454c-a283-5b3d0c848dd3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:55.391176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-e6d2fcf4-677c-454c-a283-5b3d0c848dd3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lazy-loading 'fault' on Instance uuid 577250c7-f1ee-4541-b83e-131d0e21efea {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:37:55.444327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe3501e6-e4ae-4cdc-82de-ab7f20f045da tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:55.452298 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe3501e6-e4ae-4cdc-82de-ab7f20f045da tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1500 microversion: 2.1 time: 0.448691 Aug 27 04:37:55.452898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e6d2fcf4-677c-454c-a283-5b3d0c848dd3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23eec6b7eb8b4ad897873c027e095b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3873cb4810d840ac93518952196fd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:55.453400 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 883/1754] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:55 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1500 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:55.472684 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e6d2fcf4-677c-454c-a283-5b3d0c848dd3 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 200 len: 1304 microversion: 2.1 time: 0.189442 Aug 27 04:37:55.485390 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 872/1755] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:55 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 1304 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:55.714466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdfb9061-4333-4265-ab57-d6c5741aaf01 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:55.715089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bdfb9061-4333-4265-ab57-d6c5741aaf01 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:55.721900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdfb9061-4333-4265-ab57-d6c5741aaf01 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:55.722411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdfb9061-4333-4265-ab57-d6c5741aaf01 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:55.723067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdfb9061-4333-4265-ab57-d6c5741aaf01 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:55.724228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdfb9061-4333-4265-ab57-d6c5741aaf01 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:55.725105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdfb9061-4333-4265-ab57-d6c5741aaf01 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:55.725740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdfb9061-4333-4265-ab57-d6c5741aaf01 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:55.733736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-09d580b4-594f-42cd-89c7-9eb517ccb8f1 req-5118c3f4-b831-444b-b0f2-cc6d35d1a296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bbe5194-aa1d-4db9-aec2-044d247df93a", "name": "network-vif-plugged", "status": "completed", "tag": "63c68b66-1b81-4c26-befb-1e1ff3daa600"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:55.746081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-09d580b4-594f-42cd-89c7-9eb517ccb8f1 req-5118c3f4-b831-444b-b0f2-cc6d35d1a296 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:55.747432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-09d580b4-594f-42cd-89c7-9eb517ccb8f1 req-5118c3f4-b831-444b-b0f2-cc6d35d1a296 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:55.748148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-09d580b4-594f-42cd-89c7-9eb517ccb8f1 req-5118c3f4-b831-444b-b0f2-cc6d35d1a296 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:55.771116 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-09d580b4-594f-42cd-89c7-9eb517ccb8f1 req-5118c3f4-b831-444b-b0f2-cc6d35d1a296 service nova] Creating event network-vif-plugged:63c68b66-1b81-4c26-befb-1e1ff3daa600 for instance 3bbe5194-aa1d-4db9-aec2-044d247df93a on n-h1-854823-1 Aug 27 04:37:55.777208 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-09d580b4-594f-42cd-89c7-9eb517ccb8f1 req-5118c3f4-b831-444b-b0f2-cc6d35d1a296 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047431 Aug 27 04:37:55.778479 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 873/1756] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:55.785520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e1814394-5759-4f27-8f0d-74505a48e878 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:55.786311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e1814394-5759-4f27-8f0d-74505a48e878 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:55.792849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1814394-5759-4f27-8f0d-74505a48e878 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:55.793641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1814394-5759-4f27-8f0d-74505a48e878 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:55.794308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1814394-5759-4f27-8f0d-74505a48e878 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:55.795257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1814394-5759-4f27-8f0d-74505a48e878 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:55.796471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1814394-5759-4f27-8f0d-74505a48e878 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:55.797164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1814394-5759-4f27-8f0d-74505a48e878 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:56.010467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e1814394-5759-4f27-8f0d-74505a48e878 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:56.030654 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e1814394-5759-4f27-8f0d-74505a48e878 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1477 microversion: 2.1 time: 0.250564 Aug 27 04:37:56.031254 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 874/1757] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:55 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1477 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:56.101568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdfb9061-4333-4265-ab57-d6c5741aaf01 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:56.112896 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdfb9061-4333-4265-ab57-d6c5741aaf01 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1539 microversion: 2.1 time: 0.402189 Aug 27 04:37:56.113863 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 884/1758] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:55 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1539 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:56.475197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-640f479d-38c6-4966-8b05-7ca0dd6e5b34 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:56.476058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-640f479d-38c6-4966-8b05-7ca0dd6e5b34 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:56.483115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-640f479d-38c6-4966-8b05-7ca0dd6e5b34 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:56.483612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-640f479d-38c6-4966-8b05-7ca0dd6e5b34 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:56.484058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-640f479d-38c6-4966-8b05-7ca0dd6e5b34 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:56.485029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-640f479d-38c6-4966-8b05-7ca0dd6e5b34 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:56.485658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-640f479d-38c6-4966-8b05-7ca0dd6e5b34 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:56.486254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-640f479d-38c6-4966-8b05-7ca0dd6e5b34 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:56.496103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-87ec7c5f-5fb4-4222-9c49-8098c8881330 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:56.496782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-87ec7c5f-5fb4-4222-9c49-8098c8881330 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] [instance: 577250c7-f1ee-4541-b83e-131d0e21efea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:56.504990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87ec7c5f-5fb4-4222-9c49-8098c8881330 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:56.505771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87ec7c5f-5fb4-4222-9c49-8098c8881330 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:56.506754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87ec7c5f-5fb4-4222-9c49-8098c8881330 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:56.507640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87ec7c5f-5fb4-4222-9c49-8098c8881330 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:56.508122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87ec7c5f-5fb4-4222-9c49-8098c8881330 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:56.508854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87ec7c5f-5fb4-4222-9c49-8098c8881330 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:56.526339 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-87ec7c5f-5fb4-4222-9c49-8098c8881330 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] HTTP exception thrown: Instance 577250c7-f1ee-4541-b83e-131d0e21efea could not be found. Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-87ec7c5f-5fb4-4222-9c49-8098c8881330 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Request method failure captured: Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea HTTP/1.1 Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ8O559C0M8nIm3Rkl-q_blAaFzgbnkgJzCbEJNcLMAv-nVi8lRFTGXv_ujKg4kEV0S1Nzs_CndRRfjMsFW8kAgB0VcLB-M0v1VDW9xZqsc5XIimDT9Zm4nt_PwWorfPUKRJmiVmYfUftoklGmNOnG2ejRdXxmo_H83qm7-9t0N0I34 Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 3873cb4810d840ac93518952196fd52b Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersAdminTestJSON-958669010 Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:37:56.528294 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:37:56.530550 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3873cb4810d840ac93518952196fd52b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3873cb4810d840ac93518952196fd52b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3873cb4810d840ac93518952196fd52b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3873cb4810d840ac93518952196fd52b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:56.530550 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersAdminTestJSON-958669010 Aug 27 04:37:56.530550 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 3873cb4810d840ac93518952196fd52b Aug 27 04:37:56.530550 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersAdminTestJSON-958669010 Aug 27 04:37:56.530550 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersAdminTestJSON-958669010-project Aug 27 04:37:56.530550 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:37:56.530550 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:37:56.530550 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 23eec6b7eb8b4ad897873c027e095b8d Aug 27 04:37:56.530550 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersAdminTestJSON-958669010-project Aug 27 04:37:56.530550 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:37:56.530550 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 577250c7-f1ee-4541-b83e-131d0e21efea could not be found. Aug 27 04:37:56.530550 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '577250c7-f1ee-4541-b83e-131d0e21efea'} Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 577250c7-f1ee-4541-b83e-131d0e21efea could not be found. Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:56.531548 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 577250c7-f1ee-4541-b83e-131d0e21efea could not be found. Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 577250c7-f1ee-4541-b83e-131d0e21efea could not be found. Aug 27 04:37:56.533142 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:56.545040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-87ec7c5f-5fb4-4222-9c49-8098c8881330 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] Returning 404 to user: Instance 577250c7-f1ee-4541-b83e-131d0e21efea could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:56.546963 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-87ec7c5f-5fb4-4222-9c49-8098c8881330 tempest-ServersAdminTestJSON-958669010 tempest-ServersAdminTestJSON-958669010-project] 10.222.0.79 "GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea" status: 404 len: 111 microversion: 2.1 time: 0.055656 Aug 27 04:37:56.552852 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 885/1759] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:56 2022] GET /compute/v2.1/servers/577250c7-f1ee-4541-b83e-131d0e21efea => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:37:56.656886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-640f479d-38c6-4966-8b05-7ca0dd6e5b34 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:56.667767 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-640f479d-38c6-4966-8b05-7ca0dd6e5b34 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1487 microversion: 2.1 time: 0.196419 Aug 27 04:37:56.668679 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 875/1760] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:56 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1487 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:56.692460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-001de809-dc34-45af-9bd9-8daad9a6d442 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:56.693438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-001de809-dc34-45af-9bd9-8daad9a6d442 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:56.700835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-001de809-dc34-45af-9bd9-8daad9a6d442 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:56.701606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-001de809-dc34-45af-9bd9-8daad9a6d442 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:56.702765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-001de809-dc34-45af-9bd9-8daad9a6d442 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:56.703657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-001de809-dc34-45af-9bd9-8daad9a6d442 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:56.704290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-001de809-dc34-45af-9bd9-8daad9a6d442 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:56.704930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-001de809-dc34-45af-9bd9-8daad9a6d442 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:56.773592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-001de809-dc34-45af-9bd9-8daad9a6d442 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:37:56.937418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f6604bf3-4bb7-4162-aa7d-bf92ae56c261 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:56.938644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f6604bf3-4bb7-4162-aa7d-bf92ae56c261 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:56.946619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:56.958001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6604bf3-4bb7-4162-aa7d-bf92ae56c261 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:56.959522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6604bf3-4bb7-4162-aa7d-bf92ae56c261 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:56.960167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6604bf3-4bb7-4162-aa7d-bf92ae56c261 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:56.961559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6604bf3-4bb7-4162-aa7d-bf92ae56c261 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:56.963077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6604bf3-4bb7-4162-aa7d-bf92ae56c261 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:56.964030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6604bf3-4bb7-4162-aa7d-bf92ae56c261 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:57.033954 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-001de809-dc34-45af-9bd9-8daad9a6d442 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 204 len: 0 microversion: 2.1 time: 0.345765 Aug 27 04:37:57.036400 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 886/1761] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:37:56 2022] DELETE /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:57.052203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9fcee18e-ad64-4f7b-ac3a-f2acd53b983f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f22073280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:57.129522 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9fcee18e-ad64-4f7b-ac3a-f2acd53b983f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] HTTP exception thrown: Image not found. Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9fcee18e-ad64-4f7b-ac3a-f2acd53b983f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Request method failure captured: Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/images/c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283 HTTP/1.1 Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ7QAK8ZHwjwpIbL1xIl9WfxQp4GVSA65O5iuZ0hlcZ4WGq08KgIhZUUUReVd1eSmKoiiVBis1FWK-SjVd21Fiu9YXRbMJS2wgKDE6Fw2e-gQ_hQ3t2dli8G3vBgi2XrVmYgv_BOxxihOGYVOY1eflDpehZm2M2-N7WjE41u3O_YmnA Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:37:57.131872 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:37:57.134107 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b207b502d846718f9d72f62d1d034c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:37:57.134107 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesTestJSON-465316353 Aug 27 04:37:57.134107 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:37:57.134107 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:37:57.134107 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesTestJSON-465316353-project Aug 27 04:37:57.134107 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:37:57.134107 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:37:57.134107 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: daa3b03c362d4032bd17ebfeccdcdb83 Aug 27 04:37:57.134107 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesTestJSON-465316353-project Aug 27 04:37:57.134107 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:37:57.134107 n-d-854823-1 devstack@n-api.service[128869]: exception: Image not found. Aug 27 04:37:57.134107 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283'} Aug 27 04:37:57.134107 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:57.134107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283 to delete Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:57.138350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283 could not be found. Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:57.140484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9fcee18e-ad64-4f7b-ac3a-f2acd53b983f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9fcee18e-ad64-4f7b-ac3a-f2acd53b983f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/images/c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283" status: 404 len: 62 microversion: 2.1 time: 0.085507 Aug 27 04:37:57.142234 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 887/1762] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:57 2022] DELETE /compute/v2.1/images/c8f4b3aa-6ca9-43fc-916b-bdd5b2d7d283 => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:37:57.147943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c42873f-35eb-4dfc-953c-cf497aae4951 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:57.148714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c42873f-35eb-4dfc-953c-cf497aae4951 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:57.165931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c42873f-35eb-4dfc-953c-cf497aae4951 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:57.166446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c42873f-35eb-4dfc-953c-cf497aae4951 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:57.167096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c42873f-35eb-4dfc-953c-cf497aae4951 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:57.167830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c42873f-35eb-4dfc-953c-cf497aae4951 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:57.172046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c42873f-35eb-4dfc-953c-cf497aae4951 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:57.172587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c42873f-35eb-4dfc-953c-cf497aae4951 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:57.229059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:57.288908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-f6604bf3-4bb7-4162-aa7d-bf92ae56c261 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 516299cc-c878-4b8e-bb4d-4247ddbd90cf {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:37:57.313683 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f6604bf3-4bb7-4162-aa7d-bf92ae56c261 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 2425 microversion: 2.25 time: 0.381019 Aug 27 04:37:57.316509 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 876/1763] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:37:56 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 2425 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:37:57.329650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9c2110a0-4851-4cd3-9524-4cfa209dcb39 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:57.331861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9c2110a0-4851-4cd3-9524-4cfa209dcb39 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:57.342556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c2110a0-4851-4cd3-9524-4cfa209dcb39 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:57.343373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c2110a0-4851-4cd3-9524-4cfa209dcb39 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:57.344053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c2110a0-4851-4cd3-9524-4cfa209dcb39 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:57.345032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c2110a0-4851-4cd3-9524-4cfa209dcb39 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:57.345717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c2110a0-4851-4cd3-9524-4cfa209dcb39 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:57.346371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c2110a0-4851-4cd3-9524-4cfa209dcb39 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:57.573320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9c2110a0-4851-4cd3-9524-4cfa209dcb39 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:57.587808 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9c2110a0-4851-4cd3-9524-4cfa209dcb39 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1539 microversion: 2.1 time: 0.267792 Aug 27 04:37:57.589348 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 877/1764] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:57 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1539 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:57.599523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-01ac37f3-608f-4374-ab58-17017b0404b0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:57.602085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-01ac37f3-608f-4374-ab58-17017b0404b0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:57.613822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c42873f-35eb-4dfc-953c-cf497aae4951 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:57.614012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01ac37f3-608f-4374-ab58-17017b0404b0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:57.614486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01ac37f3-608f-4374-ab58-17017b0404b0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:57.614997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01ac37f3-608f-4374-ab58-17017b0404b0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:57.615808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01ac37f3-608f-4374-ab58-17017b0404b0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:57.616884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01ac37f3-608f-4374-ab58-17017b0404b0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:57.617095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01ac37f3-608f-4374-ab58-17017b0404b0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:57.630277 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c42873f-35eb-4dfc-953c-cf497aae4951 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1477 microversion: 2.1 time: 0.492508 Aug 27 04:37:57.632140 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 888/1765] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:57 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1477 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:57.640107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55a21295-1704-4b83-8191-6e2c8ce29896 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854823-1", "block_migration": "auto"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:57.645128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55a21295-1704-4b83-8191-6e2c8ce29896 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:57.654456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55a21295-1704-4b83-8191-6e2c8ce29896 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:57.655826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55a21295-1704-4b83-8191-6e2c8ce29896 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:57.656458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55a21295-1704-4b83-8191-6e2c8ce29896 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:57.657993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55a21295-1704-4b83-8191-6e2c8ce29896 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:57.658624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55a21295-1704-4b83-8191-6e2c8ce29896 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:57.659253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55a21295-1704-4b83-8191-6e2c8ce29896 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:57.675407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-01ac37f3-608f-4374-ab58-17017b0404b0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:37:57.699913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-55a21295-1704-4b83-8191-6e2c8ce29896 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'flavor' on Instance uuid 516299cc-c878-4b8e-bb4d-4247ddbd90cf {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:37:57.716117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55a21295-1704-4b83-8191-6e2c8ce29896 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Going to try to live migrate instance to n-h2-854823-1 {{(pid=128869) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:37:57.744352 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.compute.api [None req-01ac37f3-608f-4374-ab58-17017b0404b0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Instance is already in deleting state, ignoring this request Aug 27 04:37:57.745336 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-01ac37f3-608f-4374-ab58-17017b0404b0 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 204 len: 0 microversion: 2.1 time: 0.154825 Aug 27 04:37:57.746249 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 878/1766] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:37:57 2022] DELETE /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:57.758391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c33e7d54-dc81-4cf8-8b34-5ad1a829312d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:57.759383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c33e7d54-dc81-4cf8-8b34-5ad1a829312d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:57.767315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c33e7d54-dc81-4cf8-8b34-5ad1a829312d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:57.769267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c33e7d54-dc81-4cf8-8b34-5ad1a829312d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:57.769267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c33e7d54-dc81-4cf8-8b34-5ad1a829312d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:57.769267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c33e7d54-dc81-4cf8-8b34-5ad1a829312d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:57.771979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c33e7d54-dc81-4cf8-8b34-5ad1a829312d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:57.771979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c33e7d54-dc81-4cf8-8b34-5ad1a829312d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:57.994762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c33e7d54-dc81-4cf8-8b34-5ad1a829312d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:58.009148 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c33e7d54-dc81-4cf8-8b34-5ad1a829312d tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1493 microversion: 2.1 time: 0.256869 Aug 27 04:37:58.010269 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 879/1767] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:57 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1493 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:58.095885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ccf8fa66-9386-470f-b22f-3c72abdb105a tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Calling method '.version_select at 0x7f1f21636430>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:58.177627 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ccf8fa66-9386-470f-b22f-3c72abdb105a tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "GET /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1" status: 200 len: 636 microversion: 2.1 time: 0.086091 Aug 27 04:37:58.178217 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 880/1768] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:37:58 2022] GET /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1 => generated 636 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:58.196645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3d5e0c2b-5b6b-4f5f-837b-c59b8916d4cc tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Action: 'update_all', calling method: .version_select at 0x7f1f2162c790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:58.271037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3d5e0c2b-5b6b-4f5f-837b-c59b8916d4cc tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:37:58.277494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3d5e0c2b-5b6b-4f5f-837b-c59b8916d4cc tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for user 4b8b790db1f041ad8d046679f5beb9c1 and project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:37:58.669017 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3d5e0c2b-5b6b-4f5f-837b-c59b8916d4cc tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.477843 Aug 27 04:37:58.669799 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 881/1769] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:37:58 2022] PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata => generated 61 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:37:58.675996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7b4280a4-0820-4f16-a77c-70e8a47b7797 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:58.677278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7b4280a4-0820-4f16-a77c-70e8a47b7797 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:58.683901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b4280a4-0820-4f16-a77c-70e8a47b7797 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:58.684698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b4280a4-0820-4f16-a77c-70e8a47b7797 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:58.685317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b4280a4-0820-4f16-a77c-70e8a47b7797 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:58.686763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b4280a4-0820-4f16-a77c-70e8a47b7797 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:58.687396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b4280a4-0820-4f16-a77c-70e8a47b7797 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:58.687876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b4280a4-0820-4f16-a77c-70e8a47b7797 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:58.867819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b4280a4-0820-4f16-a77c-70e8a47b7797 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:58.879731 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7b4280a4-0820-4f16-a77c-70e8a47b7797 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1539 microversion: 2.1 time: 0.207611 Aug 27 04:37:58.900978 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 882/1770] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:58 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1539 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:58.907340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b2e9bc2d-f744-4c23-bc34-b857089da2f3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:58.907961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b2e9bc2d-f744-4c23-bc34-b857089da2f3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:58.915347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2e9bc2d-f744-4c23-bc34-b857089da2f3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:58.916274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2e9bc2d-f744-4c23-bc34-b857089da2f3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:58.916938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2e9bc2d-f744-4c23-bc34-b857089da2f3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:58.917854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2e9bc2d-f744-4c23-bc34-b857089da2f3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:58.918540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2e9bc2d-f744-4c23-bc34-b857089da2f3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:58.919132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2e9bc2d-f744-4c23-bc34-b857089da2f3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:59.093903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b2e9bc2d-f744-4c23-bc34-b857089da2f3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:59.103543 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b2e9bc2d-f744-4c23-bc34-b857089da2f3 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1477 microversion: 2.1 time: 0.201241 Aug 27 04:37:59.104780 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 883/1771] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:58 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1477 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:59.112753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c641abde-88dd-47cf-a67c-9162bb7d9be5 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Calling method '.version_select at 0x7f1f215f5280>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:59.424218 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c641abde-88dd-47cf-a67c-9162bb7d9be5 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "DELETE /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.317733 Aug 27 04:37:59.424821 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 884/1772] 10.222.0.79 () {58 vars in 1296 bytes} [Sat Aug 27 04:37:59 2022] DELETE /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata/os_version => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:59.433111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ea60639a-a8d2-4906-8b49-b6352a38845e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:59.433938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ea60639a-a8d2-4906-8b49-b6352a38845e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:59.443924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea60639a-a8d2-4906-8b49-b6352a38845e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:59.444832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea60639a-a8d2-4906-8b49-b6352a38845e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:59.445427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea60639a-a8d2-4906-8b49-b6352a38845e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:59.446327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea60639a-a8d2-4906-8b49-b6352a38845e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:59.448225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea60639a-a8d2-4906-8b49-b6352a38845e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:59.449036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea60639a-a8d2-4906-8b49-b6352a38845e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:59.647741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ea60639a-a8d2-4906-8b49-b6352a38845e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:59.658718 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ea60639a-a8d2-4906-8b49-b6352a38845e tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1493 microversion: 2.1 time: 0.228786 Aug 27 04:37:59.659526 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 885/1773] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:59 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1493 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:59.665695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-4cd4125a-2f97-4574-91d0-ed6ccb3470ec req-1f65cbd7-687f-4fbb-b5da-af087b048a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c35fba-1273-4d50-9b92-f96b93bb1295", "name": "network-vif-unplugged", "status": "completed", "tag": "0e539f18-246d-462f-9c29-7eff0c12d3dd"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:59.678977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4cd4125a-2f97-4574-91d0-ed6ccb3470ec req-1f65cbd7-687f-4fbb-b5da-af087b048a65 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:59.679659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4cd4125a-2f97-4574-91d0-ed6ccb3470ec req-1f65cbd7-687f-4fbb-b5da-af087b048a65 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:59.679885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4cd4125a-2f97-4574-91d0-ed6ccb3470ec req-1f65cbd7-687f-4fbb-b5da-af087b048a65 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:59.684412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:59.692969 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-4cd4125a-2f97-4574-91d0-ed6ccb3470ec req-1f65cbd7-687f-4fbb-b5da-af087b048a65 service nova] Creating event network-vif-unplugged:0e539f18-246d-462f-9c29-7eff0c12d3dd for instance b2c35fba-1273-4d50-9b92-f96b93bb1295 on n-h1-854823-1 Aug 27 04:37:59.698376 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-4cd4125a-2f97-4574-91d0-ed6ccb3470ec req-1f65cbd7-687f-4fbb-b5da-af087b048a65 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037657 Aug 27 04:37:59.701004 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 886/1774] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:59.707648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-80ffc373-6691-4842-81e1-6ae0393bb901 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Calling method '.version_select at 0x7f1f215fa310>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:59.761282 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-80ffc373-6691-4842-81e1-6ae0393bb901 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "GET /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata" status: 200 len: 37 microversion: 2.1 time: 0.059003 Aug 27 04:37:59.762284 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 887/1775] 10.222.0.79 () {58 vars in 1260 bytes} [Sat Aug 27 04:37:59 2022] GET /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata => generated 37 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:37:59.775399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3dfb4aa0-8151-408b-aaa4-29d5b84011ec tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Action: 'update_all', calling method: .version_select at 0x7f1f21facc10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:59.843478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3dfb4aa0-8151-408b-aaa4-29d5b84011ec tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:37:59.849365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3dfb4aa0-8151-408b-aaa4-29d5b84011ec tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for user 4b8b790db1f041ad8d046679f5beb9c1 and project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:00.279640 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3dfb4aa0-8151-408b-aaa4-29d5b84011ec tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.508435 Aug 27 04:38:00.280805 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 888/1776] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:37:59 2022] PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata => generated 61 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:38:00.294612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-45146bac-35f4-4e20-af8c-37905a97a474 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:00.296384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-45146bac-35f4-4e20-af8c-37905a97a474 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:00.305165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45146bac-35f4-4e20-af8c-37905a97a474 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:00.305672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45146bac-35f4-4e20-af8c-37905a97a474 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:00.306106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45146bac-35f4-4e20-af8c-37905a97a474 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:00.307053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45146bac-35f4-4e20-af8c-37905a97a474 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:00.307693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45146bac-35f4-4e20-af8c-37905a97a474 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:00.308304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45146bac-35f4-4e20-af8c-37905a97a474 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:00.879916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-45146bac-35f4-4e20-af8c-37905a97a474 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:00.888871 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-45146bac-35f4-4e20-af8c-37905a97a474 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1534 microversion: 2.1 time: 0.606261 Aug 27 04:38:00.889875 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 889/1777] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:00 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1534 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:00.894575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7701cba6-0610-4c26-b765-4de73757526b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:00.895008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7701cba6-0610-4c26-b765-4de73757526b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:00.903244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7701cba6-0610-4c26-b765-4de73757526b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:00.904069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7701cba6-0610-4c26-b765-4de73757526b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:00.905499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7701cba6-0610-4c26-b765-4de73757526b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:00.906429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7701cba6-0610-4c26-b765-4de73757526b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:00.907245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7701cba6-0610-4c26-b765-4de73757526b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:00.907930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7701cba6-0610-4c26-b765-4de73757526b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:01.139974 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55a21295-1704-4b83-8191-6e2c8ce29896 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/action" status: 202 len: 0 microversion: 2.25 time: 3.505669 Aug 27 04:38:01.144670 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 889/1778] 10.222.0.79 () {62 vars in 1319 bytes} [Sat Aug 27 04:37:57 2022] POST /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/action => generated 0 bytes in 3512 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:01.151335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af3fa586-bf74-4769-8fc5-07141dc85f1c tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Calling method '.version_select at 0x7f1f25d23040>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:01.240294 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af3fa586-bf74-4769-8fc5-07141dc85f1c tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "GET /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.091830 Aug 27 04:38:01.242453 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 890/1779] 10.222.0.79 () {58 vars in 1290 bytes} [Sat Aug 27 04:38:01 2022] GET /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata/os_distro => generated 33 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:38:01.257295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12bfc487-dab2-40fc-84e9-86d8b82305c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:01.258813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12bfc487-dab2-40fc-84e9-86d8b82305c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:01.268751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12bfc487-dab2-40fc-84e9-86d8b82305c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:01.270575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12bfc487-dab2-40fc-84e9-86d8b82305c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:01.271187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12bfc487-dab2-40fc-84e9-86d8b82305c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:01.272892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12bfc487-dab2-40fc-84e9-86d8b82305c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:01.274459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12bfc487-dab2-40fc-84e9-86d8b82305c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:01.275288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12bfc487-dab2-40fc-84e9-86d8b82305c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:01.296019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7701cba6-0610-4c26-b765-4de73757526b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:01.315554 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7701cba6-0610-4c26-b765-4de73757526b tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1476 microversion: 2.1 time: 0.424345 Aug 27 04:38:01.316941 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 890/1780] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:00 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1476 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:01.323055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-074cccce-f6ad-4a65-a2e6-97b10c84d147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:01.323859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-074cccce-f6ad-4a65-a2e6-97b10c84d147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:01.342053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-074cccce-f6ad-4a65-a2e6-97b10c84d147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:01.343918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-074cccce-f6ad-4a65-a2e6-97b10c84d147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:01.344412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-074cccce-f6ad-4a65-a2e6-97b10c84d147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:01.345210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-074cccce-f6ad-4a65-a2e6-97b10c84d147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:01.345664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-074cccce-f6ad-4a65-a2e6-97b10c84d147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:01.346086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-074cccce-f6ad-4a65-a2e6-97b10c84d147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:01.558089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-12bfc487-dab2-40fc-84e9-86d8b82305c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa3b03c362d4032bd17ebfeccdcdb83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b207b502d846718f9d72f62d1d034c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:01.568335 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12bfc487-dab2-40fc-84e9-86d8b82305c9 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 200 len: 1493 microversion: 2.1 time: 0.323617 Aug 27 04:38:01.569203 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 891/1781] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:01 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 1493 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:01.585642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-421a47d7-4772-409b-9ba7-36df0608e7bf tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Action: 'update_all', calling method: .version_select at 0x7f1f25e48af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:01.668269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-421a47d7-4772-409b-9ba7-36df0608e7bf tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:01.674683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-421a47d7-4772-409b-9ba7-36df0608e7bf tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for user 4b8b790db1f041ad8d046679f5beb9c1 and project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:01.938534 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-421a47d7-4772-409b-9ba7-36df0608e7bf tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.367994 Aug 27 04:38:01.939566 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 892/1782] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:38:01 2022] PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata => generated 61 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:38:01.946083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9df67f6b-e9b4-4030-800a-2419a8a6e366 req-12d328f7-b749-45fa-9194-a4082089bdaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c35fba-1273-4d50-9b92-f96b93bb1295", "name": "network-vif-deleted", "tag": "0e539f18-246d-462f-9c29-7eff0c12d3dd"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:01.975866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9df67f6b-e9b4-4030-800a-2419a8a6e366 req-12d328f7-b749-45fa-9194-a4082089bdaf service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:01.976926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9df67f6b-e9b4-4030-800a-2419a8a6e366 req-12d328f7-b749-45fa-9194-a4082089bdaf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:01.977766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9df67f6b-e9b4-4030-800a-2419a8a6e366 req-12d328f7-b749-45fa-9194-a4082089bdaf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:01.993584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-074cccce-f6ad-4a65-a2e6-97b10c84d147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:01.996924 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9df67f6b-e9b4-4030-800a-2419a8a6e366 req-12d328f7-b749-45fa-9194-a4082089bdaf service nova] Creating event network-vif-deleted:0e539f18-246d-462f-9c29-7eff0c12d3dd for instance b2c35fba-1273-4d50-9b92-f96b93bb1295 on n-h1-854823-1 Aug 27 04:38:02.004227 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9df67f6b-e9b4-4030-800a-2419a8a6e366 req-12d328f7-b749-45fa-9194-a4082089bdaf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062551 Aug 27 04:38:02.005322 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 893/1783] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:02.008481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-074cccce-f6ad-4a65-a2e6-97b10c84d147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:02.011743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca43d9d7-d6ff-4ce7-ac45-f1a5476a3a7a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:02.012732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca43d9d7-d6ff-4ce7-ac45-f1a5476a3a7a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:02.016566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-074cccce-f6ad-4a65-a2e6-97b10c84d147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:02.020954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca43d9d7-d6ff-4ce7-ac45-f1a5476a3a7a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:02.021765 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-074cccce-f6ad-4a65-a2e6-97b10c84d147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.703378 Aug 27 04:38:02.021913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca43d9d7-d6ff-4ce7-ac45-f1a5476a3a7a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:02.022415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca43d9d7-d6ff-4ce7-ac45-f1a5476a3a7a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:02.022911 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 891/1784] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:01 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:02.025002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca43d9d7-d6ff-4ce7-ac45-f1a5476a3a7a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:02.025770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca43d9d7-d6ff-4ce7-ac45-f1a5476a3a7a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:02.026298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca43d9d7-d6ff-4ce7-ac45-f1a5476a3a7a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:02.043610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cc82d3ea-a7e1-4e0b-ae31-87fb4ca7a24c tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Calling method '.version_select at 0x7f1f215f5ee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:02.090925 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cc82d3ea-a7e1-4e0b-ae31-87fb4ca7a24c tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "GET /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.053082 Aug 27 04:38:02.092962 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 892/1785] 10.222.0.79 () {58 vars in 1260 bytes} [Sat Aug 27 04:38:02 2022] GET /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata => generated 61 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:38:02.125233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7c34478a-fa7b-42b5-b9c1-8f9f37bc6413 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Action: 'update_all', calling method: .version_select at 0x7f1f215faaf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:02.210923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-7c34478a-fa7b-42b5-b9c1-8f9f37bc6413 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:02.219143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-7c34478a-fa7b-42b5-b9c1-8f9f37bc6413 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for user 4b8b790db1f041ad8d046679f5beb9c1 and project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:02.344761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca43d9d7-d6ff-4ce7-ac45-f1a5476a3a7a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:02.354441 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca43d9d7-d6ff-4ce7-ac45-f1a5476a3a7a tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1521 microversion: 2.1 time: 0.347057 Aug 27 04:38:02.376186 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 894/1786] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:02 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:02.384984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-15f1c1ea-74e2-45a4-955c-e1f8186eae76 req-4ab3fccf-1542-426f-ab2b-2eb85b59f12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131", "name": "network-vif-unplugged", "status": "completed", "tag": "024c4406-8d1a-4d0a-8070-35c91fc50f3f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:02.429019 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7c34478a-fa7b-42b5-b9c1-8f9f37bc6413 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.329895 Aug 27 04:38:02.430880 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 893/1787] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:38:02 2022] PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata => generated 61 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:38:02.444901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5f9f0194-d6c9-4e36-b3fb-6a7c8918bbcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:02.446002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5f9f0194-d6c9-4e36-b3fb-6a7c8918bbcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:02.449395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-15f1c1ea-74e2-45a4-955c-e1f8186eae76 req-4ab3fccf-1542-426f-ab2b-2eb85b59f12d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:02.452656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-15f1c1ea-74e2-45a4-955c-e1f8186eae76 req-4ab3fccf-1542-426f-ab2b-2eb85b59f12d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:02.453259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-15f1c1ea-74e2-45a4-955c-e1f8186eae76 req-4ab3fccf-1542-426f-ab2b-2eb85b59f12d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:02.463790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f9f0194-d6c9-4e36-b3fb-6a7c8918bbcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:02.465885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f9f0194-d6c9-4e36-b3fb-6a7c8918bbcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:02.468226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f9f0194-d6c9-4e36-b3fb-6a7c8918bbcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:02.469509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f9f0194-d6c9-4e36-b3fb-6a7c8918bbcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:02.471460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f9f0194-d6c9-4e36-b3fb-6a7c8918bbcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:02.472375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f9f0194-d6c9-4e36-b3fb-6a7c8918bbcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:02.491154 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-15f1c1ea-74e2-45a4-955c-e1f8186eae76 req-4ab3fccf-1542-426f-ab2b-2eb85b59f12d service nova] Creating event network-vif-unplugged:024c4406-8d1a-4d0a-8070-35c91fc50f3f for instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 on n-h2-854823-1 Aug 27 04:38:02.506755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-15f1c1ea-74e2-45a4-955c-e1f8186eae76 req-4ab3fccf-1542-426f-ab2b-2eb85b59f12d service nova] Instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:38:02.551871 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-15f1c1ea-74e2-45a4-955c-e1f8186eae76 req-4ab3fccf-1542-426f-ab2b-2eb85b59f12d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172158 Aug 27 04:38:02.553557 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 895/1788] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:02.564333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af9027e3-59d2-4873-8224-735b03718b40 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:02.570340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af9027e3-59d2-4873-8224-735b03718b40 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:02.579922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af9027e3-59d2-4873-8224-735b03718b40 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:02.580754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af9027e3-59d2-4873-8224-735b03718b40 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:02.581473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af9027e3-59d2-4873-8224-735b03718b40 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:02.583284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af9027e3-59d2-4873-8224-735b03718b40 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:02.583949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af9027e3-59d2-4873-8224-735b03718b40 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:02.584566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af9027e3-59d2-4873-8224-735b03718b40 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:02.618817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af9027e3-59d2-4873-8224-735b03718b40 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:38:02.750153 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af9027e3-59d2-4873-8224-735b03718b40 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 204 len: 0 microversion: 2.1 time: 0.193544 Aug 27 04:38:02.750766 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 896/1789] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:38:02 2022] DELETE /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:02.765086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-beca9f2c-b5a2-433a-8657-72369876a6a1 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Action: 'update_all', calling method: .version_select at 0x7f1f25d235e0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:02.838128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-beca9f2c-b5a2-433a-8657-72369876a6a1 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:02.847535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-beca9f2c-b5a2-433a-8657-72369876a6a1 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for user 4b8b790db1f041ad8d046679f5beb9c1 and project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:03.009601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5f9f0194-d6c9-4e36-b3fb-6a7c8918bbcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:03.024175 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5f9f0194-d6c9-4e36-b3fb-6a7c8918bbcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1476 microversion: 2.1 time: 0.591042 Aug 27 04:38:03.025843 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 894/1790] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:02 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1476 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:03.035140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-340f9775-a4ca-4e35-951e-2d4ac63a2224 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:03.035782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-340f9775-a4ca-4e35-951e-2d4ac63a2224 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: b2c35fba-1273-4d50-9b92-f96b93bb1295] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:03.055723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-340f9775-a4ca-4e35-951e-2d4ac63a2224 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:03.058608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-340f9775-a4ca-4e35-951e-2d4ac63a2224 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:03.062900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-340f9775-a4ca-4e35-951e-2d4ac63a2224 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:03.064466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-340f9775-a4ca-4e35-951e-2d4ac63a2224 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:03.067131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-340f9775-a4ca-4e35-951e-2d4ac63a2224 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:03.067797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-340f9775-a4ca-4e35-951e-2d4ac63a2224 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:03.102698 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-340f9775-a4ca-4e35-951e-2d4ac63a2224 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] HTTP exception thrown: Instance b2c35fba-1273-4d50-9b92-f96b93bb1295 could not be found. Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-340f9775-a4ca-4e35-951e-2d4ac63a2224 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Request method failure captured: Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 HTTP/1.1 Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ7QAK8ZHwjwpIbL1xIl9WfxQp4GVSA65O5iuZ0hlcZ4WGq08KgIhZUUUReVd1eSmKoiiVBis1FWK-SjVd21Fiu9YXRbMJS2wgKDE6Fw2e-gQ_hQ3t2dli8G3vBgi2XrVmYgv_BOxxihOGYVOY1eflDpehZm2M2-N7WjE41u3O_YmnA Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:38:03.106888 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:38:03.109194 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b207b502d846718f9d72f62d1d034c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:03.109194 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.109194 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:03.109194 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.109194 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:03.109194 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:38:03.109194 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:38:03.109194 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: daa3b03c362d4032bd17ebfeccdcdb83 Aug 27 04:38:03.109194 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:03.109194 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:38:03.109194 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance b2c35fba-1273-4d50-9b92-f96b93bb1295 could not be found. Aug 27 04:38:03.109194 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'b2c35fba-1273-4d50-9b92-f96b93bb1295'} Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c35fba-1273-4d50-9b92-f96b93bb1295 could not be found. Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:03.110181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c35fba-1273-4d50-9b92-f96b93bb1295 could not be found. Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c35fba-1273-4d50-9b92-f96b93bb1295 could not be found. Aug 27 04:38:03.111860 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.113335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-340f9775-a4ca-4e35-951e-2d4ac63a2224 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Returning 404 to user: Instance b2c35fba-1273-4d50-9b92-f96b93bb1295 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:03.113335 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-340f9775-a4ca-4e35-951e-2d4ac63a2224 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295" status: 404 len: 111 microversion: 2.1 time: 0.082011 Aug 27 04:38:03.113969 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 895/1791] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:03 2022] GET /compute/v2.1/servers/b2c35fba-1273-4d50-9b92-f96b93bb1295 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:03.126981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9a6644db-dd60-4b44-85cc-a25cffb7712b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:03.127884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9a6644db-dd60-4b44-85cc-a25cffb7712b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:03.158163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a6644db-dd60-4b44-85cc-a25cffb7712b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:03.158670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a6644db-dd60-4b44-85cc-a25cffb7712b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:03.159119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a6644db-dd60-4b44-85cc-a25cffb7712b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:03.159841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a6644db-dd60-4b44-85cc-a25cffb7712b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:03.160302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a6644db-dd60-4b44-85cc-a25cffb7712b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:03.160757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a6644db-dd60-4b44-85cc-a25cffb7712b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:03.442861 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-beca9f2c-b5a2-433a-8657-72369876a6a1 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata" status: 200 len: 64 microversion: 2.1 time: 0.687233 Aug 27 04:38:03.443547 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 897/1792] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:38:02 2022] PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata => generated 64 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:38:03.454292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7bccf289-aa9e-4944-b723-a6df652dbceb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:03.455780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7bccf289-aa9e-4944-b723-a6df652dbceb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:03.465882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bccf289-aa9e-4944-b723-a6df652dbceb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:03.467360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bccf289-aa9e-4944-b723-a6df652dbceb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:03.467858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bccf289-aa9e-4944-b723-a6df652dbceb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:03.469068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bccf289-aa9e-4944-b723-a6df652dbceb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:03.469545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bccf289-aa9e-4944-b723-a6df652dbceb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:03.470036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bccf289-aa9e-4944-b723-a6df652dbceb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:03.620594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9a6644db-dd60-4b44-85cc-a25cffb7712b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:03.630595 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9a6644db-dd60-4b44-85cc-a25cffb7712b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1527 microversion: 2.1 time: 0.515248 Aug 27 04:38:03.640570 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 896/1793] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:03 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1527 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:03.655966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f809afd-a748-4d00-a02e-ee6ec49885cc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f215f2700>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:03.684938 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-4f809afd-a748-4d00-a02e-ee6ec49885cc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] HTTP exception thrown: Image not found. Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f809afd-a748-4d00-a02e-ee6ec49885cc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Request method failure captured: Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e HTTP/1.1 Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ7QAK8ZHwjwpIbL1xIl9WfxQp4GVSA65O5iuZ0hlcZ4WGq08KgIhZUUUReVd1eSmKoiiVBis1FWK-SjVd21Fiu9YXRbMJS2wgKDE6Fw2e-gQ_hQ3t2dli8G3vBgi2XrVmYgv_BOxxihOGYVOY1eflDpehZm2M2-N7WjE41u3O_YmnA Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:38:03.689263 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:38:03.690762 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b207b502d846718f9d72f62d1d034c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:03.690762 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.690762 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:03.690762 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.690762 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:03.690762 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:38:03.690762 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:38:03.690762 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: daa3b03c362d4032bd17ebfeccdcdb83 Aug 27 04:38:03.690762 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:03.690762 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:38:03.690762 n-d-854823-1 devstack@n-api.service[128870]: exception: Image not found. Aug 27 04:38:03.690762 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'b62ece15-bd09-4db5-b5f4-e15e93ae276e'} Aug 27 04:38:03.690762 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:03.690762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b62ece15-bd09-4db5-b5f4-e15e93ae276e to delete Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.691730 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b62ece15-bd09-4db5-b5f4-e15e93ae276e could not be found. Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:03.693069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f809afd-a748-4d00-a02e-ee6ec49885cc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Returning 404 to user: Image not found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4f809afd-a748-4d00-a02e-ee6ec49885cc tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e" status: 404 len: 62 microversion: 2.1 time: 0.056815 Aug 27 04:38:03.698422 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 897/1794] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:03 2022] DELETE /compute/v2.1/images/b62ece15-bd09-4db5-b5f4-e15e93ae276e => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:38:03.700786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2159a435-ec09-4d36-8e95-fc22a61a8e2c tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Calling method '.version_select at 0x7f1f21558160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:03.757170 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2159a435-ec09-4d36-8e95-fc22a61a8e2c tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "GET /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata" status: 200 len: 64 microversion: 2.1 time: 0.064920 Aug 27 04:38:03.760329 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 898/1795] 10.222.0.79 () {58 vars in 1260 bytes} [Sat Aug 27 04:38:03 2022] GET /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata => generated 64 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:38:03.768737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31e52fa4-33b1-40b3-85cf-e83b6f91bd02 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:03.769392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-31e52fa4-33b1-40b3-85cf-e83b6f91bd02 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:03.776477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31e52fa4-33b1-40b3-85cf-e83b6f91bd02 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:03.777360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31e52fa4-33b1-40b3-85cf-e83b6f91bd02 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:03.777871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31e52fa4-33b1-40b3-85cf-e83b6f91bd02 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:03.778803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31e52fa4-33b1-40b3-85cf-e83b6f91bd02 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:03.779332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31e52fa4-33b1-40b3-85cf-e83b6f91bd02 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:03.780464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31e52fa4-33b1-40b3-85cf-e83b6f91bd02 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:03.794782 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-31e52fa4-33b1-40b3-85cf-e83b6f91bd02 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] HTTP exception thrown: Instance 88460469-e163-4ebf-8076-73ddf76e72ad could not be found. Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31e52fa4-33b1-40b3-85cf-e83b6f91bd02 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Request method failure captured: Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad HTTP/1.1 Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ7QAK8ZHwjwpIbL1xIl9WfxQp4GVSA65O5iuZ0hlcZ4WGq08KgIhZUUUReVd1eSmKoiiVBis1FWK-SjVd21Fiu9YXRbMJS2wgKDE6Fw2e-gQ_hQ3t2dli8G3vBgi2XrVmYgv_BOxxihOGYVOY1eflDpehZm2M2-N7WjE41u3O_YmnA Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:38:03.796492 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:38:03.798319 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b207b502d846718f9d72f62d1d034c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:03.798319 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.798319 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:03.798319 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.798319 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:03.798319 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:38:03.798319 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:38:03.798319 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: daa3b03c362d4032bd17ebfeccdcdb83 Aug 27 04:38:03.798319 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:03.798319 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:38:03.798319 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 88460469-e163-4ebf-8076-73ddf76e72ad could not be found. Aug 27 04:38:03.798319 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '88460469-e163-4ebf-8076-73ddf76e72ad'} Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88460469-e163-4ebf-8076-73ddf76e72ad could not be found. Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:03.799316 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88460469-e163-4ebf-8076-73ddf76e72ad could not be found. Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88460469-e163-4ebf-8076-73ddf76e72ad could not be found. Aug 27 04:38:03.801753 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.803204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31e52fa4-33b1-40b3-85cf-e83b6f91bd02 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Returning 404 to user: Instance 88460469-e163-4ebf-8076-73ddf76e72ad could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:03.803204 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-31e52fa4-33b1-40b3-85cf-e83b6f91bd02 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 404 len: 111 microversion: 2.1 time: 0.037554 Aug 27 04:38:03.803204 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 899/1796] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:38:03 2022] DELETE /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:03.804434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-af412ddc-a3e5-4d80-a12b-60b21b614048 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Action: 'update_all', calling method: .version_select at 0x7f1f215581f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:03.819783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7bccf289-aa9e-4944-b723-a6df652dbceb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:03.835271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7bccf289-aa9e-4944-b723-a6df652dbceb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:03.839525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7bccf289-aa9e-4944-b723-a6df652dbceb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:03.845981 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7bccf289-aa9e-4944-b723-a6df652dbceb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.398059 Aug 27 04:38:03.857022 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 898/1797] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:03 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:03.870334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea0c2bd5-0c69-4c47-8e7f-341fd333ba7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:03.871252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea0c2bd5-0c69-4c47-8e7f-341fd333ba7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 88460469-e163-4ebf-8076-73ddf76e72ad] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:03.880650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea0c2bd5-0c69-4c47-8e7f-341fd333ba7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:03.881990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea0c2bd5-0c69-4c47-8e7f-341fd333ba7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:03.883017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea0c2bd5-0c69-4c47-8e7f-341fd333ba7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:03.883917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea0c2bd5-0c69-4c47-8e7f-341fd333ba7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:03.884483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea0c2bd5-0c69-4c47-8e7f-341fd333ba7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:03.885048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea0c2bd5-0c69-4c47-8e7f-341fd333ba7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:03.895336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-af412ddc-a3e5-4d80-a12b-60b21b614048 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:03.904799 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ea0c2bd5-0c69-4c47-8e7f-341fd333ba7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] HTTP exception thrown: Instance 88460469-e163-4ebf-8076-73ddf76e72ad could not be found. Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea0c2bd5-0c69-4c47-8e7f-341fd333ba7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Request method failure captured: Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad HTTP/1.1 Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ7QAK8ZHwjwpIbL1xIl9WfxQp4GVSA65O5iuZ0hlcZ4WGq08KgIhZUUUReVd1eSmKoiiVBis1FWK-SjVd21Fiu9YXRbMJS2wgKDE6Fw2e-gQ_hQ3t2dli8G3vBgi2XrVmYgv_BOxxihOGYVOY1eflDpehZm2M2-N7WjE41u3O_YmnA Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:38:03.906868 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:38:03.908438 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b207b502d846718f9d72f62d1d034c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:03.908438 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.908438 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:03.908438 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.908438 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:03.908438 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:38:03.908438 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:38:03.908438 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: daa3b03c362d4032bd17ebfeccdcdb83 Aug 27 04:38:03.908438 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:03.908438 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:38:03.908438 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 88460469-e163-4ebf-8076-73ddf76e72ad could not be found. Aug 27 04:38:03.908438 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '88460469-e163-4ebf-8076-73ddf76e72ad'} Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88460469-e163-4ebf-8076-73ddf76e72ad could not be found. Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:03.909404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88460469-e163-4ebf-8076-73ddf76e72ad could not be found. Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88460469-e163-4ebf-8076-73ddf76e72ad could not be found. Aug 27 04:38:03.910771 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.914196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea0c2bd5-0c69-4c47-8e7f-341fd333ba7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Returning 404 to user: Instance 88460469-e163-4ebf-8076-73ddf76e72ad could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:03.917657 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea0c2bd5-0c69-4c47-8e7f-341fd333ba7c tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad" status: 404 len: 111 microversion: 2.1 time: 0.052781 Aug 27 04:38:03.923048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-af412ddc-a3e5-4d80-a12b-60b21b614048 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for user 4b8b790db1f041ad8d046679f5beb9c1 and project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:03.923381 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 899/1798] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:03 2022] GET /compute/v2.1/servers/88460469-e163-4ebf-8076-73ddf76e72ad => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:03.931468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d711fe30-cb73-4d9e-ada1-ab77d819fd7a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f25cc1670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:03.984236 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d711fe30-cb73-4d9e-ada1-ab77d819fd7a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] HTTP exception thrown: Image not found. Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d711fe30-cb73-4d9e-ada1-ab77d819fd7a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Request method failure captured: Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 HTTP/1.1 Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ7QAK8ZHwjwpIbL1xIl9WfxQp4GVSA65O5iuZ0hlcZ4WGq08KgIhZUUUReVd1eSmKoiiVBis1FWK-SjVd21Fiu9YXRbMJS2wgKDE6Fw2e-gQ_hQ3t2dli8G3vBgi2XrVmYgv_BOxxihOGYVOY1eflDpehZm2M2-N7WjE41u3O_YmnA Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:38:03.990830 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:38:03.994367 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b207b502d846718f9d72f62d1d034c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:03.994367 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.994367 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:03.994367 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:03.994367 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:03.994367 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:38:03.994367 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:38:03.994367 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: daa3b03c362d4032bd17ebfeccdcdb83 Aug 27 04:38:03.994367 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:03.994367 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:38:03.994367 n-d-854823-1 devstack@n-api.service[128869]: exception: Image not found. Aug 27 04:38:03.994367 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '577bad02-e774-472b-8d65-1df3f6447ee7'} Aug 27 04:38:03.994367 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:03.994367 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 577bad02-e774-472b-8d65-1df3f6447ee7 to delete Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.995643 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 577bad02-e774-472b-8d65-1df3f6447ee7 could not be found. Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:03.997542 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:38:03.999380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:38:03.999380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:38:03.999380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.999380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:03.999380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.999380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:03.999380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:03.999380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:03.999380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:03.999380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:03.999380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:38:03.999380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:03.999380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d711fe30-cb73-4d9e-ada1-ab77d819fd7a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:03.999380 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d711fe30-cb73-4d9e-ada1-ab77d819fd7a tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7" status: 404 len: 62 microversion: 2.1 time: 0.070865 Aug 27 04:38:04.004573 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 900/1799] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:03 2022] DELETE /compute/v2.1/images/577bad02-e774-472b-8d65-1df3f6447ee7 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:38:04.028697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2a1efdc-aca5-428f-8dac-3248a0e637f4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:04.030771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2a1efdc-aca5-428f-8dac-3248a0e637f4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:04.048626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a1efdc-aca5-428f-8dac-3248a0e637f4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:04.049302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a1efdc-aca5-428f-8dac-3248a0e637f4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:04.049897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a1efdc-aca5-428f-8dac-3248a0e637f4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:04.050825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a1efdc-aca5-428f-8dac-3248a0e637f4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:04.051439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a1efdc-aca5-428f-8dac-3248a0e637f4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:04.052020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a1efdc-aca5-428f-8dac-3248a0e637f4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:04.072883 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d2a1efdc-aca5-428f-8dac-3248a0e637f4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] HTTP exception thrown: Instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 could not be found. Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2a1efdc-aca5-428f-8dac-3248a0e637f4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Request method failure captured: Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 HTTP/1.1 Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ7QAK8ZHwjwpIbL1xIl9WfxQp4GVSA65O5iuZ0hlcZ4WGq08KgIhZUUUReVd1eSmKoiiVBis1FWK-SjVd21Fiu9YXRbMJS2wgKDE6Fw2e-gQ_hQ3t2dli8G3vBgi2XrVmYgv_BOxxihOGYVOY1eflDpehZm2M2-N7WjE41u3O_YmnA Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:38:04.075009 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:38:04.077394 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b207b502d846718f9d72f62d1d034c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:04.077394 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesTestJSON-465316353 Aug 27 04:38:04.077394 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:04.077394 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:04.077394 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:04.077394 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:38:04.077394 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:38:04.077394 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: daa3b03c362d4032bd17ebfeccdcdb83 Aug 27 04:38:04.077394 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:04.077394 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:38:04.077394 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 could not be found. Aug 27 04:38:04.077394 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'e1a6657e-24e5-4825-9bf0-4f7b0503fa01'} Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 could not be found. Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:04.078395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 could not be found. Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 could not be found. Aug 27 04:38:04.080173 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:04.082747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2a1efdc-aca5-428f-8dac-3248a0e637f4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Returning 404 to user: Instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:04.083941 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2a1efdc-aca5-428f-8dac-3248a0e637f4 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 404 len: 111 microversion: 2.1 time: 0.074822 Aug 27 04:38:04.084796 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 901/1800] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:38:04 2022] DELETE /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:04.096066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a7fe16c-bc9d-416c-aaea-aabf13b7e949 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:04.096982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a7fe16c-bc9d-416c-aaea-aabf13b7e949 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:04.104400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a7fe16c-bc9d-416c-aaea-aabf13b7e949 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:04.105201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a7fe16c-bc9d-416c-aaea-aabf13b7e949 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:04.105881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a7fe16c-bc9d-416c-aaea-aabf13b7e949 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:04.106779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a7fe16c-bc9d-416c-aaea-aabf13b7e949 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:04.108396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a7fe16c-bc9d-416c-aaea-aabf13b7e949 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:04.109049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a7fe16c-bc9d-416c-aaea-aabf13b7e949 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:04.540592 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-af412ddc-a3e5-4d80-a12b-60b21b614048 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.739661 Aug 27 04:38:04.542997 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 900/1801] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:38:03 2022] PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata => generated 61 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:38:04.552027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0e0cb7c2-be8f-4a10-a653-95e9078935b3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:04.552967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0e0cb7c2-be8f-4a10-a653-95e9078935b3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: e1a6657e-24e5-4825-9bf0-4f7b0503fa01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:04.562134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e0cb7c2-be8f-4a10-a653-95e9078935b3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:04.566388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e0cb7c2-be8f-4a10-a653-95e9078935b3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:04.567005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e0cb7c2-be8f-4a10-a653-95e9078935b3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:04.567816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e0cb7c2-be8f-4a10-a653-95e9078935b3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:04.568286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e0cb7c2-be8f-4a10-a653-95e9078935b3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:04.568804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e0cb7c2-be8f-4a10-a653-95e9078935b3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:04.584857 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-0e0cb7c2-be8f-4a10-a653-95e9078935b3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] HTTP exception thrown: Instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 could not be found. Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0e0cb7c2-be8f-4a10-a653-95e9078935b3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Request method failure captured: Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 HTTP/1.1 Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ7QAK8ZHwjwpIbL1xIl9WfxQp4GVSA65O5iuZ0hlcZ4WGq08KgIhZUUUReVd1eSmKoiiVBis1FWK-SjVd21Fiu9YXRbMJS2wgKDE6Fw2e-gQ_hQ3t2dli8G3vBgi2XrVmYgv_BOxxihOGYVOY1eflDpehZm2M2-N7WjE41u3O_YmnA Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:38:04.586756 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:38:04.588460 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b207b502d846718f9d72f62d1d034c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:04.588460 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesTestJSON-465316353 Aug 27 04:38:04.588460 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:04.588460 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:04.588460 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:04.588460 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:38:04.588460 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:38:04.588460 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: daa3b03c362d4032bd17ebfeccdcdb83 Aug 27 04:38:04.588460 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:04.588460 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:38:04.588460 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 could not be found. Aug 27 04:38:04.588460 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'e1a6657e-24e5-4825-9bf0-4f7b0503fa01'} Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 could not be found. Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:04.589453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 could not be found. Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 could not be found. Aug 27 04:38:04.591621 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:04.596147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0e0cb7c2-be8f-4a10-a653-95e9078935b3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Returning 404 to user: Instance e1a6657e-24e5-4825-9bf0-4f7b0503fa01 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:04.597795 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0e0cb7c2-be8f-4a10-a653-95e9078935b3 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01" status: 404 len: 111 microversion: 2.1 time: 0.053468 Aug 27 04:38:04.598714 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 901/1802] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:04 2022] GET /compute/v2.1/servers/e1a6657e-24e5-4825-9bf0-4f7b0503fa01 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:04.611909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-009438e2-d7ed-4a3d-8cf6-4121092dd8ce tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Action: 'update', calling method: .version_select at 0x7f1f21558310>, body: {"meta": {"os_version": "alt"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:04.689403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-009438e2-d7ed-4a3d-8cf6-4121092dd8ce tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:04.694496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-009438e2-d7ed-4a3d-8cf6-4121092dd8ce tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for user 4b8b790db1f041ad8d046679f5beb9c1 and project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:04.800437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1a7fe16c-bc9d-416c-aaea-aabf13b7e949 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:04.808459 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a7fe16c-bc9d-416c-aaea-aabf13b7e949 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1476 microversion: 2.1 time: 0.719503 Aug 27 04:38:04.809075 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 902/1803] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:04 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1476 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:05.106074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7609c563-fb1c-4504-a363-03e54fa1c841 tempest-ListImagesTestJSON-2043490158 tempest-ListImagesTestJSON-2043490158-project] Calling method '.version_select at 0x7f1f25cc10d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:05.200400 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7609c563-fb1c-4504-a363-03e54fa1c841 tempest-ListImagesTestJSON-2043490158 tempest-ListImagesTestJSON-2043490158-project] 10.222.0.79 "GET /compute/v2.1/images/71228424-9f42-4121-865e-14501cc9b5c0" status: 200 len: 784 microversion: 2.1 time: 0.365095 Aug 27 04:38:05.201322 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 903/1804] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:04 2022] GET /compute/v2.1/images/71228424-9f42-4121-865e-14501cc9b5c0 => generated 784 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:05.218413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-07012df3-e890-4377-bfe8-3b31ba4e94fc req-2155b90f-d088-4fc9-8f43-1bc7f7eecc14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131", "tag": "024c4406-8d1a-4d0a-8070-35c91fc50f3f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:05.240276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-07012df3-e890-4377-bfe8-3b31ba4e94fc req-2155b90f-d088-4fc9-8f43-1bc7f7eecc14 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:05.240805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-07012df3-e890-4377-bfe8-3b31ba4e94fc req-2155b90f-d088-4fc9-8f43-1bc7f7eecc14 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:05.243263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-07012df3-e890-4377-bfe8-3b31ba4e94fc req-2155b90f-d088-4fc9-8f43-1bc7f7eecc14 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:05.257797 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-009438e2-d7ed-4a3d-8cf6-4121092dd8ce tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.656822 Aug 27 04:38:05.259651 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 902/1805] 10.222.0.79 () {60 vars in 1313 bytes} [Sat Aug 27 04:38:04 2022] PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata/os_version => generated 31 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:38:05.261762 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-07012df3-e890-4377-bfe8-3b31ba4e94fc req-2155b90f-d088-4fc9-8f43-1bc7f7eecc14 service nova] Creating event network-changed:024c4406-8d1a-4d0a-8070-35c91fc50f3f for instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 on n-h2-854823-1 Aug 27 04:38:05.269584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-07012df3-e890-4377-bfe8-3b31ba4e94fc req-2155b90f-d088-4fc9-8f43-1bc7f7eecc14 service nova] Instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:38:05.272056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2299629a-0740-4dcf-a23b-e9e74cf22a7f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '.version_select at 0x7f1f220318b0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:05.283161 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-07012df3-e890-4377-bfe8-3b31ba4e94fc req-2155b90f-d088-4fc9-8f43-1bc7f7eecc14 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068742 Aug 27 04:38:05.284065 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 904/1806] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:05.293277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d85f804f-27e5-4640-b729-ce6487187619 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:05.294053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d85f804f-27e5-4640-b729-ce6487187619 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:05.301539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d85f804f-27e5-4640-b729-ce6487187619 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:05.302313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d85f804f-27e5-4640-b729-ce6487187619 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:05.302504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d85f804f-27e5-4640-b729-ce6487187619 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:05.303394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d85f804f-27e5-4640-b729-ce6487187619 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:05.304178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d85f804f-27e5-4640-b729-ce6487187619 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:05.304955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d85f804f-27e5-4640-b729-ce6487187619 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:05.337799 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-2299629a-0740-4dcf-a23b-e9e74cf22a7f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] HTTP exception thrown: Image not found. Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2299629a-0740-4dcf-a23b-e9e74cf22a7f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Request method failure captured: Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 HTTP/1.1 Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ7QAK8ZHwjwpIbL1xIl9WfxQp4GVSA65O5iuZ0hlcZ4WGq08KgIhZUUUReVd1eSmKoiiVBis1FWK-SjVd21Fiu9YXRbMJS2wgKDE6Fw2e-gQ_hQ3t2dli8G3vBgi2XrVmYgv_BOxxihOGYVOY1eflDpehZm2M2-N7WjE41u3O_YmnA Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:38:05.341476 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:38:05.343904 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b207b502d846718f9d72f62d1d034c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:05.343904 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesTestJSON-465316353 Aug 27 04:38:05.343904 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:05.343904 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:05.343904 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:05.343904 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:38:05.343904 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:38:05.343904 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: daa3b03c362d4032bd17ebfeccdcdb83 Aug 27 04:38:05.343904 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:05.343904 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:38:05.343904 n-d-854823-1 devstack@n-api.service[128870]: exception: Image not found. Aug 27 04:38:05.343904 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '5eaea55c-223c-4019-898f-08951a3a98b9'} Aug 27 04:38:05.343904 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:05.343904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5eaea55c-223c-4019-898f-08951a3a98b9 to delete Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.345011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5eaea55c-223c-4019-898f-08951a3a98b9 could not be found. Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:05.346312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:38:05.347779 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:38:05.347779 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:38:05.347779 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.347779 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:05.347779 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.347779 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:05.347779 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:05.347779 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:05.347779 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:05.347779 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:05.347779 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:38:05.347779 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.347779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2299629a-0740-4dcf-a23b-e9e74cf22a7f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Returning 404 to user: Image not found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:05.347779 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2299629a-0740-4dcf-a23b-e9e74cf22a7f tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9" status: 404 len: 62 microversion: 2.1 time: 0.077574 Aug 27 04:38:05.349010 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 903/1807] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:05 2022] DELETE /compute/v2.1/images/5eaea55c-223c-4019-898f-08951a3a98b9 => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:38:05.363191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2b717496-5054-4f78-ab4b-06bcb64d3e7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:05.364207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2b717496-5054-4f78-ab4b-06bcb64d3e7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:05.376725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b717496-5054-4f78-ab4b-06bcb64d3e7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:05.378171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b717496-5054-4f78-ab4b-06bcb64d3e7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:05.378804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b717496-5054-4f78-ab4b-06bcb64d3e7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:05.379555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b717496-5054-4f78-ab4b-06bcb64d3e7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:05.380198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b717496-5054-4f78-ab4b-06bcb64d3e7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:05.380839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b717496-5054-4f78-ab4b-06bcb64d3e7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:05.552972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2b717496-5054-4f78-ab4b-06bcb64d3e7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:05.563686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2b717496-5054-4f78-ab4b-06bcb64d3e7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:05.565786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2b717496-5054-4f78-ab4b-06bcb64d3e7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:05.567180 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2b717496-5054-4f78-ab4b-06bcb64d3e7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.217570 Aug 27 04:38:05.567913 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 904/1808] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:05 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:05.572568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c5bc1cd-378c-4f0b-b367-569ce9ea560f tempest-ListImagesTestJSON-2043490158 tempest-ListImagesTestJSON-2043490158-project] Calling method '.version_select at 0x7f1f215f5280>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:05.677151 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8c5bc1cd-378c-4f0b-b367-569ce9ea560f tempest-ListImagesTestJSON-2043490158 tempest-ListImagesTestJSON-2043490158-project] 10.222.0.79 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.107915 Aug 27 04:38:05.678015 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 905/1809] 10.222.0.79 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:05 2022] GET /compute/v2.1/images => generated 445 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:05.685610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6583ccd0-057d-44b9-bef3-410c4d14a161 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Calling method '.version_select at 0x7f1f215d3e50>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:05.729042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d85f804f-27e5-4640-b729-ce6487187619 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:05.757614 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6583ccd0-057d-44b9-bef3-410c4d14a161 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "GET /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata" status: 200 len: 58 microversion: 2.1 time: 0.076615 Aug 27 04:38:05.758369 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d85f804f-27e5-4640-b729-ce6487187619 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1527 microversion: 2.1 time: 0.469767 Aug 27 04:38:05.758612 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 906/1810] 10.222.0.79 () {58 vars in 1260 bytes} [Sat Aug 27 04:38:05 2022] GET /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata => generated 58 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:38:05.769539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-75dc706a-5435-4891-a21b-8e73a606b472 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:05.770529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-75dc706a-5435-4891-a21b-8e73a606b472 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:05.772301 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 905/1811] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:05 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1527 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:05.778774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75dc706a-5435-4891-a21b-8e73a606b472 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:05.779169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ecea0b1e-e822-469f-9ee2-e60d7a282fba req-0ef568c8-a56c-4bcd-bb61-8442aadaf2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bbe5194-aa1d-4db9-aec2-044d247df93a", "name": "network-vif-unplugged", "status": "completed", "tag": "63c68b66-1b81-4c26-befb-1e1ff3daa600"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:05.779572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75dc706a-5435-4891-a21b-8e73a606b472 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:05.781045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75dc706a-5435-4891-a21b-8e73a606b472 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:05.781939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75dc706a-5435-4891-a21b-8e73a606b472 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:05.782512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75dc706a-5435-4891-a21b-8e73a606b472 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:05.783053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75dc706a-5435-4891-a21b-8e73a606b472 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:05.792934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ecea0b1e-e822-469f-9ee2-e60d7a282fba req-0ef568c8-a56c-4bcd-bb61-8442aadaf2d8 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:05.793424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ecea0b1e-e822-469f-9ee2-e60d7a282fba req-0ef568c8-a56c-4bcd-bb61-8442aadaf2d8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:05.793925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ecea0b1e-e822-469f-9ee2-e60d7a282fba req-0ef568c8-a56c-4bcd-bb61-8442aadaf2d8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:05.804223 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-75dc706a-5435-4891-a21b-8e73a606b472 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] HTTP exception thrown: Instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 could not be found. Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-75dc706a-5435-4891-a21b-8e73a606b472 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Request method failure captured: Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 HTTP/1.1 Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ7QAK8ZHwjwpIbL1xIl9WfxQp4GVSA65O5iuZ0hlcZ4WGq08KgIhZUUUReVd1eSmKoiiVBis1FWK-SjVd21Fiu9YXRbMJS2wgKDE6Fw2e-gQ_hQ3t2dli8G3vBgi2XrVmYgv_BOxxihOGYVOY1eflDpehZm2M2-N7WjE41u3O_YmnA Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:38:05.807240 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:38:05.808783 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b207b502d846718f9d72f62d1d034c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:05.808783 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesTestJSON-465316353 Aug 27 04:38:05.808783 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:05.808783 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:05.808783 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:05.808783 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:38:05.808783 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:38:05.808783 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: daa3b03c362d4032bd17ebfeccdcdb83 Aug 27 04:38:05.808783 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:05.808783 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:38:05.808783 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 could not be found. Aug 27 04:38:05.808783 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '503a7b07-108a-45d6-937d-f9cd43ef66a9'} Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 could not be found. Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:05.809620 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 could not be found. Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 could not be found. Aug 27 04:38:05.811147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.812567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-75dc706a-5435-4891-a21b-8e73a606b472 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Returning 404 to user: Instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:05.812567 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-75dc706a-5435-4891-a21b-8e73a606b472 tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "DELETE /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9" status: 404 len: 111 microversion: 2.1 time: 0.049419 Aug 27 04:38:05.812726 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ecea0b1e-e822-469f-9ee2-e60d7a282fba req-0ef568c8-a56c-4bcd-bb61-8442aadaf2d8 service nova] Creating event network-vif-unplugged:63c68b66-1b81-4c26-befb-1e1ff3daa600 for instance 3bbe5194-aa1d-4db9-aec2-044d247df93a on n-h1-854823-1 Aug 27 04:38:05.813141 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 907/1812] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:38:05 2022] DELETE /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:05.816675 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ecea0b1e-e822-469f-9ee2-e60d7a282fba req-0ef568c8-a56c-4bcd-bb61-8442aadaf2d8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041182 Aug 27 04:38:05.816675 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 906/1813] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:05.819225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-49d60c09-353f-4037-a0c3-81741c6422cb tempest-ListImagesTestJSON-2043490158 tempest-ListImagesTestJSON-2043490158-project] Calling method '.version_select at 0x7f1f215f5550>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:05.830197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9802f6c1-3847-4859-a899-4eec23cfc704 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Action: 'update_all', calling method: .version_select at 0x7f1f25cc2550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:05.876071 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-49d60c09-353f-4037-a0c3-81741c6422cb tempest-ListImagesTestJSON-2043490158 tempest-ListImagesTestJSON-2043490158-project] 10.222.0.79 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.064893 Aug 27 04:38:05.878063 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 908/1814] 10.222.0.79 () {58 vars in 1143 bytes} [Sat Aug 27 04:38:05 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:05.885982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cc6054ef-dc99-4aff-abf7-62f29959807b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:05.886820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cc6054ef-dc99-4aff-abf7-62f29959807b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] [instance: 503a7b07-108a-45d6-937d-f9cd43ef66a9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:05.896201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc6054ef-dc99-4aff-abf7-62f29959807b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:05.897059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc6054ef-dc99-4aff-abf7-62f29959807b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:05.897730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc6054ef-dc99-4aff-abf7-62f29959807b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:05.898757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc6054ef-dc99-4aff-abf7-62f29959807b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:05.900242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc6054ef-dc99-4aff-abf7-62f29959807b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:05.901170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc6054ef-dc99-4aff-abf7-62f29959807b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:05.918739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9802f6c1-3847-4859-a899-4eec23cfc704 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:05.925892 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-cc6054ef-dc99-4aff-abf7-62f29959807b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] HTTP exception thrown: Instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 could not be found. Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cc6054ef-dc99-4aff-abf7-62f29959807b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Request method failure captured: Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 HTTP/1.1 Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ7QAK8ZHwjwpIbL1xIl9WfxQp4GVSA65O5iuZ0hlcZ4WGq08KgIhZUUUReVd1eSmKoiiVBis1FWK-SjVd21Fiu9YXRbMJS2wgKDE6Fw2e-gQ_hQ3t2dli8G3vBgi2XrVmYgv_BOxxihOGYVOY1eflDpehZm2M2-N7WjE41u3O_YmnA Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:38:05.929415 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:38:05.932149 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b207b502d846718f9d72f62d1d034c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b207b502d846718f9d72f62d1d034c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:05.932149 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesTestJSON-465316353 Aug 27 04:38:05.932149 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 67b207b502d846718f9d72f62d1d034c Aug 27 04:38:05.932149 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesTestJSON-465316353 Aug 27 04:38:05.932149 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:05.932149 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:38:05.932149 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:38:05.932149 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: daa3b03c362d4032bd17ebfeccdcdb83 Aug 27 04:38:05.932149 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesTestJSON-465316353-project Aug 27 04:38:05.932149 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:38:05.932149 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 could not be found. Aug 27 04:38:05.932149 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '503a7b07-108a-45d6-937d-f9cd43ef66a9'} Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 could not be found. Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:05.935916 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 could not be found. Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 could not be found. Aug 27 04:38:05.939997 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:05.944172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9802f6c1-3847-4859-a899-4eec23cfc704 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for user 4b8b790db1f041ad8d046679f5beb9c1 and project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:05.945685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cc6054ef-dc99-4aff-abf7-62f29959807b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] Returning 404 to user: Instance 503a7b07-108a-45d6-937d-f9cd43ef66a9 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:05.946836 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cc6054ef-dc99-4aff-abf7-62f29959807b tempest-ImagesTestJSON-465316353 tempest-ImagesTestJSON-465316353-project] 10.222.0.79 "GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9" status: 404 len: 111 microversion: 2.1 time: 0.066929 Aug 27 04:38:05.948607 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 909/1815] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:05 2022] GET /compute/v2.1/servers/503a7b07-108a-45d6-937d-f9cd43ef66a9 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:05.956405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-158b8024-627f-4bd4-a983-7909b6d62a5e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:05.957524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-158b8024-627f-4bd4-a983-7909b6d62a5e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:05.968225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-158b8024-627f-4bd4-a983-7909b6d62a5e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:05.969207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-158b8024-627f-4bd4-a983-7909b6d62a5e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:05.970029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-158b8024-627f-4bd4-a983-7909b6d62a5e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:05.971289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-158b8024-627f-4bd4-a983-7909b6d62a5e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:05.971989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-158b8024-627f-4bd4-a983-7909b6d62a5e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:05.973416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-158b8024-627f-4bd4-a983-7909b6d62a5e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:06.618150 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9802f6c1-3847-4859-a899-4eec23cfc704 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.801576 Aug 27 04:38:06.618827 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 907/1816] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:38:05 2022] PUT /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata => generated 61 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:38:06.635438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-08a85c13-f335-40bb-9c92-697242fa9eaa req-5fd73d2d-9adf-4e97-8bec-ecdbcd7f622c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bbe5194-aa1d-4db9-aec2-044d247df93a", "name": "network-vif-deleted", "tag": "63c68b66-1b81-4c26-befb-1e1ff3daa600"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:06.665863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08a85c13-f335-40bb-9c92-697242fa9eaa req-5fd73d2d-9adf-4e97-8bec-ecdbcd7f622c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:06.666643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08a85c13-f335-40bb-9c92-697242fa9eaa req-5fd73d2d-9adf-4e97-8bec-ecdbcd7f622c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:06.667312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08a85c13-f335-40bb-9c92-697242fa9eaa req-5fd73d2d-9adf-4e97-8bec-ecdbcd7f622c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:06.682861 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-08a85c13-f335-40bb-9c92-697242fa9eaa req-5fd73d2d-9adf-4e97-8bec-ecdbcd7f622c service nova] Creating event network-vif-deleted:63c68b66-1b81-4c26-befb-1e1ff3daa600 for instance 3bbe5194-aa1d-4db9-aec2-044d247df93a on n-h1-854823-1 Aug 27 04:38:06.703809 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-08a85c13-f335-40bb-9c92-697242fa9eaa req-5fd73d2d-9adf-4e97-8bec-ecdbcd7f622c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083429 Aug 27 04:38:06.704828 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 908/1817] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:06.712263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bfd32f6c-0aff-4c2a-8da1-50238e030dcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:06.724963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bfd32f6c-0aff-4c2a-8da1-50238e030dcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:06.732382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfd32f6c-0aff-4c2a-8da1-50238e030dcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:06.733266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfd32f6c-0aff-4c2a-8da1-50238e030dcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:06.733776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfd32f6c-0aff-4c2a-8da1-50238e030dcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:06.734576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfd32f6c-0aff-4c2a-8da1-50238e030dcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:06.735108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfd32f6c-0aff-4c2a-8da1-50238e030dcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:06.735623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfd32f6c-0aff-4c2a-8da1-50238e030dcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:06.891938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-158b8024-627f-4bd4-a983-7909b6d62a5e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:06.902552 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-158b8024-627f-4bd4-a983-7909b6d62a5e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1474 microversion: 2.1 time: 0.952553 Aug 27 04:38:06.903425 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 910/1818] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:05 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1474 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:06.914983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5abee7c7-c6fe-48b0-9428-29c7a4a180eb tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Action: 'create', calling method: .version_select at 0x7f1f2162c4c0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:06.981278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bfd32f6c-0aff-4c2a-8da1-50238e030dcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:06.996590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bfd32f6c-0aff-4c2a-8da1-50238e030dcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:07.000406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bfd32f6c-0aff-4c2a-8da1-50238e030dcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:07.004755 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bfd32f6c-0aff-4c2a-8da1-50238e030dcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.298381 Aug 27 04:38:07.009636 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 909/1819] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:06 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:07.019058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c9c5fda1-56f6-4c32-bcac-3197491a718f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:07.022140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-5abee7c7-c6fe-48b0-9428-29c7a4a180eb tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:07.023967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c9c5fda1-56f6-4c32-bcac-3197491a718f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:07.038552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-5abee7c7-c6fe-48b0-9428-29c7a4a180eb tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Getting quotas for user 4b8b790db1f041ad8d046679f5beb9c1 and project 0b5c6ca1838e434bbfe4641385bd85c4. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:07.038879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9c5fda1-56f6-4c32-bcac-3197491a718f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:07.039952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9c5fda1-56f6-4c32-bcac-3197491a718f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:07.042573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9c5fda1-56f6-4c32-bcac-3197491a718f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:07.045355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9c5fda1-56f6-4c32-bcac-3197491a718f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:07.046170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9c5fda1-56f6-4c32-bcac-3197491a718f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:07.046765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9c5fda1-56f6-4c32-bcac-3197491a718f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:07.114439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9c5fda1-56f6-4c32-bcac-3197491a718f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:07.115565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9c5fda1-56f6-4c32-bcac-3197491a718f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:07.116245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9c5fda1-56f6-4c32-bcac-3197491a718f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:07.117068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-c9c5fda1-56f6-4c32-bcac-3197491a718f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lazy-loading 'fault' on Instance uuid 3bbe5194-aa1d-4db9-aec2-044d247df93a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:38:07.214272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c9c5fda1-56f6-4c32-bcac-3197491a718f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:07.260164 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c9c5fda1-56f6-4c32-bcac-3197491a718f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 200 len: 1315 microversion: 2.1 time: 0.244859 Aug 27 04:38:07.276561 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 910/1820] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:07 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:07.687000 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5abee7c7-c6fe-48b0-9428-29c7a4a180eb tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "POST /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata" status: 200 len: 85 microversion: 2.1 time: 0.776574 Aug 27 04:38:07.687950 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 911/1821] 10.222.0.79 () {60 vars in 1281 bytes} [Sat Aug 27 04:38:06 2022] POST /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata => generated 85 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:38:07.702691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9205c6e8-ea85-4531-8249-ccd4d12d2a68 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] Calling method '.version_select at 0x7f1f25c8f670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:07.768332 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9205c6e8-ea85-4531-8249-ccd4d12d2a68 tempest-ImagesMetadataTestJSON-1046016934 tempest-ImagesMetadataTestJSON-1046016934-project] 10.222.0.79 "GET /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata" status: 200 len: 85 microversion: 2.1 time: 0.074973 Aug 27 04:38:07.769793 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 911/1822] 10.222.0.79 () {58 vars in 1260 bytes} [Sat Aug 27 04:38:07 2022] GET /compute/v2.1/images/d1040415-75d5-4740-bad5-dc998e1c6ed1/metadata => generated 85 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:38:08.038572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-08e70f4c-ecd0-456d-b74d-bb1a0fa0f6b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:08.039343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-08e70f4c-ecd0-456d-b74d-bb1a0fa0f6b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:08.064686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08e70f4c-ecd0-456d-b74d-bb1a0fa0f6b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:08.065193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08e70f4c-ecd0-456d-b74d-bb1a0fa0f6b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:08.065628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08e70f4c-ecd0-456d-b74d-bb1a0fa0f6b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:08.071569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08e70f4c-ecd0-456d-b74d-bb1a0fa0f6b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:08.077886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08e70f4c-ecd0-456d-b74d-bb1a0fa0f6b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:08.078455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08e70f4c-ecd0-456d-b74d-bb1a0fa0f6b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:08.098511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:08.346555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-be360cb5-e000-46a7-8c96-4ca2365a4b74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:08.347710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-be360cb5-e000-46a7-8c96-4ca2365a4b74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:08.363186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be360cb5-e000-46a7-8c96-4ca2365a4b74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:08.365082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be360cb5-e000-46a7-8c96-4ca2365a4b74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:08.368006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be360cb5-e000-46a7-8c96-4ca2365a4b74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:08.369012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be360cb5-e000-46a7-8c96-4ca2365a4b74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:08.369889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be360cb5-e000-46a7-8c96-4ca2365a4b74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:08.372210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be360cb5-e000-46a7-8c96-4ca2365a4b74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:08.454723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-08e70f4c-ecd0-456d-b74d-bb1a0fa0f6b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:08.466593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-08e70f4c-ecd0-456d-b74d-bb1a0fa0f6b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:08.469223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-08e70f4c-ecd0-456d-b74d-bb1a0fa0f6b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:08.470780 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-08e70f4c-ecd0-456d-b74d-bb1a0fa0f6b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.437381 Aug 27 04:38:08.471568 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 912/1823] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:08 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:38:08.492334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f94f5e90-c2c3-4de3-8dea-6f296fb05dc1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:08.493224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f94f5e90-c2c3-4de3-8dea-6f296fb05dc1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:08.522655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f94f5e90-c2c3-4de3-8dea-6f296fb05dc1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:08.523485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f94f5e90-c2c3-4de3-8dea-6f296fb05dc1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:08.524274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f94f5e90-c2c3-4de3-8dea-6f296fb05dc1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:08.526152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f94f5e90-c2c3-4de3-8dea-6f296fb05dc1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:08.527353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f94f5e90-c2c3-4de3-8dea-6f296fb05dc1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:08.528583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f94f5e90-c2c3-4de3-8dea-6f296fb05dc1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:08.579286 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f94f5e90-c2c3-4de3-8dea-6f296fb05dc1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] HTTP exception thrown: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f94f5e90-c2c3-4de3-8dea-6f296fb05dc1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Request method failure captured: Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a HTTP/1.1 Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ9LzeqYV4BUCc_CXZKyCgJDhuJ0n2D010QQ784od245BsR3bxLb1sHxDrLyEr4O_qgJBjYkRUAA_KGuy_0GWIipzEN4V-LZRqsnqytvO99DPzpj2LnZgNSzlNtzQSnXwwcHdsJTzPP1AoM-PSJ_QnZrIKpvFlmfCiSUn_wXkMGZoYs Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:38:08.583920 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:38:08.585473 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:08.585473 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:08.585473 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:08.585473 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:08.585473 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:08.585473 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:38:08.585473 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:38:08.585473 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 307981144d4141ed9d609d88ea2e954e Aug 27 04:38:08.585473 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:08.585473 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:38:08.585473 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:08.585473 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '3bbe5194-aa1d-4db9-aec2-044d247df93a'} Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:08.586295 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:08.587653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:08.592730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f94f5e90-c2c3-4de3-8dea-6f296fb05dc1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Returning 404 to user: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:08.594023 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f94f5e90-c2c3-4de3-8dea-6f296fb05dc1 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 404 len: 111 microversion: 2.1 time: 0.120413 Aug 27 04:38:08.597309 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 913/1824] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:08 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:08.884080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1331720221", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:08.990229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] validate_networks() for [('77750c63-f69a-4025-8b95-db23cc8eae7f', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:38:09.034232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-be360cb5-e000-46a7-8c96-4ca2365a4b74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:09.043108 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-be360cb5-e000-46a7-8c96-4ca2365a4b74 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1471 microversion: 2.1 time: 1.119417 Aug 27 04:38:09.046871 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 912/1825] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:07 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1471 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:09.271431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-605525ed-9e92-4197-922c-728b166bf952 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Action: 'create', calling method: .version_select at 0x7f1f2155a280>, body: {"keypair": {"name": "tempest-keypair-381572848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+NdTAiQgAPDMF7ITpy8w3T97wHY26KO/o4kmTBxwusCIEKIEMMhgcyCpAtmurUcZsPxEyvEgk2QH9YvBHkNiI2XDyRh3yKWFrrNK953hycvhXWcDN26WeNSbHrnACCpQ=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:09.288559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:09.334680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-605525ed-9e92-4197-922c-728b166bf952 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:09.356972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-605525ed-9e92-4197-922c-728b166bf952 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for user fa957d43a57643d9a636e8e759d07ce8 and project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:09.445364 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-605525ed-9e92-4197-922c-728b166bf952 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.396891 Aug 27 04:38:09.448746 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 913/1826] 10.222.0.79 () {62 vars in 1199 bytes} [Sat Aug 27 04:38:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 401 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 04:38:09.459431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3344b80d-b978-4d31-aeae-3d06c27d8bcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:09.459981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3344b80d-b978-4d31-aeae-3d06c27d8bcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:09.478607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3344b80d-b978-4d31-aeae-3d06c27d8bcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:09.480780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3344b80d-b978-4d31-aeae-3d06c27d8bcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:09.481446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3344b80d-b978-4d31-aeae-3d06c27d8bcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:09.482376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3344b80d-b978-4d31-aeae-3d06c27d8bcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:09.485862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3344b80d-b978-4d31-aeae-3d06c27d8bcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:09.486514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3344b80d-b978-4d31-aeae-3d06c27d8bcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:09.772230 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3344b80d-b978-4d31-aeae-3d06c27d8bcb tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "POST /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131/action" status: 202 len: 0 microversion: 2.1 time: 0.321998 Aug 27 04:38:09.781117 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 914/1827] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:38:09 2022] POST /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:38:09.789432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-32c4db83-607e-44bb-bc7a-46418a6f1fb2 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Calling method '.version_select at 0x7f1f215fa550>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:09.832197 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-32c4db83-607e-44bb-bc7a-46418a6f1fb2 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-381572848" status: 200 len: 512 microversion: 2.2 time: 0.048923 Aug 27 04:38:09.832833 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 915/1828] 10.222.0.79 () {60 vars in 1255 bytes} [Sat Aug 27 04:38:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-381572848 => generated 512 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:09.853802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-21c4b3c1-14d2-4113-8e9c-4b56e0f185c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:09.858380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-21c4b3c1-14d2-4113-8e9c-4b56e0f185c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:09.890345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21c4b3c1-14d2-4113-8e9c-4b56e0f185c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:09.890851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21c4b3c1-14d2-4113-8e9c-4b56e0f185c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:09.891295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21c4b3c1-14d2-4113-8e9c-4b56e0f185c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:09.892019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21c4b3c1-14d2-4113-8e9c-4b56e0f185c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:09.908273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21c4b3c1-14d2-4113-8e9c-4b56e0f185c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:09.908858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21c4b3c1-14d2-4113-8e9c-4b56e0f185c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:10.156567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:38:10.157061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:38:10.157474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:38:10.162974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:38:10.163671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:38:10.173512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:10.174274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:10.174916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:10.175831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:10.176501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:10.177359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:10.202591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Getting quotas for project a5e2ae48d5764048b5ad189114755aa8. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:10.212791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Getting quotas for user 307981144d4141ed9d609d88ea2e954e and project a5e2ae48d5764048b5ad189114755aa8. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:10.232362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:38:10.235035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:38:10.300338 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a0241f0-8384-4c3b-9376-6015e1327f08 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.422161 Aug 27 04:38:10.301500 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 914/1829] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:38:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:38:10.306430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc616b0a-9d49-4c52-8c62-59614970298a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:10.307246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bc616b0a-9d49-4c52-8c62-59614970298a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:10.314631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc616b0a-9d49-4c52-8c62-59614970298a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:10.315385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc616b0a-9d49-4c52-8c62-59614970298a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:10.316009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc616b0a-9d49-4c52-8c62-59614970298a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:10.316923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc616b0a-9d49-4c52-8c62-59614970298a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:10.317551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc616b0a-9d49-4c52-8c62-59614970298a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:10.318151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc616b0a-9d49-4c52-8c62-59614970298a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:10.524645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-21c4b3c1-14d2-4113-8e9c-4b56e0f185c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:10.540369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-21c4b3c1-14d2-4113-8e9c-4b56e0f185c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:10.549053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-21c4b3c1-14d2-4113-8e9c-4b56e0f185c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:10.551084 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-21c4b3c1-14d2-4113-8e9c-4b56e0f185c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.713710 Aug 27 04:38:10.560211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bc616b0a-9d49-4c52-8c62-59614970298a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:10.584641 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 916/1830] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:09 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:10.602845 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc616b0a-9d49-4c52-8c62-59614970298a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1470 microversion: 2.1 time: 0.295500 Aug 27 04:38:10.606292 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 915/1831] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:10 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1470 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:10.623122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-74248342-7aa6-4c61-a957-eda83bb5ae8e req-6fd62260-8b93-4bc6-bbce-5ff496b94d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131", "name": "network-vif-plugged", "status": "completed", "tag": "024c4406-8d1a-4d0a-8070-35c91fc50f3f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:10.630365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9bd0e433-0dd1-480a-977a-0fc45cf624e0 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Calling method '.version_select at 0x7f1f21564820>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:10.635325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-74248342-7aa6-4c61-a957-eda83bb5ae8e req-6fd62260-8b93-4bc6-bbce-5ff496b94d8a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:10.635932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-74248342-7aa6-4c61-a957-eda83bb5ae8e req-6fd62260-8b93-4bc6-bbce-5ff496b94d8a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:10.636477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-74248342-7aa6-4c61-a957-eda83bb5ae8e req-6fd62260-8b93-4bc6-bbce-5ff496b94d8a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:10.652482 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-74248342-7aa6-4c61-a957-eda83bb5ae8e req-6fd62260-8b93-4bc6-bbce-5ff496b94d8a service nova] Creating event network-vif-plugged:024c4406-8d1a-4d0a-8070-35c91fc50f3f for instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 on n-h2-854823-1 Aug 27 04:38:10.666585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-74248342-7aa6-4c61-a957-eda83bb5ae8e req-6fd62260-8b93-4bc6-bbce-5ff496b94d8a service nova] Instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:38:10.678037 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9bd0e433-0dd1-480a-977a-0fc45cf624e0 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-381572848" status: 204 len: 0 microversion: 2.2 time: 0.088079 Aug 27 04:38:10.679278 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 917/1832] 10.222.0.79 () {60 vars in 1258 bytes} [Sat Aug 27 04:38:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-381572848 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:10.705350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ea26c5a0-879d-4f2a-b319-f7df25498641 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:10.705846 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-74248342-7aa6-4c61-a957-eda83bb5ae8e req-6fd62260-8b93-4bc6-bbce-5ff496b94d8a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092753 Aug 27 04:38:10.706891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ea26c5a0-879d-4f2a-b319-f7df25498641 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:10.709116 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 916/1833] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:10.725001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79915332-4050-4d81-98a3-079cb773bd26 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Action: 'create', calling method: .version_select at 0x7f1f25cc29d0>, body: {"keypair": {"name": "tempest-keypair-918273752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBMrD2rwzmqmO+ClMyFzRHuhL+efy8k+dkQTQAydUfBifArR8evD8PRwf/BW5ALk/ypCms6R0Wyh3jJwyacQTVPGmk5seIc+g2qWODWVj+Lx4kWR/8sqG7g1sLOwMTI7w=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:10.756577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:10.769875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-79915332-4050-4d81-98a3-079cb773bd26 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:10.777166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-79915332-4050-4d81-98a3-079cb773bd26 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for user fa957d43a57643d9a636e8e759d07ce8 and project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:10.817490 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-79915332-4050-4d81-98a3-079cb773bd26 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.106031 Aug 27 04:38:10.818466 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 917/1834] 10.222.0.79 () {62 vars in 1199 bytes} [Sat Aug 27 04:38:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 04:38:10.833958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f00394b-5a05-443b-9464-3328d9887eae tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Calling method '.version_select at 0x7f1f25e48550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:10.865611 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f00394b-5a05-443b-9464-3328d9887eae tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-918273752" status: 204 len: 0 microversion: 2.2 time: 0.040064 Aug 27 04:38:10.866554 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 918/1835] 10.222.0.79 () {60 vars in 1258 bytes} [Sat Aug 27 04:38:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-918273752 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:38:10.878487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ea26c5a0-879d-4f2a-b319-f7df25498641 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:10.879921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0332bbef-9498-48e9-9a04-049bc8bc584a tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Action: 'create', calling method: .version_select at 0x7f1f211a3280>, body: {"keypair": {"name": "tempest-keypair-1926763875", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:10.888486 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ea26c5a0-879d-4f2a-b319-f7df25498641 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 200 len: 1225 microversion: 2.1 time: 0.198592 Aug 27 04:38:10.890074 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 918/1836] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:10 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 1225 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:10.915521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-0332bbef-9498-48e9-9a04-049bc8bc584a tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:10.927779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-0332bbef-9498-48e9-9a04-049bc8bc584a tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for user fa957d43a57643d9a636e8e759d07ce8 and project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:10.977293 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0332bbef-9498-48e9-9a04-049bc8bc584a tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.101202 Aug 27 04:38:10.983664 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 919/1837] 10.222.0.79 () {62 vars in 1199 bytes} [Sat Aug 27 04:38:10 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 04:38:11.001717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2b5c4634-d735-4328-85e1-561536e7cb73 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Calling method '.version_select at 0x7f1f2156d700>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:11.056948 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2b5c4634-d735-4328-85e1-561536e7cb73 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926763875" status: 204 len: 0 microversion: 2.2 time: 0.071551 Aug 27 04:38:11.057975 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 919/1838] 10.222.0.79 () {60 vars in 1261 bytes} [Sat Aug 27 04:38:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926763875 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:38:11.074407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12577311-8281-4775-a46a-b6644f22b7b4 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Action: 'create', calling method: .version_select at 0x7f1f211a33a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-666721712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbxVWm4GAs0DNbGfVZyG9bFXGXpVt1UMZFSKFCRtq3HWUZ4Ch4kaIB60RKxww60o/DqnjXjuXmd2fRpDG2RR2C9tKwMufZX2wFOEqHsFlIvwMWe3nGoENY3G2S4x7zbIA=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:11.128751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-12577311-8281-4775-a46a-b6644f22b7b4 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:11.145935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-12577311-8281-4775-a46a-b6644f22b7b4 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for user fa957d43a57643d9a636e8e759d07ce8 and project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:11.213802 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12577311-8281-4775-a46a-b6644f22b7b4 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.143440 Aug 27 04:38:11.215133 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 920/1839] 10.222.0.79 () {62 vars in 1199 bytes} [Sat Aug 27 04:38:11 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 04:38:11.229384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-49faa53b-78f3-4fc3-a924-306697e8f9bb tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Action: 'create', calling method: .version_select at 0x7f1f21564820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1137406739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkoIwcix4s+qsre+3cc4Vnzueqx4fKF0Ahh+uBTr9FWdIulkdBM8BsCpfTJ+xbknJi37VSR93PAzlgSUWcoFCW0ioQM3FIWGEIlIxEBFpCReFyRX11wsjrRLRuCof7v2w=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:11.261552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-49faa53b-78f3-4fc3-a924-306697e8f9bb tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:11.276214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-49faa53b-78f3-4fc3-a924-306697e8f9bb tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for user fa957d43a57643d9a636e8e759d07ce8 and project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:11.338980 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-49faa53b-78f3-4fc3-a924-306697e8f9bb tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.113805 Aug 27 04:38:11.353941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e5a1985-3d9e-4cdd-8974-8262afbfa9e2 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Action: 'create', calling method: .version_select at 0x7f1f25cad9d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1173977007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE/s0mZLAzQgNBmjdpKCSJWRCYknxWMwu8/SfvOupk8+e73dzvl6/vYvCVVerzpy03yXSykT/T9X5B9MswwSumwbTZMf0iD5TrkYK3U7bkixgnX8ndxLFyqB0xQ9oulZQ=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:11.354273 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 920/1840] 10.222.0.79 () {62 vars in 1199 bytes} [Sat Aug 27 04:38:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 04:38:11.391258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4e5a1985-3d9e-4cdd-8974-8262afbfa9e2 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:11.402263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4e5a1985-3d9e-4cdd-8974-8262afbfa9e2 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for user fa957d43a57643d9a636e8e759d07ce8 and project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:11.462177 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e5a1985-3d9e-4cdd-8974-8262afbfa9e2 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.112396 Aug 27 04:38:11.463209 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 921/1841] 10.222.0.79 () {62 vars in 1199 bytes} [Sat Aug 27 04:38:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 04:38:11.476885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-55b3f03a-f185-4ef3-b256-e7bc0ec3f37a tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Calling method '.version_select at 0x7f1f215d3e50>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:11.481387 n-d-854823-1 devstack@n-api.service[128870]: WARNING oslo_db.sqlalchemy.utils [None req-55b3f03a-f185-4ef3-b256-e7bc0ec3f37a tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 04:38:11.488110 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-55b3f03a-f185-4ef3-b256-e7bc0ec3f37a tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.017112 Aug 27 04:38:11.505408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a67bdc69-dcf5-4357-86d0-ed1a0eb645ed tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Calling method '.version_select at 0x7f1f25cc23a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:11.508342 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 921/1842] 10.222.0.79 () {60 vars in 1177 bytes} [Sat Aug 27 04:38:11 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:11.539271 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a67bdc69-dcf5-4357-86d0-ed1a0eb645ed tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1173977007" status: 204 len: 0 microversion: 2.2 time: 0.038604 Aug 27 04:38:11.550859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-06a23361-1bd9-4136-b692-26a38b71d65f tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Calling method '.version_select at 0x7f1f215f5e50>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:11.556513 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 922/1843] 10.222.0.79 () {60 vars in 1321 bytes} [Sat Aug 27 04:38:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1173977007 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:11.580578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f38641b-05a6-42b8-9e45-35931586597a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:11.581598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f38641b-05a6-42b8-9e45-35931586597a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:11.591009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f38641b-05a6-42b8-9e45-35931586597a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:11.591993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f38641b-05a6-42b8-9e45-35931586597a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:11.595321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f38641b-05a6-42b8-9e45-35931586597a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:11.597390 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-06a23361-1bd9-4136-b692-26a38b71d65f tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1137406739" status: 204 len: 0 microversion: 2.2 time: 0.051216 Aug 27 04:38:11.602665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f38641b-05a6-42b8-9e45-35931586597a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:11.603228 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 922/1844] 10.222.0.79 () {60 vars in 1321 bytes} [Sat Aug 27 04:38:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1137406739 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:11.604327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f38641b-05a6-42b8-9e45-35931586597a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:11.604828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f38641b-05a6-42b8-9e45-35931586597a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:11.615299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e957300a-a6b8-4633-98b8-94ed8bd41fae tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Calling method '.version_select at 0x7f1f2156b160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:11.651849 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e957300a-a6b8-4633-98b8-94ed8bd41fae tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-666721712" status: 204 len: 0 microversion: 2.2 time: 0.040036 Aug 27 04:38:11.653250 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 923/1845] 10.222.0.79 () {60 vars in 1318 bytes} [Sat Aug 27 04:38:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-666721712 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:11.660206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8154e1a7-f8de-4f88-8fdf-1df7ba9a6b98 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:11.661558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8154e1a7-f8de-4f88-8fdf-1df7ba9a6b98 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:11.672363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8154e1a7-f8de-4f88-8fdf-1df7ba9a6b98 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:11.672888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8154e1a7-f8de-4f88-8fdf-1df7ba9a6b98 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:11.673387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8154e1a7-f8de-4f88-8fdf-1df7ba9a6b98 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:11.674496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8154e1a7-f8de-4f88-8fdf-1df7ba9a6b98 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:11.675324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8154e1a7-f8de-4f88-8fdf-1df7ba9a6b98 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:11.676065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8154e1a7-f8de-4f88-8fdf-1df7ba9a6b98 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:11.870371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f38641b-05a6-42b8-9e45-35931586597a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:11.886885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f38641b-05a6-42b8-9e45-35931586597a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:11.888887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f38641b-05a6-42b8-9e45-35931586597a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:11.890747 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f38641b-05a6-42b8-9e45-35931586597a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.316744 Aug 27 04:38:11.891854 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 923/1846] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:11 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:11.897323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f9cea54-4a5d-4c30-946b-6d3a22e50143 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Action: 'create', calling method: .version_select at 0x7f1f25cc18b0>, body: {"keypair": {"name": "tempest-keypair-1804641748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6P7q/Spp+iINPG8LH0oCqBJYK8EvLtmAdlxUtmTTxX0YF0suUqmXQZXXF9ckKnVRgTNw/1ERoMvt2QvmoJ16wFPCI4uH9p11XSW93ceeiyeUxljiBElxuT50s7Rdjhaw=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:11.948742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4f9cea54-4a5d-4c30-946b-6d3a22e50143 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:11.961415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4f9cea54-4a5d-4c30-946b-6d3a22e50143 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for user fa957d43a57643d9a636e8e759d07ce8 and project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:12.008009 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f9cea54-4a5d-4c30-946b-6d3a22e50143 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.114653 Aug 27 04:38:12.008952 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 924/1847] 10.222.0.79 () {62 vars in 1199 bytes} [Sat Aug 27 04:38:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 04:38:12.014951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3182d407-7838-44ca-aa4d-8e7a8383f2b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:12.019165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3182d407-7838-44ca-aa4d-8e7a8383f2b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:12.029510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3182d407-7838-44ca-aa4d-8e7a8383f2b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:12.030368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3182d407-7838-44ca-aa4d-8e7a8383f2b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:12.031062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3182d407-7838-44ca-aa4d-8e7a8383f2b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:12.032058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3182d407-7838-44ca-aa4d-8e7a8383f2b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:12.034692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3182d407-7838-44ca-aa4d-8e7a8383f2b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:12.035416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3182d407-7838-44ca-aa4d-8e7a8383f2b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:12.172260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3182d407-7838-44ca-aa4d-8e7a8383f2b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:12.181125 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3182d407-7838-44ca-aa4d-8e7a8383f2b7 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 200 len: 1277 microversion: 2.1 time: 0.170094 Aug 27 04:38:12.182207 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 925/1848] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:12 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:12.189421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cdf61809-6b1f-4508-bb25-5dcf44e85233 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Calling method '.version_select at 0x7f1f211a3a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:12.218646 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cdf61809-6b1f-4508-bb25-5dcf44e85233 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-1804641748" status: 200 len: 513 microversion: 2.2 time: 0.032660 Aug 27 04:38:12.219824 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 926/1849] 10.222.0.79 () {60 vars in 1258 bytes} [Sat Aug 27 04:38:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1804641748 => generated 513 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:12.236473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82706b72-9bfa-4d09-9b63-0e94e667280f tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Calling method '.version_select at 0x7f1f25d23280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:12.241542 n-d-854823-1 devstack@n-api.service[128869]: WARNING oslo_db.sqlalchemy.utils [None req-82706b72-9bfa-4d09-9b63-0e94e667280f tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 04:38:12.250305 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-82706b72-9bfa-4d09-9b63-0e94e667280f tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.018784 Aug 27 04:38:12.251472 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 927/1850] 10.222.0.79 () {60 vars in 1177 bytes} [Sat Aug 27 04:38:12 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:12.266651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40d0594b-5eac-49a9-b9e1-3e8609de0dc9 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Calling method '.version_select at 0x7f1f25cc1160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:12.310891 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40d0594b-5eac-49a9-b9e1-3e8609de0dc9 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804641748" status: 204 len: 0 microversion: 2.2 time: 0.050847 Aug 27 04:38:12.311945 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 928/1851] 10.222.0.79 () {60 vars in 1261 bytes} [Sat Aug 27 04:38:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804641748 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:12.329497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a0b97d3-097d-4688-8eed-12b4de824872 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Action: 'create', calling method: .version_select at 0x7f1f25cc18b0>, body: {"keypair": {"name": "tempest-keypair-1023514559", "type": "x509"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:12.359179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3a0b97d3-097d-4688-8eed-12b4de824872 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:12.369285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3a0b97d3-097d-4688-8eed-12b4de824872 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for user fa957d43a57643d9a636e8e759d07ce8 and project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:12.387982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.processutils [None req-3a0b97d3-097d-4688-8eed-12b4de824872 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpnpwwdg0g/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpnpwwdg0g/temp.key -subj /CN=fa957d43a57643d9a636e8e759d07ce8 -extensions v3_req_client {{(pid=128869) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 27 04:38:12.703329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.processutils [None req-3a0b97d3-097d-4688-8eed-12b4de824872 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpnpwwdg0g/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpnpwwdg0g/temp.key -subj /CN=fa957d43a57643d9a636e8e759d07ce8 -extensions v3_req_client" returned: 0 in 0.314s {{(pid=128869) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 27 04:38:12.705422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.processutils [None req-3a0b97d3-097d-4688-8eed-12b4de824872 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpnpwwdg0g/temp.key -password pass: {{(pid=128869) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 27 04:38:12.741918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.processutils [None req-3a0b97d3-097d-4688-8eed-12b4de824872 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpnpwwdg0g/temp.key -password pass:" returned: 0 in 0.036s {{(pid=128869) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 27 04:38:12.818301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3a0b97d3-097d-4688-8eed-12b4de824872 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:12.824154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3a0b97d3-097d-4688-8eed-12b4de824872 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Getting quotas for user fa957d43a57643d9a636e8e759d07ce8 and project 136c270570d64beda7b88a7750fa1cb0. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:12.846779 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a0b97d3-097d-4688-8eed-12b4de824872 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.527076 Aug 27 04:38:12.853895 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 929/1852] 10.222.0.79 () {62 vars in 1198 bytes} [Sat Aug 27 04:38:12 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 535 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:38:12.861995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1c85a8b-6144-43e1-afdb-bcaf61ee98d0 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Calling method '.version_select at 0x7f1f211a3040>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:12.868251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:12.874647 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1c85a8b-6144-43e1-afdb-bcaf61ee98d0 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-1023514559" status: 200 len: 1534 microversion: 2.2 time: 0.019091 Aug 27 04:38:12.875239 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 930/1853] 10.222.0.79 () {60 vars in 1258 bytes} [Sat Aug 27 04:38:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1023514559 => generated 1534 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:12.894790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8154e1a7-f8de-4f88-8fdf-1df7ba9a6b98 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:12.913411 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8154e1a7-f8de-4f88-8fdf-1df7ba9a6b98 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1470 microversion: 2.1 time: 1.250051 Aug 27 04:38:12.914337 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 924/1854] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:11 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1470 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:12.919375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6bfe0873-8bd1-42fe-a340-f8fa007a8f20 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Calling method '.version_select at 0x7f1f215f2670>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:12.928907 n-d-854823-1 devstack@n-api.service[128870]: WARNING oslo_db.sqlalchemy.utils [None req-6bfe0873-8bd1-42fe-a340-f8fa007a8f20 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 04:38:12.946329 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6bfe0873-8bd1-42fe-a340-f8fa007a8f20 tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.030670 Aug 27 04:38:12.947502 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 925/1855] 10.222.0.79 () {60 vars in 1177 bytes} [Sat Aug 27 04:38:12 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:12.952929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-76637341-4e43-4218-a3d8-3e9cac6322ab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:12.954148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-76637341-4e43-4218-a3d8-3e9cac6322ab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:12.961650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76637341-4e43-4218-a3d8-3e9cac6322ab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:12.962536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76637341-4e43-4218-a3d8-3e9cac6322ab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:12.963303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76637341-4e43-4218-a3d8-3e9cac6322ab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:12.964965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76637341-4e43-4218-a3d8-3e9cac6322ab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:12.965825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76637341-4e43-4218-a3d8-3e9cac6322ab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:12.968236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76637341-4e43-4218-a3d8-3e9cac6322ab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:13.072804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd45d267-d00e-427f-8f80-c827cb3be7b9 tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] Calling method '.version_select at 0x7f1f21977790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:13.084802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd45d267-d00e-427f-8f80-c827cb3be7b9 tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:13.085326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd45d267-d00e-427f-8f80-c827cb3be7b9 tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:13.085759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd45d267-d00e-427f-8f80-c827cb3be7b9 tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:13.086696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd45d267-d00e-427f-8f80-c827cb3be7b9 tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:13.087344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd45d267-d00e-427f-8f80-c827cb3be7b9 tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:13.087761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd45d267-d00e-427f-8f80-c827cb3be7b9 tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:13.110579 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd45d267-d00e-427f-8f80-c827cb3be7b9 tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] 10.222.0.79 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.233998 Aug 27 04:38:13.111190 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 931/1856] 10.222.0.79 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:12 2022] GET /compute/v2.1/limits => generated 511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:13.115924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb904873-0a0d-42f0-a0ed-b2837a28f86c tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] Calling method '.version_select at 0x7f1f25d23e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:13.138640 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb904873-0a0d-42f0-a0ed-b2837a28f86c tempest-KeyPairsV22TestJSON-1967694531 tempest-KeyPairsV22TestJSON-1967694531-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023514559" status: 204 len: 0 microversion: 2.2 time: 0.026065 Aug 27 04:38:13.139521 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 932/1857] 10.222.0.79 () {60 vars in 1261 bytes} [Sat Aug 27 04:38:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023514559 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:13.181713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-619e7b3b-0430-4753-a00a-e3d308e85fae tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-152690608", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:13.262960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-619e7b3b-0430-4753-a00a-e3d308e85fae tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:38:13.502958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-619e7b3b-0430-4753-a00a-e3d308e85fae tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] Getting quotas for project 379a432ede0b44ada4f0932633c44380. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:13.508729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-619e7b3b-0430-4753-a00a-e3d308e85fae tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] Getting quotas for user 0ef9e482d49f4a419c348ae0f23b8888 and project 379a432ede0b44ada4f0932633c44380. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:13.522191 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-619e7b3b-0430-4753-a00a-e3d308e85fae tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-619e7b3b-0430-4753-a00a-e3d308e85fae tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] Request method failure captured: Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 1751 Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ-0Gmd_IIzlNUmZ38SZmyWDFh0Xcz4FX-ypyIY6FixV6lZoS74GLTN3C9hiVSopsr2q8aHfHRnCQoivM3OUbbB0Y9zx10ds0_PUU6otgcvNeGY7yZICgKeKGcBk4kaNryEVnX4cfaMjd4xqEZTWgIbElLzmr1pUndjvtopG9IPnHiY Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 379a432ede0b44ada4f0932633c44380 Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-942441374 Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/379a432ede0b44ada4f0932633c44380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_379a432ede0b44ada4f0932633c44380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/379a432ede0b44ada4f0932633c44380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/379a432ede0b44ada4f0932633c44380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-942441374 Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 379a432ede0b44ada4f0932633c44380 Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-942441374 Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-942441374-project Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 0ef9e482d49f4a419c348ae0f23b8888 Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-942441374-project Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-152690608", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:38:13.524701 n-d-854823-1 devstack@n-api.service[128869]: exception: Maximum number of metadata items exceeds 128 Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-152690608', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:38:13.527776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-619e7b3b-0430-4753-a00a-e3d308e85fae tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-619e7b3b-0430-4753-a00a-e3d308e85fae tempest-AbsoluteLimitsNegativeTestJSON-942441374 tempest-AbsoluteLimitsNegativeTestJSON-942441374-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.353060 Aug 27 04:38:13.533280 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 933/1858] 10.222.0.79 () {60 vars in 1148 bytes} [Sat Aug 27 04:38:13 2022] POST /compute/v2.1/servers => generated 87 bytes in 355 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Aug 27 04:38:13.539942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-76637341-4e43-4218-a3d8-3e9cac6322ab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:13.553908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-76637341-4e43-4218-a3d8-3e9cac6322ab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:13.555653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-76637341-4e43-4218-a3d8-3e9cac6322ab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:13.556106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18e36331-f002-4e4a-8419-b6a6ff75fae9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:13.556909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18e36331-f002-4e4a-8419-b6a6ff75fae9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:13.559870 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-76637341-4e43-4218-a3d8-3e9cac6322ab tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.611021 Aug 27 04:38:13.563280 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 926/1859] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:12 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:13.583708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18e36331-f002-4e4a-8419-b6a6ff75fae9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:13.584320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18e36331-f002-4e4a-8419-b6a6ff75fae9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:13.586656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18e36331-f002-4e4a-8419-b6a6ff75fae9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:13.587587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18e36331-f002-4e4a-8419-b6a6ff75fae9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:13.588173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18e36331-f002-4e4a-8419-b6a6ff75fae9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:13.588794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18e36331-f002-4e4a-8419-b6a6ff75fae9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:13.677669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18e36331-f002-4e4a-8419-b6a6ff75fae9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:13.690111 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18e36331-f002-4e4a-8419-b6a6ff75fae9 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 200 len: 1283 microversion: 2.1 time: 0.157685 Aug 27 04:38:13.690873 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 934/1860] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:13 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 1283 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:13.934487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6d587870-a8c3-42bc-ad4f-7bd53922a32f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:13.935457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6d587870-a8c3-42bc-ad4f-7bd53922a32f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:13.943888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d587870-a8c3-42bc-ad4f-7bd53922a32f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:13.944543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d587870-a8c3-42bc-ad4f-7bd53922a32f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:13.945158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d587870-a8c3-42bc-ad4f-7bd53922a32f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:13.946076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d587870-a8c3-42bc-ad4f-7bd53922a32f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:13.946527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d587870-a8c3-42bc-ad4f-7bd53922a32f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:13.947128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d587870-a8c3-42bc-ad4f-7bd53922a32f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:14.283954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6d587870-a8c3-42bc-ad4f-7bd53922a32f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:14.287721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:14.293335 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6d587870-a8c3-42bc-ad4f-7bd53922a32f tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1470 microversion: 2.1 time: 0.362674 Aug 27 04:38:14.297486 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 927/1861] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:13 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1470 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:38:14.400944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79188e0d-b6ac-47a1-a0e7-d0e1dc3dcb3e tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] Action: 'create', calling method: .version_select at 0x7f1f211a34c0>, body: {"pool": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:14.583833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7c6b6642-6976-4b77-9f93-9466fcaf1307 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:14.584438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7c6b6642-6976-4b77-9f93-9466fcaf1307 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:14.597768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c6b6642-6976-4b77-9f93-9466fcaf1307 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:14.606557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c6b6642-6976-4b77-9f93-9466fcaf1307 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:14.607031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c6b6642-6976-4b77-9f93-9466fcaf1307 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:14.607832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c6b6642-6976-4b77-9f93-9466fcaf1307 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:14.608302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c6b6642-6976-4b77-9f93-9466fcaf1307 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:14.608755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c6b6642-6976-4b77-9f93-9466fcaf1307 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:15.057282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7c6b6642-6976-4b77-9f93-9466fcaf1307 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:15.077635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7c6b6642-6976-4b77-9f93-9466fcaf1307 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:15.080996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7c6b6642-6976-4b77-9f93-9466fcaf1307 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:15.084146 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7c6b6642-6976-4b77-9f93-9466fcaf1307 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.504473 Aug 27 04:38:15.086446 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 928/1862] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:14 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:15.106809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e1fe85a0-c7fd-4011-8fb6-c57567c76325 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:15.107850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e1fe85a0-c7fd-4011-8fb6-c57567c76325 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:15.134030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1fe85a0-c7fd-4011-8fb6-c57567c76325 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:15.135272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1fe85a0-c7fd-4011-8fb6-c57567c76325 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:15.139881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1fe85a0-c7fd-4011-8fb6-c57567c76325 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:15.141564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1fe85a0-c7fd-4011-8fb6-c57567c76325 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:15.145783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1fe85a0-c7fd-4011-8fb6-c57567c76325 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:15.146549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1fe85a0-c7fd-4011-8fb6-c57567c76325 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:15.469869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e1fe85a0-c7fd-4011-8fb6-c57567c76325 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:15.485854 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e1fe85a0-c7fd-4011-8fb6-c57567c76325 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 200 len: 1325 microversion: 2.1 time: 0.394783 Aug 27 04:38:15.486813 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 929/1863] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:15 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 1325 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:15.492515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f511f0bb-ff4f-4b4c-af0f-60b8cc517679 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:15.493661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f511f0bb-ff4f-4b4c-af0f-60b8cc517679 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:15.501211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f511f0bb-ff4f-4b4c-af0f-60b8cc517679 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:15.501915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f511f0bb-ff4f-4b4c-af0f-60b8cc517679 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:15.502544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f511f0bb-ff4f-4b4c-af0f-60b8cc517679 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:15.503704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f511f0bb-ff4f-4b4c-af0f-60b8cc517679 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:15.504325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f511f0bb-ff4f-4b4c-af0f-60b8cc517679 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:15.505314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f511f0bb-ff4f-4b4c-af0f-60b8cc517679 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:15.802192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f511f0bb-ff4f-4b4c-af0f-60b8cc517679 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:15.812121 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f511f0bb-ff4f-4b4c-af0f-60b8cc517679 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1470 microversion: 2.1 time: 0.322651 Aug 27 04:38:15.815563 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 930/1864] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:15 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1470 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:16.117646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-72c1dccc-df54-4573-992b-813527efdebe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:16.118450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-72c1dccc-df54-4573-992b-813527efdebe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:16.144746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72c1dccc-df54-4573-992b-813527efdebe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:16.149486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72c1dccc-df54-4573-992b-813527efdebe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:16.150589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72c1dccc-df54-4573-992b-813527efdebe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:16.153908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72c1dccc-df54-4573-992b-813527efdebe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:16.157949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72c1dccc-df54-4573-992b-813527efdebe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:16.159042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72c1dccc-df54-4573-992b-813527efdebe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:16.513719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-72c1dccc-df54-4573-992b-813527efdebe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:16.525922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-72c1dccc-df54-4573-992b-813527efdebe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:16.534584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-72c1dccc-df54-4573-992b-813527efdebe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:16.539702 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-72c1dccc-df54-4573-992b-813527efdebe tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.430621 Aug 27 04:38:16.541993 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 931/1865] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:16 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:16.989693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cad0a008-7950-47a0-b6ff-f85eaf01882c tempest-AbsoluteLimitsTestJSON-388728275 tempest-AbsoluteLimitsTestJSON-388728275-project] Calling method '.version_select at 0x7f1f214fe430>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:17.012409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cad0a008-7950-47a0-b6ff-f85eaf01882c tempest-AbsoluteLimitsTestJSON-388728275 tempest-AbsoluteLimitsTestJSON-388728275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:17.012937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cad0a008-7950-47a0-b6ff-f85eaf01882c tempest-AbsoluteLimitsTestJSON-388728275 tempest-AbsoluteLimitsTestJSON-388728275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:17.013397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cad0a008-7950-47a0-b6ff-f85eaf01882c tempest-AbsoluteLimitsTestJSON-388728275 tempest-AbsoluteLimitsTestJSON-388728275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:17.018148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cad0a008-7950-47a0-b6ff-f85eaf01882c tempest-AbsoluteLimitsTestJSON-388728275 tempest-AbsoluteLimitsTestJSON-388728275-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:17.018679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cad0a008-7950-47a0-b6ff-f85eaf01882c tempest-AbsoluteLimitsTestJSON-388728275 tempest-AbsoluteLimitsTestJSON-388728275-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:17.022160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cad0a008-7950-47a0-b6ff-f85eaf01882c tempest-AbsoluteLimitsTestJSON-388728275 tempest-AbsoluteLimitsTestJSON-388728275-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:17.068252 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cad0a008-7950-47a0-b6ff-f85eaf01882c tempest-AbsoluteLimitsTestJSON-388728275 tempest-AbsoluteLimitsTestJSON-388728275-project] 10.222.0.79 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.524915 Aug 27 04:38:17.080707 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 932/1866] 10.222.0.79 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:16 2022] GET /compute/v2.1/limits => generated 511 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:17.085676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-15bb8f3f-6a42-402f-8926-9d02bef7885d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:17.088248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-15bb8f3f-6a42-402f-8926-9d02bef7885d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:17.110089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15bb8f3f-6a42-402f-8926-9d02bef7885d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:17.111183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15bb8f3f-6a42-402f-8926-9d02bef7885d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:17.114294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15bb8f3f-6a42-402f-8926-9d02bef7885d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:17.115041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15bb8f3f-6a42-402f-8926-9d02bef7885d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:17.117585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15bb8f3f-6a42-402f-8926-9d02bef7885d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:17.119354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15bb8f3f-6a42-402f-8926-9d02bef7885d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:18.030940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-15bb8f3f-6a42-402f-8926-9d02bef7885d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:18.058721 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-15bb8f3f-6a42-402f-8926-9d02bef7885d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 200 len: 1325 microversion: 2.1 time: 0.970855 Aug 27 04:38:18.063081 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 933/1867] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:17 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 1325 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:18.274892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e62a74d6-f3de-4da8-9dcc-0d16bd1ce2e5 req-894714c8-d471-4181-8e83-311eacedd455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b745d9f9-3852-4b94-895c-bbe4e224ab54", "tag": "94b3bab1-5497-44e1-a48d-c247c2a75699"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:18.286154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e62a74d6-f3de-4da8-9dcc-0d16bd1ce2e5 req-894714c8-d471-4181-8e83-311eacedd455 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:18.286638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e62a74d6-f3de-4da8-9dcc-0d16bd1ce2e5 req-894714c8-d471-4181-8e83-311eacedd455 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:18.287074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e62a74d6-f3de-4da8-9dcc-0d16bd1ce2e5 req-894714c8-d471-4181-8e83-311eacedd455 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:18.312711 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e62a74d6-f3de-4da8-9dcc-0d16bd1ce2e5 req-894714c8-d471-4181-8e83-311eacedd455 service nova] Creating event network-changed:94b3bab1-5497-44e1-a48d-c247c2a75699 for instance b745d9f9-3852-4b94-895c-bbe4e224ab54 on n-h2-854823-1 Aug 27 04:38:18.343298 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e62a74d6-f3de-4da8-9dcc-0d16bd1ce2e5 req-894714c8-d471-4181-8e83-311eacedd455 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.278563 Aug 27 04:38:18.343971 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 934/1868] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:18.349395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98a5f0e4-423b-4af2-bf89-f83f3a397d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:18.350382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98a5f0e4-423b-4af2-bf89-f83f3a397d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:18.357579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a5f0e4-423b-4af2-bf89-f83f3a397d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:18.358390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a5f0e4-423b-4af2-bf89-f83f3a397d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:18.359060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a5f0e4-423b-4af2-bf89-f83f3a397d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:18.360002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a5f0e4-423b-4af2-bf89-f83f3a397d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:18.360829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a5f0e4-423b-4af2-bf89-f83f3a397d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:18.361491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a5f0e4-423b-4af2-bf89-f83f3a397d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:18.597873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-98a5f0e4-423b-4af2-bf89-f83f3a397d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:18.606253 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-98a5f0e4-423b-4af2-bf89-f83f3a397d86 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1470 microversion: 2.1 time: 0.261078 Aug 27 04:38:18.606824 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 935/1869] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:18 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1470 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:18.613210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f93702d7-731e-4809-ab8e-d8054d62655e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:18.613971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f93702d7-731e-4809-ab8e-d8054d62655e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:18.628395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93702d7-731e-4809-ab8e-d8054d62655e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:18.629066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93702d7-731e-4809-ab8e-d8054d62655e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:18.629733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93702d7-731e-4809-ab8e-d8054d62655e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:18.630474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93702d7-731e-4809-ab8e-d8054d62655e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:18.630937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93702d7-731e-4809-ab8e-d8054d62655e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:18.631366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93702d7-731e-4809-ab8e-d8054d62655e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:18.781994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f93702d7-731e-4809-ab8e-d8054d62655e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:18.795672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f93702d7-731e-4809-ab8e-d8054d62655e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:18.797163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f93702d7-731e-4809-ab8e-d8054d62655e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:18.798354 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f93702d7-731e-4809-ab8e-d8054d62655e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.190056 Aug 27 04:38:18.799115 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 936/1870] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:18 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:18.806398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-9f2e3f5b-135b-4c10-8ca9-98e8debdb987 req-e12aa8c0-4c95-43dc-9201-e8f9e3caa8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131", "name": "network-vif-unplugged", "status": "completed", "tag": "024c4406-8d1a-4d0a-8070-35c91fc50f3f"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:18.837163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9f2e3f5b-135b-4c10-8ca9-98e8debdb987 req-e12aa8c0-4c95-43dc-9201-e8f9e3caa8c1 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:18.837950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9f2e3f5b-135b-4c10-8ca9-98e8debdb987 req-e12aa8c0-4c95-43dc-9201-e8f9e3caa8c1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:18.838588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9f2e3f5b-135b-4c10-8ca9-98e8debdb987 req-e12aa8c0-4c95-43dc-9201-e8f9e3caa8c1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:18.851463 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-9f2e3f5b-135b-4c10-8ca9-98e8debdb987 req-e12aa8c0-4c95-43dc-9201-e8f9e3caa8c1 service nova] Creating event network-vif-unplugged:024c4406-8d1a-4d0a-8070-35c91fc50f3f for instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 on n-h1-854823-1 Aug 27 04:38:18.857598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-9f2e3f5b-135b-4c10-8ca9-98e8debdb987 req-e12aa8c0-4c95-43dc-9201-e8f9e3caa8c1 service nova] Instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:38:18.869019 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-9f2e3f5b-135b-4c10-8ca9-98e8debdb987 req-e12aa8c0-4c95-43dc-9201-e8f9e3caa8c1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068617 Aug 27 04:38:18.869873 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 937/1871] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:19.084395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bbf72b8e-ef39-42ac-9e9b-6758adcb733c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:19.085300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bbf72b8e-ef39-42ac-9e9b-6758adcb733c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:19.094883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbf72b8e-ef39-42ac-9e9b-6758adcb733c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:19.095610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbf72b8e-ef39-42ac-9e9b-6758adcb733c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:19.096861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbf72b8e-ef39-42ac-9e9b-6758adcb733c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:19.106064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbf72b8e-ef39-42ac-9e9b-6758adcb733c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:19.106064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbf72b8e-ef39-42ac-9e9b-6758adcb733c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:19.106267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbf72b8e-ef39-42ac-9e9b-6758adcb733c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:19.285016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bbf72b8e-ef39-42ac-9e9b-6758adcb733c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:19.297340 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bbf72b8e-ef39-42ac-9e9b-6758adcb733c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 200 len: 1325 microversion: 2.1 time: 0.216077 Aug 27 04:38:19.298267 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 938/1872] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:19 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 1325 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:19.629523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b1577be5-9fe5-44b4-af0e-37ce1da53416 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:19.630261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b1577be5-9fe5-44b4-af0e-37ce1da53416 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:19.643052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1577be5-9fe5-44b4-af0e-37ce1da53416 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:19.643540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1577be5-9fe5-44b4-af0e-37ce1da53416 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:19.644003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1577be5-9fe5-44b4-af0e-37ce1da53416 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:19.644759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1577be5-9fe5-44b4-af0e-37ce1da53416 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:19.645215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1577be5-9fe5-44b4-af0e-37ce1da53416 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:19.645635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1577be5-9fe5-44b4-af0e-37ce1da53416 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:19.807654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b1577be5-9fe5-44b4-af0e-37ce1da53416 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:19.816417 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b1577be5-9fe5-44b4-af0e-37ce1da53416 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1470 microversion: 2.1 time: 0.190728 Aug 27 04:38:19.817625 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 939/1873] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:19 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:38:19.825309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7f3ed36b-988b-4f6b-97e3-11598c704e51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:19.827026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7f3ed36b-988b-4f6b-97e3-11598c704e51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:19.833662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f3ed36b-988b-4f6b-97e3-11598c704e51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:19.834213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f3ed36b-988b-4f6b-97e3-11598c704e51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:19.834665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f3ed36b-988b-4f6b-97e3-11598c704e51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:19.835620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f3ed36b-988b-4f6b-97e3-11598c704e51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:19.836271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f3ed36b-988b-4f6b-97e3-11598c704e51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:19.836899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f3ed36b-988b-4f6b-97e3-11598c704e51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:19.993861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7f3ed36b-988b-4f6b-97e3-11598c704e51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:20.003446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7f3ed36b-988b-4f6b-97e3-11598c704e51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:20.005044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7f3ed36b-988b-4f6b-97e3-11598c704e51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:20.006342 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7f3ed36b-988b-4f6b-97e3-11598c704e51 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.184852 Aug 27 04:38:20.006894 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 940/1874] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:19 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:38:20.016838 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-79188e0d-b6ac-47a1-a0e7-d0e1dc3dcb3e tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.840189 Aug 27 04:38:20.018983 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 935/1875] 10.222.0.79 () {60 vars in 1170 bytes} [Sat Aug 27 04:38:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:20.031346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5f6fae6d-690e-4faf-994c-ad9c82b01f59 tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] Calling method '.version_select at 0x7f1f21564f70>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:20.308301 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5f6fae6d-690e-4faf-994c-ad9c82b01f59 tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/9f4d4e45-eba3-408f-bad1-da59ea2e564a" status: 200 len: 142 microversion: 2.1 time: 0.281450 Aug 27 04:38:20.308981 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 941/1876] 10.222.0.79 () {58 vars in 1260 bytes} [Sat Aug 27 04:38:20 2022] GET /compute/v2.1/os-floating-ips/9f4d4e45-eba3-408f-bad1-da59ea2e564a => generated 142 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:20.324176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3cf913b4-7de1-4140-9ada-cafc9e9dbe89 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:20.326856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e69b045b-d670-46a1-b3f8-e300940a322b tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] Calling method '.version_select at 0x7f1f21512f70>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:20.333467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3cf913b4-7de1-4140-9ada-cafc9e9dbe89 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:20.343187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cf913b4-7de1-4140-9ada-cafc9e9dbe89 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:20.344357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cf913b4-7de1-4140-9ada-cafc9e9dbe89 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:20.346682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cf913b4-7de1-4140-9ada-cafc9e9dbe89 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:20.347999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cf913b4-7de1-4140-9ada-cafc9e9dbe89 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:20.348979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cf913b4-7de1-4140-9ada-cafc9e9dbe89 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:20.351689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cf913b4-7de1-4140-9ada-cafc9e9dbe89 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:20.824072 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e69b045b-d670-46a1-b3f8-e300940a322b tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.505365 Aug 27 04:38:20.837596 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 942/1877] 10.222.0.79 () {58 vars in 1149 bytes} [Sat Aug 27 04:38:20 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:20.852082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c465d6e-1cbf-4842-bc0b-c62edf2f159d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:20.853347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1c465d6e-1cbf-4842-bc0b-c62edf2f159d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:20.869123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c465d6e-1cbf-4842-bc0b-c62edf2f159d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:20.871871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c465d6e-1cbf-4842-bc0b-c62edf2f159d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:20.872407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c465d6e-1cbf-4842-bc0b-c62edf2f159d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:20.873280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c465d6e-1cbf-4842-bc0b-c62edf2f159d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:20.873811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c465d6e-1cbf-4842-bc0b-c62edf2f159d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:20.874672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c465d6e-1cbf-4842-bc0b-c62edf2f159d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:21.243318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3cf913b4-7de1-4140-9ada-cafc9e9dbe89 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:21.269700 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3cf913b4-7de1-4140-9ada-cafc9e9dbe89 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 200 len: 1325 microversion: 2.1 time: 0.954273 Aug 27 04:38:21.270888 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 936/1878] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:20 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 1325 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:21.281088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8edddbc6-37be-4ac8-ba1f-df3df48a1ac3 tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] Calling method '.version_select at 0x7f1f25cc2280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:21.532203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1c465d6e-1cbf-4842-bc0b-c62edf2f159d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:21.551401 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1c465d6e-1cbf-4842-bc0b-c62edf2f159d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1470 microversion: 2.1 time: 0.711869 Aug 27 04:38:21.552635 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 943/1879] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:20 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1470 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:21.570096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-b396980c-9c57-43ee-9051-cd48f4b401f4 req-07cfa2ee-bebf-4fa9-8551-3a442933d58d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131", "tag": "024c4406-8d1a-4d0a-8070-35c91fc50f3f"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:21.584732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b396980c-9c57-43ee-9051-cd48f4b401f4 req-07cfa2ee-bebf-4fa9-8551-3a442933d58d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:21.585844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b396980c-9c57-43ee-9051-cd48f4b401f4 req-07cfa2ee-bebf-4fa9-8551-3a442933d58d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:21.587453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b396980c-9c57-43ee-9051-cd48f4b401f4 req-07cfa2ee-bebf-4fa9-8551-3a442933d58d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:21.604573 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b396980c-9c57-43ee-9051-cd48f4b401f4 req-07cfa2ee-bebf-4fa9-8551-3a442933d58d service nova] Creating event network-changed:024c4406-8d1a-4d0a-8070-35c91fc50f3f for instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 on n-h1-854823-1 Aug 27 04:38:21.611488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-b396980c-9c57-43ee-9051-cd48f4b401f4 req-07cfa2ee-bebf-4fa9-8551-3a442933d58d service nova] Instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:38:21.624952 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-b396980c-9c57-43ee-9051-cd48f4b401f4 req-07cfa2ee-bebf-4fa9-8551-3a442933d58d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070101 Aug 27 04:38:21.626204 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 944/1880] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:21.633559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-87d2df64-142c-4fa7-930d-c17538ef7b39 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:21.634536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-87d2df64-142c-4fa7-930d-c17538ef7b39 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:21.643114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87d2df64-142c-4fa7-930d-c17538ef7b39 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:21.646487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87d2df64-142c-4fa7-930d-c17538ef7b39 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:21.647168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87d2df64-142c-4fa7-930d-c17538ef7b39 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:21.649467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87d2df64-142c-4fa7-930d-c17538ef7b39 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:21.650137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87d2df64-142c-4fa7-930d-c17538ef7b39 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:21.651289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87d2df64-142c-4fa7-930d-c17538ef7b39 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:22.646358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-87d2df64-142c-4fa7-930d-c17538ef7b39 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:22.657399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-87d2df64-142c-4fa7-930d-c17538ef7b39 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:22.658875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-87d2df64-142c-4fa7-930d-c17538ef7b39 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:22.660116 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-87d2df64-142c-4fa7-930d-c17538ef7b39 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 1.031280 Aug 27 04:38:22.668994 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 945/1881] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:21 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:22.683776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-de50679d-1e9a-4d43-9059-e0b5ca46e153 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:22.684565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-de50679d-1e9a-4d43-9059-e0b5ca46e153 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:22.688287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:22.691917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de50679d-1e9a-4d43-9059-e0b5ca46e153 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:22.692474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de50679d-1e9a-4d43-9059-e0b5ca46e153 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:22.694633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de50679d-1e9a-4d43-9059-e0b5ca46e153 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:22.694633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de50679d-1e9a-4d43-9059-e0b5ca46e153 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:22.694633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de50679d-1e9a-4d43-9059-e0b5ca46e153 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:22.694633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de50679d-1e9a-4d43-9059-e0b5ca46e153 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:22.735203 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8edddbc6-37be-4ac8-ba1f-df3df48a1ac3 tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/9f4d4e45-eba3-408f-bad1-da59ea2e564a" status: 202 len: 0 microversion: 2.1 time: 1.463008 Aug 27 04:38:22.738650 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 937/1882] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:38:21 2022] DELETE /compute/v2.1/os-floating-ips/9f4d4e45-eba3-408f-bad1-da59ea2e564a => generated 0 bytes in 1467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:38:22.744485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f152e7e6-ed4f-4697-a175-849ff5cf3a2a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:22.745501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f152e7e6-ed4f-4697-a175-849ff5cf3a2a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:22.756153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f152e7e6-ed4f-4697-a175-849ff5cf3a2a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:22.757954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f152e7e6-ed4f-4697-a175-849ff5cf3a2a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:22.759176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f152e7e6-ed4f-4697-a175-849ff5cf3a2a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:22.760309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f152e7e6-ed4f-4697-a175-849ff5cf3a2a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:22.761328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f152e7e6-ed4f-4697-a175-849ff5cf3a2a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:22.762324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f152e7e6-ed4f-4697-a175-849ff5cf3a2a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:22.960825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f152e7e6-ed4f-4697-a175-849ff5cf3a2a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:22.973086 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f152e7e6-ed4f-4697-a175-849ff5cf3a2a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1470 microversion: 2.1 time: 0.233049 Aug 27 04:38:22.981039 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 938/1883] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:22 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1470 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:22.993435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-398d723c-a6e9-4ae3-972f-d6c0d82af88c tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] Action: 'create', calling method: .version_select at 0x7f1f2113e670>, body: {"pool": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:23.098341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:23.189467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-de50679d-1e9a-4d43-9059-e0b5ca46e153 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:23.199358 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-de50679d-1e9a-4d43-9059-e0b5ca46e153 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 200 len: 1325 microversion: 2.1 time: 0.528763 Aug 27 04:38:23.210495 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 946/1884] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:22 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 1325 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:23.517179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=52 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:23.559361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-00f144f9-f85a-4801-b592-c8b1340f27a7 req-a88485b7-b29f-479f-ac30-3523b5e0e021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516299cc-c878-4b8e-bb4d-4247ddbd90cf", "name": "network-vif-unplugged", "status": "completed", "tag": "326c17ad-2ce3-4c6b-854b-aeff6eeb991e"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:23.581406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-00f144f9-f85a-4801-b592-c8b1340f27a7 req-a88485b7-b29f-479f-ac30-3523b5e0e021 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:23.581887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-00f144f9-f85a-4801-b592-c8b1340f27a7 req-a88485b7-b29f-479f-ac30-3523b5e0e021 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:23.582598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-00f144f9-f85a-4801-b592-c8b1340f27a7 req-a88485b7-b29f-479f-ac30-3523b5e0e021 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:23.607758 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-00f144f9-f85a-4801-b592-c8b1340f27a7 req-a88485b7-b29f-479f-ac30-3523b5e0e021 service nova] Creating event network-vif-unplugged:326c17ad-2ce3-4c6b-854b-aeff6eeb991e for instance 516299cc-c878-4b8e-bb4d-4247ddbd90cf on n-h1-854823-1 Aug 27 04:38:23.617129 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-00f144f9-f85a-4801-b592-c8b1340f27a7 req-a88485b7-b29f-479f-ac30-3523b5e0e021 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060984 Aug 27 04:38:23.618031 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 947/1885] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:38:23.690806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cbe74989-c996-42e8-a543-5f26ab784547 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:23.691701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cbe74989-c996-42e8-a543-5f26ab784547 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:23.706881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbe74989-c996-42e8-a543-5f26ab784547 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:23.709473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbe74989-c996-42e8-a543-5f26ab784547 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:23.712682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbe74989-c996-42e8-a543-5f26ab784547 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:23.714549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbe74989-c996-42e8-a543-5f26ab784547 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:23.715393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbe74989-c996-42e8-a543-5f26ab784547 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:23.717023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbe74989-c996-42e8-a543-5f26ab784547 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:24.375817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cbe74989-c996-42e8-a543-5f26ab784547 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:24.396979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cbe74989-c996-42e8-a543-5f26ab784547 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:24.399015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cbe74989-c996-42e8-a543-5f26ab784547 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:24.401545 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cbe74989-c996-42e8-a543-5f26ab784547 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.716932 Aug 27 04:38:24.429165 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 948/1886] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:23 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:24.436861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ee8a8b13-c1b5-4f15-83f2-b7424282868c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:24.437490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ee8a8b13-c1b5-4f15-83f2-b7424282868c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:24.446018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee8a8b13-c1b5-4f15-83f2-b7424282868c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:24.447298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee8a8b13-c1b5-4f15-83f2-b7424282868c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:24.447941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee8a8b13-c1b5-4f15-83f2-b7424282868c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:24.449305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee8a8b13-c1b5-4f15-83f2-b7424282868c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:24.450091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee8a8b13-c1b5-4f15-83f2-b7424282868c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:24.450757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee8a8b13-c1b5-4f15-83f2-b7424282868c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:24.492398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:24.735704 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-398d723c-a6e9-4ae3-972f-d6c0d82af88c tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.752316 Aug 27 04:38:24.736340 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 939/1887] 10.222.0.79 () {60 vars in 1170 bytes} [Sat Aug 27 04:38:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:24.742184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-04749385-b3f3-4944-83f0-eb4462c9bf3e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:24.742932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-04749385-b3f3-4944-83f0-eb4462c9bf3e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:24.751081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04749385-b3f3-4944-83f0-eb4462c9bf3e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:24.751658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04749385-b3f3-4944-83f0-eb4462c9bf3e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:24.752148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04749385-b3f3-4944-83f0-eb4462c9bf3e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:24.752889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04749385-b3f3-4944-83f0-eb4462c9bf3e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:24.753349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04749385-b3f3-4944-83f0-eb4462c9bf3e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:24.753781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04749385-b3f3-4944-83f0-eb4462c9bf3e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:24.936102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-04749385-b3f3-4944-83f0-eb4462c9bf3e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:24.949867 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-04749385-b3f3-4944-83f0-eb4462c9bf3e tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 200 len: 1325 microversion: 2.1 time: 0.212111 Aug 27 04:38:24.951617 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 940/1888] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:24 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 1325 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:24.957166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0299b754-bae4-403b-b26d-223823ce3ac3 req-13486d3c-836d-4825-81b1-25a318ae205a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b745d9f9-3852-4b94-895c-bbe4e224ab54", "name": "network-vif-plugged", "status": "completed", "tag": "94b3bab1-5497-44e1-a48d-c247c2a75699"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:24.984508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0299b754-bae4-403b-b26d-223823ce3ac3 req-13486d3c-836d-4825-81b1-25a318ae205a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:24.986156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0299b754-bae4-403b-b26d-223823ce3ac3 req-13486d3c-836d-4825-81b1-25a318ae205a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:24.986911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0299b754-bae4-403b-b26d-223823ce3ac3 req-13486d3c-836d-4825-81b1-25a318ae205a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:25.008707 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0299b754-bae4-403b-b26d-223823ce3ac3 req-13486d3c-836d-4825-81b1-25a318ae205a service nova] Creating event network-vif-plugged:94b3bab1-5497-44e1-a48d-c247c2a75699 for instance b745d9f9-3852-4b94-895c-bbe4e224ab54 on n-h2-854823-1 Aug 27 04:38:25.019415 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0299b754-bae4-403b-b26d-223823ce3ac3 req-13486d3c-836d-4825-81b1-25a318ae205a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065933 Aug 27 04:38:25.021521 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 941/1889] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:25.046763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f2ac35f-b581-4e0f-9eb8-6a84fed3f970 tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] Calling method '.version_select at 0x7f1f211b2b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:25.649349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ee8a8b13-c1b5-4f15-83f2-b7424282868c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:25.666429 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ee8a8b13-c1b5-4f15-83f2-b7424282868c tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1470 microversion: 2.1 time: 1.235232 Aug 27 04:38:25.667012 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 949/1890] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:24 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1470 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:25.678671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-abc6792d-1203-4ec4-8852-cbe342eb223a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:25.682761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-abc6792d-1203-4ec4-8852-cbe342eb223a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:25.702278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abc6792d-1203-4ec4-8852-cbe342eb223a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:25.702926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abc6792d-1203-4ec4-8852-cbe342eb223a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:25.703378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abc6792d-1203-4ec4-8852-cbe342eb223a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:25.704177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abc6792d-1203-4ec4-8852-cbe342eb223a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:25.704717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abc6792d-1203-4ec4-8852-cbe342eb223a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:25.705151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abc6792d-1203-4ec4-8852-cbe342eb223a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:26.209464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-abc6792d-1203-4ec4-8852-cbe342eb223a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:26.255996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-abc6792d-1203-4ec4-8852-cbe342eb223a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:26.262538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-abc6792d-1203-4ec4-8852-cbe342eb223a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:26.266401 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-abc6792d-1203-4ec4-8852-cbe342eb223a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.595753 Aug 27 04:38:26.268911 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 950/1891] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:25 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:26.276883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-97be6b8d-b2c7-438f-8c5f-414bf7c05829 req-14512378-7c55-4c23-b3af-faa873c756eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "516299cc-c878-4b8e-bb4d-4247ddbd90cf", "tag": "326c17ad-2ce3-4c6b-854b-aeff6eeb991e"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:26.296820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-97be6b8d-b2c7-438f-8c5f-414bf7c05829 req-14512378-7c55-4c23-b3af-faa873c756eb service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:26.297724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-97be6b8d-b2c7-438f-8c5f-414bf7c05829 req-14512378-7c55-4c23-b3af-faa873c756eb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:26.298402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-97be6b8d-b2c7-438f-8c5f-414bf7c05829 req-14512378-7c55-4c23-b3af-faa873c756eb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:26.312851 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-97be6b8d-b2c7-438f-8c5f-414bf7c05829 req-14512378-7c55-4c23-b3af-faa873c756eb service nova] Creating event network-changed:326c17ad-2ce3-4c6b-854b-aeff6eeb991e for instance 516299cc-c878-4b8e-bb4d-4247ddbd90cf on n-h1-854823-1 Aug 27 04:38:26.318651 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-97be6b8d-b2c7-438f-8c5f-414bf7c05829 req-14512378-7c55-4c23-b3af-faa873c756eb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048225 Aug 27 04:38:26.319894 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 951/1892] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:26.327549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bd71b2c0-afe7-43eb-95c6-309968c6289b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:26.328555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bd71b2c0-afe7-43eb-95c6-309968c6289b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:26.335880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd71b2c0-afe7-43eb-95c6-309968c6289b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:26.336809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd71b2c0-afe7-43eb-95c6-309968c6289b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:26.338274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd71b2c0-afe7-43eb-95c6-309968c6289b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:26.339287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd71b2c0-afe7-43eb-95c6-309968c6289b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:26.339984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd71b2c0-afe7-43eb-95c6-309968c6289b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:26.340691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd71b2c0-afe7-43eb-95c6-309968c6289b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:26.673787 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f2ac35f-b581-4e0f-9eb8-6a84fed3f970 tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/811ac1db-0d01-4d1e-9ad4-b595b0f641f8" status: 202 len: 0 microversion: 2.1 time: 1.647778 Aug 27 04:38:26.674755 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 942/1893] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:38:25 2022] DELETE /compute/v2.1/os-floating-ips/811ac1db-0d01-4d1e-9ad4-b595b0f641f8 => generated 0 bytes in 1652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:38:26.682990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4fa2b3a6-65e0-469c-830f-17b566250868 tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] Calling method '.version_select at 0x7f1f2113e670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:26.700304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bd71b2c0-afe7-43eb-95c6-309968c6289b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:26.713547 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bd71b2c0-afe7-43eb-95c6-309968c6289b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 200 len: 1325 microversion: 2.1 time: 0.391998 Aug 27 04:38:26.725645 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 952/1894] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:26 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 1325 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:26.730415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2b7edece-997d-48a0-8487-7defac6666f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:26.731523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2b7edece-997d-48a0-8487-7defac6666f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:26.747695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b7edece-997d-48a0-8487-7defac6666f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:26.747695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b7edece-997d-48a0-8487-7defac6666f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:26.747695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b7edece-997d-48a0-8487-7defac6666f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:26.756781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b7edece-997d-48a0-8487-7defac6666f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:26.757707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b7edece-997d-48a0-8487-7defac6666f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:26.758342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b7edece-997d-48a0-8487-7defac6666f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:26.782893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-4fa2b3a6-65e0-469c-830f-17b566250868 tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 811ac1db-0d01-4d1e-9ad4-b595b0f641f8 could not be found", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:38:26.784485 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4fa2b3a6-65e0-469c-830f-17b566250868 tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] HTTP exception thrown: Floating IP not found for ID 811ac1db-0d01-4d1e-9ad4-b595b0f641f8 Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4fa2b3a6-65e0-469c-830f-17b566250868 tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] Request method failure captured: Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-floating-ips/811ac1db-0d01-4d1e-9ad4-b595b0f641f8 HTTP/1.1 Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ-25Z-GkDrau1K-FlC-jBScvmrbo3Ftw3Mt7wi8uaTHoflYOXf9NmGpNhL_ywoV4ysmRL5AGMl1ZTRSGv7Z5kk9V18NzQQBR1jP4k59Go8ZIUBij7kfijVN0Udzzv96XG-s9Bj3ouYZvJJcmNgBneEckVNFr14xYZQ1kBVcxQpPNsc Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 718f6cb7f3c2475aa0d83827b2cba16a Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-FloatingIPsTestJSON-562095013 Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/718f6cb7f3c2475aa0d83827b2cba16a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_718f6cb7f3c2475aa0d83827b2cba16a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/718f6cb7f3c2475aa0d83827b2cba16a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/718f6cb7f3c2475aa0d83827b2cba16a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-FloatingIPsTestJSON-562095013 Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 718f6cb7f3c2475aa0d83827b2cba16a Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FloatingIPsTestJSON-562095013 Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-FloatingIPsTestJSON-562095013-project Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: b4f38fc41a0941a4af437872af2daef0 Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-FloatingIPsTestJSON-562095013-project Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: exception: Floating IP not found for ID 811ac1db-0d01-4d1e-9ad4-b595b0f641f8 Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '811ac1db-0d01-4d1e-9ad4-b595b0f641f8'} Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 811ac1db-0d01-4d1e-9ad4-b595b0f641f8 could not be found Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39703d4f-c336-4413-a90f-875dc8796bdc'] Aug 27 04:38:26.787011 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 811ac1db-0d01-4d1e-9ad4-b595b0f641f8. Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 811ac1db-0d01-4d1e-9ad4-b595b0f641f8 Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 811ac1db-0d01-4d1e-9ad4-b595b0f641f8 Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4fa2b3a6-65e0-469c-830f-17b566250868 tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] Returning 404 to user: Floating IP not found for ID 811ac1db-0d01-4d1e-9ad4-b595b0f641f8 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4fa2b3a6-65e0-469c-830f-17b566250868 tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/811ac1db-0d01-4d1e-9ad4-b595b0f641f8" status: 404 len: 111 microversion: 2.1 time: 0.109968 Aug 27 04:38:26.795093 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 943/1895] 10.222.0.79 () {58 vars in 1260 bytes} [Sat Aug 27 04:38:26 2022] GET /compute/v2.1/os-floating-ips/811ac1db-0d01-4d1e-9ad4-b595b0f641f8 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:26.800916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-303b0e9d-0c9e-4ea8-870f-30e5accd6faa tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] Calling method '.version_select at 0x7f1f211b21f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:26.870181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-303b0e9d-0c9e-4ea8-870f-30e5accd6faa tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 811ac1db-0d01-4d1e-9ad4-b595b0f641f8 could not be found", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:38:26.870999 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-303b0e9d-0c9e-4ea8-870f-30e5accd6faa tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] HTTP exception thrown: Floating IP not found for ID 811ac1db-0d01-4d1e-9ad4-b595b0f641f8 Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-303b0e9d-0c9e-4ea8-870f-30e5accd6faa tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] Request method failure captured: Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-floating-ips/811ac1db-0d01-4d1e-9ad4-b595b0f641f8 HTTP/1.1 Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ-25Z-GkDrau1K-FlC-jBScvmrbo3Ftw3Mt7wi8uaTHoflYOXf9NmGpNhL_ywoV4ysmRL5AGMl1ZTRSGv7Z5kk9V18NzQQBR1jP4k59Go8ZIUBij7kfijVN0Udzzv96XG-s9Bj3ouYZvJJcmNgBneEckVNFr14xYZQ1kBVcxQpPNsc Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 718f6cb7f3c2475aa0d83827b2cba16a Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-FloatingIPsTestJSON-562095013 Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/718f6cb7f3c2475aa0d83827b2cba16a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_718f6cb7f3c2475aa0d83827b2cba16a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/718f6cb7f3c2475aa0d83827b2cba16a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/718f6cb7f3c2475aa0d83827b2cba16a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-FloatingIPsTestJSON-562095013 Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 718f6cb7f3c2475aa0d83827b2cba16a Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FloatingIPsTestJSON-562095013 Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-FloatingIPsTestJSON-562095013-project Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: b4f38fc41a0941a4af437872af2daef0 Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-FloatingIPsTestJSON-562095013-project Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: exception: Floating IP not found for ID 811ac1db-0d01-4d1e-9ad4-b595b0f641f8 Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '811ac1db-0d01-4d1e-9ad4-b595b0f641f8'} Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 811ac1db-0d01-4d1e-9ad4-b595b0f641f8 could not be found Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70208b42-8c65-497d-b7f1-eae0d4961ecb'] Aug 27 04:38:26.873031 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 811ac1db-0d01-4d1e-9ad4-b595b0f641f8. Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 811ac1db-0d01-4d1e-9ad4-b595b0f641f8 Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 811ac1db-0d01-4d1e-9ad4-b595b0f641f8 Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-303b0e9d-0c9e-4ea8-870f-30e5accd6faa tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] Returning 404 to user: Floating IP not found for ID 811ac1db-0d01-4d1e-9ad4-b595b0f641f8 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-303b0e9d-0c9e-4ea8-870f-30e5accd6faa tempest-FloatingIPsTestJSON-562095013 tempest-FloatingIPsTestJSON-562095013-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/811ac1db-0d01-4d1e-9ad4-b595b0f641f8" status: 404 len: 111 microversion: 2.1 time: 0.083416 Aug 27 04:38:26.881603 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 944/1896] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:38:26 2022] DELETE /compute/v2.1/os-floating-ips/811ac1db-0d01-4d1e-9ad4-b595b0f641f8 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:27.007897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=36 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:27.032912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:27.292493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-515ffe68-9671-4170-8971-3b1bc19b66a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:27.293344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-515ffe68-9671-4170-8971-3b1bc19b66a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:27.301235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-515ffe68-9671-4170-8971-3b1bc19b66a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:27.301878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-515ffe68-9671-4170-8971-3b1bc19b66a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:27.302470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-515ffe68-9671-4170-8971-3b1bc19b66a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:27.303295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-515ffe68-9671-4170-8971-3b1bc19b66a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:27.304209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-515ffe68-9671-4170-8971-3b1bc19b66a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:27.305128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-515ffe68-9671-4170-8971-3b1bc19b66a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:27.323088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2b7edece-997d-48a0-8487-7defac6666f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:27.344300 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2b7edece-997d-48a0-8487-7defac6666f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1463 microversion: 2.1 time: 0.617575 Aug 27 04:38:27.346706 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 953/1897] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:26 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1463 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:27.365965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-437e5f38-bf3c-4b55-ae9b-74e2df710ac7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:27.366922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-437e5f38-bf3c-4b55-ae9b-74e2df710ac7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:27.374163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-437e5f38-bf3c-4b55-ae9b-74e2df710ac7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:27.374920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-437e5f38-bf3c-4b55-ae9b-74e2df710ac7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:27.375517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-437e5f38-bf3c-4b55-ae9b-74e2df710ac7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:27.376397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-437e5f38-bf3c-4b55-ae9b-74e2df710ac7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:27.377163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-437e5f38-bf3c-4b55-ae9b-74e2df710ac7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:27.377759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-437e5f38-bf3c-4b55-ae9b-74e2df710ac7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:27.680415 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-437e5f38-bf3c-4b55-ae9b-74e2df710ac7 tempest-MigrationsAdminTest-239546011 tempest-MigrationsAdminTest-239546011-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1614 microversion: 2.1 time: 0.317955 Aug 27 04:38:27.692554 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 954/1898] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:27 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1614 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:38:27.712382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-27a97e5a-6707-429f-b52a-413e5fd93db5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:27.714245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-27a97e5a-6707-429f-b52a-413e5fd93db5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:27.718915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-515ffe68-9671-4170-8971-3b1bc19b66a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:27.730481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-515ffe68-9671-4170-8971-3b1bc19b66a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:27.732626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-515ffe68-9671-4170-8971-3b1bc19b66a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:27.733968 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-515ffe68-9671-4170-8971-3b1bc19b66a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.446510 Aug 27 04:38:27.734385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27a97e5a-6707-429f-b52a-413e5fd93db5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:27.735216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27a97e5a-6707-429f-b52a-413e5fd93db5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:27.736642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27a97e5a-6707-429f-b52a-413e5fd93db5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:27.737086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27a97e5a-6707-429f-b52a-413e5fd93db5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:27.737850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27a97e5a-6707-429f-b52a-413e5fd93db5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:27.738497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27a97e5a-6707-429f-b52a-413e5fd93db5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:27.749223 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 945/1899] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:27 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:38:27.754175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f732eb69-015f-428e-a89a-fd6b779115b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:27.754790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f732eb69-015f-428e-a89a-fd6b779115b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:27.764820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f732eb69-015f-428e-a89a-fd6b779115b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:27.765188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f732eb69-015f-428e-a89a-fd6b779115b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:27.765629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f732eb69-015f-428e-a89a-fd6b779115b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:27.766341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f732eb69-015f-428e-a89a-fd6b779115b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:27.766809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f732eb69-015f-428e-a89a-fd6b779115b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:27.767223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f732eb69-015f-428e-a89a-fd6b779115b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:27.775382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-27a97e5a-6707-429f-b52a-413e5fd93db5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:38:27.901332 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-27a97e5a-6707-429f-b52a-413e5fd93db5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 204 len: 0 microversion: 2.1 time: 0.192979 Aug 27 04:38:27.902899 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 955/1900] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:38:27 2022] DELETE /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:27.915824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aa0f1a3c-9145-4bb8-a769-ed422aa57f66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:27.917764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aa0f1a3c-9145-4bb8-a769-ed422aa57f66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:27.925868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa0f1a3c-9145-4bb8-a769-ed422aa57f66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:27.927182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa0f1a3c-9145-4bb8-a769-ed422aa57f66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:27.927970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa0f1a3c-9145-4bb8-a769-ed422aa57f66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:27.929582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa0f1a3c-9145-4bb8-a769-ed422aa57f66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:27.931172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa0f1a3c-9145-4bb8-a769-ed422aa57f66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:27.931944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa0f1a3c-9145-4bb8-a769-ed422aa57f66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:28.248563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f732eb69-015f-428e-a89a-fd6b779115b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:28.265511 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f732eb69-015f-428e-a89a-fd6b779115b8 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 200 len: 1522 microversion: 2.1 time: 0.514404 Aug 27 04:38:28.266779 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 946/1901] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:27 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:28.299853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-41cd9381-f93c-4dc1-a173-6184d8f6f686 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:28.300634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41cd9381-f93c-4dc1-a173-6184d8f6f686 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:28.315875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cd9381-f93c-4dc1-a173-6184d8f6f686 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:28.317871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cd9381-f93c-4dc1-a173-6184d8f6f686 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:28.320321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cd9381-f93c-4dc1-a173-6184d8f6f686 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:28.322157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cd9381-f93c-4dc1-a173-6184d8f6f686 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:28.324926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cd9381-f93c-4dc1-a173-6184d8f6f686 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:28.327406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cd9381-f93c-4dc1-a173-6184d8f6f686 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:28.414899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41cd9381-f93c-4dc1-a173-6184d8f6f686 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:38:28.453430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aa0f1a3c-9145-4bb8-a769-ed422aa57f66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:28.469817 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aa0f1a3c-9145-4bb8-a769-ed422aa57f66 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1469 microversion: 2.1 time: 0.561111 Aug 27 04:38:28.470413 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 956/1902] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:27 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1469 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:28.485007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-0c21a25d-0c5f-48f7-9eae-d18571f61489 req-ab0e05ab-34c2-4fa0-829b-cbb923d1d376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131", "name": "network-vif-plugged", "status": "completed", "tag": "024c4406-8d1a-4d0a-8070-35c91fc50f3f"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:28.501399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0c21a25d-0c5f-48f7-9eae-d18571f61489 req-ab0e05ab-34c2-4fa0-829b-cbb923d1d376 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:28.501872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0c21a25d-0c5f-48f7-9eae-d18571f61489 req-ab0e05ab-34c2-4fa0-829b-cbb923d1d376 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:28.504313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0c21a25d-0c5f-48f7-9eae-d18571f61489 req-ab0e05ab-34c2-4fa0-829b-cbb923d1d376 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:28.528600 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-0c21a25d-0c5f-48f7-9eae-d18571f61489 req-ab0e05ab-34c2-4fa0-829b-cbb923d1d376 service nova] Creating event network-vif-plugged:024c4406-8d1a-4d0a-8070-35c91fc50f3f for instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 on n-h1-854823-1 Aug 27 04:38:28.558461 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-0c21a25d-0c5f-48f7-9eae-d18571f61489 req-ab0e05ab-34c2-4fa0-829b-cbb923d1d376 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086696 Aug 27 04:38:28.559473 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 957/1903] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:28.577733 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-41cd9381-f93c-4dc1-a173-6184d8f6f686 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 204 len: 0 microversion: 2.1 time: 0.279867 Aug 27 04:38:28.580406 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 947/1904] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:38:28 2022] DELETE /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:28.588989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ff6a7624-3545-40ea-8e07-c29c627ab4d6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:28.589700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ff6a7624-3545-40ea-8e07-c29c627ab4d6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:28.602612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff6a7624-3545-40ea-8e07-c29c627ab4d6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:28.603121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff6a7624-3545-40ea-8e07-c29c627ab4d6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:28.603541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff6a7624-3545-40ea-8e07-c29c627ab4d6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:28.604247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff6a7624-3545-40ea-8e07-c29c627ab4d6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:28.604730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff6a7624-3545-40ea-8e07-c29c627ab4d6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:28.605440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff6a7624-3545-40ea-8e07-c29c627ab4d6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:28.767709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-423fc4b0-4404-4c78-aec3-e9112a23dd67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:28.769088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-423fc4b0-4404-4c78-aec3-e9112a23dd67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:28.777895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423fc4b0-4404-4c78-aec3-e9112a23dd67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:28.778411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423fc4b0-4404-4c78-aec3-e9112a23dd67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:28.783593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423fc4b0-4404-4c78-aec3-e9112a23dd67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:28.787249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423fc4b0-4404-4c78-aec3-e9112a23dd67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:28.787916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423fc4b0-4404-4c78-aec3-e9112a23dd67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:28.789439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423fc4b0-4404-4c78-aec3-e9112a23dd67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:29.078999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ff6a7624-3545-40ea-8e07-c29c627ab4d6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:29.093974 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ff6a7624-3545-40ea-8e07-c29c627ab4d6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 200 len: 1528 microversion: 2.1 time: 0.509118 Aug 27 04:38:29.095419 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 958/1905] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:28 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 1528 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:29.249984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-423fc4b0-4404-4c78-aec3-e9112a23dd67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:29.266535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-423fc4b0-4404-4c78-aec3-e9112a23dd67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:29.268049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-423fc4b0-4404-4c78-aec3-e9112a23dd67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:29.269927 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-423fc4b0-4404-4c78-aec3-e9112a23dd67 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.506825 Aug 27 04:38:29.285602 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 948/1906] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:28 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:38:29.494393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3c5cd537-bcfa-4129-887c-e98c0d53f26e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:29.495020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3c5cd537-bcfa-4129-887c-e98c0d53f26e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:29.509417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c5cd537-bcfa-4129-887c-e98c0d53f26e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:29.509918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c5cd537-bcfa-4129-887c-e98c0d53f26e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:29.510361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c5cd537-bcfa-4129-887c-e98c0d53f26e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:29.511083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c5cd537-bcfa-4129-887c-e98c0d53f26e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:29.511549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c5cd537-bcfa-4129-887c-e98c0d53f26e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:29.511981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c5cd537-bcfa-4129-887c-e98c0d53f26e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:29.914726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3c5cd537-bcfa-4129-887c-e98c0d53f26e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:29.936453 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3c5cd537-bcfa-4129-887c-e98c0d53f26e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1469 microversion: 2.1 time: 0.446990 Aug 27 04:38:29.938284 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 959/1907] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:29 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1469 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:30.125694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aab5436a-380f-4159-bf8b-f2e09db3b91c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:30.126514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aab5436a-380f-4159-bf8b-f2e09db3b91c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:30.155241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aab5436a-380f-4159-bf8b-f2e09db3b91c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:30.156024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aab5436a-380f-4159-bf8b-f2e09db3b91c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:30.156712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aab5436a-380f-4159-bf8b-f2e09db3b91c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:30.157682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aab5436a-380f-4159-bf8b-f2e09db3b91c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:30.158306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aab5436a-380f-4159-bf8b-f2e09db3b91c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:30.158902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aab5436a-380f-4159-bf8b-f2e09db3b91c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:30.296398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-60826443-4e64-4644-b6fb-be7c4de8c052 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:30.297016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-60826443-4e64-4644-b6fb-be7c4de8c052 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:30.308299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60826443-4e64-4644-b6fb-be7c4de8c052 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:30.310813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60826443-4e64-4644-b6fb-be7c4de8c052 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:30.311137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60826443-4e64-4644-b6fb-be7c4de8c052 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:30.311887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60826443-4e64-4644-b6fb-be7c4de8c052 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:30.312354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60826443-4e64-4644-b6fb-be7c4de8c052 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:30.316140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60826443-4e64-4644-b6fb-be7c4de8c052 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:31.242169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-60826443-4e64-4644-b6fb-be7c4de8c052 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:31.268779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-60826443-4e64-4644-b6fb-be7c4de8c052 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:31.271481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-60826443-4e64-4644-b6fb-be7c4de8c052 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:31.279303 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-60826443-4e64-4644-b6fb-be7c4de8c052 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.988042 Aug 27 04:38:31.287239 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 960/1908] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:30 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:38:31.302973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1beab231-3532-4d52-8f43-49762d76dce0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:31.306089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1beab231-3532-4d52-8f43-49762d76dce0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:31.314236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aab5436a-380f-4159-bf8b-f2e09db3b91c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:31.320714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1beab231-3532-4d52-8f43-49762d76dce0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:31.325211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1beab231-3532-4d52-8f43-49762d76dce0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:31.326388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1beab231-3532-4d52-8f43-49762d76dce0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:31.326616 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aab5436a-380f-4159-bf8b-f2e09db3b91c tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 200 len: 1528 microversion: 2.1 time: 1.210824 Aug 27 04:38:31.336589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1beab231-3532-4d52-8f43-49762d76dce0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:31.336816 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 949/1909] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:30 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 1528 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:31.336926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1beab231-3532-4d52-8f43-49762d76dce0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:31.336926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1beab231-3532-4d52-8f43-49762d76dce0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:32.062841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8fd4416f-43d5-4f2b-ae8d-c0456715b63c req-de23ba45-6f7b-40b5-b37d-7978ac74d167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131", "name": "network-vif-deleted", "tag": "024c4406-8d1a-4d0a-8070-35c91fc50f3f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:32.090372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8fd4416f-43d5-4f2b-ae8d-c0456715b63c req-de23ba45-6f7b-40b5-b37d-7978ac74d167 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:32.092482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8fd4416f-43d5-4f2b-ae8d-c0456715b63c req-de23ba45-6f7b-40b5-b37d-7978ac74d167 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:32.095157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8fd4416f-43d5-4f2b-ae8d-c0456715b63c req-de23ba45-6f7b-40b5-b37d-7978ac74d167 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:32.099966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:32.165618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1beab231-3532-4d52-8f43-49762d76dce0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:32.168737 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8fd4416f-43d5-4f2b-ae8d-c0456715b63c req-de23ba45-6f7b-40b5-b37d-7978ac74d167 service nova] Creating event network-vif-deleted:024c4406-8d1a-4d0a-8070-35c91fc50f3f for instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 on n-h1-854823-1 Aug 27 04:38:32.188988 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8fd4416f-43d5-4f2b-ae8d-c0456715b63c req-de23ba45-6f7b-40b5-b37d-7978ac74d167 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129601 Aug 27 04:38:32.190040 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 950/1910] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:38:32.208171 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1beab231-3532-4d52-8f43-49762d76dce0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 200 len: 1469 microversion: 2.1 time: 0.919571 Aug 27 04:38:32.214585 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 961/1911] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:31 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 1469 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:32.319383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ea1b548-15cd-4af4-8409-e7fd4c600206 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:32.320070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6ea1b548-15cd-4af4-8409-e7fd4c600206 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:32.336863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ea1b548-15cd-4af4-8409-e7fd4c600206 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:32.337386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ea1b548-15cd-4af4-8409-e7fd4c600206 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:32.337808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ea1b548-15cd-4af4-8409-e7fd4c600206 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:32.347052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ea1b548-15cd-4af4-8409-e7fd4c600206 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:32.352584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-07bc82df-02ef-4405-a35d-15937de3f232 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:32.353206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-07bc82df-02ef-4405-a35d-15937de3f232 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:32.360457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07bc82df-02ef-4405-a35d-15937de3f232 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:32.363736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ea1b548-15cd-4af4-8409-e7fd4c600206 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:32.366316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ea1b548-15cd-4af4-8409-e7fd4c600206 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:32.371298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07bc82df-02ef-4405-a35d-15937de3f232 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:32.375405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07bc82df-02ef-4405-a35d-15937de3f232 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:32.376276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07bc82df-02ef-4405-a35d-15937de3f232 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:32.383090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07bc82df-02ef-4405-a35d-15937de3f232 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:32.384467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07bc82df-02ef-4405-a35d-15937de3f232 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:32.728034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-07bc82df-02ef-4405-a35d-15937de3f232 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307981144d4141ed9d609d88ea2e954e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e2ae48d5764048b5ad189114755aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:32.745926 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-07bc82df-02ef-4405-a35d-15937de3f232 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 200 len: 1486 microversion: 2.1 time: 0.396983 Aug 27 04:38:32.748522 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 962/1912] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:32 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 1486 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:32.760311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1a667a15-06ca-4c2a-bf95-3ca084e3a6e8 req-f2b31a9b-b4c2-4d99-8505-f152bfccd949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b745d9f9-3852-4b94-895c-bbe4e224ab54", "name": "network-vif-deleted", "tag": "94b3bab1-5497-44e1-a48d-c247c2a75699"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:32.804207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1a667a15-06ca-4c2a-bf95-3ca084e3a6e8 req-f2b31a9b-b4c2-4d99-8505-f152bfccd949 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:32.804840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1a667a15-06ca-4c2a-bf95-3ca084e3a6e8 req-f2b31a9b-b4c2-4d99-8505-f152bfccd949 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:32.805656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1a667a15-06ca-4c2a-bf95-3ca084e3a6e8 req-f2b31a9b-b4c2-4d99-8505-f152bfccd949 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:32.840984 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1a667a15-06ca-4c2a-bf95-3ca084e3a6e8 req-f2b31a9b-b4c2-4d99-8505-f152bfccd949 service nova] Creating event network-vif-deleted:94b3bab1-5497-44e1-a48d-c247c2a75699 for instance b745d9f9-3852-4b94-895c-bbe4e224ab54 on n-h2-854823-1 Aug 27 04:38:32.856747 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1a667a15-06ca-4c2a-bf95-3ca084e3a6e8 req-f2b31a9b-b4c2-4d99-8505-f152bfccd949 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106323 Aug 27 04:38:32.859324 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 963/1913] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:33.239326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-34caf607-fbea-422d-8c56-c8ac4bde40cf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:33.240478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-34caf607-fbea-422d-8c56-c8ac4bde40cf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:33.263767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34caf607-fbea-422d-8c56-c8ac4bde40cf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:33.265065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34caf607-fbea-422d-8c56-c8ac4bde40cf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:33.270280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34caf607-fbea-422d-8c56-c8ac4bde40cf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:33.271646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34caf607-fbea-422d-8c56-c8ac4bde40cf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:33.273201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34caf607-fbea-422d-8c56-c8ac4bde40cf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:33.274188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34caf607-fbea-422d-8c56-c8ac4bde40cf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:33.312929 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-34caf607-fbea-422d-8c56-c8ac4bde40cf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] HTTP exception thrown: Instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 could not be found. Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-34caf607-fbea-422d-8c56-c8ac4bde40cf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Request method failure captured: Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 HTTP/1.1 Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ6AeW_zm8SY21iUcCjybOQRhFfAok2jE39-mLa09_Dltzlbt-gan45wUn5iFUC0pKIw0sMm3VP1lzjHL0IaDqIaaVXZ23IHOpUYGzCjTCGVqwYZ20wRIdZHGSB7AHKGaJ8Eeq1SzWc8v1I2Or6vKojXFfvsB8tSFslT1wKBVPaOw_w Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: abfa50b6f05c4413b2a96f2490ac43a1 Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-MigrationsAdminTest-543591827 Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-MigrationsAdminTest-543591827 Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: abfa50b6f05c4413b2a96f2490ac43a1 Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-MigrationsAdminTest-543591827 Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-MigrationsAdminTest-543591827-project Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 7e6454ced7834bbdaeee89ccef19f510 Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-MigrationsAdminTest-543591827-project Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 could not be found. Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131'} Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 could not be found. Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 could not be found. Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:33.319803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:33.327040 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:33.327040 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:33.327040 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:33.327040 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:33.327040 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:33.327040 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 could not be found. Aug 27 04:38:33.327040 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:33.332486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-34caf607-fbea-422d-8c56-c8ac4bde40cf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Returning 404 to user: Instance f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:33.334851 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-34caf607-fbea-422d-8c56-c8ac4bde40cf tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131" status: 404 len: 111 microversion: 2.1 time: 0.102868 Aug 27 04:38:33.335712 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 964/1914] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:33 2022] GET /compute/v2.1/servers/f27e5e29-ebae-4b2e-baf0-f9cc5bfc5131 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:38:33.354662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-21b77b8b-0642-4356-8b73-8c4139c67899 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:33.355799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-21b77b8b-0642-4356-8b73-8c4139c67899 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:33.355965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ea1b548-15cd-4af4-8409-e7fd4c600206 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:33.367045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ea1b548-15cd-4af4-8409-e7fd4c600206 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:33.370392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21b77b8b-0642-4356-8b73-8c4139c67899 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:33.370669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ea1b548-15cd-4af4-8409-e7fd4c600206 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:33.371218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21b77b8b-0642-4356-8b73-8c4139c67899 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:33.372971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21b77b8b-0642-4356-8b73-8c4139c67899 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:33.373136 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ea1b548-15cd-4af4-8409-e7fd4c600206 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 1.062606 Aug 27 04:38:33.373784 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 951/1915] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:32 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:33.377894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21b77b8b-0642-4356-8b73-8c4139c67899 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:33.378648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21b77b8b-0642-4356-8b73-8c4139c67899 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:33.379326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21b77b8b-0642-4356-8b73-8c4139c67899 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:33.450400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-21b77b8b-0642-4356-8b73-8c4139c67899 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:38:33.609723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:33.764278 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-21b77b8b-0642-4356-8b73-8c4139c67899 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 204 len: 0 microversion: 2.1 time: 0.423477 Aug 27 04:38:33.768899 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 965/1916] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:38:33 2022] DELETE /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:33.774724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-760970f7-c6e4-414e-9a1c-ac7c52e17846 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:33.775577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-760970f7-c6e4-414e-9a1c-ac7c52e17846 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: b745d9f9-3852-4b94-895c-bbe4e224ab54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:33.791708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2c2b6fa6-37c3-4231-8857-19d6a01a8bae tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:33.792769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2c2b6fa6-37c3-4231-8857-19d6a01a8bae tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:33.810876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-760970f7-c6e4-414e-9a1c-ac7c52e17846 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:33.814781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-760970f7-c6e4-414e-9a1c-ac7c52e17846 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:33.817451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-760970f7-c6e4-414e-9a1c-ac7c52e17846 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:33.818456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c2b6fa6-37c3-4231-8857-19d6a01a8bae tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:33.821941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c2b6fa6-37c3-4231-8857-19d6a01a8bae tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:33.822646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c2b6fa6-37c3-4231-8857-19d6a01a8bae tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:33.826618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c2b6fa6-37c3-4231-8857-19d6a01a8bae tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:33.828726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c2b6fa6-37c3-4231-8857-19d6a01a8bae tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:33.829387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c2b6fa6-37c3-4231-8857-19d6a01a8bae tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:33.829911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-760970f7-c6e4-414e-9a1c-ac7c52e17846 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:33.834325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-760970f7-c6e4-414e-9a1c-ac7c52e17846 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:33.837797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-760970f7-c6e4-414e-9a1c-ac7c52e17846 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:33.901190 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-760970f7-c6e4-414e-9a1c-ac7c52e17846 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] HTTP exception thrown: Instance b745d9f9-3852-4b94-895c-bbe4e224ab54 could not be found. Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-760970f7-c6e4-414e-9a1c-ac7c52e17846 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Request method failure captured: Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 HTTP/1.1 Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ9LzeqYV4BUCc_CXZKyCgJDhuJ0n2D010QQ784od245BsR3bxLb1sHxDrLyEr4O_qgJBjYkRUAA_KGuy_0GWIipzEN4V-LZRqsnqytvO99DPzpj2LnZgNSzlNtzQSnXwwcHdsJTzPP1AoM-PSJ_QnZrIKpvFlmfCiSUn_wXkMGZoYs Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 307981144d4141ed9d609d88ea2e954e Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance b745d9f9-3852-4b94-895c-bbe4e224ab54 could not be found. Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'b745d9f9-3852-4b94-895c-bbe4e224ab54'} Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b745d9f9-3852-4b94-895c-bbe4e224ab54 could not be found. Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b745d9f9-3852-4b94-895c-bbe4e224ab54 could not be found. Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:33.912411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:33.920504 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:33.920504 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:33.920504 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:33.920504 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:33.920504 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:33.920504 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:33.920504 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b745d9f9-3852-4b94-895c-bbe4e224ab54 could not be found. Aug 27 04:38:33.920504 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:33.920504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-760970f7-c6e4-414e-9a1c-ac7c52e17846 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Returning 404 to user: Instance b745d9f9-3852-4b94-895c-bbe4e224ab54 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:33.923374 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-760970f7-c6e4-414e-9a1c-ac7c52e17846 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54" status: 404 len: 111 microversion: 2.1 time: 0.155697 Aug 27 04:38:33.928510 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 952/1917] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:33 2022] GET /compute/v2.1/servers/b745d9f9-3852-4b94-895c-bbe4e224ab54 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:33.944460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c27f142-c78b-4f35-949f-b5b677b6c80d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '.version_select at 0x7f1f21111a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:33.993190 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3c27f142-c78b-4f35-949f-b5b677b6c80d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] HTTP exception thrown: Image not found. Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c27f142-c78b-4f35-949f-b5b677b6c80d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Request method failure captured: Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/images/5b3c7a65-1b0b-4da3-a4fb-c5990d2a1e7c HTTP/1.1 Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ9LzeqYV4BUCc_CXZKyCgJDhuJ0n2D010QQ784od245BsR3bxLb1sHxDrLyEr4O_qgJBjYkRUAA_KGuy_0GWIipzEN4V-LZRqsnqytvO99DPzpj2LnZgNSzlNtzQSnXwwcHdsJTzPP1AoM-PSJ_QnZrIKpvFlmfCiSUn_wXkMGZoYs Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 307981144d4141ed9d609d88ea2e954e Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: exception: Image not found. Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '5b3c7a65-1b0b-4da3-a4fb-c5990d2a1e7c'} Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5b3c7a65-1b0b-4da3-a4fb-c5990d2a1e7c to delete Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5b3c7a65-1b0b-4da3-a4fb-c5990d2a1e7c could not be found. Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:33.995989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:38:34.006651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:34.010766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c27f142-c78b-4f35-949f-b5b677b6c80d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:34.011697 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c27f142-c78b-4f35-949f-b5b677b6c80d tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "DELETE /compute/v2.1/images/5b3c7a65-1b0b-4da3-a4fb-c5990d2a1e7c" status: 404 len: 62 microversion: 2.1 time: 0.078624 Aug 27 04:38:34.012306 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 953/1918] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:33 2022] DELETE /compute/v2.1/images/5b3c7a65-1b0b-4da3-a4fb-c5990d2a1e7c => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:38:34.022245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-285a47c3-0d0b-459f-a6e3-a74182fc658f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:34.024930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-285a47c3-0d0b-459f-a6e3-a74182fc658f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:34.038294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-285a47c3-0d0b-459f-a6e3-a74182fc658f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:34.039983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-285a47c3-0d0b-459f-a6e3-a74182fc658f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:34.050355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-285a47c3-0d0b-459f-a6e3-a74182fc658f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:34.051593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-285a47c3-0d0b-459f-a6e3-a74182fc658f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:34.052376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-285a47c3-0d0b-459f-a6e3-a74182fc658f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:34.053110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-285a47c3-0d0b-459f-a6e3-a74182fc658f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:34.071259 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-285a47c3-0d0b-459f-a6e3-a74182fc658f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] HTTP exception thrown: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-285a47c3-0d0b-459f-a6e3-a74182fc658f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Request method failure captured: Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a HTTP/1.1 Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ9LzeqYV4BUCc_CXZKyCgJDhuJ0n2D010QQ784od245BsR3bxLb1sHxDrLyEr4O_qgJBjYkRUAA_KGuy_0GWIipzEN4V-LZRqsnqytvO99DPzpj2LnZgNSzlNtzQSnXwwcHdsJTzPP1AoM-PSJ_QnZrIKpvFlmfCiSUn_wXkMGZoYs Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 307981144d4141ed9d609d88ea2e954e Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '3bbe5194-aa1d-4db9-aec2-044d247df93a'} Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:34.073335 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:34.078568 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:34.078568 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:34.078568 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:34.078568 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:34.078568 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:34.078568 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:34.078568 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:34.078568 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:34.078568 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:34.078568 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:34.078568 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:34.085359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-285a47c3-0d0b-459f-a6e3-a74182fc658f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Returning 404 to user: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:34.085359 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-285a47c3-0d0b-459f-a6e3-a74182fc658f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 404 len: 111 microversion: 2.1 time: 0.065925 Aug 27 04:38:34.086180 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 954/1919] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:38:34 2022] DELETE /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:38:34.099088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b1b08457-8284-4b31-af5f-10af8f49c9ea tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:34.100180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b1b08457-8284-4b31-af5f-10af8f49c9ea tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 3bbe5194-aa1d-4db9-aec2-044d247df93a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:34.109333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1b08457-8284-4b31-af5f-10af8f49c9ea tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:34.110292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1b08457-8284-4b31-af5f-10af8f49c9ea tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:34.110966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1b08457-8284-4b31-af5f-10af8f49c9ea tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:34.112801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1b08457-8284-4b31-af5f-10af8f49c9ea tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:34.113812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1b08457-8284-4b31-af5f-10af8f49c9ea tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:34.114486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1b08457-8284-4b31-af5f-10af8f49c9ea tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:34.136203 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b1b08457-8284-4b31-af5f-10af8f49c9ea tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] HTTP exception thrown: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b1b08457-8284-4b31-af5f-10af8f49c9ea tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Request method failure captured: Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a HTTP/1.1 Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ9LzeqYV4BUCc_CXZKyCgJDhuJ0n2D010QQ784od245BsR3bxLb1sHxDrLyEr4O_qgJBjYkRUAA_KGuy_0GWIipzEN4V-LZRqsnqytvO99DPzpj2LnZgNSzlNtzQSnXwwcHdsJTzPP1AoM-PSJ_QnZrIKpvFlmfCiSUn_wXkMGZoYs Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 307981144d4141ed9d609d88ea2e954e Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '3bbe5194-aa1d-4db9-aec2-044d247df93a'} Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:34.148942 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:34.154123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:34.154123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:34.154123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:34.154123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:34.154123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:34.154123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:34.154123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. Aug 27 04:38:34.154123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:34.156247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b1b08457-8284-4b31-af5f-10af8f49c9ea tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Returning 404 to user: Instance 3bbe5194-aa1d-4db9-aec2-044d247df93a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:34.157455 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b1b08457-8284-4b31-af5f-10af8f49c9ea tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a" status: 404 len: 111 microversion: 2.1 time: 0.069252 Aug 27 04:38:34.158686 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 955/1920] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:34 2022] GET /compute/v2.1/servers/3bbe5194-aa1d-4db9-aec2-044d247df93a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:38:34.167375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ebd9c1ee-e21c-43d4-afd1-7242a0f53f57 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '.version_select at 0x7f1f25cc2820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:34.215472 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ebd9c1ee-e21c-43d4-afd1-7242a0f53f57 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1951530106" status: 202 len: 0 microversion: 2.1 time: 0.052091 Aug 27 04:38:34.217370 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 956/1921] 10.222.0.79 () {58 vars in 1221 bytes} [Sat Aug 27 04:38:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1951530106 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:38:34.401440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de8fe45d-c2ef-4710-8f0e-ae3b8361e9aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:34.402100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-de8fe45d-c2ef-4710-8f0e-ae3b8361e9aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:34.422797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de8fe45d-c2ef-4710-8f0e-ae3b8361e9aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:34.424940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de8fe45d-c2ef-4710-8f0e-ae3b8361e9aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:34.425992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de8fe45d-c2ef-4710-8f0e-ae3b8361e9aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:34.429039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de8fe45d-c2ef-4710-8f0e-ae3b8361e9aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:34.429571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de8fe45d-c2ef-4710-8f0e-ae3b8361e9aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:34.431138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de8fe45d-c2ef-4710-8f0e-ae3b8361e9aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:34.939737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2c2b6fa6-37c3-4231-8857-19d6a01a8bae tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:34.947827 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2c2b6fa6-37c3-4231-8857-19d6a01a8bae tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1534 microversion: 2.1 time: 1.177599 Aug 27 04:38:34.948419 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 966/1922] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:33 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1534 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:35.414989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3b38d5bb-8309-4333-9dac-d37a0522eb27 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'create', calling method: .version_select at 0x7f1f214d5940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1444554120", "description": "tempest-description-967545188"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:35.850815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de8fe45d-c2ef-4710-8f0e-ae3b8361e9aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:35.869607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de8fe45d-c2ef-4710-8f0e-ae3b8361e9aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:35.872652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de8fe45d-c2ef-4710-8f0e-ae3b8361e9aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:35.880036 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de8fe45d-c2ef-4710-8f0e-ae3b8361e9aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 1.478163 Aug 27 04:38:35.896806 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 957/1923] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:34 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:35.978675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6faf1a91-8261-4e38-914e-db028dc8fe6e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:35.979758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6faf1a91-8261-4e38-914e-db028dc8fe6e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:35.990084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6faf1a91-8261-4e38-914e-db028dc8fe6e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:35.991270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6faf1a91-8261-4e38-914e-db028dc8fe6e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:35.992062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6faf1a91-8261-4e38-914e-db028dc8fe6e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:35.993275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6faf1a91-8261-4e38-914e-db028dc8fe6e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:36.003734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6faf1a91-8261-4e38-914e-db028dc8fe6e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:36.015970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6faf1a91-8261-4e38-914e-db028dc8fe6e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:36.716046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6faf1a91-8261-4e38-914e-db028dc8fe6e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:36.727613 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6faf1a91-8261-4e38-914e-db028dc8fe6e tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 200 len: 1534 microversion: 2.1 time: 0.761496 Aug 27 04:38:36.729300 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 958/1924] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:35 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 1534 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:36.779574 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3b38d5bb-8309-4333-9dac-d37a0522eb27 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.688385 Aug 27 04:38:36.780203 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 967/1925] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:38:35 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:38:36.793171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e5475f22-d666-4cde-ba59-03e58e9b8b5a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'create', calling method: .version_select at 0x7f1f214f8280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-176359231", "description": "tempest-description-1693685452"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:36.869108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1827684696", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "fa9d001d-b3bf-4c75-aaaf-2dd93a5532f5"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:36.963402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] validate_networks() for [('fa9d001d-b3bf-4c75-aaaf-2dd93a5532f5', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:38:37.230057 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e5475f22-d666-4cde-ba59-03e58e9b8b5a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.440642 Aug 27 04:38:37.230673 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 968/1926] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:38:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:38:37.235972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-17ae49d2-d64d-41f9-aecb-eb9c1fa13d44 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:37.236787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-17ae49d2-d64d-41f9-aecb-eb9c1fa13d44 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:37.254950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ae49d2-d64d-41f9-aecb-eb9c1fa13d44 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:37.255454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ae49d2-d64d-41f9-aecb-eb9c1fa13d44 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:37.255891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ae49d2-d64d-41f9-aecb-eb9c1fa13d44 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:37.256767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ae49d2-d64d-41f9-aecb-eb9c1fa13d44 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:37.257309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ae49d2-d64d-41f9-aecb-eb9c1fa13d44 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:37.257763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ae49d2-d64d-41f9-aecb-eb9c1fa13d44 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:38.147655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:38:38.149457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:38:38.150459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:38:38.150900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:38:38.151541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:38:38.173954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:38.175309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:38.175777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:38.178922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:38.180601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:38.181503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:38.236653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Getting quotas for project b902932050be4c04bca1de4fe268c2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:38.245198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Getting quotas for user 6c59dc5e251943d59de8b2d640643a0e and project b902932050be4c04bca1de4fe268c2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:38.269208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:38:38.273070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:38:38.375935 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b996ea4-2219-4a9e-8eb5-b8fa267f0f2d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.645505 Aug 27 04:38:38.377781 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 959/1927] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:38:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:38:38.384141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-695818774", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "0d06b267-84e5-4774-91c3-0bec066508d2"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:38.444913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-17ae49d2-d64d-41f9-aecb-eb9c1fa13d44 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:38.466745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-17ae49d2-d64d-41f9-aecb-eb9c1fa13d44 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:38.472403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-17ae49d2-d64d-41f9-aecb-eb9c1fa13d44 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:38.480310 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-17ae49d2-d64d-41f9-aecb-eb9c1fa13d44 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 1.247810 Aug 27 04:38:38.482218 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 969/1928] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:37 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:38.492931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-4eed1478-776f-4998-924c-869b9f2ec091 req-ba7f9763-3908-459e-9f0c-6f8eab4bd7bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7984297a-0070-487d-83cb-a4e4d97aa5ba", "name": "network-vif-deleted", "tag": "9bf4e91c-b1ee-46b0-ab4c-5e3b87d4673b"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:38.503207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] validate_networks() for [('0d06b267-84e5-4774-91c3-0bec066508d2', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:38:38.543292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4eed1478-776f-4998-924c-869b9f2ec091 req-ba7f9763-3908-459e-9f0c-6f8eab4bd7bc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:38.544481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4eed1478-776f-4998-924c-869b9f2ec091 req-ba7f9763-3908-459e-9f0c-6f8eab4bd7bc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:38.544957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4eed1478-776f-4998-924c-869b9f2ec091 req-ba7f9763-3908-459e-9f0c-6f8eab4bd7bc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:38.593232 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-4eed1478-776f-4998-924c-869b9f2ec091 req-ba7f9763-3908-459e-9f0c-6f8eab4bd7bc service nova] Creating event network-vif-deleted:9bf4e91c-b1ee-46b0-ab4c-5e3b87d4673b for instance 7984297a-0070-487d-83cb-a4e4d97aa5ba on n-h1-854823-1 Aug 27 04:38:38.625006 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-4eed1478-776f-4998-924c-869b9f2ec091 req-ba7f9763-3908-459e-9f0c-6f8eab4bd7bc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115873 Aug 27 04:38:38.625692 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 970/1929] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:38.637145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4cdc121b-02a7-4675-bbd8-1b58cb6b245a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:38.638655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4cdc121b-02a7-4675-bbd8-1b58cb6b245a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 7984297a-0070-487d-83cb-a4e4d97aa5ba] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:38.665973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cdc121b-02a7-4675-bbd8-1b58cb6b245a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:38.666973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cdc121b-02a7-4675-bbd8-1b58cb6b245a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:38.667718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cdc121b-02a7-4675-bbd8-1b58cb6b245a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:38.685355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cdc121b-02a7-4675-bbd8-1b58cb6b245a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:38.686382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cdc121b-02a7-4675-bbd8-1b58cb6b245a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:38.687646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cdc121b-02a7-4675-bbd8-1b58cb6b245a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:38.784548 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-4cdc121b-02a7-4675-bbd8-1b58cb6b245a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] HTTP exception thrown: Instance 7984297a-0070-487d-83cb-a4e4d97aa5ba could not be found. Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4cdc121b-02a7-4675-bbd8-1b58cb6b245a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Request method failure captured: Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba HTTP/1.1 Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ6AeW_zm8SY21iUcCjybOQRhFfAok2jE39-mLa09_Dltzlbt-gan45wUn5iFUC0pKIw0sMm3VP1lzjHL0IaDqIaaVXZ23IHOpUYGzCjTCGVqwYZ20wRIdZHGSB7AHKGaJ8Eeq1SzWc8v1I2Or6vKojXFfvsB8tSFslT1wKBVPaOw_w Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: abfa50b6f05c4413b2a96f2490ac43a1 Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-MigrationsAdminTest-543591827 Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-MigrationsAdminTest-543591827 Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: abfa50b6f05c4413b2a96f2490ac43a1 Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-MigrationsAdminTest-543591827 Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-MigrationsAdminTest-543591827-project Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 7e6454ced7834bbdaeee89ccef19f510 Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-MigrationsAdminTest-543591827-project Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 7984297a-0070-487d-83cb-a4e4d97aa5ba could not be found. Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '7984297a-0070-487d-83cb-a4e4d97aa5ba'} Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7984297a-0070-487d-83cb-a4e4d97aa5ba could not be found. Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7984297a-0070-487d-83cb-a4e4d97aa5ba could not be found. Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:38.790532 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:38.795878 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:38.795878 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:38.795878 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:38.795878 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:38.795878 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:38.795878 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7984297a-0070-487d-83cb-a4e4d97aa5ba could not be found. Aug 27 04:38:38.795878 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:38.795878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4cdc121b-02a7-4675-bbd8-1b58cb6b245a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Returning 404 to user: Instance 7984297a-0070-487d-83cb-a4e4d97aa5ba could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:38.801409 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4cdc121b-02a7-4675-bbd8-1b58cb6b245a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba" status: 404 len: 111 microversion: 2.1 time: 0.174186 Aug 27 04:38:38.803942 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 971/1930] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:38 2022] GET /compute/v2.1/servers/7984297a-0070-487d-83cb-a4e4d97aa5ba => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:38.833107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-88c2b6ef-9742-4dcf-bfcf-2b1d15970a04 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:38.834278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-88c2b6ef-9742-4dcf-bfcf-2b1d15970a04 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:38.976251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-88c2b6ef-9742-4dcf-bfcf-2b1d15970a04 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:38.986459 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-88c2b6ef-9742-4dcf-bfcf-2b1d15970a04 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1215 microversion: 2.1 time: 0.181195 Aug 27 04:38:38.989258 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 972/1931] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:38 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1215 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:38.999131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fec9ecde-627b-4c04-879a-115f0b75c2c6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '.version_select at 0x7f1f214d9430>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:39.046004 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-fec9ecde-627b-4c04-879a-115f0b75c2c6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] HTTP exception thrown: Image not found. Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fec9ecde-627b-4c04-879a-115f0b75c2c6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Request method failure captured: Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/images/b40ae0cd-c940-4e17-9d1d-cfd94c0a7658 HTTP/1.1 Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ9LzeqYV4BUCc_CXZKyCgJDhuJ0n2D010QQ784od245BsR3bxLb1sHxDrLyEr4O_qgJBjYkRUAA_KGuy_0GWIipzEN4V-LZRqsnqytvO99DPzpj2LnZgNSzlNtzQSnXwwcHdsJTzPP1AoM-PSJ_QnZrIKpvFlmfCiSUn_wXkMGZoYs Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 307981144d4141ed9d609d88ea2e954e Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: exception: Image not found. Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'b40ae0cd-c940-4e17-9d1d-cfd94c0a7658'} Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b40ae0cd-c940-4e17-9d1d-cfd94c0a7658 to delete Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b40ae0cd-c940-4e17-9d1d-cfd94c0a7658 could not be found. Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:39.047797 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.052683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fec9ecde-627b-4c04-879a-115f0b75c2c6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Returning 404 to user: Image not found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:39.060595 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fec9ecde-627b-4c04-879a-115f0b75c2c6 tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "DELETE /compute/v2.1/images/b40ae0cd-c940-4e17-9d1d-cfd94c0a7658" status: 404 len: 62 microversion: 2.1 time: 0.069415 Aug 27 04:38:39.064084 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 973/1932] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:38 2022] DELETE /compute/v2.1/images/b40ae0cd-c940-4e17-9d1d-cfd94c0a7658 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:38:39.067569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-851cb5df-6568-420b-abfd-b929f835f99d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '.version_select at 0x7f1f214e30d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:39.120437 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-851cb5df-6568-420b-abfd-b929f835f99d tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229991437" status: 202 len: 0 microversion: 2.1 time: 0.057548 Aug 27 04:38:39.121056 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 974/1933] 10.222.0.79 () {58 vars in 1221 bytes} [Sat Aug 27 04:38:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229991437 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:38:39.126781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59687160-ffa5-4b5c-861e-ac5933eda26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:39.135304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-59687160-ffa5-4b5c-861e-ac5933eda26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:39.150360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59687160-ffa5-4b5c-861e-ac5933eda26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:39.157314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59687160-ffa5-4b5c-861e-ac5933eda26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:39.158270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59687160-ffa5-4b5c-861e-ac5933eda26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:39.159260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59687160-ffa5-4b5c-861e-ac5933eda26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:39.160803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59687160-ffa5-4b5c-861e-ac5933eda26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:39.161434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59687160-ffa5-4b5c-861e-ac5933eda26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:39.178394 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-59687160-ffa5-4b5c-861e-ac5933eda26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] HTTP exception thrown: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59687160-ffa5-4b5c-861e-ac5933eda26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Request method failure captured: Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b HTTP/1.1 Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ9LzeqYV4BUCc_CXZKyCgJDhuJ0n2D010QQ784od245BsR3bxLb1sHxDrLyEr4O_qgJBjYkRUAA_KGuy_0GWIipzEN4V-LZRqsnqytvO99DPzpj2LnZgNSzlNtzQSnXwwcHdsJTzPP1AoM-PSJ_QnZrIKpvFlmfCiSUn_wXkMGZoYs Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 307981144d4141ed9d609d88ea2e954e Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '1f6aa77e-f369-461e-9cf6-d9bd0dad016b'} Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:39.190037 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:39.196114 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:38:39.196114 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.196114 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:39.196114 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.196114 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:39.196114 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:39.196114 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:39.196114 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:39.196114 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:39.196114 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:38:39.196114 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.198387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59687160-ffa5-4b5c-861e-ac5933eda26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Returning 404 to user: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:39.200100 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-59687160-ffa5-4b5c-861e-ac5933eda26f tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 404 len: 111 microversion: 2.1 time: 0.077467 Aug 27 04:38:39.201897 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 975/1934] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:38:39 2022] DELETE /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:39.210587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c25e5af4-2aec-4cfc-b0b2-25c06635eb5b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:39.212042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c25e5af4-2aec-4cfc-b0b2-25c06635eb5b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] [instance: 1f6aa77e-f369-461e-9cf6-d9bd0dad016b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:39.230216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c25e5af4-2aec-4cfc-b0b2-25c06635eb5b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:39.231030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c25e5af4-2aec-4cfc-b0b2-25c06635eb5b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:39.232278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c25e5af4-2aec-4cfc-b0b2-25c06635eb5b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:39.233311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c25e5af4-2aec-4cfc-b0b2-25c06635eb5b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:39.234104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c25e5af4-2aec-4cfc-b0b2-25c06635eb5b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:39.235040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c25e5af4-2aec-4cfc-b0b2-25c06635eb5b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:39.268502 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-c25e5af4-2aec-4cfc-b0b2-25c06635eb5b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] HTTP exception thrown: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c25e5af4-2aec-4cfc-b0b2-25c06635eb5b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Request method failure captured: Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b HTTP/1.1 Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ9LzeqYV4BUCc_CXZKyCgJDhuJ0n2D010QQ784od245BsR3bxLb1sHxDrLyEr4O_qgJBjYkRUAA_KGuy_0GWIipzEN4V-LZRqsnqytvO99DPzpj2LnZgNSzlNtzQSnXwwcHdsJTzPP1AoM-PSJ_QnZrIKpvFlmfCiSUn_wXkMGZoYs Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a5e2ae48d5764048b5ad189114755aa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: a5e2ae48d5764048b5ad189114755aa8 Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550 Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 307981144d4141ed9d609d88ea2e954e Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1685064550-project Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '1f6aa77e-f369-461e-9cf6-d9bd0dad016b'} Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.272577 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:39.278081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.278081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:39.278081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:39.278081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:39.278081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:39.278081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:39.278081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. Aug 27 04:38:39.278081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:39.280478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c25e5af4-2aec-4cfc-b0b2-25c06635eb5b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] Returning 404 to user: Instance 1f6aa77e-f369-461e-9cf6-d9bd0dad016b could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:39.281958 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c25e5af4-2aec-4cfc-b0b2-25c06635eb5b tempest-ImagesOneServerNegativeTestJSON-1685064550 tempest-ImagesOneServerNegativeTestJSON-1685064550-project] 10.222.0.79 "GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b" status: 404 len: 111 microversion: 2.1 time: 0.075703 Aug 27 04:38:39.284911 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 976/1935] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:39 2022] GET /compute/v2.1/servers/1f6aa77e-f369-461e-9cf6-d9bd0dad016b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:39.522836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-129bb71a-0e79-4d85-a557-b6c402ed6c7a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:39.524137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-129bb71a-0e79-4d85-a557-b6c402ed6c7a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:39.539459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-129bb71a-0e79-4d85-a557-b6c402ed6c7a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:39.540070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-129bb71a-0e79-4d85-a557-b6c402ed6c7a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:39.540720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-129bb71a-0e79-4d85-a557-b6c402ed6c7a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:39.541719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-129bb71a-0e79-4d85-a557-b6c402ed6c7a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:39.546652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-129bb71a-0e79-4d85-a557-b6c402ed6c7a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:39.548106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-129bb71a-0e79-4d85-a557-b6c402ed6c7a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:40.183179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-129bb71a-0e79-4d85-a557-b6c402ed6c7a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:40.205627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-129bb71a-0e79-4d85-a557-b6c402ed6c7a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:40.210992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-129bb71a-0e79-4d85-a557-b6c402ed6c7a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:40.216932 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-129bb71a-0e79-4d85-a557-b6c402ed6c7a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.708154 Aug 27 04:38:40.233217 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 977/1936] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:39 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:40.238707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b578bef3-bf39-49d1-afe9-89586f1517c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:40.239335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b578bef3-bf39-49d1-afe9-89586f1517c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:40.261597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b578bef3-bf39-49d1-afe9-89586f1517c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:40.264276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b578bef3-bf39-49d1-afe9-89586f1517c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:40.265789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b578bef3-bf39-49d1-afe9-89586f1517c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:40.268297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b578bef3-bf39-49d1-afe9-89586f1517c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:40.271003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b578bef3-bf39-49d1-afe9-89586f1517c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:40.271697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b578bef3-bf39-49d1-afe9-89586f1517c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:40.480907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b578bef3-bf39-49d1-afe9-89586f1517c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:40.500371 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b578bef3-bf39-49d1-afe9-89586f1517c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1267 microversion: 2.1 time: 0.265842 Aug 27 04:38:40.513739 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 978/1937] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:40 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1267 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:40.532108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:38:40.532665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:38:40.533024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:38:40.533436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:38:40.533848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:38:40.562801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:40.563300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:40.563740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:40.564480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:40.577349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:40.577810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:40.610858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Getting quotas for project 8c840f648f684b23bd33f59b466ae029. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:40.628720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Getting quotas for user 8586e37b47d141f08610633fce374d84 and project 8c840f648f684b23bd33f59b466ae029. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:40.644436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:38:40.647254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:38:40.875920 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7250e40-59b8-43de-bf9d-1097cbff89d7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.484312 Aug 27 04:38:40.884003 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 960/1938] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:38:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:38:40.887740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-242b78c8-e3c9-4ce9-81a2-2168b152ab23 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:40.888366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-242b78c8-e3c9-4ce9-81a2-2168b152ab23 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:41.064018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-242b78c8-e3c9-4ce9-81a2-2168b152ab23 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:41.074545 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-242b78c8-e3c9-4ce9-81a2-2168b152ab23 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1215 microversion: 2.1 time: 0.190561 Aug 27 04:38:41.078394 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 979/1939] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:40 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1215 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:38:41.240096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-484a2ae3-05c3-4167-8623-146fb20d0a0e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:41.241321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-484a2ae3-05c3-4167-8623-146fb20d0a0e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:41.258332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484a2ae3-05c3-4167-8623-146fb20d0a0e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:41.258996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484a2ae3-05c3-4167-8623-146fb20d0a0e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:41.260578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484a2ae3-05c3-4167-8623-146fb20d0a0e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:41.263707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484a2ae3-05c3-4167-8623-146fb20d0a0e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:41.264393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484a2ae3-05c3-4167-8623-146fb20d0a0e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:41.276151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484a2ae3-05c3-4167-8623-146fb20d0a0e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:41.536387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0ff4fb7a-9d3a-49f1-8698-fbab7864f023 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:41.537097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0ff4fb7a-9d3a-49f1-8698-fbab7864f023 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:41.553299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ff4fb7a-9d3a-49f1-8698-fbab7864f023 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:41.553813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ff4fb7a-9d3a-49f1-8698-fbab7864f023 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:41.554263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ff4fb7a-9d3a-49f1-8698-fbab7864f023 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:41.563115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ff4fb7a-9d3a-49f1-8698-fbab7864f023 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:41.564147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ff4fb7a-9d3a-49f1-8698-fbab7864f023 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:41.564327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ff4fb7a-9d3a-49f1-8698-fbab7864f023 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:41.846794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0ff4fb7a-9d3a-49f1-8698-fbab7864f023 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:41.865954 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0ff4fb7a-9d3a-49f1-8698-fbab7864f023 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1273 microversion: 2.1 time: 0.333721 Aug 27 04:38:41.868239 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 980/1940] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:41 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1273 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:42.044600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-484a2ae3-05c3-4167-8623-146fb20d0a0e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:42.065094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-484a2ae3-05c3-4167-8623-146fb20d0a0e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:42.067447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-484a2ae3-05c3-4167-8623-146fb20d0a0e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:42.069737 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-484a2ae3-05c3-4167-8623-146fb20d0a0e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.835568 Aug 27 04:38:42.073714 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 961/1941] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:41 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:42.101072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8b88e445-5b6b-43de-b611-e884971fce31 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:42.101779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8b88e445-5b6b-43de-b611-e884971fce31 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:42.114047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b88e445-5b6b-43de-b611-e884971fce31 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:42.114802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b88e445-5b6b-43de-b611-e884971fce31 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:42.116639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b88e445-5b6b-43de-b611-e884971fce31 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:42.121612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b88e445-5b6b-43de-b611-e884971fce31 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:42.123188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b88e445-5b6b-43de-b611-e884971fce31 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:42.124126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b88e445-5b6b-43de-b611-e884971fce31 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:42.373088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8b88e445-5b6b-43de-b611-e884971fce31 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:42.387304 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8b88e445-5b6b-43de-b611-e884971fce31 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1219 microversion: 2.1 time: 0.290894 Aug 27 04:38:42.392087 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 981/1942] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:42 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1219 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:42.896178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f48410c3-de09-411b-b64e-c2fd2709eb62 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:42.898206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f48410c3-de09-411b-b64e-c2fd2709eb62 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:42.902371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:42.925730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48410c3-de09-411b-b64e-c2fd2709eb62 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:42.926287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48410c3-de09-411b-b64e-c2fd2709eb62 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:42.926738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48410c3-de09-411b-b64e-c2fd2709eb62 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:42.927479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48410c3-de09-411b-b64e-c2fd2709eb62 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:42.927941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48410c3-de09-411b-b64e-c2fd2709eb62 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:42.928369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48410c3-de09-411b-b64e-c2fd2709eb62 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:43.103015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1eb95967-b2a8-4051-8f34-e287c86fcc5d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:43.103626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1eb95967-b2a8-4051-8f34-e287c86fcc5d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:43.127226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1eb95967-b2a8-4051-8f34-e287c86fcc5d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:43.130130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1eb95967-b2a8-4051-8f34-e287c86fcc5d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:43.130591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1eb95967-b2a8-4051-8f34-e287c86fcc5d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:43.131376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1eb95967-b2a8-4051-8f34-e287c86fcc5d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:43.133130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1eb95967-b2a8-4051-8f34-e287c86fcc5d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:43.134051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1eb95967-b2a8-4051-8f34-e287c86fcc5d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:43.382063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f48410c3-de09-411b-b64e-c2fd2709eb62 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:43.396400 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f48410c3-de09-411b-b64e-c2fd2709eb62 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1273 microversion: 2.1 time: 0.504612 Aug 27 04:38:43.398622 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 962/1943] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:42 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1273 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:43.410406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b15757f-7d1b-4ef5-93fb-cee9bc7072c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:43.410919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b15757f-7d1b-4ef5-93fb-cee9bc7072c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:43.429060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b15757f-7d1b-4ef5-93fb-cee9bc7072c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:43.431047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b15757f-7d1b-4ef5-93fb-cee9bc7072c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:43.431739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b15757f-7d1b-4ef5-93fb-cee9bc7072c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:43.433861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b15757f-7d1b-4ef5-93fb-cee9bc7072c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:43.435541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b15757f-7d1b-4ef5-93fb-cee9bc7072c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:43.436795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b15757f-7d1b-4ef5-93fb-cee9bc7072c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:43.475658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b15757f-7d1b-4ef5-93fb-cee9bc7072c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:38:43.645669 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b15757f-7d1b-4ef5-93fb-cee9bc7072c4 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 204 len: 0 microversion: 2.1 time: 0.243072 Aug 27 04:38:43.646545 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 963/1944] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:38:43 2022] DELETE /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:43.662616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bab49034-2882-4e5a-a5e9-89e95910e3ae tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:43.663473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bab49034-2882-4e5a-a5e9-89e95910e3ae tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:43.678857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab49034-2882-4e5a-a5e9-89e95910e3ae tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:43.679436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab49034-2882-4e5a-a5e9-89e95910e3ae tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:43.679881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab49034-2882-4e5a-a5e9-89e95910e3ae tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:43.683169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab49034-2882-4e5a-a5e9-89e95910e3ae tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:43.683974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab49034-2882-4e5a-a5e9-89e95910e3ae tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:43.685328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab49034-2882-4e5a-a5e9-89e95910e3ae tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:43.839358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1eb95967-b2a8-4051-8f34-e287c86fcc5d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:43.857651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1eb95967-b2a8-4051-8f34-e287c86fcc5d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:43.862607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1eb95967-b2a8-4051-8f34-e287c86fcc5d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:43.867406 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1eb95967-b2a8-4051-8f34-e287c86fcc5d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.768850 Aug 27 04:38:43.868002 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 982/1945] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:43 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:38:43.879082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dcde92a3-dd99-4e05-98df-760e32b07bcd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:43.879782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dcde92a3-dd99-4e05-98df-760e32b07bcd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:43.908597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcde92a3-dd99-4e05-98df-760e32b07bcd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:43.909493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcde92a3-dd99-4e05-98df-760e32b07bcd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:43.910256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcde92a3-dd99-4e05-98df-760e32b07bcd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:43.915827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcde92a3-dd99-4e05-98df-760e32b07bcd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:43.920358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcde92a3-dd99-4e05-98df-760e32b07bcd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:43.922539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcde92a3-dd99-4e05-98df-760e32b07bcd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:43.923152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bab49034-2882-4e5a-a5e9-89e95910e3ae tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:43.972627 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bab49034-2882-4e5a-a5e9-89e95910e3ae tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1273 microversion: 2.1 time: 0.317731 Aug 27 04:38:44.003532 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 964/1946] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:43 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1273 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:44.494830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1999493237", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "c5301cb2-dd2b-47a2-b29f-f828528e0152"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:44.627129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] validate_networks() for [('c5301cb2-dd2b-47a2-b29f-f828528e0152', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:38:44.971563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dcde92a3-dd99-4e05-98df-760e32b07bcd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:45.005676 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dcde92a3-dd99-4e05-98df-760e32b07bcd tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1467 microversion: 2.1 time: 1.136283 Aug 27 04:38:45.007976 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 983/1947] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:43 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1467 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:45.026957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-28a6da81-4c28-4896-8de8-96ba0ab39a51 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:45.027947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-28a6da81-4c28-4896-8de8-96ba0ab39a51 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:45.034639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28a6da81-4c28-4896-8de8-96ba0ab39a51 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:45.035393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28a6da81-4c28-4896-8de8-96ba0ab39a51 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:45.036078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28a6da81-4c28-4896-8de8-96ba0ab39a51 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:45.037316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28a6da81-4c28-4896-8de8-96ba0ab39a51 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:45.038087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28a6da81-4c28-4896-8de8-96ba0ab39a51 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:45.038746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28a6da81-4c28-4896-8de8-96ba0ab39a51 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:45.171474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-28a6da81-4c28-4896-8de8-96ba0ab39a51 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:45.180490 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-28a6da81-4c28-4896-8de8-96ba0ab39a51 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1273 microversion: 2.1 time: 0.157955 Aug 27 04:38:45.181228 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 984/1948] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:45 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:45.188182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-37b46062-83fd-4be2-8b6d-8f567429352a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:45.191214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-37b46062-83fd-4be2-8b6d-8f567429352a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:45.228724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37b46062-83fd-4be2-8b6d-8f567429352a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:45.229407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37b46062-83fd-4be2-8b6d-8f567429352a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:45.229967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37b46062-83fd-4be2-8b6d-8f567429352a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:45.230816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37b46062-83fd-4be2-8b6d-8f567429352a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:45.232188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37b46062-83fd-4be2-8b6d-8f567429352a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:45.232900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37b46062-83fd-4be2-8b6d-8f567429352a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:45.772955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-37b46062-83fd-4be2-8b6d-8f567429352a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:45.822761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-37b46062-83fd-4be2-8b6d-8f567429352a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:45.831880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-37b46062-83fd-4be2-8b6d-8f567429352a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:45.837954 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-37b46062-83fd-4be2-8b6d-8f567429352a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1816 microversion: 2.25 time: 0.655607 Aug 27 04:38:45.843610 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 985/1949] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:45 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1816 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:45.867501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f7666ecb-97a8-474b-a3f5-e3ca57aa1f2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:45.871513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f7666ecb-97a8-474b-a3f5-e3ca57aa1f2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:45.900521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7666ecb-97a8-474b-a3f5-e3ca57aa1f2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:45.912772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7666ecb-97a8-474b-a3f5-e3ca57aa1f2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:45.915418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7666ecb-97a8-474b-a3f5-e3ca57aa1f2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:45.919794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7666ecb-97a8-474b-a3f5-e3ca57aa1f2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:45.926605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7666ecb-97a8-474b-a3f5-e3ca57aa1f2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:45.927853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7666ecb-97a8-474b-a3f5-e3ca57aa1f2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:46.144430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f7666ecb-97a8-474b-a3f5-e3ca57aa1f2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:46.188297 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f7666ecb-97a8-474b-a3f5-e3ca57aa1f2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1273 microversion: 2.1 time: 0.341317 Aug 27 04:38:46.190330 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 986/1950] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:45 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1273 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:46.196218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0ecb7ed7-57c3-4c5e-aa36-ce4954ff1b0a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:46.197199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0ecb7ed7-57c3-4c5e-aa36-ce4954ff1b0a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:46.206858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ecb7ed7-57c3-4c5e-aa36-ce4954ff1b0a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:46.207588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ecb7ed7-57c3-4c5e-aa36-ce4954ff1b0a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:46.208557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ecb7ed7-57c3-4c5e-aa36-ce4954ff1b0a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:46.209671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ecb7ed7-57c3-4c5e-aa36-ce4954ff1b0a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:46.210323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ecb7ed7-57c3-4c5e-aa36-ce4954ff1b0a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:46.210935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ecb7ed7-57c3-4c5e-aa36-ce4954ff1b0a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:46.540937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0ecb7ed7-57c3-4c5e-aa36-ce4954ff1b0a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:46.553464 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0ecb7ed7-57c3-4c5e-aa36-ce4954ff1b0a tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1425 microversion: 2.1 time: 0.361769 Aug 27 04:38:46.571256 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 987/1951] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:46 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1425 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:46.577628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6b987f65-6cbc-4bd1-9882-19610f72b51e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:46.589133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6b987f65-6cbc-4bd1-9882-19610f72b51e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:46.600734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b987f65-6cbc-4bd1-9882-19610f72b51e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:46.606889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b987f65-6cbc-4bd1-9882-19610f72b51e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:46.609044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b987f65-6cbc-4bd1-9882-19610f72b51e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:46.610706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b987f65-6cbc-4bd1-9882-19610f72b51e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:46.611864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b987f65-6cbc-4bd1-9882-19610f72b51e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:46.612308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b987f65-6cbc-4bd1-9882-19610f72b51e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:46.743109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6b987f65-6cbc-4bd1-9882-19610f72b51e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:46.770970 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6b987f65-6cbc-4bd1-9882-19610f72b51e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1273 microversion: 2.1 time: 0.179575 Aug 27 04:38:46.780634 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 988/1952] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:46 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1273 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:46.780634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8246cb9c-6065-4a01-b681-41a8c90da8ad req-fb118e93-5675-4cd1-a83b-c33398a6d2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011ab45e-31fa-4ba7-b135-d222e7a725ca", "name": "network-vif-deleted", "tag": "3b944205-dafa-4b20-992c-6ddf5b0ca271"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:46.805360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8246cb9c-6065-4a01-b681-41a8c90da8ad req-fb118e93-5675-4cd1-a83b-c33398a6d2e3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:46.806216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8246cb9c-6065-4a01-b681-41a8c90da8ad req-fb118e93-5675-4cd1-a83b-c33398a6d2e3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:46.806672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8246cb9c-6065-4a01-b681-41a8c90da8ad req-fb118e93-5675-4cd1-a83b-c33398a6d2e3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:46.844670 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8246cb9c-6065-4a01-b681-41a8c90da8ad req-fb118e93-5675-4cd1-a83b-c33398a6d2e3 service nova] Creating event network-vif-deleted:3b944205-dafa-4b20-992c-6ddf5b0ca271 for instance 011ab45e-31fa-4ba7-b135-d222e7a725ca on n-h1-854823-1 Aug 27 04:38:46.854840 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8246cb9c-6065-4a01-b681-41a8c90da8ad req-fb118e93-5675-4cd1-a83b-c33398a6d2e3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078102 Aug 27 04:38:46.857489 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 989/1953] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:46.873392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e09a240-6f6e-4b51-b243-6d0fdb99d3f3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:46.874673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4e09a240-6f6e-4b51-b243-6d0fdb99d3f3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:46.880797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:46.886762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e09a240-6f6e-4b51-b243-6d0fdb99d3f3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:46.888624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e09a240-6f6e-4b51-b243-6d0fdb99d3f3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:46.889369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e09a240-6f6e-4b51-b243-6d0fdb99d3f3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:46.890828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e09a240-6f6e-4b51-b243-6d0fdb99d3f3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:46.891527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e09a240-6f6e-4b51-b243-6d0fdb99d3f3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:46.892421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e09a240-6f6e-4b51-b243-6d0fdb99d3f3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:47.053729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:38:47.056951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:38:47.057773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:38:47.058366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:38:47.058956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:38:47.110491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:47.111039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:47.111494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:47.115197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:47.117129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:47.118138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:47.162697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4e09a240-6f6e-4b51-b243-6d0fdb99d3f3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:47.166879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Getting quotas for project 73673b6b989d49a5b11295612a21b6dd. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:38:47.174145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Getting quotas for user 9b03e4d8bd784c1390a598fb4189dc0d and project 73673b6b989d49a5b11295612a21b6dd. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:38:47.177544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4e09a240-6f6e-4b51-b243-6d0fdb99d3f3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:47.186462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4e09a240-6f6e-4b51-b243-6d0fdb99d3f3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:47.187400 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4e09a240-6f6e-4b51-b243-6d0fdb99d3f3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1806 microversion: 2.25 time: 0.320376 Aug 27 04:38:47.200555 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 990/1954] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:46 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1806 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:38:47.201003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:38:47.201003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:38:47.213232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-18655139-5447-4a20-90ba-65da4f62bc2e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:47.214051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-18655139-5447-4a20-90ba-65da4f62bc2e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:47.224852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18655139-5447-4a20-90ba-65da4f62bc2e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:47.227992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18655139-5447-4a20-90ba-65da4f62bc2e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:47.228980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18655139-5447-4a20-90ba-65da4f62bc2e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:47.234055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18655139-5447-4a20-90ba-65da4f62bc2e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:47.234563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18655139-5447-4a20-90ba-65da4f62bc2e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:47.235104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18655139-5447-4a20-90ba-65da4f62bc2e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:47.256133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:47.282617 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-38f22c9e-b819-44ed-8a1f-a48a8047a26a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.277856 Aug 27 04:38:47.283308 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 965/1955] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 04:38:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3279 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:38:47.296056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f72140f5-47cf-47d9-8440-cd7246037bcb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '.version_select at 0x7f1f2113e1f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:47.308845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f72140f5-47cf-47d9-8440-cd7246037bcb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:47.312985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f72140f5-47cf-47d9-8440-cd7246037bcb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:47.313705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f72140f5-47cf-47d9-8440-cd7246037bcb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:47.341921 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f72140f5-47cf-47d9-8440-cd7246037bcb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 2961 microversion: 2.25 time: 0.052201 Aug 27 04:38:47.343670 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 966/1956] 10.222.0.79 () {60 vars in 1184 bytes} [Sat Aug 27 04:38:47 2022] GET /compute/v2.1/os-migrations => generated 2961 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:47.348841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3302829-bf1d-497d-aeaf-9bd47b20d29c tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:47.350065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3302829-bf1d-497d-aeaf-9bd47b20d29c tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:47.520686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-18655139-5447-4a20-90ba-65da4f62bc2e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:47.549205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3302829-bf1d-497d-aeaf-9bd47b20d29c tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:47.568220 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-18655139-5447-4a20-90ba-65da4f62bc2e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1315 microversion: 2.1 time: 0.355615 Aug 27 04:38:47.569703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3302829-bf1d-497d-aeaf-9bd47b20d29c tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:47.571369 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 991/1957] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:47 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:38:47.576605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3302829-bf1d-497d-aeaf-9bd47b20d29c tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:47.582220 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3302829-bf1d-497d-aeaf-9bd47b20d29c tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1262 microversion: 2.26 time: 0.236393 Aug 27 04:38:47.586873 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 967/1958] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:47 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1262 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:47.589001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7322b518-6f0b-4748-9172-1b79240ef4eb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:47.590774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7322b518-6f0b-4748-9172-1b79240ef4eb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:47.614239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf75db23-efdc-40ea-98fc-3a9278ae34d0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:47.618862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf75db23-efdc-40ea-98fc-3a9278ae34d0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:47.626331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7322b518-6f0b-4748-9172-1b79240ef4eb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:47.628480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7322b518-6f0b-4748-9172-1b79240ef4eb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:47.632518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7322b518-6f0b-4748-9172-1b79240ef4eb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:47.635524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7322b518-6f0b-4748-9172-1b79240ef4eb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:47.636208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7322b518-6f0b-4748-9172-1b79240ef4eb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:47.638958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7322b518-6f0b-4748-9172-1b79240ef4eb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:47.642244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf75db23-efdc-40ea-98fc-3a9278ae34d0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:47.644607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf75db23-efdc-40ea-98fc-3a9278ae34d0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:47.647647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf75db23-efdc-40ea-98fc-3a9278ae34d0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:47.649554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf75db23-efdc-40ea-98fc-3a9278ae34d0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:47.652374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf75db23-efdc-40ea-98fc-3a9278ae34d0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:47.656105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf75db23-efdc-40ea-98fc-3a9278ae34d0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:47.833084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf75db23-efdc-40ea-98fc-3a9278ae34d0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:47.833614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf75db23-efdc-40ea-98fc-3a9278ae34d0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:47.838296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf75db23-efdc-40ea-98fc-3a9278ae34d0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:47.841104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-cf75db23-efdc-40ea-98fc-3a9278ae34d0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lazy-loading 'fault' on Instance uuid 011ab45e-31fa-4ba7-b135-d222e7a725ca {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:38:48.069235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf75db23-efdc-40ea-98fc-3a9278ae34d0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:48.082978 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf75db23-efdc-40ea-98fc-3a9278ae34d0 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 200 len: 1303 microversion: 2.1 time: 0.492154 Aug 27 04:38:48.092420 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 968/1959] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:47 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 1303 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:48.110098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e57dd04e-dda2-4599-b281-e4e80516ac8b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:48.111427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e57dd04e-dda2-4599-b281-e4e80516ac8b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:48.134274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57dd04e-dda2-4599-b281-e4e80516ac8b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:48.135107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57dd04e-dda2-4599-b281-e4e80516ac8b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:48.135770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57dd04e-dda2-4599-b281-e4e80516ac8b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:48.136795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57dd04e-dda2-4599-b281-e4e80516ac8b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:48.138373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57dd04e-dda2-4599-b281-e4e80516ac8b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:48.139870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57dd04e-dda2-4599-b281-e4e80516ac8b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:48.190107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-7322b518-6f0b-4748-9172-1b79240ef4eb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 516299cc-c878-4b8e-bb4d-4247ddbd90cf {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:38:48.223964 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7322b518-6f0b-4748-9172-1b79240ef4eb tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 2425 microversion: 2.25 time: 0.651312 Aug 27 04:38:48.229701 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 992/1960] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:47 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 2425 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:48.255420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-565b610e-2dd5-4552-aca0-7644402f476b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:48.256037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-565b610e-2dd5-4552-aca0-7644402f476b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:48.272355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-565b610e-2dd5-4552-aca0-7644402f476b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:48.273161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-565b610e-2dd5-4552-aca0-7644402f476b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:48.273810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-565b610e-2dd5-4552-aca0-7644402f476b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:48.274708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-565b610e-2dd5-4552-aca0-7644402f476b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:48.275335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-565b610e-2dd5-4552-aca0-7644402f476b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:48.275949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-565b610e-2dd5-4552-aca0-7644402f476b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:48.766624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e57dd04e-dda2-4599-b281-e4e80516ac8b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:48.774840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-565b610e-2dd5-4552-aca0-7644402f476b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 516299cc-c878-4b8e-bb4d-4247ddbd90cf {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:38:48.775699 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e57dd04e-dda2-4599-b281-e4e80516ac8b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1315 microversion: 2.1 time: 0.681719 Aug 27 04:38:48.776849 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 969/1961] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:48 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:48.785878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92b0f44d-e291-4722-93e0-5b49ee9148e5 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:48.787719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92b0f44d-e291-4722-93e0-5b49ee9148e5 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:48.796581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92b0f44d-e291-4722-93e0-5b49ee9148e5 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:48.797359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92b0f44d-e291-4722-93e0-5b49ee9148e5 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:48.798140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92b0f44d-e291-4722-93e0-5b49ee9148e5 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:48.799132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92b0f44d-e291-4722-93e0-5b49ee9148e5 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:48.800116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92b0f44d-e291-4722-93e0-5b49ee9148e5 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:48.801177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92b0f44d-e291-4722-93e0-5b49ee9148e5 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:48.809316 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-565b610e-2dd5-4552-aca0-7644402f476b tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 2425 microversion: 2.25 time: 0.557579 Aug 27 04:38:48.809953 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 993/1962] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:48 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 2425 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:38:48.819831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e8f6b155-d0d8-4d0f-a09d-d992e4123864 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:48.819831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e8f6b155-d0d8-4d0f-a09d-d992e4123864 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:48.836842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e8f6b155-d0d8-4d0f-a09d-d992e4123864 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:48.837363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e8f6b155-d0d8-4d0f-a09d-d992e4123864 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:48.837810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e8f6b155-d0d8-4d0f-a09d-d992e4123864 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:48.838531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e8f6b155-d0d8-4d0f-a09d-d992e4123864 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:48.838993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e8f6b155-d0d8-4d0f-a09d-d992e4123864 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:48.839425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e8f6b155-d0d8-4d0f-a09d-d992e4123864 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:49.104247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e8f6b155-d0d8-4d0f-a09d-d992e4123864 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:49.115957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e8f6b155-d0d8-4d0f-a09d-d992e4123864 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:49.122877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e8f6b155-d0d8-4d0f-a09d-d992e4123864 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:49.126456 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e8f6b155-d0d8-4d0f-a09d-d992e4123864 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1314 microversion: 2.26 time: 0.313867 Aug 27 04:38:49.127052 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 994/1963] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:48 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:49.141908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-c1e9782c-9683-4181-ac41-ec190f16f8ca req-6146971e-34c5-4108-880e-4788cb88da17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696d8484-201d-4f79-9df8-4dbe1d196b6c", "tag": "0a333640-dba0-4503-a400-755c7efa6a00"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:49.195859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c1e9782c-9683-4181-ac41-ec190f16f8ca req-6146971e-34c5-4108-880e-4788cb88da17 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:49.197942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c1e9782c-9683-4181-ac41-ec190f16f8ca req-6146971e-34c5-4108-880e-4788cb88da17 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:49.198877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c1e9782c-9683-4181-ac41-ec190f16f8ca req-6146971e-34c5-4108-880e-4788cb88da17 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:49.238151 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-c1e9782c-9683-4181-ac41-ec190f16f8ca req-6146971e-34c5-4108-880e-4788cb88da17 service nova] Creating event network-changed:0a333640-dba0-4503-a400-755c7efa6a00 for instance 696d8484-201d-4f79-9df8-4dbe1d196b6c on n-h2-854823-1 Aug 27 04:38:49.243593 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-c1e9782c-9683-4181-ac41-ec190f16f8ca req-6146971e-34c5-4108-880e-4788cb88da17 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114387 Aug 27 04:38:49.244861 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 995/1964] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:49.250809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eebc620d-b411-492a-85b8-cb9cece1e294 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:49.251625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eebc620d-b411-492a-85b8-cb9cece1e294 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:49.258678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eebc620d-b411-492a-85b8-cb9cece1e294 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:49.260329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eebc620d-b411-492a-85b8-cb9cece1e294 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:49.260329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eebc620d-b411-492a-85b8-cb9cece1e294 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:49.260989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eebc620d-b411-492a-85b8-cb9cece1e294 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:49.261607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eebc620d-b411-492a-85b8-cb9cece1e294 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:49.262428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eebc620d-b411-492a-85b8-cb9cece1e294 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:49.487187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-eebc620d-b411-492a-85b8-cb9cece1e294 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lazy-loading 'services' on Instance uuid 516299cc-c878-4b8e-bb4d-4247ddbd90cf {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:38:49.628727 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eebc620d-b411-492a-85b8-cb9cece1e294 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "DELETE /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments/3f1ffa76-8e4d-4bab-bdc9-0a7560d30ef4" status: 202 len: 0 microversion: 2.25 time: 0.382200 Aug 27 04:38:49.630222 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 996/1965] 10.222.0.79 () {60 vars in 1457 bytes} [Sat Aug 27 04:38:49 2022] DELETE /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments/3f1ffa76-8e4d-4bab-bdc9-0a7560d30ef4 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:49.638656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-116e1977-d337-467f-b27d-4f6d71a426c5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:49.639922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-116e1977-d337-467f-b27d-4f6d71a426c5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: 011ab45e-31fa-4ba7-b135-d222e7a725ca] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:49.649379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-116e1977-d337-467f-b27d-4f6d71a426c5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:49.651302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-116e1977-d337-467f-b27d-4f6d71a426c5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:49.659937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-116e1977-d337-467f-b27d-4f6d71a426c5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:49.666199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-116e1977-d337-467f-b27d-4f6d71a426c5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:49.667785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-116e1977-d337-467f-b27d-4f6d71a426c5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:49.669302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-116e1977-d337-467f-b27d-4f6d71a426c5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:49.688053 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-116e1977-d337-467f-b27d-4f6d71a426c5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] HTTP exception thrown: Instance 011ab45e-31fa-4ba7-b135-d222e7a725ca could not be found. Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-116e1977-d337-467f-b27d-4f6d71a426c5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Request method failure captured: Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca HTTP/1.1 Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ6AeW_zm8SY21iUcCjybOQRhFfAok2jE39-mLa09_Dltzlbt-gan45wUn5iFUC0pKIw0sMm3VP1lzjHL0IaDqIaaVXZ23IHOpUYGzCjTCGVqwYZ20wRIdZHGSB7AHKGaJ8Eeq1SzWc8v1I2Or6vKojXFfvsB8tSFslT1wKBVPaOw_w Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: abfa50b6f05c4413b2a96f2490ac43a1 Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-MigrationsAdminTest-543591827 Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-MigrationsAdminTest-543591827 Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: abfa50b6f05c4413b2a96f2490ac43a1 Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-MigrationsAdminTest-543591827 Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-MigrationsAdminTest-543591827-project Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 7e6454ced7834bbdaeee89ccef19f510 Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-MigrationsAdminTest-543591827-project Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 011ab45e-31fa-4ba7-b135-d222e7a725ca could not be found. Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '011ab45e-31fa-4ba7-b135-d222e7a725ca'} Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011ab45e-31fa-4ba7-b135-d222e7a725ca could not be found. Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011ab45e-31fa-4ba7-b135-d222e7a725ca could not be found. Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:49.690733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:49.696962 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:49.696962 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:49.696962 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:49.696962 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:49.696962 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:49.696962 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011ab45e-31fa-4ba7-b135-d222e7a725ca could not be found. Aug 27 04:38:49.696962 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:49.700991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-116e1977-d337-467f-b27d-4f6d71a426c5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Returning 404 to user: Instance 011ab45e-31fa-4ba7-b135-d222e7a725ca could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:49.702808 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-116e1977-d337-467f-b27d-4f6d71a426c5 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca" status: 404 len: 111 microversion: 2.1 time: 0.070191 Aug 27 04:38:49.706671 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 997/1966] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:49 2022] GET /compute/v2.1/servers/011ab45e-31fa-4ba7-b135-d222e7a725ca => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:49.712479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-173ce4cf-8a18-4381-b66f-e1e4c148ebe1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:49.716018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-173ce4cf-8a18-4381-b66f-e1e4c148ebe1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:49.722913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-173ce4cf-8a18-4381-b66f-e1e4c148ebe1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:49.723533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-173ce4cf-8a18-4381-b66f-e1e4c148ebe1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:49.724071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-173ce4cf-8a18-4381-b66f-e1e4c148ebe1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:49.724929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-173ce4cf-8a18-4381-b66f-e1e4c148ebe1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:49.725486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-173ce4cf-8a18-4381-b66f-e1e4c148ebe1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:49.725624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92b0f44d-e291-4722-93e0-5b49ee9148e5 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:49.726102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-173ce4cf-8a18-4381-b66f-e1e4c148ebe1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:49.734864 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92b0f44d-e291-4722-93e0-5b49ee9148e5 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1315 microversion: 2.1 time: 0.956776 Aug 27 04:38:49.735461 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 970/1967] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:48 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1315 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:49.749774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33d83344-c995-41e0-9853-0fa8f32aaf10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:49.757307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33d83344-c995-41e0-9853-0fa8f32aaf10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:49.779595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33d83344-c995-41e0-9853-0fa8f32aaf10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:49.780097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33d83344-c995-41e0-9853-0fa8f32aaf10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:49.780606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33d83344-c995-41e0-9853-0fa8f32aaf10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:49.785555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33d83344-c995-41e0-9853-0fa8f32aaf10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:49.786040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33d83344-c995-41e0-9853-0fa8f32aaf10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:49.786479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33d83344-c995-41e0-9853-0fa8f32aaf10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:49.803635 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-173ce4cf-8a18-4381-b66f-e1e4c148ebe1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.095526 Aug 27 04:38:49.808813 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 998/1968] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 04:38:49 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:38:49.821571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-52369efc-b7af-4757-ab02-36478e7751f1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:49.822553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-52369efc-b7af-4757-ab02-36478e7751f1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:49.837188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33d83344-c995-41e0-9853-0fa8f32aaf10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:38:49.840617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52369efc-b7af-4757-ab02-36478e7751f1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:49.841523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52369efc-b7af-4757-ab02-36478e7751f1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:49.842209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52369efc-b7af-4757-ab02-36478e7751f1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:49.843180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52369efc-b7af-4757-ab02-36478e7751f1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:49.845003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52369efc-b7af-4757-ab02-36478e7751f1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:49.850338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52369efc-b7af-4757-ab02-36478e7751f1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:49.932371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:49.991924 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33d83344-c995-41e0-9853-0fa8f32aaf10 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 204 len: 0 microversion: 2.1 time: 0.246232 Aug 27 04:38:49.994572 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 971/1969] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:38:49 2022] DELETE /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:50.006676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-21753756-2491-47a7-b141-022238890596 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:50.007942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-21753756-2491-47a7-b141-022238890596 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:50.018218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21753756-2491-47a7-b141-022238890596 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:50.019049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21753756-2491-47a7-b141-022238890596 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:50.021000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21753756-2491-47a7-b141-022238890596 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:50.023227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21753756-2491-47a7-b141-022238890596 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:50.023976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21753756-2491-47a7-b141-022238890596 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:50.024938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21753756-2491-47a7-b141-022238890596 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:50.219051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-52369efc-b7af-4757-ab02-36478e7751f1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:50.227007 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-52369efc-b7af-4757-ab02-36478e7751f1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1315 microversion: 2.1 time: 0.416144 Aug 27 04:38:50.240051 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 999/1970] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:49 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:50.245171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f947964-d904-4ae2-b2de-f47b393676bb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:50.245801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4f947964-d904-4ae2-b2de-f47b393676bb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:50.252754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f947964-d904-4ae2-b2de-f47b393676bb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:50.253505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f947964-d904-4ae2-b2de-f47b393676bb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:50.253942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f947964-d904-4ae2-b2de-f47b393676bb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:50.254658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f947964-d904-4ae2-b2de-f47b393676bb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:50.255113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f947964-d904-4ae2-b2de-f47b393676bb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:50.255641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f947964-d904-4ae2-b2de-f47b393676bb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:50.365243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4f947964-d904-4ae2-b2de-f47b393676bb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:50.378750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4f947964-d904-4ae2-b2de-f47b393676bb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:50.380352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4f947964-d904-4ae2-b2de-f47b393676bb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:50.381810 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4f947964-d904-4ae2-b2de-f47b393676bb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1320 microversion: 2.26 time: 0.140481 Aug 27 04:38:50.382561 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1000/1971] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:50 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1320 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:50.485424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-21753756-2491-47a7-b141-022238890596 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:50.496144 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-21753756-2491-47a7-b141-022238890596 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1468 microversion: 2.1 time: 0.495484 Aug 27 04:38:50.497799 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 972/1972] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:49 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1468 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:50.759771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b0c5274f-426d-458f-bcc9-3aa6a3d10df7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:50.760570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b0c5274f-426d-458f-bcc9-3aa6a3d10df7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:50.772516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0c5274f-426d-458f-bcc9-3aa6a3d10df7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:50.774242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0c5274f-426d-458f-bcc9-3aa6a3d10df7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:50.776306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0c5274f-426d-458f-bcc9-3aa6a3d10df7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:50.777210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0c5274f-426d-458f-bcc9-3aa6a3d10df7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:50.780684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0c5274f-426d-458f-bcc9-3aa6a3d10df7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:50.781094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0c5274f-426d-458f-bcc9-3aa6a3d10df7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:50.821646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-acf647be-43d0-49e9-8616-df64dc2154be tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:50.824123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-acf647be-43d0-49e9-8616-df64dc2154be tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:50.837189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acf647be-43d0-49e9-8616-df64dc2154be tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:50.838723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acf647be-43d0-49e9-8616-df64dc2154be tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:50.839351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acf647be-43d0-49e9-8616-df64dc2154be tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:50.841198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acf647be-43d0-49e9-8616-df64dc2154be tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:50.842251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acf647be-43d0-49e9-8616-df64dc2154be tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:50.842975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acf647be-43d0-49e9-8616-df64dc2154be tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:50.897027 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-acf647be-43d0-49e9-8616-df64dc2154be tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.080411 Aug 27 04:38:50.898304 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 973/1973] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 04:38:50 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:38:50.942936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4f5f2fe6-177e-46c8-b5b9-c564c37822d0 req-2e41f2e4-48f5-430b-a092-5d2e6f557470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0335025-7f4b-4576-a817-72f93df40d5d", "tag": "09f4e7a1-6b5b-4ba8-8e43-d444a1426021"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:50.960628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4f5f2fe6-177e-46c8-b5b9-c564c37822d0 req-2e41f2e4-48f5-430b-a092-5d2e6f557470 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:50.961114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4f5f2fe6-177e-46c8-b5b9-c564c37822d0 req-2e41f2e4-48f5-430b-a092-5d2e6f557470 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:50.961542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4f5f2fe6-177e-46c8-b5b9-c564c37822d0 req-2e41f2e4-48f5-430b-a092-5d2e6f557470 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:50.992283 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4f5f2fe6-177e-46c8-b5b9-c564c37822d0 req-2e41f2e4-48f5-430b-a092-5d2e6f557470 service nova] Creating event network-changed:09f4e7a1-6b5b-4ba8-8e43-d444a1426021 for instance d0335025-7f4b-4576-a817-72f93df40d5d on n-h1-854823-1 Aug 27 04:38:50.999001 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4f5f2fe6-177e-46c8-b5b9-c564c37822d0 req-2e41f2e4-48f5-430b-a092-5d2e6f557470 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059456 Aug 27 04:38:51.000971 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 974/1974] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:38:51.068261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:51.249098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9b36a50e-9a5c-4e25-8e23-e0ea17c29599 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:51.250104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9b36a50e-9a5c-4e25-8e23-e0ea17c29599 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:51.270983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b36a50e-9a5c-4e25-8e23-e0ea17c29599 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:51.271489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b36a50e-9a5c-4e25-8e23-e0ea17c29599 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:51.271982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b36a50e-9a5c-4e25-8e23-e0ea17c29599 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:51.272743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b36a50e-9a5c-4e25-8e23-e0ea17c29599 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:51.273249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b36a50e-9a5c-4e25-8e23-e0ea17c29599 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:51.273922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b36a50e-9a5c-4e25-8e23-e0ea17c29599 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:51.697981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b36a50e-9a5c-4e25-8e23-e0ea17c29599 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:51.707151 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9b36a50e-9a5c-4e25-8e23-e0ea17c29599 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1315 microversion: 2.1 time: 0.463398 Aug 27 04:38:51.725786 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 975/1975] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:51 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:51.732500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5ef94b6-0995-479b-bbcc-83e7c655b792 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:51.734695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5ef94b6-0995-479b-bbcc-83e7c655b792 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:51.743788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5ef94b6-0995-479b-bbcc-83e7c655b792 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:51.745113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5ef94b6-0995-479b-bbcc-83e7c655b792 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:51.745797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5ef94b6-0995-479b-bbcc-83e7c655b792 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:51.747351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5ef94b6-0995-479b-bbcc-83e7c655b792 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:51.748061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5ef94b6-0995-479b-bbcc-83e7c655b792 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:51.749030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5ef94b6-0995-479b-bbcc-83e7c655b792 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:51.942473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b0c5274f-426d-458f-bcc9-3aa6a3d10df7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:51.955955 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b0c5274f-426d-458f-bcc9-3aa6a3d10df7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1315 microversion: 2.1 time: 1.201111 Aug 27 04:38:51.961703 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1001/1976] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:50 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1315 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:51.974050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5d4deff6-fc92-4a0d-b4eb-be983339a5f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:51.975005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5d4deff6-fc92-4a0d-b4eb-be983339a5f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:52.011189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d4deff6-fc92-4a0d-b4eb-be983339a5f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:52.012555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d4deff6-fc92-4a0d-b4eb-be983339a5f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:52.022283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d4deff6-fc92-4a0d-b4eb-be983339a5f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:52.023903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d4deff6-fc92-4a0d-b4eb-be983339a5f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:52.025924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d4deff6-fc92-4a0d-b4eb-be983339a5f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:52.031859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d4deff6-fc92-4a0d-b4eb-be983339a5f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:52.550008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5d4deff6-fc92-4a0d-b4eb-be983339a5f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:52.569137 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5d4deff6-fc92-4a0d-b4eb-be983339a5f1 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1468 microversion: 2.1 time: 0.606043 Aug 27 04:38:52.581100 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1002/1977] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:51 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1468 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:52.589250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-95bbd3a3-1164-4738-b5f2-d3ca783e8fb5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:52.592148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-95bbd3a3-1164-4738-b5f2-d3ca783e8fb5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:52.599452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95bbd3a3-1164-4738-b5f2-d3ca783e8fb5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:52.600491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95bbd3a3-1164-4738-b5f2-d3ca783e8fb5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:52.601426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95bbd3a3-1164-4738-b5f2-d3ca783e8fb5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:52.602424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95bbd3a3-1164-4738-b5f2-d3ca783e8fb5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:52.607339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95bbd3a3-1164-4738-b5f2-d3ca783e8fb5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:52.608077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95bbd3a3-1164-4738-b5f2-d3ca783e8fb5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:52.664308 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-95bbd3a3-1164-4738-b5f2-d3ca783e8fb5 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081305 Aug 27 04:38:52.665640 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1003/1978] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 04:38:52 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:38:52.732434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-46d3c3b9-f4cd-4eaa-b1e8-dd0ff5eb859d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:52.733280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-46d3c3b9-f4cd-4eaa-b1e8-dd0ff5eb859d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:52.743041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46d3c3b9-f4cd-4eaa-b1e8-dd0ff5eb859d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:52.745014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46d3c3b9-f4cd-4eaa-b1e8-dd0ff5eb859d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:52.745608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46d3c3b9-f4cd-4eaa-b1e8-dd0ff5eb859d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:52.749700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46d3c3b9-f4cd-4eaa-b1e8-dd0ff5eb859d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:52.751087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46d3c3b9-f4cd-4eaa-b1e8-dd0ff5eb859d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:52.751802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46d3c3b9-f4cd-4eaa-b1e8-dd0ff5eb859d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:52.757105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c5ef94b6-0995-479b-bbcc-83e7c655b792 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:52.775149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c5ef94b6-0995-479b-bbcc-83e7c655b792 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:52.778464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c5ef94b6-0995-479b-bbcc-83e7c655b792 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:52.783584 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5ef94b6-0995-479b-bbcc-83e7c655b792 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1362 microversion: 2.26 time: 1.055072 Aug 27 04:38:52.788859 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 976/1979] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:51 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1362 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:52.984178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32bbccda-2b06-477f-9880-d84737e6c4c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:52.985111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32bbccda-2b06-477f-9880-d84737e6c4c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:53.028437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32bbccda-2b06-477f-9880-d84737e6c4c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:53.033103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32bbccda-2b06-477f-9880-d84737e6c4c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:53.035852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32bbccda-2b06-477f-9880-d84737e6c4c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:53.039109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32bbccda-2b06-477f-9880-d84737e6c4c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:53.039641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32bbccda-2b06-477f-9880-d84737e6c4c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:53.040085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32bbccda-2b06-477f-9880-d84737e6c4c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:53.195500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-46d3c3b9-f4cd-4eaa-b1e8-dd0ff5eb859d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:53.204184 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-46d3c3b9-f4cd-4eaa-b1e8-dd0ff5eb859d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1315 microversion: 2.1 time: 0.475539 Aug 27 04:38:53.222180 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1004/1980] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:52 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:38:53.416557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32bbccda-2b06-477f-9880-d84737e6c4c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:53.431789 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32bbccda-2b06-477f-9880-d84737e6c4c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1315 microversion: 2.1 time: 0.454072 Aug 27 04:38:53.433192 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 977/1981] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:52 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:38:53.593580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-482d04ac-9524-430b-ba57-bb3bd6583cfa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:53.594503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-482d04ac-9524-430b-ba57-bb3bd6583cfa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:53.600941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-482d04ac-9524-430b-ba57-bb3bd6583cfa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:53.601719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-482d04ac-9524-430b-ba57-bb3bd6583cfa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:53.602330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-482d04ac-9524-430b-ba57-bb3bd6583cfa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:53.603229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-482d04ac-9524-430b-ba57-bb3bd6583cfa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:53.603863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-482d04ac-9524-430b-ba57-bb3bd6583cfa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:53.604996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-482d04ac-9524-430b-ba57-bb3bd6583cfa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:53.667322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e5c55a7c-ca5f-4f26-a75d-76ec26f7b547 req-af46cc5c-0ed7-48c8-84a3-58ac8c0611e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eb73d85-d719-416d-8bab-d09b65578cc3", "tag": "f1e9eb57-5c77-4f0f-a0e4-d0d7dd3ac084"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:53.686771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e5c55a7c-ca5f-4f26-a75d-76ec26f7b547 req-af46cc5c-0ed7-48c8-84a3-58ac8c0611e6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:53.687546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e5c55a7c-ca5f-4f26-a75d-76ec26f7b547 req-af46cc5c-0ed7-48c8-84a3-58ac8c0611e6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:53.688151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e5c55a7c-ca5f-4f26-a75d-76ec26f7b547 req-af46cc5c-0ed7-48c8-84a3-58ac8c0611e6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:53.700912 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e5c55a7c-ca5f-4f26-a75d-76ec26f7b547 req-af46cc5c-0ed7-48c8-84a3-58ac8c0611e6 service nova] Creating event network-changed:f1e9eb57-5c77-4f0f-a0e4-d0d7dd3ac084 for instance 3eb73d85-d719-416d-8bab-d09b65578cc3 on n-h1-854823-1 Aug 27 04:38:53.707982 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e5c55a7c-ca5f-4f26-a75d-76ec26f7b547 req-af46cc5c-0ed7-48c8-84a3-58ac8c0611e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045369 Aug 27 04:38:53.709212 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 978/1982] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:38:53.717734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5158e63-8c18-4e6f-8ec7-db4486188486 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:53.720976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5158e63-8c18-4e6f-8ec7-db4486188486 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:53.729281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5158e63-8c18-4e6f-8ec7-db4486188486 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:53.730320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5158e63-8c18-4e6f-8ec7-db4486188486 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:53.731497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5158e63-8c18-4e6f-8ec7-db4486188486 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:53.732405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5158e63-8c18-4e6f-8ec7-db4486188486 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:53.733111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5158e63-8c18-4e6f-8ec7-db4486188486 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:53.734464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5158e63-8c18-4e6f-8ec7-db4486188486 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:53.773901 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5158e63-8c18-4e6f-8ec7-db4486188486 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.062901 Aug 27 04:38:53.775415 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 979/1983] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 04:38:53 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:38:53.808571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ec2617f-a203-48cd-a59f-5041db7b2b58 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:53.813157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ec2617f-a203-48cd-a59f-5041db7b2b58 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:53.822433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ec2617f-a203-48cd-a59f-5041db7b2b58 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:53.823176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ec2617f-a203-48cd-a59f-5041db7b2b58 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:53.823784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ec2617f-a203-48cd-a59f-5041db7b2b58 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:53.825290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ec2617f-a203-48cd-a59f-5041db7b2b58 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:53.825918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ec2617f-a203-48cd-a59f-5041db7b2b58 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:53.826514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ec2617f-a203-48cd-a59f-5041db7b2b58 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:54.018569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ec2617f-a203-48cd-a59f-5041db7b2b58 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:54.032029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ec2617f-a203-48cd-a59f-5041db7b2b58 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:54.037056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ec2617f-a203-48cd-a59f-5041db7b2b58 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:54.038545 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ec2617f-a203-48cd-a59f-5041db7b2b58 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1362 microversion: 2.26 time: 0.234199 Aug 27 04:38:54.054136 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 980/1984] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:53 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:54.128076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-482d04ac-9524-430b-ba57-bb3bd6583cfa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:54.145002 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-482d04ac-9524-430b-ba57-bb3bd6583cfa tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1468 microversion: 2.1 time: 0.555683 Aug 27 04:38:54.149684 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1005/1985] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:53 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1468 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:54.230681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c30fb95-091f-43e8-9ee8-4d8dade704ad tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:54.231373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c30fb95-091f-43e8-9ee8-4d8dade704ad tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:54.243200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c30fb95-091f-43e8-9ee8-4d8dade704ad tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:54.243712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c30fb95-091f-43e8-9ee8-4d8dade704ad tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:54.244156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c30fb95-091f-43e8-9ee8-4d8dade704ad tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:54.244930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c30fb95-091f-43e8-9ee8-4d8dade704ad tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:54.245397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c30fb95-091f-43e8-9ee8-4d8dade704ad tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:54.245833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c30fb95-091f-43e8-9ee8-4d8dade704ad tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:54.374380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-af81a53e-1d8b-4438-9e9a-5413dcd4f325 req-73f568c0-c2db-4adf-9c6d-ead3d7887e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696d8484-201d-4f79-9df8-4dbe1d196b6c", "name": "network-vif-plugged", "status": "completed", "tag": "0a333640-dba0-4503-a400-755c7efa6a00"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:54.392753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-af81a53e-1d8b-4438-9e9a-5413dcd4f325 req-73f568c0-c2db-4adf-9c6d-ead3d7887e43 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:54.393589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-af81a53e-1d8b-4438-9e9a-5413dcd4f325 req-73f568c0-c2db-4adf-9c6d-ead3d7887e43 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:54.394439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-af81a53e-1d8b-4438-9e9a-5413dcd4f325 req-73f568c0-c2db-4adf-9c6d-ead3d7887e43 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:54.431927 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-af81a53e-1d8b-4438-9e9a-5413dcd4f325 req-73f568c0-c2db-4adf-9c6d-ead3d7887e43 service nova] Creating event network-vif-plugged:0a333640-dba0-4503-a400-755c7efa6a00 for instance 696d8484-201d-4f79-9df8-4dbe1d196b6c on n-h2-854823-1 Aug 27 04:38:54.442933 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-af81a53e-1d8b-4438-9e9a-5413dcd4f325 req-73f568c0-c2db-4adf-9c6d-ead3d7887e43 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072481 Aug 27 04:38:54.444241 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1006/1986] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:38:54.456761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f0c47ebf-fbb7-4824-84c2-ff9b8d92c747 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:54.457754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f0c47ebf-fbb7-4824-84c2-ff9b8d92c747 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:54.465484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c47ebf-fbb7-4824-84c2-ff9b8d92c747 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:54.466293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c47ebf-fbb7-4824-84c2-ff9b8d92c747 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:54.466903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c47ebf-fbb7-4824-84c2-ff9b8d92c747 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:54.477638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c47ebf-fbb7-4824-84c2-ff9b8d92c747 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:54.478581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c47ebf-fbb7-4824-84c2-ff9b8d92c747 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:54.479216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c47ebf-fbb7-4824-84c2-ff9b8d92c747 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:54.635537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c30fb95-091f-43e8-9ee8-4d8dade704ad tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:54.646208 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c30fb95-091f-43e8-9ee8-4d8dade704ad tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1315 microversion: 2.1 time: 0.420343 Aug 27 04:38:54.647614 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 981/1987] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:54 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:54.789263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95a2b9c2-ab98-4e9a-8688-ce279c8d0fb7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:54.792541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95a2b9c2-ab98-4e9a-8688-ce279c8d0fb7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:54.813691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95a2b9c2-ab98-4e9a-8688-ce279c8d0fb7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:54.814542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95a2b9c2-ab98-4e9a-8688-ce279c8d0fb7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:54.815767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95a2b9c2-ab98-4e9a-8688-ce279c8d0fb7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:54.817476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95a2b9c2-ab98-4e9a-8688-ce279c8d0fb7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:54.818527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95a2b9c2-ab98-4e9a-8688-ce279c8d0fb7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:54.819282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95a2b9c2-ab98-4e9a-8688-ce279c8d0fb7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:54.867857 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95a2b9c2-ab98-4e9a-8688-ce279c8d0fb7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.083481 Aug 27 04:38:54.873227 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 982/1988] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 04:38:54 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:38:55.038143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a957e5eb-5d11-4900-b186-9e8cf013aeb5 req-3a119553-3afc-4725-98df-891ba2cfc9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c316d2a9-3517-44df-8382-8e40ae8d3b1b", "name": "network-vif-deleted", "tag": "19550fed-7930-476b-a65b-28ccbc745f07"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:55.063753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f0c47ebf-fbb7-4824-84c2-ff9b8d92c747 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:55.076886 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f0c47ebf-fbb7-4824-84c2-ff9b8d92c747 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1315 microversion: 2.1 time: 0.625642 Aug 27 04:38:55.080595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a957e5eb-5d11-4900-b186-9e8cf013aeb5 req-3a119553-3afc-4725-98df-891ba2cfc9dd service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:55.095674 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1007/1989] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:54 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:55.100498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a957e5eb-5d11-4900-b186-9e8cf013aeb5 req-3a119553-3afc-4725-98df-891ba2cfc9dd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:55.101290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a957e5eb-5d11-4900-b186-9e8cf013aeb5 req-3a119553-3afc-4725-98df-891ba2cfc9dd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:55.108873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-28fb5501-c0b2-44e0-b95b-8e73ea1dfbfb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:55.109825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-28fb5501-c0b2-44e0-b95b-8e73ea1dfbfb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:55.134778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28fb5501-c0b2-44e0-b95b-8e73ea1dfbfb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:55.135279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28fb5501-c0b2-44e0-b95b-8e73ea1dfbfb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:55.135704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28fb5501-c0b2-44e0-b95b-8e73ea1dfbfb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:55.139021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28fb5501-c0b2-44e0-b95b-8e73ea1dfbfb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:55.140491 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a957e5eb-5d11-4900-b186-9e8cf013aeb5 req-3a119553-3afc-4725-98df-891ba2cfc9dd service nova] Creating event network-vif-deleted:19550fed-7930-476b-a65b-28ccbc745f07 for instance c316d2a9-3517-44df-8382-8e40ae8d3b1b on n-h2-854823-1 Aug 27 04:38:55.141244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28fb5501-c0b2-44e0-b95b-8e73ea1dfbfb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:55.141846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28fb5501-c0b2-44e0-b95b-8e73ea1dfbfb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:55.153521 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a957e5eb-5d11-4900-b186-9e8cf013aeb5 req-3a119553-3afc-4725-98df-891ba2cfc9dd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121631 Aug 27 04:38:55.158772 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 983/1990] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:55.172690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c92a3ec-71e9-44bc-a4cf-371b2eb2ff12 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:55.173776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c92a3ec-71e9-44bc-a4cf-371b2eb2ff12 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:55.194855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c92a3ec-71e9-44bc-a4cf-371b2eb2ff12 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:55.203048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c92a3ec-71e9-44bc-a4cf-371b2eb2ff12 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:55.203738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c92a3ec-71e9-44bc-a4cf-371b2eb2ff12 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:55.204832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c92a3ec-71e9-44bc-a4cf-371b2eb2ff12 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:55.206082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c92a3ec-71e9-44bc-a4cf-371b2eb2ff12 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:55.206683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c92a3ec-71e9-44bc-a4cf-371b2eb2ff12 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:55.207561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:55.393876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c92a3ec-71e9-44bc-a4cf-371b2eb2ff12 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:55.409019 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c92a3ec-71e9-44bc-a4cf-371b2eb2ff12 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1297 microversion: 2.1 time: 0.246032 Aug 27 04:38:55.428561 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 984/1991] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:55 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1297 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:55.519703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-28fb5501-c0b2-44e0-b95b-8e73ea1dfbfb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:55.537663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-28fb5501-c0b2-44e0-b95b-8e73ea1dfbfb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:55.543607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-28fb5501-c0b2-44e0-b95b-8e73ea1dfbfb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:55.545019 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-28fb5501-c0b2-44e0-b95b-8e73ea1dfbfb tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1362 microversion: 2.26 time: 0.447901 Aug 27 04:38:55.548758 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1008/1992] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:55 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1362 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:55.667651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-463fccbc-a775-42c2-b41f-cac02abd41d8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:55.668299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-463fccbc-a775-42c2-b41f-cac02abd41d8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:55.676960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-463fccbc-a775-42c2-b41f-cac02abd41d8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:55.677471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-463fccbc-a775-42c2-b41f-cac02abd41d8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:55.678025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-463fccbc-a775-42c2-b41f-cac02abd41d8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:55.678892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-463fccbc-a775-42c2-b41f-cac02abd41d8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:55.679196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-463fccbc-a775-42c2-b41f-cac02abd41d8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:55.679619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-463fccbc-a775-42c2-b41f-cac02abd41d8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:55.883820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-01fbcb09-8030-4974-abd7-8a969fcd99d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:55.890629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-01fbcb09-8030-4974-abd7-8a969fcd99d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:55.901072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01fbcb09-8030-4974-abd7-8a969fcd99d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:55.901821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01fbcb09-8030-4974-abd7-8a969fcd99d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:55.903946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01fbcb09-8030-4974-abd7-8a969fcd99d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:55.905784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01fbcb09-8030-4974-abd7-8a969fcd99d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:55.906911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01fbcb09-8030-4974-abd7-8a969fcd99d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:55.907579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01fbcb09-8030-4974-abd7-8a969fcd99d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:55.953468 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-01fbcb09-8030-4974-abd7-8a969fcd99d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075735 Aug 27 04:38:55.959304 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1009/1993] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 04:38:55 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:38:56.103874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-69feb332-ce35-4ad3-a4c0-1eb52b8d4426 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:56.104811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-69feb332-ce35-4ad3-a4c0-1eb52b8d4426 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:56.120061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69feb332-ce35-4ad3-a4c0-1eb52b8d4426 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:56.120594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69feb332-ce35-4ad3-a4c0-1eb52b8d4426 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:56.124009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69feb332-ce35-4ad3-a4c0-1eb52b8d4426 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:56.125660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69feb332-ce35-4ad3-a4c0-1eb52b8d4426 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:56.129281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69feb332-ce35-4ad3-a4c0-1eb52b8d4426 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:56.133952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69feb332-ce35-4ad3-a4c0-1eb52b8d4426 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:56.350082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-463fccbc-a775-42c2-b41f-cac02abd41d8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:56.364178 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-463fccbc-a775-42c2-b41f-cac02abd41d8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1315 microversion: 2.1 time: 0.700460 Aug 27 04:38:56.364990 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 985/1994] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:55 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:56.441563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fda1860c-d244-47c7-8711-0899a09f4120 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:56.442231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fda1860c-d244-47c7-8711-0899a09f4120 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:56.455018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fda1860c-d244-47c7-8711-0899a09f4120 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:56.455927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fda1860c-d244-47c7-8711-0899a09f4120 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:56.456777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fda1860c-d244-47c7-8711-0899a09f4120 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:56.457719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fda1860c-d244-47c7-8711-0899a09f4120 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:56.458383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fda1860c-d244-47c7-8711-0899a09f4120 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:56.459269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fda1860c-d244-47c7-8711-0899a09f4120 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:56.533577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fda1860c-d244-47c7-8711-0899a09f4120 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:56.536948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fda1860c-d244-47c7-8711-0899a09f4120 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:56.537616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fda1860c-d244-47c7-8711-0899a09f4120 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:56.538272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-fda1860c-d244-47c7-8711-0899a09f4120 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lazy-loading 'fault' on Instance uuid c316d2a9-3517-44df-8382-8e40ae8d3b1b {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:38:56.787378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fda1860c-d244-47c7-8711-0899a09f4120 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6454ced7834bbdaeee89ccef19f510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfa50b6f05c4413b2a96f2490ac43a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:56.804791 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fda1860c-d244-47c7-8711-0899a09f4120 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 200 len: 1302 microversion: 2.1 time: 0.366941 Aug 27 04:38:56.807979 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 986/1995] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:56 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 1302 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:38:56.836363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dd066182-ce55-47d1-ba6f-2a879295b63e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:56.839866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dd066182-ce55-47d1-ba6f-2a879295b63e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:56.874463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd066182-ce55-47d1-ba6f-2a879295b63e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:56.878609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd066182-ce55-47d1-ba6f-2a879295b63e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:56.880426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd066182-ce55-47d1-ba6f-2a879295b63e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:56.882969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd066182-ce55-47d1-ba6f-2a879295b63e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:56.883646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd066182-ce55-47d1-ba6f-2a879295b63e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:56.886071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd066182-ce55-47d1-ba6f-2a879295b63e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:56.890072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-69feb332-ce35-4ad3-a4c0-1eb52b8d4426 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:56.906867 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-69feb332-ce35-4ad3-a4c0-1eb52b8d4426 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1315 microversion: 2.1 time: 0.807798 Aug 27 04:38:56.929309 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1010/1996] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:56 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1315 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:57.153903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:57.561906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=20 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:57.614649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-faea735c-b5dd-4dcb-a49c-8539884988d6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:57.618052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-faea735c-b5dd-4dcb-a49c-8539884988d6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:57.641414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-faea735c-b5dd-4dcb-a49c-8539884988d6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:57.646917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-faea735c-b5dd-4dcb-a49c-8539884988d6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:57.651972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-faea735c-b5dd-4dcb-a49c-8539884988d6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:57.655506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-faea735c-b5dd-4dcb-a49c-8539884988d6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:57.656216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-faea735c-b5dd-4dcb-a49c-8539884988d6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:57.656900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-faea735c-b5dd-4dcb-a49c-8539884988d6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:57.795150 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-faea735c-b5dd-4dcb-a49c-8539884988d6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.832446 Aug 27 04:38:57.796849 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1011/1997] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 04:38:56 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments => generated 197 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:38:57.810964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a54d2981-dc9c-4dc6-be5f-d1369a58ec03 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:57.812488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a54d2981-dc9c-4dc6-be5f-d1369a58ec03 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:57.831114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a54d2981-dc9c-4dc6-be5f-d1369a58ec03 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:57.833495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a54d2981-dc9c-4dc6-be5f-d1369a58ec03 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:57.835703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a54d2981-dc9c-4dc6-be5f-d1369a58ec03 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:57.838987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a54d2981-dc9c-4dc6-be5f-d1369a58ec03 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:57.841675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a54d2981-dc9c-4dc6-be5f-d1369a58ec03 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:57.845737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a54d2981-dc9c-4dc6-be5f-d1369a58ec03 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:58.039989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dd066182-ce55-47d1-ba6f-2a879295b63e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:58.050695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dd066182-ce55-47d1-ba6f-2a879295b63e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:58.052172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dd066182-ce55-47d1-ba6f-2a879295b63e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:58.053922 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dd066182-ce55-47d1-ba6f-2a879295b63e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1362 microversion: 2.26 time: 1.241861 Aug 27 04:38:58.065500 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 987/1998] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:56 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1362 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:58.071152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74a1a346-02d7-4dd8-a80f-0e73d4acc224 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:58.071784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74a1a346-02d7-4dd8-a80f-0e73d4acc224 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] [instance: c316d2a9-3517-44df-8382-8e40ae8d3b1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:58.079687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74a1a346-02d7-4dd8-a80f-0e73d4acc224 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:58.080107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74a1a346-02d7-4dd8-a80f-0e73d4acc224 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:58.080711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74a1a346-02d7-4dd8-a80f-0e73d4acc224 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:58.081441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74a1a346-02d7-4dd8-a80f-0e73d4acc224 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:58.081992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74a1a346-02d7-4dd8-a80f-0e73d4acc224 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:58.082428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74a1a346-02d7-4dd8-a80f-0e73d4acc224 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:58.101128 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-74a1a346-02d7-4dd8-a80f-0e73d4acc224 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] HTTP exception thrown: Instance c316d2a9-3517-44df-8382-8e40ae8d3b1b could not be found. Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74a1a346-02d7-4dd8-a80f-0e73d4acc224 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Request method failure captured: Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b HTTP/1.1 Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ6AeW_zm8SY21iUcCjybOQRhFfAok2jE39-mLa09_Dltzlbt-gan45wUn5iFUC0pKIw0sMm3VP1lzjHL0IaDqIaaVXZ23IHOpUYGzCjTCGVqwYZ20wRIdZHGSB7AHKGaJ8Eeq1SzWc8v1I2Or6vKojXFfvsB8tSFslT1wKBVPaOw_w Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: abfa50b6f05c4413b2a96f2490ac43a1 Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-MigrationsAdminTest-543591827 Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abfa50b6f05c4413b2a96f2490ac43a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-MigrationsAdminTest-543591827 Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: abfa50b6f05c4413b2a96f2490ac43a1 Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-MigrationsAdminTest-543591827 Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-MigrationsAdminTest-543591827-project Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 7e6454ced7834bbdaeee89ccef19f510 Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-MigrationsAdminTest-543591827-project Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance c316d2a9-3517-44df-8382-8e40ae8d3b1b could not be found. Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'c316d2a9-3517-44df-8382-8e40ae8d3b1b'} Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c316d2a9-3517-44df-8382-8e40ae8d3b1b could not be found. Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c316d2a9-3517-44df-8382-8e40ae8d3b1b could not be found. Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:58.104873 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:58.110947 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:58.110947 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:58.110947 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:58.110947 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:58.110947 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:58.110947 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c316d2a9-3517-44df-8382-8e40ae8d3b1b could not be found. Aug 27 04:38:58.110947 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:38:58.117581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74a1a346-02d7-4dd8-a80f-0e73d4acc224 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] Returning 404 to user: Instance c316d2a9-3517-44df-8382-8e40ae8d3b1b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:58.118849 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74a1a346-02d7-4dd8-a80f-0e73d4acc224 tempest-MigrationsAdminTest-543591827 tempest-MigrationsAdminTest-543591827-project] 10.222.0.79 "GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b" status: 404 len: 111 microversion: 2.1 time: 0.052222 Aug 27 04:38:58.120184 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 988/1999] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:58 2022] GET /compute/v2.1/servers/c316d2a9-3517-44df-8382-8e40ae8d3b1b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:58.128835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89afb7ac-7b70-4584-9b47-aaa213d2c4e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:58.129679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89afb7ac-7b70-4584-9b47-aaa213d2c4e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:58.160419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89afb7ac-7b70-4584-9b47-aaa213d2c4e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:58.161412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89afb7ac-7b70-4584-9b47-aaa213d2c4e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:58.162161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89afb7ac-7b70-4584-9b47-aaa213d2c4e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:58.164307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89afb7ac-7b70-4584-9b47-aaa213d2c4e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:58.164856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89afb7ac-7b70-4584-9b47-aaa213d2c4e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:58.165319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89afb7ac-7b70-4584-9b47-aaa213d2c4e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:58.308118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a54d2981-dc9c-4dc6-be5f-d1369a58ec03 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:58.318405 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a54d2981-dc9c-4dc6-be5f-d1369a58ec03 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1315 microversion: 2.1 time: 0.512445 Aug 27 04:38:58.321497 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1012/2000] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:57 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:58.465508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89afb7ac-7b70-4584-9b47-aaa213d2c4e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:58.476852 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89afb7ac-7b70-4584-9b47-aaa213d2c4e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1504 microversion: 2.1 time: 0.355083 Aug 27 04:38:58.484450 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 989/2001] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:58 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:58.508226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3fae80d8-c93b-4e4c-af18-d9c6f71615d6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1444554120"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:58.509580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3fae80d8-c93b-4e4c-af18-d9c6f71615d6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:58.528737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fae80d8-c93b-4e4c-af18-d9c6f71615d6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:58.529841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fae80d8-c93b-4e4c-af18-d9c6f71615d6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:58.530527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fae80d8-c93b-4e4c-af18-d9c6f71615d6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:58.531998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fae80d8-c93b-4e4c-af18-d9c6f71615d6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:58.533851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fae80d8-c93b-4e4c-af18-d9c6f71615d6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:58.535777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fae80d8-c93b-4e4c-af18-d9c6f71615d6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:58.582644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-068e856a-93ff-43bb-8efd-d178dc7d4eb0 tempest-ListImageFiltersNegativeTestJSON-1351646597 tempest-ListImageFiltersNegativeTestJSON-1351646597-project] Calling method '.version_select at 0x7f1f214d5790>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:58.584457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:58.629434 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-068e856a-93ff-43bb-8efd-d178dc7d4eb0 tempest-ListImageFiltersNegativeTestJSON-1351646597 tempest-ListImageFiltersNegativeTestJSON-1351646597-project] HTTP exception thrown: Image not found. Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-068e856a-93ff-43bb-8efd-d178dc7d4eb0 tempest-ListImageFiltersNegativeTestJSON-1351646597 tempest-ListImageFiltersNegativeTestJSON-1351646597-project] Request method failure captured: Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/images/2ceaaeef-415d-4f71-91e4-dcf78a3fa301 HTTP/1.1 Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_iNxf9XwQYJDfQ2WxjtIUJmN3Na1qtA-lgdbtKV6R0xhFsMWePpsgFWYvKLvUvxBCLgd0c885bD_uagyR5aNGjAGY5V4hDK1X0hukx4H6qtDixMzdsPibfd8bvMRrjSOmK5XMIDGRBhZtczuQzRmsJ2YPhef8LbDo5cj4CqicLKCQ Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 19d2aa194d01477a8fbd09b0a35ac9fd Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1351646597 Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19d2aa194d01477a8fbd09b0a35ac9fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_19d2aa194d01477a8fbd09b0a35ac9fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/19d2aa194d01477a8fbd09b0a35ac9fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19d2aa194d01477a8fbd09b0a35ac9fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1351646597 Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 19d2aa194d01477a8fbd09b0a35ac9fd Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1351646597 Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ListImageFiltersNegativeTestJSON-1351646597-project Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 5a1f6a309ca74b00aa1aba042cd1db2d Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1351646597-project Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: exception: Image not found. Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '2ceaaeef-415d-4f71-91e4-dcf78a3fa301'} Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2ceaaeef-415d-4f71-91e4-dcf78a3fa301 Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:38:58.631688 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2ceaaeef-415d-4f71-91e4-dcf78a3fa301 could not be found. Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-068e856a-93ff-43bb-8efd-d178dc7d4eb0 tempest-ListImageFiltersNegativeTestJSON-1351646597 tempest-ListImageFiltersNegativeTestJSON-1351646597-project] Returning 404 to user: Image not found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-068e856a-93ff-43bb-8efd-d178dc7d4eb0 tempest-ListImageFiltersNegativeTestJSON-1351646597 tempest-ListImageFiltersNegativeTestJSON-1351646597-project] 10.222.0.79 "GET /compute/v2.1/images/2ceaaeef-415d-4f71-91e4-dcf78a3fa301" status: 404 len: 62 microversion: 2.1 time: 0.309308 Aug 27 04:38:58.640459 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1013/2002] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:58 2022] GET /compute/v2.1/images/2ceaaeef-415d-4f71-91e4-dcf78a3fa301 => generated 62 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:38:58.807870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0014c73a-3473-4aee-9f7d-aeac0a5133a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:58.811985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0014c73a-3473-4aee-9f7d-aeac0a5133a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:58.827994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0014c73a-3473-4aee-9f7d-aeac0a5133a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:58.828492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0014c73a-3473-4aee-9f7d-aeac0a5133a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:58.845729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0014c73a-3473-4aee-9f7d-aeac0a5133a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:58.846514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0014c73a-3473-4aee-9f7d-aeac0a5133a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:58.847057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0014c73a-3473-4aee-9f7d-aeac0a5133a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:58.847442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0014c73a-3473-4aee-9f7d-aeac0a5133a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:58.847678 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.network.security_group_api [None req-3fae80d8-c93b-4e4c-af18-d9c6f71615d6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Adding security group 8b4becf2-156e-4d21-a007-a96024279c4b to port 0a333640-dba0-4503-a400-755c7efa6a00 Aug 27 04:38:59.001251 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0014c73a-3473-4aee-9f7d-aeac0a5133a8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.197645 Aug 27 04:38:59.011311 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1014/2003] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 04:38:58 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:38:59.034047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-c5b9b6ff-17a0-4233-a6de-d301b07d9b04 req-25b2cf67-6720-4626-9fc0-d2f52daad2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0335025-7f4b-4576-a817-72f93df40d5d", "name": "network-vif-plugged", "status": "completed", "tag": "09f4e7a1-6b5b-4ba8-8e43-d444a1426021"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:59.103266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c5b9b6ff-17a0-4233-a6de-d301b07d9b04 req-25b2cf67-6720-4626-9fc0-d2f52daad2ae service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:59.103679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c5b9b6ff-17a0-4233-a6de-d301b07d9b04 req-25b2cf67-6720-4626-9fc0-d2f52daad2ae service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:59.104127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c5b9b6ff-17a0-4233-a6de-d301b07d9b04 req-25b2cf67-6720-4626-9fc0-d2f52daad2ae service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:59.140245 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-c5b9b6ff-17a0-4233-a6de-d301b07d9b04 req-25b2cf67-6720-4626-9fc0-d2f52daad2ae service nova] Creating event network-vif-plugged:09f4e7a1-6b5b-4ba8-8e43-d444a1426021 for instance d0335025-7f4b-4576-a817-72f93df40d5d on n-h1-854823-1 Aug 27 04:38:59.146891 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-c5b9b6ff-17a0-4233-a6de-d301b07d9b04 req-25b2cf67-6720-4626-9fc0-d2f52daad2ae service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133466 Aug 27 04:38:59.156999 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1015/2004] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:59.163357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e824d7fa-a085-465e-8702-ef26858b7fa2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:59.175211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e824d7fa-a085-465e-8702-ef26858b7fa2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:59.194687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e824d7fa-a085-465e-8702-ef26858b7fa2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:59.195238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e824d7fa-a085-465e-8702-ef26858b7fa2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:59.195689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e824d7fa-a085-465e-8702-ef26858b7fa2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:59.196692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e824d7fa-a085-465e-8702-ef26858b7fa2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:59.202430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e824d7fa-a085-465e-8702-ef26858b7fa2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:59.202911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e824d7fa-a085-465e-8702-ef26858b7fa2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:59.457553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e824d7fa-a085-465e-8702-ef26858b7fa2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:59.488908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e824d7fa-a085-465e-8702-ef26858b7fa2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:59.491629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e824d7fa-a085-465e-8702-ef26858b7fa2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:59.493740 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e824d7fa-a085-465e-8702-ef26858b7fa2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1362 microversion: 2.26 time: 0.334555 Aug 27 04:38:59.495699 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1016/2005] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:38:59 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:59.502918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5f2bf9d0-4611-489d-93fc-727c197de321 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:59.503760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5f2bf9d0-4611-489d-93fc-727c197de321 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:59.512393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f2bf9d0-4611-489d-93fc-727c197de321 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:59.513451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f2bf9d0-4611-489d-93fc-727c197de321 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:59.515183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f2bf9d0-4611-489d-93fc-727c197de321 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:59.516245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f2bf9d0-4611-489d-93fc-727c197de321 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:59.519057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f2bf9d0-4611-489d-93fc-727c197de321 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:59.519865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f2bf9d0-4611-489d-93fc-727c197de321 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:59.716412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5f2bf9d0-4611-489d-93fc-727c197de321 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:59.735010 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5f2bf9d0-4611-489d-93fc-727c197de321 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1315 microversion: 2.1 time: 0.237264 Aug 27 04:38:59.736327 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1017/2006] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:38:59 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:59.950433 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3fae80d8-c93b-4e4c-af18-d9c6f71615d6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c/action" status: 202 len: 0 microversion: 2.1 time: 1.448397 Aug 27 04:38:59.953007 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 990/2007] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:38:58 2022] POST /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c/action => generated 0 bytes in 1452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:38:59.962418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68eb6f9c-4b52-4981-bc07-633723ed6e91 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-176359231"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:59.964801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68eb6f9c-4b52-4981-bc07-633723ed6e91 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:38:59.991121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68eb6f9c-4b52-4981-bc07-633723ed6e91 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:59.991964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68eb6f9c-4b52-4981-bc07-633723ed6e91 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:59.992649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68eb6f9c-4b52-4981-bc07-633723ed6e91 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:38:59.993680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68eb6f9c-4b52-4981-bc07-633723ed6e91 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:38:59.994585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68eb6f9c-4b52-4981-bc07-633723ed6e91 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:38:59.995049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68eb6f9c-4b52-4981-bc07-633723ed6e91 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:00.116513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-267e091a-954a-4047-80cb-f2b47aa3396a tempest-FloatingIPsNegativeTestJSON-1382648643 tempest-FloatingIPsNegativeTestJSON-1382648643-project] Calling method '.version_select at 0x7f1f21477040>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:00.270301 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-267e091a-954a-4047-80cb-f2b47aa3396a tempest-FloatingIPsNegativeTestJSON-1382648643 tempest-FloatingIPsNegativeTestJSON-1382648643-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.531927 Aug 27 04:39:00.271058 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1018/2008] 10.222.0.79 () {58 vars in 1149 bytes} [Sat Aug 27 04:38:59 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:39:00.282505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-f20db22b-ea4e-4aa8-b778-338bffdaf805 req-660cc4c2-6233-4dd2-9433-4d089fe49421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696d8484-201d-4f79-9df8-4dbe1d196b6c", "tag": "0a333640-dba0-4503-a400-755c7efa6a00"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:00.312939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f20db22b-ea4e-4aa8-b778-338bffdaf805 req-660cc4c2-6233-4dd2-9433-4d089fe49421 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:00.314961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f20db22b-ea4e-4aa8-b778-338bffdaf805 req-660cc4c2-6233-4dd2-9433-4d089fe49421 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:00.315851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f20db22b-ea4e-4aa8-b778-338bffdaf805 req-660cc4c2-6233-4dd2-9433-4d089fe49421 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:00.325462 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.network.security_group_api [None req-68eb6f9c-4b52-4981-bc07-633723ed6e91 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Adding security group 495d1828-8f2f-4c46-b78e-d9cb0df5063f to port 0a333640-dba0-4503-a400-755c7efa6a00 Aug 27 04:39:00.334495 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f20db22b-ea4e-4aa8-b778-338bffdaf805 req-660cc4c2-6233-4dd2-9433-4d089fe49421 service nova] Creating event network-changed:0a333640-dba0-4503-a400-755c7efa6a00 for instance 696d8484-201d-4f79-9df8-4dbe1d196b6c on n-h2-854823-1 Aug 27 04:39:00.343588 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-f20db22b-ea4e-4aa8-b778-338bffdaf805 req-660cc4c2-6233-4dd2-9433-4d089fe49421 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070431 Aug 27 04:39:00.345186 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1019/2009] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:00.359378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-148ced78-6621-404a-bd49-1efa57d46932 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:00.364305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-148ced78-6621-404a-bd49-1efa57d46932 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:00.381641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-148ced78-6621-404a-bd49-1efa57d46932 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:00.383551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-148ced78-6621-404a-bd49-1efa57d46932 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:00.385340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-148ced78-6621-404a-bd49-1efa57d46932 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:00.388678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-148ced78-6621-404a-bd49-1efa57d46932 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:00.389358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-148ced78-6621-404a-bd49-1efa57d46932 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:00.390070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-148ced78-6621-404a-bd49-1efa57d46932 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:00.474311 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-148ced78-6621-404a-bd49-1efa57d46932 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.126114 Aug 27 04:39:00.489815 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1020/2010] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 04:39:00 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:00.502145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b846e13a-707c-4023-bba6-3e972ff19a23 tempest-FloatingIPsNegativeTestJSON-1382648643 tempest-FloatingIPsNegativeTestJSON-1382648643-project] Action: 'create', calling method: .version_select at 0x7f1f21477820>, body: {"pool": "non_exist_pool"} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:00.664472 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-b846e13a-707c-4023-bba6-3e972ff19a23 tempest-FloatingIPsNegativeTestJSON-1382648643 tempest-FloatingIPsNegativeTestJSON-1382648643-project] HTTP exception thrown: Floating IP pool not found. Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b846e13a-707c-4023-bba6-3e972ff19a23 tempest-FloatingIPsNegativeTestJSON-1382648643 tempest-FloatingIPsNegativeTestJSON-1382648643-project] Request method failure captured: Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 26 Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_jr_eE39xMtSxrdjK4xCavaZC9c7JHBFhzEX4NBbyyl-ZQ314Q7Sku1fmWbufoQC_6gGQ9aohYM4tUXnxGrFq0uAt4hAzSDsJ0s3i-PoGudcf7l9Q7n_8gNMr5MrbX5CKp6GhQvULMzWAla2pJ_3edu0gF1LJ8FUP4nYjdtc6-o-k Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 9fa6aef2cff541988400c034efa89819 Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1382648643 Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9fa6aef2cff541988400c034efa89819"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9fa6aef2cff541988400c034efa89819"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9fa6aef2cff541988400c034efa89819"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9fa6aef2cff541988400c034efa89819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1382648643 Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 9fa6aef2cff541988400c034efa89819 Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1382648643 Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FloatingIPsNegativeTestJSON-1382648643-project Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 927af4edab594f4991c9f13a39a38245 Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1382648643-project Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: {"pool": "non_exist_pool"} Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: exception: Floating IP pool not found. Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:00.666584 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:00.673985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 27 04:39:00.673985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:00.673985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b846e13a-707c-4023-bba6-3e972ff19a23 tempest-FloatingIPsNegativeTestJSON-1382648643 tempest-FloatingIPsNegativeTestJSON-1382648643-project] Returning 404 to user: Floating IP pool not found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:00.673985 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b846e13a-707c-4023-bba6-3e972ff19a23 tempest-FloatingIPsNegativeTestJSON-1382648643 tempest-FloatingIPsNegativeTestJSON-1382648643-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.176935 Aug 27 04:39:00.673985 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1021/2011] 10.222.0.79 () {60 vars in 1170 bytes} [Sat Aug 27 04:39:00 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:39:00.681692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-63daff05-eadf-486d-b22f-841cac404cd1 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:00.682146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-63daff05-eadf-486d-b22f-841cac404cd1 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:00.713290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63daff05-eadf-486d-b22f-841cac404cd1 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:00.714049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63daff05-eadf-486d-b22f-841cac404cd1 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:00.715481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63daff05-eadf-486d-b22f-841cac404cd1 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:00.716261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63daff05-eadf-486d-b22f-841cac404cd1 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:00.720267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63daff05-eadf-486d-b22f-841cac404cd1 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:00.720811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63daff05-eadf-486d-b22f-841cac404cd1 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:01.167400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-63daff05-eadf-486d-b22f-841cac404cd1 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:01.184706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-63daff05-eadf-486d-b22f-841cac404cd1 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:01.186278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-63daff05-eadf-486d-b22f-841cac404cd1 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:01.187459 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-63daff05-eadf-486d-b22f-841cac404cd1 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1362 microversion: 2.26 time: 0.517341 Aug 27 04:39:01.193762 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1022/2012] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:00 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1362 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:01.207758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-90706630-69f0-4906-b40f-ef9a571a8d71 tempest-FloatingIPsNegativeTestJSON-1382648643 tempest-FloatingIPsNegativeTestJSON-1382648643-project] Calling method '.version_select at 0x7f1f214d5e50>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:01.386093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG neutronclient.v2_0.client [None req-90706630-69f0-4906-b40f-ef9a571a8d71 tempest-FloatingIPsNegativeTestJSON-1382648643 tempest-FloatingIPsNegativeTestJSON-1382648643-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5b063f25-5756-4952-8f94-cc9b4f374c33 could not be found", "detail": ""}} {{(pid=128870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:39:01.386799 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-90706630-69f0-4906-b40f-ef9a571a8d71 tempest-FloatingIPsNegativeTestJSON-1382648643 tempest-FloatingIPsNegativeTestJSON-1382648643-project] HTTP exception thrown: Floating IP not found for ID 5b063f25-5756-4952-8f94-cc9b4f374c33 Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-90706630-69f0-4906-b40f-ef9a571a8d71 tempest-FloatingIPsNegativeTestJSON-1382648643 tempest-FloatingIPsNegativeTestJSON-1382648643-project] Request method failure captured: Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/os-floating-ips/5b063f25-5756-4952-8f94-cc9b4f374c33 HTTP/1.1 Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_jr_eE39xMtSxrdjK4xCavaZC9c7JHBFhzEX4NBbyyl-ZQ314Q7Sku1fmWbufoQC_6gGQ9aohYM4tUXnxGrFq0uAt4hAzSDsJ0s3i-PoGudcf7l9Q7n_8gNMr5MrbX5CKp6GhQvULMzWAla2pJ_3edu0gF1LJ8FUP4nYjdtc6-o-k Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 9fa6aef2cff541988400c034efa89819 Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1382648643 Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9fa6aef2cff541988400c034efa89819"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9fa6aef2cff541988400c034efa89819"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9fa6aef2cff541988400c034efa89819"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9fa6aef2cff541988400c034efa89819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1382648643 Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 9fa6aef2cff541988400c034efa89819 Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1382648643 Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FloatingIPsNegativeTestJSON-1382648643-project Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 927af4edab594f4991c9f13a39a38245 Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1382648643-project Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: exception: Floating IP not found for ID 5b063f25-5756-4952-8f94-cc9b4f374c33 Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '5b063f25-5756-4952-8f94-cc9b4f374c33'} Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5b063f25-5756-4952-8f94-cc9b4f374c33 could not be found Aug 27 04:39:01.391564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2dd1f54-daab-4ec0-b41c-45ee358d73f3'] Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5b063f25-5756-4952-8f94-cc9b4f374c33. Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5b063f25-5756-4952-8f94-cc9b4f374c33 Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5b063f25-5756-4952-8f94-cc9b4f374c33 Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-90706630-69f0-4906-b40f-ef9a571a8d71 tempest-FloatingIPsNegativeTestJSON-1382648643 tempest-FloatingIPsNegativeTestJSON-1382648643-project] Returning 404 to user: Floating IP not found for ID 5b063f25-5756-4952-8f94-cc9b4f374c33 {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-90706630-69f0-4906-b40f-ef9a571a8d71 tempest-FloatingIPsNegativeTestJSON-1382648643 tempest-FloatingIPsNegativeTestJSON-1382648643-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/5b063f25-5756-4952-8f94-cc9b4f374c33" status: 404 len: 111 microversion: 2.1 time: 0.197129 Aug 27 04:39:01.396213 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1023/2013] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:39:01 2022] DELETE /compute/v2.1/os-floating-ips/5b063f25-5756-4952-8f94-cc9b4f374c33 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:39:01.405004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6f94ebfc-72fa-429d-8ac5-2910e15e6e80 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:01.406049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6f94ebfc-72fa-429d-8ac5-2910e15e6e80 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:01.426043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f94ebfc-72fa-429d-8ac5-2910e15e6e80 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:01.426527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f94ebfc-72fa-429d-8ac5-2910e15e6e80 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:01.426963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f94ebfc-72fa-429d-8ac5-2910e15e6e80 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:01.431840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f94ebfc-72fa-429d-8ac5-2910e15e6e80 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:01.435082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f94ebfc-72fa-429d-8ac5-2910e15e6e80 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:01.437232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f94ebfc-72fa-429d-8ac5-2910e15e6e80 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:01.549269 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68eb6f9c-4b52-4981-bc07-633723ed6e91 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c/action" status: 202 len: 0 microversion: 2.1 time: 1.592863 Aug 27 04:39:01.551007 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 991/2014] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:38:59 2022] POST /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c/action => generated 0 bytes in 1595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:01.562542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae5e0e4d-7084-4a8a-a786-8643946d0fe2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:01.564297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae5e0e4d-7084-4a8a-a786-8643946d0fe2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:01.577549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae5e0e4d-7084-4a8a-a786-8643946d0fe2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:01.581208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae5e0e4d-7084-4a8a-a786-8643946d0fe2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:01.583248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae5e0e4d-7084-4a8a-a786-8643946d0fe2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:01.585622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae5e0e4d-7084-4a8a-a786-8643946d0fe2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:01.587390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae5e0e4d-7084-4a8a-a786-8643946d0fe2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:01.589831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae5e0e4d-7084-4a8a-a786-8643946d0fe2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:02.004081 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae5e0e4d-7084-4a8a-a786-8643946d0fe2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.448530 Aug 27 04:39:02.018422 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 992/2015] 10.222.0.79 () {58 vars in 1293 bytes} [Sat Aug 27 04:39:01 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c/os-security-groups => generated 1157 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:02.125047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6f94ebfc-72fa-429d-8ac5-2910e15e6e80 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:02.134804 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6f94ebfc-72fa-429d-8ac5-2910e15e6e80 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1315 microversion: 2.1 time: 0.740027 Aug 27 04:39:02.139128 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1024/2016] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:01 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:02.163524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3c5f5534-17eb-4539-b024-6ac47a554cac tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'create', calling method: .version_select at 0x7f1f214d5f70>, body: {"security_group": {"name": " tempest-securitygroup -1044106389 ", "description": "tempest-description-1990405699"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:02.444792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3959aaa-89d7-4186-a7fb-706a59c656b2 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Action: 'create', calling method: .version_select at 0x7f1f210b7820>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS949PicUKFrlASXuA7ZczI6q408ELJ63oSUz36FvQAbm9wSrzKtiPKkIxglhAQCzkUyn0b9JfUIHOOC8T9O6F+9Ki7rbKewVkRSqfQcOx3141WJV6Qlo3YiKsACeOD2g=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3959aaa-89d7-4186-a7fb-706a59c656b2 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Request method failure captured: Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 257 Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_leCi8mEFEDi7UJ680q10Yha5ULJ7URjJubq9jx6-suQ95yncxq1-Uc6t0xpa0ByJUzHKmW_tCbh12LHQ-RVr8dGbtMFBYcN3zbTJyIkCXOh7xpZRo8q8kVYlr4_Tj7EMx0_NSajihg9E1MxIpvX0_u521x6R_27019d3fxYqMvQQ Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a0b444b132ae4d11b4923bfade812341 Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS949PicUKFrlASXuA7ZczI6q408ELJ63oSUz36FvQAbm9wSrzKtiPKkIxglhAQCzkUyn0b9JfUIHOOC8T9O6F+9Ki7rbKewVkRSqfQcOx3141WJV6Qlo3YiKsACeOD2g=="}} Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS949PicUKFrlASXuA7ZczI6q408ELJ63oSUz36FvQAbm9wSrzKtiPKkIxglhAQCzkUyn0b9JfUIHOOC8T9O6F+9Ki7rbKewVkRSqfQcOx3141WJV6Qlo3YiKsACeOD2g=='}}} Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 27 04:39:02.449660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 04:39:02.454444 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.462561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3959aaa-89d7-4186-a7fb-706a59c656b2 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:02.464075 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3959aaa-89d7-4186-a7fb-706a59c656b2 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.444450 Aug 27 04:39:02.466381 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 993/2017] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:39:02 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 447 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:39:02.483039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c81a644d-6069-4fe3-95bb-5a394a5441d9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:02.485840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c81a644d-6069-4fe3-95bb-5a394a5441d9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:02.504133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81a644d-6069-4fe3-95bb-5a394a5441d9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:02.506636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81a644d-6069-4fe3-95bb-5a394a5441d9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:02.507984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81a644d-6069-4fe3-95bb-5a394a5441d9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:02.509098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81a644d-6069-4fe3-95bb-5a394a5441d9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:02.509803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81a644d-6069-4fe3-95bb-5a394a5441d9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:02.510548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81a644d-6069-4fe3-95bb-5a394a5441d9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:02.600658 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3c5f5534-17eb-4539-b024-6ac47a554cac tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.460069 Aug 27 04:39:02.601904 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1025/2018] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:39:02 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:02.607174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-59b7084e-9120-431d-8829-bc9569071ceb req-aefa24ba-368f-4e05-8e90-ee40d92fe84b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696d8484-201d-4f79-9df8-4dbe1d196b6c", "tag": "0a333640-dba0-4503-a400-755c7efa6a00"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:02.639804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-59b7084e-9120-431d-8829-bc9569071ceb req-aefa24ba-368f-4e05-8e90-ee40d92fe84b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:02.643176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-59b7084e-9120-431d-8829-bc9569071ceb req-aefa24ba-368f-4e05-8e90-ee40d92fe84b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:02.643869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-59b7084e-9120-431d-8829-bc9569071ceb req-aefa24ba-368f-4e05-8e90-ee40d92fe84b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:02.679170 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-59b7084e-9120-431d-8829-bc9569071ceb req-aefa24ba-368f-4e05-8e90-ee40d92fe84b service nova] Creating event network-changed:0a333640-dba0-4503-a400-755c7efa6a00 for instance 696d8484-201d-4f79-9df8-4dbe1d196b6c on n-h2-854823-1 Aug 27 04:39:02.688008 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-59b7084e-9120-431d-8829-bc9569071ceb req-aefa24ba-368f-4e05-8e90-ee40d92fe84b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084688 Aug 27 04:39:02.709597 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1026/2019] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:02.723695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f9e66690-2c4e-4e57-b375-5093465fc512 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Action: 'create', calling method: .version_select at 0x7f1f213fe3a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1849268915", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:02.784703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-f9e66690-2c4e-4e57-b375-5093465fc512 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Getting quotas for project 480fcbc2725a436aac657c1211aa8af4. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:39:02.799043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-f9e66690-2c4e-4e57-b375-5093465fc512 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Getting quotas for user a0b444b132ae4d11b4923bfade812341 and project 480fcbc2725a436aac657c1211aa8af4. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:39:02.838739 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-f9e66690-2c4e-4e57-b375-5093465fc512 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f9e66690-2c4e-4e57-b375-5093465fc512 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Request method failure captured: Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 2167 Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_leCi8mEFEDi7UJ680q10Yha5ULJ7URjJubq9jx6-suQ95yncxq1-Uc6t0xpa0ByJUzHKmW_tCbh12LHQ-RVr8dGbtMFBYcN3zbTJyIkCXOh7xpZRo8q8kVYlr4_Tj7EMx0_NSajihg9E1MxIpvX0_u521x6R_27019d3fxYqMvQQ Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a0b444b132ae4d11b4923bfade812341 Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1849268915", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:39:02.866974 n-d-854823-1 devstack@n-api.service[128870]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1849268915', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:02.870130 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:02.873711 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:02.876637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c81a644d-6069-4fe3-95bb-5a394a5441d9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:02.877118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f9e66690-2c4e-4e57-b375-5093465fc512 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:02.878333 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f9e66690-2c4e-4e57-b375-5093465fc512 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.166648 Aug 27 04:39:02.879151 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1027/2020] 10.222.0.79 () {60 vars in 1160 bytes} [Sat Aug 27 04:39:02 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:02.893833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d460acff-6125-439a-a9ac-2db5a67a92fd tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f21400550>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:02.901246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c81a644d-6069-4fe3-95bb-5a394a5441d9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:02.903696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c81a644d-6069-4fe3-95bb-5a394a5441d9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:02.905841 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c81a644d-6069-4fe3-95bb-5a394a5441d9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1362 microversion: 2.26 time: 0.431586 Aug 27 04:39:02.914115 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 994/2021] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:02 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:02.920518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa19ca36-47d1-42d4-b047-e617e359a4e3 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Action: 'create', calling method: .version_select at 0x7f1f210b7040>, body: {"keypair": {"name": "tempest-keypair-353071174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdn8tqDFTwJJaigek3ZkIwiS1J339SxUvzFMU43laQvWRrORmtU1NyyHBJnUTbvY5UYDgEtKx5aDKjY2Nor0mzbHucR8Ir1pH5b1Hn/cpHVCiE8WEaNztzseyq6Er9WUA=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:02.972410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-fa19ca36-47d1-42d4-b047-e617e359a4e3 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Getting quotas for project 480fcbc2725a436aac657c1211aa8af4. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:39:02.988386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-fa19ca36-47d1-42d4-b047-e617e359a4e3 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Getting quotas for user a0b444b132ae4d11b4923bfade812341 and project 480fcbc2725a436aac657c1211aa8af4. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:39:02.995828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:03.031915 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa19ca36-47d1-42d4-b047-e617e359a4e3 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116246 Aug 27 04:39:03.033733 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 995/2022] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:39:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:03.048135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f2fd6191-80ee-4356-828c-b8052c6238c9 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Action: 'create', calling method: .version_select at 0x7f1f211a30d0>, body: {"keypair": {"name": "tempest-keypair-353071174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgN64GUzd7VWM7t/72AB/cA7YptCpccZTooF0WcEY/J25VrlibNotBBkOHFhnyYh4pxDVhKJBPmJhaTTZkixCxjPB0aHpPP/F6aejy31MptqtHb4QLa1U/hyYA/5XRZ8A=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:03.097402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f2fd6191-80ee-4356-828c-b8052c6238c9 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Getting quotas for project 480fcbc2725a436aac657c1211aa8af4. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:39:03.112168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f2fd6191-80ee-4356-828c-b8052c6238c9 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Getting quotas for user a0b444b132ae4d11b4923bfade812341 and project 480fcbc2725a436aac657c1211aa8af4. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:39:03.144663 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f2fd6191-80ee-4356-828c-b8052c6238c9 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] HTTP exception thrown: Key pair 'tempest-keypair-353071174' already exists. Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f2fd6191-80ee-4356-828c-b8052c6238c9 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Request method failure captured: Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 272 Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_leCi8mEFEDi7UJ680q10Yha5ULJ7URjJubq9jx6-suQ95yncxq1-Uc6t0xpa0ByJUzHKmW_tCbh12LHQ-RVr8dGbtMFBYcN3zbTJyIkCXOh7xpZRo8q8kVYlr4_Tj7EMx0_NSajihg9E1MxIpvX0_u521x6R_27019d3fxYqMvQQ Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a0b444b132ae4d11b4923bfade812341 Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: {"keypair": {"name": "tempest-keypair-353071174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgN64GUzd7VWM7t/72AB/cA7YptCpccZTooF0WcEY/J25VrlibNotBBkOHFhnyYh4pxDVhKJBPmJhaTTZkixCxjPB0aHpPP/F6aejy31MptqtHb4QLa1U/hyYA/5XRZ8A=="}} Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: exception: Key pair 'tempest-keypair-353071174' already exists. Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-353071174', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgN64GUzd7VWM7t/72AB/cA7YptCpccZTooF0WcEY/J25VrlibNotBBkOHFhnyYh4pxDVhKJBPmJhaTTZkixCxjPB0aHpPP/F6aejy31MptqtHb4QLa1U/hyYA/5XRZ8A=='}}} Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result.read() Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'a0b444b132ae4d11b4923bfade812341-tempest-keypair-353071174' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 27 04:39:03.160777 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result.read() Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 04:39:03.165472 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'a0b444b132ae4d11b4923bfade812341-tempest-keypair-353071174' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 4, 39, 3, 132225), 'updated_at': None, 'name': 'tempest-keypair-353071174', 'user_id': 'a0b444b132ae4d11b4923bfade812341', 'fingerprint': '75:9e:0d:57:f1:bb:0e:8d:ca:4f:56:80:69:9e:c3:ca', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgN64GUzd7VWM7t/72AB/cA7YptCpccZTooF0WcEY/J25VrlibNotBBkOHFhnyYh4pxDVhKJBPmJhaTTZkixCxjPB0aHpPP/F6aejy31MptqtHb4QLa1U/hyYA/5XRZ8A==', 'type': 'ssh'}] Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi keypair.create() Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._create() Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-353071174' already exists. Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 27 04:39:03.176404 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-353071174' already exists. Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-353071174' already exists. Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f2fd6191-80ee-4356-828c-b8052c6238c9 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Returning 409 to user: Key pair 'tempest-keypair-353071174' already exists. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f2fd6191-80ee-4356-828c-b8052c6238c9 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.119778 Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 996/2023] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:39:03 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c3022ff-96cc-4b73-a256-bec08c0b7070 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:03.186972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c3022ff-96cc-4b73-a256-bec08c0b7070 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:03.189367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c3022ff-96cc-4b73-a256-bec08c0b7070 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:03.189367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c3022ff-96cc-4b73-a256-bec08c0b7070 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:03.189367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c3022ff-96cc-4b73-a256-bec08c0b7070 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:03.190122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c3022ff-96cc-4b73-a256-bec08c0b7070 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:03.193864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c3022ff-96cc-4b73-a256-bec08c0b7070 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:03.193864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c3022ff-96cc-4b73-a256-bec08c0b7070 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:03.477824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c3022ff-96cc-4b73-a256-bec08c0b7070 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:03.491332 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c3022ff-96cc-4b73-a256-bec08c0b7070 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1501 microversion: 2.1 time: 0.324760 Aug 27 04:39:03.493212 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 997/2024] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:03 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1501 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:03.500752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59445b16-e188-412b-808b-a608f4a1aae0 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Calling method '.version_select at 0x7f1f211043a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:03.531109 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59445b16-e188-412b-808b-a608f4a1aae0 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-353071174" status: 202 len: 0 microversion: 2.1 time: 0.036249 Aug 27 04:39:03.532653 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 998/2025] 10.222.0.79 () {58 vars in 1218 bytes} [Sat Aug 27 04:39:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-353071174 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:03.545643 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d460acff-6125-439a-a9ac-2db5a67a92fd tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/f44779cf-e54d-4dbb-bc83-6591cce013fa" status: 200 len: 224 microversion: 2.1 time: 0.665268 Aug 27 04:39:03.546220 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1028/2026] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 04:39:02 2022] GET /compute/v2.1/os-security-groups/f44779cf-e54d-4dbb-bc83-6591cce013fa => generated 224 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:03.552269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-33d13314-46ef-4041-b3ba-2f55a35402f8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:03.553333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-33d13314-46ef-4041-b3ba-2f55a35402f8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:03.569029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33d13314-46ef-4041-b3ba-2f55a35402f8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:03.572626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33d13314-46ef-4041-b3ba-2f55a35402f8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:03.573391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33d13314-46ef-4041-b3ba-2f55a35402f8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:03.574377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33d13314-46ef-4041-b3ba-2f55a35402f8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:03.575375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33d13314-46ef-4041-b3ba-2f55a35402f8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:03.576033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33d13314-46ef-4041-b3ba-2f55a35402f8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:03.619883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-33d13314-46ef-4041-b3ba-2f55a35402f8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:39:03.745504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dcb2e245-9bcb-4e36-9ed1-5bb8141bd494 tempest-QuotaClassesAdminTestJSON-883466620 tempest-QuotaClassesAdminTestJSON-883466620-project-admin] Calling method '.version_select at 0x7f1f21172af0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:03.767323 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-33d13314-46ef-4041-b3ba-2f55a35402f8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 204 len: 0 microversion: 2.1 time: 0.219078 Aug 27 04:39:03.768724 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1029/2027] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:39:03 2022] DELETE /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:39:03.782011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e366143-dbdf-48d2-8aaf-44b301958b97 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Action: 'create', calling method: .version_select at 0x7f1f21400310>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWpsdc8cCUE9ldS24JpM3zaxPm5nKVYzyJjb46newR7BYF4fR45FM1sdDCo9rZDW8uXaW8F1KV+b8E0MbMSadE3UfovW/w321EnbkIlpYeIqeaS8WnA2uaHDB6zXjOusQ=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:03.782884 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dcb2e245-9bcb-4e36-9ed1-5bb8141bd494 tempest-QuotaClassesAdminTestJSON-883466620 tempest-QuotaClassesAdminTestJSON-883466620-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.244249 Aug 27 04:39:03.783755 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 999/2028] 10.222.0.79 () {58 vars in 1185 bytes} [Sat Aug 27 04:39:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e366143-dbdf-48d2-8aaf-44b301958b97 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Request method failure captured: Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 247 Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_leCi8mEFEDi7UJ680q10Yha5ULJ7URjJubq9jx6-suQ95yncxq1-Uc6t0xpa0ByJUzHKmW_tCbh12LHQ-RVr8dGbtMFBYcN3zbTJyIkCXOh7xpZRo8q8kVYlr4_Tj7EMx0_NSajihg9E1MxIpvX0_u521x6R_27019d3fxYqMvQQ Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a0b444b132ae4d11b4923bfade812341 Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWpsdc8cCUE9ldS24JpM3zaxPm5nKVYzyJjb46newR7BYF4fR45FM1sdDCo9rZDW8uXaW8F1KV+b8E0MbMSadE3UfovW/w321EnbkIlpYeIqeaS8WnA2uaHDB6zXjOusQ=="}} Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWpsdc8cCUE9ldS24JpM3zaxPm5nKVYzyJjb46newR7BYF4fR45FM1sdDCo9rZDW8uXaW8F1KV+b8E0MbMSadE3UfovW/w321EnbkIlpYeIqeaS8WnA2uaHDB6zXjOusQ=='}}} Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi '' Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:39:03.789144 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:39:03.795419 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:03.797580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53e91856-1b86-45b2-9047-34ff4438b560 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f2113e3a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:03.800364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e366143-dbdf-48d2-8aaf-44b301958b97 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:03.805484 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3e366143-dbdf-48d2-8aaf-44b301958b97 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.035052 Aug 27 04:39:03.811901 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1030/2029] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:39:03 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:39:03.830556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c458081e-e4fd-437f-885d-f10aad626d1d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:03.831318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c458081e-e4fd-437f-885d-f10aad626d1d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:03.844339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c458081e-e4fd-437f-885d-f10aad626d1d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:03.845496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c458081e-e4fd-437f-885d-f10aad626d1d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:03.846171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c458081e-e4fd-437f-885d-f10aad626d1d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:03.847222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c458081e-e4fd-437f-885d-f10aad626d1d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:03.849718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c458081e-e4fd-437f-885d-f10aad626d1d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:03.852034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c458081e-e4fd-437f-885d-f10aad626d1d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:04.111825 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-53e91856-1b86-45b2-9047-34ff4438b560 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/f44779cf-e54d-4dbb-bc83-6591cce013fa" status: 202 len: 0 microversion: 2.1 time: 0.326067 Aug 27 04:39:04.118689 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1000/2030] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:39:03 2022] DELETE /compute/v2.1/os-security-groups/f44779cf-e54d-4dbb-bc83-6591cce013fa => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:04.125254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db5f4b1b-a3ed-45c9-b91c-039a0f61bef0 tempest-QuotaClassesAdminTestJSON-883466620 tempest-QuotaClassesAdminTestJSON-883466620-project-admin] Action: 'update', calling method: .version_select at 0x7f1f2114bdc0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:04.478745 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db5f4b1b-a3ed-45c9-b91c-039a0f61bef0 tempest-QuotaClassesAdminTestJSON-883466620 tempest-QuotaClassesAdminTestJSON-883466620-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.358739 Aug 27 04:39:04.484866 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1001/2031] 10.222.0.79 () {60 vars in 1206 bytes} [Sat Aug 27 04:39:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:04.493399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70f63808-3e64-431b-b9b4-ae077bf14f46 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Action: 'create', calling method: .version_select at 0x7f1f211a3550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1324117329", "public_key": " "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:04.511820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-70f63808-3e64-431b-b9b4-ae077bf14f46 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Getting quotas for project 480fcbc2725a436aac657c1211aa8af4. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:39:04.521954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c458081e-e4fd-437f-885d-f10aad626d1d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:04.530406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-70f63808-3e64-431b-b9b4-ae077bf14f46 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Getting quotas for user a0b444b132ae4d11b4923bfade812341 and project 480fcbc2725a436aac657c1211aa8af4. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:39:04.537164 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c458081e-e4fd-437f-885d-f10aad626d1d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1507 microversion: 2.1 time: 0.723469 Aug 27 04:39:04.541709 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1031/2032] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:03 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1507 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:04.548168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1caa0ca4-76e0-4769-9039-8aee04340857 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:04.549874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1caa0ca4-76e0-4769-9039-8aee04340857 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:04.557333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1caa0ca4-76e0-4769-9039-8aee04340857 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:04.557935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1caa0ca4-76e0-4769-9039-8aee04340857 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:04.558436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1caa0ca4-76e0-4769-9039-8aee04340857 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:04.560020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1caa0ca4-76e0-4769-9039-8aee04340857 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:04.564361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1caa0ca4-76e0-4769-9039-8aee04340857 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:04.565112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1caa0ca4-76e0-4769-9039-8aee04340857 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:04.570693 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-70f63808-3e64-431b-b9b4-ae077bf14f46 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70f63808-3e64-431b-b9b4-ae077bf14f46 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Request method failure captured: Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 95 Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_leCi8mEFEDi7UJ680q10Yha5ULJ7URjJubq9jx6-suQ95yncxq1-Uc6t0xpa0ByJUzHKmW_tCbh12LHQ-RVr8dGbtMFBYcN3zbTJyIkCXOh7xpZRo8q8kVYlr4_Tj7EMx0_NSajihg9E1MxIpvX0_u521x6R_27019d3fxYqMvQQ Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a0b444b132ae4d11b4923bfade812341 Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1324117329", "public_key": " "}} Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1324117329', 'public_key': ' '}}} Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:04.573326 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70f63808-3e64-431b-b9b4-ae077bf14f46 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:04.578099 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-70f63808-3e64-431b-b9b4-ae077bf14f46 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.089427 Aug 27 04:39:04.584376 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1002/2033] 10.222.0.79 () {60 vars in 1158 bytes} [Sat Aug 27 04:39:04 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:04.591546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6343f3d3-6d7f-45e2-8023-b2cd385119ca tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f210601f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:04.618171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-6343f3d3-6d7f-45e2-8023-b2cd385119ca tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:39:04.618796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-6343f3d3-6d7f-45e2-8023-b2cd385119ca tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Neutron security group f44779cf-e54d-4dbb-bc83-6591cce013fa not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:39:04.619325 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6343f3d3-6d7f-45e2-8023-b2cd385119ca tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist Aug 27 04:39:04.619325 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-eea33453-dd8a-41e1-8980-817c2a8f2c1a'] Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6343f3d3-6d7f-45e2-8023-b2cd385119ca tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-security-groups/f44779cf-e54d-4dbb-bc83-6591cce013fa HTTP/1.1 Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: exception: Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-eea33453-dd8a-41e1-8980-817c2a8f2c1a'] Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'f44779cf-e54d-4dbb-bc83-6591cce013fa'} Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:39:04.637379 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eea33453-dd8a-41e1-8980-817c2a8f2c1a'] Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eea33453-dd8a-41e1-8980-817c2a8f2c1a'] Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eea33453-dd8a-41e1-8980-817c2a8f2c1a'] Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eea33453-dd8a-41e1-8980-817c2a8f2c1a'] Aug 27 04:39:04.642360 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.651304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6343f3d3-6d7f-45e2-8023-b2cd385119ca tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 404 to user: Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist Aug 27 04:39:04.651304 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-eea33453-dd8a-41e1-8980-817c2a8f2c1a'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:04.651304 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6343f3d3-6d7f-45e2-8023-b2cd385119ca tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/f44779cf-e54d-4dbb-bc83-6591cce013fa" status: 404 len: 194 microversion: 2.1 time: 0.057859 Aug 27 04:39:04.651304 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1003/2034] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 04:39:04 2022] GET /compute/v2.1/os-security-groups/f44779cf-e54d-4dbb-bc83-6591cce013fa => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:39:04.656062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0dccb269-26a6-4717-bb2b-f69067604e8e tempest-QuotaClassesAdminTestJSON-883466620 tempest-QuotaClassesAdminTestJSON-883466620-project-admin] Calling method '.version_select at 0x7f1f210b7dc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:04.686341 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0dccb269-26a6-4717-bb2b-f69067604e8e tempest-QuotaClassesAdminTestJSON-883466620 tempest-QuotaClassesAdminTestJSON-883466620-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.035162 Aug 27 04:39:04.686942 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1004/2035] 10.222.0.79 () {58 vars in 1185 bytes} [Sat Aug 27 04:39:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:04.708709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a35bbac-3037-4753-85ef-b4f7c57e7cbc tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Action: 'create', calling method: .version_select at 0x7f1f210494c0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGWa6RUxdhtpFo24ZkvVlUNxxL5agHr2+/WGypA1XODJZzUHSgiiKRTYus7YicET2QfYOduiu3cFDTxYNOfp9evrHS+6t5Nrst+7E6/4x0cGA24WDt1QlN7oQKjsFq0+g=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a35bbac-3037-4753-85ef-b4f7c57e7cbc tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Request method failure captured: Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 507 Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_leCi8mEFEDi7UJ680q10Yha5ULJ7URjJubq9jx6-suQ95yncxq1-Uc6t0xpa0ByJUzHKmW_tCbh12LHQ-RVr8dGbtMFBYcN3zbTJyIkCXOh7xpZRo8q8kVYlr4_Tj7EMx0_NSajihg9E1MxIpvX0_u521x6R_27019d3fxYqMvQQ Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a0b444b132ae4d11b4923bfade812341 Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGWa6RUxdhtpFo24ZkvVlUNxxL5agHr2+/WGypA1XODJZzUHSgiiKRTYus7YicET2QfYOduiu3cFDTxYNOfp9evrHS+6t5Nrst+7E6/4x0cGA24WDt1QlN7oQKjsFq0+g=="}} Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGWa6RUxdhtpFo24ZkvVlUNxxL5agHr2+/WGypA1XODJZzUHSgiiKRTYus7YicET2QfYOduiu3cFDTxYNOfp9evrHS+6t5Nrst+7E6/4x0cGA24WDt1QlN7oQKjsFq0+g=='}}} Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 27 04:39:04.713043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a35bbac-3037-4753-85ef-b4f7c57e7cbc tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a35bbac-3037-4753-85ef-b4f7c57e7cbc tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.016183 Aug 27 04:39:04.717840 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1005/2036] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:39:04 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:39:04.727752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3304795f-95d0-4c70-bee9-9cbe7890019f tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'create', calling method: .version_select at 0x7f1f25cc24c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-574133948", "description": "tempest-description-287026080"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:04.983205 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3304795f-95d0-4c70-bee9-9cbe7890019f tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.261109 Aug 27 04:39:04.984047 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1006/2037] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:39:04 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:04.990434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46b513ff-20b5-40d9-8e21-1f1330970b65 tempest-QuotaClassesAdminTestJSON-883466620 tempest-QuotaClassesAdminTestJSON-883466620-project-admin] Action: 'update', calling method: .version_select at 0x7f1f2104eaf0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:05.093493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=9,nova_api:DELETE=1,nova_api:UPDATE=20 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:05.125200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1caa0ca4-76e0-4769-9039-8aee04340857 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:05.139583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1caa0ca4-76e0-4769-9039-8aee04340857 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:05.141134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1caa0ca4-76e0-4769-9039-8aee04340857 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:05.142388 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1caa0ca4-76e0-4769-9039-8aee04340857 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1362 microversion: 2.26 time: 0.597998 Aug 27 04:39:05.146020 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1032/2038] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:04 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1362 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:05.168813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-754e444d-0132-4236-8eb5-81a6a5077954 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Action: 'create', calling method: .version_select at 0x7f1f2138b1f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-928486435", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:05.180521 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46b513ff-20b5-40d9-8e21-1f1330970b65 tempest-QuotaClassesAdminTestJSON-883466620 tempest-QuotaClassesAdminTestJSON-883466620-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.194792 Aug 27 04:39:05.182191 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1007/2039] 10.222.0.79 () {60 vars in 1206 bytes} [Sat Aug 27 04:39:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:05.194298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-754e444d-0132-4236-8eb5-81a6a5077954 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Getting quotas for project 480fcbc2725a436aac657c1211aa8af4. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:39:05.200761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9dac757a-2a6f-4a07-afa6-260c99d7a749 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'create', calling method: .version_select at 0x7f1f211729d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1745279918", "description": "tempest-description-1595221814"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:05.201268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-754e444d-0132-4236-8eb5-81a6a5077954 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Getting quotas for user a0b444b132ae4d11b4923bfade812341 and project 480fcbc2725a436aac657c1211aa8af4. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:39:05.224340 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-754e444d-0132-4236-8eb5-81a6a5077954 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-754e444d-0132-4236-8eb5-81a6a5077954 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Request method failure captured: Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 117 Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_leCi8mEFEDi7UJ680q10Yha5ULJ7URjJubq9jx6-suQ95yncxq1-Uc6t0xpa0ByJUzHKmW_tCbh12LHQ-RVr8dGbtMFBYcN3zbTJyIkCXOh7xpZRo8q8kVYlr4_Tj7EMx0_NSajihg9E1MxIpvX0_u521x6R_27019d3fxYqMvQQ Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a0b444b132ae4d11b4923bfade812341 Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-928486435", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-928486435', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 04:39:05.227232 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 04:39:05.232886 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:05.237291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-754e444d-0132-4236-8eb5-81a6a5077954 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:05.238367 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-754e444d-0132-4236-8eb5-81a6a5077954 tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.089799 Aug 27 04:39:05.239445 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1033/2040] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:39:05 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:05.251625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ff698706-e441-4d60-989a-bfd2b5bb9efb tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Calling method '.version_select at 0x7f1f214d9310>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:05.270380 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-ff698706-e441-4d60-989a-bfd2b5bb9efb tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-301813975 not found for user a0b444b132ae4d11b4923bfade812341 Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ff698706-e441-4d60-989a-bfd2b5bb9efb tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Request method failure captured: Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-301813975 HTTP/1.1 Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_leCi8mEFEDi7UJ680q10Yha5ULJ7URjJubq9jx6-suQ95yncxq1-Uc6t0xpa0ByJUzHKmW_tCbh12LHQ-RVr8dGbtMFBYcN3zbTJyIkCXOh7xpZRo8q8kVYlr4_Tj7EMx0_NSajihg9E1MxIpvX0_u521x6R_27019d3fxYqMvQQ Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/480fcbc2725a436aac657c1211aa8af4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 480fcbc2725a436aac657c1211aa8af4 Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1715683152 Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a0b444b132ae4d11b4923bfade812341 Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1715683152-project Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: exception: Keypair tempest-keypair-non-existent-301813975 not found for user a0b444b132ae4d11b4923bfade812341 Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'tempest-keypair-non-existent-301813975'} Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-301813975 not found for user a0b444b132ae4d11b4923bfade812341 Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:05.272692 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-301813975 not found for user a0b444b132ae4d11b4923bfade812341 Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-301813975 not found for user a0b444b132ae4d11b4923bfade812341 Aug 27 04:39:05.278356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:05.281863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ff698706-e441-4d60-989a-bfd2b5bb9efb tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] Returning 404 to user: Keypair tempest-keypair-non-existent-301813975 not found for user a0b444b132ae4d11b4923bfade812341 {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:05.283714 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ff698706-e441-4d60-989a-bfd2b5bb9efb tempest-KeyPairsNegativeTestJSON-1715683152 tempest-KeyPairsNegativeTestJSON-1715683152-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-301813975" status: 404 len: 144 microversion: 2.1 time: 0.039115 Aug 27 04:39:05.284872 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1034/2041] 10.222.0.79 () {58 vars in 1257 bytes} [Sat Aug 27 04:39:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-301813975 => generated 144 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:39:05.570676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dad4c91d-14e7-4d31-8195-67f9fe29e12d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:05.575747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dad4c91d-14e7-4d31-8195-67f9fe29e12d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:05.614241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dad4c91d-14e7-4d31-8195-67f9fe29e12d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:05.618234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dad4c91d-14e7-4d31-8195-67f9fe29e12d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:05.619716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dad4c91d-14e7-4d31-8195-67f9fe29e12d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:05.625328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dad4c91d-14e7-4d31-8195-67f9fe29e12d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:05.626091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dad4c91d-14e7-4d31-8195-67f9fe29e12d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:05.626789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dad4c91d-14e7-4d31-8195-67f9fe29e12d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:05.680160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:06.041614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dad4c91d-14e7-4d31-8195-67f9fe29e12d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:06.059839 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dad4c91d-14e7-4d31-8195-67f9fe29e12d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1507 microversion: 2.1 time: 0.497015 Aug 27 04:39:06.066539 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1035/2042] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:05 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1507 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:06.171609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8bc5b140-c4bc-4c73-8aac-85a32c5b5160 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:06.172939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8bc5b140-c4bc-4c73-8aac-85a32c5b5160 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:06.177820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:06.182743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bc5b140-c4bc-4c73-8aac-85a32c5b5160 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:06.183582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bc5b140-c4bc-4c73-8aac-85a32c5b5160 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:06.184822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bc5b140-c4bc-4c73-8aac-85a32c5b5160 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:06.186037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bc5b140-c4bc-4c73-8aac-85a32c5b5160 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:06.188915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bc5b140-c4bc-4c73-8aac-85a32c5b5160 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:06.189611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bc5b140-c4bc-4c73-8aac-85a32c5b5160 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:06.307784 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9dac757a-2a6f-4a07-afa6-260c99d7a749 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.122703 Aug 27 04:39:06.309976 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1008/2043] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:39:05 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:06.329705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a5c4267a-b557-4861-80e7-53902dfa8981 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'create', calling method: .version_select at 0x7f1f210081f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1475272436", "description": "tempest-description-115967878"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:06.620435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8bc5b140-c4bc-4c73-8aac-85a32c5b5160 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:06.651828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8bc5b140-c4bc-4c73-8aac-85a32c5b5160 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:06.660043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8bc5b140-c4bc-4c73-8aac-85a32c5b5160 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:06.661345 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8bc5b140-c4bc-4c73-8aac-85a32c5b5160 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1362 microversion: 2.26 time: 0.496087 Aug 27 04:39:06.664451 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1036/2044] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:06 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1362 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:06.945669 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a5c4267a-b557-4861-80e7-53902dfa8981 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.627511 Aug 27 04:39:06.947354 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1009/2045] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:39:06 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:06.961818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8b31c3cc-3c0f-4534-920a-1dbb825b1132 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f2138baf0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:06.982690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6cf69025-19dc-47d4-a43f-07dd118a70f9 req-74a5215a-bd44-4ce6-a005-73681274eb80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0335025-7f4b-4576-a817-72f93df40d5d", "name": "network-vif-deleted", "tag": "09f4e7a1-6b5b-4ba8-8e43-d444a1426021"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:07.015418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6cf69025-19dc-47d4-a43f-07dd118a70f9 req-74a5215a-bd44-4ce6-a005-73681274eb80 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:07.015898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6cf69025-19dc-47d4-a43f-07dd118a70f9 req-74a5215a-bd44-4ce6-a005-73681274eb80 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:07.016327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6cf69025-19dc-47d4-a43f-07dd118a70f9 req-74a5215a-bd44-4ce6-a005-73681274eb80 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:07.056154 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6cf69025-19dc-47d4-a43f-07dd118a70f9 req-74a5215a-bd44-4ce6-a005-73681274eb80 service nova] Creating event network-vif-deleted:09f4e7a1-6b5b-4ba8-8e43-d444a1426021 for instance d0335025-7f4b-4576-a817-72f93df40d5d on n-h1-854823-1 Aug 27 04:39:07.073338 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6cf69025-19dc-47d4-a43f-07dd118a70f9 req-74a5215a-bd44-4ce6-a005-73681274eb80 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092086 Aug 27 04:39:07.077439 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1010/2046] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:07.089856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1c9a22b8-2ac2-4dc7-b389-c877e8d07039 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:07.109512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1c9a22b8-2ac2-4dc7-b389-c877e8d07039 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:07.120905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c9a22b8-2ac2-4dc7-b389-c877e8d07039 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:07.122010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c9a22b8-2ac2-4dc7-b389-c877e8d07039 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:07.122380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c9a22b8-2ac2-4dc7-b389-c877e8d07039 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:07.123090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c9a22b8-2ac2-4dc7-b389-c877e8d07039 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:07.123534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c9a22b8-2ac2-4dc7-b389-c877e8d07039 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:07.133936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c9a22b8-2ac2-4dc7-b389-c877e8d07039 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:07.240396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c9a22b8-2ac2-4dc7-b389-c877e8d07039 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:07.241037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c9a22b8-2ac2-4dc7-b389-c877e8d07039 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:07.241490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c9a22b8-2ac2-4dc7-b389-c877e8d07039 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:07.241970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-1c9a22b8-2ac2-4dc7-b389-c877e8d07039 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lazy-loading 'fault' on Instance uuid d0335025-7f4b-4576-a817-72f93df40d5d {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:07.365829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c9a22b8-2ac2-4dc7-b389-c877e8d07039 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:07.375568 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1c9a22b8-2ac2-4dc7-b389-c877e8d07039 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 200 len: 1305 microversion: 2.1 time: 0.293185 Aug 27 04:39:07.391562 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1011/2047] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:07 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 1305 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:07.399936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-782ba80a-5fb5-4133-8577-723e13fc6a7b req-5ccdb692-d8ee-4115-9fa6-c03af852dfb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb73d85-d719-416d-8bab-d09b65578cc3", "name": "network-vif-plugged", "status": "completed", "tag": "f1e9eb57-5c77-4f0f-a0e4-d0d7dd3ac084"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:07.421474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-782ba80a-5fb5-4133-8577-723e13fc6a7b req-5ccdb692-d8ee-4115-9fa6-c03af852dfb4 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:07.423355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-782ba80a-5fb5-4133-8577-723e13fc6a7b req-5ccdb692-d8ee-4115-9fa6-c03af852dfb4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:07.426073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-782ba80a-5fb5-4133-8577-723e13fc6a7b req-5ccdb692-d8ee-4115-9fa6-c03af852dfb4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:07.440292 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-782ba80a-5fb5-4133-8577-723e13fc6a7b req-5ccdb692-d8ee-4115-9fa6-c03af852dfb4 service nova] Creating event network-vif-plugged:f1e9eb57-5c77-4f0f-a0e4-d0d7dd3ac084 for instance 3eb73d85-d719-416d-8bab-d09b65578cc3 on n-h1-854823-1 Aug 27 04:39:07.447640 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-782ba80a-5fb5-4133-8577-723e13fc6a7b req-5ccdb692-d8ee-4115-9fa6-c03af852dfb4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054642 Aug 27 04:39:07.448884 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1012/2048] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:07.699014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a84ee1f1-485a-4e6a-8fcd-dc6e1f4f0e26 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:07.703066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a84ee1f1-485a-4e6a-8fcd-dc6e1f4f0e26 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:07.739794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a84ee1f1-485a-4e6a-8fcd-dc6e1f4f0e26 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:07.744875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a84ee1f1-485a-4e6a-8fcd-dc6e1f4f0e26 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:07.748025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a84ee1f1-485a-4e6a-8fcd-dc6e1f4f0e26 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:07.752126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a84ee1f1-485a-4e6a-8fcd-dc6e1f4f0e26 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:07.754118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a84ee1f1-485a-4e6a-8fcd-dc6e1f4f0e26 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:07.754688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a84ee1f1-485a-4e6a-8fcd-dc6e1f4f0e26 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:07.851823 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8b31c3cc-3c0f-4534-920a-1dbb825b1132 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.894306 Aug 27 04:39:07.853018 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1037/2049] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 04:39:06 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:07.873087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7c27e4a8-70d6-41b4-a404-ed1cb7fa027c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f21536040>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:08.233014 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7c27e4a8-70d6-41b4-a404-ed1cb7fa027c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/3b38223d-62e8-48ac-a20f-218e114f586d" status: 202 len: 0 microversion: 2.1 time: 0.367103 Aug 27 04:39:08.234283 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1038/2050] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:39:07 2022] DELETE /compute/v2.1/os-security-groups/3b38223d-62e8-48ac-a20f-218e114f586d => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:39:08.244140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ba76481b-5ec3-44f5-9e8a-7c21d43bff17 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f21485ca0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:08.288041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG neutronclient.v2_0.client [None req-ba76481b-5ec3-44f5-9e8a-7c21d43bff17 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist", "detail": ""}} {{(pid=128870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:39:08.288777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.security_group_api [None req-ba76481b-5ec3-44f5-9e8a-7c21d43bff17 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Neutron security group 3b38223d-62e8-48ac-a20f-218e114f586d not found {{(pid=128870) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:39:08.289314 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-ba76481b-5ec3-44f5-9e8a-7c21d43bff17 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist Aug 27 04:39:08.289314 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-67e9f86c-3a12-4f8d-966c-7c4df95f40cd'] Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ba76481b-5ec3-44f5-9e8a-7c21d43bff17 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-security-groups/3b38223d-62e8-48ac-a20f-218e114f586d HTTP/1.1 Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: exception: Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-67e9f86c-3a12-4f8d-966c-7c4df95f40cd'] Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '3b38223d-62e8-48ac-a20f-218e114f586d'} Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:39:08.292806 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67e9f86c-3a12-4f8d-966c-7c4df95f40cd'] Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67e9f86c-3a12-4f8d-966c-7c4df95f40cd'] Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67e9f86c-3a12-4f8d-966c-7c4df95f40cd'] Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67e9f86c-3a12-4f8d-966c-7c4df95f40cd'] Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ba76481b-5ec3-44f5-9e8a-7c21d43bff17 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 404 to user: Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-67e9f86c-3a12-4f8d-966c-7c4df95f40cd'] {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ba76481b-5ec3-44f5-9e8a-7c21d43bff17 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/3b38223d-62e8-48ac-a20f-218e114f586d" status: 404 len: 194 microversion: 2.1 time: 0.055302 Aug 27 04:39:08.301473 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1039/2051] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 04:39:08 2022] GET /compute/v2.1/os-security-groups/3b38223d-62e8-48ac-a20f-218e114f586d => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:39:08.309725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-df80191c-5823-4e95-9a09-a15584e6fddd tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f214b7040>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:08.439761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a84ee1f1-485a-4e6a-8fcd-dc6e1f4f0e26 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:08.449794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a84ee1f1-485a-4e6a-8fcd-dc6e1f4f0e26 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:08.455433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a84ee1f1-485a-4e6a-8fcd-dc6e1f4f0e26 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:08.459020 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a84ee1f1-485a-4e6a-8fcd-dc6e1f4f0e26 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1362 microversion: 2.26 time: 0.772593 Aug 27 04:39:08.464019 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1013/2052] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:07 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1362 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:08.475626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3ba2c7d6-f929-4151-bc46-1560b7e37688 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:08.481409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3ba2c7d6-f929-4151-bc46-1560b7e37688 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:08.499918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ba2c7d6-f929-4151-bc46-1560b7e37688 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:08.506506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ba2c7d6-f929-4151-bc46-1560b7e37688 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:08.509227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ba2c7d6-f929-4151-bc46-1560b7e37688 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:08.510225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ba2c7d6-f929-4151-bc46-1560b7e37688 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:08.512461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ba2c7d6-f929-4151-bc46-1560b7e37688 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:08.513073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ba2c7d6-f929-4151-bc46-1560b7e37688 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:08.559704 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3ba2c7d6-f929-4151-bc46-1560b7e37688 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3ba2c7d6-f929-4151-bc46-1560b7e37688 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d HTTP/1.1 Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'd0335025-7f4b-4576-a817-72f93df40d5d'} Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:08.563867 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.569516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:08.569516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:08.569516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:08.569516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:08.569516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:08.569516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:39:08.569516 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.569516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3ba2c7d6-f929-4151-bc46-1560b7e37688 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:08.571326 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3ba2c7d6-f929-4151-bc46-1560b7e37688 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 404 len: 111 microversion: 2.1 time: 0.102786 Aug 27 04:39:08.572836 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1014/2053] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:08 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:39:08.666996 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-df80191c-5823-4e95-9a09-a15584e6fddd tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/a7eaa6db-4ea9-4f44-8090-4cd31a3ee489" status: 202 len: 0 microversion: 2.1 time: 0.367065 Aug 27 04:39:08.668771 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1040/2054] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:39:08 2022] DELETE /compute/v2.1/os-security-groups/a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:08.683365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d6cb8ca-6edf-4165-86a8-67020f0679e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f21088820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:08.737149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-8d6cb8ca-6edf-4165-86a8-67020f0679e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:39:08.738019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-8d6cb8ca-6edf-4165-86a8-67020f0679e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Neutron security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:39:08.738582 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8d6cb8ca-6edf-4165-86a8-67020f0679e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist Aug 27 04:39:08.738582 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-29d01815-1f0c-4f5c-ac3f-8bbc018d9fdf'] Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d6cb8ca-6edf-4165-86a8-67020f0679e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-security-groups/a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 HTTP/1.1 Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: exception: Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-29d01815-1f0c-4f5c-ac3f-8bbc018d9fdf'] Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'a7eaa6db-4ea9-4f44-8090-4cd31a3ee489'} Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:39:08.743065 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29d01815-1f0c-4f5c-ac3f-8bbc018d9fdf'] Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29d01815-1f0c-4f5c-ac3f-8bbc018d9fdf'] Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29d01815-1f0c-4f5c-ac3f-8bbc018d9fdf'] Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29d01815-1f0c-4f5c-ac3f-8bbc018d9fdf'] Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d6cb8ca-6edf-4165-86a8-67020f0679e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 404 to user: Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-29d01815-1f0c-4f5c-ac3f-8bbc018d9fdf'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8d6cb8ca-6edf-4165-86a8-67020f0679e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/a7eaa6db-4ea9-4f44-8090-4cd31a3ee489" status: 404 len: 194 microversion: 2.1 time: 0.071897 Aug 27 04:39:08.747536 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1015/2055] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 04:39:08 2022] GET /compute/v2.1/os-security-groups/a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:39:08.754843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-082e5b44-c9ce-44a9-bbad-8c76dc1dd085 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f213fba60>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:08.875696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1701048867", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "fa9d001d-b3bf-4c75-aaaf-2dd93a5532f5"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:08.975189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] validate_networks() for [('fa9d001d-b3bf-4c75-aaaf-2dd93a5532f5', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:39:09.454968 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-082e5b44-c9ce-44a9-bbad-8c76dc1dd085 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/9d97cb96-e961-4a23-a82e-6e4cd0ee669d" status: 202 len: 0 microversion: 2.1 time: 0.704258 Aug 27 04:39:09.455616 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1041/2056] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:39:08 2022] DELETE /compute/v2.1/os-security-groups/9d97cb96-e961-4a23-a82e-6e4cd0ee669d => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:09.465466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4000218e-8e7f-47f9-b818-e3448d974ec8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f213fbf70>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:09.544072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG neutronclient.v2_0.client [None req-4000218e-8e7f-47f9-b818-e3448d974ec8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist", "detail": ""}} {{(pid=128870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:39:09.544760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.security_group_api [None req-4000218e-8e7f-47f9-b818-e3448d974ec8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Neutron security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d not found {{(pid=128870) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:39:09.545301 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-4000218e-8e7f-47f9-b818-e3448d974ec8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist Aug 27 04:39:09.545301 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-43a5f30a-fc3d-456b-9a56-93b5801df931'] Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4000218e-8e7f-47f9-b818-e3448d974ec8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-security-groups/9d97cb96-e961-4a23-a82e-6e4cd0ee669d HTTP/1.1 Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: exception: Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-43a5f30a-fc3d-456b-9a56-93b5801df931'] Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '9d97cb96-e961-4a23-a82e-6e4cd0ee669d'} Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:39:09.547755 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43a5f30a-fc3d-456b-9a56-93b5801df931'] Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43a5f30a-fc3d-456b-9a56-93b5801df931'] Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43a5f30a-fc3d-456b-9a56-93b5801df931'] Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43a5f30a-fc3d-456b-9a56-93b5801df931'] Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4000218e-8e7f-47f9-b818-e3448d974ec8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 404 to user: Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-43a5f30a-fc3d-456b-9a56-93b5801df931'] {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:09.553720 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4000218e-8e7f-47f9-b818-e3448d974ec8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/9d97cb96-e961-4a23-a82e-6e4cd0ee669d" status: 404 len: 194 microversion: 2.1 time: 0.088984 Aug 27 04:39:09.558249 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1042/2057] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 04:39:09 2022] GET /compute/v2.1/os-security-groups/9d97cb96-e961-4a23-a82e-6e4cd0ee669d => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:39:09.573193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-462a8790-8847-40d7-92ef-d54b8db00e12 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:09.577749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-462a8790-8847-40d7-92ef-d54b8db00e12 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:09.597483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-462a8790-8847-40d7-92ef-d54b8db00e12 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:09.600489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-462a8790-8847-40d7-92ef-d54b8db00e12 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:09.601253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-462a8790-8847-40d7-92ef-d54b8db00e12 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:09.605166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-462a8790-8847-40d7-92ef-d54b8db00e12 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:09.606833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-462a8790-8847-40d7-92ef-d54b8db00e12 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:09.607625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-462a8790-8847-40d7-92ef-d54b8db00e12 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:09.904670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-462a8790-8847-40d7-92ef-d54b8db00e12 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:09.913967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-462a8790-8847-40d7-92ef-d54b8db00e12 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:09.918237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-462a8790-8847-40d7-92ef-d54b8db00e12 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:09.922110 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-462a8790-8847-40d7-92ef-d54b8db00e12 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1362 microversion: 2.26 time: 0.366605 Aug 27 04:39:09.922862 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1043/2058] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:09 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:09.944611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-17b126db-e0c3-47ac-9640-1b7c470fa21c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f213fee50>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:10.082834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:39:10.083309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:39:10.084634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:39:10.085079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:39:10.085736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:39:10.103970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:10.104447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:10.104907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:10.106336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:10.106786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:10.112563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:10.141128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Getting quotas for project b902932050be4c04bca1de4fe268c2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:39:10.155178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Getting quotas for user 6c59dc5e251943d59de8b2d640643a0e and project b902932050be4c04bca1de4fe268c2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:39:10.173415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:39:10.176600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:39:10.259060 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92fb207c-aa45-4b5a-ba07-c0045ff5e7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.390637 Aug 27 04:39:10.259721 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1016/2059] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:39:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:39:10.273763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3bb0970f-7342-43f9-815b-96c922ff59fd tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:10.275176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3bb0970f-7342-43f9-815b-96c922ff59fd tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:10.378144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3bb0970f-7342-43f9-815b-96c922ff59fd tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:10.391495 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3bb0970f-7342-43f9-815b-96c922ff59fd tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1215 microversion: 2.1 time: 0.123728 Aug 27 04:39:10.392065 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1017/2060] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:10 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1215 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:10.946052 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-17b126db-e0c3-47ac-9640-1b7c470fa21c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.005462 Aug 27 04:39:10.956342 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1044/2061] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 04:39:09 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:10.956492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ce3e535-9243-437d-a184-a72fcaf1bf4b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:10.956492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ce3e535-9243-437d-a184-a72fcaf1bf4b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:10.963486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ec7cb945-761e-4007-b7a4-8d0fba997eb7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'create', calling method: .version_select at 0x7f1f213a81f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1214652553", "description": "tempest-description-2045315087"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:10.971837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce3e535-9243-437d-a184-a72fcaf1bf4b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:10.977790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce3e535-9243-437d-a184-a72fcaf1bf4b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:10.978306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce3e535-9243-437d-a184-a72fcaf1bf4b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:10.979067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce3e535-9243-437d-a184-a72fcaf1bf4b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:10.979543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce3e535-9243-437d-a184-a72fcaf1bf4b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:10.979980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce3e535-9243-437d-a184-a72fcaf1bf4b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:11.257677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4ce3e535-9243-437d-a184-a72fcaf1bf4b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:11.269348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4ce3e535-9243-437d-a184-a72fcaf1bf4b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:11.271112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4ce3e535-9243-437d-a184-a72fcaf1bf4b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:11.272356 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ce3e535-9243-437d-a184-a72fcaf1bf4b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1545 microversion: 2.26 time: 0.329530 Aug 27 04:39:11.273750 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1018/2062] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:10 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1545 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:11.302192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f21104b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:11.335975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:11.337880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:11.338360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:11.341867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:11.357246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:11.359418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:11.359870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:11.364334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:11.366816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:11.368860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:11.439942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:11.440451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:11.440959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:11.462119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:11.462612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:11.468241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:11.523370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lazy-loading 'flavor' on Instance uuid 3eb73d85-d719-416d-8bab-d09b65578cc3 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:11.645913 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e00ce986-f42d-4eb6-9f04-e91e70ae1702 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "PUT /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-963241350" status: 201 len: 0 microversion: 2.26 time: 0.349193 Aug 27 04:39:11.648098 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1019/2063] 10.222.0.79 () {62 vars in 1377 bytes} [Sat Aug 27 04:39:11 2022] PUT /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-963241350 => generated 0 bytes in 352 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 27 04:39:11.654181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cfe1ef58-6f1c-4fb2-b43b-612f4f6056b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:11.655116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cfe1ef58-6f1c-4fb2-b43b-612f4f6056b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:11.659714 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ec7cb945-761e-4007-b7a4-8d0fba997eb7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.700161 Aug 27 04:39:11.661308 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1045/2064] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:39:10 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:11.663794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfe1ef58-6f1c-4fb2-b43b-612f4f6056b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:11.664522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfe1ef58-6f1c-4fb2-b43b-612f4f6056b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:11.665013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfe1ef58-6f1c-4fb2-b43b-612f4f6056b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:11.665888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfe1ef58-6f1c-4fb2-b43b-612f4f6056b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:11.666368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfe1ef58-6f1c-4fb2-b43b-612f4f6056b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:11.666936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfe1ef58-6f1c-4fb2-b43b-612f4f6056b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:11.668915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e2964dc9-1f83-4625-9805-2222702b686b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f213a8160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:11.710263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2964dc9-1f83-4625-9805-2222702b686b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:11.710771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2964dc9-1f83-4625-9805-2222702b686b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:11.716805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2964dc9-1f83-4625-9805-2222702b686b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:11.754400 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e2964dc9-1f83-4625-9805-2222702b686b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-963241350" status: 204 len: 0 microversion: 2.26 time: 0.091485 Aug 27 04:39:11.755019 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1046/2065] 10.222.0.79 () {60 vars in 1358 bytes} [Sat Aug 27 04:39:11 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-963241350 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:39:11.775457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2da65a7b-fd89-4d55-a498-b5078c38bc76 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'create', calling method: .version_select at 0x7f1f213a8040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-237942575", "description": "tempest-description-868375699"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:11.857849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cfe1ef58-6f1c-4fb2-b43b-612f4f6056b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:11.873481 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cfe1ef58-6f1c-4fb2-b43b-612f4f6056b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1267 microversion: 2.1 time: 0.223926 Aug 27 04:39:11.891865 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1020/2066] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:11 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:11.908655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f210aedc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:11.944337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:11.946532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:11.951728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:11.954264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:11.984173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:11.991306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:11.992815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:11.994375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:11.997387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:11.998925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:12.073190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:12.073950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:12.075393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:12.115019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lazy-loading 'flavor' on Instance uuid 3eb73d85-d719-416d-8bab-d09b65578cc3 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:12.155059 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7bc9e1bb-34d4-4c61-b04e-78c947be5442 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags" status: 204 len: 0 microversion: 2.26 time: 0.259533 Aug 27 04:39:12.157791 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1021/2067] 10.222.0.79 () {60 vars in 1295 bytes} [Sat Aug 27 04:39:11 2022] DELETE /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:39:12.180834 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2da65a7b-fd89-4d55-a498-b5078c38bc76 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.424427 Aug 27 04:39:12.182188 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1047/2068] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:39:11 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:12.184751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c63e86a-ad54-42c5-85ad-376bf483bba9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f21104dc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:12.211788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c63e86a-ad54-42c5-85ad-376bf483bba9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:12.213101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c63e86a-ad54-42c5-85ad-376bf483bba9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:12.215238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c63e86a-ad54-42c5-85ad-376bf483bba9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:12.244297 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c63e86a-ad54-42c5-85ad-376bf483bba9 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags" status: 200 len: 12 microversion: 2.26 time: 0.077275 Aug 27 04:39:12.247968 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1022/2069] 10.222.0.79 () {60 vars in 1292 bytes} [Sat Aug 27 04:39:12 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags => generated 12 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:12.264127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f213dd160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:12.331662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:12.332165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:12.339307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:12.342035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:12.382014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:12.384957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:12.385413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:12.392879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:12.393489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:12.394811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:12.494991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:12.495411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:12.499748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:12.538978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:12.539412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:12.539857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:12.619359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lazy-loading 'flavor' on Instance uuid 3eb73d85-d719-416d-8bab-d09b65578cc3 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:12.656676 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b337064b-e793-4d32-b264-404cbc4f4546 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "PUT /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-450979200" status: 201 len: 0 microversion: 2.26 time: 0.402590 Aug 27 04:39:12.660261 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1048/2070] 10.222.0.79 () {62 vars in 1377 bytes} [Sat Aug 27 04:39:12 2022] PUT /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-450979200 => generated 0 bytes in 407 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 04:39:12.671164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1361649505", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "0d06b267-84e5-4774-91c3-0bec066508d2"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:12.774956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] validate_networks() for [('0d06b267-84e5-4774-91c3-0bec066508d2', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:39:13.180024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1664496196", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:13.256814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:39:13.675602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:39:13.676568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:39:13.677432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:39:13.678229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:39:13.678745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:39:13.706703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:13.707465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:13.708335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:13.709621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:13.710215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:13.710760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:13.760038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Getting quotas for project 851596d90257494a92286fd41e796615. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:39:13.783019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Getting quotas for user 79b9b0d20ee74c999f83602bfb52b705 and project 851596d90257494a92286fd41e796615. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:39:13.836294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:39:13.855643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:39:13.935486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:39:13.936083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:39:13.936428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:39:13.937187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:39:13.937885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:39:13.955302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:13.956123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:13.956784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:13.958610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:13.961032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:13.961654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:13.977503 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da8a9498-684d-4143-83cb-cf4a98d97ce4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.432857 Aug 27 04:39:13.979340 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1023/2071] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:39:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:39:13.994099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-501459d9-451e-46bb-aad0-8a635346af3b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f210494c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:14.034785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Getting quotas for project 8c840f648f684b23bd33f59b466ae029. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:39:14.041452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-501459d9-451e-46bb-aad0-8a635346af3b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:14.044625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-501459d9-451e-46bb-aad0-8a635346af3b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:14.046326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-501459d9-451e-46bb-aad0-8a635346af3b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:14.075461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Getting quotas for user 8586e37b47d141f08610633fce374d84 and project 8c840f648f684b23bd33f59b466ae029. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:39:14.080560 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-501459d9-451e-46bb-aad0-8a635346af3b tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags" status: 200 len: 35 microversion: 2.26 time: 0.094528 Aug 27 04:39:14.081252 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1024/2072] 10.222.0.79 () {60 vars in 1292 bytes} [Sat Aug 27 04:39:13 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags => generated 35 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:14.092781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4763cc9a-19a7-42cf-9aae-4ef05097463d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:14.093418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4763cc9a-19a7-42cf-9aae-4ef05097463d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:14.097726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:39:14.107032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:39:14.112285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4763cc9a-19a7-42cf-9aae-4ef05097463d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:14.112836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4763cc9a-19a7-42cf-9aae-4ef05097463d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:14.113283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4763cc9a-19a7-42cf-9aae-4ef05097463d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:14.117606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4763cc9a-19a7-42cf-9aae-4ef05097463d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:14.118301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4763cc9a-19a7-42cf-9aae-4ef05097463d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:14.125638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4763cc9a-19a7-42cf-9aae-4ef05097463d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:14.211291 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dee43358-8acb-4d8b-96ce-3c7211c86f9d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.549701 Aug 27 04:39:14.218873 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1049/2073] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:39:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:39:14.683101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bdba4f8f-87ab-4dee-99db-1fb474498b91 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:14.690089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bdba4f8f-87ab-4dee-99db-1fb474498b91 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:14.690463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bdba4f8f-87ab-4dee-99db-1fb474498b91 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:14.692230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bdba4f8f-87ab-4dee-99db-1fb474498b91 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:14.694530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bdba4f8f-87ab-4dee-99db-1fb474498b91 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:14.695291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bdba4f8f-87ab-4dee-99db-1fb474498b91 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:14.697321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bdba4f8f-87ab-4dee-99db-1fb474498b91 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:14.760052 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bdba4f8f-87ab-4dee-99db-1fb474498b91 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.539754 Aug 27 04:39:14.761250 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1050/2074] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:39:14 2022] GET /compute/v2.1/os-services => generated 944 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:14.788769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-15695e79-a131-4f7a-ba28-80519cdd417f tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:14.792169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-15695e79-a131-4f7a-ba28-80519cdd417f tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:14.910712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-15695e79-a131-4f7a-ba28-80519cdd417f tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:14.921839 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-15695e79-a131-4f7a-ba28-80519cdd417f tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1217 microversion: 2.1 time: 0.153762 Aug 27 04:39:14.954544 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1051/2075] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:14 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1217 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:14.982101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f213a8790>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:15.002033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.002949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.003638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.004509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:15.028573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.042450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.043941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.046211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.047085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.047772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.105131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.106104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.106543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.164769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lazy-loading 'flavor' on Instance uuid 3eb73d85-d719-416d-8bab-d09b65578cc3 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:15.210858 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a86b5ec8-e621-44d5-9f5c-e6f7589e9e55 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-450979200" status: 204 len: 0 microversion: 2.26 time: 0.249955 Aug 27 04:39:15.212849 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1052/2076] 10.222.0.79 () {60 vars in 1361 bytes} [Sat Aug 27 04:39:14 2022] DELETE /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-450979200 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:39:15.220990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-897aada4-804e-43cd-b9ef-f5890769da77 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:15.221953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-897aada4-804e-43cd-b9ef-f5890769da77 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:15.343956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-897aada4-804e-43cd-b9ef-f5890769da77 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:15.344301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4763cc9a-19a7-42cf-9aae-4ef05097463d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:15.354180 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4763cc9a-19a7-42cf-9aae-4ef05097463d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1315 microversion: 2.1 time: 1.271855 Aug 27 04:39:15.356552 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-897aada4-804e-43cd-b9ef-f5890769da77 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1216 microversion: 2.1 time: 0.140138 Aug 27 04:39:15.363537 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1025/2077] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:14 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1315 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:15.374580 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1053/2078] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:15 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:15.384668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42e52c93-96c8-4930-a30e-562a9adcba6e tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:15.401729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-71efffcd-cf07-421d-8e03-902097a92e7a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f213fb160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:15.402168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42e52c93-96c8-4930-a30e-562a9adcba6e tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.404756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42e52c93-96c8-4930-a30e-562a9adcba6e tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.406248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42e52c93-96c8-4930-a30e-562a9adcba6e tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.408103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42e52c93-96c8-4930-a30e-562a9adcba6e tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.409992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42e52c93-96c8-4930-a30e-562a9adcba6e tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.411526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42e52c93-96c8-4930-a30e-562a9adcba6e tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.446748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71efffcd-cf07-421d-8e03-902097a92e7a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.447847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71efffcd-cf07-421d-8e03-902097a92e7a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.448226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71efffcd-cf07-421d-8e03-902097a92e7a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.473043 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-71efffcd-cf07-421d-8e03-902097a92e7a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags" status: 200 len: 12 microversion: 2.26 time: 0.096709 Aug 27 04:39:15.476734 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1054/2079] 10.222.0.79 () {60 vars in 1292 bytes} [Sat Aug 27 04:39:15 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags => generated 12 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:15.495740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f214fe040>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:15.498267 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42e52c93-96c8-4930-a30e-562a9adcba6e tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=n-d-854823-1" status: 200 len: 578 microversion: 2.1 time: 0.126811 Aug 27 04:39:15.501321 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1026/2080] 10.222.0.79 () {58 vars in 1172 bytes} [Sat Aug 27 04:39:15 2022] GET /compute/v2.1/os-services?host=n-d-854823-1 => generated 578 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:15.520508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.521874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.523328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.526395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:15.540348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.541967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.542668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.544666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13ec3606-7b3c-4926-ab81-6c92307f0c7c tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:15.545735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.547410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.561629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13ec3606-7b3c-4926-ab81-6c92307f0c7c tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.562431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13ec3606-7b3c-4926-ab81-6c92307f0c7c tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.563765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13ec3606-7b3c-4926-ab81-6c92307f0c7c tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.564047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.571280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13ec3606-7b3c-4926-ab81-6c92307f0c7c tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.572356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13ec3606-7b3c-4926-ab81-6c92307f0c7c tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.572897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13ec3606-7b3c-4926-ab81-6c92307f0c7c tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.634505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.635000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.635438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.672571 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13ec3606-7b3c-4926-ab81-6c92307f0c7c tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.156893 Aug 27 04:39:15.674035 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1027/2081] 10.222.0.79 () {58 vars in 1176 bytes} [Sat Aug 27 04:39:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:15.690936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eeaf2c17-bfb9-4d8f-9179-fbcdf7a123d9 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:15.694750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeaf2c17-bfb9-4d8f-9179-fbcdf7a123d9 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.695243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeaf2c17-bfb9-4d8f-9179-fbcdf7a123d9 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.695774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeaf2c17-bfb9-4d8f-9179-fbcdf7a123d9 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.696762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeaf2c17-bfb9-4d8f-9179-fbcdf7a123d9 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.697530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeaf2c17-bfb9-4d8f-9179-fbcdf7a123d9 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.698260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeaf2c17-bfb9-4d8f-9179-fbcdf7a123d9 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.704474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:15.727893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lazy-loading 'flavor' on Instance uuid 3eb73d85-d719-416d-8bab-d09b65578cc3 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:15.771783 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3134efd6-b6bd-4569-9900-a1b5f1e13dbf tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags" status: 204 len: 0 microversion: 2.26 time: 0.288192 Aug 27 04:39:15.772409 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1055/2082] 10.222.0.79 () {60 vars in 1295 bytes} [Sat Aug 27 04:39:15 2022] DELETE /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:39:15.785193 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eeaf2c17-bfb9-4d8f-9179-fbcdf7a123d9 tempest-ServicesAdminTestJSON-685610036 tempest-ServicesAdminTestJSON-685610036-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.099809 Aug 27 04:39:15.800860 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1028/2083] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:39:15 2022] GET /compute/v2.1/os-services => generated 944 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:15.804214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-296db55a-0b3b-4e44-aefc-0ab2635d3cc3 req-b70ecdd7-2d5d-46bd-b0b9-0a80b4a272aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f1e5e54-0d90-49a2-96ec-29f55ab91060", "tag": "7fac25bf-ac7d-42b3-a2ac-5cf4ece26e48"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:15.816907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f2101baf0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:15.845652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.846874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.847331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.848003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:15.863449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-296db55a-0b3b-4e44-aefc-0ab2635d3cc3 req-b70ecdd7-2d5d-46bd-b0b9-0a80b4a272aa service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.863936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-296db55a-0b3b-4e44-aefc-0ab2635d3cc3 req-b70ecdd7-2d5d-46bd-b0b9-0a80b4a272aa service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.864371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-296db55a-0b3b-4e44-aefc-0ab2635d3cc3 req-b70ecdd7-2d5d-46bd-b0b9-0a80b4a272aa service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.883833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.889044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.889907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.892065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.894200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.894978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.900726 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-296db55a-0b3b-4e44-aefc-0ab2635d3cc3 req-b70ecdd7-2d5d-46bd-b0b9-0a80b4a272aa service nova] Creating event network-changed:7fac25bf-ac7d-42b3-a2ac-5cf4ece26e48 for instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 on n-h1-854823-1 Aug 27 04:39:15.909744 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-296db55a-0b3b-4e44-aefc-0ab2635d3cc3 req-b70ecdd7-2d5d-46bd-b0b9-0a80b4a272aa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119066 Aug 27 04:39:15.912489 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1056/2084] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:15.944183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6e799626-2ec5-4cf5-ade6-f68eb5ddcd2b tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:15.944987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6e799626-2ec5-4cf5-ade6-f68eb5ddcd2b tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:15.957560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e799626-2ec5-4cf5-ade6-f68eb5ddcd2b tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.973790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.974751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.975348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.983800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e799626-2ec5-4cf5-ade6-f68eb5ddcd2b tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.987447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e799626-2ec5-4cf5-ade6-f68eb5ddcd2b tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:15.988320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e799626-2ec5-4cf5-ade6-f68eb5ddcd2b tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:15.990275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e799626-2ec5-4cf5-ade6-f68eb5ddcd2b tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:15.990954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e799626-2ec5-4cf5-ade6-f68eb5ddcd2b tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.023167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.024343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.025554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.109142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lazy-loading 'flavor' on Instance uuid 3eb73d85-d719-416d-8bab-d09b65578cc3 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:16.146750 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8b98f6d-25fe-4560-93b5-1a8265582962 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "PUT /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-1201648278" status: 201 len: 0 microversion: 2.26 time: 0.344366 Aug 27 04:39:16.147504 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1029/2085] 10.222.0.79 () {62 vars in 1380 bytes} [Sat Aug 27 04:39:15 2022] PUT /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-1201648278 => generated 0 bytes in 346 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 27 04:39:16.158673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f2113e1f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:16.172199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.172726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.173481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.174637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:16.182002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.182828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.184812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.185766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.186781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.187576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.233407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.234564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.236357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.254615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.255486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.256415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.300882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6e799626-2ec5-4cf5-ade6-f68eb5ddcd2b tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:16.327535 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6e799626-2ec5-4cf5-ade6-f68eb5ddcd2b tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1269 microversion: 2.1 time: 0.388187 Aug 27 04:39:16.332319 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1057/2086] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:15 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1269 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:16.341811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lazy-loading 'flavor' on Instance uuid 3eb73d85-d719-416d-8bab-d09b65578cc3 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:16.381971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7d0afe39-2125-46e1-8d58-412d322c955c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:16.382922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7d0afe39-2125-46e1-8d58-412d322c955c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:16.389980 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86a51f08-29cb-4b45-9aca-51cfec122e09 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "PUT /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-1569173939" status: 201 len: 0 microversion: 2.26 time: 0.234035 Aug 27 04:39:16.393730 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1030/2087] 10.222.0.79 () {62 vars in 1380 bytes} [Sat Aug 27 04:39:16 2022] PUT /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-1569173939 => generated 0 bytes in 240 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 27 04:39:16.408465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30270981-9506-4fe5-a633-d315dab5cdc7 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:16.409859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-30270981-9506-4fe5-a633-d315dab5cdc7 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:16.411454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d0afe39-2125-46e1-8d58-412d322c955c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.411983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d0afe39-2125-46e1-8d58-412d322c955c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.412495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d0afe39-2125-46e1-8d58-412d322c955c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.413281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d0afe39-2125-46e1-8d58-412d322c955c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.413750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d0afe39-2125-46e1-8d58-412d322c955c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.414182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d0afe39-2125-46e1-8d58-412d322c955c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.432294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30270981-9506-4fe5-a633-d315dab5cdc7 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.434024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30270981-9506-4fe5-a633-d315dab5cdc7 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.440499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30270981-9506-4fe5-a633-d315dab5cdc7 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.442071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30270981-9506-4fe5-a633-d315dab5cdc7 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.444746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30270981-9506-4fe5-a633-d315dab5cdc7 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.446496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30270981-9506-4fe5-a633-d315dab5cdc7 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.680816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7d0afe39-2125-46e1-8d58-412d322c955c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:16.696315 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7d0afe39-2125-46e1-8d58-412d322c955c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1268 microversion: 2.1 time: 0.317395 Aug 27 04:39:16.705560 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1058/2088] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:16 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1268 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:16.712964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f213fec10>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:16.733352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.749654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.753974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.754878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:16.773643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.774151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.774592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.775304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.777875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.778312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.846346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.858287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.859231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.883754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-30270981-9506-4fe5-a633-d315dab5cdc7 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:16.889041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lazy-loading 'flavor' on Instance uuid 3eb73d85-d719-416d-8bab-d09b65578cc3 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:16.898585 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-30270981-9506-4fe5-a633-d315dab5cdc7 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1315 microversion: 2.1 time: 0.499375 Aug 27 04:39:16.899239 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1031/2089] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:16 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:16.923254 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cdb4eb37-f2dd-4dc7-8e07-76f2a8209873 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags" status: 204 len: 0 microversion: 2.26 time: 0.215729 Aug 27 04:39:16.928486 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1059/2090] 10.222.0.79 () {60 vars in 1295 bytes} [Sat Aug 27 04:39:16 2022] DELETE /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:39:16.933532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e11c6d2-1d32-439e-8b51-4cb8469c3e7d tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f211725e0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:16.936476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4,nova_api:INSERT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:16.960449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e11c6d2-1d32-439e-8b51-4cb8469c3e7d tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:16.960703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e11c6d2-1d32-439e-8b51-4cb8469c3e7d tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:16.961122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e11c6d2-1d32-439e-8b51-4cb8469c3e7d tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:16.991881 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e11c6d2-1d32-439e-8b51-4cb8469c3e7d tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags" status: 200 len: 12 microversion: 2.26 time: 0.062659 Aug 27 04:39:16.992577 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1032/2091] 10.222.0.79 () {60 vars in 1292 bytes} [Sat Aug 27 04:39:16 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags => generated 12 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:17.006188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f21564f70>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:17.021755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.023561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.026534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.027050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:17.051822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.052818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.054676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.055716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.056517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.057221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.105037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.106362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.107040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.125817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lazy-loading 'flavor' on Instance uuid 3eb73d85-d719-416d-8bab-d09b65578cc3 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:17.149600 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-430df548-c363-49f6-99c4-57f7e4815c05 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags" status: 204 len: 0 microversion: 2.26 time: 0.148267 Aug 27 04:39:17.151309 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1060/2092] 10.222.0.79 () {60 vars in 1295 bytes} [Sat Aug 27 04:39:16 2022] DELETE /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:39:17.162553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f21060700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:17.195810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.196626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.197268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.198001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:17.218559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.219911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.220374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.223094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.223769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.226260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.282771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.283551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.284165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.294439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.295217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.295932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.329584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lazy-loading 'flavor' on Instance uuid 3eb73d85-d719-416d-8bab-d09b65578cc3 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:17.352689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f02cd577-ede1-4f30-a8a3-4e86d80586ea tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:17.353517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f02cd577-ede1-4f30-a8a3-4e86d80586ea tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:17.362431 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3d098cb-8459-48b5-b3fe-9d0f253ec8f2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "PUT /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-1111506128" status: 201 len: 0 microversion: 2.26 time: 0.204906 Aug 27 04:39:17.363582 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1033/2093] 10.222.0.79 () {62 vars in 1380 bytes} [Sat Aug 27 04:39:17 2022] PUT /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-1111506128 => generated 0 bytes in 207 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 27 04:39:17.376926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f02cd577-ede1-4f30-a8a3-4e86d80586ea tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.378192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f02cd577-ede1-4f30-a8a3-4e86d80586ea tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.379519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f02cd577-ede1-4f30-a8a3-4e86d80586ea tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.380689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f02cd577-ede1-4f30-a8a3-4e86d80586ea tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.383964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f21104ee0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:17.392225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f02cd577-ede1-4f30-a8a3-4e86d80586ea tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.393314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f02cd577-ede1-4f30-a8a3-4e86d80586ea tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.407133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.410458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.411285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.413785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:17.426710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.431240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.432926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.434873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.437262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.437930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.502588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.503077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.503511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.530505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.531015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.531443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.584139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lazy-loading 'flavor' on Instance uuid 3eb73d85-d719-416d-8bab-d09b65578cc3 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:17.620988 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-158d30d8-ce2a-437e-8039-81eb5b4898f0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "PUT /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-894952499" status: 201 len: 0 microversion: 2.26 time: 0.249871 Aug 27 04:39:17.631823 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1034/2094] 10.222.0.79 () {62 vars in 1377 bytes} [Sat Aug 27 04:39:17 2022] PUT /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags/tempest-tag-894952499 => generated 0 bytes in 258 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 27 04:39:17.642711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Action: 'update_all', calling method: .version_select at 0x7f1f2104e820>, body: {"tags": ["tempest-tag-975802311", "tempest-tag-912719560"]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:17.665365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.666588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.667023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.667515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:17.675099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.675591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.676071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.676849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.677305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.687621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.759125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.759615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.760050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.786890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lazy-loading 'flavor' on Instance uuid 3eb73d85-d719-416d-8bab-d09b65578cc3 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:17.826699 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e0fe2aca-b351-4fbf-96f0-cccf5fe27c2f tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "PUT /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags" status: 200 len: 60 microversion: 2.26 time: 0.190259 Aug 27 04:39:17.830768 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1035/2095] 10.222.0.79 () {62 vars in 1312 bytes} [Sat Aug 27 04:39:17 2022] PUT /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags => generated 60 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:17.837385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be4207d5-9b90-4abd-9703-24ce9b7f5e2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:17.838003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-be4207d5-9b90-4abd-9703-24ce9b7f5e2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:17.845298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be4207d5-9b90-4abd-9703-24ce9b7f5e2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.845797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be4207d5-9b90-4abd-9703-24ce9b7f5e2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.846237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be4207d5-9b90-4abd-9703-24ce9b7f5e2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.847106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be4207d5-9b90-4abd-9703-24ce9b7f5e2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:17.847629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be4207d5-9b90-4abd-9703-24ce9b7f5e2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:17.848056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be4207d5-9b90-4abd-9703-24ce9b7f5e2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:17.953632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be4207d5-9b90-4abd-9703-24ce9b7f5e2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:17.963260 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be4207d5-9b90-4abd-9703-24ce9b7f5e2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1274 microversion: 2.1 time: 0.130655 Aug 27 04:39:17.979867 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1036/2096] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:17 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1274 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:17.981026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58a18578-f6b3-41d2-873c-ab4abf44056d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:17.981689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-58a18578-f6b3-41d2-873c-ab4abf44056d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:18.001320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58a18578-f6b3-41d2-873c-ab4abf44056d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.001728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58a18578-f6b3-41d2-873c-ab4abf44056d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.002326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58a18578-f6b3-41d2-873c-ab4abf44056d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.002980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58a18578-f6b3-41d2-873c-ab4abf44056d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.003526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58a18578-f6b3-41d2-873c-ab4abf44056d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.003958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58a18578-f6b3-41d2-873c-ab4abf44056d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.067253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f02cd577-ede1-4f30-a8a3-4e86d80586ea tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:18.072297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:18.090954 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f02cd577-ede1-4f30-a8a3-4e86d80586ea tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1275 microversion: 2.1 time: 0.742763 Aug 27 04:39:18.091541 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1061/2097] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:17 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1275 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:18.111116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-96bdcf76-e112-4c16-a9f4-fb2897f19c98 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f214feca0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:18.133200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96bdcf76-e112-4c16-a9f4-fb2897f19c98 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.140900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96bdcf76-e112-4c16-a9f4-fb2897f19c98 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.141572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96bdcf76-e112-4c16-a9f4-fb2897f19c98 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.177427 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-96bdcf76-e112-4c16-a9f4-fb2897f19c98 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags" status: 200 len: 60 microversion: 2.26 time: 0.083206 Aug 27 04:39:18.178778 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1062/2098] 10.222.0.79 () {60 vars in 1292 bytes} [Sat Aug 27 04:39:18 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags => generated 60 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:18.188279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-171341d5-f650-4e82-af64-bc1bcb7ea665 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:18.189409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-171341d5-f650-4e82-af64-bc1bcb7ea665 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:18.217503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-171341d5-f650-4e82-af64-bc1bcb7ea665 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.218027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-171341d5-f650-4e82-af64-bc1bcb7ea665 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.218488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-171341d5-f650-4e82-af64-bc1bcb7ea665 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.219227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-171341d5-f650-4e82-af64-bc1bcb7ea665 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.219691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-171341d5-f650-4e82-af64-bc1bcb7ea665 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.220361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-171341d5-f650-4e82-af64-bc1bcb7ea665 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.265804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=5,nova_cell1:RELEASE=4,nova_cell1:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:18.272709 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-58a18578-f6b3-41d2-873c-ab4abf44056d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1811 microversion: 2.1 time: 0.303857 Aug 27 04:39:18.273354 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1037/2099] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:17 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1811 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:18.281490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '.version_select at 0x7f1f2101bb80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:18.291904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.292693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.293935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.294640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:18.310405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.310895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.312386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.313436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.314078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.314738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.344743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.345284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.345770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.380194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lazy-loading 'flavor' on Instance uuid 3eb73d85-d719-416d-8bab-d09b65578cc3 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:18.403272 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52c39376-f982-49ad-9f8e-fedca2dd7c5e tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags" status: 204 len: 0 microversion: 2.26 time: 0.127864 Aug 27 04:39:18.404211 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1038/2100] 10.222.0.79 () {60 vars in 1295 bytes} [Sat Aug 27 04:39:18 2022] DELETE /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3/tags => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:39:18.409215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a161bf3e-5831-483d-91a3-7d87c7d24d95 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:18.415241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a161bf3e-5831-483d-91a3-7d87c7d24d95 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.416068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a161bf3e-5831-483d-91a3-7d87c7d24d95 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.416596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a161bf3e-5831-483d-91a3-7d87c7d24d95 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.418048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a161bf3e-5831-483d-91a3-7d87c7d24d95 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.418048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a161bf3e-5831-483d-91a3-7d87c7d24d95 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.419170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a161bf3e-5831-483d-91a3-7d87c7d24d95 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.446388 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a161bf3e-5831-483d-91a3-7d87c7d24d95 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040772 Aug 27 04:39:18.448695 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1039/2101] 10.222.0.79 () {58 vars in 1176 bytes} [Sat Aug 27 04:39:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:18.460512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-450ab8bb-3584-4573-bfa1-4da1bc0affc0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:18.461094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-450ab8bb-3584-4573-bfa1-4da1bc0affc0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:18.477157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-450ab8bb-3584-4573-bfa1-4da1bc0affc0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.477660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-450ab8bb-3584-4573-bfa1-4da1bc0affc0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.478098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-450ab8bb-3584-4573-bfa1-4da1bc0affc0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.482444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-450ab8bb-3584-4573-bfa1-4da1bc0affc0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.482953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-450ab8bb-3584-4573-bfa1-4da1bc0affc0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.483388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-450ab8bb-3584-4573-bfa1-4da1bc0affc0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.526394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-450ab8bb-3584-4573-bfa1-4da1bc0affc0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:39:18.637383 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-450ab8bb-3584-4573-bfa1-4da1bc0affc0 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 204 len: 0 microversion: 2.26 time: 0.185719 Aug 27 04:39:18.637983 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1040/2102] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:39:18 2022] DELETE /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:39:18.649673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa478a94-509b-415f-ae1c-bd04fd489867 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:18.650492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aa478a94-509b-415f-ae1c-bd04fd489867 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:18.662171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa478a94-509b-415f-ae1c-bd04fd489867 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.662593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa478a94-509b-415f-ae1c-bd04fd489867 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.663416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa478a94-509b-415f-ae1c-bd04fd489867 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.665123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa478a94-509b-415f-ae1c-bd04fd489867 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:18.665729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa478a94-509b-415f-ae1c-bd04fd489867 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:18.667288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa478a94-509b-415f-ae1c-bd04fd489867 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:18.865584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aa478a94-509b-415f-ae1c-bd04fd489867 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:18.884058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aa478a94-509b-415f-ae1c-bd04fd489867 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:18.885984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aa478a94-509b-415f-ae1c-bd04fd489867 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:18.887753 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa478a94-509b-415f-ae1c-bd04fd489867 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1551 microversion: 2.26 time: 0.245207 Aug 27 04:39:18.888671 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1041/2103] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:18 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1551 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:39:18.987437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a63737c-f4b3-4602-a109-881841889ea2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:18.988713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a63737c-f4b3-4602-a109-881841889ea2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:19.003807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a63737c-f4b3-4602-a109-881841889ea2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:19.006100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a63737c-f4b3-4602-a109-881841889ea2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:19.008169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a63737c-f4b3-4602-a109-881841889ea2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:19.021284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a63737c-f4b3-4602-a109-881841889ea2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:19.021972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a63737c-f4b3-4602-a109-881841889ea2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:19.025170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a63737c-f4b3-4602-a109-881841889ea2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:19.141636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a63737c-f4b3-4602-a109-881841889ea2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:19.153571 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a63737c-f4b3-4602-a109-881841889ea2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1274 microversion: 2.1 time: 0.170063 Aug 27 04:39:19.154571 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1042/2104] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:18 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1274 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:19.159135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7faa32d3-f7a9-4492-954d-73a3f9d0ecda tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:19.159736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7faa32d3-f7a9-4492-954d-73a3f9d0ecda tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:19.190603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7faa32d3-f7a9-4492-954d-73a3f9d0ecda tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:19.191583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7faa32d3-f7a9-4492-954d-73a3f9d0ecda tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:19.192451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7faa32d3-f7a9-4492-954d-73a3f9d0ecda tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:19.193925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7faa32d3-f7a9-4492-954d-73a3f9d0ecda tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:19.194634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7faa32d3-f7a9-4492-954d-73a3f9d0ecda tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:19.195287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7faa32d3-f7a9-4492-954d-73a3f9d0ecda tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:19.238917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-171341d5-f650-4e82-af64-bc1bcb7ea665 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:19.252724 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-171341d5-f650-4e82-af64-bc1bcb7ea665 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1315 microversion: 2.1 time: 1.072386 Aug 27 04:39:19.255497 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1063/2105] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:18 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1315 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:19.632681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7faa32d3-f7a9-4492-954d-73a3f9d0ecda tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:19.650027 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7faa32d3-f7a9-4492-954d-73a3f9d0ecda tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1275 microversion: 2.1 time: 0.494385 Aug 27 04:39:19.651039 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1043/2106] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:19 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1275 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:19.915065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-92e9906f-57ed-406f-9533-3b379e6ab2b2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:19.915705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-92e9906f-57ed-406f-9533-3b379e6ab2b2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:19.945053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92e9906f-57ed-406f-9533-3b379e6ab2b2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:19.945942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92e9906f-57ed-406f-9533-3b379e6ab2b2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:19.946619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92e9906f-57ed-406f-9533-3b379e6ab2b2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:19.947643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92e9906f-57ed-406f-9533-3b379e6ab2b2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:19.959219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92e9906f-57ed-406f-9533-3b379e6ab2b2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:19.959893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92e9906f-57ed-406f-9533-3b379e6ab2b2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:20.177305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6cf01487-db2b-47f1-9700-264f73b3d531 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:20.178241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6cf01487-db2b-47f1-9700-264f73b3d531 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:20.195706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf01487-db2b-47f1-9700-264f73b3d531 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:20.202579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf01487-db2b-47f1-9700-264f73b3d531 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:20.204409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf01487-db2b-47f1-9700-264f73b3d531 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:20.209154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf01487-db2b-47f1-9700-264f73b3d531 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:20.209913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf01487-db2b-47f1-9700-264f73b3d531 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:20.212202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf01487-db2b-47f1-9700-264f73b3d531 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:20.429442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6cf01487-db2b-47f1-9700-264f73b3d531 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:20.445540 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6cf01487-db2b-47f1-9700-264f73b3d531 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1274 microversion: 2.1 time: 0.272535 Aug 27 04:39:20.447869 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1044/2107] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:20 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1274 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:20.453853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7bccdcd0-9cbb-4514-86cd-3cb00481576a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:20.454858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7bccdcd0-9cbb-4514-86cd-3cb00481576a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:20.482118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bccdcd0-9cbb-4514-86cd-3cb00481576a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:20.489943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bccdcd0-9cbb-4514-86cd-3cb00481576a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:20.492312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bccdcd0-9cbb-4514-86cd-3cb00481576a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:20.493534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bccdcd0-9cbb-4514-86cd-3cb00481576a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:20.494174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bccdcd0-9cbb-4514-86cd-3cb00481576a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:20.495586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bccdcd0-9cbb-4514-86cd-3cb00481576a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:20.798336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7bccdcd0-9cbb-4514-86cd-3cb00481576a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:20.810769 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7bccdcd0-9cbb-4514-86cd-3cb00481576a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1315 microversion: 2.1 time: 0.359845 Aug 27 04:39:20.826847 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1045/2108] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:20 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:20.842292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82ff92bf-5b00-4573-8363-59088c4cea86 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:20.843934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-92e9906f-57ed-406f-9533-3b379e6ab2b2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:20.865046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-82ff92bf-5b00-4573-8363-59088c4cea86 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:20.869248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-92e9906f-57ed-406f-9533-3b379e6ab2b2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:20.874083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-92e9906f-57ed-406f-9533-3b379e6ab2b2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:20.877585 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-92e9906f-57ed-406f-9533-3b379e6ab2b2 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1551 microversion: 2.26 time: 0.969909 Aug 27 04:39:20.877810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82ff92bf-5b00-4573-8363-59088c4cea86 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:20.878516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82ff92bf-5b00-4573-8363-59088c4cea86 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:20.880159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82ff92bf-5b00-4573-8363-59088c4cea86 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:20.881845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82ff92bf-5b00-4573-8363-59088c4cea86 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:20.884068 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1064/2109] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:19 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1551 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:20.890170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82ff92bf-5b00-4573-8363-59088c4cea86 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:20.890645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82ff92bf-5b00-4573-8363-59088c4cea86 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:21.330523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ccd2f025-ce24-4561-85a6-9249e59678ac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d9d9070-6418-43b6-91b5-42b0d0c358a6", "device": "/dev/xvdb"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:21.333854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ccd2f025-ce24-4561-85a6-9249e59678ac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:21.375931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccd2f025-ce24-4561-85a6-9249e59678ac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:21.376444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccd2f025-ce24-4561-85a6-9249e59678ac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:21.376923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccd2f025-ce24-4561-85a6-9249e59678ac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:21.377642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccd2f025-ce24-4561-85a6-9249e59678ac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:21.378098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccd2f025-ce24-4561-85a6-9249e59678ac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:21.378516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccd2f025-ce24-4561-85a6-9249e59678ac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:21.953111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-82ff92bf-5b00-4573-8363-59088c4cea86 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:21.976163 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-82ff92bf-5b00-4573-8363-59088c4cea86 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1317 microversion: 2.1 time: 1.132974 Aug 27 04:39:21.977159 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1046/2110] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:20 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1317 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:21.985755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ecdbac44-c6f2-483e-9011-1da126f735c1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:21.986698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ecdbac44-c6f2-483e-9011-1da126f735c1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:22.016851 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ccd2f025-ce24-4561-85a6-9249e59678ac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "POST /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690089 Aug 27 04:39:22.026993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdbac44-c6f2-483e-9011-1da126f735c1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:22.028050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdbac44-c6f2-483e-9011-1da126f735c1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:22.028494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdbac44-c6f2-483e-9011-1da126f735c1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:22.029244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdbac44-c6f2-483e-9011-1da126f735c1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:22.036946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdbac44-c6f2-483e-9011-1da126f735c1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:22.037415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdbac44-c6f2-483e-9011-1da126f735c1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:22.058017 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1065/2111] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 04:39:21 2022] POST /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments => generated 194 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:39:22.086910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-955d9952-fc4f-41bc-8d2f-d1d61db46e9e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:22.087655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-955d9952-fc4f-41bc-8d2f-d1d61db46e9e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:22.104792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-955d9952-fc4f-41bc-8d2f-d1d61db46e9e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:22.106232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-955d9952-fc4f-41bc-8d2f-d1d61db46e9e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:22.106784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-955d9952-fc4f-41bc-8d2f-d1d61db46e9e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:22.109757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-955d9952-fc4f-41bc-8d2f-d1d61db46e9e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:22.110714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-955d9952-fc4f-41bc-8d2f-d1d61db46e9e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:22.111549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-955d9952-fc4f-41bc-8d2f-d1d61db46e9e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:23.010982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-955d9952-fc4f-41bc-8d2f-d1d61db46e9e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:23.028966 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-955d9952-fc4f-41bc-8d2f-d1d61db46e9e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1315 microversion: 2.1 time: 0.966251 Aug 27 04:39:23.031694 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1066/2112] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:22 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1315 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:23.045773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ab3317ba-f7f5-4e57-828a-af7694d22ac7 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:23.046682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ab3317ba-f7f5-4e57-828a-af7694d22ac7 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:23.061690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab3317ba-f7f5-4e57-828a-af7694d22ac7 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:23.069333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab3317ba-f7f5-4e57-828a-af7694d22ac7 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:23.070091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab3317ba-f7f5-4e57-828a-af7694d22ac7 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:23.071176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab3317ba-f7f5-4e57-828a-af7694d22ac7 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:23.071810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab3317ba-f7f5-4e57-828a-af7694d22ac7 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:23.072787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab3317ba-f7f5-4e57-828a-af7694d22ac7 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:23.311000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ecdbac44-c6f2-483e-9011-1da126f735c1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:23.320974 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ecdbac44-c6f2-483e-9011-1da126f735c1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1316 microversion: 2.1 time: 1.340191 Aug 27 04:39:23.325257 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1047/2113] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:21 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1316 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:23.336252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6c474c7-b8d2-403e-843b-f5b42354da05 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:23.338283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6c474c7-b8d2-403e-843b-f5b42354da05 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:23.350969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6c474c7-b8d2-403e-843b-f5b42354da05 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:23.355949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6c474c7-b8d2-403e-843b-f5b42354da05 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:23.359067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6c474c7-b8d2-403e-843b-f5b42354da05 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:23.360069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6c474c7-b8d2-403e-843b-f5b42354da05 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:23.361030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6c474c7-b8d2-403e-843b-f5b42354da05 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:23.361666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6c474c7-b8d2-403e-843b-f5b42354da05 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:23.634816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ab3317ba-f7f5-4e57-828a-af7694d22ac7 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:23.663342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ab3317ba-f7f5-4e57-828a-af7694d22ac7 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:23.665249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ab3317ba-f7f5-4e57-828a-af7694d22ac7 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b03e4d8bd784c1390a598fb4189dc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73673b6b989d49a5b11295612a21b6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:23.666796 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ab3317ba-f7f5-4e57-828a-af7694d22ac7 tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 200 len: 1551 microversion: 2.26 time: 0.633923 Aug 27 04:39:23.667984 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1067/2114] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:23 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 1551 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:23.764022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d6c474c7-b8d2-403e-843b-f5b42354da05 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:23.781199 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6c474c7-b8d2-403e-843b-f5b42354da05 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1317 microversion: 2.1 time: 0.454378 Aug 27 04:39:23.782623 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1048/2115] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:23 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:23.794021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-50671e64-c70a-4e58-95b0-87c3b3aca550 req-a6c01b79-ad03-480c-8357-94840dfb3278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1e5e54-0d90-49a2-96ec-29f55ab91060", "name": "network-vif-plugged", "status": "completed", "tag": "7fac25bf-ac7d-42b3-a2ac-5cf4ece26e48"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:23.815411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=55,nova_cell0:UPDATE=7 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:23.819458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-50671e64-c70a-4e58-95b0-87c3b3aca550 req-a6c01b79-ad03-480c-8357-94840dfb3278 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:23.820202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-50671e64-c70a-4e58-95b0-87c3b3aca550 req-a6c01b79-ad03-480c-8357-94840dfb3278 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:23.821746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-50671e64-c70a-4e58-95b0-87c3b3aca550 req-a6c01b79-ad03-480c-8357-94840dfb3278 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:23.837610 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-50671e64-c70a-4e58-95b0-87c3b3aca550 req-a6c01b79-ad03-480c-8357-94840dfb3278 service nova] Creating event network-vif-plugged:7fac25bf-ac7d-42b3-a2ac-5cf4ece26e48 for instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 on n-h1-854823-1 Aug 27 04:39:23.860199 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-50671e64-c70a-4e58-95b0-87c3b3aca550 req-a6c01b79-ad03-480c-8357-94840dfb3278 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074256 Aug 27 04:39:23.860913 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1049/2116] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:23.883249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-535b5e0d-c8d2-4117-8337-48f8f6ce7bb6 req-a68c83eb-6606-43e6-9e15-48b10f1316ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb73d85-d719-416d-8bab-d09b65578cc3", "name": "network-vif-deleted", "tag": "f1e9eb57-5c77-4f0f-a0e4-d0d7dd3ac084"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:23.903597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-22a657d5-c0b9-4f29-b11f-e68b08e0c263 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Action: 'update', calling method: .version_select at 0x7f1f214fe310>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:23.907677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a657d5-c0b9-4f29-b11f-e68b08e0c263 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:23.908495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a657d5-c0b9-4f29-b11f-e68b08e0c263 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:23.909150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a657d5-c0b9-4f29-b11f-e68b08e0c263 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:23.911540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-535b5e0d-c8d2-4117-8337-48f8f6ce7bb6 req-a68c83eb-6606-43e6-9e15-48b10f1316ab service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:23.912045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-535b5e0d-c8d2-4117-8337-48f8f6ce7bb6 req-a68c83eb-6606-43e6-9e15-48b10f1316ab service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:23.912498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-535b5e0d-c8d2-4117-8337-48f8f6ce7bb6 req-a68c83eb-6606-43e6-9e15-48b10f1316ab service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:23.919686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a657d5-c0b9-4f29-b11f-e68b08e0c263 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:23.920793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a657d5-c0b9-4f29-b11f-e68b08e0c263 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:23.921744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22a657d5-c0b9-4f29-b11f-e68b08e0c263 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:23.933878 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-22a657d5-c0b9-4f29-b11f-e68b08e0c263 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] HTTP exception thrown: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-22a657d5-c0b9-4f29-b11f-e68b08e0c263 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Request method failure captured: Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: request: PUT /compute/v2.1/os-services/8c88a077-d1b6-447c-8e3b-35cc4066a7a1 HTTP/1.1 Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 56 Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_65ByqTOHP5deqQ4-Q8YhFS2LaOB76vNhfgbYfezuufQJ5M1QomaTBMnfAKLLSgDs2e-ETFZNXz1b4d9GZCmIwrecl1R8TCxzB7uBZ-TUfPd_9bB031eJ11jFeMlFqnal6Gy-IG4D3Ex_GPwbAf9u96xiz0f1pnpJcykjNbDXHAto Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: f53b529d6cb545f1b2c202a2be43fa30 Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-765561188 Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f53b529d6cb545f1b2c202a2be43fa30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f53b529d6cb545f1b2c202a2be43fa30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f53b529d6cb545f1b2c202a2be43fa30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f53b529d6cb545f1b2c202a2be43fa30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-765561188 Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: f53b529d6cb545f1b2c202a2be43fa30 Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-765561188 Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 9f3eb6703a7247599202745d26927744 Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: exception: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '8c88a077-d1b6-447c-8e3b-35cc4066a7a1', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:39:23.936363 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:23.944235 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 04:39:23.944235 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:39:23.944235 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:23.944235 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:23.944235 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:23.944235 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:23.944235 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:23.944235 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:23.944235 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:23.944235 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:23.944235 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:23.944235 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:23.944235 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:23.947422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-22a657d5-c0b9-4f29-b11f-e68b08e0c263 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Returning 404 to user: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:23.948372 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-22a657d5-c0b9-4f29-b11f-e68b08e0c263 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-services/8c88a077-d1b6-447c-8e3b-35cc4066a7a1" status: 404 len: 110 microversion: 2.53 time: 0.278491 Aug 27 04:39:23.951536 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-535b5e0d-c8d2-4117-8337-48f8f6ce7bb6 req-a68c83eb-6606-43e6-9e15-48b10f1316ab service nova] Creating event network-vif-deleted:f1e9eb57-5c77-4f0f-a0e4-d0d7dd3ac084 for instance 3eb73d85-d719-416d-8bab-d09b65578cc3 on n-h1-854823-1 Aug 27 04:39:23.954048 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1068/2117] 10.222.0.79 () {62 vars in 1309 bytes} [Sat Aug 27 04:39:23 2022] PUT /compute/v2.1/os-services/8c88a077-d1b6-447c-8e3b-35cc4066a7a1 => generated 110 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:39:23.959814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ecce2ec-5931-4fad-9a31-e8c841b70a43 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Action: 'update', calling method: .version_select at 0x7f1f214fe0d0>, body: {"status": "disabled"} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:23.963378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ecce2ec-5931-4fad-9a31-e8c841b70a43 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:23.963871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ecce2ec-5931-4fad-9a31-e8c841b70a43 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:23.964319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ecce2ec-5931-4fad-9a31-e8c841b70a43 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:23.970673 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-535b5e0d-c8d2-4117-8337-48f8f6ce7bb6 req-a68c83eb-6606-43e6-9e15-48b10f1316ab service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107689 Aug 27 04:39:23.971360 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1050/2118] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:23.971708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ecce2ec-5931-4fad-9a31-e8c841b70a43 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:23.972217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ecce2ec-5931-4fad-9a31-e8c841b70a43 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:23.972681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ecce2ec-5931-4fad-9a31-e8c841b70a43 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:23.978981 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-1ecce2ec-5931-4fad-9a31-e8c841b70a43 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] HTTP exception thrown: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ecce2ec-5931-4fad-9a31-e8c841b70a43 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Request method failure captured: Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: request: PUT /compute/v2.1/os-services/8c88a077-d1b6-447c-8e3b-35cc4066a7a1 HTTP/1.1 Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 22 Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_65ByqTOHP5deqQ4-Q8YhFS2LaOB76vNhfgbYfezuufQJ5M1QomaTBMnfAKLLSgDs2e-ETFZNXz1b4d9GZCmIwrecl1R8TCxzB7uBZ-TUfPd_9bB031eJ11jFeMlFqnal6Gy-IG4D3Ex_GPwbAf9u96xiz0f1pnpJcykjNbDXHAto Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: f53b529d6cb545f1b2c202a2be43fa30 Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-765561188 Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f53b529d6cb545f1b2c202a2be43fa30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f53b529d6cb545f1b2c202a2be43fa30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f53b529d6cb545f1b2c202a2be43fa30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f53b529d6cb545f1b2c202a2be43fa30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-765561188 Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: f53b529d6cb545f1b2c202a2be43fa30 Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-765561188 Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 9f3eb6703a7247599202745d26927744 Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: {"status": "disabled"} Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: exception: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '8c88a077-d1b6-447c-8e3b-35cc4066a7a1', 'body': {'status': 'disabled'}} Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:39:23.981218 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ecce2ec-5931-4fad-9a31-e8c841b70a43 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Returning 404 to user: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:23.986872 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1ecce2ec-5931-4fad-9a31-e8c841b70a43 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-services/8c88a077-d1b6-447c-8e3b-35cc4066a7a1" status: 404 len: 110 microversion: 2.53 time: 0.027604 Aug 27 04:39:23.988851 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1069/2119] 10.222.0.79 () {62 vars in 1309 bytes} [Sat Aug 27 04:39:23 2022] PUT /compute/v2.1/os-services/8c88a077-d1b6-447c-8e3b-35cc4066a7a1 => generated 110 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:39:23.993082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53b026d2-771d-4f4c-9036-d897d97eb4ef tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Action: 'update', calling method: .version_select at 0x7f1f2117dc10>, body: {"status": "enabled"} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:24.012436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b026d2-771d-4f4c-9036-d897d97eb4ef tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.013007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b026d2-771d-4f4c-9036-d897d97eb4ef tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.013459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b026d2-771d-4f4c-9036-d897d97eb4ef tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.031986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b026d2-771d-4f4c-9036-d897d97eb4ef tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.032402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b026d2-771d-4f4c-9036-d897d97eb4ef tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.041516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b026d2-771d-4f4c-9036-d897d97eb4ef tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.055298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cbda9731-c72f-4283-a217-05ce4c117939 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:24.056025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cbda9731-c72f-4283-a217-05ce4c117939 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:24.059937 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-53b026d2-771d-4f4c-9036-d897d97eb4ef tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] HTTP exception thrown: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53b026d2-771d-4f4c-9036-d897d97eb4ef tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Request method failure captured: Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: request: PUT /compute/v2.1/os-services/8c88a077-d1b6-447c-8e3b-35cc4066a7a1 HTTP/1.1 Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 21 Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_65ByqTOHP5deqQ4-Q8YhFS2LaOB76vNhfgbYfezuufQJ5M1QomaTBMnfAKLLSgDs2e-ETFZNXz1b4d9GZCmIwrecl1R8TCxzB7uBZ-TUfPd_9bB031eJ11jFeMlFqnal6Gy-IG4D3Ex_GPwbAf9u96xiz0f1pnpJcykjNbDXHAto Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: f53b529d6cb545f1b2c202a2be43fa30 Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-765561188 Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f53b529d6cb545f1b2c202a2be43fa30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f53b529d6cb545f1b2c202a2be43fa30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f53b529d6cb545f1b2c202a2be43fa30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f53b529d6cb545f1b2c202a2be43fa30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-765561188 Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: f53b529d6cb545f1b2c202a2be43fa30 Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-765561188 Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 9f3eb6703a7247599202745d26927744 Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: {"status": "enabled"} Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: exception: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '8c88a077-d1b6-447c-8e3b-35cc4066a7a1', 'body': {'status': 'enabled'}} Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:39:24.074625 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:24.080325 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 04:39:24.080325 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:39:24.080325 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:24.080325 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.080325 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:24.080325 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.080325 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:24.080325 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:24.080325 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:24.080325 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:24.080325 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:24.080325 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. Aug 27 04:39:24.080325 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.081403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbda9731-c72f-4283-a217-05ce4c117939 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.081520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53b026d2-771d-4f4c-9036-d897d97eb4ef tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Returning 404 to user: Service 8c88a077-d1b6-447c-8e3b-35cc4066a7a1 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:24.081620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbda9731-c72f-4283-a217-05ce4c117939 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.081718 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-53b026d2-771d-4f4c-9036-d897d97eb4ef tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-services/8c88a077-d1b6-447c-8e3b-35cc4066a7a1" status: 404 len: 110 microversion: 2.53 time: 0.088254 Aug 27 04:39:24.081815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbda9731-c72f-4283-a217-05ce4c117939 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.081905 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1051/2120] 10.222.0.79 () {62 vars in 1309 bytes} [Sat Aug 27 04:39:23 2022] PUT /compute/v2.1/os-services/8c88a077-d1b6-447c-8e3b-35cc4066a7a1 => generated 110 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:39:24.084850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbda9731-c72f-4283-a217-05ce4c117939 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.085474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbda9731-c72f-4283-a217-05ce4c117939 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.086029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbda9731-c72f-4283-a217-05ce4c117939 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.093095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68900cb5-1f43-418f-83f4-a8bbb8f0d20d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:24.104015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68900cb5-1f43-418f-83f4-a8bbb8f0d20d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.104693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68900cb5-1f43-418f-83f4-a8bbb8f0d20d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.108068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68900cb5-1f43-418f-83f4-a8bbb8f0d20d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.108997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68900cb5-1f43-418f-83f4-a8bbb8f0d20d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.110239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68900cb5-1f43-418f-83f4-a8bbb8f0d20d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.110709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68900cb5-1f43-418f-83f4-a8bbb8f0d20d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.153604 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68900cb5-1f43-418f-83f4-a8bbb8f0d20d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.068315 Aug 27 04:39:24.155417 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1052/2121] 10.222.0.79 () {60 vars in 1178 bytes} [Sat Aug 27 04:39:24 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:24.168346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac19685e-54a8-4044-b0b0-f07953a1161c tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:24.172413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac19685e-54a8-4044-b0b0-f07953a1161c tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.173487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac19685e-54a8-4044-b0b0-f07953a1161c tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.174272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac19685e-54a8-4044-b0b0-f07953a1161c tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.175279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac19685e-54a8-4044-b0b0-f07953a1161c tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.175993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac19685e-54a8-4044-b0b0-f07953a1161c tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.176752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac19685e-54a8-4044-b0b0-f07953a1161c tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.207722 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac19685e-54a8-4044-b0b0-f07953a1161c tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.043203 Aug 27 04:39:24.217383 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1053/2122] 10.222.0.79 () {60 vars in 1211 bytes} [Sat Aug 27 04:39:24 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:39:24.222543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6ef1a08-aa65-430a-9730-893a85c244ab tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:24.226570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6ef1a08-aa65-430a-9730-893a85c244ab tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.227722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6ef1a08-aa65-430a-9730-893a85c244ab tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.228437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6ef1a08-aa65-430a-9730-893a85c244ab tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.229543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6ef1a08-aa65-430a-9730-893a85c244ab tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.230392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6ef1a08-aa65-430a-9730-893a85c244ab tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.231062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6ef1a08-aa65-430a-9730-893a85c244ab tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.262236 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6ef1a08-aa65-430a-9730-893a85c244ab tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.042712 Aug 27 04:39:24.271471 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1054/2123] 10.222.0.79 () {60 vars in 1178 bytes} [Sat Aug 27 04:39:24 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:24.276408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1fdfe42e-62e8-44e6-9ffc-b7e813a7960d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:24.281700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fdfe42e-62e8-44e6-9ffc-b7e813a7960d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.282586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fdfe42e-62e8-44e6-9ffc-b7e813a7960d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.283265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fdfe42e-62e8-44e6-9ffc-b7e813a7960d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.284271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fdfe42e-62e8-44e6-9ffc-b7e813a7960d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.284999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fdfe42e-62e8-44e6-9ffc-b7e813a7960d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.285663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fdfe42e-62e8-44e6-9ffc-b7e813a7960d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.313486 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1fdfe42e-62e8-44e6-9ffc-b7e813a7960d tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=n-d-854823-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.040770 Aug 27 04:39:24.324756 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1055/2124] 10.222.0.79 () {60 vars in 1235 bytes} [Sat Aug 27 04:39:24 2022] GET /compute/v2.1/os-services?host=n-d-854823-1&binary=xxx => generated 16 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:24.330920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-125c7afd-c7b8-499c-a11d-ba4fe0e349d1 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:24.336129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-125c7afd-c7b8-499c-a11d-ba4fe0e349d1 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.337028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-125c7afd-c7b8-499c-a11d-ba4fe0e349d1 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.337733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-125c7afd-c7b8-499c-a11d-ba4fe0e349d1 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.338912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-125c7afd-c7b8-499c-a11d-ba4fe0e349d1 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.340905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-125c7afd-c7b8-499c-a11d-ba4fe0e349d1 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.341772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-125c7afd-c7b8-499c-a11d-ba4fe0e349d1 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.372168 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-125c7afd-c7b8-499c-a11d-ba4fe0e349d1 tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.045214 Aug 27 04:39:24.381281 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1056/2125] 10.222.0.79 () {60 vars in 1178 bytes} [Sat Aug 27 04:39:24 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:24.387876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d11ef89a-8211-4f15-99ec-ad2c161e11e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:24.388979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d11ef89a-8211-4f15-99ec-ad2c161e11e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:24.396301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d11ef89a-8211-4f15-99ec-ad2c161e11e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.397234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d11ef89a-8211-4f15-99ec-ad2c161e11e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.398570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d11ef89a-8211-4f15-99ec-ad2c161e11e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.399566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d11ef89a-8211-4f15-99ec-ad2c161e11e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.400269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d11ef89a-8211-4f15-99ec-ad2c161e11e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.401360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d11ef89a-8211-4f15-99ec-ad2c161e11e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.618130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d11ef89a-8211-4f15-99ec-ad2c161e11e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:24.626990 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d11ef89a-8211-4f15-99ec-ad2c161e11e6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1316 microversion: 2.1 time: 0.244162 Aug 27 04:39:24.627894 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1057/2126] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:24 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:24.632639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5861cdc1-b7ca-4470-abd9-c8ea81f62bbf tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:24.636467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5861cdc1-b7ca-4470-abd9-c8ea81f62bbf tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.637715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5861cdc1-b7ca-4470-abd9-c8ea81f62bbf tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.638319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5861cdc1-b7ca-4470-abd9-c8ea81f62bbf tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.639224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5861cdc1-b7ca-4470-abd9-c8ea81f62bbf tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.639857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5861cdc1-b7ca-4470-abd9-c8ea81f62bbf tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.640462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5861cdc1-b7ca-4470-abd9-c8ea81f62bbf tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.652323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:24.671258 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5861cdc1-b7ca-4470-abd9-c8ea81f62bbf tempest-ServicesAdminNegativeV253TestJSON-765561188 tempest-ServicesAdminNegativeV253TestJSON-765561188-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.041886 Aug 27 04:39:24.672038 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1058/2127] 10.222.0.79 () {60 vars in 1239 bytes} [Sat Aug 27 04:39:24 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:24.843660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d229d969-89a2-4d40-b13b-ad54eb35bdf4 tempest-ServicesAdminNegativeV253TestJSON-555578439 tempest-ServicesAdminNegativeV253TestJSON-555578439-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:24.856806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d229d969-89a2-4d40-b13b-ad54eb35bdf4 tempest-ServicesAdminNegativeV253TestJSON-555578439 tempest-ServicesAdminNegativeV253TestJSON-555578439-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'f570a7af2df44b8da5324228ac5ffc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe61d93825041dc90494864328b17e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d229d969-89a2-4d40-b13b-ad54eb35bdf4 tempest-ServicesAdminNegativeV253TestJSON-555578439 tempest-ServicesAdminNegativeV253TestJSON-555578439-project] Request method failure captured: Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_5Gba3aiENX25Z6acTUs5fUPlSwiRG1lXjwXw5d0WtUnDyWoZEX3sabPfCDaK8-UvBTrwkzyoXfpD9KKUbnoe7iyl1fdm3ClxTPeohIp8xCM37BmHAXOWOb16EDNVxQxGxGGWr4ojhHoph_jgVnbNGMnBFE901lYh6q-psailjsEg Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: bfe61d93825041dc90494864328b17e1 Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-555578439 Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bfe61d93825041dc90494864328b17e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bfe61d93825041dc90494864328b17e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bfe61d93825041dc90494864328b17e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bfe61d93825041dc90494864328b17e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-555578439 Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: bfe61d93825041dc90494864328b17e1 Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-555578439 Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServicesAdminNegativeV253TestJSON-555578439-project Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: f570a7af2df44b8da5324228ac5ffc13 Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-555578439-project Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: action_args: {} Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 04:39:24.863980 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 04:39:24.870621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.870621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:24.870621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.870621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:24.870621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:24.870621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:24.870621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 04:39:24.870621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 04:39:24.870621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 04:39:24.870621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.870621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d229d969-89a2-4d40-b13b-ad54eb35bdf4 tempest-ServicesAdminNegativeV253TestJSON-555578439 tempest-ServicesAdminNegativeV253TestJSON-555578439-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:24.870621 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d229d969-89a2-4d40-b13b-ad54eb35bdf4 tempest-ServicesAdminNegativeV253TestJSON-555578439 tempest-ServicesAdminNegativeV253TestJSON-555578439-project] 10.222.0.79 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.186926 Aug 27 04:39:24.878210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cbda9731-c72f-4283-a217-05ce4c117939 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:24.882012 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1059/2128] 10.222.0.79 () {60 vars in 1178 bytes} [Sat Aug 27 04:39:24 2022] GET /compute/v2.1/os-services => generated 112 bytes in 201 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:39:24.906290 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cbda9731-c72f-4283-a217-05ce4c117939 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1315 microversion: 2.1 time: 0.854672 Aug 27 04:39:24.911373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a9fb113-91f3-4cde-be72-3063ca95439a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:24.912003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a9fb113-91f3-4cde-be72-3063ca95439a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] [instance: 3eb73d85-d719-416d-8bab-d09b65578cc3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:24.921132 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1070/2129] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:24 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1315 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:24.927118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5694de5a-adfc-452d-aec8-009bba9b7fc4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:24.928173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a9fb113-91f3-4cde-be72-3063ca95439a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.929053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a9fb113-91f3-4cde-be72-3063ca95439a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.929513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a9fb113-91f3-4cde-be72-3063ca95439a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.929903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5694de5a-adfc-452d-aec8-009bba9b7fc4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:24.930271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a9fb113-91f3-4cde-be72-3063ca95439a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.930745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a9fb113-91f3-4cde-be72-3063ca95439a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.931181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a9fb113-91f3-4cde-be72-3063ca95439a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.944864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5694de5a-adfc-452d-aec8-009bba9b7fc4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.947919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5694de5a-adfc-452d-aec8-009bba9b7fc4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.949280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5694de5a-adfc-452d-aec8-009bba9b7fc4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.951485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5694de5a-adfc-452d-aec8-009bba9b7fc4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:24.952519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5694de5a-adfc-452d-aec8-009bba9b7fc4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:24.953249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5694de5a-adfc-452d-aec8-009bba9b7fc4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:24.977595 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9a9fb113-91f3-4cde-be72-3063ca95439a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] HTTP exception thrown: Instance 3eb73d85-d719-416d-8bab-d09b65578cc3 could not be found. Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a9fb113-91f3-4cde-be72-3063ca95439a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Request method failure captured: Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 HTTP/1.1 Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_TXSymITzU64J8HCz11IlHIW9Desy_A7r0SSaehGOD6VCb4oJx9URTK7U5NJDMeCp-65SKc_MD9cxxLLQF_S8N8jbbPjVnsAsgNLSyrMRtGYAro9f-2brEfxDItqjMSjVipxFBYuMEOdKlMWvyw8UaTLJ4kNU7zQV2aIW_MUvgpLA Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.26 Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 73673b6b989d49a5b11295612a21b6dd Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerTagsTestJSON-1221514684 Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73673b6b989d49a5b11295612a21b6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_73673b6b989d49a5b11295612a21b6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/73673b6b989d49a5b11295612a21b6dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73673b6b989d49a5b11295612a21b6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerTagsTestJSON-1221514684 Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 73673b6b989d49a5b11295612a21b6dd Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerTagsTestJSON-1221514684 Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerTagsTestJSON-1221514684-project Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 9b03e4d8bd784c1390a598fb4189dc0d Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerTagsTestJSON-1221514684-project Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 3eb73d85-d719-416d-8bab-d09b65578cc3 could not be found. Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '3eb73d85-d719-416d-8bab-d09b65578cc3'} Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb73d85-d719-416d-8bab-d09b65578cc3 could not be found. Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb73d85-d719-416d-8bab-d09b65578cc3 could not be found. Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:24.989884 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.995407 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:24.995407 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:24.995407 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:24.995407 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:24.995407 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:24.995407 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb73d85-d719-416d-8bab-d09b65578cc3 could not be found. Aug 27 04:39:24.995407 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:24.999461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a9fb113-91f3-4cde-be72-3063ca95439a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] Returning 404 to user: Instance 3eb73d85-d719-416d-8bab-d09b65578cc3 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:25.001164 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a9fb113-91f3-4cde-be72-3063ca95439a tempest-ServerTagsTestJSON-1221514684 tempest-ServerTagsTestJSON-1221514684-project] 10.222.0.79 "GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3" status: 404 len: 111 microversion: 2.26 time: 0.116929 Aug 27 04:39:25.001967 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1060/2130] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:24 2022] GET /compute/v2.1/servers/3eb73d85-d719-416d-8bab-d09b65578cc3 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:39:25.349938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=18 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:25.424110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9c83109b-48cd-400e-9f1c-98d797961550 req-f3d0199a-9917-4c5f-ac8b-5e3483d300a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33688238-9f13-4f5a-b81c-b01f3fbcaebf", "tag": "24c5fda3-094d-4a40-8063-0a5f386b3f06"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:25.446219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9c83109b-48cd-400e-9f1c-98d797961550 req-f3d0199a-9917-4c5f-ac8b-5e3483d300a1 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:25.454343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9c83109b-48cd-400e-9f1c-98d797961550 req-f3d0199a-9917-4c5f-ac8b-5e3483d300a1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:25.456332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9c83109b-48cd-400e-9f1c-98d797961550 req-f3d0199a-9917-4c5f-ac8b-5e3483d300a1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:25.503995 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9c83109b-48cd-400e-9f1c-98d797961550 req-f3d0199a-9917-4c5f-ac8b-5e3483d300a1 service nova] Creating event network-changed:24c5fda3-094d-4a40-8063-0a5f386b3f06 for instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf on n-h2-854823-1 Aug 27 04:39:25.517252 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9c83109b-48cd-400e-9f1c-98d797961550 req-f3d0199a-9917-4c5f-ac8b-5e3483d300a1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098408 Aug 27 04:39:25.520981 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1061/2131] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:25.651881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e0deff2a-bd07-4a4b-8cab-6b2e8a016855 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:25.653315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e0deff2a-bd07-4a4b-8cab-6b2e8a016855 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:25.670555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0deff2a-bd07-4a4b-8cab-6b2e8a016855 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:25.671102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0deff2a-bd07-4a4b-8cab-6b2e8a016855 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:25.671548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0deff2a-bd07-4a4b-8cab-6b2e8a016855 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:25.672279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0deff2a-bd07-4a4b-8cab-6b2e8a016855 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:25.675919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0deff2a-bd07-4a4b-8cab-6b2e8a016855 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:25.676443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0deff2a-bd07-4a4b-8cab-6b2e8a016855 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:25.822163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5694de5a-adfc-452d-aec8-009bba9b7fc4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:25.833061 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5694de5a-adfc-452d-aec8-009bba9b7fc4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1317 microversion: 2.1 time: 0.910433 Aug 27 04:39:25.833649 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1071/2132] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:24 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1317 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:25.927502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2fd66320-8c91-477f-a069-0c87496a3b5f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:25.928625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2fd66320-8c91-477f-a069-0c87496a3b5f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:25.939296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fd66320-8c91-477f-a069-0c87496a3b5f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:25.940058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fd66320-8c91-477f-a069-0c87496a3b5f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:25.940689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fd66320-8c91-477f-a069-0c87496a3b5f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:25.943677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fd66320-8c91-477f-a069-0c87496a3b5f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:25.944328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fd66320-8c91-477f-a069-0c87496a3b5f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:25.950893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fd66320-8c91-477f-a069-0c87496a3b5f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:26.194580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e0deff2a-bd07-4a4b-8cab-6b2e8a016855 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:26.209498 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e0deff2a-bd07-4a4b-8cab-6b2e8a016855 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1316 microversion: 2.1 time: 0.559445 Aug 27 04:39:26.230176 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1062/2133] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:25 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1316 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:26.376858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2fd66320-8c91-477f-a069-0c87496a3b5f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:26.393145 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2fd66320-8c91-477f-a069-0c87496a3b5f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1501 microversion: 2.1 time: 0.468733 Aug 27 04:39:26.393761 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1072/2134] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:25 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1501 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:26.649884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d1c816f-38dd-4cca-8715-2d594149c397 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Action: 'create', calling method: .version_select at 0x7f1f211723a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1559200088", "description": "tempest-description-1277550970"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:26.859957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d9184d72-c010-434a-9296-b99c2125d8a1 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:26.861065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d9184d72-c010-434a-9296-b99c2125d8a1 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:26.888387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9184d72-c010-434a-9296-b99c2125d8a1 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:26.890047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9184d72-c010-434a-9296-b99c2125d8a1 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:26.893659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9184d72-c010-434a-9296-b99c2125d8a1 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:26.895632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9184d72-c010-434a-9296-b99c2125d8a1 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:26.904203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9184d72-c010-434a-9296-b99c2125d8a1 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:26.908032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9184d72-c010-434a-9296-b99c2125d8a1 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:27.457921 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d1c816f-38dd-4cca-8715-2d594149c397 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.149229 Aug 27 04:39:27.459259 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1063/2135] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:39:26 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:27.464236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14917c09-b75c-41ef-a273-6a1f2f99355a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:27.465350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14917c09-b75c-41ef-a273-6a1f2f99355a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:27.480119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14917c09-b75c-41ef-a273-6a1f2f99355a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:27.484282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14917c09-b75c-41ef-a273-6a1f2f99355a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:27.485173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14917c09-b75c-41ef-a273-6a1f2f99355a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:27.486276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14917c09-b75c-41ef-a273-6a1f2f99355a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:27.486909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14917c09-b75c-41ef-a273-6a1f2f99355a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:27.488330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14917c09-b75c-41ef-a273-6a1f2f99355a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:27.666923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d9184d72-c010-434a-9296-b99c2125d8a1 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:27.688155 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d9184d72-c010-434a-9296-b99c2125d8a1 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1317 microversion: 2.1 time: 0.824083 Aug 27 04:39:27.689208 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1073/2136] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:26 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1317 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:27.705324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8bf447e9-5783-46db-bc74-b75b86dc73d3 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Action: 'create', calling method: .version_select at 0x7f1f2135ff70>, body: {"security_group_rule": {"parent_group_id": "b735584b-32ef-4d3a-9fd7-8c6dd8d52252", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:27.952069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14917c09-b75c-41ef-a273-6a1f2f99355a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:27.973589 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14917c09-b75c-41ef-a273-6a1f2f99355a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1316 microversion: 2.1 time: 0.506685 Aug 27 04:39:27.991364 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1064/2137] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:27 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:28.001139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-91be774d-6e0f-494b-bfaf-8df68c486d89 req-a112171a-c231-4f51-800a-419a238e4ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39575026-a753-4c15-ba36-59029811826f", "tag": "e868a365-84b1-4305-9f13-56da941f9db8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:28.020692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-91be774d-6e0f-494b-bfaf-8df68c486d89 req-a112171a-c231-4f51-800a-419a238e4ce7 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:28.021843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-91be774d-6e0f-494b-bfaf-8df68c486d89 req-a112171a-c231-4f51-800a-419a238e4ce7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:28.022503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-91be774d-6e0f-494b-bfaf-8df68c486d89 req-a112171a-c231-4f51-800a-419a238e4ce7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:28.040039 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-91be774d-6e0f-494b-bfaf-8df68c486d89 req-a112171a-c231-4f51-800a-419a238e4ce7 service nova] Creating event network-changed:e868a365-84b1-4305-9f13-56da941f9db8 for instance 39575026-a753-4c15-ba36-59029811826f on n-h2-854823-1 Aug 27 04:39:28.050668 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-91be774d-6e0f-494b-bfaf-8df68c486d89 req-a112171a-c231-4f51-800a-419a238e4ce7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057348 Aug 27 04:39:28.052054 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1065/2138] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:28.531005 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8bf447e9-5783-46db-bc74-b75b86dc73d3 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.840632 Aug 27 04:39:28.533136 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1074/2139] 10.222.0.79 () {60 vars in 1195 bytes} [Sat Aug 27 04:39:27 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:28.548078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86d797e6-fb18-45bb-917d-469588518caf tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Action: 'create', calling method: .version_select at 0x7f1f20fb8a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1080544861", "description": "tempest-description-518007072"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:28.711736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7bb25d90-63d8-4032-96a7-3e689431f155 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:28.712923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7bb25d90-63d8-4032-96a7-3e689431f155 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:28.725651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bb25d90-63d8-4032-96a7-3e689431f155 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:28.726068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bb25d90-63d8-4032-96a7-3e689431f155 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:28.726515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bb25d90-63d8-4032-96a7-3e689431f155 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:28.727240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bb25d90-63d8-4032-96a7-3e689431f155 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:28.727699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bb25d90-63d8-4032-96a7-3e689431f155 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:28.734761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bb25d90-63d8-4032-96a7-3e689431f155 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:29.278673 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86d797e6-fb18-45bb-917d-469588518caf tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.735446 Aug 27 04:39:29.287035 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1066/2140] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:39:28 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:29.292972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a3056fc-c77c-459d-a87d-5b79696509bc tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:29.293728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a3056fc-c77c-459d-a87d-5b79696509bc tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:29.318505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a3056fc-c77c-459d-a87d-5b79696509bc tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:29.320473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a3056fc-c77c-459d-a87d-5b79696509bc tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:29.320970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a3056fc-c77c-459d-a87d-5b79696509bc tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:29.321730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a3056fc-c77c-459d-a87d-5b79696509bc tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:29.322195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a3056fc-c77c-459d-a87d-5b79696509bc tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:29.322624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a3056fc-c77c-459d-a87d-5b79696509bc tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:29.339240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7bb25d90-63d8-4032-96a7-3e689431f155 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:29.352371 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7bb25d90-63d8-4032-96a7-3e689431f155 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1317 microversion: 2.1 time: 0.646527 Aug 27 04:39:29.365423 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1075/2141] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:28 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:29.371712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-381561d3-02dc-404e-9323-c7e3d818b570 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Action: 'create', calling method: .version_select at 0x7f1f213dd8b0>, body: {"security_group_rule": {"parent_group_id": "28ce72e6-36b2-4080-96f7-f4a560523996", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:29.863525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a3056fc-c77c-459d-a87d-5b79696509bc tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:29.879509 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a3056fc-c77c-459d-a87d-5b79696509bc tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1316 microversion: 2.1 time: 0.591270 Aug 27 04:39:29.882026 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1067/2142] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:29 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:29.893286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0862f39c-3341-4748-870d-a6bc382d1d53 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f541a88-7da8-4157-8809-f3bbd38b6cb8"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:29.905914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0862f39c-3341-4748-870d-a6bc382d1d53 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:29.915095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0862f39c-3341-4748-870d-a6bc382d1d53 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:29.919922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0862f39c-3341-4748-870d-a6bc382d1d53 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:29.920425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0862f39c-3341-4748-870d-a6bc382d1d53 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:29.921724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0862f39c-3341-4748-870d-a6bc382d1d53 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:29.944572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0862f39c-3341-4748-870d-a6bc382d1d53 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:29.945391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0862f39c-3341-4748-870d-a6bc382d1d53 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:30.406680 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-381561d3-02dc-404e-9323-c7e3d818b570 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.039304 Aug 27 04:39:30.407309 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1076/2143] 10.222.0.79 () {60 vars in 1195 bytes} [Sat Aug 27 04:39:29 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:30.412542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a3dfbc29-2ed7-41ce-b751-92a156ffa11a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:30.413183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a3dfbc29-2ed7-41ce-b751-92a156ffa11a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:30.439188 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0862f39c-3341-4748-870d-a6bc382d1d53 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "POST /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547614 Aug 27 04:39:30.439887 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1068/2144] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 04:39:29 2022] POST /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060/os-volume_attachments => generated 194 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:30.443986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3dfbc29-2ed7-41ce-b751-92a156ffa11a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:30.447731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3dfbc29-2ed7-41ce-b751-92a156ffa11a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:30.456894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3dfbc29-2ed7-41ce-b751-92a156ffa11a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:30.457824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3dfbc29-2ed7-41ce-b751-92a156ffa11a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:30.458309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3dfbc29-2ed7-41ce-b751-92a156ffa11a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:30.458902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3dfbc29-2ed7-41ce-b751-92a156ffa11a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:30.465266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a77aec0-e433-49c5-842c-94ac009b1b81 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Action: 'create', calling method: .version_select at 0x7f1f20fb8670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1809579206", "description": "tempest-description-1003704378"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:30.836741 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a77aec0-e433-49c5-842c-94ac009b1b81 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.395298 Aug 27 04:39:30.837679 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1069/2145] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:39:30 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:30.850844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3cf22351-34a1-4db2-ade9-3e1ce93c3249 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Action: 'create', calling method: .version_select at 0x7f1f211a9a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-853891419", "description": "tempest-description-1223715856"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:31.216117 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3cf22351-34a1-4db2-ade9-3e1ce93c3249 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.369850 Aug 27 04:39:31.216846 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1070/2146] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:39:30 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:39:31.222674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7fd6fcc4-dd41-48ad-98fc-dc305ff6bb5e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:31.224303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7fd6fcc4-dd41-48ad-98fc-dc305ff6bb5e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:31.265436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd6fcc4-dd41-48ad-98fc-dc305ff6bb5e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:31.266777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd6fcc4-dd41-48ad-98fc-dc305ff6bb5e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:31.267323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd6fcc4-dd41-48ad-98fc-dc305ff6bb5e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:31.269544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd6fcc4-dd41-48ad-98fc-dc305ff6bb5e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:31.270255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd6fcc4-dd41-48ad-98fc-dc305ff6bb5e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:31.271294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd6fcc4-dd41-48ad-98fc-dc305ff6bb5e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:31.627415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7fd6fcc4-dd41-48ad-98fc-dc305ff6bb5e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:31.646727 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7fd6fcc4-dd41-48ad-98fc-dc305ff6bb5e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1316 microversion: 2.1 time: 0.427748 Aug 27 04:39:31.651256 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1071/2147] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:31 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:31.659903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45216a31-891d-4c35-b6df-c2d0a9bb30bf tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Action: 'create', calling method: .version_select at 0x7f1f211b2280>, body: {"security_group_rule": {"parent_group_id": "397e416e-4178-4266-a2a9-b79e92a2c494", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "087a79a3-e46d-4bd6-b962-317b9a319244"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:32.280280 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45216a31-891d-4c35-b6df-c2d0a9bb30bf tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.626874 Aug 27 04:39:32.281510 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1072/2148] 10.222.0.79 () {60 vars in 1195 bytes} [Sat Aug 27 04:39:31 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:32.296868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f458adaf-249d-4579-96f7-87a28c83940c tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Action: 'create', calling method: .version_select at 0x7f1f2115f700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-149396648", "description": "tempest-description-1342242493"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:32.575943 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f458adaf-249d-4579-96f7-87a28c83940c tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.283794 Aug 27 04:39:32.583419 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1073/2149] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:39:32 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:39:32.719937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a3dfbc29-2ed7-41ce-b751-92a156ffa11a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:32.726265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-911933704", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:32.745115 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a3dfbc29-2ed7-41ce-b751-92a156ffa11a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1317 microversion: 2.1 time: 2.336299 Aug 27 04:39:32.747473 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1077/2150] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:30 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1317 bytes in 2339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:32.762634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6fec0999-ea3d-47c6-9da6-6100f5af2159 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Action: 'create', calling method: .version_select at 0x7f1f2130c160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1977099193", "description": "tempest-description-1787964656"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:32.854913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:39:33.185643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:39:33.186076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:39:33.186564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:39:33.186986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:39:33.187401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:39:33.209522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:33.210755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:33.211843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:33.213207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:33.214008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:33.214932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:33.278289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:33.287220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Getting quotas for project 8dad6db2d7fc4c0eb26ce4e6e6806aa7. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:39:33.300254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Getting quotas for user ebad0656b90f4d6fa0d76d7210462c88 and project 8dad6db2d7fc4c0eb26ce4e6e6806aa7. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:39:33.331790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:39:33.335708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:39:33.414772 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6a9749c-0fdf-4c34-a9a5-bcc4fbf0163a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829311 Aug 27 04:39:33.415758 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1074/2151] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:39:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:39:33.423929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60fa1539-6467-40ee-9de9-eb28f3c877b2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:33.425006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60fa1539-6467-40ee-9de9-eb28f3c877b2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:33.437304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60fa1539-6467-40ee-9de9-eb28f3c877b2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:33.453221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60fa1539-6467-40ee-9de9-eb28f3c877b2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:33.453695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60fa1539-6467-40ee-9de9-eb28f3c877b2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:33.455101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60fa1539-6467-40ee-9de9-eb28f3c877b2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:33.455800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60fa1539-6467-40ee-9de9-eb28f3c877b2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:33.456193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60fa1539-6467-40ee-9de9-eb28f3c877b2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:33.475479 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6fec0999-ea3d-47c6-9da6-6100f5af2159 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.726846 Aug 27 04:39:33.476582 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1078/2152] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:39:32 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:33.482601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9f06c64c-2bc7-4448-8511-c6fc8acbcc30 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:33.483605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9f06c64c-2bc7-4448-8511-c6fc8acbcc30 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:33.694164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60fa1539-6467-40ee-9de9-eb28f3c877b2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:33.718459 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60fa1539-6467-40ee-9de9-eb28f3c877b2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1316 microversion: 2.1 time: 0.301030 Aug 27 04:39:33.719419 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1075/2153] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:33 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:33.728549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c8afdbc-71b4-4fc8-9ee1-353eb9bfbab4 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Action: 'create', calling method: .version_select at 0x7f1f2115ff70>, body: {"security_group_rule": {"parent_group_id": "9ab2bd1d-bde9-4a5a-a237-8d89137ffaab", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7ed52226-0624-4aa4-b147-6fcf24bb0d6b"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:33.782372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9f06c64c-2bc7-4448-8511-c6fc8acbcc30 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:33.809256 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9f06c64c-2bc7-4448-8511-c6fc8acbcc30 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1213 microversion: 2.1 time: 0.329644 Aug 27 04:39:33.810951 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1079/2154] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:33 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1213 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:33.817995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c8c1ac54-c571-40ec-bc07-2c39434c63c2 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:33.819496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c8c1ac54-c571-40ec-bc07-2c39434c63c2 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:33.827423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8c1ac54-c571-40ec-bc07-2c39434c63c2 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:33.828311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8c1ac54-c571-40ec-bc07-2c39434c63c2 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:33.829565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8c1ac54-c571-40ec-bc07-2c39434c63c2 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:33.830586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8c1ac54-c571-40ec-bc07-2c39434c63c2 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:33.832172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8c1ac54-c571-40ec-bc07-2c39434c63c2 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:33.836942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8c1ac54-c571-40ec-bc07-2c39434c63c2 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:33.971525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:34.307359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c8c1ac54-c571-40ec-bc07-2c39434c63c2 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:34.326070 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c8c1ac54-c571-40ec-bc07-2c39434c63c2 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1317 microversion: 2.1 time: 0.509248 Aug 27 04:39:34.332434 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1080/2155] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:33 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:34.434353 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7c8afdbc-71b4-4fc8-9ee1-353eb9bfbab4 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.713289 Aug 27 04:39:34.439462 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1076/2156] 10.222.0.79 () {60 vars in 1195 bytes} [Sat Aug 27 04:39:33 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:34.451573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b76ff2bd-8a2b-45b2-9c8e-e629cb0ff9b7 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Calling method '.version_select at 0x7f1f213a85e0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:34.739858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ed865a4-7b8c-4bfe-805a-e17926809034 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:34.740406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ed865a4-7b8c-4bfe-805a-e17926809034 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:34.752053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed865a4-7b8c-4bfe-805a-e17926809034 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:34.752928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed865a4-7b8c-4bfe-805a-e17926809034 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:34.753582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed865a4-7b8c-4bfe-805a-e17926809034 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:34.758568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed865a4-7b8c-4bfe-805a-e17926809034 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:34.759334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed865a4-7b8c-4bfe-805a-e17926809034 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:34.760198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed865a4-7b8c-4bfe-805a-e17926809034 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:35.031117 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b76ff2bd-8a2b-45b2-9c8e-e629cb0ff9b7 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/7ed52226-0624-4aa4-b147-6fcf24bb0d6b" status: 202 len: 0 microversion: 2.1 time: 0.583832 Aug 27 04:39:35.032149 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1081/2157] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:39:34 2022] DELETE /compute/v2.1/os-security-groups/7ed52226-0624-4aa4-b147-6fcf24bb0d6b => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:35.037417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-17be9ea7-60ae-4456-8ddd-8af006c1dca1 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:35.038315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-17be9ea7-60ae-4456-8ddd-8af006c1dca1 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:35.051694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17be9ea7-60ae-4456-8ddd-8af006c1dca1 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:35.055074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17be9ea7-60ae-4456-8ddd-8af006c1dca1 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:35.055717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17be9ea7-60ae-4456-8ddd-8af006c1dca1 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:35.060487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17be9ea7-60ae-4456-8ddd-8af006c1dca1 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:35.061202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17be9ea7-60ae-4456-8ddd-8af006c1dca1 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:35.061841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17be9ea7-60ae-4456-8ddd-8af006c1dca1 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:35.139644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ed865a4-7b8c-4bfe-805a-e17926809034 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:35.155442 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ed865a4-7b8c-4bfe-805a-e17926809034 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1316 microversion: 2.1 time: 0.413639 Aug 27 04:39:35.156792 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1077/2158] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:34 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:35.165139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f65d60d1-f1a4-4c45-bf8f-0769f20045db tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Calling method '.version_select at 0x7f1f2115f550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:35.226153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-17be9ea7-60ae-4456-8ddd-8af006c1dca1 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:35.243141 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-17be9ea7-60ae-4456-8ddd-8af006c1dca1 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1265 microversion: 2.1 time: 0.209552 Aug 27 04:39:35.248286 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1082/2159] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:35 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:35.355063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-824219e4-f90c-40c3-a722-eed3a2dac828 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:35.356593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-824219e4-f90c-40c3-a722-eed3a2dac828 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:35.365807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-824219e4-f90c-40c3-a722-eed3a2dac828 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:35.371850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-824219e4-f90c-40c3-a722-eed3a2dac828 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:35.372695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-824219e4-f90c-40c3-a722-eed3a2dac828 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:35.373777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-824219e4-f90c-40c3-a722-eed3a2dac828 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:35.375997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-824219e4-f90c-40c3-a722-eed3a2dac828 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:35.376710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-824219e4-f90c-40c3-a722-eed3a2dac828 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:35.685201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-824219e4-f90c-40c3-a722-eed3a2dac828 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:35.697475 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-824219e4-f90c-40c3-a722-eed3a2dac828 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1317 microversion: 2.1 time: 0.347040 Aug 27 04:39:35.702628 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1083/2160] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:35 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:35.715260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-12f926a7-7ad3-44ef-94a6-9e11614877c6 req-9bee1f1e-8f51-4144-8f17-e32bbb74912b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39575026-a753-4c15-ba36-59029811826f", "name": "network-vif-plugged", "status": "completed", "tag": "e868a365-84b1-4305-9f13-56da941f9db8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:35.741218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-12f926a7-7ad3-44ef-94a6-9e11614877c6 req-9bee1f1e-8f51-4144-8f17-e32bbb74912b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:35.743132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-12f926a7-7ad3-44ef-94a6-9e11614877c6 req-9bee1f1e-8f51-4144-8f17-e32bbb74912b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:35.745309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-12f926a7-7ad3-44ef-94a6-9e11614877c6 req-9bee1f1e-8f51-4144-8f17-e32bbb74912b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:35.756414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:35.781672 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-12f926a7-7ad3-44ef-94a6-9e11614877c6 req-9bee1f1e-8f51-4144-8f17-e32bbb74912b service nova] Creating event network-vif-plugged:e868a365-84b1-4305-9f13-56da941f9db8 for instance 39575026-a753-4c15-ba36-59029811826f on n-h2-854823-1 Aug 27 04:39:35.796963 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-12f926a7-7ad3-44ef-94a6-9e11614877c6 req-9bee1f1e-8f51-4144-8f17-e32bbb74912b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091379 Aug 27 04:39:35.797928 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1084/2161] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:35.893772 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f65d60d1-f1a4-4c45-bf8f-0769f20045db tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/9ab2bd1d-bde9-4a5a-a237-8d89137ffaab" status: 200 len: 247 microversion: 2.1 time: 0.735288 Aug 27 04:39:35.895124 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1078/2162] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 04:39:35 2022] GET /compute/v2.1/os-security-groups/9ab2bd1d-bde9-4a5a-a237-8d89137ffaab => generated 247 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:35.915122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cec1371b-57e0-4096-9ecb-8d12a4e75247 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Action: 'create', calling method: .version_select at 0x7f1f213ab790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-857880630", "description": "tempest-description-1081109152"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:36.177823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d7496dc-5b73-4b0e-8708-b2dcb40dd8d2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:36.178688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1d7496dc-5b73-4b0e-8708-b2dcb40dd8d2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:36.187816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d7496dc-5b73-4b0e-8708-b2dcb40dd8d2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:36.191139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d7496dc-5b73-4b0e-8708-b2dcb40dd8d2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:36.191849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d7496dc-5b73-4b0e-8708-b2dcb40dd8d2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:36.194250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d7496dc-5b73-4b0e-8708-b2dcb40dd8d2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:36.195021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d7496dc-5b73-4b0e-8708-b2dcb40dd8d2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:36.199667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d7496dc-5b73-4b0e-8708-b2dcb40dd8d2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:36.509966 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cec1371b-57e0-4096-9ecb-8d12a4e75247 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.601910 Aug 27 04:39:36.510560 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1085/2163] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:39:35 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:39:36.523523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99c01bca-1595-4efc-a535-b6ca09a2983e tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:36.524289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-99c01bca-1595-4efc-a535-b6ca09a2983e tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:36.526760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:36.551576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99c01bca-1595-4efc-a535-b6ca09a2983e tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:36.552991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99c01bca-1595-4efc-a535-b6ca09a2983e tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:36.553792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99c01bca-1595-4efc-a535-b6ca09a2983e tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:36.555273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99c01bca-1595-4efc-a535-b6ca09a2983e tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:36.556106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99c01bca-1595-4efc-a535-b6ca09a2983e tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:36.556821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99c01bca-1595-4efc-a535-b6ca09a2983e tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:36.638284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1d7496dc-5b73-4b0e-8708-b2dcb40dd8d2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:36.673910 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d7496dc-5b73-4b0e-8708-b2dcb40dd8d2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1316 microversion: 2.1 time: 0.496072 Aug 27 04:39:36.677573 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1079/2164] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:36 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:36.713904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d5371a9-8b73-423c-8eaa-278ddae37443 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Action: 'create', calling method: .version_select at 0x7f1f2115f700>, body: {"security_group_rule": {"parent_group_id": "630dd0f1-5af7-4033-96d7-bc3131865979", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:36.752136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-99c01bca-1595-4efc-a535-b6ca09a2983e tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:36.769233 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-99c01bca-1595-4efc-a535-b6ca09a2983e tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1271 microversion: 2.1 time: 0.257511 Aug 27 04:39:36.772007 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1086/2165] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:36 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1271 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:36.787258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-49e58583-2346-491b-9b8d-ce541592868c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:36.791364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-49e58583-2346-491b-9b8d-ce541592868c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:36.809451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49e58583-2346-491b-9b8d-ce541592868c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:36.810614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49e58583-2346-491b-9b8d-ce541592868c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:36.811881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49e58583-2346-491b-9b8d-ce541592868c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:36.815139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49e58583-2346-491b-9b8d-ce541592868c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:36.816023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49e58583-2346-491b-9b8d-ce541592868c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:36.818501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49e58583-2346-491b-9b8d-ce541592868c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:37.126389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-49e58583-2346-491b-9b8d-ce541592868c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:37.135744 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-49e58583-2346-491b-9b8d-ce541592868c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1317 microversion: 2.1 time: 0.362033 Aug 27 04:39:37.149378 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1087/2166] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:36 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:37.155880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1491249038", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f6f5b09f-74c4-46ac-874b-9207e349b51e"}], "block_device_mapping_v2": [{"uuid": "6cd4638c-4d54-423f-94bd-54abb35d7af5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:37.274380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] validate_networks() for [('f6f5b09f-74c4-46ac-874b-9207e349b51e', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:39:37.505107 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d5371a9-8b73-423c-8eaa-278ddae37443 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.820267 Aug 27 04:39:37.517384 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1080/2167] 10.222.0.79 () {60 vars in 1195 bytes} [Sat Aug 27 04:39:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:37.523911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98b25666-3a54-423b-8233-ea5ee6fd3e3c tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Action: 'create', calling method: .version_select at 0x7f1f21088dc0>, body: {"security_group_rule": {"parent_group_id": "630dd0f1-5af7-4033-96d7-bc3131865979", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:37.897577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:39:37.898994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:39:37.901077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:39:37.901800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:39:37.902799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:39:37.922935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:37.923976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:37.924444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:37.925493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:37.927330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:37.927985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:37.963715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Getting quotas for project 002ba94e9b364c3e8784927de5770ed1. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:39:37.972798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Getting quotas for user 1d3d23499c474adaa7fe3a2260f5ec36 and project 002ba94e9b364c3e8784927de5770ed1. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:39:37.981717 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98b25666-3a54-423b-8233-ea5ee6fd3e3c tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.462824 Aug 27 04:39:37.982549 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1081/2168] 10.222.0.79 () {60 vars in 1195 bytes} [Sat Aug 27 04:39:37 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:37.994589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f205a4fd-1b2f-4bc4-aeda-dd4ead0e865e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:37.997757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f205a4fd-1b2f-4bc4-aeda-dd4ead0e865e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:38.022009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f205a4fd-1b2f-4bc4-aeda-dd4ead0e865e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:38.022516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f205a4fd-1b2f-4bc4-aeda-dd4ead0e865e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:38.023162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f205a4fd-1b2f-4bc4-aeda-dd4ead0e865e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:38.023953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f205a4fd-1b2f-4bc4-aeda-dd4ead0e865e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:38.024366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f205a4fd-1b2f-4bc4-aeda-dd4ead0e865e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:38.024818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f205a4fd-1b2f-4bc4-aeda-dd4ead0e865e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:38.085974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:39:38.088882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6cd4638c-4d54-423f-94bd-54abb35d7af5',volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:39:38.430868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f205a4fd-1b2f-4bc4-aeda-dd4ead0e865e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:38.442348 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f205a4fd-1b2f-4bc4-aeda-dd4ead0e865e tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1316 microversion: 2.1 time: 0.451613 Aug 27 04:39:38.442946 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1082/2169] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:37 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:38.460619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-503cc5d1-9ba9-4c30-886f-5a748c5a59f3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:38.461254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-503cc5d1-9ba9-4c30-886f-5a748c5a59f3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:38.470040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-503cc5d1-9ba9-4c30-886f-5a748c5a59f3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:38.470548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-503cc5d1-9ba9-4c30-886f-5a748c5a59f3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:38.470989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-503cc5d1-9ba9-4c30-886f-5a748c5a59f3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:38.475507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-503cc5d1-9ba9-4c30-886f-5a748c5a59f3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:38.478081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-503cc5d1-9ba9-4c30-886f-5a748c5a59f3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:38.486173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-503cc5d1-9ba9-4c30-886f-5a748c5a59f3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:38.488848 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9649c91f-1159-440a-8679-a022efec3e22 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.335902 Aug 27 04:39:38.493779 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1088/2170] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 04:39:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:39:38.505705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-bd554fb1-6393-4d2c-aa42-5cbdcaf9a1f0 req-9eb77ab4-db71-490a-a2d3-3f6a7c074b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33688238-9f13-4f5a-b81c-b01f3fbcaebf", "name": "network-vif-plugged", "status": "completed", "tag": "24c5fda3-094d-4a40-8063-0a5f386b3f06"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:38.540464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bd554fb1-6393-4d2c-aa42-5cbdcaf9a1f0 req-9eb77ab4-db71-490a-a2d3-3f6a7c074b88 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:38.541565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bd554fb1-6393-4d2c-aa42-5cbdcaf9a1f0 req-9eb77ab4-db71-490a-a2d3-3f6a7c074b88 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:38.543461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bd554fb1-6393-4d2c-aa42-5cbdcaf9a1f0 req-9eb77ab4-db71-490a-a2d3-3f6a7c074b88 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:38.571265 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-bd554fb1-6393-4d2c-aa42-5cbdcaf9a1f0 req-9eb77ab4-db71-490a-a2d3-3f6a7c074b88 service nova] Creating event network-vif-plugged:24c5fda3-094d-4a40-8063-0a5f386b3f06 for instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf on n-h2-854823-1 Aug 27 04:39:38.586114 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-bd554fb1-6393-4d2c-aa42-5cbdcaf9a1f0 req-9eb77ab4-db71-490a-a2d3-3f6a7c074b88 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092566 Aug 27 04:39:38.590164 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1089/2171] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:38.605846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e29afca8-063c-4749-bc1c-feb4c60f21f3 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Calling method '.version_select at 0x7f1f213a8670>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:38.784101 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e29afca8-063c-4749-bc1c-feb4c60f21f3 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/630dd0f1-5af7-4033-96d7-bc3131865979" status: 200 len: 664 microversion: 2.1 time: 0.189176 Aug 27 04:39:38.785150 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1090/2172] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 04:39:38 2022] GET /compute/v2.1/os-security-groups/630dd0f1-5af7-4033-96d7-bc3131865979 => generated 664 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:38.791311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f71f35ee-519f-4c51-83c5-7e50499fc78a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:38.792401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f71f35ee-519f-4c51-83c5-7e50499fc78a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:38.807568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f71f35ee-519f-4c51-83c5-7e50499fc78a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:38.809160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f71f35ee-519f-4c51-83c5-7e50499fc78a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:38.812743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f71f35ee-519f-4c51-83c5-7e50499fc78a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:38.813724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f71f35ee-519f-4c51-83c5-7e50499fc78a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:38.814368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f71f35ee-519f-4c51-83c5-7e50499fc78a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:38.814924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f71f35ee-519f-4c51-83c5-7e50499fc78a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:39.163164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-503cc5d1-9ba9-4c30-886f-5a748c5a59f3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:39.176205 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-503cc5d1-9ba9-4c30-886f-5a748c5a59f3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1313 microversion: 2.1 time: 0.732208 Aug 27 04:39:39.178211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f71f35ee-519f-4c51-83c5-7e50499fc78a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:39.190195 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1083/2173] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:38 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1313 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:39.195526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32db27ef-5579-48e3-8012-5077ae5073a4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:39.196147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32db27ef-5579-48e3-8012-5077ae5073a4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:39.200661 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f71f35ee-519f-4c51-83c5-7e50499fc78a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1467 microversion: 2.1 time: 0.413618 Aug 27 04:39:39.201970 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1091/2174] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:38 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1467 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:39.204058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32db27ef-5579-48e3-8012-5077ae5073a4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:39.204723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32db27ef-5579-48e3-8012-5077ae5073a4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:39.205273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32db27ef-5579-48e3-8012-5077ae5073a4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:39.206092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32db27ef-5579-48e3-8012-5077ae5073a4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:39.206664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32db27ef-5579-48e3-8012-5077ae5073a4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:39.207196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32db27ef-5579-48e3-8012-5077ae5073a4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:39.209220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1038ab6d-916a-4780-bc1f-ae3c7f700dc9 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Calling method '.version_select at 0x7f1f213ab8b0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:39.373426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32db27ef-5579-48e3-8012-5077ae5073a4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:39.382791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32db27ef-5579-48e3-8012-5077ae5073a4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:39.388733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32db27ef-5579-48e3-8012-5077ae5073a4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:39.396128 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32db27ef-5579-48e3-8012-5077ae5073a4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1185 microversion: 2.25 time: 0.204594 Aug 27 04:39:39.397071 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1084/2175] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:39 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1185 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:39.409577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31f349c5-d3a5-4690-89f3-0ac4b10adfa9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-677716464", "metadata": {"image_type": "test"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:39.412698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31f349c5-d3a5-4690-89f3-0ac4b10adfa9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:39.434004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31f349c5-d3a5-4690-89f3-0ac4b10adfa9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:39.434747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31f349c5-d3a5-4690-89f3-0ac4b10adfa9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:39.435705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31f349c5-d3a5-4690-89f3-0ac4b10adfa9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:39.436735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31f349c5-d3a5-4690-89f3-0ac4b10adfa9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:39.437463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31f349c5-d3a5-4690-89f3-0ac4b10adfa9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:39.438462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31f349c5-d3a5-4690-89f3-0ac4b10adfa9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:39.495637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-31f349c5-d3a5-4690-89f3-0ac4b10adfa9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Getting quotas for project 851596d90257494a92286fd41e796615. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:39:39.505605 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1038ab6d-916a-4780-bc1f-ae3c7f700dc9 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-group-rules/02b17d3c-1d07-4f50-96c1-54c5ba32e840" status: 202 len: 0 microversion: 2.1 time: 0.301858 Aug 27 04:39:39.506421 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1092/2176] 10.222.0.79 () {58 vars in 1287 bytes} [Sat Aug 27 04:39:39 2022] DELETE /compute/v2.1/os-security-group-rules/02b17d3c-1d07-4f50-96c1-54c5ba32e840 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:39.515587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d165c89c-b0ad-4e44-aeca-38def9038774 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:39.516375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d165c89c-b0ad-4e44-aeca-38def9038774 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:39.520170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-31f349c5-d3a5-4690-89f3-0ac4b10adfa9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Getting quotas for user 79b9b0d20ee74c999f83602bfb52b705 and project 851596d90257494a92286fd41e796615. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:39:39.556582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d165c89c-b0ad-4e44-aeca-38def9038774 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:39.560639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d165c89c-b0ad-4e44-aeca-38def9038774 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:39.561577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d165c89c-b0ad-4e44-aeca-38def9038774 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:39.564780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d165c89c-b0ad-4e44-aeca-38def9038774 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:39.565451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d165c89c-b0ad-4e44-aeca-38def9038774 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:39.566518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d165c89c-b0ad-4e44-aeca-38def9038774 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:39.780446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d165c89c-b0ad-4e44-aeca-38def9038774 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:39.816806 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d165c89c-b0ad-4e44-aeca-38def9038774 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1316 microversion: 2.1 time: 0.303376 Aug 27 04:39:39.836435 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1093/2177] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:39 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:39.856383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-739b9ed8-10f9-43e9-ba7d-b88d318dd00b tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Calling method '.version_select at 0x7f1f213a8040>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:40.018394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:40.036129 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31f349c5-d3a5-4690-89f3-0ac4b10adfa9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "POST /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f/action" status: 202 len: 0 microversion: 2.1 time: 0.637589 Aug 27 04:39:40.043348 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1085/2178] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:39:39 2022] POST /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:39:40.050982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-179cb17e-63e2-4c2c-bd72-d3513a544f4f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:40.051715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-179cb17e-63e2-4c2c-bd72-d3513a544f4f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:40.062078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-179cb17e-63e2-4c2c-bd72-d3513a544f4f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:40.063554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-179cb17e-63e2-4c2c-bd72-d3513a544f4f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:40.064209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-179cb17e-63e2-4c2c-bd72-d3513a544f4f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:40.065288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-179cb17e-63e2-4c2c-bd72-d3513a544f4f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:40.066187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-179cb17e-63e2-4c2c-bd72-d3513a544f4f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:40.066774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-179cb17e-63e2-4c2c-bd72-d3513a544f4f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:40.333223 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-739b9ed8-10f9-43e9-ba7d-b88d318dd00b tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/630dd0f1-5af7-4033-96d7-bc3131865979" status: 202 len: 0 microversion: 2.1 time: 0.494639 Aug 27 04:39:40.334714 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1094/2179] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:39:39 2022] DELETE /compute/v2.1/os-security-groups/630dd0f1-5af7-4033-96d7-bc3131865979 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:40.343547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-2ff7e8f0-23a6-4cf1-b834-417f94335248 req-59ad2e0c-c8b2-4346-bcde-457b81a9ec93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3f02291-a124-4f4a-b89b-77e9285af835", "tag": "5529cd80-c310-4b0d-8cc2-191ea0bfba3d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:40.363848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2ff7e8f0-23a6-4cf1-b834-417f94335248 req-59ad2e0c-c8b2-4346-bcde-457b81a9ec93 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:40.373119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2ff7e8f0-23a6-4cf1-b834-417f94335248 req-59ad2e0c-c8b2-4346-bcde-457b81a9ec93 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:40.373935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2ff7e8f0-23a6-4cf1-b834-417f94335248 req-59ad2e0c-c8b2-4346-bcde-457b81a9ec93 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:40.405976 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-2ff7e8f0-23a6-4cf1-b834-417f94335248 req-59ad2e0c-c8b2-4346-bcde-457b81a9ec93 service nova] Creating event network-changed:5529cd80-c310-4b0d-8cc2-191ea0bfba3d for instance f3f02291-a124-4f4a-b89b-77e9285af835 on n-h1-854823-1 Aug 27 04:39:40.417071 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-2ff7e8f0-23a6-4cf1-b834-417f94335248 req-59ad2e0c-c8b2-4346-bcde-457b81a9ec93 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080672 Aug 27 04:39:40.424300 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1095/2180] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:40.429880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-239e24a5-001e-44e6-b939-ae0b49068925 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f213dfee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:40.547308 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-239e24a5-001e-44e6-b939-ae0b49068925 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.121409 Aug 27 04:39:40.551551 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1096/2181] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:40 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:40.567335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9f3428f9-0c92-4c5f-b17b-399e112f7fa0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:40.570350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9f3428f9-0c92-4c5f-b17b-399e112f7fa0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:40.586965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f3428f9-0c92-4c5f-b17b-399e112f7fa0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:40.587485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f3428f9-0c92-4c5f-b17b-399e112f7fa0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:40.587943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f3428f9-0c92-4c5f-b17b-399e112f7fa0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:40.588716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f3428f9-0c92-4c5f-b17b-399e112f7fa0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:40.589183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f3428f9-0c92-4c5f-b17b-399e112f7fa0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:40.589664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f3428f9-0c92-4c5f-b17b-399e112f7fa0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:40.679197 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-179cb17e-63e2-4c2c-bd72-d3513a544f4f tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1857 microversion: 2.1 time: 0.633837 Aug 27 04:39:40.681517 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1086/2182] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:40 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1857 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:40.697537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec43cb19-5444-425a-b1fd-8995f9a4bea3 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Calling method '.version_select at 0x7f1f20fb84c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:40.989086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9f3428f9-0c92-4c5f-b17b-399e112f7fa0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:41.002291 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9f3428f9-0c92-4c5f-b17b-399e112f7fa0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1313 microversion: 2.1 time: 0.446548 Aug 27 04:39:41.003113 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1097/2183] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:40 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:41.012258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-10ecb30d-beca-41d9-8668-aa746870a20e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:41.013755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-10ecb30d-beca-41d9-8668-aa746870a20e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:41.027100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-ec43cb19-5444-425a-b1fd-8995f9a4bea3 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7ed52226-0624-4aa4-b147-6fcf24bb0d6b does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:39:41.027706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-ec43cb19-5444-425a-b1fd-8995f9a4bea3 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Neutron security group 7ed52226-0624-4aa4-b147-6fcf24bb0d6b not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:39:41.028241 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ec43cb19-5444-425a-b1fd-8995f9a4bea3 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] HTTP exception thrown: Security group 7ed52226-0624-4aa4-b147-6fcf24bb0d6b does not exist Aug 27 04:39:41.028241 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-29f40105-85a3-483d-b92f-ca90ee67470c'] Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec43cb19-5444-425a-b1fd-8995f9a4bea3 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Request method failure captured: Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-groups/7ed52226-0624-4aa4-b147-6fcf24bb0d6b HTTP/1.1 Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_-6DJsGzqsrWPB9xkRV6GigHqFDsukpoiskDNrRB9lRekyyt5I69zE6UX8e61HabfIhjFXug-3oZ0_1MHWumi3npGuewPx7xNvHQ8cUdZL6bQTYdPY-RjfHvhWZQTaDLpiCQgsl9Fnz9DTgd59PymEY10rqWRwssHBCDfwTJ57v6I Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 3e7cae06b5d1462cbe5d649230a1d0c5 Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-738447955 Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3e7cae06b5d1462cbe5d649230a1d0c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3e7cae06b5d1462cbe5d649230a1d0c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3e7cae06b5d1462cbe5d649230a1d0c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3e7cae06b5d1462cbe5d649230a1d0c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupRulesTestJSON-738447955 Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 3e7cae06b5d1462cbe5d649230a1d0c5 Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-738447955 Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupRulesTestJSON-738447955-project Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 2ef66590ce384d92ba6d0babe6d05f26 Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupRulesTestJSON-738447955-project Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: exception: Security group 7ed52226-0624-4aa4-b147-6fcf24bb0d6b does not exist Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-29f40105-85a3-483d-b92f-ca90ee67470c'] Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '7ed52226-0624-4aa4-b147-6fcf24bb0d6b'} Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:39:41.031106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7ed52226-0624-4aa4-b147-6fcf24bb0d6b does not exist Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29f40105-85a3-483d-b92f-ca90ee67470c'] Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7ed52226-0624-4aa4-b147-6fcf24bb0d6b does not exist Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29f40105-85a3-483d-b92f-ca90ee67470c'] Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7ed52226-0624-4aa4-b147-6fcf24bb0d6b does not exist Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29f40105-85a3-483d-b92f-ca90ee67470c'] Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7ed52226-0624-4aa4-b147-6fcf24bb0d6b does not exist Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29f40105-85a3-483d-b92f-ca90ee67470c'] Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec43cb19-5444-425a-b1fd-8995f9a4bea3 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Returning 404 to user: Security group 7ed52226-0624-4aa4-b147-6fcf24bb0d6b does not exist Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-29f40105-85a3-483d-b92f-ca90ee67470c'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:41.038767 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec43cb19-5444-425a-b1fd-8995f9a4bea3 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/7ed52226-0624-4aa4-b147-6fcf24bb0d6b" status: 404 len: 194 microversion: 2.1 time: 0.351982 Aug 27 04:39:41.042503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10ecb30d-beca-41d9-8668-aa746870a20e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:41.048447 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1087/2184] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:39:40 2022] DELETE /compute/v2.1/os-security-groups/7ed52226-0624-4aa4-b147-6fcf24bb0d6b => generated 194 bytes in 365 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:39:41.053758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c54a9295-00c0-42e6-8b93-0d0dcc0c474d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854823-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:41.055003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10ecb30d-beca-41d9-8668-aa746870a20e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:41.055596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10ecb30d-beca-41d9-8668-aa746870a20e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:41.057065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c54a9295-00c0-42e6-8b93-0d0dcc0c474d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:41.062407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10ecb30d-beca-41d9-8668-aa746870a20e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:41.062968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10ecb30d-beca-41d9-8668-aa746870a20e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:41.063417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10ecb30d-beca-41d9-8668-aa746870a20e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:41.066185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c54a9295-00c0-42e6-8b93-0d0dcc0c474d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:41.066848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c54a9295-00c0-42e6-8b93-0d0dcc0c474d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:41.067457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c54a9295-00c0-42e6-8b93-0d0dcc0c474d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:41.068925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c54a9295-00c0-42e6-8b93-0d0dcc0c474d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:41.069723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c54a9295-00c0-42e6-8b93-0d0dcc0c474d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:41.071092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c54a9295-00c0-42e6-8b93-0d0dcc0c474d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:41.102782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-c54a9295-00c0-42e6-8b93-0d0dcc0c474d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lazy-loading 'flavor' on Instance uuid 0c1ebbce-7c0d-4f08-a05f-359d0527b76d {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:41.119058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c54a9295-00c0-42e6-8b93-0d0dcc0c474d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Going to try to live migrate instance to n-h2-854823-1 {{(pid=128869) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:39:41.239220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10ecb30d-beca-41d9-8668-aa746870a20e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:41.252449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10ecb30d-beca-41d9-8668-aa746870a20e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:41.271782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10ecb30d-beca-41d9-8668-aa746870a20e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:41.279219 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-10ecb30d-beca-41d9-8668-aa746870a20e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1251 microversion: 2.25 time: 0.271566 Aug 27 04:39:41.281558 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1098/2185] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:41 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1251 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:41.300689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98542d99-457f-4cec-9e8b-de59285dae2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:41.301863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98542d99-457f-4cec-9e8b-de59285dae2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:41.323569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98542d99-457f-4cec-9e8b-de59285dae2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:41.331474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98542d99-457f-4cec-9e8b-de59285dae2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:41.333804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98542d99-457f-4cec-9e8b-de59285dae2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:41.337132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98542d99-457f-4cec-9e8b-de59285dae2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:41.339056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98542d99-457f-4cec-9e8b-de59285dae2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:41.344814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98542d99-457f-4cec-9e8b-de59285dae2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:41.636635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-98542d99-457f-4cec-9e8b-de59285dae2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:41.648125 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-98542d99-457f-4cec-9e8b-de59285dae2a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1504 microversion: 2.1 time: 0.364148 Aug 27 04:39:41.651757 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1099/2186] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:41 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1504 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:41.658163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2345af40-818f-40d3-b209-4e2553413eba tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Calling method '.version_select at 0x7f1f21314e50>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:41.918297 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2345af40-818f-40d3-b209-4e2553413eba tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/9ab2bd1d-bde9-4a5a-a237-8d89137ffaab" status: 202 len: 0 microversion: 2.1 time: 0.264000 Aug 27 04:39:41.919217 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1100/2187] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:39:41 2022] DELETE /compute/v2.1/os-security-groups/9ab2bd1d-bde9-4a5a-a237-8d89137ffaab => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:41.926374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b08ae31c-3d5f-4e07-99f0-aae1fcde2193 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f2138b0d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:42.019108 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b08ae31c-3d5f-4e07-99f0-aae1fcde2193 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.098634 Aug 27 04:39:42.022119 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1101/2188] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:41 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:42.033526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-47d17376-5064-481f-945a-0aaeeacbe5c4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1214652553"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:42.035535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-47d17376-5064-481f-945a-0aaeeacbe5c4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:42.057405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47d17376-5064-481f-945a-0aaeeacbe5c4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:42.059091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47d17376-5064-481f-945a-0aaeeacbe5c4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:42.062014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47d17376-5064-481f-945a-0aaeeacbe5c4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:42.063996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47d17376-5064-481f-945a-0aaeeacbe5c4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:42.064695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47d17376-5064-481f-945a-0aaeeacbe5c4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:42.065302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47d17376-5064-481f-945a-0aaeeacbe5c4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:42.320072 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.network.security_group_api [None req-47d17376-5064-481f-945a-0aaeeacbe5c4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Adding security group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 to port 24c5fda3-094d-4a40-8063-0a5f386b3f06 Aug 27 04:39:42.899221 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-47d17376-5064-481f-945a-0aaeeacbe5c4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf/action" status: 202 len: 0 microversion: 2.1 time: 0.875440 Aug 27 04:39:42.906422 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1102/2189] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:39:42 2022] POST /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf/action => generated 0 bytes in 883 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:42.915678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5e369665-67e3-4245-815c-ad3de3561031 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Calling method '.version_select at 0x7f1f21314310>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:43.215886 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5e369665-67e3-4245-815c-ad3de3561031 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/087a79a3-e46d-4bd6-b962-317b9a319244" status: 202 len: 0 microversion: 2.1 time: 0.307952 Aug 27 04:39:43.216926 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1103/2190] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:39:42 2022] DELETE /compute/v2.1/os-security-groups/087a79a3-e46d-4bd6-b962-317b9a319244 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:43.221903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7d415e60-09a6-4a11-9e35-bc1ccdee3de3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:43.222661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7d415e60-09a6-4a11-9e35-bc1ccdee3de3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:43.242909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d415e60-09a6-4a11-9e35-bc1ccdee3de3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:43.246092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=28 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:43.255388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d415e60-09a6-4a11-9e35-bc1ccdee3de3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:43.261090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d415e60-09a6-4a11-9e35-bc1ccdee3de3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:43.263848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d415e60-09a6-4a11-9e35-bc1ccdee3de3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:43.266616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d415e60-09a6-4a11-9e35-bc1ccdee3de3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:43.267330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d415e60-09a6-4a11-9e35-bc1ccdee3de3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:43.321735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:43.679795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7d415e60-09a6-4a11-9e35-bc1ccdee3de3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:43.706142 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7d415e60-09a6-4a11-9e35-bc1ccdee3de3 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1313 microversion: 2.1 time: 0.483352 Aug 27 04:39:43.708055 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1104/2191] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:43 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:43.724709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-13d1d09b-0127-4908-a4fa-f85bafb8cdcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:43.727944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-13d1d09b-0127-4908-a4fa-f85bafb8cdcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:43.754530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13d1d09b-0127-4908-a4fa-f85bafb8cdcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:43.758131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13d1d09b-0127-4908-a4fa-f85bafb8cdcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:43.761154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13d1d09b-0127-4908-a4fa-f85bafb8cdcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:43.764558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13d1d09b-0127-4908-a4fa-f85bafb8cdcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:43.765070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13d1d09b-0127-4908-a4fa-f85bafb8cdcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:43.765510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13d1d09b-0127-4908-a4fa-f85bafb8cdcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:44.052869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-13d1d09b-0127-4908-a4fa-f85bafb8cdcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:44.067466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-13d1d09b-0127-4908-a4fa-f85bafb8cdcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:44.072002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-13d1d09b-0127-4908-a4fa-f85bafb8cdcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:44.073229 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-13d1d09b-0127-4908-a4fa-f85bafb8cdcd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1293 microversion: 2.25 time: 0.363586 Aug 27 04:39:44.091479 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1105/2192] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:43 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1293 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:44.097521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98391877-031b-4034-8ffa-a9f29360aeb1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f21314310>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:44.249914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG neutronclient.v2_0.client [None req-98391877-031b-4034-8ffa-a9f29360aeb1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 in use.", "detail": ""}} {{(pid=128870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:39:44.251124 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-98391877-031b-4034-8ffa-a9f29360aeb1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Security Group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 in use. Aug 27 04:39:44.251124 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-38c1cbf3-ad6a-42b4-a458-941a76bd471c'] Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98391877-031b-4034-8ffa-a9f29360aeb1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/os-security-groups/9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 HTTP/1.1 Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: exception: Security Group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 in use. Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-38c1cbf3-ad6a-42b4-a458-941a76bd471c'] Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062'} Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:39:44.253859 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 in use. Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38c1cbf3-ad6a-42b4-a458-941a76bd471c'] Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 in use. Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38c1cbf3-ad6a-42b4-a458-941a76bd471c'] Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 in use. Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38c1cbf3-ad6a-42b4-a458-941a76bd471c'] Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 in use. Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38c1cbf3-ad6a-42b4-a458-941a76bd471c'] Aug 27 04:39:44.258658 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:39:44.264927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98391877-031b-4034-8ffa-a9f29360aeb1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 400 to user: Security Group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 in use. Aug 27 04:39:44.264927 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-38c1cbf3-ad6a-42b4-a458-941a76bd471c'] {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:44.264927 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-98391877-031b-4034-8ffa-a9f29360aeb1 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062" status: 400 len: 185 microversion: 2.1 time: 0.171741 Aug 27 04:39:44.264927 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1106/2193] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:39:44 2022] DELETE /compute/v2.1/os-security-groups/9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 => generated 185 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:39:44.273345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ebcd4a7b-30da-47d8-b609-7fb9c49fca31 req-3323c455-f51a-454a-90f3-db814b49eedc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33688238-9f13-4f5a-b81c-b01f3fbcaebf", "tag": "24c5fda3-094d-4a40-8063-0a5f386b3f06"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:44.287070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ebcd4a7b-30da-47d8-b609-7fb9c49fca31 req-3323c455-f51a-454a-90f3-db814b49eedc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:44.288033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ebcd4a7b-30da-47d8-b609-7fb9c49fca31 req-3323c455-f51a-454a-90f3-db814b49eedc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:44.288989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ebcd4a7b-30da-47d8-b609-7fb9c49fca31 req-3323c455-f51a-454a-90f3-db814b49eedc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:44.306580 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ebcd4a7b-30da-47d8-b609-7fb9c49fca31 req-3323c455-f51a-454a-90f3-db814b49eedc service nova] Creating event network-changed:24c5fda3-094d-4a40-8063-0a5f386b3f06 for instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf on n-h2-854823-1 Aug 27 04:39:44.314132 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ebcd4a7b-30da-47d8-b609-7fb9c49fca31 req-3323c455-f51a-454a-90f3-db814b49eedc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046789 Aug 27 04:39:44.315441 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1107/2194] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:44.325507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-28146e19-d3ae-4b11-a875-39a6e722907b tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f213fe790>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:44.417281 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-28146e19-d3ae-4b11-a875-39a6e722907b tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.100204 Aug 27 04:39:44.419966 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1108/2195] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:44 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:44.425983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3460bb9c-deae-4a7a-93d2-c59b1cc79286 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Calling method '.version_select at 0x7f1f21314a60>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:44.949509 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c54a9295-00c0-42e6-8b93-0d0dcc0c474d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/action" status: 202 len: 0 microversion: 2.1 time: 3.900141 Aug 27 04:39:44.954810 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1088/2196] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:39:41 2022] POST /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/action => generated 0 bytes in 3907 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:44.960569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf7f8b5a-925f-4e3f-a264-a6e0485df6c6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:44.969910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf7f8b5a-925f-4e3f-a264-a6e0485df6c6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:44.983534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf7f8b5a-925f-4e3f-a264-a6e0485df6c6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:44.987371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf7f8b5a-925f-4e3f-a264-a6e0485df6c6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:44.988140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf7f8b5a-925f-4e3f-a264-a6e0485df6c6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:44.993007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf7f8b5a-925f-4e3f-a264-a6e0485df6c6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:44.993770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf7f8b5a-925f-4e3f-a264-a6e0485df6c6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:44.997106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf7f8b5a-925f-4e3f-a264-a6e0485df6c6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:45.206488 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf7f8b5a-925f-4e3f-a264-a6e0485df6c6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf/action" status: 202 len: 0 microversion: 2.1 time: 0.250235 Aug 27 04:39:45.210232 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1089/2197] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:39:44 2022] POST /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:45.221614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d683738-957c-424f-a27d-7fd7976af7c5 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:45.222406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d683738-957c-424f-a27d-7fd7976af7c5 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:45.235616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d683738-957c-424f-a27d-7fd7976af7c5 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:45.238531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d683738-957c-424f-a27d-7fd7976af7c5 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:45.239288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d683738-957c-424f-a27d-7fd7976af7c5 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:45.241475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d683738-957c-424f-a27d-7fd7976af7c5 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:45.242350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d683738-957c-424f-a27d-7fd7976af7c5 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:45.246351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d683738-957c-424f-a27d-7fd7976af7c5 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:45.413444 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3460bb9c-deae-4a7a-93d2-c59b1cc79286 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/397e416e-4178-4266-a2a9-b79e92a2c494" status: 202 len: 0 microversion: 2.1 time: 0.992181 Aug 27 04:39:45.416720 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1109/2198] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:39:44 2022] DELETE /compute/v2.1/os-security-groups/397e416e-4178-4266-a2a9-b79e92a2c494 => generated 0 bytes in 996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:45.424285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2d550081-6db1-42dd-8105-a85e46f80a77 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:45.425676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2d550081-6db1-42dd-8105-a85e46f80a77 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:45.462558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d550081-6db1-42dd-8105-a85e46f80a77 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:45.471197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d550081-6db1-42dd-8105-a85e46f80a77 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:45.471197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d550081-6db1-42dd-8105-a85e46f80a77 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:45.474901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d550081-6db1-42dd-8105-a85e46f80a77 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:45.478668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d550081-6db1-42dd-8105-a85e46f80a77 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:45.486980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d550081-6db1-42dd-8105-a85e46f80a77 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:45.941391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d683738-957c-424f-a27d-7fd7976af7c5 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:45.958541 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d683738-957c-424f-a27d-7fd7976af7c5 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1313 microversion: 2.1 time: 0.749438 Aug 27 04:39:45.977391 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1090/2199] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:45 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1313 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:45.986531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a86c1994-2cb9-403f-8268-d8ac703d6e7d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:45.992056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a86c1994-2cb9-403f-8268-d8ac703d6e7d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:46.013900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a86c1994-2cb9-403f-8268-d8ac703d6e7d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:46.017007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a86c1994-2cb9-403f-8268-d8ac703d6e7d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:46.020071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a86c1994-2cb9-403f-8268-d8ac703d6e7d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:46.021134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a86c1994-2cb9-403f-8268-d8ac703d6e7d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:46.023176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a86c1994-2cb9-403f-8268-d8ac703d6e7d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:46.023903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a86c1994-2cb9-403f-8268-d8ac703d6e7d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:46.565576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a86c1994-2cb9-403f-8268-d8ac703d6e7d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:46.595899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a86c1994-2cb9-403f-8268-d8ac703d6e7d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:46.599756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a86c1994-2cb9-403f-8268-d8ac703d6e7d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:46.602358 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a86c1994-2cb9-403f-8268-d8ac703d6e7d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1293 microversion: 2.25 time: 0.623262 Aug 27 04:39:46.605338 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1091/2200] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:45 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1293 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:46.621989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6cf478b4-9b6d-464d-ae23-8511847dbca4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:46.623110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6cf478b4-9b6d-464d-ae23-8511847dbca4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:46.632323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf478b4-9b6d-464d-ae23-8511847dbca4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:46.636108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf478b4-9b6d-464d-ae23-8511847dbca4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:46.638663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf478b4-9b6d-464d-ae23-8511847dbca4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:46.640449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf478b4-9b6d-464d-ae23-8511847dbca4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:46.642734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf478b4-9b6d-464d-ae23-8511847dbca4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:46.643993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf478b4-9b6d-464d-ae23-8511847dbca4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:46.700245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2d550081-6db1-42dd-8105-a85e46f80a77 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:46.713144 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2d550081-6db1-42dd-8105-a85e46f80a77 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 1.294059 Aug 27 04:39:46.713733 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1110/2201] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:45 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:46.726742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-2c108857-c2d4-4f22-ad32-d473fab7922f req-aa16ebb2-43ad-4859-ba8e-ebecdfb702ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39575026-a753-4c15-ba36-59029811826f", "name": "network-vif-plugged", "status": "completed", "tag": "e868a365-84b1-4305-9f13-56da941f9db8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:46.752811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2c108857-c2d4-4f22-ad32-d473fab7922f req-aa16ebb2-43ad-4859-ba8e-ebecdfb702ed service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:46.757262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2c108857-c2d4-4f22-ad32-d473fab7922f req-aa16ebb2-43ad-4859-ba8e-ebecdfb702ed service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:46.757962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2c108857-c2d4-4f22-ad32-d473fab7922f req-aa16ebb2-43ad-4859-ba8e-ebecdfb702ed service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:46.779247 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-2c108857-c2d4-4f22-ad32-d473fab7922f req-aa16ebb2-43ad-4859-ba8e-ebecdfb702ed service nova] Creating event network-vif-plugged:e868a365-84b1-4305-9f13-56da941f9db8 for instance 39575026-a753-4c15-ba36-59029811826f on n-h2-854823-1 Aug 27 04:39:46.796028 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-2c108857-c2d4-4f22-ad32-d473fab7922f req-aa16ebb2-43ad-4859-ba8e-ebecdfb702ed service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078785 Aug 27 04:39:46.799002 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1111/2202] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:46.812606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-43c2d195-3d3f-4de3-958f-4fd56d5ae22c tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Calling method '.version_select at 0x7f1f214b74c0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:47.076914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6cf478b4-9b6d-464d-ae23-8511847dbca4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:47.100637 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6cf478b4-9b6d-464d-ae23-8511847dbca4 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1575 microversion: 2.1 time: 0.493532 Aug 27 04:39:47.101614 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1092/2203] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:46 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1575 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:47.110077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c7303b89-3d19-4b01-b184-601049a4d724 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f2117d700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:47.193808 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c7303b89-3d19-4b01-b184-601049a4d724 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.090405 Aug 27 04:39:47.194759 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1093/2204] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:47 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:47.211543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-53029a0e-b093-4878-b2d7-ba2b1bc49c09 req-af7e81f9-dbd3-4513-a782-b7918d9ab3ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d59b3ef-e433-480b-9183-d020c885ce4d", "tag": "a44adf17-8cdc-487e-b7d9-6433d193ac0c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:47.236398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-53029a0e-b093-4878-b2d7-ba2b1bc49c09 req-af7e81f9-dbd3-4513-a782-b7918d9ab3ca service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:47.237411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-53029a0e-b093-4878-b2d7-ba2b1bc49c09 req-af7e81f9-dbd3-4513-a782-b7918d9ab3ca service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:47.238052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-53029a0e-b093-4878-b2d7-ba2b1bc49c09 req-af7e81f9-dbd3-4513-a782-b7918d9ab3ca service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:47.256612 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-53029a0e-b093-4878-b2d7-ba2b1bc49c09 req-af7e81f9-dbd3-4513-a782-b7918d9ab3ca service nova] Creating event network-changed:a44adf17-8cdc-487e-b7d9-6433d193ac0c for instance 6d59b3ef-e433-480b-9183-d020c885ce4d on n-h1-854823-1 Aug 27 04:39:47.263464 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-53029a0e-b093-4878-b2d7-ba2b1bc49c09 req-af7e81f9-dbd3-4513-a782-b7918d9ab3ca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067305 Aug 27 04:39:47.267990 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1094/2205] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:47.278958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-edb16057-a58e-4689-9cf2-d186034fe146 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:47.281152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-edb16057-a58e-4689-9cf2-d186034fe146 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:47.298541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edb16057-a58e-4689-9cf2-d186034fe146 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:47.300297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edb16057-a58e-4689-9cf2-d186034fe146 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:47.304922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edb16057-a58e-4689-9cf2-d186034fe146 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:47.307744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edb16057-a58e-4689-9cf2-d186034fe146 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:47.308486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edb16057-a58e-4689-9cf2-d186034fe146 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:47.309174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edb16057-a58e-4689-9cf2-d186034fe146 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:47.764923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-edb16057-a58e-4689-9cf2-d186034fe146 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:47.783748 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-edb16057-a58e-4689-9cf2-d186034fe146 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1313 microversion: 2.1 time: 0.514090 Aug 27 04:39:47.799598 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1095/2206] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:47 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:47.813031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-644ae119-79a6-4c11-9468-e486d3e52a02 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:47.821284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-644ae119-79a6-4c11-9468-e486d3e52a02 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:47.836281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-644ae119-79a6-4c11-9468-e486d3e52a02 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:47.836821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-644ae119-79a6-4c11-9468-e486d3e52a02 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:47.837665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-644ae119-79a6-4c11-9468-e486d3e52a02 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:47.838399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-644ae119-79a6-4c11-9468-e486d3e52a02 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:47.838857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-644ae119-79a6-4c11-9468-e486d3e52a02 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:47.847620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-644ae119-79a6-4c11-9468-e486d3e52a02 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:47.950118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:47.985416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:48.307970 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-43c2d195-3d3f-4de3-958f-4fd56d5ae22c tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/28ce72e6-36b2-4080-96f7-f4a560523996" status: 202 len: 0 microversion: 2.1 time: 1.503588 Aug 27 04:39:48.309614 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1112/2207] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:39:46 2022] DELETE /compute/v2.1/os-security-groups/28ce72e6-36b2-4080-96f7-f4a560523996 => generated 0 bytes in 1510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:48.314518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4fb113f2-fcad-48b3-abf7-a4ad9b70df90 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:48.315690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4fb113f2-fcad-48b3-abf7-a4ad9b70df90 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:48.341339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fb113f2-fcad-48b3-abf7-a4ad9b70df90 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:48.342258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fb113f2-fcad-48b3-abf7-a4ad9b70df90 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:48.342957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fb113f2-fcad-48b3-abf7-a4ad9b70df90 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:48.348644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fb113f2-fcad-48b3-abf7-a4ad9b70df90 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:48.349886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fb113f2-fcad-48b3-abf7-a4ad9b70df90 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:48.350537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fb113f2-fcad-48b3-abf7-a4ad9b70df90 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:48.815390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4fb113f2-fcad-48b3-abf7-a4ad9b70df90 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:48.833845 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4fb113f2-fcad-48b3-abf7-a4ad9b70df90 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.522438 Aug 27 04:39:48.834502 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1113/2208] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:48 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:48.857602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-644ae119-79a6-4c11-9468-e486d3e52a02 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:48.859661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-320d068f-1adf-45d0-b3da-cc1ab62d7765 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:48.868191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-320d068f-1adf-45d0-b3da-cc1ab62d7765 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:48.881957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-644ae119-79a6-4c11-9468-e486d3e52a02 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:48.887553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-320d068f-1adf-45d0-b3da-cc1ab62d7765 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:48.893201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-644ae119-79a6-4c11-9468-e486d3e52a02 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:48.894756 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-644ae119-79a6-4c11-9468-e486d3e52a02 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1293 microversion: 2.25 time: 1.094084 Aug 27 04:39:48.895189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-320d068f-1adf-45d0-b3da-cc1ab62d7765 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:48.895759 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1096/2209] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:47 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1293 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:48.895991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-320d068f-1adf-45d0-b3da-cc1ab62d7765 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:48.896928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-320d068f-1adf-45d0-b3da-cc1ab62d7765 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:48.897257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-320d068f-1adf-45d0-b3da-cc1ab62d7765 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:48.897687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-320d068f-1adf-45d0-b3da-cc1ab62d7765 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:48.924743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f59f78f2-e8d9-43b8-a034-6e66b7341865 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f2115f280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:48.994523 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f59f78f2-e8d9-43b8-a034-6e66b7341865 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.082291 Aug 27 04:39:49.001915 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1097/2210] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:48 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:49.007112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-80b950f4-aa6f-4a19-bb3f-6bf527b27060 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] Calling method '.version_select at 0x7f1f210881f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:49.646767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-320d068f-1adf-45d0-b3da-cc1ab62d7765 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:49.660445 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-320d068f-1adf-45d0-b3da-cc1ab62d7765 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1575 microversion: 2.1 time: 0.824827 Aug 27 04:39:49.664862 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1114/2211] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:48 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1575 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:49.680450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fcb6f416-5bcb-4952-8a66-5542b111898c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:49.692162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fcb6f416-5bcb-4952-8a66-5542b111898c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:49.702272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb6f416-5bcb-4952-8a66-5542b111898c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:49.705324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb6f416-5bcb-4952-8a66-5542b111898c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:49.707968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb6f416-5bcb-4952-8a66-5542b111898c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:49.709138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb6f416-5bcb-4952-8a66-5542b111898c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:49.711253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb6f416-5bcb-4952-8a66-5542b111898c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:49.712749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb6f416-5bcb-4952-8a66-5542b111898c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:49.847587 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-80b950f4-aa6f-4a19-bb3f-6bf527b27060 tempest-SecurityGroupRulesTestJSON-738447955 tempest-SecurityGroupRulesTestJSON-738447955-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/b735584b-32ef-4d3a-9fd7-8c6dd8d52252" status: 202 len: 0 microversion: 2.1 time: 0.849148 Aug 27 04:39:49.850824 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1098/2212] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:39:48 2022] DELETE /compute/v2.1/os-security-groups/b735584b-32ef-4d3a-9fd7-8c6dd8d52252 => generated 0 bytes in 854 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:49.860009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3452e5f4-f800-4e63-bc24-c2a96dc01b2c req-75f583f6-0c8f-4d86-a580-2a5ab5334f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f02291-a124-4f4a-b89b-77e9285af835", "name": "network-vif-plugged", "status": "completed", "tag": "5529cd80-c310-4b0d-8cc2-191ea0bfba3d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:49.945849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3452e5f4-f800-4e63-bc24-c2a96dc01b2c req-75f583f6-0c8f-4d86-a580-2a5ab5334f2a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:49.949887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3452e5f4-f800-4e63-bc24-c2a96dc01b2c req-75f583f6-0c8f-4d86-a580-2a5ab5334f2a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:49.950542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3452e5f4-f800-4e63-bc24-c2a96dc01b2c req-75f583f6-0c8f-4d86-a580-2a5ab5334f2a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:49.984157 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3452e5f4-f800-4e63-bc24-c2a96dc01b2c req-75f583f6-0c8f-4d86-a580-2a5ab5334f2a service nova] Creating event network-vif-plugged:5529cd80-c310-4b0d-8cc2-191ea0bfba3d for instance f3f02291-a124-4f4a-b89b-77e9285af835 on n-h1-854823-1 Aug 27 04:39:49.996153 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3452e5f4-f800-4e63-bc24-c2a96dc01b2c req-75f583f6-0c8f-4d86-a580-2a5ab5334f2a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142673 Aug 27 04:39:50.004867 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1099/2213] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:50.023624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d0a4af5-1584-4111-a9aa-786b5427e298 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:50.027476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3d0a4af5-1584-4111-a9aa-786b5427e298 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:50.073290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d0a4af5-1584-4111-a9aa-786b5427e298 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:50.080621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d0a4af5-1584-4111-a9aa-786b5427e298 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:50.081576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d0a4af5-1584-4111-a9aa-786b5427e298 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:50.086431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d0a4af5-1584-4111-a9aa-786b5427e298 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:50.092666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d0a4af5-1584-4111-a9aa-786b5427e298 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:50.093631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d0a4af5-1584-4111-a9aa-786b5427e298 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:50.606773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d0a4af5-1584-4111-a9aa-786b5427e298 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:50.625302 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d0a4af5-1584-4111-a9aa-786b5427e298 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.616546 Aug 27 04:39:50.625902 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1100/2214] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:50 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:50.634822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98152324-b686-4352-adb0-b65d7df1fddd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:50.636809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98152324-b686-4352-adb0-b65d7df1fddd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:50.665189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98152324-b686-4352-adb0-b65d7df1fddd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:50.665944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98152324-b686-4352-adb0-b65d7df1fddd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:50.666573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98152324-b686-4352-adb0-b65d7df1fddd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:50.668003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98152324-b686-4352-adb0-b65d7df1fddd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:50.669300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98152324-b686-4352-adb0-b65d7df1fddd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:50.670438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98152324-b686-4352-adb0-b65d7df1fddd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:50.900249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fcb6f416-5bcb-4952-8a66-5542b111898c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:50.920782 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fcb6f416-5bcb-4952-8a66-5542b111898c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1313 microversion: 2.1 time: 1.251988 Aug 27 04:39:50.923444 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1115/2215] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:49 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1313 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:50.936729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-50bb126b-728c-475a-8899-c872fd3a598a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f21308430>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:50.951616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-98152324-b686-4352-adb0-b65d7df1fddd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:50.963585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-98152324-b686-4352-adb0-b65d7df1fddd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:50.966729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-98152324-b686-4352-adb0-b65d7df1fddd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:50.970337 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98152324-b686-4352-adb0-b65d7df1fddd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1281 microversion: 2.25 time: 0.339395 Aug 27 04:39:50.982344 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1101/2216] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:50 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1281 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:50.993962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03196d0f-e68e-4221-85ee-e32f617ac68d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:50.997269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03196d0f-e68e-4221-85ee-e32f617ac68d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:51.027307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03196d0f-e68e-4221-85ee-e32f617ac68d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:51.028030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03196d0f-e68e-4221-85ee-e32f617ac68d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:51.029512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03196d0f-e68e-4221-85ee-e32f617ac68d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:51.031220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03196d0f-e68e-4221-85ee-e32f617ac68d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:51.033119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03196d0f-e68e-4221-85ee-e32f617ac68d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:51.036174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03196d0f-e68e-4221-85ee-e32f617ac68d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:51.049133 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-50bb126b-728c-475a-8899-c872fd3a598a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.124364 Aug 27 04:39:51.056922 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1116/2217] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:50 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:51.063688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-25c9a8cc-26af-43f9-87e9-de4508ba4c82 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:51.064195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-25c9a8cc-26af-43f9-87e9-de4508ba4c82 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:51.085090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25c9a8cc-26af-43f9-87e9-de4508ba4c82 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:51.085595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25c9a8cc-26af-43f9-87e9-de4508ba4c82 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:51.086048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25c9a8cc-26af-43f9-87e9-de4508ba4c82 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:51.086770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25c9a8cc-26af-43f9-87e9-de4508ba4c82 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:51.090217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25c9a8cc-26af-43f9-87e9-de4508ba4c82 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:51.090899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25c9a8cc-26af-43f9-87e9-de4508ba4c82 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:51.156266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-25c9a8cc-26af-43f9-87e9-de4508ba4c82 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:39:51.220849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:51.317104 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-25c9a8cc-26af-43f9-87e9-de4508ba4c82 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 204 len: 0 microversion: 2.1 time: 0.258770 Aug 27 04:39:51.327709 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1117/2218] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:39:51 2022] DELETE /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:39:51.333946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cf5807be-474f-4956-afc3-39d5f2c221e1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:51.337693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cf5807be-474f-4956-afc3-39d5f2c221e1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:51.354793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf5807be-474f-4956-afc3-39d5f2c221e1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:51.356367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf5807be-474f-4956-afc3-39d5f2c221e1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:51.364430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf5807be-474f-4956-afc3-39d5f2c221e1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:51.367564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf5807be-474f-4956-afc3-39d5f2c221e1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:51.368279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf5807be-474f-4956-afc3-39d5f2c221e1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:51.368946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf5807be-474f-4956-afc3-39d5f2c221e1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:51.402995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-03196d0f-e68e-4221-85ee-e32f617ac68d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:51.413939 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03196d0f-e68e-4221-85ee-e32f617ac68d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1573 microversion: 2.1 time: 0.430131 Aug 27 04:39:51.436629 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1102/2219] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:50 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1573 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:51.447982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-212dda71-881a-4b28-885b-2f8399d7fa7a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-237942575"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:51.449696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-212dda71-881a-4b28-885b-2f8399d7fa7a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:51.461157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-212dda71-881a-4b28-885b-2f8399d7fa7a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:51.461858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-212dda71-881a-4b28-885b-2f8399d7fa7a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:51.463470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-212dda71-881a-4b28-885b-2f8399d7fa7a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:51.466941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-212dda71-881a-4b28-885b-2f8399d7fa7a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:51.467545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-212dda71-881a-4b28-885b-2f8399d7fa7a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:51.468069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-212dda71-881a-4b28-885b-2f8399d7fa7a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:51.827993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cf5807be-474f-4956-afc3-39d5f2c221e1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:51.838784 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cf5807be-474f-4956-afc3-39d5f2c221e1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1553 microversion: 2.1 time: 0.508946 Aug 27 04:39:51.841576 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1118/2220] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:51 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1553 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:51.867435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-991bd191-db0f-47cf-b984-0f5704172e21 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:51.868062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-991bd191-db0f-47cf-b984-0f5704172e21 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:51.884749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-991bd191-db0f-47cf-b984-0f5704172e21 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:51.885987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-991bd191-db0f-47cf-b984-0f5704172e21 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:51.887382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-991bd191-db0f-47cf-b984-0f5704172e21 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:51.888316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-991bd191-db0f-47cf-b984-0f5704172e21 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:51.895129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-991bd191-db0f-47cf-b984-0f5704172e21 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:51.896243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-991bd191-db0f-47cf-b984-0f5704172e21 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:51.925823 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.network.security_group_api [None req-212dda71-881a-4b28-885b-2f8399d7fa7a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Adding security group 745715f7-b97a-4d83-a218-276f60f75a24 to port 24c5fda3-094d-4a40-8063-0a5f386b3f06 Aug 27 04:39:52.542042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-991bd191-db0f-47cf-b984-0f5704172e21 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:52.572709 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-991bd191-db0f-47cf-b984-0f5704172e21 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.726568 Aug 27 04:39:52.576107 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1119/2221] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:51 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:52.586217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5fb1dea8-c358-4897-b6d6-bba18a9a2564 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:52.589895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5fb1dea8-c358-4897-b6d6-bba18a9a2564 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:52.602282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fb1dea8-c358-4897-b6d6-bba18a9a2564 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:52.604921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fb1dea8-c358-4897-b6d6-bba18a9a2564 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:52.608382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fb1dea8-c358-4897-b6d6-bba18a9a2564 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:52.609507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fb1dea8-c358-4897-b6d6-bba18a9a2564 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:52.611125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fb1dea8-c358-4897-b6d6-bba18a9a2564 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:52.642236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fb1dea8-c358-4897-b6d6-bba18a9a2564 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:52.783509 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-212dda71-881a-4b28-885b-2f8399d7fa7a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf/action" status: 202 len: 0 microversion: 2.1 time: 1.340906 Aug 27 04:39:52.787388 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1103/2222] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:39:51 2022] POST /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf/action => generated 0 bytes in 1346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:39:52.792424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40d36e37-8842-4bb0-97c8-f0b99a4498c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:52.793694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40d36e37-8842-4bb0-97c8-f0b99a4498c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:52.821688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d36e37-8842-4bb0-97c8-f0b99a4498c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:52.822195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d36e37-8842-4bb0-97c8-f0b99a4498c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:52.822636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d36e37-8842-4bb0-97c8-f0b99a4498c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:52.823366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d36e37-8842-4bb0-97c8-f0b99a4498c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:52.823839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d36e37-8842-4bb0-97c8-f0b99a4498c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:52.824265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d36e37-8842-4bb0-97c8-f0b99a4498c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:53.105323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40d36e37-8842-4bb0-97c8-f0b99a4498c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:53.115681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40d36e37-8842-4bb0-97c8-f0b99a4498c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:53.118949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40d36e37-8842-4bb0-97c8-f0b99a4498c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:53.121088 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40d36e37-8842-4bb0-97c8-f0b99a4498c3 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1281 microversion: 2.25 time: 0.332178 Aug 27 04:39:53.121842 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1104/2223] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:52 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1281 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:53.127763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77ce13d1-7e85-42a4-8a74-9936776aa21d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f20ffd8b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:53.173477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5fb1dea8-c358-4897-b6d6-bba18a9a2564 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:53.183848 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5fb1dea8-c358-4897-b6d6-bba18a9a2564 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1313 microversion: 2.1 time: 0.605697 Aug 27 04:39:53.186308 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77ce13d1-7e85-42a4-8a74-9936776aa21d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.063204 Aug 27 04:39:53.187076 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1105/2224] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:53 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:53.199761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df0e7188-fa04-4379-bbb4-f20f8be7f97a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f2101bd30>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:53.202478 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1120/2225] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:52 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:53.214899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9538e180-ad7e-4778-b4dc-941d2c3a3a28 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:53.215520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9538e180-ad7e-4778-b4dc-941d2c3a3a28 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:53.245150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9538e180-ad7e-4778-b4dc-941d2c3a3a28 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:53.246221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9538e180-ad7e-4778-b4dc-941d2c3a3a28 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:53.246668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9538e180-ad7e-4778-b4dc-941d2c3a3a28 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:53.247398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9538e180-ad7e-4778-b4dc-941d2c3a3a28 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:53.247861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9538e180-ad7e-4778-b4dc-941d2c3a3a28 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:53.248294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9538e180-ad7e-4778-b4dc-941d2c3a3a28 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:53.389204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-df0e7188-fa04-4379-bbb4-f20f8be7f97a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 745715f7-b97a-4d83-a218-276f60f75a24 in use.", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:39:53.390494 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-df0e7188-fa04-4379-bbb4-f20f8be7f97a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Security Group 745715f7-b97a-4d83-a218-276f60f75a24 in use. Aug 27 04:39:53.390494 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-17fddaa5-5224-4986-9c00-ab4f91416a4d'] Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df0e7188-fa04-4379-bbb4-f20f8be7f97a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-groups/745715f7-b97a-4d83-a218-276f60f75a24 HTTP/1.1 Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: exception: Security Group 745715f7-b97a-4d83-a218-276f60f75a24 in use. Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-17fddaa5-5224-4986-9c00-ab4f91416a4d'] Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '745715f7-b97a-4d83-a218-276f60f75a24'} Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:39:53.392896 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 745715f7-b97a-4d83-a218-276f60f75a24 in use. Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-17fddaa5-5224-4986-9c00-ab4f91416a4d'] Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 745715f7-b97a-4d83-a218-276f60f75a24 in use. Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-17fddaa5-5224-4986-9c00-ab4f91416a4d'] Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 745715f7-b97a-4d83-a218-276f60f75a24 in use. Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-17fddaa5-5224-4986-9c00-ab4f91416a4d'] Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 745715f7-b97a-4d83-a218-276f60f75a24 in use. Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-17fddaa5-5224-4986-9c00-ab4f91416a4d'] Aug 27 04:39:53.399282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:39:53.406111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df0e7188-fa04-4379-bbb4-f20f8be7f97a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 400 to user: Security Group 745715f7-b97a-4d83-a218-276f60f75a24 in use. Aug 27 04:39:53.406111 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-17fddaa5-5224-4986-9c00-ab4f91416a4d'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:39:53.407442 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-df0e7188-fa04-4379-bbb4-f20f8be7f97a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/745715f7-b97a-4d83-a218-276f60f75a24" status: 400 len: 185 microversion: 2.1 time: 0.219027 Aug 27 04:39:53.412129 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1106/2226] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:39:53 2022] DELETE /compute/v2.1/os-security-groups/745715f7-b97a-4d83-a218-276f60f75a24 => generated 185 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:39:53.421084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-82107d3d-33ad-43c2-b647-af1fd5e3e9c6 req-f11c1937-4189-4dbf-8156-05c707266a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33688238-9f13-4f5a-b81c-b01f3fbcaebf", "tag": "24c5fda3-094d-4a40-8063-0a5f386b3f06"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:53.431841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-82107d3d-33ad-43c2-b647-af1fd5e3e9c6 req-f11c1937-4189-4dbf-8156-05c707266a44 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:53.432738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-82107d3d-33ad-43c2-b647-af1fd5e3e9c6 req-f11c1937-4189-4dbf-8156-05c707266a44 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:53.434088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-82107d3d-33ad-43c2-b647-af1fd5e3e9c6 req-f11c1937-4189-4dbf-8156-05c707266a44 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:53.447013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:53.450658 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-82107d3d-33ad-43c2-b647-af1fd5e3e9c6 req-f11c1937-4189-4dbf-8156-05c707266a44 service nova] Creating event network-changed:24c5fda3-094d-4a40-8063-0a5f386b3f06 for instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf on n-h2-854823-1 Aug 27 04:39:53.457476 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-82107d3d-33ad-43c2-b647-af1fd5e3e9c6 req-f11c1937-4189-4dbf-8156-05c707266a44 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043408 Aug 27 04:39:53.463499 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1107/2227] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:53.476035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38f5e531-0751-4289-8c44-9019519c18c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:53.477141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38f5e531-0751-4289-8c44-9019519c18c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:53.487784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f5e531-0751-4289-8c44-9019519c18c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:53.489139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f5e531-0751-4289-8c44-9019519c18c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:53.491401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f5e531-0751-4289-8c44-9019519c18c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:53.498523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f5e531-0751-4289-8c44-9019519c18c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:53.500642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f5e531-0751-4289-8c44-9019519c18c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:53.503256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f5e531-0751-4289-8c44-9019519c18c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:53.628506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38f5e531-0751-4289-8c44-9019519c18c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:39:53.966427 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-38f5e531-0751-4289-8c44-9019519c18c2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 204 len: 0 microversion: 2.1 time: 0.498489 Aug 27 04:39:53.969319 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1108/2228] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:39:53 2022] DELETE /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:39:53.977384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5bc4d8c-b0b3-40ce-8a4d-da88709037cb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:53.982583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5bc4d8c-b0b3-40ce-8a4d-da88709037cb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:53.991889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5bc4d8c-b0b3-40ce-8a4d-da88709037cb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:53.992865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5bc4d8c-b0b3-40ce-8a4d-da88709037cb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:53.993609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5bc4d8c-b0b3-40ce-8a4d-da88709037cb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:53.994576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5bc4d8c-b0b3-40ce-8a4d-da88709037cb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:53.995354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5bc4d8c-b0b3-40ce-8a4d-da88709037cb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:53.996131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5bc4d8c-b0b3-40ce-8a4d-da88709037cb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:54.292464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f5bc4d8c-b0b3-40ce-8a4d-da88709037cb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:54.305247 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5bc4d8c-b0b3-40ce-8a4d-da88709037cb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.331585 Aug 27 04:39:54.309862 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1109/2229] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:53 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:54.315620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47b7175b-6fe3-48aa-a47b-a3ab09ca47f3 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:54.316409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47b7175b-6fe3-48aa-a47b-a3ab09ca47f3 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:54.345012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b7175b-6fe3-48aa-a47b-a3ab09ca47f3 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:54.345633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b7175b-6fe3-48aa-a47b-a3ab09ca47f3 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:54.346184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b7175b-6fe3-48aa-a47b-a3ab09ca47f3 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:54.347133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b7175b-6fe3-48aa-a47b-a3ab09ca47f3 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:54.347700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b7175b-6fe3-48aa-a47b-a3ab09ca47f3 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:54.348238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b7175b-6fe3-48aa-a47b-a3ab09ca47f3 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:54.628218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9538e180-ad7e-4778-b4dc-941d2c3a3a28 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:54.637897 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9538e180-ad7e-4778-b4dc-941d2c3a3a28 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1553 microversion: 2.1 time: 1.434259 Aug 27 04:39:54.649253 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1121/2230] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:53 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1553 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:54.655086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4db3cfd0-1572-4693-a648-c564b6a69901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:54.655935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4db3cfd0-1572-4693-a648-c564b6a69901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:54.674394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4db3cfd0-1572-4693-a648-c564b6a69901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:54.675383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4db3cfd0-1572-4693-a648-c564b6a69901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:54.676036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4db3cfd0-1572-4693-a648-c564b6a69901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:54.677185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4db3cfd0-1572-4693-a648-c564b6a69901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:54.677842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4db3cfd0-1572-4693-a648-c564b6a69901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:54.689244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4db3cfd0-1572-4693-a648-c564b6a69901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:54.732502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47b7175b-6fe3-48aa-a47b-a3ab09ca47f3 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:54.741239 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47b7175b-6fe3-48aa-a47b-a3ab09ca47f3 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1647 microversion: 2.1 time: 0.430058 Aug 27 04:39:54.746427 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1110/2231] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:54 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1647 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:54.751427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72deec35-4e6c-4172-a0e4-4ae4f0ec2c69 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f211b2ee0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:54.827597 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-72deec35-4e6c-4172-a0e4-4ae4f0ec2c69 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.080027 Aug 27 04:39:54.838218 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1111/2232] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:54 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:54.848338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09d3add0-1145-431f-91df-aa9fcfffb99a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:54.850747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-09d3add0-1145-431f-91df-aa9fcfffb99a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:54.867958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09d3add0-1145-431f-91df-aa9fcfffb99a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:54.875087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09d3add0-1145-431f-91df-aa9fcfffb99a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:54.875858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09d3add0-1145-431f-91df-aa9fcfffb99a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:54.876865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09d3add0-1145-431f-91df-aa9fcfffb99a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:54.877544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09d3add0-1145-431f-91df-aa9fcfffb99a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:54.878009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09d3add0-1145-431f-91df-aa9fcfffb99a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:54.990272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4db3cfd0-1572-4693-a648-c564b6a69901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:55.012626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4db3cfd0-1572-4693-a648-c564b6a69901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:55.020380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4db3cfd0-1572-4693-a648-c564b6a69901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:55.022577 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4db3cfd0-1572-4693-a648-c564b6a69901 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1281 microversion: 2.25 time: 0.372115 Aug 27 04:39:55.023682 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1122/2233] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:54 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1281 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:55.329830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-93574edd-92a6-4d52-bb80-ce0c44095076 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:55.330647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-93574edd-92a6-4d52-bb80-ce0c44095076 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:55.341459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93574edd-92a6-4d52-bb80-ce0c44095076 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:55.350723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93574edd-92a6-4d52-bb80-ce0c44095076 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:55.351380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93574edd-92a6-4d52-bb80-ce0c44095076 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:55.357246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09d3add0-1145-431f-91df-aa9fcfffb99a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:55.370304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93574edd-92a6-4d52-bb80-ce0c44095076 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:55.372872 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09d3add0-1145-431f-91df-aa9fcfffb99a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1313 microversion: 2.1 time: 0.530199 Aug 27 04:39:55.373805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93574edd-92a6-4d52-bb80-ce0c44095076 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:55.373805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93574edd-92a6-4d52-bb80-ce0c44095076 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:55.375925 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1112/2234] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:54 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:55.676434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e68abbfa-f706-4b7e-b053-82c67b3a3081 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:55.677440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e68abbfa-f706-4b7e-b053-82c67b3a3081 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:55.692156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e68abbfa-f706-4b7e-b053-82c67b3a3081 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:55.696503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e68abbfa-f706-4b7e-b053-82c67b3a3081 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:55.698075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e68abbfa-f706-4b7e-b053-82c67b3a3081 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:55.702975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e68abbfa-f706-4b7e-b053-82c67b3a3081 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:55.707073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e68abbfa-f706-4b7e-b053-82c67b3a3081 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:55.710809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e68abbfa-f706-4b7e-b053-82c67b3a3081 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:55.895806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-93574edd-92a6-4d52-bb80-ce0c44095076 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:55.908093 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-93574edd-92a6-4d52-bb80-ce0c44095076 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.582546 Aug 27 04:39:55.916037 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1123/2235] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:55 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:55.949402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ac2b155c-24c9-4243-9b20-ad44e8952ebd tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:55.952311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ac2b155c-24c9-4243-9b20-ad44e8952ebd tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:55.977195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac2b155c-24c9-4243-9b20-ad44e8952ebd tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:55.983267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac2b155c-24c9-4243-9b20-ad44e8952ebd tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:55.985547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac2b155c-24c9-4243-9b20-ad44e8952ebd tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:55.991343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac2b155c-24c9-4243-9b20-ad44e8952ebd tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:55.992417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac2b155c-24c9-4243-9b20-ad44e8952ebd tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:55.998429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac2b155c-24c9-4243-9b20-ad44e8952ebd tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:56.474515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e68abbfa-f706-4b7e-b053-82c67b3a3081 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:56.488065 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e68abbfa-f706-4b7e-b053-82c67b3a3081 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1553 microversion: 2.1 time: 0.814906 Aug 27 04:39:56.493930 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1113/2236] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:55 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1553 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:56.506464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4d9e4477-3302-476e-8bd2-063f6d15eaac tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f211b2280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:56.615513 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4d9e4477-3302-476e-8bd2-063f6d15eaac tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.120354 Aug 27 04:39:56.616245 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1114/2237] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:56 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:56.632500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35cd22d7-e3ce-441a-8418-6236691f0cd0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:56.633220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35cd22d7-e3ce-441a-8418-6236691f0cd0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:56.663770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35cd22d7-e3ce-441a-8418-6236691f0cd0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:56.664880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35cd22d7-e3ce-441a-8418-6236691f0cd0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:56.677721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35cd22d7-e3ce-441a-8418-6236691f0cd0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:56.682755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35cd22d7-e3ce-441a-8418-6236691f0cd0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:56.684460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35cd22d7-e3ce-441a-8418-6236691f0cd0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:56.685275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35cd22d7-e3ce-441a-8418-6236691f0cd0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:57.396121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac2b155c-24c9-4243-9b20-ad44e8952ebd tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:57.404577 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ac2b155c-24c9-4243-9b20-ad44e8952ebd tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1647 microversion: 2.1 time: 1.486990 Aug 27 04:39:57.408975 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1124/2238] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:55 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1647 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:57.422240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d7b0ac02-f7a6-47b7-99a4-527f8f91deee tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:57.423278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d7b0ac02-f7a6-47b7-99a4-527f8f91deee tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:57.444418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7b0ac02-f7a6-47b7-99a4-527f8f91deee tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:57.445393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7b0ac02-f7a6-47b7-99a4-527f8f91deee tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:57.446124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7b0ac02-f7a6-47b7-99a4-527f8f91deee tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:57.447148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7b0ac02-f7a6-47b7-99a4-527f8f91deee tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:57.447854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7b0ac02-f7a6-47b7-99a4-527f8f91deee tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:57.448521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7b0ac02-f7a6-47b7-99a4-527f8f91deee tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:57.845608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d7b0ac02-f7a6-47b7-99a4-527f8f91deee tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:57.853411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35cd22d7-e3ce-441a-8418-6236691f0cd0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:57.854150 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d7b0ac02-f7a6-47b7-99a4-527f8f91deee tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1463 microversion: 2.1 time: 0.443592 Aug 27 04:39:57.854740 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1125/2239] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:57 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1463 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:57.867465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35cd22d7-e3ce-441a-8418-6236691f0cd0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:57.868009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6296067d-2768-45c7-a893-9b0b8d181d2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:57.877382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35cd22d7-e3ce-441a-8418-6236691f0cd0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:57.883672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6296067d-2768-45c7-a893-9b0b8d181d2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:57.891455 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35cd22d7-e3ce-441a-8418-6236691f0cd0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1281 microversion: 2.25 time: 1.267854 Aug 27 04:39:57.892678 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1115/2240] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:56 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1281 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:57.893622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6296067d-2768-45c7-a893-9b0b8d181d2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:57.894132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6296067d-2768-45c7-a893-9b0b8d181d2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:57.894674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6296067d-2768-45c7-a893-9b0b8d181d2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:57.895296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6296067d-2768-45c7-a893-9b0b8d181d2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:57.895756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6296067d-2768-45c7-a893-9b0b8d181d2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:57.904049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6296067d-2768-45c7-a893-9b0b8d181d2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:57.910315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-602e6883-bc66-4d17-99d9-da3c3598c782 req-0a72b3a7-2006-4d8a-a754-ce33019f5bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33688238-9f13-4f5a-b81c-b01f3fbcaebf", "name": "network-vif-deleted", "tag": "24c5fda3-094d-4a40-8063-0a5f386b3f06"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:57.968042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-602e6883-bc66-4d17-99d9-da3c3598c782 req-0a72b3a7-2006-4d8a-a754-ce33019f5bfa service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:57.974135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-602e6883-bc66-4d17-99d9-da3c3598c782 req-0a72b3a7-2006-4d8a-a754-ce33019f5bfa service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:57.974811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-602e6883-bc66-4d17-99d9-da3c3598c782 req-0a72b3a7-2006-4d8a-a754-ce33019f5bfa service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:58.066365 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-602e6883-bc66-4d17-99d9-da3c3598c782 req-0a72b3a7-2006-4d8a-a754-ce33019f5bfa service nova] Creating event network-vif-deleted:24c5fda3-094d-4a40-8063-0a5f386b3f06 for instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf on n-h2-854823-1 Aug 27 04:39:58.089955 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-602e6883-bc66-4d17-99d9-da3c3598c782 req-0a72b3a7-2006-4d8a-a754-ce33019f5bfa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193624 Aug 27 04:39:58.115899 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1116/2241] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:58.150490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f10dd317-a80a-476b-bd0e-28e5d24c329e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:58.177270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f10dd317-a80a-476b-bd0e-28e5d24c329e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:58.219493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f10dd317-a80a-476b-bd0e-28e5d24c329e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:58.219699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6296067d-2768-45c7-a893-9b0b8d181d2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:58.220600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f10dd317-a80a-476b-bd0e-28e5d24c329e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:58.241042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f10dd317-a80a-476b-bd0e-28e5d24c329e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:58.249411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f10dd317-a80a-476b-bd0e-28e5d24c329e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:58.249927 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6296067d-2768-45c7-a893-9b0b8d181d2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.385694 Aug 27 04:39:58.251305 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1126/2242] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:57 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:58.259216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e90dc2b5-b0cf-49f9-8c11-11ebab6ea486 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f214f8040>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:58.269906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f10dd317-a80a-476b-bd0e-28e5d24c329e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:58.270361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f10dd317-a80a-476b-bd0e-28e5d24c329e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:58.377606 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e90dc2b5-b0cf-49f9-8c11-11ebab6ea486 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.125032 Aug 27 04:39:58.378198 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1127/2243] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:58 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:58.542628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f10dd317-a80a-476b-bd0e-28e5d24c329e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:58.553394 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f10dd317-a80a-476b-bd0e-28e5d24c329e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1511 microversion: 2.1 time: 0.430597 Aug 27 04:39:58.573312 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1117/2244] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:58 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1511 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:58.584001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e605332-9448-47ae-9709-7278adb32242 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:58.585030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e605332-9448-47ae-9709-7278adb32242 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:58.592161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e605332-9448-47ae-9709-7278adb32242 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:58.595016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e605332-9448-47ae-9709-7278adb32242 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:58.595721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e605332-9448-47ae-9709-7278adb32242 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:58.596767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e605332-9448-47ae-9709-7278adb32242 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:58.597490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e605332-9448-47ae-9709-7278adb32242 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:58.598155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e605332-9448-47ae-9709-7278adb32242 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:58.780452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e605332-9448-47ae-9709-7278adb32242 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:58.783169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e605332-9448-47ae-9709-7278adb32242 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:58.783729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e605332-9448-47ae-9709-7278adb32242 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:58.784319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-7e605332-9448-47ae-9709-7278adb32242 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lazy-loading 'fault' on Instance uuid 33688238-9f13-4f5a-b81c-b01f3fbcaebf {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:39:58.889811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7e605332-9448-47ae-9709-7278adb32242 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:58.925189 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e605332-9448-47ae-9709-7278adb32242 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 200 len: 1306 microversion: 2.1 time: 0.349910 Aug 27 04:39:58.927965 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1118/2245] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:58 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 1306 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:58.934176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-222ef8f2-e584-4493-a63e-9549efed6e3c req-c0121f0a-ceff-4546-91ff-f04c3f18735f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1e5e54-0d90-49a2-96ec-29f55ab91060", "name": "network-vif-deleted", "tag": "7fac25bf-ac7d-42b3-a2ac-5cf4ece26e48"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:58.979741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-222ef8f2-e584-4493-a63e-9549efed6e3c req-c0121f0a-ceff-4546-91ff-f04c3f18735f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:58.983120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-222ef8f2-e584-4493-a63e-9549efed6e3c req-c0121f0a-ceff-4546-91ff-f04c3f18735f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:58.984732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-222ef8f2-e584-4493-a63e-9549efed6e3c req-c0121f0a-ceff-4546-91ff-f04c3f18735f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.008493 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-222ef8f2-e584-4493-a63e-9549efed6e3c req-c0121f0a-ceff-4546-91ff-f04c3f18735f service nova] Creating event network-vif-deleted:7fac25bf-ac7d-42b3-a2ac-5cf4ece26e48 for instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 on n-h1-854823-1 Aug 27 04:39:59.026627 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-222ef8f2-e584-4493-a63e-9549efed6e3c req-c0121f0a-ceff-4546-91ff-f04c3f18735f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096478 Aug 27 04:39:59.030705 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1119/2246] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:59.049969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d19ab3db-fcee-44f4-86af-eb65a2eb91b4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:59.052118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d19ab3db-fcee-44f4-86af-eb65a2eb91b4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:59.070107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d19ab3db-fcee-44f4-86af-eb65a2eb91b4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:59.075191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d19ab3db-fcee-44f4-86af-eb65a2eb91b4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:59.077279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d19ab3db-fcee-44f4-86af-eb65a2eb91b4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.078316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d19ab3db-fcee-44f4-86af-eb65a2eb91b4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:59.147700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d19ab3db-fcee-44f4-86af-eb65a2eb91b4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:59.147700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d19ab3db-fcee-44f4-86af-eb65a2eb91b4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.271163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a150c65a-c3b3-4945-ac96-a45e3be4ba09 tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] Calling method '.version_select at 0x7f1f214774c0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:59.283467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a150c65a-c3b3-4945-ac96-a45e3be4ba09 tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:59.283852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a150c65a-c3b3-4945-ac96-a45e3be4ba09 tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:59.292982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a150c65a-c3b3-4945-ac96-a45e3be4ba09 tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.320636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a150c65a-c3b3-4945-ac96-a45e3be4ba09 tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:59.325188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a150c65a-c3b3-4945-ac96-a45e3be4ba09 tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:59.328205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a150c65a-c3b3-4945-ac96-a45e3be4ba09 tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.375080 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a150c65a-c3b3-4945-ac96-a45e3be4ba09 tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/8dad6db2d7fc4c0eb26ce4e6e6806aa7?start=2022-08-26T04%3A39%3A57.869960&end=2022-08-28T04%3A39%3A57.869960" status: 200 len: 693 microversion: 2.1 time: 0.992345 Aug 27 04:39:59.380729 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1128/2247] 10.222.0.79 () {58 vars in 1412 bytes} [Sat Aug 27 04:39:58 2022] GET /compute/v2.1/os-simple-tenant-usage/8dad6db2d7fc4c0eb26ce4e6e6806aa7?start=2022-08-26T04%3A39%3A57.869960&end=2022-08-28T04%3A39%3A57.869960 => generated 693 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:59.393922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-51cde203-084d-47ec-99cd-d3a0a30e6e40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:59.394561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-51cde203-084d-47ec-99cd-d3a0a30e6e40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:59.409741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51cde203-084d-47ec-99cd-d3a0a30e6e40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:59.410173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51cde203-084d-47ec-99cd-d3a0a30e6e40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:59.410619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51cde203-084d-47ec-99cd-d3a0a30e6e40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.411363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51cde203-084d-47ec-99cd-d3a0a30e6e40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:59.411815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51cde203-084d-47ec-99cd-d3a0a30e6e40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:59.412410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51cde203-084d-47ec-99cd-d3a0a30e6e40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.465338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d19ab3db-fcee-44f4-86af-eb65a2eb91b4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:59.477452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d19ab3db-fcee-44f4-86af-eb65a2eb91b4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:59.480276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d19ab3db-fcee-44f4-86af-eb65a2eb91b4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:59.485050 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d19ab3db-fcee-44f4-86af-eb65a2eb91b4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1281 microversion: 2.25 time: 0.446938 Aug 27 04:39:59.487682 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1120/2248] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:39:59 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1281 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:59.506307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c97146dc-2204-4c72-8105-9adc5d7b1156 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f25c8f700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:59.623876 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c97146dc-2204-4c72-8105-9adc5d7b1156 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.134971 Aug 27 04:39:59.624625 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1121/2249] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:59 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:59.633142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9193713b-2f64-40a1-b865-bb5c8b2f744a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '.version_select at 0x7f1f2101bd30>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:59.692420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9193713b-2f64-40a1-b865-bb5c8b2f744a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:59.700335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9193713b-2f64-40a1-b865-bb5c8b2f744a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:59.701115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9193713b-2f64-40a1-b865-bb5c8b2f744a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.732518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-51cde203-084d-47ec-99cd-d3a0a30e6e40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:59.742509 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-51cde203-084d-47ec-99cd-d3a0a30e6e40 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.360541 Aug 27 04:39:59.744474 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1129/2250] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:59 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:59.750493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d0d05bf3-204c-47d7-9761-ef7379d70ef4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:59.751450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d0d05bf3-204c-47d7-9761-ef7379d70ef4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:59.758546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0d05bf3-204c-47d7-9761-ef7379d70ef4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:59.759349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0d05bf3-204c-47d7-9761-ef7379d70ef4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:59.759925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0d05bf3-204c-47d7-9761-ef7379d70ef4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.760830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0d05bf3-204c-47d7-9761-ef7379d70ef4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:59.761731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0d05bf3-204c-47d7-9761-ef7379d70ef4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:59.762358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0d05bf3-204c-47d7-9761-ef7379d70ef4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.778392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9193713b-2f64-40a1-b865-bb5c8b2f744a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:59.781957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9193713b-2f64-40a1-b865-bb5c8b2f744a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:59.782694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9193713b-2f64-40a1-b865-bb5c8b2f744a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.837393 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9193713b-2f64-40a1-b865-bb5c8b2f744a tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/8dad6db2d7fc4c0eb26ce4e6e6806aa7?start=2022-08-26T04%3A39%3A57.869960&end=2022-08-28T04%3A39%3A57.869960" status: 200 len: 637 microversion: 2.1 time: 0.211076 Aug 27 04:39:59.837991 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1122/2251] 10.222.0.79 () {58 vars in 1412 bytes} [Sat Aug 27 04:39:59 2022] GET /compute/v2.1/os-simple-tenant-usage/8dad6db2d7fc4c0eb26ce4e6e6806aa7?start=2022-08-26T04%3A39%3A57.869960&end=2022-08-28T04%3A39%3A57.869960 => generated 637 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:59.853866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2152c747-5285-4099-a48a-23d25286ac5b tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] Calling method '.version_select at 0x7f1f20fb8790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:59.862663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:59.864850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2152c747-5285-4099-a48a-23d25286ac5b tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:59.865505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2152c747-5285-4099-a48a-23d25286ac5b tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:59.866138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2152c747-5285-4099-a48a-23d25286ac5b tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.884281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2152c747-5285-4099-a48a-23d25286ac5b tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:59.885078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2152c747-5285-4099-a48a-23d25286ac5b tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:59.885665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2152c747-5285-4099-a48a-23d25286ac5b tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.904407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d0d05bf3-204c-47d7-9761-ef7379d70ef4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:59.938201 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d0d05bf3-204c-47d7-9761-ef7379d70ef4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1346 microversion: 2.1 time: 0.192369 Aug 27 04:39:59.945518 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1130/2252] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:59 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1346 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:59.965164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ee073236-de9c-473a-8b59-94ee3258ef52 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:59.968297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ee073236-de9c-473a-8b59-94ee3258ef52 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:59.987012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee073236-de9c-473a-8b59-94ee3258ef52 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:59.988048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee073236-de9c-473a-8b59-94ee3258ef52 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:59.989304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee073236-de9c-473a-8b59-94ee3258ef52 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.990382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee073236-de9c-473a-8b59-94ee3258ef52 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:59.992401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee073236-de9c-473a-8b59-94ee3258ef52 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:59.993131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee073236-de9c-473a-8b59-94ee3258ef52 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:00.013124 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-ee073236-de9c-473a-8b59-94ee3258ef52 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ee073236-de9c-473a-8b59-94ee3258ef52 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf HTTP/1.1 Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '33688238-9f13-4f5a-b81c-b01f3fbcaebf'} Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:00.015359 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:00.018774 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:00.018774 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:00.018774 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:00.018774 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:00.018774 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:00.018774 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:00.018774 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:00.020663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ee073236-de9c-473a-8b59-94ee3258ef52 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 404 to user: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:00.023391 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ee073236-de9c-473a-8b59-94ee3258ef52 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 404 len: 111 microversion: 2.1 time: 0.076636 Aug 27 04:40:00.028988 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1131/2253] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:59 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:00.036119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2e2f34bf-323b-4dd9-a66b-995069398f42 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f21536ee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:00.149167 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2152c747-5285-4099-a48a-23d25286ac5b tempest-TenantUsagesTestJSON-1101262588 tempest-TenantUsagesTestJSON-1101262588-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T04%3A39%3A57.869960&end=2022-08-28T04%3A39%3A57.869960&detailed=1" status: 200 len: 24363 microversion: 2.1 time: 0.299066 Aug 27 04:40:00.152146 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1123/2254] 10.222.0.79 () {58 vars in 1335 bytes} [Sat Aug 27 04:39:59 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T04%3A39%3A57.869960&end=2022-08-28T04%3A39%3A57.869960&detailed=1 => generated 24363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:00.192245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f7402ff-5ccf-474b-b09f-f9e2e6d0a9ac tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:00.193151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f7402ff-5ccf-474b-b09f-f9e2e6d0a9ac tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:00.204799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f7402ff-5ccf-474b-b09f-f9e2e6d0a9ac tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:00.205658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f7402ff-5ccf-474b-b09f-f9e2e6d0a9ac tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:00.206620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f7402ff-5ccf-474b-b09f-f9e2e6d0a9ac tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:00.209183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f7402ff-5ccf-474b-b09f-f9e2e6d0a9ac tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:00.210810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f7402ff-5ccf-474b-b09f-f9e2e6d0a9ac tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:00.211658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f7402ff-5ccf-474b-b09f-f9e2e6d0a9ac tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:00.274712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f7402ff-5ccf-474b-b09f-f9e2e6d0a9ac tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:40:00.465197 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f7402ff-5ccf-474b-b09f-f9e2e6d0a9ac tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 204 len: 0 microversion: 2.1 time: 0.275989 Aug 27 04:40:00.466782 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1124/2255] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:40:00 2022] DELETE /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:40:00.476895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69bd4397-188e-4d28-a4be-41559a7a549c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:00.477919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69bd4397-188e-4d28-a4be-41559a7a549c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:00.486460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69bd4397-188e-4d28-a4be-41559a7a549c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:00.487213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69bd4397-188e-4d28-a4be-41559a7a549c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:00.487969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69bd4397-188e-4d28-a4be-41559a7a549c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:00.489779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69bd4397-188e-4d28-a4be-41559a7a549c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:00.490425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69bd4397-188e-4d28-a4be-41559a7a549c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:00.491085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69bd4397-188e-4d28-a4be-41559a7a549c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:00.677992 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2e2f34bf-323b-4dd9-a66b-995069398f42 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062" status: 202 len: 0 microversion: 2.1 time: 0.647043 Aug 27 04:40:00.679321 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1132/2256] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:40:00 2022] DELETE /compute/v2.1/os-security-groups/9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:00.691478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dd61f542-889d-44d3-a7ba-ad97fb51203b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:00.693654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dd61f542-889d-44d3-a7ba-ad97fb51203b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:00.738718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd61f542-889d-44d3-a7ba-ad97fb51203b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:00.741246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd61f542-889d-44d3-a7ba-ad97fb51203b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:00.742548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd61f542-889d-44d3-a7ba-ad97fb51203b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:00.747047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd61f542-889d-44d3-a7ba-ad97fb51203b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:00.748441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd61f542-889d-44d3-a7ba-ad97fb51203b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:00.749241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd61f542-889d-44d3-a7ba-ad97fb51203b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:00.971869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-69bd4397-188e-4d28-a4be-41559a7a549c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:00.983170 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69bd4397-188e-4d28-a4be-41559a7a549c tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1469 microversion: 2.1 time: 0.511406 Aug 27 04:40:00.983937 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1125/2257] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:00 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1469 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:00.988992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56a4ee9b-e3ac-4dde-9bb4-53cb7ca358e0 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f25c75160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:01.046451 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-56a4ee9b-e3ac-4dde-9bb4-53cb7ca358e0 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.061117 Aug 27 04:40:01.049373 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1126/2258] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:00 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:01.062235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f82a3cff-5eaf-453b-96b1-7b03251c3299 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f211b2a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:01.129142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dd61f542-889d-44d3-a7ba-ad97fb51203b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:01.139909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dd61f542-889d-44d3-a7ba-ad97fb51203b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:01.147480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dd61f542-889d-44d3-a7ba-ad97fb51203b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:01.149783 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dd61f542-889d-44d3-a7ba-ad97fb51203b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1281 microversion: 2.25 time: 0.465404 Aug 27 04:40:01.171187 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1133/2259] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:00 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1281 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:01.181348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-730f6d4b-5a98-4f8a-a42b-48aaa8831bba req-ab94aaa5-120c-4156-9578-551e16c809c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d59b3ef-e433-480b-9183-d020c885ce4d", "name": "network-vif-plugged", "status": "completed", "tag": "a44adf17-8cdc-487e-b7d9-6433d193ac0c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:01.206855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-730f6d4b-5a98-4f8a-a42b-48aaa8831bba req-ab94aaa5-120c-4156-9578-551e16c809c4 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:01.207571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-730f6d4b-5a98-4f8a-a42b-48aaa8831bba req-ab94aaa5-120c-4156-9578-551e16c809c4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:01.208265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-730f6d4b-5a98-4f8a-a42b-48aaa8831bba req-ab94aaa5-120c-4156-9578-551e16c809c4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:01.237686 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-730f6d4b-5a98-4f8a-a42b-48aaa8831bba req-ab94aaa5-120c-4156-9578-551e16c809c4 service nova] Creating event network-vif-plugged:a44adf17-8cdc-487e-b7d9-6433d193ac0c for instance 6d59b3ef-e433-480b-9183-d020c885ce4d on n-h1-854823-1 Aug 27 04:40:01.246165 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-730f6d4b-5a98-4f8a-a42b-48aaa8831bba req-ab94aaa5-120c-4156-9578-551e16c809c4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073055 Aug 27 04:40:01.246983 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1134/2260] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:01.258415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-38bebfdc-e287-483d-ae1f-b9284a8af082 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:01.259919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-38bebfdc-e287-483d-ae1f-b9284a8af082 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:01.268778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38bebfdc-e287-483d-ae1f-b9284a8af082 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:01.270183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38bebfdc-e287-483d-ae1f-b9284a8af082 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:01.270991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38bebfdc-e287-483d-ae1f-b9284a8af082 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:01.273249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38bebfdc-e287-483d-ae1f-b9284a8af082 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:01.274033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38bebfdc-e287-483d-ae1f-b9284a8af082 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:01.274611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38bebfdc-e287-483d-ae1f-b9284a8af082 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:01.328066 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f82a3cff-5eaf-453b-96b1-7b03251c3299 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/745715f7-b97a-4d83-a218-276f60f75a24" status: 202 len: 0 microversion: 2.1 time: 0.277410 Aug 27 04:40:01.329472 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1127/2261] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:40:01 2022] DELETE /compute/v2.1/os-security-groups/745715f7-b97a-4d83-a218-276f60f75a24 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:01.336282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-02fe7ac8-630b-430b-92b3-f9cd3789f39e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:01.337398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-02fe7ac8-630b-430b-92b3-f9cd3789f39e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:01.379688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fe7ac8-630b-430b-92b3-f9cd3789f39e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:01.380273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fe7ac8-630b-430b-92b3-f9cd3789f39e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:01.380764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fe7ac8-630b-430b-92b3-f9cd3789f39e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:01.381526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fe7ac8-630b-430b-92b3-f9cd3789f39e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:01.382096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fe7ac8-630b-430b-92b3-f9cd3789f39e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:01.385026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fe7ac8-630b-430b-92b3-f9cd3789f39e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:01.438523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:01.622326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-02fe7ac8-630b-430b-92b3-f9cd3789f39e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:01.634737 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-02fe7ac8-630b-430b-92b3-f9cd3789f39e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1346 microversion: 2.1 time: 0.303644 Aug 27 04:40:01.637302 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1128/2262] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:01 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1346 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:01.646041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-06bc1b91-6b6d-49f0-bf7b-014fe23b4316 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'create', calling method: .version_select at 0x7f1f211b2790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-906097713", "description": "tempest-description-1129377078"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:01.705438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-38bebfdc-e287-483d-ae1f-b9284a8af082 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:01.715124 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-38bebfdc-e287-483d-ae1f-b9284a8af082 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.461466 Aug 27 04:40:01.728138 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1135/2263] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:01 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:02.009605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-97076870-fae7-4c64-939d-36f27e266a72 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:02.010248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-97076870-fae7-4c64-939d-36f27e266a72 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:02.030776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97076870-fae7-4c64-939d-36f27e266a72 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:02.031276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97076870-fae7-4c64-939d-36f27e266a72 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:02.032362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97076870-fae7-4c64-939d-36f27e266a72 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:02.032501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97076870-fae7-4c64-939d-36f27e266a72 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:02.032970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97076870-fae7-4c64-939d-36f27e266a72 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:02.033412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97076870-fae7-4c64-939d-36f27e266a72 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:02.085504 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-06bc1b91-6b6d-49f0-bf7b-014fe23b4316 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.443437 Aug 27 04:40:02.096249 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1129/2264] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:40:01 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:02.102695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ca048fa-8ec0-4f56-9565-745d36bd8cfe tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f211b28b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:02.242281 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ca048fa-8ec0-4f56-9565-745d36bd8cfe tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.144637 Aug 27 04:40:02.242883 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1130/2265] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:02 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:02.248037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-510d5411-db25-47c1-aa5c-6896a3466bcb tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Action: 'update', calling method: .version_select at 0x7f1f20ffdaf0>, body: {"security_group": {"name": "tempest-sg-hth-1410109979", "description": "tempest-description-hth-322391527"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:02.552015 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-510d5411-db25-47c1-aa5c-6896a3466bcb tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "PUT /compute/v2.1/os-security-groups/f01befae-dd49-4726-9e0b-fa88441f2e9e" status: 200 len: 217 microversion: 2.1 time: 0.307868 Aug 27 04:40:02.552997 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1131/2266] 10.222.0.79 () {60 vars in 1290 bytes} [Sat Aug 27 04:40:02 2022] PUT /compute/v2.1/os-security-groups/f01befae-dd49-4726-9e0b-fa88441f2e9e => generated 217 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:02.558631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8653505-a0fe-45c6-ab6e-11421a83d3aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:02.560179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8653505-a0fe-45c6-ab6e-11421a83d3aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:02.576426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8653505-a0fe-45c6-ab6e-11421a83d3aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:02.580952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8653505-a0fe-45c6-ab6e-11421a83d3aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:02.581649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8653505-a0fe-45c6-ab6e-11421a83d3aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:02.585979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8653505-a0fe-45c6-ab6e-11421a83d3aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:02.586958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8653505-a0fe-45c6-ab6e-11421a83d3aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:02.587562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8653505-a0fe-45c6-ab6e-11421a83d3aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:02.686264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-97076870-fae7-4c64-939d-36f27e266a72 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:02.704546 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-97076870-fae7-4c64-939d-36f27e266a72 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1469 microversion: 2.1 time: 0.698691 Aug 27 04:40:02.705907 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1136/2267] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:02 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1469 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:02.729140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-26d72979-77ae-4a34-bbfa-1b1c8d3df8e8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f21308af0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:02.854189 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-26d72979-77ae-4a34-bbfa-1b1c8d3df8e8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/f01befae-dd49-4726-9e0b-fa88441f2e9e" status: 200 len: 217 microversion: 2.1 time: 0.146575 Aug 27 04:40:02.855083 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1137/2268] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 04:40:02 2022] GET /compute/v2.1/os-security-groups/f01befae-dd49-4726-9e0b-fa88441f2e9e => generated 217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:02.860146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f6819bbb-652d-4291-b393-2ec41b21fab0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:02.862685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f6819bbb-652d-4291-b393-2ec41b21fab0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:02.879002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6819bbb-652d-4291-b393-2ec41b21fab0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:02.883201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6819bbb-652d-4291-b393-2ec41b21fab0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:02.883926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6819bbb-652d-4291-b393-2ec41b21fab0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:02.885044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6819bbb-652d-4291-b393-2ec41b21fab0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:02.889263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6819bbb-652d-4291-b393-2ec41b21fab0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:02.890475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6819bbb-652d-4291-b393-2ec41b21fab0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:02.905678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:02.951179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d8653505-a0fe-45c6-ab6e-11421a83d3aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:02.966020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d8653505-a0fe-45c6-ab6e-11421a83d3aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:02.970593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d8653505-a0fe-45c6-ab6e-11421a83d3aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:02.973504 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8653505-a0fe-45c6-ab6e-11421a83d3aa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1281 microversion: 2.25 time: 0.419456 Aug 27 04:40:02.974634 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1132/2269] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:02 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1281 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:02.981385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5092779a-deaa-43bf-81e2-a5074d21ec0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:02.982180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5092779a-deaa-43bf-81e2-a5074d21ec0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:02.990822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5092779a-deaa-43bf-81e2-a5074d21ec0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:02.991473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5092779a-deaa-43bf-81e2-a5074d21ec0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:02.992154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5092779a-deaa-43bf-81e2-a5074d21ec0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:02.993369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5092779a-deaa-43bf-81e2-a5074d21ec0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:02.994040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5092779a-deaa-43bf-81e2-a5074d21ec0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:02.995161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5092779a-deaa-43bf-81e2-a5074d21ec0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:03.088328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f6819bbb-652d-4291-b393-2ec41b21fab0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:03.111647 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f6819bbb-652d-4291-b393-2ec41b21fab0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1346 microversion: 2.1 time: 0.255313 Aug 27 04:40:03.128134 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1138/2270] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:02 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1346 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:03.135151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5c657cb5-eae7-45fc-a44c-910fb1a2b21d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f213fb4c0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:03.411141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5092779a-deaa-43bf-81e2-a5074d21ec0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:03.424290 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5092779a-deaa-43bf-81e2-a5074d21ec0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.448409 Aug 27 04:40:03.440799 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1133/2271] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:02 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:03.450710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f42ce6d-40e2-4571-a37f-c6c8b5ade24e tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f220739d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:03.549950 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f42ce6d-40e2-4571-a37f-c6c8b5ade24e tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.112763 Aug 27 04:40:03.552407 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1134/2272] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:03 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:03.732892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-08ee233b-7ee8-44f2-bd4f-647a51b47ef0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:03.733689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-08ee233b-7ee8-44f2-bd4f-647a51b47ef0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:03.747966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08ee233b-7ee8-44f2-bd4f-647a51b47ef0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:03.748472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08ee233b-7ee8-44f2-bd4f-647a51b47ef0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:03.748936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08ee233b-7ee8-44f2-bd4f-647a51b47ef0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:03.749652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08ee233b-7ee8-44f2-bd4f-647a51b47ef0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:03.750367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08ee233b-7ee8-44f2-bd4f-647a51b47ef0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:03.750799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08ee233b-7ee8-44f2-bd4f-647a51b47ef0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:03.893004 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5c657cb5-eae7-45fc-a44c-910fb1a2b21d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/f01befae-dd49-4726-9e0b-fa88441f2e9e" status: 202 len: 0 microversion: 2.1 time: 0.763069 Aug 27 04:40:03.893847 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1139/2273] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:40:03 2022] DELETE /compute/v2.1/os-security-groups/f01befae-dd49-4726-9e0b-fa88441f2e9e => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:03.900636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-70764739-8253-46c3-b9b5-52f51190b5f5 req-4e7c27af-d958-4ff5-9695-3a2e0ffe2251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f02291-a124-4f4a-b89b-77e9285af835", "name": "network-vif-deleted", "tag": "5529cd80-c310-4b0d-8cc2-191ea0bfba3d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:03.921608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-08ee233b-7ee8-44f2-bd4f-647a51b47ef0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebad0656b90f4d6fa0d76d7210462c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dad6db2d7fc4c0eb26ce4e6e6806aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:03.932945 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-08ee233b-7ee8-44f2-bd4f-647a51b47ef0 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 200 len: 1427 microversion: 2.1 time: 0.204201 Aug 27 04:40:03.934163 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1135/2274] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:03 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 1427 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:03.943690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0587a7d-895f-4dc4-b687-be7d0834a7f2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:03.946525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0587a7d-895f-4dc4-b687-be7d0834a7f2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:03.961131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-70764739-8253-46c3-b9b5-52f51190b5f5 req-4e7c27af-d958-4ff5-9695-3a2e0ffe2251 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:03.961894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-70764739-8253-46c3-b9b5-52f51190b5f5 req-4e7c27af-d958-4ff5-9695-3a2e0ffe2251 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:03.962485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-70764739-8253-46c3-b9b5-52f51190b5f5 req-4e7c27af-d958-4ff5-9695-3a2e0ffe2251 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:03.984664 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-70764739-8253-46c3-b9b5-52f51190b5f5 req-4e7c27af-d958-4ff5-9695-3a2e0ffe2251 service nova] Creating event network-vif-deleted:5529cd80-c310-4b0d-8cc2-191ea0bfba3d for instance f3f02291-a124-4f4a-b89b-77e9285af835 on n-h1-854823-1 Aug 27 04:40:03.990400 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-70764739-8253-46c3-b9b5-52f51190b5f5 req-4e7c27af-d958-4ff5-9695-3a2e0ffe2251 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094974 Aug 27 04:40:03.994573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0587a7d-895f-4dc4-b687-be7d0834a7f2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:03.995359 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1140/2275] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:03.996922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0587a7d-895f-4dc4-b687-be7d0834a7f2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:03.997513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0587a7d-895f-4dc4-b687-be7d0834a7f2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:04.001650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0587a7d-895f-4dc4-b687-be7d0834a7f2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:04.003035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd1f3148-6176-4df0-b6a9-2b90293d0bf1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:04.003561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0587a7d-895f-4dc4-b687-be7d0834a7f2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:04.004114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fd1f3148-6176-4df0-b6a9-2b90293d0bf1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:04.012366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd1f3148-6176-4df0-b6a9-2b90293d0bf1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:04.012849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd1f3148-6176-4df0-b6a9-2b90293d0bf1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:04.014157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd1f3148-6176-4df0-b6a9-2b90293d0bf1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:04.014621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd1f3148-6176-4df0-b6a9-2b90293d0bf1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:04.015230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd1f3148-6176-4df0-b6a9-2b90293d0bf1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:04.015418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0587a7d-895f-4dc4-b687-be7d0834a7f2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:04.016029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd1f3148-6176-4df0-b6a9-2b90293d0bf1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:04.060691 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f0587a7d-895f-4dc4-b687-be7d0834a7f2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0587a7d-895f-4dc4-b687-be7d0834a7f2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf HTTP/1.1 Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '33688238-9f13-4f5a-b81c-b01f3fbcaebf'} Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:40:04.062730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:40:04.066601 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:04.066601 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.066601 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:04.066601 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.066601 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:04.066601 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:04.066601 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:04.066601 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:04.066601 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:04.066601 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:04.066601 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.077550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0587a7d-895f-4dc4-b687-be7d0834a7f2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 404 to user: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:04.080924 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0587a7d-895f-4dc4-b687-be7d0834a7f2 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 404 len: 111 microversion: 2.1 time: 0.144176 Aug 27 04:40:04.081745 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1136/2276] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:40:03 2022] DELETE /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:04.096698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e2a4c2e-acb5-45a4-a1d8-ed7bfec47f35 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:04.098320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e2a4c2e-acb5-45a4-a1d8-ed7bfec47f35 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 33688238-9f13-4f5a-b81c-b01f3fbcaebf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:04.113218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2a4c2e-acb5-45a4-a1d8-ed7bfec47f35 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:04.113734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2a4c2e-acb5-45a4-a1d8-ed7bfec47f35 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:04.114179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2a4c2e-acb5-45a4-a1d8-ed7bfec47f35 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:04.119851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2a4c2e-acb5-45a4-a1d8-ed7bfec47f35 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:04.121538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2a4c2e-acb5-45a4-a1d8-ed7bfec47f35 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:04.122038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2a4c2e-acb5-45a4-a1d8-ed7bfec47f35 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:04.163899 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3e2a4c2e-acb5-45a4-a1d8-ed7bfec47f35 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e2a4c2e-acb5-45a4-a1d8-ed7bfec47f35 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf HTTP/1.1 Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '33688238-9f13-4f5a-b81c-b01f3fbcaebf'} Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:04.184732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.188017 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:04.188017 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:04.188017 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:04.188017 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:04.188017 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:04.188017 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. Aug 27 04:40:04.188017 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.194022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e2a4c2e-acb5-45a4-a1d8-ed7bfec47f35 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 404 to user: Instance 33688238-9f13-4f5a-b81c-b01f3fbcaebf could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:04.200488 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e2a4c2e-acb5-45a4-a1d8-ed7bfec47f35 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf" status: 404 len: 111 microversion: 2.1 time: 0.112640 Aug 27 04:40:04.203356 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1137/2277] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:04 2022] GET /compute/v2.1/servers/33688238-9f13-4f5a-b81c-b01f3fbcaebf => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:04.216270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-758184c8-acad-477f-b98f-cf9bf58936f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:04.220885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-758184c8-acad-477f-b98f-cf9bf58936f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:04.239843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-758184c8-acad-477f-b98f-cf9bf58936f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:04.243461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-758184c8-acad-477f-b98f-cf9bf58936f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:04.246883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-758184c8-acad-477f-b98f-cf9bf58936f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:04.248580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-758184c8-acad-477f-b98f-cf9bf58936f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:04.249062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-758184c8-acad-477f-b98f-cf9bf58936f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:04.249648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-758184c8-acad-477f-b98f-cf9bf58936f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:04.304618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fd1f3148-6176-4df0-b6a9-2b90293d0bf1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:04.314545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fd1f3148-6176-4df0-b6a9-2b90293d0bf1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:04.320593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fd1f3148-6176-4df0-b6a9-2b90293d0bf1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:04.324466 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fd1f3148-6176-4df0-b6a9-2b90293d0bf1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1477 microversion: 2.25 time: 0.326501 Aug 27 04:40:04.326633 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1141/2278] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:03 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1477 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:04.335265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53b360a3-124a-4346-a77b-31c8e2115165 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f21308430>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:04.383568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG neutronclient.v2_0.client [None req-53b360a3-124a-4346-a77b-31c8e2115165 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 745715f7-b97a-4d83-a218-276f60f75a24 does not exist", "detail": ""}} {{(pid=128870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:40:04.384183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.security_group_api [None req-53b360a3-124a-4346-a77b-31c8e2115165 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Neutron security group 745715f7-b97a-4d83-a218-276f60f75a24 not found {{(pid=128870) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:40:04.384739 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-53b360a3-124a-4346-a77b-31c8e2115165 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Security group 745715f7-b97a-4d83-a218-276f60f75a24 does not exist Aug 27 04:40:04.384739 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-c8610936-8434-45a7-acad-6eee02a0f8a0'] Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53b360a3-124a-4346-a77b-31c8e2115165 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/os-security-groups/745715f7-b97a-4d83-a218-276f60f75a24 HTTP/1.1 Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: exception: Security group 745715f7-b97a-4d83-a218-276f60f75a24 does not exist Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-c8610936-8434-45a7-acad-6eee02a0f8a0'] Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '745715f7-b97a-4d83-a218-276f60f75a24'} Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:40:04.387843 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 745715f7-b97a-4d83-a218-276f60f75a24 does not exist Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c8610936-8434-45a7-acad-6eee02a0f8a0'] Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 745715f7-b97a-4d83-a218-276f60f75a24 does not exist Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c8610936-8434-45a7-acad-6eee02a0f8a0'] Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 745715f7-b97a-4d83-a218-276f60f75a24 does not exist Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c8610936-8434-45a7-acad-6eee02a0f8a0'] Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 745715f7-b97a-4d83-a218-276f60f75a24 does not exist Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c8610936-8434-45a7-acad-6eee02a0f8a0'] Aug 27 04:40:04.390766 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.396206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53b360a3-124a-4346-a77b-31c8e2115165 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 404 to user: Security group 745715f7-b97a-4d83-a218-276f60f75a24 does not exist Aug 27 04:40:04.396206 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-c8610936-8434-45a7-acad-6eee02a0f8a0'] {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:04.398511 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-53b360a3-124a-4346-a77b-31c8e2115165 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/745715f7-b97a-4d83-a218-276f60f75a24" status: 404 len: 194 microversion: 2.1 time: 0.067755 Aug 27 04:40:04.399583 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1142/2279] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:40:04 2022] DELETE /compute/v2.1/os-security-groups/745715f7-b97a-4d83-a218-276f60f75a24 => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:04.448464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-758184c8-acad-477f-b98f-cf9bf58936f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:04.465262 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-758184c8-acad-477f-b98f-cf9bf58936f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1346 microversion: 2.1 time: 0.257465 Aug 27 04:40:04.467607 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1138/2280] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:04 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1346 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:04.485736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc14dfd6-8e1e-400b-b043-f6485c31915a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f20ffd5e0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:04.563822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-bc14dfd6-8e1e-400b-b043-f6485c31915a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:40:04.564348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-bc14dfd6-8e1e-400b-b043-f6485c31915a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Neutron security group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:40:04.564855 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-bc14dfd6-8e1e-400b-b043-f6485c31915a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Security group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 does not exist Aug 27 04:40:04.564855 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-b9e40725-45b4-4861-8ea4-6d60eca24b58'] Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc14dfd6-8e1e-400b-b043-f6485c31915a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-groups/9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 HTTP/1.1 Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: exception: Security group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 does not exist Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-b9e40725-45b4-4861-8ea4-6d60eca24b58'] Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062'} Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:40:04.568787 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 does not exist Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9e40725-45b4-4861-8ea4-6d60eca24b58'] Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 does not exist Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9e40725-45b4-4861-8ea4-6d60eca24b58'] Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 does not exist Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9e40725-45b4-4861-8ea4-6d60eca24b58'] Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 does not exist Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9e40725-45b4-4861-8ea4-6d60eca24b58'] Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc14dfd6-8e1e-400b-b043-f6485c31915a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 404 to user: Security group 9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 does not exist Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-b9e40725-45b4-4861-8ea4-6d60eca24b58'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:04.571707 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc14dfd6-8e1e-400b-b043-f6485c31915a tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062" status: 404 len: 194 microversion: 2.1 time: 0.101887 Aug 27 04:40:04.577706 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1139/2281] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:40:04 2022] DELETE /compute/v2.1/os-security-groups/9bdd5bba-bb6c-4c1c-baa6-4a20cb36c062 => generated 194 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:04.580062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8138507b-3378-4e00-ba74-1a9c71b3fdf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:04.580837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8138507b-3378-4e00-ba74-1a9c71b3fdf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:04.589872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8138507b-3378-4e00-ba74-1a9c71b3fdf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:04.591374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8138507b-3378-4e00-ba74-1a9c71b3fdf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:04.607108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8138507b-3378-4e00-ba74-1a9c71b3fdf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:04.609739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8138507b-3378-4e00-ba74-1a9c71b3fdf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:04.611570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8138507b-3378-4e00-ba74-1a9c71b3fdf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:04.612883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8138507b-3378-4e00-ba74-1a9c71b3fdf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:04.976294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6d8537e2-2b1a-4a1d-9f39-4a9a8ba33f2f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:04.977495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6d8537e2-2b1a-4a1d-9f39-4a9a8ba33f2f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:04.990660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:04.994146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d8537e2-2b1a-4a1d-9f39-4a9a8ba33f2f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:04.995105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d8537e2-2b1a-4a1d-9f39-4a9a8ba33f2f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:04.996966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d8537e2-2b1a-4a1d-9f39-4a9a8ba33f2f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:04.998314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d8537e2-2b1a-4a1d-9f39-4a9a8ba33f2f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:04.999004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d8537e2-2b1a-4a1d-9f39-4a9a8ba33f2f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:04.999640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d8537e2-2b1a-4a1d-9f39-4a9a8ba33f2f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:05.032951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8138507b-3378-4e00-ba74-1a9c71b3fdf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:05.050744 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8138507b-3378-4e00-ba74-1a9c71b3fdf3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.476961 Aug 27 04:40:05.052574 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1140/2282] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:04 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:05.062092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97f43603-db09-4537-ae40-f2a428243f27 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f25cc2e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:05.142860 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97f43603-db09-4537-ae40-f2a428243f27 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.088641 Aug 27 04:40:05.145611 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1141/2283] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:05 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:05.152214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d917c531-b3f1-4be1-9506-e349c401cbed tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f25cade50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:05.310048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-6d8537e2-2b1a-4a1d-9f39-4a9a8ba33f2f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 6d59b3ef-e433-480b-9183-d020c885ce4d {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:40:05.356415 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6d8537e2-2b1a-4a1d-9f39-4a9a8ba33f2f tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1970 microversion: 2.25 time: 0.949685 Aug 27 04:40:05.361718 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1143/2284] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:04 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1970 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:05.373318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cf21cfd9-7d08-4d2d-8b67-ae2c0e57a8a4 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:05.374186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cf21cfd9-7d08-4d2d-8b67-ae2c0e57a8a4 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] [instance: f3f02291-a124-4f4a-b89b-77e9285af835] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:05.397062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf21cfd9-7d08-4d2d-8b67-ae2c0e57a8a4 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:05.400083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf21cfd9-7d08-4d2d-8b67-ae2c0e57a8a4 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:05.400844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf21cfd9-7d08-4d2d-8b67-ae2c0e57a8a4 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:05.403447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf21cfd9-7d08-4d2d-8b67-ae2c0e57a8a4 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:05.406682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf21cfd9-7d08-4d2d-8b67-ae2c0e57a8a4 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:05.407477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf21cfd9-7d08-4d2d-8b67-ae2c0e57a8a4 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:05.445745 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-cf21cfd9-7d08-4d2d-8b67-ae2c0e57a8a4 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] HTTP exception thrown: Instance f3f02291-a124-4f4a-b89b-77e9285af835 could not be found. Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cf21cfd9-7d08-4d2d-8b67-ae2c0e57a8a4 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Request method failure captured: Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 HTTP/1.1 Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaAClkah38bOhUxi90TXTBtGwTdTiTCMD8c4ARyHA_9GLhrj5GD96roPHMPmodq9mNr3PyNuB4igwC45PbPZuAVt5cYts2cJit3wPm55L17cYfof1g1pMaQBThe49sfpYoEa5ggj0pKPhF6r8xt1tSzqSbaDGTsFh5uGDNGuk9-ErMk Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8dad6db2d7fc4c0eb26ce4e6e6806aa7 Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TenantUsagesTestJSON-1568740289 Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8dad6db2d7fc4c0eb26ce4e6e6806aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8dad6db2d7fc4c0eb26ce4e6e6806aa7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8dad6db2d7fc4c0eb26ce4e6e6806aa7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8dad6db2d7fc4c0eb26ce4e6e6806aa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TenantUsagesTestJSON-1568740289 Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8dad6db2d7fc4c0eb26ce4e6e6806aa7 Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1568740289 Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TenantUsagesTestJSON-1568740289-project Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: ebad0656b90f4d6fa0d76d7210462c88 Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TenantUsagesTestJSON-1568740289-project Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance f3f02291-a124-4f4a-b89b-77e9285af835 could not be found. Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'f3f02291-a124-4f4a-b89b-77e9285af835'} Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f02291-a124-4f4a-b89b-77e9285af835 could not be found. Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f02291-a124-4f4a-b89b-77e9285af835 could not be found. Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:05.452271 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.455504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:05.455504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:05.455504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:05.455504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:05.455504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:05.455504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f02291-a124-4f4a-b89b-77e9285af835 could not be found. Aug 27 04:40:05.455504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.455504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cf21cfd9-7d08-4d2d-8b67-ae2c0e57a8a4 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] Returning 404 to user: Instance f3f02291-a124-4f4a-b89b-77e9285af835 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:05.456946 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cf21cfd9-7d08-4d2d-8b67-ae2c0e57a8a4 tempest-TenantUsagesTestJSON-1568740289 tempest-TenantUsagesTestJSON-1568740289-project] 10.222.0.79 "GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835" status: 404 len: 111 microversion: 2.1 time: 0.090980 Aug 27 04:40:05.457637 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1144/2285] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:05 2022] GET /compute/v2.1/servers/f3f02291-a124-4f4a-b89b-77e9285af835 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:05.496667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a3f34d3d-32d1-4fed-91bf-52d54fc589e5 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:05.503141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a3f34d3d-32d1-4fed-91bf-52d54fc589e5 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:05.503617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-d917c531-b3f1-4be1-9506-e349c401cbed tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:40:05.504286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-d917c531-b3f1-4be1-9506-e349c401cbed tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Neutron security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:40:05.505565 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d917c531-b3f1-4be1-9506-e349c401cbed tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist Aug 27 04:40:05.505565 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-339274cb-9967-48b8-9253-d7850b340b5f'] Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d917c531-b3f1-4be1-9506-e349c401cbed tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-groups/9d97cb96-e961-4a23-a82e-6e4cd0ee669d HTTP/1.1 Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: exception: Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-339274cb-9967-48b8-9253-d7850b340b5f'] Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '9d97cb96-e961-4a23-a82e-6e4cd0ee669d'} Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:40:05.515388 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-339274cb-9967-48b8-9253-d7850b340b5f'] Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-339274cb-9967-48b8-9253-d7850b340b5f'] Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-339274cb-9967-48b8-9253-d7850b340b5f'] Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-339274cb-9967-48b8-9253-d7850b340b5f'] Aug 27 04:40:05.518494 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.525409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d917c531-b3f1-4be1-9506-e349c401cbed tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 404 to user: Security group 9d97cb96-e961-4a23-a82e-6e4cd0ee669d does not exist Aug 27 04:40:05.525409 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-339274cb-9967-48b8-9253-d7850b340b5f'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:05.526586 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d917c531-b3f1-4be1-9506-e349c401cbed tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/9d97cb96-e961-4a23-a82e-6e4cd0ee669d" status: 404 len: 194 microversion: 2.1 time: 0.379768 Aug 27 04:40:05.527643 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1142/2286] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:40:05 2022] DELETE /compute/v2.1/os-security-groups/9d97cb96-e961-4a23-a82e-6e4cd0ee669d => generated 194 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:05.537418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a7fb331-def8-476a-9f04-2b484d063399 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:05.537624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3f34d3d-32d1-4fed-91bf-52d54fc589e5 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:05.537985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3f34d3d-32d1-4fed-91bf-52d54fc589e5 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:05.542992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a7fb331-def8-476a-9f04-2b484d063399 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:05.543408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3f34d3d-32d1-4fed-91bf-52d54fc589e5 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:05.546580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3f34d3d-32d1-4fed-91bf-52d54fc589e5 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:05.547078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3f34d3d-32d1-4fed-91bf-52d54fc589e5 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:05.547521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3f34d3d-32d1-4fed-91bf-52d54fc589e5 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:05.561098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a7fb331-def8-476a-9f04-2b484d063399 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:05.562809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a7fb331-def8-476a-9f04-2b484d063399 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:05.564509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a7fb331-def8-476a-9f04-2b484d063399 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:05.567597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a7fb331-def8-476a-9f04-2b484d063399 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:05.568186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a7fb331-def8-476a-9f04-2b484d063399 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:05.568858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a7fb331-def8-476a-9f04-2b484d063399 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:05.734423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a7fb331-def8-476a-9f04-2b484d063399 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:05.747238 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a7fb331-def8-476a-9f04-2b484d063399 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1346 microversion: 2.1 time: 0.217267 Aug 27 04:40:05.752232 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1143/2287] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:05 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1346 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:05.763693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa374233-d03a-4c6c-88e5-0d9efd084bd9 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f22073280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:05.800584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-a3f34d3d-32d1-4fed-91bf-52d54fc589e5 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 6d59b3ef-e433-480b-9183-d020c885ce4d {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:40:05.833224 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a3f34d3d-32d1-4fed-91bf-52d54fc589e5 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1970 microversion: 2.25 time: 0.363219 Aug 27 04:40:05.842427 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1145/2288] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:05 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1970 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:05.842833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-aa374233-d03a-4c6c-88e5-0d9efd084bd9 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:40:05.843850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-aa374233-d03a-4c6c-88e5-0d9efd084bd9 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Neutron security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:40:05.844802 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-aa374233-d03a-4c6c-88e5-0d9efd084bd9 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist Aug 27 04:40:05.844802 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-0b1073ba-10a5-419a-b9f2-57f2730e73af'] Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa374233-d03a-4c6c-88e5-0d9efd084bd9 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-groups/a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 HTTP/1.1 Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: exception: Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-0b1073ba-10a5-419a-b9f2-57f2730e73af'] Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'a7eaa6db-4ea9-4f44-8090-4cd31a3ee489'} Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:40:05.847265 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b1073ba-10a5-419a-b9f2-57f2730e73af'] Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b1073ba-10a5-419a-b9f2-57f2730e73af'] Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b1073ba-10a5-419a-b9f2-57f2730e73af'] Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b1073ba-10a5-419a-b9f2-57f2730e73af'] Aug 27 04:40:05.850741 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:05.853921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa374233-d03a-4c6c-88e5-0d9efd084bd9 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 404 to user: Security group a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 does not exist Aug 27 04:40:05.853921 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-0b1073ba-10a5-419a-b9f2-57f2730e73af'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:05.855175 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa374233-d03a-4c6c-88e5-0d9efd084bd9 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/a7eaa6db-4ea9-4f44-8090-4cd31a3ee489" status: 404 len: 194 microversion: 2.1 time: 0.101298 Aug 27 04:40:05.859496 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1144/2289] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:40:05 2022] DELETE /compute/v2.1/os-security-groups/a7eaa6db-4ea9-4f44-8090-4cd31a3ee489 => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:05.867601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c3897fb-c185-4302-8f2e-98a8761d9ad6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f20fb8f70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:05.879277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f280076a-a718-4ffd-a8cd-19a870f62ef7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:05.892584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f280076a-a718-4ffd-a8cd-19a870f62ef7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:05.893091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f280076a-a718-4ffd-a8cd-19a870f62ef7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:05.893536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f280076a-a718-4ffd-a8cd-19a870f62ef7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:05.894285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f280076a-a718-4ffd-a8cd-19a870f62ef7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:05.894752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f280076a-a718-4ffd-a8cd-19a870f62ef7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:05.895186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f280076a-a718-4ffd-a8cd-19a870f62ef7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:05.974588 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f280076a-a718-4ffd-a8cd-19a870f62ef7 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.115875 Aug 27 04:40:05.977606 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1146/2290] 10.222.0.79 () {60 vars in 1217 bytes} [Sat Aug 27 04:40:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:06.009160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-7c3897fb-c185-4302-8f2e-98a8761d9ad6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:40:06.009784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-7c3897fb-c185-4302-8f2e-98a8761d9ad6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Neutron security group 3b38223d-62e8-48ac-a20f-218e114f586d not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:40:06.010423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ed233c2c-c1a9-4a56-b923-089c22b8d8f8 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854823-1", "block_migration": "auto"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:06.010541 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7c3897fb-c185-4302-8f2e-98a8761d9ad6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist Aug 27 04:40:06.010541 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-6c4d47eb-faef-4069-9612-7235bb126c4e'] Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c3897fb-c185-4302-8f2e-98a8761d9ad6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-groups/3b38223d-62e8-48ac-a20f-218e114f586d HTTP/1.1 Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: exception: Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-6c4d47eb-faef-4069-9612-7235bb126c4e'] Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '3b38223d-62e8-48ac-a20f-218e114f586d'} Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:40:06.013618 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c4d47eb-faef-4069-9612-7235bb126c4e'] Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c4d47eb-faef-4069-9612-7235bb126c4e'] Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c4d47eb-faef-4069-9612-7235bb126c4e'] Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c4d47eb-faef-4069-9612-7235bb126c4e'] Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c3897fb-c185-4302-8f2e-98a8761d9ad6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 404 to user: Security group 3b38223d-62e8-48ac-a20f-218e114f586d does not exist Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-6c4d47eb-faef-4069-9612-7235bb126c4e'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:06.017373 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7c3897fb-c185-4302-8f2e-98a8761d9ad6 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/3b38223d-62e8-48ac-a20f-218e114f586d" status: 404 len: 194 microversion: 2.1 time: 0.156350 Aug 27 04:40:06.019894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ed233c2c-c1a9-4a56-b923-089c22b8d8f8 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:06.023612 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1145/2291] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:40:05 2022] DELETE /compute/v2.1/os-security-groups/3b38223d-62e8-48ac-a20f-218e114f586d => generated 194 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:06.040012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6341f14-6861-4e8d-a76a-771e8b8a85b8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f22073280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:06.047335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed233c2c-c1a9-4a56-b923-089c22b8d8f8 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:06.047842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed233c2c-c1a9-4a56-b923-089c22b8d8f8 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:06.048299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed233c2c-c1a9-4a56-b923-089c22b8d8f8 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:06.049058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed233c2c-c1a9-4a56-b923-089c22b8d8f8 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:06.054275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed233c2c-c1a9-4a56-b923-089c22b8d8f8 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:06.057537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed233c2c-c1a9-4a56-b923-089c22b8d8f8 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:06.100641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-f6341f14-6861-4e8d-a76a-771e8b8a85b8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:40:06.101270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-f6341f14-6861-4e8d-a76a-771e8b8a85b8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Neutron security group f44779cf-e54d-4dbb-bc83-6591cce013fa not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:40:06.101879 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f6341f14-6861-4e8d-a76a-771e8b8a85b8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist Aug 27 04:40:06.101879 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-7ebaac89-e8b0-4b4d-8c9e-962bd509ab36'] Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6341f14-6861-4e8d-a76a-771e8b8a85b8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-groups/f44779cf-e54d-4dbb-bc83-6591cce013fa HTTP/1.1 Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: exception: Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-7ebaac89-e8b0-4b4d-8c9e-962bd509ab36'] Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'f44779cf-e54d-4dbb-bc83-6591cce013fa'} Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:40:06.103885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ebaac89-e8b0-4b4d-8c9e-962bd509ab36'] Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ebaac89-e8b0-4b4d-8c9e-962bd509ab36'] Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ebaac89-e8b0-4b4d-8c9e-962bd509ab36'] Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ebaac89-e8b0-4b4d-8c9e-962bd509ab36'] Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6341f14-6861-4e8d-a76a-771e8b8a85b8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 404 to user: Security group f44779cf-e54d-4dbb-bc83-6591cce013fa does not exist Aug 27 04:40:06.107536 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-7ebaac89-e8b0-4b4d-8c9e-962bd509ab36'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:06.109742 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6341f14-6861-4e8d-a76a-771e8b8a85b8 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/f44779cf-e54d-4dbb-bc83-6591cce013fa" status: 404 len: 194 microversion: 2.1 time: 0.085034 Aug 27 04:40:06.110513 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1146/2292] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:40:06 2022] DELETE /compute/v2.1/os-security-groups/f44779cf-e54d-4dbb-bc83-6591cce013fa => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:06.124257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-038f5844-6bf4-4760-8fae-f68959fa37eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:06.141614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-038f5844-6bf4-4760-8fae-f68959fa37eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:06.155235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-ed233c2c-c1a9-4a56-b923-089c22b8d8f8 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'flavor' on Instance uuid 6d59b3ef-e433-480b-9183-d020c885ce4d {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:40:06.161360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-038f5844-6bf4-4760-8fae-f68959fa37eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:06.161863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-038f5844-6bf4-4760-8fae-f68959fa37eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:06.162308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-038f5844-6bf4-4760-8fae-f68959fa37eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:06.163038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-038f5844-6bf4-4760-8fae-f68959fa37eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:06.163499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-038f5844-6bf4-4760-8fae-f68959fa37eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:06.175433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-038f5844-6bf4-4760-8fae-f68959fa37eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:06.188193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ed233c2c-c1a9-4a56-b923-089c22b8d8f8 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Going to try to live migrate instance to n-h2-854823-1 {{(pid=128870) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:40:06.562420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-038f5844-6bf4-4760-8fae-f68959fa37eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:06.576921 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-038f5844-6bf4-4760-8fae-f68959fa37eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.458458 Aug 27 04:40:06.597904 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1147/2293] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:06 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:06.616231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d52de05-513b-46cc-a8b5-5da5becb4c78 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:06.618489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d52de05-513b-46cc-a8b5-5da5becb4c78 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:06.631329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d52de05-513b-46cc-a8b5-5da5becb4c78 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:06.632083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d52de05-513b-46cc-a8b5-5da5becb4c78 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:06.632863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d52de05-513b-46cc-a8b5-5da5becb4c78 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:06.634570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d52de05-513b-46cc-a8b5-5da5becb4c78 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:06.635228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d52de05-513b-46cc-a8b5-5da5becb4c78 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:06.638577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d52de05-513b-46cc-a8b5-5da5becb4c78 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:06.698032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d52de05-513b-46cc-a8b5-5da5becb4c78 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:40:06.891393 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d52de05-513b-46cc-a8b5-5da5becb4c78 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 204 len: 0 microversion: 2.1 time: 0.290673 Aug 27 04:40:06.895503 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1148/2294] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:40:06 2022] DELETE /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:40:06.903754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8001d53f-012a-4b1b-8d30-f999ef0f3865 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f21088790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:07.016311 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8001d53f-012a-4b1b-8d30-f999ef0f3865 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.120783 Aug 27 04:40:07.018988 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1149/2295] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:06 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:07.040790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50450646-baf8-4296-85e0-ad24447327b3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:07.044520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50450646-baf8-4296-85e0-ad24447327b3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:07.061997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50450646-baf8-4296-85e0-ad24447327b3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:07.063467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50450646-baf8-4296-85e0-ad24447327b3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:07.065133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50450646-baf8-4296-85e0-ad24447327b3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:07.065906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50450646-baf8-4296-85e0-ad24447327b3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:07.071114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50450646-baf8-4296-85e0-ad24447327b3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:07.071114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50450646-baf8-4296-85e0-ad24447327b3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:07.298798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50450646-baf8-4296-85e0-ad24447327b3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:07.319528 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50450646-baf8-4296-85e0-ad24447327b3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1346 microversion: 2.1 time: 0.298140 Aug 27 04:40:07.322324 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1150/2296] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:07 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1346 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:07.345505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40f95b83-0e02-4950-a479-481ee12134a7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:07.346325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40f95b83-0e02-4950-a479-481ee12134a7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:07.365066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40f95b83-0e02-4950-a479-481ee12134a7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:07.373354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40f95b83-0e02-4950-a479-481ee12134a7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:07.374000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40f95b83-0e02-4950-a479-481ee12134a7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:07.375163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40f95b83-0e02-4950-a479-481ee12134a7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:07.376906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40f95b83-0e02-4950-a479-481ee12134a7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:07.377499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40f95b83-0e02-4950-a479-481ee12134a7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:07.804932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40f95b83-0e02-4950-a479-481ee12134a7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:07.844471 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40f95b83-0e02-4950-a479-481ee12134a7 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1647 microversion: 2.1 time: 0.518696 Aug 27 04:40:07.848017 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1151/2297] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:07 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1647 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:07.880019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12aedc5e-af27-4af1-bd4e-7f7e980a3905 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:07.884172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12aedc5e-af27-4af1-bd4e-7f7e980a3905 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:07.916680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12aedc5e-af27-4af1-bd4e-7f7e980a3905 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:07.917907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12aedc5e-af27-4af1-bd4e-7f7e980a3905 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:07.920800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12aedc5e-af27-4af1-bd4e-7f7e980a3905 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:07.922122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12aedc5e-af27-4af1-bd4e-7f7e980a3905 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:07.923263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12aedc5e-af27-4af1-bd4e-7f7e980a3905 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:07.924087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12aedc5e-af27-4af1-bd4e-7f7e980a3905 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:08.324187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-12aedc5e-af27-4af1-bd4e-7f7e980a3905 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:08.356309 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12aedc5e-af27-4af1-bd4e-7f7e980a3905 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.501895 Aug 27 04:40:08.357930 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1152/2298] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:07 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:08.373601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-daa91bb9-e041-4201-8aaa-51dd6268b880 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f211724c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:08.475539 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-daa91bb9-e041-4201-8aaa-51dd6268b880 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.116274 Aug 27 04:40:08.477283 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1153/2299] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:08 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:08.503865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b174c15-4f47-4ecd-a449-15f77a7261c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:08.504345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b174c15-4f47-4ecd-a449-15f77a7261c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:08.532289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b174c15-4f47-4ecd-a449-15f77a7261c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:08.533211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b174c15-4f47-4ecd-a449-15f77a7261c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:08.535158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b174c15-4f47-4ecd-a449-15f77a7261c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:08.538104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b174c15-4f47-4ecd-a449-15f77a7261c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:08.546972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b174c15-4f47-4ecd-a449-15f77a7261c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:08.553517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b174c15-4f47-4ecd-a449-15f77a7261c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:08.718674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0b174c15-4f47-4ecd-a449-15f77a7261c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:08.739404 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b174c15-4f47-4ecd-a449-15f77a7261c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1346 microversion: 2.1 time: 0.248441 Aug 27 04:40:08.740379 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1154/2300] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:08 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1346 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:08.889417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce7def60-18a7-493c-9768-4168dd62c496 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:08.890040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce7def60-18a7-493c-9768-4168dd62c496 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:08.904986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7def60-18a7-493c-9768-4168dd62c496 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:08.905512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7def60-18a7-493c-9768-4168dd62c496 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:08.905969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7def60-18a7-493c-9768-4168dd62c496 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:08.906735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7def60-18a7-493c-9768-4168dd62c496 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:08.907242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7def60-18a7-493c-9768-4168dd62c496 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:08.907625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7def60-18a7-493c-9768-4168dd62c496 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:09.656127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce7def60-18a7-493c-9768-4168dd62c496 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:09.665973 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce7def60-18a7-493c-9768-4168dd62c496 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1647 microversion: 2.1 time: 0.781001 Aug 27 04:40:09.670208 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1155/2301] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:08 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1647 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:09.678418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b54eb6f-48e5-49b7-b215-cf00a120dc46 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:09.684175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b54eb6f-48e5-49b7-b215-cf00a120dc46 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:09.719532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b54eb6f-48e5-49b7-b215-cf00a120dc46 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:09.720396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b54eb6f-48e5-49b7-b215-cf00a120dc46 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:09.721105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b54eb6f-48e5-49b7-b215-cf00a120dc46 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:09.722052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b54eb6f-48e5-49b7-b215-cf00a120dc46 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:09.722877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b54eb6f-48e5-49b7-b215-cf00a120dc46 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:09.725945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b54eb6f-48e5-49b7-b215-cf00a120dc46 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:09.884350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:10.059511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b54eb6f-48e5-49b7-b215-cf00a120dc46 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:10.063435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:10.076917 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b54eb6f-48e5-49b7-b215-cf00a120dc46 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.404510 Aug 27 04:40:10.077534 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1156/2302] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:09 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:10.083675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b6ce5bb9-b2a6-4a3c-a52c-d44b9f069bcd tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f2117d0d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:10.159189 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b6ce5bb9-b2a6-4a3c-a52c-d44b9f069bcd tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.078202 Aug 27 04:40:10.173225 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1157/2303] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:10 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:10.183630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8ce82b7-52bc-4111-876c-e82f34efedb0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:10.184297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8ce82b7-52bc-4111-876c-e82f34efedb0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:10.212018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8ce82b7-52bc-4111-876c-e82f34efedb0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:10.212546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8ce82b7-52bc-4111-876c-e82f34efedb0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:10.213029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8ce82b7-52bc-4111-876c-e82f34efedb0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:10.213755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8ce82b7-52bc-4111-876c-e82f34efedb0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:10.214796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8ce82b7-52bc-4111-876c-e82f34efedb0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:10.215231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8ce82b7-52bc-4111-876c-e82f34efedb0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:10.430727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8ce82b7-52bc-4111-876c-e82f34efedb0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:10.456919 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8ce82b7-52bc-4111-876c-e82f34efedb0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1346 microversion: 2.1 time: 0.280411 Aug 27 04:40:10.459174 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1158/2304] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:10 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1346 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:10.693116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-687c0477-5499-4b06-bcce-5bf215b2c488 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:10.697701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-687c0477-5499-4b06-bcce-5bf215b2c488 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:10.710131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-687c0477-5499-4b06-bcce-5bf215b2c488 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:10.711915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-687c0477-5499-4b06-bcce-5bf215b2c488 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:10.712699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-687c0477-5499-4b06-bcce-5bf215b2c488 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:10.713648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-687c0477-5499-4b06-bcce-5bf215b2c488 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:10.717922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-687c0477-5499-4b06-bcce-5bf215b2c488 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:10.718636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-687c0477-5499-4b06-bcce-5bf215b2c488 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:11.143265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-687c0477-5499-4b06-bcce-5bf215b2c488 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:11.156674 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-687c0477-5499-4b06-bcce-5bf215b2c488 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1647 microversion: 2.1 time: 0.468997 Aug 27 04:40:11.158015 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1159/2305] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:10 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1647 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:11.179285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66815d89-a881-4e55-8642-6425df631b7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:11.179701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66815d89-a881-4e55-8642-6425df631b7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:11.234862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66815d89-a881-4e55-8642-6425df631b7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:11.234862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66815d89-a881-4e55-8642-6425df631b7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:11.234862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66815d89-a881-4e55-8642-6425df631b7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:11.234862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66815d89-a881-4e55-8642-6425df631b7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:11.234862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66815d89-a881-4e55-8642-6425df631b7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:11.234862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66815d89-a881-4e55-8642-6425df631b7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:11.442148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66815d89-a881-4e55-8642-6425df631b7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:11.453146 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66815d89-a881-4e55-8642-6425df631b7e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.293677 Aug 27 04:40:11.468273 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1160/2306] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:11 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:11.473360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-77eb1ecd-2967-4f86-9ab7-d8b8ff8e9027 req-13309cf3-1ad9-45bb-a1c8-173c92a40106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c1ebbce-7c0d-4f08-a05f-359d0527b76d", "name": "network-vif-unplugged", "status": "completed", "tag": "8348ead6-1b46-443f-99ec-f72deeb2c4f5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:11.485050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77eb1ecd-2967-4f86-9ab7-d8b8ff8e9027 req-13309cf3-1ad9-45bb-a1c8-173c92a40106 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:11.485542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77eb1ecd-2967-4f86-9ab7-d8b8ff8e9027 req-13309cf3-1ad9-45bb-a1c8-173c92a40106 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:11.485980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77eb1ecd-2967-4f86-9ab7-d8b8ff8e9027 req-13309cf3-1ad9-45bb-a1c8-173c92a40106 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:11.502206 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-77eb1ecd-2967-4f86-9ab7-d8b8ff8e9027 req-13309cf3-1ad9-45bb-a1c8-173c92a40106 service nova] Creating event network-vif-unplugged:8348ead6-1b46-443f-99ec-f72deeb2c4f5 for instance 0c1ebbce-7c0d-4f08-a05f-359d0527b76d on n-h1-854823-1 Aug 27 04:40:11.508026 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-77eb1ecd-2967-4f86-9ab7-d8b8ff8e9027 req-13309cf3-1ad9-45bb-a1c8-173c92a40106 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038241 Aug 27 04:40:11.509915 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1161/2307] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:11.517891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46a94156-b4f7-4f0d-86ce-814d08c3a641 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f25ccd160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:11.583284 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46a94156-b4f7-4f0d-86ce-814d08c3a641 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1423 microversion: 2.1 time: 0.072074 Aug 27 04:40:11.584161 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1162/2308] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:11 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1423 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:11.591782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22ff14b0-8bff-411c-b919-8ce71ac7498e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:11.592845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22ff14b0-8bff-411c-b919-8ce71ac7498e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:11.603012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ff14b0-8bff-411c-b919-8ce71ac7498e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:11.603959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ff14b0-8bff-411c-b919-8ce71ac7498e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:11.605627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ff14b0-8bff-411c-b919-8ce71ac7498e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:11.606855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ff14b0-8bff-411c-b919-8ce71ac7498e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:11.607560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ff14b0-8bff-411c-b919-8ce71ac7498e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:11.608399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ff14b0-8bff-411c-b919-8ce71ac7498e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:11.672623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ff14b0-8bff-411c-b919-8ce71ac7498e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:11.678078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ff14b0-8bff-411c-b919-8ce71ac7498e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:11.678402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ff14b0-8bff-411c-b919-8ce71ac7498e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:11.678878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-22ff14b0-8bff-411c-b919-8ce71ac7498e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lazy-loading 'fault' on Instance uuid 0f1e5e54-0d90-49a2-96ec-29f55ab91060 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:40:11.845690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22ff14b0-8bff-411c-b919-8ce71ac7498e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:11.862906 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22ff14b0-8bff-411c-b919-8ce71ac7498e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 200 len: 1351 microversion: 2.1 time: 0.269193 Aug 27 04:40:11.864406 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1163/2309] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:11 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 1351 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:12.181260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4013bb36-2020-4f06-8b5b-d16fc0b6ee2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:12.182560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4013bb36-2020-4f06-8b5b-d16fc0b6ee2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:12.196069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4013bb36-2020-4f06-8b5b-d16fc0b6ee2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:12.196638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4013bb36-2020-4f06-8b5b-d16fc0b6ee2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:12.197080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4013bb36-2020-4f06-8b5b-d16fc0b6ee2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:12.199076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4013bb36-2020-4f06-8b5b-d16fc0b6ee2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:12.199562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4013bb36-2020-4f06-8b5b-d16fc0b6ee2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:12.200972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4013bb36-2020-4f06-8b5b-d16fc0b6ee2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:12.288346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4013bb36-2020-4f06-8b5b-d16fc0b6ee2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:12.301599 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4013bb36-2020-4f06-8b5b-d16fc0b6ee2c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1468 microversion: 2.1 time: 0.125853 Aug 27 04:40:12.315495 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1164/2310] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:12 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1468 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:12.534782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84ddd7a6-6cf3-4b7a-9749-64c08352c280 tempest-FlavorsV2NegativeTest-183647689 tempest-FlavorsV2NegativeTest-183647689-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:12.544996 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-84ddd7a6-6cf3-4b7a-9749-64c08352c280 tempest-FlavorsV2NegativeTest-183647689 tempest-FlavorsV2NegativeTest-183647689-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.240340 Aug 27 04:40:12.546086 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1165/2311] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:40:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:12.550976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34f257e1-eb4d-4145-96f6-2f96e9f14d61 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:12.551585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34f257e1-eb4d-4145-96f6-2f96e9f14d61 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:12.559507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34f257e1-eb4d-4145-96f6-2f96e9f14d61 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:12.560322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34f257e1-eb4d-4145-96f6-2f96e9f14d61 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:12.560782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34f257e1-eb4d-4145-96f6-2f96e9f14d61 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:12.561670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34f257e1-eb4d-4145-96f6-2f96e9f14d61 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:12.562175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34f257e1-eb4d-4145-96f6-2f96e9f14d61 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:12.562605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34f257e1-eb4d-4145-96f6-2f96e9f14d61 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:12.688723 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ed233c2c-c1a9-4a56-b923-089c22b8d8f8 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d/action" status: 202 len: 0 microversion: 2.25 time: 6.693863 Aug 27 04:40:12.693328 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1147/2312] 10.222.0.79 () {62 vars in 1319 bytes} [Sat Aug 27 04:40:05 2022] POST /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d/action => generated 0 bytes in 6697 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:40:12.709483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e486cc17-0331-454b-8ff4-6023bf4361a4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f215f21f0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:12.827565 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e486cc17-0331-454b-8ff4-6023bf4361a4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1432 microversion: 2.1 time: 0.136283 Aug 27 04:40:12.828150 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1148/2313] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:12 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1432 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:12.856336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-742d5eb6-5056-4a06-bb7b-2b89926a22b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:12.857291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-742d5eb6-5056-4a06-bb7b-2b89926a22b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:12.890895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742d5eb6-5056-4a06-bb7b-2b89926a22b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:12.892795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742d5eb6-5056-4a06-bb7b-2b89926a22b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:12.896511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742d5eb6-5056-4a06-bb7b-2b89926a22b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:12.908874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742d5eb6-5056-4a06-bb7b-2b89926a22b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:12.910568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34f257e1-eb4d-4145-96f6-2f96e9f14d61 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:12.911276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742d5eb6-5056-4a06-bb7b-2b89926a22b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:12.911915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742d5eb6-5056-4a06-bb7b-2b89926a22b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:12.924143 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34f257e1-eb4d-4145-96f6-2f96e9f14d61 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.376840 Aug 27 04:40:12.925964 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1166/2314] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:12 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:12.937255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a93e28e1-22d7-4376-b4a8-db009b5565aa tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f25c8fb80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:13.024595 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a93e28e1-22d7-4376-b4a8-db009b5565aa tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 200 len: 1432 microversion: 2.1 time: 0.096655 Aug 27 04:40:13.026448 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1167/2315] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:12 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 1432 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:13.033495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13c05223-4886-4ece-b427-3d341f763c47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:13.034411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13c05223-4886-4ece-b427-3d341f763c47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:13.043047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13c05223-4886-4ece-b427-3d341f763c47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:13.043839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13c05223-4886-4ece-b427-3d341f763c47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:13.044813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13c05223-4886-4ece-b427-3d341f763c47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:13.045724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13c05223-4886-4ece-b427-3d341f763c47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:13.047201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13c05223-4886-4ece-b427-3d341f763c47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:13.047826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13c05223-4886-4ece-b427-3d341f763c47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:13.067110 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-13c05223-4886-4ece-b427-3d341f763c47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13c05223-4886-4ece-b427-3d341f763c47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 HTTP/1.1 Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '0f1e5e54-0d90-49a2-96ec-29f55ab91060'} Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:13.069807 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:13.074010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:13.074010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:13.074010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:13.074010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:13.074010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:13.074010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:40:13.074010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:13.076901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13c05223-4886-4ece-b427-3d341f763c47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:13.079292 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13c05223-4886-4ece-b427-3d341f763c47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 404 len: 111 microversion: 2.1 time: 0.050965 Aug 27 04:40:13.084051 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1168/2316] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:13 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:13.097610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e7638eef-baa7-4b46-855e-c57f935abb0d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:13.098421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e7638eef-baa7-4b46-855e-c57f935abb0d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:13.116007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7638eef-baa7-4b46-855e-c57f935abb0d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:13.118663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7638eef-baa7-4b46-855e-c57f935abb0d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:13.119644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7638eef-baa7-4b46-855e-c57f935abb0d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:13.121806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7638eef-baa7-4b46-855e-c57f935abb0d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:13.123452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7638eef-baa7-4b46-855e-c57f935abb0d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:13.126045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7638eef-baa7-4b46-855e-c57f935abb0d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:13.541528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e7638eef-baa7-4b46-855e-c57f935abb0d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:13.552634 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e7638eef-baa7-4b46-855e-c57f935abb0d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1467 microversion: 2.1 time: 0.467817 Aug 27 04:40:13.553228 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1169/2317] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:13 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1467 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:13.569083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f797a354-6703-4851-ac9b-458cfd45538c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:13.569716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f797a354-6703-4851-ac9b-458cfd45538c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:13.582438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f797a354-6703-4851-ac9b-458cfd45538c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:13.582978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f797a354-6703-4851-ac9b-458cfd45538c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:13.584769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f797a354-6703-4851-ac9b-458cfd45538c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:13.589876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f797a354-6703-4851-ac9b-458cfd45538c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:13.590679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f797a354-6703-4851-ac9b-458cfd45538c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:13.591257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f797a354-6703-4851-ac9b-458cfd45538c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:13.616083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-742d5eb6-5056-4a06-bb7b-2b89926a22b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:13.629321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-742d5eb6-5056-4a06-bb7b-2b89926a22b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:13.632406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-742d5eb6-5056-4a06-bb7b-2b89926a22b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:13.634202 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-742d5eb6-5056-4a06-bb7b-2b89926a22b8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.798212 Aug 27 04:40:13.635450 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1149/2318] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:12 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:13.636840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f797a354-6703-4851-ac9b-458cfd45538c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:13.637335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f797a354-6703-4851-ac9b-458cfd45538c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:13.637885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f797a354-6703-4851-ac9b-458cfd45538c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:13.638495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-f797a354-6703-4851-ac9b-458cfd45538c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lazy-loading 'fault' on Instance uuid 696d8484-201d-4f79-9df8-4dbe1d196b6c {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:40:13.645005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e19d2da-4fab-4b3c-9329-73c946c13891 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:13.648595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4e19d2da-4fab-4b3c-9329-73c946c13891 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:13.657356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e19d2da-4fab-4b3c-9329-73c946c13891 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:13.658756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e19d2da-4fab-4b3c-9329-73c946c13891 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:13.659546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e19d2da-4fab-4b3c-9329-73c946c13891 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:13.660479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e19d2da-4fab-4b3c-9329-73c946c13891 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:13.661289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e19d2da-4fab-4b3c-9329-73c946c13891 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:13.661934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e19d2da-4fab-4b3c-9329-73c946c13891 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:13.683812 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-4e19d2da-4fab-4b3c-9329-73c946c13891 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e19d2da-4fab-4b3c-9329-73c946c13891 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060/os-volume_attachments HTTP/1.1 Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'server_id': '0f1e5e54-0d90-49a2-96ec-29f55ab91060'} Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:40:13.685817 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:40:13.690481 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:40:13.690481 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:13.690481 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:13.690481 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:13.690481 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:13.690481 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:13.690481 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:13.690481 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:13.690481 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:13.690481 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:40:13.690481 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:13.691661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e19d2da-4fab-4b3c-9329-73c946c13891 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:13.692667 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4e19d2da-4fab-4b3c-9329-73c946c13891 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053685 Aug 27 04:40:13.693463 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1150/2319] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:40:13 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:13.704340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-33f2d0b2-b5dc-49db-bf05-599db36c6569 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f21572550>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:13.738913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f797a354-6703-4851-ac9b-458cfd45538c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8586e37b47d141f08610633fce374d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c840f648f684b23bd33f59b466ae029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:13.750275 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f797a354-6703-4851-ac9b-458cfd45538c tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 200 len: 1305 microversion: 2.1 time: 0.191109 Aug 27 04:40:13.755302 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1170/2320] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:13 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 1305 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:13.770039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ab3a6d34-510c-41d6-bf89-4be6b593e87b req-2a77e741-ead7-4a46-b6b1-f7474ee7861b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696d8484-201d-4f79-9df8-4dbe1d196b6c", "name": "network-vif-deleted", "tag": "0a333640-dba0-4503-a400-755c7efa6a00"}, {"name": "network-changed", "server_uuid": "0c1ebbce-7c0d-4f08-a05f-359d0527b76d", "tag": "8348ead6-1b46-443f-99ec-f72deeb2c4f5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:13.789952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ab3a6d34-510c-41d6-bf89-4be6b593e87b req-2a77e741-ead7-4a46-b6b1-f7474ee7861b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:13.790620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ab3a6d34-510c-41d6-bf89-4be6b593e87b req-2a77e741-ead7-4a46-b6b1-f7474ee7861b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:13.791716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ab3a6d34-510c-41d6-bf89-4be6b593e87b req-2a77e741-ead7-4a46-b6b1-f7474ee7861b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:13.797594 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-33f2d0b2-b5dc-49db-bf05-599db36c6569 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/71228424-9f42-4121-865e-14501cc9b5c0" status: 200 len: 784 microversion: 2.1 time: 0.099301 Aug 27 04:40:13.807882 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1151/2321] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:13 2022] GET /compute/v2.1/images/71228424-9f42-4121-865e-14501cc9b5c0 => generated 784 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:13.810053 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ab3a6d34-510c-41d6-bf89-4be6b593e87b req-2a77e741-ead7-4a46-b6b1-f7474ee7861b service nova] Creating event network-vif-deleted:0a333640-dba0-4503-a400-755c7efa6a00 for instance 696d8484-201d-4f79-9df8-4dbe1d196b6c on n-h2-854823-1 Aug 27 04:40:13.810719 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ab3a6d34-510c-41d6-bf89-4be6b593e87b req-2a77e741-ead7-4a46-b6b1-f7474ee7861b service nova] Creating event network-changed:8348ead6-1b46-443f-99ec-f72deeb2c4f5 for instance 0c1ebbce-7c0d-4f08-a05f-359d0527b76d on n-h1-854823-1 Aug 27 04:40:13.813048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ff010324-437e-48f1-a66c-8ade3313f7e7 tempest-FlavorsV2NegativeTest-183647689 tempest-FlavorsV2NegativeTest-183647689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1934585390", "imageRef": "a19ff033-6ff2-48ea-8bcb-87484c7d38fb", "flavorRef": "452"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:13.821427 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ab3a6d34-510c-41d6-bf89-4be6b593e87b req-2a77e741-ead7-4a46-b6b1-f7474ee7861b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.064701 Aug 27 04:40:13.822447 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1171/2322] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:13.828892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9028f44b-9bea-43c6-9fba-2309bc43614a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:13.840655 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9028f44b-9bea-43c6-9fba-2309bc43614a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016484 Aug 27 04:40:13.842558 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1172/2323] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:40:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:13.861039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-04fd3876-d249-4168-a05b-34da53049557 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f25d32f70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:13.946077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-ff010324-437e-48f1-a66c-8ade3313f7e7 tempest-FlavorsV2NegativeTest-183647689 tempest-FlavorsV2NegativeTest-183647689-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:40:14.640053 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-ff010324-437e-48f1-a66c-8ade3313f7e7 tempest-FlavorsV2NegativeTest-183647689 tempest-FlavorsV2NegativeTest-183647689-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ff010324-437e-48f1-a66c-8ade3313f7e7 tempest-FlavorsV2NegativeTest-183647689 tempest-FlavorsV2NegativeTest-183647689-project] Request method failure captured: Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 143 Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaAspF3kbVN_FjEqgia887dqkkkdfLQ0j9LrJJmWZ7acmXQiPtTSHxzfKKI7PcW8ukxVhnRzkGSdPWY6cf9H-tMMNePWrJ35AEmIP_3ClI2D4VqP9ekTuf-Lrosqu2Jfkz4y457y06MfBk-jyPsbubUaRXjc0P37jDbLeAKB179LrrY Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 721eb5d9cbd44bd7890f791d09836bf0 Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FlavorsV2NegativeTest-183647689 Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/721eb5d9cbd44bd7890f791d09836bf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_721eb5d9cbd44bd7890f791d09836bf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/721eb5d9cbd44bd7890f791d09836bf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/721eb5d9cbd44bd7890f791d09836bf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FlavorsV2NegativeTest-183647689 Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 721eb5d9cbd44bd7890f791d09836bf0 Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-183647689 Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FlavorsV2NegativeTest-183647689-project Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: bce0067ddbcb4ecf8bd514180b035536 Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FlavorsV2NegativeTest-183647689-project Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1934585390", "imageRef": "a19ff033-6ff2-48ea-8bcb-87484c7d38fb", "flavorRef": "452"}} Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: exception: Flavor's memory is too small for requested image. Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1934585390', 'imageRef': 'a19ff033-6ff2-48ea-8bcb-87484c7d38fb', 'flavorRef': '452'}}} Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:40:14.642812 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 27 04:40:14.646930 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:14.648790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ff010324-437e-48f1-a66c-8ade3313f7e7 tempest-FlavorsV2NegativeTest-183647689 tempest-FlavorsV2NegativeTest-183647689-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:14.649684 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ff010324-437e-48f1-a66c-8ade3313f7e7 tempest-FlavorsV2NegativeTest-183647689 tempest-FlavorsV2NegativeTest-183647689-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.840765 Aug 27 04:40:14.650292 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1152/2324] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:40:13 2022] POST /compute/v2.1/servers => generated 93 bytes in 842 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:14.663838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3f7d6756-9d13-4250-93cb-08219a9bf17f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:14.666615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3f7d6756-9d13-4250-93cb-08219a9bf17f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:14.679457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f7d6756-9d13-4250-93cb-08219a9bf17f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:14.679967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f7d6756-9d13-4250-93cb-08219a9bf17f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:14.680416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f7d6756-9d13-4250-93cb-08219a9bf17f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:14.685592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f7d6756-9d13-4250-93cb-08219a9bf17f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:14.686150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f7d6756-9d13-4250-93cb-08219a9bf17f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:14.686767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f7d6756-9d13-4250-93cb-08219a9bf17f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:14.705963 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-04fd3876-d249-4168-a05b-34da53049557 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "DELETE /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 204 len: 0 microversion: 2.1 time: 0.855088 Aug 27 04:40:14.707505 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1173/2325] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:13 2022] DELETE /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:40:14.718739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1624147222", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "fa9d001d-b3bf-4c75-aaaf-2dd93a5532f5"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:14.802175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] validate_networks() for [('fa9d001d-b3bf-4c75-aaaf-2dd93a5532f5', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:40:15.424842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3f7d6756-9d13-4250-93cb-08219a9bf17f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:15.440602 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3f7d6756-9d13-4250-93cb-08219a9bf17f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.782233 Aug 27 04:40:15.443008 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1153/2326] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:14 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:15.454103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-38d762c8-ad45-4f54-b4fa-dab7440b4b2e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:15.460158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-38d762c8-ad45-4f54-b4fa-dab7440b4b2e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:15.480325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38d762c8-ad45-4f54-b4fa-dab7440b4b2e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:15.481407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38d762c8-ad45-4f54-b4fa-dab7440b4b2e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:15.483232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38d762c8-ad45-4f54-b4fa-dab7440b4b2e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:15.484451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38d762c8-ad45-4f54-b4fa-dab7440b4b2e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:15.485275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38d762c8-ad45-4f54-b4fa-dab7440b4b2e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:15.485864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38d762c8-ad45-4f54-b4fa-dab7440b4b2e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:15.585727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:40:15.587187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:40:15.587801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:40:15.588327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:40:15.588981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:40:15.640271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:15.641009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:15.641510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:15.642263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:15.642729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:15.643869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:15.678250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Getting quotas for project b902932050be4c04bca1de4fe268c2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:40:15.686829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Getting quotas for user 6c59dc5e251943d59de8b2d640643a0e and project b902932050be4c04bca1de4fe268c2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:40:15.704568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:40:15.707323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: fee11b39-0c51-4f70-b911-6b111653c849] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:40:15.827667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-38d762c8-ad45-4f54-b4fa-dab7440b4b2e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:15.842113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-38d762c8-ad45-4f54-b4fa-dab7440b4b2e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:15.842749 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50a19274-011f-4348-8232-f38065b09b7f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.130377 Aug 27 04:40:15.843625 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1174/2327] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:40:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:40:15.843733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-38d762c8-ad45-4f54-b4fa-dab7440b4b2e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:15.844889 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-38d762c8-ad45-4f54-b4fa-dab7440b4b2e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.399214 Aug 27 04:40:15.845444 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1154/2328] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:15 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:15.860303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c9cf22d6-56fa-434b-bcc3-cfa6c9858dd0 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f25d32820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:15.861984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d2299202-b675-473b-a2a8-658efef65bde tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:15.862619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d2299202-b675-473b-a2a8-658efef65bde tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] [instance: 696d8484-201d-4f79-9df8-4dbe1d196b6c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:15.882740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2299202-b675-473b-a2a8-658efef65bde tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:15.883255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2299202-b675-473b-a2a8-658efef65bde tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:15.883708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2299202-b675-473b-a2a8-658efef65bde tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:15.884434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2299202-b675-473b-a2a8-658efef65bde tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:15.884933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2299202-b675-473b-a2a8-658efef65bde tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:15.885492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2299202-b675-473b-a2a8-658efef65bde tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:15.906124 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-d2299202-b675-473b-a2a8-658efef65bde tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] HTTP exception thrown: Instance 696d8484-201d-4f79-9df8-4dbe1d196b6c could not be found. Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d2299202-b675-473b-a2a8-658efef65bde tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Request method failure captured: Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c HTTP/1.1 Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_KoEjXpKARUYoU_lrdasD0ajQFjwX_iVK9VoUF9cZOEAOEVxvDK8KXO0o9SNmmZCxR1Khi5NRswDKX8u4GAWS8xwoqBC4pcOqV_qnFjYLs517Om0xO1QHI2kcBI1WGjiJFFb04Zts1as1Uahi9N32wGfahx2Zl6XbvRQvWXqK3las Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c840f648f684b23bd33f59b466ae029"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c840f648f684b23bd33f59b466ae029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8c840f648f684b23bd33f59b466ae029 Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1170315804 Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8586e37b47d141f08610633fce374d84 Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-SecurityGroupsTestJSON-1170315804-project Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 696d8484-201d-4f79-9df8-4dbe1d196b6c could not be found. Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '696d8484-201d-4f79-9df8-4dbe1d196b6c'} Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 696d8484-201d-4f79-9df8-4dbe1d196b6c could not be found. Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 696d8484-201d-4f79-9df8-4dbe1d196b6c could not be found. Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:15.908044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:15.911518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:15.911518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:15.911518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:15.911518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:15.911518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:15.911518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 696d8484-201d-4f79-9df8-4dbe1d196b6c could not be found. Aug 27 04:40:15.911518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:15.914134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d2299202-b675-473b-a2a8-658efef65bde tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Returning 404 to user: Instance 696d8484-201d-4f79-9df8-4dbe1d196b6c could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:15.915610 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d2299202-b675-473b-a2a8-658efef65bde tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c" status: 404 len: 111 microversion: 2.1 time: 0.067417 Aug 27 04:40:15.917538 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1155/2329] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:15 2022] GET /compute/v2.1/servers/696d8484-201d-4f79-9df8-4dbe1d196b6c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:15.918824 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c9cf22d6-56fa-434b-bcc3-cfa6c9858dd0 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] HTTP exception thrown: Image not found. Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c9cf22d6-56fa-434b-bcc3-cfa6c9858dd0 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Request method failure captured: Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 HTTP/1.1 Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_woK6Ya4niQrEexsBKsmTunnoQzAO464p8PeA03wzY9CL5lS0eb6OvDOmvJYJQRK4JLtIsixVSUL3NSaPJm4n0735dfFH1sTIqVav26y--Y0zn0Onr3h3JOH_aqY2hwxzDLbbpFawcM5RnOP4CPyyBEMZg6fcFwm1WjtI6I7VrRiw Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 851596d90257494a92286fd41e796615 Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerTestJSON-1879319611 Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/851596d90257494a92286fd41e796615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_851596d90257494a92286fd41e796615"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/851596d90257494a92286fd41e796615"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/851596d90257494a92286fd41e796615"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerTestJSON-1879319611 Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 851596d90257494a92286fd41e796615 Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1879319611 Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerTestJSON-1879319611-project Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 79b9b0d20ee74c999f83602bfb52b705 Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerTestJSON-1879319611-project Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: exception: Image not found. Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '4b80c972-4657-46ca-856a-b827b8ef7696'} Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4b80c972-4657-46ca-856a-b827b8ef7696 Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:40:15.923152 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4b80c972-4657-46ca-856a-b827b8ef7696 could not be found. Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c9cf22d6-56fa-434b-bcc3-cfa6c9858dd0 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c9cf22d6-56fa-434b-bcc3-cfa6c9858dd0 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 404 len: 62 microversion: 2.1 time: 0.079855 Aug 27 04:40:15.926966 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1175/2330] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:15 2022] GET /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:40:15.934904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dcc42353-5bb4-4857-a522-ec347ef5b2b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:15.935809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dcc42353-5bb4-4857-a522-ec347ef5b2b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: fee11b39-0c51-4f70-b911-6b111653c849] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:15.942149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:15.944907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d924805b-95e1-4452-9ad8-bb2c23d2d27d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f21bb4430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:16.106992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dcc42353-5bb4-4857-a522-ec347ef5b2b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:16.120234 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dcc42353-5bb4-4857-a522-ec347ef5b2b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849" status: 200 len: 1215 microversion: 2.1 time: 0.200998 Aug 27 04:40:16.139373 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1156/2331] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:15 2022] GET /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849 => generated 1215 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:16.146916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1b53b8e6-f00d-4e71-a9d5-e2b2bebfd07d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-515039637"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:16.156776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1b53b8e6-f00d-4e71-a9d5-e2b2bebfd07d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:16.177443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b53b8e6-f00d-4e71-a9d5-e2b2bebfd07d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:16.178511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b53b8e6-f00d-4e71-a9d5-e2b2bebfd07d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:16.178511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b53b8e6-f00d-4e71-a9d5-e2b2bebfd07d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:16.179113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b53b8e6-f00d-4e71-a9d5-e2b2bebfd07d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:16.179576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b53b8e6-f00d-4e71-a9d5-e2b2bebfd07d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:16.180000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b53b8e6-f00d-4e71-a9d5-e2b2bebfd07d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:16.382190 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d924805b-95e1-4452-9ad8-bb2c23d2d27d tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/495d1828-8f2f-4c46-b78e-d9cb0df5063f" status: 202 len: 0 microversion: 2.1 time: 0.453900 Aug 27 04:40:16.384008 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1176/2332] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:40:15 2022] DELETE /compute/v2.1/os-security-groups/495d1828-8f2f-4c46-b78e-d9cb0df5063f => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:16.393221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a5ab3f24-effb-4565-bb35-84ca5fad5b23 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:16.394478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a5ab3f24-effb-4565-bb35-84ca5fad5b23 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: fee11b39-0c51-4f70-b911-6b111653c849] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:16.426059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:16.461403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a5ab3f24-effb-4565-bb35-84ca5fad5b23 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: fee11b39-0c51-4f70-b911-6b111653c849] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:40:16.719767 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.scheduler.client.report [None req-a5ab3f24-effb-4565-bb35-84ca5fad5b23 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Deleted allocations for instance fee11b39-0c51-4f70-b911-6b111653c849 Aug 27 04:40:16.755390 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1b53b8e6-f00d-4e71-a9d5-e2b2bebfd07d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "POST /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f/action" status: 202 len: 0 microversion: 2.1 time: 0.614438 Aug 27 04:40:16.757560 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1157/2333] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:40:16 2022] POST /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:40:16.769929 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a5ab3f24-effb-4565-bb35-84ca5fad5b23 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849" status: 204 len: 0 microversion: 2.1 time: 0.375787 Aug 27 04:40:16.770994 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1177/2334] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:40:16 2022] DELETE /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:40:16.771803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68648131-26a3-45a3-81c5-d6a17cf26639 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] Calling method '.version_select at 0x7f1f213fb790>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:16.778429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-034b58e3-3be0-42e2-bd34-b717184991e3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:16.779312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-034b58e3-3be0-42e2-bd34-b717184991e3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:16.817636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-034b58e3-3be0-42e2-bd34-b717184991e3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:16.818587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-034b58e3-3be0-42e2-bd34-b717184991e3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:16.819198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-034b58e3-3be0-42e2-bd34-b717184991e3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:16.821096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-034b58e3-3be0-42e2-bd34-b717184991e3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:16.821744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-034b58e3-3be0-42e2-bd34-b717184991e3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:16.827915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-034b58e3-3be0-42e2-bd34-b717184991e3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:17.142097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-034b58e3-3be0-42e2-bd34-b717184991e3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:17.151043 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-034b58e3-3be0-42e2-bd34-b717184991e3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.378814 Aug 27 04:40:17.153304 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1178/2335] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:16 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:17.162326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a72dab63-2d8b-489c-a28d-63ebc8d6a971 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f25c8fc10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:17.225407 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a72dab63-2d8b-489c-a28d-63ebc8d6a971 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.069489 Aug 27 04:40:17.227280 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1179/2336] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:17 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:17.232510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f29adb6d-0e2a-4ddb-923a-00037d2cdeed tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:17.233392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f29adb6d-0e2a-4ddb-923a-00037d2cdeed tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: fee11b39-0c51-4f70-b911-6b111653c849] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:17.249049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f29adb6d-0e2a-4ddb-923a-00037d2cdeed tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:17.249431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f29adb6d-0e2a-4ddb-923a-00037d2cdeed tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:17.253978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f29adb6d-0e2a-4ddb-923a-00037d2cdeed tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:17.254941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f29adb6d-0e2a-4ddb-923a-00037d2cdeed tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:17.255589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f29adb6d-0e2a-4ddb-923a-00037d2cdeed tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:17.256035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f29adb6d-0e2a-4ddb-923a-00037d2cdeed tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:17.334113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f29adb6d-0e2a-4ddb-923a-00037d2cdeed tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:17.346309 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f29adb6d-0e2a-4ddb-923a-00037d2cdeed tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849" status: 200 len: 1219 microversion: 2.1 time: 0.117580 Aug 27 04:40:17.346904 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1180/2337] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:17 2022] GET /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:17.365195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35ac0493-3d04-4f65-b5dd-0ee32d3e3bf8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:17.365832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35ac0493-3d04-4f65-b5dd-0ee32d3e3bf8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:17.372796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35ac0493-3d04-4f65-b5dd-0ee32d3e3bf8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:17.373294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35ac0493-3d04-4f65-b5dd-0ee32d3e3bf8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:17.373739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35ac0493-3d04-4f65-b5dd-0ee32d3e3bf8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:17.374519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35ac0493-3d04-4f65-b5dd-0ee32d3e3bf8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:17.374914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35ac0493-3d04-4f65-b5dd-0ee32d3e3bf8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:17.375719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35ac0493-3d04-4f65-b5dd-0ee32d3e3bf8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:17.541693 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-68648131-26a3-45a3-81c5-d6a17cf26639 tempest-SecurityGroupsTestJSON-1170315804 tempest-SecurityGroupsTestJSON-1170315804-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/8b4becf2-156e-4d21-a007-a96024279c4b" status: 202 len: 0 microversion: 2.1 time: 0.782398 Aug 27 04:40:17.542968 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1158/2338] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:40:16 2022] DELETE /compute/v2.1/os-security-groups/8b4becf2-156e-4d21-a007-a96024279c4b => generated 0 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:17.550841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-692e8376-eec8-4374-a487-c2621617f629 req-ede1fe11-d6e5-47c5-b4ad-15f7821197fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39575026-a753-4c15-ba36-59029811826f", "name": "network-vif-unplugged", "status": "completed", "tag": "e868a365-84b1-4305-9f13-56da941f9db8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:17.592656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-692e8376-eec8-4374-a487-c2621617f629 req-ede1fe11-d6e5-47c5-b4ad-15f7821197fd service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:17.596279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-692e8376-eec8-4374-a487-c2621617f629 req-ede1fe11-d6e5-47c5-b4ad-15f7821197fd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:17.599603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-692e8376-eec8-4374-a487-c2621617f629 req-ede1fe11-d6e5-47c5-b4ad-15f7821197fd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:17.600848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35ac0493-3d04-4f65-b5dd-0ee32d3e3bf8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:17.610901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35ac0493-3d04-4f65-b5dd-0ee32d3e3bf8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:17.615099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35ac0493-3d04-4f65-b5dd-0ee32d3e3bf8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:17.616913 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35ac0493-3d04-4f65-b5dd-0ee32d3e3bf8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.268609 Aug 27 04:40:17.618445 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1181/2339] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:17 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:17.637580 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-692e8376-eec8-4374-a487-c2621617f629 req-ede1fe11-d6e5-47c5-b4ad-15f7821197fd service nova] Creating event network-vif-unplugged:e868a365-84b1-4305-9f13-56da941f9db8 for instance 39575026-a753-4c15-ba36-59029811826f on n-h2-854823-1 Aug 27 04:40:17.646792 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-692e8376-eec8-4374-a487-c2621617f629 req-ede1fe11-d6e5-47c5-b4ad-15f7821197fd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101324 Aug 27 04:40:17.648403 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1159/2340] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:18.180024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7dd05c24-7afe-42c1-994d-1acd8dd8592e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:18.180750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7dd05c24-7afe-42c1-994d-1acd8dd8592e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:18.193223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dd05c24-7afe-42c1-994d-1acd8dd8592e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:18.195905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dd05c24-7afe-42c1-994d-1acd8dd8592e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:18.196435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dd05c24-7afe-42c1-994d-1acd8dd8592e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:18.203643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dd05c24-7afe-42c1-994d-1acd8dd8592e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:18.204168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dd05c24-7afe-42c1-994d-1acd8dd8592e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:18.207592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dd05c24-7afe-42c1-994d-1acd8dd8592e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:18.247027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0fb911e3-431e-45de-8b06-7537d958dd01 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f2130c160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:18.354314 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0fb911e3-431e-45de-8b06-7537d958dd01 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.114251 Aug 27 04:40:18.356522 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1160/2341] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:18 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:18.418058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c52da1b-eb77-4a0d-a190-0420feb6c49f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:18.424990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4c52da1b-eb77-4a0d-a190-0420feb6c49f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: fee11b39-0c51-4f70-b911-6b111653c849] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:18.446908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c52da1b-eb77-4a0d-a190-0420feb6c49f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:18.447431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c52da1b-eb77-4a0d-a190-0420feb6c49f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:18.449773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c52da1b-eb77-4a0d-a190-0420feb6c49f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:18.450889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c52da1b-eb77-4a0d-a190-0420feb6c49f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:18.451661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c52da1b-eb77-4a0d-a190-0420feb6c49f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:18.452254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c52da1b-eb77-4a0d-a190-0420feb6c49f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:18.494605 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-4c52da1b-eb77-4a0d-a190-0420feb6c49f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c52da1b-eb77-4a0d-a190-0420feb6c49f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849 HTTP/1.1 Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'fee11b39-0c51-4f70-b911-6b111653c849'} Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:18.501474 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:18.504750 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:18.504750 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:18.504750 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:18.504750 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:18.504750 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:18.504750 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:40:18.504750 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:40:18.511312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c52da1b-eb77-4a0d-a190-0420feb6c49f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:18.513773 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4c52da1b-eb77-4a0d-a190-0420feb6c49f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849" status: 404 len: 111 microversion: 2.1 time: 0.113147 Aug 27 04:40:18.514518 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1161/2342] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:18 2022] GET /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:18.539418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7dd05c24-7afe-42c1-994d-1acd8dd8592e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:18.552283 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7dd05c24-7afe-42c1-994d-1acd8dd8592e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.382260 Aug 27 04:40:18.553447 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1182/2343] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:18 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:18.644415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef295ba9-d768-46ec-ab49-fdb980d39fa4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:18.645089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ef295ba9-d768-46ec-ab49-fdb980d39fa4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:18.656106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef295ba9-d768-46ec-ab49-fdb980d39fa4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:18.656663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef295ba9-d768-46ec-ab49-fdb980d39fa4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:18.657117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef295ba9-d768-46ec-ab49-fdb980d39fa4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:18.657846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef295ba9-d768-46ec-ab49-fdb980d39fa4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:18.658310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef295ba9-d768-46ec-ab49-fdb980d39fa4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:18.658748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef295ba9-d768-46ec-ab49-fdb980d39fa4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:18.742131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1301225735", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "fa9d001d-b3bf-4c75-aaaf-2dd93a5532f5"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:18.807963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] validate_networks() for [('fa9d001d-b3bf-4c75-aaaf-2dd93a5532f5', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:40:19.134199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef295ba9-d768-46ec-ab49-fdb980d39fa4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:19.144009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef295ba9-d768-46ec-ab49-fdb980d39fa4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:19.150393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef295ba9-d768-46ec-ab49-fdb980d39fa4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:19.152945 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ef295ba9-d768-46ec-ab49-fdb980d39fa4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.512357 Aug 27 04:40:19.156848 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1162/2344] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:18 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:19.383121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5defafc0-6264-4159-96bf-ada874c6a0df tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Action: 'create', calling method: .version_select at 0x7f1f2156ba60>, body: {"keypair": {"name": "tempest-keypair-1980467507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAYc+py+nBLfR5rJgvsCQITPz5AilbDT0sKSN3gwgJlBzUNZCsdhh/vBYggCYwPFBcY13jXZ9E2sF206G6gX3Chixchqc87keQyosMDdnRhIs/9+yI7kSfmieHN6HADmA=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:19.430524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-5defafc0-6264-4159-96bf-ada874c6a0df tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Getting quotas for project 7774d5268c134a52a0037ac64bf9735f. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:40:19.438770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-5defafc0-6264-4159-96bf-ada874c6a0df tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Getting quotas for user 7886b73059f64e6b9c7d7675549ab38d and project 7774d5268c134a52a0037ac64bf9735f. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:40:19.483752 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5defafc0-6264-4159-96bf-ada874c6a0df tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.269706 Aug 27 04:40:19.487603 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1163/2345] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:40:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:40:19.493776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c42df51-cb08-4e2c-b1c9-9c79fa6b323d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f21572b80>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:19.603256 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1c42df51-cb08-4e2c-b1c9-9c79fa6b323d tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.113761 Aug 27 04:40:19.614516 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1164/2346] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:19 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:19.629948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-57e4b41d-9e53-4620-91ab-1dece55360a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:19.634018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-57e4b41d-9e53-4620-91ab-1dece55360a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:19.654505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57e4b41d-9e53-4620-91ab-1dece55360a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:19.655886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57e4b41d-9e53-4620-91ab-1dece55360a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:19.657066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57e4b41d-9e53-4620-91ab-1dece55360a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:19.661082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57e4b41d-9e53-4620-91ab-1dece55360a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:19.661945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57e4b41d-9e53-4620-91ab-1dece55360a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:19.663297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57e4b41d-9e53-4620-91ab-1dece55360a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:19.710951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:20.038775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-57e4b41d-9e53-4620-91ab-1dece55360a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:20.050702 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-57e4b41d-9e53-4620-91ab-1dece55360a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.432957 Aug 27 04:40:20.057059 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1165/2347] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:19 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:20.181967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-943d3391-9c21-4d59-b67e-6cbd8cfe5cf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:20.183661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-943d3391-9c21-4d59-b67e-6cbd8cfe5cf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:20.197653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-943d3391-9c21-4d59-b67e-6cbd8cfe5cf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:20.199896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-943d3391-9c21-4d59-b67e-6cbd8cfe5cf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:20.200588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-943d3391-9c21-4d59-b67e-6cbd8cfe5cf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:20.209164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-943d3391-9c21-4d59-b67e-6cbd8cfe5cf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:20.210407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-943d3391-9c21-4d59-b67e-6cbd8cfe5cf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:20.212356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-943d3391-9c21-4d59-b67e-6cbd8cfe5cf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:20.605037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:40:20.605491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:40:20.605944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:40:20.606491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:40:20.606785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:40:20.622134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:20.622773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:20.623412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:20.624404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:20.625294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:20.625879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:20.657444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Getting quotas for project b902932050be4c04bca1de4fe268c2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:40:20.667711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Getting quotas for user 6c59dc5e251943d59de8b2d640643a0e and project b902932050be4c04bca1de4fe268c2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:40:20.689598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:40:20.692444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:40:20.734578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-943d3391-9c21-4d59-b67e-6cbd8cfe5cf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:20.752598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-943d3391-9c21-4d59-b67e-6cbd8cfe5cf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:20.763121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-943d3391-9c21-4d59-b67e-6cbd8cfe5cf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:20.766601 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-943d3391-9c21-4d59-b67e-6cbd8cfe5cf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.589372 Aug 27 04:40:20.772269 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1166/2348] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:20 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:40:20.790319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cb58d23c-39bf-4387-8e4d-7c95336a612a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f21572160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:20.813347 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe0f9618-4316-4acc-98fa-c79b5a7712ab tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.072047 Aug 27 04:40:20.820203 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1183/2349] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:40:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:40:20.843309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-798cd32a-666b-48b9-a9ee-0847ca14462c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:20.846629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-798cd32a-666b-48b9-a9ee-0847ca14462c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:20.903891 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cb58d23c-39bf-4387-8e4d-7c95336a612a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.130337 Aug 27 04:40:20.904487 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1167/2350] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:20 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:20.973323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-798cd32a-666b-48b9-a9ee-0847ca14462c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:20.981076 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-798cd32a-666b-48b9-a9ee-0847ca14462c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1215 microversion: 2.1 time: 0.150894 Aug 27 04:40:20.981988 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1184/2351] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:20 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:21.088338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9f3c82bc-f250-4f82-93bd-4b18d3a64adb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:21.089571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9f3c82bc-f250-4f82-93bd-4b18d3a64adb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:21.103845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f3c82bc-f250-4f82-93bd-4b18d3a64adb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:21.104352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f3c82bc-f250-4f82-93bd-4b18d3a64adb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:21.105427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f3c82bc-f250-4f82-93bd-4b18d3a64adb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:21.106153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f3c82bc-f250-4f82-93bd-4b18d3a64adb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:21.106622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f3c82bc-f250-4f82-93bd-4b18d3a64adb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:21.107072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f3c82bc-f250-4f82-93bd-4b18d3a64adb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:21.799185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a16f4b7b-84da-4a9d-92e4-66c13681dfaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:21.799789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a16f4b7b-84da-4a9d-92e4-66c13681dfaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:21.817601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a16f4b7b-84da-4a9d-92e4-66c13681dfaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:21.824760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a16f4b7b-84da-4a9d-92e4-66c13681dfaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:21.825465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a16f4b7b-84da-4a9d-92e4-66c13681dfaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:21.826381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a16f4b7b-84da-4a9d-92e4-66c13681dfaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:21.827314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a16f4b7b-84da-4a9d-92e4-66c13681dfaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:21.829196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a16f4b7b-84da-4a9d-92e4-66c13681dfaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:22.258715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9f3c82bc-f250-4f82-93bd-4b18d3a64adb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:22.272102 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9f3c82bc-f250-4f82-93bd-4b18d3a64adb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 1.194954 Aug 27 04:40:22.273801 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1168/2352] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:21 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:22.282012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd3ee625-270a-4bb3-bc79-678cd9ff761b tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f21564700>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:22.394539 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fd3ee625-270a-4bb3-bc79-678cd9ff761b tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.116858 Aug 27 04:40:22.395655 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1169/2353] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:22 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:22.410297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e0efdc4-2be4-4421-849b-750ed47ddafe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:22.417851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e0efdc4-2be4-4421-849b-750ed47ddafe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:22.461594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e0efdc4-2be4-4421-849b-750ed47ddafe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:22.463996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e0efdc4-2be4-4421-849b-750ed47ddafe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:22.465721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e0efdc4-2be4-4421-849b-750ed47ddafe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:22.466645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e0efdc4-2be4-4421-849b-750ed47ddafe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:22.470601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e0efdc4-2be4-4421-849b-750ed47ddafe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:22.477603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e0efdc4-2be4-4421-849b-750ed47ddafe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:22.762319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9e0efdc4-2be4-4421-849b-750ed47ddafe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:22.777870 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e0efdc4-2be4-4421-849b-750ed47ddafe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1267 microversion: 2.1 time: 0.377528 Aug 27 04:40:22.778983 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1170/2354] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:22 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1267 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:23.011512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a16f4b7b-84da-4a9d-92e4-66c13681dfaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:23.053281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a16f4b7b-84da-4a9d-92e4-66c13681dfaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:23.063726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a16f4b7b-84da-4a9d-92e4-66c13681dfaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:23.074110 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a16f4b7b-84da-4a9d-92e4-66c13681dfaa tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 1.273682 Aug 27 04:40:23.082084 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1185/2355] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:21 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:23.298339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-78878a3a-66cd-41ce-8d46-9f0832f4b402 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:23.299107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-78878a3a-66cd-41ce-8d46-9f0832f4b402 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:23.316573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78878a3a-66cd-41ce-8d46-9f0832f4b402 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:23.317477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78878a3a-66cd-41ce-8d46-9f0832f4b402 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:23.318169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78878a3a-66cd-41ce-8d46-9f0832f4b402 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:23.319701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78878a3a-66cd-41ce-8d46-9f0832f4b402 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:23.320354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78878a3a-66cd-41ce-8d46-9f0832f4b402 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:23.322854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78878a3a-66cd-41ce-8d46-9f0832f4b402 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:23.412730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-005c4f43-6dc9-4f09-8635-f238ab613b02 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f21b50e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:23.527542 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-005c4f43-6dc9-4f09-8635-f238ab613b02 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.119820 Aug 27 04:40:23.537174 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1186/2356] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:23 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:23.801761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dcbf4ddb-d619-4efb-b544-0da67bfbf5ff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:23.802535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dcbf4ddb-d619-4efb-b544-0da67bfbf5ff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:23.830212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcbf4ddb-d619-4efb-b544-0da67bfbf5ff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:23.830893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcbf4ddb-d619-4efb-b544-0da67bfbf5ff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:23.831359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcbf4ddb-d619-4efb-b544-0da67bfbf5ff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:23.837242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcbf4ddb-d619-4efb-b544-0da67bfbf5ff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:23.838046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcbf4ddb-d619-4efb-b544-0da67bfbf5ff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:23.838504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcbf4ddb-d619-4efb-b544-0da67bfbf5ff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:23.863820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-78878a3a-66cd-41ce-8d46-9f0832f4b402 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:23.878193 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-78878a3a-66cd-41ce-8d46-9f0832f4b402 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.584835 Aug 27 04:40:23.885513 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1171/2357] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:23 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:24.111711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ad0560cd-7d88-4fba-b962-4a8d513e2b1d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:24.112751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ad0560cd-7d88-4fba-b962-4a8d513e2b1d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:24.122771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad0560cd-7d88-4fba-b962-4a8d513e2b1d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:24.129366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad0560cd-7d88-4fba-b962-4a8d513e2b1d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:24.130677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad0560cd-7d88-4fba-b962-4a8d513e2b1d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:24.133222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad0560cd-7d88-4fba-b962-4a8d513e2b1d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:24.134745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad0560cd-7d88-4fba-b962-4a8d513e2b1d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:24.141730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad0560cd-7d88-4fba-b962-4a8d513e2b1d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:24.411322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ad0560cd-7d88-4fba-b962-4a8d513e2b1d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:24.426557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ad0560cd-7d88-4fba-b962-4a8d513e2b1d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:24.428058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ad0560cd-7d88-4fba-b962-4a8d513e2b1d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:24.432390 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ad0560cd-7d88-4fba-b962-4a8d513e2b1d tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.325155 Aug 27 04:40:24.434020 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1172/2358] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:24 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:24.438768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e5aa8930-e460-4570-b738-dbdcf744f938 req-9ab75dfc-bf00-47b5-835b-db8bd220f865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39575026-a753-4c15-ba36-59029811826f", "name": "network-vif-plugged", "status": "completed", "tag": "e868a365-84b1-4305-9f13-56da941f9db8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:24.468214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e5aa8930-e460-4570-b738-dbdcf744f938 req-9ab75dfc-bf00-47b5-835b-db8bd220f865 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:24.468741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e5aa8930-e460-4570-b738-dbdcf744f938 req-9ab75dfc-bf00-47b5-835b-db8bd220f865 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:24.469185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e5aa8930-e460-4570-b738-dbdcf744f938 req-9ab75dfc-bf00-47b5-835b-db8bd220f865 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:24.494725 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e5aa8930-e460-4570-b738-dbdcf744f938 req-9ab75dfc-bf00-47b5-835b-db8bd220f865 service nova] Creating event network-vif-plugged:e868a365-84b1-4305-9f13-56da941f9db8 for instance 39575026-a753-4c15-ba36-59029811826f on n-h2-854823-1 Aug 27 04:40:24.508810 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e5aa8930-e460-4570-b738-dbdcf744f938 req-9ab75dfc-bf00-47b5-835b-db8bd220f865 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073329 Aug 27 04:40:24.509458 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1173/2359] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:24.550228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-911b894a-962e-464a-8398-d6caa0e5c8ed tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f2156be50>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:24.645346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dcbf4ddb-d619-4efb-b544-0da67bfbf5ff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:24.680374 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-911b894a-962e-464a-8398-d6caa0e5c8ed tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.138016 Aug 27 04:40:24.683091 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dcbf4ddb-d619-4efb-b544-0da67bfbf5ff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1275 microversion: 2.1 time: 0.883680 Aug 27 04:40:24.701026 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1174/2360] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:24 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:24.708958 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1187/2361] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:23 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1275 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:24.909380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-86c9a982-550a-45fe-b1d6-b5fa3ac09385 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:24.911299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-86c9a982-550a-45fe-b1d6-b5fa3ac09385 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:24.948878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86c9a982-550a-45fe-b1d6-b5fa3ac09385 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:24.949611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86c9a982-550a-45fe-b1d6-b5fa3ac09385 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:24.950617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86c9a982-550a-45fe-b1d6-b5fa3ac09385 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:24.955889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86c9a982-550a-45fe-b1d6-b5fa3ac09385 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:24.956686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86c9a982-550a-45fe-b1d6-b5fa3ac09385 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:24.960315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86c9a982-550a-45fe-b1d6-b5fa3ac09385 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:24.984471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1277706429", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c724f16c-d875-4f58-8d82-354774072096"}], "security_groups": [{"name": "tempest-securitygroup--96851069"}], "key_name": "tempest-keypair-1980467507", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:25.347496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] validate_networks() for [('c724f16c-d875-4f58-8d82-354774072096', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:40:25.764729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-86c9a982-550a-45fe-b1d6-b5fa3ac09385 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:25.781113 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-86c9a982-550a-45fe-b1d6-b5fa3ac09385 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.877131 Aug 27 04:40:25.783843 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1175/2362] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:24 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:25.788912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-42bc09ac-708e-42d2-bf17-5ac9f27ee4d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:25.789535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-42bc09ac-708e-42d2-bf17-5ac9f27ee4d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:25.809415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42bc09ac-708e-42d2-bf17-5ac9f27ee4d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:25.809842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42bc09ac-708e-42d2-bf17-5ac9f27ee4d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:25.810281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42bc09ac-708e-42d2-bf17-5ac9f27ee4d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:25.815645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42bc09ac-708e-42d2-bf17-5ac9f27ee4d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:25.816305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42bc09ac-708e-42d2-bf17-5ac9f27ee4d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:25.816850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42bc09ac-708e-42d2-bf17-5ac9f27ee4d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:26.466842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Getting quotas for project 7774d5268c134a52a0037ac64bf9735f. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:40:26.487996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Getting quotas for user 7886b73059f64e6b9c7d7675549ab38d and project 7774d5268c134a52a0037ac64bf9735f. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:40:26.537791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:40:26.538915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:40:26.540825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:40:26.542715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:40:26.543304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:40:26.565726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-42bc09ac-708e-42d2-bf17-5ac9f27ee4d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:26.584461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:26.585101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-42bc09ac-708e-42d2-bf17-5ac9f27ee4d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:26.585798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:26.589597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:26.591807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-42bc09ac-708e-42d2-bf17-5ac9f27ee4d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:26.592723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:26.593449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:26.594768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:26.595328 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-42bc09ac-708e-42d2-bf17-5ac9f27ee4d4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.810403 Aug 27 04:40:26.618428 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1176/2363] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:25 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:26.623964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:26.655299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-77e4b3d8-c65f-401a-9bdf-d8eaa9531492 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f214d5160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:26.657863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Getting quotas for project 7774d5268c134a52a0037ac64bf9735f. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:40:26.683518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Getting quotas for user 7886b73059f64e6b9c7d7675549ab38d and project 7774d5268c134a52a0037ac64bf9735f. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:40:26.724397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:40:26.734386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:40:26.765891 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-77e4b3d8-c65f-401a-9bdf-d8eaa9531492 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.145624 Aug 27 04:40:26.766485 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1177/2364] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:26 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:26.782306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f6325729-7b67-4adc-a85e-49cc92f64323 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:26.782932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f6325729-7b67-4adc-a85e-49cc92f64323 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:26.816301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6325729-7b67-4adc-a85e-49cc92f64323 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:26.816906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6325729-7b67-4adc-a85e-49cc92f64323 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:26.821970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6325729-7b67-4adc-a85e-49cc92f64323 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:26.827686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6325729-7b67-4adc-a85e-49cc92f64323 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:26.831458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6325729-7b67-4adc-a85e-49cc92f64323 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:26.835777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6325729-7b67-4adc-a85e-49cc92f64323 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:26.873303 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3079415f-c38a-4416-8260-ff64389a23ff tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.895087 Aug 27 04:40:26.875647 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1188/2365] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:40:24 2022] POST /compute/v2.1/servers => generated 407 bytes in 1899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:40:26.892292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c7fc70a-791b-4de9-9e44-dce6e0b50d69 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:26.894305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c7fc70a-791b-4de9-9e44-dce6e0b50d69 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:26.916736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c7fc70a-791b-4de9-9e44-dce6e0b50d69 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:26.917696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c7fc70a-791b-4de9-9e44-dce6e0b50d69 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:26.919000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c7fc70a-791b-4de9-9e44-dce6e0b50d69 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:26.922408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c7fc70a-791b-4de9-9e44-dce6e0b50d69 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:26.923077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c7fc70a-791b-4de9-9e44-dce6e0b50d69 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:26.923672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c7fc70a-791b-4de9-9e44-dce6e0b50d69 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:27.426642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f6325729-7b67-4adc-a85e-49cc92f64323 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:27.438769 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f6325729-7b67-4adc-a85e-49cc92f64323 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1273 microversion: 2.1 time: 0.671232 Aug 27 04:40:27.439376 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1178/2366] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:26 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1273 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:27.443935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-651b8088-94e7-48d5-ad08-2b44b1e97af4 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:27.444491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-651b8088-94e7-48d5-ad08-2b44b1e97af4 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:27.659513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5c7fc70a-791b-4de9-9e44-dce6e0b50d69 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:27.668906 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c7fc70a-791b-4de9-9e44-dce6e0b50d69 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.790850 Aug 27 04:40:27.669527 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1189/2367] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:26 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:27.678137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e49924b4-2684-4b58-b270-22c62d38dfac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:27.678974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e49924b4-2684-4b58-b270-22c62d38dfac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:27.698178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e49924b4-2684-4b58-b270-22c62d38dfac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:27.699914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e49924b4-2684-4b58-b270-22c62d38dfac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:27.702669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e49924b4-2684-4b58-b270-22c62d38dfac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:27.703582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e49924b4-2684-4b58-b270-22c62d38dfac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:27.704908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e49924b4-2684-4b58-b270-22c62d38dfac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:27.707911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e49924b4-2684-4b58-b270-22c62d38dfac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:28.121840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e49924b4-2684-4b58-b270-22c62d38dfac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:28.133999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e49924b4-2684-4b58-b270-22c62d38dfac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:28.155383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e49924b4-2684-4b58-b270-22c62d38dfac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:28.162718 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e49924b4-2684-4b58-b270-22c62d38dfac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.492112 Aug 27 04:40:28.169364 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1190/2368] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:27 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:28.174605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c663b30-4d60-432b-918a-a78f43fdfb29 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f21b2e1f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:28.333845 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c663b30-4d60-432b-918a-a78f43fdfb29 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.162923 Aug 27 04:40:28.334982 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1191/2369] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:28 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:28.419883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-651b8088-94e7-48d5-ad08-2b44b1e97af4 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:28.432175 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-651b8088-94e7-48d5-ad08-2b44b1e97af4 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1278 microversion: 2.1 time: 0.991664 Aug 27 04:40:28.434269 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1179/2370] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:27 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1278 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:28.464611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01e7374d-c33a-4423-ae12-6c64f31249f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:28.465718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01e7374d-c33a-4423-ae12-6c64f31249f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:28.479245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01e7374d-c33a-4423-ae12-6c64f31249f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:28.482826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01e7374d-c33a-4423-ae12-6c64f31249f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:28.486705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01e7374d-c33a-4423-ae12-6c64f31249f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:28.491880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01e7374d-c33a-4423-ae12-6c64f31249f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:28.496650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01e7374d-c33a-4423-ae12-6c64f31249f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:28.497344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01e7374d-c33a-4423-ae12-6c64f31249f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:28.696184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-57a6adb3-19b8-400c-b2f1-da1aa742ae2a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:28.696963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-57a6adb3-19b8-400c-b2f1-da1aa742ae2a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:28.708287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57a6adb3-19b8-400c-b2f1-da1aa742ae2a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:28.713602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57a6adb3-19b8-400c-b2f1-da1aa742ae2a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:28.714268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57a6adb3-19b8-400c-b2f1-da1aa742ae2a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:28.724960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57a6adb3-19b8-400c-b2f1-da1aa742ae2a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:28.727579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57a6adb3-19b8-400c-b2f1-da1aa742ae2a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:28.739784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57a6adb3-19b8-400c-b2f1-da1aa742ae2a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:29.211023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01e7374d-c33a-4423-ae12-6c64f31249f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:29.242368 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01e7374d-c33a-4423-ae12-6c64f31249f0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1315 microversion: 2.1 time: 0.779645 Aug 27 04:40:29.261686 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1192/2371] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:28 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:29.283753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f781b186-6399-4374-a3a1-eb003ea23a93 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:29.288521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f781b186-6399-4374-a3a1-eb003ea23a93 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:29.302309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f781b186-6399-4374-a3a1-eb003ea23a93 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:29.303062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f781b186-6399-4374-a3a1-eb003ea23a93 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:29.305205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f781b186-6399-4374-a3a1-eb003ea23a93 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:29.306113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f781b186-6399-4374-a3a1-eb003ea23a93 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:29.313510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f781b186-6399-4374-a3a1-eb003ea23a93 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:29.313961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f781b186-6399-4374-a3a1-eb003ea23a93 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:29.750521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f781b186-6399-4374-a3a1-eb003ea23a93 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:29.775899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f781b186-6399-4374-a3a1-eb003ea23a93 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:29.790871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f781b186-6399-4374-a3a1-eb003ea23a93 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:29.794422 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f781b186-6399-4374-a3a1-eb003ea23a93 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.530348 Aug 27 04:40:29.804139 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1193/2372] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:29 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:29.811853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-921bae19-1fa3-49c2-aee4-9c4edc212985 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f25d23430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:29.902521 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-921bae19-1fa3-49c2-aee4-9c4edc212985 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.097049 Aug 27 04:40:29.903658 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1194/2373] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:29 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:29.917936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf686788-ee62-4fcd-8e50-6f83bce86028 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:29.918295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-57a6adb3-19b8-400c-b2f1-da1aa742ae2a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:29.920699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf686788-ee62-4fcd-8e50-6f83bce86028 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:29.941919 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-57a6adb3-19b8-400c-b2f1-da1aa742ae2a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 1.249277 Aug 27 04:40:29.968255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf686788-ee62-4fcd-8e50-6f83bce86028 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:29.969392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf686788-ee62-4fcd-8e50-6f83bce86028 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:29.970797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf686788-ee62-4fcd-8e50-6f83bce86028 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:29.972774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf686788-ee62-4fcd-8e50-6f83bce86028 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:29.973925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf686788-ee62-4fcd-8e50-6f83bce86028 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:29.975884 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1180/2374] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:28 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:29.976772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf686788-ee62-4fcd-8e50-6f83bce86028 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:30.116181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf686788-ee62-4fcd-8e50-6f83bce86028 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:30.130919 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf686788-ee62-4fcd-8e50-6f83bce86028 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1336 microversion: 2.1 time: 0.223717 Aug 27 04:40:30.133447 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1195/2375] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:29 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1336 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:30.272069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5b96aab-895a-46c0-a063-6562a50191f3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:30.272861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f5b96aab-895a-46c0-a063-6562a50191f3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:30.284984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5b96aab-895a-46c0-a063-6562a50191f3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:30.287985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5b96aab-895a-46c0-a063-6562a50191f3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:30.288870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5b96aab-895a-46c0-a063-6562a50191f3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:30.292500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5b96aab-895a-46c0-a063-6562a50191f3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:30.295722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5b96aab-895a-46c0-a063-6562a50191f3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:30.296558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5b96aab-895a-46c0-a063-6562a50191f3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:30.843663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-11cd18cc-ac26-40fb-99f6-e81f8ff36d29 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:30.844343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-11cd18cc-ac26-40fb-99f6-e81f8ff36d29 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:30.860928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11cd18cc-ac26-40fb-99f6-e81f8ff36d29 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:30.861530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11cd18cc-ac26-40fb-99f6-e81f8ff36d29 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:30.865484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11cd18cc-ac26-40fb-99f6-e81f8ff36d29 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:30.866313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11cd18cc-ac26-40fb-99f6-e81f8ff36d29 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:30.866877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11cd18cc-ac26-40fb-99f6-e81f8ff36d29 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:30.867324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11cd18cc-ac26-40fb-99f6-e81f8ff36d29 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:31.176350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11cd18cc-ac26-40fb-99f6-e81f8ff36d29 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:31.194848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11cd18cc-ac26-40fb-99f6-e81f8ff36d29 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:31.196639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11cd18cc-ac26-40fb-99f6-e81f8ff36d29 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:31.201158 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-11cd18cc-ac26-40fb-99f6-e81f8ff36d29 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.363519 Aug 27 04:40:31.201786 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1196/2376] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:30 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:31.216308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ccc00d40-834e-4b54-82d5-49578ea4694e tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f25ccd310>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:31.299878 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ccc00d40-834e-4b54-82d5-49578ea4694e tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.093799 Aug 27 04:40:31.300755 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1197/2377] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:31 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:31.315814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3539fd67-10fa-4eff-8391-7e92cb84fc7f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:31.317974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3539fd67-10fa-4eff-8391-7e92cb84fc7f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:31.327115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3539fd67-10fa-4eff-8391-7e92cb84fc7f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:31.328094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3539fd67-10fa-4eff-8391-7e92cb84fc7f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:31.328900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3539fd67-10fa-4eff-8391-7e92cb84fc7f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:31.329841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3539fd67-10fa-4eff-8391-7e92cb84fc7f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:31.330567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3539fd67-10fa-4eff-8391-7e92cb84fc7f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:31.331207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3539fd67-10fa-4eff-8391-7e92cb84fc7f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:31.585726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3539fd67-10fa-4eff-8391-7e92cb84fc7f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:31.601745 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3539fd67-10fa-4eff-8391-7e92cb84fc7f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 0.299479 Aug 27 04:40:31.602583 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1198/2378] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:31 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:31.621816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03edee17-3269-42ea-9165-0725024d1ff8 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:31.624353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03edee17-3269-42ea-9165-0725024d1ff8 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:31.642760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03edee17-3269-42ea-9165-0725024d1ff8 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:31.646270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03edee17-3269-42ea-9165-0725024d1ff8 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:31.648892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03edee17-3269-42ea-9165-0725024d1ff8 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:31.649971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03edee17-3269-42ea-9165-0725024d1ff8 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:31.652879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03edee17-3269-42ea-9165-0725024d1ff8 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:31.653584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03edee17-3269-42ea-9165-0725024d1ff8 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:31.807433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-03edee17-3269-42ea-9165-0725024d1ff8 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:31.840238 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03edee17-3269-42ea-9165-0725024d1ff8 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1336 microversion: 2.1 time: 0.233432 Aug 27 04:40:31.858937 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1199/2379] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:31 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1336 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:32.229559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d7b3842-d19e-4440-9c00-a475eec77d7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:32.230433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d7b3842-d19e-4440-9c00-a475eec77d7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:32.240509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d7b3842-d19e-4440-9c00-a475eec77d7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:32.241775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d7b3842-d19e-4440-9c00-a475eec77d7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:32.242771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d7b3842-d19e-4440-9c00-a475eec77d7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:32.244412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d7b3842-d19e-4440-9c00-a475eec77d7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:32.246772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d7b3842-d19e-4440-9c00-a475eec77d7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:32.247489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d7b3842-d19e-4440-9c00-a475eec77d7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:32.271327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f5b96aab-895a-46c0-a063-6562a50191f3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:32.280988 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f5b96aab-895a-46c0-a063-6562a50191f3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1315 microversion: 2.1 time: 2.013652 Aug 27 04:40:32.285531 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1181/2380] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:30 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1315 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:32.315129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53a45533-a9f1-4ec5-867f-2ad004a6f23e tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f213fb0d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:32.423572 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-53a45533-a9f1-4ec5-867f-2ad004a6f23e tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.112206 Aug 27 04:40:32.424431 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1182/2381] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:32 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:32.513699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d7b3842-d19e-4440-9c00-a475eec77d7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:32.534066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d7b3842-d19e-4440-9c00-a475eec77d7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:32.535863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d7b3842-d19e-4440-9c00-a475eec77d7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:32.538559 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d7b3842-d19e-4440-9c00-a475eec77d7e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.314426 Aug 27 04:40:32.542092 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1200/2382] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:32 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:32.623453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-30ada189-e188-46fc-af96-9e061774a025 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:32.624085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-30ada189-e188-46fc-af96-9e061774a025 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:32.637818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30ada189-e188-46fc-af96-9e061774a025 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:32.638320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30ada189-e188-46fc-af96-9e061774a025 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:32.640851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30ada189-e188-46fc-af96-9e061774a025 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:32.641780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30ada189-e188-46fc-af96-9e061774a025 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:32.643305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30ada189-e188-46fc-af96-9e061774a025 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:32.645842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30ada189-e188-46fc-af96-9e061774a025 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:32.869374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2689ae3-9fa2-48a5-a421-980ed11a52ed tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:32.872193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2689ae3-9fa2-48a5-a421-980ed11a52ed tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:32.905364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2689ae3-9fa2-48a5-a421-980ed11a52ed tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:32.907291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2689ae3-9fa2-48a5-a421-980ed11a52ed tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:32.911249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2689ae3-9fa2-48a5-a421-980ed11a52ed tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:32.915102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2689ae3-9fa2-48a5-a421-980ed11a52ed tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:32.919015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2689ae3-9fa2-48a5-a421-980ed11a52ed tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:32.919157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2689ae3-9fa2-48a5-a421-980ed11a52ed tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:33.143059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b2689ae3-9fa2-48a5-a421-980ed11a52ed tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:33.156232 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2689ae3-9fa2-48a5-a421-980ed11a52ed tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1336 microversion: 2.1 time: 0.293753 Aug 27 04:40:33.172550 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1201/2383] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:32 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1336 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:33.314505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05917bfa-f440-4323-9889-b07a8c809529 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:33.317376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05917bfa-f440-4323-9889-b07a8c809529 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:33.335585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05917bfa-f440-4323-9889-b07a8c809529 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:33.338065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05917bfa-f440-4323-9889-b07a8c809529 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:33.339809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05917bfa-f440-4323-9889-b07a8c809529 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:33.343116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05917bfa-f440-4323-9889-b07a8c809529 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:33.343885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05917bfa-f440-4323-9889-b07a8c809529 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:33.345010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05917bfa-f440-4323-9889-b07a8c809529 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:33.683573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05917bfa-f440-4323-9889-b07a8c809529 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:33.697066 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05917bfa-f440-4323-9889-b07a8c809529 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1315 microversion: 2.1 time: 0.388357 Aug 27 04:40:33.702796 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1202/2384] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:33 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:33.716974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0615f1f5-4cc1-4062-ab2e-429e7fdaffa2 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f25d329d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:33.798665 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0615f1f5-4cc1-4062-ab2e-429e7fdaffa2 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.094493 Aug 27 04:40:33.799603 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1203/2385] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:33 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:33.806348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1245f20b-3445-43a1-ba67-1871b1fde03f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:33.807512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1245f20b-3445-43a1-ba67-1871b1fde03f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:33.815307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1245f20b-3445-43a1-ba67-1871b1fde03f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:33.816068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1245f20b-3445-43a1-ba67-1871b1fde03f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:33.816806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1245f20b-3445-43a1-ba67-1871b1fde03f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:33.817888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1245f20b-3445-43a1-ba67-1871b1fde03f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:33.818753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1245f20b-3445-43a1-ba67-1871b1fde03f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:33.819391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1245f20b-3445-43a1-ba67-1871b1fde03f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:34.017958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1245f20b-3445-43a1-ba67-1871b1fde03f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:34.029325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1245f20b-3445-43a1-ba67-1871b1fde03f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:34.030915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1245f20b-3445-43a1-ba67-1871b1fde03f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:34.032236 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1245f20b-3445-43a1-ba67-1871b1fde03f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.231267 Aug 27 04:40:34.033221 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1204/2386] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:33 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:34.181294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-075b4091-720e-43f2-a5df-15e0ce286dc3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:34.182747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-075b4091-720e-43f2-a5df-15e0ce286dc3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:34.200089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-075b4091-720e-43f2-a5df-15e0ce286dc3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:34.206094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-075b4091-720e-43f2-a5df-15e0ce286dc3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:34.207295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-075b4091-720e-43f2-a5df-15e0ce286dc3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:34.210800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-075b4091-720e-43f2-a5df-15e0ce286dc3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:34.212430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-075b4091-720e-43f2-a5df-15e0ce286dc3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:34.213516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-075b4091-720e-43f2-a5df-15e0ce286dc3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:34.324424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-30ada189-e188-46fc-af96-9e061774a025 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:34.344434 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-30ada189-e188-46fc-af96-9e061774a025 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1716 microversion: 2.1 time: 1.723204 Aug 27 04:40:34.346555 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1183/2387] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:32 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1716 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:34.370848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-075b4091-720e-43f2-a5df-15e0ce286dc3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:34.385338 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-075b4091-720e-43f2-a5df-15e0ce286dc3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1336 microversion: 2.1 time: 0.209754 Aug 27 04:40:34.387282 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1205/2388] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:34 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1336 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:34.729375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ec7376b-fa4f-4e11-8d06-ad89fab64e78 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:34.730468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0ec7376b-fa4f-4e11-8d06-ad89fab64e78 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:34.764178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ec7376b-fa4f-4e11-8d06-ad89fab64e78 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:34.768822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ec7376b-fa4f-4e11-8d06-ad89fab64e78 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:34.772744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ec7376b-fa4f-4e11-8d06-ad89fab64e78 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:34.774238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ec7376b-fa4f-4e11-8d06-ad89fab64e78 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:34.780142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ec7376b-fa4f-4e11-8d06-ad89fab64e78 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:34.783701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ec7376b-fa4f-4e11-8d06-ad89fab64e78 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:35.152503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e6f734c8-190f-4608-bafe-747b8782c910 tempest-AZV2TestJSON-1480270215 tempest-AZV2TestJSON-1480270215-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:35.154926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f734c8-190f-4608-bafe-747b8782c910 tempest-AZV2TestJSON-1480270215 tempest-AZV2TestJSON-1480270215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:35.156156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f734c8-190f-4608-bafe-747b8782c910 tempest-AZV2TestJSON-1480270215 tempest-AZV2TestJSON-1480270215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:35.156941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f734c8-190f-4608-bafe-747b8782c910 tempest-AZV2TestJSON-1480270215 tempest-AZV2TestJSON-1480270215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:35.160331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f734c8-190f-4608-bafe-747b8782c910 tempest-AZV2TestJSON-1480270215 tempest-AZV2TestJSON-1480270215-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:35.162794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f734c8-190f-4608-bafe-747b8782c910 tempest-AZV2TestJSON-1480270215 tempest-AZV2TestJSON-1480270215-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:35.165111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6f734c8-190f-4608-bafe-747b8782c910 tempest-AZV2TestJSON-1480270215 tempest-AZV2TestJSON-1480270215-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:35.220251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:35.229011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0ec7376b-fa4f-4e11-8d06-ad89fab64e78 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:35.250622 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ec7376b-fa4f-4e11-8d06-ad89fab64e78 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1315 microversion: 2.1 time: 0.528375 Aug 27 04:40:35.255624 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1206/2389] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:34 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:35.281261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9170755-5535-4a8a-8e62-4dab7a5d964f tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f21bb49d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:35.290404 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e6f734c8-190f-4608-bafe-747b8782c910 tempest-AZV2TestJSON-1480270215 tempest-AZV2TestJSON-1480270215-project] 10.222.0.79 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.683956 Aug 27 04:40:35.294626 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1184/2390] 10.222.0.79 () {58 vars in 1164 bytes} [Sat Aug 27 04:40:34 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:40:35.328229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-781c0028-884f-4ef1-82d8-eab746eff719 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:35.331300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-781c0028-884f-4ef1-82d8-eab746eff719 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:35.342410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-781c0028-884f-4ef1-82d8-eab746eff719 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:35.343396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-781c0028-884f-4ef1-82d8-eab746eff719 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:35.344077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-781c0028-884f-4ef1-82d8-eab746eff719 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:35.348081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-781c0028-884f-4ef1-82d8-eab746eff719 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:35.349269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-781c0028-884f-4ef1-82d8-eab746eff719 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:35.350352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-781c0028-884f-4ef1-82d8-eab746eff719 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:35.368322 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9170755-5535-4a8a-8e62-4dab7a5d964f tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.109342 Aug 27 04:40:35.376281 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1207/2391] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:35 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:35.704602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78ff9641-de7d-4963-8ff4-35e9db5e4c41 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:35.705295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78ff9641-de7d-4963-8ff4-35e9db5e4c41 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:35.720222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78ff9641-de7d-4963-8ff4-35e9db5e4c41 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:35.722981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78ff9641-de7d-4963-8ff4-35e9db5e4c41 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:35.724491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78ff9641-de7d-4963-8ff4-35e9db5e4c41 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:35.726453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78ff9641-de7d-4963-8ff4-35e9db5e4c41 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:35.726958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78ff9641-de7d-4963-8ff4-35e9db5e4c41 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:35.727396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78ff9641-de7d-4963-8ff4-35e9db5e4c41 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:35.951030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-78ff9641-de7d-4963-8ff4-35e9db5e4c41 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:35.967245 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78ff9641-de7d-4963-8ff4-35e9db5e4c41 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1706 microversion: 2.1 time: 0.596303 Aug 27 04:40:35.980619 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1208/2392] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:35 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1706 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:35.980619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbbfbe2d-1ebb-4a22-a4d3-d8c42b1fa215 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:35.980619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bbbfbe2d-1ebb-4a22-a4d3-d8c42b1fa215 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:35.992019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:35.995799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbbfbe2d-1ebb-4a22-a4d3-d8c42b1fa215 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:35.996350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbbfbe2d-1ebb-4a22-a4d3-d8c42b1fa215 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:35.998193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbbfbe2d-1ebb-4a22-a4d3-d8c42b1fa215 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:35.999025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbbfbe2d-1ebb-4a22-a4d3-d8c42b1fa215 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:36.000596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbbfbe2d-1ebb-4a22-a4d3-d8c42b1fa215 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:36.002716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbbfbe2d-1ebb-4a22-a4d3-d8c42b1fa215 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:36.252274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bbbfbe2d-1ebb-4a22-a4d3-d8c42b1fa215 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:36.267363 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bbbfbe2d-1ebb-4a22-a4d3-d8c42b1fa215 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1402 microversion: 2.1 time: 0.294093 Aug 27 04:40:36.275259 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1209/2393] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:35 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1402 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:36.289177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92c9f541-b8d1-4540-a7c9-a7834e1c2221 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '.version_select at 0x7f1f22011ee0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:36.297367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c9f541-b8d1-4540-a7c9-a7834e1c2221 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:36.301341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c9f541-b8d1-4540-a7c9-a7834e1c2221 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:36.301882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c9f541-b8d1-4540-a7c9-a7834e1c2221 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:36.331681 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92c9f541-b8d1-4540-a7c9-a7834e1c2221 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 2701 microversion: 2.1 time: 0.055672 Aug 27 04:40:36.347393 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1210/2394] 10.222.0.79 () {58 vars in 1143 bytes} [Sat Aug 27 04:40:36 2022] GET /compute/v2.1/os-migrations => generated 2701 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:36.352903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5eb31a40-75c8-447d-9027-8e5c3ec96f30 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:36.353508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5eb31a40-75c8-447d-9027-8e5c3ec96f30 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:36.374623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eb31a40-75c8-447d-9027-8e5c3ec96f30 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:36.375019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eb31a40-75c8-447d-9027-8e5c3ec96f30 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:36.375653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eb31a40-75c8-447d-9027-8e5c3ec96f30 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:36.377429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eb31a40-75c8-447d-9027-8e5c3ec96f30 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:36.377429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eb31a40-75c8-447d-9027-8e5c3ec96f30 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:36.384715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eb31a40-75c8-447d-9027-8e5c3ec96f30 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:36.402186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:36.616296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:36.641102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-781c0028-884f-4ef1-82d8-eab746eff719 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:36.654615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-781c0028-884f-4ef1-82d8-eab746eff719 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:36.658278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-781c0028-884f-4ef1-82d8-eab746eff719 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:36.660166 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-781c0028-884f-4ef1-82d8-eab746eff719 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 1.362747 Aug 27 04:40:36.662912 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1185/2395] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:35 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:36.669202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3569c3e5-7570-4ca5-b467-4df00343e940 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:36.670152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3569c3e5-7570-4ca5-b467-4df00343e940 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:36.681255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3569c3e5-7570-4ca5-b467-4df00343e940 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:36.682168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3569c3e5-7570-4ca5-b467-4df00343e940 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:36.682880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3569c3e5-7570-4ca5-b467-4df00343e940 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:36.687203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3569c3e5-7570-4ca5-b467-4df00343e940 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:36.693416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3569c3e5-7570-4ca5-b467-4df00343e940 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:36.697326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3569c3e5-7570-4ca5-b467-4df00343e940 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:36.707208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=26 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:36.848653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5eb31a40-75c8-447d-9027-8e5c3ec96f30 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:36.868306 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5eb31a40-75c8-447d-9027-8e5c3ec96f30 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1315 microversion: 2.1 time: 0.519488 Aug 27 04:40:36.886915 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1211/2396] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:36 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:36.894922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69dfc400-74fc-4c66-a684-c769a13798b6 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f211a3e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:36.996445 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69dfc400-74fc-4c66-a684-c769a13798b6 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.095874 Aug 27 04:40:36.999807 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1212/2397] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:36 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:37.005105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-86879fcc-cbc0-4bf2-b300-2588ff85ab90 req-89d89bb2-c72c-4ffa-b0b6-4e78e627d36c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0c55941-6705-4a1a-8e95-21886e1499f3", "tag": "815ba3c2-7f4a-4ed8-aa0b-011b806fff32"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:37.051049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-86879fcc-cbc0-4bf2-b300-2588ff85ab90 req-89d89bb2-c72c-4ffa-b0b6-4e78e627d36c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:37.051546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-86879fcc-cbc0-4bf2-b300-2588ff85ab90 req-89d89bb2-c72c-4ffa-b0b6-4e78e627d36c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:37.052210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-86879fcc-cbc0-4bf2-b300-2588ff85ab90 req-89d89bb2-c72c-4ffa-b0b6-4e78e627d36c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:37.078047 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-86879fcc-cbc0-4bf2-b300-2588ff85ab90 req-89d89bb2-c72c-4ffa-b0b6-4e78e627d36c service nova] Creating event network-changed:815ba3c2-7f4a-4ed8-aa0b-011b806fff32 for instance a0c55941-6705-4a1a-8e95-21886e1499f3 on n-h2-854823-1 Aug 27 04:40:37.087870 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-86879fcc-cbc0-4bf2-b300-2588ff85ab90 req-89d89bb2-c72c-4ffa-b0b6-4e78e627d36c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086424 Aug 27 04:40:37.100959 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1213/2398] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:37.302030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cdebc408-0a0a-40f4-8e13-22a50ececa88 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:37.303688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cdebc408-0a0a-40f4-8e13-22a50ececa88 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:37.326157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdebc408-0a0a-40f4-8e13-22a50ececa88 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:37.329137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdebc408-0a0a-40f4-8e13-22a50ececa88 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:37.329891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdebc408-0a0a-40f4-8e13-22a50ececa88 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:37.330953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdebc408-0a0a-40f4-8e13-22a50ececa88 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:37.331626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdebc408-0a0a-40f4-8e13-22a50ececa88 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:37.332063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdebc408-0a0a-40f4-8e13-22a50ececa88 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:37.619682 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3569c3e5-7570-4ca5-b467-4df00343e940 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1857 microversion: 2.1 time: 0.954444 Aug 27 04:40:37.638874 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1186/2399] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:36 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1857 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:37.647660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-681a68f0-a184-482d-bd3c-a8a356d58dbe tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:37.648899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-681a68f0-a184-482d-bd3c-a8a356d58dbe tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:37.666577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-681a68f0-a184-482d-bd3c-a8a356d58dbe tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:37.668210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-681a68f0-a184-482d-bd3c-a8a356d58dbe tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:37.669218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-681a68f0-a184-482d-bd3c-a8a356d58dbe tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:37.672817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-681a68f0-a184-482d-bd3c-a8a356d58dbe tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:37.673323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-681a68f0-a184-482d-bd3c-a8a356d58dbe tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:37.675073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-681a68f0-a184-482d-bd3c-a8a356d58dbe tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:38.023351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cdebc408-0a0a-40f4-8e13-22a50ececa88 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:38.048085 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cdebc408-0a0a-40f4-8e13-22a50ececa88 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1402 microversion: 2.1 time: 0.749150 Aug 27 04:40:38.050153 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1214/2400] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:37 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1402 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:38.068337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-282a1a17-1ae1-428d-a9ea-dc1cfd7537d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:38.074616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-282a1a17-1ae1-428d-a9ea-dc1cfd7537d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:38.084241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-282a1a17-1ae1-428d-a9ea-dc1cfd7537d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:38.087835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-282a1a17-1ae1-428d-a9ea-dc1cfd7537d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:38.092381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-282a1a17-1ae1-428d-a9ea-dc1cfd7537d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:38.096824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-282a1a17-1ae1-428d-a9ea-dc1cfd7537d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:38.097631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-282a1a17-1ae1-428d-a9ea-dc1cfd7537d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:38.098393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-282a1a17-1ae1-428d-a9ea-dc1cfd7537d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:38.238404 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-681a68f0-a184-482d-bd3c-a8a356d58dbe tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1857 microversion: 2.1 time: 0.595765 Aug 27 04:40:38.249101 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1187/2401] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:37 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1857 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:38.267186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6965951e-61dc-415d-86da-8906138e12b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:38.268149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6965951e-61dc-415d-86da-8906138e12b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:38.282844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6965951e-61dc-415d-86da-8906138e12b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:38.286117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6965951e-61dc-415d-86da-8906138e12b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:38.287854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6965951e-61dc-415d-86da-8906138e12b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:38.288849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6965951e-61dc-415d-86da-8906138e12b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:38.290381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6965951e-61dc-415d-86da-8906138e12b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:38.292373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6965951e-61dc-415d-86da-8906138e12b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:38.424816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:39.415135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6965951e-61dc-415d-86da-8906138e12b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:39.442895 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6965951e-61dc-415d-86da-8906138e12b9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1315 microversion: 2.1 time: 1.190213 Aug 27 04:40:39.465161 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1188/2402] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:38 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1315 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:39.493446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc020d44-173c-4c5e-a1c6-7b4ce4047472 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f215d3dc0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:39.585669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-282a1a17-1ae1-428d-a9ea-dc1cfd7537d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:39.605201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-282a1a17-1ae1-428d-a9ea-dc1cfd7537d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:39.608760 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bc020d44-173c-4c5e-a1c6-7b4ce4047472 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.140289 Aug 27 04:40:39.612984 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1189/2403] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:39 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:39.625110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cb416d75-66aa-4e9a-9fc8-392e8cba29c4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:39.626032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cb416d75-66aa-4e9a-9fc8-392e8cba29c4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:39.629305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-282a1a17-1ae1-428d-a9ea-dc1cfd7537d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:39.635291 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-282a1a17-1ae1-428d-a9ea-dc1cfd7537d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 1.581353 Aug 27 04:40:39.635968 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1215/2404] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:38 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:39.649597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a614a0f-08e2-48fc-afec-599dafacd2cd tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:39.649905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a614a0f-08e2-48fc-afec-599dafacd2cd tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:39.672658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb416d75-66aa-4e9a-9fc8-392e8cba29c4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:39.673408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb416d75-66aa-4e9a-9fc8-392e8cba29c4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:39.673867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb416d75-66aa-4e9a-9fc8-392e8cba29c4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:39.674987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb416d75-66aa-4e9a-9fc8-392e8cba29c4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:39.675700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb416d75-66aa-4e9a-9fc8-392e8cba29c4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:39.676289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb416d75-66aa-4e9a-9fc8-392e8cba29c4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:39.696590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a614a0f-08e2-48fc-afec-599dafacd2cd tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:39.699513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a614a0f-08e2-48fc-afec-599dafacd2cd tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:39.701261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a614a0f-08e2-48fc-afec-599dafacd2cd tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:39.704328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:39.705735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a614a0f-08e2-48fc-afec-599dafacd2cd tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:39.706351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a614a0f-08e2-48fc-afec-599dafacd2cd tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:39.706860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a614a0f-08e2-48fc-afec-599dafacd2cd tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:39.863941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-cb416d75-66aa-4e9a-9fc8-392e8cba29c4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lazy-loading 'services' on Instance uuid 0c1ebbce-7c0d-4f08-a05f-359d0527b76d {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:40:40.085402 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cb416d75-66aa-4e9a-9fc8-392e8cba29c4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments/1d9d9070-6418-43b6-91b5-42b0d0c358a6" status: 202 len: 0 microversion: 2.1 time: 0.470679 Aug 27 04:40:40.086292 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1190/2405] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 04:40:39 2022] DELETE /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments/1d9d9070-6418-43b6-91b5-42b0d0c358a6 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:40.097572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-24fc19ec-b9da-4e94-a3da-f14a8e2b0778 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:40.104753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-24fc19ec-b9da-4e94-a3da-f14a8e2b0778 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:40.122175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24fc19ec-b9da-4e94-a3da-f14a8e2b0778 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:40.122991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24fc19ec-b9da-4e94-a3da-f14a8e2b0778 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:40.125710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24fc19ec-b9da-4e94-a3da-f14a8e2b0778 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:40.127544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24fc19ec-b9da-4e94-a3da-f14a8e2b0778 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:40.128204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24fc19ec-b9da-4e94-a3da-f14a8e2b0778 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:40.133910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24fc19ec-b9da-4e94-a3da-f14a8e2b0778 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:40.208073 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-24fc19ec-b9da-4e94-a3da-f14a8e2b0778 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112356 Aug 27 04:40:40.212191 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1191/2406] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:40:40 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:40:40.221755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-0272218c-d9ef-4872-a0f7-16c252fc60aa req-51bd6fc9-b00c-4f1e-88a2-268fdf98eb3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa23773c-4169-43f8-8529-5f22a60e8836", "tag": "3cad5baa-ac77-43e1-8c2c-9c89cccb50dd"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:40.251382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0272218c-d9ef-4872-a0f7-16c252fc60aa req-51bd6fc9-b00c-4f1e-88a2-268fdf98eb3a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:40.254128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0272218c-d9ef-4872-a0f7-16c252fc60aa req-51bd6fc9-b00c-4f1e-88a2-268fdf98eb3a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:40.256727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0272218c-d9ef-4872-a0f7-16c252fc60aa req-51bd6fc9-b00c-4f1e-88a2-268fdf98eb3a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:40.275733 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-0272218c-d9ef-4872-a0f7-16c252fc60aa req-51bd6fc9-b00c-4f1e-88a2-268fdf98eb3a service nova] Creating event network-changed:3cad5baa-ac77-43e1-8c2c-9c89cccb50dd for instance aa23773c-4169-43f8-8529-5f22a60e8836 on n-h1-854823-1 Aug 27 04:40:40.298278 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-0272218c-d9ef-4872-a0f7-16c252fc60aa req-51bd6fc9-b00c-4f1e-88a2-268fdf98eb3a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078684 Aug 27 04:40:40.299497 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1192/2407] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:40.401101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a614a0f-08e2-48fc-afec-599dafacd2cd tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:40.422131 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a614a0f-08e2-48fc-afec-599dafacd2cd tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1402 microversion: 2.1 time: 0.785069 Aug 27 04:40:40.423266 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1216/2408] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:39 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1402 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:40.470763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ebb3a8b2-90e6-4add-9245-4c644f91752b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:40.472929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ebb3a8b2-90e6-4add-9245-4c644f91752b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:40.484820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebb3a8b2-90e6-4add-9245-4c644f91752b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:40.490304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebb3a8b2-90e6-4add-9245-4c644f91752b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:40.491159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebb3a8b2-90e6-4add-9245-4c644f91752b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:40.492081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebb3a8b2-90e6-4add-9245-4c644f91752b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:40.492731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebb3a8b2-90e6-4add-9245-4c644f91752b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:40.493222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebb3a8b2-90e6-4add-9245-4c644f91752b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:40.624969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a14e9072-5884-410c-8311-c6ad8ddf19f3 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f21b6aca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:40.715804 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a14e9072-5884-410c-8311-c6ad8ddf19f3 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.092044 Aug 27 04:40:40.719682 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1217/2409] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:40 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:40.740384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c7e89e15-218c-4595-83c3-38e29c47627f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:40.746065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c7e89e15-218c-4595-83c3-38e29c47627f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:40.790011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7e89e15-218c-4595-83c3-38e29c47627f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:40.790568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7e89e15-218c-4595-83c3-38e29c47627f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:40.791047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7e89e15-218c-4595-83c3-38e29c47627f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:40.800265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7e89e15-218c-4595-83c3-38e29c47627f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:40.805194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7e89e15-218c-4595-83c3-38e29c47627f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:40.805866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7e89e15-218c-4595-83c3-38e29c47627f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:41.330020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ebb3a8b2-90e6-4add-9245-4c644f91752b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:41.343961 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ebb3a8b2-90e6-4add-9245-4c644f91752b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1315 microversion: 2.1 time: 0.873823 Aug 27 04:40:41.345394 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1193/2410] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:40 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1315 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:41.355807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a368acf8-4f9a-4390-b866-67ccd3a6a0c5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:41.360547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a368acf8-4f9a-4390-b866-67ccd3a6a0c5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:41.368107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7e89e15-218c-4595-83c3-38e29c47627f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:41.388021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7e89e15-218c-4595-83c3-38e29c47627f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:41.391008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a368acf8-4f9a-4390-b866-67ccd3a6a0c5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:41.393239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a368acf8-4f9a-4390-b866-67ccd3a6a0c5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:41.393935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a368acf8-4f9a-4390-b866-67ccd3a6a0c5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:41.394237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7e89e15-218c-4595-83c3-38e29c47627f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:41.395477 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c7e89e15-218c-4595-83c3-38e29c47627f tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.674730 Aug 27 04:40:41.396388 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1218/2411] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:40 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:41.396710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a368acf8-4f9a-4390-b866-67ccd3a6a0c5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:41.397355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a368acf8-4f9a-4390-b866-67ccd3a6a0c5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:41.398722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a368acf8-4f9a-4390-b866-67ccd3a6a0c5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:41.446100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e197f16-38e6-4b3c-83e2-2a00b53b273c tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:41.447737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e197f16-38e6-4b3c-83e2-2a00b53b273c tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:41.457014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e197f16-38e6-4b3c-83e2-2a00b53b273c tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:41.457833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e197f16-38e6-4b3c-83e2-2a00b53b273c tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:41.458445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e197f16-38e6-4b3c-83e2-2a00b53b273c tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:41.459601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e197f16-38e6-4b3c-83e2-2a00b53b273c tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:41.460375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e197f16-38e6-4b3c-83e2-2a00b53b273c tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:41.460977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e197f16-38e6-4b3c-83e2-2a00b53b273c tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:41.527975 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a368acf8-4f9a-4390-b866-67ccd3a6a0c5 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181157 Aug 27 04:40:41.541303 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1194/2412] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:40:41 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:41.742904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0f97422a-f71e-40f1-b5c7-2a5322861b32 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f2156b430>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:41.853036 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0f97422a-f71e-40f1-b5c7-2a5322861b32 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.122844 Aug 27 04:40:41.853947 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1195/2413] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:41 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:42.365146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d79462e7-8920-412d-b2cf-190ab16cdbe8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:42.369284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d79462e7-8920-412d-b2cf-190ab16cdbe8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:42.387049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d79462e7-8920-412d-b2cf-190ab16cdbe8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:42.388005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d79462e7-8920-412d-b2cf-190ab16cdbe8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:42.389650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d79462e7-8920-412d-b2cf-190ab16cdbe8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:42.397203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d79462e7-8920-412d-b2cf-190ab16cdbe8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:42.400277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d79462e7-8920-412d-b2cf-190ab16cdbe8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:42.400969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d79462e7-8920-412d-b2cf-190ab16cdbe8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:42.643696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1e197f16-38e6-4b3c-83e2-2a00b53b273c tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:42.657686 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e197f16-38e6-4b3c-83e2-2a00b53b273c tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1402 microversion: 2.1 time: 1.211851 Aug 27 04:40:42.658346 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1219/2414] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:41 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1402 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:42.677386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68acb40a-01ec-4add-ad75-d64ac0a36d20 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:42.678019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68acb40a-01ec-4add-ad75-d64ac0a36d20 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:42.709476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68acb40a-01ec-4add-ad75-d64ac0a36d20 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:42.709983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68acb40a-01ec-4add-ad75-d64ac0a36d20 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:42.710426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68acb40a-01ec-4add-ad75-d64ac0a36d20 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:42.711149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68acb40a-01ec-4add-ad75-d64ac0a36d20 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:42.725079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68acb40a-01ec-4add-ad75-d64ac0a36d20 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:42.725727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68acb40a-01ec-4add-ad75-d64ac0a36d20 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:43.249157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-68acb40a-01ec-4add-ad75-d64ac0a36d20 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:43.269633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-68acb40a-01ec-4add-ad75-d64ac0a36d20 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:43.274499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-68acb40a-01ec-4add-ad75-d64ac0a36d20 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:43.278563 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68acb40a-01ec-4add-ad75-d64ac0a36d20 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.616002 Aug 27 04:40:43.287126 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1220/2415] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:42 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:43.325363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d40f624-23f0-49c5-8018-0b8df668021f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:43.333452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d40f624-23f0-49c5-8018-0b8df668021f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:43.352646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d40f624-23f0-49c5-8018-0b8df668021f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:43.353142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d40f624-23f0-49c5-8018-0b8df668021f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:43.353581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d40f624-23f0-49c5-8018-0b8df668021f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:43.354339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d40f624-23f0-49c5-8018-0b8df668021f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:43.354796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d40f624-23f0-49c5-8018-0b8df668021f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:43.355247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d40f624-23f0-49c5-8018-0b8df668021f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:43.477552 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d40f624-23f0-49c5-8018-0b8df668021f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174483 Aug 27 04:40:43.489115 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1221/2416] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:40:43 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:43.506813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2506ca5d-e69b-4f48-9549-3654fe592b56 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f21977ca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:43.620115 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2506ca5d-e69b-4f48-9549-3654fe592b56 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.125069 Aug 27 04:40:43.622988 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1222/2417] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:43 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:43.686313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce2adc03-c396-4a8f-85e6-7d1f8c0d3e3f tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:43.687672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce2adc03-c396-4a8f-85e6-7d1f8c0d3e3f tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:43.700836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce2adc03-c396-4a8f-85e6-7d1f8c0d3e3f tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:43.701340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce2adc03-c396-4a8f-85e6-7d1f8c0d3e3f tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:43.701784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce2adc03-c396-4a8f-85e6-7d1f8c0d3e3f tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:43.702499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce2adc03-c396-4a8f-85e6-7d1f8c0d3e3f tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:43.702960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce2adc03-c396-4a8f-85e6-7d1f8c0d3e3f tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:43.703391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce2adc03-c396-4a8f-85e6-7d1f8c0d3e3f tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:44.416875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce2adc03-c396-4a8f-85e6-7d1f8c0d3e3f tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:44.426949 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce2adc03-c396-4a8f-85e6-7d1f8c0d3e3f tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1402 microversion: 2.1 time: 0.748310 Aug 27 04:40:44.431754 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1223/2418] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:43 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1402 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:44.449078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c24a8a9b-bd31-4649-bc31-c1cd2b55bca4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:44.461504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c24a8a9b-bd31-4649-bc31-c1cd2b55bca4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:44.469566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c24a8a9b-bd31-4649-bc31-c1cd2b55bca4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:44.477343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c24a8a9b-bd31-4649-bc31-c1cd2b55bca4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:44.478170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c24a8a9b-bd31-4649-bc31-c1cd2b55bca4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:44.479682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c24a8a9b-bd31-4649-bc31-c1cd2b55bca4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:44.480362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c24a8a9b-bd31-4649-bc31-c1cd2b55bca4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:44.481052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c24a8a9b-bd31-4649-bc31-c1cd2b55bca4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:44.805685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d79462e7-8920-412d-b2cf-190ab16cdbe8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:44.814347 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d79462e7-8920-412d-b2cf-190ab16cdbe8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1315 microversion: 2.1 time: 2.453067 Aug 27 04:40:44.817815 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1196/2419] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:42 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1315 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:44.841002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0503dd07-f6a4-4fcf-9969-e9460ba84fee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:44.843344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0503dd07-f6a4-4fcf-9969-e9460ba84fee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:44.871243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0503dd07-f6a4-4fcf-9969-e9460ba84fee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:44.871762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0503dd07-f6a4-4fcf-9969-e9460ba84fee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:44.872214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0503dd07-f6a4-4fcf-9969-e9460ba84fee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:44.872992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0503dd07-f6a4-4fcf-9969-e9460ba84fee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:44.874568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0503dd07-f6a4-4fcf-9969-e9460ba84fee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:44.879388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0503dd07-f6a4-4fcf-9969-e9460ba84fee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:44.945054 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0503dd07-f6a4-4fcf-9969-e9460ba84fee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124053 Aug 27 04:40:44.950696 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1197/2420] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:40:44 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:44.956205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-537356f3-46d8-43a0-b39c-279288932d97 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f214d5700>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:45.050100 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-537356f3-46d8-43a0-b39c-279288932d97 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.097966 Aug 27 04:40:45.056741 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1198/2421] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:44 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:45.076373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c24a8a9b-bd31-4649-bc31-c1cd2b55bca4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:45.123549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c24a8a9b-bd31-4649-bc31-c1cd2b55bca4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:45.125866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c24a8a9b-bd31-4649-bc31-c1cd2b55bca4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:45.136081 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c24a8a9b-bd31-4649-bc31-c1cd2b55bca4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.701718 Aug 27 04:40:45.142143 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1224/2422] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:44 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:45.201550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:45.451282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2aa9d165-07a8-4ea7-a7c5-d4d641237551 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:45.453355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2aa9d165-07a8-4ea7-a7c5-d4d641237551 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:45.485292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2aa9d165-07a8-4ea7-a7c5-d4d641237551 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:45.485292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2aa9d165-07a8-4ea7-a7c5-d4d641237551 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:45.489324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2aa9d165-07a8-4ea7-a7c5-d4d641237551 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:45.490364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2aa9d165-07a8-4ea7-a7c5-d4d641237551 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:45.492494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2aa9d165-07a8-4ea7-a7c5-d4d641237551 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:45.494066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2aa9d165-07a8-4ea7-a7c5-d4d641237551 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:45.540916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1848088229", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "bcedcbbe-f9e5-425b-a145-0aa42ef36186"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:45.693329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] validate_networks() for [('bcedcbbe-f9e5-425b-a145-0aa42ef36186', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:40:46.156206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2aa9d165-07a8-4ea7-a7c5-d4d641237551 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:46.178724 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2aa9d165-07a8-4ea7-a7c5-d4d641237551 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1402 microversion: 2.1 time: 0.730098 Aug 27 04:40:46.197001 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1225/2423] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:45 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1402 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:46.214800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-258185dd-9c85-4323-8e99-bf2caab929c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:46.215748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-258185dd-9c85-4323-8e99-bf2caab929c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:46.246874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258185dd-9c85-4323-8e99-bf2caab929c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:46.248028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258185dd-9c85-4323-8e99-bf2caab929c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:46.248867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258185dd-9c85-4323-8e99-bf2caab929c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:46.252489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258185dd-9c85-4323-8e99-bf2caab929c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:46.253251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258185dd-9c85-4323-8e99-bf2caab929c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:46.253848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258185dd-9c85-4323-8e99-bf2caab929c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:47.018914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:40:47.021787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:40:47.022936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:40:47.024933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:40:47.026557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:40:47.058380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:47.059591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:47.060872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:47.062625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:47.063673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:47.064718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:47.106645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Getting quotas for project 449305a5c79342058280f9482da58766. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:40:47.151374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Getting quotas for user 31386d6abd9b41f7a14a91f638331d95 and project 449305a5c79342058280f9482da58766. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:40:47.208375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:40:47.213471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:40:47.257183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-258185dd-9c85-4323-8e99-bf2caab929c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:47.267526 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-258185dd-9c85-4323-8e99-bf2caab929c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1315 microversion: 2.1 time: 1.068354 Aug 27 04:40:47.281103 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1226/2424] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:46 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1315 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:47.293499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6ee29ef-90a8-4521-9284-3fb649a73386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:47.293499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6ee29ef-90a8-4521-9284-3fb649a73386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:47.306535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ee29ef-90a8-4521-9284-3fb649a73386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:47.308273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ee29ef-90a8-4521-9284-3fb649a73386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:47.309229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ee29ef-90a8-4521-9284-3fb649a73386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:47.310530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ee29ef-90a8-4521-9284-3fb649a73386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:47.315761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ee29ef-90a8-4521-9284-3fb649a73386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:47.327882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ee29ef-90a8-4521-9284-3fb649a73386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:47.392768 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6ee29ef-90a8-4521-9284-3fb649a73386 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110416 Aug 27 04:40:47.394011 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1227/2425] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:40:47 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:47.399107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7db676df-22b4-4e71-887a-d1a5527c93ba tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f2115faf0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:47.434365 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dcc9388c-01a8-4e36-bb88-22500fc3db89 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.375418 Aug 27 04:40:47.436876 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1199/2426] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:40:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:40:47.453636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ed680e11-cbe7-4ce6-ad83-908df526c999 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:47.467693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ed680e11-cbe7-4ce6-ad83-908df526c999 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:47.505275 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7db676df-22b4-4e71-887a-d1a5527c93ba tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1428 microversion: 2.1 time: 0.109893 Aug 27 04:40:47.519291 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1228/2427] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:47 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:47.534369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed680e11-cbe7-4ce6-ad83-908df526c999 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:47.535349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed680e11-cbe7-4ce6-ad83-908df526c999 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:47.536090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed680e11-cbe7-4ce6-ad83-908df526c999 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:47.542119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43eea070-0751-445c-b486-f10388515e1e tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:47.542914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed680e11-cbe7-4ce6-ad83-908df526c999 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:47.543784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed680e11-cbe7-4ce6-ad83-908df526c999 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:47.544521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed680e11-cbe7-4ce6-ad83-908df526c999 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:47.548163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43eea070-0751-445c-b486-f10388515e1e tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:47.587971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43eea070-0751-445c-b486-f10388515e1e tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:47.593142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43eea070-0751-445c-b486-f10388515e1e tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:47.594507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43eea070-0751-445c-b486-f10388515e1e tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:47.596579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43eea070-0751-445c-b486-f10388515e1e tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:47.601198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43eea070-0751-445c-b486-f10388515e1e tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:47.609103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43eea070-0751-445c-b486-f10388515e1e tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:47.927862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed680e11-cbe7-4ce6-ad83-908df526c999 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:47.938254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed680e11-cbe7-4ce6-ad83-908df526c999 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:47.945009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed680e11-cbe7-4ce6-ad83-908df526c999 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:47.946426 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ed680e11-cbe7-4ce6-ad83-908df526c999 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.508305 Aug 27 04:40:47.951065 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1200/2428] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:47 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:47.960818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0a31d1fc-60db-4565-872e-79b5901ab0c2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:47.965782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0a31d1fc-60db-4565-872e-79b5901ab0c2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:48.064371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0a31d1fc-60db-4565-872e-79b5901ab0c2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:48.074728 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0a31d1fc-60db-4565-872e-79b5901ab0c2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1224 microversion: 2.1 time: 0.121944 Aug 27 04:40:48.075997 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1201/2429] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:47 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1224 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:48.325314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd17b70f-ac5f-4611-8126-61d2ef102365 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:48.326299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fd17b70f-ac5f-4611-8126-61d2ef102365 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:48.345230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd17b70f-ac5f-4611-8126-61d2ef102365 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:48.355831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd17b70f-ac5f-4611-8126-61d2ef102365 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:48.357772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd17b70f-ac5f-4611-8126-61d2ef102365 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:48.362509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd17b70f-ac5f-4611-8126-61d2ef102365 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:48.363211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd17b70f-ac5f-4611-8126-61d2ef102365 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:48.363965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd17b70f-ac5f-4611-8126-61d2ef102365 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:48.491964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-43eea070-0751-445c-b486-f10388515e1e tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:48.506995 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43eea070-0751-445c-b486-f10388515e1e tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1402 microversion: 2.1 time: 0.985656 Aug 27 04:40:48.508990 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1229/2430] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:47 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1402 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:48.522205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d9f7dac8-83b2-4224-acd6-00c4ae4e27e1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:48.527956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d9f7dac8-83b2-4224-acd6-00c4ae4e27e1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:48.550798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9f7dac8-83b2-4224-acd6-00c4ae4e27e1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:48.551579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9f7dac8-83b2-4224-acd6-00c4ae4e27e1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:48.552151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9f7dac8-83b2-4224-acd6-00c4ae4e27e1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:48.553011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9f7dac8-83b2-4224-acd6-00c4ae4e27e1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:48.557839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9f7dac8-83b2-4224-acd6-00c4ae4e27e1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:48.558706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9f7dac8-83b2-4224-acd6-00c4ae4e27e1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:48.710322 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d9f7dac8-83b2-4224-acd6-00c4ae4e27e1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195277 Aug 27 04:40:48.711594 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1230/2431] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:40:48 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:48.725848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fd17b70f-ac5f-4611-8126-61d2ef102365 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:48.744348 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fd17b70f-ac5f-4611-8126-61d2ef102365 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1315 microversion: 2.1 time: 0.418883 Aug 27 04:40:48.745592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d570a209-1c29-4285-ad6b-c57d8e76856a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f21977430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:48.761043 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1202/2432] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:48 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:48.827314 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d570a209-1c29-4285-ad6b-c57d8e76856a tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1437 microversion: 2.1 time: 0.113034 Aug 27 04:40:48.828553 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1231/2433] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:48 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1437 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:48.843425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f987e083-d9ce-4843-b72c-a95847b94fac tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f215f2550>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:48.921164 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f987e083-d9ce-4843-b72c-a95847b94fac tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 200 len: 1437 microversion: 2.1 time: 0.083386 Aug 27 04:40:48.923060 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1203/2434] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:48 2022] GET /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 1437 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:48.936688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-67906c00-1643-4e05-ab50-1665802627df tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:48.937624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-67906c00-1643-4e05-ab50-1665802627df tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:48.953465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67906c00-1643-4e05-ab50-1665802627df tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:48.954184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67906c00-1643-4e05-ab50-1665802627df tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:48.957114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67906c00-1643-4e05-ab50-1665802627df tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:48.958127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67906c00-1643-4e05-ab50-1665802627df tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:48.960285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67906c00-1643-4e05-ab50-1665802627df tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:48.961944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67906c00-1643-4e05-ab50-1665802627df tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:48.973751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fc2d773f-6425-4eef-8963-b72df9021147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:48.975055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fc2d773f-6425-4eef-8963-b72df9021147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:48.991424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc2d773f-6425-4eef-8963-b72df9021147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:48.993723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc2d773f-6425-4eef-8963-b72df9021147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:48.994541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc2d773f-6425-4eef-8963-b72df9021147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:48.998939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc2d773f-6425-4eef-8963-b72df9021147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:48.999658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc2d773f-6425-4eef-8963-b72df9021147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:49.000289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc2d773f-6425-4eef-8963-b72df9021147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:49.344306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fc2d773f-6425-4eef-8963-b72df9021147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:49.361035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fc2d773f-6425-4eef-8963-b72df9021147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:49.364743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fc2d773f-6425-4eef-8963-b72df9021147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:49.368299 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fc2d773f-6425-4eef-8963-b72df9021147 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.397324 Aug 27 04:40:49.370914 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1204/2435] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:48 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:40:49.379710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ad21b0b9-997f-47bd-ba63-8102d6d80145 req-04ec8901-fed7-4618-a2f5-8180ab77af9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c55941-6705-4a1a-8e95-21886e1499f3", "name": "network-vif-plugged", "status": "completed", "tag": "815ba3c2-7f4a-4ed8-aa0b-011b806fff32"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:49.395083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ad21b0b9-997f-47bd-ba63-8102d6d80145 req-04ec8901-fed7-4618-a2f5-8180ab77af9b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:49.395847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ad21b0b9-997f-47bd-ba63-8102d6d80145 req-04ec8901-fed7-4618-a2f5-8180ab77af9b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:49.396495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ad21b0b9-997f-47bd-ba63-8102d6d80145 req-04ec8901-fed7-4618-a2f5-8180ab77af9b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:49.413519 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ad21b0b9-997f-47bd-ba63-8102d6d80145 req-04ec8901-fed7-4618-a2f5-8180ab77af9b service nova] Creating event network-vif-plugged:815ba3c2-7f4a-4ed8-aa0b-011b806fff32 for instance a0c55941-6705-4a1a-8e95-21886e1499f3 on n-h2-854823-1 Aug 27 04:40:49.420796 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ad21b0b9-997f-47bd-ba63-8102d6d80145 req-04ec8901-fed7-4618-a2f5-8180ab77af9b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046797 Aug 27 04:40:49.422161 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1205/2436] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:49.437222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-86d90655-838b-406f-8718-4e5bf2df89f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:49.440170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-86d90655-838b-406f-8718-4e5bf2df89f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:49.459228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86d90655-838b-406f-8718-4e5bf2df89f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:49.460222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86d90655-838b-406f-8718-4e5bf2df89f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:49.462449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86d90655-838b-406f-8718-4e5bf2df89f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:49.467204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86d90655-838b-406f-8718-4e5bf2df89f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:49.467923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86d90655-838b-406f-8718-4e5bf2df89f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:49.470048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86d90655-838b-406f-8718-4e5bf2df89f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:49.647451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-86d90655-838b-406f-8718-4e5bf2df89f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:49.665206 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-86d90655-838b-406f-8718-4e5bf2df89f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1276 microversion: 2.1 time: 0.238631 Aug 27 04:40:49.668385 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1206/2437] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:49 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:49.681990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-78085494-c6af-480c-ad25-e47f548749d4 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:49.684337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-78085494-c6af-480c-ad25-e47f548749d4 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:49.694665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78085494-c6af-480c-ad25-e47f548749d4 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:49.695340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78085494-c6af-480c-ad25-e47f548749d4 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:49.695956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78085494-c6af-480c-ad25-e47f548749d4 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:49.698389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78085494-c6af-480c-ad25-e47f548749d4 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:49.699686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78085494-c6af-480c-ad25-e47f548749d4 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:49.700310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78085494-c6af-480c-ad25-e47f548749d4 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:49.823479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-67906c00-1643-4e05-ab50-1665802627df tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:49.834464 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-67906c00-1643-4e05-ab50-1665802627df tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1480 microversion: 2.1 time: 0.902456 Aug 27 04:40:49.835099 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1232/2438] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:48 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1480 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:49.840754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63bbc103-9ab1-41e9-ae95-52dc2f02761d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:49.843053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-63bbc103-9ab1-41e9-ae95-52dc2f02761d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:49.857194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63bbc103-9ab1-41e9-ae95-52dc2f02761d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:49.872667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63bbc103-9ab1-41e9-ae95-52dc2f02761d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:49.873712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63bbc103-9ab1-41e9-ae95-52dc2f02761d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:49.874662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63bbc103-9ab1-41e9-ae95-52dc2f02761d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:49.875351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63bbc103-9ab1-41e9-ae95-52dc2f02761d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:49.876264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63bbc103-9ab1-41e9-ae95-52dc2f02761d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:49.912849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:49.947152 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63bbc103-9ab1-41e9-ae95-52dc2f02761d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110933 Aug 27 04:40:49.956711 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1233/2439] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:40:49 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:49.960425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-78085494-c6af-480c-ad25-e47f548749d4 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:49.964624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-48105c11-e68a-49de-b756-03d3289d4152 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:49.966800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-48105c11-e68a-49de-b756-03d3289d4152 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:49.982556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48105c11-e68a-49de-b756-03d3289d4152 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:49.983947 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-78085494-c6af-480c-ad25-e47f548749d4 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1402 microversion: 2.1 time: 0.311808 Aug 27 04:40:49.984735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48105c11-e68a-49de-b756-03d3289d4152 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:49.986001 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1207/2440] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:49 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1402 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:49.986694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48105c11-e68a-49de-b756-03d3289d4152 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:49.987653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48105c11-e68a-49de-b756-03d3289d4152 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:49.991039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48105c11-e68a-49de-b756-03d3289d4152 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:49.991676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48105c11-e68a-49de-b756-03d3289d4152 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:50.380197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-48105c11-e68a-49de-b756-03d3289d4152 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:50.393965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c1b833c6-371d-442c-82b4-7b868639a120 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:50.394581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c1b833c6-371d-442c-82b4-7b868639a120 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:50.396630 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-48105c11-e68a-49de-b756-03d3289d4152 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1315 microversion: 2.1 time: 0.438266 Aug 27 04:40:50.400751 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1234/2441] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:49 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:50.415666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1b833c6-371d-442c-82b4-7b868639a120 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:50.421003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1b833c6-371d-442c-82b4-7b868639a120 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:50.421507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1b833c6-371d-442c-82b4-7b868639a120 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:50.422253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1b833c6-371d-442c-82b4-7b868639a120 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:50.427005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1b833c6-371d-442c-82b4-7b868639a120 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:50.427496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1b833c6-371d-442c-82b4-7b868639a120 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:50.690212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58b9928c-b811-4085-b6d8-c7f39ad55b4f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:50.691178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-58b9928c-b811-4085-b6d8-c7f39ad55b4f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:50.703050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58b9928c-b811-4085-b6d8-c7f39ad55b4f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:50.703570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58b9928c-b811-4085-b6d8-c7f39ad55b4f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:50.704017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58b9928c-b811-4085-b6d8-c7f39ad55b4f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:50.706161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58b9928c-b811-4085-b6d8-c7f39ad55b4f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:50.706638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58b9928c-b811-4085-b6d8-c7f39ad55b4f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:50.707081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58b9928c-b811-4085-b6d8-c7f39ad55b4f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:50.849797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c1b833c6-371d-442c-82b4-7b868639a120 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:50.875655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c1b833c6-371d-442c-82b4-7b868639a120 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:50.877381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c1b833c6-371d-442c-82b4-7b868639a120 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:50.878667 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c1b833c6-371d-442c-82b4-7b868639a120 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.489010 Aug 27 04:40:50.897498 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1208/2442] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:50 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:50.902852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d6d3ff20-37da-4ff8-9201-6ece20224af9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:50.903654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d6d3ff20-37da-4ff8-9201-6ece20224af9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:50.910735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6d3ff20-37da-4ff8-9201-6ece20224af9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:50.920944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6d3ff20-37da-4ff8-9201-6ece20224af9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:50.921635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6d3ff20-37da-4ff8-9201-6ece20224af9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:50.922541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6d3ff20-37da-4ff8-9201-6ece20224af9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:50.923156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6d3ff20-37da-4ff8-9201-6ece20224af9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:50.923759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6d3ff20-37da-4ff8-9201-6ece20224af9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:51.052748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-58b9928c-b811-4085-b6d8-c7f39ad55b4f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:51.077124 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-58b9928c-b811-4085-b6d8-c7f39ad55b4f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1294 microversion: 2.1 time: 0.386619 Aug 27 04:40:51.079004 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1235/2443] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:50 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1294 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:51.087590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88f04272-b8e4-4ca0-97a0-39012104540c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:51.091805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88f04272-b8e4-4ca0-97a0-39012104540c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:51.101581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88f04272-b8e4-4ca0-97a0-39012104540c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:51.102431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88f04272-b8e4-4ca0-97a0-39012104540c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:51.103367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88f04272-b8e4-4ca0-97a0-39012104540c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:51.104978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88f04272-b8e4-4ca0-97a0-39012104540c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:51.107030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88f04272-b8e4-4ca0-97a0-39012104540c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:51.107899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88f04272-b8e4-4ca0-97a0-39012104540c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:51.218418 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88f04272-b8e4-4ca0-97a0-39012104540c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137952 Aug 27 04:40:51.225010 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1236/2444] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:40:51 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:51.235294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3b39dc7-36e8-44cd-9bec-72338b7d4018 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:51.243955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c3b39dc7-36e8-44cd-9bec-72338b7d4018 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:51.266572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b39dc7-36e8-44cd-9bec-72338b7d4018 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:51.267205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b39dc7-36e8-44cd-9bec-72338b7d4018 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:51.271889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b39dc7-36e8-44cd-9bec-72338b7d4018 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:51.273209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b39dc7-36e8-44cd-9bec-72338b7d4018 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:51.273912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b39dc7-36e8-44cd-9bec-72338b7d4018 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:51.274575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b39dc7-36e8-44cd-9bec-72338b7d4018 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:51.350740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d6d3ff20-37da-4ff8-9201-6ece20224af9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:51.369204 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d6d3ff20-37da-4ff8-9201-6ece20224af9 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1467 microversion: 2.1 time: 0.470090 Aug 27 04:40:51.370943 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1209/2445] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:50 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1467 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:51.402987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5f86d5e0-9ba4-415f-98ce-2055ae194ae4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f215723a0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:52.257454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3b39dc7-36e8-44cd-9bec-72338b7d4018 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:52.285150 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3b39dc7-36e8-44cd-9bec-72338b7d4018 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1402 microversion: 2.1 time: 1.058021 Aug 27 04:40:52.285777 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1237/2446] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:51 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1402 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:52.311441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e43d6a83-e470-473f-b8f9-65b96da92822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:52.322137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e43d6a83-e470-473f-b8f9-65b96da92822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:52.352949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e43d6a83-e470-473f-b8f9-65b96da92822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:52.353391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e43d6a83-e470-473f-b8f9-65b96da92822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:52.362586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e43d6a83-e470-473f-b8f9-65b96da92822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:52.366416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e43d6a83-e470-473f-b8f9-65b96da92822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:52.368381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e43d6a83-e470-473f-b8f9-65b96da92822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:52.370712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e43d6a83-e470-473f-b8f9-65b96da92822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:52.769779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e43d6a83-e470-473f-b8f9-65b96da92822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:52.786391 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e43d6a83-e470-473f-b8f9-65b96da92822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1501 microversion: 2.1 time: 0.483024 Aug 27 04:40:52.787020 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1238/2447] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:52 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1501 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:52.811416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2b213363-90b4-4b04-94ee-7ff04de6fa73 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:52.819587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2b213363-90b4-4b04-94ee-7ff04de6fa73 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:52.840381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b213363-90b4-4b04-94ee-7ff04de6fa73 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:52.842278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b213363-90b4-4b04-94ee-7ff04de6fa73 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:52.842890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b213363-90b4-4b04-94ee-7ff04de6fa73 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:52.846118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b213363-90b4-4b04-94ee-7ff04de6fa73 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:52.846944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b213363-90b4-4b04-94ee-7ff04de6fa73 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:52.848799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b213363-90b4-4b04-94ee-7ff04de6fa73 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:53.034725 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5f86d5e0-9ba4-415f-98ce-2055ae194ae4 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "DELETE /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7" status: 204 len: 0 microversion: 2.1 time: 1.642838 Aug 27 04:40:53.035393 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1210/2448] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:51 2022] DELETE /compute/v2.1/images/31148356-6fbb-4965-a561-f48368905fb7 => generated 0 bytes in 1644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:40:53.043943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-57ac7f34-2c0b-4036-b57d-1e0327572c23 req-8fb8ca21-473f-4742-a9fe-f7d395a6bd63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa23773c-4169-43f8-8529-5f22a60e8836", "name": "network-vif-plugged", "status": "completed", "tag": "3cad5baa-ac77-43e1-8c2c-9c89cccb50dd"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:53.071582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-57ac7f34-2c0b-4036-b57d-1e0327572c23 req-8fb8ca21-473f-4742-a9fe-f7d395a6bd63 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:53.076806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-57ac7f34-2c0b-4036-b57d-1e0327572c23 req-8fb8ca21-473f-4742-a9fe-f7d395a6bd63 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:53.077377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-57ac7f34-2c0b-4036-b57d-1e0327572c23 req-8fb8ca21-473f-4742-a9fe-f7d395a6bd63 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:53.109933 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-57ac7f34-2c0b-4036-b57d-1e0327572c23 req-8fb8ca21-473f-4742-a9fe-f7d395a6bd63 service nova] Creating event network-vif-plugged:3cad5baa-ac77-43e1-8c2c-9c89cccb50dd for instance aa23773c-4169-43f8-8529-5f22a60e8836 on n-h1-854823-1 Aug 27 04:40:53.127964 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-57ac7f34-2c0b-4036-b57d-1e0327572c23 req-8fb8ca21-473f-4742-a9fe-f7d395a6bd63 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090963 Aug 27 04:40:53.130127 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1211/2449] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:53.148852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-08c9d62a-50b7-4c25-83e5-7c0a451eec6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:53.150105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-08c9d62a-50b7-4c25-83e5-7c0a451eec6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:53.176815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c9d62a-50b7-4c25-83e5-7c0a451eec6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:53.177328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c9d62a-50b7-4c25-83e5-7c0a451eec6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:53.177774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c9d62a-50b7-4c25-83e5-7c0a451eec6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:53.180279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c9d62a-50b7-4c25-83e5-7c0a451eec6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:53.181029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c9d62a-50b7-4c25-83e5-7c0a451eec6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:53.183768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c9d62a-50b7-4c25-83e5-7c0a451eec6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:53.405590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-08c9d62a-50b7-4c25-83e5-7c0a451eec6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:53.418472 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-08c9d62a-50b7-4c25-83e5-7c0a451eec6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1282 microversion: 2.1 time: 0.286159 Aug 27 04:40:53.428878 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1212/2450] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:53 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1282 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:53.451745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5da5a953-795e-4759-bec8-5959720bb3d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:53.457125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5da5a953-795e-4759-bec8-5959720bb3d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:53.478159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da5a953-795e-4759-bec8-5959720bb3d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:53.478666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da5a953-795e-4759-bec8-5959720bb3d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:53.479628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da5a953-795e-4759-bec8-5959720bb3d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:53.491565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da5a953-795e-4759-bec8-5959720bb3d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:53.492211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da5a953-795e-4759-bec8-5959720bb3d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:53.493817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da5a953-795e-4759-bec8-5959720bb3d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:53.592561 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5da5a953-795e-4759-bec8-5959720bb3d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.161045 Aug 27 04:40:53.599487 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1213/2451] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:40:53 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d/os-volume_attachments => generated 25 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:40:53.614068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-deb8abac-0e19-4b4d-8118-d43abd879822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:53.621033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-deb8abac-0e19-4b4d-8118-d43abd879822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:53.636357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-deb8abac-0e19-4b4d-8118-d43abd879822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:53.636782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-deb8abac-0e19-4b4d-8118-d43abd879822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:53.637222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-deb8abac-0e19-4b4d-8118-d43abd879822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:53.638701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-deb8abac-0e19-4b4d-8118-d43abd879822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:53.639164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-deb8abac-0e19-4b4d-8118-d43abd879822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:53.641344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-deb8abac-0e19-4b4d-8118-d43abd879822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:53.645875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:53.724125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2b213363-90b4-4b04-94ee-7ff04de6fa73 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:53.736115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2b213363-90b4-4b04-94ee-7ff04de6fa73 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:53.745156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2b213363-90b4-4b04-94ee-7ff04de6fa73 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:53.750198 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2b213363-90b4-4b04-94ee-7ff04de6fa73 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.959005 Aug 27 04:40:53.752364 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1239/2452] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:52 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:53.792045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e13aac37-7276-41d5-80c9-f8059eca73d6 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '.version_select at 0x7f1f21977b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:53.825877 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-deb8abac-0e19-4b4d-8118-d43abd879822 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "POST /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3/action" status: 202 len: 0 microversion: 2.1 time: 0.224440 Aug 27 04:40:53.830218 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1214/2453] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:40:53 2022] POST /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:53.840292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b09d623d-c141-4cd4-9fed-5b62c2475a8b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:53.841056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b09d623d-c141-4cd4-9fed-5b62c2475a8b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:53.853367 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e13aac37-7276-41d5-80c9-f8059eca73d6 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] HTTP exception thrown: Image not found. Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e13aac37-7276-41d5-80c9-f8059eca73d6 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Request method failure captured: Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 HTTP/1.1 Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_woK6Ya4niQrEexsBKsmTunnoQzAO464p8PeA03wzY9CL5lS0eb6OvDOmvJYJQRK4JLtIsixVSUL3NSaPJm4n0735dfFH1sTIqVav26y--Y0zn0Onr3h3JOH_aqY2hwxzDLbbpFawcM5RnOP4CPyyBEMZg6fcFwm1WjtI6I7VrRiw Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 851596d90257494a92286fd41e796615 Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerTestJSON-1879319611 Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/851596d90257494a92286fd41e796615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_851596d90257494a92286fd41e796615"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/851596d90257494a92286fd41e796615"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/851596d90257494a92286fd41e796615"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerTestJSON-1879319611 Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 851596d90257494a92286fd41e796615 Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1879319611 Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerTestJSON-1879319611-project Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 79b9b0d20ee74c999f83602bfb52b705 Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerTestJSON-1879319611-project Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: exception: Image not found. Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '4b80c972-4657-46ca-856a-b827b8ef7696'} Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4b80c972-4657-46ca-856a-b827b8ef7696 to delete Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4b80c972-4657-46ca-856a-b827b8ef7696 could not be found. Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:53.857651 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e13aac37-7276-41d5-80c9-f8059eca73d6 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:40:53.862060 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e13aac37-7276-41d5-80c9-f8059eca73d6 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "DELETE /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696" status: 404 len: 62 microversion: 2.1 time: 0.092922 Aug 27 04:40:53.866608 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1240/2454] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:53 2022] DELETE /compute/v2.1/images/4b80c972-4657-46ca-856a-b827b8ef7696 => generated 62 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:40:53.868397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b09d623d-c141-4cd4-9fed-5b62c2475a8b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:53.868932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b09d623d-c141-4cd4-9fed-5b62c2475a8b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:53.869376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b09d623d-c141-4cd4-9fed-5b62c2475a8b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:53.873325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b09d623d-c141-4cd4-9fed-5b62c2475a8b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:53.873325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b09d623d-c141-4cd4-9fed-5b62c2475a8b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:53.873325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b09d623d-c141-4cd4-9fed-5b62c2475a8b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:53.929523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4002f35-cdd9-4074-b37f-811bd030f316 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:53.935315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4002f35-cdd9-4074-b37f-811bd030f316 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:53.965596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4002f35-cdd9-4074-b37f-811bd030f316 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:53.966105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4002f35-cdd9-4074-b37f-811bd030f316 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:53.966554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4002f35-cdd9-4074-b37f-811bd030f316 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:53.988241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4002f35-cdd9-4074-b37f-811bd030f316 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:53.988928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4002f35-cdd9-4074-b37f-811bd030f316 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:53.990505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4002f35-cdd9-4074-b37f-811bd030f316 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:54.282715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b09d623d-c141-4cd4-9fed-5b62c2475a8b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:54.314069 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b09d623d-c141-4cd4-9fed-5b62c2475a8b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1402 microversion: 2.1 time: 0.484507 Aug 27 04:40:54.329605 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1215/2455] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:53 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1402 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:54.335134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4da60f2-e1ce-4646-9d24-4c3eac57e121 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:54.335637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f4da60f2-e1ce-4646-9d24-4c3eac57e121 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:54.344221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4da60f2-e1ce-4646-9d24-4c3eac57e121 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:54.345002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4da60f2-e1ce-4646-9d24-4c3eac57e121 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:54.345655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4da60f2-e1ce-4646-9d24-4c3eac57e121 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:54.346673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4da60f2-e1ce-4646-9d24-4c3eac57e121 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:54.347280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4da60f2-e1ce-4646-9d24-4c3eac57e121 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:54.347858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4da60f2-e1ce-4646-9d24-4c3eac57e121 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:54.406652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f4da60f2-e1ce-4646-9d24-4c3eac57e121 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:40:54.620290 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f4da60f2-e1ce-4646-9d24-4c3eac57e121 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "DELETE /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 204 len: 0 microversion: 2.1 time: 0.288315 Aug 27 04:40:54.624419 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1216/2456] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:40:54 2022] DELETE /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:40:54.628261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dd5be577-096f-4953-a9ec-88a015556544 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:54.629230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dd5be577-096f-4953-a9ec-88a015556544 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:54.638811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd5be577-096f-4953-a9ec-88a015556544 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:54.639499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd5be577-096f-4953-a9ec-88a015556544 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:54.640105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd5be577-096f-4953-a9ec-88a015556544 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:54.641879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd5be577-096f-4953-a9ec-88a015556544 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:54.642411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd5be577-096f-4953-a9ec-88a015556544 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:54.642884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd5be577-096f-4953-a9ec-88a015556544 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:55.128828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4002f35-cdd9-4074-b37f-811bd030f316 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:55.139287 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4002f35-cdd9-4074-b37f-811bd030f316 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1506 microversion: 2.1 time: 1.271528 Aug 27 04:40:55.139899 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1241/2457] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:53 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1506 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:55.150615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dd5be577-096f-4953-a9ec-88a015556544 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:55.162099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2875cc3e-4f87-4092-8fbe-5924dde57eef tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:55.165282 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dd5be577-096f-4953-a9ec-88a015556544 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1324 microversion: 2.1 time: 0.541784 Aug 27 04:40:55.167399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2875cc3e-4f87-4092-8fbe-5924dde57eef tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:55.167777 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1217/2458] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:54 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1324 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:55.180324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ac645fca-9c40-4ebf-b272-66f4bfbf1726 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:55.183825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ac645fca-9c40-4ebf-b272-66f4bfbf1726 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:55.202348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac645fca-9c40-4ebf-b272-66f4bfbf1726 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:55.205245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac645fca-9c40-4ebf-b272-66f4bfbf1726 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:55.205924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac645fca-9c40-4ebf-b272-66f4bfbf1726 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:55.206750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2875cc3e-4f87-4092-8fbe-5924dde57eef tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:55.207079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2875cc3e-4f87-4092-8fbe-5924dde57eef tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:55.207545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2875cc3e-4f87-4092-8fbe-5924dde57eef tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:55.208308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2875cc3e-4f87-4092-8fbe-5924dde57eef tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:55.208585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac645fca-9c40-4ebf-b272-66f4bfbf1726 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:55.209398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2875cc3e-4f87-4092-8fbe-5924dde57eef tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:55.209844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2875cc3e-4f87-4092-8fbe-5924dde57eef tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:55.210164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac645fca-9c40-4ebf-b272-66f4bfbf1726 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:55.211846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac645fca-9c40-4ebf-b272-66f4bfbf1726 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:55.597048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac645fca-9c40-4ebf-b272-66f4bfbf1726 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:55.607669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac645fca-9c40-4ebf-b272-66f4bfbf1726 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:55.609407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac645fca-9c40-4ebf-b272-66f4bfbf1726 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:55.610888 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ac645fca-9c40-4ebf-b272-66f4bfbf1726 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.441573 Aug 27 04:40:55.624106 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1218/2459] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:55 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:55.633180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-0b183346-d0c7-4313-b229-2351410810d8 req-6662baae-4d29-4cd4-9b10-025815cbfd96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39575026-a753-4c15-ba36-59029811826f", "name": "network-vif-unplugged", "status": "completed", "tag": "e868a365-84b1-4305-9f13-56da941f9db8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:55.657716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0b183346-d0c7-4313-b229-2351410810d8 req-6662baae-4d29-4cd4-9b10-025815cbfd96 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:55.660097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0b183346-d0c7-4313-b229-2351410810d8 req-6662baae-4d29-4cd4-9b10-025815cbfd96 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:55.660624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0b183346-d0c7-4313-b229-2351410810d8 req-6662baae-4d29-4cd4-9b10-025815cbfd96 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:55.695123 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-0b183346-d0c7-4313-b229-2351410810d8 req-6662baae-4d29-4cd4-9b10-025815cbfd96 service nova] Creating event network-vif-unplugged:e868a365-84b1-4305-9f13-56da941f9db8 for instance 39575026-a753-4c15-ba36-59029811826f on n-h2-854823-1 Aug 27 04:40:55.709235 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-0b183346-d0c7-4313-b229-2351410810d8 req-6662baae-4d29-4cd4-9b10-025815cbfd96 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083445 Aug 27 04:40:55.710015 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1219/2460] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:55.724898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59c1d2e9-62f5-4df7-b63b-0ced7bc7024d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:55.725619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-59c1d2e9-62f5-4df7-b63b-0ced7bc7024d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:55.742779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59c1d2e9-62f5-4df7-b63b-0ced7bc7024d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:55.743335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59c1d2e9-62f5-4df7-b63b-0ced7bc7024d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:55.744008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59c1d2e9-62f5-4df7-b63b-0ced7bc7024d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:55.745491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59c1d2e9-62f5-4df7-b63b-0ced7bc7024d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:55.746653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59c1d2e9-62f5-4df7-b63b-0ced7bc7024d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:55.747040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59c1d2e9-62f5-4df7-b63b-0ced7bc7024d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:56.055234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-59c1d2e9-62f5-4df7-b63b-0ced7bc7024d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:56.073969 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-59c1d2e9-62f5-4df7-b63b-0ced7bc7024d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1589 microversion: 2.1 time: 0.360501 Aug 27 04:40:56.074806 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1220/2461] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:55 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1589 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:56.100361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-964ac865-aa70-44c3-ab88-c31f902c1efe tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:56.101736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-964ac865-aa70-44c3-ab88-c31f902c1efe tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:56.110605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-964ac865-aa70-44c3-ab88-c31f902c1efe tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:56.111124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-964ac865-aa70-44c3-ab88-c31f902c1efe tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:56.111579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-964ac865-aa70-44c3-ab88-c31f902c1efe tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:56.112319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-964ac865-aa70-44c3-ab88-c31f902c1efe tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:56.112940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-964ac865-aa70-44c3-ab88-c31f902c1efe tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:56.113661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-964ac865-aa70-44c3-ab88-c31f902c1efe tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:56.229733 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-964ac865-aa70-44c3-ab88-c31f902c1efe tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135696 Aug 27 04:40:56.230910 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1221/2462] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 04:40:56 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:56.236254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d66841ee-e87a-4c7f-a60d-e552deb559dd tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:56.237152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d66841ee-e87a-4c7f-a60d-e552deb559dd tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:56.256939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d66841ee-e87a-4c7f-a60d-e552deb559dd tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:56.259480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d66841ee-e87a-4c7f-a60d-e552deb559dd tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:56.261219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d66841ee-e87a-4c7f-a60d-e552deb559dd tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:56.262071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d66841ee-e87a-4c7f-a60d-e552deb559dd tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:56.264252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d66841ee-e87a-4c7f-a60d-e552deb559dd tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:56.264883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d66841ee-e87a-4c7f-a60d-e552deb559dd tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:56.646025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d66841ee-e87a-4c7f-a60d-e552deb559dd tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:56.657233 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d66841ee-e87a-4c7f-a60d-e552deb559dd tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1486 microversion: 2.1 time: 0.425050 Aug 27 04:40:56.673172 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1222/2463] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:56 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1486 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:56.673172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e03187ba-58d0-48a6-bf05-9fd851a1d6ac tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:56.673172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e03187ba-58d0-48a6-bf05-9fd851a1d6ac tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:56.680339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2875cc3e-4f87-4092-8fbe-5924dde57eef tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:56.684011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e03187ba-58d0-48a6-bf05-9fd851a1d6ac tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:56.684642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e03187ba-58d0-48a6-bf05-9fd851a1d6ac tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:56.685111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e03187ba-58d0-48a6-bf05-9fd851a1d6ac tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:56.696809 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2875cc3e-4f87-4092-8fbe-5924dde57eef tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1473 microversion: 2.1 time: 1.555670 Aug 27 04:40:56.697294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e03187ba-58d0-48a6-bf05-9fd851a1d6ac tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:56.697939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e03187ba-58d0-48a6-bf05-9fd851a1d6ac tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:56.698355 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1242/2464] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:55 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1473 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:56.698775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e03187ba-58d0-48a6-bf05-9fd851a1d6ac tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:56.713316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23058cb9-484b-4adc-a237-6de680c65371 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:56.715046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-23058cb9-484b-4adc-a237-6de680c65371 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:56.725459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23058cb9-484b-4adc-a237-6de680c65371 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:56.727363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23058cb9-484b-4adc-a237-6de680c65371 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:56.729896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23058cb9-484b-4adc-a237-6de680c65371 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:56.730882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23058cb9-484b-4adc-a237-6de680c65371 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:56.736581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23058cb9-484b-4adc-a237-6de680c65371 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:56.737557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23058cb9-484b-4adc-a237-6de680c65371 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:57.082586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:57.518410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e03187ba-58d0-48a6-bf05-9fd851a1d6ac tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:57.533358 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e03187ba-58d0-48a6-bf05-9fd851a1d6ac tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1324 microversion: 2.1 time: 0.870411 Aug 27 04:40:57.544959 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1223/2465] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:56 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1324 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:57.554202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5ed25c31-0854-4f5e-abba-471d0dab4112 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:57.556144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5ed25c31-0854-4f5e-abba-471d0dab4112 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:57.571079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ed25c31-0854-4f5e-abba-471d0dab4112 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:57.573691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ed25c31-0854-4f5e-abba-471d0dab4112 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:57.575304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ed25c31-0854-4f5e-abba-471d0dab4112 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:57.577281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ed25c31-0854-4f5e-abba-471d0dab4112 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:57.579460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ed25c31-0854-4f5e-abba-471d0dab4112 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:57.583983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ed25c31-0854-4f5e-abba-471d0dab4112 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:57.661628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5ed25c31-0854-4f5e-abba-471d0dab4112 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:40:57.857531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-23058cb9-484b-4adc-a237-6de680c65371 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:57.882954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-23058cb9-484b-4adc-a237-6de680c65371 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:57.892611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-23058cb9-484b-4adc-a237-6de680c65371 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:57.904324 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23058cb9-484b-4adc-a237-6de680c65371 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 1.199657 Aug 27 04:40:57.909261 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1243/2466] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:56 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:40:57.929977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:57.933191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e54153f-b00e-4c0f-9cac-a2381545263c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:57.934427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e54153f-b00e-4c0f-9cac-a2381545263c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:57.943032 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5ed25c31-0854-4f5e-abba-471d0dab4112 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 204 len: 0 microversion: 2.1 time: 0.390347 Aug 27 04:40:57.947366 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1224/2467] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:40:57 2022] DELETE /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:40:57.959755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-05d4143b-965f-45b7-b4d4-e3399e5dc1f9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:57.966611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-05d4143b-965f-45b7-b4d4-e3399e5dc1f9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:57.969072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e54153f-b00e-4c0f-9cac-a2381545263c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:57.970915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e54153f-b00e-4c0f-9cac-a2381545263c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:57.972973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e54153f-b00e-4c0f-9cac-a2381545263c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:57.977392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e54153f-b00e-4c0f-9cac-a2381545263c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:57.983273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e54153f-b00e-4c0f-9cac-a2381545263c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:57.984031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e54153f-b00e-4c0f-9cac-a2381545263c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:58.013465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05d4143b-965f-45b7-b4d4-e3399e5dc1f9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:58.015816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05d4143b-965f-45b7-b4d4-e3399e5dc1f9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:58.017631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05d4143b-965f-45b7-b4d4-e3399e5dc1f9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:58.019211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05d4143b-965f-45b7-b4d4-e3399e5dc1f9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:58.019705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05d4143b-965f-45b7-b4d4-e3399e5dc1f9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:58.022352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05d4143b-965f-45b7-b4d4-e3399e5dc1f9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:58.096451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:58.763377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2e54153f-b00e-4c0f-9cac-a2381545263c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:58.789287 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e54153f-b00e-4c0f-9cac-a2381545263c tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1473 microversion: 2.1 time: 0.873655 Aug 27 04:40:58.789935 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1244/2468] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:57 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1473 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:58.806512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cdbdaf0d-b444-457e-9135-2b52e1ac9bae req-a660ad46-e6a0-4f77-98d4-dc434227ed84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c8d252-e69b-489b-86ff-6ca1eecec963", "tag": "294de1ec-f506-40c1-a6ae-379dd686a18a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:58.857807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cdbdaf0d-b444-457e-9135-2b52e1ac9bae req-a660ad46-e6a0-4f77-98d4-dc434227ed84 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:58.862304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cdbdaf0d-b444-457e-9135-2b52e1ac9bae req-a660ad46-e6a0-4f77-98d4-dc434227ed84 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:58.868148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cdbdaf0d-b444-457e-9135-2b52e1ac9bae req-a660ad46-e6a0-4f77-98d4-dc434227ed84 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:58.954363 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cdbdaf0d-b444-457e-9135-2b52e1ac9bae req-a660ad46-e6a0-4f77-98d4-dc434227ed84 service nova] Creating event network-changed:294de1ec-f506-40c1-a6ae-379dd686a18a for instance 85c8d252-e69b-489b-86ff-6ca1eecec963 on n-h1-854823-1 Aug 27 04:40:58.983157 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cdbdaf0d-b444-457e-9135-2b52e1ac9bae req-a660ad46-e6a0-4f77-98d4-dc434227ed84 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190260 Aug 27 04:40:58.991170 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1245/2469] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:59.013968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b7d553a5-bd37-47d1-98c6-c6069d95e390 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:59.015088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b7d553a5-bd37-47d1-98c6-c6069d95e390 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:59.035109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7d553a5-bd37-47d1-98c6-c6069d95e390 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:59.037495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7d553a5-bd37-47d1-98c6-c6069d95e390 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:59.039385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7d553a5-bd37-47d1-98c6-c6069d95e390 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:59.042374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7d553a5-bd37-47d1-98c6-c6069d95e390 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:59.043297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7d553a5-bd37-47d1-98c6-c6069d95e390 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:59.043998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7d553a5-bd37-47d1-98c6-c6069d95e390 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:59.445285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b7d553a5-bd37-47d1-98c6-c6069d95e390 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:59.458849 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b7d553a5-bd37-47d1-98c6-c6069d95e390 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1324 microversion: 2.1 time: 0.463554 Aug 27 04:40:59.460162 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1246/2470] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:58 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1324 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:59.486713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c95bd2f1-369e-4207-9936-6fff5f693b53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:59.487650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c95bd2f1-369e-4207-9936-6fff5f693b53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:59.496847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c95bd2f1-369e-4207-9936-6fff5f693b53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:59.497809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c95bd2f1-369e-4207-9936-6fff5f693b53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:59.498831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c95bd2f1-369e-4207-9936-6fff5f693b53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:59.499794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c95bd2f1-369e-4207-9936-6fff5f693b53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:59.500436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c95bd2f1-369e-4207-9936-6fff5f693b53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:59.501446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c95bd2f1-369e-4207-9936-6fff5f693b53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:59.786587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-05d4143b-965f-45b7-b4d4-e3399e5dc1f9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:59.797650 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-05d4143b-965f-45b7-b4d4-e3399e5dc1f9 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1492 microversion: 2.1 time: 1.844848 Aug 27 04:40:59.798248 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1225/2471] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:57 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1492 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:59.813116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a3e7d7ab-9ca1-460e-a3f6-09ffc6adff45 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:59.816481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a3e7d7ab-9ca1-460e-a3f6-09ffc6adff45 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:59.831093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3e7d7ab-9ca1-460e-a3f6-09ffc6adff45 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:59.834889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3e7d7ab-9ca1-460e-a3f6-09ffc6adff45 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:59.835679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3e7d7ab-9ca1-460e-a3f6-09ffc6adff45 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:59.838872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3e7d7ab-9ca1-460e-a3f6-09ffc6adff45 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:59.839659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3e7d7ab-9ca1-460e-a3f6-09ffc6adff45 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:59.840303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3e7d7ab-9ca1-460e-a3f6-09ffc6adff45 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:00.118244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c95bd2f1-369e-4207-9936-6fff5f693b53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:00.132029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c95bd2f1-369e-4207-9936-6fff5f693b53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:00.133686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c95bd2f1-369e-4207-9936-6fff5f693b53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:00.134889 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c95bd2f1-369e-4207-9936-6fff5f693b53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.671465 Aug 27 04:41:00.143429 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1247/2472] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:40:59 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:00.148711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0a39c6d0-dd96-4c1e-a272-dcef0080c1d2 req-32a04d9c-c676-4616-85b5-059322a3233c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39575026-a753-4c15-ba36-59029811826f", "name": "network-vif-deleted", "tag": "e868a365-84b1-4305-9f13-56da941f9db8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:00.170932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0a39c6d0-dd96-4c1e-a272-dcef0080c1d2 req-32a04d9c-c676-4616-85b5-059322a3233c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:00.175939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0a39c6d0-dd96-4c1e-a272-dcef0080c1d2 req-32a04d9c-c676-4616-85b5-059322a3233c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:00.178189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0a39c6d0-dd96-4c1e-a272-dcef0080c1d2 req-32a04d9c-c676-4616-85b5-059322a3233c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:00.213511 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0a39c6d0-dd96-4c1e-a272-dcef0080c1d2 req-32a04d9c-c676-4616-85b5-059322a3233c service nova] Creating event network-vif-deleted:e868a365-84b1-4305-9f13-56da941f9db8 for instance 39575026-a753-4c15-ba36-59029811826f on n-h2-854823-1 Aug 27 04:41:00.225435 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0a39c6d0-dd96-4c1e-a272-dcef0080c1d2 req-32a04d9c-c676-4616-85b5-059322a3233c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077114 Aug 27 04:41:00.228218 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1248/2473] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:00.269459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a3e7d7ab-9ca1-460e-a3f6-09ffc6adff45 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b9b0d20ee74c999f83602bfb52b705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851596d90257494a92286fd41e796615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:00.284870 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a3e7d7ab-9ca1-460e-a3f6-09ffc6adff45 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 200 len: 1431 microversion: 2.1 time: 0.474231 Aug 27 04:41:00.286197 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1226/2474] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:59 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 1431 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:00.488870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5afcbd6d-7456-4aed-bd2e-ce59aa42262f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:00.489932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5afcbd6d-7456-4aed-bd2e-ce59aa42262f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:00.505004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5afcbd6d-7456-4aed-bd2e-ce59aa42262f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:00.507215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5afcbd6d-7456-4aed-bd2e-ce59aa42262f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:00.507731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5afcbd6d-7456-4aed-bd2e-ce59aa42262f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:00.519740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5afcbd6d-7456-4aed-bd2e-ce59aa42262f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:00.521581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5afcbd6d-7456-4aed-bd2e-ce59aa42262f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:00.523107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5afcbd6d-7456-4aed-bd2e-ce59aa42262f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:00.828205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fbb2122a-9ebb-4a23-b1c2-5f0724e0fd96 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:00.828893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fbb2122a-9ebb-4a23-b1c2-5f0724e0fd96 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:00.841720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbb2122a-9ebb-4a23-b1c2-5f0724e0fd96 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:00.844912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbb2122a-9ebb-4a23-b1c2-5f0724e0fd96 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:00.845566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbb2122a-9ebb-4a23-b1c2-5f0724e0fd96 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:00.850964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbb2122a-9ebb-4a23-b1c2-5f0724e0fd96 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:00.852409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbb2122a-9ebb-4a23-b1c2-5f0724e0fd96 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:00.866601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbb2122a-9ebb-4a23-b1c2-5f0724e0fd96 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:00.907789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:00.977022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5afcbd6d-7456-4aed-bd2e-ce59aa42262f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:00.987487 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5afcbd6d-7456-4aed-bd2e-ce59aa42262f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1324 microversion: 2.1 time: 0.511816 Aug 27 04:41:00.989291 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1249/2475] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:00 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1324 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:01.172830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2784e1da-679b-4260-973f-9f36a949d7fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:01.174297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2784e1da-679b-4260-973f-9f36a949d7fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:01.188101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2784e1da-679b-4260-973f-9f36a949d7fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:01.190011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2784e1da-679b-4260-973f-9f36a949d7fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:01.190974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2784e1da-679b-4260-973f-9f36a949d7fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:01.193157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2784e1da-679b-4260-973f-9f36a949d7fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:01.195508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2784e1da-679b-4260-973f-9f36a949d7fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:01.196159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2784e1da-679b-4260-973f-9f36a949d7fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:01.467030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2784e1da-679b-4260-973f-9f36a949d7fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:01.481961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2784e1da-679b-4260-973f-9f36a949d7fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:01.485339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2784e1da-679b-4260-973f-9f36a949d7fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:01.488549 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2784e1da-679b-4260-973f-9f36a949d7fc tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.323657 Aug 27 04:41:01.495419 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1250/2476] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:01 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:01.509228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe0ef62b-6eeb-4b65-b5ee-e4b0b164c334 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:01.510666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe0ef62b-6eeb-4b65-b5ee-e4b0b164c334 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] [instance: 39575026-a753-4c15-ba36-59029811826f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:01.530793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe0ef62b-6eeb-4b65-b5ee-e4b0b164c334 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:01.535547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe0ef62b-6eeb-4b65-b5ee-e4b0b164c334 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:01.537046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe0ef62b-6eeb-4b65-b5ee-e4b0b164c334 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:01.538625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe0ef62b-6eeb-4b65-b5ee-e4b0b164c334 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:01.543185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe0ef62b-6eeb-4b65-b5ee-e4b0b164c334 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:01.544499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe0ef62b-6eeb-4b65-b5ee-e4b0b164c334 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:01.579371 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-fe0ef62b-6eeb-4b65-b5ee-e4b0b164c334 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] HTTP exception thrown: Instance 39575026-a753-4c15-ba36-59029811826f could not be found. Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe0ef62b-6eeb-4b65-b5ee-e4b0b164c334 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Request method failure captured: Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f HTTP/1.1 Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_woK6Ya4niQrEexsBKsmTunnoQzAO464p8PeA03wzY9CL5lS0eb6OvDOmvJYJQRK4JLtIsixVSUL3NSaPJm4n0735dfFH1sTIqVav26y--Y0zn0Onr3h3JOH_aqY2hwxzDLbbpFawcM5RnOP4CPyyBEMZg6fcFwm1WjtI6I7VrRiw Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 851596d90257494a92286fd41e796615 Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerTestJSON-1879319611 Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/851596d90257494a92286fd41e796615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_851596d90257494a92286fd41e796615"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/851596d90257494a92286fd41e796615"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/851596d90257494a92286fd41e796615"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerTestJSON-1879319611 Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 851596d90257494a92286fd41e796615 Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1879319611 Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerTestJSON-1879319611-project Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 79b9b0d20ee74c999f83602bfb52b705 Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerTestJSON-1879319611-project Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 39575026-a753-4c15-ba36-59029811826f could not be found. Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '39575026-a753-4c15-ba36-59029811826f'} Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39575026-a753-4c15-ba36-59029811826f could not be found. Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39575026-a753-4c15-ba36-59029811826f could not be found. Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:41:01.581105 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:41:01.584675 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:41:01.584675 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:41:01.584675 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:41:01.584675 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:41:01.584675 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:41:01.584675 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39575026-a753-4c15-ba36-59029811826f could not be found. Aug 27 04:41:01.584675 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:41:01.584675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe0ef62b-6eeb-4b65-b5ee-e4b0b164c334 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] Returning 404 to user: Instance 39575026-a753-4c15-ba36-59029811826f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:41:01.584675 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe0ef62b-6eeb-4b65-b5ee-e4b0b164c334 tempest-ImagesOneServerTestJSON-1879319611 tempest-ImagesOneServerTestJSON-1879319611-project] 10.222.0.79 "GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f" status: 404 len: 111 microversion: 2.1 time: 0.085865 Aug 27 04:41:01.584675 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1251/2477] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:01 2022] GET /compute/v2.1/servers/39575026-a753-4c15-ba36-59029811826f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:41:01.748055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fbb2122a-9ebb-4a23-b1c2-5f0724e0fd96 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:01.764408 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fbb2122a-9ebb-4a23-b1c2-5f0724e0fd96 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1492 microversion: 2.1 time: 0.938523 Aug 27 04:41:01.765073 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1227/2478] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:00 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1492 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:01.787889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4bf066a9-c0fb-4f6c-aea0-340a4eb0c1d9 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:01.791159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4bf066a9-c0fb-4f6c-aea0-340a4eb0c1d9 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:01.814783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4bf066a9-c0fb-4f6c-aea0-340a4eb0c1d9 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:01.816759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4bf066a9-c0fb-4f6c-aea0-340a4eb0c1d9 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:01.818691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4bf066a9-c0fb-4f6c-aea0-340a4eb0c1d9 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:01.821091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4bf066a9-c0fb-4f6c-aea0-340a4eb0c1d9 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:01.827359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4bf066a9-c0fb-4f6c-aea0-340a4eb0c1d9 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:01.828178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4bf066a9-c0fb-4f6c-aea0-340a4eb0c1d9 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:01.915480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-334347548", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "7a554d33-7c77-4955-a453-fe37c4f850fa"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:02.086883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] validate_networks() for [('7a554d33-7c77-4955-a453-fe37c4f850fa', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:41:02.367804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4bf066a9-c0fb-4f6c-aea0-340a4eb0c1d9 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:02.379735 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4bf066a9-c0fb-4f6c-aea0-340a4eb0c1d9 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1589 microversion: 2.1 time: 0.608912 Aug 27 04:41:02.386958 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1228/2479] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:01 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1589 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:02.405478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-55f9872b-0dc7-4fd6-af5f-e0896adbc409 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:02.406382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-55f9872b-0dc7-4fd6-af5f-e0896adbc409 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:02.421090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55f9872b-0dc7-4fd6-af5f-e0896adbc409 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:02.428035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55f9872b-0dc7-4fd6-af5f-e0896adbc409 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:02.428510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55f9872b-0dc7-4fd6-af5f-e0896adbc409 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:02.431498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55f9872b-0dc7-4fd6-af5f-e0896adbc409 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:02.432810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55f9872b-0dc7-4fd6-af5f-e0896adbc409 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:02.436297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55f9872b-0dc7-4fd6-af5f-e0896adbc409 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:02.749687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-55f9872b-0dc7-4fd6-af5f-e0896adbc409 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:02.776324 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-55f9872b-0dc7-4fd6-af5f-e0896adbc409 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1324 microversion: 2.1 time: 0.387395 Aug 27 04:41:02.776558 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1229/2480] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:02 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1324 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:02.812919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-22ba13f9-3169-415e-af68-b1bae261b086 req-b04453b9-066b-4b05-9465-15b3d18338da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa23773c-4169-43f8-8529-5f22a60e8836", "tag": "3cad5baa-ac77-43e1-8c2c-9c89cccb50dd"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:02.840184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-22ba13f9-3169-415e-af68-b1bae261b086 req-b04453b9-066b-4b05-9465-15b3d18338da service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:02.842487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-22ba13f9-3169-415e-af68-b1bae261b086 req-b04453b9-066b-4b05-9465-15b3d18338da service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:02.843747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-22ba13f9-3169-415e-af68-b1bae261b086 req-b04453b9-066b-4b05-9465-15b3d18338da service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:02.865739 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-22ba13f9-3169-415e-af68-b1bae261b086 req-b04453b9-066b-4b05-9465-15b3d18338da service nova] Creating event network-changed:3cad5baa-ac77-43e1-8c2c-9c89cccb50dd for instance aa23773c-4169-43f8-8529-5f22a60e8836 on n-h1-854823-1 Aug 27 04:41:02.872778 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-22ba13f9-3169-415e-af68-b1bae261b086 req-b04453b9-066b-4b05-9465-15b3d18338da service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095088 Aug 27 04:41:02.879024 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1230/2481] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:02.886230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3192a898-0443-4835-9c65-c278660a3fd9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:02.887425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3192a898-0443-4835-9c65-c278660a3fd9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:02.896301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3192a898-0443-4835-9c65-c278660a3fd9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:02.897716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3192a898-0443-4835-9c65-c278660a3fd9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:02.898451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3192a898-0443-4835-9c65-c278660a3fd9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:02.899504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3192a898-0443-4835-9c65-c278660a3fd9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:02.900194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3192a898-0443-4835-9c65-c278660a3fd9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:02.914706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3192a898-0443-4835-9c65-c278660a3fd9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:03.513723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3192a898-0443-4835-9c65-c278660a3fd9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:03.522811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3192a898-0443-4835-9c65-c278660a3fd9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:03.524270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3192a898-0443-4835-9c65-c278660a3fd9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:03.533762 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3192a898-0443-4835-9c65-c278660a3fd9 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.653228 Aug 27 04:41:03.534383 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1231/2482] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:02 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:03.539059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3b09763b-2ee8-45da-a4b0-f77bc8bba7b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:03.539669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3b09763b-2ee8-45da-a4b0-f77bc8bba7b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:03.556275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b09763b-2ee8-45da-a4b0-f77bc8bba7b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:03.559198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b09763b-2ee8-45da-a4b0-f77bc8bba7b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:03.569252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b09763b-2ee8-45da-a4b0-f77bc8bba7b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:03.570253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b09763b-2ee8-45da-a4b0-f77bc8bba7b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:03.570900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b09763b-2ee8-45da-a4b0-f77bc8bba7b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:03.571509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b09763b-2ee8-45da-a4b0-f77bc8bba7b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:03.655266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b09763b-2ee8-45da-a4b0-f77bc8bba7b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:03.655372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b09763b-2ee8-45da-a4b0-f77bc8bba7b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:03.658523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b09763b-2ee8-45da-a4b0-f77bc8bba7b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:03.659019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-3b09763b-2ee8-45da-a4b0-f77bc8bba7b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lazy-loading 'fault' on Instance uuid a0c55941-6705-4a1a-8e95-21886e1499f3 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:41:03.806003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3b09763b-2ee8-45da-a4b0-f77bc8bba7b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:03.815062 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3b09763b-2ee8-45da-a4b0-f77bc8bba7b1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 200 len: 1305 microversion: 2.1 time: 0.279608 Aug 27 04:41:03.819834 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1232/2483] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:03 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 1305 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:03.830505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:41:03.831014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:41:03.832797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98b717df-9f18-4f4d-b86f-062a1d6f40b4 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:03.833457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98b717df-9f18-4f4d-b86f-062a1d6f40b4 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:03.834335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:41:03.836261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:41:03.836943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:41:03.857676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98b717df-9f18-4f4d-b86f-062a1d6f40b4 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:03.858194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98b717df-9f18-4f4d-b86f-062a1d6f40b4 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:03.858646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98b717df-9f18-4f4d-b86f-062a1d6f40b4 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:03.859404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98b717df-9f18-4f4d-b86f-062a1d6f40b4 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:03.859874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98b717df-9f18-4f4d-b86f-062a1d6f40b4 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:03.860327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98b717df-9f18-4f4d-b86f-062a1d6f40b4 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:03.865663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:03.870500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:03.871739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:03.875926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:03.876649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:03.877333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:03.941469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Getting quotas for project 31d3333b4ddd41e2a8afc3a4506894c5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:41:03.957185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Getting quotas for user 180ae8cc1dcc4076ab73bb564b49eba5 and project 31d3333b4ddd41e2a8afc3a4506894c5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:41:04.014940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Going to run 2 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:41:04.031504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: a1871fce-ce02-43f5-a460-02f259a72471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:41:04.155229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=a1871fce-ce02-43f5-a460-02f259a72471,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:41:04.231034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-98b717df-9f18-4f4d-b86f-062a1d6f40b4 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:04.243298 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-98b717df-9f18-4f4d-b86f-062a1d6f40b4 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1324 microversion: 2.1 time: 0.421623 Aug 27 04:41:04.244083 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1233/2484] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:03 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1324 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:04.323906 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dd7dcf2d-976c-4820-a6ac-f02c53c7162f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.739408 Aug 27 04:41:04.325180 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1252/2485] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:41:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:41:04.339960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-25722c23-7251-4f0b-be2e-904f7670a652 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:04.345523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-25722c23-7251-4f0b-be2e-904f7670a652 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:04.346751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-25722c23-7251-4f0b-be2e-904f7670a652 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Searching by: {'deleted': False, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:41:04.396475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25722c23-7251-4f0b-be2e-904f7670a652 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:04.398409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25722c23-7251-4f0b-be2e-904f7670a652 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:04.401990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25722c23-7251-4f0b-be2e-904f7670a652 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:04.403007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25722c23-7251-4f0b-be2e-904f7670a652 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:04.404012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25722c23-7251-4f0b-be2e-904f7670a652 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:04.404645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25722c23-7251-4f0b-be2e-904f7670a652 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:04.559426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c77261f-b835-4024-b016-7a29cbbba5c6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:04.560041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c77261f-b835-4024-b016-7a29cbbba5c6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:04.578447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c77261f-b835-4024-b016-7a29cbbba5c6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:04.578861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c77261f-b835-4024-b016-7a29cbbba5c6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:04.579319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c77261f-b835-4024-b016-7a29cbbba5c6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:04.580068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c77261f-b835-4024-b016-7a29cbbba5c6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:04.580555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c77261f-b835-4024-b016-7a29cbbba5c6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:04.590574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c77261f-b835-4024-b016-7a29cbbba5c6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:04.637242 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-25722c23-7251-4f0b-be2e-904f7670a652 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.301617 Aug 27 04:41:04.638297 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1234/2486] 10.222.0.79 () {58 vars in 1125 bytes} [Sat Aug 27 04:41:04 2022] GET /compute/v2.1/servers => generated 675 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:04.649850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-431260e5-85ad-47ed-9fe8-f7a23e3e8701 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:04.653592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-431260e5-85ad-47ed-9fe8-f7a23e3e8701 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:04.925673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-431260e5-85ad-47ed-9fe8-f7a23e3e8701 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:04.940265 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-431260e5-85ad-47ed-9fe8-f7a23e3e8701 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1219 microversion: 2.1 time: 0.292625 Aug 27 04:41:04.940922 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1235/2487] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:04 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1219 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:04.958708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-21fd51b2-a4bf-4c03-98a5-b0335cd64875 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:04.960353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-21fd51b2-a4bf-4c03-98a5-b0335cd64875 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:04.964356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c77261f-b835-4024-b016-7a29cbbba5c6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:04.985143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21fd51b2-a4bf-4c03-98a5-b0335cd64875 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:04.985646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21fd51b2-a4bf-4c03-98a5-b0335cd64875 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:04.986083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21fd51b2-a4bf-4c03-98a5-b0335cd64875 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:04.991250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:04.994030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21fd51b2-a4bf-4c03-98a5-b0335cd64875 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:04.996917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21fd51b2-a4bf-4c03-98a5-b0335cd64875 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:04.997406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21fd51b2-a4bf-4c03-98a5-b0335cd64875 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:05.001115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c77261f-b835-4024-b016-7a29cbbba5c6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:05.003400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c77261f-b835-4024-b016-7a29cbbba5c6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:05.009653 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c77261f-b835-4024-b016-7a29cbbba5c6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.454876 Aug 27 04:41:05.014588 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1253/2488] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:04 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:05.027580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-77e02b80-8675-453c-9cb5-40f4309956e3 req-a2a2b3ee-0baa-419d-be9b-f81dde703258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c55941-6705-4a1a-8e95-21886e1499f3", "name": "network-vif-deleted", "tag": "815ba3c2-7f4a-4ed8-aa0b-011b806fff32"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:05.046238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77e02b80-8675-453c-9cb5-40f4309956e3 req-a2a2b3ee-0baa-419d-be9b-f81dde703258 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:05.047012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77e02b80-8675-453c-9cb5-40f4309956e3 req-a2a2b3ee-0baa-419d-be9b-f81dde703258 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:05.047639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77e02b80-8675-453c-9cb5-40f4309956e3 req-a2a2b3ee-0baa-419d-be9b-f81dde703258 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:05.055808 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-21fd51b2-a4bf-4c03-98a5-b0335cd64875 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:41:05.071187 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-77e02b80-8675-453c-9cb5-40f4309956e3 req-a2a2b3ee-0baa-419d-be9b-f81dde703258 service nova] Creating event network-vif-deleted:815ba3c2-7f4a-4ed8-aa0b-011b806fff32 for instance a0c55941-6705-4a1a-8e95-21886e1499f3 on n-h2-854823-1 Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-21fd51b2-a4bf-4c03-98a5-b0335cd64875 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 HTTP/1.1 Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'a0c55941-6705-4a1a-8e95-21886e1499f3'} Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:41:05.074522 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:41:05.081697 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:41:05.081697 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:41:05.081697 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:41:05.081697 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:41:05.081697 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:41:05.081697 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:41:05.081697 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:41:05.081697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-21fd51b2-a4bf-4c03-98a5-b0335cd64875 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:41:05.081697 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-21fd51b2-a4bf-4c03-98a5-b0335cd64875 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 404 len: 111 microversion: 2.1 time: 0.132483 Aug 27 04:41:05.085065 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1236/2489] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:04 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:41:05.089101 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-77e02b80-8675-453c-9cb5-40f4309956e3 req-a2a2b3ee-0baa-419d-be9b-f81dde703258 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070888 Aug 27 04:41:05.092431 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1254/2490] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:05.272456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0ebf1e2-7f09-4eed-a8b2-67e4ffbf5695 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:05.273340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c0ebf1e2-7f09-4eed-a8b2-67e4ffbf5695 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:05.280897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0ebf1e2-7f09-4eed-a8b2-67e4ffbf5695 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:05.289467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0ebf1e2-7f09-4eed-a8b2-67e4ffbf5695 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:05.290642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0ebf1e2-7f09-4eed-a8b2-67e4ffbf5695 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:05.294233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0ebf1e2-7f09-4eed-a8b2-67e4ffbf5695 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:05.295683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0ebf1e2-7f09-4eed-a8b2-67e4ffbf5695 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:05.296133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0ebf1e2-7f09-4eed-a8b2-67e4ffbf5695 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:05.366572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-983995640", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "fa9d001d-b3bf-4c75-aaaf-2dd93a5532f5"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:05.525068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] validate_networks() for [('fa9d001d-b3bf-4c75-aaaf-2dd93a5532f5', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:41:05.582551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c0ebf1e2-7f09-4eed-a8b2-67e4ffbf5695 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:05.596817 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c0ebf1e2-7f09-4eed-a8b2-67e4ffbf5695 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1324 microversion: 2.1 time: 0.329355 Aug 27 04:41:05.598801 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1237/2491] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:05 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:05.962791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-93ecaa33-64cf-4124-a526-09d653fd9fc4 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:05.965006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-93ecaa33-64cf-4124-a526-09d653fd9fc4 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:05.979788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93ecaa33-64cf-4124-a526-09d653fd9fc4 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:05.983638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93ecaa33-64cf-4124-a526-09d653fd9fc4 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:05.985335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93ecaa33-64cf-4124-a526-09d653fd9fc4 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:05.988493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93ecaa33-64cf-4124-a526-09d653fd9fc4 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:05.993655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93ecaa33-64cf-4124-a526-09d653fd9fc4 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:05.994654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93ecaa33-64cf-4124-a526-09d653fd9fc4 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:06.232185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-93ecaa33-64cf-4124-a526-09d653fd9fc4 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:06.248366 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-93ecaa33-64cf-4124-a526-09d653fd9fc4 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1223 microversion: 2.1 time: 0.290351 Aug 27 04:41:06.260811 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1238/2492] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:05 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1223 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:06.278541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6ae8b1f6-8baf-48ef-b9d7-d688e5734a53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:06.279626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6ae8b1f6-8baf-48ef-b9d7-d688e5734a53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:06.292218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ae8b1f6-8baf-48ef-b9d7-d688e5734a53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:06.293919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ae8b1f6-8baf-48ef-b9d7-d688e5734a53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:06.294590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ae8b1f6-8baf-48ef-b9d7-d688e5734a53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:06.297963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ae8b1f6-8baf-48ef-b9d7-d688e5734a53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:06.298648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ae8b1f6-8baf-48ef-b9d7-d688e5734a53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:06.300171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ae8b1f6-8baf-48ef-b9d7-d688e5734a53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:06.339649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:41:06.340165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:41:06.340591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:41:06.341008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:41:06.341836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:41:06.348733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:06.365734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:06.368653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:06.369480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:06.371657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:06.377358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:06.377754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:06.437886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Getting quotas for project b902932050be4c04bca1de4fe268c2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:41:06.445332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Getting quotas for user 6c59dc5e251943d59de8b2d640643a0e and project b902932050be4c04bca1de4fe268c2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:41:06.461001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:41:06.465287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:41:06.534060 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55e2c166-0f21-4bd9-aa4f-48d6d9afa5a8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.172226 Aug 27 04:41:06.542055 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1255/2493] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:41:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:41:06.547116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95bba860-ee18-4e6d-a09a-03a177bdad7c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:06.547966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95bba860-ee18-4e6d-a09a-03a177bdad7c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:06.673891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95bba860-ee18-4e6d-a09a-03a177bdad7c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:06.688210 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95bba860-ee18-4e6d-a09a-03a177bdad7c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1214 microversion: 2.1 time: 0.144859 Aug 27 04:41:06.689570 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1256/2494] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:06 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:06.712816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36092b6f-929a-4957-87d6-d0822dd63f57 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:06.714425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36092b6f-929a-4957-87d6-d0822dd63f57 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:06.724677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36092b6f-929a-4957-87d6-d0822dd63f57 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:06.725352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36092b6f-929a-4957-87d6-d0822dd63f57 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:06.725980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36092b6f-929a-4957-87d6-d0822dd63f57 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:06.726839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36092b6f-929a-4957-87d6-d0822dd63f57 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:06.727445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36092b6f-929a-4957-87d6-d0822dd63f57 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:06.728020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36092b6f-929a-4957-87d6-d0822dd63f57 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:06.767423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6ae8b1f6-8baf-48ef-b9d7-d688e5734a53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:06.787200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6ae8b1f6-8baf-48ef-b9d7-d688e5734a53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:06.796830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6ae8b1f6-8baf-48ef-b9d7-d688e5734a53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:06.798051 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6ae8b1f6-8baf-48ef-b9d7-d688e5734a53 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.535669 Aug 27 04:41:06.814685 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1239/2495] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:06 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:06.988553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36092b6f-929a-4957-87d6-d0822dd63f57 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:07.000255 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36092b6f-929a-4957-87d6-d0822dd63f57 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1324 microversion: 2.1 time: 0.309452 Aug 27 04:41:07.001720 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1257/2496] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:06 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1324 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:07.275062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a53e89bc-084d-4745-bd69-10889f25780d tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:07.276937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a53e89bc-084d-4745-bd69-10889f25780d tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:07.316123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a53e89bc-084d-4745-bd69-10889f25780d tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:07.316673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a53e89bc-084d-4745-bd69-10889f25780d tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:07.317133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a53e89bc-084d-4745-bd69-10889f25780d tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:07.317868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a53e89bc-084d-4745-bd69-10889f25780d tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:07.319334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a53e89bc-084d-4745-bd69-10889f25780d tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:07.319790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a53e89bc-084d-4745-bd69-10889f25780d tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:07.519874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a53e89bc-084d-4745-bd69-10889f25780d tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:07.532876 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a53e89bc-084d-4745-bd69-10889f25780d tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1279 microversion: 2.1 time: 0.264329 Aug 27 04:41:07.553232 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1240/2497] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:07 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1279 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:07.711445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-51764eb5-0242-4527-bf36-3f1c290fa7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:07.715027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-51764eb5-0242-4527-bf36-3f1c290fa7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:07.718268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-65f17a6b-2d21-4957-89a5-b57c86e3bff8 req-7d418eec-a6a3-4b1b-97ca-7d94832dd9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c8d252-e69b-489b-86ff-6ca1eecec963", "name": "network-vif-plugged", "status": "completed", "tag": "294de1ec-f506-40c1-a6ae-379dd686a18a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:07.724315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51764eb5-0242-4527-bf36-3f1c290fa7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:07.725268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51764eb5-0242-4527-bf36-3f1c290fa7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:07.725934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51764eb5-0242-4527-bf36-3f1c290fa7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:07.728834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51764eb5-0242-4527-bf36-3f1c290fa7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:07.729810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51764eb5-0242-4527-bf36-3f1c290fa7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:07.731862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51764eb5-0242-4527-bf36-3f1c290fa7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:07.738876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-65f17a6b-2d21-4957-89a5-b57c86e3bff8 req-7d418eec-a6a3-4b1b-97ca-7d94832dd9ca service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:07.740015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-65f17a6b-2d21-4957-89a5-b57c86e3bff8 req-7d418eec-a6a3-4b1b-97ca-7d94832dd9ca service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:07.740303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-65f17a6b-2d21-4957-89a5-b57c86e3bff8 req-7d418eec-a6a3-4b1b-97ca-7d94832dd9ca service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:07.772030 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-65f17a6b-2d21-4957-89a5-b57c86e3bff8 req-7d418eec-a6a3-4b1b-97ca-7d94832dd9ca service nova] Creating event network-vif-plugged:294de1ec-f506-40c1-a6ae-379dd686a18a for instance 85c8d252-e69b-489b-86ff-6ca1eecec963 on n-h1-854823-1 Aug 27 04:41:07.782051 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-65f17a6b-2d21-4957-89a5-b57c86e3bff8 req-7d418eec-a6a3-4b1b-97ca-7d94832dd9ca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067292 Aug 27 04:41:07.783001 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1241/2498] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:07.825129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b15b26f8-c81e-41cb-9563-6f1f89424893 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:07.826257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b15b26f8-c81e-41cb-9563-6f1f89424893 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:07.849927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b15b26f8-c81e-41cb-9563-6f1f89424893 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:07.853226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b15b26f8-c81e-41cb-9563-6f1f89424893 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:07.857754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b15b26f8-c81e-41cb-9563-6f1f89424893 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:07.858209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-51764eb5-0242-4527-bf36-3f1c290fa7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:07.858911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b15b26f8-c81e-41cb-9563-6f1f89424893 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:07.860478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b15b26f8-c81e-41cb-9563-6f1f89424893 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:07.861103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b15b26f8-c81e-41cb-9563-6f1f89424893 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:07.867043 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-51764eb5-0242-4527-bf36-3f1c290fa7c6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1210 microversion: 2.1 time: 0.160208 Aug 27 04:41:07.881255 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1258/2499] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:07 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1210 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:08.034082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa85fad0-c481-49bd-965a-52f9d95e50cc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:08.038990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fa85fad0-c481-49bd-965a-52f9d95e50cc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:08.078070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa85fad0-c481-49bd-965a-52f9d95e50cc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:08.082465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa85fad0-c481-49bd-965a-52f9d95e50cc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:08.085932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa85fad0-c481-49bd-965a-52f9d95e50cc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:08.109461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa85fad0-c481-49bd-965a-52f9d95e50cc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:08.111389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa85fad0-c481-49bd-965a-52f9d95e50cc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:08.112332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa85fad0-c481-49bd-965a-52f9d95e50cc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:08.341872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa85fad0-c481-49bd-965a-52f9d95e50cc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:08.352643 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa85fad0-c481-49bd-965a-52f9d95e50cc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1324 microversion: 2.1 time: 0.333920 Aug 27 04:41:08.353885 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1259/2500] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:08 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:08.358784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79e3bbd9-2619-40dc-ad1a-45eb9692250b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f210ae280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:08.427772 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-79e3bbd9-2619-40dc-ad1a-45eb9692250b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/53e40336-d687-497f-8d54-b68e5e55a854" status: 200 len: 662 microversion: 2.1 time: 0.072525 Aug 27 04:41:08.428640 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1260/2501] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:08 2022] GET /compute/v2.1/images/53e40336-d687-497f-8d54-b68e5e55a854 => generated 662 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:08.444763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47650323-0126-4483-928c-a2bfa6248019 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f2197b9d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:08.507572 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47650323-0126-4483-928c-a2bfa6248019 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/53e40336-d687-497f-8d54-b68e5e55a854" status: 200 len: 662 microversion: 2.1 time: 0.067362 Aug 27 04:41:08.516196 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1261/2502] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:08 2022] GET /compute/v2.1/images/53e40336-d687-497f-8d54-b68e5e55a854 => generated 662 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:08.562458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a5dda2b6-b44b-4b21-869e-8341b7e65751 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:08.564712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a5dda2b6-b44b-4b21-869e-8341b7e65751 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:08.573431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dda2b6-b44b-4b21-869e-8341b7e65751 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:08.573931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dda2b6-b44b-4b21-869e-8341b7e65751 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:08.576276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dda2b6-b44b-4b21-869e-8341b7e65751 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:08.577047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dda2b6-b44b-4b21-869e-8341b7e65751 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:08.578387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dda2b6-b44b-4b21-869e-8341b7e65751 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:08.578966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dda2b6-b44b-4b21-869e-8341b7e65751 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:08.657224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a5dda2b6-b44b-4b21-869e-8341b7e65751 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:08.668196 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a5dda2b6-b44b-4b21-869e-8341b7e65751 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1277 microversion: 2.1 time: 0.111484 Aug 27 04:41:08.669548 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1262/2503] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:08 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:08.891329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab7822b4-544b-407b-a409-fe6624373f88 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:08.892826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab7822b4-544b-407b-a409-fe6624373f88 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:08.902097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab7822b4-544b-407b-a409-fe6624373f88 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:08.902791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab7822b4-544b-407b-a409-fe6624373f88 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:08.903238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab7822b4-544b-407b-a409-fe6624373f88 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:08.903951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab7822b4-544b-407b-a409-fe6624373f88 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:08.904602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab7822b4-544b-407b-a409-fe6624373f88 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:08.905181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab7822b4-544b-407b-a409-fe6624373f88 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:08.919901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b15b26f8-c81e-41cb-9563-6f1f89424893 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:08.936251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b15b26f8-c81e-41cb-9563-6f1f89424893 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:08.937806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b15b26f8-c81e-41cb-9563-6f1f89424893 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:08.939206 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b15b26f8-c81e-41cb-9563-6f1f89424893 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 1.120243 Aug 27 04:41:08.954688 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1242/2504] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:07 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:08.990807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab7822b4-544b-407b-a409-fe6624373f88 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:09.000066 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab7822b4-544b-407b-a409-fe6624373f88 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1266 microversion: 2.1 time: 0.113757 Aug 27 04:41:09.013638 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1263/2505] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:08 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:09.373983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c1e83dfc-6b5b-437c-a26b-f21a396d7afc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:09.376236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c1e83dfc-6b5b-437c-a26b-f21a396d7afc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:09.414759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1e83dfc-6b5b-437c-a26b-f21a396d7afc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:09.417567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1e83dfc-6b5b-437c-a26b-f21a396d7afc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:09.420317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1e83dfc-6b5b-437c-a26b-f21a396d7afc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:09.421320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1e83dfc-6b5b-437c-a26b-f21a396d7afc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:09.422035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1e83dfc-6b5b-437c-a26b-f21a396d7afc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:09.423515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1e83dfc-6b5b-437c-a26b-f21a396d7afc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:09.694368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b901c47f-7fe4-4b78-9f6a-d5054af5f452 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:09.695746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b901c47f-7fe4-4b78-9f6a-d5054af5f452 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:09.714802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b901c47f-7fe4-4b78-9f6a-d5054af5f452 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:09.715720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b901c47f-7fe4-4b78-9f6a-d5054af5f452 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:09.716875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b901c47f-7fe4-4b78-9f6a-d5054af5f452 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:09.717990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b901c47f-7fe4-4b78-9f6a-d5054af5f452 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:09.721195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b901c47f-7fe4-4b78-9f6a-d5054af5f452 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:09.722237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b901c47f-7fe4-4b78-9f6a-d5054af5f452 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:10.168254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c1e83dfc-6b5b-437c-a26b-f21a396d7afc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:10.186059 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c1e83dfc-6b5b-437c-a26b-f21a396d7afc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1324 microversion: 2.1 time: 0.816412 Aug 27 04:41:10.186657 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1243/2506] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:09 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1324 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:10.191311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e423277a-4812-4176-9f5e-44ade2a62621 req-7fc62896-79f5-4f56-8e5a-50d437dc0d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d59b3ef-e433-480b-9183-d020c885ce4d", "name": "network-vif-unplugged", "status": "completed", "tag": "a44adf17-8cdc-487e-b7d9-6433d193ac0c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:10.210826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e423277a-4812-4176-9f5e-44ade2a62621 req-7fc62896-79f5-4f56-8e5a-50d437dc0d3c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:10.211318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e423277a-4812-4176-9f5e-44ade2a62621 req-7fc62896-79f5-4f56-8e5a-50d437dc0d3c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:10.211922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e423277a-4812-4176-9f5e-44ade2a62621 req-7fc62896-79f5-4f56-8e5a-50d437dc0d3c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:10.226817 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e423277a-4812-4176-9f5e-44ade2a62621 req-7fc62896-79f5-4f56-8e5a-50d437dc0d3c service nova] Creating event network-vif-unplugged:a44adf17-8cdc-487e-b7d9-6433d193ac0c for instance 6d59b3ef-e433-480b-9183-d020c885ce4d on n-h1-854823-1 Aug 27 04:41:10.233853 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e423277a-4812-4176-9f5e-44ade2a62621 req-7fc62896-79f5-4f56-8e5a-50d437dc0d3c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045879 Aug 27 04:41:10.235592 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1244/2507] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:10.243272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c783e1e7-397a-4d3e-9d78-0967f4e36779 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:10.244340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c783e1e7-397a-4d3e-9d78-0967f4e36779 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:10.253829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c783e1e7-397a-4d3e-9d78-0967f4e36779 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:10.254569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c783e1e7-397a-4d3e-9d78-0967f4e36779 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:10.259536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b901c47f-7fe4-4b78-9f6a-d5054af5f452 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:10.264422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c783e1e7-397a-4d3e-9d78-0967f4e36779 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:10.269392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c783e1e7-397a-4d3e-9d78-0967f4e36779 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:10.270249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c783e1e7-397a-4d3e-9d78-0967f4e36779 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:10.270911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c783e1e7-397a-4d3e-9d78-0967f4e36779 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:10.275365 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b901c47f-7fe4-4b78-9f6a-d5054af5f452 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1277 microversion: 2.1 time: 0.587375 Aug 27 04:41:10.276666 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1264/2508] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:09 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1277 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:10.283686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e723883-cded-42cb-95d0-cb09ddf93a6a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:10.297995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e723883-cded-42cb-95d0-cb09ddf93a6a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:10.307925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e723883-cded-42cb-95d0-cb09ddf93a6a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:10.308809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e723883-cded-42cb-95d0-cb09ddf93a6a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:10.309483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e723883-cded-42cb-95d0-cb09ddf93a6a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:10.311407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e723883-cded-42cb-95d0-cb09ddf93a6a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:10.312086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e723883-cded-42cb-95d0-cb09ddf93a6a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:10.312756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e723883-cded-42cb-95d0-cb09ddf93a6a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:10.411396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e723883-cded-42cb-95d0-cb09ddf93a6a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:10.433003 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e723883-cded-42cb-95d0-cb09ddf93a6a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1272 microversion: 2.1 time: 0.154961 Aug 27 04:41:10.436085 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1265/2509] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:10 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:10.444130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d20f7b2-3c83-416a-9359-9435c742091d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f22011310>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:10.536424 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d20f7b2-3c83-416a-9359-9435c742091d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/2c456f60-0fed-45b8-a039-69f1eec3c947" status: 200 len: 661 microversion: 2.1 time: 0.097337 Aug 27 04:41:10.537884 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1266/2510] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:10 2022] GET /compute/v2.1/images/2c456f60-0fed-45b8-a039-69f1eec3c947 => generated 661 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:10.552650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9387f19a-bcb7-41fc-bb5d-ebfcf7985f68 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21a0b8b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:10.612441 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9387f19a-bcb7-41fc-bb5d-ebfcf7985f68 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/2c456f60-0fed-45b8-a039-69f1eec3c947" status: 200 len: 661 microversion: 2.1 time: 0.065547 Aug 27 04:41:10.624149 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1267/2511] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:10 2022] GET /compute/v2.1/images/2c456f60-0fed-45b8-a039-69f1eec3c947 => generated 661 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:41:10.975768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c783e1e7-397a-4d3e-9d78-0967f4e36779 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:10.987847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c783e1e7-397a-4d3e-9d78-0967f4e36779 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:10.990066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c783e1e7-397a-4d3e-9d78-0967f4e36779 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:10.991493 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c783e1e7-397a-4d3e-9d78-0967f4e36779 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.754251 Aug 27 04:41:11.007224 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1245/2512] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:10 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:11.210029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37b5ac3e-c99c-438a-a5a9-31ec97a94afe tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:11.210649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37b5ac3e-c99c-438a-a5a9-31ec97a94afe tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:11.225120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37b5ac3e-c99c-438a-a5a9-31ec97a94afe tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:11.225625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37b5ac3e-c99c-438a-a5a9-31ec97a94afe tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:11.226067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37b5ac3e-c99c-438a-a5a9-31ec97a94afe tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:11.228842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37b5ac3e-c99c-438a-a5a9-31ec97a94afe tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:11.229314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37b5ac3e-c99c-438a-a5a9-31ec97a94afe tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:11.234162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37b5ac3e-c99c-438a-a5a9-31ec97a94afe tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:11.300795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cb540fe9-8299-40e3-a7ba-be5e5b904087 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:11.301830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cb540fe9-8299-40e3-a7ba-be5e5b904087 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:11.314562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb540fe9-8299-40e3-a7ba-be5e5b904087 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:11.316371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb540fe9-8299-40e3-a7ba-be5e5b904087 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:11.317817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb540fe9-8299-40e3-a7ba-be5e5b904087 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:11.319373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb540fe9-8299-40e3-a7ba-be5e5b904087 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:11.321797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb540fe9-8299-40e3-a7ba-be5e5b904087 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:11.323068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb540fe9-8299-40e3-a7ba-be5e5b904087 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:11.602717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-37b5ac3e-c99c-438a-a5a9-31ec97a94afe tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:11.620979 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37b5ac3e-c99c-438a-a5a9-31ec97a94afe tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1521 microversion: 2.1 time: 0.413068 Aug 27 04:41:11.622065 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1268/2513] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:11 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:11.632188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46728fa0-217d-4929-90ab-0d2e115f01eb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:11.633089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46728fa0-217d-4929-90ab-0d2e115f01eb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:11.641370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46728fa0-217d-4929-90ab-0d2e115f01eb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:11.642225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46728fa0-217d-4929-90ab-0d2e115f01eb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:11.642954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46728fa0-217d-4929-90ab-0d2e115f01eb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:11.643895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46728fa0-217d-4929-90ab-0d2e115f01eb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:11.644783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46728fa0-217d-4929-90ab-0d2e115f01eb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:11.645453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46728fa0-217d-4929-90ab-0d2e115f01eb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:11.743597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46728fa0-217d-4929-90ab-0d2e115f01eb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:11.766413 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46728fa0-217d-4929-90ab-0d2e115f01eb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1272 microversion: 2.1 time: 0.142839 Aug 27 04:41:11.769363 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1269/2514] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:11 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1272 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:11.775146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bb89a900-fc07-4d73-be7e-01a4dffa1885 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Action: 'create', calling method: .version_select at 0x7f1f21a73430>, body: {"pool": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:12.498980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cb540fe9-8299-40e3-a7ba-be5e5b904087 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:12.512771 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cb540fe9-8299-40e3-a7ba-be5e5b904087 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1319 microversion: 2.1 time: 1.216923 Aug 27 04:41:12.526130 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1246/2515] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:11 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1319 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:12.541642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fb1f6e0b-1743-49b5-b5a2-cdecc1eb6514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:12.543850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fb1f6e0b-1743-49b5-b5a2-cdecc1eb6514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:12.557568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1f6e0b-1743-49b5-b5a2-cdecc1eb6514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:12.559148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1f6e0b-1743-49b5-b5a2-cdecc1eb6514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:12.559859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1f6e0b-1743-49b5-b5a2-cdecc1eb6514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:12.561336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1f6e0b-1743-49b5-b5a2-cdecc1eb6514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:12.562046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1f6e0b-1743-49b5-b5a2-cdecc1eb6514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:12.562948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1f6e0b-1743-49b5-b5a2-cdecc1eb6514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:13.230491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fb1f6e0b-1743-49b5-b5a2-cdecc1eb6514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:13.265100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fb1f6e0b-1743-49b5-b5a2-cdecc1eb6514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:13.266709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fb1f6e0b-1743-49b5-b5a2-cdecc1eb6514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:13.267758 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fb1f6e0b-1743-49b5-b5a2-cdecc1eb6514 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.738405 Aug 27 04:41:13.270297 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1247/2516] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:12 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:13.288170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-00b93566-b035-46ba-a513-d994efa81b8b req-a638a927-8c88-4ac4-8bc7-9d3f3872784f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d59b3ef-e433-480b-9183-d020c885ce4d", "tag": "a44adf17-8cdc-487e-b7d9-6433d193ac0c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:13.311768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-00b93566-b035-46ba-a513-d994efa81b8b req-a638a927-8c88-4ac4-8bc7-9d3f3872784f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:13.312196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-00b93566-b035-46ba-a513-d994efa81b8b req-a638a927-8c88-4ac4-8bc7-9d3f3872784f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:13.312691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-00b93566-b035-46ba-a513-d994efa81b8b req-a638a927-8c88-4ac4-8bc7-9d3f3872784f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:13.325334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:13.339352 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-00b93566-b035-46ba-a513-d994efa81b8b req-a638a927-8c88-4ac4-8bc7-9d3f3872784f service nova] Creating event network-changed:a44adf17-8cdc-487e-b7d9-6433d193ac0c for instance 6d59b3ef-e433-480b-9183-d020c885ce4d on n-h1-854823-1 Aug 27 04:41:13.347714 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-00b93566-b035-46ba-a513-d994efa81b8b req-a638a927-8c88-4ac4-8bc7-9d3f3872784f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070951 Aug 27 04:41:13.349552 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1248/2517] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:13.356885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-47f1338b-f2d2-4c6d-a614-2752cc4ddf7f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f214d50d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:13.424667 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-47f1338b-f2d2-4c6d-a614-2752cc4ddf7f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/113a5b30-49f3-426e-bcf8-af5ee467dd73" status: 200 len: 661 microversion: 2.1 time: 0.072200 Aug 27 04:41:13.438502 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1249/2518] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:13 2022] GET /compute/v2.1/images/113a5b30-49f3-426e-bcf8-af5ee467dd73 => generated 661 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:13.447100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-927c5c9e-807e-4585-a5f0-2eb68d8da204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:13.449429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-927c5c9e-807e-4585-a5f0-2eb68d8da204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:13.460288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-927c5c9e-807e-4585-a5f0-2eb68d8da204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:13.461099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-927c5c9e-807e-4585-a5f0-2eb68d8da204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:13.461841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-927c5c9e-807e-4585-a5f0-2eb68d8da204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:13.462796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-927c5c9e-807e-4585-a5f0-2eb68d8da204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:13.463504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-927c5c9e-807e-4585-a5f0-2eb68d8da204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:13.464147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-927c5c9e-807e-4585-a5f0-2eb68d8da204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:13.764732 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bb89a900-fc07-4d73-be7e-01a4dffa1885 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.993798 Aug 27 04:41:13.784287 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1270/2519] 10.222.0.79 () {60 vars in 1170 bytes} [Sat Aug 27 04:41:11 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:13.791829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-140321e8-26e0-449a-a249-8e20c80c7c01 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21ad1040>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:13.873130 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-140321e8-26e0-449a-a249-8e20c80c7c01 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/113a5b30-49f3-426e-bcf8-af5ee467dd73" status: 200 len: 661 microversion: 2.1 time: 0.087628 Aug 27 04:41:13.873912 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1271/2520] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:13 2022] GET /compute/v2.1/images/113a5b30-49f3-426e-bcf8-af5ee467dd73 => generated 661 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:13.906987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31e45c77-9008-4608-a376-f102e35ac6e7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:13.908546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31e45c77-9008-4608-a376-f102e35ac6e7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:13.935677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31e45c77-9008-4608-a376-f102e35ac6e7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:13.937604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31e45c77-9008-4608-a376-f102e35ac6e7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:13.939075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31e45c77-9008-4608-a376-f102e35ac6e7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:13.940906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31e45c77-9008-4608-a376-f102e35ac6e7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:13.943864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31e45c77-9008-4608-a376-f102e35ac6e7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:13.945246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31e45c77-9008-4608-a376-f102e35ac6e7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:14.003741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-927c5c9e-807e-4585-a5f0-2eb68d8da204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:14.019080 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-927c5c9e-807e-4585-a5f0-2eb68d8da204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1314 microversion: 2.1 time: 0.572489 Aug 27 04:41:14.019828 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1250/2521] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:13 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:14.031482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1941172991", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "bcedcbbe-f9e5-425b-a145-0aa42ef36186"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:14.159744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] validate_networks() for [('bcedcbbe-f9e5-425b-a145-0aa42ef36186', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:41:14.320475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31e45c77-9008-4608-a376-f102e35ac6e7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:14.328939 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31e45c77-9008-4608-a376-f102e35ac6e7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1319 microversion: 2.1 time: 0.451042 Aug 27 04:41:14.330369 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1272/2522] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:13 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:14.348428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1745191445", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:14.455972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:41:14.532665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:14.861590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:41:14.862115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:41:14.863036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:41:14.863581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:41:14.864107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:41:14.893323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:14.893927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:14.895705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:14.897244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:14.898648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:14.900699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:14.936063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:14.941443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Getting quotas for project 0f7dc74b8c2542c89421611c9ded66e1. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:41:14.948293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Getting quotas for user 346cf8d02f204e42b7da064228fe678c and project 0f7dc74b8c2542c89421611c9ded66e1. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:41:14.963983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:41:14.967253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 0e0d6029-a40b-45b9-b230-2033ec88617e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:41:15.043193 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-432bf77a-5195-488b-a401-b64caf3bfe5e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706196 Aug 27 04:41:15.045305 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1273/2523] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:41:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:41:15.063646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0efdfd2f-8b2a-4c98-a483-f44dac4335c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:15.065390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0efdfd2f-8b2a-4c98-a483-f44dac4335c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:15.085000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0efdfd2f-8b2a-4c98-a483-f44dac4335c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:15.087218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0efdfd2f-8b2a-4c98-a483-f44dac4335c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:15.088496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0efdfd2f-8b2a-4c98-a483-f44dac4335c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:15.093152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0efdfd2f-8b2a-4c98-a483-f44dac4335c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:15.096238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0efdfd2f-8b2a-4c98-a483-f44dac4335c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:15.099109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0efdfd2f-8b2a-4c98-a483-f44dac4335c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:15.362604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0efdfd2f-8b2a-4c98-a483-f44dac4335c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:15.372313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0efdfd2f-8b2a-4c98-a483-f44dac4335c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:15.373819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0efdfd2f-8b2a-4c98-a483-f44dac4335c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:15.375000 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0efdfd2f-8b2a-4c98-a483-f44dac4335c0 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.327838 Aug 27 04:41:15.388985 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1274/2524] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:15 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:15.396194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f488559e-416d-4dba-a8e4-feddf8ca1204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:15.396921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f488559e-416d-4dba-a8e4-feddf8ca1204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:15.412647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f488559e-416d-4dba-a8e4-feddf8ca1204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:15.415490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f488559e-416d-4dba-a8e4-feddf8ca1204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:15.418525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f488559e-416d-4dba-a8e4-feddf8ca1204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:15.419443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f488559e-416d-4dba-a8e4-feddf8ca1204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:15.420092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f488559e-416d-4dba-a8e4-feddf8ca1204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:15.420766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f488559e-416d-4dba-a8e4-feddf8ca1204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:15.747234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f488559e-416d-4dba-a8e4-feddf8ca1204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:15.761816 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f488559e-416d-4dba-a8e4-feddf8ca1204 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1314 microversion: 2.1 time: 0.371679 Aug 27 04:41:15.763375 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1275/2525] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:15 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:15.771159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2082104171", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:15.885913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:41:16.168036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:41:16.169379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:41:16.170064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:41:16.170493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:41:16.171070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:41:16.193601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:16.194104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:16.194547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:16.201402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:16.202895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:16.205272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:16.257151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Getting quotas for project 449305a5c79342058280f9482da58766. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:41:16.270264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Getting quotas for user 31386d6abd9b41f7a14a91f638331d95 and project 449305a5c79342058280f9482da58766. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:41:16.299119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:41:16.309923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:41:16.353929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:41:16.354473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:41:16.355067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:41:16.355590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:41:16.356117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:41:16.382879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:16.383460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:16.398545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:16.399986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:16.401306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:16.406813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:16.433129 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e33772a8-0471-4fa4-9c5f-c292756b85ea tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.410017 Aug 27 04:41:16.439687 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1251/2526] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:41:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:41:16.454606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Getting quotas for project 0f7dc74b8c2542c89421611c9ded66e1. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:41:16.454834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-33718bac-7fd8-494f-a302-bf3634eb3b8b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:16.455451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-33718bac-7fd8-494f-a302-bf3634eb3b8b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:16.464312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33718bac-7fd8-494f-a302-bf3634eb3b8b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:16.465328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33718bac-7fd8-494f-a302-bf3634eb3b8b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:16.466106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33718bac-7fd8-494f-a302-bf3634eb3b8b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:16.466996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33718bac-7fd8-494f-a302-bf3634eb3b8b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:16.468201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33718bac-7fd8-494f-a302-bf3634eb3b8b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:16.468981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33718bac-7fd8-494f-a302-bf3634eb3b8b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:16.470946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Getting quotas for user 346cf8d02f204e42b7da064228fe678c and project 0f7dc74b8c2542c89421611c9ded66e1. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:41:16.501314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:41:16.506878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:41:16.642688 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7303a5cf-0593-4786-8138-eafd19ca8685 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.878038 Aug 27 04:41:16.645590 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1276/2527] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:41:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:41:16.654512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-26371512-6c30-4d13-b31c-bb77aa20e41f req-e5b17f30-e558-44a6-9412-81684d608bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24504b35-3a86-47cf-9dd6-3e119044d628", "tag": "003f92bc-20c3-401e-b6aa-031d76d7988a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:16.672899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-26371512-6c30-4d13-b31c-bb77aa20e41f req-e5b17f30-e558-44a6-9412-81684d608bae service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:16.674186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-26371512-6c30-4d13-b31c-bb77aa20e41f req-e5b17f30-e558-44a6-9412-81684d608bae service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:16.674964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-26371512-6c30-4d13-b31c-bb77aa20e41f req-e5b17f30-e558-44a6-9412-81684d608bae service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:16.740135 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-26371512-6c30-4d13-b31c-bb77aa20e41f req-e5b17f30-e558-44a6-9412-81684d608bae service nova] Creating event network-changed:003f92bc-20c3-401e-b6aa-031d76d7988a for instance 24504b35-3a86-47cf-9dd6-3e119044d628 on n-h1-854823-1 Aug 27 04:41:16.757336 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-26371512-6c30-4d13-b31c-bb77aa20e41f req-e5b17f30-e558-44a6-9412-81684d608bae service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109908 Aug 27 04:41:16.763484 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1277/2528] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:16.784361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4cd14df-6373-42ec-a8e1-86906ea1f778 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:16.786039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4cd14df-6373-42ec-a8e1-86906ea1f778 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:16.803606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cd14df-6373-42ec-a8e1-86906ea1f778 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:16.804132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cd14df-6373-42ec-a8e1-86906ea1f778 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:16.804666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cd14df-6373-42ec-a8e1-86906ea1f778 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:16.809062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cd14df-6373-42ec-a8e1-86906ea1f778 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:16.810258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cd14df-6373-42ec-a8e1-86906ea1f778 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:16.810827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cd14df-6373-42ec-a8e1-86906ea1f778 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:17.521402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4cd14df-6373-42ec-a8e1-86906ea1f778 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:17.532684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4cd14df-6373-42ec-a8e1-86906ea1f778 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:17.542463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4cd14df-6373-42ec-a8e1-86906ea1f778 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:17.543679 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4cd14df-6373-42ec-a8e1-86906ea1f778 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.777287 Aug 27 04:41:17.544739 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1278/2529] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:16 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:17.563270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a93c783-aa8b-4702-9a9c-712006a66c92 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:17.565025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a93c783-aa8b-4702-9a9c-712006a66c92 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:17.584322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a93c783-aa8b-4702-9a9c-712006a66c92 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:17.585068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a93c783-aa8b-4702-9a9c-712006a66c92 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:17.586284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a93c783-aa8b-4702-9a9c-712006a66c92 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:17.589172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a93c783-aa8b-4702-9a9c-712006a66c92 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:17.590889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a93c783-aa8b-4702-9a9c-712006a66c92 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:17.593034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a93c783-aa8b-4702-9a9c-712006a66c92 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:17.759623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a93c783-aa8b-4702-9a9c-712006a66c92 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:17.776338 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a93c783-aa8b-4702-9a9c-712006a66c92 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1220 microversion: 2.1 time: 0.223150 Aug 27 04:41:17.779176 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1279/2530] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:17 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1220 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:17.794788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98093dd3-fb92-4993-b97d-e0e2b18d82e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:17.797560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98093dd3-fb92-4993-b97d-e0e2b18d82e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:17.834940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98093dd3-fb92-4993-b97d-e0e2b18d82e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:17.835459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98093dd3-fb92-4993-b97d-e0e2b18d82e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:17.835901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98093dd3-fb92-4993-b97d-e0e2b18d82e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:17.843723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98093dd3-fb92-4993-b97d-e0e2b18d82e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:17.844311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98093dd3-fb92-4993-b97d-e0e2b18d82e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:17.845044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98093dd3-fb92-4993-b97d-e0e2b18d82e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:17.953994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-33718bac-7fd8-494f-a302-bf3634eb3b8b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:17.969420 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-33718bac-7fd8-494f-a302-bf3634eb3b8b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1319 microversion: 2.1 time: 1.528463 Aug 27 04:41:17.970040 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1252/2531] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:16 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1319 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:17.981332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0c583693-bb4a-40fa-ac47-20dd180e814b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:17.981979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0c583693-bb4a-40fa-ac47-20dd180e814b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:18.003038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c583693-bb4a-40fa-ac47-20dd180e814b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:18.005568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c583693-bb4a-40fa-ac47-20dd180e814b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:18.005831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c583693-bb4a-40fa-ac47-20dd180e814b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:18.009841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c583693-bb4a-40fa-ac47-20dd180e814b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:18.010793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c583693-bb4a-40fa-ac47-20dd180e814b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:18.013382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c583693-bb4a-40fa-ac47-20dd180e814b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:18.128905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-98093dd3-fb92-4993-b97d-e0e2b18d82e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:18.136481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:18.139569 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98093dd3-fb92-4993-b97d-e0e2b18d82e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1222 microversion: 2.1 time: 0.359178 Aug 27 04:41:18.140491 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1280/2532] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:17 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1222 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:18.351991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0c583693-bb4a-40fa-ac47-20dd180e814b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:18.369574 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0c583693-bb4a-40fa-ac47-20dd180e814b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1314 microversion: 2.1 time: 0.396776 Aug 27 04:41:18.386379 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1253/2533] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:17 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:18.568074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1662667e-fa1b-4a38-a3b5-5868e4e2f303 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:18.568570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1662667e-fa1b-4a38-a3b5-5868e4e2f303 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:18.586112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1662667e-fa1b-4a38-a3b5-5868e4e2f303 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:18.586611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1662667e-fa1b-4a38-a3b5-5868e4e2f303 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:18.587134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1662667e-fa1b-4a38-a3b5-5868e4e2f303 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:18.587850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1662667e-fa1b-4a38-a3b5-5868e4e2f303 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:18.588858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1662667e-fa1b-4a38-a3b5-5868e4e2f303 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:18.589284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1662667e-fa1b-4a38-a3b5-5868e4e2f303 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:18.801251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-768f1e18-a9a9-4dc6-a8d1-6da6c7a420b1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:18.801888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-768f1e18-a9a9-4dc6-a8d1-6da6c7a420b1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:18.814317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-768f1e18-a9a9-4dc6-a8d1-6da6c7a420b1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:18.814779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-768f1e18-a9a9-4dc6-a8d1-6da6c7a420b1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:18.820355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-768f1e18-a9a9-4dc6-a8d1-6da6c7a420b1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:18.821213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-768f1e18-a9a9-4dc6-a8d1-6da6c7a420b1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:18.821886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-768f1e18-a9a9-4dc6-a8d1-6da6c7a420b1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:18.822785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-768f1e18-a9a9-4dc6-a8d1-6da6c7a420b1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:18.840061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1662667e-fa1b-4a38-a3b5-5868e4e2f303 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:18.855593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1662667e-fa1b-4a38-a3b5-5868e4e2f303 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:18.858087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1662667e-fa1b-4a38-a3b5-5868e4e2f303 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:18.859956 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1662667e-fa1b-4a38-a3b5-5868e4e2f303 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.295990 Aug 27 04:41:18.872950 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1281/2534] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:18 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:18.938751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-768f1e18-a9a9-4dc6-a8d1-6da6c7a420b1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:18.948322 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-768f1e18-a9a9-4dc6-a8d1-6da6c7a420b1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1276 microversion: 2.1 time: 0.152306 Aug 27 04:41:18.949649 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1254/2535] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:18 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:18.992130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9339017f-7f0a-4aad-a309-3c1bd4134491 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:18.992799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9339017f-7f0a-4aad-a309-3c1bd4134491 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:18.999595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9339017f-7f0a-4aad-a309-3c1bd4134491 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:19.000240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9339017f-7f0a-4aad-a309-3c1bd4134491 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:19.001027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9339017f-7f0a-4aad-a309-3c1bd4134491 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:19.001745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9339017f-7f0a-4aad-a309-3c1bd4134491 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:19.002209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9339017f-7f0a-4aad-a309-3c1bd4134491 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:19.002638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9339017f-7f0a-4aad-a309-3c1bd4134491 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:19.189111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d85046d-ac5e-4b4e-8ccc-809655ea7263 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:19.191039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9d85046d-ac5e-4b4e-8ccc-809655ea7263 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:19.205698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d85046d-ac5e-4b4e-8ccc-809655ea7263 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:19.206847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d85046d-ac5e-4b4e-8ccc-809655ea7263 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:19.208204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d85046d-ac5e-4b4e-8ccc-809655ea7263 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:19.210019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d85046d-ac5e-4b4e-8ccc-809655ea7263 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:19.211615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d85046d-ac5e-4b4e-8ccc-809655ea7263 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:19.212655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d85046d-ac5e-4b4e-8ccc-809655ea7263 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:19.302073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9339017f-7f0a-4aad-a309-3c1bd4134491 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:19.320146 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9339017f-7f0a-4aad-a309-3c1bd4134491 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1319 microversion: 2.1 time: 0.332700 Aug 27 04:41:19.321298 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1282/2536] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:18 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:19.394089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e0ae4f9a-56ec-43ee-ac65-7ea5d7792896 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:19.395055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e0ae4f9a-56ec-43ee-ac65-7ea5d7792896 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:19.401631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0ae4f9a-56ec-43ee-ac65-7ea5d7792896 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:19.402319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0ae4f9a-56ec-43ee-ac65-7ea5d7792896 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:19.402929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0ae4f9a-56ec-43ee-ac65-7ea5d7792896 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:19.403794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0ae4f9a-56ec-43ee-ac65-7ea5d7792896 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:19.404514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0ae4f9a-56ec-43ee-ac65-7ea5d7792896 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:19.405111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0ae4f9a-56ec-43ee-ac65-7ea5d7792896 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:19.407827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9d85046d-ac5e-4b4e-8ccc-809655ea7263 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:19.419267 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9d85046d-ac5e-4b4e-8ccc-809655ea7263 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1214 microversion: 2.1 time: 0.247412 Aug 27 04:41:19.421004 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1255/2537] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:19 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1214 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:19.496430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a18a94f8-0394-48df-84e2-5409f10780fe req-41e4fc11-4617-43ab-b409-d77dffafcb8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4549183c-6ddf-442e-a0fd-6abba4b648c3", "tag": "58521f19-b6b8-4427-a0d6-6704d0cec337"}, {"name": "network-changed", "server_uuid": "a1871fce-ce02-43f5-a460-02f259a72471", "tag": "36205269-ec1e-4154-aca0-c4d791be2668"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:19.516380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a18a94f8-0394-48df-84e2-5409f10780fe req-41e4fc11-4617-43ab-b409-d77dffafcb8b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:19.517313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a18a94f8-0394-48df-84e2-5409f10780fe req-41e4fc11-4617-43ab-b409-d77dffafcb8b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:19.518020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a18a94f8-0394-48df-84e2-5409f10780fe req-41e4fc11-4617-43ab-b409-d77dffafcb8b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:19.551486 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a18a94f8-0394-48df-84e2-5409f10780fe req-41e4fc11-4617-43ab-b409-d77dffafcb8b service nova] Creating event network-changed:58521f19-b6b8-4427-a0d6-6704d0cec337 for instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 on n-h2-854823-1 Aug 27 04:41:19.552309 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a18a94f8-0394-48df-84e2-5409f10780fe req-41e4fc11-4617-43ab-b409-d77dffafcb8b service nova] Creating event network-changed:36205269-ec1e-4154-aca0-c4d791be2668 for instance a1871fce-ce02-43f5-a460-02f259a72471 on n-h2-854823-1 Aug 27 04:41:19.562370 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a18a94f8-0394-48df-84e2-5409f10780fe req-41e4fc11-4617-43ab-b409-d77dffafcb8b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072269 Aug 27 04:41:19.565701 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1256/2538] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:41:19.595347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e0ae4f9a-56ec-43ee-ac65-7ea5d7792896 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:19.603329 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e0ae4f9a-56ec-43ee-ac65-7ea5d7792896 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1314 microversion: 2.1 time: 0.213198 Aug 27 04:41:19.605452 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1283/2539] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:19 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:19.884443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c59edc91-94dc-41e6-88c7-9374ef9488c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:19.885913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c59edc91-94dc-41e6-88c7-9374ef9488c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:19.894651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c59edc91-94dc-41e6-88c7-9374ef9488c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:19.895499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c59edc91-94dc-41e6-88c7-9374ef9488c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:19.896345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c59edc91-94dc-41e6-88c7-9374ef9488c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:19.897385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c59edc91-94dc-41e6-88c7-9374ef9488c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:19.897927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c59edc91-94dc-41e6-88c7-9374ef9488c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:19.898559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c59edc91-94dc-41e6-88c7-9374ef9488c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:19.969694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e779dcad-69a5-4e3b-b72b-eb107c53685f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:19.970312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e779dcad-69a5-4e3b-b72b-eb107c53685f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:19.976708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e779dcad-69a5-4e3b-b72b-eb107c53685f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:19.977207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e779dcad-69a5-4e3b-b72b-eb107c53685f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:19.977647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e779dcad-69a5-4e3b-b72b-eb107c53685f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:19.979116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e779dcad-69a5-4e3b-b72b-eb107c53685f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:19.979586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e779dcad-69a5-4e3b-b72b-eb107c53685f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:19.980014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e779dcad-69a5-4e3b-b72b-eb107c53685f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:20.058171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e779dcad-69a5-4e3b-b72b-eb107c53685f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:20.065869 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e779dcad-69a5-4e3b-b72b-eb107c53685f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1276 microversion: 2.1 time: 0.100131 Aug 27 04:41:20.066741 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1284/2540] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:19 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1276 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:20.135535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c59edc91-94dc-41e6-88c7-9374ef9488c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:20.145788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c59edc91-94dc-41e6-88c7-9374ef9488c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:20.146789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c59edc91-94dc-41e6-88c7-9374ef9488c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:20.148250 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c59edc91-94dc-41e6-88c7-9374ef9488c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.269495 Aug 27 04:41:20.149110 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1257/2541] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:19 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:20.356855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac74ea67-018c-4bab-b0f4-82db6bddf014 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:20.357617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac74ea67-018c-4bab-b0f4-82db6bddf014 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:20.365305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac74ea67-018c-4bab-b0f4-82db6bddf014 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:20.366319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac74ea67-018c-4bab-b0f4-82db6bddf014 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:20.366836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac74ea67-018c-4bab-b0f4-82db6bddf014 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:20.367622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac74ea67-018c-4bab-b0f4-82db6bddf014 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:20.368160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac74ea67-018c-4bab-b0f4-82db6bddf014 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:20.368719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac74ea67-018c-4bab-b0f4-82db6bddf014 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:20.441654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6566b872-1c50-4421-a255-850db2632959 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:20.442409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6566b872-1c50-4421-a255-850db2632959 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:20.464922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6566b872-1c50-4421-a255-850db2632959 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:20.465421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6566b872-1c50-4421-a255-850db2632959 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:20.477923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6566b872-1c50-4421-a255-850db2632959 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:20.478786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6566b872-1c50-4421-a255-850db2632959 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:20.479341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6566b872-1c50-4421-a255-850db2632959 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:20.479687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6566b872-1c50-4421-a255-850db2632959 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:20.653925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6566b872-1c50-4421-a255-850db2632959 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:20.667537 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6566b872-1c50-4421-a255-850db2632959 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1214 microversion: 2.1 time: 0.229629 Aug 27 04:41:20.686817 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1258/2542] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:20 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:20.692722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f400c744-9e7d-4194-a0f5-b2d460a6cc81 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:20.694007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f400c744-9e7d-4194-a0f5-b2d460a6cc81 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:20.703211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f400c744-9e7d-4194-a0f5-b2d460a6cc81 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:20.703901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f400c744-9e7d-4194-a0f5-b2d460a6cc81 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:20.704740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f400c744-9e7d-4194-a0f5-b2d460a6cc81 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:20.705633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f400c744-9e7d-4194-a0f5-b2d460a6cc81 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:20.706366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f400c744-9e7d-4194-a0f5-b2d460a6cc81 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:20.707041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f400c744-9e7d-4194-a0f5-b2d460a6cc81 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:20.714690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac74ea67-018c-4bab-b0f4-82db6bddf014 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:20.723200 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac74ea67-018c-4bab-b0f4-82db6bddf014 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1319 microversion: 2.1 time: 0.371583 Aug 27 04:41:20.732189 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1285/2543] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:20 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:21.093712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98817dca-0d74-4eac-a2f2-cbe65dc5741a tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:21.096413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98817dca-0d74-4eac-a2f2-cbe65dc5741a tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:21.110038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98817dca-0d74-4eac-a2f2-cbe65dc5741a tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:21.110767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98817dca-0d74-4eac-a2f2-cbe65dc5741a tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:21.111400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98817dca-0d74-4eac-a2f2-cbe65dc5741a tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:21.112822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98817dca-0d74-4eac-a2f2-cbe65dc5741a tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:21.113445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98817dca-0d74-4eac-a2f2-cbe65dc5741a tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:21.114105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98817dca-0d74-4eac-a2f2-cbe65dc5741a tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:21.171256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f400c744-9e7d-4194-a0f5-b2d460a6cc81 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:21.188811 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f400c744-9e7d-4194-a0f5-b2d460a6cc81 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1314 microversion: 2.1 time: 0.500358 Aug 27 04:41:21.202868 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1259/2544] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:20 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:21.219133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ec550db6-044e-4c8e-8fc6-5064801d37e1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:21.221964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ec550db6-044e-4c8e-8fc6-5064801d37e1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:21.249074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-98817dca-0d74-4eac-a2f2-cbe65dc5741a tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:21.251377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec550db6-044e-4c8e-8fc6-5064801d37e1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:21.253405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec550db6-044e-4c8e-8fc6-5064801d37e1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:21.254663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec550db6-044e-4c8e-8fc6-5064801d37e1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:21.255807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec550db6-044e-4c8e-8fc6-5064801d37e1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:21.257498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec550db6-044e-4c8e-8fc6-5064801d37e1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:21.260586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec550db6-044e-4c8e-8fc6-5064801d37e1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:21.261882 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98817dca-0d74-4eac-a2f2-cbe65dc5741a tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1276 microversion: 2.1 time: 0.177458 Aug 27 04:41:21.262693 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1286/2545] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:21 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:21.576427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ec550db6-044e-4c8e-8fc6-5064801d37e1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:21.587571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ec550db6-044e-4c8e-8fc6-5064801d37e1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:21.610568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ec550db6-044e-4c8e-8fc6-5064801d37e1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:21.612417 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ec550db6-044e-4c8e-8fc6-5064801d37e1 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.408198 Aug 27 04:41:21.613611 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1260/2546] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:21 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:21.689681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae90fd79-e177-416c-bf1e-69903f5e46a1 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:21.690627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae90fd79-e177-416c-bf1e-69903f5e46a1 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:21.707525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae90fd79-e177-416c-bf1e-69903f5e46a1 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:21.708633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae90fd79-e177-416c-bf1e-69903f5e46a1 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:21.709497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae90fd79-e177-416c-bf1e-69903f5e46a1 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:21.722095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae90fd79-e177-416c-bf1e-69903f5e46a1 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:21.724181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae90fd79-e177-416c-bf1e-69903f5e46a1 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:21.725141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae90fd79-e177-416c-bf1e-69903f5e46a1 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:21.749585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f10493cb-f576-4d71-bdc2-8bda302ecf43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:21.750636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f10493cb-f576-4d71-bdc2-8bda302ecf43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:21.772263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f10493cb-f576-4d71-bdc2-8bda302ecf43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:21.774003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f10493cb-f576-4d71-bdc2-8bda302ecf43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:21.779449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f10493cb-f576-4d71-bdc2-8bda302ecf43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:21.781878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f10493cb-f576-4d71-bdc2-8bda302ecf43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:21.785299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f10493cb-f576-4d71-bdc2-8bda302ecf43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:21.787332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f10493cb-f576-4d71-bdc2-8bda302ecf43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:22.202115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ae90fd79-e177-416c-bf1e-69903f5e46a1 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:22.210749 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae90fd79-e177-416c-bf1e-69903f5e46a1 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1278 microversion: 2.1 time: 0.525735 Aug 27 04:41:22.217445 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1287/2547] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:21 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1278 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:22.227066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2caf93e3-5f16-4c95-b8d0-6f6a7f990ab2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:22.235474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2caf93e3-5f16-4c95-b8d0-6f6a7f990ab2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:22.243392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2caf93e3-5f16-4c95-b8d0-6f6a7f990ab2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:22.244544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2caf93e3-5f16-4c95-b8d0-6f6a7f990ab2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:22.251353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2caf93e3-5f16-4c95-b8d0-6f6a7f990ab2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:22.252576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2caf93e3-5f16-4c95-b8d0-6f6a7f990ab2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:22.253348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2caf93e3-5f16-4c95-b8d0-6f6a7f990ab2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:22.254011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2caf93e3-5f16-4c95-b8d0-6f6a7f990ab2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:22.711992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f10493cb-f576-4d71-bdc2-8bda302ecf43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:22.735436 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f10493cb-f576-4d71-bdc2-8bda302ecf43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1319 microversion: 2.1 time: 0.991897 Aug 27 04:41:22.738732 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1261/2548] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:21 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1319 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:22.769928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ffbfc736-e5b0-460e-bb81-61f12e4a1d24 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:22.772491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ffbfc736-e5b0-460e-bb81-61f12e4a1d24 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:22.794798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffbfc736-e5b0-460e-bb81-61f12e4a1d24 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:22.797133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffbfc736-e5b0-460e-bb81-61f12e4a1d24 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:22.797875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffbfc736-e5b0-460e-bb81-61f12e4a1d24 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:22.799881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffbfc736-e5b0-460e-bb81-61f12e4a1d24 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:22.800616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffbfc736-e5b0-460e-bb81-61f12e4a1d24 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:22.803459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffbfc736-e5b0-460e-bb81-61f12e4a1d24 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:22.920947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2caf93e3-5f16-4c95-b8d0-6f6a7f990ab2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:22.930702 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2caf93e3-5f16-4c95-b8d0-6f6a7f990ab2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1314 microversion: 2.1 time: 0.708059 Aug 27 04:41:22.936182 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1288/2549] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:22 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1314 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:22.949056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-525403bb-0b57-435a-847d-60cb7b270035 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:22.949957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-525403bb-0b57-435a-847d-60cb7b270035 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:22.958258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-525403bb-0b57-435a-847d-60cb7b270035 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:22.963471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-525403bb-0b57-435a-847d-60cb7b270035 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:22.964240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-525403bb-0b57-435a-847d-60cb7b270035 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:22.967287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-525403bb-0b57-435a-847d-60cb7b270035 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:22.969271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-525403bb-0b57-435a-847d-60cb7b270035 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:22.970552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-525403bb-0b57-435a-847d-60cb7b270035 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:22.981702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ffbfc736-e5b0-460e-bb81-61f12e4a1d24 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:22.997013 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ffbfc736-e5b0-460e-bb81-61f12e4a1d24 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1282 microversion: 2.1 time: 0.251315 Aug 27 04:41:23.008616 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1262/2550] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:22 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1282 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:23.235366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c4c8a058-89fc-45ac-b6f6-5329446bc3ec tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:23.239657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c4c8a058-89fc-45ac-b6f6-5329446bc3ec tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:23.293257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4c8a058-89fc-45ac-b6f6-5329446bc3ec tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:23.294244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4c8a058-89fc-45ac-b6f6-5329446bc3ec tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:23.295633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4c8a058-89fc-45ac-b6f6-5329446bc3ec tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:23.296653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4c8a058-89fc-45ac-b6f6-5329446bc3ec tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:23.297331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4c8a058-89fc-45ac-b6f6-5329446bc3ec tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:23.300297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4c8a058-89fc-45ac-b6f6-5329446bc3ec tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:23.572145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c4c8a058-89fc-45ac-b6f6-5329446bc3ec tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:23.586480 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c4c8a058-89fc-45ac-b6f6-5329446bc3ec tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1276 microversion: 2.1 time: 0.354439 Aug 27 04:41:23.587638 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1263/2551] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:23 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1276 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:23.737022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-68b6838f-eb4e-4d61-a71b-9887fef32036 req-2f5a2e1c-50bf-420f-a410-8b55e4fb4c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0d6029-a40b-45b9-b230-2033ec88617e", "tag": "54e043d1-9346-4c9a-917b-026289b24400"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:23.752572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-68b6838f-eb4e-4d61-a71b-9887fef32036 req-2f5a2e1c-50bf-420f-a410-8b55e4fb4c4f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:23.754460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-68b6838f-eb4e-4d61-a71b-9887fef32036 req-2f5a2e1c-50bf-420f-a410-8b55e4fb4c4f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:23.754911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-68b6838f-eb4e-4d61-a71b-9887fef32036 req-2f5a2e1c-50bf-420f-a410-8b55e4fb4c4f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:23.771088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-525403bb-0b57-435a-847d-60cb7b270035 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:23.778890 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-68b6838f-eb4e-4d61-a71b-9887fef32036 req-2f5a2e1c-50bf-420f-a410-8b55e4fb4c4f service nova] Creating event network-changed:54e043d1-9346-4c9a-917b-026289b24400 for instance 0e0d6029-a40b-45b9-b230-2033ec88617e on n-h1-854823-1 Aug 27 04:41:23.783194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-525403bb-0b57-435a-847d-60cb7b270035 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:23.785673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-525403bb-0b57-435a-847d-60cb7b270035 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:23.787119 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-525403bb-0b57-435a-847d-60cb7b270035 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.849751 Aug 27 04:41:23.788099 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1289/2552] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:22 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:23.793573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a68c38c-25f7-4345-9421-108a20a71e7b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:23.794646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a68c38c-25f7-4345-9421-108a20a71e7b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:23.796917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:23.808725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a68c38c-25f7-4345-9421-108a20a71e7b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:23.809511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a68c38c-25f7-4345-9421-108a20a71e7b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:23.810107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a68c38c-25f7-4345-9421-108a20a71e7b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:23.811062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a68c38c-25f7-4345-9421-108a20a71e7b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:23.811182 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-68b6838f-eb4e-4d61-a71b-9887fef32036 req-2f5a2e1c-50bf-420f-a410-8b55e4fb4c4f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073613 Aug 27 04:41:23.811779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a68c38c-25f7-4345-9421-108a20a71e7b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:23.811890 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1264/2553] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:23.812753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a68c38c-25f7-4345-9421-108a20a71e7b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:23.961787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c9906e59-f486-455a-99ae-e5018fe9ea19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:23.962503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c9906e59-f486-455a-99ae-e5018fe9ea19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:23.979960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9906e59-f486-455a-99ae-e5018fe9ea19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:23.981316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9906e59-f486-455a-99ae-e5018fe9ea19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:23.982147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9906e59-f486-455a-99ae-e5018fe9ea19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:23.983116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9906e59-f486-455a-99ae-e5018fe9ea19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:23.983806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9906e59-f486-455a-99ae-e5018fe9ea19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:23.984436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9906e59-f486-455a-99ae-e5018fe9ea19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:24.311165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1a68c38c-25f7-4345-9421-108a20a71e7b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:24.324250 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a68c38c-25f7-4345-9421-108a20a71e7b tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1319 microversion: 2.1 time: 0.534801 Aug 27 04:41:24.325123 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1290/2554] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:23 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1319 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:24.330004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d04dedaf-a497-4bb4-9688-5280011e2ff2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:24.330822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d04dedaf-a497-4bb4-9688-5280011e2ff2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:24.343896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d04dedaf-a497-4bb4-9688-5280011e2ff2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:24.344514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d04dedaf-a497-4bb4-9688-5280011e2ff2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:24.345086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d04dedaf-a497-4bb4-9688-5280011e2ff2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:24.345871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d04dedaf-a497-4bb4-9688-5280011e2ff2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:24.347012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d04dedaf-a497-4bb4-9688-5280011e2ff2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:24.347915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d04dedaf-a497-4bb4-9688-5280011e2ff2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:24.448943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c9906e59-f486-455a-99ae-e5018fe9ea19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:24.470796 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c9906e59-f486-455a-99ae-e5018fe9ea19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1314 microversion: 2.1 time: 0.513109 Aug 27 04:41:24.473121 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1265/2555] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:23 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:24.479234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-43afc148-cb7e-4fa7-a2bb-b7c958909584 req-2b73c24c-f78a-4021-a8d2-21daf03afe25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24504b35-3a86-47cf-9dd6-3e119044d628", "name": "network-vif-plugged", "status": "completed", "tag": "003f92bc-20c3-401e-b6aa-031d76d7988a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:24.497221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:24.520506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-43afc148-cb7e-4fa7-a2bb-b7c958909584 req-2b73c24c-f78a-4021-a8d2-21daf03afe25 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:24.522966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-43afc148-cb7e-4fa7-a2bb-b7c958909584 req-2b73c24c-f78a-4021-a8d2-21daf03afe25 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:24.523738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-43afc148-cb7e-4fa7-a2bb-b7c958909584 req-2b73c24c-f78a-4021-a8d2-21daf03afe25 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:24.561946 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-43afc148-cb7e-4fa7-a2bb-b7c958909584 req-2b73c24c-f78a-4021-a8d2-21daf03afe25 service nova] Creating event network-vif-plugged:003f92bc-20c3-401e-b6aa-031d76d7988a for instance 24504b35-3a86-47cf-9dd6-3e119044d628 on n-h1-854823-1 Aug 27 04:41:24.577531 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-43afc148-cb7e-4fa7-a2bb-b7c958909584 req-2b73c24c-f78a-4021-a8d2-21daf03afe25 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101372 Aug 27 04:41:24.579722 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1266/2556] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:24.628880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e4b6e481-a7cd-4380-a799-6752af87d72f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:24.629625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e4b6e481-a7cd-4380-a799-6752af87d72f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:24.655454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4b6e481-a7cd-4380-a799-6752af87d72f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:24.656122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4b6e481-a7cd-4380-a799-6752af87d72f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:24.657609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4b6e481-a7cd-4380-a799-6752af87d72f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:24.660674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4b6e481-a7cd-4380-a799-6752af87d72f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:24.661408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4b6e481-a7cd-4380-a799-6752af87d72f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:24.662137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4b6e481-a7cd-4380-a799-6752af87d72f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:24.813022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d04dedaf-a497-4bb4-9688-5280011e2ff2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:24.829949 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d04dedaf-a497-4bb4-9688-5280011e2ff2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1324 microversion: 2.1 time: 0.502948 Aug 27 04:41:24.830943 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1291/2557] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:24 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1324 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:24.838554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-457412427", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e70262b8-a762-4feb-8fb3-236b3c41daf8"}], "block_device_mapping_v2": [{"uuid": "678ba586-9d63-4c44-8ef6-2601509ebfbb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:24.977771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] validate_networks() for [('e70262b8-a762-4feb-8fb3-236b3c41daf8', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:41:25.129629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e4b6e481-a7cd-4380-a799-6752af87d72f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:25.156385 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e4b6e481-a7cd-4380-a799-6752af87d72f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1318 microversion: 2.1 time: 0.545556 Aug 27 04:41:25.172876 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1267/2558] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:24 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1318 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:25.186457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e07135a4-d601-4cd2-98b3-5de55b9535ac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:25.190056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e07135a4-d601-4cd2-98b3-5de55b9535ac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:25.208419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07135a4-d601-4cd2-98b3-5de55b9535ac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:25.209851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07135a4-d601-4cd2-98b3-5de55b9535ac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:25.211711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07135a4-d601-4cd2-98b3-5de55b9535ac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:25.214174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07135a4-d601-4cd2-98b3-5de55b9535ac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:25.217698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07135a4-d601-4cd2-98b3-5de55b9535ac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:25.219226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07135a4-d601-4cd2-98b3-5de55b9535ac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:25.669166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e07135a4-d601-4cd2-98b3-5de55b9535ac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:25.682293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e07135a4-d601-4cd2-98b3-5de55b9535ac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:25.684211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e07135a4-d601-4cd2-98b3-5de55b9535ac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:25.686327 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e07135a4-d601-4cd2-98b3-5de55b9535ac tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1487 microversion: 2.25 time: 0.520602 Aug 27 04:41:25.687121 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1268/2559] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:25 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1487 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:25.721034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e5ba33ec-e3fd-40d8-9b40-1cdfe28e3d57 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:25.724187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e5ba33ec-e3fd-40d8-9b40-1cdfe28e3d57 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:25.741805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5ba33ec-e3fd-40d8-9b40-1cdfe28e3d57 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:25.742730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5ba33ec-e3fd-40d8-9b40-1cdfe28e3d57 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:25.747289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5ba33ec-e3fd-40d8-9b40-1cdfe28e3d57 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:25.749249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5ba33ec-e3fd-40d8-9b40-1cdfe28e3d57 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:25.750327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5ba33ec-e3fd-40d8-9b40-1cdfe28e3d57 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:25.767092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5ba33ec-e3fd-40d8-9b40-1cdfe28e3d57 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:25.784255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:26.237517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:26.248009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e5ba33ec-e3fd-40d8-9b40-1cdfe28e3d57 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:26.256095 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e5ba33ec-e3fd-40d8-9b40-1cdfe28e3d57 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1319 microversion: 2.1 time: 0.567527 Aug 27 04:41:26.257306 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1269/2560] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:25 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1319 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:26.261215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:41:26.262460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:41:26.263275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:41:26.263845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:41:26.265104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:41:26.272507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3ca8a97d-4440-4c86-91aa-1b53f812bfff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:26.273253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3ca8a97d-4440-4c86-91aa-1b53f812bfff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:26.276659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:26.277146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:26.277738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:26.278614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:26.279142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:26.279739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:26.283077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ca8a97d-4440-4c86-91aa-1b53f812bfff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:26.284274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ca8a97d-4440-4c86-91aa-1b53f812bfff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:26.285264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ca8a97d-4440-4c86-91aa-1b53f812bfff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:26.286766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ca8a97d-4440-4c86-91aa-1b53f812bfff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:26.287371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ca8a97d-4440-4c86-91aa-1b53f812bfff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:26.287807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ca8a97d-4440-4c86-91aa-1b53f812bfff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:26.304492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Getting quotas for project 67b142dea11c4e7d921bbb7dd5e543be. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:41:26.315547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Getting quotas for user 8213929124384914aebc5e05572cc1ed and project 67b142dea11c4e7d921bbb7dd5e543be. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:41:26.323024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:26.393281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:41:26.395941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='678ba586-9d63-4c44-8ef6-2601509ebfbb',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:41:26.573953 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-87565af7-0a63-4eb1-89d4-ad7ee00797d2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.741834 Aug 27 04:41:26.575474 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1292/2561] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:41:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:41:26.584889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6b22b54-eb6e-406d-ad89-d2d4e88cc62e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:26.585727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e6b22b54-eb6e-406d-ad89-d2d4e88cc62e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:26.592807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b22b54-eb6e-406d-ad89-d2d4e88cc62e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:26.593531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b22b54-eb6e-406d-ad89-d2d4e88cc62e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:26.594178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b22b54-eb6e-406d-ad89-d2d4e88cc62e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:26.596068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b22b54-eb6e-406d-ad89-d2d4e88cc62e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:26.596766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b22b54-eb6e-406d-ad89-d2d4e88cc62e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:26.597348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b22b54-eb6e-406d-ad89-d2d4e88cc62e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:26.776922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e6b22b54-eb6e-406d-ad89-d2d4e88cc62e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:26.786680 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6b22b54-eb6e-406d-ad89-d2d4e88cc62e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1324 microversion: 2.1 time: 0.209680 Aug 27 04:41:26.788943 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1293/2562] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:26 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1324 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:26.794938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b6b3b5b3-3fe1-46db-9e08-356276df3d88 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:26.795984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b6b3b5b3-3fe1-46db-9e08-356276df3d88 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:26.807371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6b3b5b3-3fe1-46db-9e08-356276df3d88 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:26.808143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6b3b5b3-3fe1-46db-9e08-356276df3d88 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:26.809482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6b3b5b3-3fe1-46db-9e08-356276df3d88 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:26.810484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6b3b5b3-3fe1-46db-9e08-356276df3d88 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:26.811243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6b3b5b3-3fe1-46db-9e08-356276df3d88 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:26.811942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6b3b5b3-3fe1-46db-9e08-356276df3d88 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:26.920816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3ca8a97d-4440-4c86-91aa-1b53f812bfff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:26.932850 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3ca8a97d-4440-4c86-91aa-1b53f812bfff tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1314 microversion: 2.1 time: 0.674109 Aug 27 04:41:26.934100 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1270/2563] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:26 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:26.939086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-f6d633db-ea26-4b6a-a06c-1219555c0120 req-9a89a93d-fc47-44a4-a50f-19ddeecf6050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3", "tag": "06142979-93d1-48a2-a72f-11b13cbb0e03"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:26.950090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f6d633db-ea26-4b6a-a06c-1219555c0120 req-9a89a93d-fc47-44a4-a50f-19ddeecf6050 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:26.950678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f6d633db-ea26-4b6a-a06c-1219555c0120 req-9a89a93d-fc47-44a4-a50f-19ddeecf6050 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:26.951170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f6d633db-ea26-4b6a-a06c-1219555c0120 req-9a89a93d-fc47-44a4-a50f-19ddeecf6050 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:26.968505 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f6d633db-ea26-4b6a-a06c-1219555c0120 req-9a89a93d-fc47-44a4-a50f-19ddeecf6050 service nova] Creating event network-changed:06142979-93d1-48a2-a72f-11b13cbb0e03 for instance 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 on n-h1-854823-1 Aug 27 04:41:26.974613 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-f6d633db-ea26-4b6a-a06c-1219555c0120 req-9a89a93d-fc47-44a4-a50f-19ddeecf6050 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038625 Aug 27 04:41:26.976019 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1271/2564] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:26.986657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-57efa4bf-e393-4b24-8192-06b59f7f05f1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:26.987984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-57efa4bf-e393-4b24-8192-06b59f7f05f1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:26.995829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b6b3b5b3-3fe1-46db-9e08-356276df3d88 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:27.004894 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b6b3b5b3-3fe1-46db-9e08-356276df3d88 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1318 microversion: 2.1 time: 0.214347 Aug 27 04:41:27.017881 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1294/2565] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:26 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:27.017881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d66d0017-15a5-4efa-85da-52c8e2684ebd req-275b137f-e76b-483c-8c6b-e4c66030dce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4549183c-6ddf-442e-a0fd-6abba4b648c3", "name": "network-vif-plugged", "status": "completed", "tag": "58521f19-b6b8-4427-a0d6-6704d0cec337"}, {"server_uuid": "a1871fce-ce02-43f5-a460-02f259a72471", "name": "network-vif-plugged", "status": "completed", "tag": "36205269-ec1e-4154-aca0-c4d791be2668"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:27.032048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d66d0017-15a5-4efa-85da-52c8e2684ebd req-275b137f-e76b-483c-8c6b-e4c66030dce3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.033493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d66d0017-15a5-4efa-85da-52c8e2684ebd req-275b137f-e76b-483c-8c6b-e4c66030dce3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.034196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d66d0017-15a5-4efa-85da-52c8e2684ebd req-275b137f-e76b-483c-8c6b-e4c66030dce3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.049801 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d66d0017-15a5-4efa-85da-52c8e2684ebd req-275b137f-e76b-483c-8c6b-e4c66030dce3 service nova] Creating event network-vif-plugged:58521f19-b6b8-4427-a0d6-6704d0cec337 for instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 on n-h2-854823-1 Aug 27 04:41:27.050536 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d66d0017-15a5-4efa-85da-52c8e2684ebd req-275b137f-e76b-483c-8c6b-e4c66030dce3 service nova] Creating event network-vif-plugged:36205269-ec1e-4154-aca0-c4d791be2668 for instance a1871fce-ce02-43f5-a460-02f259a72471 on n-h2-854823-1 Aug 27 04:41:27.057668 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d66d0017-15a5-4efa-85da-52c8e2684ebd req-275b137f-e76b-483c-8c6b-e4c66030dce3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047714 Aug 27 04:41:27.058449 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1295/2566] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:27.064964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-634373e9-898b-4588-8249-1672c55f85cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:27.065752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-634373e9-898b-4588-8249-1672c55f85cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:27.074804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-634373e9-898b-4588-8249-1672c55f85cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.076048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-634373e9-898b-4588-8249-1672c55f85cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.076769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-634373e9-898b-4588-8249-1672c55f85cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.077789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-634373e9-898b-4588-8249-1672c55f85cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.078267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-634373e9-898b-4588-8249-1672c55f85cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.078765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-634373e9-898b-4588-8249-1672c55f85cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.101548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-57efa4bf-e393-4b24-8192-06b59f7f05f1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:27.117305 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-57efa4bf-e393-4b24-8192-06b59f7f05f1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1052 microversion: 2.1 time: 0.139371 Aug 27 04:41:27.130031 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1272/2567] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:26 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1052 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:27.145088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-f8d1b696-a337-4268-8932-19a6770c549d req-7b1bb5fd-5277-4b4b-a9a1-eec5691c09b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629128a5-55ce-4184-8821-6dede5fd0081", "tag": "1def81ec-2b40-44c8-a429-c0786309e355"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:27.167391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f8d1b696-a337-4268-8932-19a6770c549d req-7b1bb5fd-5277-4b4b-a9a1-eec5691c09b6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.168389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f8d1b696-a337-4268-8932-19a6770c549d req-7b1bb5fd-5277-4b4b-a9a1-eec5691c09b6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.169380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f8d1b696-a337-4268-8932-19a6770c549d req-7b1bb5fd-5277-4b4b-a9a1-eec5691c09b6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.187270 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f8d1b696-a337-4268-8932-19a6770c549d req-7b1bb5fd-5277-4b4b-a9a1-eec5691c09b6 service nova] Creating event network-changed:1def81ec-2b40-44c8-a429-c0786309e355 for instance 629128a5-55ce-4184-8821-6dede5fd0081 on n-h1-854823-1 Aug 27 04:41:27.192876 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-f8d1b696-a337-4268-8932-19a6770c549d req-7b1bb5fd-5277-4b4b-a9a1-eec5691c09b6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061411 Aug 27 04:41:27.193873 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1273/2568] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:27.284243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-72390558-4923-4562-9a3e-72d816b191fe tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:27.285056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-72390558-4923-4562-9a3e-72d816b191fe tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:27.290561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-634373e9-898b-4588-8249-1672c55f85cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:27.298965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72390558-4923-4562-9a3e-72d816b191fe tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.299468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72390558-4923-4562-9a3e-72d816b191fe tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.299911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72390558-4923-4562-9a3e-72d816b191fe tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.300420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-634373e9-898b-4588-8249-1672c55f85cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:27.301005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72390558-4923-4562-9a3e-72d816b191fe tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.301281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72390558-4923-4562-9a3e-72d816b191fe tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.302464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-634373e9-898b-4588-8249-1672c55f85cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:27.303513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72390558-4923-4562-9a3e-72d816b191fe tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.303866 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-634373e9-898b-4588-8249-1672c55f85cf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1477 microversion: 2.25 time: 0.244155 Aug 27 04:41:27.304829 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1296/2569] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:27 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1477 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:27.329062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bf54edf-2e5c-40d0-abc9-c21b42e87b94 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '.version_select at 0x7f1f2199f4c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:27.333947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf54edf-2e5c-40d0-abc9-c21b42e87b94 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.334443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf54edf-2e5c-40d0-abc9-c21b42e87b94 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.334876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf54edf-2e5c-40d0-abc9-c21b42e87b94 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.348117 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0bf54edf-2e5c-40d0-abc9-c21b42e87b94 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 3204 microversion: 2.25 time: 0.023430 Aug 27 04:41:27.358992 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1297/2570] 10.222.0.79 () {60 vars in 1184 bytes} [Sat Aug 27 04:41:27 2022] GET /compute/v2.1/os-migrations => generated 3204 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:27.365285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14016a76-ec00-4b31-bf81-d0060f234a19 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:27.366259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14016a76-ec00-4b31-bf81-d0060f234a19 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:27.372479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14016a76-ec00-4b31-bf81-d0060f234a19 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.373016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14016a76-ec00-4b31-bf81-d0060f234a19 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.373451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14016a76-ec00-4b31-bf81-d0060f234a19 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.374164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14016a76-ec00-4b31-bf81-d0060f234a19 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.374627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14016a76-ec00-4b31-bf81-d0060f234a19 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.375087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14016a76-ec00-4b31-bf81-d0060f234a19 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.518924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-14016a76-ec00-4b31-bf81-d0060f234a19 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] Lazy-loading 'services' on Instance uuid 6d59b3ef-e433-480b-9183-d020c885ce4d {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:41:27.533472 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14016a76-ec00-4b31-bf81-d0060f234a19 tempest-LiveAutoBlockMigrationV225Test-1696098070 tempest-LiveAutoBlockMigrationV225Test-1696098070-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1970 microversion: 2.25 time: 0.173013 Aug 27 04:41:27.534691 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1298/2571] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:27 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1970 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:27.570381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40d07f33-da5d-44df-9b7a-b049b2f506b6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:27.570916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40d07f33-da5d-44df-9b7a-b049b2f506b6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:27.577579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d07f33-da5d-44df-9b7a-b049b2f506b6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.578073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d07f33-da5d-44df-9b7a-b049b2f506b6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.578510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d07f33-da5d-44df-9b7a-b049b2f506b6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.579210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d07f33-da5d-44df-9b7a-b049b2f506b6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.579669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d07f33-da5d-44df-9b7a-b049b2f506b6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.580096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40d07f33-da5d-44df-9b7a-b049b2f506b6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.584659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:27.608159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40d07f33-da5d-44df-9b7a-b049b2f506b6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:41:27.658807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-72390558-4923-4562-9a3e-72d816b191fe tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:27.701603 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-72390558-4923-4562-9a3e-72d816b191fe tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1319 microversion: 2.1 time: 0.422616 Aug 27 04:41:27.716598 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1274/2572] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:27 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1319 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:27.717598 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40d07f33-da5d-44df-9b7a-b049b2f506b6 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 204 len: 0 microversion: 2.25 time: 0.144248 Aug 27 04:41:27.717598 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1299/2573] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:41:27 2022] DELETE /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 04:41:27.725969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-df152ffa-b827-481f-957b-e4a627a416cd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:27.725969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-df152ffa-b827-481f-957b-e4a627a416cd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:27.729399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-df152ffa-b827-481f-957b-e4a627a416cd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.730113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-df152ffa-b827-481f-957b-e4a627a416cd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.730972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-df152ffa-b827-481f-957b-e4a627a416cd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.732107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-df152ffa-b827-481f-957b-e4a627a416cd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.732915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-df152ffa-b827-481f-957b-e4a627a416cd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.733534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-df152ffa-b827-481f-957b-e4a627a416cd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.810507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d9714402-b821-4d48-9138-8c62fbdd09a1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:27.812250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d9714402-b821-4d48-9138-8c62fbdd09a1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:27.833411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9714402-b821-4d48-9138-8c62fbdd09a1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.833999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9714402-b821-4d48-9138-8c62fbdd09a1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.834516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9714402-b821-4d48-9138-8c62fbdd09a1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.835337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9714402-b821-4d48-9138-8c62fbdd09a1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.835872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9714402-b821-4d48-9138-8c62fbdd09a1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.836375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9714402-b821-4d48-9138-8c62fbdd09a1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.896792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-df152ffa-b827-481f-957b-e4a627a416cd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:27.908272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-df152ffa-b827-481f-957b-e4a627a416cd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:27.909810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-df152ffa-b827-481f-957b-e4a627a416cd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:27.911020 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-df152ffa-b827-481f-957b-e4a627a416cd tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1483 microversion: 2.25 time: 0.194855 Aug 27 04:41:27.911556 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1275/2574] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:27 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1483 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:41:27.956015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-120f7b35-f8b4-47f5-8383-06c618989209 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:27.957255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-120f7b35-f8b4-47f5-8383-06c618989209 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:27.964878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-120f7b35-f8b4-47f5-8383-06c618989209 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.965921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-120f7b35-f8b4-47f5-8383-06c618989209 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.966469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-120f7b35-f8b4-47f5-8383-06c618989209 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:27.967314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-120f7b35-f8b4-47f5-8383-06c618989209 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:27.967836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-120f7b35-f8b4-47f5-8383-06c618989209 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:27.968353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-120f7b35-f8b4-47f5-8383-06c618989209 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:28.144597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d9714402-b821-4d48-9138-8c62fbdd09a1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:28.153145 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d9714402-b821-4d48-9138-8c62fbdd09a1 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1324 microversion: 2.1 time: 0.349514 Aug 27 04:41:28.153926 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1300/2575] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:27 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1324 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:28.158237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbcef0c6-0566-4a4b-a86c-8d776cdbd320 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:28.158849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dbcef0c6-0566-4a4b-a86c-8d776cdbd320 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:28.170946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbcef0c6-0566-4a4b-a86c-8d776cdbd320 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:28.171437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbcef0c6-0566-4a4b-a86c-8d776cdbd320 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:28.171872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbcef0c6-0566-4a4b-a86c-8d776cdbd320 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:28.172592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbcef0c6-0566-4a4b-a86c-8d776cdbd320 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:28.173052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbcef0c6-0566-4a4b-a86c-8d776cdbd320 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:28.173480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbcef0c6-0566-4a4b-a86c-8d776cdbd320 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:28.214087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-120f7b35-f8b4-47f5-8383-06c618989209 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:28.222095 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-120f7b35-f8b4-47f5-8383-06c618989209 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1314 microversion: 2.1 time: 0.270599 Aug 27 04:41:28.229224 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1276/2576] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:27 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:28.229224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-73ecf568-415d-4cdb-b212-21308a15d058 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:28.229224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-73ecf568-415d-4cdb-b212-21308a15d058 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:28.236331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73ecf568-415d-4cdb-b212-21308a15d058 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:28.236871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73ecf568-415d-4cdb-b212-21308a15d058 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:28.237318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73ecf568-415d-4cdb-b212-21308a15d058 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:28.238229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73ecf568-415d-4cdb-b212-21308a15d058 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:28.238714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73ecf568-415d-4cdb-b212-21308a15d058 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:28.239152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73ecf568-415d-4cdb-b212-21308a15d058 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:28.375770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dbcef0c6-0566-4a4b-a86c-8d776cdbd320 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:28.382645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-73ecf568-415d-4cdb-b212-21308a15d058 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:28.386462 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbcef0c6-0566-4a4b-a86c-8d776cdbd320 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1318 microversion: 2.1 time: 0.231681 Aug 27 04:41:28.387139 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1301/2577] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:28 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:28.399562 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-73ecf568-415d-4cdb-b212-21308a15d058 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1150 microversion: 2.1 time: 0.169241 Aug 27 04:41:28.399562 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1277/2578] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:28 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1150 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:28.738713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0a2e280e-78c6-4165-8dae-5cc3713bebd3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:28.739244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0a2e280e-78c6-4165-8dae-5cc3713bebd3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:28.745368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a2e280e-78c6-4165-8dae-5cc3713bebd3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:28.745849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a2e280e-78c6-4165-8dae-5cc3713bebd3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:28.746281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a2e280e-78c6-4165-8dae-5cc3713bebd3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:28.746969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a2e280e-78c6-4165-8dae-5cc3713bebd3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:28.747420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a2e280e-78c6-4165-8dae-5cc3713bebd3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:28.748014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a2e280e-78c6-4165-8dae-5cc3713bebd3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:28.933358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a0263cf-44ac-4f2c-8983-72dd2f5aa60e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:28.934485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5a0263cf-44ac-4f2c-8983-72dd2f5aa60e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:28.943987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a0263cf-44ac-4f2c-8983-72dd2f5aa60e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:28.944855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a0263cf-44ac-4f2c-8983-72dd2f5aa60e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:28.945566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a0263cf-44ac-4f2c-8983-72dd2f5aa60e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:28.946786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a0263cf-44ac-4f2c-8983-72dd2f5aa60e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:28.948042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a0263cf-44ac-4f2c-8983-72dd2f5aa60e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:28.948854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a0263cf-44ac-4f2c-8983-72dd2f5aa60e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:29.014976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0a2e280e-78c6-4165-8dae-5cc3713bebd3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:29.023855 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0a2e280e-78c6-4165-8dae-5cc3713bebd3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1319 microversion: 2.1 time: 0.289147 Aug 27 04:41:29.024447 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1278/2579] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:28 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:29.174815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d6d2d261-8645-4d2f-8089-e65f08537e66 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:29.175689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d6d2d261-8645-4d2f-8089-e65f08537e66 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:29.183494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6d2d261-8645-4d2f-8089-e65f08537e66 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:29.184267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6d2d261-8645-4d2f-8089-e65f08537e66 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:29.184741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6d2d261-8645-4d2f-8089-e65f08537e66 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:29.185638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6d2d261-8645-4d2f-8089-e65f08537e66 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:29.186109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6d2d261-8645-4d2f-8089-e65f08537e66 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:29.186548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6d2d261-8645-4d2f-8089-e65f08537e66 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:29.453733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5a0263cf-44ac-4f2c-8983-72dd2f5aa60e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:29.465367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5a0263cf-44ac-4f2c-8983-72dd2f5aa60e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:29.467140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5a0263cf-44ac-4f2c-8983-72dd2f5aa60e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:29.468487 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5a0263cf-44ac-4f2c-8983-72dd2f5aa60e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1483 microversion: 2.25 time: 0.539092 Aug 27 04:41:29.471039 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1302/2580] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:28 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1483 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:41:29.477321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d253ca22-7885-41ad-a647-52ea5d9b7d69 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:29.479261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d253ca22-7885-41ad-a647-52ea5d9b7d69 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:29.488845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d253ca22-7885-41ad-a647-52ea5d9b7d69 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:29.490578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d253ca22-7885-41ad-a647-52ea5d9b7d69 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:29.491750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d253ca22-7885-41ad-a647-52ea5d9b7d69 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:29.492818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d253ca22-7885-41ad-a647-52ea5d9b7d69 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:29.493784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d253ca22-7885-41ad-a647-52ea5d9b7d69 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:29.494976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d253ca22-7885-41ad-a647-52ea5d9b7d69 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:29.659376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d253ca22-7885-41ad-a647-52ea5d9b7d69 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:29.678930 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d253ca22-7885-41ad-a647-52ea5d9b7d69 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1500 microversion: 2.1 time: 0.204225 Aug 27 04:41:29.682490 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1303/2581] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:29 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1500 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:29.688259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d631b00c-e45b-4413-a761-6659f212a56d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:29.693882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d631b00c-e45b-4413-a761-6659f212a56d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:29.707529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d631b00c-e45b-4413-a761-6659f212a56d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:29.708354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d631b00c-e45b-4413-a761-6659f212a56d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:29.709046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d631b00c-e45b-4413-a761-6659f212a56d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:29.710291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d631b00c-e45b-4413-a761-6659f212a56d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:29.710973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d631b00c-e45b-4413-a761-6659f212a56d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:29.711846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d631b00c-e45b-4413-a761-6659f212a56d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:29.737914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d6d2d261-8645-4d2f-8089-e65f08537e66 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:29.772241 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d6d2d261-8645-4d2f-8089-e65f08537e66 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1324 microversion: 2.1 time: 0.600080 Aug 27 04:41:29.774945 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1279/2582] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:29 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1324 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:29.783629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-abcc1d49-c2c9-431a-9e19-f7f4bcebb1d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:29.785397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-abcc1d49-c2c9-431a-9e19-f7f4bcebb1d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:29.799148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abcc1d49-c2c9-431a-9e19-f7f4bcebb1d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:29.799904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abcc1d49-c2c9-431a-9e19-f7f4bcebb1d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:29.800355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abcc1d49-c2c9-431a-9e19-f7f4bcebb1d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:29.801294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abcc1d49-c2c9-431a-9e19-f7f4bcebb1d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:29.802035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abcc1d49-c2c9-431a-9e19-f7f4bcebb1d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:29.802685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abcc1d49-c2c9-431a-9e19-f7f4bcebb1d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:29.973004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-abcc1d49-c2c9-431a-9e19-f7f4bcebb1d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:29.985797 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-abcc1d49-c2c9-431a-9e19-f7f4bcebb1d9 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1150 microversion: 2.1 time: 0.207202 Aug 27 04:41:29.987277 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1280/2583] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:29 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1150 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:29.996253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d95916d9-5967-4439-b5f1-8d5e2250e267 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:29.996922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d95916d9-5967-4439-b5f1-8d5e2250e267 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:30.021512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d631b00c-e45b-4413-a761-6659f212a56d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:30.032405 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d631b00c-e45b-4413-a761-6659f212a56d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1318 microversion: 2.1 time: 0.347613 Aug 27 04:41:30.033264 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1304/2584] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:29 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:30.040497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d95916d9-5967-4439-b5f1-8d5e2250e267 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:30.042285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d95916d9-5967-4439-b5f1-8d5e2250e267 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:30.042743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d95916d9-5967-4439-b5f1-8d5e2250e267 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:30.043541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d95916d9-5967-4439-b5f1-8d5e2250e267 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:30.044143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d95916d9-5967-4439-b5f1-8d5e2250e267 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:30.045014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d95916d9-5967-4439-b5f1-8d5e2250e267 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:30.047818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af4e0dc4-58c3-4c1f-be21-d96fcc2dacf7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:30.054933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af4e0dc4-58c3-4c1f-be21-d96fcc2dacf7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:30.069760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af4e0dc4-58c3-4c1f-be21-d96fcc2dacf7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:30.070412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af4e0dc4-58c3-4c1f-be21-d96fcc2dacf7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:30.070958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af4e0dc4-58c3-4c1f-be21-d96fcc2dacf7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:30.071803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af4e0dc4-58c3-4c1f-be21-d96fcc2dacf7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:30.073576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af4e0dc4-58c3-4c1f-be21-d96fcc2dacf7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:30.073576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af4e0dc4-58c3-4c1f-be21-d96fcc2dacf7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:30.081991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-d95916d9-5967-4439-b5f1-8d5e2250e267 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lazy-loading 'flavor' on Instance uuid 4549183c-6ddf-442e-a0fd-6abba4b648c3 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:41:30.309738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af4e0dc4-58c3-4c1f-be21-d96fcc2dacf7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:30.318219 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af4e0dc4-58c3-4c1f-be21-d96fcc2dacf7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 200 len: 1506 microversion: 2.1 time: 0.276329 Aug 27 04:41:30.320447 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1305/2585] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:30 2022] GET /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:30.341219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-880e5412-35f6-4293-adec-e4c219adc422 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:30.341955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-880e5412-35f6-4293-adec-e4c219adc422 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: a1871fce-ce02-43f5-a460-02f259a72471] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:30.348216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-880e5412-35f6-4293-adec-e4c219adc422 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:30.348822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-880e5412-35f6-4293-adec-e4c219adc422 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:30.349501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-880e5412-35f6-4293-adec-e4c219adc422 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:30.350447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-880e5412-35f6-4293-adec-e4c219adc422 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:30.351151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-880e5412-35f6-4293-adec-e4c219adc422 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:30.351791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-880e5412-35f6-4293-adec-e4c219adc422 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:30.388831 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d95916d9-5967-4439-b5f1-8d5e2250e267 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "POST /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3/action" status: 202 len: 0 microversion: 2.1 time: 0.399336 Aug 27 04:41:30.389778 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1281/2586] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:41:29 2022] POST /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:30.403300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4211bad-47df-45fe-a851-5b9fb9859a0e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:30.404081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f4211bad-47df-45fe-a851-5b9fb9859a0e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:30.412581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4211bad-47df-45fe-a851-5b9fb9859a0e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:30.412581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4211bad-47df-45fe-a851-5b9fb9859a0e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:30.412966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4211bad-47df-45fe-a851-5b9fb9859a0e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:30.413711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4211bad-47df-45fe-a851-5b9fb9859a0e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:30.414168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4211bad-47df-45fe-a851-5b9fb9859a0e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:30.414733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4211bad-47df-45fe-a851-5b9fb9859a0e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:30.549352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-880e5412-35f6-4293-adec-e4c219adc422 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:30.561961 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-880e5412-35f6-4293-adec-e4c219adc422 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/a1871fce-ce02-43f5-a460-02f259a72471" status: 200 len: 1506 microversion: 2.1 time: 0.224978 Aug 27 04:41:30.563024 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1306/2587] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:30 2022] GET /compute/v2.1/servers/a1871fce-ce02-43f5-a460-02f259a72471 => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:30.567917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ac7e0a6-2704-4880-b708-5c2454ee6d35 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:30.568852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ac7e0a6-2704-4880-b708-5c2454ee6d35 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:30.576715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac7e0a6-2704-4880-b708-5c2454ee6d35 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:30.577482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac7e0a6-2704-4880-b708-5c2454ee6d35 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:30.578130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac7e0a6-2704-4880-b708-5c2454ee6d35 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:30.579000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac7e0a6-2704-4880-b708-5c2454ee6d35 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:30.579465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac7e0a6-2704-4880-b708-5c2454ee6d35 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:30.580461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac7e0a6-2704-4880-b708-5c2454ee6d35 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:30.781923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ac7e0a6-2704-4880-b708-5c2454ee6d35 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:30.794654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ac7e0a6-2704-4880-b708-5c2454ee6d35 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:30.798095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ac7e0a6-2704-4880-b708-5c2454ee6d35 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:30.799093 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ac7e0a6-2704-4880-b708-5c2454ee6d35 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1483 microversion: 2.25 time: 0.235058 Aug 27 04:41:30.800352 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1307/2588] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:30 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1483 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:30.806958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e543962-a600-4f6d-bb15-1f1b10c4fc45 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:30.808150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e543962-a600-4f6d-bb15-1f1b10c4fc45 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: a1871fce-ce02-43f5-a460-02f259a72471] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:30.825224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e543962-a600-4f6d-bb15-1f1b10c4fc45 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:30.826542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e543962-a600-4f6d-bb15-1f1b10c4fc45 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:30.828157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e543962-a600-4f6d-bb15-1f1b10c4fc45 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:30.830828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e543962-a600-4f6d-bb15-1f1b10c4fc45 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:30.832329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e543962-a600-4f6d-bb15-1f1b10c4fc45 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:30.833462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e543962-a600-4f6d-bb15-1f1b10c4fc45 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:30.869918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e543962-a600-4f6d-bb15-1f1b10c4fc45 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: a1871fce-ce02-43f5-a460-02f259a72471] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:41:31.060945 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e543962-a600-4f6d-bb15-1f1b10c4fc45 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a1871fce-ce02-43f5-a460-02f259a72471" status: 204 len: 0 microversion: 2.1 time: 0.258108 Aug 27 04:41:31.062125 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1308/2589] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:41:30 2022] DELETE /compute/v2.1/servers/a1871fce-ce02-43f5-a460-02f259a72471 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:41:31.072110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c9d7a50-80e3-4034-9ef6-2bfa6373c721 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:31.074210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c9d7a50-80e3-4034-9ef6-2bfa6373c721 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:31.086404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9d7a50-80e3-4034-9ef6-2bfa6373c721 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:31.086915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9d7a50-80e3-4034-9ef6-2bfa6373c721 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:31.087361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9d7a50-80e3-4034-9ef6-2bfa6373c721 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:31.088134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9d7a50-80e3-4034-9ef6-2bfa6373c721 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:31.088607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9d7a50-80e3-4034-9ef6-2bfa6373c721 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:31.089267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9d7a50-80e3-4034-9ef6-2bfa6373c721 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:31.187163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f4211bad-47df-45fe-a851-5b9fb9859a0e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:31.196344 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f4211bad-47df-45fe-a851-5b9fb9859a0e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.802406 Aug 27 04:41:31.215305 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1282/2590] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:30 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:31.215305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0cae5f8f-234a-4d92-8602-76a70d6c9244 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:31.215305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0cae5f8f-234a-4d92-8602-76a70d6c9244 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:31.228755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cae5f8f-234a-4d92-8602-76a70d6c9244 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:31.229390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cae5f8f-234a-4d92-8602-76a70d6c9244 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:31.231778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cae5f8f-234a-4d92-8602-76a70d6c9244 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:31.232784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cae5f8f-234a-4d92-8602-76a70d6c9244 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:31.233425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cae5f8f-234a-4d92-8602-76a70d6c9244 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:31.234023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cae5f8f-234a-4d92-8602-76a70d6c9244 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:31.338341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0cae5f8f-234a-4d92-8602-76a70d6c9244 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:31.350137 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0cae5f8f-234a-4d92-8602-76a70d6c9244 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1168 microversion: 2.1 time: 0.149288 Aug 27 04:41:31.351585 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1283/2591] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:31 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1168 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:31.370400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aaa8bf54-c2a8-4e5a-b057-359638c46969 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:31.371194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aaa8bf54-c2a8-4e5a-b057-359638c46969 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:31.381381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaa8bf54-c2a8-4e5a-b057-359638c46969 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:31.382112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaa8bf54-c2a8-4e5a-b057-359638c46969 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:31.382936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaa8bf54-c2a8-4e5a-b057-359638c46969 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:31.385825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaa8bf54-c2a8-4e5a-b057-359638c46969 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:31.386623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaa8bf54-c2a8-4e5a-b057-359638c46969 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:31.387212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaa8bf54-c2a8-4e5a-b057-359638c46969 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:31.412983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c9d7a50-80e3-4034-9ef6-2bfa6373c721 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:31.422834 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c9d7a50-80e3-4034-9ef6-2bfa6373c721 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1324 microversion: 2.1 time: 0.359228 Aug 27 04:41:31.438845 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1309/2592] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:31 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1324 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:31.445750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6583040e-d9ca-40c6-a085-f23e359d7dbb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:31.446357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6583040e-d9ca-40c6-a085-f23e359d7dbb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:31.476835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6583040e-d9ca-40c6-a085-f23e359d7dbb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:31.477429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6583040e-d9ca-40c6-a085-f23e359d7dbb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:31.477915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6583040e-d9ca-40c6-a085-f23e359d7dbb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:31.478776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6583040e-d9ca-40c6-a085-f23e359d7dbb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:31.479239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6583040e-d9ca-40c6-a085-f23e359d7dbb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:31.481477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6583040e-d9ca-40c6-a085-f23e359d7dbb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:31.520789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6583040e-d9ca-40c6-a085-f23e359d7dbb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 24504b35-3a86-47cf-9dd6-3e119044d628] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:41:31.584891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:31.618390 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6583040e-d9ca-40c6-a085-f23e359d7dbb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "DELETE /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628" status: 204 len: 0 microversion: 2.1 time: 0.177200 Aug 27 04:41:31.620022 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1310/2593] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:41:31 2022] DELETE /compute/v2.1/servers/24504b35-3a86-47cf-9dd6-3e119044d628 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:41:31.626907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-eb704afc-56c3-45b6-bf6a-fe9466c39938 req-ed5136e2-9942-4d20-bc1e-abee49345458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d59b3ef-e433-480b-9183-d020c885ce4d", "name": "network-vif-deleted", "tag": "a44adf17-8cdc-487e-b7d9-6433d193ac0c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:31.638895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-eb704afc-56c3-45b6-bf6a-fe9466c39938 req-ed5136e2-9942-4d20-bc1e-abee49345458 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:31.640519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-eb704afc-56c3-45b6-bf6a-fe9466c39938 req-ed5136e2-9942-4d20-bc1e-abee49345458 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:31.641985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-eb704afc-56c3-45b6-bf6a-fe9466c39938 req-ed5136e2-9942-4d20-bc1e-abee49345458 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:31.655921 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-eb704afc-56c3-45b6-bf6a-fe9466c39938 req-ed5136e2-9942-4d20-bc1e-abee49345458 service nova] Creating event network-vif-deleted:a44adf17-8cdc-487e-b7d9-6433d193ac0c for instance 6d59b3ef-e433-480b-9183-d020c885ce4d on n-h2-854823-1 Aug 27 04:41:31.661934 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-eb704afc-56c3-45b6-bf6a-fe9466c39938 req-ed5136e2-9942-4d20-bc1e-abee49345458 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040013 Aug 27 04:41:31.663246 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1311/2594] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:31.676013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aaa8bf54-c2a8-4e5a-b057-359638c46969 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:31.685790 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aaa8bf54-c2a8-4e5a-b057-359638c46969 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1318 microversion: 2.1 time: 0.333831 Aug 27 04:41:31.700433 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1284/2595] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:31 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:31.760748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-2086775951", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "7a554d33-7c77-4955-a453-fe37c4f850fa"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:31.824069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-19c2e486-e891-4faa-84fb-721dfd191327 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:31.824248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] validate_networks() for [('7a554d33-7c77-4955-a453-fe37c4f850fa', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:41:31.835639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-19c2e486-e891-4faa-84fb-721dfd191327 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:31.844691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19c2e486-e891-4faa-84fb-721dfd191327 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:31.845561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19c2e486-e891-4faa-84fb-721dfd191327 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:31.846172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19c2e486-e891-4faa-84fb-721dfd191327 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:31.847059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19c2e486-e891-4faa-84fb-721dfd191327 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:31.848151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19c2e486-e891-4faa-84fb-721dfd191327 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:31.848905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19c2e486-e891-4faa-84fb-721dfd191327 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:31.929826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-19c2e486-e891-4faa-84fb-721dfd191327 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:31.938960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-19c2e486-e891-4faa-84fb-721dfd191327 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:31.941815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-19c2e486-e891-4faa-84fb-721dfd191327 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:31.943226 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-19c2e486-e891-4faa-84fb-721dfd191327 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1441 microversion: 2.25 time: 0.123735 Aug 27 04:41:31.943966 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1285/2596] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:31 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1441 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:32.226005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c8983a2e-dbda-4fab-b862-b790ca95db97 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:32.226798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c8983a2e-dbda-4fab-b862-b790ca95db97 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:32.236496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8983a2e-dbda-4fab-b862-b790ca95db97 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:32.237553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8983a2e-dbda-4fab-b862-b790ca95db97 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:32.238674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8983a2e-dbda-4fab-b862-b790ca95db97 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:32.239818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8983a2e-dbda-4fab-b862-b790ca95db97 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:32.240595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8983a2e-dbda-4fab-b862-b790ca95db97 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:32.241120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8983a2e-dbda-4fab-b862-b790ca95db97 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:32.287883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:32.668880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c8983a2e-dbda-4fab-b862-b790ca95db97 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:32.679335 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c8983a2e-dbda-4fab-b862-b790ca95db97 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.459589 Aug 27 04:41:32.681452 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1286/2597] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:32 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:32.694724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-43ed8c47-d16f-4fce-bc40-9eabef407626 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:32.695638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-43ed8c47-d16f-4fce-bc40-9eabef407626 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:32.704290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43ed8c47-d16f-4fce-bc40-9eabef407626 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:32.705049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43ed8c47-d16f-4fce-bc40-9eabef407626 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:32.705652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43ed8c47-d16f-4fce-bc40-9eabef407626 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:32.706554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43ed8c47-d16f-4fce-bc40-9eabef407626 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:32.707231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43ed8c47-d16f-4fce-bc40-9eabef407626 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:32.707813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43ed8c47-d16f-4fce-bc40-9eabef407626 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:32.827674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:41:32.828952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:41:32.829678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:41:32.830298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:41:32.831063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:41:32.847451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-43ed8c47-d16f-4fce-bc40-9eabef407626 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:32.857336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=33 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:32.861612 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-43ed8c47-d16f-4fce-bc40-9eabef407626 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1168 microversion: 2.1 time: 0.178428 Aug 27 04:41:32.862020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:32.862883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:32.903380 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1287/2598] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:32 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1168 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:32.906859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:32.908029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:32.914337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:32.915290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:32.918537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-48fc38a5-9e66-4edd-8651-62ae723f2408 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:32.925944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-48fc38a5-9e66-4edd-8651-62ae723f2408 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:32.953782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48fc38a5-9e66-4edd-8651-62ae723f2408 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:32.954801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=11 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:32.955555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48fc38a5-9e66-4edd-8651-62ae723f2408 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:32.964680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48fc38a5-9e66-4edd-8651-62ae723f2408 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:32.974612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48fc38a5-9e66-4edd-8651-62ae723f2408 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:32.975542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48fc38a5-9e66-4edd-8651-62ae723f2408 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:32.977616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48fc38a5-9e66-4edd-8651-62ae723f2408 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:33.019542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Getting quotas for project 31d3333b4ddd41e2a8afc3a4506894c5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:41:33.036219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Getting quotas for user 180ae8cc1dcc4076ab73bb564b49eba5 and project 31d3333b4ddd41e2a8afc3a4506894c5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:41:33.092542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Going to run 2 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:41:33.095509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:41:33.153603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=3197b6a8-32ef-44cb-b1f3-f23b7a9677c4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:41:33.271325 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da7b3362-5240-4d18-9422-506b254d5204 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.515866 Aug 27 04:41:33.274784 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1312/2599] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:41:31 2022] POST /compute/v2.1/servers => generated 32 bytes in 1518 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 04:41:33.278250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-10833ef2-91b7-4310-ad3d-0f946ad355e4 req-853d13d9-e170-4af2-b206-e19d3f8082a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0d6029-a40b-45b9-b230-2033ec88617e", "name": "network-vif-plugged", "status": "completed", "tag": "54e043d1-9346-4c9a-917b-026289b24400"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:33.292440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10833ef2-91b7-4310-ad3d-0f946ad355e4 req-853d13d9-e170-4af2-b206-e19d3f8082a1 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:33.301747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10833ef2-91b7-4310-ad3d-0f946ad355e4 req-853d13d9-e170-4af2-b206-e19d3f8082a1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:33.302995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10833ef2-91b7-4310-ad3d-0f946ad355e4 req-853d13d9-e170-4af2-b206-e19d3f8082a1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:33.343889 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-10833ef2-91b7-4310-ad3d-0f946ad355e4 req-853d13d9-e170-4af2-b206-e19d3f8082a1 service nova] Creating event network-vif-plugged:54e043d1-9346-4c9a-917b-026289b24400 for instance 0e0d6029-a40b-45b9-b230-2033ec88617e on n-h1-854823-1 Aug 27 04:41:33.349941 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-10833ef2-91b7-4310-ad3d-0f946ad355e4 req-853d13d9-e170-4af2-b206-e19d3f8082a1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076153 Aug 27 04:41:33.352045 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1313/2600] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:33.358141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-912c35c5-128d-4377-88be-a13e8f6758a2 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:33.358931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-912c35c5-128d-4377-88be-a13e8f6758a2 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:33.366529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-912c35c5-128d-4377-88be-a13e8f6758a2 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:33.367195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-912c35c5-128d-4377-88be-a13e8f6758a2 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:33.367783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-912c35c5-128d-4377-88be-a13e8f6758a2 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:33.368651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-912c35c5-128d-4377-88be-a13e8f6758a2 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:33.369206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-912c35c5-128d-4377-88be-a13e8f6758a2 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:33.369700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-912c35c5-128d-4377-88be-a13e8f6758a2 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:33.438077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-48fc38a5-9e66-4edd-8651-62ae723f2408 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:33.448247 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-48fc38a5-9e66-4edd-8651-62ae723f2408 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1324 microversion: 2.1 time: 0.541547 Aug 27 04:41:33.469608 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1288/2601] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:32 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1324 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:33.476686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-acb73dc2-903f-48fe-afd9-2285b85e618e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:33.478842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-acb73dc2-903f-48fe-afd9-2285b85e618e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:33.506989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-acb73dc2-903f-48fe-afd9-2285b85e618e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:33.507988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-acb73dc2-903f-48fe-afd9-2285b85e618e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:33.510273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-acb73dc2-903f-48fe-afd9-2285b85e618e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:33.510273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-acb73dc2-903f-48fe-afd9-2285b85e618e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:33.510444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-acb73dc2-903f-48fe-afd9-2285b85e618e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:33.511253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-acb73dc2-903f-48fe-afd9-2285b85e618e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:33.690726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-acb73dc2-903f-48fe-afd9-2285b85e618e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:33.702701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-acb73dc2-903f-48fe-afd9-2285b85e618e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:33.709924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-acb73dc2-903f-48fe-afd9-2285b85e618e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:33.711187 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-acb73dc2-903f-48fe-afd9-2285b85e618e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1266 microversion: 2.25 time: 0.240319 Aug 27 04:41:33.713027 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1289/2602] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:33 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:33.728956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4b504b49-52df-491d-a473-df727c5db0b6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:33.734574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4b504b49-52df-491d-a473-df727c5db0b6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:33.737820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4b504b49-52df-491d-a473-df727c5db0b6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Searching by: {'deleted': False, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:41:33.778846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b504b49-52df-491d-a473-df727c5db0b6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:33.779542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b504b49-52df-491d-a473-df727c5db0b6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:33.780167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b504b49-52df-491d-a473-df727c5db0b6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:33.783197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b504b49-52df-491d-a473-df727c5db0b6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:33.783900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b504b49-52df-491d-a473-df727c5db0b6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:33.786070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b504b49-52df-491d-a473-df727c5db0b6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:33.842504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-4b504b49-52df-491d-a473-df727c5db0b6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:41:33.991693 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4b504b49-52df-491d-a473-df727c5db0b6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.259115 Aug 27 04:41:33.997645 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1290/2603] 10.222.0.79 () {58 vars in 1125 bytes} [Sat Aug 27 04:41:33 2022] GET /compute/v2.1/servers => generated 1335 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:34.003858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bbd67c2b-2416-450c-87a1-4cf240e2380e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:34.004490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bbd67c2b-2416-450c-87a1-4cf240e2380e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:34.021855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-912c35c5-128d-4377-88be-a13e8f6758a2 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:34.023719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbd67c2b-2416-450c-87a1-4cf240e2380e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:34.027192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbd67c2b-2416-450c-87a1-4cf240e2380e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:34.028213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbd67c2b-2416-450c-87a1-4cf240e2380e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:34.036905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbd67c2b-2416-450c-87a1-4cf240e2380e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:34.037819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbd67c2b-2416-450c-87a1-4cf240e2380e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:34.037943 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-912c35c5-128d-4377-88be-a13e8f6758a2 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1318 microversion: 2.1 time: 0.684103 Aug 27 04:41:34.038483 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1314/2604] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:33 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:34.039006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbd67c2b-2416-450c-87a1-4cf240e2380e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:34.043054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aed63c12-53db-4822-977e-0ca471ccfad7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:34.067924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aed63c12-53db-4822-977e-0ca471ccfad7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:34.082444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aed63c12-53db-4822-977e-0ca471ccfad7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:34.083381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aed63c12-53db-4822-977e-0ca471ccfad7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:34.084709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aed63c12-53db-4822-977e-0ca471ccfad7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:34.087100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aed63c12-53db-4822-977e-0ca471ccfad7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:34.088330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aed63c12-53db-4822-977e-0ca471ccfad7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:34.096908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aed63c12-53db-4822-977e-0ca471ccfad7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:34.489687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bbd67c2b-2416-450c-87a1-4cf240e2380e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:34.526208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aed63c12-53db-4822-977e-0ca471ccfad7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:34.526577 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bbd67c2b-2416-450c-87a1-4cf240e2380e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.526095 Aug 27 04:41:34.527402 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1291/2605] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:33 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:34.539714 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aed63c12-53db-4822-977e-0ca471ccfad7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1210 microversion: 2.1 time: 0.500162 Aug 27 04:41:34.541086 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1315/2606] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:34 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1210 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:34.549310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1f96168a-5ace-49d9-86fa-fc3edc08be03 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:34.550314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1f96168a-5ace-49d9-86fa-fc3edc08be03 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:34.551540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c55bdbc0-fb25-41cd-8848-cde0bb295305 req-0cf6d867-64ba-4ab3-9385-6e91d14d4741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1871fce-ce02-43f5-a460-02f259a72471", "name": "network-vif-deleted", "tag": "36205269-ec1e-4154-aca0-c4d791be2668"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:34.559980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:UPDATE=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:34.580328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c55bdbc0-fb25-41cd-8848-cde0bb295305 req-0cf6d867-64ba-4ab3-9385-6e91d14d4741 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:34.581230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c55bdbc0-fb25-41cd-8848-cde0bb295305 req-0cf6d867-64ba-4ab3-9385-6e91d14d4741 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:34.581911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c55bdbc0-fb25-41cd-8848-cde0bb295305 req-0cf6d867-64ba-4ab3-9385-6e91d14d4741 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:34.606149 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c55bdbc0-fb25-41cd-8848-cde0bb295305 req-0cf6d867-64ba-4ab3-9385-6e91d14d4741 service nova] Creating event network-vif-deleted:36205269-ec1e-4154-aca0-c4d791be2668 for instance a1871fce-ce02-43f5-a460-02f259a72471 on n-h2-854823-1 Aug 27 04:41:34.616766 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c55bdbc0-fb25-41cd-8848-cde0bb295305 req-0cf6d867-64ba-4ab3-9385-6e91d14d4741 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074111 Aug 27 04:41:34.623390 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1316/2607] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:34.635448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85906b98-2240-408d-a4b2-b3941666255e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:34.638190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-85906b98-2240-408d-a4b2-b3941666255e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:34.653912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85906b98-2240-408d-a4b2-b3941666255e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:34.657681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85906b98-2240-408d-a4b2-b3941666255e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:34.658312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85906b98-2240-408d-a4b2-b3941666255e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:34.659166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85906b98-2240-408d-a4b2-b3941666255e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:34.665441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85906b98-2240-408d-a4b2-b3941666255e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:34.666693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85906b98-2240-408d-a4b2-b3941666255e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:34.784254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1f96168a-5ace-49d9-86fa-fc3edc08be03 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:34.793188 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1f96168a-5ace-49d9-86fa-fc3edc08be03 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1218 microversion: 2.1 time: 0.263454 Aug 27 04:41:34.798744 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1292/2608] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:34 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1218 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:34.820986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-33bb628e-0330-48d3-98bc-05424788f46e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:34.823809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-33bb628e-0330-48d3-98bc-05424788f46e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:34.842444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33bb628e-0330-48d3-98bc-05424788f46e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:34.844245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33bb628e-0330-48d3-98bc-05424788f46e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:34.844746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33bb628e-0330-48d3-98bc-05424788f46e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:34.846035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33bb628e-0330-48d3-98bc-05424788f46e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:34.847777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33bb628e-0330-48d3-98bc-05424788f46e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:34.848848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33bb628e-0330-48d3-98bc-05424788f46e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:34.958717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-33bb628e-0330-48d3-98bc-05424788f46e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:34.968660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-33bb628e-0330-48d3-98bc-05424788f46e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:34.970440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-33bb628e-0330-48d3-98bc-05424788f46e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:34.971842 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-33bb628e-0330-48d3-98bc-05424788f46e tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1266 microversion: 2.25 time: 0.164994 Aug 27 04:41:34.972621 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1293/2609] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:34 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:35.060450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c9b93d73-6d5d-43f1-a1fb-626d6d55f99b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:35.061386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c9b93d73-6d5d-43f1-a1fb-626d6d55f99b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:35.070525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9b93d73-6d5d-43f1-a1fb-626d6d55f99b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:35.071460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9b93d73-6d5d-43f1-a1fb-626d6d55f99b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:35.073167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9b93d73-6d5d-43f1-a1fb-626d6d55f99b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:35.073923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9b93d73-6d5d-43f1-a1fb-626d6d55f99b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:35.074519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9b93d73-6d5d-43f1-a1fb-626d6d55f99b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:35.075179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9b93d73-6d5d-43f1-a1fb-626d6d55f99b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:35.158768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-85906b98-2240-408d-a4b2-b3941666255e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:35.192620 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-85906b98-2240-408d-a4b2-b3941666255e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1324 microversion: 2.1 time: 0.567428 Aug 27 04:41:35.193713 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1317/2610] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:34 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1324 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:35.479620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c9b93d73-6d5d-43f1-a1fb-626d6d55f99b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:35.497157 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c9b93d73-6d5d-43f1-a1fb-626d6d55f99b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1318 microversion: 2.1 time: 0.441209 Aug 27 04:41:35.512224 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1294/2611] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:35 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:35.549111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee5d4c96-315a-4b4d-8341-c963f2685b49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:35.549738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee5d4c96-315a-4b4d-8341-c963f2685b49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:35.566391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d2ac1fd7-acc7-4ebc-8584-609eca79ac93 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:35.567987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d2ac1fd7-acc7-4ebc-8584-609eca79ac93 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:35.573784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee5d4c96-315a-4b4d-8341-c963f2685b49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:35.576973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee5d4c96-315a-4b4d-8341-c963f2685b49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:35.579667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2ac1fd7-acc7-4ebc-8584-609eca79ac93 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:35.579993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee5d4c96-315a-4b4d-8341-c963f2685b49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:35.580957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee5d4c96-315a-4b4d-8341-c963f2685b49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:35.581736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2ac1fd7-acc7-4ebc-8584-609eca79ac93 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:35.582383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee5d4c96-315a-4b4d-8341-c963f2685b49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:35.582980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2ac1fd7-acc7-4ebc-8584-609eca79ac93 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:35.583558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee5d4c96-315a-4b4d-8341-c963f2685b49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:35.584556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2ac1fd7-acc7-4ebc-8584-609eca79ac93 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:35.588391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2ac1fd7-acc7-4ebc-8584-609eca79ac93 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:35.589160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2ac1fd7-acc7-4ebc-8584-609eca79ac93 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:35.831429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d2ac1fd7-acc7-4ebc-8584-609eca79ac93 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:35.841688 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d2ac1fd7-acc7-4ebc-8584-609eca79ac93 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1210 microversion: 2.1 time: 0.279557 Aug 27 04:41:35.843303 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1295/2612] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:35 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1210 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:35.855303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c91dd54c-fd6d-4066-bb1b-58c39a6c57bb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:35.856024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee5d4c96-315a-4b4d-8341-c963f2685b49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:35.856334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c91dd54c-fd6d-4066-bb1b-58c39a6c57bb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:35.867216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c91dd54c-fd6d-4066-bb1b-58c39a6c57bb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:35.867890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c91dd54c-fd6d-4066-bb1b-58c39a6c57bb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:35.868036 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee5d4c96-315a-4b4d-8341-c963f2685b49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.324040 Aug 27 04:41:35.868516 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1318/2613] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:35 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:35.869374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c91dd54c-fd6d-4066-bb1b-58c39a6c57bb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:35.870233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c91dd54c-fd6d-4066-bb1b-58c39a6c57bb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:35.870841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c91dd54c-fd6d-4066-bb1b-58c39a6c57bb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:35.871420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c91dd54c-fd6d-4066-bb1b-58c39a6c57bb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:35.973810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c91dd54c-fd6d-4066-bb1b-58c39a6c57bb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:35.989640 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c91dd54c-fd6d-4066-bb1b-58c39a6c57bb tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1222 microversion: 2.1 time: 0.137962 Aug 27 04:41:35.990469 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1296/2614] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:35 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1222 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:36.008646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46923728-dba3-414c-af41-e273d1c308bf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:36.010043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46923728-dba3-414c-af41-e273d1c308bf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:36.022019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46923728-dba3-414c-af41-e273d1c308bf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:36.022722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46923728-dba3-414c-af41-e273d1c308bf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:36.023493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46923728-dba3-414c-af41-e273d1c308bf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:36.024386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46923728-dba3-414c-af41-e273d1c308bf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:36.025042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46923728-dba3-414c-af41-e273d1c308bf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:36.025604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46923728-dba3-414c-af41-e273d1c308bf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:36.095173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46923728-dba3-414c-af41-e273d1c308bf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:36.113040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46923728-dba3-414c-af41-e273d1c308bf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:36.115221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46923728-dba3-414c-af41-e273d1c308bf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:36.116809 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46923728-dba3-414c-af41-e273d1c308bf tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1266 microversion: 2.25 time: 0.112060 Aug 27 04:41:36.117938 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1319/2615] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:36 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:36.214344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d3fbc83-6ccd-459e-9e5a-d24a2c2d220d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:36.214962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9d3fbc83-6ccd-459e-9e5a-d24a2c2d220d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:36.221831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d3fbc83-6ccd-459e-9e5a-d24a2c2d220d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:36.222909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d3fbc83-6ccd-459e-9e5a-d24a2c2d220d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:36.223695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d3fbc83-6ccd-459e-9e5a-d24a2c2d220d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:36.224599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d3fbc83-6ccd-459e-9e5a-d24a2c2d220d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:36.225214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d3fbc83-6ccd-459e-9e5a-d24a2c2d220d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:36.225784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d3fbc83-6ccd-459e-9e5a-d24a2c2d220d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:36.524212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3ae419a8-9e08-418d-92d7-16668a8a5b79 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:36.525568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3ae419a8-9e08-418d-92d7-16668a8a5b79 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:36.526112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9d3fbc83-6ccd-459e-9e5a-d24a2c2d220d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:36.533494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ae419a8-9e08-418d-92d7-16668a8a5b79 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:36.534550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ae419a8-9e08-418d-92d7-16668a8a5b79 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:36.535204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ae419a8-9e08-418d-92d7-16668a8a5b79 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:36.536127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ae419a8-9e08-418d-92d7-16668a8a5b79 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:36.536845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ae419a8-9e08-418d-92d7-16668a8a5b79 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:36.537473 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9d3fbc83-6ccd-459e-9e5a-d24a2c2d220d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1324 microversion: 2.1 time: 0.326940 Aug 27 04:41:36.537698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ae419a8-9e08-418d-92d7-16668a8a5b79 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:36.538089 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1297/2616] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:36 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1324 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:36.693015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-66b28f59-6180-46a1-a35e-9d1261b64cb1 req-11d8faf4-ba46-4482-9731-5c3406d50b0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c1a9e4-475f-4c6a-bf72-653e8fc46611", "tag": "c7badfa4-4c98-4ab6-80be-9df19f2265d3"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:36.706159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-66b28f59-6180-46a1-a35e-9d1261b64cb1 req-11d8faf4-ba46-4482-9731-5c3406d50b0e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:36.707250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-66b28f59-6180-46a1-a35e-9d1261b64cb1 req-11d8faf4-ba46-4482-9731-5c3406d50b0e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:36.708111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-66b28f59-6180-46a1-a35e-9d1261b64cb1 req-11d8faf4-ba46-4482-9731-5c3406d50b0e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:36.722643 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-66b28f59-6180-46a1-a35e-9d1261b64cb1 req-11d8faf4-ba46-4482-9731-5c3406d50b0e service nova] Creating event network-changed:c7badfa4-4c98-4ab6-80be-9df19f2265d3 for instance c3c1a9e4-475f-4c6a-bf72-653e8fc46611 on n-h2-854823-1 Aug 27 04:41:36.733607 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-66b28f59-6180-46a1-a35e-9d1261b64cb1 req-11d8faf4-ba46-4482-9731-5c3406d50b0e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045247 Aug 27 04:41:36.734954 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1298/2617] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:36.790166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3ae419a8-9e08-418d-92d7-16668a8a5b79 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:36.814031 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3ae419a8-9e08-418d-92d7-16668a8a5b79 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1318 microversion: 2.1 time: 0.293616 Aug 27 04:41:36.818991 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1320/2618] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:36 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:36.865320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-713cc9df-184e-4b82-b2b6-5ffbbf4a77d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:36.866239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-713cc9df-184e-4b82-b2b6-5ffbbf4a77d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:36.875477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-713cc9df-184e-4b82-b2b6-5ffbbf4a77d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:36.876853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-713cc9df-184e-4b82-b2b6-5ffbbf4a77d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:36.877629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-713cc9df-184e-4b82-b2b6-5ffbbf4a77d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:36.879547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-713cc9df-184e-4b82-b2b6-5ffbbf4a77d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:36.880417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-713cc9df-184e-4b82-b2b6-5ffbbf4a77d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:36.881240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-713cc9df-184e-4b82-b2b6-5ffbbf4a77d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:36.895843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2869c917-5aed-411f-a043-a52e03ba87b0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:36.897325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2869c917-5aed-411f-a043-a52e03ba87b0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:36.905920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2869c917-5aed-411f-a043-a52e03ba87b0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:36.906680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2869c917-5aed-411f-a043-a52e03ba87b0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:36.907314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2869c917-5aed-411f-a043-a52e03ba87b0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:36.908855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2869c917-5aed-411f-a043-a52e03ba87b0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:36.910876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2869c917-5aed-411f-a043-a52e03ba87b0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:36.912517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2869c917-5aed-411f-a043-a52e03ba87b0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:37.173988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2869c917-5aed-411f-a043-a52e03ba87b0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:37.186762 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2869c917-5aed-411f-a043-a52e03ba87b0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.294792 Aug 27 04:41:37.201460 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1321/2619] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:36 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:37.205789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-713cc9df-184e-4b82-b2b6-5ffbbf4a77d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:37.210079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-087e619e-a654-4efc-b3b4-5dc5052613d6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:37.210622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-087e619e-a654-4efc-b3b4-5dc5052613d6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:37.225305 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-713cc9df-184e-4b82-b2b6-5ffbbf4a77d1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1210 microversion: 2.1 time: 0.361455 Aug 27 04:41:37.227045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-087e619e-a654-4efc-b3b4-5dc5052613d6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:37.227597 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1299/2620] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:36 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1210 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:37.228114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-087e619e-a654-4efc-b3b4-5dc5052613d6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:37.228766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-087e619e-a654-4efc-b3b4-5dc5052613d6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:37.229703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-087e619e-a654-4efc-b3b4-5dc5052613d6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:37.230593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-087e619e-a654-4efc-b3b4-5dc5052613d6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:37.231199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-087e619e-a654-4efc-b3b4-5dc5052613d6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:37.237238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ec5dcabd-ee71-40e1-aa81-3f0a1107451d req-7cbfe4f7-c1ac-4878-94aa-d5a75123a5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3", "name": "network-vif-plugged", "status": "completed", "tag": "06142979-93d1-48a2-a72f-11b13cbb0e03"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:37.262082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ec5dcabd-ee71-40e1-aa81-3f0a1107451d req-7cbfe4f7-c1ac-4878-94aa-d5a75123a5fc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:37.265905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ec5dcabd-ee71-40e1-aa81-3f0a1107451d req-7cbfe4f7-c1ac-4878-94aa-d5a75123a5fc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:37.266517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ec5dcabd-ee71-40e1-aa81-3f0a1107451d req-7cbfe4f7-c1ac-4878-94aa-d5a75123a5fc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:37.298970 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ec5dcabd-ee71-40e1-aa81-3f0a1107451d req-7cbfe4f7-c1ac-4878-94aa-d5a75123a5fc service nova] Creating event network-vif-plugged:06142979-93d1-48a2-a72f-11b13cbb0e03 for instance 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 on n-h1-854823-1 Aug 27 04:41:37.304176 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ec5dcabd-ee71-40e1-aa81-3f0a1107451d req-7cbfe4f7-c1ac-4878-94aa-d5a75123a5fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074995 Aug 27 04:41:37.304827 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1300/2621] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:37.310144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ab4399af-065e-44f2-8161-4a0b4ed1ef46 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:37.318831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ab4399af-065e-44f2-8161-4a0b4ed1ef46 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:37.333361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab4399af-065e-44f2-8161-4a0b4ed1ef46 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:37.339831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab4399af-065e-44f2-8161-4a0b4ed1ef46 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:37.340466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab4399af-065e-44f2-8161-4a0b4ed1ef46 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:37.341400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab4399af-065e-44f2-8161-4a0b4ed1ef46 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:37.342017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab4399af-065e-44f2-8161-4a0b4ed1ef46 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:37.342167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-087e619e-a654-4efc-b3b4-5dc5052613d6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:37.342912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab4399af-065e-44f2-8161-4a0b4ed1ef46 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:37.355152 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-087e619e-a654-4efc-b3b4-5dc5052613d6 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1222 microversion: 2.1 time: 0.151430 Aug 27 04:41:37.356026 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1322/2622] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:37 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1222 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:37.460893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ab4399af-065e-44f2-8161-4a0b4ed1ef46 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:37.481756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ab4399af-065e-44f2-8161-4a0b4ed1ef46 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:37.488667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ab4399af-065e-44f2-8161-4a0b4ed1ef46 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:37.494874 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ab4399af-065e-44f2-8161-4a0b4ed1ef46 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1266 microversion: 2.25 time: 0.188624 Aug 27 04:41:37.495515 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1301/2623] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:37 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:37.559970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bb2a1562-7b2d-4c10-9fd6-7085d87d1613 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:37.560772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bb2a1562-7b2d-4c10-9fd6-7085d87d1613 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:37.573211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb2a1562-7b2d-4c10-9fd6-7085d87d1613 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:37.574253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb2a1562-7b2d-4c10-9fd6-7085d87d1613 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:37.574815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb2a1562-7b2d-4c10-9fd6-7085d87d1613 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:37.575660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb2a1562-7b2d-4c10-9fd6-7085d87d1613 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:37.580108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb2a1562-7b2d-4c10-9fd6-7085d87d1613 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:37.580697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb2a1562-7b2d-4c10-9fd6-7085d87d1613 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:37.839790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-85517b3a-a9b0-4996-a92a-a323f8d97a3b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:37.840414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-85517b3a-a9b0-4996-a92a-a323f8d97a3b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:37.850392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85517b3a-a9b0-4996-a92a-a323f8d97a3b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:37.851202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85517b3a-a9b0-4996-a92a-a323f8d97a3b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:37.851875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85517b3a-a9b0-4996-a92a-a323f8d97a3b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:37.852851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85517b3a-a9b0-4996-a92a-a323f8d97a3b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:37.854196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85517b3a-a9b0-4996-a92a-a323f8d97a3b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:37.854978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85517b3a-a9b0-4996-a92a-a323f8d97a3b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:37.902033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bb2a1562-7b2d-4c10-9fd6-7085d87d1613 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:37.914336 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bb2a1562-7b2d-4c10-9fd6-7085d87d1613 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1324 microversion: 2.1 time: 0.356337 Aug 27 04:41:37.930524 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1323/2624] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:37 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1324 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:38.172759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-85517b3a-a9b0-4996-a92a-a323f8d97a3b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:38.178092 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-85517b3a-a9b0-4996-a92a-a323f8d97a3b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1318 microversion: 2.1 time: 0.341974 Aug 27 04:41:38.179087 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1302/2625] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:37 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:38.217330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18ddf7cc-feba-4d64-ab8d-93eab776053b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:38.218165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18ddf7cc-feba-4d64-ab8d-93eab776053b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:38.226857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ddf7cc-feba-4d64-ab8d-93eab776053b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:38.227485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ddf7cc-feba-4d64-ab8d-93eab776053b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:38.228220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ddf7cc-feba-4d64-ab8d-93eab776053b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:38.229316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ddf7cc-feba-4d64-ab8d-93eab776053b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:38.230145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ddf7cc-feba-4d64-ab8d-93eab776053b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:38.230847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ddf7cc-feba-4d64-ab8d-93eab776053b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:38.256209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-03bc554e-d52c-44de-8be6-5e2dc22d5b7b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:38.257038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-03bc554e-d52c-44de-8be6-5e2dc22d5b7b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:38.267208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03bc554e-d52c-44de-8be6-5e2dc22d5b7b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:38.269518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03bc554e-d52c-44de-8be6-5e2dc22d5b7b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:38.273088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03bc554e-d52c-44de-8be6-5e2dc22d5b7b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:38.273992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03bc554e-d52c-44de-8be6-5e2dc22d5b7b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:38.274576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03bc554e-d52c-44de-8be6-5e2dc22d5b7b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:38.275888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03bc554e-d52c-44de-8be6-5e2dc22d5b7b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:38.625567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-03bc554e-d52c-44de-8be6-5e2dc22d5b7b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:38.636038 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-03bc554e-d52c-44de-8be6-5e2dc22d5b7b tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1210 microversion: 2.1 time: 0.383586 Aug 27 04:41:38.652168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18ddf7cc-feba-4d64-ab8d-93eab776053b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:38.653411 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1303/2626] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:38 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1210 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:38.658784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a2598f1-981a-46a9-905b-a10c377bfe0f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:38.659726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a2598f1-981a-46a9-905b-a10c377bfe0f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:38.662657 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18ddf7cc-feba-4d64-ab8d-93eab776053b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.452543 Aug 27 04:41:38.664824 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1324/2627] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:38 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:38.667379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a2598f1-981a-46a9-905b-a10c377bfe0f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:38.668359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a2598f1-981a-46a9-905b-a10c377bfe0f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:38.668996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a2598f1-981a-46a9-905b-a10c377bfe0f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:38.669870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a2598f1-981a-46a9-905b-a10c377bfe0f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:38.670606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a2598f1-981a-46a9-905b-a10c377bfe0f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:38.671190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a2598f1-981a-46a9-905b-a10c377bfe0f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:38.679922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9491e433-5e35-4a9d-8ad6-329c45af225a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:38.683035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9491e433-5e35-4a9d-8ad6-329c45af225a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:38.696310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9491e433-5e35-4a9d-8ad6-329c45af225a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:38.699074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9491e433-5e35-4a9d-8ad6-329c45af225a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:38.699594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9491e433-5e35-4a9d-8ad6-329c45af225a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:38.700393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9491e433-5e35-4a9d-8ad6-329c45af225a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:38.704430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9491e433-5e35-4a9d-8ad6-329c45af225a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:38.704992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9491e433-5e35-4a9d-8ad6-329c45af225a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:38.778829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6a2598f1-981a-46a9-905b-a10c377bfe0f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:38.791714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:38.795456 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a2598f1-981a-46a9-905b-a10c377bfe0f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1270 microversion: 2.1 time: 0.140262 Aug 27 04:41:38.796897 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1304/2628] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:38 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1270 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:38.837920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9491e433-5e35-4a9d-8ad6-329c45af225a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:38.849943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9491e433-5e35-4a9d-8ad6-329c45af225a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:38.851811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9491e433-5e35-4a9d-8ad6-329c45af225a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:38.853408 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9491e433-5e35-4a9d-8ad6-329c45af225a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1266 microversion: 2.25 time: 0.186243 Aug 27 04:41:38.854506 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1325/2629] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:38 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:38.938273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-557017a9-d9e4-49e6-93d0-ad80889d3d59 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:38.938897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-557017a9-d9e4-49e6-93d0-ad80889d3d59 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:38.946074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-557017a9-d9e4-49e6-93d0-ad80889d3d59 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:38.947452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-557017a9-d9e4-49e6-93d0-ad80889d3d59 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:38.947920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-557017a9-d9e4-49e6-93d0-ad80889d3d59 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:38.948842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-557017a9-d9e4-49e6-93d0-ad80889d3d59 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:38.949317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-557017a9-d9e4-49e6-93d0-ad80889d3d59 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:38.949748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-557017a9-d9e4-49e6-93d0-ad80889d3d59 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:39.199784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ee04278-341d-4fdd-a7c3-3e66f5d3a247 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:39.200854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ee04278-341d-4fdd-a7c3-3e66f5d3a247 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:39.217764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ee04278-341d-4fdd-a7c3-3e66f5d3a247 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:39.218526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ee04278-341d-4fdd-a7c3-3e66f5d3a247 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:39.219150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ee04278-341d-4fdd-a7c3-3e66f5d3a247 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:39.220302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ee04278-341d-4fdd-a7c3-3e66f5d3a247 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:39.221110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ee04278-341d-4fdd-a7c3-3e66f5d3a247 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:39.221944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ee04278-341d-4fdd-a7c3-3e66f5d3a247 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:39.461103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4ee04278-341d-4fdd-a7c3-3e66f5d3a247 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:39.470730 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ee04278-341d-4fdd-a7c3-3e66f5d3a247 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1318 microversion: 2.1 time: 0.275136 Aug 27 04:41:39.486504 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1326/2630] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:39 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:39.661605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75e90b17-1f46-4036-8344-ec7af7eb6313 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:39.663035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75e90b17-1f46-4036-8344-ec7af7eb6313 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:39.678054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e90b17-1f46-4036-8344-ec7af7eb6313 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:39.679216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e90b17-1f46-4036-8344-ec7af7eb6313 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:39.681984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e90b17-1f46-4036-8344-ec7af7eb6313 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:39.683408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e90b17-1f46-4036-8344-ec7af7eb6313 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:39.685382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e90b17-1f46-4036-8344-ec7af7eb6313 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:39.686432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e90b17-1f46-4036-8344-ec7af7eb6313 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:39.824635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-557017a9-d9e4-49e6-93d0-ad80889d3d59 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:39.842173 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-557017a9-d9e4-49e6-93d0-ad80889d3d59 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1324 microversion: 2.1 time: 0.908174 Aug 27 04:41:39.843037 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1305/2631] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:38 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1324 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:39.847911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f1c1f5f6-1149-4702-9a65-12eab6a1a927 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:39.848792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f1c1f5f6-1149-4702-9a65-12eab6a1a927 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:39.860437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1c1f5f6-1149-4702-9a65-12eab6a1a927 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:39.870128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1c1f5f6-1149-4702-9a65-12eab6a1a927 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:39.870755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1c1f5f6-1149-4702-9a65-12eab6a1a927 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:39.871687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1c1f5f6-1149-4702-9a65-12eab6a1a927 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:39.873890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1c1f5f6-1149-4702-9a65-12eab6a1a927 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:39.873890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1c1f5f6-1149-4702-9a65-12eab6a1a927 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:39.895858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75e90b17-1f46-4036-8344-ec7af7eb6313 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:39.904900 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75e90b17-1f46-4036-8344-ec7af7eb6313 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1210 microversion: 2.1 time: 0.249099 Aug 27 04:41:39.908388 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1327/2632] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:39 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1210 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:39.913353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e59e983e-1e34-469c-94aa-a6d40e1c8d5a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:39.919221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e59e983e-1e34-469c-94aa-a6d40e1c8d5a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:39.939598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e59e983e-1e34-469c-94aa-a6d40e1c8d5a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:39.940097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e59e983e-1e34-469c-94aa-a6d40e1c8d5a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:39.941426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e59e983e-1e34-469c-94aa-a6d40e1c8d5a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:39.942417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e59e983e-1e34-469c-94aa-a6d40e1c8d5a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:39.943074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e59e983e-1e34-469c-94aa-a6d40e1c8d5a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:39.943674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e59e983e-1e34-469c-94aa-a6d40e1c8d5a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:40.029588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e59e983e-1e34-469c-94aa-a6d40e1c8d5a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:40.047622 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e59e983e-1e34-469c-94aa-a6d40e1c8d5a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1270 microversion: 2.1 time: 0.137941 Aug 27 04:41:40.048228 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1328/2633] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:39 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:40.059416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f30573f-7d59-4ed3-bcc3-ede6ad5dcdca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:40.061895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f30573f-7d59-4ed3-bcc3-ede6ad5dcdca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:40.068896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f30573f-7d59-4ed3-bcc3-ede6ad5dcdca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:40.069625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f30573f-7d59-4ed3-bcc3-ede6ad5dcdca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:40.070259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f30573f-7d59-4ed3-bcc3-ede6ad5dcdca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:40.071153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f30573f-7d59-4ed3-bcc3-ede6ad5dcdca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:40.072700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f30573f-7d59-4ed3-bcc3-ede6ad5dcdca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:40.073301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f30573f-7d59-4ed3-bcc3-ede6ad5dcdca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:40.153271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8f30573f-7d59-4ed3-bcc3-ede6ad5dcdca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:40.164809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8f30573f-7d59-4ed3-bcc3-ede6ad5dcdca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:40.171868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8f30573f-7d59-4ed3-bcc3-ede6ad5dcdca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:40.176049 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f30573f-7d59-4ed3-bcc3-ede6ad5dcdca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1266 microversion: 2.25 time: 0.120448 Aug 27 04:41:40.176815 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1329/2634] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:40 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:40.283543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f1c1f5f6-1149-4702-9a65-12eab6a1a927 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:40.292912 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f1c1f5f6-1149-4702-9a65-12eab6a1a927 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.448647 Aug 27 04:41:40.293513 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1306/2635] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:39 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:40.493257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2e8c575-6303-4f12-8e9f-e930c35f1c4b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:40.494746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2e8c575-6303-4f12-8e9f-e930c35f1c4b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:40.503788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2e8c575-6303-4f12-8e9f-e930c35f1c4b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:40.504903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2e8c575-6303-4f12-8e9f-e930c35f1c4b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:40.505549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2e8c575-6303-4f12-8e9f-e930c35f1c4b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:40.546178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2e8c575-6303-4f12-8e9f-e930c35f1c4b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:40.547970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2e8c575-6303-4f12-8e9f-e930c35f1c4b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:40.548735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2e8c575-6303-4f12-8e9f-e930c35f1c4b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:40.583926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:40.660411 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:41:40.660801 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 04:41:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 (ip 10.222.0.79) !!! Aug 27 04:41:40.670931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a5374831-9697-470b-8a1f-9bbd1a8813b1 req-dce68728-6446-4de5-96b9-ef780316ca2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24504b35-3a86-47cf-9dd6-3e119044d628", "name": "network-vif-deleted", "tag": "003f92bc-20c3-401e-b6aa-031d76d7988a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:40.708296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a5374831-9697-470b-8a1f-9bbd1a8813b1 req-dce68728-6446-4de5-96b9-ef780316ca2c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:40.709140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a5374831-9697-470b-8a1f-9bbd1a8813b1 req-dce68728-6446-4de5-96b9-ef780316ca2c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:40.709842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a5374831-9697-470b-8a1f-9bbd1a8813b1 req-dce68728-6446-4de5-96b9-ef780316ca2c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:40.751382 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a5374831-9697-470b-8a1f-9bbd1a8813b1 req-dce68728-6446-4de5-96b9-ef780316ca2c service nova] Creating event network-vif-deleted:003f92bc-20c3-401e-b6aa-031d76d7988a for instance 24504b35-3a86-47cf-9dd6-3e119044d628 on n-h1-854823-1 Aug 27 04:41:40.757945 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a5374831-9697-470b-8a1f-9bbd1a8813b1 req-dce68728-6446-4de5-96b9-ef780316ca2c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091079 Aug 27 04:41:40.772897 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1307/2636] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:41:40.865688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-62445f17-93fa-4db3-aa9b-cf581e4c2e6f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:40.866640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-62445f17-93fa-4db3-aa9b-cf581e4c2e6f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:40.897462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62445f17-93fa-4db3-aa9b-cf581e4c2e6f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:40.901169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62445f17-93fa-4db3-aa9b-cf581e4c2e6f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:40.903258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62445f17-93fa-4db3-aa9b-cf581e4c2e6f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:40.905087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62445f17-93fa-4db3-aa9b-cf581e4c2e6f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:40.909294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62445f17-93fa-4db3-aa9b-cf581e4c2e6f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:40.912563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62445f17-93fa-4db3-aa9b-cf581e4c2e6f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:40.923884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2e8c575-6303-4f12-8e9f-e930c35f1c4b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:40.934063 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2e8c575-6303-4f12-8e9f-e930c35f1c4b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1318 microversion: 2.1 time: 0.445858 Aug 27 04:41:40.939629 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1330/2637] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:40 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:40.958963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f4464549-b0f7-46f3-99fd-61509ccc79f1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:40.959943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f4464549-b0f7-46f3-99fd-61509ccc79f1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:40.972473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4464549-b0f7-46f3-99fd-61509ccc79f1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:40.975585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4464549-b0f7-46f3-99fd-61509ccc79f1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:40.978932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4464549-b0f7-46f3-99fd-61509ccc79f1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:40.980060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4464549-b0f7-46f3-99fd-61509ccc79f1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:40.980887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4464549-b0f7-46f3-99fd-61509ccc79f1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:40.981512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4464549-b0f7-46f3-99fd-61509ccc79f1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:41.241617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-62445f17-93fa-4db3-aa9b-cf581e4c2e6f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:41.250160 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-62445f17-93fa-4db3-aa9b-cf581e4c2e6f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1324 microversion: 2.1 time: 0.389079 Aug 27 04:41:41.256298 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1308/2638] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:40 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:41.286744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fa956495-438f-4236-a099-45d5290746d1 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:41.288363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fa956495-438f-4236-a099-45d5290746d1 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:41.319689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa956495-438f-4236-a099-45d5290746d1 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:41.320456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa956495-438f-4236-a099-45d5290746d1 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:41.321629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa956495-438f-4236-a099-45d5290746d1 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:41.322583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa956495-438f-4236-a099-45d5290746d1 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:41.325297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa956495-438f-4236-a099-45d5290746d1 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:41.325922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa956495-438f-4236-a099-45d5290746d1 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:41.413301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f4464549-b0f7-46f3-99fd-61509ccc79f1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:41.434519 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f4464549-b0f7-46f3-99fd-61509ccc79f1 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1210 microversion: 2.1 time: 0.493469 Aug 27 04:41:41.439920 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1331/2639] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:40 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1210 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:41.453137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:41.456983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:41.480736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:41.482556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:41.483694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:41.485627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:41.487003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:41.489155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:41.574459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:41.577137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:41.577596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:41.578673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lazy-loading 'fault' on Instance uuid 6d59b3ef-e433-480b-9183-d020c885ce4d {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:41:41.688918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fa956495-438f-4236-a099-45d5290746d1 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:41.703879 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fa956495-438f-4236-a099-45d5290746d1 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1278 microversion: 2.1 time: 0.446146 Aug 27 04:41:41.709609 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1309/2640] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:41 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1278 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:41.728494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3845622f-30d0-47c9-887e-088c74106596 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:41.735597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3845622f-30d0-47c9-887e-088c74106596 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:41.774493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3845622f-30d0-47c9-887e-088c74106596 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:41.777310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3845622f-30d0-47c9-887e-088c74106596 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:41.787957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3845622f-30d0-47c9-887e-088c74106596 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:41.789069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3845622f-30d0-47c9-887e-088c74106596 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:41.790092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3845622f-30d0-47c9-887e-088c74106596 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:41.793322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3845622f-30d0-47c9-887e-088c74106596 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:42.143497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3845622f-30d0-47c9-887e-088c74106596 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:42.155636 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3845622f-30d0-47c9-887e-088c74106596 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.444847 Aug 27 04:41:42.159787 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1310/2641] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:41 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:42.178383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-652cf9e7-02ed-4ac5-b828-851da8ff0c04 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:42.179606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-652cf9e7-02ed-4ac5-b828-851da8ff0c04 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:42.201983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-652cf9e7-02ed-4ac5-b828-851da8ff0c04 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:42.202774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-652cf9e7-02ed-4ac5-b828-851da8ff0c04 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:42.203326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-652cf9e7-02ed-4ac5-b828-851da8ff0c04 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:42.204155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-652cf9e7-02ed-4ac5-b828-851da8ff0c04 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:42.204766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-652cf9e7-02ed-4ac5-b828-851da8ff0c04 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:42.205316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-652cf9e7-02ed-4ac5-b828-851da8ff0c04 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:42.211397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:42.223179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:42.229265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:42.230800 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52a474ec-5fc8-477e-ac20-3f16d4eed2fb tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 200 len: 1194 microversion: 2.25 time: 0.788893 Aug 27 04:41:42.234494 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1332/2642] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:41 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 1194 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:42.275323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1780c95-b556-4c16-88f7-19edd773f019 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:42.275960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1780c95-b556-4c16-88f7-19edd773f019 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:42.298402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1780c95-b556-4c16-88f7-19edd773f019 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:42.298911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1780c95-b556-4c16-88f7-19edd773f019 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:42.299359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1780c95-b556-4c16-88f7-19edd773f019 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:42.300083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1780c95-b556-4c16-88f7-19edd773f019 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:42.300562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1780c95-b556-4c16-88f7-19edd773f019 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:42.301002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1780c95-b556-4c16-88f7-19edd773f019 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:42.497739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-652cf9e7-02ed-4ac5-b828-851da8ff0c04 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:42.512849 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-652cf9e7-02ed-4ac5-b828-851da8ff0c04 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1468 microversion: 2.1 time: 0.348102 Aug 27 04:41:42.532718 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1311/2643] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:42 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1468 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:42.551602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-94b883e0-39e1-44c9-8757-99948920c3b3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:42.552319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-94b883e0-39e1-44c9-8757-99948920c3b3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:42.566476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94b883e0-39e1-44c9-8757-99948920c3b3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:42.568441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94b883e0-39e1-44c9-8757-99948920c3b3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:42.575560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94b883e0-39e1-44c9-8757-99948920c3b3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:42.576455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94b883e0-39e1-44c9-8757-99948920c3b3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:42.577051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94b883e0-39e1-44c9-8757-99948920c3b3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:42.578529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94b883e0-39e1-44c9-8757-99948920c3b3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:42.728775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1780c95-b556-4c16-88f7-19edd773f019 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:42.741932 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1780c95-b556-4c16-88f7-19edd773f019 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1324 microversion: 2.1 time: 0.469910 Aug 27 04:41:42.744430 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1333/2644] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:42 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1324 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:42.757670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe826aee-2f52-458d-be2d-1a6ab499244f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:42.758157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe826aee-2f52-458d-be2d-1a6ab499244f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 0e0d6029-a40b-45b9-b230-2033ec88617e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:42.783720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe826aee-2f52-458d-be2d-1a6ab499244f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:42.784237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe826aee-2f52-458d-be2d-1a6ab499244f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:42.784729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe826aee-2f52-458d-be2d-1a6ab499244f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:42.785444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe826aee-2f52-458d-be2d-1a6ab499244f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:42.785923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe826aee-2f52-458d-be2d-1a6ab499244f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:42.786340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe826aee-2f52-458d-be2d-1a6ab499244f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:42.985981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:43.055160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe826aee-2f52-458d-be2d-1a6ab499244f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:43.081441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=5 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:43.088855 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe826aee-2f52-458d-be2d-1a6ab499244f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e" status: 200 len: 1468 microversion: 2.1 time: 0.341340 Aug 27 04:41:43.090261 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1334/2645] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:42 2022] GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e => generated 1468 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:43.096788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-16419267-527c-4cb3-9753-85058eeac2c7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:43.097729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-16419267-527c-4cb3-9753-85058eeac2c7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:43.106869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16419267-527c-4cb3-9753-85058eeac2c7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:43.108484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16419267-527c-4cb3-9753-85058eeac2c7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:43.109272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16419267-527c-4cb3-9753-85058eeac2c7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:43.110831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16419267-527c-4cb3-9753-85058eeac2c7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:43.111502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16419267-527c-4cb3-9753-85058eeac2c7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:43.112169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16419267-527c-4cb3-9753-85058eeac2c7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:43.204930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-94b883e0-39e1-44c9-8757-99948920c3b3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:43.218175 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-94b883e0-39e1-44c9-8757-99948920c3b3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1210 microversion: 2.1 time: 0.681129 Aug 27 04:41:43.238006 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1312/2646] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:42 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1210 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:43.251634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aa2fc4f3-15e6-4e31-9c83-5af399e0727f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1721261246"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:43.254278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aa2fc4f3-15e6-4e31-9c83-5af399e0727f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 0e0d6029-a40b-45b9-b230-2033ec88617e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:43.277365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa2fc4f3-15e6-4e31-9c83-5af399e0727f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:43.278073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa2fc4f3-15e6-4e31-9c83-5af399e0727f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:43.278665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa2fc4f3-15e6-4e31-9c83-5af399e0727f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:43.279533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa2fc4f3-15e6-4e31-9c83-5af399e0727f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:43.281588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa2fc4f3-15e6-4e31-9c83-5af399e0727f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:43.282196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa2fc4f3-15e6-4e31-9c83-5af399e0727f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:43.406127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-16419267-527c-4cb3-9753-85058eeac2c7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:43.414333 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-16419267-527c-4cb3-9753-85058eeac2c7 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1318 microversion: 2.1 time: 0.322356 Aug 27 04:41:43.414936 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1335/2647] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:43 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:43.423569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6261a210-4970-43aa-9fa6-206cff0010f6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:43.424193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6261a210-4970-43aa-9fa6-206cff0010f6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:43.437538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6261a210-4970-43aa-9fa6-206cff0010f6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:43.438279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6261a210-4970-43aa-9fa6-206cff0010f6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:43.438945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6261a210-4970-43aa-9fa6-206cff0010f6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:43.440993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6261a210-4970-43aa-9fa6-206cff0010f6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:43.441948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6261a210-4970-43aa-9fa6-206cff0010f6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:43.442639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6261a210-4970-43aa-9fa6-206cff0010f6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:43.701031 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aa2fc4f3-15e6-4e31-9c83-5af399e0727f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "POST /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e/action" status: 202 len: 0 microversion: 2.1 time: 0.460184 Aug 27 04:41:43.705142 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1313/2648] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:41:43 2022] POST /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:41:43.711368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6261a210-4970-43aa-9fa6-206cff0010f6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:43.720520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef3b2fed-1d98-4672-84ce-09854e8ce8c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:43.723063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ef3b2fed-1d98-4672-84ce-09854e8ce8c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 6d59b3ef-e433-480b-9183-d020c885ce4d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:43.723515 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6261a210-4970-43aa-9fa6-206cff0010f6 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.307510 Aug 27 04:41:43.732940 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1336/2649] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:43 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:43.735981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:43.739205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a79e407-0559-4e89-a5ce-6ed704d2f293 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21813430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:43.744252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef3b2fed-1d98-4672-84ce-09854e8ce8c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:43.745120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef3b2fed-1d98-4672-84ce-09854e8ce8c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:43.746621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef3b2fed-1d98-4672-84ce-09854e8ce8c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:43.748318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef3b2fed-1d98-4672-84ce-09854e8ce8c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:43.748957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef3b2fed-1d98-4672-84ce-09854e8ce8c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:43.749593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef3b2fed-1d98-4672-84ce-09854e8ce8c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:43.774933 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-ef3b2fed-1d98-4672-84ce-09854e8ce8c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] HTTP exception thrown: Instance 6d59b3ef-e433-480b-9183-d020c885ce4d could not be found. Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef3b2fed-1d98-4672-84ce-09854e8ce8c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Request method failure captured: Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d HTTP/1.1 Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ6kU1BsVnQt_zRKICUC7ruDaiNUqIGtFnVSGvnisX4tJZH290wng_sg4R_OQ3pLxBfwcJUWL076bQIFvkpyAmLUnZPhm65I39UrLlta392dZ8xnek4ChpZ_zueUdLpU4LTERpikeRJp50XLG6D7Rigg7KCsXQPWGN87EreaUvtZup4 Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 002ba94e9b364c3e8784927de5770ed1 Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1027428516 Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1027428516 Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 002ba94e9b364c3e8784927de5770ed1 Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1027428516 Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-LiveAutoBlockMigrationV225Test-1027428516-project Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 1d3d23499c474adaa7fe3a2260f5ec36 Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1027428516-project Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 6d59b3ef-e433-480b-9183-d020c885ce4d could not be found. Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '6d59b3ef-e433-480b-9183-d020c885ce4d'} Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d59b3ef-e433-480b-9183-d020c885ce4d could not be found. Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d59b3ef-e433-480b-9183-d020c885ce4d could not be found. Aug 27 04:41:43.776947 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:41:43.780765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:41:43.780765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:41:43.780765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:41:43.780765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:41:43.780765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:41:43.780765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:41:43.780765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:41:43.780765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d59b3ef-e433-480b-9183-d020c885ce4d could not be found. Aug 27 04:41:43.780765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:41:43.784964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef3b2fed-1d98-4672-84ce-09854e8ce8c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Returning 404 to user: Instance 6d59b3ef-e433-480b-9183-d020c885ce4d could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:41:43.786033 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ef3b2fed-1d98-4672-84ce-09854e8ce8c4 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d" status: 404 len: 111 microversion: 2.25 time: 0.077646 Aug 27 04:41:43.787088 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1314/2650] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:43 2022] GET /compute/v2.1/servers/6d59b3ef-e433-480b-9183-d020c885ce4d => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:41:43.793656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-992c74dd-8a81-468e-ad2a-ba7522176ff7 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:43.795979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-992c74dd-8a81-468e-ad2a-ba7522176ff7 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:43.814224 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5a79e407-0559-4e89-a5ce-6ed704d2f293 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1455 microversion: 2.1 time: 0.079870 Aug 27 04:41:43.815891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-992c74dd-8a81-468e-ad2a-ba7522176ff7 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:43.818410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-992c74dd-8a81-468e-ad2a-ba7522176ff7 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:43.819050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-992c74dd-8a81-468e-ad2a-ba7522176ff7 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:43.819547 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1337/2651] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:43 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:43.821191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-992c74dd-8a81-468e-ad2a-ba7522176ff7 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:43.823575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-992c74dd-8a81-468e-ad2a-ba7522176ff7 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:43.824759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-992c74dd-8a81-468e-ad2a-ba7522176ff7 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:43.827279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:44.138967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-13dba014-f3c9-4d12-a7e1-cebb256b66c0 req-aacd8d48-1d7b-4771-a517-06a5078cea39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629128a5-55ce-4184-8821-6dede5fd0081", "name": "network-vif-plugged", "status": "completed", "tag": "1def81ec-2b40-44c8-a429-c0786309e355"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:44.154491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-13dba014-f3c9-4d12-a7e1-cebb256b66c0 req-aacd8d48-1d7b-4771-a517-06a5078cea39 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:44.155086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-13dba014-f3c9-4d12-a7e1-cebb256b66c0 req-aacd8d48-1d7b-4771-a517-06a5078cea39 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:44.155638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-13dba014-f3c9-4d12-a7e1-cebb256b66c0 req-aacd8d48-1d7b-4771-a517-06a5078cea39 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:44.168281 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-13dba014-f3c9-4d12-a7e1-cebb256b66c0 req-aacd8d48-1d7b-4771-a517-06a5078cea39 service nova] Creating event network-vif-plugged:1def81ec-2b40-44c8-a429-c0786309e355 for instance 629128a5-55ce-4184-8821-6dede5fd0081 on n-h1-854823-1 Aug 27 04:41:44.173617 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-13dba014-f3c9-4d12-a7e1-cebb256b66c0 req-aacd8d48-1d7b-4771-a517-06a5078cea39 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038892 Aug 27 04:41:44.176669 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1338/2652] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:41:44.246399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6ffa746-89c2-411b-9299-0f0eb019a703 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:44.247373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6ffa746-89c2-411b-9299-0f0eb019a703 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:44.258029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6ffa746-89c2-411b-9299-0f0eb019a703 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:44.283506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6ffa746-89c2-411b-9299-0f0eb019a703 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:44.284191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6ffa746-89c2-411b-9299-0f0eb019a703 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:44.287819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6ffa746-89c2-411b-9299-0f0eb019a703 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:44.288507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6ffa746-89c2-411b-9299-0f0eb019a703 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:44.290228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6ffa746-89c2-411b-9299-0f0eb019a703 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:44.645516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d6ffa746-89c2-411b-9299-0f0eb019a703 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:44.657289 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6ffa746-89c2-411b-9299-0f0eb019a703 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1210 microversion: 2.1 time: 0.415673 Aug 27 04:41:44.657823 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1339/2653] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:44 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1210 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:44.662943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bda85e80-7d29-451d-9e11-86a52f87592a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:44.669084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bda85e80-7d29-451d-9e11-86a52f87592a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:44.678997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bda85e80-7d29-451d-9e11-86a52f87592a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:44.679749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bda85e80-7d29-451d-9e11-86a52f87592a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:44.680375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bda85e80-7d29-451d-9e11-86a52f87592a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:44.681219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-992c74dd-8a81-468e-ad2a-ba7522176ff7 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:44.682514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bda85e80-7d29-451d-9e11-86a52f87592a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:44.683141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bda85e80-7d29-451d-9e11-86a52f87592a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:44.683723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bda85e80-7d29-451d-9e11-86a52f87592a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:44.704064 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-992c74dd-8a81-468e-ad2a-ba7522176ff7 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1324 microversion: 2.1 time: 0.913860 Aug 27 04:41:44.708050 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1315/2654] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:43 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1324 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:44.749287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a8fecfab-c172-411b-937c-9caa2b2cf6d3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:44.749955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a8fecfab-c172-411b-937c-9caa2b2cf6d3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:44.766628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8fecfab-c172-411b-937c-9caa2b2cf6d3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:44.768201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8fecfab-c172-411b-937c-9caa2b2cf6d3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:44.769027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8fecfab-c172-411b-937c-9caa2b2cf6d3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:44.770297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8fecfab-c172-411b-937c-9caa2b2cf6d3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:44.771203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8fecfab-c172-411b-937c-9caa2b2cf6d3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:44.771855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8fecfab-c172-411b-937c-9caa2b2cf6d3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:44.804509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:44.984288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a8fecfab-c172-411b-937c-9caa2b2cf6d3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:44.998487 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a8fecfab-c172-411b-937c-9caa2b2cf6d3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.253528 Aug 27 04:41:45.000069 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1316/2655] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:44 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:45.007152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-f8302170-b87f-4135-9f84-eeb8e012434d req-a3721c33-88a9-4a26-b0cd-05fbe8c489d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3197b6a8-32ef-44cb-b1f3-f23b7a9677c4", "tag": "2f365edb-1055-4c11-b711-9765715d2b9d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:45.035680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bda85e80-7d29-451d-9e11-86a52f87592a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:45.066083 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bda85e80-7d29-451d-9e11-86a52f87592a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1318 microversion: 2.1 time: 0.406691 Aug 27 04:41:45.067154 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1340/2656] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:44 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:45.072911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-145bcc87-1eac-46a6-ad14-cb67fc616efb tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f2199ff70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:45.095908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f8302170-b87f-4135-9f84-eeb8e012434d req-a3721c33-88a9-4a26-b0cd-05fbe8c489d9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:45.105646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f8302170-b87f-4135-9f84-eeb8e012434d req-a3721c33-88a9-4a26-b0cd-05fbe8c489d9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:45.106108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f8302170-b87f-4135-9f84-eeb8e012434d req-a3721c33-88a9-4a26-b0cd-05fbe8c489d9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:45.142639 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f8302170-b87f-4135-9f84-eeb8e012434d req-a3721c33-88a9-4a26-b0cd-05fbe8c489d9 service nova] Creating event network-changed:2f365edb-1055-4c11-b711-9765715d2b9d for instance 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4 on n-h1-854823-1 Aug 27 04:41:45.149650 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-145bcc87-1eac-46a6-ad14-cb67fc616efb tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1455 microversion: 2.1 time: 0.081227 Aug 27 04:41:45.155991 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1341/2657] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:45 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:45.160961 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-f8302170-b87f-4135-9f84-eeb8e012434d req-a3721c33-88a9-4a26-b0cd-05fbe8c489d9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158581 Aug 27 04:41:45.161780 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1317/2658] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:45.162890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-060693e7-8795-455d-bd31-93fa34f9805a req-b879460c-9730-4e8f-9a08-a1fbd9b87d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2fae55d-3829-41ee-8a71-af3656927791", "tag": "a40c76fa-0224-490a-8311-696b4862fcf1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:45.178909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-060693e7-8795-455d-bd31-93fa34f9805a req-b879460c-9730-4e8f-9a08-a1fbd9b87d8d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:45.179698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-060693e7-8795-455d-bd31-93fa34f9805a req-b879460c-9730-4e8f-9a08-a1fbd9b87d8d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:45.180304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-060693e7-8795-455d-bd31-93fa34f9805a req-b879460c-9730-4e8f-9a08-a1fbd9b87d8d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:45.195317 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-060693e7-8795-455d-bd31-93fa34f9805a req-b879460c-9730-4e8f-9a08-a1fbd9b87d8d service nova] Creating event network-changed:a40c76fa-0224-490a-8311-696b4862fcf1 for instance d2fae55d-3829-41ee-8a71-af3656927791 on n-h1-854823-1 Aug 27 04:41:45.201811 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-060693e7-8795-455d-bd31-93fa34f9805a req-b879460c-9730-4e8f-9a08-a1fbd9b87d8d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044157 Aug 27 04:41:45.203188 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1342/2659] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:45.679583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-79546824-31df-4218-9d8f-c559ab191fdd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:45.680747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-79546824-31df-4218-9d8f-c559ab191fdd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:45.687741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79546824-31df-4218-9d8f-c559ab191fdd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:45.688492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79546824-31df-4218-9d8f-c559ab191fdd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:45.689455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79546824-31df-4218-9d8f-c559ab191fdd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:45.690796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79546824-31df-4218-9d8f-c559ab191fdd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:45.691466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79546824-31df-4218-9d8f-c559ab191fdd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:45.692079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79546824-31df-4218-9d8f-c559ab191fdd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:45.735320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70f0a945-bd27-4977-9fba-b394bc75114d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:45.736846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-70f0a945-bd27-4977-9fba-b394bc75114d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:45.748635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70f0a945-bd27-4977-9fba-b394bc75114d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:45.749392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70f0a945-bd27-4977-9fba-b394bc75114d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:45.749985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70f0a945-bd27-4977-9fba-b394bc75114d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:45.751558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70f0a945-bd27-4977-9fba-b394bc75114d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:45.752171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70f0a945-bd27-4977-9fba-b394bc75114d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:45.752771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70f0a945-bd27-4977-9fba-b394bc75114d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:45.870573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-79546824-31df-4218-9d8f-c559ab191fdd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:45.881038 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-79546824-31df-4218-9d8f-c559ab191fdd tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1198 microversion: 2.1 time: 0.206236 Aug 27 04:41:45.896471 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1318/2660] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:45 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1198 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:45.950684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-70f0a945-bd27-4977-9fba-b394bc75114d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:45.958845 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-70f0a945-bd27-4977-9fba-b394bc75114d tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1324 microversion: 2.1 time: 0.228701 Aug 27 04:41:45.959451 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1343/2661] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:45 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1324 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:46.030075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-13f86daa-42aa-4fd4-8a5c-a0529c371bef tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:46.030696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-13f86daa-42aa-4fd4-8a5c-a0529c371bef tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:46.043882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13f86daa-42aa-4fd4-8a5c-a0529c371bef tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:46.044383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13f86daa-42aa-4fd4-8a5c-a0529c371bef tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:46.044852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13f86daa-42aa-4fd4-8a5c-a0529c371bef tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:46.045603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13f86daa-42aa-4fd4-8a5c-a0529c371bef tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:46.046060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13f86daa-42aa-4fd4-8a5c-a0529c371bef tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:46.046507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13f86daa-42aa-4fd4-8a5c-a0529c371bef tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:46.092576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd492e1f-d245-47c0-8495-68798487ff42 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:46.093267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd492e1f-d245-47c0-8495-68798487ff42 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:46.108972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd492e1f-d245-47c0-8495-68798487ff42 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:46.109483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd492e1f-d245-47c0-8495-68798487ff42 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:46.109923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd492e1f-d245-47c0-8495-68798487ff42 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:46.110643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd492e1f-d245-47c0-8495-68798487ff42 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:46.111098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd492e1f-d245-47c0-8495-68798487ff42 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:46.111520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd492e1f-d245-47c0-8495-68798487ff42 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:46.411621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-13f86daa-42aa-4fd4-8a5c-a0529c371bef tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:46.435208 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-13f86daa-42aa-4fd4-8a5c-a0529c371bef tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.408195 Aug 27 04:41:46.435208 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1319/2662] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:46 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:46.440775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0677d1c5-c553-47fd-825b-6d9c2ee53df7 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f25e54310>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:46.516251 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0677d1c5-c553-47fd-825b-6d9c2ee53df7 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1455 microversion: 2.1 time: 0.079916 Aug 27 04:41:46.523471 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1320/2663] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:46 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:46.550844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd492e1f-d245-47c0-8495-68798487ff42 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:46.560156 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd492e1f-d245-47c0-8495-68798487ff42 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1318 microversion: 2.1 time: 0.473528 Aug 27 04:41:46.561083 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1344/2664] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:46 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:46.903523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d958da67-8b68-4374-ab5e-50c925c82cac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:46.904187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d958da67-8b68-4374-ab5e-50c925c82cac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:46.921740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d958da67-8b68-4374-ab5e-50c925c82cac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:46.922249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d958da67-8b68-4374-ab5e-50c925c82cac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:46.922695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d958da67-8b68-4374-ab5e-50c925c82cac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:46.923516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d958da67-8b68-4374-ab5e-50c925c82cac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:46.923990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d958da67-8b68-4374-ab5e-50c925c82cac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:46.924656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d958da67-8b68-4374-ab5e-50c925c82cac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:46.986010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dd4c887e-15a0-4bbb-b002-dac105b52a6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:46.987252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dd4c887e-15a0-4bbb-b002-dac105b52a6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:47.007636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd4c887e-15a0-4bbb-b002-dac105b52a6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:47.008368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd4c887e-15a0-4bbb-b002-dac105b52a6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:47.008996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd4c887e-15a0-4bbb-b002-dac105b52a6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:47.010441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd4c887e-15a0-4bbb-b002-dac105b52a6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:47.011049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd4c887e-15a0-4bbb-b002-dac105b52a6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:47.011633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd4c887e-15a0-4bbb-b002-dac105b52a6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:47.880938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d958da67-8b68-4374-ab5e-50c925c82cac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:47.886308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dd4c887e-15a0-4bbb-b002-dac105b52a6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:47.896930 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d958da67-8b68-4374-ab5e-50c925c82cac tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1198 microversion: 2.1 time: 0.998624 Aug 27 04:41:47.898423 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1321/2665] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:46 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1198 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:47.901730 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dd4c887e-15a0-4bbb-b002-dac105b52a6c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 200 len: 1520 microversion: 2.1 time: 0.919475 Aug 27 04:41:47.904110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cf46b2a9-893a-4863-876f-1b990380df65 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:47.920663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cf46b2a9-893a-4863-876f-1b990380df65 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:47.923833 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1345/2666] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:46 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 1520 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:47.928759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5037794-6804-43a7-8b75-0d5d78d78e1b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f25d23430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:47.939997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf46b2a9-893a-4863-876f-1b990380df65 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:47.940502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf46b2a9-893a-4863-876f-1b990380df65 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:47.941173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf46b2a9-893a-4863-876f-1b990380df65 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:47.945652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf46b2a9-893a-4863-876f-1b990380df65 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:47.946351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf46b2a9-893a-4863-876f-1b990380df65 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:47.947487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cf46b2a9-893a-4863-876f-1b990380df65 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:48.020097 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5037794-6804-43a7-8b75-0d5d78d78e1b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1455 microversion: 2.1 time: 0.095077 Aug 27 04:41:48.021110 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1346/2667] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:47 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:48.037356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22d962fe-86b7-4d54-b0bd-7198a2eaa46c tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:48.037949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22d962fe-86b7-4d54-b0bd-7198a2eaa46c tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:48.057375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22d962fe-86b7-4d54-b0bd-7198a2eaa46c tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:48.057877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22d962fe-86b7-4d54-b0bd-7198a2eaa46c tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:48.058320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22d962fe-86b7-4d54-b0bd-7198a2eaa46c tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:48.059040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22d962fe-86b7-4d54-b0bd-7198a2eaa46c tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:48.059499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22d962fe-86b7-4d54-b0bd-7198a2eaa46c tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:48.060110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22d962fe-86b7-4d54-b0bd-7198a2eaa46c tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:48.245371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22d962fe-86b7-4d54-b0bd-7198a2eaa46c tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:48.257808 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22d962fe-86b7-4d54-b0bd-7198a2eaa46c tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1318 microversion: 2.1 time: 0.232880 Aug 27 04:41:48.258355 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1347/2668] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:48 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:48.263121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b24d95b-b56f-4a43-a3c1-cb4fc9e38e68 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.40"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:48.279891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b24d95b-b56f-4a43-a3c1-cb4fc9e38e68 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:48.300462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b24d95b-b56f-4a43-a3c1-cb4fc9e38e68 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:48.301500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b24d95b-b56f-4a43-a3c1-cb4fc9e38e68 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:48.302204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b24d95b-b56f-4a43-a3c1-cb4fc9e38e68 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:48.303407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b24d95b-b56f-4a43-a3c1-cb4fc9e38e68 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:48.304152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b24d95b-b56f-4a43-a3c1-cb4fc9e38e68 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:48.306039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b24d95b-b56f-4a43-a3c1-cb4fc9e38e68 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:48.365038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b24d95b-b56f-4a43-a3c1-cb4fc9e38e68 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "refresh_cache-85c8d252-e69b-489b-86ff-6ca1eecec963" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:41:48.365580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b24d95b-b56f-4a43-a3c1-cb4fc9e38e68 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquired lock "refresh_cache-85c8d252-e69b-489b-86ff-6ca1eecec963" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:41:48.523031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cf46b2a9-893a-4863-876f-1b990380df65 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:48.537282 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cf46b2a9-893a-4863-876f-1b990380df65 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.631865 Aug 27 04:41:48.538537 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1322/2669] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:47 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:48.918529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ac445399-1b42-4348-8ac8-d56238c94c2c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:48.919311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ac445399-1b42-4348-8ac8-d56238c94c2c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:48.934159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac445399-1b42-4348-8ac8-d56238c94c2c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:48.934803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac445399-1b42-4348-8ac8-d56238c94c2c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:48.935351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac445399-1b42-4348-8ac8-d56238c94c2c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:48.936203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac445399-1b42-4348-8ac8-d56238c94c2c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:48.936789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac445399-1b42-4348-8ac8-d56238c94c2c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:48.937324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac445399-1b42-4348-8ac8-d56238c94c2c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:48.989732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:49.213517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac445399-1b42-4348-8ac8-d56238c94c2c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:49.230710 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ac445399-1b42-4348-8ac8-d56238c94c2c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1198 microversion: 2.1 time: 0.316511 Aug 27 04:41:49.245242 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1323/2670] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:48 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1198 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:49.265468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e9a6eca-2215-438c-b76a-d0cda620496f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f25e541f0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:49.317540 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e9a6eca-2215-438c-b76a-d0cda620496f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1455 microversion: 2.1 time: 0.070692 Aug 27 04:41:49.325757 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1324/2671] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:49 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:49.335307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99bc6c03-9b61-4757-8fff-6cc53a12893e tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:49.347928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-99bc6c03-9b61-4757-8fff-6cc53a12893e tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:49.355028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99bc6c03-9b61-4757-8fff-6cc53a12893e tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:49.355680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99bc6c03-9b61-4757-8fff-6cc53a12893e tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:49.356244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99bc6c03-9b61-4757-8fff-6cc53a12893e tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:49.357427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99bc6c03-9b61-4757-8fff-6cc53a12893e tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:49.357998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99bc6c03-9b61-4757-8fff-6cc53a12893e tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:49.358532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99bc6c03-9b61-4757-8fff-6cc53a12893e tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:49.531185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-99bc6c03-9b61-4757-8fff-6cc53a12893e tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:49.539222 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-99bc6c03-9b61-4757-8fff-6cc53a12893e tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1318 microversion: 2.1 time: 0.211895 Aug 27 04:41:49.552926 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1325/2672] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:49 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:49.566707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-97d13bce-2a67-4ff5-924b-459c7bfb6d2f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:49.570312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-97d13bce-2a67-4ff5-924b-459c7bfb6d2f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:49.578680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97d13bce-2a67-4ff5-924b-459c7bfb6d2f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:49.579477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97d13bce-2a67-4ff5-924b-459c7bfb6d2f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:49.580161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97d13bce-2a67-4ff5-924b-459c7bfb6d2f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:49.581146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97d13bce-2a67-4ff5-924b-459c7bfb6d2f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:49.582343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97d13bce-2a67-4ff5-924b-459c7bfb6d2f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:49.591477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97d13bce-2a67-4ff5-924b-459c7bfb6d2f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:49.811574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-97d13bce-2a67-4ff5-924b-459c7bfb6d2f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:49.833205 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-97d13bce-2a67-4ff5-924b-459c7bfb6d2f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.277470 Aug 27 04:41:49.845468 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1326/2673] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:49 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:49.850704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6f093ac2-3020-44b5-a660-bdf1828003d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:49.851383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6f093ac2-3020-44b5-a660-bdf1828003d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:49.861330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f093ac2-3020-44b5-a660-bdf1828003d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:49.862041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f093ac2-3020-44b5-a660-bdf1828003d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:49.862817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f093ac2-3020-44b5-a660-bdf1828003d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:49.863793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f093ac2-3020-44b5-a660-bdf1828003d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:49.864411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f093ac2-3020-44b5-a660-bdf1828003d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:49.865033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f093ac2-3020-44b5-a660-bdf1828003d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:49.897198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6f093ac2-3020-44b5-a660-bdf1828003d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:41:50.037915 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6f093ac2-3020-44b5-a660-bdf1828003d8 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "DELETE /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 204 len: 0 microversion: 2.25 time: 0.190920 Aug 27 04:41:50.040863 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1327/2674] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:41:49 2022] DELETE /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:41:50.052619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-75b576e7-bf69-4020-b7c8-c53eb61ece48 req-242dfbed-4e09-4d33-bd40-96919199a097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0d6029-a40b-45b9-b230-2033ec88617e", "name": "network-vif-plugged", "status": "completed", "tag": "54e043d1-9346-4c9a-917b-026289b24400"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:50.069676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-75b576e7-bf69-4020-b7c8-c53eb61ece48 req-242dfbed-4e09-4d33-bd40-96919199a097 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:50.071044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-75b576e7-bf69-4020-b7c8-c53eb61ece48 req-242dfbed-4e09-4d33-bd40-96919199a097 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:50.071475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-75b576e7-bf69-4020-b7c8-c53eb61ece48 req-242dfbed-4e09-4d33-bd40-96919199a097 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:50.096308 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-75b576e7-bf69-4020-b7c8-c53eb61ece48 req-242dfbed-4e09-4d33-bd40-96919199a097 service nova] Creating event network-vif-plugged:54e043d1-9346-4c9a-917b-026289b24400 for instance 0e0d6029-a40b-45b9-b230-2033ec88617e on n-h1-854823-1 Aug 27 04:41:50.102452 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-75b576e7-bf69-4020-b7c8-c53eb61ece48 req-242dfbed-4e09-4d33-bd40-96919199a097 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059361 Aug 27 04:41:50.107099 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1328/2675] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:50.113892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-22168c95-f07d-4a36-b33a-e410cbdc5754 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:50.114594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-22168c95-f07d-4a36-b33a-e410cbdc5754 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:50.122816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22168c95-f07d-4a36-b33a-e410cbdc5754 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:50.123360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22168c95-f07d-4a36-b33a-e410cbdc5754 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:50.123902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22168c95-f07d-4a36-b33a-e410cbdc5754 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:50.124725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22168c95-f07d-4a36-b33a-e410cbdc5754 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:50.125184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22168c95-f07d-4a36-b33a-e410cbdc5754 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:50.125733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22168c95-f07d-4a36-b33a-e410cbdc5754 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:50.280438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-22168c95-f07d-4a36-b33a-e410cbdc5754 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:50.289195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-22168c95-f07d-4a36-b33a-e410cbdc5754 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:50.292351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-22168c95-f07d-4a36-b33a-e410cbdc5754 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:50.293691 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-22168c95-f07d-4a36-b33a-e410cbdc5754 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1734 microversion: 2.25 time: 0.184619 Aug 27 04:41:50.300166 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1329/2676] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:50 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:50.306734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0eb226e-dbc0-4895-bad6-6f32eccc43e0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:50.307341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c0eb226e-dbc0-4895-bad6-6f32eccc43e0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:50.313361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0eb226e-dbc0-4895-bad6-6f32eccc43e0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:50.313998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0eb226e-dbc0-4895-bad6-6f32eccc43e0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:50.314432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0eb226e-dbc0-4895-bad6-6f32eccc43e0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:50.315149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0eb226e-dbc0-4895-bad6-6f32eccc43e0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:50.315603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0eb226e-dbc0-4895-bad6-6f32eccc43e0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:50.316021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0eb226e-dbc0-4895-bad6-6f32eccc43e0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:50.474382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c0eb226e-dbc0-4895-bad6-6f32eccc43e0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:50.491431 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c0eb226e-dbc0-4895-bad6-6f32eccc43e0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1198 microversion: 2.1 time: 0.190076 Aug 27 04:41:50.492252 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1330/2677] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:50 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1198 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:50.506898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b0d7aa68-ab23-4176-8257-d999139249e6 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f25ecf3a0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:50.569051 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b0d7aa68-ab23-4176-8257-d999139249e6 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1455 microversion: 2.1 time: 0.075609 Aug 27 04:41:50.576819 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1331/2678] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:50 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:50.580400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-6b24d95b-b56f-4a43-a3c1-cb4fc9e38e68 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Building network info cache for instance {{(pid=128869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:41:50.587142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef1db4d5-224f-470e-a8a6-8b52cc8d6bf5 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:50.587787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ef1db4d5-224f-470e-a8a6-8b52cc8d6bf5 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:50.597365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef1db4d5-224f-470e-a8a6-8b52cc8d6bf5 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:50.598312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef1db4d5-224f-470e-a8a6-8b52cc8d6bf5 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:50.598910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef1db4d5-224f-470e-a8a6-8b52cc8d6bf5 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:50.599915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef1db4d5-224f-470e-a8a6-8b52cc8d6bf5 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:50.600660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef1db4d5-224f-470e-a8a6-8b52cc8d6bf5 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:50.601557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef1db4d5-224f-470e-a8a6-8b52cc8d6bf5 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:50.759672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef1db4d5-224f-470e-a8a6-8b52cc8d6bf5 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:50.777152 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ef1db4d5-224f-470e-a8a6-8b52cc8d6bf5 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1318 microversion: 2.1 time: 0.199148 Aug 27 04:41:50.789540 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1332/2679] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:50 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:50.795556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-6411571e-8287-46e4-bc6f-e6fd021c7b31 req-af99b5cb-5969-4915-8c42-ebcc0c034fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c8d252-e69b-489b-86ff-6ca1eecec963", "tag": "294de1ec-f506-40c1-a6ae-379dd686a18a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:50.817571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6411571e-8287-46e4-bc6f-e6fd021c7b31 req-af99b5cb-5969-4915-8c42-ebcc0c034fdd service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:50.818085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6411571e-8287-46e4-bc6f-e6fd021c7b31 req-af99b5cb-5969-4915-8c42-ebcc0c034fdd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:50.818589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6411571e-8287-46e4-bc6f-e6fd021c7b31 req-af99b5cb-5969-4915-8c42-ebcc0c034fdd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:50.833201 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-6411571e-8287-46e4-bc6f-e6fd021c7b31 req-af99b5cb-5969-4915-8c42-ebcc0c034fdd service nova] Creating event network-changed:294de1ec-f506-40c1-a6ae-379dd686a18a for instance 85c8d252-e69b-489b-86ff-6ca1eecec963 on n-h1-854823-1 Aug 27 04:41:50.840501 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-6411571e-8287-46e4-bc6f-e6fd021c7b31 req-af99b5cb-5969-4915-8c42-ebcc0c034fdd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049610 Aug 27 04:41:50.841645 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1333/2680] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:50.875058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ab96984a-de31-4157-8623-50de8ecb552b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:50.877276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ab96984a-de31-4157-8623-50de8ecb552b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:50.890774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab96984a-de31-4157-8623-50de8ecb552b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:50.891505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab96984a-de31-4157-8623-50de8ecb552b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:50.892124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab96984a-de31-4157-8623-50de8ecb552b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:50.893138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab96984a-de31-4157-8623-50de8ecb552b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:50.893738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab96984a-de31-4157-8623-50de8ecb552b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:50.897182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab96984a-de31-4157-8623-50de8ecb552b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:51.384623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ab96984a-de31-4157-8623-50de8ecb552b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:51.401323 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ab96984a-de31-4157-8623-50de8ecb552b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.543176 Aug 27 04:41:51.404359 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1334/2681] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:50 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:51.416898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-10855b16-6a8e-416a-a5f6-2b0182642c4b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:51.418035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-10855b16-6a8e-416a-a5f6-2b0182642c4b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:51.452852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10855b16-6a8e-416a-a5f6-2b0182642c4b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:51.459225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10855b16-6a8e-416a-a5f6-2b0182642c4b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:51.464631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10855b16-6a8e-416a-a5f6-2b0182642c4b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:51.465807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10855b16-6a8e-416a-a5f6-2b0182642c4b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:51.466526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10855b16-6a8e-416a-a5f6-2b0182642c4b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:51.468628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10855b16-6a8e-416a-a5f6-2b0182642c4b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:52.215784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-6b24d95b-b56f-4a43-a3c1-cb4fc9e38e68 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Updating instance_info_cache with network_info: [{"id": "294de1ec-f506-40c1-a6ae-379dd686a18a", "address": "fa:16:3e:28:75:aa", "network": {"id": "bcedcbbe-f9e5-425b-a145-0aa42ef36186", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1734361074-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "449305a5c79342058280f9482da58766", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap294de1ec-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:41:52.238458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b24d95b-b56f-4a43-a3c1-cb4fc9e38e68 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Releasing lock "refresh_cache-85c8d252-e69b-489b-86ff-6ca1eecec963" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:41:52.239800 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b24d95b-b56f-4a43-a3c1-cb4fc9e38e68 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "POST /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963/action" status: 202 len: 0 microversion: 2.1 time: 3.980404 Aug 27 04:41:52.241206 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1348/2682] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:41:48 2022] POST /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963/action => generated 0 bytes in 3982 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 04:41:52.254202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66074fd2-3176-4d13-96f4-aec391824251 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:52.256555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66074fd2-3176-4d13-96f4-aec391824251 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:52.273842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66074fd2-3176-4d13-96f4-aec391824251 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:52.275502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66074fd2-3176-4d13-96f4-aec391824251 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:52.277089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66074fd2-3176-4d13-96f4-aec391824251 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:52.280482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66074fd2-3176-4d13-96f4-aec391824251 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:52.282387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66074fd2-3176-4d13-96f4-aec391824251 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:52.282991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66074fd2-3176-4d13-96f4-aec391824251 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:52.380233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10855b16-6a8e-416a-a5f6-2b0182642c4b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:52.398884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10855b16-6a8e-416a-a5f6-2b0182642c4b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:52.402673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10855b16-6a8e-416a-a5f6-2b0182642c4b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:52.404107 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-10855b16-6a8e-416a-a5f6-2b0182642c4b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1734 microversion: 2.25 time: 0.998330 Aug 27 04:41:52.405276 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1335/2683] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:51 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1734 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:52.414127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f2f1d19-03c4-4bcd-baf5-43982706f14c tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f25e71ee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:52.486777 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4f2f1d19-03c4-4bcd-baf5-43982706f14c tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1455 microversion: 2.1 time: 0.080152 Aug 27 04:41:52.491618 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1336/2684] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:52 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:52.501743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-370505b0-bf8d-46db-8ccc-9b225c2a835a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:52.502451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-370505b0-bf8d-46db-8ccc-9b225c2a835a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:52.526957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-370505b0-bf8d-46db-8ccc-9b225c2a835a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:52.530147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-370505b0-bf8d-46db-8ccc-9b225c2a835a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:52.530633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-370505b0-bf8d-46db-8ccc-9b225c2a835a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:52.531380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-370505b0-bf8d-46db-8ccc-9b225c2a835a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:52.533010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-370505b0-bf8d-46db-8ccc-9b225c2a835a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:52.533455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-370505b0-bf8d-46db-8ccc-9b225c2a835a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:52.772949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-370505b0-bf8d-46db-8ccc-9b225c2a835a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:52.785471 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-370505b0-bf8d-46db-8ccc-9b225c2a835a tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1318 microversion: 2.1 time: 0.292639 Aug 27 04:41:52.786180 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1337/2685] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:52 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:52.796481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.40"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:52.802154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:52.818556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66074fd2-3176-4d13-96f4-aec391824251 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:52.835614 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66074fd2-3176-4d13-96f4-aec391824251 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1198 microversion: 2.1 time: 0.593000 Aug 27 04:41:52.838763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:52.841943 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1349/2686] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:52 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1198 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:52.842650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:52.846333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:52.848377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:52.850706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:52.853553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:52.865202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-17c591d7-8a59-4b34-9c47-312f3dfce9d5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:52.866076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-17c591d7-8a59-4b34-9c47-312f3dfce9d5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:52.877186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17c591d7-8a59-4b34-9c47-312f3dfce9d5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:52.877949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17c591d7-8a59-4b34-9c47-312f3dfce9d5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:52.878724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17c591d7-8a59-4b34-9c47-312f3dfce9d5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:52.879925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17c591d7-8a59-4b34-9c47-312f3dfce9d5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:52.881186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17c591d7-8a59-4b34-9c47-312f3dfce9d5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:52.883873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17c591d7-8a59-4b34-9c47-312f3dfce9d5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:52.916772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "refresh_cache-629128a5-55ce-4184-8821-6dede5fd0081" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:41:52.916923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquired lock "refresh_cache-629128a5-55ce-4184-8821-6dede5fd0081" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:41:52.937200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:53.272048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-17c591d7-8a59-4b34-9c47-312f3dfce9d5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:53.294929 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-17c591d7-8a59-4b34-9c47-312f3dfce9d5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.450128 Aug 27 04:41:53.296873 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1350/2687] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:52 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:53.432328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f050754-bc27-406a-b641-15f76d62772b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:53.433158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3f050754-bc27-406a-b641-15f76d62772b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:53.451924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f050754-bc27-406a-b641-15f76d62772b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:53.452574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f050754-bc27-406a-b641-15f76d62772b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:53.453114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f050754-bc27-406a-b641-15f76d62772b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:53.454063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f050754-bc27-406a-b641-15f76d62772b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:53.455185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f050754-bc27-406a-b641-15f76d62772b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:53.455974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f050754-bc27-406a-b641-15f76d62772b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:53.997171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f050754-bc27-406a-b641-15f76d62772b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:54.012143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f050754-bc27-406a-b641-15f76d62772b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:54.013889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f050754-bc27-406a-b641-15f76d62772b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:54.018666 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f050754-bc27-406a-b641-15f76d62772b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 200 len: 1666 microversion: 2.25 time: 0.591168 Aug 27 04:41:54.020603 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1351/2688] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:53 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 1666 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:41:54.031881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c56e317-cea6-44c2-ad42-c8fb98d393f6 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f218131f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:54.106424 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c56e317-cea6-44c2-ad42-c8fb98d393f6 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1455 microversion: 2.1 time: 0.080305 Aug 27 04:41:54.108902 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1352/2689] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:54 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:54.125639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8ab762be-fbaf-4ec9-a27a-fd14bf5d7237 req-ddb41975-3e30-4c80-b8a9-e92c2edb20b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516299cc-c878-4b8e-bb4d-4247ddbd90cf", "name": "network-vif-deleted", "tag": "326c17ad-2ce3-4c6b-854b-aeff6eeb991e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:54.153944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8ab762be-fbaf-4ec9-a27a-fd14bf5d7237 req-ddb41975-3e30-4c80-b8a9-e92c2edb20b4 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:54.154508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8ab762be-fbaf-4ec9-a27a-fd14bf5d7237 req-ddb41975-3e30-4c80-b8a9-e92c2edb20b4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:54.155106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8ab762be-fbaf-4ec9-a27a-fd14bf5d7237 req-ddb41975-3e30-4c80-b8a9-e92c2edb20b4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:54.171746 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8ab762be-fbaf-4ec9-a27a-fd14bf5d7237 req-ddb41975-3e30-4c80-b8a9-e92c2edb20b4 service nova] Creating event network-vif-deleted:326c17ad-2ce3-4c6b-854b-aeff6eeb991e for instance 516299cc-c878-4b8e-bb4d-4247ddbd90cf on n-h2-854823-1 Aug 27 04:41:54.187282 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8ab762be-fbaf-4ec9-a27a-fd14bf5d7237 req-ddb41975-3e30-4c80-b8a9-e92c2edb20b4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077110 Aug 27 04:41:54.187896 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1353/2690] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:54.203337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30d3150f-8a2a-47e5-99c7-0a52c67d0e43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:54.206924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-30d3150f-8a2a-47e5-99c7-0a52c67d0e43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:54.222050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30d3150f-8a2a-47e5-99c7-0a52c67d0e43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:54.222979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30d3150f-8a2a-47e5-99c7-0a52c67d0e43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:54.224487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30d3150f-8a2a-47e5-99c7-0a52c67d0e43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:54.226739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30d3150f-8a2a-47e5-99c7-0a52c67d0e43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:54.227616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30d3150f-8a2a-47e5-99c7-0a52c67d0e43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:54.229721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30d3150f-8a2a-47e5-99c7-0a52c67d0e43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:54.506041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-30d3150f-8a2a-47e5-99c7-0a52c67d0e43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:54.520449 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-30d3150f-8a2a-47e5-99c7-0a52c67d0e43 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1318 microversion: 2.1 time: 0.329139 Aug 27 04:41:54.521554 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1354/2691] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:54 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:54.533470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90aea55c-bc01-487a-b403-2dcc01f146c0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:54.534174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90aea55c-bc01-487a-b403-2dcc01f146c0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:54.549255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90aea55c-bc01-487a-b403-2dcc01f146c0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:54.549763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90aea55c-bc01-487a-b403-2dcc01f146c0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:54.550305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90aea55c-bc01-487a-b403-2dcc01f146c0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:54.560118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90aea55c-bc01-487a-b403-2dcc01f146c0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:54.560118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90aea55c-bc01-487a-b403-2dcc01f146c0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:54.560480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90aea55c-bc01-487a-b403-2dcc01f146c0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:54.935865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-90aea55c-bc01-487a-b403-2dcc01f146c0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:54.948856 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90aea55c-bc01-487a-b403-2dcc01f146c0 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1198 microversion: 2.1 time: 0.425960 Aug 27 04:41:54.951983 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1355/2692] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:54 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1198 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:54.959566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-37fef382-ebd9-44ab-8aaf-02bcdacc2e34 req-171db0e3-45b6-4dd3-b5dc-25816eb11ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c1a9e4-475f-4c6a-bf72-653e8fc46611", "name": "network-vif-plugged", "status": "completed", "tag": "c7badfa4-4c98-4ab6-80be-9df19f2265d3"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:54.969494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-37fef382-ebd9-44ab-8aaf-02bcdacc2e34 req-171db0e3-45b6-4dd3-b5dc-25816eb11ec5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:54.975563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-37fef382-ebd9-44ab-8aaf-02bcdacc2e34 req-171db0e3-45b6-4dd3-b5dc-25816eb11ec5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:54.975563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-37fef382-ebd9-44ab-8aaf-02bcdacc2e34 req-171db0e3-45b6-4dd3-b5dc-25816eb11ec5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:54.990590 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-37fef382-ebd9-44ab-8aaf-02bcdacc2e34 req-171db0e3-45b6-4dd3-b5dc-25816eb11ec5 service nova] Creating event network-vif-plugged:c7badfa4-4c98-4ab6-80be-9df19f2265d3 for instance c3c1a9e4-475f-4c6a-bf72-653e8fc46611 on n-h2-854823-1 Aug 27 04:41:54.999455 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-37fef382-ebd9-44ab-8aaf-02bcdacc2e34 req-171db0e3-45b6-4dd3-b5dc-25816eb11ec5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044028 Aug 27 04:41:55.000099 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1356/2693] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:55.006224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-93039bbf-45dd-4e3c-84e3-4205c96a638e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:55.008488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-93039bbf-45dd-4e3c-84e3-4205c96a638e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:55.021263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93039bbf-45dd-4e3c-84e3-4205c96a638e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:55.022055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93039bbf-45dd-4e3c-84e3-4205c96a638e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:55.022507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93039bbf-45dd-4e3c-84e3-4205c96a638e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:55.023284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93039bbf-45dd-4e3c-84e3-4205c96a638e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:55.023741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93039bbf-45dd-4e3c-84e3-4205c96a638e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:55.024394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93039bbf-45dd-4e3c-84e3-4205c96a638e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:55.358623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-93039bbf-45dd-4e3c-84e3-4205c96a638e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:55.366844 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-93039bbf-45dd-4e3c-84e3-4205c96a638e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.365244 Aug 27 04:41:55.371821 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1357/2694] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:55 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:55.377179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-848278ae-4ae0-4e76-a1a1-b33541ba5187 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:55.393525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-848278ae-4ae0-4e76-a1a1-b33541ba5187 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 516299cc-c878-4b8e-bb4d-4247ddbd90cf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:55.408728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-848278ae-4ae0-4e76-a1a1-b33541ba5187 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:55.417340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-848278ae-4ae0-4e76-a1a1-b33541ba5187 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:55.418064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-848278ae-4ae0-4e76-a1a1-b33541ba5187 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:55.418986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-848278ae-4ae0-4e76-a1a1-b33541ba5187 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:55.419607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-848278ae-4ae0-4e76-a1a1-b33541ba5187 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:55.420204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-848278ae-4ae0-4e76-a1a1-b33541ba5187 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:55.457337 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-848278ae-4ae0-4e76-a1a1-b33541ba5187 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] HTTP exception thrown: Instance 516299cc-c878-4b8e-bb4d-4247ddbd90cf could not be found. Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-848278ae-4ae0-4e76-a1a1-b33541ba5187 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Request method failure captured: Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf HTTP/1.1 Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ6kU1BsVnQt_zRKICUC7ruDaiNUqIGtFnVSGvnisX4tJZH290wng_sg4R_OQ3pLxBfwcJUWL076bQIFvkpyAmLUnZPhm65I39UrLlta392dZ8xnek4ChpZ_zueUdLpU4LTERpikeRJp50XLG6D7Rigg7KCsXQPWGN87EreaUvtZup4 Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 002ba94e9b364c3e8784927de5770ed1 Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1027428516 Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1027428516 Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 002ba94e9b364c3e8784927de5770ed1 Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1027428516 Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-LiveAutoBlockMigrationV225Test-1027428516-project Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 1d3d23499c474adaa7fe3a2260f5ec36 Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1027428516-project Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 516299cc-c878-4b8e-bb4d-4247ddbd90cf could not be found. Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '516299cc-c878-4b8e-bb4d-4247ddbd90cf'} Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 516299cc-c878-4b8e-bb4d-4247ddbd90cf could not be found. Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 516299cc-c878-4b8e-bb4d-4247ddbd90cf could not be found. Aug 27 04:41:55.460817 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:41:55.465291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:41:55.465291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:41:55.465291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:41:55.465291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:41:55.465291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:41:55.465291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:41:55.465291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:41:55.465291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 516299cc-c878-4b8e-bb4d-4247ddbd90cf could not be found. Aug 27 04:41:55.465291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:41:55.472884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-848278ae-4ae0-4e76-a1a1-b33541ba5187 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Returning 404 to user: Instance 516299cc-c878-4b8e-bb4d-4247ddbd90cf could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:41:55.473985 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-848278ae-4ae0-4e76-a1a1-b33541ba5187 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf" status: 404 len: 111 microversion: 2.25 time: 0.100913 Aug 27 04:41:55.474752 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1358/2695] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:41:55 2022] GET /compute/v2.1/servers/516299cc-c878-4b8e-bb4d-4247ddbd90cf => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:41:55.479708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cacd41a6-a5ba-44e4-973d-a4dd116eff17 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f218d3ca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:55.586298 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cacd41a6-a5ba-44e4-973d-a4dd116eff17 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1455 microversion: 2.1 time: 0.109764 Aug 27 04:41:55.587730 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1359/2696] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:55 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:55.592523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-08871ea6-4415-427d-ac5f-0a92a1f67e1c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '.version_select at 0x7f1f20ed5a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:55.626577 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-08871ea6-4415-427d-ac5f-0a92a1f67e1c tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193405832" status: 204 len: 0 microversion: 2.25 time: 0.037005 Aug 27 04:41:55.628089 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1360/2697] 10.222.0.79 () {60 vars in 1262 bytes} [Sat Aug 27 04:41:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193405832 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:41:55.633890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49265394-e47c-491e-8db0-77b82121816f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:55.635566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-49265394-e47c-491e-8db0-77b82121816f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:55.647866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265394-e47c-491e-8db0-77b82121816f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:55.648724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265394-e47c-491e-8db0-77b82121816f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:55.649612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265394-e47c-491e-8db0-77b82121816f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:55.650580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265394-e47c-491e-8db0-77b82121816f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:55.651315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265394-e47c-491e-8db0-77b82121816f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:55.651983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49265394-e47c-491e-8db0-77b82121816f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:55.918480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49265394-e47c-491e-8db0-77b82121816f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:55.926979 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49265394-e47c-491e-8db0-77b82121816f tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1318 microversion: 2.1 time: 0.297461 Aug 27 04:41:55.933340 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1361/2698] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:55 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:55.979423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90381f7b-348e-41cf-9498-ad0d4fec786e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:55.980062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90381f7b-348e-41cf-9498-ad0d4fec786e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:55.992984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90381f7b-348e-41cf-9498-ad0d4fec786e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:55.994064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90381f7b-348e-41cf-9498-ad0d4fec786e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:55.994511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90381f7b-348e-41cf-9498-ad0d4fec786e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:55.995424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90381f7b-348e-41cf-9498-ad0d4fec786e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:56.003218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90381f7b-348e-41cf-9498-ad0d4fec786e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:56.003630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90381f7b-348e-41cf-9498-ad0d4fec786e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:56.598514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-90381f7b-348e-41cf-9498-ad0d4fec786e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:56.622374 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90381f7b-348e-41cf-9498-ad0d4fec786e tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1198 microversion: 2.1 time: 0.648033 Aug 27 04:41:56.623033 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1362/2699] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:55 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1198 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:41:56.638776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-afc21e93-20d5-45d3-841f-a45a8fd3b00e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:56.639821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-afc21e93-20d5-45d3-841f-a45a8fd3b00e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:56.656596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc21e93-20d5-45d3-841f-a45a8fd3b00e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:56.657289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc21e93-20d5-45d3-841f-a45a8fd3b00e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:56.657610 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.network.neutron [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] re-assign floating IP 172.25.3.40 from instance 85c8d252-e69b-489b-86ff-6ca1eecec963 Aug 27 04:41:56.658375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc21e93-20d5-45d3-841f-a45a8fd3b00e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:56.659241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc21e93-20d5-45d3-841f-a45a8fd3b00e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:56.659837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc21e93-20d5-45d3-841f-a45a8fd3b00e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:56.662528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc21e93-20d5-45d3-841f-a45a8fd3b00e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:56.751823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Building network info cache for instance {{(pid=128870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:41:57.306511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-afc21e93-20d5-45d3-841f-a45a8fd3b00e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:57.327320 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-afc21e93-20d5-45d3-841f-a45a8fd3b00e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.701932 Aug 27 04:41:57.336294 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1363/2700] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:56 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:57.342393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7112f7f8-0af7-4e86-8019-a1426293b2e2 req-d44bef3c-62df-48c9-bb6b-449425c2d383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c8d252-e69b-489b-86ff-6ca1eecec963", "tag": "294de1ec-f506-40c1-a6ae-379dd686a18a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:57.370933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7112f7f8-0af7-4e86-8019-a1426293b2e2 req-d44bef3c-62df-48c9-bb6b-449425c2d383 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:57.371751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7112f7f8-0af7-4e86-8019-a1426293b2e2 req-d44bef3c-62df-48c9-bb6b-449425c2d383 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:57.372656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7112f7f8-0af7-4e86-8019-a1426293b2e2 req-d44bef3c-62df-48c9-bb6b-449425c2d383 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:57.395932 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7112f7f8-0af7-4e86-8019-a1426293b2e2 req-d44bef3c-62df-48c9-bb6b-449425c2d383 service nova] Creating event network-changed:294de1ec-f506-40c1-a6ae-379dd686a18a for instance 85c8d252-e69b-489b-86ff-6ca1eecec963 on n-h1-854823-1 Aug 27 04:41:57.420217 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7112f7f8-0af7-4e86-8019-a1426293b2e2 req-d44bef3c-62df-48c9-bb6b-449425c2d383 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082385 Aug 27 04:41:57.424657 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1364/2701] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:57.440004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2bd0c12c-59b4-47d0-a1f5-d4fd5aa597ac tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21ad1040>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:57.521683 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2bd0c12c-59b4-47d0-a1f5-d4fd5aa597ac tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1455 microversion: 2.1 time: 0.095066 Aug 27 04:41:57.523943 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1365/2702] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:57 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:57.529856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ae16fb3-2ebd-4ba1-a8ef-6617353414af tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:57.530950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ae16fb3-2ebd-4ba1-a8ef-6617353414af tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:57.539499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae16fb3-2ebd-4ba1-a8ef-6617353414af tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:57.541014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae16fb3-2ebd-4ba1-a8ef-6617353414af tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:57.541664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae16fb3-2ebd-4ba1-a8ef-6617353414af tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:57.542870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae16fb3-2ebd-4ba1-a8ef-6617353414af tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:57.543568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae16fb3-2ebd-4ba1-a8ef-6617353414af tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:57.544298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae16fb3-2ebd-4ba1-a8ef-6617353414af tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:58.390129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ae16fb3-2ebd-4ba1-a8ef-6617353414af tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:58.398696 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ae16fb3-2ebd-4ba1-a8ef-6617353414af tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1318 microversion: 2.1 time: 0.873154 Aug 27 04:41:58.414161 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1366/2703] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:57 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1318 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:58.414161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-26a71b8f-0633-42d1-846d-50db6ae5e9d7 req-36524208-acde-4a65-9fd2-b388f813ee40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fae55d-3829-41ee-8a71-af3656927791", "name": "network-vif-plugged", "status": "completed", "tag": "a40c76fa-0224-490a-8311-696b4862fcf1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:58.439401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-26a71b8f-0633-42d1-846d-50db6ae5e9d7 req-36524208-acde-4a65-9fd2-b388f813ee40 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:58.439903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-26a71b8f-0633-42d1-846d-50db6ae5e9d7 req-36524208-acde-4a65-9fd2-b388f813ee40 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:58.442188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-26a71b8f-0633-42d1-846d-50db6ae5e9d7 req-36524208-acde-4a65-9fd2-b388f813ee40 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:58.450393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Updating instance_info_cache with network_info: [{"id": "294de1ec-f506-40c1-a6ae-379dd686a18a", "address": "fa:16:3e:28:75:aa", "network": {"id": "bcedcbbe-f9e5-425b-a145-0aa42ef36186", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1734361074-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "449305a5c79342058280f9482da58766", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap294de1ec-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:41:58.467727 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-26a71b8f-0633-42d1-846d-50db6ae5e9d7 req-36524208-acde-4a65-9fd2-b388f813ee40 service nova] Creating event network-vif-plugged:a40c76fa-0224-490a-8311-696b4862fcf1 for instance d2fae55d-3829-41ee-8a71-af3656927791 on n-h1-854823-1 Aug 27 04:41:58.478236 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-26a71b8f-0633-42d1-846d-50db6ae5e9d7 req-36524208-acde-4a65-9fd2-b388f813ee40 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074006 Aug 27 04:41:58.479566 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1367/2704] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:58.479939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Building network info cache for instance {{(pid=128870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:41:58.491121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d6ff231-9935-4e72-8a67-88a0313b6b0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:58.493769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d6ff231-9935-4e72-8a67-88a0313b6b0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:58.505317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d6ff231-9935-4e72-8a67-88a0313b6b0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:58.506252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d6ff231-9935-4e72-8a67-88a0313b6b0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:58.507111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d6ff231-9935-4e72-8a67-88a0313b6b0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:58.510285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d6ff231-9935-4e72-8a67-88a0313b6b0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:58.511097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d6ff231-9935-4e72-8a67-88a0313b6b0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:58.511990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d6ff231-9935-4e72-8a67-88a0313b6b0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:59.310611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d6ff231-9935-4e72-8a67-88a0313b6b0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:59.327350 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d6ff231-9935-4e72-8a67-88a0313b6b0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1380 microversion: 2.1 time: 0.846138 Aug 27 04:41:59.327994 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1368/2705] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:58 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1380 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:41:59.333514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d322bcb4-ade3-410b-9ec1-861123e5c31b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:59.339302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d322bcb4-ade3-410b-9ec1-861123e5c31b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:59.358141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d322bcb4-ade3-410b-9ec1-861123e5c31b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:59.358650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d322bcb4-ade3-410b-9ec1-861123e5c31b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:59.361056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d322bcb4-ade3-410b-9ec1-861123e5c31b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:59.362135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d322bcb4-ade3-410b-9ec1-861123e5c31b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:59.364646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d322bcb4-ade3-410b-9ec1-861123e5c31b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:59.365266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d322bcb4-ade3-410b-9ec1-861123e5c31b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:59.457972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d322bcb4-ade3-410b-9ec1-861123e5c31b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:41:59.670427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:59.702020 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d322bcb4-ade3-410b-9ec1-861123e5c31b tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "DELETE /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 204 len: 0 microversion: 2.25 time: 0.372004 Aug 27 04:41:59.706548 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1369/2706] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:41:59 2022] DELETE /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:41:59.742418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2cbeece-3689-4e3b-8cd9-2ed3f30a6309 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:59.743307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2cbeece-3689-4e3b-8cd9-2ed3f30a6309 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:59.751935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2cbeece-3689-4e3b-8cd9-2ed3f30a6309 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:59.753689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2cbeece-3689-4e3b-8cd9-2ed3f30a6309 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:59.755825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2cbeece-3689-4e3b-8cd9-2ed3f30a6309 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:59.759428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2cbeece-3689-4e3b-8cd9-2ed3f30a6309 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:59.762235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2cbeece-3689-4e3b-8cd9-2ed3f30a6309 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:59.763724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2cbeece-3689-4e3b-8cd9-2ed3f30a6309 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:59.815396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Updating instance_info_cache with network_info: [{"id": "1def81ec-2b40-44c8-a429-c0786309e355", "address": "fa:16:3e:96:39:ee", "network": {"id": "bcedcbbe-f9e5-425b-a145-0aa42ef36186", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1734361074-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "449305a5c79342058280f9482da58766", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1def81ec-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:41:59.858527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Releasing lock "refresh_cache-629128a5-55ce-4184-8821-6dede5fd0081" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:41:59.860147 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e6cd1277-9012-4637-97d8-db392e50a6f3 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "POST /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081/action" status: 202 len: 0 microversion: 2.1 time: 7.070351 Aug 27 04:41:59.861272 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1338/2707] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:41:52 2022] POST /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081/action => generated 0 bytes in 7074 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 04:41:59.870310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d6b3446a-d01f-49b2-8625-3559b6f22fca tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21636550>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:59.972565 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d6b3446a-d01f-49b2-8625-3559b6f22fca tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1455 microversion: 2.1 time: 0.109894 Aug 27 04:41:59.978880 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1339/2708] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:59 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:00.215880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8b1bff9b-38fe-48ca-a691-a2a742ce385a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:00.218060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8b1bff9b-38fe-48ca-a691-a2a742ce385a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:00.221304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2cbeece-3689-4e3b-8cd9-2ed3f30a6309 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:00.230814 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2cbeece-3689-4e3b-8cd9-2ed3f30a6309 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1506 microversion: 2.1 time: 0.521068 Aug 27 04:42:00.232919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b1bff9b-38fe-48ca-a691-a2a742ce385a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:00.234332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b1bff9b-38fe-48ca-a691-a2a742ce385a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:00.236328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b1bff9b-38fe-48ca-a691-a2a742ce385a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:00.236946 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1370/2709] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:59 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:00.237706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b1bff9b-38fe-48ca-a691-a2a742ce385a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:00.241252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b1bff9b-38fe-48ca-a691-a2a742ce385a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:00.241765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-116423cc-dd37-4f3e-9480-7564aec8c560 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:00.242376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-116423cc-dd37-4f3e-9480-7564aec8c560 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:00.242582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b1bff9b-38fe-48ca-a691-a2a742ce385a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:00.257628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-116423cc-dd37-4f3e-9480-7564aec8c560 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:00.258132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-116423cc-dd37-4f3e-9480-7564aec8c560 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:00.258602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-116423cc-dd37-4f3e-9480-7564aec8c560 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:00.260041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-116423cc-dd37-4f3e-9480-7564aec8c560 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:00.260547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-116423cc-dd37-4f3e-9480-7564aec8c560 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:00.260986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-116423cc-dd37-4f3e-9480-7564aec8c560 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:00.501792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-116423cc-dd37-4f3e-9480-7564aec8c560 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:00.511537 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-116423cc-dd37-4f3e-9480-7564aec8c560 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1318 microversion: 2.1 time: 0.273399 Aug 27 04:42:00.524592 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1371/2710] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:00 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:00.530846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7e18764b-e6d2-48f6-89b3-c61287f46daa req-1e1ae6cc-e623-46ab-80fe-26ce83517225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629128a5-55ce-4184-8821-6dede5fd0081", "tag": "1def81ec-2b40-44c8-a429-c0786309e355"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:00.548974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7e18764b-e6d2-48f6-89b3-c61287f46daa req-1e1ae6cc-e623-46ab-80fe-26ce83517225 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:00.549496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7e18764b-e6d2-48f6-89b3-c61287f46daa req-1e1ae6cc-e623-46ab-80fe-26ce83517225 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:00.550174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7e18764b-e6d2-48f6-89b3-c61287f46daa req-1e1ae6cc-e623-46ab-80fe-26ce83517225 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:00.580689 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7e18764b-e6d2-48f6-89b3-c61287f46daa req-1e1ae6cc-e623-46ab-80fe-26ce83517225 service nova] Creating event network-changed:1def81ec-2b40-44c8-a429-c0786309e355 for instance 629128a5-55ce-4184-8821-6dede5fd0081 on n-h1-854823-1 Aug 27 04:42:00.601509 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7e18764b-e6d2-48f6-89b3-c61287f46daa req-1e1ae6cc-e623-46ab-80fe-26ce83517225 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087636 Aug 27 04:42:00.602338 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1372/2711] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:00.614328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05797336-8676-46b2-ae07-d606880612ca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:00.622535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05797336-8676-46b2-ae07-d606880612ca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:00.632058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05797336-8676-46b2-ae07-d606880612ca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:00.649195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05797336-8676-46b2-ae07-d606880612ca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:00.650596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05797336-8676-46b2-ae07-d606880612ca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:00.651394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05797336-8676-46b2-ae07-d606880612ca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:00.651874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05797336-8676-46b2-ae07-d606880612ca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:00.652305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05797336-8676-46b2-ae07-d606880612ca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:00.659881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:00.678446 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8b1bff9b-38fe-48ca-a691-a2a742ce385a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1531 microversion: 2.1 time: 0.698152 Aug 27 04:42:00.688880 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1340/2712] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:41:59 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1531 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:00.688880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd8d7da3-b686-4a2c-97aa-d5f7d11dd6ca tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.40"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:00.938040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fd8d7da3-b686-4a2c-97aa-d5f7d11dd6ca tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:00.944404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd8d7da3-b686-4a2c-97aa-d5f7d11dd6ca tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:00.944943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd8d7da3-b686-4a2c-97aa-d5f7d11dd6ca tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:00.945385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd8d7da3-b686-4a2c-97aa-d5f7d11dd6ca tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:00.946092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd8d7da3-b686-4a2c-97aa-d5f7d11dd6ca tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:00.946605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd8d7da3-b686-4a2c-97aa-d5f7d11dd6ca tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:00.949826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd8d7da3-b686-4a2c-97aa-d5f7d11dd6ca tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:00.955740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:01.596175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05797336-8676-46b2-ae07-d606880612ca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:01.611248 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-fd8d7da3-b686-4a2c-97aa-d5f7d11dd6ca tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] HTTP exception thrown: Floating IP 172.25.3.40 is not associated with instance 85c8d252-e69b-489b-86ff-6ca1eecec963. Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd8d7da3-b686-4a2c-97aa-d5f7d11dd6ca tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Request method failure captured: Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963/action HTTP/1.1 Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 48 Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaBMVE_l-KYKsL46xT9YdZNfYYjAzpB9qe8KP-kkSLR_k-eWbaBw90srQq1Sp9RhSVOWzUBG-Ym9GkfKdWBMUNJ9cIFnwSMRbyJNC3K3veYRXYtgYkkkE3JJgBfKUQx4XuOlxPW4tx0SjKDr73uY-GSy631NtquLcEWfAt-Ks0ZJ2xU Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 449305a5c79342058280f9482da58766 Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1064743616 Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/449305a5c79342058280f9482da58766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_449305a5c79342058280f9482da58766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/449305a5c79342058280f9482da58766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/449305a5c79342058280f9482da58766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1064743616 Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 449305a5c79342058280f9482da58766 Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1064743616 Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FloatingIPsAssociationTestJSON-1064743616-project Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 31386d6abd9b41f7a14a91f638331d95 Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1064743616-project Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: {"removeFloatingIp": {"address": "172.25.3.40"}} Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: exception: Floating IP 172.25.3.40 is not associated with instance 85c8d252-e69b-489b-86ff-6ca1eecec963. Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '85c8d252-e69b-489b-86ff-6ca1eecec963', 'body': {'removeFloatingIp': {'address': '172.25.3.40'}}} Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.40 is not associated with instance 85c8d252-e69b-489b-86ff-6ca1eecec963. Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.40 is not associated with instance 85c8d252-e69b-489b-86ff-6ca1eecec963. Aug 27 04:42:01.612974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:01.616720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd8d7da3-b686-4a2c-97aa-d5f7d11dd6ca tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Returning 409 to user: Floating IP 172.25.3.40 is not associated with instance 85c8d252-e69b-489b-86ff-6ca1eecec963. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:01.616720 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fd8d7da3-b686-4a2c-97aa-d5f7d11dd6ca tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "POST /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963/action" status: 409 len: 145 microversion: 2.1 time: 0.931220 Aug 27 04:42:01.616720 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1341/2713] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:42:00 2022] POST /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963/action => generated 145 bytes in 932 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:42:01.617263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05797336-8676-46b2-ae07-d606880612ca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:01.620085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-09ad9f57-b61b-4aa1-9b26-ab129150451e tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:01.623468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-09ad9f57-b61b-4aa1-9b26-ab129150451e tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:01.638026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ad9f57-b61b-4aa1-9b26-ab129150451e tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:01.638325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05797336-8676-46b2-ae07-d606880612ca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:01.638530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ad9f57-b61b-4aa1-9b26-ab129150451e tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:01.640301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ad9f57-b61b-4aa1-9b26-ab129150451e tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:01.641254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ad9f57-b61b-4aa1-9b26-ab129150451e tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:01.644172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ad9f57-b61b-4aa1-9b26-ab129150451e tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:01.644909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09ad9f57-b61b-4aa1-9b26-ab129150451e tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:01.647457 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05797336-8676-46b2-ae07-d606880612ca tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 200 len: 1548 microversion: 2.25 time: 1.037712 Aug 27 04:42:01.648076 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1373/2714] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:42:00 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 1548 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:01.677849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fffa541d-299e-44b3-be0d-60a679f4e92d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20ef4940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:01.772372 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fffa541d-299e-44b3-be0d-60a679f4e92d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1455 microversion: 2.1 time: 0.098260 Aug 27 04:42:01.773086 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1374/2715] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:01 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:01.786276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-773966f0-9511-4a22-9e9e-f1c6247a6679 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:01.791587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-773966f0-9511-4a22-9e9e-f1c6247a6679 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:01.819817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773966f0-9511-4a22-9e9e-f1c6247a6679 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:01.820320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773966f0-9511-4a22-9e9e-f1c6247a6679 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:01.820789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773966f0-9511-4a22-9e9e-f1c6247a6679 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:01.828874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773966f0-9511-4a22-9e9e-f1c6247a6679 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:01.830651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773966f0-9511-4a22-9e9e-f1c6247a6679 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:01.832496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773966f0-9511-4a22-9e9e-f1c6247a6679 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:02.002233 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-09ad9f57-b61b-4aa1-9b26-ab129150451e tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1531 microversion: 2.1 time: 0.386229 Aug 27 04:42:02.005770 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1342/2716] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:01 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1531 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:02.011287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a3cc0bf6-8b0c-4a9e-8182-54a05850217e req-91e0ddd5-4a97-482f-80aa-d8e31a86a5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3197b6a8-32ef-44cb-b1f3-f23b7a9677c4", "name": "network-vif-plugged", "status": "completed", "tag": "2f365edb-1055-4c11-b711-9765715d2b9d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:02.022974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a3cc0bf6-8b0c-4a9e-8182-54a05850217e req-91e0ddd5-4a97-482f-80aa-d8e31a86a5de service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:02.023797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a3cc0bf6-8b0c-4a9e-8182-54a05850217e req-91e0ddd5-4a97-482f-80aa-d8e31a86a5de service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:02.024396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a3cc0bf6-8b0c-4a9e-8182-54a05850217e req-91e0ddd5-4a97-482f-80aa-d8e31a86a5de service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:02.036937 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a3cc0bf6-8b0c-4a9e-8182-54a05850217e req-91e0ddd5-4a97-482f-80aa-d8e31a86a5de service nova] Creating event network-vif-plugged:2f365edb-1055-4c11-b711-9765715d2b9d for instance 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4 on n-h1-854823-1 Aug 27 04:42:02.044155 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a3cc0bf6-8b0c-4a9e-8182-54a05850217e req-91e0ddd5-4a97-482f-80aa-d8e31a86a5de service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036717 Aug 27 04:42:02.045365 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1343/2717] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:02.054372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fbdd6678-4c2c-4afe-bc2d-ab7fbfc106c3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:02.071435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fbdd6678-4c2c-4afe-bc2d-ab7fbfc106c3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:02.087736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbdd6678-4c2c-4afe-bc2d-ab7fbfc106c3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:02.091588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbdd6678-4c2c-4afe-bc2d-ab7fbfc106c3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:02.093939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbdd6678-4c2c-4afe-bc2d-ab7fbfc106c3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:02.095833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbdd6678-4c2c-4afe-bc2d-ab7fbfc106c3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:02.098469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbdd6678-4c2c-4afe-bc2d-ab7fbfc106c3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:02.099071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbdd6678-4c2c-4afe-bc2d-ab7fbfc106c3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:02.534015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fbdd6678-4c2c-4afe-bc2d-ab7fbfc106c3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:02.549863 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fbdd6678-4c2c-4afe-bc2d-ab7fbfc106c3 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1505 microversion: 2.1 time: 0.501393 Aug 27 04:42:02.570636 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1344/2718] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:02 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:02.578517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ca8f5bba-d2af-47ad-a20a-ab704224e0f2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.40"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:02.879964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ca8f5bba-d2af-47ad-a20a-ab704224e0f2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:02.886907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca8f5bba-d2af-47ad-a20a-ab704224e0f2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:02.887689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca8f5bba-d2af-47ad-a20a-ab704224e0f2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:02.893533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca8f5bba-d2af-47ad-a20a-ab704224e0f2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:02.894706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca8f5bba-d2af-47ad-a20a-ab704224e0f2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:02.895356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca8f5bba-d2af-47ad-a20a-ab704224e0f2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:02.895956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca8f5bba-d2af-47ad-a20a-ab704224e0f2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:03.030575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-773966f0-9511-4a22-9e9e-f1c6247a6679 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:03.039769 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-773966f0-9511-4a22-9e9e-f1c6247a6679 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1527 microversion: 2.1 time: 1.265625 Aug 27 04:42:03.052771 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1375/2719] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:01 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1527 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:03.104926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9566903e-0ab1-4ef8-a62d-5c1c998e9a47 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:03.104926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9566903e-0ab1-4ef8-a62d-5c1c998e9a47 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:03.104926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9566903e-0ab1-4ef8-a62d-5c1c998e9a47 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:03.104926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9566903e-0ab1-4ef8-a62d-5c1c998e9a47 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:03.104926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9566903e-0ab1-4ef8-a62d-5c1c998e9a47 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:03.104926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9566903e-0ab1-4ef8-a62d-5c1c998e9a47 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:03.104926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9566903e-0ab1-4ef8-a62d-5c1c998e9a47 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:03.104926 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9566903e-0ab1-4ef8-a62d-5c1c998e9a47 tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048552 Aug 27 04:42:03.108989 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1376/2720] 10.222.0.79 () {58 vars in 1176 bytes} [Sat Aug 27 04:42:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:03.116218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4467e78-2af5-4aa9-8b8b-bfdd53208d60 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:03.116945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4467e78-2af5-4aa9-8b8b-bfdd53208d60 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:03.126660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4467e78-2af5-4aa9-8b8b-bfdd53208d60 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:03.132960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4467e78-2af5-4aa9-8b8b-bfdd53208d60 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:03.133443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4467e78-2af5-4aa9-8b8b-bfdd53208d60 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:03.134265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4467e78-2af5-4aa9-8b8b-bfdd53208d60 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:03.134736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4467e78-2af5-4aa9-8b8b-bfdd53208d60 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:03.135165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4467e78-2af5-4aa9-8b8b-bfdd53208d60 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:03.335913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca8f5bba-d2af-47ad-a20a-ab704224e0f2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "refresh_cache-629128a5-55ce-4184-8821-6dede5fd0081" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:42:03.339248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca8f5bba-d2af-47ad-a20a-ab704224e0f2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquired lock "refresh_cache-629128a5-55ce-4184-8821-6dede5fd0081" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:42:03.531890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4467e78-2af5-4aa9-8b8b-bfdd53208d60 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:03.542188 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4467e78-2af5-4aa9-8b8b-bfdd53208d60 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/3197b6a8-32ef-44cb-b1f3-f23b7a9677c4" status: 200 len: 1318 microversion: 2.1 time: 0.431969 Aug 27 04:42:03.562302 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1377/2721] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:03 2022] GET /compute/v2.1/servers/3197b6a8-32ef-44cb-b1f3-f23b7a9677c4 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:03.567386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee0ee17f-908a-421a-bf0c-e8a615420bc7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:03.568010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee0ee17f-908a-421a-bf0c-e8a615420bc7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 993886de-4066-4da7-9768-ad92fdea6cc2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:03.580813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0ee17f-908a-421a-bf0c-e8a615420bc7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:03.581318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0ee17f-908a-421a-bf0c-e8a615420bc7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:03.581764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0ee17f-908a-421a-bf0c-e8a615420bc7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:03.583391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0ee17f-908a-421a-bf0c-e8a615420bc7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:03.583391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0ee17f-908a-421a-bf0c-e8a615420bc7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:03.583391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0ee17f-908a-421a-bf0c-e8a615420bc7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:03.620755 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ee0ee17f-908a-421a-bf0c-e8a615420bc7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] HTTP exception thrown: Instance 993886de-4066-4da7-9768-ad92fdea6cc2 could not be found. Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee0ee17f-908a-421a-bf0c-e8a615420bc7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Request method failure captured: Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 HTTP/1.1 Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ6kU1BsVnQt_zRKICUC7ruDaiNUqIGtFnVSGvnisX4tJZH290wng_sg4R_OQ3pLxBfwcJUWL076bQIFvkpyAmLUnZPhm65I39UrLlta392dZ8xnek4ChpZ_zueUdLpU4LTERpikeRJp50XLG6D7Rigg7KCsXQPWGN87EreaUvtZup4 Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 002ba94e9b364c3e8784927de5770ed1 Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1027428516 Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1027428516 Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 002ba94e9b364c3e8784927de5770ed1 Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1027428516 Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-LiveAutoBlockMigrationV225Test-1027428516-project Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 1d3d23499c474adaa7fe3a2260f5ec36 Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1027428516-project Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 993886de-4066-4da7-9768-ad92fdea6cc2 could not be found. Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '993886de-4066-4da7-9768-ad92fdea6cc2'} Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993886de-4066-4da7-9768-ad92fdea6cc2 could not be found. Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993886de-4066-4da7-9768-ad92fdea6cc2 could not be found. Aug 27 04:42:03.622616 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:03.628123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:03.628123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:03.628123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:03.628123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:03.628123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:03.628123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:42:03.628123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:42:03.628123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993886de-4066-4da7-9768-ad92fdea6cc2 could not be found. Aug 27 04:42:03.628123 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:03.628123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee0ee17f-908a-421a-bf0c-e8a615420bc7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Returning 404 to user: Instance 993886de-4066-4da7-9768-ad92fdea6cc2 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:03.628123 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee0ee17f-908a-421a-bf0c-e8a615420bc7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2" status: 404 len: 111 microversion: 2.25 time: 0.060685 Aug 27 04:42:03.631611 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1378/2722] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:42:03 2022] GET /compute/v2.1/servers/993886de-4066-4da7-9768-ad92fdea6cc2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:42:03.643119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-da5a85c6-7375-49fe-88d4-818defe5b14d req-4a213010-ea4a-481c-b7b6-1d45f692d42c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993886de-4066-4da7-9768-ad92fdea6cc2", "name": "network-vif-deleted", "tag": "fe518eb7-32a5-415b-a705-ace010eb9348"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:03.671253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-da5a85c6-7375-49fe-88d4-818defe5b14d req-4a213010-ea4a-481c-b7b6-1d45f692d42c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:03.671791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-da5a85c6-7375-49fe-88d4-818defe5b14d req-4a213010-ea4a-481c-b7b6-1d45f692d42c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:03.672238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-da5a85c6-7375-49fe-88d4-818defe5b14d req-4a213010-ea4a-481c-b7b6-1d45f692d42c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:03.689186 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-da5a85c6-7375-49fe-88d4-818defe5b14d req-4a213010-ea4a-481c-b7b6-1d45f692d42c service nova] Creating event network-vif-deleted:fe518eb7-32a5-415b-a705-ace010eb9348 for instance 993886de-4066-4da7-9768-ad92fdea6cc2 on n-h2-854823-1 Aug 27 04:42:03.708580 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-da5a85c6-7375-49fe-88d4-818defe5b14d req-4a213010-ea4a-481c-b7b6-1d45f692d42c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075493 Aug 27 04:42:03.710244 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1379/2723] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:03.717971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18aff9f2-e166-46b1-a8f3-4b63af3d336d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20ed5940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:03.820641 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18aff9f2-e166-46b1-a8f3-4b63af3d336d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1455 microversion: 2.1 time: 0.109188 Aug 27 04:42:03.822807 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1380/2724] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:03 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:03.835435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60de4171-018c-4786-ad88-4d06f95fb42a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854823-1", "block_migration": false, "disk_over_commit": false}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:03.839318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60de4171-018c-4786-ad88-4d06f95fb42a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:03.855766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60de4171-018c-4786-ad88-4d06f95fb42a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:03.858398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60de4171-018c-4786-ad88-4d06f95fb42a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:03.859056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60de4171-018c-4786-ad88-4d06f95fb42a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:03.859961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60de4171-018c-4786-ad88-4d06f95fb42a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:03.865666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60de4171-018c-4786-ad88-4d06f95fb42a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:03.866291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60de4171-018c-4786-ad88-4d06f95fb42a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:03.921544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-60de4171-018c-4786-ad88-4d06f95fb42a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lazy-loading 'flavor' on Instance uuid c3c1a9e4-475f-4c6a-bf72-653e8fc46611 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:42:03.948556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60de4171-018c-4786-ad88-4d06f95fb42a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Going to try to live migrate instance to n-h1-854823-1 {{(pid=128869) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 04:42:04.835731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-ca8f5bba-d2af-47ad-a20a-ab704224e0f2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Building network info cache for instance {{(pid=128870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:42:07.727320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-ca8f5bba-d2af-47ad-a20a-ab704224e0f2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Updating instance_info_cache with network_info: [{"id": "1def81ec-2b40-44c8-a429-c0786309e355", "address": "fa:16:3e:96:39:ee", "network": {"id": "bcedcbbe-f9e5-425b-a145-0aa42ef36186", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1734361074-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "449305a5c79342058280f9482da58766", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1def81ec-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:42:07.746763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca8f5bba-d2af-47ad-a20a-ab704224e0f2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Releasing lock "refresh_cache-629128a5-55ce-4184-8821-6dede5fd0081" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:42:07.752237 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ca8f5bba-d2af-47ad-a20a-ab704224e0f2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "POST /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081/action" status: 202 len: 0 microversion: 2.1 time: 5.176067 Aug 27 04:42:07.753699 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1345/2725] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:42:02 2022] POST /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081/action => generated 0 bytes in 5183 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 04:42:07.770903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a78d216f-69bc-4524-a552-1cba21353bf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:07.774299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a78d216f-69bc-4524-a552-1cba21353bf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:07.794784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78d216f-69bc-4524-a552-1cba21353bf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:07.795281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78d216f-69bc-4524-a552-1cba21353bf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:07.795732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78d216f-69bc-4524-a552-1cba21353bf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:07.801615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78d216f-69bc-4524-a552-1cba21353bf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:07.802679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78d216f-69bc-4524-a552-1cba21353bf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:07.804393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78d216f-69bc-4524-a552-1cba21353bf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:07.875793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a78d216f-69bc-4524-a552-1cba21353bf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:42:08.067349 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a78d216f-69bc-4524-a552-1cba21353bf7 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "DELETE /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 204 len: 0 microversion: 2.25 time: 0.308158 Aug 27 04:42:08.074496 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1346/2726] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:42:07 2022] DELETE /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:42:08.097557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2d861844-72ec-499f-9f02-4524d3f31369 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:08.101211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2d861844-72ec-499f-9f02-4524d3f31369 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:08.124551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d861844-72ec-499f-9f02-4524d3f31369 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:08.130739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d861844-72ec-499f-9f02-4524d3f31369 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:08.132927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d861844-72ec-499f-9f02-4524d3f31369 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:08.135150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d861844-72ec-499f-9f02-4524d3f31369 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:08.139071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d861844-72ec-499f-9f02-4524d3f31369 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:08.140902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d861844-72ec-499f-9f02-4524d3f31369 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:08.295970 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60de4171-018c-4786-ad88-4d06f95fb42a tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611/action" status: 202 len: 0 microversion: 2.1 time: 4.471882 Aug 27 04:42:08.298114 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1381/2727] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:42:03 2022] POST /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611/action => generated 0 bytes in 4474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:42:08.308153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-413a0534-7f23-4efb-9914-dcd5d6640687 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:08.330847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-413a0534-7f23-4efb-9914-dcd5d6640687 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:08.365958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-413a0534-7f23-4efb-9914-dcd5d6640687 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:08.372375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-413a0534-7f23-4efb-9914-dcd5d6640687 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:08.383193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-413a0534-7f23-4efb-9914-dcd5d6640687 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:08.387493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-413a0534-7f23-4efb-9914-dcd5d6640687 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:08.388640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-413a0534-7f23-4efb-9914-dcd5d6640687 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:08.392037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-413a0534-7f23-4efb-9914-dcd5d6640687 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:08.900992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-413a0534-7f23-4efb-9914-dcd5d6640687 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:08.912267 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-413a0534-7f23-4efb-9914-dcd5d6640687 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/3197b6a8-32ef-44cb-b1f3-f23b7a9677c4" status: 200 len: 1506 microversion: 2.1 time: 0.610476 Aug 27 04:42:08.914259 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1382/2728] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:08 2022] GET /compute/v2.1/servers/3197b6a8-32ef-44cb-b1f3-f23b7a9677c4 => generated 1506 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:08.919074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2f74ec9-2ad7-4b20-9403-7e76d545a9c9 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f218ecb80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:09.329257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2d861844-72ec-499f-9f02-4524d3f31369 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:09.343318 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2d861844-72ec-499f-9f02-4524d3f31369 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1522 microversion: 2.1 time: 1.266109 Aug 27 04:42:09.365290 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1347/2729] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:08 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1522 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:09.370821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-51132d40-832f-4b47-8b23-8f3ac37ca872 req-dfafb5d8-6b7c-457f-b8ce-474d690fd562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629128a5-55ce-4184-8821-6dede5fd0081", "tag": "1def81ec-2b40-44c8-a429-c0786309e355"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:09.381562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-51132d40-832f-4b47-8b23-8f3ac37ca872 req-dfafb5d8-6b7c-457f-b8ce-474d690fd562 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:09.382422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-51132d40-832f-4b47-8b23-8f3ac37ca872 req-dfafb5d8-6b7c-457f-b8ce-474d690fd562 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:09.383056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-51132d40-832f-4b47-8b23-8f3ac37ca872 req-dfafb5d8-6b7c-457f-b8ce-474d690fd562 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:09.411941 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-51132d40-832f-4b47-8b23-8f3ac37ca872 req-dfafb5d8-6b7c-457f-b8ce-474d690fd562 service nova] Creating event network-changed:1def81ec-2b40-44c8-a429-c0786309e355 for instance 629128a5-55ce-4184-8821-6dede5fd0081 on n-h1-854823-1 Aug 27 04:42:09.423164 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-51132d40-832f-4b47-8b23-8f3ac37ca872 req-dfafb5d8-6b7c-457f-b8ce-474d690fd562 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055620 Aug 27 04:42:09.425434 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1348/2730] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:09.441995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a5dd6b08-faaa-4c38-bac6-c8e9f71d0a67 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:09.443215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a5dd6b08-faaa-4c38-bac6-c8e9f71d0a67 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:09.453587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5dd6b08-faaa-4c38-bac6-c8e9f71d0a67 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:09.454527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5dd6b08-faaa-4c38-bac6-c8e9f71d0a67 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:09.455260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5dd6b08-faaa-4c38-bac6-c8e9f71d0a67 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:09.464338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5dd6b08-faaa-4c38-bac6-c8e9f71d0a67 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:09.466543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5dd6b08-faaa-4c38-bac6-c8e9f71d0a67 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:09.467085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5dd6b08-faaa-4c38-bac6-c8e9f71d0a67 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:09.543964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a5dd6b08-faaa-4c38-bac6-c8e9f71d0a67 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:42:09.784516 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a5dd6b08-faaa-4c38-bac6-c8e9f71d0a67 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "DELETE /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 204 len: 0 microversion: 2.1 time: 0.348273 Aug 27 04:42:09.787647 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1349/2731] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:42:09 2022] DELETE /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:42:09.805180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bb58cfce-ef82-4dc3-975d-6e2e710a9d76 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:09.806458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bb58cfce-ef82-4dc3-975d-6e2e710a9d76 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:09.823506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb58cfce-ef82-4dc3-975d-6e2e710a9d76 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:09.824202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb58cfce-ef82-4dc3-975d-6e2e710a9d76 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:09.824913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb58cfce-ef82-4dc3-975d-6e2e710a9d76 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:09.825798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb58cfce-ef82-4dc3-975d-6e2e710a9d76 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:09.826410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb58cfce-ef82-4dc3-975d-6e2e710a9d76 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:09.827185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb58cfce-ef82-4dc3-975d-6e2e710a9d76 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:09.984958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bb58cfce-ef82-4dc3-975d-6e2e710a9d76 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:09.999226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bb58cfce-ef82-4dc3-975d-6e2e710a9d76 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:10.009205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bb58cfce-ef82-4dc3-975d-6e2e710a9d76 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3d23499c474adaa7fe3a2260f5ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ba94e9b364c3e8784927de5770ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:10.012751 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bb58cfce-ef82-4dc3-975d-6e2e710a9d76 tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 200 len: 1522 microversion: 2.25 time: 0.221846 Aug 27 04:42:10.027872 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1350/2732] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:42:09 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:10.030379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4ac4d1d1-f112-4015-a92c-f397e0010499 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:10.031062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4ac4d1d1-f112-4015-a92c-f397e0010499 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:10.047897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ac4d1d1-f112-4015-a92c-f397e0010499 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:10.048459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ac4d1d1-f112-4015-a92c-f397e0010499 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:10.049161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ac4d1d1-f112-4015-a92c-f397e0010499 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:10.053055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ac4d1d1-f112-4015-a92c-f397e0010499 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:10.053651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ac4d1d1-f112-4015-a92c-f397e0010499 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:10.060549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ac4d1d1-f112-4015-a92c-f397e0010499 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:10.477050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4ac4d1d1-f112-4015-a92c-f397e0010499 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:10.511893 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4ac4d1d1-f112-4015-a92c-f397e0010499 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.497238 Aug 27 04:42:10.532849 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1351/2733] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:10 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:10.545545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8cd2744f-58cc-4c91-9742-0744dc3b24dd tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:10.546132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8cd2744f-58cc-4c91-9742-0744dc3b24dd tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:10.581487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cd2744f-58cc-4c91-9742-0744dc3b24dd tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:10.582157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cd2744f-58cc-4c91-9742-0744dc3b24dd tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:10.582619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cd2744f-58cc-4c91-9742-0744dc3b24dd tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:10.583479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cd2744f-58cc-4c91-9742-0744dc3b24dd tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:10.584008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cd2744f-58cc-4c91-9742-0744dc3b24dd tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:10.584575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cd2744f-58cc-4c91-9742-0744dc3b24dd tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:10.621328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8cd2744f-58cc-4c91-9742-0744dc3b24dd tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:42:10.784700 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8cd2744f-58cc-4c91-9742-0744dc3b24dd tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3197b6a8-32ef-44cb-b1f3-f23b7a9677c4" status: 204 len: 0 microversion: 2.1 time: 0.249517 Aug 27 04:42:10.788660 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1352/2734] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:42:10 2022] DELETE /compute/v2.1/servers/3197b6a8-32ef-44cb-b1f3-f23b7a9677c4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:42:10.799407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1966ecb2-7f1a-4107-9038-c9f7ba289ebc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.40"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:10.811670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1966ecb2-7f1a-4107-9038-c9f7ba289ebc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:10.828686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1966ecb2-7f1a-4107-9038-c9f7ba289ebc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:10.829385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1966ecb2-7f1a-4107-9038-c9f7ba289ebc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:10.829837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1966ecb2-7f1a-4107-9038-c9f7ba289ebc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:10.830666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1966ecb2-7f1a-4107-9038-c9f7ba289ebc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:10.836788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1966ecb2-7f1a-4107-9038-c9f7ba289ebc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:10.839988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1966ecb2-7f1a-4107-9038-c9f7ba289ebc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:10.896399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:10.921277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1966ecb2-7f1a-4107-9038-c9f7ba289ebc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "refresh_cache-85c8d252-e69b-489b-86ff-6ca1eecec963" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:42:10.927288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1966ecb2-7f1a-4107-9038-c9f7ba289ebc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquired lock "refresh_cache-85c8d252-e69b-489b-86ff-6ca1eecec963" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:42:13.076326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:14.098798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-1966ecb2-7f1a-4107-9038-c9f7ba289ebc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Building network info cache for instance {{(pid=128870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:42:16.299671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-1966ecb2-7f1a-4107-9038-c9f7ba289ebc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Updating instance_info_cache with network_info: [{"id": "294de1ec-f506-40c1-a6ae-379dd686a18a", "address": "fa:16:3e:28:75:aa", "network": {"id": "bcedcbbe-f9e5-425b-a145-0aa42ef36186", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1734361074-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "449305a5c79342058280f9482da58766", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap294de1ec-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:42:16.332834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1966ecb2-7f1a-4107-9038-c9f7ba289ebc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Releasing lock "refresh_cache-85c8d252-e69b-489b-86ff-6ca1eecec963" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:42:16.334277 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1966ecb2-7f1a-4107-9038-c9f7ba289ebc tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "POST /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963/action" status: 202 len: 0 microversion: 2.1 time: 5.544851 Aug 27 04:42:16.335473 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1353/2735] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:42:10 2022] POST /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963/action => generated 0 bytes in 5549 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 04:42:16.342249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-21c9a642-78cf-42bc-8fff-3dd4e5ec258c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:16.347175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-21c9a642-78cf-42bc-8fff-3dd4e5ec258c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:16.350400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:16.370081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21c9a642-78cf-42bc-8fff-3dd4e5ec258c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:16.371564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21c9a642-78cf-42bc-8fff-3dd4e5ec258c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:16.372581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21c9a642-78cf-42bc-8fff-3dd4e5ec258c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:16.375699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21c9a642-78cf-42bc-8fff-3dd4e5ec258c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:16.377291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21c9a642-78cf-42bc-8fff-3dd4e5ec258c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:16.378217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21c9a642-78cf-42bc-8fff-3dd4e5ec258c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:16.756397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-21c9a642-78cf-42bc-8fff-3dd4e5ec258c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:16.769103 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-21c9a642-78cf-42bc-8fff-3dd4e5ec258c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1522 microversion: 2.1 time: 0.432102 Aug 27 04:42:16.775718 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1354/2736] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:16 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:16.784084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8f76dd09-f325-4587-aab3-010e4671fc47 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:16.784623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8f76dd09-f325-4587-aab3-010e4671fc47 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:16.804690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f76dd09-f325-4587-aab3-010e4671fc47 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:16.805026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f76dd09-f325-4587-aab3-010e4671fc47 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:16.805495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f76dd09-f325-4587-aab3-010e4671fc47 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:16.806229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f76dd09-f325-4587-aab3-010e4671fc47 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:16.806685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f76dd09-f325-4587-aab3-010e4671fc47 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:16.807105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f76dd09-f325-4587-aab3-010e4671fc47 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:16.888569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8f76dd09-f325-4587-aab3-010e4671fc47 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:42:17.200353 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8f76dd09-f325-4587-aab3-010e4671fc47 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 204 len: 0 microversion: 2.1 time: 0.420971 Aug 27 04:42:17.210275 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1355/2737] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:42:16 2022] DELETE /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:42:17.241395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b9b54967-6ea5-44bb-a5ac-71e14e84c21a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:17.242690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b9b54967-6ea5-44bb-a5ac-71e14e84c21a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] [instance: 686b50ec-d768-4cc2-bb93-e92096bc7ba0] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:17.273815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9b54967-6ea5-44bb-a5ac-71e14e84c21a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:17.274943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9b54967-6ea5-44bb-a5ac-71e14e84c21a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:17.275403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9b54967-6ea5-44bb-a5ac-71e14e84c21a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:17.276145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9b54967-6ea5-44bb-a5ac-71e14e84c21a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:17.276648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9b54967-6ea5-44bb-a5ac-71e14e84c21a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:17.277201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9b54967-6ea5-44bb-a5ac-71e14e84c21a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:17.335833 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-b9b54967-6ea5-44bb-a5ac-71e14e84c21a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] HTTP exception thrown: Instance 686b50ec-d768-4cc2-bb93-e92096bc7ba0 could not be found. Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b9b54967-6ea5-44bb-a5ac-71e14e84c21a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Request method failure captured: Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 HTTP/1.1 Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ6kU1BsVnQt_zRKICUC7ruDaiNUqIGtFnVSGvnisX4tJZH290wng_sg4R_OQ3pLxBfwcJUWL076bQIFvkpyAmLUnZPhm65I39UrLlta392dZ8xnek4ChpZ_zueUdLpU4LTERpikeRJp50XLG6D7Rigg7KCsXQPWGN87EreaUvtZup4 Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 002ba94e9b364c3e8784927de5770ed1 Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1027428516 Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/002ba94e9b364c3e8784927de5770ed1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1027428516 Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 002ba94e9b364c3e8784927de5770ed1 Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1027428516 Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-LiveAutoBlockMigrationV225Test-1027428516-project Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 1d3d23499c474adaa7fe3a2260f5ec36 Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1027428516-project Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 686b50ec-d768-4cc2-bb93-e92096bc7ba0 could not be found. Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '686b50ec-d768-4cc2-bb93-e92096bc7ba0'} Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 686b50ec-d768-4cc2-bb93-e92096bc7ba0 could not be found. Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 686b50ec-d768-4cc2-bb93-e92096bc7ba0 could not be found. Aug 27 04:42:17.338134 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:17.342102 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:17.342102 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:17.342102 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:17.342102 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:17.342102 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:17.342102 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:42:17.342102 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:42:17.342102 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 686b50ec-d768-4cc2-bb93-e92096bc7ba0 could not be found. Aug 27 04:42:17.342102 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:17.342102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b9b54967-6ea5-44bb-a5ac-71e14e84c21a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] Returning 404 to user: Instance 686b50ec-d768-4cc2-bb93-e92096bc7ba0 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:17.342102 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b9b54967-6ea5-44bb-a5ac-71e14e84c21a tempest-LiveAutoBlockMigrationV225Test-1027428516 tempest-LiveAutoBlockMigrationV225Test-1027428516-project] 10.222.0.79 "GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0" status: 404 len: 111 microversion: 2.25 time: 0.122522 Aug 27 04:42:17.368163 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1356/2738] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:42:17 2022] GET /compute/v2.1/servers/686b50ec-d768-4cc2-bb93-e92096bc7ba0 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:42:17.373948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-837fdb77-05ee-42dc-bad6-8ee6a9479eee req-c42383ab-b4c4-4c8a-8f41-9160f6c09f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4549183c-6ddf-442e-a0fd-6abba4b648c3", "name": "network-vif-plugged", "status": "completed", "tag": "58521f19-b6b8-4427-a0d6-6704d0cec337"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:17.416102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-837fdb77-05ee-42dc-bad6-8ee6a9479eee req-c42383ab-b4c4-4c8a-8f41-9160f6c09f17 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:17.416607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-837fdb77-05ee-42dc-bad6-8ee6a9479eee req-c42383ab-b4c4-4c8a-8f41-9160f6c09f17 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:17.425205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-837fdb77-05ee-42dc-bad6-8ee6a9479eee req-c42383ab-b4c4-4c8a-8f41-9160f6c09f17 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:17.469011 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-837fdb77-05ee-42dc-bad6-8ee6a9479eee req-c42383ab-b4c4-4c8a-8f41-9160f6c09f17 service nova] Creating event network-vif-plugged:58521f19-b6b8-4427-a0d6-6704d0cec337 for instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 on n-h2-854823-1 Aug 27 04:42:17.495044 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-837fdb77-05ee-42dc-bad6-8ee6a9479eee req-c42383ab-b4c4-4c8a-8f41-9160f6c09f17 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124906 Aug 27 04:42:17.498965 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1357/2739] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:17.519076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a7c644b6-1e55-4ee4-8367-5e0b4518ecf7 req-10917d4b-5d78-4bb3-80e3-c7a365df57d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686b50ec-d768-4cc2-bb93-e92096bc7ba0", "name": "network-vif-deleted", "tag": "c861cdbe-63fe-49f8-bb14-9b4c752f86d7"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:17.542765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a7c644b6-1e55-4ee4-8367-5e0b4518ecf7 req-10917d4b-5d78-4bb3-80e3-c7a365df57d7 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:17.545832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a7c644b6-1e55-4ee4-8367-5e0b4518ecf7 req-10917d4b-5d78-4bb3-80e3-c7a365df57d7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:17.546576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a7c644b6-1e55-4ee4-8367-5e0b4518ecf7 req-10917d4b-5d78-4bb3-80e3-c7a365df57d7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:17.580755 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a7c644b6-1e55-4ee4-8367-5e0b4518ecf7 req-10917d4b-5d78-4bb3-80e3-c7a365df57d7 service nova] Creating event network-vif-deleted:c861cdbe-63fe-49f8-bb14-9b4c752f86d7 for instance 686b50ec-d768-4cc2-bb93-e92096bc7ba0 on n-h2-854823-1 Aug 27 04:42:17.594634 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a7c644b6-1e55-4ee4-8367-5e0b4518ecf7 req-10917d4b-5d78-4bb3-80e3-c7a365df57d7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091485 Aug 27 04:42:17.596800 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1358/2740] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:17.620996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1759cf3c-47bf-4aa3-b920-db307dc2e045 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:17.622841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1759cf3c-47bf-4aa3-b920-db307dc2e045 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:17.649984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1759cf3c-47bf-4aa3-b920-db307dc2e045 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:17.661298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1759cf3c-47bf-4aa3-b920-db307dc2e045 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:17.665588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1759cf3c-47bf-4aa3-b920-db307dc2e045 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:17.666728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1759cf3c-47bf-4aa3-b920-db307dc2e045 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:17.667428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1759cf3c-47bf-4aa3-b920-db307dc2e045 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:17.668098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1759cf3c-47bf-4aa3-b920-db307dc2e045 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:18.323538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1759cf3c-47bf-4aa3-b920-db307dc2e045 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:18.323538 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1759cf3c-47bf-4aa3-b920-db307dc2e045 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.711759 Aug 27 04:42:18.323538 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1359/2741] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:17 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:18.337749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:18.474081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-9962e2d5-3960-4417-a09b-54c8ef8582c3 req-23ee93c1-a89f-46c7-9624-741180b386ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3197b6a8-32ef-44cb-b1f3-f23b7a9677c4", "name": "network-vif-deleted", "tag": "2f365edb-1055-4c11-b711-9765715d2b9d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:18.530029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9962e2d5-3960-4417-a09b-54c8ef8582c3 req-23ee93c1-a89f-46c7-9624-741180b386ee service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:18.530536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9962e2d5-3960-4417-a09b-54c8ef8582c3 req-23ee93c1-a89f-46c7-9624-741180b386ee service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:18.537096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9962e2d5-3960-4417-a09b-54c8ef8582c3 req-23ee93c1-a89f-46c7-9624-741180b386ee service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:18.593584 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-9962e2d5-3960-4417-a09b-54c8ef8582c3 req-23ee93c1-a89f-46c7-9624-741180b386ee service nova] Creating event network-vif-deleted:2f365edb-1055-4c11-b711-9765715d2b9d for instance 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4 on n-h1-854823-1 Aug 27 04:42:18.609693 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-9962e2d5-3960-4417-a09b-54c8ef8582c3 req-23ee93c1-a89f-46c7-9624-741180b386ee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294054 Aug 27 04:42:18.619333 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1360/2742] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:18.625004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0c9be315-b069-4239-81e2-e84bce70a2c2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '.version_select at 0x7f1f21a05700>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:18.910579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:19.759858 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0c9be315-b069-4239-81e2-e84bce70a2c2 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/73e12a6c-0dcd-4f5d-b273-50d44d68e128" status: 200 len: 184 microversion: 2.1 time: 1.139149 Aug 27 04:42:19.761933 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1361/2743] 10.222.0.79 () {58 vars in 1260 bytes} [Sat Aug 27 04:42:18 2022] GET /compute/v2.1/os-floating-ips/73e12a6c-0dcd-4f5d-b273-50d44d68e128 => generated 184 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:19.766886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f595d0bc-6ad8-4e51-85ae-5193a4674421 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:19.767942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f595d0bc-6ad8-4e51-85ae-5193a4674421 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:19.783562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f595d0bc-6ad8-4e51-85ae-5193a4674421 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:19.788897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f595d0bc-6ad8-4e51-85ae-5193a4674421 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:19.790249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f595d0bc-6ad8-4e51-85ae-5193a4674421 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:19.793979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f595d0bc-6ad8-4e51-85ae-5193a4674421 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:19.794794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f595d0bc-6ad8-4e51-85ae-5193a4674421 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:19.795458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f595d0bc-6ad8-4e51-85ae-5193a4674421 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:19.828618 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-f595d0bc-6ad8-4e51-85ae-5193a4674421 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] HTTP exception thrown: Instance 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4 could not be found. Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f595d0bc-6ad8-4e51-85ae-5193a4674421 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Request method failure captured: Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/3197b6a8-32ef-44cb-b1f3-f23b7a9677c4 HTTP/1.1 Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaBdzJxg3-nI85J2rTtzDNJ0YpbyEVqGjCogTvt761TL7VlquGUGP-2SMMm7-R0a-VwKbzf6npDTrPrNY-Yb6lel5YQKbpoqGh0ibzq2NONbmAkUgl_63y2LXirrYqafl1wxfonL2DSTiFgg9LHoPoJIFQhrgj1Yko8rbMiU5ZitS4U Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 31d3333b4ddd41e2a8afc3a4506894c5 Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-MultipleCreateTestJSON-2079813281 Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/31d3333b4ddd41e2a8afc3a4506894c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_31d3333b4ddd41e2a8afc3a4506894c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/31d3333b4ddd41e2a8afc3a4506894c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/31d3333b4ddd41e2a8afc3a4506894c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-MultipleCreateTestJSON-2079813281 Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 31d3333b4ddd41e2a8afc3a4506894c5 Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2079813281 Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-MultipleCreateTestJSON-2079813281-project Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 180ae8cc1dcc4076ab73bb564b49eba5 Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-MultipleCreateTestJSON-2079813281-project Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4 could not be found. Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '3197b6a8-32ef-44cb-b1f3-f23b7a9677c4'} Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4 could not be found. Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4 could not be found. Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:19.848949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:19.854864 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:19.854864 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:19.854864 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:19.854864 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:42:19.854864 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:42:19.854864 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4 could not be found. Aug 27 04:42:19.854864 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:19.854864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f595d0bc-6ad8-4e51-85ae-5193a4674421 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Returning 404 to user: Instance 3197b6a8-32ef-44cb-b1f3-f23b7a9677c4 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:19.854864 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f595d0bc-6ad8-4e51-85ae-5193a4674421 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/3197b6a8-32ef-44cb-b1f3-f23b7a9677c4" status: 404 len: 111 microversion: 2.1 time: 0.091707 Aug 27 04:42:19.858978 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1362/2744] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:19 2022] GET /compute/v2.1/servers/3197b6a8-32ef-44cb-b1f3-f23b7a9677c4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:42:19.878154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-742eb574-8e46-41d2-8916-815b84b5e8b8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:19.882945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-742eb574-8e46-41d2-8916-815b84b5e8b8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:19.910234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742eb574-8e46-41d2-8916-815b84b5e8b8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:19.913254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742eb574-8e46-41d2-8916-815b84b5e8b8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:19.917037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742eb574-8e46-41d2-8916-815b84b5e8b8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:19.926636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742eb574-8e46-41d2-8916-815b84b5e8b8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:19.927585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742eb574-8e46-41d2-8916-815b84b5e8b8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:19.928284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742eb574-8e46-41d2-8916-815b84b5e8b8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:20.988124 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2f74ec9-2ad7-4b20-9403-7e76d545a9c9 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1464 microversion: 2.1 time: 12.072565 Aug 27 04:42:20.991973 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1383/2745] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:08 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1464 bytes in 12077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:21.010862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-80b04613-cb72-4b34-b2c3-27d52c638bf4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:21.011503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-80b04613-cb72-4b34-b2c3-27d52c638bf4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:21.046467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80b04613-cb72-4b34-b2c3-27d52c638bf4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:21.046987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80b04613-cb72-4b34-b2c3-27d52c638bf4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:21.047441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80b04613-cb72-4b34-b2c3-27d52c638bf4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:21.048196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80b04613-cb72-4b34-b2c3-27d52c638bf4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:21.058717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80b04613-cb72-4b34-b2c3-27d52c638bf4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:21.059309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80b04613-cb72-4b34-b2c3-27d52c638bf4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:21.288327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-742eb574-8e46-41d2-8916-815b84b5e8b8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:21.297701 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-742eb574-8e46-41d2-8916-815b84b5e8b8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1522 microversion: 2.1 time: 1.441215 Aug 27 04:42:21.303744 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1363/2746] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:19 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1522 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:21.315276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8f25774a-b51c-486f-8aba-0789640e1600 req-e8d7179e-7669-4334-b913-57b11ba1af2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c8d252-e69b-489b-86ff-6ca1eecec963", "tag": "294de1ec-f506-40c1-a6ae-379dd686a18a"}, {"server_uuid": "629128a5-55ce-4184-8821-6dede5fd0081", "name": "network-vif-deleted", "tag": "1def81ec-2b40-44c8-a429-c0786309e355"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:21.377487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8f25774a-b51c-486f-8aba-0789640e1600 req-e8d7179e-7669-4334-b913-57b11ba1af2b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:21.377982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8f25774a-b51c-486f-8aba-0789640e1600 req-e8d7179e-7669-4334-b913-57b11ba1af2b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:21.378422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8f25774a-b51c-486f-8aba-0789640e1600 req-e8d7179e-7669-4334-b913-57b11ba1af2b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:21.421718 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8f25774a-b51c-486f-8aba-0789640e1600 req-e8d7179e-7669-4334-b913-57b11ba1af2b service nova] Creating event network-changed:294de1ec-f506-40c1-a6ae-379dd686a18a for instance 85c8d252-e69b-489b-86ff-6ca1eecec963 on n-h1-854823-1 Aug 27 04:42:21.422238 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8f25774a-b51c-486f-8aba-0789640e1600 req-e8d7179e-7669-4334-b913-57b11ba1af2b service nova] Creating event network-vif-deleted:1def81ec-2b40-44c8-a429-c0786309e355 for instance 629128a5-55ce-4184-8821-6dede5fd0081 on n-h1-854823-1 Aug 27 04:42:21.434452 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8f25774a-b51c-486f-8aba-0789640e1600 req-e8d7179e-7669-4334-b913-57b11ba1af2b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.127296 Aug 27 04:42:21.435391 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1364/2747] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:21.448953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4caed2dc-0861-4b46-ad52-96bfb95f474b tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.40"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:21.522306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80b04613-cb72-4b34-b2c3-27d52c638bf4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:21.545804 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-80b04613-cb72-4b34-b2c3-27d52c638bf4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.543119 Aug 27 04:42:21.546979 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1384/2748] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:20 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:21.578282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2b208bf-9b64-4df9-9f27-9da1da7f0144 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:21.579789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2b208bf-9b64-4df9-9f27-9da1da7f0144 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:21.607638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b208bf-9b64-4df9-9f27-9da1da7f0144 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:21.614150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b208bf-9b64-4df9-9f27-9da1da7f0144 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:21.616327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b208bf-9b64-4df9-9f27-9da1da7f0144 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:21.621850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b208bf-9b64-4df9-9f27-9da1da7f0144 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:21.624818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b208bf-9b64-4df9-9f27-9da1da7f0144 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:21.629658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b208bf-9b64-4df9-9f27-9da1da7f0144 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:21.771012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4caed2dc-0861-4b46-ad52-96bfb95f474b tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:21.778894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4caed2dc-0861-4b46-ad52-96bfb95f474b tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:21.779915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4caed2dc-0861-4b46-ad52-96bfb95f474b tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:21.780027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4caed2dc-0861-4b46-ad52-96bfb95f474b tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:21.781405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4caed2dc-0861-4b46-ad52-96bfb95f474b tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:21.784808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4caed2dc-0861-4b46-ad52-96bfb95f474b tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:21.786551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4caed2dc-0861-4b46-ad52-96bfb95f474b tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:22.360689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2b208bf-9b64-4df9-9f27-9da1da7f0144 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180ae8cc1dcc4076ab73bb564b49eba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d3333b4ddd41e2a8afc3a4506894c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:22.379343 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2b208bf-9b64-4df9-9f27-9da1da7f0144 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 200 len: 1511 microversion: 2.1 time: 0.829041 Aug 27 04:42:22.382535 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1385/2749] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:21 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 1511 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:22.401826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4caed2dc-0861-4b46-ad52-96bfb95f474b tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "refresh_cache-85c8d252-e69b-489b-86ff-6ca1eecec963" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:42:22.402333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4caed2dc-0861-4b46-ad52-96bfb95f474b tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquired lock "refresh_cache-85c8d252-e69b-489b-86ff-6ca1eecec963" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:42:22.402918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae273c00-10da-4b7d-9f2c-9ddd083c8979 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20f281f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:22.495302 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae273c00-10da-4b7d-9f2c-9ddd083c8979 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 200 len: 1464 microversion: 2.1 time: 0.111493 Aug 27 04:42:22.498571 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1386/2750] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:22 2022] GET /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 1464 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:22.511258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ade6efd9-0c40-49dd-9b1b-10695154bda4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:22.513244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ade6efd9-0c40-49dd-9b1b-10695154bda4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:22.529058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ade6efd9-0c40-49dd-9b1b-10695154bda4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:22.531627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ade6efd9-0c40-49dd-9b1b-10695154bda4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:22.535837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ade6efd9-0c40-49dd-9b1b-10695154bda4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:22.536899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ade6efd9-0c40-49dd-9b1b-10695154bda4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:22.537545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ade6efd9-0c40-49dd-9b1b-10695154bda4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:22.538206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ade6efd9-0c40-49dd-9b1b-10695154bda4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:23.546431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ade6efd9-0c40-49dd-9b1b-10695154bda4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:23.555954 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ade6efd9-0c40-49dd-9b1b-10695154bda4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1522 microversion: 2.1 time: 1.055413 Aug 27 04:42:23.558938 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1387/2751] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:22 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1522 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:23.583478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d98f079-2438-47da-a024-43700908f7ef tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:23.584384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d98f079-2438-47da-a024-43700908f7ef tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 0e0d6029-a40b-45b9-b230-2033ec88617e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:23.597256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d98f079-2438-47da-a024-43700908f7ef tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:23.598123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d98f079-2438-47da-a024-43700908f7ef tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:23.598997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d98f079-2438-47da-a024-43700908f7ef tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:23.599943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d98f079-2438-47da-a024-43700908f7ef tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:23.600608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d98f079-2438-47da-a024-43700908f7ef tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:23.605741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d98f079-2438-47da-a024-43700908f7ef tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:23.738864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-4caed2dc-0861-4b46-ad52-96bfb95f474b tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Building network info cache for instance {{(pid=128870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:42:24.040651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d98f079-2438-47da-a024-43700908f7ef tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:24.068617 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d98f079-2438-47da-a024-43700908f7ef tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e" status: 200 len: 1468 microversion: 2.1 time: 0.500985 Aug 27 04:42:24.069523 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1388/2752] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:23 2022] GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e => generated 1468 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:24.088472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7c8ba86-886c-4b1c-9e18-0ce3dc9a707c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:24.089556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a7c8ba86-886c-4b1c-9e18-0ce3dc9a707c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:24.110609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7c8ba86-886c-4b1c-9e18-0ce3dc9a707c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:24.111621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7c8ba86-886c-4b1c-9e18-0ce3dc9a707c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:24.113786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7c8ba86-886c-4b1c-9e18-0ce3dc9a707c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:24.114764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7c8ba86-886c-4b1c-9e18-0ce3dc9a707c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:24.116160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7c8ba86-886c-4b1c-9e18-0ce3dc9a707c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:24.119644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7c8ba86-886c-4b1c-9e18-0ce3dc9a707c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:24.528359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a7c8ba86-886c-4b1c-9e18-0ce3dc9a707c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:24.537132 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a7c8ba86-886c-4b1c-9e18-0ce3dc9a707c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.464292 Aug 27 04:42:24.541603 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1389/2753] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:24 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:24.552767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4169e1ac-c56e-4c6a-9d0a-7ccff039dceb req-288a068e-d089-48b3-b50e-b2c6bc8f53da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fae55d-3829-41ee-8a71-af3656927791", "name": "network-vif-deleted", "tag": "a40c76fa-0224-490a-8311-696b4862fcf1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:24.579275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4169e1ac-c56e-4c6a-9d0a-7ccff039dceb req-288a068e-d089-48b3-b50e-b2c6bc8f53da service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:24.580128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4169e1ac-c56e-4c6a-9d0a-7ccff039dceb req-288a068e-d089-48b3-b50e-b2c6bc8f53da service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:24.580786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4169e1ac-c56e-4c6a-9d0a-7ccff039dceb req-288a068e-d089-48b3-b50e-b2c6bc8f53da service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:24.611537 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4169e1ac-c56e-4c6a-9d0a-7ccff039dceb req-288a068e-d089-48b3-b50e-b2c6bc8f53da service nova] Creating event network-vif-deleted:a40c76fa-0224-490a-8311-696b4862fcf1 for instance d2fae55d-3829-41ee-8a71-af3656927791 on n-h1-854823-1 Aug 27 04:42:24.625547 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4169e1ac-c56e-4c6a-9d0a-7ccff039dceb req-288a068e-d089-48b3-b50e-b2c6bc8f53da service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082378 Aug 27 04:42:24.629287 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1390/2754] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:24.642542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14b6e53f-0552-4b95-9145-94987ab28d88 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:24.643583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14b6e53f-0552-4b95-9145-94987ab28d88 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] [instance: d2fae55d-3829-41ee-8a71-af3656927791] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:24.686926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b6e53f-0552-4b95-9145-94987ab28d88 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:24.687922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b6e53f-0552-4b95-9145-94987ab28d88 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:24.688736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b6e53f-0552-4b95-9145-94987ab28d88 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:24.689852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b6e53f-0552-4b95-9145-94987ab28d88 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:24.705195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b6e53f-0552-4b95-9145-94987ab28d88 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:24.705945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b6e53f-0552-4b95-9145-94987ab28d88 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:24.749955 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-14b6e53f-0552-4b95-9145-94987ab28d88 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] HTTP exception thrown: Instance d2fae55d-3829-41ee-8a71-af3656927791 could not be found. Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14b6e53f-0552-4b95-9145-94987ab28d88 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Request method failure captured: Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 HTTP/1.1 Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaBdzJxg3-nI85J2rTtzDNJ0YpbyEVqGjCogTvt761TL7VlquGUGP-2SMMm7-R0a-VwKbzf6npDTrPrNY-Yb6lel5YQKbpoqGh0ibzq2NONbmAkUgl_63y2LXirrYqafl1wxfonL2DSTiFgg9LHoPoJIFQhrgj1Yko8rbMiU5ZitS4U Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 31d3333b4ddd41e2a8afc3a4506894c5 Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-MultipleCreateTestJSON-2079813281 Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/31d3333b4ddd41e2a8afc3a4506894c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_31d3333b4ddd41e2a8afc3a4506894c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/31d3333b4ddd41e2a8afc3a4506894c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/31d3333b4ddd41e2a8afc3a4506894c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-MultipleCreateTestJSON-2079813281 Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 31d3333b4ddd41e2a8afc3a4506894c5 Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2079813281 Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-MultipleCreateTestJSON-2079813281-project Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 180ae8cc1dcc4076ab73bb564b49eba5 Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-MultipleCreateTestJSON-2079813281-project Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance d2fae55d-3829-41ee-8a71-af3656927791 could not be found. Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'd2fae55d-3829-41ee-8a71-af3656927791'} Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2fae55d-3829-41ee-8a71-af3656927791 could not be found. Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2fae55d-3829-41ee-8a71-af3656927791 could not be found. Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:24.751920 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:24.756403 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:24.756403 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:24.756403 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:24.756403 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:42:24.756403 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:42:24.756403 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2fae55d-3829-41ee-8a71-af3656927791 could not be found. Aug 27 04:42:24.756403 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:24.759224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14b6e53f-0552-4b95-9145-94987ab28d88 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] Returning 404 to user: Instance d2fae55d-3829-41ee-8a71-af3656927791 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:24.769861 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14b6e53f-0552-4b95-9145-94987ab28d88 tempest-MultipleCreateTestJSON-2079813281 tempest-MultipleCreateTestJSON-2079813281-project] 10.222.0.79 "GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791" status: 404 len: 111 microversion: 2.1 time: 0.138989 Aug 27 04:42:24.771086 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1391/2755] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:24 2022] GET /compute/v2.1/servers/d2fae55d-3829-41ee-8a71-af3656927791 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:42:24.776677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c82ff4ac-dcfc-4be0-90da-49a4adba91ed req-6426167d-92de-4d8d-85a1-9e1491aa4008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c8d252-e69b-489b-86ff-6ca1eecec963", "tag": "294de1ec-f506-40c1-a6ae-379dd686a18a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:24.796257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c82ff4ac-dcfc-4be0-90da-49a4adba91ed req-6426167d-92de-4d8d-85a1-9e1491aa4008 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:24.801277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c82ff4ac-dcfc-4be0-90da-49a4adba91ed req-6426167d-92de-4d8d-85a1-9e1491aa4008 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:24.802031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c82ff4ac-dcfc-4be0-90da-49a4adba91ed req-6426167d-92de-4d8d-85a1-9e1491aa4008 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:24.825065 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c82ff4ac-dcfc-4be0-90da-49a4adba91ed req-6426167d-92de-4d8d-85a1-9e1491aa4008 service nova] Creating event network-changed:294de1ec-f506-40c1-a6ae-379dd686a18a for instance 85c8d252-e69b-489b-86ff-6ca1eecec963 on n-h1-854823-1 Aug 27 04:42:24.850228 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c82ff4ac-dcfc-4be0-90da-49a4adba91ed req-6426167d-92de-4d8d-85a1-9e1491aa4008 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077538 Aug 27 04:42:24.851572 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1392/2756] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:24.858340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45e12d18-4e59-4352-8a47-a20e39b70e02 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1899571695"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:24.861619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-45e12d18-4e59-4352-8a47-a20e39b70e02 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:24.881363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45e12d18-4e59-4352-8a47-a20e39b70e02 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:24.882258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45e12d18-4e59-4352-8a47-a20e39b70e02 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:24.882979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45e12d18-4e59-4352-8a47-a20e39b70e02 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:24.884523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45e12d18-4e59-4352-8a47-a20e39b70e02 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:24.885237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45e12d18-4e59-4352-8a47-a20e39b70e02 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:24.885919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45e12d18-4e59-4352-8a47-a20e39b70e02 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:25.316608 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45e12d18-4e59-4352-8a47-a20e39b70e02 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "POST /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3/action" status: 202 len: 0 microversion: 2.1 time: 0.463183 Aug 27 04:42:25.321644 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1393/2757] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:42:24 2022] POST /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:42:25.328079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81b79f7d-e8c5-434b-9e90-f51cc3170362 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:25.332566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-81b79f7d-e8c5-434b-9e90-f51cc3170362 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:25.344377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81b79f7d-e8c5-434b-9e90-f51cc3170362 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:25.349343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81b79f7d-e8c5-434b-9e90-f51cc3170362 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:25.350016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81b79f7d-e8c5-434b-9e90-f51cc3170362 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:25.350920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81b79f7d-e8c5-434b-9e90-f51cc3170362 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:25.351511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81b79f7d-e8c5-434b-9e90-f51cc3170362 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:25.357265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81b79f7d-e8c5-434b-9e90-f51cc3170362 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:25.861179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-81b79f7d-e8c5-434b-9e90-f51cc3170362 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:25.873989 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-81b79f7d-e8c5-434b-9e90-f51cc3170362 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1522 microversion: 2.1 time: 0.550718 Aug 27 04:42:25.874742 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1394/2758] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:25 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:25.895029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc82a894-0592-4c90-b6fe-4059d3d43466 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20f52280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:25.963246 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc82a894-0592-4c90-b6fe-4059d3d43466 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.074261 Aug 27 04:42:25.978688 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1395/2759] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:25 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:25.986603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cb0fdd8-b3ae-4b01-8037-d5f6830746ce tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:25.989291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2cb0fdd8-b3ae-4b01-8037-d5f6830746ce tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:26.010174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb0fdd8-b3ae-4b01-8037-d5f6830746ce tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:26.011101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb0fdd8-b3ae-4b01-8037-d5f6830746ce tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:26.011783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb0fdd8-b3ae-4b01-8037-d5f6830746ce tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:26.013695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb0fdd8-b3ae-4b01-8037-d5f6830746ce tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:26.017433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb0fdd8-b3ae-4b01-8037-d5f6830746ce tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:26.018234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb0fdd8-b3ae-4b01-8037-d5f6830746ce tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:26.570269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2cb0fdd8-b3ae-4b01-8037-d5f6830746ce tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:26.592643 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2cb0fdd8-b3ae-4b01-8037-d5f6830746ce tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.619722 Aug 27 04:42:26.601455 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1396/2760] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:25 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:26.751167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-4caed2dc-0861-4b46-ad52-96bfb95f474b tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Updating instance_info_cache with network_info: [{"id": "294de1ec-f506-40c1-a6ae-379dd686a18a", "address": "fa:16:3e:28:75:aa", "network": {"id": "bcedcbbe-f9e5-425b-a145-0aa42ef36186", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1734361074-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "449305a5c79342058280f9482da58766", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap294de1ec-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:42:26.781361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4caed2dc-0861-4b46-ad52-96bfb95f474b tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Releasing lock "refresh_cache-85c8d252-e69b-489b-86ff-6ca1eecec963" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:42:26.783079 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4caed2dc-0861-4b46-ad52-96bfb95f474b tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "POST /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963/action" status: 202 len: 0 microversion: 2.1 time: 5.339951 Aug 27 04:42:26.785700 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1365/2761] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:42:21 2022] POST /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963/action => generated 0 bytes in 5344 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 04:42:26.799456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f3a1c878-70ff-40b6-82de-da677ff285a1 req-0c441ebc-399e-4e47-a9aa-1e0b383b815e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0d6029-a40b-45b9-b230-2033ec88617e", "name": "network-vif-unplugged", "status": "completed", "tag": "54e043d1-9346-4c9a-917b-026289b24400"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:26.805239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6506aef7-308a-4b4e-909b-2add6a432d2f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:26.818931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6506aef7-308a-4b4e-909b-2add6a432d2f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:26.832224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f3a1c878-70ff-40b6-82de-da677ff285a1 req-0c441ebc-399e-4e47-a9aa-1e0b383b815e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:26.837601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f3a1c878-70ff-40b6-82de-da677ff285a1 req-0c441ebc-399e-4e47-a9aa-1e0b383b815e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:26.838063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f3a1c878-70ff-40b6-82de-da677ff285a1 req-0c441ebc-399e-4e47-a9aa-1e0b383b815e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:26.839248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6506aef7-308a-4b4e-909b-2add6a432d2f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:26.841325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6506aef7-308a-4b4e-909b-2add6a432d2f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:26.842874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6506aef7-308a-4b4e-909b-2add6a432d2f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:26.844790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6506aef7-308a-4b4e-909b-2add6a432d2f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:26.845609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6506aef7-308a-4b4e-909b-2add6a432d2f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:26.846321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6506aef7-308a-4b4e-909b-2add6a432d2f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:26.868785 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f3a1c878-70ff-40b6-82de-da677ff285a1 req-0c441ebc-399e-4e47-a9aa-1e0b383b815e service nova] Creating event network-vif-unplugged:54e043d1-9346-4c9a-917b-026289b24400 for instance 0e0d6029-a40b-45b9-b230-2033ec88617e on n-h1-854823-1 Aug 27 04:42:26.880212 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-6506aef7-308a-4b4e-909b-2add6a432d2f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] HTTP exception thrown: Instance 629128a5-55ce-4184-8821-6dede5fd0081 could not be found. Aug 27 04:42:26.881190 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f3a1c878-70ff-40b6-82de-da677ff285a1 req-0c441ebc-399e-4e47-a9aa-1e0b383b815e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.278348 Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6506aef7-308a-4b4e-909b-2add6a432d2f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Request method failure captured: Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 HTTP/1.1 Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaBMVE_l-KYKsL46xT9YdZNfYYjAzpB9qe8KP-kkSLR_k-eWbaBw90srQq1Sp9RhSVOWzUBG-Ym9GkfKdWBMUNJ9cIFnwSMRbyJNC3K3veYRXYtgYkkkE3JJgBfKUQx4XuOlxPW4tx0SjKDr73uY-GSy631NtquLcEWfAt-Ks0ZJ2xU Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 449305a5c79342058280f9482da58766 Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1064743616 Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/449305a5c79342058280f9482da58766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_449305a5c79342058280f9482da58766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/449305a5c79342058280f9482da58766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/449305a5c79342058280f9482da58766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1064743616 Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 449305a5c79342058280f9482da58766 Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1064743616 Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FloatingIPsAssociationTestJSON-1064743616-project Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 31386d6abd9b41f7a14a91f638331d95 Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1064743616-project Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 629128a5-55ce-4184-8821-6dede5fd0081 could not be found. Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '629128a5-55ce-4184-8821-6dede5fd0081'} Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629128a5-55ce-4184-8821-6dede5fd0081 could not be found. Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:42:26.883004 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:42:26.888370 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629128a5-55ce-4184-8821-6dede5fd0081 could not be found. Aug 27 04:42:26.888370 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:26.888370 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:26.888370 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:26.888370 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:26.888370 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:26.888370 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:26.888370 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:42:26.888370 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:42:26.888370 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629128a5-55ce-4184-8821-6dede5fd0081 could not be found. Aug 27 04:42:26.888370 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:26.889352 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1397/2762] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:26.896486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6506aef7-308a-4b4e-909b-2add6a432d2f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Returning 404 to user: Instance 629128a5-55ce-4184-8821-6dede5fd0081 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:26.897765 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6506aef7-308a-4b4e-909b-2add6a432d2f tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "DELETE /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 404 len: 111 microversion: 2.1 time: 0.108263 Aug 27 04:42:26.903481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ec8f837-0dd7-4c3c-a908-2a99998af962 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:26.912791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9ec8f837-0dd7-4c3c-a908-2a99998af962 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:26.916712 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1366/2763] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:42:26 2022] DELETE /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:42:26.933989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ec8f837-0dd7-4c3c-a908-2a99998af962 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:26.936827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ec8f837-0dd7-4c3c-a908-2a99998af962 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:26.937732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ec8f837-0dd7-4c3c-a908-2a99998af962 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:26.940507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ec8f837-0dd7-4c3c-a908-2a99998af962 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:26.942435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ec8f837-0dd7-4c3c-a908-2a99998af962 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:26.944701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ec8f837-0dd7-4c3c-a908-2a99998af962 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:26.955375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5491b408-6dbd-4812-9da2-595fef22dd49 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:26.957330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5491b408-6dbd-4812-9da2-595fef22dd49 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 629128a5-55ce-4184-8821-6dede5fd0081] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:26.970955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5491b408-6dbd-4812-9da2-595fef22dd49 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:26.971788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5491b408-6dbd-4812-9da2-595fef22dd49 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:26.972699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5491b408-6dbd-4812-9da2-595fef22dd49 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:26.973675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5491b408-6dbd-4812-9da2-595fef22dd49 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:26.974362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5491b408-6dbd-4812-9da2-595fef22dd49 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:26.975264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5491b408-6dbd-4812-9da2-595fef22dd49 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:26.993765 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-5491b408-6dbd-4812-9da2-595fef22dd49 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] HTTP exception thrown: Instance 629128a5-55ce-4184-8821-6dede5fd0081 could not be found. Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5491b408-6dbd-4812-9da2-595fef22dd49 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Request method failure captured: Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 HTTP/1.1 Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaBMVE_l-KYKsL46xT9YdZNfYYjAzpB9qe8KP-kkSLR_k-eWbaBw90srQq1Sp9RhSVOWzUBG-Ym9GkfKdWBMUNJ9cIFnwSMRbyJNC3K3veYRXYtgYkkkE3JJgBfKUQx4XuOlxPW4tx0SjKDr73uY-GSy631NtquLcEWfAt-Ks0ZJ2xU Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 449305a5c79342058280f9482da58766 Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1064743616 Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/449305a5c79342058280f9482da58766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_449305a5c79342058280f9482da58766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/449305a5c79342058280f9482da58766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/449305a5c79342058280f9482da58766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1064743616 Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 449305a5c79342058280f9482da58766 Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1064743616 Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FloatingIPsAssociationTestJSON-1064743616-project Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 31386d6abd9b41f7a14a91f638331d95 Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1064743616-project Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 629128a5-55ce-4184-8821-6dede5fd0081 could not be found. Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '629128a5-55ce-4184-8821-6dede5fd0081'} Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629128a5-55ce-4184-8821-6dede5fd0081 could not be found. Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629128a5-55ce-4184-8821-6dede5fd0081 could not be found. Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:26.995795 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:26.999452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:26.999452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:26.999452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:26.999452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:26.999452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:42:26.999452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:42:26.999452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629128a5-55ce-4184-8821-6dede5fd0081 could not be found. Aug 27 04:42:26.999452 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:27.012720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5491b408-6dbd-4812-9da2-595fef22dd49 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Returning 404 to user: Instance 629128a5-55ce-4184-8821-6dede5fd0081 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:27.014264 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5491b408-6dbd-4812-9da2-595fef22dd49 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081" status: 404 len: 111 microversion: 2.1 time: 0.096142 Aug 27 04:42:27.019750 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1367/2764] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:26 2022] GET /compute/v2.1/servers/629128a5-55ce-4184-8821-6dede5fd0081 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:42:27.025811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8b87c29d-f01c-4e96-a5f6-4e49bda0d339 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21536430>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:27.088374 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8b87c29d-f01c-4e96-a5f6-4e49bda0d339 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.066974 Aug 27 04:42:27.090042 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1368/2765] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:27 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:27.095323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b127ca3d-7045-455a-b4e0-8c09169c2260 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '.version_select at 0x7f1f21775310>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:27.327511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9ec8f837-0dd7-4c3c-a908-2a99998af962 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:27.353869 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ec8f837-0dd7-4c3c-a908-2a99998af962 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1522 microversion: 2.1 time: 0.462068 Aug 27 04:42:27.355242 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1398/2766] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:26 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:27.645542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b6fc425b-ec5b-4b6b-8149-212dbbed1e19 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:27.646919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b6fc425b-ec5b-4b6b-8149-212dbbed1e19 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:27.663779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6fc425b-ec5b-4b6b-8149-212dbbed1e19 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:27.666672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6fc425b-ec5b-4b6b-8149-212dbbed1e19 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:27.667185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6fc425b-ec5b-4b6b-8149-212dbbed1e19 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:27.667978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6fc425b-ec5b-4b6b-8149-212dbbed1e19 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:27.670509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6fc425b-ec5b-4b6b-8149-212dbbed1e19 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:27.671021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6fc425b-ec5b-4b6b-8149-212dbbed1e19 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:28.565971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b6fc425b-ec5b-4b6b-8149-212dbbed1e19 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:28.576494 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b6fc425b-ec5b-4b6b-8149-212dbbed1e19 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.950370 Aug 27 04:42:28.577745 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1399/2767] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:27 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:28.597393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c359aa13-f6d2-4462-9dcb-3ea000102529 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20f28c10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:28.710180 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c359aa13-f6d2-4462-9dcb-3ea000102529 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.130101 Aug 27 04:42:28.723136 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1400/2768] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:28 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:28.731853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eaf0fa27-bbb7-43cf-b968-9ebaf14d2440 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:28.732911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eaf0fa27-bbb7-43cf-b968-9ebaf14d2440 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:28.742478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaf0fa27-bbb7-43cf-b968-9ebaf14d2440 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:28.743385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaf0fa27-bbb7-43cf-b968-9ebaf14d2440 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:28.744222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaf0fa27-bbb7-43cf-b968-9ebaf14d2440 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:28.745332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaf0fa27-bbb7-43cf-b968-9ebaf14d2440 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:28.746579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaf0fa27-bbb7-43cf-b968-9ebaf14d2440 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:28.747246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaf0fa27-bbb7-43cf-b968-9ebaf14d2440 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:29.027546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eaf0fa27-bbb7-43cf-b968-9ebaf14d2440 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:29.041184 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eaf0fa27-bbb7-43cf-b968-9ebaf14d2440 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1522 microversion: 2.1 time: 0.316195 Aug 27 04:42:29.043102 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1401/2769] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:28 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:29.603697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5f417b9-89bb-43b1-979c-28f8e08c8d79 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:29.604301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5f417b9-89bb-43b1-979c-28f8e08c8d79 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:29.616423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f417b9-89bb-43b1-979c-28f8e08c8d79 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:29.617261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f417b9-89bb-43b1-979c-28f8e08c8d79 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:29.618734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f417b9-89bb-43b1-979c-28f8e08c8d79 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:29.620097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f417b9-89bb-43b1-979c-28f8e08c8d79 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:29.620835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f417b9-89bb-43b1-979c-28f8e08c8d79 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:29.621349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f417b9-89bb-43b1-979c-28f8e08c8d79 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:29.802873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f5f417b9-89bb-43b1-979c-28f8e08c8d79 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:29.810780 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5f417b9-89bb-43b1-979c-28f8e08c8d79 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.216033 Aug 27 04:42:29.811374 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1402/2770] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:29 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:29.816234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a3505878-7c1e-4f20-a99e-85e74d42e5bb tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20ed5a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:29.866424 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a3505878-7c1e-4f20-a99e-85e74d42e5bb tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.053497 Aug 27 04:42:29.866857 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1403/2771] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:29 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:30.066255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32348838-7820-4764-88dd-705833d89fe2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:30.067254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32348838-7820-4764-88dd-705833d89fe2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:30.077018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32348838-7820-4764-88dd-705833d89fe2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:30.077834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32348838-7820-4764-88dd-705833d89fe2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:30.079072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32348838-7820-4764-88dd-705833d89fe2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:30.080456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32348838-7820-4764-88dd-705833d89fe2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:30.081735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32348838-7820-4764-88dd-705833d89fe2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:30.082486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32348838-7820-4764-88dd-705833d89fe2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:30.275176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32348838-7820-4764-88dd-705833d89fe2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:30.286271 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32348838-7820-4764-88dd-705833d89fe2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1504 microversion: 2.1 time: 0.225202 Aug 27 04:42:30.287631 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1404/2772] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:30 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:30.837419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1650964-8309-49c4-9641-4e6c123b8636 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:30.838147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e1650964-8309-49c4-9641-4e6c123b8636 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:30.848494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1650964-8309-49c4-9641-4e6c123b8636 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:30.849542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1650964-8309-49c4-9641-4e6c123b8636 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:30.849985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1650964-8309-49c4-9641-4e6c123b8636 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:30.855959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1650964-8309-49c4-9641-4e6c123b8636 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:30.856467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1650964-8309-49c4-9641-4e6c123b8636 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:30.857609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1650964-8309-49c4-9641-4e6c123b8636 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:31.170817 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b127ca3d-7045-455a-b4e0-8c09169c2260 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/73e12a6c-0dcd-4f5d-b273-50d44d68e128" status: 202 len: 0 microversion: 2.1 time: 4.079348 Aug 27 04:42:31.172878 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1369/2773] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:42:27 2022] DELETE /compute/v2.1/os-floating-ips/73e12a6c-0dcd-4f5d-b273-50d44d68e128 => generated 0 bytes in 4082 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:42:31.179018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc068391-548a-4be7-a9eb-5a07807c16d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f25ec6b80>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:31.179905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e1650964-8309-49c4-9641-4e6c123b8636 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:31.183901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:31.206979 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1650964-8309-49c4-9641-4e6c123b8636 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.375991 Aug 27 04:42:31.210055 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1405/2774] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:30 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:31.225512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df9568ea-7e6c-48b9-ba5d-03fbbd56b678 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:31.226041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-df9568ea-7e6c-48b9-ba5d-03fbbd56b678 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:31.246373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df9568ea-7e6c-48b9-ba5d-03fbbd56b678 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:31.246843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df9568ea-7e6c-48b9-ba5d-03fbbd56b678 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:31.247522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df9568ea-7e6c-48b9-ba5d-03fbbd56b678 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:31.248774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df9568ea-7e6c-48b9-ba5d-03fbbd56b678 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:31.249751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df9568ea-7e6c-48b9-ba5d-03fbbd56b678 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:31.253144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df9568ea-7e6c-48b9-ba5d-03fbbd56b678 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:31.257683 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bc068391-548a-4be7-a9eb-5a07807c16d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.083261 Aug 27 04:42:31.258928 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1370/2775] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:31 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:31.310961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-36631c81-bd34-46e0-a9b6-58c170311fbb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:31.312777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-36631c81-bd34-46e0-a9b6-58c170311fbb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:31.328207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36631c81-bd34-46e0-a9b6-58c170311fbb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:31.330005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36631c81-bd34-46e0-a9b6-58c170311fbb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:31.330721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36631c81-bd34-46e0-a9b6-58c170311fbb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:31.331696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36631c81-bd34-46e0-a9b6-58c170311fbb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:31.331877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-df9568ea-7e6c-48b9-ba5d-03fbbd56b678 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:42:31.333922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36631c81-bd34-46e0-a9b6-58c170311fbb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:31.334532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36631c81-bd34-46e0-a9b6-58c170311fbb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:31.475143 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-df9568ea-7e6c-48b9-ba5d-03fbbd56b678 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "DELETE /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 204 len: 0 microversion: 2.1 time: 0.263475 Aug 27 04:42:31.487235 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1406/2776] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:42:31 2022] DELETE /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:42:31.495695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d92fc9b2-c6eb-452d-82b5-13c367522adf tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:31.497546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d92fc9b2-c6eb-452d-82b5-13c367522adf tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:31.506150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d92fc9b2-c6eb-452d-82b5-13c367522adf tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:31.506667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d92fc9b2-c6eb-452d-82b5-13c367522adf tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:31.507252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d92fc9b2-c6eb-452d-82b5-13c367522adf tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:31.516558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d92fc9b2-c6eb-452d-82b5-13c367522adf tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:31.517075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d92fc9b2-c6eb-452d-82b5-13c367522adf tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:31.517530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d92fc9b2-c6eb-452d-82b5-13c367522adf tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:31.775028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d92fc9b2-c6eb-452d-82b5-13c367522adf tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:31.784245 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d92fc9b2-c6eb-452d-82b5-13c367522adf tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1527 microversion: 2.1 time: 0.294611 Aug 27 04:42:31.785254 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1407/2777] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:31 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1527 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:31.907342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-36631c81-bd34-46e0-a9b6-58c170311fbb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:31.935342 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-36631c81-bd34-46e0-a9b6-58c170311fbb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1504 microversion: 2.1 time: 0.630016 Aug 27 04:42:31.942226 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1371/2778] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:31 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1504 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:32.052376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-115d1ac9-1165-4531-8fc9-b68f29e75d7a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:32.059048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-115d1ac9-1165-4531-8fc9-b68f29e75d7a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:32.060399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-115d1ac9-1165-4531-8fc9-b68f29e75d7a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Searching by: {'deleted': False, 'project_id': '7774d5268c134a52a0037ac64bf9735f'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:42:32.069526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-115d1ac9-1165-4531-8fc9-b68f29e75d7a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:32.070498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-115d1ac9-1165-4531-8fc9-b68f29e75d7a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:32.072259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-115d1ac9-1165-4531-8fc9-b68f29e75d7a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:32.074165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-115d1ac9-1165-4531-8fc9-b68f29e75d7a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:32.075242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-115d1ac9-1165-4531-8fc9-b68f29e75d7a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:32.075910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-115d1ac9-1165-4531-8fc9-b68f29e75d7a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:32.146260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-115d1ac9-1165-4531-8fc9-b68f29e75d7a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:42:32.201281 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-115d1ac9-1165-4531-8fc9-b68f29e75d7a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.153615 Aug 27 04:42:32.202322 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1408/2779] 10.222.0.79 () {58 vars in 1125 bytes} [Sat Aug 27 04:42:32 2022] GET /compute/v2.1/servers => generated 340 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:32.215460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:32.221191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:32.222404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Searching by: {'deleted': False, 'project_id': '7774d5268c134a52a0037ac64bf9735f'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:42:32.230551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:32.231428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:32.232099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:32.233169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:32.233787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:32.234879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:32.236944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da0cef49-1382-49c5-b924-ceec7ae91789 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:32.237692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da0cef49-1382-49c5-b924-ceec7ae91789 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:32.250030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da0cef49-1382-49c5-b924-ceec7ae91789 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:32.250864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da0cef49-1382-49c5-b924-ceec7ae91789 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:32.251787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da0cef49-1382-49c5-b924-ceec7ae91789 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:32.252767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da0cef49-1382-49c5-b924-ceec7ae91789 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:32.253419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da0cef49-1382-49c5-b924-ceec7ae91789 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:32.254007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da0cef49-1382-49c5-b924-ceec7ae91789 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:32.273568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:42:32.316920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:32.324350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:32.324950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:32.325386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:32.547845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da0cef49-1382-49c5-b924-ceec7ae91789 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:32.561421 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da0cef49-1382-49c5-b924-ceec7ae91789 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.334262 Aug 27 04:42:32.563891 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1409/2780] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:32 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:32.573113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af9908d3-3f92-42dd-9f97-85a333fb58f6 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21744e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:32.632255 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1b7d96b0-cb81-4bf1-93cd-469f0bd3041b tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.420939 Aug 27 04:42:32.633414 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1372/2781] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:42:32 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:32.647390 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af9908d3-3f92-42dd-9f97-85a333fb58f6 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.081205 Aug 27 04:42:32.651748 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1410/2782] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:32 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:32.659293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-74588373-3974-412f-aec6-2f116bb45446 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:32.672235 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-74588373-3974-412f-aec6-2f116bb45446 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017585 Aug 27 04:42:32.675614 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1373/2783] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:42:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:32.805790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-086cf294-5e65-470d-8ec4-52b2989db540 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:32.806705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-086cf294-5e65-470d-8ec4-52b2989db540 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:32.813327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086cf294-5e65-470d-8ec4-52b2989db540 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:32.814127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086cf294-5e65-470d-8ec4-52b2989db540 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:32.814971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086cf294-5e65-470d-8ec4-52b2989db540 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:32.815965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086cf294-5e65-470d-8ec4-52b2989db540 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:32.817535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086cf294-5e65-470d-8ec4-52b2989db540 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:32.818192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086cf294-5e65-470d-8ec4-52b2989db540 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:32.962981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f10a887c-78d3-4c74-86dd-7493e627f917 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:32.963705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f10a887c-78d3-4c74-86dd-7493e627f917 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:32.975044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f10a887c-78d3-4c74-86dd-7493e627f917 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:32.977644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f10a887c-78d3-4c74-86dd-7493e627f917 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:32.980801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f10a887c-78d3-4c74-86dd-7493e627f917 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:32.981830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f10a887c-78d3-4c74-86dd-7493e627f917 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:32.982403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f10a887c-78d3-4c74-86dd-7493e627f917 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:32.985827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f10a887c-78d3-4c74-86dd-7493e627f917 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:33.060184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-086cf294-5e65-470d-8ec4-52b2989db540 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:33.087703 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-086cf294-5e65-470d-8ec4-52b2989db540 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1527 microversion: 2.1 time: 0.286468 Aug 27 04:42:33.088771 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1411/2784] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:32 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1527 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:33.094379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf2c7e20-da65-4c9b-9d03-5911925f56d3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:33.095191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf2c7e20-da65-4c9b-9d03-5911925f56d3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:33.104736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf2c7e20-da65-4c9b-9d03-5911925f56d3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:33.105562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf2c7e20-da65-4c9b-9d03-5911925f56d3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:33.106267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf2c7e20-da65-4c9b-9d03-5911925f56d3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:33.107257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf2c7e20-da65-4c9b-9d03-5911925f56d3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:33.107981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf2c7e20-da65-4c9b-9d03-5911925f56d3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:33.108832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf2c7e20-da65-4c9b-9d03-5911925f56d3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:33.156356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf2c7e20-da65-4c9b-9d03-5911925f56d3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:42:33.330712 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf2c7e20-da65-4c9b-9d03-5911925f56d3 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 204 len: 0 microversion: 2.1 time: 0.239126 Aug 27 04:42:33.332952 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1412/2785] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:42:33 2022] DELETE /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:42:33.342380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c19c6300-b1fe-4aee-9d57-b7b5540aa0da tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:33.343212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c19c6300-b1fe-4aee-9d57-b7b5540aa0da tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:33.351673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c19c6300-b1fe-4aee-9d57-b7b5540aa0da tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:33.353665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c19c6300-b1fe-4aee-9d57-b7b5540aa0da tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:33.354384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c19c6300-b1fe-4aee-9d57-b7b5540aa0da tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:33.355501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c19c6300-b1fe-4aee-9d57-b7b5540aa0da tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:33.356199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c19c6300-b1fe-4aee-9d57-b7b5540aa0da tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:33.356668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c19c6300-b1fe-4aee-9d57-b7b5540aa0da tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:33.869653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c19c6300-b1fe-4aee-9d57-b7b5540aa0da tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:33.879786 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c19c6300-b1fe-4aee-9d57-b7b5540aa0da tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1714 microversion: 2.1 time: 0.541866 Aug 27 04:42:33.880440 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1413/2786] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:33 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1714 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:33.887722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-07d6454b-718c-4714-a57b-551d927229b7 req-b18db092-3356-4c40-9f85-86a87bbe0ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4549183c-6ddf-442e-a0fd-6abba4b648c3", "name": "network-vif-unplugged", "status": "completed", "tag": "58521f19-b6b8-4427-a0d6-6704d0cec337"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:33.907359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-07d6454b-718c-4714-a57b-551d927229b7 req-b18db092-3356-4c40-9f85-86a87bbe0ded service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:33.907579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-07d6454b-718c-4714-a57b-551d927229b7 req-b18db092-3356-4c40-9f85-86a87bbe0ded service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:33.912758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-07d6454b-718c-4714-a57b-551d927229b7 req-b18db092-3356-4c40-9f85-86a87bbe0ded service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:33.935452 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-07d6454b-718c-4714-a57b-551d927229b7 req-b18db092-3356-4c40-9f85-86a87bbe0ded service nova] Creating event network-vif-unplugged:58521f19-b6b8-4427-a0d6-6704d0cec337 for instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 on n-h2-854823-1 Aug 27 04:42:33.941884 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-07d6454b-718c-4714-a57b-551d927229b7 req-b18db092-3356-4c40-9f85-86a87bbe0ded service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058075 Aug 27 04:42:33.943135 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1414/2787] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:33.952488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5a193d4-2e2e-461e-a079-b0f6a50c3fff tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:33.953459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b5a193d4-2e2e-461e-a079-b0f6a50c3fff tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:33.967438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5a193d4-2e2e-461e-a079-b0f6a50c3fff tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:33.968033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5a193d4-2e2e-461e-a079-b0f6a50c3fff tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:33.968598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5a193d4-2e2e-461e-a079-b0f6a50c3fff tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:33.969414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5a193d4-2e2e-461e-a079-b0f6a50c3fff tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:33.969971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5a193d4-2e2e-461e-a079-b0f6a50c3fff tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:33.970648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5a193d4-2e2e-461e-a079-b0f6a50c3fff tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:33.980814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f10a887c-78d3-4c74-86dd-7493e627f917 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:34.017943 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f10a887c-78d3-4c74-86dd-7493e627f917 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1504 microversion: 2.1 time: 1.047476 Aug 27 04:42:34.018621 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1374/2788] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:32 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1504 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:34.070374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-27da8641-16ff-451c-a742-33c691be0346 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f2174b790>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:34.204138 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-27da8641-16ff-451c-a742-33c691be0346 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.158041 Aug 27 04:42:34.204749 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1375/2789] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:34 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:34.218884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a2ac5de7-adef-49d8-9c8e-07ceaaa7d493 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:34.219782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a2ac5de7-adef-49d8-9c8e-07ceaaa7d493 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:34.226820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2ac5de7-adef-49d8-9c8e-07ceaaa7d493 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:34.228423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2ac5de7-adef-49d8-9c8e-07ceaaa7d493 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:34.230314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2ac5de7-adef-49d8-9c8e-07ceaaa7d493 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:34.230314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2ac5de7-adef-49d8-9c8e-07ceaaa7d493 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:34.230758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2ac5de7-adef-49d8-9c8e-07ceaaa7d493 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:34.231447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2ac5de7-adef-49d8-9c8e-07ceaaa7d493 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:34.404748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5a193d4-2e2e-461e-a079-b0f6a50c3fff tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:34.415235 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5a193d4-2e2e-461e-a079-b0f6a50c3fff tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.470526 Aug 27 04:42:34.431687 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1415/2790] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:33 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:34.567744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a2ac5de7-adef-49d8-9c8e-07ceaaa7d493 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:34.576994 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a2ac5de7-adef-49d8-9c8e-07ceaaa7d493 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1527 microversion: 2.1 time: 0.370922 Aug 27 04:42:34.585579 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1376/2791] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:34 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1527 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:34.902602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab2704f2-339c-4173-97d6-1ac046c7eccb tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:34.903236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab2704f2-339c-4173-97d6-1ac046c7eccb tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:34.914437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab2704f2-339c-4173-97d6-1ac046c7eccb tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:34.915369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab2704f2-339c-4173-97d6-1ac046c7eccb tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:34.916159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab2704f2-339c-4173-97d6-1ac046c7eccb tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:34.917257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab2704f2-339c-4173-97d6-1ac046c7eccb tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:34.917987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab2704f2-339c-4173-97d6-1ac046c7eccb tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:34.918730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab2704f2-339c-4173-97d6-1ac046c7eccb tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:35.041438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a840c13e-9c46-4168-9f8d-509e7a248457 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:35.042862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a840c13e-9c46-4168-9f8d-509e7a248457 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:35.061244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a840c13e-9c46-4168-9f8d-509e7a248457 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:35.062125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a840c13e-9c46-4168-9f8d-509e7a248457 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:35.062799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a840c13e-9c46-4168-9f8d-509e7a248457 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:35.063757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a840c13e-9c46-4168-9f8d-509e7a248457 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:35.064338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a840c13e-9c46-4168-9f8d-509e7a248457 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:35.064814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a840c13e-9c46-4168-9f8d-509e7a248457 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:35.107346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:35.485720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a840c13e-9c46-4168-9f8d-509e7a248457 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:35.518158 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a840c13e-9c46-4168-9f8d-509e7a248457 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 200 len: 1447 microversion: 2.1 time: 0.479882 Aug 27 04:42:35.519743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab2704f2-339c-4173-97d6-1ac046c7eccb tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:35.520397 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1377/2792] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:35 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 1447 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:35.540115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c68b948e-5f71-49e6-a806-5a67311f6bac tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f217ab700>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:35.541393 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab2704f2-339c-4173-97d6-1ac046c7eccb tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1714 microversion: 2.1 time: 0.643944 Aug 27 04:42:35.542115 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1416/2793] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:34 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1714 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:35.547239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0eed2ab9-b8b5-4ee9-bdc0-5c12db63773c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:35.552380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0eed2ab9-b8b5-4ee9-bdc0-5c12db63773c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:35.577109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0eed2ab9-b8b5-4ee9-bdc0-5c12db63773c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:35.577672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0eed2ab9-b8b5-4ee9-bdc0-5c12db63773c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:35.578299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0eed2ab9-b8b5-4ee9-bdc0-5c12db63773c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:35.579200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0eed2ab9-b8b5-4ee9-bdc0-5c12db63773c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:35.579814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0eed2ab9-b8b5-4ee9-bdc0-5c12db63773c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:35.580585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0eed2ab9-b8b5-4ee9-bdc0-5c12db63773c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:35.616336 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c68b948e-5f71-49e6-a806-5a67311f6bac tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.093189 Aug 27 04:42:35.617357 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1378/2794] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:35 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:35.624023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-304ca63a-f8a5-4ba3-984a-165015d7144a req-b9d7c7f0-2dae-4417-8e37-5147d4bb5ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c1a9e4-475f-4c6a-bf72-653e8fc46611", "name": "network-vif-unplugged", "status": "completed", "tag": "c7badfa4-4c98-4ab6-80be-9df19f2265d3"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:35.636753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-304ca63a-f8a5-4ba3-984a-165015d7144a req-b9d7c7f0-2dae-4417-8e37-5147d4bb5ac3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:35.637637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-304ca63a-f8a5-4ba3-984a-165015d7144a req-b9d7c7f0-2dae-4417-8e37-5147d4bb5ac3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:35.638307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-304ca63a-f8a5-4ba3-984a-165015d7144a req-b9d7c7f0-2dae-4417-8e37-5147d4bb5ac3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:35.652994 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-304ca63a-f8a5-4ba3-984a-165015d7144a req-b9d7c7f0-2dae-4417-8e37-5147d4bb5ac3 service nova] Creating event network-vif-unplugged:c7badfa4-4c98-4ab6-80be-9df19f2265d3 for instance c3c1a9e4-475f-4c6a-bf72-653e8fc46611 on n-h2-854823-1 Aug 27 04:42:35.659780 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-304ca63a-f8a5-4ba3-984a-165015d7144a req-b9d7c7f0-2dae-4417-8e37-5147d4bb5ac3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040278 Aug 27 04:42:35.661589 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1379/2795] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:35.669040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:35.669897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:35.678138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:35.678890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:35.679587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:35.681594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:35.682369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:35.683133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:35.739789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:42:35.748439 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.compute.api [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Working on deleting snapshot 27bb47c3-87fd-435c-9e5c-7eeb24102413 from shelved instance... Aug 27 04:42:36.498889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0eed2ab9-b8b5-4ee9-bdc0-5c12db63773c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:36.516442 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0eed2ab9-b8b5-4ee9-bdc0-5c12db63773c tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.972924 Aug 27 04:42:36.527715 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1417/2796] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:35 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:36.538675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a88c375-d6ee-4630-a70c-203f2976cf9e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:36.539790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a88c375-d6ee-4630-a70c-203f2976cf9e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:36.549312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a88c375-d6ee-4630-a70c-203f2976cf9e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:36.550945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a88c375-d6ee-4630-a70c-203f2976cf9e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:36.551607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a88c375-d6ee-4630-a70c-203f2976cf9e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:36.552623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a88c375-d6ee-4630-a70c-203f2976cf9e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:36.553299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a88c375-d6ee-4630-a70c-203f2976cf9e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:36.553950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a88c375-d6ee-4630-a70c-203f2976cf9e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:36.610117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Doing local delete in cell e7bc291f-2aa3-4d66-a942-e096e031ad4c(cell1) {{(pid=128870) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 27 04:42:36.611781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:36.612295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:36.612986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:36.613794 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.compute.api [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 27 04:42:36.621955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] deallocate_for_instance() {{(pid=128870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 27 04:42:37.039044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a88c375-d6ee-4630-a70c-203f2976cf9e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:37.056896 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a88c375-d6ee-4630-a70c-203f2976cf9e tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1527 microversion: 2.1 time: 0.527966 Aug 27 04:42:37.059810 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1418/2797] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:36 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1527 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:37.072213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b1c662b7-f605-4aab-8080-d36e001b583d req-a796a155-e908-4c15-959b-707816007f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3", "name": "network-vif-plugged", "status": "completed", "tag": "06142979-93d1-48a2-a72f-11b13cbb0e03"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:37.098447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b1c662b7-f605-4aab-8080-d36e001b583d req-a796a155-e908-4c15-959b-707816007f64 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:37.099817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b1c662b7-f605-4aab-8080-d36e001b583d req-a796a155-e908-4c15-959b-707816007f64 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:37.101531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b1c662b7-f605-4aab-8080-d36e001b583d req-a796a155-e908-4c15-959b-707816007f64 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:37.133490 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b1c662b7-f605-4aab-8080-d36e001b583d req-a796a155-e908-4c15-959b-707816007f64 service nova] Creating event network-vif-plugged:06142979-93d1-48a2-a72f-11b13cbb0e03 for instance 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 on n-h1-854823-1 Aug 27 04:42:37.148650 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b1c662b7-f605-4aab-8080-d36e001b583d req-a796a155-e908-4c15-959b-707816007f64 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087354 Aug 27 04:42:37.150357 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1419/2798] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:37.159890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-41ccbe71-68cd-432f-952f-50c96bc082fa tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:37.161250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41ccbe71-68cd-432f-952f-50c96bc082fa tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:37.171375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ccbe71-68cd-432f-952f-50c96bc082fa tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:37.172332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ccbe71-68cd-432f-952f-50c96bc082fa tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:37.174062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ccbe71-68cd-432f-952f-50c96bc082fa tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:37.181440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ccbe71-68cd-432f-952f-50c96bc082fa tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:37.182735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ccbe71-68cd-432f-952f-50c96bc082fa tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:37.183455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ccbe71-68cd-432f-952f-50c96bc082fa tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:37.675694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-41ccbe71-68cd-432f-952f-50c96bc082fa tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:37.691435 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-41ccbe71-68cd-432f-952f-50c96bc082fa tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1714 microversion: 2.1 time: 0.538991 Aug 27 04:42:37.705869 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1420/2799] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:37 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1714 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:37.710576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-750cf4c6-0fa4-4743-8f73-6c37c9936192 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e619d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:37.774575 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-750cf4c6-0fa4-4743-8f73-6c37c9936192 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.079965 Aug 27 04:42:37.775347 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1421/2800] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:37 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:37.786167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e162142-a876-4d7b-94ea-7387bce26a2f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:37.787045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e162142-a876-4d7b-94ea-7387bce26a2f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:37.794031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e162142-a876-4d7b-94ea-7387bce26a2f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:37.794601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e162142-a876-4d7b-94ea-7387bce26a2f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:37.795405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e162142-a876-4d7b-94ea-7387bce26a2f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:37.796294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e162142-a876-4d7b-94ea-7387bce26a2f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:37.796950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e162142-a876-4d7b-94ea-7387bce26a2f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:37.797539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e162142-a876-4d7b-94ea-7387bce26a2f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:37.826107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:38.206046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4e162142-a876-4d7b-94ea-7387bce26a2f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:38.223929 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e162142-a876-4d7b-94ea-7387bce26a2f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.446237 Aug 27 04:42:38.224658 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1422/2801] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:37 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:38.243961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e8998860-3713-439f-b3cd-fc2a801a3ede req-a1a14cbe-c008-4cd5-9b7d-54ebdb5f31ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c8d252-e69b-489b-86ff-6ca1eecec963", "name": "network-vif-deleted", "tag": "294de1ec-f506-40c1-a6ae-379dd686a18a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:38.266885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e8998860-3713-439f-b3cd-fc2a801a3ede req-a1a14cbe-c008-4cd5-9b7d-54ebdb5f31ae service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:38.267370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e8998860-3713-439f-b3cd-fc2a801a3ede req-a1a14cbe-c008-4cd5-9b7d-54ebdb5f31ae service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:38.267969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e8998860-3713-439f-b3cd-fc2a801a3ede req-a1a14cbe-c008-4cd5-9b7d-54ebdb5f31ae service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:38.291483 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e8998860-3713-439f-b3cd-fc2a801a3ede req-a1a14cbe-c008-4cd5-9b7d-54ebdb5f31ae service nova] Creating event network-vif-deleted:294de1ec-f506-40c1-a6ae-379dd686a18a for instance 85c8d252-e69b-489b-86ff-6ca1eecec963 on n-h1-854823-1 Aug 27 04:42:38.306511 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e8998860-3713-439f-b3cd-fc2a801a3ede req-a1a14cbe-c008-4cd5-9b7d-54ebdb5f31ae service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068327 Aug 27 04:42:38.307133 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1423/2802] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:38.312456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e5f65735-bbaf-4564-bb1d-9281522ddad9 req-61cfe301-28e2-46f6-8e35-b915e9b4fd83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c1a9e4-475f-4c6a-bf72-653e8fc46611", "tag": "c7badfa4-4c98-4ab6-80be-9df19f2265d3"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:38.342433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e5f65735-bbaf-4564-bb1d-9281522ddad9 req-61cfe301-28e2-46f6-8e35-b915e9b4fd83 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:38.343070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e5f65735-bbaf-4564-bb1d-9281522ddad9 req-61cfe301-28e2-46f6-8e35-b915e9b4fd83 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:38.343504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e5f65735-bbaf-4564-bb1d-9281522ddad9 req-61cfe301-28e2-46f6-8e35-b915e9b4fd83 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:38.358970 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e5f65735-bbaf-4564-bb1d-9281522ddad9 req-61cfe301-28e2-46f6-8e35-b915e9b4fd83 service nova] Creating event network-changed:c7badfa4-4c98-4ab6-80be-9df19f2265d3 for instance c3c1a9e4-475f-4c6a-bf72-653e8fc46611 on n-h2-854823-1 Aug 27 04:42:38.372699 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e5f65735-bbaf-4564-bb1d-9281522ddad9 req-61cfe301-28e2-46f6-8e35-b915e9b4fd83 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063917 Aug 27 04:42:38.376362 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1424/2803] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:38.388667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94c70ab5-6e22-416e-9c23-c1cdee5b5d00 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:38.389374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94c70ab5-6e22-416e-9c23-c1cdee5b5d00 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:38.423131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c70ab5-6e22-416e-9c23-c1cdee5b5d00 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:38.423646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c70ab5-6e22-416e-9c23-c1cdee5b5d00 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:38.424082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c70ab5-6e22-416e-9c23-c1cdee5b5d00 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:38.424881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c70ab5-6e22-416e-9c23-c1cdee5b5d00 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:38.425277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c70ab5-6e22-416e-9c23-c1cdee5b5d00 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:38.425710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c70ab5-6e22-416e-9c23-c1cdee5b5d00 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:38.562796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c70ab5-6e22-416e-9c23-c1cdee5b5d00 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:38.563296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c70ab5-6e22-416e-9c23-c1cdee5b5d00 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:38.563729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c70ab5-6e22-416e-9c23-c1cdee5b5d00 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:38.564192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-94c70ab5-6e22-416e-9c23-c1cdee5b5d00 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lazy-loading 'fault' on Instance uuid 85c8d252-e69b-489b-86ff-6ca1eecec963 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:42:38.645426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94c70ab5-6e22-416e-9c23-c1cdee5b5d00 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31386d6abd9b41f7a14a91f638331d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449305a5c79342058280f9482da58766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:38.659236 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94c70ab5-6e22-416e-9c23-c1cdee5b5d00 tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 200 len: 1314 microversion: 2.1 time: 0.280889 Aug 27 04:42:38.663129 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1425/2804] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:38 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:38.718354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e0c95615-9861-47b9-a154-f415c75e401a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:38.719033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e0c95615-9861-47b9-a154-f415c75e401a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:38.729239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0c95615-9861-47b9-a154-f415c75e401a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:38.729744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0c95615-9861-47b9-a154-f415c75e401a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:38.730190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0c95615-9861-47b9-a154-f415c75e401a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:38.731097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0c95615-9861-47b9-a154-f415c75e401a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:38.731721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0c95615-9861-47b9-a154-f415c75e401a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:38.732485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0c95615-9861-47b9-a154-f415c75e401a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:38.981472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Updating instance_info_cache with network_info: [] {{(pid=128870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:42:39.319281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e0c95615-9861-47b9-a154-f415c75e401a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:39.347532 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e0c95615-9861-47b9-a154-f415c75e401a tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1714 microversion: 2.1 time: 0.631996 Aug 27 04:42:39.363461 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1426/2805] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:38 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1714 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:39.376292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c3425d8-f848-4d0b-866f-02f8aa737f17 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e585e0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:39.498626 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-98d78668-6ee1-4aaa-9c42-489a0bf82af2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 204 len: 0 microversion: 2.1 time: 3.835535 Aug 27 04:42:39.502552 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1380/2806] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:42:35 2022] DELETE /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 0 bytes in 3837 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:42:39.506680 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c3425d8-f848-4d0b-866f-02f8aa737f17 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.151935 Aug 27 04:42:39.507567 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1427/2807] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:39 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:39.518501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7ccd344-9d7f-4f6a-8ef2-96e5f23b6425 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:39.519371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7ccd344-9d7f-4f6a-8ef2-96e5f23b6425 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:39.523132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7a6f56e9-f3fe-4deb-ae01-1049c45d48d3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:39.532958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7a6f56e9-f3fe-4deb-ae01-1049c45d48d3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:39.538409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7ccd344-9d7f-4f6a-8ef2-96e5f23b6425 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:39.538846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7ccd344-9d7f-4f6a-8ef2-96e5f23b6425 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:39.539326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7ccd344-9d7f-4f6a-8ef2-96e5f23b6425 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:39.540329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7ccd344-9d7f-4f6a-8ef2-96e5f23b6425 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:39.541133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a6f56e9-f3fe-4deb-ae01-1049c45d48d3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:39.541790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a6f56e9-f3fe-4deb-ae01-1049c45d48d3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:39.542388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a6f56e9-f3fe-4deb-ae01-1049c45d48d3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:39.543278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a6f56e9-f3fe-4deb-ae01-1049c45d48d3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:39.544555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a6f56e9-f3fe-4deb-ae01-1049c45d48d3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:39.546734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7ccd344-9d7f-4f6a-8ef2-96e5f23b6425 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:39.547250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7ccd344-9d7f-4f6a-8ef2-96e5f23b6425 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:39.547586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a6f56e9-f3fe-4deb-ae01-1049c45d48d3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:39.602432 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f7ccd344-9d7f-4f6a-8ef2-96e5f23b6425 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7ccd344-9d7f-4f6a-8ef2-96e5f23b6425 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 HTTP/1.1 Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '4549183c-6ddf-442e-a0fd-6abba4b648c3'} Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:39.604156 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:39.607840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:39.607840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:39.607840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:39.607840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:42:39.607840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:42:39.607840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:42:39.607840 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:39.608666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7ccd344-9d7f-4f6a-8ef2-96e5f23b6425 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:39.613487 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7ccd344-9d7f-4f6a-8ef2-96e5f23b6425 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 404 len: 111 microversion: 2.1 time: 0.103776 Aug 27 04:42:39.614042 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1428/2808] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:39 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:42:39.680063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49a119c5-d1a6-40a5-b9f3-387ef343eb4c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:39.680718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-49a119c5-d1a6-40a5-b9f3-387ef343eb4c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] [instance: 85c8d252-e69b-489b-86ff-6ca1eecec963] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:39.696256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49a119c5-d1a6-40a5-b9f3-387ef343eb4c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:39.696790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49a119c5-d1a6-40a5-b9f3-387ef343eb4c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:39.697236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49a119c5-d1a6-40a5-b9f3-387ef343eb4c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:39.697953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49a119c5-d1a6-40a5-b9f3-387ef343eb4c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:39.698414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49a119c5-d1a6-40a5-b9f3-387ef343eb4c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:39.698844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49a119c5-d1a6-40a5-b9f3-387ef343eb4c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:39.739792 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-49a119c5-d1a6-40a5-b9f3-387ef343eb4c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] HTTP exception thrown: Instance 85c8d252-e69b-489b-86ff-6ca1eecec963 could not be found. Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49a119c5-d1a6-40a5-b9f3-387ef343eb4c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Request method failure captured: Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 HTTP/1.1 Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaBMVE_l-KYKsL46xT9YdZNfYYjAzpB9qe8KP-kkSLR_k-eWbaBw90srQq1Sp9RhSVOWzUBG-Ym9GkfKdWBMUNJ9cIFnwSMRbyJNC3K3veYRXYtgYkkkE3JJgBfKUQx4XuOlxPW4tx0SjKDr73uY-GSy631NtquLcEWfAt-Ks0ZJ2xU Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 449305a5c79342058280f9482da58766 Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1064743616 Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/449305a5c79342058280f9482da58766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_449305a5c79342058280f9482da58766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/449305a5c79342058280f9482da58766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/449305a5c79342058280f9482da58766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1064743616 Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 449305a5c79342058280f9482da58766 Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1064743616 Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-FloatingIPsAssociationTestJSON-1064743616-project Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 31386d6abd9b41f7a14a91f638331d95 Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1064743616-project Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 85c8d252-e69b-489b-86ff-6ca1eecec963 could not be found. Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '85c8d252-e69b-489b-86ff-6ca1eecec963'} Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c8d252-e69b-489b-86ff-6ca1eecec963 could not be found. Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c8d252-e69b-489b-86ff-6ca1eecec963 could not be found. Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:39.741476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:39.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:39.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:39.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:39.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:39.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:42:39.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:42:39.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c8d252-e69b-489b-86ff-6ca1eecec963 could not be found. Aug 27 04:42:39.747536 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:39.747536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49a119c5-d1a6-40a5-b9f3-387ef343eb4c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] Returning 404 to user: Instance 85c8d252-e69b-489b-86ff-6ca1eecec963 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:39.747536 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49a119c5-d1a6-40a5-b9f3-387ef343eb4c tempest-FloatingIPsAssociationTestJSON-1064743616 tempest-FloatingIPsAssociationTestJSON-1064743616-project] 10.222.0.79 "GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963" status: 404 len: 111 microversion: 2.1 time: 0.067505 Aug 27 04:42:39.760952 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1429/2809] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:39 2022] GET /compute/v2.1/servers/85c8d252-e69b-489b-86ff-6ca1eecec963 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:42:39.873678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1890875518", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "fa9d001d-b3bf-4c75-aaaf-2dd93a5532f5"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:39.971640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] validate_networks() for [('fa9d001d-b3bf-4c75-aaaf-2dd93a5532f5', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:42:40.432229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7a6f56e9-f3fe-4deb-ae01-1049c45d48d3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:40.458625 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7a6f56e9-f3fe-4deb-ae01-1049c45d48d3 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.958308 Aug 27 04:42:40.467320 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1381/2810] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:39 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:40.489471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-920cab02-ac36-47aa-a186-93483d1a7c55 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:40.491620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-920cab02-ac36-47aa-a186-93483d1a7c55 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:40.508148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-920cab02-ac36-47aa-a186-93483d1a7c55 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:40.521089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-920cab02-ac36-47aa-a186-93483d1a7c55 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:40.523420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-920cab02-ac36-47aa-a186-93483d1a7c55 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:40.532719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-920cab02-ac36-47aa-a186-93483d1a7c55 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:40.540034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-920cab02-ac36-47aa-a186-93483d1a7c55 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:40.540627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-920cab02-ac36-47aa-a186-93483d1a7c55 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:40.717318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-920cab02-ac36-47aa-a186-93483d1a7c55 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7886b73059f64e6b9c7d7675549ab38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7774d5268c134a52a0037ac64bf9735f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:40.727621 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-920cab02-ac36-47aa-a186-93483d1a7c55 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 200 len: 1648 microversion: 2.1 time: 0.257801 Aug 27 04:42:40.732521 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1382/2811] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:40 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 1648 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:40.752654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-7df78965-5de2-4495-a7dd-e574989d52d6 req-464c709f-cc29-4259-9663-e3f6223c024e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4549183c-6ddf-442e-a0fd-6abba4b648c3", "name": "network-vif-deleted", "tag": "58521f19-b6b8-4427-a0d6-6704d0cec337"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:40.798477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7df78965-5de2-4495-a7dd-e574989d52d6 req-464c709f-cc29-4259-9663-e3f6223c024e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:40.798477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7df78965-5de2-4495-a7dd-e574989d52d6 req-464c709f-cc29-4259-9663-e3f6223c024e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:40.798477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7df78965-5de2-4495-a7dd-e574989d52d6 req-464c709f-cc29-4259-9663-e3f6223c024e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:40.838441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.compute.server_external_events [req-7df78965-5de2-4495-a7dd-e574989d52d6 req-464c709f-cc29-4259-9663-e3f6223c024e service nova] Unable to find a host for instance 4549183c-6ddf-442e-a0fd-6abba4b648c3. Dropping event network-vif-deleted {{(pid=128870) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 04:42:40.839743 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-7df78965-5de2-4495-a7dd-e574989d52d6 req-464c709f-cc29-4259-9663-e3f6223c024e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.105654 Aug 27 04:42:40.841697 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1383/2812] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 108 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 04:42:40.848438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-78e02059-30f4-4211-a8fa-ca6fdf3323d1 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f213ab820>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:40.949092 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-78e02059-30f4-4211-a8fa-ca6fdf3323d1 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.104935 Aug 27 04:42:40.957240 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1384/2813] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:40 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:41.521178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-84f3eb01-3932-4f77-9975-0c6d88ded5d8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:41.521178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-84f3eb01-3932-4f77-9975-0c6d88ded5d8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:41.530573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84f3eb01-3932-4f77-9975-0c6d88ded5d8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:41.532271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84f3eb01-3932-4f77-9975-0c6d88ded5d8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:41.534627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84f3eb01-3932-4f77-9975-0c6d88ded5d8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:41.539958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84f3eb01-3932-4f77-9975-0c6d88ded5d8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:41.541224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84f3eb01-3932-4f77-9975-0c6d88ded5d8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:41.541886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84f3eb01-3932-4f77-9975-0c6d88ded5d8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:42.118148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:42.223983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-84f3eb01-3932-4f77-9975-0c6d88ded5d8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:42.241749 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-84f3eb01-3932-4f77-9975-0c6d88ded5d8 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.750641 Aug 27 04:42:42.243083 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1385/2814] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:41 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:42.247984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:42.312937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:42.792244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6517325e-762e-4cda-9f3e-6ee2cc49ca44 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-114738036", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:42.796942 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-6517325e-762e-4cda-9f3e-6ee2cc49ca44 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] HTTP exception thrown: min_count must be <= max_count Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6517325e-762e-4cda-9f3e-6ee2cc49ca44 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Request method failure captured: Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 183 Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaDBr7rXFJEB4YEdWMmCnRHsXR6ClFtEbShfGYs0QSY5bcZJMDWDjOciibDjDgyMLPv9IxlIlcf5hGhxokbJa3fiSbAfk6Qrepvm6MS9wNkUBzRqlUiT853DoAWCLflqugdH2-37DhEgnQV-bxBjoM87X8TAcBiVeoq3WC3MeviMIMo Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 73c1621d5ff4490886cdc68b57f4d87d Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 73c1621d5ff4490886cdc68b57f4d87d Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-MultipleCreateNegativeTestJSON-729087988-project Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 78b7803f709e4a59868c3bfaa6ef7ccd Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-729087988-project Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-114738036", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: exception: min_count must be <= max_count Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-114738036', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 27 04:42:42.815131 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:42.819293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6517325e-762e-4cda-9f3e-6ee2cc49ca44 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Returning 400 to user: min_count must be <= max_count {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:42.819293 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6517325e-762e-4cda-9f3e-6ee2cc49ca44 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.572497 Aug 27 04:42:42.822666 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1386/2815] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:42:42 2022] POST /compute/v2.1/servers => generated 74 bytes in 579 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:42.833991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c6ee5852-4c41-4492-857e-b779f1c73b1d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:42.838437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c6ee5852-4c41-4492-857e-b779f1c73b1d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] [instance: aa23773c-4169-43f8-8529-5f22a60e8836] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:42.858357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6ee5852-4c41-4492-857e-b779f1c73b1d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:42.858869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6ee5852-4c41-4492-857e-b779f1c73b1d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:42.859311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6ee5852-4c41-4492-857e-b779f1c73b1d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:42.865032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6ee5852-4c41-4492-857e-b779f1c73b1d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:42.866181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6ee5852-4c41-4492-857e-b779f1c73b1d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:42.868053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6ee5852-4c41-4492-857e-b779f1c73b1d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:42.921144 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-c6ee5852-4c41-4492-857e-b779f1c73b1d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] HTTP exception thrown: Instance aa23773c-4169-43f8-8529-5f22a60e8836 could not be found. Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c6ee5852-4c41-4492-857e-b779f1c73b1d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Request method failure captured: Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 HTTP/1.1 Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaAzX6RqXvZMzzP4ATx0TzI7vsgqA51JWRMV-62gg_B8LwZjtnnT0asdKhA0_aBSCrmu-Kk9TAKJXuOEXU4irWALomgE7lU19ydzz7vMJ1W36NGHNBztrXnKxYYMRAsWJE8UewSM9CKspbTGMb6NyR1J7UhJi-wgnMkF6x-e1OPrGVk Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 7774d5268c134a52a0037ac64bf9735f Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestManualDisk-1377888989 Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7774d5268c134a52a0037ac64bf9735f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7774d5268c134a52a0037ac64bf9735f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7774d5268c134a52a0037ac64bf9735f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7774d5268c134a52a0037ac64bf9735f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestManualDisk-1377888989 Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 7774d5268c134a52a0037ac64bf9735f Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestManualDisk-1377888989 Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestManualDisk-1377888989-project Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 7886b73059f64e6b9c7d7675549ab38d Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestManualDisk-1377888989-project Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance aa23773c-4169-43f8-8529-5f22a60e8836 could not be found. Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'aa23773c-4169-43f8-8529-5f22a60e8836'} Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa23773c-4169-43f8-8529-5f22a60e8836 could not be found. Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa23773c-4169-43f8-8529-5f22a60e8836 could not be found. Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:42.925726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:42.932206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:42.932206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:42.932206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:42.932206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:42:42.932206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:42:42.932206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa23773c-4169-43f8-8529-5f22a60e8836 could not be found. Aug 27 04:42:42.932206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:42.932206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c6ee5852-4c41-4492-857e-b779f1c73b1d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Returning 404 to user: Instance aa23773c-4169-43f8-8529-5f22a60e8836 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:42.932206 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c6ee5852-4c41-4492-857e-b779f1c73b1d tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836" status: 404 len: 111 microversion: 2.1 time: 0.107433 Aug 27 04:42:42.935758 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1387/2816] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:42 2022] GET /compute/v2.1/servers/aa23773c-4169-43f8-8529-5f22a60e8836 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:42:42.949285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1cfc9d7f-752b-4626-b630-b4608dc2ecc4 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f213abd30>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:42.962395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:42:42.963152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:42:42.965130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:42:42.965741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:42:42.966354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:42:42.981234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:42.984455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:42.985185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:42.986385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:42.989752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:42.990463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:43.021820 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1cfc9d7f-752b-4626-b630-b4608dc2ecc4 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.079469 Aug 27 04:42:43.022425 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1388/2817] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:42 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:43.036276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e482c7ae-5109-4120-bf71-44f2ccd392bf tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-321946730", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "max_count": 0}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:43.037210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Getting quotas for project b902932050be4c04bca1de4fe268c2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:42:43.040221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e482c7ae-5109-4120-bf71-44f2ccd392bf tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Request method failure captured: Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 167 Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaDBr7rXFJEB4YEdWMmCnRHsXR6ClFtEbShfGYs0QSY5bcZJMDWDjOciibDjDgyMLPv9IxlIlcf5hGhxokbJa3fiSbAfk6Qrepvm6MS9wNkUBzRqlUiT853DoAWCLflqugdH2-37DhEgnQV-bxBjoM87X8TAcBiVeoq3WC3MeviMIMo Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 73c1621d5ff4490886cdc68b57f4d87d Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 73c1621d5ff4490886cdc68b57f4d87d Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-MultipleCreateNegativeTestJSON-729087988-project Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 78b7803f709e4a59868c3bfaa6ef7ccd Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-729087988-project Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-321946730", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "max_count": 0}} Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-321946730', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'max_count': 0}}} Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 0 Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:42:43.056266 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 04:42:43.060357 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.064607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Getting quotas for user 6c59dc5e251943d59de8b2d640643a0e and project b902932050be4c04bca1de4fe268c2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:42:43.064703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e482c7ae-5109-4120-bf71-44f2ccd392bf tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:43.064703 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e482c7ae-5109-4120-bf71-44f2ccd392bf tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.033579 Aug 27 04:42:43.064703 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1389/2818] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:42:43 2022] POST /compute/v2.1/servers => generated 130 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:42:43.087241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c2fc52b7-c0a2-434f-ad10-06681fe3eed7 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] Calling method '.version_select at 0x7f1f217ab700>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:43.134170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:42:43.144286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:42:43.153998 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c2fc52b7-c0a2-434f-ad10-06681fe3eed7 tempest-ServersTestManualDisk-1377888989 tempest-ServersTestManualDisk-1377888989-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980467507" status: 202 len: 0 microversion: 2.1 time: 0.087733 Aug 27 04:42:43.154604 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1390/2819] 10.222.0.79 () {58 vars in 1221 bytes} [Sat Aug 27 04:42:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980467507 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:42:43.171025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a81fbf51-0950-42ef-94ac-286de8f8cb80 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-30410895", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "max_count": 2.5}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a81fbf51-0950-42ef-94ac-286de8f8cb80 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Request method failure captured: Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 168 Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaDBr7rXFJEB4YEdWMmCnRHsXR6ClFtEbShfGYs0QSY5bcZJMDWDjOciibDjDgyMLPv9IxlIlcf5hGhxokbJa3fiSbAfk6Qrepvm6MS9wNkUBzRqlUiT853DoAWCLflqugdH2-37DhEgnQV-bxBjoM87X8TAcBiVeoq3WC3MeviMIMo Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 73c1621d5ff4490886cdc68b57f4d87d Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 73c1621d5ff4490886cdc68b57f4d87d Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-MultipleCreateNegativeTestJSON-729087988-project Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 78b7803f709e4a59868c3bfaa6ef7ccd Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-729087988-project Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-30410895", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "max_count": 2.5}} Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-30410895', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'max_count': 2.5}}} Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 2.5 Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:42:43.183712 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.188023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a81fbf51-0950-42ef-94ac-286de8f8cb80 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:43.191794 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a81fbf51-0950-42ef-94ac-286de8f8cb80 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020765 Aug 27 04:42:43.192929 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1391/2820] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:42:43 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:42:43.267582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3089ad4e-b5da-4cef-bf3d-bd2813539483 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:43.268218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3089ad4e-b5da-4cef-bf3d-bd2813539483 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:43.281829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3089ad4e-b5da-4cef-bf3d-bd2813539483 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:43.282404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3089ad4e-b5da-4cef-bf3d-bd2813539483 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:43.283584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3089ad4e-b5da-4cef-bf3d-bd2813539483 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:43.284398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3089ad4e-b5da-4cef-bf3d-bd2813539483 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:43.284935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3089ad4e-b5da-4cef-bf3d-bd2813539483 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:43.285802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3089ad4e-b5da-4cef-bf3d-bd2813539483 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:43.337562 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b686a1e-bac3-4848-a69f-4ca69321e71c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.466019 Aug 27 04:42:43.339727 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1430/2821] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:42:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:42:43.345329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-979225ad-2f1d-42b2-9668-fad2cbe23d20 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1697431616", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "min_count": 0}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-979225ad-2f1d-42b2-9668-fad2cbe23d20 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Request method failure captured: Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 168 Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaDBr7rXFJEB4YEdWMmCnRHsXR6ClFtEbShfGYs0QSY5bcZJMDWDjOciibDjDgyMLPv9IxlIlcf5hGhxokbJa3fiSbAfk6Qrepvm6MS9wNkUBzRqlUiT853DoAWCLflqugdH2-37DhEgnQV-bxBjoM87X8TAcBiVeoq3WC3MeviMIMo Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 73c1621d5ff4490886cdc68b57f4d87d Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 73c1621d5ff4490886cdc68b57f4d87d Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-MultipleCreateNegativeTestJSON-729087988-project Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 78b7803f709e4a59868c3bfaa6ef7ccd Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-729087988-project Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1697431616", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "min_count": 0}} Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1697431616', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'min_count': 0}}} Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 0 Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:42:43.351572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 04:42:43.356405 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.374914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-979225ad-2f1d-42b2-9668-fad2cbe23d20 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:43.376071 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-979225ad-2f1d-42b2-9668-fad2cbe23d20 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.035060 Aug 27 04:42:43.378853 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1431/2822] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:42:43 2022] POST /compute/v2.1/servers => generated 130 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:42:43.386944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-44cc6de7-eecf-4f86-934f-252076f40289 req-b37b12db-d473-401b-9d84-d6a3094b717d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa23773c-4169-43f8-8529-5f22a60e8836", "name": "network-vif-deleted", "tag": "3cad5baa-ac77-43e1-8c2c-9c89cccb50dd"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:43.441662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-44cc6de7-eecf-4f86-934f-252076f40289 req-b37b12db-d473-401b-9d84-d6a3094b717d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:43.442167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-44cc6de7-eecf-4f86-934f-252076f40289 req-b37b12db-d473-401b-9d84-d6a3094b717d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:43.444779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-44cc6de7-eecf-4f86-934f-252076f40289 req-b37b12db-d473-401b-9d84-d6a3094b717d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:43.480394 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-44cc6de7-eecf-4f86-934f-252076f40289 req-b37b12db-d473-401b-9d84-d6a3094b717d service nova] Creating event network-vif-deleted:3cad5baa-ac77-43e1-8c2c-9c89cccb50dd for instance aa23773c-4169-43f8-8529-5f22a60e8836 on n-h1-854823-1 Aug 27 04:42:43.511777 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-44cc6de7-eecf-4f86-934f-252076f40289 req-b37b12db-d473-401b-9d84-d6a3094b717d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131041 Aug 27 04:42:43.512414 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1432/2823] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:43.530753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c0953e5-9a62-4e1f-abdd-0fe0597f2a69 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:43.533013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c0953e5-9a62-4e1f-abdd-0fe0597f2a69 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:43.649855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c0953e5-9a62-4e1f-abdd-0fe0597f2a69 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:43.665092 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c0953e5-9a62-4e1f-abdd-0fe0597f2a69 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1215 microversion: 2.1 time: 0.147302 Aug 27 04:42:43.668049 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1433/2824] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:43 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:43.683501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-804460cd-136e-4b12-8646-b8dfc9402c91 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1513873316", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "min_count": 2.5}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-804460cd-136e-4b12-8646-b8dfc9402c91 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Request method failure captured: Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 170 Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaDBr7rXFJEB4YEdWMmCnRHsXR6ClFtEbShfGYs0QSY5bcZJMDWDjOciibDjDgyMLPv9IxlIlcf5hGhxokbJa3fiSbAfk6Qrepvm6MS9wNkUBzRqlUiT853DoAWCLflqugdH2-37DhEgnQV-bxBjoM87X8TAcBiVeoq3WC3MeviMIMo Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 73c1621d5ff4490886cdc68b57f4d87d Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/73c1621d5ff4490886cdc68b57f4d87d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 73c1621d5ff4490886cdc68b57f4d87d Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-729087988 Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-MultipleCreateNegativeTestJSON-729087988-project Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 78b7803f709e4a59868c3bfaa6ef7ccd Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-729087988-project Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1513873316", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "min_count": 2.5}} Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1513873316', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'min_count': 2.5}}} Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 2.5 Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:42:43.710332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 04:42:43.716705 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:42:43.722469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-804460cd-136e-4b12-8646-b8dfc9402c91 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:43.728655 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-804460cd-136e-4b12-8646-b8dfc9402c91 tempest-MultipleCreateNegativeTestJSON-729087988 tempest-MultipleCreateNegativeTestJSON-729087988-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.053988 Aug 27 04:42:43.734125 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1434/2825] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:42:43 2022] POST /compute/v2.1/servers => generated 139 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:42:44.015783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3089ad4e-b5da-4cef-bf3d-bd2813539483 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:44.041916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01febb83-0b90-4292-8cb8-a34c566a91da tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f25d32430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:44.067208 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3089ad4e-b5da-4cef-bf3d-bd2813539483 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.797534 Aug 27 04:42:44.087303 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1392/2826] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:43 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:44.184159 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01febb83-0b90-4292-8cb8-a34c566a91da tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.149976 Aug 27 04:42:44.194180 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1435/2827] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:44 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:44.691554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c62ca76a-439d-49b3-894e-e0b963f81d1b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:44.692819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c62ca76a-439d-49b3-894e-e0b963f81d1b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:45.095145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c62ca76a-439d-49b3-894e-e0b963f81d1b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:45.103593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b05e6dbe-b7e1-4a31-a8fb-c094624570ee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:45.104510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b05e6dbe-b7e1-4a31-a8fb-c094624570ee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:45.129375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b05e6dbe-b7e1-4a31-a8fb-c094624570ee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:45.130093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b05e6dbe-b7e1-4a31-a8fb-c094624570ee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:45.132372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b05e6dbe-b7e1-4a31-a8fb-c094624570ee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:45.134229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b05e6dbe-b7e1-4a31-a8fb-c094624570ee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:45.134895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b05e6dbe-b7e1-4a31-a8fb-c094624570ee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:45.136938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b05e6dbe-b7e1-4a31-a8fb-c094624570ee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:45.137884 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c62ca76a-439d-49b3-894e-e0b963f81d1b tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1215 microversion: 2.1 time: 0.450309 Aug 27 04:42:45.139010 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1393/2828] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:44 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1215 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:45.209450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1a7aeb5f-1200-4269-b571-6ab40389435a tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f2174bc10>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:45.327217 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1a7aeb5f-1200-4269-b571-6ab40389435a tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.128237 Aug 27 04:42:45.329600 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1394/2829] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:45 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:45.618947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b05e6dbe-b7e1-4a31-a8fb-c094624570ee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:45.645577 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b05e6dbe-b7e1-4a31-a8fb-c094624570ee tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.548743 Aug 27 04:42:45.647678 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1436/2830] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:45 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:46.162253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-49cf73c3-e2df-47bd-b87e-ad5ba24e6902 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:46.163641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-49cf73c3-e2df-47bd-b87e-ad5ba24e6902 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:46.177608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49cf73c3-e2df-47bd-b87e-ad5ba24e6902 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:46.196870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49cf73c3-e2df-47bd-b87e-ad5ba24e6902 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:46.197739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49cf73c3-e2df-47bd-b87e-ad5ba24e6902 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:46.203068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49cf73c3-e2df-47bd-b87e-ad5ba24e6902 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:46.203995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49cf73c3-e2df-47bd-b87e-ad5ba24e6902 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:46.204727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49cf73c3-e2df-47bd-b87e-ad5ba24e6902 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:46.349247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2590ed45-6728-4788-8d85-727fde661840 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e95ee0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:46.439356 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2590ed45-6728-4788-8d85-727fde661840 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.096316 Aug 27 04:42:46.440430 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1437/2831] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:46 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:46.671919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-302097c0-6e93-47ee-b2a4-e4bfc5ffc932 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:46.673295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-302097c0-6e93-47ee-b2a4-e4bfc5ffc932 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:46.689682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-302097c0-6e93-47ee-b2a4-e4bfc5ffc932 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:46.690167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-302097c0-6e93-47ee-b2a4-e4bfc5ffc932 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:46.690617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-302097c0-6e93-47ee-b2a4-e4bfc5ffc932 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:46.699376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-302097c0-6e93-47ee-b2a4-e4bfc5ffc932 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:46.699891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-302097c0-6e93-47ee-b2a4-e4bfc5ffc932 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:46.699891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-302097c0-6e93-47ee-b2a4-e4bfc5ffc932 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:47.165913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-49cf73c3-e2df-47bd-b87e-ad5ba24e6902 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:47.178254 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-49cf73c3-e2df-47bd-b87e-ad5ba24e6902 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1275 microversion: 2.1 time: 1.022218 Aug 27 04:42:47.178865 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1395/2832] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:46 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1275 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:47.453878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-302097c0-6e93-47ee-b2a4-e4bfc5ffc932 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:47.456302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ccf21a0-0572-41f7-a9ba-47d33eafd926 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21558550>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:47.472391 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-302097c0-6e93-47ee-b2a4-e4bfc5ffc932 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.799459 Aug 27 04:42:47.473296 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1438/2833] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:46 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:47.534741 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1ccf21a0-0572-41f7-a9ba-47d33eafd926 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.083601 Aug 27 04:42:47.536328 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1396/2834] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:47 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:48.203421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1260c3be-271b-45e2-a08e-6396c1cc1980 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:48.204889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1260c3be-271b-45e2-a08e-6396c1cc1980 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:48.216166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1260c3be-271b-45e2-a08e-6396c1cc1980 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:48.221496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1260c3be-271b-45e2-a08e-6396c1cc1980 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:48.222841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1260c3be-271b-45e2-a08e-6396c1cc1980 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:48.225476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1260c3be-271b-45e2-a08e-6396c1cc1980 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:48.228235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1260c3be-271b-45e2-a08e-6396c1cc1980 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:48.230106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1260c3be-271b-45e2-a08e-6396c1cc1980 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:48.449599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1260c3be-271b-45e2-a08e-6396c1cc1980 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:48.461724 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1260c3be-271b-45e2-a08e-6396c1cc1980 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1273 microversion: 2.1 time: 0.263272 Aug 27 04:42:48.463713 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1439/2835] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:48 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1273 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:48.498221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7fe163d6-67b1-4aff-8fa4-54fa0a9c6e0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:48.498904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7fe163d6-67b1-4aff-8fa4-54fa0a9c6e0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:48.522121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:48.536140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fe163d6-67b1-4aff-8fa4-54fa0a9c6e0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:48.540356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fe163d6-67b1-4aff-8fa4-54fa0a9c6e0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:48.541776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fe163d6-67b1-4aff-8fa4-54fa0a9c6e0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:48.544012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fe163d6-67b1-4aff-8fa4-54fa0a9c6e0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:48.545146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fe163d6-67b1-4aff-8fa4-54fa0a9c6e0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:48.554652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e266b50d-f48c-4d67-8d18-1d3a32752101 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e63790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:48.561061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fe163d6-67b1-4aff-8fa4-54fa0a9c6e0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:48.671536 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e266b50d-f48c-4d67-8d18-1d3a32752101 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.123984 Aug 27 04:42:48.672784 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1440/2836] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:48 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:49.549814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2106985915", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:49.620513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:42:49.994031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7fe163d6-67b1-4aff-8fa4-54fa0a9c6e0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:50.009125 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7fe163d6-67b1-4aff-8fa4-54fa0a9c6e0f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 1.515494 Aug 27 04:42:50.012783 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1397/2837] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:48 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:50.024578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f7e56c8b-3e9f-45a2-8d76-08fea8d29807 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:50.025980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f7e56c8b-3e9f-45a2-8d76-08fea8d29807 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:50.067396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7e56c8b-3e9f-45a2-8d76-08fea8d29807 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:50.069636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7e56c8b-3e9f-45a2-8d76-08fea8d29807 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:50.071307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7e56c8b-3e9f-45a2-8d76-08fea8d29807 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:50.073681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7e56c8b-3e9f-45a2-8d76-08fea8d29807 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:50.074866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7e56c8b-3e9f-45a2-8d76-08fea8d29807 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:50.077949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7e56c8b-3e9f-45a2-8d76-08fea8d29807 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:50.238515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f7e56c8b-3e9f-45a2-8d76-08fea8d29807 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:50.247806 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f7e56c8b-3e9f-45a2-8d76-08fea8d29807 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1273 microversion: 2.1 time: 0.233598 Aug 27 04:42:50.249163 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1398/2838] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:50 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:50.254313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-52329fee-1a9b-45fc-81bd-dd10603c3493 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f213dd820>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:50.315183 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-52329fee-1a9b-45fc-81bd-dd10603c3493 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.064698 Aug 27 04:42:50.315772 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1399/2839] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:50 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:51.043975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8299ac23-7d31-44c1-88ec-77e2b32c293f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:51.044645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8299ac23-7d31-44c1-88ec-77e2b32c293f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:51.081829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8299ac23-7d31-44c1-88ec-77e2b32c293f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:51.082336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8299ac23-7d31-44c1-88ec-77e2b32c293f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:51.082781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8299ac23-7d31-44c1-88ec-77e2b32c293f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:51.083510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8299ac23-7d31-44c1-88ec-77e2b32c293f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:51.083975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8299ac23-7d31-44c1-88ec-77e2b32c293f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:51.084406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8299ac23-7d31-44c1-88ec-77e2b32c293f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:51.514451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8299ac23-7d31-44c1-88ec-77e2b32c293f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:51.538881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:51.549537 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8299ac23-7d31-44c1-88ec-77e2b32c293f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.516939 Aug 27 04:42:51.551240 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1400/2840] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:51 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:51.566716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d4d94a1f-e436-435c-8829-05b15317f25a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:51.567624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d4d94a1f-e436-435c-8829-05b15317f25a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:51.607373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4d94a1f-e436-435c-8829-05b15317f25a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:51.608583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4d94a1f-e436-435c-8829-05b15317f25a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:51.610657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4d94a1f-e436-435c-8829-05b15317f25a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:51.612912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4d94a1f-e436-435c-8829-05b15317f25a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:51.613622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4d94a1f-e436-435c-8829-05b15317f25a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:51.615645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4d94a1f-e436-435c-8829-05b15317f25a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:51.838263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:42:51.839242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:42:51.839887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:42:51.840482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:42:51.841149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:42:51.864916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:51.870786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:51.871576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:51.878518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:51.881960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:51.886433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:51.951340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Getting quotas for project c901ec7cc4c04a858bca519630b40e8e. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:42:51.967982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Getting quotas for user 66685e0d1c2747ad929b47eec9f55044 and project c901ec7cc4c04a858bca519630b40e8e. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:42:52.013641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:42:52.016457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:42:52.133537 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-007a172c-c3a5-4fda-aa97-3757d991fcd7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.278598 Aug 27 04:42:52.138708 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1441/2841] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:42:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:42:52.150152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d4d94a1f-e436-435c-8829-05b15317f25a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:52.161352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85aa9994-0609-4547-8583-e38cd69fe9a9 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20eb8b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:52.163356 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d4d94a1f-e436-435c-8829-05b15317f25a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1315 microversion: 2.1 time: 0.606851 Aug 27 04:42:52.182658 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1401/2842] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:51 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:52.190470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e5114e68-58b5-4ca7-a2c6-a38a367b1784 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:52.191446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e5114e68-58b5-4ca7-a2c6-a38a367b1784 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:52.295449 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-85aa9994-0609-4547-8583-e38cd69fe9a9 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.155352 Aug 27 04:42:52.302881 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1442/2843] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:52 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:52.473153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e5114e68-58b5-4ca7-a2c6-a38a367b1784 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:52.487392 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e5114e68-58b5-4ca7-a2c6-a38a367b1784 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1222 microversion: 2.1 time: 0.303030 Aug 27 04:42:52.488454 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1402/2844] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:52 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1222 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:52.574394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1804ddfc-5bc4-48f5-874b-5fe5213eb324 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:52.575001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1804ddfc-5bc4-48f5-874b-5fe5213eb324 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:52.592195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1804ddfc-5bc4-48f5-874b-5fe5213eb324 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:52.592726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1804ddfc-5bc4-48f5-874b-5fe5213eb324 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:52.600967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1804ddfc-5bc4-48f5-874b-5fe5213eb324 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:52.601931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1804ddfc-5bc4-48f5-874b-5fe5213eb324 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:52.602420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1804ddfc-5bc4-48f5-874b-5fe5213eb324 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:52.602857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1804ddfc-5bc4-48f5-874b-5fe5213eb324 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:53.188958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c3dab458-ed86-4d1a-add8-31b89486c885 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:53.190723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c3dab458-ed86-4d1a-add8-31b89486c885 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:53.207211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3dab458-ed86-4d1a-add8-31b89486c885 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:53.208553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3dab458-ed86-4d1a-add8-31b89486c885 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:53.210649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3dab458-ed86-4d1a-add8-31b89486c885 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:53.213070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3dab458-ed86-4d1a-add8-31b89486c885 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:53.214851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3dab458-ed86-4d1a-add8-31b89486c885 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:53.217449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3dab458-ed86-4d1a-add8-31b89486c885 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:53.344282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1804ddfc-5bc4-48f5-874b-5fe5213eb324 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:53.357994 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1804ddfc-5bc4-48f5-874b-5fe5213eb324 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 0.789081 Aug 27 04:42:53.382548 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1443/2845] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:52 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:53.388480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c469526-ce01-436d-8ab8-1b8deeae3851 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20ea11f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:53.475516 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c469526-ce01-436d-8ab8-1b8deeae3851 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.091218 Aug 27 04:42:53.483986 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1444/2846] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:53 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:53.510914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2169b8e0-62b3-4394-ba9a-1acbebcf16e3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:53.511819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2169b8e0-62b3-4394-ba9a-1acbebcf16e3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:53.534487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2169b8e0-62b3-4394-ba9a-1acbebcf16e3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:53.540822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2169b8e0-62b3-4394-ba9a-1acbebcf16e3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:53.552347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2169b8e0-62b3-4394-ba9a-1acbebcf16e3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:53.553382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2169b8e0-62b3-4394-ba9a-1acbebcf16e3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:53.554016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2169b8e0-62b3-4394-ba9a-1acbebcf16e3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:53.554702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2169b8e0-62b3-4394-ba9a-1acbebcf16e3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:53.930082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c3dab458-ed86-4d1a-add8-31b89486c885 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:53.947111 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c3dab458-ed86-4d1a-add8-31b89486c885 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1315 microversion: 2.1 time: 0.765428 Aug 27 04:42:53.948947 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1403/2847] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:53 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1315 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:54.380121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-36a068d7-8fdd-452c-8e63-9fb7e663f9eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:54.381005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-36a068d7-8fdd-452c-8e63-9fb7e663f9eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:54.399580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36a068d7-8fdd-452c-8e63-9fb7e663f9eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:54.402489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36a068d7-8fdd-452c-8e63-9fb7e663f9eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:54.405715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36a068d7-8fdd-452c-8e63-9fb7e663f9eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:54.413209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36a068d7-8fdd-452c-8e63-9fb7e663f9eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:54.415140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36a068d7-8fdd-452c-8e63-9fb7e663f9eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:54.415754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36a068d7-8fdd-452c-8e63-9fb7e663f9eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:54.488992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2169b8e0-62b3-4394-ba9a-1acbebcf16e3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:54.506469 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2169b8e0-62b3-4394-ba9a-1acbebcf16e3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1218 microversion: 2.1 time: 1.001618 Aug 27 04:42:54.511081 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1445/2848] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:53 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1218 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:54.526427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-939e59c7-ade7-41e2-83cf-52c13ec9c9a6 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e718b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:54.655035 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-939e59c7-ade7-41e2-83cf-52c13ec9c9a6 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.141318 Aug 27 04:42:54.655751 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1446/2849] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:54 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:54.972250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86486eb9-aee6-4627-9897-e4c2511fcda3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:54.973060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86486eb9-aee6-4627-9897-e4c2511fcda3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:54.994974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86486eb9-aee6-4627-9897-e4c2511fcda3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:54.998128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86486eb9-aee6-4627-9897-e4c2511fcda3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:54.999623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86486eb9-aee6-4627-9897-e4c2511fcda3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:55.001478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86486eb9-aee6-4627-9897-e4c2511fcda3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:55.004065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86486eb9-aee6-4627-9897-e4c2511fcda3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:55.005555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86486eb9-aee6-4627-9897-e4c2511fcda3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:55.821092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86486eb9-aee6-4627-9897-e4c2511fcda3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:55.829095 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86486eb9-aee6-4627-9897-e4c2511fcda3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1315 microversion: 2.1 time: 0.861449 Aug 27 04:42:55.833644 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1447/2850] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:54 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1315 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:55.840613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3a5de34-5946-469b-96ac-a811b9d930f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:55.847618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c3a5de34-5946-469b-96ac-a811b9d930f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:55.868792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3a5de34-5946-469b-96ac-a811b9d930f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:55.870137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3a5de34-5946-469b-96ac-a811b9d930f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:55.870793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3a5de34-5946-469b-96ac-a811b9d930f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:55.875519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3a5de34-5946-469b-96ac-a811b9d930f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:55.875519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3a5de34-5946-469b-96ac-a811b9d930f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:55.875519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3a5de34-5946-469b-96ac-a811b9d930f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:56.161413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3a5de34-5946-469b-96ac-a811b9d930f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:56.172720 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3a5de34-5946-469b-96ac-a811b9d930f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1280 microversion: 2.1 time: 0.337512 Aug 27 04:42:56.177534 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1448/2851] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:55 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1280 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:56.189499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78d7cb64-daab-41ce-bd70-3df6d1e4a14f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f218f3dc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:56.285257 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78d7cb64-daab-41ce-bd70-3df6d1e4a14f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.103244 Aug 27 04:42:56.297315 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1449/2852] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:56 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:56.414447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e3321519-66fc-4ec2-933a-43322d7f3542 req-367e561f-0a35-455f-bc60-b446cb25c12c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c", "tag": "68ab2f4f-4070-462a-b9f1-f0bfd0940ba2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:56.435592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e3321519-66fc-4ec2-933a-43322d7f3542 req-367e561f-0a35-455f-bc60-b446cb25c12c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:56.436414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e3321519-66fc-4ec2-933a-43322d7f3542 req-367e561f-0a35-455f-bc60-b446cb25c12c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:56.436893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e3321519-66fc-4ec2-933a-43322d7f3542 req-367e561f-0a35-455f-bc60-b446cb25c12c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:56.462867 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e3321519-66fc-4ec2-933a-43322d7f3542 req-367e561f-0a35-455f-bc60-b446cb25c12c service nova] Creating event network-changed:68ab2f4f-4070-462a-b9f1-f0bfd0940ba2 for instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c on n-h1-854823-1 Aug 27 04:42:56.488449 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e3321519-66fc-4ec2-933a-43322d7f3542 req-367e561f-0a35-455f-bc60-b446cb25c12c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079430 Aug 27 04:42:56.496162 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1450/2853] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:56.858660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64468f98-bf24-4e71-a115-928a13d3745f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:56.859375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-64468f98-bf24-4e71-a115-928a13d3745f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:56.872773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-36a068d7-8fdd-452c-8e63-9fb7e663f9eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:56.874580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64468f98-bf24-4e71-a115-928a13d3745f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:56.884120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64468f98-bf24-4e71-a115-928a13d3745f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:56.884596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64468f98-bf24-4e71-a115-928a13d3745f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:56.885349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64468f98-bf24-4e71-a115-928a13d3745f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:56.886668 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-36a068d7-8fdd-452c-8e63-9fb7e663f9eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1390 microversion: 2.1 time: 2.511208 Aug 27 04:42:56.887271 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1404/2854] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:54 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1390 bytes in 2513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:56.889824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64468f98-bf24-4e71-a115-928a13d3745f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:56.890292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64468f98-bf24-4e71-a115-928a13d3745f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:57.201265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-902451b2-0e74-4fc6-a79f-f965548eac52 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:57.201891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-902451b2-0e74-4fc6-a79f-f965548eac52 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:57.218582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-902451b2-0e74-4fc6-a79f-f965548eac52 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:57.219277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-902451b2-0e74-4fc6-a79f-f965548eac52 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:57.219965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-902451b2-0e74-4fc6-a79f-f965548eac52 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:57.220974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-902451b2-0e74-4fc6-a79f-f965548eac52 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:57.221602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-902451b2-0e74-4fc6-a79f-f965548eac52 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:57.222190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-902451b2-0e74-4fc6-a79f-f965548eac52 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:57.890272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-64468f98-bf24-4e71-a115-928a13d3745f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:57.900470 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64468f98-bf24-4e71-a115-928a13d3745f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1315 microversion: 2.1 time: 1.047235 Aug 27 04:42:57.901344 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1451/2855] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:56 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1315 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:57.918621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ad98fd2-f84e-445a-bab9-6c8ddee90e06 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e58280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:58.018550 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ad98fd2-f84e-445a-bab9-6c8ddee90e06 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.115456 Aug 27 04:42:58.019786 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1452/2856] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:57 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:58.027722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29df666a-ca99-4909-8d70-cea7fbc76a4f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:58.028811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29df666a-ca99-4909-8d70-cea7fbc76a4f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:58.038104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29df666a-ca99-4909-8d70-cea7fbc76a4f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:58.039465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29df666a-ca99-4909-8d70-cea7fbc76a4f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:58.040112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29df666a-ca99-4909-8d70-cea7fbc76a4f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:58.041071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29df666a-ca99-4909-8d70-cea7fbc76a4f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:58.041708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29df666a-ca99-4909-8d70-cea7fbc76a4f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:58.042301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29df666a-ca99-4909-8d70-cea7fbc76a4f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:58.295267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-902451b2-0e74-4fc6-a79f-f965548eac52 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:58.308414 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-902451b2-0e74-4fc6-a79f-f965548eac52 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1280 microversion: 2.1 time: 1.111252 Aug 27 04:42:58.327471 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1405/2857] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:57 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1280 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:58.890544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29df666a-ca99-4909-8d70-cea7fbc76a4f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:58.901356 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29df666a-ca99-4909-8d70-cea7fbc76a4f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1380 microversion: 2.1 time: 0.877753 Aug 27 04:42:58.929988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6d897e38-590f-4c6d-a307-e73f2a9cbbc2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:58.930621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6d897e38-590f-4c6d-a307-e73f2a9cbbc2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:58.935001 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1453/2858] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:58 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1380 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:58.969746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d897e38-590f-4c6d-a307-e73f2a9cbbc2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:58.970467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27106cf5-3cad-4bfc-92df-b513f0849ecc tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '.version_select at 0x7f1f20e58790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:58.970599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d897e38-590f-4c6d-a307-e73f2a9cbbc2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:58.974754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d897e38-590f-4c6d-a307-e73f2a9cbbc2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:58.982265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27106cf5-3cad-4bfc-92df-b513f0849ecc tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:58.982761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27106cf5-3cad-4bfc-92df-b513f0849ecc tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:58.982988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d897e38-590f-4c6d-a307-e73f2a9cbbc2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:58.983207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27106cf5-3cad-4bfc-92df-b513f0849ecc tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:58.984091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d897e38-590f-4c6d-a307-e73f2a9cbbc2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:58.985767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d897e38-590f-4c6d-a307-e73f2a9cbbc2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:59.008185 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-27106cf5-3cad-4bfc-92df-b513f0849ecc tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1554 microversion: 2.1 time: 0.067617 Aug 27 04:42:59.013220 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1454/2859] 10.222.0.79 () {58 vars in 1143 bytes} [Sat Aug 27 04:42:58 2022] GET /compute/v2.1/os-migrations => generated 1554 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:59.028383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4128b953-28f1-485d-8f43-e6b4882cb53d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:59.034810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4128b953-28f1-485d-8f43-e6b4882cb53d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:59.048812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4128b953-28f1-485d-8f43-e6b4882cb53d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:59.050056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4128b953-28f1-485d-8f43-e6b4882cb53d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:59.052166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4128b953-28f1-485d-8f43-e6b4882cb53d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:59.055915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4128b953-28f1-485d-8f43-e6b4882cb53d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:59.056676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4128b953-28f1-485d-8f43-e6b4882cb53d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:59.057337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4128b953-28f1-485d-8f43-e6b4882cb53d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:59.633303 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4128b953-28f1-485d-8f43-e6b4882cb53d tempest-LiveMigrationTest-2095607927 tempest-LiveMigrationTest-2095607927-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1531 microversion: 2.1 time: 0.604332 Aug 27 04:42:59.633971 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1455/2860] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:59 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1531 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:59.652365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ef90566-71d9-4e2d-8135-8e961aabe3b3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e71280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:59.733064 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8ef90566-71d9-4e2d-8135-8e961aabe3b3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.090495 Aug 27 04:42:59.733660 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1456/2861] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:59 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:59.751037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-385170b1-25c3-48ec-8947-2564900b9bc7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:59.752251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-385170b1-25c3-48ec-8947-2564900b9bc7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:59.781265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-385170b1-25c3-48ec-8947-2564900b9bc7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:59.782827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-385170b1-25c3-48ec-8947-2564900b9bc7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:59.783685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-385170b1-25c3-48ec-8947-2564900b9bc7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:59.785094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-385170b1-25c3-48ec-8947-2564900b9bc7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:59.785936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-385170b1-25c3-48ec-8947-2564900b9bc7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:59.786588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-385170b1-25c3-48ec-8947-2564900b9bc7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:59.863190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:00.310451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6d897e38-590f-4c6d-a307-e73f2a9cbbc2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:00.342811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-385170b1-25c3-48ec-8947-2564900b9bc7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:00.365465 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6d897e38-590f-4c6d-a307-e73f2a9cbbc2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1315 microversion: 2.1 time: 1.445960 Aug 27 04:43:00.379031 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-385170b1-25c3-48ec-8947-2564900b9bc7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1280 microversion: 2.1 time: 0.631715 Aug 27 04:43:00.379031 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1457/2862] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:59 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1280 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:00.379342 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1406/2863] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:58 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1315 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:00.385771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d0d6a7a-a134-4e3d-993d-e4a85e991764 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:00.386282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d0d6a7a-a134-4e3d-993d-e4a85e991764 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:00.401941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d0d6a7a-a134-4e3d-993d-e4a85e991764 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:00.403789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d0d6a7a-a134-4e3d-993d-e4a85e991764 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:00.404245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d0d6a7a-a134-4e3d-993d-e4a85e991764 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:00.407734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d0d6a7a-a134-4e3d-993d-e4a85e991764 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:00.409281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d0d6a7a-a134-4e3d-993d-e4a85e991764 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:00.410741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d0d6a7a-a134-4e3d-993d-e4a85e991764 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:00.499111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d0d6a7a-a134-4e3d-993d-e4a85e991764 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:43:00.752381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7ce346a7-8e6e-4b0b-8fa4-4d4b83951ea1 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21558310>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:00.768501 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d0d6a7a-a134-4e3d-993d-e4a85e991764 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 204 len: 0 microversion: 2.1 time: 0.392386 Aug 27 04:43:00.774111 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1458/2864] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:43:00 2022] DELETE /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:43:00.785645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-348bef9c-2a2d-4c68-8f7d-f28cb77262db tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:00.786941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-348bef9c-2a2d-4c68-8f7d-f28cb77262db tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:00.802801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-348bef9c-2a2d-4c68-8f7d-f28cb77262db tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:00.805177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-348bef9c-2a2d-4c68-8f7d-f28cb77262db tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:00.806150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-348bef9c-2a2d-4c68-8f7d-f28cb77262db tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:00.807359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-348bef9c-2a2d-4c68-8f7d-f28cb77262db tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:00.815345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-348bef9c-2a2d-4c68-8f7d-f28cb77262db tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:00.817248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-348bef9c-2a2d-4c68-8f7d-f28cb77262db tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:00.825836 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7ce346a7-8e6e-4b0b-8fa4-4d4b83951ea1 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.078308 Aug 27 04:43:00.830058 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1407/2865] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:00 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:01.283086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-348bef9c-2a2d-4c68-8f7d-f28cb77262db tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:01.296004 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-348bef9c-2a2d-4c68-8f7d-f28cb77262db tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1386 microversion: 2.1 time: 0.520080 Aug 27 04:43:01.297205 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1459/2866] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:00 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1386 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:01.393427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2d230b84-64fd-48c8-ba38-77782a5a1fd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:01.394724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ddea1c3e-e369-40f9-8ce1-d4be550cb3e7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:01.397863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ddea1c3e-e369-40f9-8ce1-d4be550cb3e7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:01.401184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2d230b84-64fd-48c8-ba38-77782a5a1fd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:01.423798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddea1c3e-e369-40f9-8ce1-d4be550cb3e7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:01.426356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddea1c3e-e369-40f9-8ce1-d4be550cb3e7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:01.428392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddea1c3e-e369-40f9-8ce1-d4be550cb3e7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:01.429132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d230b84-64fd-48c8-ba38-77782a5a1fd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:01.432209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d230b84-64fd-48c8-ba38-77782a5a1fd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:01.433023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d230b84-64fd-48c8-ba38-77782a5a1fd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:01.433613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddea1c3e-e369-40f9-8ce1-d4be550cb3e7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:01.437303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddea1c3e-e369-40f9-8ce1-d4be550cb3e7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:01.438020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d230b84-64fd-48c8-ba38-77782a5a1fd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:01.438642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddea1c3e-e369-40f9-8ce1-d4be550cb3e7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:01.439287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d230b84-64fd-48c8-ba38-77782a5a1fd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:01.446278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d230b84-64fd-48c8-ba38-77782a5a1fd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:01.614210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ddea1c3e-e369-40f9-8ce1-d4be550cb3e7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:01.628605 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ddea1c3e-e369-40f9-8ce1-d4be550cb3e7 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1280 microversion: 2.1 time: 0.243542 Aug 27 04:43:01.629972 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1460/2867] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:01 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1280 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:01.843431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-93997809-5c87-4fb1-9d56-e7e3866e99f7 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20ea18b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:01.905929 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-93997809-5c87-4fb1-9d56-e7e3866e99f7 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.067560 Aug 27 04:43:01.906530 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1461/2868] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:01 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:43:02.318916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a77ed5c-d25a-4ce3-b6a2-d846e0403297 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:02.319952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a77ed5c-d25a-4ce3-b6a2-d846e0403297 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:02.331343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:02.333663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=14 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:02.341041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a77ed5c-d25a-4ce3-b6a2-d846e0403297 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:02.342098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a77ed5c-d25a-4ce3-b6a2-d846e0403297 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:02.343633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a77ed5c-d25a-4ce3-b6a2-d846e0403297 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:02.346550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a77ed5c-d25a-4ce3-b6a2-d846e0403297 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:02.347535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a77ed5c-d25a-4ce3-b6a2-d846e0403297 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:02.350106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a77ed5c-d25a-4ce3-b6a2-d846e0403297 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:02.423182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2d230b84-64fd-48c8-ba38-77782a5a1fd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:02.447967 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2d230b84-64fd-48c8-ba38-77782a5a1fd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1315 microversion: 2.1 time: 1.064770 Aug 27 04:43:02.464568 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1408/2869] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:01 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1315 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:02.651655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-38de8bc1-ef4b-4f80-8f3c-feebd4224823 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:02.652600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-38de8bc1-ef4b-4f80-8f3c-feebd4224823 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:02.664620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:02.670719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38de8bc1-ef4b-4f80-8f3c-feebd4224823 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:02.671687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38de8bc1-ef4b-4f80-8f3c-feebd4224823 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:02.672404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38de8bc1-ef4b-4f80-8f3c-feebd4224823 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:02.675734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38de8bc1-ef4b-4f80-8f3c-feebd4224823 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:02.677072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38de8bc1-ef4b-4f80-8f3c-feebd4224823 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:02.677625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38de8bc1-ef4b-4f80-8f3c-feebd4224823 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:03.322235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a77ed5c-d25a-4ce3-b6a2-d846e0403297 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:03.337704 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a77ed5c-d25a-4ce3-b6a2-d846e0403297 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1386 microversion: 2.1 time: 1.023961 Aug 27 04:43:03.338573 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1462/2870] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:02 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1386 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:43:03.346028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12324ba6-e027-474b-bc4e-74dd29d59473 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f218d3af0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:03.452454 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12324ba6-e027-474b-bc4e-74dd29d59473 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.112589 Aug 27 04:43:03.454295 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1463/2871] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:03 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:03.481013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-11cb785d-90fc-4417-ae3e-accf352583c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:03.483160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-11cb785d-90fc-4417-ae3e-accf352583c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:03.515195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-38de8bc1-ef4b-4f80-8f3c-feebd4224823 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:03.549635 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-38de8bc1-ef4b-4f80-8f3c-feebd4224823 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1322 microversion: 2.1 time: 0.892046 Aug 27 04:43:03.552553 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1409/2872] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:02 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1322 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:03.565500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11cb785d-90fc-4417-ae3e-accf352583c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:03.569271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11cb785d-90fc-4417-ae3e-accf352583c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:03.576926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11cb785d-90fc-4417-ae3e-accf352583c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:03.581575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11cb785d-90fc-4417-ae3e-accf352583c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:03.582635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11cb785d-90fc-4417-ae3e-accf352583c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:03.584377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11cb785d-90fc-4417-ae3e-accf352583c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:04.134996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11cb785d-90fc-4417-ae3e-accf352583c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:04.153780 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-11cb785d-90fc-4417-ae3e-accf352583c3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1315 microversion: 2.1 time: 0.680133 Aug 27 04:43:04.159040 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1464/2873] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:03 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:04.365185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4d6ee6fd-e8ca-4460-9c7d-dce6f2df51c6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:04.370479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4d6ee6fd-e8ca-4460-9c7d-dce6f2df51c6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:04.392497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d6ee6fd-e8ca-4460-9c7d-dce6f2df51c6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:04.393017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d6ee6fd-e8ca-4460-9c7d-dce6f2df51c6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:04.393452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d6ee6fd-e8ca-4460-9c7d-dce6f2df51c6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:04.400208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d6ee6fd-e8ca-4460-9c7d-dce6f2df51c6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:04.401383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d6ee6fd-e8ca-4460-9c7d-dce6f2df51c6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:04.402726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d6ee6fd-e8ca-4460-9c7d-dce6f2df51c6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:04.467832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a56beb6-3782-4478-90ed-2290a3a4b620 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20f52280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:04.535608 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a56beb6-3782-4478-90ed-2290a3a4b620 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1455 microversion: 2.1 time: 0.071332 Aug 27 04:43:04.536455 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1465/2874] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:04 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:04.594460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ec4e674-d59c-4df0-9f8b-bc200b513c3a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:04.595439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ec4e674-d59c-4df0-9f8b-bc200b513c3a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:04.616084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec4e674-d59c-4df0-9f8b-bc200b513c3a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:04.618184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec4e674-d59c-4df0-9f8b-bc200b513c3a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:04.619573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec4e674-d59c-4df0-9f8b-bc200b513c3a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:04.622936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec4e674-d59c-4df0-9f8b-bc200b513c3a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:04.624245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec4e674-d59c-4df0-9f8b-bc200b513c3a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:04.626244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec4e674-d59c-4df0-9f8b-bc200b513c3a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:05.066896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4d6ee6fd-e8ca-4460-9c7d-dce6f2df51c6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:05.093037 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4d6ee6fd-e8ca-4460-9c7d-dce6f2df51c6 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1386 microversion: 2.1 time: 0.738326 Aug 27 04:43:05.094199 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1410/2875] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:04 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1386 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:05.136815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-0560f817-5662-4b68-9ef7-475888228483 req-e6109efc-d1a9-432f-bfe6-a02da5fabd4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c1a9e4-475f-4c6a-bf72-653e8fc46611", "name": "network-vif-deleted", "tag": "c7badfa4-4c98-4ab6-80be-9df19f2265d3"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:05.137744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ec4e674-d59c-4df0-9f8b-bc200b513c3a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:05.156604 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ec4e674-d59c-4df0-9f8b-bc200b513c3a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1322 microversion: 2.1 time: 0.568156 Aug 27 04:43:05.161194 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1466/2876] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:04 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1322 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:05.177098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0560f817-5662-4b68-9ef7-475888228483 req-e6109efc-d1a9-432f-bfe6-a02da5fabd4a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:05.177098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0560f817-5662-4b68-9ef7-475888228483 req-e6109efc-d1a9-432f-bfe6-a02da5fabd4a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:05.177098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0560f817-5662-4b68-9ef7-475888228483 req-e6109efc-d1a9-432f-bfe6-a02da5fabd4a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:05.191656 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-0560f817-5662-4b68-9ef7-475888228483 req-e6109efc-d1a9-432f-bfe6-a02da5fabd4a service nova] Creating event network-vif-deleted:c7badfa4-4c98-4ab6-80be-9df19f2265d3 for instance c3c1a9e4-475f-4c6a-bf72-653e8fc46611 on n-h1-854823-1 Aug 27 04:43:05.197165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1c87ad71-3b09-40e6-86c6-c1408ff4dae0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:05.197950 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-0560f817-5662-4b68-9ef7-475888228483 req-e6109efc-d1a9-432f-bfe6-a02da5fabd4a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066097 Aug 27 04:43:05.198795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1c87ad71-3b09-40e6-86c6-c1408ff4dae0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:05.199131 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1411/2877] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:05.226646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c87ad71-3b09-40e6-86c6-c1408ff4dae0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:05.227330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c87ad71-3b09-40e6-86c6-c1408ff4dae0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:05.232584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c87ad71-3b09-40e6-86c6-c1408ff4dae0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:05.234196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c87ad71-3b09-40e6-86c6-c1408ff4dae0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:05.236182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c87ad71-3b09-40e6-86c6-c1408ff4dae0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:05.237003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c87ad71-3b09-40e6-86c6-c1408ff4dae0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:05.564350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0e956065-d998-4edb-9d59-7e8b69468451 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f25e543a0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:05.697621 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0e956065-d998-4edb-9d59-7e8b69468451 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1464 microversion: 2.1 time: 0.148859 Aug 27 04:43:05.708930 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1412/2878] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:05 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1464 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:43:05.714353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a6f1b42f-3d46-46a7-bda3-29a4bd116e81 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21a04940>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:05.800274 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a6f1b42f-3d46-46a7-bda3-29a4bd116e81 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 200 len: 1464 microversion: 2.1 time: 0.078730 Aug 27 04:43:05.819213 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1413/2879] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:05 2022] GET /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 1464 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:05.826370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d6d87a6-d9bf-4f1a-be9c-450d9ac8b9e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:05.827125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9d6d87a6-d9bf-4f1a-be9c-450d9ac8b9e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:05.840197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d6d87a6-d9bf-4f1a-be9c-450d9ac8b9e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:05.840730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d6d87a6-d9bf-4f1a-be9c-450d9ac8b9e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:05.845271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d6d87a6-d9bf-4f1a-be9c-450d9ac8b9e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:05.846344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d6d87a6-d9bf-4f1a-be9c-450d9ac8b9e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:05.846878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d6d87a6-d9bf-4f1a-be9c-450d9ac8b9e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:05.847320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d6d87a6-d9bf-4f1a-be9c-450d9ac8b9e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:06.057677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c87ad71-3b09-40e6-86c6-c1408ff4dae0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:06.069411 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1c87ad71-3b09-40e6-86c6-c1408ff4dae0 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1315 microversion: 2.1 time: 0.886991 Aug 27 04:43:06.072830 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1467/2880] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:05 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1315 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:06.117924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60528f72-66e2-4704-b204-ce4c869d1332 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:06.118965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60528f72-66e2-4704-b204-ce4c869d1332 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:06.135994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60528f72-66e2-4704-b204-ce4c869d1332 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:06.137860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60528f72-66e2-4704-b204-ce4c869d1332 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:06.140113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60528f72-66e2-4704-b204-ce4c869d1332 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:06.155220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60528f72-66e2-4704-b204-ce4c869d1332 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:06.163229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60528f72-66e2-4704-b204-ce4c869d1332 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:06.165096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60528f72-66e2-4704-b204-ce4c869d1332 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:06.488749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60528f72-66e2-4704-b204-ce4c869d1332 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:06.526360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9d6d87a6-d9bf-4f1a-be9c-450d9ac8b9e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:06.535752 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60528f72-66e2-4704-b204-ce4c869d1332 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1183 microversion: 2.1 time: 0.424147 Aug 27 04:43:06.536374 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1468/2881] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:06 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1183 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:06.558269 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9d6d87a6-d9bf-4f1a-be9c-450d9ac8b9e8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1468 microversion: 2.1 time: 0.737494 Aug 27 04:43:06.566702 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1414/2882] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:05 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1468 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:06.572660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3747ebbf-f1a8-4b41-919d-6aa26cdaf487 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:06.573295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3747ebbf-f1a8-4b41-919d-6aa26cdaf487 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:06.591379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4cc1aaa4-22dc-42c0-86a8-9bffd54e71c3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-13488452"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:06.594336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4cc1aaa4-22dc-42c0-86a8-9bffd54e71c3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 0e0d6029-a40b-45b9-b230-2033ec88617e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:06.604211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3747ebbf-f1a8-4b41-919d-6aa26cdaf487 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:06.606978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3747ebbf-f1a8-4b41-919d-6aa26cdaf487 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:06.612762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3747ebbf-f1a8-4b41-919d-6aa26cdaf487 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:06.613342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3747ebbf-f1a8-4b41-919d-6aa26cdaf487 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:06.615021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3747ebbf-f1a8-4b41-919d-6aa26cdaf487 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:06.615709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3747ebbf-f1a8-4b41-919d-6aa26cdaf487 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:06.629263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cc1aaa4-22dc-42c0-86a8-9bffd54e71c3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:06.633962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cc1aaa4-22dc-42c0-86a8-9bffd54e71c3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:06.635574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cc1aaa4-22dc-42c0-86a8-9bffd54e71c3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:06.638816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cc1aaa4-22dc-42c0-86a8-9bffd54e71c3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:06.646016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cc1aaa4-22dc-42c0-86a8-9bffd54e71c3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:06.647899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cc1aaa4-22dc-42c0-86a8-9bffd54e71c3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:07.178276 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4cc1aaa4-22dc-42c0-86a8-9bffd54e71c3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "POST /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e/action" status: 202 len: 0 microversion: 2.1 time: 0.587597 Aug 27 04:43:07.181367 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1415/2883] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:43:06 2022] POST /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 27 04:43:07.208409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-c024d706-0bff-44d7-a78f-ef8f5f57348a req-18b749ec-1929-41bf-acb2-85e4dd5e11e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c", "name": "network-vif-plugged", "status": "completed", "tag": "68ab2f4f-4070-462a-b9f1-f0bfd0940ba2"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:07.225959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c024d706-0bff-44d7-a78f-ef8f5f57348a req-18b749ec-1929-41bf-acb2-85e4dd5e11e5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:07.228876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c024d706-0bff-44d7-a78f-ef8f5f57348a req-18b749ec-1929-41bf-acb2-85e4dd5e11e5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:07.237656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c024d706-0bff-44d7-a78f-ef8f5f57348a req-18b749ec-1929-41bf-acb2-85e4dd5e11e5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:07.269669 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-c024d706-0bff-44d7-a78f-ef8f5f57348a req-18b749ec-1929-41bf-acb2-85e4dd5e11e5 service nova] Creating event network-vif-plugged:68ab2f4f-4070-462a-b9f1-f0bfd0940ba2 for instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c on n-h1-854823-1 Aug 27 04:43:07.284722 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-c024d706-0bff-44d7-a78f-ef8f5f57348a req-18b749ec-1929-41bf-acb2-85e4dd5e11e5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100123 Aug 27 04:43:07.293676 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1416/2884] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:07.301071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c5036447-ac22-4de3-8f68-ab88538c7804 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:07.302320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c5036447-ac22-4de3-8f68-ab88538c7804 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:07.329736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5036447-ac22-4de3-8f68-ab88538c7804 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:07.330495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5036447-ac22-4de3-8f68-ab88538c7804 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:07.331117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5036447-ac22-4de3-8f68-ab88538c7804 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:07.332082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5036447-ac22-4de3-8f68-ab88538c7804 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:07.332848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5036447-ac22-4de3-8f68-ab88538c7804 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:07.333427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5036447-ac22-4de3-8f68-ab88538c7804 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:07.355262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3747ebbf-f1a8-4b41-919d-6aa26cdaf487 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:07.385055 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3747ebbf-f1a8-4b41-919d-6aa26cdaf487 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1322 microversion: 2.1 time: 0.820772 Aug 27 04:43:07.386884 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1469/2885] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:06 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1322 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:07.414978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c9e59adc-64b3-41bc-965a-d1958894a3fd req-84789abf-ca79-485a-9d7e-735800ce8a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82475b2-a407-4da4-afa7-23c2ffc38415", "tag": "20abfd0d-de86-4429-9b8c-f2ff325b15f6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:07.447997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9e59adc-64b3-41bc-965a-d1958894a3fd req-84789abf-ca79-485a-9d7e-735800ce8a35 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:07.449560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9e59adc-64b3-41bc-965a-d1958894a3fd req-84789abf-ca79-485a-9d7e-735800ce8a35 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:07.450259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9e59adc-64b3-41bc-965a-d1958894a3fd req-84789abf-ca79-485a-9d7e-735800ce8a35 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:07.466951 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c9e59adc-64b3-41bc-965a-d1958894a3fd req-84789abf-ca79-485a-9d7e-735800ce8a35 service nova] Creating event network-changed:20abfd0d-de86-4429-9b8c-f2ff325b15f6 for instance c82475b2-a407-4da4-afa7-23c2ffc38415 on n-h2-854823-1 Aug 27 04:43:07.474788 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c9e59adc-64b3-41bc-965a-d1958894a3fd req-84789abf-ca79-485a-9d7e-735800ce8a35 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077026 Aug 27 04:43:07.475790 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1470/2886] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:07.483031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bff9bac7-e579-4496-8226-04a92a8a8f75 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e6bc10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:07.606831 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bff9bac7-e579-4496-8226-04a92a8a8f75 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.128870 Aug 27 04:43:07.615830 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1471/2887] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:07 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:07.626586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f083fc4b-539c-4a8b-ac78-7f4a03e6ff44 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:07.629108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f083fc4b-539c-4a8b-ac78-7f4a03e6ff44 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:07.645842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f083fc4b-539c-4a8b-ac78-7f4a03e6ff44 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:07.646717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f083fc4b-539c-4a8b-ac78-7f4a03e6ff44 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:07.649630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f083fc4b-539c-4a8b-ac78-7f4a03e6ff44 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:07.651206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f083fc4b-539c-4a8b-ac78-7f4a03e6ff44 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:07.653922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f083fc4b-539c-4a8b-ac78-7f4a03e6ff44 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:07.654639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f083fc4b-539c-4a8b-ac78-7f4a03e6ff44 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:07.859237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f083fc4b-539c-4a8b-ac78-7f4a03e6ff44 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:07.874253 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f083fc4b-539c-4a8b-ac78-7f4a03e6ff44 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1183 microversion: 2.1 time: 0.257281 Aug 27 04:43:07.880649 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1472/2888] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:07 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1183 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:08.279689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c5036447-ac22-4de3-8f68-ab88538c7804 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:08.296149 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c5036447-ac22-4de3-8f68-ab88538c7804 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1315 microversion: 2.1 time: 1.000448 Aug 27 04:43:08.311303 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1417/2889] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:07 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1315 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:08.409347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94998aa4-9634-46d9-8044-4481ae8a8b92 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:08.410718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94998aa4-9634-46d9-8044-4481ae8a8b92 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:08.430566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94998aa4-9634-46d9-8044-4481ae8a8b92 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:08.432748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94998aa4-9634-46d9-8044-4481ae8a8b92 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:08.435735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94998aa4-9634-46d9-8044-4481ae8a8b92 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:08.437985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94998aa4-9634-46d9-8044-4481ae8a8b92 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:08.438691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94998aa4-9634-46d9-8044-4481ae8a8b92 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:08.441097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94998aa4-9634-46d9-8044-4481ae8a8b92 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:08.630670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f1300b75-759d-4cfb-a8fa-e494565a67f3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f213df0d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:08.723858 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f1300b75-759d-4cfb-a8fa-e494565a67f3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.097702 Aug 27 04:43:08.740499 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1418/2890] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:08 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:08.904687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3b90cd22-886d-4551-9dc8-1a71641ded66 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:08.905248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3b90cd22-886d-4551-9dc8-1a71641ded66 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:08.916170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b90cd22-886d-4551-9dc8-1a71641ded66 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:08.916491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b90cd22-886d-4551-9dc8-1a71641ded66 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:08.918925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b90cd22-886d-4551-9dc8-1a71641ded66 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:08.920033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b90cd22-886d-4551-9dc8-1a71641ded66 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:08.922544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b90cd22-886d-4551-9dc8-1a71641ded66 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:08.923888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b90cd22-886d-4551-9dc8-1a71641ded66 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:09.178568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94998aa4-9634-46d9-8044-4481ae8a8b92 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:09.187214 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94998aa4-9634-46d9-8044-4481ae8a8b92 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1322 microversion: 2.1 time: 0.782974 Aug 27 04:43:09.197397 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1473/2891] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:08 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1322 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:09.243312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3b90cd22-886d-4551-9dc8-1a71641ded66 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:09.267747 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3b90cd22-886d-4551-9dc8-1a71641ded66 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1183 microversion: 2.1 time: 0.357365 Aug 27 04:43:09.281841 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1419/2892] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:08 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:43:09.319159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ddbdc338-828f-4cac-959c-df15e96b4125 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:09.325870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ddbdc338-828f-4cac-959c-df15e96b4125 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:09.342144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddbdc338-828f-4cac-959c-df15e96b4125 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:09.342891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddbdc338-828f-4cac-959c-df15e96b4125 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:09.343557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddbdc338-828f-4cac-959c-df15e96b4125 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:09.344448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddbdc338-828f-4cac-959c-df15e96b4125 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:09.345434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddbdc338-828f-4cac-959c-df15e96b4125 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:09.346044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddbdc338-828f-4cac-959c-df15e96b4125 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:09.752817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-44fce381-fa6a-4ad6-b3c8-6c5acf7573c4 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f213dd1f0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:09.868089 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-44fce381-fa6a-4ad6-b3c8-6c5acf7573c4 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.108036 Aug 27 04:43:09.872208 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1420/2893] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:09 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:10.066076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ddbdc338-828f-4cac-959c-df15e96b4125 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:10.085362 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ddbdc338-828f-4cac-959c-df15e96b4125 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1315 microversion: 2.1 time: 0.770672 Aug 27 04:43:10.088309 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1474/2894] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:09 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:10.227825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2cd3cf1e-65fa-45ef-931e-86b6892f31a8 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:10.229383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2cd3cf1e-65fa-45ef-931e-86b6892f31a8 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:10.259024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2cd3cf1e-65fa-45ef-931e-86b6892f31a8 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:10.262327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2cd3cf1e-65fa-45ef-931e-86b6892f31a8 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:10.265667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2cd3cf1e-65fa-45ef-931e-86b6892f31a8 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:10.271580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2cd3cf1e-65fa-45ef-931e-86b6892f31a8 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:10.274624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2cd3cf1e-65fa-45ef-931e-86b6892f31a8 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:10.275105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2cd3cf1e-65fa-45ef-931e-86b6892f31a8 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:10.301501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62128b32-440d-4301-be8f-64e49f8a1cba tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:10.302275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-62128b32-440d-4301-be8f-64e49f8a1cba tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:10.311909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62128b32-440d-4301-be8f-64e49f8a1cba tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:10.317227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62128b32-440d-4301-be8f-64e49f8a1cba tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:10.317699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62128b32-440d-4301-be8f-64e49f8a1cba tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:10.318462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62128b32-440d-4301-be8f-64e49f8a1cba tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:10.319121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62128b32-440d-4301-be8f-64e49f8a1cba tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:10.319703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62128b32-440d-4301-be8f-64e49f8a1cba tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:10.501417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-62128b32-440d-4301-be8f-64e49f8a1cba tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:10.515132 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62128b32-440d-4301-be8f-64e49f8a1cba tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1183 microversion: 2.1 time: 0.217440 Aug 27 04:43:10.527030 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1475/2895] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:10 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:43:10.543255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cca8816c-9994-463a-b345-d0866d39cc7c req-bbcf0b3f-9b36-40c9-b0d3-658977a1a258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3", "name": "network-vif-unplugged", "status": "completed", "tag": "06142979-93d1-48a2-a72f-11b13cbb0e03"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:10.561487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cca8816c-9994-463a-b345-d0866d39cc7c req-bbcf0b3f-9b36-40c9-b0d3-658977a1a258 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:10.562246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cca8816c-9994-463a-b345-d0866d39cc7c req-bbcf0b3f-9b36-40c9-b0d3-658977a1a258 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:10.563652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cca8816c-9994-463a-b345-d0866d39cc7c req-bbcf0b3f-9b36-40c9-b0d3-658977a1a258 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:10.591990 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cca8816c-9994-463a-b345-d0866d39cc7c req-bbcf0b3f-9b36-40c9-b0d3-658977a1a258 service nova] Creating event network-vif-unplugged:06142979-93d1-48a2-a72f-11b13cbb0e03 for instance 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 on n-h1-854823-1 Aug 27 04:43:10.603013 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cca8816c-9994-463a-b345-d0866d39cc7c req-bbcf0b3f-9b36-40c9-b0d3-658977a1a258 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074371 Aug 27 04:43:10.607409 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1476/2896] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:10.888107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b3127dd-8013-40c2-83a3-826b48641595 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e6bee0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:10.910858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2cd3cf1e-65fa-45ef-931e-86b6892f31a8 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:10.935558 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2cd3cf1e-65fa-45ef-931e-86b6892f31a8 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1322 microversion: 2.1 time: 0.702332 Aug 27 04:43:10.954261 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1421/2897] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:10 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1322 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:11.000987 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b3127dd-8013-40c2-83a3-826b48641595 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.117066 Aug 27 04:43:11.001596 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1477/2898] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:10 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:43:11.110609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c889ddd9-1628-4917-8342-317909f70d19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:11.112221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c889ddd9-1628-4917-8342-317909f70d19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:11.126366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c889ddd9-1628-4917-8342-317909f70d19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:11.131789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c889ddd9-1628-4917-8342-317909f70d19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:11.132426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c889ddd9-1628-4917-8342-317909f70d19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:11.133267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c889ddd9-1628-4917-8342-317909f70d19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:11.133813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c889ddd9-1628-4917-8342-317909f70d19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:11.134313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c889ddd9-1628-4917-8342-317909f70d19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:11.548767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b78c18c9-f33a-4d4e-98d9-1fa9c1c7e438 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:11.549768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b78c18c9-f33a-4d4e-98d9-1fa9c1c7e438 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:11.562517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b78c18c9-f33a-4d4e-98d9-1fa9c1c7e438 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:11.580075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b78c18c9-f33a-4d4e-98d9-1fa9c1c7e438 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:11.584358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b78c18c9-f33a-4d4e-98d9-1fa9c1c7e438 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:11.588845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b78c18c9-f33a-4d4e-98d9-1fa9c1c7e438 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:11.590097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b78c18c9-f33a-4d4e-98d9-1fa9c1c7e438 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:11.593264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b78c18c9-f33a-4d4e-98d9-1fa9c1c7e438 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:11.810493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b78c18c9-f33a-4d4e-98d9-1fa9c1c7e438 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:11.814282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:11.829109 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b78c18c9-f33a-4d4e-98d9-1fa9c1c7e438 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1183 microversion: 2.1 time: 0.285359 Aug 27 04:43:11.832012 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1478/2899] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:11 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1183 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:43:11.964041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ffa5e99-f6c2-46a1-a5a1-a6361b1d5136 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:11.965087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ffa5e99-f6c2-46a1-a5a1-a6361b1d5136 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:11.979764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ffa5e99-f6c2-46a1-a5a1-a6361b1d5136 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:11.982378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ffa5e99-f6c2-46a1-a5a1-a6361b1d5136 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:11.983058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ffa5e99-f6c2-46a1-a5a1-a6361b1d5136 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:11.985353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ffa5e99-f6c2-46a1-a5a1-a6361b1d5136 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:11.986853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ffa5e99-f6c2-46a1-a5a1-a6361b1d5136 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:11.989098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ffa5e99-f6c2-46a1-a5a1-a6361b1d5136 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:12.406938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ffa5e99-f6c2-46a1-a5a1-a6361b1d5136 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:12.423705 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ffa5e99-f6c2-46a1-a5a1-a6361b1d5136 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1322 microversion: 2.1 time: 0.465168 Aug 27 04:43:12.437531 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1479/2900] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:11 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1322 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:12.437531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3d400e6-5d81-40ca-933d-c494f2ca6a72 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e63040>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:12.504988 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3d400e6-5d81-40ca-933d-c494f2ca6a72 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.078979 Aug 27 04:43:12.517233 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1480/2901] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:12 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:12.607761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c889ddd9-1628-4917-8342-317909f70d19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:12.651525 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c889ddd9-1628-4917-8342-317909f70d19 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1502 microversion: 2.1 time: 1.541191 Aug 27 04:43:12.654545 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1422/2902] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:11 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1502 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:12.686410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-945b8517-6acc-432a-8b5e-8ea52ddfb3ec tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:12.708407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945b8517-6acc-432a-8b5e-8ea52ddfb3ec tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:12.711375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945b8517-6acc-432a-8b5e-8ea52ddfb3ec tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:12.712697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945b8517-6acc-432a-8b5e-8ea52ddfb3ec tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:12.756940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-945b8517-6acc-432a-8b5e-8ea52ddfb3ec tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Going to try to stop instance {{(pid=128869) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 04:43:12.847381 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-945b8517-6acc-432a-8b5e-8ea52ddfb3ec tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "POST /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c/action" status: 202 len: 0 microversion: 2.1 time: 0.173846 Aug 27 04:43:12.847381 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1481/2903] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:43:12 2022] POST /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:43:12.855007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0f81790b-99ae-48b0-8446-ea80bedf5ef4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:12.856258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0f81790b-99ae-48b0-8446-ea80bedf5ef4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:12.865606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dee31a89-cf75-4172-9f35-efcb57f97653 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:12.866405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dee31a89-cf75-4172-9f35-efcb57f97653 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:12.872693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f81790b-99ae-48b0-8446-ea80bedf5ef4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:12.874399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f81790b-99ae-48b0-8446-ea80bedf5ef4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:12.875914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f81790b-99ae-48b0-8446-ea80bedf5ef4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:12.877202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f81790b-99ae-48b0-8446-ea80bedf5ef4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:12.877960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f81790b-99ae-48b0-8446-ea80bedf5ef4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:12.878819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f81790b-99ae-48b0-8446-ea80bedf5ef4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:12.887605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee31a89-cf75-4172-9f35-efcb57f97653 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:12.888180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee31a89-cf75-4172-9f35-efcb57f97653 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:12.888825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee31a89-cf75-4172-9f35-efcb57f97653 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:12.889572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee31a89-cf75-4172-9f35-efcb57f97653 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:12.890038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee31a89-cf75-4172-9f35-efcb57f97653 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:12.890470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee31a89-cf75-4172-9f35-efcb57f97653 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:12.915957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:13.062904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0f81790b-99ae-48b0-8446-ea80bedf5ef4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:13.073311 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0f81790b-99ae-48b0-8446-ea80bedf5ef4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1183 microversion: 2.1 time: 0.223906 Aug 27 04:43:13.074018 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1423/2904] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:12 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:13.350908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dee31a89-cf75-4172-9f35-efcb57f97653 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:13.360041 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dee31a89-cf75-4172-9f35-efcb57f97653 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1512 microversion: 2.1 time: 0.507577 Aug 27 04:43:13.365001 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1482/2905] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:12 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1512 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:13.446886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e88b4c20-f8b2-434b-b910-da60460df8f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:13.447695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e88b4c20-f8b2-434b-b910-da60460df8f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:13.455744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:13.458513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88b4c20-f8b2-434b-b910-da60460df8f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:13.459431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88b4c20-f8b2-434b-b910-da60460df8f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:13.460118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88b4c20-f8b2-434b-b910-da60460df8f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:13.461235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88b4c20-f8b2-434b-b910-da60460df8f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:13.462026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88b4c20-f8b2-434b-b910-da60460df8f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:13.462690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88b4c20-f8b2-434b-b910-da60460df8f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:13.685114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-202b86d7-60b2-4043-aeff-780587ab98d9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Action: 'create', calling method: .version_select at 0x7f1f212651f0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1146195231", "policies": ["affinity"]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:13.722053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-202b86d7-60b2-4043-aeff-780587ab98d9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:13.739211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-202b86d7-60b2-4043-aeff-780587ab98d9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for user b6adda0a01c642158e8399b9e98aa9cc and project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:13.784901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e88b4c20-f8b2-434b-b910-da60460df8f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:13.797072 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e88b4c20-f8b2-434b-b910-da60460df8f5 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1322 microversion: 2.1 time: 0.354728 Aug 27 04:43:13.798813 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1483/2906] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:13 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:13.816556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a2cda24b-c27d-414d-a02a-230a3b86552a tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e581f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:13.827381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-202b86d7-60b2-4043-aeff-780587ab98d9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:13.841668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-202b86d7-60b2-4043-aeff-780587ab98d9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for user b6adda0a01c642158e8399b9e98aa9cc and project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:13.903089 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a2cda24b-c27d-414d-a02a-230a3b86552a tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.102575 Aug 27 04:43:13.904802 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1484/2907] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:13 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:13.911475 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-202b86d7-60b2-4043-aeff-780587ab98d9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.484795 Aug 27 04:43:13.912821 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1424/2908] 10.222.0.79 () {60 vars in 1174 bytes} [Sat Aug 27 04:43:13 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:13.924742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aff92da6-b59c-4317-9ecc-089d636b36e9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Action: 'create', calling method: .version_select at 0x7f1f20e63670>, body: {"server_group": {"name": "tempest-server-group-1378678271", "policies": ["affinity"]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:13.965837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-aff92da6-b59c-4317-9ecc-089d636b36e9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:13.984069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-aff92da6-b59c-4317-9ecc-089d636b36e9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for user b6adda0a01c642158e8399b9e98aa9cc and project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:14.098458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99e25898-9dc3-45bd-aed5-ac332fd1f832 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:14.099118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-99e25898-9dc3-45bd-aed5-ac332fd1f832 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:14.117551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e25898-9dc3-45bd-aed5-ac332fd1f832 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:14.120093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-aff92da6-b59c-4317-9ecc-089d636b36e9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:14.121738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e25898-9dc3-45bd-aed5-ac332fd1f832 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:14.124169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e25898-9dc3-45bd-aed5-ac332fd1f832 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:14.126590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e25898-9dc3-45bd-aed5-ac332fd1f832 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:14.130360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e25898-9dc3-45bd-aed5-ac332fd1f832 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:14.131136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e25898-9dc3-45bd-aed5-ac332fd1f832 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:14.137923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-aff92da6-b59c-4317-9ecc-089d636b36e9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for user b6adda0a01c642158e8399b9e98aa9cc and project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:14.180750 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aff92da6-b59c-4317-9ecc-089d636b36e9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.260664 Aug 27 04:43:14.183873 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1485/2909] 10.222.0.79 () {60 vars in 1173 bytes} [Sat Aug 27 04:43:13 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:14.192074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c404c598-3845-4a4b-b77a-de66bc4f3779 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Action: 'create', calling method: .version_select at 0x7f1f20e631f0>, body: {"server_group": {"name": "tempest-server-group-1378678271", "policies": ["affinity"]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:14.236465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c404c598-3845-4a4b-b77a-de66bc4f3779 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:14.251327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c404c598-3845-4a4b-b77a-de66bc4f3779 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for user b6adda0a01c642158e8399b9e98aa9cc and project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:14.346673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c404c598-3845-4a4b-b77a-de66bc4f3779 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:14.354666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c404c598-3845-4a4b-b77a-de66bc4f3779 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for user b6adda0a01c642158e8399b9e98aa9cc and project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:14.370333 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c404c598-3845-4a4b-b77a-de66bc4f3779 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.182152 Aug 27 04:43:14.371835 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1486/2910] 10.222.0.79 () {60 vars in 1173 bytes} [Sat Aug 27 04:43:14 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:14.383835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b6544b70-7644-4744-8c97-6bc15202eb9b tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:14.456760 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b6544b70-7644-4744-8c97-6bc15202eb9b tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/bcbc4b81-97a2-4a6d-9259-478a1a0c8825" status: 204 len: 0 microversion: 2.1 time: 0.077817 Aug 27 04:43:14.460685 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1487/2911] 10.222.0.79 () {58 vars in 1266 bytes} [Sat Aug 27 04:43:14 2022] DELETE /compute/v2.1/os-server-groups/bcbc4b81-97a2-4a6d-9259-478a1a0c8825 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:43:14.466152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d68c162-2cdc-4b62-b948-8236459e8a56 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:14.468954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d68c162-2cdc-4b62-b948-8236459e8a56 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:14.497708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d68c162-2cdc-4b62-b948-8236459e8a56 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:14.499934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d68c162-2cdc-4b62-b948-8236459e8a56 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:14.500578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d68c162-2cdc-4b62-b948-8236459e8a56 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:14.502824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d68c162-2cdc-4b62-b948-8236459e8a56 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:14.519613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d68c162-2cdc-4b62-b948-8236459e8a56 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:14.520941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d68c162-2cdc-4b62-b948-8236459e8a56 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:14.551859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-99e25898-9dc3-45bd-aed5-ac332fd1f832 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:14.566212 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-99e25898-9dc3-45bd-aed5-ac332fd1f832 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1183 microversion: 2.1 time: 0.472824 Aug 27 04:43:14.566826 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1425/2912] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:14 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1183 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:14.580663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8dab8492-15e6-4bd8-bf20-bd14cc4d4cac tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:14.630677 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8dab8492-15e6-4bd8-bf20-bd14cc4d4cac tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.062110 Aug 27 04:43:14.632220 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1426/2913] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:43:14 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:14.642408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e86e9939-b163-4485-af5f-0f5ad54d65e9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:14.724192 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e86e9939-b163-4485-af5f-0f5ad54d65e9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/9b69176f-e1b6-4200-8022-40ba362e3745" status: 204 len: 0 microversion: 2.1 time: 0.085787 Aug 27 04:43:14.725989 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1427/2914] 10.222.0.79 () {58 vars in 1266 bytes} [Sat Aug 27 04:43:14 2022] DELETE /compute/v2.1/os-server-groups/9b69176f-e1b6-4200-8022-40ba362e3745 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:43:14.736427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e45251ee-1deb-4709-8d88-3de852e5b26d tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:14.761324 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e45251ee-1deb-4709-8d88-3de852e5b26d tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.030432 Aug 27 04:43:14.764610 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1428/2915] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:43:14 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:14.778313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c39fecf7-41e5-45e8-b648-919752a02d52 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Action: 'create', calling method: .version_select at 0x7f1f25ecfca0>, body: {"server_group": {"name": "tempest-server-group-515041145", "policies": ["affinity"]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:14.823643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-c39fecf7-41e5-45e8-b648-919752a02d52 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:14.840112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-c39fecf7-41e5-45e8-b648-919752a02d52 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for user b6adda0a01c642158e8399b9e98aa9cc and project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:14.947455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:15.042278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-c39fecf7-41e5-45e8-b648-919752a02d52 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:15.063818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-c39fecf7-41e5-45e8-b648-919752a02d52 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for user b6adda0a01c642158e8399b9e98aa9cc and project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:15.122894 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c39fecf7-41e5-45e8-b648-919752a02d52 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.348572 Aug 27 04:43:15.168183 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1429/2916] 10.222.0.79 () {60 vars in 1173 bytes} [Sat Aug 27 04:43:14 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:43:15.192114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f2cae497-6282-4543-8df7-eaf9ba9db930 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:15.194235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f2cae497-6282-4543-8df7-eaf9ba9db930 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:15.221962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2cae497-6282-4543-8df7-eaf9ba9db930 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:15.222743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2cae497-6282-4543-8df7-eaf9ba9db930 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:15.227248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2cae497-6282-4543-8df7-eaf9ba9db930 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:15.235442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2cae497-6282-4543-8df7-eaf9ba9db930 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:15.237722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2cae497-6282-4543-8df7-eaf9ba9db930 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:15.239946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2cae497-6282-4543-8df7-eaf9ba9db930 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:15.340157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d68c162-2cdc-4b62-b948-8236459e8a56 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:15.365107 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d68c162-2cdc-4b62-b948-8236459e8a56 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1512 microversion: 2.1 time: 0.899394 Aug 27 04:43:15.368887 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1488/2917] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:14 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1512 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:15.399507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c593f9ae-d82b-4a49-b32b-b59d8f611aed tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e6baf0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:15.633618 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c593f9ae-d82b-4a49-b32b-b59d8f611aed tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.254095 Aug 27 04:43:15.646390 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1489/2918] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:15 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:15.666795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bfa5a11-3df4-4237-b539-0a06191547a6 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:15.848127 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6bfa5a11-3df4-4237-b539-0a06191547a6 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/236e96f5-4b46-42e8-93ad-1f6b2031af2a" status: 204 len: 0 microversion: 2.1 time: 0.199112 Aug 27 04:43:15.854573 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1490/2919] 10.222.0.79 () {58 vars in 1266 bytes} [Sat Aug 27 04:43:15 2022] DELETE /compute/v2.1/os-server-groups/236e96f5-4b46-42e8-93ad-1f6b2031af2a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:43:15.867008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82e2f85b-f3db-48fc-8fe3-275ebfb94b2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:15.869341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-82e2f85b-f3db-48fc-8fe3-275ebfb94b2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:15.898749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2f85b-f3db-48fc-8fe3-275ebfb94b2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:15.908746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2f85b-f3db-48fc-8fe3-275ebfb94b2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:15.909904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2f85b-f3db-48fc-8fe3-275ebfb94b2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:15.911201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2f85b-f3db-48fc-8fe3-275ebfb94b2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:15.916762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2f85b-f3db-48fc-8fe3-275ebfb94b2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:15.919255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2f85b-f3db-48fc-8fe3-275ebfb94b2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:16.051927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f2cae497-6282-4543-8df7-eaf9ba9db930 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:16.064966 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f2cae497-6282-4543-8df7-eaf9ba9db930 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1322 microversion: 2.1 time: 0.898984 Aug 27 04:43:16.072805 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1430/2920] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:15 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1322 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:16.093790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-83521f11-18dd-4054-bd14-b3d6edc2eed7 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:16.125711 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-83521f11-18dd-4054-bd14-b3d6edc2eed7 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.050257 Aug 27 04:43:16.130579 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1431/2921] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:43:16 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:16.152594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f62512f7-dfb2-428c-88b1-f30e1e5bfd0c tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Action: 'create', calling method: .version_select at 0x7f1f213abaf0>, body: {"server_group": {"name": "tempest-server-group-61274911", "policies": ["anti-affinity"]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:16.161858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2f85b-f3db-48fc-8fe3-275ebfb94b2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:16.162359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2f85b-f3db-48fc-8fe3-275ebfb94b2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:16.162801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2f85b-f3db-48fc-8fe3-275ebfb94b2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:16.168502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-82e2f85b-f3db-48fc-8fe3-275ebfb94b2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lazy-loading 'fault' on Instance uuid c3c1a9e4-475f-4c6a-bf72-653e8fc46611 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:43:16.215340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-f62512f7-dfb2-428c-88b1-f30e1e5bfd0c tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:16.231351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-f62512f7-dfb2-428c-88b1-f30e1e5bfd0c tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for user b6adda0a01c642158e8399b9e98aa9cc and project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:16.448188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-f62512f7-dfb2-428c-88b1-f30e1e5bfd0c tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:16.460210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-82e2f85b-f3db-48fc-8fe3-275ebfb94b2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:16.473372 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-82e2f85b-f3db-48fc-8fe3-275ebfb94b2d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 200 len: 1142 microversion: 2.1 time: 0.617160 Aug 27 04:43:16.482134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-f62512f7-dfb2-428c-88b1-f30e1e5bfd0c tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for user b6adda0a01c642158e8399b9e98aa9cc and project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:16.485701 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1491/2922] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:15 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 1142 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:16.496898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b1fd7851-4d57-4849-a5dc-59dfe56ed742 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:16.515481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b1fd7851-4d57-4849-a5dc-59dfe56ed742 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:16.549023 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f62512f7-dfb2-428c-88b1-f30e1e5bfd0c tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 167 microversion: 2.1 time: 0.404323 Aug 27 04:43:16.551433 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1432/2923] 10.222.0.79 () {60 vars in 1173 bytes} [Sat Aug 27 04:43:16 2022] POST /compute/v2.1/os-server-groups => generated 167 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:43:16.567417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1fd7851-4d57-4849-a5dc-59dfe56ed742 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:16.569216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8d174056-3c0e-45f1-ab4c-5ab16d20da7c tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:16.571124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1fd7851-4d57-4849-a5dc-59dfe56ed742 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:16.581440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1fd7851-4d57-4849-a5dc-59dfe56ed742 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:16.584752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1fd7851-4d57-4849-a5dc-59dfe56ed742 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:16.585366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1fd7851-4d57-4849-a5dc-59dfe56ed742 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:16.586096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1fd7851-4d57-4849-a5dc-59dfe56ed742 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:16.667302 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8d174056-3c0e-45f1-ab4c-5ab16d20da7c tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/0ebe0de0-d572-47aa-a6c4-1fa4a8f44d71" status: 204 len: 0 microversion: 2.1 time: 0.100303 Aug 27 04:43:16.670073 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1433/2924] 10.222.0.79 () {58 vars in 1266 bytes} [Sat Aug 27 04:43:16 2022] DELETE /compute/v2.1/os-server-groups/0ebe0de0-d572-47aa-a6c4-1fa4a8f44d71 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:43:16.697465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-735f72a1-4347-4e73-92d5-128eabe9c828 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f213ab9d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:16.815071 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-735f72a1-4347-4e73-92d5-128eabe9c828 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.143472 Aug 27 04:43:16.822755 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1434/2925] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:16 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:16.841875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3f435585-f7d9-42ff-bd0d-4abddd8d580c tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:16.879335 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3f435585-f7d9-42ff-bd0d-4abddd8d580c tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.062561 Aug 27 04:43:16.880135 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1435/2926] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:43:16 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:17.005364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-2122181513", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "22db88cd-782d-4515-b524-a561cb2673de"}]}, "os:scheduler_hints": {"group": "32c1536f-961d-458d-9edc-d2c1e9bd2d5c"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:17.144452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] validate_networks() for [('22db88cd-782d-4515-b524-a561cb2673de', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:43:17.322266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b1fd7851-4d57-4849-a5dc-59dfe56ed742 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:17.331833 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b1fd7851-4d57-4849-a5dc-59dfe56ed742 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1512 microversion: 2.1 time: 0.844757 Aug 27 04:43:17.335043 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1492/2927] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:16 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1512 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:17.354004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fba72699-4370-4710-a56a-cf0c06dfd921 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:17.357155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fba72699-4370-4710-a56a-cf0c06dfd921 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:17.388851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fba72699-4370-4710-a56a-cf0c06dfd921 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:17.393256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fba72699-4370-4710-a56a-cf0c06dfd921 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:17.394577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fba72699-4370-4710-a56a-cf0c06dfd921 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:17.395473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fba72699-4370-4710-a56a-cf0c06dfd921 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:17.398916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fba72699-4370-4710-a56a-cf0c06dfd921 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:17.407192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fba72699-4370-4710-a56a-cf0c06dfd921 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:17.905041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fba72699-4370-4710-a56a-cf0c06dfd921 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:17.913500 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fba72699-4370-4710-a56a-cf0c06dfd921 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1322 microversion: 2.1 time: 0.576581 Aug 27 04:43:17.935878 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1493/2928] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:17 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1322 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:17.944431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8dfd7c46-ca27-4cea-bfc6-2738d9dcd9a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:17.949335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8dfd7c46-ca27-4cea-bfc6-2738d9dcd9a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c3c1a9e4-475f-4c6a-bf72-653e8fc46611] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:17.967153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dfd7c46-ca27-4cea-bfc6-2738d9dcd9a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:17.968180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dfd7c46-ca27-4cea-bfc6-2738d9dcd9a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:17.969409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dfd7c46-ca27-4cea-bfc6-2738d9dcd9a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:17.974755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dfd7c46-ca27-4cea-bfc6-2738d9dcd9a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:17.975555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dfd7c46-ca27-4cea-bfc6-2738d9dcd9a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:17.976114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dfd7c46-ca27-4cea-bfc6-2738d9dcd9a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:18.005608 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8dfd7c46-ca27-4cea-bfc6-2738d9dcd9a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] HTTP exception thrown: Instance c3c1a9e4-475f-4c6a-bf72-653e8fc46611 could not be found. Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8dfd7c46-ca27-4cea-bfc6-2738d9dcd9a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Request method failure captured: Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 HTTP/1.1 Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ8LYqvzwfoQfgeHMNqSsaekwWA45v9g5RlrI9ATo8z9y2OYq7KiYL9u_hx5gfwZW3-BH-Shkw5I0bkVqz2iU-DLz3hd4UVU3xVjk91TD2FqT5yr74DgplSVuJBxBSijz5gVPvw3civPVzUBDFdZwU_Aaj2hzEH69M9crBZPHeY5f7Q Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 67b142dea11c4e7d921bbb7dd5e543be Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-LiveMigrationTest-600329319 Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-LiveMigrationTest-600329319 Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 67b142dea11c4e7d921bbb7dd5e543be Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-LiveMigrationTest-600329319 Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-LiveMigrationTest-600329319-project Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8213929124384914aebc5e05572cc1ed Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-LiveMigrationTest-600329319-project Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance c3c1a9e4-475f-4c6a-bf72-653e8fc46611 could not be found. Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'c3c1a9e4-475f-4c6a-bf72-653e8fc46611'} Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3c1a9e4-475f-4c6a-bf72-653e8fc46611 could not be found. Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c1a9e4-475f-4c6a-bf72-653e8fc46611 could not be found. Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:18.018952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:18.023074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:18.023074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:18.023074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:18.023074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:18.023074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:18.023074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c1a9e4-475f-4c6a-bf72-653e8fc46611 could not be found. Aug 27 04:43:18.023074 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:18.023074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8dfd7c46-ca27-4cea-bfc6-2738d9dcd9a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Returning 404 to user: Instance c3c1a9e4-475f-4c6a-bf72-653e8fc46611 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:18.023074 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8dfd7c46-ca27-4cea-bfc6-2738d9dcd9a2 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611" status: 404 len: 111 microversion: 2.1 time: 0.083648 Aug 27 04:43:18.024848 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1494/2929] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:17 2022] GET /compute/v2.1/servers/c3c1a9e4-475f-4c6a-bf72-653e8fc46611 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:18.036468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7b989da-9561-4160-97b9-d5d0f8441b24 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e580d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:18.154210 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7b989da-9561-4160-97b9-d5d0f8441b24 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.128031 Aug 27 04:43:18.168603 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1495/2930] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:18 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:18.314786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-71ef06d6-d19a-4941-abec-4a435ec0ea0b tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] Action: 'create', calling method: .version_select at 0x7f1f20dc8040>, body: {"pool": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:19.749534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:43:19.756005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:43:19.756722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:43:19.758474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:43:19.759070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:43:19.811198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:19.811692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:19.812324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:19.817944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:19.821374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:19.825235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:19.874932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:19.936330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for user b6adda0a01c642158e8399b9e98aa9cc and project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:20.014795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:43:20.026188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:43:20.225922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_group_members'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:20.251826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for user b6adda0a01c642158e8399b9e98aa9cc and project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_group_members'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:20.379466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_group_members'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:20.393182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Getting quotas for user b6adda0a01c642158e8399b9e98aa9cc and project 8bb9f678a09d41eea6f3d833841fb7d3. Resources: {'server_group_members'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:20.462236 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-382815d0-5d62-4733-bc2f-1a306dd26e57 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.461565 Aug 27 04:43:20.468631 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1436/2931] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:43:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:43:20.480433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-06024255-5277-4bb5-b27d-8a2e1c90d24d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:20.481341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-06024255-5277-4bb5-b27d-8a2e1c90d24d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:20.506419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06024255-5277-4bb5-b27d-8a2e1c90d24d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:20.507382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06024255-5277-4bb5-b27d-8a2e1c90d24d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:20.514002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06024255-5277-4bb5-b27d-8a2e1c90d24d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:20.515140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06024255-5277-4bb5-b27d-8a2e1c90d24d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:20.515838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06024255-5277-4bb5-b27d-8a2e1c90d24d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:20.516486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06024255-5277-4bb5-b27d-8a2e1c90d24d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:21.500737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-06024255-5277-4bb5-b27d-8a2e1c90d24d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:21.511723 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-06024255-5277-4bb5-b27d-8a2e1c90d24d tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1512 microversion: 2.1 time: 1.041633 Aug 27 04:43:21.518179 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1437/2932] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:20 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1512 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:21.548775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3a7ac23d-3abb-4429-bd2e-82f981db87c0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:21.549638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3a7ac23d-3abb-4429-bd2e-82f981db87c0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:21.580305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a7ac23d-3abb-4429-bd2e-82f981db87c0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:21.581198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a7ac23d-3abb-4429-bd2e-82f981db87c0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:21.591873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a7ac23d-3abb-4429-bd2e-82f981db87c0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:21.592798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a7ac23d-3abb-4429-bd2e-82f981db87c0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:21.594434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a7ac23d-3abb-4429-bd2e-82f981db87c0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:21.595092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a7ac23d-3abb-4429-bd2e-82f981db87c0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:22.607029 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-71ef06d6-d19a-4941-abec-4a435ec0ea0b tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.431825 Aug 27 04:43:22.608804 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1496/2933] 10.222.0.79 () {60 vars in 1170 bytes} [Sat Aug 27 04:43:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:22.614717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f7823b0-74a6-4dba-bae1-81a69cb1718d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20dca790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:22.709446 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f7823b0-74a6-4dba-bae1-81a69cb1718d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.098825 Aug 27 04:43:22.720512 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1497/2934] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:22 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:22.730171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7ef15e54-58f8-4d75-80cc-4bab53596e96 req-2a85638c-9627-456c-87cf-76c66f1dbc28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0d6029-a40b-45b9-b230-2033ec88617e", "name": "network-vif-plugged", "status": "completed", "tag": "54e043d1-9346-4c9a-917b-026289b24400"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:22.784856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7ef15e54-58f8-4d75-80cc-4bab53596e96 req-2a85638c-9627-456c-87cf-76c66f1dbc28 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:22.785366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7ef15e54-58f8-4d75-80cc-4bab53596e96 req-2a85638c-9627-456c-87cf-76c66f1dbc28 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:22.785788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7ef15e54-58f8-4d75-80cc-4bab53596e96 req-2a85638c-9627-456c-87cf-76c66f1dbc28 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:22.829524 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7ef15e54-58f8-4d75-80cc-4bab53596e96 req-2a85638c-9627-456c-87cf-76c66f1dbc28 service nova] Creating event network-vif-plugged:54e043d1-9346-4c9a-917b-026289b24400 for instance 0e0d6029-a40b-45b9-b230-2033ec88617e on n-h1-854823-1 Aug 27 04:43:22.865481 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7ef15e54-58f8-4d75-80cc-4bab53596e96 req-2a85638c-9627-456c-87cf-76c66f1dbc28 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140585 Aug 27 04:43:22.874849 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1498/2935] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:22.885501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cabde407-af5f-4f31-85fa-7f38e4e8afa4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:22.895231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cabde407-af5f-4f31-85fa-7f38e4e8afa4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:22.920228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cabde407-af5f-4f31-85fa-7f38e4e8afa4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:22.920991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cabde407-af5f-4f31-85fa-7f38e4e8afa4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:22.921716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cabde407-af5f-4f31-85fa-7f38e4e8afa4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:22.922876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cabde407-af5f-4f31-85fa-7f38e4e8afa4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:22.923672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cabde407-af5f-4f31-85fa-7f38e4e8afa4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:22.932112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cabde407-af5f-4f31-85fa-7f38e4e8afa4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:22.979808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3a7ac23d-3abb-4429-bd2e-82f981db87c0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:22.990739 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3a7ac23d-3abb-4429-bd2e-82f981db87c0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1322 microversion: 2.1 time: 1.469044 Aug 27 04:43:22.994271 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1438/2936] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:21 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1322 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:23.019357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-23c89fa6-5e8a-4eda-8f78-7f43a9c97f10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:23.026983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-23c89fa6-5e8a-4eda-8f78-7f43a9c97f10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:23.041579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:23.047735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23c89fa6-5e8a-4eda-8f78-7f43a9c97f10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:23.048568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23c89fa6-5e8a-4eda-8f78-7f43a9c97f10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:23.049428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23c89fa6-5e8a-4eda-8f78-7f43a9c97f10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:23.051574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23c89fa6-5e8a-4eda-8f78-7f43a9c97f10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:23.052370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23c89fa6-5e8a-4eda-8f78-7f43a9c97f10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:23.053315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23c89fa6-5e8a-4eda-8f78-7f43a9c97f10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:23.146471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cabde407-af5f-4f31-85fa-7f38e4e8afa4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6adda0a01c642158e8399b9e98aa9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb9f678a09d41eea6f3d833841fb7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:23.160900 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cabde407-af5f-4f31-85fa-7f38e4e8afa4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 200 len: 1265 microversion: 2.1 time: 0.280158 Aug 27 04:43:23.161780 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1499/2937] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:22 2022] GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:23.174729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f0ebe10-99a3-450c-b6bb-96c1fef2c332 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] Action: 'create', calling method: .version_select at 0x7f1f20dcaa60>, body: {"pool": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:24.363976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=16 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:24.542605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-23c89fa6-5e8a-4eda-8f78-7f43a9c97f10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:24.585081 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-23c89fa6-5e8a-4eda-8f78-7f43a9c97f10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1512 microversion: 2.1 time: 1.572031 Aug 27 04:43:24.608186 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1439/2938] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:23 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1512 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:24.620249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-da9579f1-7154-45ef-b044-52e4f48b3494 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f213ab160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:24.709492 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-da9579f1-7154-45ef-b044-52e4f48b3494 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.099748 Aug 27 04:43:24.710098 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1440/2939] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:24 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:24.721932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0234454c-ff0f-483e-b830-4dd143573640 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:24.722568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0234454c-ff0f-483e-b830-4dd143573640 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:24.741365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0234454c-ff0f-483e-b830-4dd143573640 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:24.741910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0234454c-ff0f-483e-b830-4dd143573640 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:24.742364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0234454c-ff0f-483e-b830-4dd143573640 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:24.749575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0234454c-ff0f-483e-b830-4dd143573640 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:24.750248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0234454c-ff0f-483e-b830-4dd143573640 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:24.751009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0234454c-ff0f-483e-b830-4dd143573640 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:26.578047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0234454c-ff0f-483e-b830-4dd143573640 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:26.641312 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0234454c-ff0f-483e-b830-4dd143573640 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1322 microversion: 2.1 time: 1.921135 Aug 27 04:43:26.646372 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1441/2940] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:24 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1322 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:26.688052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f7662802-6c7c-42a6-9c55-2946f166a46d tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:26.689244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f7662802-6c7c-42a6-9c55-2946f166a46d tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:26.736867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7662802-6c7c-42a6-9c55-2946f166a46d tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:26.740226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7662802-6c7c-42a6-9c55-2946f166a46d tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:26.740723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7662802-6c7c-42a6-9c55-2946f166a46d tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:26.741541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7662802-6c7c-42a6-9c55-2946f166a46d tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:26.751113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7662802-6c7c-42a6-9c55-2946f166a46d tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:26.753444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7662802-6c7c-42a6-9c55-2946f166a46d tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:27.448010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f7662802-6c7c-42a6-9c55-2946f166a46d tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6adda0a01c642158e8399b9e98aa9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb9f678a09d41eea6f3d833841fb7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:27.456839 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f7662802-6c7c-42a6-9c55-2946f166a46d tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 200 len: 1271 microversion: 2.1 time: 0.803898 Aug 27 04:43:27.464121 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1442/2941] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:26 2022] GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 1271 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:27.480556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-7637f3e7-05d5-4c89-ba74-9b0a5a213430 req-5c53e2d8-f15d-4c4c-a1c1-db36fbebc3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82475b2-a407-4da4-afa7-23c2ffc38415", "name": "network-vif-plugged", "status": "completed", "tag": "20abfd0d-de86-4429-9b8c-f2ff325b15f6"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:27.514713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7637f3e7-05d5-4c89-ba74-9b0a5a213430 req-5c53e2d8-f15d-4c4c-a1c1-db36fbebc3cf service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:27.533972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7637f3e7-05d5-4c89-ba74-9b0a5a213430 req-5c53e2d8-f15d-4c4c-a1c1-db36fbebc3cf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:27.536492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7637f3e7-05d5-4c89-ba74-9b0a5a213430 req-5c53e2d8-f15d-4c4c-a1c1-db36fbebc3cf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:27.601124 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-7637f3e7-05d5-4c89-ba74-9b0a5a213430 req-5c53e2d8-f15d-4c4c-a1c1-db36fbebc3cf service nova] Creating event network-vif-plugged:20abfd0d-de86-4429-9b8c-f2ff325b15f6 for instance c82475b2-a407-4da4-afa7-23c2ffc38415 on n-h2-854823-1 Aug 27 04:43:27.644802 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-7637f3e7-05d5-4c89-ba74-9b0a5a213430 req-5c53e2d8-f15d-4c4c-a1c1-db36fbebc3cf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178964 Aug 27 04:43:27.654178 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1443/2942] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:27.670942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8936c1f0-6016-47ad-a79e-a6cb02d436cb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:27.683962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8936c1f0-6016-47ad-a79e-a6cb02d436cb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:27.714576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8936c1f0-6016-47ad-a79e-a6cb02d436cb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:27.732779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8936c1f0-6016-47ad-a79e-a6cb02d436cb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:27.733762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8936c1f0-6016-47ad-a79e-a6cb02d436cb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:27.734605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8936c1f0-6016-47ad-a79e-a6cb02d436cb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:27.735140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8936c1f0-6016-47ad-a79e-a6cb02d436cb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:27.735875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8936c1f0-6016-47ad-a79e-a6cb02d436cb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:28.042657 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f0ebe10-99a3-450c-b6bb-96c1fef2c332 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.878823 Aug 27 04:43:28.044217 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1500/2943] 10.222.0.79 () {60 vars in 1170 bytes} [Sat Aug 27 04:43:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:28.049352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39bb9cbf-e2f8-4e74-9f7e-e260d7b18ab8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20dca9d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:28.169711 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39bb9cbf-e2f8-4e74-9f7e-e260d7b18ab8 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.123938 Aug 27 04:43:28.170322 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1501/2944] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:28 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:28.190701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bcd83f24-e408-4962-86ba-0f5cfff7acb7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:28.192590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bcd83f24-e408-4962-86ba-0f5cfff7acb7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:28.233129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcd83f24-e408-4962-86ba-0f5cfff7acb7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:28.233847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcd83f24-e408-4962-86ba-0f5cfff7acb7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:28.234530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcd83f24-e408-4962-86ba-0f5cfff7acb7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:28.236395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcd83f24-e408-4962-86ba-0f5cfff7acb7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:28.238317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcd83f24-e408-4962-86ba-0f5cfff7acb7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:28.242241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcd83f24-e408-4962-86ba-0f5cfff7acb7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:28.286097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bcd83f24-e408-4962-86ba-0f5cfff7acb7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:43:28.520127 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bcd83f24-e408-4962-86ba-0f5cfff7acb7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 204 len: 0 microversion: 2.1 time: 0.348423 Aug 27 04:43:28.521072 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1502/2945] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:43:28 2022] DELETE /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:43:28.541478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c908108-212d-47bd-9b74-a2aa2ee6c428 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:28.548493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c908108-212d-47bd-9b74-a2aa2ee6c428 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:28.571774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c908108-212d-47bd-9b74-a2aa2ee6c428 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:28.572780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c908108-212d-47bd-9b74-a2aa2ee6c428 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:28.577204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c908108-212d-47bd-9b74-a2aa2ee6c428 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:28.578683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c908108-212d-47bd-9b74-a2aa2ee6c428 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:28.579647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c908108-212d-47bd-9b74-a2aa2ee6c428 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:28.580420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c908108-212d-47bd-9b74-a2aa2ee6c428 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:28.840484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8936c1f0-6016-47ad-a79e-a6cb02d436cb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:28.855474 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8936c1f0-6016-47ad-a79e-a6cb02d436cb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1512 microversion: 2.1 time: 1.199608 Aug 27 04:43:28.870847 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1444/2946] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:27 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1512 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:28.892518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7c3e1b96-1481-4994-b44c-6b514bc41ea5 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] Action: 'create', calling method: .version_select at 0x7f1f213ab9d0>, body: {"pool": null} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:29.009798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5c908108-212d-47bd-9b74-a2aa2ee6c428 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:29.021055 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c908108-212d-47bd-9b74-a2aa2ee6c428 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1322 microversion: 2.1 time: 0.493156 Aug 27 04:43:29.042698 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1503/2947] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:28 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:29.062914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dae86c11-7662-45bd-978d-d581fbcd892a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:29.063672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dae86c11-7662-45bd-978d-d581fbcd892a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:29.098607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae86c11-7662-45bd-978d-d581fbcd892a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:29.101732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae86c11-7662-45bd-978d-d581fbcd892a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:29.102876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae86c11-7662-45bd-978d-d581fbcd892a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:29.104973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae86c11-7662-45bd-978d-d581fbcd892a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:29.107037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae86c11-7662-45bd-978d-d581fbcd892a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:29.107652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae86c11-7662-45bd-978d-d581fbcd892a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:29.513361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dae86c11-7662-45bd-978d-d581fbcd892a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6adda0a01c642158e8399b9e98aa9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb9f678a09d41eea6f3d833841fb7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:29.523017 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dae86c11-7662-45bd-978d-d581fbcd892a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 200 len: 1313 microversion: 2.1 time: 0.478871 Aug 27 04:43:29.536217 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1504/2948] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:29 2022] GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:29.536217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-02d4c295-f592-4e8f-b91b-32a493b46b7a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:29.536217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-02d4c295-f592-4e8f-b91b-32a493b46b7a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:29.553985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:29.567143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4c295-f592-4e8f-b91b-32a493b46b7a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:29.569361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4c295-f592-4e8f-b91b-32a493b46b7a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:29.569978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4c295-f592-4e8f-b91b-32a493b46b7a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:29.573317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4c295-f592-4e8f-b91b-32a493b46b7a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:29.574070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4c295-f592-4e8f-b91b-32a493b46b7a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:29.574258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4c295-f592-4e8f-b91b-32a493b46b7a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:29.836198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:29.947329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-02d4c295-f592-4e8f-b91b-32a493b46b7a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:29.957265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:29.966706 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-02d4c295-f592-4e8f-b91b-32a493b46b7a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1666 microversion: 2.1 time: 0.434075 Aug 27 04:43:29.980485 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1505/2949] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:29 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1666 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:29.980485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52ead8d4-12aa-4979-964d-a25f2f2333ef tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20ea18b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:30.191875 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52ead8d4-12aa-4979-964d-a25f2f2333ef tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.222826 Aug 27 04:43:30.192944 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1506/2950] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:29 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:30.221933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7698fd85-0e77-424b-a9be-e15d9079cdc1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:30.222566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7698fd85-0e77-424b-a9be-e15d9079cdc1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:30.264949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7698fd85-0e77-424b-a9be-e15d9079cdc1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:30.265386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7698fd85-0e77-424b-a9be-e15d9079cdc1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:30.265831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7698fd85-0e77-424b-a9be-e15d9079cdc1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:30.266822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7698fd85-0e77-424b-a9be-e15d9079cdc1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:30.275060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7698fd85-0e77-424b-a9be-e15d9079cdc1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:30.275573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7698fd85-0e77-424b-a9be-e15d9079cdc1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:30.417746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=38 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:30.600735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7698fd85-0e77-424b-a9be-e15d9079cdc1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:30.611794 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7698fd85-0e77-424b-a9be-e15d9079cdc1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1512 microversion: 2.1 time: 0.410521 Aug 27 04:43:30.614705 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1507/2951] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:30 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1512 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:30.625495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d870369a-c154-41df-870a-18fadcc23499 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:30.626600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d870369a-c154-41df-870a-18fadcc23499 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:30.640473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d870369a-c154-41df-870a-18fadcc23499 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:30.640996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d870369a-c154-41df-870a-18fadcc23499 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:30.641463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d870369a-c154-41df-870a-18fadcc23499 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:30.642248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d870369a-c154-41df-870a-18fadcc23499 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:30.642710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d870369a-c154-41df-870a-18fadcc23499 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:30.643138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d870369a-c154-41df-870a-18fadcc23499 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:31.107687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d870369a-c154-41df-870a-18fadcc23499 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:31.149880 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d870369a-c154-41df-870a-18fadcc23499 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1471 microversion: 2.1 time: 0.525641 Aug 27 04:43:31.165690 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1508/2952] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:30 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1471 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:31.180983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a082756-e4d0-472c-86db-04c299c415de tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:31.181736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a082756-e4d0-472c-86db-04c299c415de tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:31.208755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a082756-e4d0-472c-86db-04c299c415de tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:31.209460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a082756-e4d0-472c-86db-04c299c415de tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:31.214124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a082756-e4d0-472c-86db-04c299c415de tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:31.214951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a082756-e4d0-472c-86db-04c299c415de tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:31.215441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a082756-e4d0-472c-86db-04c299c415de tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:31.220119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a082756-e4d0-472c-86db-04c299c415de tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:31.814087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a082756-e4d0-472c-86db-04c299c415de tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6adda0a01c642158e8399b9e98aa9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb9f678a09d41eea6f3d833841fb7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:31.824841 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a082756-e4d0-472c-86db-04c299c415de tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 200 len: 1313 microversion: 2.1 time: 0.654245 Aug 27 04:43:31.843987 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1509/2953] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:31 2022] GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:31.853936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac9fce2e-6f96-4b9c-8668-ebdb38bf2578 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:31.857030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac9fce2e-6f96-4b9c-8668-ebdb38bf2578 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:31.870604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9fce2e-6f96-4b9c-8668-ebdb38bf2578 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:31.871114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9fce2e-6f96-4b9c-8668-ebdb38bf2578 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:31.871553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9fce2e-6f96-4b9c-8668-ebdb38bf2578 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:31.872275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9fce2e-6f96-4b9c-8668-ebdb38bf2578 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:31.874173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9fce2e-6f96-4b9c-8668-ebdb38bf2578 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:31.874923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9fce2e-6f96-4b9c-8668-ebdb38bf2578 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:32.160882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac9fce2e-6f96-4b9c-8668-ebdb38bf2578 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:32.173979 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac9fce2e-6f96-4b9c-8668-ebdb38bf2578 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1666 microversion: 2.1 time: 0.328227 Aug 27 04:43:32.181718 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1510/2954] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:31 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1666 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:32.352083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-352abc0d-852e-4703-be45-54920b19672c tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:32.352851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-352abc0d-852e-4703-be45-54920b19672c tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] [instance: 877e109f-decc-47a8-8018-c41f7a0e6f2c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:32.372811 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-352abc0d-852e-4703-be45-54920b19672c tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] HTTP exception thrown: Instance 877e109f-decc-47a8-8018-c41f7a0e6f2c could not be found. Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-352abc0d-852e-4703-be45-54920b19672c tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Request method failure captured: Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/877e109f-decc-47a8-8018-c41f7a0e6f2c/action HTTP/1.1 Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 15 Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaDIdM_FoUVjSD0JsWSKDVhpVhyzUxqVppm4ddumsEiEtBITz3dCVZb9906xQ9E1-kaZzRUpYZnhsHYpnWOf-P3eJAJNZeK1cO6VCdC7wLclVNxLmeBm1rSzogEPyssjPgQF6T-7FJS9VW-X4YVwhPJJierSIabKCDonVBkMCe0r9hI Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: f859dd00c4e94e9cb5c18532deb7a680 Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: f859dd00c4e94e9cb5c18532deb7a680 Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersAdminNegativeTestJSON-1420917107-project-admin Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 9f1ecec45e8947ec80ca19f2b078fa9c Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1420917107-project-admin Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: {"migrate": {}} Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 877e109f-decc-47a8-8018-c41f7a0e6f2c could not be found. Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '877e109f-decc-47a8-8018-c41f7a0e6f2c', 'body': {'migrate': {}}} Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 877e109f-decc-47a8-8018-c41f7a0e6f2c could not be found. Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 877e109f-decc-47a8-8018-c41f7a0e6f2c could not be found. Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:32.375110 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:32.379604 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:32.379604 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:32.379604 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:32.379604 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:32.379604 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 877e109f-decc-47a8-8018-c41f7a0e6f2c could not be found. Aug 27 04:43:32.379604 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:32.390408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-352abc0d-852e-4703-be45-54920b19672c tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Returning 404 to user: Instance 877e109f-decc-47a8-8018-c41f7a0e6f2c could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:32.391920 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-352abc0d-852e-4703-be45-54920b19672c tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/877e109f-decc-47a8-8018-c41f7a0e6f2c/action" status: 404 len: 111 microversion: 2.1 time: 0.208579 Aug 27 04:43:32.405036 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1511/2955] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:43:32 2022] POST /compute/v2.1/servers/877e109f-decc-47a8-8018-c41f7a0e6f2c/action => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:32.416895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e7478558-ee06-4e8b-87a0-3c10ba1d0433 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20dc13a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:32.506238 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e7478558-ee06-4e8b-87a0-3c10ba1d0433 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.098108 Aug 27 04:43:32.512604 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1512/2956] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:32 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:32.517773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2117653d-b745-4190-86c8-a625b075ba9f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:32.531332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2117653d-b745-4190-86c8-a625b075ba9f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:32.545822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2117653d-b745-4190-86c8-a625b075ba9f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:32.561438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2117653d-b745-4190-86c8-a625b075ba9f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:32.562326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2117653d-b745-4190-86c8-a625b075ba9f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:32.563382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2117653d-b745-4190-86c8-a625b075ba9f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:32.565576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2117653d-b745-4190-86c8-a625b075ba9f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:32.566299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2117653d-b745-4190-86c8-a625b075ba9f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:32.885013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2117653d-b745-4190-86c8-a625b075ba9f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:32.894188 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2117653d-b745-4190-86c8-a625b075ba9f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1512 microversion: 2.1 time: 0.380197 Aug 27 04:43:32.896344 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1513/2957] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:32 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1512 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:32.907551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1473271899", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:33.044796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:43:33.609823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:43:33.611181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:43:33.611902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:43:33.612776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:43:33.613437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:43:33.651018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:33.655265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:33.660451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:33.662330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:33.688290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:33.690100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:33.761348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Getting quotas for project c901ec7cc4c04a858bca519630b40e8e. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:33.778343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Getting quotas for user 66685e0d1c2747ad929b47eec9f55044 and project c901ec7cc4c04a858bca519630b40e8e. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:33.807431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:43:33.812200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:43:33.910733 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d3c94c4-acb0-4edc-93af-330065af294e tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013031 Aug 27 04:43:33.914409 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1514/2958] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:43:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:43:33.930209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3ebb2a6-712f-4db4-9c0f-4417b7159429 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:33.931287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c3ebb2a6-712f-4db4-9c0f-4417b7159429 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:33.939361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ebb2a6-712f-4db4-9c0f-4417b7159429 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:33.940225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ebb2a6-712f-4db4-9c0f-4417b7159429 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:33.940934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ebb2a6-712f-4db4-9c0f-4417b7159429 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:33.942601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ebb2a6-712f-4db4-9c0f-4417b7159429 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:33.945337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ebb2a6-712f-4db4-9c0f-4417b7159429 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:33.947199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ebb2a6-712f-4db4-9c0f-4417b7159429 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:34.398280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3ebb2a6-712f-4db4-9c0f-4417b7159429 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6adda0a01c642158e8399b9e98aa9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb9f678a09d41eea6f3d833841fb7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:34.417279 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3ebb2a6-712f-4db4-9c0f-4417b7159429 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 200 len: 1313 microversion: 2.1 time: 0.501461 Aug 27 04:43:34.422171 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1515/2959] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:33 2022] GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:34.438560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54319682-bd5f-409f-82e1-ad4eb86b7aad tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:34.448466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-54319682-bd5f-409f-82e1-ad4eb86b7aad tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:34.466504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54319682-bd5f-409f-82e1-ad4eb86b7aad tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:34.467678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54319682-bd5f-409f-82e1-ad4eb86b7aad tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:34.469492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54319682-bd5f-409f-82e1-ad4eb86b7aad tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:34.470679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54319682-bd5f-409f-82e1-ad4eb86b7aad tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:34.471525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54319682-bd5f-409f-82e1-ad4eb86b7aad tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:34.473776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54319682-bd5f-409f-82e1-ad4eb86b7aad tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:34.646579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-54319682-bd5f-409f-82e1-ad4eb86b7aad tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:34.664489 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-54319682-bd5f-409f-82e1-ad4eb86b7aad tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 200 len: 1599 microversion: 2.1 time: 0.238862 Aug 27 04:43:34.665904 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1516/2960] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:34 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 1599 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:34.807667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-552324735", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "3d1ddeac-0a30-4a81-901a-52f60fc35de4"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:34.942248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] validate_networks() for [('3d1ddeac-0a30-4a81-901a-52f60fc35de4', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:43:36.537306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:43:36.538332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:43:36.538332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:43:36.539074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:43:36.539750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:43:36.565303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:36.565985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:36.567258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:36.573307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:36.576289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:36.578039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:36.689884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Getting quotas for project 92968abec17a4879bffad84cc55b3a14. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:36.716050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Getting quotas for user 97689789f62c484e96e1f14037a8bd31 and project 92968abec17a4879bffad84cc55b3a14. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:36.773310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:43:36.776256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:43:36.874875 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88e21e40-ea91-4d92-b801-85a00a076503 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.207605 Aug 27 04:43:36.876306 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1517/2961] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 04:43:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2210 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:43:36.887706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf348932-31a1-419c-b988-e9c31f134f39 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f218d3430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:37.084010 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf348932-31a1-419c-b988-e9c31f134f39 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.206001 Aug 27 04:43:37.085039 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1518/2962] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:36 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:37.090201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8c69658-c0e3-4bb2-a374-c77bccd220fb tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:37.090815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a8c69658-c0e3-4bb2-a374-c77bccd220fb tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:37.108201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c69658-c0e3-4bb2-a374-c77bccd220fb tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:37.122725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c69658-c0e3-4bb2-a374-c77bccd220fb tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:37.124945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c69658-c0e3-4bb2-a374-c77bccd220fb tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:37.125889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c69658-c0e3-4bb2-a374-c77bccd220fb tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:37.134466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c69658-c0e3-4bb2-a374-c77bccd220fb tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:37.136955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c69658-c0e3-4bb2-a374-c77bccd220fb tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:37.339866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8c69658-c0e3-4bb2-a374-c77bccd220fb tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:37.372153 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8c69658-c0e3-4bb2-a374-c77bccd220fb tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 200 len: 1280 microversion: 2.1 time: 0.279742 Aug 27 04:43:37.380693 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1519/2963] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:37 2022] GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 1280 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:37.409530 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7c3e1b96-1481-4994-b44c-6b514bc41ea5 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 8.536837 Aug 27 04:43:37.410976 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1445/2964] 10.222.0.79 () {60 vars in 1170 bytes} [Sat Aug 27 04:43:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 8539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:37.418221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6651187d-c6a8-4ed6-8ae0-75e7b9040771 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:37.421213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6651187d-c6a8-4ed6-8ae0-75e7b9040771 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:37.464128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6651187d-c6a8-4ed6-8ae0-75e7b9040771 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:37.464683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6651187d-c6a8-4ed6-8ae0-75e7b9040771 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:37.465129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6651187d-c6a8-4ed6-8ae0-75e7b9040771 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:37.475456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6651187d-c6a8-4ed6-8ae0-75e7b9040771 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:37.488944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6651187d-c6a8-4ed6-8ae0-75e7b9040771 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:37.490140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6651187d-c6a8-4ed6-8ae0-75e7b9040771 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:37.784872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c00416a5-2067-4218-bbec-76a57ba15efe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:37.785505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c00416a5-2067-4218-bbec-76a57ba15efe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:37.826511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c00416a5-2067-4218-bbec-76a57ba15efe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:37.827072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c00416a5-2067-4218-bbec-76a57ba15efe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:37.827533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c00416a5-2067-4218-bbec-76a57ba15efe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:37.837440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c00416a5-2067-4218-bbec-76a57ba15efe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:37.841048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c00416a5-2067-4218-bbec-76a57ba15efe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:37.843996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c00416a5-2067-4218-bbec-76a57ba15efe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:38.390559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6651187d-c6a8-4ed6-8ae0-75e7b9040771 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6adda0a01c642158e8399b9e98aa9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb9f678a09d41eea6f3d833841fb7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:38.403269 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6651187d-c6a8-4ed6-8ae0-75e7b9040771 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 200 len: 1313 microversion: 2.1 time: 0.990734 Aug 27 04:43:38.424092 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1446/2965] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:37 2022] GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 1313 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:38.425712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3a55dcf7-ce94-422d-8031-a20ad523a709 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:38.425712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3a55dcf7-ce94-422d-8031-a20ad523a709 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 0c1ebbce-7c0d-4f08-a05f-359d0527b76d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:38.465252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a55dcf7-ce94-422d-8031-a20ad523a709 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:38.466018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a55dcf7-ce94-422d-8031-a20ad523a709 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:38.471093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a55dcf7-ce94-422d-8031-a20ad523a709 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:38.472092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a55dcf7-ce94-422d-8031-a20ad523a709 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:38.472770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a55dcf7-ce94-422d-8031-a20ad523a709 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:38.473380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a55dcf7-ce94-422d-8031-a20ad523a709 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:38.526695 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-3a55dcf7-ce94-422d-8031-a20ad523a709 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] HTTP exception thrown: Instance 0c1ebbce-7c0d-4f08-a05f-359d0527b76d could not be found. Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3a55dcf7-ce94-422d-8031-a20ad523a709 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Request method failure captured: Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d HTTP/1.1 Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ8LYqvzwfoQfgeHMNqSsaekwWA45v9g5RlrI9ATo8z9y2OYq7KiYL9u_hx5gfwZW3-BH-Shkw5I0bkVqz2iU-DLz3hd4UVU3xVjk91TD2FqT5yr74DgplSVuJBxBSijz5gVPvw3civPVzUBDFdZwU_Aaj2hzEH69M9crBZPHeY5f7Q Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 67b142dea11c4e7d921bbb7dd5e543be Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-LiveMigrationTest-600329319 Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-LiveMigrationTest-600329319 Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 67b142dea11c4e7d921bbb7dd5e543be Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-LiveMigrationTest-600329319 Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-LiveMigrationTest-600329319-project Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8213929124384914aebc5e05572cc1ed Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-LiveMigrationTest-600329319-project Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 0c1ebbce-7c0d-4f08-a05f-359d0527b76d could not be found. Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '0c1ebbce-7c0d-4f08-a05f-359d0527b76d'} Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c1ebbce-7c0d-4f08-a05f-359d0527b76d could not be found. Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c1ebbce-7c0d-4f08-a05f-359d0527b76d could not be found. Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:38.528394 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:38.533871 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:38.533871 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:38.533871 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:38.533871 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:38.533871 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:38.533871 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c1ebbce-7c0d-4f08-a05f-359d0527b76d could not be found. Aug 27 04:43:38.533871 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:38.533871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3a55dcf7-ce94-422d-8031-a20ad523a709 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Returning 404 to user: Instance 0c1ebbce-7c0d-4f08-a05f-359d0527b76d could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:38.533871 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3a55dcf7-ce94-422d-8031-a20ad523a709 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d" status: 404 len: 111 microversion: 2.1 time: 0.118063 Aug 27 04:43:38.533871 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1447/2966] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:38 2022] GET /compute/v2.1/servers/0c1ebbce-7c0d-4f08-a05f-359d0527b76d => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:38.749909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-58986e95-bab5-4bd6-a52e-818bc1a646e0 req-08412876-c05e-44e0-a56b-8f8c9f1ed1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbbf89c1-bdf2-424f-bbb8-fff3ffda5424", "tag": "56cb120f-702f-4024-94e0-cdc0f4b37758"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:38.768260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-58986e95-bab5-4bd6-a52e-818bc1a646e0 req-08412876-c05e-44e0-a56b-8f8c9f1ed1d0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:38.773952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-58986e95-bab5-4bd6-a52e-818bc1a646e0 req-08412876-c05e-44e0-a56b-8f8c9f1ed1d0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:38.774667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-58986e95-bab5-4bd6-a52e-818bc1a646e0 req-08412876-c05e-44e0-a56b-8f8c9f1ed1d0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:38.781976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c00416a5-2067-4218-bbec-76a57ba15efe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:38.799528 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c00416a5-2067-4218-bbec-76a57ba15efe tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1512 microversion: 2.1 time: 1.416800 Aug 27 04:43:38.800286 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1520/2967] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:37 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1512 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:38.822440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31c747e0-a56c-4b6d-b619-dfa123edfe31 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:38.829975 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-58986e95-bab5-4bd6-a52e-818bc1a646e0 req-08412876-c05e-44e0-a56b-8f8c9f1ed1d0 service nova] Creating event network-changed:56cb120f-702f-4024-94e0-cdc0f4b37758 for instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 on n-h2-854823-1 Aug 27 04:43:38.830510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31c747e0-a56c-4b6d-b619-dfa123edfe31 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:38.844394 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-58986e95-bab5-4bd6-a52e-818bc1a646e0 req-08412876-c05e-44e0-a56b-8f8c9f1ed1d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.312064 Aug 27 04:43:38.848029 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1448/2968] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:38.861152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1d0e601c-a947-40a1-8fe4-3e80ee645f21 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] Action: 'create', calling method: .version_select at 0x7f1f21a2caf0>, body: {"pool": null} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:38.862683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31c747e0-a56c-4b6d-b619-dfa123edfe31 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:38.871435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31c747e0-a56c-4b6d-b619-dfa123edfe31 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:38.873087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31c747e0-a56c-4b6d-b619-dfa123edfe31 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:38.877528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31c747e0-a56c-4b6d-b619-dfa123edfe31 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:38.878695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31c747e0-a56c-4b6d-b619-dfa123edfe31 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:38.880174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31c747e0-a56c-4b6d-b619-dfa123edfe31 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:39.033127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31c747e0-a56c-4b6d-b619-dfa123edfe31 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:39.049033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31c747e0-a56c-4b6d-b619-dfa123edfe31 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:39.057465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31c747e0-a56c-4b6d-b619-dfa123edfe31 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:39.061719 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31c747e0-a56c-4b6d-b619-dfa123edfe31 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1310 microversion: 2.21 time: 0.252358 Aug 27 04:43:39.082787 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1521/2969] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:43:38 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1310 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:39.089832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4525a38c-cc85-4c09-acdb-d0925adf4119 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e71550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:39.201929 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4525a38c-cc85-4c09-acdb-d0925adf4119 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.117586 Aug 27 04:43:39.208790 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1522/2970] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:39 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:39.215087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d12f1320-d953-4829-a734-47886f1b5b9a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:39.217358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d12f1320-d953-4829-a734-47886f1b5b9a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:39.274302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d12f1320-d953-4829-a734-47886f1b5b9a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:39.282201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d12f1320-d953-4829-a734-47886f1b5b9a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:39.283034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d12f1320-d953-4829-a734-47886f1b5b9a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:39.295271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d12f1320-d953-4829-a734-47886f1b5b9a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:39.296611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d12f1320-d953-4829-a734-47886f1b5b9a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:39.298446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d12f1320-d953-4829-a734-47886f1b5b9a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:40.543393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d12f1320-d953-4829-a734-47886f1b5b9a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:40.559311 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d12f1320-d953-4829-a734-47886f1b5b9a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 200 len: 1322 microversion: 2.1 time: 1.348450 Aug 27 04:43:40.567127 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1523/2971] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:39 2022] GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 1322 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:40.576115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09ff690a-61af-43d2-ae6a-501c302086f4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '.version_select at 0x7f1f20e95550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:40.626535 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09ff690a-61af-43d2-ae6a-501c302086f4 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-724225157" status: 202 len: 0 microversion: 2.1 time: 0.057744 Aug 27 04:43:40.628132 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1524/2972] 10.222.0.79 () {58 vars in 1218 bytes} [Sat Aug 27 04:43:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-724225157 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:43:40.635042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57e8b711-5544-433c-a31a-ccf4597c64b9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:40.640177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57e8b711-5544-433c-a31a-ccf4597c64b9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:40.655089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57e8b711-5544-433c-a31a-ccf4597c64b9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:40.655774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57e8b711-5544-433c-a31a-ccf4597c64b9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:40.658186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57e8b711-5544-433c-a31a-ccf4597c64b9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:40.659100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57e8b711-5544-433c-a31a-ccf4597c64b9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:40.660206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57e8b711-5544-433c-a31a-ccf4597c64b9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:40.665281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57e8b711-5544-433c-a31a-ccf4597c64b9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:41.679652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57e8b711-5544-433c-a31a-ccf4597c64b9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6adda0a01c642158e8399b9e98aa9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb9f678a09d41eea6f3d833841fb7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:41.693689 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57e8b711-5544-433c-a31a-ccf4597c64b9 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 200 len: 1313 microversion: 2.1 time: 1.062986 Aug 27 04:43:41.695024 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1525/2973] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:40 2022] GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 1313 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:41.708385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-900076a0-53e5-4627-a6c5-e51334ad4f49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:41.716621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-900076a0-53e5-4627-a6c5-e51334ad4f49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:41.734114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-900076a0-53e5-4627-a6c5-e51334ad4f49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:41.736853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-900076a0-53e5-4627-a6c5-e51334ad4f49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:41.738084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-900076a0-53e5-4627-a6c5-e51334ad4f49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:41.739687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-900076a0-53e5-4627-a6c5-e51334ad4f49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:41.747411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-900076a0-53e5-4627-a6c5-e51334ad4f49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:41.747864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-900076a0-53e5-4627-a6c5-e51334ad4f49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:42.466673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-900076a0-53e5-4627-a6c5-e51334ad4f49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:42.487419 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-900076a0-53e5-4627-a6c5-e51334ad4f49 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1512 microversion: 2.1 time: 0.790668 Aug 27 04:43:42.489479 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1526/2974] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:41 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1512 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:42.504955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e0c7dd2-c625-497b-b3d5-dbe2992d2e93 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:42.505870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e0c7dd2-c625-497b-b3d5-dbe2992d2e93 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:42.526587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e0c7dd2-c625-497b-b3d5-dbe2992d2e93 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:42.528261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e0c7dd2-c625-497b-b3d5-dbe2992d2e93 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:42.529995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e0c7dd2-c625-497b-b3d5-dbe2992d2e93 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:42.530731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e0c7dd2-c625-497b-b3d5-dbe2992d2e93 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:42.533526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e0c7dd2-c625-497b-b3d5-dbe2992d2e93 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:42.534307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e0c7dd2-c625-497b-b3d5-dbe2992d2e93 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:43.007361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e0c7dd2-c625-497b-b3d5-dbe2992d2e93 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:43.019834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e0c7dd2-c625-497b-b3d5-dbe2992d2e93 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:43.034523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e0c7dd2-c625-497b-b3d5-dbe2992d2e93 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:43.036000 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e0c7dd2-c625-497b-b3d5-dbe2992d2e93 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1316 microversion: 2.21 time: 0.540986 Aug 27 04:43:43.036799 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1527/2975] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:43:42 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:43.074787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e85f1d1-2136-4615-893c-a5b22f979812 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20deca60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:43.168807 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e85f1d1-2136-4615-893c-a5b22f979812 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.115329 Aug 27 04:43:43.169588 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1528/2976] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:43 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:43.181021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3cd5c447-684e-48e7-8d71-23b655284673 req-1b3844e2-2ce6-4564-ab9b-8e777a155479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c1ebbce-7c0d-4f08-a05f-359d0527b76d", "name": "network-vif-deleted", "tag": "8348ead6-1b46-443f-99ec-f72deeb2c4f5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:43.205565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3cd5c447-684e-48e7-8d71-23b655284673 req-1b3844e2-2ce6-4564-ab9b-8e777a155479 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:43.206490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3cd5c447-684e-48e7-8d71-23b655284673 req-1b3844e2-2ce6-4564-ab9b-8e777a155479 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:43.207170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3cd5c447-684e-48e7-8d71-23b655284673 req-1b3844e2-2ce6-4564-ab9b-8e777a155479 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:43.235459 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3cd5c447-684e-48e7-8d71-23b655284673 req-1b3844e2-2ce6-4564-ab9b-8e777a155479 service nova] Creating event network-vif-deleted:8348ead6-1b46-443f-99ec-f72deeb2c4f5 for instance 0c1ebbce-7c0d-4f08-a05f-359d0527b76d on n-h2-854823-1 Aug 27 04:43:43.257528 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3cd5c447-684e-48e7-8d71-23b655284673 req-1b3844e2-2ce6-4564-ab9b-8e777a155479 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083085 Aug 27 04:43:43.261176 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1529/2977] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:43.288973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73c95a46-19ad-41c1-b1c1-25376bea08af tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:43.290085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73c95a46-19ad-41c1-b1c1-25376bea08af tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:43.299467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73c95a46-19ad-41c1-b1c1-25376bea08af tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:43.304701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73c95a46-19ad-41c1-b1c1-25376bea08af tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:43.305408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73c95a46-19ad-41c1-b1c1-25376bea08af tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:43.306387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73c95a46-19ad-41c1-b1c1-25376bea08af tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:43.308425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73c95a46-19ad-41c1-b1c1-25376bea08af tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:43.309179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73c95a46-19ad-41c1-b1c1-25376bea08af tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:43.657297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-73c95a46-19ad-41c1-b1c1-25376bea08af tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:43.670991 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-73c95a46-19ad-41c1-b1c1-25376bea08af tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 200 len: 1322 microversion: 2.1 time: 0.406397 Aug 27 04:43:43.672269 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1530/2978] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:43 2022] GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:43.680885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1cff5c43-4a67-4f71-9c51-8d24e9d4e195 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:43.681802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1cff5c43-4a67-4f71-9c51-8d24e9d4e195 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:43.698883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cff5c43-4a67-4f71-9c51-8d24e9d4e195 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:43.699672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cff5c43-4a67-4f71-9c51-8d24e9d4e195 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:43.700369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cff5c43-4a67-4f71-9c51-8d24e9d4e195 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:43.701351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cff5c43-4a67-4f71-9c51-8d24e9d4e195 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:43.702036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cff5c43-4a67-4f71-9c51-8d24e9d4e195 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:43.702653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cff5c43-4a67-4f71-9c51-8d24e9d4e195 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:43.746756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:44.144695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1cff5c43-4a67-4f71-9c51-8d24e9d4e195 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6adda0a01c642158e8399b9e98aa9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb9f678a09d41eea6f3d833841fb7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:44.160380 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1cff5c43-4a67-4f71-9c51-8d24e9d4e195 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 200 len: 1313 microversion: 2.1 time: 0.486477 Aug 27 04:43:44.163563 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1531/2979] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:43 2022] GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:44.184370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f260b799-1a32-45dd-8be2-8b32626d4ef3 req-2cdeeb7b-64b9-4fa5-a519-0052b4745d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674b2c93-d5f3-4312-87df-f26c8ace2f66", "tag": "7cac15c2-ca33-47d8-ac95-a6e3dec4250c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:44.225254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f260b799-1a32-45dd-8be2-8b32626d4ef3 req-2cdeeb7b-64b9-4fa5-a519-0052b4745d05 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:44.226198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f260b799-1a32-45dd-8be2-8b32626d4ef3 req-2cdeeb7b-64b9-4fa5-a519-0052b4745d05 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:44.226800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f260b799-1a32-45dd-8be2-8b32626d4ef3 req-2cdeeb7b-64b9-4fa5-a519-0052b4745d05 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:44.240014 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f260b799-1a32-45dd-8be2-8b32626d4ef3 req-2cdeeb7b-64b9-4fa5-a519-0052b4745d05 service nova] Creating event network-changed:7cac15c2-ca33-47d8-ac95-a6e3dec4250c for instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 on n-h1-854823-1 Aug 27 04:43:44.249002 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f260b799-1a32-45dd-8be2-8b32626d4ef3 req-2cdeeb7b-64b9-4fa5-a519-0052b4745d05 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078249 Aug 27 04:43:44.251683 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1532/2980] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:44.274277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af02e60f-a7a7-447e-b108-d33a398eba95 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:44.276305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af02e60f-a7a7-447e-b108-d33a398eba95 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:44.294031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af02e60f-a7a7-447e-b108-d33a398eba95 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:44.295031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af02e60f-a7a7-447e-b108-d33a398eba95 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:44.300876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af02e60f-a7a7-447e-b108-d33a398eba95 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:44.302967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af02e60f-a7a7-447e-b108-d33a398eba95 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:44.305602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af02e60f-a7a7-447e-b108-d33a398eba95 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:44.308125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af02e60f-a7a7-447e-b108-d33a398eba95 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:44.607418 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1d0e601c-a947-40a1-8fe4-3e80ee645f21 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.757736 Aug 27 04:43:44.608097 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1449/2981] 10.222.0.79 () {60 vars in 1170 bytes} [Sat Aug 27 04:43:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:44.619357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af02e60f-a7a7-447e-b108-d33a398eba95 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:44.621955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-feedbb83-dbe0-45d3-816f-d433cafdea15 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:44.622728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-feedbb83-dbe0-45d3-816f-d433cafdea15 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:44.637623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-feedbb83-dbe0-45d3-816f-d433cafdea15 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:44.638265 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af02e60f-a7a7-447e-b108-d33a398eba95 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1489 microversion: 2.1 time: 0.383207 Aug 27 04:43:44.638440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-feedbb83-dbe0-45d3-816f-d433cafdea15 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:44.638852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-feedbb83-dbe0-45d3-816f-d433cafdea15 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:44.639565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-feedbb83-dbe0-45d3-816f-d433cafdea15 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:44.640028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-feedbb83-dbe0-45d3-816f-d433cafdea15 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:44.640711 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1533/2982] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:44 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1489 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:44.646436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ded5b123-0bb6-4bb1-9307-0cdcbcb38d36 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20ea1160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:44.658480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-feedbb83-dbe0-45d3-816f-d433cafdea15 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:44.708403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=65 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:44.712441 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ded5b123-0bb6-4bb1-9307-0cdcbcb38d36 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.070151 Aug 27 04:43:44.721946 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1534/2983] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:44 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:44.728595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-54c5a2d3-8a14-4613-aa55-3f4428954d41 req-bb5211c8-d47c-480b-ae2c-05691b306e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbbf89c1-bdf2-424f-bbb8-fff3ffda5424", "name": "network-vif-plugged", "status": "completed", "tag": "56cb120f-702f-4024-94e0-cdc0f4b37758"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:44.747984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-54c5a2d3-8a14-4613-aa55-3f4428954d41 req-bb5211c8-d47c-480b-ae2c-05691b306e72 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:44.749068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-54c5a2d3-8a14-4613-aa55-3f4428954d41 req-bb5211c8-d47c-480b-ae2c-05691b306e72 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:44.749653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-54c5a2d3-8a14-4613-aa55-3f4428954d41 req-bb5211c8-d47c-480b-ae2c-05691b306e72 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:44.766336 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-54c5a2d3-8a14-4613-aa55-3f4428954d41 req-bb5211c8-d47c-480b-ae2c-05691b306e72 service nova] Creating event network-vif-plugged:56cb120f-702f-4024-94e0-cdc0f4b37758 for instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 on n-h2-854823-1 Aug 27 04:43:44.774880 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-54c5a2d3-8a14-4613-aa55-3f4428954d41 req-bb5211c8-d47c-480b-ae2c-05691b306e72 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050831 Aug 27 04:43:44.775708 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1535/2984] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:44.781255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-debe0b19-a58b-4ef7-9104-1da65d59bcf7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:44.783829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-debe0b19-a58b-4ef7-9104-1da65d59bcf7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:44.815105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-debe0b19-a58b-4ef7-9104-1da65d59bcf7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:44.816151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-debe0b19-a58b-4ef7-9104-1da65d59bcf7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:44.816888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-debe0b19-a58b-4ef7-9104-1da65d59bcf7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:44.818113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-debe0b19-a58b-4ef7-9104-1da65d59bcf7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:44.818983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-debe0b19-a58b-4ef7-9104-1da65d59bcf7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:44.820876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-debe0b19-a58b-4ef7-9104-1da65d59bcf7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:44.894873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-debe0b19-a58b-4ef7-9104-1da65d59bcf7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:43:45.122036 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-debe0b19-a58b-4ef7-9104-1da65d59bcf7 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 204 len: 0 microversion: 2.1 time: 0.344733 Aug 27 04:43:45.126095 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1536/2985] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:43:44 2022] DELETE /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:43:45.142019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e31441e-15e1-4d8a-bb06-5c12f20b299f tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] Calling method '.version_select at 0x7f1f20e63670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:45.498345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-feedbb83-dbe0-45d3-816f-d433cafdea15 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:45.507691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-feedbb83-dbe0-45d3-816f-d433cafdea15 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:45.526296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-feedbb83-dbe0-45d3-816f-d433cafdea15 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:45.528305 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-feedbb83-dbe0-45d3-816f-d433cafdea15 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1358 microversion: 2.21 time: 0.909540 Aug 27 04:43:45.528440 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1450/2986] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:43:44 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1358 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:45.540021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-19d5026b-a70f-4f2f-942b-082cfcf9ebfb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:45.540581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-19d5026b-a70f-4f2f-942b-082cfcf9ebfb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:45.555228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19d5026b-a70f-4f2f-942b-082cfcf9ebfb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:45.555810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19d5026b-a70f-4f2f-942b-082cfcf9ebfb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:45.556165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19d5026b-a70f-4f2f-942b-082cfcf9ebfb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:45.556953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19d5026b-a70f-4f2f-942b-082cfcf9ebfb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:45.557372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19d5026b-a70f-4f2f-942b-082cfcf9ebfb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:45.557800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19d5026b-a70f-4f2f-942b-082cfcf9ebfb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:45.584213 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e31441e-15e1-4d8a-bb06-5c12f20b299f tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/79e3ad11-11c3-43d4-9767-10e17fbe55b3" status: 200 len: 142 microversion: 2.1 time: 0.456821 Aug 27 04:43:45.586204 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1537/2987] 10.222.0.79 () {58 vars in 1260 bytes} [Sat Aug 27 04:43:45 2022] GET /compute/v2.1/os-floating-ips/79e3ad11-11c3-43d4-9767-10e17fbe55b3 => generated 142 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:45.594057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fbeb879c-ed30-4a8d-90dc-b7d5431adcdf tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:45.595450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fbeb879c-ed30-4a8d-90dc-b7d5431adcdf tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:45.603989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-19d5026b-a70f-4f2f-942b-082cfcf9ebfb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:43:45.609126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbeb879c-ed30-4a8d-90dc-b7d5431adcdf tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:45.609853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbeb879c-ed30-4a8d-90dc-b7d5431adcdf tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:45.610816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbeb879c-ed30-4a8d-90dc-b7d5431adcdf tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:45.611970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbeb879c-ed30-4a8d-90dc-b7d5431adcdf tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:45.612652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbeb879c-ed30-4a8d-90dc-b7d5431adcdf tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:45.613629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbeb879c-ed30-4a8d-90dc-b7d5431adcdf tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:45.743753 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-19d5026b-a70f-4f2f-942b-082cfcf9ebfb tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 204 len: 0 microversion: 2.1 time: 0.214053 Aug 27 04:43:45.747686 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1451/2988] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:43:45 2022] DELETE /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:43:45.758561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e7dda4f-509a-4a75-8f31-5a95e136034a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:45.759545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4e7dda4f-509a-4a75-8f31-5a95e136034a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:45.770951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e7dda4f-509a-4a75-8f31-5a95e136034a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:45.771677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e7dda4f-509a-4a75-8f31-5a95e136034a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:45.772136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e7dda4f-509a-4a75-8f31-5a95e136034a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:45.773478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e7dda4f-509a-4a75-8f31-5a95e136034a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:45.773949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e7dda4f-509a-4a75-8f31-5a95e136034a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:45.774396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e7dda4f-509a-4a75-8f31-5a95e136034a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:45.903417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fbeb879c-ed30-4a8d-90dc-b7d5431adcdf tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:45.920060 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fbeb879c-ed30-4a8d-90dc-b7d5431adcdf tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 200 len: 1322 microversion: 2.1 time: 0.331694 Aug 27 04:43:45.932630 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1538/2989] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:45 2022] GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:45.932630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ed9c349-3e58-48b4-9792-f0ccd8764d9f tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:45.933560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ed9c349-3e58-48b4-9792-f0ccd8764d9f tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:45.941001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ed9c349-3e58-48b4-9792-f0ccd8764d9f tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:45.941644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ed9c349-3e58-48b4-9792-f0ccd8764d9f tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:45.942088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ed9c349-3e58-48b4-9792-f0ccd8764d9f tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:45.942814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ed9c349-3e58-48b4-9792-f0ccd8764d9f tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:45.943276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ed9c349-3e58-48b4-9792-f0ccd8764d9f tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:45.943703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ed9c349-3e58-48b4-9792-f0ccd8764d9f tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:46.201745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4ed9c349-3e58-48b4-9792-f0ccd8764d9f tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6adda0a01c642158e8399b9e98aa9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb9f678a09d41eea6f3d833841fb7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:46.219406 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ed9c349-3e58-48b4-9792-f0ccd8764d9f tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 200 len: 1313 microversion: 2.1 time: 0.296408 Aug 27 04:43:46.220316 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1539/2990] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:45 2022] GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:46.232317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f52bb463-4fe5-4dde-8490-03ae40e594d0 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] Calling method '.version_select at 0x7f1f20e711f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:46.509852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4e7dda4f-509a-4a75-8f31-5a95e136034a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:46.527241 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4e7dda4f-509a-4a75-8f31-5a95e136034a tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 200 len: 1485 microversion: 2.1 time: 0.778160 Aug 27 04:43:46.542126 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1452/2991] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:45 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 1485 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:46.548101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fe96cdb7-e7b9-4cb9-adc4-1ac4c3fdd0b3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21558dc0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:46.622405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:46.734106 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fe96cdb7-e7b9-4cb9-adc4-1ac4c3fdd0b3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1453 microversion: 2.1 time: 0.190364 Aug 27 04:43:46.746054 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1453/2992] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:46 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1453 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:46.757884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:46.761745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ada3a3e5-46e0-4871-8232-2b8b1760d3f5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:46.764219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ada3a3e5-46e0-4871-8232-2b8b1760d3f5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:46.784969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ada3a3e5-46e0-4871-8232-2b8b1760d3f5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:46.787461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ada3a3e5-46e0-4871-8232-2b8b1760d3f5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:46.788217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ada3a3e5-46e0-4871-8232-2b8b1760d3f5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:46.790191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ada3a3e5-46e0-4871-8232-2b8b1760d3f5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:46.791886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ada3a3e5-46e0-4871-8232-2b8b1760d3f5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:46.792684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ada3a3e5-46e0-4871-8232-2b8b1760d3f5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:47.290592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ada3a3e5-46e0-4871-8232-2b8b1760d3f5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:47.335803 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ada3a3e5-46e0-4871-8232-2b8b1760d3f5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1495 microversion: 2.1 time: 0.586322 Aug 27 04:43:47.339667 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1454/2993] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:46 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1495 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:47.350867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-88936422-1c47-47f2-a690-c1e0cba477b8 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:47.352118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-88936422-1c47-47f2-a690-c1e0cba477b8 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:47.365345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88936422-1c47-47f2-a690-c1e0cba477b8 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:47.366845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88936422-1c47-47f2-a690-c1e0cba477b8 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:47.368995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88936422-1c47-47f2-a690-c1e0cba477b8 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:47.371031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88936422-1c47-47f2-a690-c1e0cba477b8 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:47.372236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88936422-1c47-47f2-a690-c1e0cba477b8 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:47.373155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88936422-1c47-47f2-a690-c1e0cba477b8 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:47.830051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-88936422-1c47-47f2-a690-c1e0cba477b8 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:47.842409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-88936422-1c47-47f2-a690-c1e0cba477b8 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:47.848667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-88936422-1c47-47f2-a690-c1e0cba477b8 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:47.856837 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-88936422-1c47-47f2-a690-c1e0cba477b8 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1358 microversion: 2.21 time: 0.508505 Aug 27 04:43:47.868701 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1455/2994] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:43:47 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1358 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:47.870064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-91150e63-89db-40ab-8e80-9922de618cb3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:47.870988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-91150e63-89db-40ab-8e80-9922de618cb3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:47.882694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91150e63-89db-40ab-8e80-9922de618cb3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:47.883196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91150e63-89db-40ab-8e80-9922de618cb3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:47.883654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91150e63-89db-40ab-8e80-9922de618cb3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:47.884366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91150e63-89db-40ab-8e80-9922de618cb3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:47.884861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91150e63-89db-40ab-8e80-9922de618cb3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:47.885336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91150e63-89db-40ab-8e80-9922de618cb3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:48.504297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-91150e63-89db-40ab-8e80-9922de618cb3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:48.539354 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-91150e63-89db-40ab-8e80-9922de618cb3 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 200 len: 1322 microversion: 2.1 time: 0.679208 Aug 27 04:43:48.554511 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1456/2995] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:47 2022] GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 1322 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:48.563427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0bdb8268-aea6-4993-baba-3ea009851f5b tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:48.564336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0bdb8268-aea6-4993-baba-3ea009851f5b tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:48.575172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bdb8268-aea6-4993-baba-3ea009851f5b tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:48.577453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bdb8268-aea6-4993-baba-3ea009851f5b tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:48.578081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bdb8268-aea6-4993-baba-3ea009851f5b tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:48.579265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bdb8268-aea6-4993-baba-3ea009851f5b tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:48.580251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bdb8268-aea6-4993-baba-3ea009851f5b tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:48.581079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bdb8268-aea6-4993-baba-3ea009851f5b tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:48.798836 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f52bb463-4fe5-4dde-8490-03ae40e594d0 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/79e3ad11-11c3-43d4-9767-10e17fbe55b3" status: 202 len: 0 microversion: 2.1 time: 2.571291 Aug 27 04:43:48.800235 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1540/2996] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:43:46 2022] DELETE /compute/v2.1/os-floating-ips/79e3ad11-11c3-43d4-9767-10e17fbe55b3 => generated 0 bytes in 2580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:43:48.810856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f89372f6-497f-431a-8123-fc920c7af75d req-b4ee7049-d918-4761-8918-3081228a1853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea1e00b-093a-4ed1-9640-a2a775d92433", "name": "network-vif-deleted", "tag": "d062da01-c364-4876-b2fb-050be39ee311"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:48.824156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f89372f6-497f-431a-8123-fc920c7af75d req-b4ee7049-d918-4761-8918-3081228a1853 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:48.824691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f89372f6-497f-431a-8123-fc920c7af75d req-b4ee7049-d918-4761-8918-3081228a1853 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:48.825451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f89372f6-497f-431a-8123-fc920c7af75d req-b4ee7049-d918-4761-8918-3081228a1853 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:48.837731 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f89372f6-497f-431a-8123-fc920c7af75d req-b4ee7049-d918-4761-8918-3081228a1853 service nova] Creating event network-vif-deleted:d062da01-c364-4876-b2fb-050be39ee311 for instance 4ea1e00b-093a-4ed1-9640-a2a775d92433 on n-h2-854823-1 Aug 27 04:43:48.843841 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f89372f6-497f-431a-8123-fc920c7af75d req-b4ee7049-d918-4761-8918-3081228a1853 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037359 Aug 27 04:43:48.844450 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1541/2997] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:48.849870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3f15e2b-0136-4009-b119-9eb54c34891f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:48.851331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b3f15e2b-0136-4009-b119-9eb54c34891f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: 4ea1e00b-093a-4ed1-9640-a2a775d92433] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:48.858658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3f15e2b-0136-4009-b119-9eb54c34891f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:48.859215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3f15e2b-0136-4009-b119-9eb54c34891f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:48.860175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3f15e2b-0136-4009-b119-9eb54c34891f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:48.861315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3f15e2b-0136-4009-b119-9eb54c34891f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:48.861946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3f15e2b-0136-4009-b119-9eb54c34891f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:48.862641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3f15e2b-0136-4009-b119-9eb54c34891f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:48.878337 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b3f15e2b-0136-4009-b119-9eb54c34891f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] HTTP exception thrown: Instance 4ea1e00b-093a-4ed1-9640-a2a775d92433 could not be found. Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3f15e2b-0136-4009-b119-9eb54c34891f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Request method failure captured: Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 HTTP/1.1 Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ8LYqvzwfoQfgeHMNqSsaekwWA45v9g5RlrI9ATo8z9y2OYq7KiYL9u_hx5gfwZW3-BH-Shkw5I0bkVqz2iU-DLz3hd4UVU3xVjk91TD2FqT5yr74DgplSVuJBxBSijz5gVPvw3civPVzUBDFdZwU_Aaj2hzEH69M9crBZPHeY5f7Q Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 67b142dea11c4e7d921bbb7dd5e543be Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-LiveMigrationTest-600329319 Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-LiveMigrationTest-600329319 Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 67b142dea11c4e7d921bbb7dd5e543be Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-LiveMigrationTest-600329319 Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-LiveMigrationTest-600329319-project Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8213929124384914aebc5e05572cc1ed Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-LiveMigrationTest-600329319-project Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 4ea1e00b-093a-4ed1-9640-a2a775d92433 could not be found. Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '4ea1e00b-093a-4ed1-9640-a2a775d92433'} Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea1e00b-093a-4ed1-9640-a2a775d92433 could not be found. Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea1e00b-093a-4ed1-9640-a2a775d92433 could not be found. Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:48.880340 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:48.887022 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:48.887022 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:48.887022 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:48.887022 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:48.887022 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:48.887022 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea1e00b-093a-4ed1-9640-a2a775d92433 could not be found. Aug 27 04:43:48.887022 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:48.887022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3f15e2b-0136-4009-b119-9eb54c34891f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Returning 404 to user: Instance 4ea1e00b-093a-4ed1-9640-a2a775d92433 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:48.887022 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3f15e2b-0136-4009-b119-9eb54c34891f tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433" status: 404 len: 111 microversion: 2.1 time: 0.036103 Aug 27 04:43:48.887022 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1542/2998] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:48 2022] GET /compute/v2.1/servers/4ea1e00b-093a-4ed1-9640-a2a775d92433 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:48.890459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9c5615d-eb75-4106-b2ab-49c2d7ca5c9d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e71af0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:48.946628 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9c5615d-eb75-4106-b2ab-49c2d7ca5c9d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1462 microversion: 2.1 time: 0.059647 Aug 27 04:43:48.949923 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1543/2999] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:48 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1462 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:48.952338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27c012d0-ee33-45e4-b6ee-b2e3c09c3e38 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:48.953009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-27c012d0-ee33-45e4-b6ee-b2e3c09c3e38 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:48.962890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27c012d0-ee33-45e4-b6ee-b2e3c09c3e38 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:48.963761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27c012d0-ee33-45e4-b6ee-b2e3c09c3e38 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:48.964210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27c012d0-ee33-45e4-b6ee-b2e3c09c3e38 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:48.964977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27c012d0-ee33-45e4-b6ee-b2e3c09c3e38 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:48.965445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27c012d0-ee33-45e4-b6ee-b2e3c09c3e38 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:48.966705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27c012d0-ee33-45e4-b6ee-b2e3c09c3e38 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:49.168679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0bdb8268-aea6-4993-baba-3ea009851f5b tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6adda0a01c642158e8399b9e98aa9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb9f678a09d41eea6f3d833841fb7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:49.180188 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0bdb8268-aea6-4993-baba-3ea009851f5b tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 200 len: 1498 microversion: 2.1 time: 0.623635 Aug 27 04:43:49.180833 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1457/3000] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:48 2022] GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 1498 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:49.187187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-202495fd-e2bc-43d4-ab13-b92e8cc3a632 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] Calling method '.version_select at 0x7f1f2127ca60>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:49.387128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-27c012d0-ee33-45e4-b6ee-b2e3c09c3e38 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:49.398353 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-27c012d0-ee33-45e4-b6ee-b2e3c09c3e38 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 200 len: 1495 microversion: 2.1 time: 0.449308 Aug 27 04:43:49.399601 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1544/3001] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:48 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 1495 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:49.405811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bfc9d659-71b7-45d5-8e58-61aa04ca5cbf tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:49.406734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bfc9d659-71b7-45d5-8e58-61aa04ca5cbf tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:49.415135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfc9d659-71b7-45d5-8e58-61aa04ca5cbf tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:49.416040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfc9d659-71b7-45d5-8e58-61aa04ca5cbf tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:49.416790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfc9d659-71b7-45d5-8e58-61aa04ca5cbf tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:49.418766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfc9d659-71b7-45d5-8e58-61aa04ca5cbf tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:49.419569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfc9d659-71b7-45d5-8e58-61aa04ca5cbf tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:49.420308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfc9d659-71b7-45d5-8e58-61aa04ca5cbf tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:49.979639 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-202495fd-e2bc-43d4-ab13-b92e8cc3a632 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.797269 Aug 27 04:43:49.987311 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1458/3002] 10.222.0.79 () {58 vars in 1164 bytes} [Sat Aug 27 04:43:49 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:43:49.993111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d100144e-dde0-4b5e-880c-d86cb1ab8047 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:49.996027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d100144e-dde0-4b5e-880c-d86cb1ab8047 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:50.021338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d100144e-dde0-4b5e-880c-d86cb1ab8047 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:50.021928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d100144e-dde0-4b5e-880c-d86cb1ab8047 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:50.022628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d100144e-dde0-4b5e-880c-d86cb1ab8047 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:50.024646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d100144e-dde0-4b5e-880c-d86cb1ab8047 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:50.025350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d100144e-dde0-4b5e-880c-d86cb1ab8047 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:50.026063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d100144e-dde0-4b5e-880c-d86cb1ab8047 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:50.069597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d100144e-dde0-4b5e-880c-d86cb1ab8047 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:43:50.142379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bfc9d659-71b7-45d5-8e58-61aa04ca5cbf tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:50.169426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bfc9d659-71b7-45d5-8e58-61aa04ca5cbf tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:50.171980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bfc9d659-71b7-45d5-8e58-61aa04ca5cbf tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:50.206509 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bfc9d659-71b7-45d5-8e58-61aa04ca5cbf tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1358 microversion: 2.21 time: 0.774184 Aug 27 04:43:50.212901 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1545/3003] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:43:49 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1358 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:50.236883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae2e6c32-5ff3-4ce3-8abc-b86690f9038f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e6b4c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:50.265690 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d100144e-dde0-4b5e-880c-d86cb1ab8047 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 204 len: 0 microversion: 2.1 time: 0.282900 Aug 27 04:43:50.267138 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1459/3004] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:43:49 2022] DELETE /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:43:50.280008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53a821af-245b-4828-85b6-b5e71b3bc190 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:50.322886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.compute.server_groups [None req-53a821af-245b-4828-85b6-b5e71b3bc190 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Querying cell e7bc291f-2aa3-4d66-a942-e096e031ad4c(cell1) for 1 instances {{(pid=128870) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 04:43:50.323848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a821af-245b-4828-85b6-b5e71b3bc190 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:50.324488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a821af-245b-4828-85b6-b5e71b3bc190 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:50.325123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a821af-245b-4828-85b6-b5e71b3bc190 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:50.335757 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae2e6c32-5ff3-4ce3-8abc-b86690f9038f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 200 len: 1462 microversion: 2.1 time: 0.118833 Aug 27 04:43:50.337788 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1546/3005] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:50 2022] GET /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 1462 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:50.357414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea7470b8-dd7a-496b-bc63-be068b8a96de tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:50.359703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea7470b8-dd7a-496b-bc63-be068b8a96de tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:50.364693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:50.384775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea7470b8-dd7a-496b-bc63-be068b8a96de tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:50.385676 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-53a821af-245b-4828-85b6-b5e71b3bc190 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/32c1536f-961d-458d-9edc-d2c1e9bd2d5c" status: 200 len: 222 microversion: 2.1 time: 0.116040 Aug 27 04:43:50.386287 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1460/3006] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:43:50 2022] GET /compute/v2.1/os-server-groups/32c1536f-961d-458d-9edc-d2c1e9bd2d5c => generated 222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:50.386789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea7470b8-dd7a-496b-bc63-be068b8a96de tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:50.389069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea7470b8-dd7a-496b-bc63-be068b8a96de tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:50.393484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea7470b8-dd7a-496b-bc63-be068b8a96de tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:50.395052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea7470b8-dd7a-496b-bc63-be068b8a96de tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:50.398785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea7470b8-dd7a-496b-bc63-be068b8a96de tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:50.406395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a9cf8c87-2aa9-46ce-af64-14267b08d148 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] Calling method '.version_select at 0x7f1f211cd160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:50.618010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ea7470b8-dd7a-496b-bc63-be068b8a96de tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:50.628979 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea7470b8-dd7a-496b-bc63-be068b8a96de tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 200 len: 1322 microversion: 2.1 time: 0.286538 Aug 27 04:43:50.646367 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1547/3007] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:50 2022] GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:50.652417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9f90d6d-3e58-4308-b4c9-981b13fec7eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:50.653060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9f90d6d-3e58-4308-b4c9-981b13fec7eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:50.660323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9f90d6d-3e58-4308-b4c9-981b13fec7eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:50.661198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9f90d6d-3e58-4308-b4c9-981b13fec7eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:50.661916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9f90d6d-3e58-4308-b4c9-981b13fec7eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:50.663630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9f90d6d-3e58-4308-b4c9-981b13fec7eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:50.664371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9f90d6d-3e58-4308-b4c9-981b13fec7eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:50.664982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9f90d6d-3e58-4308-b4c9-981b13fec7eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:50.940668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9f90d6d-3e58-4308-b4c9-981b13fec7eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:50.973732 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9f90d6d-3e58-4308-b4c9-981b13fec7eb tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1500 microversion: 2.1 time: 0.318217 Aug 27 04:43:50.990501 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1548/3008] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:50 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1500 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:51.006370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6bf9093-004b-4616-a820-3a4e85244d66 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:51.008548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6bf9093-004b-4616-a820-3a4e85244d66 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 0e0d6029-a40b-45b9-b230-2033ec88617e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:51.018725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6bf9093-004b-4616-a820-3a4e85244d66 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:51.019737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6bf9093-004b-4616-a820-3a4e85244d66 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:51.020974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6bf9093-004b-4616-a820-3a4e85244d66 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:51.022931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6bf9093-004b-4616-a820-3a4e85244d66 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:51.023888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6bf9093-004b-4616-a820-3a4e85244d66 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:51.024974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6bf9093-004b-4616-a820-3a4e85244d66 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:51.092217 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a9cf8c87-2aa9-46ce-af64-14267b08d148 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.704879 Aug 27 04:43:51.093589 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1461/3009] 10.222.0.79 () {58 vars in 1149 bytes} [Sat Aug 27 04:43:50 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:51.106994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-43483786-5cce-4c68-b22b-5da75d8145bd tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:51.108792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-43483786-5cce-4c68-b22b-5da75d8145bd tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:51.122747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43483786-5cce-4c68-b22b-5da75d8145bd tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:51.123618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43483786-5cce-4c68-b22b-5da75d8145bd tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:51.124301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43483786-5cce-4c68-b22b-5da75d8145bd tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:51.139867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43483786-5cce-4c68-b22b-5da75d8145bd tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:51.141012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43483786-5cce-4c68-b22b-5da75d8145bd tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:51.141677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43483786-5cce-4c68-b22b-5da75d8145bd tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:51.232991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-43483786-5cce-4c68-b22b-5da75d8145bd tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:43:51.296472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a6bf9093-004b-4616-a820-3a4e85244d66 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:51.307361 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6bf9093-004b-4616-a820-3a4e85244d66 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e" status: 200 len: 1468 microversion: 2.1 time: 0.303247 Aug 27 04:43:51.309925 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1549/3010] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:50 2022] GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e => generated 1468 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:51.338473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c12dd81-ab6f-42c7-8aa8-60367af99d8e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:51.341568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c12dd81-ab6f-42c7-8aa8-60367af99d8e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:51.350757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12dd81-ab6f-42c7-8aa8-60367af99d8e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:51.351524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12dd81-ab6f-42c7-8aa8-60367af99d8e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:51.360953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12dd81-ab6f-42c7-8aa8-60367af99d8e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:51.363801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12dd81-ab6f-42c7-8aa8-60367af99d8e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:51.367535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12dd81-ab6f-42c7-8aa8-60367af99d8e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:51.368365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12dd81-ab6f-42c7-8aa8-60367af99d8e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:51.409426 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6c12dd81-ab6f-42c7-8aa8-60367af99d8e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c12dd81-ab6f-42c7-8aa8-60367af99d8e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c HTTP/1.1 Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c'} Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:51.415093 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:51.419190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:51.419190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:51.419190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:51.419190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:51.419190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:51.419190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:43:51.419190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:51.422996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c12dd81-ab6f-42c7-8aa8-60367af99d8e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:51.425507 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c12dd81-ab6f-42c7-8aa8-60367af99d8e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 404 len: 111 microversion: 2.1 time: 0.112895 Aug 27 04:43:51.426181 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1550/3011] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:51 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:51.435183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-28f7e9f0-76eb-4893-9d79-95f3167d7734 req-232a3249-e686-4cc2-bcd3-8153aee0626f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674b2c93-d5f3-4312-87df-f26c8ace2f66", "name": "network-vif-plugged", "status": "completed", "tag": "7cac15c2-ca33-47d8-ac95-a6e3dec4250c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:51.449308 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-43483786-5cce-4c68-b22b-5da75d8145bd tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 204 len: 0 microversion: 2.1 time: 0.353778 Aug 27 04:43:51.449993 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1462/3012] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:43:51 2022] DELETE /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:43:51.462489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-f709983e-93f4-45bb-8ad6-31f5a9598ea2 req-8ce2b58b-15e4-4198-9e68-b3635ca34dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac000e1e-dc39-4884-96c6-dc414741500d", "tag": "f73056e2-3ed0-4906-a4d1-5d817a28be53"}, {"server_uuid": "bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c", "name": "network-vif-deleted", "tag": "68ab2f4f-4070-462a-b9f1-f0bfd0940ba2"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:51.479206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-28f7e9f0-76eb-4893-9d79-95f3167d7734 req-232a3249-e686-4cc2-bcd3-8153aee0626f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:51.480067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-28f7e9f0-76eb-4893-9d79-95f3167d7734 req-232a3249-e686-4cc2-bcd3-8153aee0626f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:51.483160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-28f7e9f0-76eb-4893-9d79-95f3167d7734 req-232a3249-e686-4cc2-bcd3-8153aee0626f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:51.489098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f709983e-93f4-45bb-8ad6-31f5a9598ea2 req-8ce2b58b-15e4-4198-9e68-b3635ca34dfe service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:51.489847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f709983e-93f4-45bb-8ad6-31f5a9598ea2 req-8ce2b58b-15e4-4198-9e68-b3635ca34dfe service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:51.490446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f709983e-93f4-45bb-8ad6-31f5a9598ea2 req-8ce2b58b-15e4-4198-9e68-b3635ca34dfe service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:51.504508 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-28f7e9f0-76eb-4893-9d79-95f3167d7734 req-232a3249-e686-4cc2-bcd3-8153aee0626f service nova] Creating event network-vif-plugged:7cac15c2-ca33-47d8-ac95-a6e3dec4250c for instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 on n-h1-854823-1 Aug 27 04:43:51.523334 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f709983e-93f4-45bb-8ad6-31f5a9598ea2 req-8ce2b58b-15e4-4198-9e68-b3635ca34dfe service nova] Creating event network-changed:f73056e2-3ed0-4906-a4d1-5d817a28be53 for instance ac000e1e-dc39-4884-96c6-dc414741500d on n-h2-854823-1 Aug 27 04:43:51.524781 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f709983e-93f4-45bb-8ad6-31f5a9598ea2 req-8ce2b58b-15e4-4198-9e68-b3635ca34dfe service nova] Creating event network-vif-deleted:68ab2f4f-4070-462a-b9f1-f0bfd0940ba2 for instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c on n-h1-854823-1 Aug 27 04:43:51.530576 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-28f7e9f0-76eb-4893-9d79-95f3167d7734 req-232a3249-e686-4cc2-bcd3-8153aee0626f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102637 Aug 27 04:43:51.531210 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1551/3013] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:51.534639 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-f709983e-93f4-45bb-8ad6-31f5a9598ea2 req-8ce2b58b-15e4-4198-9e68-b3635ca34dfe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.076907 Aug 27 04:43:51.535968 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1463/3014] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:51.540954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a0bd6bd-b038-4e06-9cab-8f07cb984778 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] Calling method '.version_select at 0x7f1f20de68b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:51.552809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0b0b2c2b-2420-48f7-9fad-de371ac08417 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:51.555603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0b0b2c2b-2420-48f7-9fad-de371ac08417 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:51.564093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b0b2c2b-2420-48f7-9fad-de371ac08417 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:51.564975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b0b2c2b-2420-48f7-9fad-de371ac08417 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:51.565635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b0b2c2b-2420-48f7-9fad-de371ac08417 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:51.566699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b0b2c2b-2420-48f7-9fad-de371ac08417 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:51.567442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b0b2c2b-2420-48f7-9fad-de371ac08417 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:51.568342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b0b2c2b-2420-48f7-9fad-de371ac08417 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:51.956685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0b0b2c2b-2420-48f7-9fad-de371ac08417 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:51.967658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0b0b2c2b-2420-48f7-9fad-de371ac08417 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:51.982680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0b0b2c2b-2420-48f7-9fad-de371ac08417 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:51.984134 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0b0b2c2b-2420-48f7-9fad-de371ac08417 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1358 microversion: 2.21 time: 0.446781 Aug 27 04:43:51.989369 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1464/3015] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:43:51 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1358 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:52.019909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-94af33a8-704c-4f58-bec1-7a2a84aafb09 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f211cdee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:52.227828 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-94af33a8-704c-4f58-bec1-7a2a84aafb09 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images?changes-since=2022-08-27T04%3A41%3A11Z" status: 200 len: 1901 microversion: 2.1 time: 0.224760 Aug 27 04:43:52.229286 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1465/3016] 10.222.0.79 () {58 vars in 1199 bytes} [Sat Aug 27 04:43:52 2022] GET /compute/v2.1/images?changes-since=2022-08-27T04%3A41%3A11Z => generated 1901 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:52.238049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-42195a1a-ed22-4718-aaa2-eb06c6507c88 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:52.239160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-42195a1a-ed22-4718-aaa2-eb06c6507c88 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:52.251176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42195a1a-ed22-4718-aaa2-eb06c6507c88 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:52.252717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42195a1a-ed22-4718-aaa2-eb06c6507c88 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:52.253708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42195a1a-ed22-4718-aaa2-eb06c6507c88 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:52.254947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42195a1a-ed22-4718-aaa2-eb06c6507c88 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:52.255641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42195a1a-ed22-4718-aaa2-eb06c6507c88 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:52.256349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42195a1a-ed22-4718-aaa2-eb06c6507c88 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:52.426630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-42195a1a-ed22-4718-aaa2-eb06c6507c88 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6adda0a01c642158e8399b9e98aa9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb9f678a09d41eea6f3d833841fb7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:52.430873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:52.441849 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-42195a1a-ed22-4718-aaa2-eb06c6507c88 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 200 len: 1504 microversion: 2.1 time: 0.211067 Aug 27 04:43:52.458397 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1466/3017] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:52 2022] GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:52.467971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1156243047", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "fa9d001d-b3bf-4c75-aaaf-2dd93a5532f5"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:52.566797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] validate_networks() for [('fa9d001d-b3bf-4c75-aaaf-2dd93a5532f5', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:43:52.831581 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5a0bd6bd-b038-4e06-9cab-8f07cb984778 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/7ecbe35f-45a2-4953-a6f2-a384ca746f07" status: 202 len: 0 microversion: 2.1 time: 1.295579 Aug 27 04:43:52.835799 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1552/3018] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:43:51 2022] DELETE /compute/v2.1/os-floating-ips/7ecbe35f-45a2-4953-a6f2-a384ca746f07 => generated 0 bytes in 1301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:43:52.838687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1382f7dd-c03b-4c13-845d-0239362059aa tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:52.839679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1382f7dd-c03b-4c13-845d-0239362059aa tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:52.846574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1382f7dd-c03b-4c13-845d-0239362059aa tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:52.847549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1382f7dd-c03b-4c13-845d-0239362059aa tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:52.848340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1382f7dd-c03b-4c13-845d-0239362059aa tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:52.849320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1382f7dd-c03b-4c13-845d-0239362059aa tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:52.850000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1382f7dd-c03b-4c13-845d-0239362059aa tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:52.851199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1382f7dd-c03b-4c13-845d-0239362059aa tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:52.997675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1382f7dd-c03b-4c13-845d-0239362059aa tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:53.006774 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1382f7dd-c03b-4c13-845d-0239362059aa tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 200 len: 1322 microversion: 2.1 time: 0.172861 Aug 27 04:43:53.007369 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1553/3019] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:52 2022] GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:53.015610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-36ecaf79-d3cb-429f-b0f1-cd3565c094ed req-eac77d02-7110-4d0f-8f9a-6a51f674ca4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e6b1d8-56bd-49dd-952f-758425633218", "name": "network-vif-deleted", "tag": "e2dd7cd4-c5d5-4ad2-80a1-6b887249437f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:53.025903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-36ecaf79-d3cb-429f-b0f1-cd3565c094ed req-eac77d02-7110-4d0f-8f9a-6a51f674ca4e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:53.026697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-36ecaf79-d3cb-429f-b0f1-cd3565c094ed req-eac77d02-7110-4d0f-8f9a-6a51f674ca4e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:53.027202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-36ecaf79-d3cb-429f-b0f1-cd3565c094ed req-eac77d02-7110-4d0f-8f9a-6a51f674ca4e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:53.039859 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-36ecaf79-d3cb-429f-b0f1-cd3565c094ed req-eac77d02-7110-4d0f-8f9a-6a51f674ca4e service nova] Creating event network-vif-deleted:e2dd7cd4-c5d5-4ad2-80a1-6b887249437f for instance c0e6b1d8-56bd-49dd-952f-758425633218 on n-h2-854823-1 Aug 27 04:43:53.045252 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-36ecaf79-d3cb-429f-b0f1-cd3565c094ed req-eac77d02-7110-4d0f-8f9a-6a51f674ca4e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034925 Aug 27 04:43:53.045866 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1554/3020] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:53.052558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1e40b60-2075-45c6-a610-46cb738b215d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:53.054360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e1e40b60-2075-45c6-a610-46cb738b215d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:53.061745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1e40b60-2075-45c6-a610-46cb738b215d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:53.062245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1e40b60-2075-45c6-a610-46cb738b215d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:53.062673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1e40b60-2075-45c6-a610-46cb738b215d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:53.063521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1e40b60-2075-45c6-a610-46cb738b215d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:53.064032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1e40b60-2075-45c6-a610-46cb738b215d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:53.064800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1e40b60-2075-45c6-a610-46cb738b215d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:53.080807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:43:53.081396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:43:53.081881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:43:53.082296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:43:53.082712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:43:53.093204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:53.093696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:53.094127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:53.094863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:53.095323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:53.095774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:53.142793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Getting quotas for project b902932050be4c04bca1de4fe268c2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:43:53.146891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:53.148816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e1e40b60-2075-45c6-a610-46cb738b215d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8213929124384914aebc5e05572cc1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b142dea11c4e7d921bbb7dd5e543be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:53.156158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Getting quotas for user 6c59dc5e251943d59de8b2d640643a0e and project b902932050be4c04bca1de4fe268c2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:43:53.157551 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1e40b60-2075-45c6-a610-46cb738b215d tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 200 len: 1458 microversion: 2.1 time: 0.110226 Aug 27 04:43:53.158428 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1555/3021] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:53 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 1458 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:53.164019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-406b9d85-e40b-49f0-8956-653ccf4532c0 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20df5940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:53.216892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:43:53.219344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:43:53.246530 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-406b9d85-e40b-49f0-8956-653ccf4532c0 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1897337048" status: 200 len: 485 microversion: 2.1 time: 0.086722 Aug 27 04:43:53.247726 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1556/3022] 10.222.0.79 () {58 vars in 1231 bytes} [Sat Aug 27 04:43:53 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1897337048 => generated 485 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:53.258569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ecb1bc97-f674-4a6f-92a2-6231dd9f79c8 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] Calling method '.version_select at 0x7f1f20dc10d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:53.276252 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-446c75b2-6992-40fc-a354-9a848f97e991 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815005 Aug 27 04:43:53.283620 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1467/3023] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:43:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:43:53.290915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-667f0d0b-2c3b-4648-9619-3a6db5027bde tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:53.291915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-667f0d0b-2c3b-4648-9619-3a6db5027bde tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:53.298817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-667f0d0b-2c3b-4648-9619-3a6db5027bde tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:53.299422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-667f0d0b-2c3b-4648-9619-3a6db5027bde tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:53.299960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-667f0d0b-2c3b-4648-9619-3a6db5027bde tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:53.300948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-667f0d0b-2c3b-4648-9619-3a6db5027bde tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:53.301662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-667f0d0b-2c3b-4648-9619-3a6db5027bde tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:53.302294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-667f0d0b-2c3b-4648-9619-3a6db5027bde tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:54.013127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-667f0d0b-2c3b-4648-9619-3a6db5027bde tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:54.027316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-667f0d0b-2c3b-4648-9619-3a6db5027bde tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:54.032735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-667f0d0b-2c3b-4648-9619-3a6db5027bde tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:54.035973 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-667f0d0b-2c3b-4648-9619-3a6db5027bde tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1358 microversion: 2.21 time: 0.748424 Aug 27 04:43:54.038766 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1468/3024] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:43:53 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1358 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:54.052717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-18909c7b-2abb-49a7-96a3-1f5ae0651d8f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21a2caf0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:54.228877 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-18909c7b-2abb-49a7-96a3-1f5ae0651d8f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images?server=0e0d6029-a40b-45b9-b230-2033ec88617e" status: 200 len: 956 microversion: 2.1 time: 0.188730 Aug 27 04:43:54.235602 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1469/3025] 10.222.0.79 () {58 vars in 1209 bytes} [Sat Aug 27 04:43:54 2022] GET /compute/v2.1/images?server=0e0d6029-a40b-45b9-b230-2033ec88617e => generated 956 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:54.251642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c93e4cef-c77a-450a-b32f-73ae9bae7568 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:54.254393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c93e4cef-c77a-450a-b32f-73ae9bae7568 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:54.277578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c93e4cef-c77a-450a-b32f-73ae9bae7568 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:54.278086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c93e4cef-c77a-450a-b32f-73ae9bae7568 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:54.280984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c93e4cef-c77a-450a-b32f-73ae9bae7568 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:54.282609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c93e4cef-c77a-450a-b32f-73ae9bae7568 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:54.285546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c93e4cef-c77a-450a-b32f-73ae9bae7568 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:54.287025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c93e4cef-c77a-450a-b32f-73ae9bae7568 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:54.411802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c93e4cef-c77a-450a-b32f-73ae9bae7568 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:54.421498 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c93e4cef-c77a-450a-b32f-73ae9bae7568 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1211 microversion: 2.1 time: 0.184434 Aug 27 04:43:54.422394 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1470/3026] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:54 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1211 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:54.428915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7aad8366-4b50-477a-bbcd-ffff345db4c0 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:54.429816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7aad8366-4b50-477a-bbcd-ffff345db4c0 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:54.437951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aad8366-4b50-477a-bbcd-ffff345db4c0 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:54.438536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aad8366-4b50-477a-bbcd-ffff345db4c0 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:54.439043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aad8366-4b50-477a-bbcd-ffff345db4c0 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:54.439749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aad8366-4b50-477a-bbcd-ffff345db4c0 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:54.440210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aad8366-4b50-477a-bbcd-ffff345db4c0 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:54.440665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aad8366-4b50-477a-bbcd-ffff345db4c0 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:54.664731 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ecb1bc97-f674-4a6f-92a2-6231dd9f79c8 tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/c0f5d4a0-fdd1-4014-9d13-ef1121c4f31c" status: 202 len: 0 microversion: 2.1 time: 1.415707 Aug 27 04:43:54.666406 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1557/3027] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:43:53 2022] DELETE /compute/v2.1/os-floating-ips/c0f5d4a0-fdd1-4014-9d13-ef1121c4f31c => generated 0 bytes in 1418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:43:54.673105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-949c8606-4761-4a6b-8c08-4aea5110f4c9 req-b3012740-e408-4dd0-a883-fa5f00d3e565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0d6029-a40b-45b9-b230-2033ec88617e", "name": "network-vif-unplugged", "status": "completed", "tag": "54e043d1-9346-4c9a-917b-026289b24400"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:54.683207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-949c8606-4761-4a6b-8c08-4aea5110f4c9 req-b3012740-e408-4dd0-a883-fa5f00d3e565 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:54.683781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-949c8606-4761-4a6b-8c08-4aea5110f4c9 req-b3012740-e408-4dd0-a883-fa5f00d3e565 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:54.684279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-949c8606-4761-4a6b-8c08-4aea5110f4c9 req-b3012740-e408-4dd0-a883-fa5f00d3e565 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:54.696731 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-949c8606-4761-4a6b-8c08-4aea5110f4c9 req-b3012740-e408-4dd0-a883-fa5f00d3e565 service nova] Creating event network-vif-unplugged:54e043d1-9346-4c9a-917b-026289b24400 for instance 0e0d6029-a40b-45b9-b230-2033ec88617e on n-h1-854823-1 Aug 27 04:43:54.702026 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-949c8606-4761-4a6b-8c08-4aea5110f4c9 req-b3012740-e408-4dd0-a883-fa5f00d3e565 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033969 Aug 27 04:43:54.703418 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1558/3028] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:54.709007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a506501-832d-4d6b-aed7-50f7dbca3148 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:54.710656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a506501-832d-4d6b-aed7-50f7dbca3148 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:54.717748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a506501-832d-4d6b-aed7-50f7dbca3148 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:54.718314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a506501-832d-4d6b-aed7-50f7dbca3148 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:54.718811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a506501-832d-4d6b-aed7-50f7dbca3148 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:54.719573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a506501-832d-4d6b-aed7-50f7dbca3148 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:54.720092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a506501-832d-4d6b-aed7-50f7dbca3148 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:54.720649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a506501-832d-4d6b-aed7-50f7dbca3148 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:54.810106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7aad8366-4b50-477a-bbcd-ffff345db4c0 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6adda0a01c642158e8399b9e98aa9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb9f678a09d41eea6f3d833841fb7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:54.821606 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7aad8366-4b50-477a-bbcd-ffff345db4c0 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 200 len: 1504 microversion: 2.1 time: 0.397968 Aug 27 04:43:54.822494 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1471/3029] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:54 2022] GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 1504 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:54.830692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1b4f45a0-6a3b-42c0-95db-54ad35c8fb88 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:54.831668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1b4f45a0-6a3b-42c0-95db-54ad35c8fb88 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] [instance: c0e6b1d8-56bd-49dd-952f-758425633218] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:54.840339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b4f45a0-6a3b-42c0-95db-54ad35c8fb88 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:54.841141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b4f45a0-6a3b-42c0-95db-54ad35c8fb88 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:54.842555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b4f45a0-6a3b-42c0-95db-54ad35c8fb88 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:54.843268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b4f45a0-6a3b-42c0-95db-54ad35c8fb88 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:54.844400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b4f45a0-6a3b-42c0-95db-54ad35c8fb88 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:54.846450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b4f45a0-6a3b-42c0-95db-54ad35c8fb88 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:54.864625 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-1b4f45a0-6a3b-42c0-95db-54ad35c8fb88 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] HTTP exception thrown: Instance c0e6b1d8-56bd-49dd-952f-758425633218 could not be found. Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1b4f45a0-6a3b-42c0-95db-54ad35c8fb88 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Request method failure captured: Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 HTTP/1.1 Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ8LYqvzwfoQfgeHMNqSsaekwWA45v9g5RlrI9ATo8z9y2OYq7KiYL9u_hx5gfwZW3-BH-Shkw5I0bkVqz2iU-DLz3hd4UVU3xVjk91TD2FqT5yr74DgplSVuJBxBSijz5gVPvw3civPVzUBDFdZwU_Aaj2hzEH69M9crBZPHeY5f7Q Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 67b142dea11c4e7d921bbb7dd5e543be Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-LiveMigrationTest-600329319 Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67b142dea11c4e7d921bbb7dd5e543be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-LiveMigrationTest-600329319 Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 67b142dea11c4e7d921bbb7dd5e543be Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-LiveMigrationTest-600329319 Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-LiveMigrationTest-600329319-project Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8213929124384914aebc5e05572cc1ed Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-LiveMigrationTest-600329319-project Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance c0e6b1d8-56bd-49dd-952f-758425633218 could not be found. Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'c0e6b1d8-56bd-49dd-952f-758425633218'} Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e6b1d8-56bd-49dd-952f-758425633218 could not be found. Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e6b1d8-56bd-49dd-952f-758425633218 could not be found. Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:54.866954 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:54.870870 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:54.870870 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:54.870870 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:54.870870 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:54.870870 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:54.870870 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e6b1d8-56bd-49dd-952f-758425633218 could not be found. Aug 27 04:43:54.870870 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:54.873550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1b4f45a0-6a3b-42c0-95db-54ad35c8fb88 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] Returning 404 to user: Instance c0e6b1d8-56bd-49dd-952f-758425633218 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:54.874671 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1b4f45a0-6a3b-42c0-95db-54ad35c8fb88 tempest-LiveMigrationTest-600329319 tempest-LiveMigrationTest-600329319-project] 10.222.0.79 "GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218" status: 404 len: 111 microversion: 2.1 time: 0.050751 Aug 27 04:43:54.880987 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1472/3030] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:54 2022] GET /compute/v2.1/servers/c0e6b1d8-56bd-49dd-952f-758425633218 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:54.887321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59356ad5-19d9-440e-b735-9aa81d60b825 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21a2cf70>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:54.895933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1a506501-832d-4d6b-aed7-50f7dbca3148 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:54.900959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:54.906042 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a506501-832d-4d6b-aed7-50f7dbca3148 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 200 len: 1472 microversion: 2.1 time: 0.200973 Aug 27 04:43:54.906625 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1559/3031] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:54 2022] GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 1472 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:54.912768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e5c03a08-e8a4-43db-aa14-9feb3a9d268e tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] Calling method '.version_select at 0x7f1f20df5280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:54.963601 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-59356ad5-19d9-440e-b735-9aa81d60b825 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2F4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 485 microversion: 2.1 time: 0.080380 Aug 27 04:43:54.965160 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1473/3032] 10.222.0.79 () {58 vars in 1317 bytes} [Sat Aug 27 04:43:54 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2F4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 485 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:54.970348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4dac46a0-085d-47a7-84e7-5eb155d2cf82 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:54.971281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4dac46a0-085d-47a7-84e7-5eb155d2cf82 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:54.983450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4dac46a0-085d-47a7-84e7-5eb155d2cf82 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:54.985066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4dac46a0-085d-47a7-84e7-5eb155d2cf82 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:54.985725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4dac46a0-085d-47a7-84e7-5eb155d2cf82 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:54.986803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4dac46a0-085d-47a7-84e7-5eb155d2cf82 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:54.988389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4dac46a0-085d-47a7-84e7-5eb155d2cf82 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:54.988969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4dac46a0-085d-47a7-84e7-5eb155d2cf82 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:55.040150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-4dac46a0-085d-47a7-84e7-5eb155d2cf82 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lazy-loading 'flavor' on Instance uuid 674b2c93-d5f3-4312-87df-f26c8ace2f66 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:43:55.169948 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4dac46a0-085d-47a7-84e7-5eb155d2cf82 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66/action" status: 202 len: 0 microversion: 2.1 time: 0.201311 Aug 27 04:43:55.172381 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1474/3033] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:43:54 2022] POST /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:43:55.182310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0d5fec10-e3aa-4fd6-a6cf-406f3bae6f21 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f2123d700>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:55.261778 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0d5fec10-e3aa-4fd6-a6cf-406f3bae6f21 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2F4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 485 microversion: 2.1 time: 0.086705 Aug 27 04:43:55.264659 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1475/3034] 10.222.0.79 () {58 vars in 1303 bytes} [Sat Aug 27 04:43:55 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2F4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 485 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:55.270467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-14a96aeb-ea59-4e36-9e99-f5dd9abd9c0c tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:55.271534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-14a96aeb-ea59-4e36-9e99-f5dd9abd9c0c tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:55.283660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14a96aeb-ea59-4e36-9e99-f5dd9abd9c0c tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:55.284562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14a96aeb-ea59-4e36-9e99-f5dd9abd9c0c tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:55.285570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14a96aeb-ea59-4e36-9e99-f5dd9abd9c0c tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:55.286821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14a96aeb-ea59-4e36-9e99-f5dd9abd9c0c tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:55.287499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14a96aeb-ea59-4e36-9e99-f5dd9abd9c0c tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:55.289475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14a96aeb-ea59-4e36-9e99-f5dd9abd9c0c tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:55.572179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-14a96aeb-ea59-4e36-9e99-f5dd9abd9c0c tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:55.582753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-14a96aeb-ea59-4e36-9e99-f5dd9abd9c0c tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:55.584553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-14a96aeb-ea59-4e36-9e99-f5dd9abd9c0c tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:55.585776 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-14a96aeb-ea59-4e36-9e99-f5dd9abd9c0c tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1358 microversion: 2.21 time: 0.319833 Aug 27 04:43:55.586597 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1476/3035] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:43:55 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:55.591774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-92352f52-c8a1-431f-bafc-91479fe03c68 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:55.592391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-92352f52-c8a1-431f-bafc-91479fe03c68 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:55.598563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92352f52-c8a1-431f-bafc-91479fe03c68 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:55.599310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92352f52-c8a1-431f-bafc-91479fe03c68 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:55.599986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92352f52-c8a1-431f-bafc-91479fe03c68 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:55.600984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92352f52-c8a1-431f-bafc-91479fe03c68 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:55.601669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92352f52-c8a1-431f-bafc-91479fe03c68 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:55.602313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92352f52-c8a1-431f-bafc-91479fe03c68 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:55.864518 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-92352f52-c8a1-431f-bafc-91479fe03c68 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 200 len: 1631 microversion: 2.1 time: 0.276496 Aug 27 04:43:55.865498 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1477/3036] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:55 2022] GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 1631 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:55.883386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e43a7905-4ff7-4214-ac34-9d2e38c25277 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21228ca0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.016545 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e43a7905-4ff7-4214-ac34-9d2e38c25277 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.149262 Aug 27 04:43:56.017635 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1478/3037] 10.222.0.79 () {58 vars in 1149 bytes} [Sat Aug 27 04:43:55 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:56.023814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-484bb8ea-8237-4527-adb2-bd4ee8acaa24 req-f4401bdf-20a9-4930-b086-a77c4ffc56d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbbf89c1-bdf2-424f-bbb8-fff3ffda5424", "name": "network-vif-deleted", "tag": "56cb120f-702f-4024-94e0-cdc0f4b37758"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:56.035533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-484bb8ea-8237-4527-adb2-bd4ee8acaa24 req-f4401bdf-20a9-4930-b086-a77c4ffc56d1 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.036281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-484bb8ea-8237-4527-adb2-bd4ee8acaa24 req-f4401bdf-20a9-4930-b086-a77c4ffc56d1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.036944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-484bb8ea-8237-4527-adb2-bd4ee8acaa24 req-f4401bdf-20a9-4930-b086-a77c4ffc56d1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.048806 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-484bb8ea-8237-4527-adb2-bd4ee8acaa24 req-f4401bdf-20a9-4930-b086-a77c4ffc56d1 service nova] Creating event network-vif-deleted:56cb120f-702f-4024-94e0-cdc0f4b37758 for instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 on n-h2-854823-1 Aug 27 04:43:56.056247 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-484bb8ea-8237-4527-adb2-bd4ee8acaa24 req-f4401bdf-20a9-4930-b086-a77c4ffc56d1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037090 Aug 27 04:43:56.057306 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1479/3038] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:56.064459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5ff75f6d-6c85-48ad-8c71-df0b0de92336 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.065698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5ff75f6d-6c85-48ad-8c71-df0b0de92336 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:56.073867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ff75f6d-6c85-48ad-8c71-df0b0de92336 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.074730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ff75f6d-6c85-48ad-8c71-df0b0de92336 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.075422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ff75f6d-6c85-48ad-8c71-df0b0de92336 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.076350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ff75f6d-6c85-48ad-8c71-df0b0de92336 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.077184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ff75f6d-6c85-48ad-8c71-df0b0de92336 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.078600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ff75f6d-6c85-48ad-8c71-df0b0de92336 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.203331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5ff75f6d-6c85-48ad-8c71-df0b0de92336 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:56.213106 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5ff75f6d-6c85-48ad-8c71-df0b0de92336 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1273 microversion: 2.1 time: 0.154330 Aug 27 04:43:56.215002 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1480/3039] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:56 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:56.219768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cafed6c5-24ef-4f0c-8dd5-02363ae006f4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.220468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cafed6c5-24ef-4f0c-8dd5-02363ae006f4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:56.226473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cafed6c5-24ef-4f0c-8dd5-02363ae006f4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.227041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cafed6c5-24ef-4f0c-8dd5-02363ae006f4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.227625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cafed6c5-24ef-4f0c-8dd5-02363ae006f4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.228516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cafed6c5-24ef-4f0c-8dd5-02363ae006f4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.229126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cafed6c5-24ef-4f0c-8dd5-02363ae006f4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.229558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cafed6c5-24ef-4f0c-8dd5-02363ae006f4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.244946 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-cafed6c5-24ef-4f0c-8dd5-02363ae006f4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] HTTP exception thrown: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cafed6c5-24ef-4f0c-8dd5-02363ae006f4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Request method failure captured: Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 HTTP/1.1 Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaDh-zWnaeGsM2gXqQrwhLawVyFev3zb93VokikK5L5x91HMjSqu6y_tbKqS3mqGv5CV1RTCkFSRFMDKuls6D3wt7PViQ9s_uE24K4ow6dXfJDPycn1nLPqqDEdarZWOyGpi_rRUsjLkL4mvzp3fTGlbyLJ09Uf4y-LrxNzGsSL6Cxc Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8bb9f678a09d41eea6f3d833841fb7d3 Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8bb9f678a09d41eea6f3d833841fb7d3 Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerGroupTestJSON-857249572-project Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: b6adda0a01c642158e8399b9e98aa9cc Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerGroupTestJSON-857249572-project Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'bbbf89c1-bdf2-424f-bbb8-fff3ffda5424'} Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:56.246597 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.251188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:56.251188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:56.251188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:56.251188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:56.251188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:56.251188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.251188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.251188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cafed6c5-24ef-4f0c-8dd5-02363ae006f4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Returning 404 to user: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:56.251188 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cafed6c5-24ef-4f0c-8dd5-02363ae006f4 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 404 len: 111 microversion: 2.1 time: 0.032508 Aug 27 04:43:56.251188 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1481/3040] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:56 2022] GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:56.253494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c2d8ecd5-9bbd-4a28-8b08-b9f2d06eaf77 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f211cb550>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.324106 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c2d8ecd5-9bbd-4a28-8b08-b9f2d06eaf77 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.074218 Aug 27 04:43:56.324798 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1482/3041] 10.222.0.79 () {58 vars in 1149 bytes} [Sat Aug 27 04:43:56 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:56.329489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d90f8260-f000-4de9-a7bf-11c74152bdbe tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.347327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.compute.server_groups [None req-d90f8260-f000-4de9-a7bf-11c74152bdbe tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Querying cell e7bc291f-2aa3-4d66-a942-e096e031ad4c(cell1) for 1 instances {{(pid=128870) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 04:43:56.348229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d90f8260-f000-4de9-a7bf-11c74152bdbe tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.348759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d90f8260-f000-4de9-a7bf-11c74152bdbe tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.349203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d90f8260-f000-4de9-a7bf-11c74152bdbe tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.359454 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d90f8260-f000-4de9-a7bf-11c74152bdbe tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.033582 Aug 27 04:43:56.360035 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1483/3042] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:43:56 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:56.367229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e50e4062-f784-4610-903b-056c8a346924 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f211cb8b0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.442387 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e50e4062-f784-4610-903b-056c8a346924 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images?limit=1" status: 200 len: 620 microversion: 2.1 time: 0.081167 Aug 27 04:43:56.443109 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1484/3043] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:43:56 2022] GET /compute/v2.1/images?limit=1 => generated 620 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:56.448402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1625e482-07a5-4e6f-b6c3-d35a7fe01fe1 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.462761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.compute.server_groups [None req-1625e482-07a5-4e6f-b6c3-d35a7fe01fe1 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Querying cell e7bc291f-2aa3-4d66-a942-e096e031ad4c(cell1) for 1 instances {{(pid=128870) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 04:43:56.463478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1625e482-07a5-4e6f-b6c3-d35a7fe01fe1 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.463967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1625e482-07a5-4e6f-b6c3-d35a7fe01fe1 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.464409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1625e482-07a5-4e6f-b6c3-d35a7fe01fe1 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.474659 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1625e482-07a5-4e6f-b6c3-d35a7fe01fe1 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/32c1536f-961d-458d-9edc-d2c1e9bd2d5c" status: 200 len: 184 microversion: 2.1 time: 0.030722 Aug 27 04:43:56.475751 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1485/3044] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:43:56 2022] GET /compute/v2.1/os-server-groups/32c1536f-961d-458d-9edc-d2c1e9bd2d5c => generated 184 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:56.480668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c5e289b-8164-435e-9f60-5527dc4f89a4 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f25ec68b0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.563821 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4c5e289b-8164-435e-9f60-5527dc4f89a4 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/detail?changes-since=2022-08-27T04%3A41%3A06Z" status: 200 len: 6332 microversion: 2.1 time: 0.086520 Aug 27 04:43:56.564424 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1486/3045] 10.222.0.79 () {58 vars in 1220 bytes} [Sat Aug 27 04:43:56 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-27T04%3A41%3A06Z => generated 6332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:56.576829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b53b9ccd-91cf-44a1-bcbc-fa9e191a1b91 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.576829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b53b9ccd-91cf-44a1-bcbc-fa9e191a1b91 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:56.576829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b53b9ccd-91cf-44a1-bcbc-fa9e191a1b91 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.576829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b53b9ccd-91cf-44a1-bcbc-fa9e191a1b91 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.576829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b53b9ccd-91cf-44a1-bcbc-fa9e191a1b91 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.577224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b53b9ccd-91cf-44a1-bcbc-fa9e191a1b91 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.577636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b53b9ccd-91cf-44a1-bcbc-fa9e191a1b91 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.578063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b53b9ccd-91cf-44a1-bcbc-fa9e191a1b91 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.592350 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-b53b9ccd-91cf-44a1-bcbc-fa9e191a1b91 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] HTTP exception thrown: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b53b9ccd-91cf-44a1-bcbc-fa9e191a1b91 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Request method failure captured: Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 HTTP/1.1 Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaDh-zWnaeGsM2gXqQrwhLawVyFev3zb93VokikK5L5x91HMjSqu6y_tbKqS3mqGv5CV1RTCkFSRFMDKuls6D3wt7PViQ9s_uE24K4ow6dXfJDPycn1nLPqqDEdarZWOyGpi_rRUsjLkL4mvzp3fTGlbyLJ09Uf4y-LrxNzGsSL6Cxc Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8bb9f678a09d41eea6f3d833841fb7d3 Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8bb9f678a09d41eea6f3d833841fb7d3 Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerGroupTestJSON-857249572-project Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: b6adda0a01c642158e8399b9e98aa9cc Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerGroupTestJSON-857249572-project Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'bbbf89c1-bdf2-424f-bbb8-fff3ffda5424'} Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:43:56.594147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:56.598616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.598616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.598616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:56.598616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.598616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:56.598616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:56.598616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:56.598616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:56.598616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:56.598616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.598616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.598616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b53b9ccd-91cf-44a1-bcbc-fa9e191a1b91 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Returning 404 to user: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:56.598616 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b53b9ccd-91cf-44a1-bcbc-fa9e191a1b91 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 404 len: 111 microversion: 2.1 time: 0.030167 Aug 27 04:43:56.598616 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1487/3046] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:43:56 2022] DELETE /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:56.603802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a6f296ab-c717-469d-a264-74bb70981ab2 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f211cb940>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.648738 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a6f296ab-c717-469d-a264-74bb70981ab2 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1897337048" status: 200 len: 665 microversion: 2.1 time: 0.051581 Aug 27 04:43:56.649469 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1488/3047] 10.222.0.79 () {58 vars in 1252 bytes} [Sat Aug 27 04:43:56 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1897337048 => generated 665 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:56.654613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7db6172-4438-4e2e-b94f-23033e3bdb0a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.654805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c7db6172-4438-4e2e-b94f-23033e3bdb0a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] [instance: bbbf89c1-bdf2-424f-bbb8-fff3ffda5424] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:56.665540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7db6172-4438-4e2e-b94f-23033e3bdb0a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.666136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7db6172-4438-4e2e-b94f-23033e3bdb0a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.666652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7db6172-4438-4e2e-b94f-23033e3bdb0a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.667448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7db6172-4438-4e2e-b94f-23033e3bdb0a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.668127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7db6172-4438-4e2e-b94f-23033e3bdb0a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.668581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7db6172-4438-4e2e-b94f-23033e3bdb0a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.683014 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-c7db6172-4438-4e2e-b94f-23033e3bdb0a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] HTTP exception thrown: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7db6172-4438-4e2e-b94f-23033e3bdb0a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Request method failure captured: Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 HTTP/1.1 Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaDh-zWnaeGsM2gXqQrwhLawVyFev3zb93VokikK5L5x91HMjSqu6y_tbKqS3mqGv5CV1RTCkFSRFMDKuls6D3wt7PViQ9s_uE24K4ow6dXfJDPycn1nLPqqDEdarZWOyGpi_rRUsjLkL4mvzp3fTGlbyLJ09Uf4y-LrxNzGsSL6Cxc Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8bb9f678a09d41eea6f3d833841fb7d3 Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8bb9f678a09d41eea6f3d833841fb7d3 Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerGroupTestJSON-857249572-project Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: b6adda0a01c642158e8399b9e98aa9cc Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerGroupTestJSON-857249572-project Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'bbbf89c1-bdf2-424f-bbb8-fff3ffda5424'} Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:56.684653 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.689199 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:56.689199 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:56.689199 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:56.689199 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:56.689199 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:56.689199 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. Aug 27 04:43:56.689199 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.689199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7db6172-4438-4e2e-b94f-23033e3bdb0a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Returning 404 to user: Instance bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:56.689199 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7db6172-4438-4e2e-b94f-23033e3bdb0a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424" status: 404 len: 111 microversion: 2.1 time: 0.035838 Aug 27 04:43:56.689199 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1489/3048] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:56 2022] GET /compute/v2.1/servers/bbbf89c1-bdf2-424f-bbb8-fff3ffda5424 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:56.691411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4fabf9df-0f99-465a-810a-d25fbad64bf3 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.691838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4fabf9df-0f99-465a-810a-d25fbad64bf3 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:56.697658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fabf9df-0f99-465a-810a-d25fbad64bf3 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.698155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fabf9df-0f99-465a-810a-d25fbad64bf3 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.698580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fabf9df-0f99-465a-810a-d25fbad64bf3 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.699280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fabf9df-0f99-465a-810a-d25fbad64bf3 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.699742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fabf9df-0f99-465a-810a-d25fbad64bf3 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.700161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fabf9df-0f99-465a-810a-d25fbad64bf3 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.837288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4fabf9df-0f99-465a-810a-d25fbad64bf3 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:56.845673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4fabf9df-0f99-465a-810a-d25fbad64bf3 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:56.847097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4fabf9df-0f99-465a-810a-d25fbad64bf3 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:56.848762 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4fabf9df-0f99-465a-810a-d25fbad64bf3 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1358 microversion: 2.21 time: 0.160792 Aug 27 04:43:56.849274 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1490/3049] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:43:56 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:56.853846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-653f3b21-04a0-4377-84df-45b6a1cf4504 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f211cb8b0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.905423 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-653f3b21-04a0-4377-84df-45b6a1cf4504 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2F4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1467 microversion: 2.1 time: 0.055099 Aug 27 04:43:56.906062 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1491/3050] 10.222.0.79 () {58 vars in 1338 bytes} [Sat Aug 27 04:43:56 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2F4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1467 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:56.911972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-01df3569-9277-4d02-8f2e-2541bff063af tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.919876 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-01df3569-9277-4d02-8f2e-2541bff063af tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] HTTP exception thrown: Instance group 0ebe0de0-d572-47aa-a6c4-1fa4a8f44d71 could not be found. Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-01df3569-9277-4d02-8f2e-2541bff063af tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Request method failure captured: Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/os-server-groups/0ebe0de0-d572-47aa-a6c4-1fa4a8f44d71 HTTP/1.1 Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaDh-zWnaeGsM2gXqQrwhLawVyFev3zb93VokikK5L5x91HMjSqu6y_tbKqS3mqGv5CV1RTCkFSRFMDKuls6D3wt7PViQ9s_uE24K4ow6dXfJDPycn1nLPqqDEdarZWOyGpi_rRUsjLkL4mvzp3fTGlbyLJ09Uf4y-LrxNzGsSL6Cxc Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8bb9f678a09d41eea6f3d833841fb7d3 Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8bb9f678a09d41eea6f3d833841fb7d3 Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerGroupTestJSON-857249572-project Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: b6adda0a01c642158e8399b9e98aa9cc Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerGroupTestJSON-857249572-project Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance group 0ebe0de0-d572-47aa-a6c4-1fa4a8f44d71 could not be found. Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '0ebe0de0-d572-47aa-a6c4-1fa4a8f44d71'} Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0ebe0de0-d572-47aa-a6c4-1fa4a8f44d71 could not be found. Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0ebe0de0-d572-47aa-a6c4-1fa4a8f44d71 could not be found. Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.929164 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:56.936757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:56.936757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:56.936757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:56.936757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:56.936757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0ebe0de0-d572-47aa-a6c4-1fa4a8f44d71 could not be found. Aug 27 04:43:56.936757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:56.936757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-01df3569-9277-4d02-8f2e-2541bff063af tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Returning 404 to user: Instance group 0ebe0de0-d572-47aa-a6c4-1fa4a8f44d71 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:56.936757 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-01df3569-9277-4d02-8f2e-2541bff063af tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/0ebe0de0-d572-47aa-a6c4-1fa4a8f44d71" status: 404 len: 117 microversion: 2.1 time: 0.023854 Aug 27 04:43:56.936757 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1492/3051] 10.222.0.79 () {58 vars in 1266 bytes} [Sat Aug 27 04:43:56 2022] DELETE /compute/v2.1/os-server-groups/0ebe0de0-d572-47aa-a6c4-1fa4a8f44d71 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:56.938434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-5f342698-138b-4c61-9468-53383e97a961 req-fbefcb4e-7af6-48c9-9099-8f5ac1e9b270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac000e1e-dc39-4884-96c6-dc414741500d", "name": "network-vif-plugged", "status": "completed", "tag": "f73056e2-3ed0-4906-a4d1-5d817a28be53"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:56.949573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5f342698-138b-4c61-9468-53383e97a961 req-fbefcb4e-7af6-48c9-9099-8f5ac1e9b270 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.950046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5f342698-138b-4c61-9468-53383e97a961 req-fbefcb4e-7af6-48c9-9099-8f5ac1e9b270 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.950475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5f342698-138b-4c61-9468-53383e97a961 req-fbefcb4e-7af6-48c9-9099-8f5ac1e9b270 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.961371 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-5f342698-138b-4c61-9468-53383e97a961 req-fbefcb4e-7af6-48c9-9099-8f5ac1e9b270 service nova] Creating event network-vif-plugged:f73056e2-3ed0-4906-a4d1-5d817a28be53 for instance ac000e1e-dc39-4884-96c6-dc414741500d on n-h2-854823-1 Aug 27 04:43:56.966266 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-5f342698-138b-4c61-9468-53383e97a961 req-fbefcb4e-7af6-48c9-9099-8f5ac1e9b270 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032392 Aug 27 04:43:56.968191 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1493/3052] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:56.973679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ec16c05e-e00d-459b-a87b-120d852190e0 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:56.974372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ec16c05e-e00d-459b-a87b-120d852190e0 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:56.981151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec16c05e-e00d-459b-a87b-120d852190e0 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.981794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec16c05e-e00d-459b-a87b-120d852190e0 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.982061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec16c05e-e00d-459b-a87b-120d852190e0 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:56.982799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec16c05e-e00d-459b-a87b-120d852190e0 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:56.983201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec16c05e-e00d-459b-a87b-120d852190e0 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:56.983624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec16c05e-e00d-459b-a87b-120d852190e0 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:57.181738 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ec16c05e-e00d-459b-a87b-120d852190e0 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 200 len: 1614 microversion: 2.1 time: 0.211470 Aug 27 04:43:57.183733 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1494/3053] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:56 2022] GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 1614 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:57.188640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f13369e-898c-4a35-a34e-65ea25af021d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21228ca0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:57.242032 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4f13369e-898c-4a35-a34e-65ea25af021d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2F4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1467 microversion: 2.1 time: 0.057018 Aug 27 04:43:57.242605 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1495/3054] 10.222.0.79 () {58 vars in 1324 bytes} [Sat Aug 27 04:43:57 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2F4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1467 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:57.247185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-83da5f10-8db9-4669-a226-7323b7243de8 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:57.254945 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-83da5f10-8db9-4669-a226-7323b7243de8 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] HTTP exception thrown: Instance group 236e96f5-4b46-42e8-93ad-1f6b2031af2a could not be found. Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-83da5f10-8db9-4669-a226-7323b7243de8 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Request method failure captured: Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/os-server-groups/236e96f5-4b46-42e8-93ad-1f6b2031af2a HTTP/1.1 Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaDh-zWnaeGsM2gXqQrwhLawVyFev3zb93VokikK5L5x91HMjSqu6y_tbKqS3mqGv5CV1RTCkFSRFMDKuls6D3wt7PViQ9s_uE24K4ow6dXfJDPycn1nLPqqDEdarZWOyGpi_rRUsjLkL4mvzp3fTGlbyLJ09Uf4y-LrxNzGsSL6Cxc Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8bb9f678a09d41eea6f3d833841fb7d3 Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8bb9f678a09d41eea6f3d833841fb7d3 Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerGroupTestJSON-857249572-project Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: b6adda0a01c642158e8399b9e98aa9cc Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerGroupTestJSON-857249572-project Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance group 236e96f5-4b46-42e8-93ad-1f6b2031af2a could not be found. Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '236e96f5-4b46-42e8-93ad-1f6b2031af2a'} Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 236e96f5-4b46-42e8-93ad-1f6b2031af2a could not be found. Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 236e96f5-4b46-42e8-93ad-1f6b2031af2a could not be found. Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.256596 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.260850 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:57.260850 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:57.260850 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:57.260850 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:57.260850 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 236e96f5-4b46-42e8-93ad-1f6b2031af2a could not be found. Aug 27 04:43:57.260850 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.260850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-83da5f10-8db9-4669-a226-7323b7243de8 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Returning 404 to user: Instance group 236e96f5-4b46-42e8-93ad-1f6b2031af2a could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:57.260850 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-83da5f10-8db9-4669-a226-7323b7243de8 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/236e96f5-4b46-42e8-93ad-1f6b2031af2a" status: 404 len: 117 microversion: 2.1 time: 0.014448 Aug 27 04:43:57.260850 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1496/3055] 10.222.0.79 () {58 vars in 1266 bytes} [Sat Aug 27 04:43:57 2022] DELETE /compute/v2.1/os-server-groups/236e96f5-4b46-42e8-93ad-1f6b2031af2a => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:57.265867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5bd02408-a9e4-4053-9b24-47821200efc3 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:57.266439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5bd02408-a9e4-4053-9b24-47821200efc3 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:57.273103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bd02408-a9e4-4053-9b24-47821200efc3 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:57.273592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bd02408-a9e4-4053-9b24-47821200efc3 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:57.274035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bd02408-a9e4-4053-9b24-47821200efc3 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:57.274730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bd02408-a9e4-4053-9b24-47821200efc3 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:57.275198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bd02408-a9e4-4053-9b24-47821200efc3 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:57.275853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bd02408-a9e4-4053-9b24-47821200efc3 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:57.313923 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-5bd02408-a9e4-4053-9b24-47821200efc3 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] HTTP exception thrown: Cannot 'migrate' instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 while it is in vm_state suspended Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5bd02408-a9e4-4053-9b24-47821200efc3 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Request method failure captured: Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66/action HTTP/1.1 Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 15 Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaDIdM_FoUVjSD0JsWSKDVhpVhyzUxqVppm4ddumsEiEtBITz3dCVZb9906xQ9E1-kaZzRUpYZnhsHYpnWOf-P3eJAJNZeK1cO6VCdC7wLclVNxLmeBm1rSzogEPyssjPgQF6T-7FJS9VW-X4YVwhPJJierSIabKCDonVBkMCe0r9hI Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: f859dd00c4e94e9cb5c18532deb7a680 Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: f859dd00c4e94e9cb5c18532deb7a680 Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersAdminNegativeTestJSON-1420917107-project-admin Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 9f1ecec45e8947ec80ca19f2b078fa9c Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1420917107-project-admin Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: {"migrate": {}} Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: exception: Cannot 'migrate' instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 while it is in vm_state suspended Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '674b2c93-d5f3-4312-87df-f26c8ace2f66', 'body': {'migrate': {}}} Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 in vm_state suspended. Cannot resize while the instance is in this state. Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:43:57.315543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 while it is in vm_state suspended Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 while it is in vm_state suspended Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5bd02408-a9e4-4053-9b24-47821200efc3 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Returning 409 to user: Cannot 'migrate' instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 while it is in vm_state suspended {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5bd02408-a9e4-4053-9b24-47821200efc3 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66/action" status: 409 len: 148 microversion: 2.1 time: 0.054656 Aug 27 04:43:57.320099 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1497/3056] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:43:57 2022] POST /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66/action => generated 148 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:43:57.325203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a9aa8265-9b1b-4020-be0a-7d968dd08fb8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:57.325820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a9aa8265-9b1b-4020-be0a-7d968dd08fb8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:57.332288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9aa8265-9b1b-4020-be0a-7d968dd08fb8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:57.332823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9aa8265-9b1b-4020-be0a-7d968dd08fb8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:57.333282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9aa8265-9b1b-4020-be0a-7d968dd08fb8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:57.334145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9aa8265-9b1b-4020-be0a-7d968dd08fb8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:57.334600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9aa8265-9b1b-4020-be0a-7d968dd08fb8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:57.335018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9aa8265-9b1b-4020-be0a-7d968dd08fb8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:57.402057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a9aa8265-9b1b-4020-be0a-7d968dd08fb8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:57.410006 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a9aa8265-9b1b-4020-be0a-7d968dd08fb8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1273 microversion: 2.1 time: 0.091511 Aug 27 04:43:57.410580 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1498/3057] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:57 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:57.415125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae0c102b-85e7-476e-ad31-0fa70a01297d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f213dfb80>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:57.508624 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ae0c102b-85e7-476e-ad31-0fa70a01297d tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.096937 Aug 27 04:43:57.509419 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1499/3058] 10.222.0.79 () {58 vars in 1170 bytes} [Sat Aug 27 04:43:57 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:57.519185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f3cf7f9c-9414-4fb7-bba3-fbb6491b8c79 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:57.527475 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-f3cf7f9c-9414-4fb7-bba3-fbb6491b8c79 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] HTTP exception thrown: Instance group 9b69176f-e1b6-4200-8022-40ba362e3745 could not be found. Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f3cf7f9c-9414-4fb7-bba3-fbb6491b8c79 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Request method failure captured: Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/os-server-groups/9b69176f-e1b6-4200-8022-40ba362e3745 HTTP/1.1 Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaDh-zWnaeGsM2gXqQrwhLawVyFev3zb93VokikK5L5x91HMjSqu6y_tbKqS3mqGv5CV1RTCkFSRFMDKuls6D3wt7PViQ9s_uE24K4ow6dXfJDPycn1nLPqqDEdarZWOyGpi_rRUsjLkL4mvzp3fTGlbyLJ09Uf4y-LrxNzGsSL6Cxc Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8bb9f678a09d41eea6f3d833841fb7d3 Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8bb9f678a09d41eea6f3d833841fb7d3 Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerGroupTestJSON-857249572-project Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: b6adda0a01c642158e8399b9e98aa9cc Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerGroupTestJSON-857249572-project Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance group 9b69176f-e1b6-4200-8022-40ba362e3745 could not be found. Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '9b69176f-e1b6-4200-8022-40ba362e3745'} Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9b69176f-e1b6-4200-8022-40ba362e3745 could not be found. Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9b69176f-e1b6-4200-8022-40ba362e3745 could not be found. Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.529104 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.533085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:57.533085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:57.533085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:57.533085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:57.533085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9b69176f-e1b6-4200-8022-40ba362e3745 could not be found. Aug 27 04:43:57.533085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.533085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f3cf7f9c-9414-4fb7-bba3-fbb6491b8c79 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Returning 404 to user: Instance group 9b69176f-e1b6-4200-8022-40ba362e3745 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:57.533085 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f3cf7f9c-9414-4fb7-bba3-fbb6491b8c79 tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/9b69176f-e1b6-4200-8022-40ba362e3745" status: 404 len: 117 microversion: 2.1 time: 0.016556 Aug 27 04:43:57.534625 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1500/3059] 10.222.0.79 () {58 vars in 1266 bytes} [Sat Aug 27 04:43:57 2022] DELETE /compute/v2.1/os-server-groups/9b69176f-e1b6-4200-8022-40ba362e3745 => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:57.539639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-40d62bc3-2721-439f-9424-c1ea64045a2c tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-40d62bc3-2721-439f-9424-c1ea64045a2c tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Request method failure captured: Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415/action HTTP/1.1 Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 39 Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaDIdM_FoUVjSD0JsWSKDVhpVhyzUxqVppm4ddumsEiEtBITz3dCVZb9906xQ9E1-kaZzRUpYZnhsHYpnWOf-P3eJAJNZeK1cO6VCdC7wLclVNxLmeBm1rSzogEPyssjPgQF6T-7FJS9VW-X4YVwhPJJierSIabKCDonVBkMCe0r9hI Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: f859dd00c4e94e9cb5c18532deb7a680 Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: f859dd00c4e94e9cb5c18532deb7a680 Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersAdminNegativeTestJSON-1420917107-project-admin Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 9f1ecec45e8947ec80ca19f2b078fa9c Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1420917107-project-admin Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: {"os-resetState": {"state": "invalid"}} Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'c82475b2-a407-4da4-afa7-23c2ffc38415', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:43:57.543792 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:43:57.551461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 04:43:57.551461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.551461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:57.551461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.551461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.551461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:57.551461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:57.551461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:43:57.551461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:43:57.551461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 04:43:57.551461 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.551461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-40d62bc3-2721-439f-9424-c1ea64045a2c tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:57.551461 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-40d62bc3-2721-439f-9424-c1ea64045a2c tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415/action" status: 400 len: 144 microversion: 2.1 time: 0.009396 Aug 27 04:43:57.551461 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1501/3060] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:43:57 2022] POST /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415/action => generated 144 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:43:57.553308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2d549621-6bc7-4120-9680-d324b4312759 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f211abca0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:57.619137 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e5c03a08-e8a4-43db-aa14-9feb3a9d268e tempest-FloatingIPDetailsTestJSON-202053159 tempest-FloatingIPDetailsTestJSON-202053159-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/e389fb49-4efd-4d7d-ac47-bca914d5a5dd" status: 202 len: 0 microversion: 2.1 time: 2.711457 Aug 27 04:43:57.620587 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1560/3061] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:43:54 2022] DELETE /compute/v2.1/os-floating-ips/e389fb49-4efd-4d7d-ac47-bca914d5a5dd => generated 0 bytes in 2713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:43:57.622937 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2d549621-6bc7-4120-9680-d324b4312759 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.076154 Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1502/3062] 10.222.0.79 () {58 vars in 1170 bytes} [Sat Aug 27 04:43:57 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-194538fe-ccc6-42e9-a5e5-27bbe5412249 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-194538fe-ccc6-42e9-a5e5-27bbe5412249 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Request method failure captured: Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415/action HTTP/1.1 Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 31 Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaDIdM_FoUVjSD0JsWSKDVhpVhyzUxqVppm4ddumsEiEtBITz3dCVZb9906xQ9E1-kaZzRUpYZnhsHYpnWOf-P3eJAJNZeK1cO6VCdC7wLclVNxLmeBm1rSzogEPyssjPgQF6T-7FJS9VW-X4YVwhPJJierSIabKCDonVBkMCe0r9hI Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: f859dd00c4e94e9cb5c18532deb7a680 Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: f859dd00c4e94e9cb5c18532deb7a680 Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersAdminNegativeTestJSON-1420917107-project-admin Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 9f1ecec45e8947ec80ca19f2b078fa9c Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1420917107-project-admin Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: {"os-resetState": {"state": 1}} Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'c82475b2-a407-4da4-afa7-23c2ffc38415', 'body': {'os-resetState': {'state': 1}}} Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 1 Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:57.635062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-194538fe-ccc6-42e9-a5e5-27bbe5412249 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-194538fe-ccc6-42e9-a5e5-27bbe5412249 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415/action" status: 400 len: 120 microversion: 2.1 time: 0.009906 Aug 27 04:43:57.638764 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1503/3063] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:43:57 2022] POST /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415/action => generated 120 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:43:57.639923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f55989a7-ef27-46bb-91f4-b8b773b3aa2e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f2127cca0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:57.659994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea423558-eedb-4de2-932e-62e2460a410a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:57.669976 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ea423558-eedb-4de2-932e-62e2460a410a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] HTTP exception thrown: Instance group bcbc4b81-97a2-4a6d-9259-478a1a0c8825 could not be found. Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea423558-eedb-4de2-932e-62e2460a410a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Request method failure captured: Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-server-groups/bcbc4b81-97a2-4a6d-9259-478a1a0c8825 HTTP/1.1 Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaDh-zWnaeGsM2gXqQrwhLawVyFev3zb93VokikK5L5x91HMjSqu6y_tbKqS3mqGv5CV1RTCkFSRFMDKuls6D3wt7PViQ9s_uE24K4ow6dXfJDPycn1nLPqqDEdarZWOyGpi_rRUsjLkL4mvzp3fTGlbyLJ09Uf4y-LrxNzGsSL6Cxc Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8bb9f678a09d41eea6f3d833841fb7d3 Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bb9f678a09d41eea6f3d833841fb7d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8bb9f678a09d41eea6f3d833841fb7d3 Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerGroupTestJSON-857249572 Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerGroupTestJSON-857249572-project Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: b6adda0a01c642158e8399b9e98aa9cc Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerGroupTestJSON-857249572-project Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance group bcbc4b81-97a2-4a6d-9259-478a1a0c8825 could not be found. Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'bcbc4b81-97a2-4a6d-9259-478a1a0c8825'} Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group bcbc4b81-97a2-4a6d-9259-478a1a0c8825 could not be found. Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group bcbc4b81-97a2-4a6d-9259-478a1a0c8825 could not be found. Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.673652 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.677720 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:57.677720 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:57.677720 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:57.677720 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:57.677720 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group bcbc4b81-97a2-4a6d-9259-478a1a0c8825 could not be found. Aug 27 04:43:57.677720 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.677720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea423558-eedb-4de2-932e-62e2460a410a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Returning 404 to user: Instance group bcbc4b81-97a2-4a6d-9259-478a1a0c8825 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:57.677720 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea423558-eedb-4de2-932e-62e2460a410a tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/bcbc4b81-97a2-4a6d-9259-478a1a0c8825" status: 404 len: 117 microversion: 2.1 time: 0.053347 Aug 27 04:43:57.680874 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1561/3064] 10.222.0.79 () {58 vars in 1266 bytes} [Sat Aug 27 04:43:57 2022] DELETE /compute/v2.1/os-server-groups/bcbc4b81-97a2-4a6d-9259-478a1a0c8825 => generated 117 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:57.685895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-480873e8-2e29-4db1-98a8-df0fe0e89f80 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:57.688335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-480873e8-2e29-4db1-98a8-df0fe0e89f80 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Failed to fetch instance by id 999 {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 04:43:57.688897 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-480873e8-2e29-4db1-98a8-df0fe0e89f80 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-480873e8-2e29-4db1-98a8-df0fe0e89f80 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Request method failure captured: Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 37 Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaDIdM_FoUVjSD0JsWSKDVhpVhyzUxqVppm4ddumsEiEtBITz3dCVZb9906xQ9E1-kaZzRUpYZnhsHYpnWOf-P3eJAJNZeK1cO6VCdC7wLclVNxLmeBm1rSzogEPyssjPgQF6T-7FJS9VW-X4YVwhPJJierSIabKCDonVBkMCe0r9hI Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: f859dd00c4e94e9cb5c18532deb7a680 Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f859dd00c4e94e9cb5c18532deb7a680"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: f859dd00c4e94e9cb5c18532deb7a680 Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1420917107 Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersAdminNegativeTestJSON-1420917107-project-admin Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 9f1ecec45e8947ec80ca19f2b078fa9c Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1420917107-project-admin Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: {"os-resetState": {"state": "error"}} Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 999 could not be found. Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:43:57.698788 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:43:57.703262 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:43:57.703262 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 27 04:43:57.703262 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:43:57.703262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-480873e8-2e29-4db1-98a8-df0fe0e89f80 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:43:57.703262 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-480873e8-2e29-4db1-98a8-df0fe0e89f80 tempest-ServersAdminNegativeTestJSON-1420917107 tempest-ServersAdminNegativeTestJSON-1420917107-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.019937 Aug 27 04:43:57.706819 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1562/3065] 10.222.0.79 () {60 vars in 1179 bytes} [Sat Aug 27 04:43:57 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:43:57.714241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-011479bd-8a0d-4438-b3ae-13fda3f27dca tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:57.714768 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f55989a7-ef27-46bb-91f4-b8b773b3aa2e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/71228424-9f42-4121-865e-14501cc9b5c0" status: 200 len: 784 microversion: 2.1 time: 0.078306 Aug 27 04:43:57.715682 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1504/3066] 10.222.0.79 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:57 2022] GET /compute/v2.1/images/71228424-9f42-4121-865e-14501cc9b5c0 => generated 784 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:57.720420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-94602f03-9e54-47d9-838d-27c1fe1ccc34 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:57.721026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-94602f03-9e54-47d9-838d-27c1fe1ccc34 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:57.737984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94602f03-9e54-47d9-838d-27c1fe1ccc34 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:57.738622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94602f03-9e54-47d9-838d-27c1fe1ccc34 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:57.739136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94602f03-9e54-47d9-838d-27c1fe1ccc34 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:57.741886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94602f03-9e54-47d9-838d-27c1fe1ccc34 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:57.742426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94602f03-9e54-47d9-838d-27c1fe1ccc34 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:57.742933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94602f03-9e54-47d9-838d-27c1fe1ccc34 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:57.802669 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-011479bd-8a0d-4438-b3ae-13fda3f27dca tempest-ServerGroupTestJSON-857249572 tempest-ServerGroupTestJSON-857249572-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/32c1536f-961d-458d-9edc-d2c1e9bd2d5c" status: 204 len: 0 microversion: 2.1 time: 0.094701 Aug 27 04:43:57.808282 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1563/3067] 10.222.0.79 () {58 vars in 1266 bytes} [Sat Aug 27 04:43:57 2022] DELETE /compute/v2.1/os-server-groups/32c1536f-961d-458d-9edc-d2c1e9bd2d5c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:43:57.811978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-94602f03-9e54-47d9-838d-27c1fe1ccc34 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:43:57.817409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d315cc89-b508-48ec-9b22-d73347dbe4c9 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e71430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:57.870911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:57.888608 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d315cc89-b508-48ec-9b22-d73347dbe4c9 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.078959 Aug 27 04:43:57.894200 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1564/3068] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 04:43:57 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:57.908684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c6c38ae4-be49-4d3d-9946-ddef95dae915 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:57.918974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c6c38ae4-be49-4d3d-9946-ddef95dae915 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:57.932603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c38ae4-be49-4d3d-9946-ddef95dae915 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:57.933415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c38ae4-be49-4d3d-9946-ddef95dae915 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:57.934130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c38ae4-be49-4d3d-9946-ddef95dae915 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:57.935644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c38ae4-be49-4d3d-9946-ddef95dae915 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:57.936370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c38ae4-be49-4d3d-9946-ddef95dae915 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:57.944688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c38ae4-be49-4d3d-9946-ddef95dae915 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:58.040142 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-94602f03-9e54-47d9-838d-27c1fe1ccc34 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "DELETE /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 204 len: 0 microversion: 2.1 time: 0.323121 Aug 27 04:43:58.041372 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1505/3069] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:43:57 2022] DELETE /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:43:58.047462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-17302e57-bbe9-4a50-a04f-903bf8d260d4 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f215588b0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:58.768190 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-17302e57-bbe9-4a50-a04f-903bf8d260d4 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "DELETE /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d" status: 204 len: 0 microversion: 2.1 time: 0.725328 Aug 27 04:43:58.768857 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1506/3070] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:58 2022] DELETE /compute/v2.1/images/377bc6d5-4d7c-4a0c-bd24-6283d668560d => generated 0 bytes in 727 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:43:58.774243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b55c97af-3944-4457-beab-a4605cfe72ef tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:58.774994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b55c97af-3944-4457-beab-a4605cfe72ef tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:58.782724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b55c97af-3944-4457-beab-a4605cfe72ef tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:58.783504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b55c97af-3944-4457-beab-a4605cfe72ef tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:58.784374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b55c97af-3944-4457-beab-a4605cfe72ef tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:58.785522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b55c97af-3944-4457-beab-a4605cfe72ef tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:58.786587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b55c97af-3944-4457-beab-a4605cfe72ef tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:58.788086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b55c97af-3944-4457-beab-a4605cfe72ef tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:58.935479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c6c38ae4-be49-4d3d-9946-ddef95dae915 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:58.945246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c6c38ae4-be49-4d3d-9946-ddef95dae915 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:58.946724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c6c38ae4-be49-4d3d-9946-ddef95dae915 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:58.948363 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c6c38ae4-be49-4d3d-9946-ddef95dae915 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1358 microversion: 2.21 time: 1.052905 Aug 27 04:43:58.949470 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1565/3071] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:43:57 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1358 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:43:58.956544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c57242a-bddc-4fb0-9337-6071c32e2926 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:58.957891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c57242a-bddc-4fb0-9337-6071c32e2926 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:58.971411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c57242a-bddc-4fb0-9337-6071c32e2926 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:58.973176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c57242a-bddc-4fb0-9337-6071c32e2926 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:58.973805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c57242a-bddc-4fb0-9337-6071c32e2926 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:58.976347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c57242a-bddc-4fb0-9337-6071c32e2926 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:58.977663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c57242a-bddc-4fb0-9337-6071c32e2926 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:43:58.978259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c57242a-bddc-4fb0-9337-6071c32e2926 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:43:59.022866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b55c97af-3944-4457-beab-a4605cfe72ef tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:59.037162 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b55c97af-3944-4457-beab-a4605cfe72ef tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 200 len: 1469 microversion: 2.1 time: 0.267137 Aug 27 04:43:59.037848 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1507/3072] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:58 2022] GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 1469 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:59.046372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef985792-5939-4013-b922-3e4b9632d66c tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f2123da60>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:59.686969 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ef985792-5939-4013-b922-3e4b9632d66c tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "DELETE /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071" status: 204 len: 0 microversion: 2.1 time: 0.644787 Aug 27 04:43:59.687546 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1508/3073] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:59 2022] DELETE /compute/v2.1/images/b9c43fff-7488-4ba8-aa7f-93f43a4d7071 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:43:59.698268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e83bf27a-44ec-4779-be30-3672c2b8e122 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f211ea9d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:59.804184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c57242a-bddc-4fb0-9337-6071c32e2926 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:43:59.816798 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c57242a-bddc-4fb0-9337-6071c32e2926 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1315 microversion: 2.1 time: 0.865944 Aug 27 04:43:59.818162 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1566/3074] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:58 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1315 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:43:59.979445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4938f5c6-c333-4832-8a1d-43c48ac97353 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:59.981386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4938f5c6-c333-4832-8a1d-43c48ac97353 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:43:59.997796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4938f5c6-c333-4832-8a1d-43c48ac97353 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:43:59.998821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4938f5c6-c333-4832-8a1d-43c48ac97353 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:00.000260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4938f5c6-c333-4832-8a1d-43c48ac97353 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:00.001752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4938f5c6-c333-4832-8a1d-43c48ac97353 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:00.004210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4938f5c6-c333-4832-8a1d-43c48ac97353 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:00.005989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4938f5c6-c333-4832-8a1d-43c48ac97353 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:00.573492 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e83bf27a-44ec-4779-be30-3672c2b8e122 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "DELETE /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78" status: 204 len: 0 microversion: 2.1 time: 0.881566 Aug 27 04:44:00.574852 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1509/3075] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:43:59 2022] DELETE /compute/v2.1/images/ee697a6c-ead7-431b-b7ac-38a7382a0b78 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:44:00.582510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5a26358f-aeae-489c-a76a-50d968f1a3e1 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:00.583240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5a26358f-aeae-489c-a76a-50d968f1a3e1 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:00.611697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a26358f-aeae-489c-a76a-50d968f1a3e1 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:00.616469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a26358f-aeae-489c-a76a-50d968f1a3e1 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:00.618407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a26358f-aeae-489c-a76a-50d968f1a3e1 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:00.619570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a26358f-aeae-489c-a76a-50d968f1a3e1 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:00.622738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a26358f-aeae-489c-a76a-50d968f1a3e1 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:00.625869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a26358f-aeae-489c-a76a-50d968f1a3e1 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:01.228347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5a26358f-aeae-489c-a76a-50d968f1a3e1 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:01.250284 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5a26358f-aeae-489c-a76a-50d968f1a3e1 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 200 len: 1427 microversion: 2.1 time: 0.673480 Aug 27 04:44:01.251714 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1510/3076] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:00 2022] GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 1427 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:01.260089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-16aa8d0e-9e6c-43ab-9648-ab65eef0ab07 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:01.262119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-16aa8d0e-9e6c-43ab-9648-ab65eef0ab07 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:01.270433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16aa8d0e-9e6c-43ab-9648-ab65eef0ab07 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:01.272011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16aa8d0e-9e6c-43ab-9648-ab65eef0ab07 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:01.273374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16aa8d0e-9e6c-43ab-9648-ab65eef0ab07 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:01.274571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16aa8d0e-9e6c-43ab-9648-ab65eef0ab07 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:01.275353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16aa8d0e-9e6c-43ab-9648-ab65eef0ab07 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:01.277213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16aa8d0e-9e6c-43ab-9648-ab65eef0ab07 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:01.366375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-16aa8d0e-9e6c-43ab-9648-ab65eef0ab07 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:44:01.488468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4938f5c6-c333-4832-8a1d-43c48ac97353 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:01.516015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4938f5c6-c333-4832-8a1d-43c48ac97353 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:01.518284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4938f5c6-c333-4832-8a1d-43c48ac97353 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:01.521231 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4938f5c6-c333-4832-8a1d-43c48ac97353 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1552 microversion: 2.21 time: 1.549649 Aug 27 04:44:01.537139 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1567/3077] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:43:59 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1552 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:44:01.567591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31a3fb73-b1e2-4fd3-ad38-767f772cd8bc tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:01.570597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31a3fb73-b1e2-4fd3-ad38-767f772cd8bc tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:01.580743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a3fb73-b1e2-4fd3-ad38-767f772cd8bc tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:01.581629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a3fb73-b1e2-4fd3-ad38-767f772cd8bc tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:01.583789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a3fb73-b1e2-4fd3-ad38-767f772cd8bc tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:01.584961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a3fb73-b1e2-4fd3-ad38-767f772cd8bc tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:01.585729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a3fb73-b1e2-4fd3-ad38-767f772cd8bc tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:01.586484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a3fb73-b1e2-4fd3-ad38-767f772cd8bc tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:01.603421 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-16aa8d0e-9e6c-43ab-9648-ab65eef0ab07 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 204 len: 0 microversion: 2.1 time: 0.349792 Aug 27 04:44:01.604387 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1511/3078] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:44:01 2022] DELETE /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:44:01.612379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1f420f94-b22f-40b8-aa11-b582027f086a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:01.613044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1f420f94-b22f-40b8-aa11-b582027f086a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:01.628908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f420f94-b22f-40b8-aa11-b582027f086a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:01.630644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f420f94-b22f-40b8-aa11-b582027f086a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:01.631115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f420f94-b22f-40b8-aa11-b582027f086a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:01.638507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f420f94-b22f-40b8-aa11-b582027f086a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:01.639030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f420f94-b22f-40b8-aa11-b582027f086a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:01.639461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f420f94-b22f-40b8-aa11-b582027f086a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:01.689097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1f420f94-b22f-40b8-aa11-b582027f086a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:44:01.800801 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1f420f94-b22f-40b8-aa11-b582027f086a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 204 len: 0 microversion: 2.21 time: 0.194648 Aug 27 04:44:01.801925 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1512/3079] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:44:01 2022] DELETE /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:44:01.808457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e66e868-d217-48bf-a6ea-92195ec1484e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:01.809475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3e66e868-d217-48bf-a6ea-92195ec1484e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:01.816188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e66e868-d217-48bf-a6ea-92195ec1484e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:01.817023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e66e868-d217-48bf-a6ea-92195ec1484e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:01.817780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e66e868-d217-48bf-a6ea-92195ec1484e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:01.819219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e66e868-d217-48bf-a6ea-92195ec1484e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:01.819827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e66e868-d217-48bf-a6ea-92195ec1484e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:01.820439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e66e868-d217-48bf-a6ea-92195ec1484e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:02.048677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3e66e868-d217-48bf-a6ea-92195ec1484e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:02.058641 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3e66e868-d217-48bf-a6ea-92195ec1484e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1474 microversion: 2.1 time: 0.255005 Aug 27 04:44:02.059417 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1513/3080] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:01 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1474 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:02.064470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-b75f78b5-05bf-48ae-99b3-34671ade0096 req-49902067-2679-4067-89ae-865690b62502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674b2c93-d5f3-4312-87df-f26c8ace2f66", "name": "network-vif-deleted", "tag": "7cac15c2-ca33-47d8-ac95-a6e3dec4250c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:02.079983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b75f78b5-05bf-48ae-99b3-34671ade0096 req-49902067-2679-4067-89ae-865690b62502 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:02.081654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b75f78b5-05bf-48ae-99b3-34671ade0096 req-49902067-2679-4067-89ae-865690b62502 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:02.082346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b75f78b5-05bf-48ae-99b3-34671ade0096 req-49902067-2679-4067-89ae-865690b62502 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:02.107313 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b75f78b5-05bf-48ae-99b3-34671ade0096 req-49902067-2679-4067-89ae-865690b62502 service nova] Creating event network-vif-deleted:7cac15c2-ca33-47d8-ac95-a6e3dec4250c for instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 on n-h1-854823-1 Aug 27 04:44:02.113767 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-b75f78b5-05bf-48ae-99b3-34671ade0096 req-49902067-2679-4067-89ae-865690b62502 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052883 Aug 27 04:44:02.114877 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1514/3081] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:02.134578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-161de726-8cb9-4f8b-ad3a-2490dbbb262a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:02.135300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-161de726-8cb9-4f8b-ad3a-2490dbbb262a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:02.143818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-161de726-8cb9-4f8b-ad3a-2490dbbb262a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:02.144421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-161de726-8cb9-4f8b-ad3a-2490dbbb262a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:02.144890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-161de726-8cb9-4f8b-ad3a-2490dbbb262a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:02.145621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-161de726-8cb9-4f8b-ad3a-2490dbbb262a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:02.146243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-161de726-8cb9-4f8b-ad3a-2490dbbb262a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:02.146673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-161de726-8cb9-4f8b-ad3a-2490dbbb262a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:02.464285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-161de726-8cb9-4f8b-ad3a-2490dbbb262a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:02.481072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-161de726-8cb9-4f8b-ad3a-2490dbbb262a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:02.483154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-161de726-8cb9-4f8b-ad3a-2490dbbb262a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:02.486305 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-161de726-8cb9-4f8b-ad3a-2490dbbb262a tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1558 microversion: 2.21 time: 0.369793 Aug 27 04:44:02.491394 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1515/3082] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:44:02 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1558 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:44:02.520405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e395d6fc-3a5b-4c60-998e-bb766188d78c tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:02.521088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e395d6fc-3a5b-4c60-998e-bb766188d78c tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:02.533279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31a3fb73-b1e2-4fd3-ad38-767f772cd8bc tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:02.545447 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31a3fb73-b1e2-4fd3-ad38-767f772cd8bc tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1315 microversion: 2.1 time: 1.006656 Aug 27 04:44:02.550672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e395d6fc-3a5b-4c60-998e-bb766188d78c tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:02.551325 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1568/3083] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:01 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1315 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:02.552713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e395d6fc-3a5b-4c60-998e-bb766188d78c tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:02.553914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e395d6fc-3a5b-4c60-998e-bb766188d78c tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:02.554799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e395d6fc-3a5b-4c60-998e-bb766188d78c tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:02.555422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e395d6fc-3a5b-4c60-998e-bb766188d78c tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:02.556013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e395d6fc-3a5b-4c60-998e-bb766188d78c tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:02.686655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e395d6fc-3a5b-4c60-998e-bb766188d78c tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:02.695432 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e395d6fc-3a5b-4c60-998e-bb766188d78c tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 200 len: 1427 microversion: 2.1 time: 0.202746 Aug 27 04:44:02.696775 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1516/3084] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:02 2022] GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 1427 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:03.086843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac9ef545-13f0-4d19-9ae6-7e77656fafdf tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:03.087473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac9ef545-13f0-4d19-9ae6-7e77656fafdf tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:03.101309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9ef545-13f0-4d19-9ae6-7e77656fafdf tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:03.102632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9ef545-13f0-4d19-9ae6-7e77656fafdf tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:03.106543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9ef545-13f0-4d19-9ae6-7e77656fafdf tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:03.111461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9ef545-13f0-4d19-9ae6-7e77656fafdf tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:03.113152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9ef545-13f0-4d19-9ae6-7e77656fafdf tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:03.113830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9ef545-13f0-4d19-9ae6-7e77656fafdf tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:03.527505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5163867c-6ee5-4505-a735-cc5c9f5fbb4b tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:03.528782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5163867c-6ee5-4505-a735-cc5c9f5fbb4b tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:03.533471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:03.534926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:03.543598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5163867c-6ee5-4505-a735-cc5c9f5fbb4b tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:03.546729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5163867c-6ee5-4505-a735-cc5c9f5fbb4b tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:03.547366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5163867c-6ee5-4505-a735-cc5c9f5fbb4b tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:03.549635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5163867c-6ee5-4505-a735-cc5c9f5fbb4b tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:03.550460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5163867c-6ee5-4505-a735-cc5c9f5fbb4b tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:03.551205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5163867c-6ee5-4505-a735-cc5c9f5fbb4b tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:03.811696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac9ef545-13f0-4d19-9ae6-7e77656fafdf tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:03.828586 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac9ef545-13f0-4d19-9ae6-7e77656fafdf tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1474 microversion: 2.1 time: 0.745962 Aug 27 04:44:03.829409 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1569/3085] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:03 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1474 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:03.837776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bb3f6e73-5c22-4ad5-bb26-84b3fd1aac01 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:03.839208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bb3f6e73-5c22-4ad5-bb26-84b3fd1aac01 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:03.848543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb3f6e73-5c22-4ad5-bb26-84b3fd1aac01 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:03.856585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb3f6e73-5c22-4ad5-bb26-84b3fd1aac01 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:03.857840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb3f6e73-5c22-4ad5-bb26-84b3fd1aac01 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:03.859940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb3f6e73-5c22-4ad5-bb26-84b3fd1aac01 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:03.860774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb3f6e73-5c22-4ad5-bb26-84b3fd1aac01 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:03.862154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb3f6e73-5c22-4ad5-bb26-84b3fd1aac01 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:04.024864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5163867c-6ee5-4505-a735-cc5c9f5fbb4b tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:04.043624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5163867c-6ee5-4505-a735-cc5c9f5fbb4b tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:04.048203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5163867c-6ee5-4505-a735-cc5c9f5fbb4b tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:04.053886 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5163867c-6ee5-4505-a735-cc5c9f5fbb4b tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1558 microversion: 2.21 time: 0.535802 Aug 27 04:44:04.056067 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1517/3086] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:44:03 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1558 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:44:04.061673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0f1cec8-3d43-4c87-b2f8-bbde1dc0dc09 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:04.062739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c0f1cec8-3d43-4c87-b2f8-bbde1dc0dc09 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: 674b2c93-d5f3-4312-87df-f26c8ace2f66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:04.077099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0f1cec8-3d43-4c87-b2f8-bbde1dc0dc09 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:04.077977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0f1cec8-3d43-4c87-b2f8-bbde1dc0dc09 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:04.078701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0f1cec8-3d43-4c87-b2f8-bbde1dc0dc09 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:04.079886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0f1cec8-3d43-4c87-b2f8-bbde1dc0dc09 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:04.081167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0f1cec8-3d43-4c87-b2f8-bbde1dc0dc09 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:04.083175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0f1cec8-3d43-4c87-b2f8-bbde1dc0dc09 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:04.139997 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-c0f1cec8-3d43-4c87-b2f8-bbde1dc0dc09 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] HTTP exception thrown: Instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 could not be found. Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0f1cec8-3d43-4c87-b2f8-bbde1dc0dc09 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Request method failure captured: Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 HTTP/1.1 Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaDG3wLikZK1l7XF5YeTse9F6W6Nmnjx3datj_w59gjheemrsbzXPN68vHp_1cSTQF6SFPpn9qlEKjlYRpNcQ1irDW8d4jdY98CZG8XhAWMd-x7WwthPy_Wun_O6GUGtIF2VfaFpVd5M_iJ0Vh05naPM5meCTnrN6njNOY_DCWNSL3I Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: c901ec7cc4c04a858bca519630b40e8e Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1531733094 Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c901ec7cc4c04a858bca519630b40e8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c901ec7cc4c04a858bca519630b40e8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c901ec7cc4c04a858bca519630b40e8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c901ec7cc4c04a858bca519630b40e8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1531733094 Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: c901ec7cc4c04a858bca519630b40e8e Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1531733094 Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersAdminNegativeTestJSON-1531733094-project Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 66685e0d1c2747ad929b47eec9f55044 Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1531733094-project Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 could not be found. Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '674b2c93-d5f3-4312-87df-f26c8ace2f66'} Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 could not be found. Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 could not be found. Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:04.146887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:04.151498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:04.151498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:04.151498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:04.151498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:04.151498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:04.151498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:04.151498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 could not be found. Aug 27 04:44:04.151498 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:04.152555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0f1cec8-3d43-4c87-b2f8-bbde1dc0dc09 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Returning 404 to user: Instance 674b2c93-d5f3-4312-87df-f26c8ace2f66 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:04.163037 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c0f1cec8-3d43-4c87-b2f8-bbde1dc0dc09 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66" status: 404 len: 111 microversion: 2.1 time: 0.096052 Aug 27 04:44:04.171364 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1518/3087] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:04 2022] GET /compute/v2.1/servers/674b2c93-d5f3-4312-87df-f26c8ace2f66 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:04.204809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d4076805-a6ff-4549-aba9-90bb68618dcd tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:04.207166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d4076805-a6ff-4549-aba9-90bb68618dcd tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:04.223213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4076805-a6ff-4549-aba9-90bb68618dcd tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:04.225564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4076805-a6ff-4549-aba9-90bb68618dcd tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:04.230857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4076805-a6ff-4549-aba9-90bb68618dcd tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:04.232296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4076805-a6ff-4549-aba9-90bb68618dcd tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:04.233080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4076805-a6ff-4549-aba9-90bb68618dcd tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:04.233624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4076805-a6ff-4549-aba9-90bb68618dcd tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:04.344179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d4076805-a6ff-4549-aba9-90bb68618dcd tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:44:04.438597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bb3f6e73-5c22-4ad5-bb26-84b3fd1aac01 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:04.450400 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bb3f6e73-5c22-4ad5-bb26-84b3fd1aac01 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1315 microversion: 2.1 time: 0.618916 Aug 27 04:44:04.451632 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1570/3088] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:03 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:04.463301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a3faea08-82b0-4b8d-a7f6-c5337674c256 req-722700e0-1d72-40b8-aeec-9db960d6e516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0778ea23-5cf7-420f-94d9-4f43f79bf8bf", "tag": "cd347df0-5318-4354-83d7-2fe855526129"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:04.514926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:04.527444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a3faea08-82b0-4b8d-a7f6-c5337674c256 req-722700e0-1d72-40b8-aeec-9db960d6e516 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:04.528310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a3faea08-82b0-4b8d-a7f6-c5337674c256 req-722700e0-1d72-40b8-aeec-9db960d6e516 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:04.528975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a3faea08-82b0-4b8d-a7f6-c5337674c256 req-722700e0-1d72-40b8-aeec-9db960d6e516 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:04.562472 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a3faea08-82b0-4b8d-a7f6-c5337674c256 req-722700e0-1d72-40b8-aeec-9db960d6e516 service nova] Creating event network-changed:cd347df0-5318-4354-83d7-2fe855526129 for instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf on n-h2-854823-1 Aug 27 04:44:04.567935 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a3faea08-82b0-4b8d-a7f6-c5337674c256 req-722700e0-1d72-40b8-aeec-9db960d6e516 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114798 Aug 27 04:44:04.572462 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1571/3089] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:04.581018 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d4076805-a6ff-4549-aba9-90bb68618dcd tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 204 len: 0 microversion: 2.1 time: 0.406653 Aug 27 04:44:04.582540 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1519/3090] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:44:04 2022] DELETE /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:44:04.593049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5f77ce4-cda9-4f30-823f-e09289870562 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:04.595498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5f77ce4-cda9-4f30-823f-e09289870562 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:04.605990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f77ce4-cda9-4f30-823f-e09289870562 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:04.606802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f77ce4-cda9-4f30-823f-e09289870562 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:04.607526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f77ce4-cda9-4f30-823f-e09289870562 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:04.609557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f77ce4-cda9-4f30-823f-e09289870562 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:04.610259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f77ce4-cda9-4f30-823f-e09289870562 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:04.613402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f77ce4-cda9-4f30-823f-e09289870562 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:04.680010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-41c77c69-8836-4d56-91dd-63272d1e53ad req-5a6408f1-c1e2-4d2c-a6d3-8435c5b63912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac000e1e-dc39-4884-96c6-dc414741500d", "name": "network-vif-deleted", "tag": "f73056e2-3ed0-4906-a4d1-5d817a28be53"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:04.726198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-41c77c69-8836-4d56-91dd-63272d1e53ad req-5a6408f1-c1e2-4d2c-a6d3-8435c5b63912 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:04.727389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-41c77c69-8836-4d56-91dd-63272d1e53ad req-5a6408f1-c1e2-4d2c-a6d3-8435c5b63912 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:04.730186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-41c77c69-8836-4d56-91dd-63272d1e53ad req-5a6408f1-c1e2-4d2c-a6d3-8435c5b63912 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:04.774813 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-41c77c69-8836-4d56-91dd-63272d1e53ad req-5a6408f1-c1e2-4d2c-a6d3-8435c5b63912 service nova] Creating event network-vif-deleted:f73056e2-3ed0-4906-a4d1-5d817a28be53 for instance ac000e1e-dc39-4884-96c6-dc414741500d on n-h2-854823-1 Aug 27 04:44:04.787946 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-41c77c69-8836-4d56-91dd-63272d1e53ad req-5a6408f1-c1e2-4d2c-a6d3-8435c5b63912 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113345 Aug 27 04:44:04.797876 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1520/3091] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:04.856247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2bc8eef1-48bd-4457-a7a3-6a30a08dda2e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:04.857046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2bc8eef1-48bd-4457-a7a3-6a30a08dda2e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:04.868629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bc8eef1-48bd-4457-a7a3-6a30a08dda2e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:04.876640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bc8eef1-48bd-4457-a7a3-6a30a08dda2e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:04.877456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bc8eef1-48bd-4457-a7a3-6a30a08dda2e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:04.878486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bc8eef1-48bd-4457-a7a3-6a30a08dda2e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:04.879170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bc8eef1-48bd-4457-a7a3-6a30a08dda2e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:04.879840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bc8eef1-48bd-4457-a7a3-6a30a08dda2e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:04.884711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:05.248262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2bc8eef1-48bd-4457-a7a3-6a30a08dda2e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:05.266978 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2bc8eef1-48bd-4457-a7a3-6a30a08dda2e tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1474 microversion: 2.1 time: 0.414780 Aug 27 04:44:05.276577 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1521/3092] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:04 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1474 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:05.303417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-275dac00-04ae-47a5-bb5c-41116f3e42d2 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:05.308693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-275dac00-04ae-47a5-bb5c-41116f3e42d2 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:05.326664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-275dac00-04ae-47a5-bb5c-41116f3e42d2 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:05.327461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-275dac00-04ae-47a5-bb5c-41116f3e42d2 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:05.329315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-275dac00-04ae-47a5-bb5c-41116f3e42d2 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:05.330167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-275dac00-04ae-47a5-bb5c-41116f3e42d2 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:05.330861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-275dac00-04ae-47a5-bb5c-41116f3e42d2 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:05.331538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-275dac00-04ae-47a5-bb5c-41116f3e42d2 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:05.476079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-275dac00-04ae-47a5-bb5c-41116f3e42d2 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:05.491300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-275dac00-04ae-47a5-bb5c-41116f3e42d2 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:05.493206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-275dac00-04ae-47a5-bb5c-41116f3e42d2 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:05.494667 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-275dac00-04ae-47a5-bb5c-41116f3e42d2 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1516 microversion: 2.21 time: 0.225360 Aug 27 04:44:05.497698 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1522/3093] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:44:05 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1516 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:44:05.503129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-47ef98e9-46e3-463b-8f26-5ad949e1cd48 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:05.504110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-47ef98e9-46e3-463b-8f26-5ad949e1cd48 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:05.511727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47ef98e9-46e3-463b-8f26-5ad949e1cd48 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:05.512446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47ef98e9-46e3-463b-8f26-5ad949e1cd48 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:05.513092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47ef98e9-46e3-463b-8f26-5ad949e1cd48 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:05.513959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47ef98e9-46e3-463b-8f26-5ad949e1cd48 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:05.514629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47ef98e9-46e3-463b-8f26-5ad949e1cd48 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:05.516751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47ef98e9-46e3-463b-8f26-5ad949e1cd48 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:05.729094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f5f77ce4-cda9-4f30-823f-e09289870562 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:05.744628 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5f77ce4-cda9-4f30-823f-e09289870562 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1477 microversion: 2.1 time: 1.155351 Aug 27 04:44:05.746151 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1572/3094] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:04 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1477 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:05.858992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-47ef98e9-46e3-463b-8f26-5ad949e1cd48 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:05.867670 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-47ef98e9-46e3-463b-8f26-5ad949e1cd48 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1315 microversion: 2.1 time: 0.368646 Aug 27 04:44:05.881742 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1523/3095] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:05 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:05.956114 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-206678eb-51fa-45ab-b1eb-7be28110b7f1 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] 10.222.0.79 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.208349 Aug 27 04:44:05.957284 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1573/3096] 10.222.0.79 () {58 vars in 1128 bytes} [Sat Aug 27 04:44:05 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 04:44:05.968622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9061a462-bc5d-471e-bdd5-58a91950b3e1 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Calling method '.version_select at 0x7f1f211cb160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:06.007518 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-9061a462-bc5d-471e-bdd5-58a91950b3e1 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] HTTP exception thrown: Image not found. Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9061a462-bc5d-471e-bdd5-58a91950b3e1 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Request method failure captured: Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaEVNBGr4derfGbRb0jbsMRFB5aimj2rF8xQoBDA7VtMOmlmmMxHY_JcP1o7qddnF2YDmLe4EeelsUmvdr3nb7-W9XQ_KAxDIaDuNuvAbvaVFMUJK1xkuyzCkkVYOOemvnBbeq-XJagenD9EON-lfrzp1S_dyC6KzS0p15HqPNpGDqk Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 2dee4c7bc11a44949a415486af110c40 Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2dee4c7bc11a44949a415486af110c40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 2dee4c7bc11a44949a415486af110c40 Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesDeleteNegativeTestJSON-1460651472-project Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 809d11e1330d4eda8e3ad5605d0d04c5 Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472-project Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: exception: Image not found. Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '-1'} Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.009748 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9061a462-bc5d-471e-bdd5-58a91950b3e1 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Returning 404 to user: Image not found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:06.014561 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9061a462-bc5d-471e-bdd5-58a91950b3e1 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] 10.222.0.79 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.047952 Aug 27 04:44:06.016190 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1524/3097] 10.222.0.79 () {58 vars in 1134 bytes} [Sat Aug 27 04:44:05 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:44:06.023964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25b58310-41e6-438c-91ab-ad12441f5d54 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Calling method '.version_select at 0x7f1f20e5a550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:06.070467 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-25b58310-41e6-438c-91ab-ad12441f5d54 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] HTTP exception thrown: Image not found. Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25b58310-41e6-438c-91ab-ad12441f5d54 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Request method failure captured: Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/images/55181412-9bbd-4fc1-992b-75f3d7413c8j HTTP/1.1 Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaEVNBGr4derfGbRb0jbsMRFB5aimj2rF8xQoBDA7VtMOmlmmMxHY_JcP1o7qddnF2YDmLe4EeelsUmvdr3nb7-W9XQ_KAxDIaDuNuvAbvaVFMUJK1xkuyzCkkVYOOemvnBbeq-XJagenD9EON-lfrzp1S_dyC6KzS0p15HqPNpGDqk Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 2dee4c7bc11a44949a415486af110c40 Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2dee4c7bc11a44949a415486af110c40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 2dee4c7bc11a44949a415486af110c40 Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesDeleteNegativeTestJSON-1460651472-project Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 809d11e1330d4eda8e3ad5605d0d04c5 Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472-project Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: exception: Image not found. Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '55181412-9bbd-4fc1-992b-75f3d7413c8j'} Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 55181412-9bbd-4fc1-992b-75f3d7413c8j to delete Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 55181412-9bbd-4fc1-992b-75f3d7413c8j could not be found. Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.073208 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25b58310-41e6-438c-91ab-ad12441f5d54 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:06.077371 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25b58310-41e6-438c-91ab-ad12441f5d54 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] 10.222.0.79 "DELETE /compute/v2.1/images/55181412-9bbd-4fc1-992b-75f3d7413c8j" status: 404 len: 62 microversion: 2.1 time: 0.055117 Aug 27 04:44:06.089551 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1574/3098] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:06 2022] DELETE /compute/v2.1/images/55181412-9bbd-4fc1-992b-75f3d7413c8j => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:44:06.091783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-29feed12-bdde-43df-8a5e-522805826537 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Calling method '.version_select at 0x7f1f2116caf0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:06.168262 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-29feed12-bdde-43df-8a5e-522805826537 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] HTTP exception thrown: Image not found. Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-29feed12-bdde-43df-8a5e-522805826537 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Request method failure captured: Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/images/e7643df3-745a-4d51-a9ac-33dc172517701 HTTP/1.1 Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaEVNBGr4derfGbRb0jbsMRFB5aimj2rF8xQoBDA7VtMOmlmmMxHY_JcP1o7qddnF2YDmLe4EeelsUmvdr3nb7-W9XQ_KAxDIaDuNuvAbvaVFMUJK1xkuyzCkkVYOOemvnBbeq-XJagenD9EON-lfrzp1S_dyC6KzS0p15HqPNpGDqk Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 2dee4c7bc11a44949a415486af110c40 Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2dee4c7bc11a44949a415486af110c40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 2dee4c7bc11a44949a415486af110c40 Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesDeleteNegativeTestJSON-1460651472-project Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 809d11e1330d4eda8e3ad5605d0d04c5 Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472-project Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: exception: Image not found. Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'e7643df3-745a-4d51-a9ac-33dc172517701'} Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e7643df3-745a-4d51-a9ac-33dc172517701 to delete Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e7643df3-745a-4d51-a9ac-33dc172517701 could not be found. Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.174669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-29feed12-bdde-43df-8a5e-522805826537 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Returning 404 to user: Image not found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:06.180398 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-29feed12-bdde-43df-8a5e-522805826537 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] 10.222.0.79 "DELETE /compute/v2.1/images/e7643df3-745a-4d51-a9ac-33dc172517701" status: 404 len: 62 microversion: 2.1 time: 0.094527 Aug 27 04:44:06.193486 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1525/3099] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:44:06 2022] DELETE /compute/v2.1/images/e7643df3-745a-4d51-a9ac-33dc172517701 => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:44:06.210688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c486e12-06f6-4bd9-bac4-8babd38d9ca7 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Calling method '.version_select at 0x7f1f20f523a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:06.275801 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-2c486e12-06f6-4bd9-bac4-8babd38d9ca7 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] HTTP exception thrown: Image not found. Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c486e12-06f6-4bd9-bac4-8babd38d9ca7 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Request method failure captured: Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/images/tempest-invalid-1952258366 HTTP/1.1 Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaEVNBGr4derfGbRb0jbsMRFB5aimj2rF8xQoBDA7VtMOmlmmMxHY_JcP1o7qddnF2YDmLe4EeelsUmvdr3nb7-W9XQ_KAxDIaDuNuvAbvaVFMUJK1xkuyzCkkVYOOemvnBbeq-XJagenD9EON-lfrzp1S_dyC6KzS0p15HqPNpGDqk Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 2dee4c7bc11a44949a415486af110c40 Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2dee4c7bc11a44949a415486af110c40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 2dee4c7bc11a44949a415486af110c40 Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesDeleteNegativeTestJSON-1460651472-project Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 809d11e1330d4eda8e3ad5605d0d04c5 Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472-project Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: exception: Image not found. Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'tempest-invalid-1952258366'} Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1952258366 to delete Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1952258366 could not be found. Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.278419 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c486e12-06f6-4bd9-bac4-8babd38d9ca7 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:06.283266 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c486e12-06f6-4bd9-bac4-8babd38d9ca7 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] 10.222.0.79 "DELETE /compute/v2.1/images/tempest-invalid-1952258366" status: 404 len: 62 microversion: 2.1 time: 0.089207 Aug 27 04:44:06.289098 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1575/3100] 10.222.0.79 () {58 vars in 1206 bytes} [Sat Aug 27 04:44:06 2022] DELETE /compute/v2.1/images/tempest-invalid-1952258366 => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:44:06.292815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5f0e667a-08f5-4f73-8c97-c7373b7313d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:06.293436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5f0e667a-08f5-4f73-8c97-c7373b7313d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:06.306277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d20a3e66-1a57-4fef-ba38-a8e139ee0ba9 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Calling method '.version_select at 0x7f1f21a0bf70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:06.306486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f0e667a-08f5-4f73-8c97-c7373b7313d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:06.308010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f0e667a-08f5-4f73-8c97-c7373b7313d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:06.308480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f0e667a-08f5-4f73-8c97-c7373b7313d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:06.310500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f0e667a-08f5-4f73-8c97-c7373b7313d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:06.312087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f0e667a-08f5-4f73-8c97-c7373b7313d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:06.312813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f0e667a-08f5-4f73-8c97-c7373b7313d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:06.340448 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d20a3e66-1a57-4fef-ba38-a8e139ee0ba9 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] HTTP exception thrown: Image not found. Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d20a3e66-1a57-4fef-ba38-a8e139ee0ba9 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Request method failure captured: Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/images/e375743f-9809-4f82-8994-1d80bd1fd36d HTTP/1.1 Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaEVNBGr4derfGbRb0jbsMRFB5aimj2rF8xQoBDA7VtMOmlmmMxHY_JcP1o7qddnF2YDmLe4EeelsUmvdr3nb7-W9XQ_KAxDIaDuNuvAbvaVFMUJK1xkuyzCkkVYOOemvnBbeq-XJagenD9EON-lfrzp1S_dyC6KzS0p15HqPNpGDqk Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 2dee4c7bc11a44949a415486af110c40 Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2dee4c7bc11a44949a415486af110c40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2dee4c7bc11a44949a415486af110c40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 2dee4c7bc11a44949a415486af110c40 Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472 Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesDeleteNegativeTestJSON-1460651472-project Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 809d11e1330d4eda8e3ad5605d0d04c5 Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1460651472-project Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: exception: Image not found. Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'e375743f-9809-4f82-8994-1d80bd1fd36d'} Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e375743f-9809-4f82-8994-1d80bd1fd36d to delete Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e375743f-9809-4f82-8994-1d80bd1fd36d could not be found. Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.342508 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:44:06.346828 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:06.351468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d20a3e66-1a57-4fef-ba38-a8e139ee0ba9 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:06.352775 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d20a3e66-1a57-4fef-ba38-a8e139ee0ba9 tempest-ImagesDeleteNegativeTestJSON-1460651472 tempest-ImagesDeleteNegativeTestJSON-1460651472-project] 10.222.0.79 "DELETE /compute/v2.1/images/e375743f-9809-4f82-8994-1d80bd1fd36d" status: 404 len: 62 microversion: 2.1 time: 0.062071 Aug 27 04:44:06.353561 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1576/3101] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:06 2022] DELETE /compute/v2.1/images/e375743f-9809-4f82-8994-1d80bd1fd36d => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:44:06.427258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f0e667a-08f5-4f73-8c97-c7373b7313d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:06.427760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f0e667a-08f5-4f73-8c97-c7373b7313d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:06.428404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f0e667a-08f5-4f73-8c97-c7373b7313d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:06.433333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-5f0e667a-08f5-4f73-8c97-c7373b7313d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lazy-loading 'fault' on Instance uuid 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:44:06.520469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:06.521115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:06.527623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5f0e667a-08f5-4f73-8c97-c7373b7313d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:06.534293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:06.535037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:06.535669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:06.538454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:06.539962 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5f0e667a-08f5-4f73-8c97-c7373b7313d3 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 200 len: 1308 microversion: 2.1 time: 0.251112 Aug 27 04:44:06.540245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:06.540790 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1526/3102] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:06 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:44:06.541676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:06.604191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:06.606055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:06.606884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:06.607905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lazy-loading 'fault' on Instance uuid ac000e1e-dc39-4884-96c6-dc414741500d {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:44:06.652727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-5503714d-d939-4061-8ed8-b6569831e1e2 req-e6efd483-a988-4e14-bccb-a54b5d79d47b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3", "name": "network-vif-deleted", "tag": "06142979-93d1-48a2-a72f-11b13cbb0e03"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:06.670204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5503714d-d939-4061-8ed8-b6569831e1e2 req-e6efd483-a988-4e14-bccb-a54b5d79d47b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:06.672141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5503714d-d939-4061-8ed8-b6569831e1e2 req-e6efd483-a988-4e14-bccb-a54b5d79d47b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:06.674053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5503714d-d939-4061-8ed8-b6569831e1e2 req-e6efd483-a988-4e14-bccb-a54b5d79d47b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:06.690748 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-5503714d-d939-4061-8ed8-b6569831e1e2 req-e6efd483-a988-4e14-bccb-a54b5d79d47b service nova] Creating event network-vif-deleted:06142979-93d1-48a2-a72f-11b13cbb0e03 for instance 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 on n-h1-854823-1 Aug 27 04:44:06.696624 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-5503714d-d939-4061-8ed8-b6569831e1e2 req-e6efd483-a988-4e14-bccb-a54b5d79d47b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048002 Aug 27 04:44:06.697842 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1527/3103] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:44:06.775007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-088da25f-78da-4f9b-9fc6-2ff558a25021 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:06.776661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-088da25f-78da-4f9b-9fc6-2ff558a25021 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:06.799178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-088da25f-78da-4f9b-9fc6-2ff558a25021 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:06.800585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-088da25f-78da-4f9b-9fc6-2ff558a25021 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:06.801529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-088da25f-78da-4f9b-9fc6-2ff558a25021 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:06.802715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-088da25f-78da-4f9b-9fc6-2ff558a25021 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:06.804041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-088da25f-78da-4f9b-9fc6-2ff558a25021 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:06.805059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-088da25f-78da-4f9b-9fc6-2ff558a25021 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:06.876615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:06.888782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:06.890243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97689789f62c484e96e1f14037a8bd31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92968abec17a4879bffad84cc55b3a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:06.894179 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63e0b063-5c23-4c60-bc45-ffeff7bb9565 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 200 len: 1348 microversion: 2.21 time: 0.378738 Aug 27 04:44:06.898578 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1577/3104] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:44:06 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 1348 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:44:06.904426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12830d3b-701c-4a9c-aded-bd7306050bb3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:06.907402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12830d3b-701c-4a9c-aded-bd7306050bb3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:06.921551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12830d3b-701c-4a9c-aded-bd7306050bb3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:06.922164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12830d3b-701c-4a9c-aded-bd7306050bb3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:06.922688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12830d3b-701c-4a9c-aded-bd7306050bb3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:06.925938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12830d3b-701c-4a9c-aded-bd7306050bb3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:06.926431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12830d3b-701c-4a9c-aded-bd7306050bb3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:06.926870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12830d3b-701c-4a9c-aded-bd7306050bb3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:07.102479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-088da25f-78da-4f9b-9fc6-2ff558a25021 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:07.111159 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-088da25f-78da-4f9b-9fc6-2ff558a25021 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1477 microversion: 2.1 time: 0.345589 Aug 27 04:44:07.112741 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1528/3105] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:06 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1477 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:07.563716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6cc0d379-225c-4e47-a019-6c1778f23f9f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:07.565359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6cc0d379-225c-4e47-a019-6c1778f23f9f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:07.572452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6cc0d379-225c-4e47-a019-6c1778f23f9f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:07.573215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6cc0d379-225c-4e47-a019-6c1778f23f9f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:07.573897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6cc0d379-225c-4e47-a019-6c1778f23f9f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:07.574863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6cc0d379-225c-4e47-a019-6c1778f23f9f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:07.575834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6cc0d379-225c-4e47-a019-6c1778f23f9f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:07.576617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6cc0d379-225c-4e47-a019-6c1778f23f9f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:07.592972 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-6cc0d379-225c-4e47-a019-6c1778f23f9f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] HTTP exception thrown: Instance 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 could not be found. Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6cc0d379-225c-4e47-a019-6c1778f23f9f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Request method failure captured: Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 HTTP/1.1 Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaBhoymFzIsUZpi4Vcu5TWK6UCOq8y4em7Fp9d1k-278Zx9qt44U6ACYMKOYQUI3lrmWD0nOMl4ZnjL31ImdVyegUS590NnRnCabBT-xFMGniICB-K7xXDz-an0P769RX_NFHYlx5H1D6I8hYMJ3_ziqq6hFQkG83lBRZLe6bdPiFdU Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 0f7dc74b8c2542c89421611c9ded66e1 Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ListImageFiltersTestJSON-1848891985 Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0f7dc74b8c2542c89421611c9ded66e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0f7dc74b8c2542c89421611c9ded66e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0f7dc74b8c2542c89421611c9ded66e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0f7dc74b8c2542c89421611c9ded66e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ListImageFiltersTestJSON-1848891985 Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 0f7dc74b8c2542c89421611c9ded66e1 Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1848891985 Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ListImageFiltersTestJSON-1848891985-project Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 346cf8d02f204e42b7da064228fe678c Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ListImageFiltersTestJSON-1848891985-project Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 could not be found. Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3'} Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 could not be found. Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 could not be found. Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:07.595321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:07.599216 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:07.599216 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:07.599216 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:07.599216 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:07.599216 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:07.599216 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 could not be found. Aug 27 04:44:07.599216 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:07.603119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6cc0d379-225c-4e47-a019-6c1778f23f9f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Returning 404 to user: Instance 4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:07.604307 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6cc0d379-225c-4e47-a019-6c1778f23f9f tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3" status: 404 len: 111 microversion: 2.1 time: 0.045484 Aug 27 04:44:07.608388 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1529/3106] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:07 2022] GET /compute/v2.1/servers/4ac4ba9f-9c8e-4b92-99d5-e5b3219480d3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:44:07.614577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-290b5738-596d-40c2-82d2-7934864eee1a tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:07.615373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-290b5738-596d-40c2-82d2-7934864eee1a tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 0e0d6029-a40b-45b9-b230-2033ec88617e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:07.625361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-290b5738-596d-40c2-82d2-7934864eee1a tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:07.626119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-290b5738-596d-40c2-82d2-7934864eee1a tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:07.626988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-290b5738-596d-40c2-82d2-7934864eee1a tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:07.628730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-290b5738-596d-40c2-82d2-7934864eee1a tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:07.629665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-290b5738-596d-40c2-82d2-7934864eee1a tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:07.630298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-290b5738-596d-40c2-82d2-7934864eee1a tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:07.661079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-290b5738-596d-40c2-82d2-7934864eee1a tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 0e0d6029-a40b-45b9-b230-2033ec88617e] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:44:07.716053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-12830d3b-701c-4a9c-aded-bd7306050bb3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:07.765809 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12830d3b-701c-4a9c-aded-bd7306050bb3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1315 microversion: 2.1 time: 0.848105 Aug 27 04:44:07.786879 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-290b5738-596d-40c2-82d2-7934864eee1a tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e" status: 204 len: 0 microversion: 2.1 time: 0.175663 Aug 27 04:44:07.788471 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1530/3108] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:44:07 2022] DELETE /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:44:07.790055 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1578/3107] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:06 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1315 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:07.814137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9a55471c-5a83-4662-b298-c78a948fde99 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:07.815198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9a55471c-5a83-4662-b298-c78a948fde99 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 0e0d6029-a40b-45b9-b230-2033ec88617e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:07.833276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a55471c-5a83-4662-b298-c78a948fde99 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:07.834209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a55471c-5a83-4662-b298-c78a948fde99 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:07.834862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a55471c-5a83-4662-b298-c78a948fde99 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:07.835763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a55471c-5a83-4662-b298-c78a948fde99 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:07.837856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a55471c-5a83-4662-b298-c78a948fde99 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:07.839828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a55471c-5a83-4662-b298-c78a948fde99 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:07.917691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fafa41d5-b03d-4f97-a28f-2cac26085f6f tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:07.918311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fafa41d5-b03d-4f97-a28f-2cac26085f6f tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:07.927598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fafa41d5-b03d-4f97-a28f-2cac26085f6f tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:07.928133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fafa41d5-b03d-4f97-a28f-2cac26085f6f tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:07.928792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fafa41d5-b03d-4f97-a28f-2cac26085f6f tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:07.929748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fafa41d5-b03d-4f97-a28f-2cac26085f6f tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:07.931494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fafa41d5-b03d-4f97-a28f-2cac26085f6f tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:07.932124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fafa41d5-b03d-4f97-a28f-2cac26085f6f tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:07.952903 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-fafa41d5-b03d-4f97-a28f-2cac26085f6f tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] HTTP exception thrown: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fafa41d5-b03d-4f97-a28f-2cac26085f6f tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Request method failure captured: Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d HTTP/1.1 Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaD0qZFo3KZyfzwTULL0yAxEa2C808zk4sPYBSCY7447JFpDHqDAYqX9FO7jBKc46LPkGcpsJPGw9nc0q-YL5T8pG3-rRTN2d5Tlzxx1cClx_2GSMivjDWF_V9eVAszOLTqYXO9aSrgWXWEO4bqkY6cQ3U5OaeJOGmsZboWZLbuNj3k Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 92968abec17a4879bffad84cc55b3a14 Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-InstanceActionsV221TestJSON-128972699 Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/92968abec17a4879bffad84cc55b3a14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_92968abec17a4879bffad84cc55b3a14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/92968abec17a4879bffad84cc55b3a14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/92968abec17a4879bffad84cc55b3a14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-InstanceActionsV221TestJSON-128972699 Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 92968abec17a4879bffad84cc55b3a14 Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-128972699 Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-InstanceActionsV221TestJSON-128972699-project Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 97689789f62c484e96e1f14037a8bd31 Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-InstanceActionsV221TestJSON-128972699-project Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'ac000e1e-dc39-4884-96c6-dc414741500d'} Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:07.954827 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:07.959946 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:07.959946 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:07.959946 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:07.959946 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:07.959946 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:07.959946 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:07.959946 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:07.959946 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:07.962400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fafa41d5-b03d-4f97-a28f-2cac26085f6f tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Returning 404 to user: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:07.963585 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fafa41d5-b03d-4f97-a28f-2cac26085f6f tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 404 len: 111 microversion: 2.21 time: 0.049897 Aug 27 04:44:07.964329 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1579/3109] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:44:07 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:44:07.973632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c7d291f1-b0a3-454b-8b2d-397f9132802e tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '.version_select at 0x7f1f20dc13a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:07.974219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c7d291f1-b0a3-454b-8b2d-397f9132802e tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:07.981685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7d291f1-b0a3-454b-8b2d-397f9132802e tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:07.982142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7d291f1-b0a3-454b-8b2d-397f9132802e tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:07.982556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7d291f1-b0a3-454b-8b2d-397f9132802e tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:07.983272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7d291f1-b0a3-454b-8b2d-397f9132802e tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:07.984066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7d291f1-b0a3-454b-8b2d-397f9132802e tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:07.985093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7d291f1-b0a3-454b-8b2d-397f9132802e tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:08.092111 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c7d291f1-b0a3-454b-8b2d-397f9132802e tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.122979 Aug 27 04:44:08.092739 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1580/3110] 10.222.0.79 () {60 vars in 1337 bytes} [Sat Aug 27 04:44:07 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d/os-instance-actions => generated 611 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:44:08.105900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0983f3e2-f3e2-408f-9dfa-0221eae5c887 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:08.106404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0983f3e2-f3e2-408f-9dfa-0221eae5c887 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:08.112847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0983f3e2-f3e2-408f-9dfa-0221eae5c887 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:08.113346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0983f3e2-f3e2-408f-9dfa-0221eae5c887 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:08.113780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0983f3e2-f3e2-408f-9dfa-0221eae5c887 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:08.114667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0983f3e2-f3e2-408f-9dfa-0221eae5c887 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:08.115121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0983f3e2-f3e2-408f-9dfa-0221eae5c887 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:08.116134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0983f3e2-f3e2-408f-9dfa-0221eae5c887 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:08.138086 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0983f3e2-f3e2-408f-9dfa-0221eae5c887 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] HTTP exception thrown: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0983f3e2-f3e2-408f-9dfa-0221eae5c887 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Request method failure captured: Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d HTTP/1.1 Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaD0qZFo3KZyfzwTULL0yAxEa2C808zk4sPYBSCY7447JFpDHqDAYqX9FO7jBKc46LPkGcpsJPGw9nc0q-YL5T8pG3-rRTN2d5Tlzxx1cClx_2GSMivjDWF_V9eVAszOLTqYXO9aSrgWXWEO4bqkY6cQ3U5OaeJOGmsZboWZLbuNj3k Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 92968abec17a4879bffad84cc55b3a14 Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-InstanceActionsV221TestJSON-128972699 Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/92968abec17a4879bffad84cc55b3a14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_92968abec17a4879bffad84cc55b3a14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/92968abec17a4879bffad84cc55b3a14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/92968abec17a4879bffad84cc55b3a14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-InstanceActionsV221TestJSON-128972699 Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 92968abec17a4879bffad84cc55b3a14 Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-128972699 Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-InstanceActionsV221TestJSON-128972699-project Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 97689789f62c484e96e1f14037a8bd31 Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-InstanceActionsV221TestJSON-128972699-project Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'ac000e1e-dc39-4884-96c6-dc414741500d'} Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:08.139989 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:08.144474 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:08.144474 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:08.144474 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:08.144474 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:08.144474 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:08.144474 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:08.144474 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:08.144474 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:08.144474 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:08.144474 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:08.144474 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:08.146863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0983f3e2-f3e2-408f-9dfa-0221eae5c887 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Returning 404 to user: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:08.148087 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0983f3e2-f3e2-408f-9dfa-0221eae5c887 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 404 len: 111 microversion: 2.21 time: 0.046223 Aug 27 04:44:08.152788 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1581/3111] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:44:08 2022] DELETE /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:44:08.158146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b6b79671-fe89-4d81-8a4d-56625bbb048a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:08.158795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b6b79671-fe89-4d81-8a4d-56625bbb048a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:08.166049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6b79671-fe89-4d81-8a4d-56625bbb048a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:08.171161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6b79671-fe89-4d81-8a4d-56625bbb048a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:08.172014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6b79671-fe89-4d81-8a4d-56625bbb048a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:08.173131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6b79671-fe89-4d81-8a4d-56625bbb048a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:08.173750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6b79671-fe89-4d81-8a4d-56625bbb048a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:08.175706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6b79671-fe89-4d81-8a4d-56625bbb048a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:08.222331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9a55471c-5a83-4662-b298-c78a948fde99 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:08.237941 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9a55471c-5a83-4662-b298-c78a948fde99 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e" status: 200 len: 1474 microversion: 2.1 time: 0.443171 Aug 27 04:44:08.239183 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1531/3112] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:07 2022] GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e => generated 1474 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:08.245622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d87bc2c0-d781-466e-9a33-e73b38f18195 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:08.246641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d87bc2c0-d781-466e-9a33-e73b38f18195 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] [instance: ac000e1e-dc39-4884-96c6-dc414741500d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:08.257834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d87bc2c0-d781-466e-9a33-e73b38f18195 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:08.259628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d87bc2c0-d781-466e-9a33-e73b38f18195 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:08.260246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d87bc2c0-d781-466e-9a33-e73b38f18195 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:08.263508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d87bc2c0-d781-466e-9a33-e73b38f18195 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:08.264258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d87bc2c0-d781-466e-9a33-e73b38f18195 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:08.265991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d87bc2c0-d781-466e-9a33-e73b38f18195 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:08.295410 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-d87bc2c0-d781-466e-9a33-e73b38f18195 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] HTTP exception thrown: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d87bc2c0-d781-466e-9a33-e73b38f18195 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Request method failure captured: Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d HTTP/1.1 Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaD0qZFo3KZyfzwTULL0yAxEa2C808zk4sPYBSCY7447JFpDHqDAYqX9FO7jBKc46LPkGcpsJPGw9nc0q-YL5T8pG3-rRTN2d5Tlzxx1cClx_2GSMivjDWF_V9eVAszOLTqYXO9aSrgWXWEO4bqkY6cQ3U5OaeJOGmsZboWZLbuNj3k Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 92968abec17a4879bffad84cc55b3a14 Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-InstanceActionsV221TestJSON-128972699 Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/92968abec17a4879bffad84cc55b3a14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_92968abec17a4879bffad84cc55b3a14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/92968abec17a4879bffad84cc55b3a14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/92968abec17a4879bffad84cc55b3a14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-InstanceActionsV221TestJSON-128972699 Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 92968abec17a4879bffad84cc55b3a14 Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-128972699 Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-InstanceActionsV221TestJSON-128972699-project Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 97689789f62c484e96e1f14037a8bd31 Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-InstanceActionsV221TestJSON-128972699-project Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'ac000e1e-dc39-4884-96c6-dc414741500d'} Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:08.298809 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:08.303738 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:08.303738 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:08.303738 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:08.303738 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:08.303738 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:08.303738 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:08.303738 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. Aug 27 04:44:08.303738 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:08.305680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d87bc2c0-d781-466e-9a33-e73b38f18195 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] Returning 404 to user: Instance ac000e1e-dc39-4884-96c6-dc414741500d could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:08.307441 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d87bc2c0-d781-466e-9a33-e73b38f18195 tempest-InstanceActionsV221TestJSON-128972699 tempest-InstanceActionsV221TestJSON-128972699-project] 10.222.0.79 "GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d" status: 404 len: 111 microversion: 2.21 time: 0.066980 Aug 27 04:44:08.308390 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1532/3113] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:44:08 2022] GET /compute/v2.1/servers/ac000e1e-dc39-4884-96c6-dc414741500d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:44:08.707718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-25e99347-36f8-4658-a6c6-6ba28f526396 req-773eb703-5f2b-4fa2-abda-866deffff7dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82475b2-a407-4da4-afa7-23c2ffc38415", "name": "network-vif-deleted", "tag": "20abfd0d-de86-4429-9b8c-f2ff325b15f6"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:08.728048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-25e99347-36f8-4658-a6c6-6ba28f526396 req-773eb703-5f2b-4fa2-abda-866deffff7dd service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:08.729025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-25e99347-36f8-4658-a6c6-6ba28f526396 req-773eb703-5f2b-4fa2-abda-866deffff7dd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:08.729657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-25e99347-36f8-4658-a6c6-6ba28f526396 req-773eb703-5f2b-4fa2-abda-866deffff7dd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:08.751423 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-25e99347-36f8-4658-a6c6-6ba28f526396 req-773eb703-5f2b-4fa2-abda-866deffff7dd service nova] Creating event network-vif-deleted:20abfd0d-de86-4429-9b8c-f2ff325b15f6 for instance c82475b2-a407-4da4-afa7-23c2ffc38415 on n-h2-854823-1 Aug 27 04:44:08.780186 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-25e99347-36f8-4658-a6c6-6ba28f526396 req-773eb703-5f2b-4fa2-abda-866deffff7dd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072251 Aug 27 04:44:08.784267 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1533/3114] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:08.816561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7b9c805f-a8fc-4405-bda2-d19ba0f577c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:08.818114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7b9c805f-a8fc-4405-bda2-d19ba0f577c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:08.838044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b9c805f-a8fc-4405-bda2-d19ba0f577c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:08.839879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b9c805f-a8fc-4405-bda2-d19ba0f577c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:08.843107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b9c805f-a8fc-4405-bda2-d19ba0f577c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:08.843960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b9c805f-a8fc-4405-bda2-d19ba0f577c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:08.845017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b9c805f-a8fc-4405-bda2-d19ba0f577c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:08.845881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b9c805f-a8fc-4405-bda2-d19ba0f577c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:09.165474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b6b79671-fe89-4d81-8a4d-56625bbb048a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66685e0d1c2747ad929b47eec9f55044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c901ec7cc4c04a858bca519630b40e8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:09.177298 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b6b79671-fe89-4d81-8a4d-56625bbb048a tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 200 len: 1435 microversion: 2.1 time: 1.023395 Aug 27 04:44:09.178404 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1582/3115] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:08 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 1435 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:09.229467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b9c805f-a8fc-4405-bda2-d19ba0f577c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:09.238976 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7b9c805f-a8fc-4405-bda2-d19ba0f577c1 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1315 microversion: 2.1 time: 0.432136 Aug 27 04:44:09.257025 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1534/3116] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:08 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:09.267812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-726d97b9-0e0d-43dd-b905-ceba1af0910b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:09.268468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-726d97b9-0e0d-43dd-b905-ceba1af0910b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 0e0d6029-a40b-45b9-b230-2033ec88617e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:09.302504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-726d97b9-0e0d-43dd-b905-ceba1af0910b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:09.303214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-726d97b9-0e0d-43dd-b905-ceba1af0910b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:09.303902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-726d97b9-0e0d-43dd-b905-ceba1af0910b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:09.304864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-726d97b9-0e0d-43dd-b905-ceba1af0910b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:09.307657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-726d97b9-0e0d-43dd-b905-ceba1af0910b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:09.309766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-726d97b9-0e0d-43dd-b905-ceba1af0910b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:09.902612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-726d97b9-0e0d-43dd-b905-ceba1af0910b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:09.923112 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-726d97b9-0e0d-43dd-b905-ceba1af0910b tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e" status: 200 len: 1474 microversion: 2.1 time: 0.660861 Aug 27 04:44:09.924962 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1583/3117] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:09 2022] GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e => generated 1474 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:10.202338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-509caa51-61c8-4fb5-a69a-5dd8b001abf0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:10.203614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-509caa51-61c8-4fb5-a69a-5dd8b001abf0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] [instance: c82475b2-a407-4da4-afa7-23c2ffc38415] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:10.216028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-509caa51-61c8-4fb5-a69a-5dd8b001abf0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:10.216605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-509caa51-61c8-4fb5-a69a-5dd8b001abf0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:10.217067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-509caa51-61c8-4fb5-a69a-5dd8b001abf0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:10.218710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-509caa51-61c8-4fb5-a69a-5dd8b001abf0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:10.219408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-509caa51-61c8-4fb5-a69a-5dd8b001abf0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:10.220212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-509caa51-61c8-4fb5-a69a-5dd8b001abf0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:10.269058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-397ebcf0-44f9-4fc3-a6c8-bcdbf9871ae8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:10.269864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-397ebcf0-44f9-4fc3-a6c8-bcdbf9871ae8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:10.277951 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-509caa51-61c8-4fb5-a69a-5dd8b001abf0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] HTTP exception thrown: Instance c82475b2-a407-4da4-afa7-23c2ffc38415 could not be found. Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-509caa51-61c8-4fb5-a69a-5dd8b001abf0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Request method failure captured: Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 HTTP/1.1 Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaDG3wLikZK1l7XF5YeTse9F6W6Nmnjx3datj_w59gjheemrsbzXPN68vHp_1cSTQF6SFPpn9qlEKjlYRpNcQ1irDW8d4jdY98CZG8XhAWMd-x7WwthPy_Wun_O6GUGtIF2VfaFpVd5M_iJ0Vh05naPM5meCTnrN6njNOY_DCWNSL3I Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: c901ec7cc4c04a858bca519630b40e8e Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1531733094 Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c901ec7cc4c04a858bca519630b40e8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c901ec7cc4c04a858bca519630b40e8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c901ec7cc4c04a858bca519630b40e8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c901ec7cc4c04a858bca519630b40e8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1531733094 Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: c901ec7cc4c04a858bca519630b40e8e Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1531733094 Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersAdminNegativeTestJSON-1531733094-project Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 66685e0d1c2747ad929b47eec9f55044 Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1531733094-project Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance c82475b2-a407-4da4-afa7-23c2ffc38415 could not be found. Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'c82475b2-a407-4da4-afa7-23c2ffc38415'} Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c82475b2-a407-4da4-afa7-23c2ffc38415 could not be found. Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c82475b2-a407-4da4-afa7-23c2ffc38415 could not be found. Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:10.280757 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:10.285274 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:10.285274 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:10.285274 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:10.285274 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:10.285274 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:10.285274 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:10.285274 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c82475b2-a407-4da4-afa7-23c2ffc38415 could not be found. Aug 27 04:44:10.285274 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:10.285274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-509caa51-61c8-4fb5-a69a-5dd8b001abf0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] Returning 404 to user: Instance c82475b2-a407-4da4-afa7-23c2ffc38415 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:10.285274 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-509caa51-61c8-4fb5-a69a-5dd8b001abf0 tempest-ServersAdminNegativeTestJSON-1531733094 tempest-ServersAdminNegativeTestJSON-1531733094-project] 10.222.0.79 "GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415" status: 404 len: 111 microversion: 2.1 time: 0.086391 Aug 27 04:44:10.287770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-397ebcf0-44f9-4fc3-a6c8-bcdbf9871ae8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:10.288080 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1535/3118] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:10 2022] GET /compute/v2.1/servers/c82475b2-a407-4da4-afa7-23c2ffc38415 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:10.288196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-397ebcf0-44f9-4fc3-a6c8-bcdbf9871ae8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:10.288196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-397ebcf0-44f9-4fc3-a6c8-bcdbf9871ae8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:10.293764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-397ebcf0-44f9-4fc3-a6c8-bcdbf9871ae8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:10.296299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-397ebcf0-44f9-4fc3-a6c8-bcdbf9871ae8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:10.300741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-397ebcf0-44f9-4fc3-a6c8-bcdbf9871ae8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:10.726654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-397ebcf0-44f9-4fc3-a6c8-bcdbf9871ae8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:10.765872 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-397ebcf0-44f9-4fc3-a6c8-bcdbf9871ae8 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1315 microversion: 2.1 time: 0.480284 Aug 27 04:44:10.769588 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1584/3119] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:10 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:44:10.957135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d9df3769-36ce-4912-a152-4a2bdb52e908 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:10.957756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d9df3769-36ce-4912-a152-4a2bdb52e908 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 0e0d6029-a40b-45b9-b230-2033ec88617e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:10.969194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9df3769-36ce-4912-a152-4a2bdb52e908 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:10.970247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9df3769-36ce-4912-a152-4a2bdb52e908 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:10.973451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9df3769-36ce-4912-a152-4a2bdb52e908 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:10.974498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9df3769-36ce-4912-a152-4a2bdb52e908 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:10.976085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9df3769-36ce-4912-a152-4a2bdb52e908 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:10.980409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9df3769-36ce-4912-a152-4a2bdb52e908 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:11.150118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2cbef319-1038-4a64-afb4-1646ea12445a req-d2079f77-f8a9-4a61-a867-2a1e8783b575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0d6029-a40b-45b9-b230-2033ec88617e", "name": "network-vif-deleted", "tag": "54e043d1-9346-4c9a-917b-026289b24400"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:11.172589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2cbef319-1038-4a64-afb4-1646ea12445a req-d2079f77-f8a9-4a61-a867-2a1e8783b575 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:11.174230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d9df3769-36ce-4912-a152-4a2bdb52e908 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346cf8d02f204e42b7da064228fe678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7dc74b8c2542c89421611c9ded66e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:11.175188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2cbef319-1038-4a64-afb4-1646ea12445a req-d2079f77-f8a9-4a61-a867-2a1e8783b575 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:11.175800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2cbef319-1038-4a64-afb4-1646ea12445a req-d2079f77-f8a9-4a61-a867-2a1e8783b575 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:11.185456 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d9df3769-36ce-4912-a152-4a2bdb52e908 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e" status: 200 len: 1432 microversion: 2.1 time: 0.236491 Aug 27 04:44:11.186079 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1536/3120] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:10 2022] GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e => generated 1432 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:11.214609 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2cbef319-1038-4a64-afb4-1646ea12445a req-d2079f77-f8a9-4a61-a867-2a1e8783b575 service nova] Creating event network-vif-deleted:54e043d1-9346-4c9a-917b-026289b24400 for instance 0e0d6029-a40b-45b9-b230-2033ec88617e on n-h1-854823-1 Aug 27 04:44:11.220898 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2cbef319-1038-4a64-afb4-1646ea12445a req-d2079f77-f8a9-4a61-a867-2a1e8783b575 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078485 Aug 27 04:44:11.233222 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1585/3121] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:11.790980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a27be58a-f750-4a50-962d-890e49380850 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:11.791599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a27be58a-f750-4a50-962d-890e49380850 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:11.801378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a27be58a-f750-4a50-962d-890e49380850 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:11.801801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a27be58a-f750-4a50-962d-890e49380850 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:11.809673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a27be58a-f750-4a50-962d-890e49380850 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:11.810446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a27be58a-f750-4a50-962d-890e49380850 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:11.810927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a27be58a-f750-4a50-962d-890e49380850 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:11.811365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a27be58a-f750-4a50-962d-890e49380850 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:12.212639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2b39b216-e0ed-46f2-972f-f6ce328f2bce tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:12.214195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2b39b216-e0ed-46f2-972f-f6ce328f2bce tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] [instance: 0e0d6029-a40b-45b9-b230-2033ec88617e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:12.229276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b39b216-e0ed-46f2-972f-f6ce328f2bce tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:12.231639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b39b216-e0ed-46f2-972f-f6ce328f2bce tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:12.235767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b39b216-e0ed-46f2-972f-f6ce328f2bce tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:12.239052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b39b216-e0ed-46f2-972f-f6ce328f2bce tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:12.241607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b39b216-e0ed-46f2-972f-f6ce328f2bce tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:12.247156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b39b216-e0ed-46f2-972f-f6ce328f2bce tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:12.283903 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-2b39b216-e0ed-46f2-972f-f6ce328f2bce tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] HTTP exception thrown: Instance 0e0d6029-a40b-45b9-b230-2033ec88617e could not be found. Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2b39b216-e0ed-46f2-972f-f6ce328f2bce tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Request method failure captured: Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e HTTP/1.1 Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaBhoymFzIsUZpi4Vcu5TWK6UCOq8y4em7Fp9d1k-278Zx9qt44U6ACYMKOYQUI3lrmWD0nOMl4ZnjL31ImdVyegUS590NnRnCabBT-xFMGniICB-K7xXDz-an0P769RX_NFHYlx5H1D6I8hYMJ3_ziqq6hFQkG83lBRZLe6bdPiFdU Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 0f7dc74b8c2542c89421611c9ded66e1 Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ListImageFiltersTestJSON-1848891985 Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0f7dc74b8c2542c89421611c9ded66e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0f7dc74b8c2542c89421611c9ded66e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0f7dc74b8c2542c89421611c9ded66e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0f7dc74b8c2542c89421611c9ded66e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ListImageFiltersTestJSON-1848891985 Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 0f7dc74b8c2542c89421611c9ded66e1 Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1848891985 Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ListImageFiltersTestJSON-1848891985-project Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 346cf8d02f204e42b7da064228fe678c Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ListImageFiltersTestJSON-1848891985-project Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 0e0d6029-a40b-45b9-b230-2033ec88617e could not be found. Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '0e0d6029-a40b-45b9-b230-2033ec88617e'} Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e0d6029-a40b-45b9-b230-2033ec88617e could not be found. Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e0d6029-a40b-45b9-b230-2033ec88617e could not be found. Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:12.286981 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:12.291656 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:12.291656 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:12.291656 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:12.291656 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:12.291656 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:12.291656 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e0d6029-a40b-45b9-b230-2033ec88617e could not be found. Aug 27 04:44:12.291656 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:12.298534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2b39b216-e0ed-46f2-972f-f6ce328f2bce tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Returning 404 to user: Instance 0e0d6029-a40b-45b9-b230-2033ec88617e could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:12.300167 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2b39b216-e0ed-46f2-972f-f6ce328f2bce tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e" status: 404 len: 111 microversion: 2.1 time: 0.092152 Aug 27 04:44:12.306609 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1586/3122] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:12 2022] GET /compute/v2.1/servers/0e0d6029-a40b-45b9-b230-2033ec88617e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:12.313293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3061c48-f3c5-44ac-afe6-339a437c9a38 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e63700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:12.667799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a27be58a-f750-4a50-962d-890e49380850 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:12.678315 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a27be58a-f750-4a50-962d-890e49380850 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1315 microversion: 2.1 time: 0.891689 Aug 27 04:44:12.681045 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1537/3123] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:11 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1315 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:12.691618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-f9de1948-26aa-492e-b467-39c20c234b12 req-5ead344b-d129-4e79-b47d-43800a2605b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0778ea23-5cf7-420f-94d9-4f43f79bf8bf", "name": "network-vif-plugged", "status": "completed", "tag": "cd347df0-5318-4354-83d7-2fe855526129"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:12.719133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f9de1948-26aa-492e-b467-39c20c234b12 req-5ead344b-d129-4e79-b47d-43800a2605b3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:12.719920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f9de1948-26aa-492e-b467-39c20c234b12 req-5ead344b-d129-4e79-b47d-43800a2605b3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:12.736040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f9de1948-26aa-492e-b467-39c20c234b12 req-5ead344b-d129-4e79-b47d-43800a2605b3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:12.772949 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f9de1948-26aa-492e-b467-39c20c234b12 req-5ead344b-d129-4e79-b47d-43800a2605b3 service nova] Creating event network-vif-plugged:cd347df0-5318-4354-83d7-2fe855526129 for instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf on n-h2-854823-1 Aug 27 04:44:12.780267 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-f9de1948-26aa-492e-b467-39c20c234b12 req-5ead344b-d129-4e79-b47d-43800a2605b3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095511 Aug 27 04:44:12.781588 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1538/3124] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:13.112659 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3061c48-f3c5-44ac-afe6-339a437c9a38 tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "DELETE /compute/v2.1/images/113a5b30-49f3-426e-bcf8-af5ee467dd73" status: 204 len: 0 microversion: 2.1 time: 0.803067 Aug 27 04:44:13.113238 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1587/3125] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:12 2022] DELETE /compute/v2.1/images/113a5b30-49f3-426e-bcf8-af5ee467dd73 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:44:13.125653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a41d0da2-8fb8-4cfc-8baf-07441e1e26dc tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f21167d30>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:13.633978 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a41d0da2-8fb8-4cfc-8baf-07441e1e26dc tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "DELETE /compute/v2.1/images/2c456f60-0fed-45b8-a039-69f1eec3c947" status: 204 len: 0 microversion: 2.1 time: 0.515202 Aug 27 04:44:13.638212 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1539/3126] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:13 2022] DELETE /compute/v2.1/images/2c456f60-0fed-45b8-a039-69f1eec3c947 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:44:13.648228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df02dc23-43db-4e6c-ab9a-d6cbe3091bdd tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] Calling method '.version_select at 0x7f1f20e611f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:13.701547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53f761a0-0e37-428c-92b6-b23cfbc49d10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:13.703189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-53f761a0-0e37-428c-92b6-b23cfbc49d10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:13.728668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53f761a0-0e37-428c-92b6-b23cfbc49d10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:13.732838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53f761a0-0e37-428c-92b6-b23cfbc49d10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:13.737153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53f761a0-0e37-428c-92b6-b23cfbc49d10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:13.741614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53f761a0-0e37-428c-92b6-b23cfbc49d10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:13.743087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53f761a0-0e37-428c-92b6-b23cfbc49d10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:13.749338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53f761a0-0e37-428c-92b6-b23cfbc49d10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:14.004693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53f761a0-0e37-428c-92b6-b23cfbc49d10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:14.016977 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-53f761a0-0e37-428c-92b6-b23cfbc49d10 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1315 microversion: 2.1 time: 0.319746 Aug 27 04:44:14.019186 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1540/3127] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:13 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:44:14.706419 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-df02dc23-43db-4e6c-ab9a-d6cbe3091bdd tempest-ListImageFiltersTestJSON-1848891985 tempest-ListImageFiltersTestJSON-1848891985-project] 10.222.0.79 "DELETE /compute/v2.1/images/53e40336-d687-497f-8d54-b68e5e55a854" status: 204 len: 0 microversion: 2.1 time: 1.067272 Aug 27 04:44:14.708273 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1588/3128] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:13 2022] DELETE /compute/v2.1/images/53e40336-d687-497f-8d54-b68e5e55a854 => generated 0 bytes in 1070 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:44:15.042304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2790d1fd-ae0d-451a-b527-ef78831cb49e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:15.043816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2790d1fd-ae0d-451a-b527-ef78831cb49e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:15.056361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2790d1fd-ae0d-451a-b527-ef78831cb49e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:15.057323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2790d1fd-ae0d-451a-b527-ef78831cb49e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:15.058285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2790d1fd-ae0d-451a-b527-ef78831cb49e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:15.059804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2790d1fd-ae0d-451a-b527-ef78831cb49e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:15.060490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2790d1fd-ae0d-451a-b527-ef78831cb49e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:15.061487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2790d1fd-ae0d-451a-b527-ef78831cb49e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:15.285643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2790d1fd-ae0d-451a-b527-ef78831cb49e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:15.301587 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2790d1fd-ae0d-451a-b527-ef78831cb49e tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1501 microversion: 2.1 time: 0.265230 Aug 27 04:44:15.303049 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1541/3129] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:15 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1501 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:15.324613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a069c76-9614-44e9-ab65-175985e0cbe3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:15.325858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a069c76-9614-44e9-ab65-175985e0cbe3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:15.339965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a069c76-9614-44e9-ab65-175985e0cbe3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:15.340477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a069c76-9614-44e9-ab65-175985e0cbe3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:15.342197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a069c76-9614-44e9-ab65-175985e0cbe3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:15.344479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a069c76-9614-44e9-ab65-175985e0cbe3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:15.345027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a069c76-9614-44e9-ab65-175985e0cbe3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:15.346356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a069c76-9614-44e9-ab65-175985e0cbe3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:15.399332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-8a069c76-9614-44e9-ab65-175985e0cbe3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lazy-loading 'flavor' on Instance uuid 0778ea23-5cf7-420f-94d9-4f43f79bf8bf {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:44:15.451802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:15.551666 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a069c76-9614-44e9-ab65-175985e0cbe3 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "POST /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf/action" status: 202 len: 0 microversion: 2.1 time: 0.232674 Aug 27 04:44:15.553447 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1589/3130] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:44:15 2022] POST /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:44:15.569374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-60e3d39c-af52-4329-92e4-cbc17038614f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:15.571297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-60e3d39c-af52-4329-92e4-cbc17038614f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:15.589600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60e3d39c-af52-4329-92e4-cbc17038614f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:15.590531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60e3d39c-af52-4329-92e4-cbc17038614f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:15.591619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60e3d39c-af52-4329-92e4-cbc17038614f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:15.595968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60e3d39c-af52-4329-92e4-cbc17038614f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:15.596917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60e3d39c-af52-4329-92e4-cbc17038614f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:15.597645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60e3d39c-af52-4329-92e4-cbc17038614f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:15.949816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-60e3d39c-af52-4329-92e4-cbc17038614f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:15.954341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:15.983987 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-60e3d39c-af52-4329-92e4-cbc17038614f tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1509 microversion: 2.1 time: 0.425667 Aug 27 04:44:15.986935 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1542/3131] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:15 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1509 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:17.008087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d7422707-2409-4655-b05c-7fa992c87f33 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:17.009992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d7422707-2409-4655-b05c-7fa992c87f33 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:17.026187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7422707-2409-4655-b05c-7fa992c87f33 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:17.040700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7422707-2409-4655-b05c-7fa992c87f33 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:17.043050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7422707-2409-4655-b05c-7fa992c87f33 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:17.046087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7422707-2409-4655-b05c-7fa992c87f33 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:17.055874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7422707-2409-4655-b05c-7fa992c87f33 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:17.057132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7422707-2409-4655-b05c-7fa992c87f33 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:17.449706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7daac9c2-792c-48ec-90be-0cad87234f3e tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] Action: 'create', calling method: .version_select at 0x7f1f20e631f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-720634534", "metadata": {"Type": "work"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:18.081559 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7daac9c2-792c-48ec-90be-0cad87234f3e tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.307282 Aug 27 04:44:18.082539 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1590/3132] 10.222.0.79 () {60 vars in 1156 bytes} [Sat Aug 27 04:44:16 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1310 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 04:44:18.098167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce0fcd8e-5c7c-402a-91b6-dae57f638fdc tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] Calling method '.version_select at 0x7f1f20ea11f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:18.152866 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce0fcd8e-5c7c-402a-91b6-dae57f638fdc tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6" status: 200 len: 352 microversion: 2.1 time: 0.059079 Aug 27 04:44:18.161490 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1591/3133] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 04:44:18 2022] GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:18.268226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d7422707-2409-4655-b05c-7fa992c87f33 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:18.281961 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d7422707-2409-4655-b05c-7fa992c87f33 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1492 microversion: 2.1 time: 1.276794 Aug 27 04:44:18.299889 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1543/3134] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:17 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1492 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:18.311589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-38a44eb3-7142-43c1-9770-ef62b314d104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:18.316392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-38a44eb3-7142-43c1-9770-ef62b314d104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:18.324584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38a44eb3-7142-43c1-9770-ef62b314d104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:18.325340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38a44eb3-7142-43c1-9770-ef62b314d104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:18.325970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38a44eb3-7142-43c1-9770-ef62b314d104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:18.327002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38a44eb3-7142-43c1-9770-ef62b314d104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:18.328279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38a44eb3-7142-43c1-9770-ef62b314d104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:18.328932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38a44eb3-7142-43c1-9770-ef62b314d104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:18.422890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-38a44eb3-7142-43c1-9770-ef62b314d104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:44:18.574716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-451880b2-8b17-413b-a108-1c4e4004467f tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Action: 'create', calling method: .version_select at 0x7f1f20dc1dc0>, body: {"keypair": {"name": "tempest-keypair-995112791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ6rVwy/Cof+zLD4Hlu51bQGQfr8D5qAzoD8k+7Qh5Qyu0j5DAy+4SlyLHy31EYlGifaGefRmJfLSVPJCdmw8XK61OJSgrgvyCsaB5E7SguUKIPBoMBqNGSwR7T08uoZQ=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:18.636545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-451880b2-8b17-413b-a108-1c4e4004467f tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Getting quotas for project ba9dc0acc581458491581c7976cab114. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:44:18.658487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-451880b2-8b17-413b-a108-1c4e4004467f tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Getting quotas for user 02f327cc0359435bb90265713187ec15 and project ba9dc0acc581458491581c7976cab114. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:44:18.673478 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-38a44eb3-7142-43c1-9770-ef62b314d104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 204 len: 0 microversion: 2.1 time: 0.370572 Aug 27 04:44:18.675165 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1544/3135] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:44:18 2022] DELETE /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:44:18.685069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-844bfc13-7ea0-4004-99e5-263004833796 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:18.686172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-844bfc13-7ea0-4004-99e5-263004833796 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:18.693170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-844bfc13-7ea0-4004-99e5-263004833796 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:18.694751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-844bfc13-7ea0-4004-99e5-263004833796 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:18.695458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-844bfc13-7ea0-4004-99e5-263004833796 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:18.696499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-844bfc13-7ea0-4004-99e5-263004833796 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:18.697225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-844bfc13-7ea0-4004-99e5-263004833796 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:18.697890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-844bfc13-7ea0-4004-99e5-263004833796 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:18.715286 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-451880b2-8b17-413b-a108-1c4e4004467f tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.452084 Aug 27 04:44:18.720765 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1592/3136] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:44:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:18.727490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdbdcbd4-9193-4aaa-8c68-079f0fcccd48 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Calling method '.version_select at 0x7f1f20e953a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:18.750961 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdbdcbd4-9193-4aaa-8c68-079f0fcccd48 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-995112791" status: 200 len: 497 microversion: 2.1 time: 0.027060 Aug 27 04:44:18.752116 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1593/3137] 10.222.0.79 () {58 vars in 1215 bytes} [Sat Aug 27 04:44:18 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-995112791 => generated 497 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:18.764430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1436541a-1de2-4ea1-9089-632af6f8bb4d tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Calling method '.version_select at 0x7f1f20e61790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:18.789422 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1436541a-1de2-4ea1-9089-632af6f8bb4d tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-995112791" status: 202 len: 0 microversion: 2.1 time: 0.029063 Aug 27 04:44:18.798056 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1594/3138] 10.222.0.79 () {58 vars in 1218 bytes} [Sat Aug 27 04:44:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-995112791 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:44:18.806154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-110d2990-282d-43d9-8f41-46037c475145 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Action: 'create', calling method: .version_select at 0x7f1f20e711f0>, body: {"keypair": {"name": "tempest-keypair-1714844686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIcHD/3ltO9jqiFQkzbMb9lxJeJzAWxgxwPTBTiWpemBXOn2VDIv1aSE4tg0xqXvBHFfm4/Mr9dKox4V9cWXv3tBu7yQ7r2os3+oPQtd7auFIjT7kFaT2KV7UtT4uMFjg=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:18.826850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-110d2990-282d-43d9-8f41-46037c475145 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Getting quotas for project ba9dc0acc581458491581c7976cab114. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:44:18.845593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-110d2990-282d-43d9-8f41-46037c475145 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Getting quotas for user 02f327cc0359435bb90265713187ec15 and project ba9dc0acc581458491581c7976cab114. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:44:18.887011 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-110d2990-282d-43d9-8f41-46037c475145 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087189 Aug 27 04:44:18.899670 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1595/3139] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:44:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:18.906335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f4417ae-bf2c-492b-8baf-9be473d083d5 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Calling method '.version_select at 0x7f1f20e71dc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:18.933295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:18.967557 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f4417ae-bf2c-492b-8baf-9be473d083d5 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1714844686" status: 202 len: 0 microversion: 2.1 time: 0.062749 Aug 27 04:44:18.968568 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1596/3140] 10.222.0.79 () {58 vars in 1221 bytes} [Sat Aug 27 04:44:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1714844686 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:44:18.981705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e07687d1-f315-479c-b378-90ed60103a99 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Action: 'create', calling method: .version_select at 0x7f1f20e61ee0>, body: {"keypair": {"name": "tempest-keypair-947891781", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:19.007952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e07687d1-f315-479c-b378-90ed60103a99 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Getting quotas for project ba9dc0acc581458491581c7976cab114. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:44:19.014363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e07687d1-f315-479c-b378-90ed60103a99 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Getting quotas for user 02f327cc0359435bb90265713187ec15 and project ba9dc0acc581458491581c7976cab114. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:44:19.052049 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e07687d1-f315-479c-b378-90ed60103a99 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.077036 Aug 27 04:44:19.052976 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1597/3141] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:44:18 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:19.067518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-efd0f6d1-5471-408b-9035-783cef1c9475 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Calling method '.version_select at 0x7f1f20e955e0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:19.132366 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-efd0f6d1-5471-408b-9035-783cef1c9475 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-947891781" status: 202 len: 0 microversion: 2.1 time: 0.071594 Aug 27 04:44:19.133404 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1598/3142] 10.222.0.79 () {58 vars in 1218 bytes} [Sat Aug 27 04:44:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-947891781 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:44:19.140667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-844bfc13-7ea0-4004-99e5-263004833796 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:19.148987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5fc314c-cabe-4f16-bc3e-3effc17c287d tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Action: 'create', calling method: .version_select at 0x7f1f20dec8b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-21975922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEuFklVSmbwbSSSbE5Mawa8v6wccuuyUb9V3sWEXHDTpTB/RREqqySB48FPkZ1elBKzMdZcNDTn2G+3CGMPh7T5xWInBKSgJH4yXeoxCGVlxR/y+rXKxNipH7ukwTFktA=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:19.160734 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-844bfc13-7ea0-4004-99e5-263004833796 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1498 microversion: 2.1 time: 0.476294 Aug 27 04:44:19.160734 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1545/3143] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:18 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1498 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:44:19.167283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f9b98a6f-c23f-4d2e-b201-a35753643f5b tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] Calling method '.version_select at 0x7f1f211670d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:19.183431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c5fc314c-cabe-4f16-bc3e-3effc17c287d tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Getting quotas for project ba9dc0acc581458491581c7976cab114. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:44:19.190906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c5fc314c-cabe-4f16-bc3e-3effc17c287d tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Getting quotas for user 02f327cc0359435bb90265713187ec15 and project ba9dc0acc581458491581c7976cab114. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:44:19.230177 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5fc314c-cabe-4f16-bc3e-3effc17c287d tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.088598 Aug 27 04:44:19.239363 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1599/3144] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:44:19 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:44:19.244961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8dd01ed7-6c7a-40e0-a5b3-3078a365b97a tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Action: 'create', calling method: .version_select at 0x7f1f20ea1280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2092966876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO78eKkwG9Yf+MdT7fBUFrwyZs/DRf6QnA5lEFxrH+GN1Lp8J5wmk5i1tJ8o11t1Wxh00HZxbjEduUmLFT5sobpvBo2f8UZLLFSMBhk3gwbgu/fpbLDvIho8ikrj3t/xWA=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:19.290125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8dd01ed7-6c7a-40e0-a5b3-3078a365b97a tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Getting quotas for project ba9dc0acc581458491581c7976cab114. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:44:19.303400 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f9b98a6f-c23f-4d2e-b201-a35753643f5b tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6" status: 200 len: 352 microversion: 2.1 time: 0.140687 Aug 27 04:44:19.310688 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1546/3145] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 04:44:19 2022] GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:19.313724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8dd01ed7-6c7a-40e0-a5b3-3078a365b97a tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Getting quotas for user 02f327cc0359435bb90265713187ec15 and project ba9dc0acc581458491581c7976cab114. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:44:19.363719 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8dd01ed7-6c7a-40e0-a5b3-3078a365b97a tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.123140 Aug 27 04:44:19.364449 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1600/3146] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:44:19 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:44:19.383147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb3a53e5-64ff-4885-9655-fd503ac9e4db tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Action: 'create', calling method: .version_select at 0x7f1f211bb670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-952838094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIPrVlamUf4auNFJThhpySGunRxgW2IknLfZkcxif7UxAwGdNq3PuLgA/vrPhJhb58L5OVmo9uLIiSGlUZGJ9pPh7+xuIpFehNNLDPCs2lJfyFvXPSnGahDaUTGI3tovQ=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:19.421567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-eb3a53e5-64ff-4885-9655-fd503ac9e4db tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Getting quotas for project ba9dc0acc581458491581c7976cab114. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:44:19.428740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-eb3a53e5-64ff-4885-9655-fd503ac9e4db tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Getting quotas for user 02f327cc0359435bb90265713187ec15 and project ba9dc0acc581458491581c7976cab114. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:44:19.464996 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb3a53e5-64ff-4885-9655-fd503ac9e4db tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.088856 Aug 27 04:44:19.466968 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1547/3147] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:44:19 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:19.478396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff429abc-fb7d-4745-94c5-2982fa4bd433 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Calling method '.version_select at 0x7f1f20e63d30>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:19.484978 n-d-854823-1 devstack@n-api.service[128869]: WARNING oslo_db.sqlalchemy.utils [None req-ff429abc-fb7d-4745-94c5-2982fa4bd433 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 04:44:19.498991 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff429abc-fb7d-4745-94c5-2982fa4bd433 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.025465 Aug 27 04:44:19.507095 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1601/3148] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:44:19 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:19.513737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-254a085c-a67f-4346-8b07-1eed73fcc84f tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Calling method '.version_select at 0x7f1f2116d0d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:19.554437 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-254a085c-a67f-4346-8b07-1eed73fcc84f tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-952838094" status: 202 len: 0 microversion: 2.1 time: 0.043839 Aug 27 04:44:19.555463 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1548/3149] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 04:44:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-952838094 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:44:19.563567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e87994a8-9068-4e81-bdf1-dc6ccdf0f0b7 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Calling method '.version_select at 0x7f1f20e69550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:19.587406 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e87994a8-9068-4e81-bdf1-dc6ccdf0f0b7 tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2092966876" status: 202 len: 0 microversion: 2.1 time: 0.027469 Aug 27 04:44:19.589691 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1602/3150] 10.222.0.79 () {58 vars in 1278 bytes} [Sat Aug 27 04:44:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2092966876 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:44:19.602459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef2b1d5d-a193-4c93-8914-17e610e0425a tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] Calling method '.version_select at 0x7f1f211eab80>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:19.651413 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ef2b1d5d-a193-4c93-8914-17e610e0425a tempest-KeyPairsV2TestJSON-1254221401 tempest-KeyPairsV2TestJSON-1254221401-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-21975922" status: 202 len: 0 microversion: 2.1 time: 0.054946 Aug 27 04:44:19.653476 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1549/3151] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:44:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-21975922 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:44:20.190685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a557bfec-b4bf-4142-baac-3e6f72d2b728 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:20.191709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a557bfec-b4bf-4142-baac-3e6f72d2b728 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:20.219265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a557bfec-b4bf-4142-baac-3e6f72d2b728 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:20.220022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a557bfec-b4bf-4142-baac-3e6f72d2b728 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:20.221654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a557bfec-b4bf-4142-baac-3e6f72d2b728 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:20.222571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a557bfec-b4bf-4142-baac-3e6f72d2b728 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:20.223249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a557bfec-b4bf-4142-baac-3e6f72d2b728 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:20.224316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a557bfec-b4bf-4142-baac-3e6f72d2b728 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:20.321218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0ae9e0dd-0f01-44d4-89a8-7a0fa179fd61 tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] Calling method '.version_select at 0x7f1f21107820>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:20.455068 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0ae9e0dd-0f01-44d4-89a8-7a0fa179fd61 tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6" status: 200 len: 353 microversion: 2.1 time: 0.140303 Aug 27 04:44:20.456134 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1550/3152] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 04:44:20 2022] GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:20.468927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8aeaf69e-865b-45d9-bd5c-6c5976f548ef tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] Calling method '.version_select at 0x7f1f21107430>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:20.535745 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8aeaf69e-865b-45d9-bd5c-6c5976f548ef tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6" status: 200 len: 353 microversion: 2.1 time: 0.070229 Aug 27 04:44:20.536656 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1551/3153] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 04:44:20 2022] GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:44:20.558377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-82cdb4bd-d18a-4eaf-a57a-a2f56a98e90c tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] Calling method '.version_select at 0x7f1f2117cf70>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:20.647270 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-82cdb4bd-d18a-4eaf-a57a-a2f56a98e90c tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6" status: 202 len: 0 microversion: 2.1 time: 0.099740 Aug 27 04:44:20.648568 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1552/3154] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 04:44:20 2022] DELETE /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:44:20.656816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-819490c1-ac78-41dd-9bce-93d7791a7496 tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] Calling method '.version_select at 0x7f1f21167160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:20.745056 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-819490c1-ac78-41dd-9bce-93d7791a7496 tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6" status: 200 len: 352 microversion: 2.1 time: 0.092675 Aug 27 04:44:20.745645 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1553/3155] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 04:44:20 2022] GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:44:20.975399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a557bfec-b4bf-4142-baac-3e6f72d2b728 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:20.995345 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a557bfec-b4bf-4142-baac-3e6f72d2b728 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1498 microversion: 2.1 time: 0.813938 Aug 27 04:44:20.999376 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1603/3156] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:20 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1498 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:21.761709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b38e78ca-951d-4302-88a7-1180c0e40171 tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] Calling method '.version_select at 0x7f1f21107d30>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:21.916481 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b38e78ca-951d-4302-88a7-1180c0e40171 tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6" status: 200 len: 352 microversion: 2.1 time: 0.160659 Aug 27 04:44:21.917672 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1554/3157] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 04:44:21 2022] GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 => generated 352 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:22.018722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f47381dd-fcdb-4943-ba3e-f2597b37eeca tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:22.019355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f47381dd-fcdb-4943-ba3e-f2597b37eeca tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:22.039737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f47381dd-fcdb-4943-ba3e-f2597b37eeca tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:22.040253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f47381dd-fcdb-4943-ba3e-f2597b37eeca tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:22.042053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f47381dd-fcdb-4943-ba3e-f2597b37eeca tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:22.044699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f47381dd-fcdb-4943-ba3e-f2597b37eeca tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:22.045817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f47381dd-fcdb-4943-ba3e-f2597b37eeca tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:22.053322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f47381dd-fcdb-4943-ba3e-f2597b37eeca tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:22.874918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f47381dd-fcdb-4943-ba3e-f2597b37eeca tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:22.883882 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f47381dd-fcdb-4943-ba3e-f2597b37eeca tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1498 microversion: 2.1 time: 0.869719 Aug 27 04:44:22.888430 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1604/3158] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:22 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1498 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:22.932798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-65322b9b-9b94-4e24-bc84-8cdcf51e911f tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] Calling method '.version_select at 0x7f1f2116dc10>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:23.057851 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-65322b9b-9b94-4e24-bc84-8cdcf51e911f tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6" status: 200 len: 352 microversion: 2.1 time: 0.130740 Aug 27 04:44:23.066107 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1555/3159] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 04:44:22 2022] GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 => generated 352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:23.501059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-30168be4-eb5f-4d92-adcc-b14c523633a9 req-d69df674-bc4c-4215-931b-39a7af286c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0778ea23-5cf7-420f-94d9-4f43f79bf8bf", "name": "network-vif-deleted", "tag": "cd347df0-5318-4354-83d7-2fe855526129"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:23.527753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-30168be4-eb5f-4d92-adcc-b14c523633a9 req-d69df674-bc4c-4215-931b-39a7af286c94 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:23.529692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-30168be4-eb5f-4d92-adcc-b14c523633a9 req-d69df674-bc4c-4215-931b-39a7af286c94 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:23.530394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-30168be4-eb5f-4d92-adcc-b14c523633a9 req-d69df674-bc4c-4215-931b-39a7af286c94 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:23.601420 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-30168be4-eb5f-4d92-adcc-b14c523633a9 req-d69df674-bc4c-4215-931b-39a7af286c94 service nova] Creating event network-vif-deleted:cd347df0-5318-4354-83d7-2fe855526129 for instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf on n-h2-854823-1 Aug 27 04:44:23.608293 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-30168be4-eb5f-4d92-adcc-b14c523633a9 req-d69df674-bc4c-4215-931b-39a7af286c94 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112722 Aug 27 04:44:23.609882 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1605/3160] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:23.912787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5cbed35d-d975-465c-8e90-5391e8eeacd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:23.913587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5cbed35d-d975-465c-8e90-5391e8eeacd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:23.931999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cbed35d-d975-465c-8e90-5391e8eeacd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:23.946768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cbed35d-d975-465c-8e90-5391e8eeacd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:23.948699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cbed35d-d975-465c-8e90-5391e8eeacd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:23.951171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cbed35d-d975-465c-8e90-5391e8eeacd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:23.953316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cbed35d-d975-465c-8e90-5391e8eeacd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:23.955718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cbed35d-d975-465c-8e90-5391e8eeacd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:24.030893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cbed35d-d975-465c-8e90-5391e8eeacd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:24.035306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cbed35d-d975-465c-8e90-5391e8eeacd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:24.036261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cbed35d-d975-465c-8e90-5391e8eeacd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:24.037253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-5cbed35d-d975-465c-8e90-5391e8eeacd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lazy-loading 'fault' on Instance uuid 0778ea23-5cf7-420f-94d9-4f43f79bf8bf {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:44:24.074719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bb0e8133-26c4-43d5-8245-b6cc764ed10e tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] Calling method '.version_select at 0x7f1f20e61dc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:24.246977 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bb0e8133-26c4-43d5-8245-b6cc764ed10e tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6" status: 200 len: 352 microversion: 2.1 time: 0.177233 Aug 27 04:44:24.247610 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1606/3161] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 04:44:24 2022] GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 => generated 352 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:24.280150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5cbed35d-d975-465c-8e90-5391e8eeacd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c59dc5e251943d59de8b2d640643a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b902932050be4c04bca1de4fe268c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:24.291220 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5cbed35d-d975-465c-8e90-5391e8eeacd2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 200 len: 1305 microversion: 2.1 time: 0.381513 Aug 27 04:44:24.293194 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1556/3162] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:23 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 1305 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:25.264487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45288066-669a-4013-a846-6c4c3dbd11a2 tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] Calling method '.version_select at 0x7f1f20df59d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:25.304131 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-45288066-669a-4013-a846-6c4c3dbd11a2 tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] HTTP exception thrown: Volume 3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 could not be found. Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45288066-669a-4013-a846-6c4c3dbd11a2 tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] Request method failure captured: Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 HTTP/1.1 Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaEg-MCcOZlZticcGkqlxABigNlE9aarYmzGFx3QYI7grDen8i9NlmdcOIv06p8W6gXuCVbg4cwd-7FwsNb2OtnGo0SQHNL1YweYv76UbshiT49dP7pL4nc1gQU-BjLzvgiOFvaHVfQ88HlRXDaEXMZGY7CqXaRPoivOwy121wsf5T4 Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cb154261b2844f518b801ca2f3c9007a Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesGetTestJSON-1253224515 Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cb154261b2844f518b801ca2f3c9007a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cb154261b2844f518b801ca2f3c9007a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cb154261b2844f518b801ca2f3c9007a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cb154261b2844f518b801ca2f3c9007a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesGetTestJSON-1253224515 Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cb154261b2844f518b801ca2f3c9007a Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesGetTestJSON-1253224515 Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-VolumesGetTestJSON-1253224515-project Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 3b9ef607bd5546c296fef5ffecc4edc2 Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesGetTestJSON-1253224515-project Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: exception: Volume 3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 could not be found. Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '3e8de9aa-ca3c-4018-8941-bb38ba26e6c6'} Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 could not be found. (HTTP 404) (Request-ID: req-a92e31c9-bfb0-482b-b226-f10d9b8c3c78) Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 04:44:25.306525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 could not be found. Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 could not be found. Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 could not be found. Aug 27 04:44:25.311077 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.316624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45288066-669a-4013-a846-6c4c3dbd11a2 tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] Returning 404 to user: Volume 3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:25.316624 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45288066-669a-4013-a846-6c4c3dbd11a2 tempest-VolumesGetTestJSON-1253224515 tempest-VolumesGetTestJSON-1253224515-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6" status: 404 len: 109 microversion: 2.1 time: 0.057726 Aug 27 04:44:25.319892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a78de525-d80f-4eae-84e2-900d6c258def tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:25.320719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a78de525-d80f-4eae-84e2-900d6c258def tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:25.322425 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1607/3163] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 04:44:25 2022] GET /compute/v2.1/os-volumes/3e8de9aa-ca3c-4018-8941-bb38ba26e6c6 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:25.332957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78de525-d80f-4eae-84e2-900d6c258def tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.333446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78de525-d80f-4eae-84e2-900d6c258def tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.334434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78de525-d80f-4eae-84e2-900d6c258def tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.335174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78de525-d80f-4eae-84e2-900d6c258def tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.340034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78de525-d80f-4eae-84e2-900d6c258def tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.345569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78de525-d80f-4eae-84e2-900d6c258def tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.373814 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-a78de525-d80f-4eae-84e2-900d6c258def tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a78de525-d80f-4eae-84e2-900d6c258def tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf HTTP/1.1 Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '0778ea23-5cf7-420f-94d9-4f43f79bf8bf'} Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.379368 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.383981 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.383981 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.383981 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.383981 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:25.383981 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:25.383981 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.383981 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.387401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a78de525-d80f-4eae-84e2-900d6c258def tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:25.390539 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a78de525-d80f-4eae-84e2-900d6c258def tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 404 len: 111 microversion: 2.1 time: 0.075749 Aug 27 04:44:25.391342 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1557/3164] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:25 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:44:25.411262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b0fb4a1a-fcca-4da4-a0e6-271d1307cbd5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:25.411802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b0fb4a1a-fcca-4da4-a0e6-271d1307cbd5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:25.425789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fb4a1a-fcca-4da4-a0e6-271d1307cbd5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.426308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fb4a1a-fcca-4da4-a0e6-271d1307cbd5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.426759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fb4a1a-fcca-4da4-a0e6-271d1307cbd5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.427488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fb4a1a-fcca-4da4-a0e6-271d1307cbd5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.428478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fb4a1a-fcca-4da4-a0e6-271d1307cbd5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.429126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fb4a1a-fcca-4da4-a0e6-271d1307cbd5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.490964 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b0fb4a1a-fcca-4da4-a0e6-271d1307cbd5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b0fb4a1a-fcca-4da4-a0e6-271d1307cbd5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf HTTP/1.1 Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '0778ea23-5cf7-420f-94d9-4f43f79bf8bf'} Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:25.494879 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:25.498856 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.498856 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.498856 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.498856 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.498856 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.498856 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.498856 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.498856 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:25.498856 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:25.498856 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.498856 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.503816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b0fb4a1a-fcca-4da4-a0e6-271d1307cbd5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:25.506825 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b0fb4a1a-fcca-4da4-a0e6-271d1307cbd5 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 404 len: 111 microversion: 2.1 time: 0.099623 Aug 27 04:44:25.518459 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1608/3165] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:44:25 2022] DELETE /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:25.527184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1e34619b-85e0-48c7-85d1-7e59f033d7df tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:25.528773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1e34619b-85e0-48c7-85d1-7e59f033d7df tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0778ea23-5cf7-420f-94d9-4f43f79bf8bf] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:25.541885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e34619b-85e0-48c7-85d1-7e59f033d7df tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.545316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e34619b-85e0-48c7-85d1-7e59f033d7df tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.546052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e34619b-85e0-48c7-85d1-7e59f033d7df tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.548821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e34619b-85e0-48c7-85d1-7e59f033d7df tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.550225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e34619b-85e0-48c7-85d1-7e59f033d7df tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.550962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e34619b-85e0-48c7-85d1-7e59f033d7df tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.594063 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-1e34619b-85e0-48c7-85d1-7e59f033d7df tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1e34619b-85e0-48c7-85d1-7e59f033d7df tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf HTTP/1.1 Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '0778ea23-5cf7-420f-94d9-4f43f79bf8bf'} Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.602137 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.605985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.605985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.605985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.605985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:25.605985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:25.605985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. Aug 27 04:44:25.605985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.610188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1e34619b-85e0-48c7-85d1-7e59f033d7df tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance 0778ea23-5cf7-420f-94d9-4f43f79bf8bf could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:25.614588 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1e34619b-85e0-48c7-85d1-7e59f033d7df tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf" status: 404 len: 111 microversion: 2.1 time: 0.091261 Aug 27 04:44:25.616844 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1558/3166] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:25 2022] GET /compute/v2.1/servers/0778ea23-5cf7-420f-94d9-4f43f79bf8bf => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:25.626114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0335f8f7-9ac9-4b1d-8ec1-2a1808f449b2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:25.627606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0335f8f7-9ac9-4b1d-8ec1-2a1808f449b2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:25.641747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0335f8f7-9ac9-4b1d-8ec1-2a1808f449b2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.642524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0335f8f7-9ac9-4b1d-8ec1-2a1808f449b2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.645642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0335f8f7-9ac9-4b1d-8ec1-2a1808f449b2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.647320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0335f8f7-9ac9-4b1d-8ec1-2a1808f449b2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.647810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0335f8f7-9ac9-4b1d-8ec1-2a1808f449b2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.648240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0335f8f7-9ac9-4b1d-8ec1-2a1808f449b2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.682210 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0335f8f7-9ac9-4b1d-8ec1-2a1808f449b2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0335f8f7-9ac9-4b1d-8ec1-2a1808f449b2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c HTTP/1.1 Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c'} Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:25.693781 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:25.698852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:44:25.698852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.698852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.698852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.698852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.698852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.698852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.698852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:25.698852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:25.698852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:44:25.698852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.698852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0335f8f7-9ac9-4b1d-8ec1-2a1808f449b2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:25.698852 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0335f8f7-9ac9-4b1d-8ec1-2a1808f449b2 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 404 len: 111 microversion: 2.1 time: 0.073941 Aug 27 04:44:25.698852 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1609/3167] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:44:25 2022] DELETE /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:44:25.706024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e3f984e7-2869-487a-81db-eefdaaa2c227 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:25.706833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e3f984e7-2869-487a-81db-eefdaaa2c227 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:25.719941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3f984e7-2869-487a-81db-eefdaaa2c227 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.723267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3f984e7-2869-487a-81db-eefdaaa2c227 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.726192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3f984e7-2869-487a-81db-eefdaaa2c227 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.727173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3f984e7-2869-487a-81db-eefdaaa2c227 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.729641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3f984e7-2869-487a-81db-eefdaaa2c227 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.730540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3f984e7-2869-487a-81db-eefdaaa2c227 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.793655 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-e3f984e7-2869-487a-81db-eefdaaa2c227 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e3f984e7-2869-487a-81db-eefdaaa2c227 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c HTTP/1.1 Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c'} Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.795224 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.803704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.803704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.803704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.803704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:25.803704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:25.803704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. Aug 27 04:44:25.803704 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.803704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e3f984e7-2869-487a-81db-eefdaaa2c227 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:25.803704 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e3f984e7-2869-487a-81db-eefdaaa2c227 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c" status: 404 len: 111 microversion: 2.1 time: 0.095454 Aug 27 04:44:25.803704 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1559/3168] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:25 2022] GET /compute/v2.1/servers/bd7d9c18-86b1-48f5-88c5-84e9bfe49c9c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:25.806056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-114a9d35-5fc0-4598-9be5-79e4c16682aa tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:25.806579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-114a9d35-5fc0-4598-9be5-79e4c16682aa tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:25.815244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-114a9d35-5fc0-4598-9be5-79e4c16682aa tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.815766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-114a9d35-5fc0-4598-9be5-79e4c16682aa tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.816389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-114a9d35-5fc0-4598-9be5-79e4c16682aa tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.817498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-114a9d35-5fc0-4598-9be5-79e4c16682aa tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.817969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-114a9d35-5fc0-4598-9be5-79e4c16682aa tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.819366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-114a9d35-5fc0-4598-9be5-79e4c16682aa tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.861710 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-114a9d35-5fc0-4598-9be5-79e4c16682aa tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-114a9d35-5fc0-4598-9be5-79e4c16682aa tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 HTTP/1.1 Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '4549183c-6ddf-442e-a0fd-6abba4b648c3'} Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:25.867378 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:25.871816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:44:25.871816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.871816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.871816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.871816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.871816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.871816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.871816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:25.871816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:25.871816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:44:25.871816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.876775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-114a9d35-5fc0-4598-9be5-79e4c16682aa tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:25.881034 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-114a9d35-5fc0-4598-9be5-79e4c16682aa tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 404 len: 111 microversion: 2.1 time: 0.078684 Aug 27 04:44:25.883474 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1610/3169] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:44:25 2022] DELETE /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:25.891926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5def2961-ef8c-4e56-bb25-56c1f186a234 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:25.893064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5def2961-ef8c-4e56-bb25-56c1f186a234 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 4549183c-6ddf-442e-a0fd-6abba4b648c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:25.903500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5def2961-ef8c-4e56-bb25-56c1f186a234 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.905549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5def2961-ef8c-4e56-bb25-56c1f186a234 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.906961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5def2961-ef8c-4e56-bb25-56c1f186a234 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.918466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5def2961-ef8c-4e56-bb25-56c1f186a234 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.919129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5def2961-ef8c-4e56-bb25-56c1f186a234 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.920136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5def2961-ef8c-4e56-bb25-56c1f186a234 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.942740 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-5def2961-ef8c-4e56-bb25-56c1f186a234 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5def2961-ef8c-4e56-bb25-56c1f186a234 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 HTTP/1.1 Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '4549183c-6ddf-442e-a0fd-6abba4b648c3'} Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:25.944940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.953801 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:25.953801 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:25.953801 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:25.953801 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:25.953801 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:25.953801 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. Aug 27 04:44:25.953801 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:25.953801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5def2961-ef8c-4e56-bb25-56c1f186a234 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance 4549183c-6ddf-442e-a0fd-6abba4b648c3 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:25.953801 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5def2961-ef8c-4e56-bb25-56c1f186a234 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3" status: 404 len: 111 microversion: 2.1 time: 0.058970 Aug 27 04:44:25.955723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1447352d-b110-444f-bc40-4811cf1c1a47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:25.956456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1447352d-b110-444f-bc40-4811cf1c1a47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:25.970467 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1560/3170] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:25 2022] GET /compute/v2.1/servers/4549183c-6ddf-442e-a0fd-6abba4b648c3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:25.972094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1447352d-b110-444f-bc40-4811cf1c1a47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.972828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1447352d-b110-444f-bc40-4811cf1c1a47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.973466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1447352d-b110-444f-bc40-4811cf1c1a47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:25.974893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1447352d-b110-444f-bc40-4811cf1c1a47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:25.975593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1447352d-b110-444f-bc40-4811cf1c1a47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:25.976542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1447352d-b110-444f-bc40-4811cf1c1a47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:26.014834 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1447352d-b110-444f-bc40-4811cf1c1a47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1447352d-b110-444f-bc40-4811cf1c1a47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 HTTP/1.1 Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'a0c55941-6705-4a1a-8e95-21886e1499f3'} Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:26.016811 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:26.021697 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:44:26.021697 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.021697 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:26.021697 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.021697 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:26.021697 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:26.021697 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:26.021697 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:26.021697 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:26.021697 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:44:26.021697 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.021697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1447352d-b110-444f-bc40-4811cf1c1a47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:26.025586 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1447352d-b110-444f-bc40-4811cf1c1a47 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 404 len: 111 microversion: 2.1 time: 0.073892 Aug 27 04:44:26.026590 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1611/3171] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:44:25 2022] DELETE /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:44:26.034616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0311b696-00e1-49f6-b24c-915bb2545054 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:26.035562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0311b696-00e1-49f6-b24c-915bb2545054 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: a0c55941-6705-4a1a-8e95-21886e1499f3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:26.052076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0311b696-00e1-49f6-b24c-915bb2545054 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:26.053471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0311b696-00e1-49f6-b24c-915bb2545054 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:26.054890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0311b696-00e1-49f6-b24c-915bb2545054 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:26.055827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0311b696-00e1-49f6-b24c-915bb2545054 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:26.056749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0311b696-00e1-49f6-b24c-915bb2545054 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:26.057374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0311b696-00e1-49f6-b24c-915bb2545054 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:26.081693 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-0311b696-00e1-49f6-b24c-915bb2545054 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0311b696-00e1-49f6-b24c-915bb2545054 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 HTTP/1.1 Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'a0c55941-6705-4a1a-8e95-21886e1499f3'} Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:26.098504 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.103816 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:26.103816 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:26.103816 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:26.103816 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:26.103816 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:26.103816 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. Aug 27 04:44:26.103816 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.103816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0311b696-00e1-49f6-b24c-915bb2545054 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance a0c55941-6705-4a1a-8e95-21886e1499f3 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:26.109264 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0311b696-00e1-49f6-b24c-915bb2545054 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3" status: 404 len: 111 microversion: 2.1 time: 0.072632 Aug 27 04:44:26.113074 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1561/3172] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:26 2022] GET /compute/v2.1/servers/a0c55941-6705-4a1a-8e95-21886e1499f3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:26.122079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-056cd1aa-b38f-4499-9b2e-c55be473c90c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:26.122780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-056cd1aa-b38f-4499-9b2e-c55be473c90c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: fee11b39-0c51-4f70-b911-6b111653c849] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:26.132633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-056cd1aa-b38f-4499-9b2e-c55be473c90c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:26.136518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-056cd1aa-b38f-4499-9b2e-c55be473c90c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:26.137227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-056cd1aa-b38f-4499-9b2e-c55be473c90c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:26.138273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-056cd1aa-b38f-4499-9b2e-c55be473c90c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:26.139535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-056cd1aa-b38f-4499-9b2e-c55be473c90c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:26.140957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-056cd1aa-b38f-4499-9b2e-c55be473c90c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:26.187837 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-056cd1aa-b38f-4499-9b2e-c55be473c90c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-056cd1aa-b38f-4499-9b2e-c55be473c90c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849 HTTP/1.1 Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'fee11b39-0c51-4f70-b911-6b111653c849'} Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:26.194829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:26.200919 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:44:26.200919 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.200919 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:26.200919 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.200919 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:26.200919 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:26.200919 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:26.200919 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:26.200919 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:26.200919 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:44:26.200919 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.202821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-056cd1aa-b38f-4499-9b2e-c55be473c90c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:26.215858 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-056cd1aa-b38f-4499-9b2e-c55be473c90c tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849" status: 404 len: 111 microversion: 2.1 time: 0.095035 Aug 27 04:44:26.216441 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1612/3173] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:44:26 2022] DELETE /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:26.226284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-215f2d1e-c582-4900-a211-062ddd226470 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:26.227221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-215f2d1e-c582-4900-a211-062ddd226470 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: fee11b39-0c51-4f70-b911-6b111653c849] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:26.229727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:26.255480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-215f2d1e-c582-4900-a211-062ddd226470 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:26.260602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-215f2d1e-c582-4900-a211-062ddd226470 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:26.262024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-215f2d1e-c582-4900-a211-062ddd226470 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:26.267557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-215f2d1e-c582-4900-a211-062ddd226470 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:26.268410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-215f2d1e-c582-4900-a211-062ddd226470 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:26.269203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-215f2d1e-c582-4900-a211-062ddd226470 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:26.338757 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-215f2d1e-c582-4900-a211-062ddd226470 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-215f2d1e-c582-4900-a211-062ddd226470 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849 HTTP/1.1 Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'fee11b39-0c51-4f70-b911-6b111653c849'} Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:26.351118 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.355940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:26.355940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:26.355940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:26.355940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:26.355940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:26.355940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. Aug 27 04:44:26.355940 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:26.357675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-215f2d1e-c582-4900-a211-062ddd226470 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance fee11b39-0c51-4f70-b911-6b111653c849 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:26.363506 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-215f2d1e-c582-4900-a211-062ddd226470 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849" status: 404 len: 111 microversion: 2.1 time: 0.138555 Aug 27 04:44:26.365486 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1562/3174] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:26 2022] GET /compute/v2.1/servers/fee11b39-0c51-4f70-b911-6b111653c849 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:31.268330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=20 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:32.054531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2aaab87f-7cf4-4f03-b1d6-350adeb009d3 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Action: 'create', calling method: .version_select at 0x7f1f20dc1670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-155442160", "description": "tempest-description-2119479781"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:33.191032 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2aaab87f-7cf4-4f03-b1d6-350adeb009d3 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.929295 Aug 27 04:44:33.200857 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1613/3175] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:44:31 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:33.207856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6e4c8ae7-d76b-4c46-a4e3-c21f77a0287e tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Action: 'create', calling method: .version_select at 0x7f1f2116caf0>, body: {"security_group_rule": {"parent_group_id": "1526be8e-4c54-4b7b-b89f-ebbef747f016", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:33.213658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:35.732271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f2bf36e6-db4f-494b-adce-1e19797cf0f4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:35.732949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f2bf36e6-db4f-494b-adce-1e19797cf0f4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:35.750571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2bf36e6-db4f-494b-adce-1e19797cf0f4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:35.763633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2bf36e6-db4f-494b-adce-1e19797cf0f4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:35.764706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2bf36e6-db4f-494b-adce-1e19797cf0f4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:35.767820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2bf36e6-db4f-494b-adce-1e19797cf0f4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:35.768556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2bf36e6-db4f-494b-adce-1e19797cf0f4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:35.772331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2bf36e6-db4f-494b-adce-1e19797cf0f4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:35.816616 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f2bf36e6-db4f-494b-adce-1e19797cf0f4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f2bf36e6-db4f-494b-adce-1e19797cf0f4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 HTTP/1.1 Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '0f1e5e54-0d90-49a2-96ec-29f55ab91060'} Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:35.825450 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:35.830317 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:44:35.830317 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:35.830317 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:35.830317 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:35.830317 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:35.830317 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:35.830317 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:35.830317 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:35.830317 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:35.830317 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:44:35.830317 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:35.830317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f2bf36e6-db4f-494b-adce-1e19797cf0f4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:35.832615 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f2bf36e6-db4f-494b-adce-1e19797cf0f4 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 404 len: 111 microversion: 2.1 time: 0.105105 Aug 27 04:44:35.833297 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1614/3176] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:44:35 2022] DELETE /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:35.853265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b94871b1-5977-4bd3-9a47-f12497ce6ecf tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:35.854301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b94871b1-5977-4bd3-9a47-f12497ce6ecf tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: 0f1e5e54-0d90-49a2-96ec-29f55ab91060] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:35.878277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b94871b1-5977-4bd3-9a47-f12497ce6ecf tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:35.878912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b94871b1-5977-4bd3-9a47-f12497ce6ecf tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:35.881752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b94871b1-5977-4bd3-9a47-f12497ce6ecf tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:35.884500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b94871b1-5977-4bd3-9a47-f12497ce6ecf tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:35.886347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b94871b1-5977-4bd3-9a47-f12497ce6ecf tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:35.888444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b94871b1-5977-4bd3-9a47-f12497ce6ecf tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:35.949451 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b94871b1-5977-4bd3-9a47-f12497ce6ecf tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b94871b1-5977-4bd3-9a47-f12497ce6ecf tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 HTTP/1.1 Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '0f1e5e54-0d90-49a2-96ec-29f55ab91060'} Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:35.957660 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:35.963878 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:35.963878 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:35.963878 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:35.963878 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:35.963878 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:35.963878 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. Aug 27 04:44:35.963878 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:35.963878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b94871b1-5977-4bd3-9a47-f12497ce6ecf tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance 0f1e5e54-0d90-49a2-96ec-29f55ab91060 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:35.971042 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b94871b1-5977-4bd3-9a47-f12497ce6ecf tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060" status: 404 len: 111 microversion: 2.1 time: 0.114872 Aug 27 04:44:35.971903 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1615/3177] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:35 2022] GET /compute/v2.1/servers/0f1e5e54-0d90-49a2-96ec-29f55ab91060 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:35.984000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed3c02d4-8f04-4b22-80c8-0ed0f89ab104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:35.984874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ed3c02d4-8f04-4b22-80c8-0ed0f89ab104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:36.003545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed3c02d4-8f04-4b22-80c8-0ed0f89ab104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:36.004171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed3c02d4-8f04-4b22-80c8-0ed0f89ab104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:36.004779 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6e4c8ae7-d76b-4c46-a4e3-c21f77a0287e tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.802604 Aug 27 04:44:36.006679 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1563/3178] 10.222.0.79 () {60 vars in 1195 bytes} [Sat Aug 27 04:44:33 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:36.006948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed3c02d4-8f04-4b22-80c8-0ed0f89ab104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:36.013210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed3c02d4-8f04-4b22-80c8-0ed0f89ab104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:36.013913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed3c02d4-8f04-4b22-80c8-0ed0f89ab104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:36.015067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed3c02d4-8f04-4b22-80c8-0ed0f89ab104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:36.020059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1fce04d7-06e2-400b-98e3-da7b9af083f9 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Action: 'create', calling method: .version_select at 0x7f1f211bb700>, body: {"security_group_rule": {"parent_group_id": "1526be8e-4c54-4b7b-b89f-ebbef747f016", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:36.045914 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ed3c02d4-8f04-4b22-80c8-0ed0f89ab104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed3c02d4-8f04-4b22-80c8-0ed0f89ab104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d HTTP/1.1 Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'd0335025-7f4b-4576-a817-72f93df40d5d'} Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:36.050075 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:36.054463 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:44:36.054463 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:36.054463 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:36.054463 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:36.054463 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:36.054463 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:36.054463 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:36.054463 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:36.054463 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:36.054463 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:44:36.054463 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:36.062313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed3c02d4-8f04-4b22-80c8-0ed0f89ab104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:36.063612 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ed3c02d4-8f04-4b22-80c8-0ed0f89ab104 tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 404 len: 111 microversion: 2.1 time: 0.087528 Aug 27 04:44:36.070145 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1616/3179] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:44:35 2022] DELETE /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:44:36.075786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d27f5f7e-8d6e-4640-b102-46add06d9d2a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:36.083983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d27f5f7e-8d6e-4640-b102-46add06d9d2a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] [instance: d0335025-7f4b-4576-a817-72f93df40d5d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:36.091032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d27f5f7e-8d6e-4640-b102-46add06d9d2a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:36.101291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d27f5f7e-8d6e-4640-b102-46add06d9d2a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:36.101971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d27f5f7e-8d6e-4640-b102-46add06d9d2a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:36.102867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d27f5f7e-8d6e-4640-b102-46add06d9d2a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:36.103482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d27f5f7e-8d6e-4640-b102-46add06d9d2a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:36.104017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d27f5f7e-8d6e-4640-b102-46add06d9d2a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:36.133566 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d27f5f7e-8d6e-4640-b102-46add06d9d2a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] HTTP exception thrown: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d27f5f7e-8d6e-4640-b102-46add06d9d2a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Request method failure captured: Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d HTTP/1.1 Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCZ_LcSvW5exTMDxP0l6Qjnhs726fs3usb6l2qsiSMXAYvbeAUQEsOh0FI6Gz7jt4I7HKkK78bD2pPGJBWAGJvrGRrB5hxon8rrO0m2XDqZkQhqQXxqcf87WhvChnoohtzxCIJexZDg-GSAB8VHVD7yM6wDVBJA3dJJhS6a6ZsOqEFPA Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b902932050be4c04bca1de4fe268c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b902932050be4c04bca1de4fe268c2b0 Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-505010867 Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 6c59dc5e251943d59de8b2d640643a0e Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-505010867-project Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'd0335025-7f4b-4576-a817-72f93df40d5d'} Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:36.136784 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:36.140712 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:36.140712 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:36.140712 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:36.140712 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:36.140712 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:36.140712 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. Aug 27 04:44:36.140712 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:36.147423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d27f5f7e-8d6e-4640-b102-46add06d9d2a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] Returning 404 to user: Instance d0335025-7f4b-4576-a817-72f93df40d5d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:36.152040 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d27f5f7e-8d6e-4640-b102-46add06d9d2a tempest-DeleteServersTestJSON-505010867 tempest-DeleteServersTestJSON-505010867-project] 10.222.0.79 "GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d" status: 404 len: 111 microversion: 2.1 time: 0.080281 Aug 27 04:44:36.153159 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1617/3180] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:36 2022] GET /compute/v2.1/servers/d0335025-7f4b-4576-a817-72f93df40d5d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:36.292292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:37.085325 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-1fce04d7-06e2-400b-98e3-da7b9af083f9 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] HTTP exception thrown: This rule already exists in group 1526be8e-4c54-4b7b-b89f-ebbef747f016 Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1fce04d7-06e2-400b-98e3-da7b9af083f9 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Request method failure captured: Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 138 Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaEvfFa9aq2Q1Dn1BRiX8SYE2F2T0RkgNYRwhz6vpU9KDCj5WQuTui_IA9WlAYjoBx3sP9muzZEUXCMN4UYjnpOMPoAXOBqK6G0NX1745mACHPpvsg65691twnj30HQa-g9r90oOscx7qp6BoRwVE-Nlpkj1GeIIhgXOKODtCUZoHoY Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_af00585c17534fe2a505026fa4b23c95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8660724680e348888c18cf092fbfca93 Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: {"security_group_rule": {"parent_group_id": "1526be8e-4c54-4b7b-b89f-ebbef747f016", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: exception: This rule already exists in group 1526be8e-4c54-4b7b-b89f-ebbef747f016 Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1526be8e-4c54-4b7b-b89f-ebbef747f016', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 1526be8e-4c54-4b7b-b89f-ebbef747f016 Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 1526be8e-4c54-4b7b-b89f-ebbef747f016 Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:37.086974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:37.092546 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:37.092546 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:37.092546 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 1526be8e-4c54-4b7b-b89f-ebbef747f016 Aug 27 04:44:37.092546 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:37.092546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1fce04d7-06e2-400b-98e3-da7b9af083f9 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Returning 400 to user: This rule already exists in group 1526be8e-4c54-4b7b-b89f-ebbef747f016 {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:37.092546 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1fce04d7-06e2-400b-98e3-da7b9af083f9 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 1.074170 Aug 27 04:44:37.094448 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1564/3181] 10.222.0.79 () {60 vars in 1195 bytes} [Sat Aug 27 04:44:36 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 1080 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:44:37.098535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5eaf6829-74b6-4c32-bf1d-399c3fefa1f7 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Calling method '.version_select at 0x7f1f20dc1f70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:37.863424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3d87fd2f-8e2e-4e1a-b323-69274a1ef938 tempest-FloatingIPDetailsNegativeTestJSON-1941349554 tempest-FloatingIPDetailsNegativeTestJSON-1941349554-project] Calling method '.version_select at 0x7f1f21167700>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:38.010793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG neutronclient.v2_0.client [None req-3d87fd2f-8e2e-4e1a-b323-69274a1ef938 tempest-FloatingIPDetailsNegativeTestJSON-1941349554 tempest-FloatingIPDetailsNegativeTestJSON-1941349554-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 049bf180-898f-4105-9fc4-3f06ea1922f3 could not be found", "detail": ""}} {{(pid=128870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:44:38.013267 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-3d87fd2f-8e2e-4e1a-b323-69274a1ef938 tempest-FloatingIPDetailsNegativeTestJSON-1941349554 tempest-FloatingIPDetailsNegativeTestJSON-1941349554-project] HTTP exception thrown: Floating IP not found for ID 049bf180-898f-4105-9fc4-3f06ea1922f3 Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3d87fd2f-8e2e-4e1a-b323-69274a1ef938 tempest-FloatingIPDetailsNegativeTestJSON-1941349554 tempest-FloatingIPDetailsNegativeTestJSON-1941349554-project] Request method failure captured: Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-floating-ips/049bf180-898f-4105-9fc4-3f06ea1922f3 HTTP/1.1 Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaE1ZPqwYoU-ashRqb_Gng_EKSP6uWByOcp_gU--QX5eSJumCC4m3t0um85JK6iVmUODCnqZysQ2C7FxKe43Eg5UBlPKrmSCQQdESs7OYDff5KY-dwkkkd1s13U93J7Sq5wPFOuWJtzS_FcstSxWHcGvLiSZRlUjQYaXRYkjpnDneqQ Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 93f31fd277c8436e958e9d40da2d84ae Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1941349554 Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93f31fd277c8436e958e9d40da2d84ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_93f31fd277c8436e958e9d40da2d84ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/93f31fd277c8436e958e9d40da2d84ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93f31fd277c8436e958e9d40da2d84ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1941349554 Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 93f31fd277c8436e958e9d40da2d84ae Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1941349554 Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1941349554-project Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 53e63542cc59438c826ab39e5058b5ba Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1941349554-project Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: exception: Floating IP not found for ID 049bf180-898f-4105-9fc4-3f06ea1922f3 Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '049bf180-898f-4105-9fc4-3f06ea1922f3'} Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:44:38.013854 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 049bf180-898f-4105-9fc4-3f06ea1922f3 could not be found Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-17def2be-7b0f-49eb-99a3-ee7bc0737ef4'] Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 049bf180-898f-4105-9fc4-3f06ea1922f3. Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 049bf180-898f-4105-9fc4-3f06ea1922f3 Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 049bf180-898f-4105-9fc4-3f06ea1922f3 Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3d87fd2f-8e2e-4e1a-b323-69274a1ef938 tempest-FloatingIPDetailsNegativeTestJSON-1941349554 tempest-FloatingIPDetailsNegativeTestJSON-1941349554-project] Returning 404 to user: Floating IP not found for ID 049bf180-898f-4105-9fc4-3f06ea1922f3 {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:38.019280 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3d87fd2f-8e2e-4e1a-b323-69274a1ef938 tempest-FloatingIPDetailsNegativeTestJSON-1941349554 tempest-FloatingIPDetailsNegativeTestJSON-1941349554-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/049bf180-898f-4105-9fc4-3f06ea1922f3" status: 404 len: 111 microversion: 2.1 time: 0.408912 Aug 27 04:44:38.022237 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1565/3182] 10.222.0.79 () {58 vars in 1260 bytes} [Sat Aug 27 04:44:37 2022] GET /compute/v2.1/os-floating-ips/049bf180-898f-4105-9fc4-3f06ea1922f3 => generated 111 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:39.068981 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5eaf6829-74b6-4c32-bf1d-399c3fefa1f7 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-group-rules/c6355be9-47ee-4db6-ab01-3029ab6e840e" status: 202 len: 0 microversion: 2.1 time: 1.974869 Aug 27 04:44:39.073488 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1618/3183] 10.222.0.79 () {58 vars in 1287 bytes} [Sat Aug 27 04:44:37 2022] DELETE /compute/v2.1/os-security-group-rules/c6355be9-47ee-4db6-ab01-3029ab6e840e => generated 0 bytes in 1977 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:44:39.081004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3624d6cf-3a94-4cf2-9c97-78bb8861b222 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Action: 'create', calling method: .version_select at 0x7f1f21109940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1070167672", "description": "tempest-description-2138032040"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:41.117368 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3624d6cf-3a94-4cf2-9c97-78bb8861b222 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 2.042215 Aug 27 04:44:41.132771 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1566/3184] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:44:39 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 2058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:41.134111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-deafa7da-dc4e-4338-8ba6-c3fa4bf0317c tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Action: 'create', calling method: .version_select at 0x7f1f20e61430>, body: {"security_group_rule": {"parent_group_id": "781d98a9-fa40-481d-bf89-53b0b17f16ec", "ip_protocol": "tcp", "from_port": 2124190783, "to_port": 22}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:41.495788 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-deafa7da-dc4e-4338-8ba6-c3fa4bf0317c tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] HTTP exception thrown: Invalid port range 2124190783:22. Former value cannot be greater than the later Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-deafa7da-dc4e-4338-8ba6-c3fa4bf0317c tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Request method failure captured: Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 146 Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaEvfFa9aq2Q1Dn1BRiX8SYE2F2T0RkgNYRwhz6vpU9KDCj5WQuTui_IA9WlAYjoBx3sP9muzZEUXCMN4UYjnpOMPoAXOBqK6G0NX1745mACHPpvsg65691twnj30HQa-g9r90oOscx7qp6BoRwVE-Nlpkj1GeIIhgXOKODtCUZoHoY Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_af00585c17534fe2a505026fa4b23c95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8660724680e348888c18cf092fbfca93 Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: {"security_group_rule": {"parent_group_id": "781d98a9-fa40-481d-bf89-53b0b17f16ec", "ip_protocol": "tcp", "from_port": 2124190783, "to_port": 22}} Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid port range 2124190783:22. Former value cannot be greater than the later Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'security_group_rule': {'parent_group_id': '781d98a9-fa40-481d-bf89-53b0b17f16ec', 'ip_protocol': 'tcp', 'from_port': 2124190783, 'to_port': 22}}} Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 2124190783:22. Former value cannot be greater than the later Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 2124190783:22. Former value cannot be greater than the later Aug 27 04:44:41.497476 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:41.501575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:41.501575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:41.501575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:41.501575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:41.501575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:41.501575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:41.501575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:41.501575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 2124190783:22. Former value cannot be greater than the later Aug 27 04:44:41.501575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:41.501575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-deafa7da-dc4e-4338-8ba6-c3fa4bf0317c tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Returning 400 to user: Invalid port range 2124190783:22. Former value cannot be greater than the later {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:41.517373 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-deafa7da-dc4e-4338-8ba6-c3fa4bf0317c tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.380887 Aug 27 04:44:41.518043 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1619/3185] 10.222.0.79 () {60 vars in 1195 bytes} [Sat Aug 27 04:44:41 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 391 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:44:41.541035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-20542330-22bc-48b9-b442-720b38ab4f90 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Action: 'create', calling method: .version_select at 0x7f1f210fe940>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-941680492", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:41.544868 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-20542330-22bc-48b9-b442-720b38ab4f90 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] HTTP exception thrown: Security group id should be uuid Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-20542330-22bc-48b9-b442-720b38ab4f90 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Request method failure captured: Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 130 Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaEvfFa9aq2Q1Dn1BRiX8SYE2F2T0RkgNYRwhz6vpU9KDCj5WQuTui_IA9WlAYjoBx3sP9muzZEUXCMN4UYjnpOMPoAXOBqK6G0NX1745mACHPpvsg65691twnj30HQa-g9r90oOscx7qp6BoRwVE-Nlpkj1GeIIhgXOKODtCUZoHoY Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_af00585c17534fe2a505026fa4b23c95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8660724680e348888c18cf092fbfca93 Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-941680492", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: exception: Security group id should be uuid Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-941680492', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:41.547066 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:41.551196 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 27 04:44:41.551196 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:41.558603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-20542330-22bc-48b9-b442-720b38ab4f90 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Returning 400 to user: Security group id should be uuid {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:41.561320 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-20542330-22bc-48b9-b442-720b38ab4f90 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.035760 Aug 27 04:44:41.566156 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1567/3186] 10.222.0.79 () {60 vars in 1195 bytes} [Sat Aug 27 04:44:41 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:41.578046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-916b98e1-3a8c-4609-a1e5-b0b7072598fe tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Action: 'create', calling method: .version_select at 0x7f1f20df5d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1786590042", "description": "tempest-description-962891029"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:42.950018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1932398696", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": "none"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:43.103696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:44:43.104050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:44:43.104553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:44:43.106195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:44:43.108357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:44:43.137507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:43.138016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:43.138464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:43.139197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:43.139657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:43.140084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:43.218352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Getting quotas for project a7f0761664fd4c0a87bbf5b4d350ce0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:44:43.228676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Getting quotas for user 546a39f0e78c464db553f22d07a707bc and project a7f0761664fd4c0a87bbf5b4d350ce0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:44:43.263525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:44:43.268166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:44:43.278387 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-916b98e1-3a8c-4609-a1e5-b0b7072598fe tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.704986 Aug 27 04:44:43.283108 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1620/3187] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:44:41 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:43.293174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc448989-7137-45a3-a34c-e6df4cfed7cb tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Action: 'create', calling method: .version_select at 0x7f1f20e5a940>, body: {"security_group_rule": {"parent_group_id": "89f6f02e-27ff-4d8c-b84f-5767adb36b0d", "ip_protocol": "tempest-999-915620174", "from_port": 22, "to_port": 22}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:43.361681 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-22e1a7e0-ab7c-40c9-befc-2b0518cd1ac8 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.708719 Aug 27 04:44:43.369976 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1568/3188] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 04:44:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:44:43.385495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5f6027b9-50bc-4163-8807-d6afce192d7e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:43.388166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5f6027b9-50bc-4163-8807-d6afce192d7e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:43.583948 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-fc448989-7137-45a3-a34c-e6df4cfed7cb tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] HTTP exception thrown: Invalid IP protocol tempest-999-915620174. Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc448989-7137-45a3-a34c-e6df4cfed7cb tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Request method failure captured: Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 156 Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaEvfFa9aq2Q1Dn1BRiX8SYE2F2T0RkgNYRwhz6vpU9KDCj5WQuTui_IA9WlAYjoBx3sP9muzZEUXCMN4UYjnpOMPoAXOBqK6G0NX1745mACHPpvsg65691twnj30HQa-g9r90oOscx7qp6BoRwVE-Nlpkj1GeIIhgXOKODtCUZoHoY Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_af00585c17534fe2a505026fa4b23c95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8660724680e348888c18cf092fbfca93 Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: {"security_group_rule": {"parent_group_id": "89f6f02e-27ff-4d8c-b84f-5767adb36b0d", "ip_protocol": "tempest-999-915620174", "from_port": 22, "to_port": 22}} Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid IP protocol tempest-999-915620174. Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'security_group_rule': {'parent_group_id': '89f6f02e-27ff-4d8c-b84f-5767adb36b0d', 'ip_protocol': 'tempest-999-915620174', 'from_port': 22, 'to_port': 22}}} Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-915620174. Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-915620174. Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:43.595138 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:43.600291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:43.600291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:43.600291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:43.600291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:43.600291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:43.600291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:43.600291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-915620174. Aug 27 04:44:43.600291 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:43.600291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc448989-7137-45a3-a34c-e6df4cfed7cb tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Returning 400 to user: Invalid IP protocol tempest-999-915620174. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:43.600291 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc448989-7137-45a3-a34c-e6df4cfed7cb tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.310186 Aug 27 04:44:43.600291 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1621/3189] 10.222.0.79 () {60 vars in 1195 bytes} [Sat Aug 27 04:44:43 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 311 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 27 04:44:43.611029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-446e3c4d-e608-4677-a64a-08b2a2c2f29e tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Action: 'create', calling method: .version_select at 0x7f1f20e69b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2005258117", "description": "tempest-description-1378825320"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:44.491687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5f6027b9-50bc-4163-8807-d6afce192d7e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:44.508641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5f6027b9-50bc-4163-8807-d6afce192d7e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:44.510483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5f6027b9-50bc-4163-8807-d6afce192d7e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:44.524881 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5f6027b9-50bc-4163-8807-d6afce192d7e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "PUT /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1359 microversion: 2.75 time: 1.152642 Aug 27 04:44:44.529124 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1569/3190] 10.222.0.79 () {62 vars in 1297 bytes} [Sat Aug 27 04:44:43 2022] PUT /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1359 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:44:44.558347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ed1b7be1-77aa-4235-9615-8cd5a6409518 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:44.558985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ed1b7be1-77aa-4235-9615-8cd5a6409518 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:44.568944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed1b7be1-77aa-4235-9615-8cd5a6409518 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:44.569436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed1b7be1-77aa-4235-9615-8cd5a6409518 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:44.569869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed1b7be1-77aa-4235-9615-8cd5a6409518 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:44.576709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed1b7be1-77aa-4235-9615-8cd5a6409518 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:44.577242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed1b7be1-77aa-4235-9615-8cd5a6409518 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:44.579614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed1b7be1-77aa-4235-9615-8cd5a6409518 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:44.904078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed1b7be1-77aa-4235-9615-8cd5a6409518 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:44.913818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed1b7be1-77aa-4235-9615-8cd5a6409518 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:44.915256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed1b7be1-77aa-4235-9615-8cd5a6409518 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:44.937859 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ed1b7be1-77aa-4235-9615-8cd5a6409518 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1355 microversion: 2.75 time: 0.383639 Aug 27 04:44:44.952556 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1570/3191] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:44:44 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1355 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:44:45.141934 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-446e3c4d-e608-4677-a64a-08b2a2c2f29e tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.536813 Aug 27 04:44:45.143478 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1622/3192] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:44:43 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:45.156001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c70d3bfe-0ba8-46ad-8f05-c59c28f14122 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Action: 'create', calling method: .version_select at 0x7f1f211eae50>, body: {"security_group_rule": {"parent_group_id": "99085cce-c42b-43b1-99ed-291bf4748ea6", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:45.434191 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-c70d3bfe-0ba8-46ad-8f05-c59c28f14122 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c70d3bfe-0ba8-46ad-8f05-c59c28f14122 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Request method failure captured: Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 138 Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaEvfFa9aq2Q1Dn1BRiX8SYE2F2T0RkgNYRwhz6vpU9KDCj5WQuTui_IA9WlAYjoBx3sP9muzZEUXCMN4UYjnpOMPoAXOBqK6G0NX1745mACHPpvsg65691twnj30HQa-g9r90oOscx7qp6BoRwVE-Nlpkj1GeIIhgXOKODtCUZoHoY Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_af00585c17534fe2a505026fa4b23c95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8660724680e348888c18cf092fbfca93 Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: {"security_group_rule": {"parent_group_id": "99085cce-c42b-43b1-99ed-291bf4748ea6", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'security_group_rule': {'parent_group_id': '99085cce-c42b-43b1-99ed-291bf4748ea6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 04:44:45.435703 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:45.440323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:45.440323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:45.440323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:45.440323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:45.440323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:45.440323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:45.440323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:45.440323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 04:44:45.440323 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:45.440323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c70d3bfe-0ba8-46ad-8f05-c59c28f14122 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:45.440323 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c70d3bfe-0ba8-46ad-8f05-c59c28f14122 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.285684 Aug 27 04:44:45.443741 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1571/3193] 10.222.0.79 () {60 vars in 1195 bytes} [Sat Aug 27 04:44:45 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:44:45.449724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25c07dad-28d4-4740-8a0a-9d2ab4953476 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Action: 'create', calling method: .version_select at 0x7f1f20e611f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1708796947", "description": "tempest-description-146737085"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:45.971807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9caef117-a009-42d4-962c-a3e94beba930 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:45.972419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9caef117-a009-42d4-962c-a3e94beba930 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:45.989006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9caef117-a009-42d4-962c-a3e94beba930 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:45.990265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9caef117-a009-42d4-962c-a3e94beba930 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:45.992420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9caef117-a009-42d4-962c-a3e94beba930 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:45.996803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9caef117-a009-42d4-962c-a3e94beba930 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:45.999756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9caef117-a009-42d4-962c-a3e94beba930 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:46.000813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9caef117-a009-42d4-962c-a3e94beba930 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:46.093264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:46.134508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:46.457087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9caef117-a009-42d4-962c-a3e94beba930 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:46.489828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9caef117-a009-42d4-962c-a3e94beba930 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:46.495161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9caef117-a009-42d4-962c-a3e94beba930 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:46.511687 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9caef117-a009-42d4-962c-a3e94beba930 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1419 microversion: 2.75 time: 0.548089 Aug 27 04:44:46.518157 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1572/3194] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:44:45 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1419 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:44:46.591668 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25c07dad-28d4-4740-8a0a-9d2ab4953476 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.146043 Aug 27 04:44:46.594725 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1623/3195] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:44:45 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:44:46.609784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3f837338-aebf-43af-8767-077a1cc36cc9 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Action: 'create', calling method: .version_select at 0x7f1f21167700>, body: {"security_group_rule": {"parent_group_id": "b7f339cf-e8f4-48a3-a8b8-52563e3693e4", "ip_protocol": "tcp", "from_port": 22, "to_port": 1062172227}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:47.400625 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-3f837338-aebf-43af-8767-077a1cc36cc9 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] HTTP exception thrown: Invalid port range 22:1062172227. Valid TCP ports should be between 1-65535 Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3f837338-aebf-43af-8767-077a1cc36cc9 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Request method failure captured: Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 146 Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaEvfFa9aq2Q1Dn1BRiX8SYE2F2T0RkgNYRwhz6vpU9KDCj5WQuTui_IA9WlAYjoBx3sP9muzZEUXCMN4UYjnpOMPoAXOBqK6G0NX1745mACHPpvsg65691twnj30HQa-g9r90oOscx7qp6BoRwVE-Nlpkj1GeIIhgXOKODtCUZoHoY Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_af00585c17534fe2a505026fa4b23c95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8660724680e348888c18cf092fbfca93 Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: {"security_group_rule": {"parent_group_id": "b7f339cf-e8f4-48a3-a8b8-52563e3693e4", "ip_protocol": "tcp", "from_port": 22, "to_port": 1062172227}} Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid port range 22:1062172227. Valid TCP ports should be between 1-65535 Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b7f339cf-e8f4-48a3-a8b8-52563e3693e4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1062172227}}} Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1062172227. Valid TCP ports should be between 1-65535 Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1062172227. Valid TCP ports should be between 1-65535 Aug 27 04:44:47.403841 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:47.408836 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:47.408836 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:47.408836 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:47.408836 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:47.408836 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:47.408836 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:47.408836 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:47.408836 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1062172227. Valid TCP ports should be between 1-65535 Aug 27 04:44:47.408836 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:44:47.408836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3f837338-aebf-43af-8767-077a1cc36cc9 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Returning 400 to user: Invalid port range 22:1062172227. Valid TCP ports should be between 1-65535 {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:47.412713 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3f837338-aebf-43af-8767-077a1cc36cc9 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.807553 Aug 27 04:44:47.451896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49fef3eb-db27-4df9-97a0-9da3669302dc tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Action: 'create', calling method: .version_select at 0x7f1f20e69b80>, body: {"security_group_rule": {"parent_group_id": "86ffb1ec-3dff-4697-8e8c-dc047f48f6c1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:47.455483 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1573/3196] 10.222.0.79 () {60 vars in 1195 bytes} [Sat Aug 27 04:44:46 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 851 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:44:47.540291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-64bd2fa2-7bc7-464f-a39b-b919b509c167 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:47.542808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-64bd2fa2-7bc7-464f-a39b-b919b509c167 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:47.568805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64bd2fa2-7bc7-464f-a39b-b919b509c167 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:47.569515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64bd2fa2-7bc7-464f-a39b-b919b509c167 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:47.570157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64bd2fa2-7bc7-464f-a39b-b919b509c167 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:47.571050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64bd2fa2-7bc7-464f-a39b-b919b509c167 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:47.571667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64bd2fa2-7bc7-464f-a39b-b919b509c167 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:47.572253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64bd2fa2-7bc7-464f-a39b-b919b509c167 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:47.798451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-64bd2fa2-7bc7-464f-a39b-b919b509c167 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:47.809954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-64bd2fa2-7bc7-464f-a39b-b919b509c167 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:47.818964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-64bd2fa2-7bc7-464f-a39b-b919b509c167 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:47.848128 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-64bd2fa2-7bc7-464f-a39b-b919b509c167 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1417 microversion: 2.75 time: 0.312457 Aug 27 04:44:47.877044 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1574/3197] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:44:47 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1417 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:44:47.978774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-49fef3eb-db27-4df9-97a0-9da3669302dc tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 86ffb1ec-3dff-4697-8e8c-dc047f48f6c1 does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:44:47.980377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-49fef3eb-db27-4df9-97a0-9da3669302dc tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Neutron security group 86ffb1ec-3dff-4697-8e8c-dc047f48f6c1 not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:44:47.981164 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-49fef3eb-db27-4df9-97a0-9da3669302dc tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] HTTP exception thrown: Security group 86ffb1ec-3dff-4697-8e8c-dc047f48f6c1 does not exist Aug 27 04:44:47.981164 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-a9eb46e5-784b-478c-a1fe-901b8ed8a6b4'] Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49fef3eb-db27-4df9-97a0-9da3669302dc tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Request method failure captured: Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 138 Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaEvfFa9aq2Q1Dn1BRiX8SYE2F2T0RkgNYRwhz6vpU9KDCj5WQuTui_IA9WlAYjoBx3sP9muzZEUXCMN4UYjnpOMPoAXOBqK6G0NX1745mACHPpvsg65691twnj30HQa-g9r90oOscx7qp6BoRwVE-Nlpkj1GeIIhgXOKODtCUZoHoY Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_af00585c17534fe2a505026fa4b23c95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8660724680e348888c18cf092fbfca93 Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: {"security_group_rule": {"parent_group_id": "86ffb1ec-3dff-4697-8e8c-dc047f48f6c1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: exception: Security group 86ffb1ec-3dff-4697-8e8c-dc047f48f6c1 does not exist Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-a9eb46e5-784b-478c-a1fe-901b8ed8a6b4'] Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'security_group_rule': {'parent_group_id': '86ffb1ec-3dff-4697-8e8c-dc047f48f6c1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:44:47.984010 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 86ffb1ec-3dff-4697-8e8c-dc047f48f6c1 does not exist Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9eb46e5-784b-478c-a1fe-901b8ed8a6b4'] Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 86ffb1ec-3dff-4697-8e8c-dc047f48f6c1 does not exist Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9eb46e5-784b-478c-a1fe-901b8ed8a6b4'] Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 86ffb1ec-3dff-4697-8e8c-dc047f48f6c1 does not exist Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9eb46e5-784b-478c-a1fe-901b8ed8a6b4'] Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 86ffb1ec-3dff-4697-8e8c-dc047f48f6c1 does not exist Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9eb46e5-784b-478c-a1fe-901b8ed8a6b4'] Aug 27 04:44:47.987796 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:47.994865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49fef3eb-db27-4df9-97a0-9da3669302dc tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Returning 404 to user: Security group 86ffb1ec-3dff-4697-8e8c-dc047f48f6c1 does not exist Aug 27 04:44:47.994865 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-a9eb46e5-784b-478c-a1fe-901b8ed8a6b4'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:47.996448 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49fef3eb-db27-4df9-97a0-9da3669302dc tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.550576 Aug 27 04:44:47.997291 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1624/3198] 10.222.0.79 () {60 vars in 1195 bytes} [Sat Aug 27 04:44:47 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 553 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:44:48.011778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ffb24089-684d-4643-a594-9f8095d0c365 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Calling method '.version_select at 0x7f1f20d88790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:48.231392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-ffb24089-684d-4643-a594-9f8095d0c365 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 76946e14-aea5-4ccc-8cea-01ef4bab063d does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:44:48.232277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-ffb24089-684d-4643-a594-9f8095d0c365 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Neutron security group rule 76946e14-aea5-4ccc-8cea-01ef4bab063d not found {{(pid=128869) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 27 04:44:48.233158 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ffb24089-684d-4643-a594-9f8095d0c365 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] HTTP exception thrown: Security group rule 76946e14-aea5-4ccc-8cea-01ef4bab063d does not exist Aug 27 04:44:48.233158 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-c745495f-9f45-40ea-8ca6-3430e72ce15a'] Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ffb24089-684d-4643-a594-9f8095d0c365 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Request method failure captured: Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-group-rules/76946e14-aea5-4ccc-8cea-01ef4bab063d HTTP/1.1 Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaEvfFa9aq2Q1Dn1BRiX8SYE2F2T0RkgNYRwhz6vpU9KDCj5WQuTui_IA9WlAYjoBx3sP9muzZEUXCMN4UYjnpOMPoAXOBqK6G0NX1745mACHPpvsg65691twnj30HQa-g9r90oOscx7qp6BoRwVE-Nlpkj1GeIIhgXOKODtCUZoHoY Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_af00585c17534fe2a505026fa4b23c95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/af00585c17534fe2a505026fa4b23c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: af00585c17534fe2a505026fa4b23c95 Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758 Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8660724680e348888c18cf092fbfca93 Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: exception: Security group rule 76946e14-aea5-4ccc-8cea-01ef4bab063d does not exist Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-c745495f-9f45-40ea-8ca6-3430e72ce15a'] Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '76946e14-aea5-4ccc-8cea-01ef4bab063d'} Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:44:48.236586 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 76946e14-aea5-4ccc-8cea-01ef4bab063d does not exist Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c745495f-9f45-40ea-8ca6-3430e72ce15a'] Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 76946e14-aea5-4ccc-8cea-01ef4bab063d does not exist Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c745495f-9f45-40ea-8ca6-3430e72ce15a'] Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 76946e14-aea5-4ccc-8cea-01ef4bab063d does not exist Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c745495f-9f45-40ea-8ca6-3430e72ce15a'] Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 76946e14-aea5-4ccc-8cea-01ef4bab063d does not exist Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c745495f-9f45-40ea-8ca6-3430e72ce15a'] Aug 27 04:44:48.243130 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:44:48.252026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ffb24089-684d-4643-a594-9f8095d0c365 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Returning 404 to user: Security group rule 76946e14-aea5-4ccc-8cea-01ef4bab063d does not exist Aug 27 04:44:48.252026 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-c745495f-9f45-40ea-8ca6-3430e72ce15a'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:44:48.253715 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ffb24089-684d-4643-a594-9f8095d0c365 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-group-rules/76946e14-aea5-4ccc-8cea-01ef4bab063d" status: 404 len: 199 microversion: 2.1 time: 0.250932 Aug 27 04:44:48.254488 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1625/3199] 10.222.0.79 () {58 vars in 1287 bytes} [Sat Aug 27 04:44:48 2022] DELETE /compute/v2.1/os-security-group-rules/76946e14-aea5-4ccc-8cea-01ef4bab063d => generated 199 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:44:48.265743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43c8b783-03aa-4958-9b4c-cecc3c28e7d7 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Calling method '.version_select at 0x7f1f20e69280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:48.377819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eda3b239-a046-4e79-ad50-322c6e8a4518 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Action: 'create', calling method: .version_select at 0x7f1f21125160>, body: {"keypair": {"name": "tempest-keypair-1624376974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNep6fC8uYD5W6P18b1s8vbDoKuYOtXIxp3nfuCuRVti175R0z1ZxQerlbOTSpDQTBpSF7Y7+cbTfw1cSFuwtoqax9unkqeR/ABBdTlGPCQHXGayDDs+ddSSQUh6c+3C9A=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:48.420779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-eda3b239-a046-4e79-ad50-322c6e8a4518 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Getting quotas for project 7a05f87ee5fb4d56acc906e2fb616b4a. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:44:48.443642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-eda3b239-a046-4e79-ad50-322c6e8a4518 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Getting quotas for user 7381d46a2eb14fa39e645f8459dc4367 and project 7a05f87ee5fb4d56acc906e2fb616b4a. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:44:48.514810 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eda3b239-a046-4e79-ad50-322c6e8a4518 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.635319 Aug 27 04:44:48.522317 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1575/3200] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:44:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:48.900630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-71bd5884-7c36-4a5e-928b-d8b98d8e8ae3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:48.908637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-71bd5884-7c36-4a5e-928b-d8b98d8e8ae3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:48.956549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71bd5884-7c36-4a5e-928b-d8b98d8e8ae3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:48.957792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71bd5884-7c36-4a5e-928b-d8b98d8e8ae3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:48.966442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71bd5884-7c36-4a5e-928b-d8b98d8e8ae3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:48.968423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71bd5884-7c36-4a5e-928b-d8b98d8e8ae3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:48.972991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71bd5884-7c36-4a5e-928b-d8b98d8e8ae3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:48.978287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71bd5884-7c36-4a5e-928b-d8b98d8e8ae3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:49.331417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-71bd5884-7c36-4a5e-928b-d8b98d8e8ae3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:49.358709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-71bd5884-7c36-4a5e-928b-d8b98d8e8ae3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:49.361428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-71bd5884-7c36-4a5e-928b-d8b98d8e8ae3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:49.382178 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-71bd5884-7c36-4a5e-928b-d8b98d8e8ae3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1417 microversion: 2.75 time: 0.492722 Aug 27 04:44:49.383972 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1576/3201] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:44:48 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1417 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:44:50.398781 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43c8b783-03aa-4958-9b4c-cecc3c28e7d7 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/b7f339cf-e8f4-48a3-a8b8-52563e3693e4" status: 202 len: 0 microversion: 2.1 time: 2.131422 Aug 27 04:44:50.411988 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1626/3202] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:44:48 2022] DELETE /compute/v2.1/os-security-groups/b7f339cf-e8f4-48a3-a8b8-52563e3693e4 => generated 0 bytes in 2145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:44:50.418216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22094b2a-17cf-4e94-8e67-f4243ef63fe3 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Calling method '.version_select at 0x7f1f20ea1820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:50.783928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-181590505", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "e4a32aa6-e667-44d0-b1a6-6b9cd237e0ef"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:51.444020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] validate_networks() for [('e4a32aa6-e667-44d0-b1a6-6b9cd237e0ef', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:44:51.610615 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22094b2a-17cf-4e94-8e67-f4243ef63fe3 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/99085cce-c42b-43b1-99ed-291bf4748ea6" status: 202 len: 0 microversion: 2.1 time: 1.197105 Aug 27 04:44:51.611205 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1627/3203] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:44:50 2022] DELETE /compute/v2.1/os-security-groups/99085cce-c42b-43b1-99ed-291bf4748ea6 => generated 0 bytes in 1198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:44:51.619683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1f9e117-8488-4417-aef2-e985da37844d tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:51.621759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f1f9e117-8488-4417-aef2-e985da37844d tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:51.643857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1f9e117-8488-4417-aef2-e985da37844d tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:51.647224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1f9e117-8488-4417-aef2-e985da37844d tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:51.648520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1f9e117-8488-4417-aef2-e985da37844d tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:51.651206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1f9e117-8488-4417-aef2-e985da37844d tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:51.653857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1f9e117-8488-4417-aef2-e985da37844d tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:51.657018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1f9e117-8488-4417-aef2-e985da37844d tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:52.762848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1f9e117-8488-4417-aef2-e985da37844d tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:52.776231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1f9e117-8488-4417-aef2-e985da37844d tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:52.780344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1f9e117-8488-4417-aef2-e985da37844d tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:52.801722 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1f9e117-8488-4417-aef2-e985da37844d tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1438 microversion: 2.75 time: 1.188302 Aug 27 04:44:52.802391 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1628/3204] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:44:51 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1438 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:44:52.838563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f10270f1-a0cf-4230-91c6-dfa084ba9d17 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Calling method '.version_select at 0x7f1f20df5430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:53.183329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:54.033309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:44:54.034083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:44:54.034694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:44:54.035337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:44:54.035961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:44:54.064816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:54.071438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:54.072558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:54.074593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:54.076909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:54.081909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:54.138236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Getting quotas for project b4c2750325a547848214f021f63aecb6. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:44:54.154051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Getting quotas for user aca12246038e4b8e8cf1233d7f14d67a and project b4c2750325a547848214f021f63aecb6. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:44:54.187350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Going to run 3 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:44:54.196851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: 7af3b552-91dc-4362-a577-341d856e2d23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:44:54.232265 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f10270f1-a0cf-4230-91c6-dfa084ba9d17 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/89f6f02e-27ff-4d8c-b84f-5767adb36b0d" status: 202 len: 0 microversion: 2.1 time: 1.398490 Aug 27 04:44:54.238547 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1629/3205] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:44:52 2022] DELETE /compute/v2.1/os-security-groups/89f6f02e-27ff-4d8c-b84f-5767adb36b0d => generated 0 bytes in 1436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:44:54.246704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71228424-9f42-4121-865e-14501cc9b5c0"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:54.262873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:54.269526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: bfdfb1e3-2547-470d-a438-4a58bed4fa34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=7af3b552-91dc-4362-a577-341d856e2d23,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:44:54.285112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:54.287335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:54.289092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:54.290016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:54.291814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:54.293221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:54.361301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=bfdfb1e3-2547-470d-a438-4a58bed4fa34,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:44:54.478868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:44:54.480950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:44:54.481714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:44:54.482552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:44:54.483412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:44:54.510675 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-06636160-89e8-4920-80cd-20b20c4d0686 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.314704 Aug 27 04:44:54.511326 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1577/3206] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:44:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:44:54.521613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2eb12612-5d45-4b39-9b7d-143471a4a347 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Calling method '.version_select at 0x7f1f21111820>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:54.670570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:54.691464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:54.693797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:54.694301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:54.695632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:54.697516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:54.699513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:55.112102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:55.137981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:55.158147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:55.174791 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d409a57-b41c-4fd4-b4dc-d1cf19b1637a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "POST /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830/action" status: 202 len: 1495 microversion: 2.75 time: 0.929750 Aug 27 04:44:55.175875 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1630/3207] 10.222.0.79 () {62 vars in 1319 bytes} [Sat Aug 27 04:44:54 2022] POST /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830/action => generated 1495 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 04:44:55.185012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b55ed80-7bc4-44ec-8639-aee5f4244b4c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:55.201329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0b55ed80-7bc4-44ec-8639-aee5f4244b4c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:55.207042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b55ed80-7bc4-44ec-8639-aee5f4244b4c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Searching by: {'deleted': False, 'project_id': 'b4c2750325a547848214f021f63aecb6'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:44:55.285787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b55ed80-7bc4-44ec-8639-aee5f4244b4c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:55.289859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b55ed80-7bc4-44ec-8639-aee5f4244b4c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:55.289859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b55ed80-7bc4-44ec-8639-aee5f4244b4c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:55.290142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b55ed80-7bc4-44ec-8639-aee5f4244b4c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:55.294600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b55ed80-7bc4-44ec-8639-aee5f4244b4c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:55.298222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b55ed80-7bc4-44ec-8639-aee5f4244b4c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:55.422954 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b55ed80-7bc4-44ec-8639-aee5f4244b4c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.242012 Aug 27 04:44:55.427370 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1631/3208] 10.222.0.79 () {58 vars in 1125 bytes} [Sat Aug 27 04:44:55 2022] GET /compute/v2.1/servers => generated 1015 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:55.459752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-603c6450-cd77-44fe-8b98-12e0e4d0d52c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:55.460393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-603c6450-cd77-44fe-8b98-12e0e4d0d52c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:55.483485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-603c6450-cd77-44fe-8b98-12e0e4d0d52c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:55.484017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-603c6450-cd77-44fe-8b98-12e0e4d0d52c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:55.484457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-603c6450-cd77-44fe-8b98-12e0e4d0d52c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:55.485251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-603c6450-cd77-44fe-8b98-12e0e4d0d52c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:55.485665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-603c6450-cd77-44fe-8b98-12e0e4d0d52c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:55.486094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-603c6450-cd77-44fe-8b98-12e0e4d0d52c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:55.735854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-603c6450-cd77-44fe-8b98-12e0e4d0d52c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:55.767995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-603c6450-cd77-44fe-8b98-12e0e4d0d52c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:55.772348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-603c6450-cd77-44fe-8b98-12e0e4d0d52c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:55.794285 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-603c6450-cd77-44fe-8b98-12e0e4d0d52c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.364362 Aug 27 04:44:55.795276 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1632/3209] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:44:55 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:44:55.831873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f69460b1-2e67-4647-8c96-61a266af8f12 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:55.835403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f69460b1-2e67-4647-8c96-61a266af8f12 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:56.176095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f69460b1-2e67-4647-8c96-61a266af8f12 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:56.195456 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f69460b1-2e67-4647-8c96-61a266af8f12 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1222 microversion: 2.1 time: 0.370854 Aug 27 04:44:56.197211 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1633/3210] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:55 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1222 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:56.701931 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2eb12612-5d45-4b39-9b7d-143471a4a347 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/781d98a9-fa40-481d-bf89-53b0b17f16ec" status: 202 len: 0 microversion: 2.1 time: 2.184016 Aug 27 04:44:56.702630 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1578/3211] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:44:54 2022] DELETE /compute/v2.1/os-security-groups/781d98a9-fa40-481d-bf89-53b0b17f16ec => generated 0 bytes in 2185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:44:56.726479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99b92a9c-2450-4e96-8fcf-211efdf3b8c3 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] Calling method '.version_select at 0x7f1f20e69b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:56.835989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-93588f10-87f2-405c-b200-444bc4a6a6ec tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:56.838157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-93588f10-87f2-405c-b200-444bc4a6a6ec tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:56.872305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93588f10-87f2-405c-b200-444bc4a6a6ec tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:56.874328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93588f10-87f2-405c-b200-444bc4a6a6ec tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:56.874874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93588f10-87f2-405c-b200-444bc4a6a6ec tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:56.877931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93588f10-87f2-405c-b200-444bc4a6a6ec tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:56.882314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93588f10-87f2-405c-b200-444bc4a6a6ec tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:56.885187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93588f10-87f2-405c-b200-444bc4a6a6ec tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:57.057159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-93588f10-87f2-405c-b200-444bc4a6a6ec tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:57.070048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-93588f10-87f2-405c-b200-444bc4a6a6ec tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:57.074406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-93588f10-87f2-405c-b200-444bc4a6a6ec tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:57.104564 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-93588f10-87f2-405c-b200-444bc4a6a6ec tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.278477 Aug 27 04:44:57.105623 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1579/3212] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:44:56 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:44:57.222304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-86072cb5-4975-4080-944c-d826c72ac4e6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:57.222928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-86072cb5-4975-4080-944c-d826c72ac4e6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:57.257719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86072cb5-4975-4080-944c-d826c72ac4e6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:57.261725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86072cb5-4975-4080-944c-d826c72ac4e6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:57.262231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86072cb5-4975-4080-944c-d826c72ac4e6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:57.262932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86072cb5-4975-4080-944c-d826c72ac4e6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:57.263400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86072cb5-4975-4080-944c-d826c72ac4e6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:57.263833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86072cb5-4975-4080-944c-d826c72ac4e6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:57.312460 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99b92a9c-2450-4e96-8fcf-211efdf3b8c3 tempest-SecurityGroupRulesNegativeTestJSON-2097630758 tempest-SecurityGroupRulesNegativeTestJSON-2097630758-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/1526be8e-4c54-4b7b-b89f-ebbef747f016" status: 202 len: 0 microversion: 2.1 time: 0.604510 Aug 27 04:44:57.318061 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1634/3213] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:44:56 2022] DELETE /compute/v2.1/os-security-groups/1526be8e-4c54-4b7b-b89f-ebbef747f016 => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:44:57.684134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-86072cb5-4975-4080-944c-d826c72ac4e6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:57.702728 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-86072cb5-4975-4080-944c-d826c72ac4e6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1226 microversion: 2.1 time: 0.484624 Aug 27 04:44:57.727435 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1580/3214] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:57 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1226 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:58.143904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a114b679-c15d-4bb6-9087-22d567f48573 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:58.144566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a114b679-c15d-4bb6-9087-22d567f48573 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:58.191809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a114b679-c15d-4bb6-9087-22d567f48573 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:58.194578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a114b679-c15d-4bb6-9087-22d567f48573 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:58.195698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a114b679-c15d-4bb6-9087-22d567f48573 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:58.204185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a114b679-c15d-4bb6-9087-22d567f48573 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:58.206398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a114b679-c15d-4bb6-9087-22d567f48573 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:58.213646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a114b679-c15d-4bb6-9087-22d567f48573 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:58.727048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2d35fd5f-922c-4120-af56-d106849a1f50 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:58.728405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2d35fd5f-922c-4120-af56-d106849a1f50 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:44:58.746907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d35fd5f-922c-4120-af56-d106849a1f50 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:58.750748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d35fd5f-922c-4120-af56-d106849a1f50 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:58.751656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d35fd5f-922c-4120-af56-d106849a1f50 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:58.753912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d35fd5f-922c-4120-af56-d106849a1f50 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:44:58.757949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d35fd5f-922c-4120-af56-d106849a1f50 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:44:58.760018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d35fd5f-922c-4120-af56-d106849a1f50 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:44:59.139264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a114b679-c15d-4bb6-9087-22d567f48573 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:59.156490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a114b679-c15d-4bb6-9087-22d567f48573 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:59.162958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a114b679-c15d-4bb6-9087-22d567f48573 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:59.177602 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a114b679-c15d-4bb6-9087-22d567f48573 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 1.045423 Aug 27 04:44:59.182124 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1635/3215] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:44:58 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:44:59.311650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2d35fd5f-922c-4120-af56-d106849a1f50 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:59.335530 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2d35fd5f-922c-4120-af56-d106849a1f50 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1282 microversion: 2.1 time: 0.603661 Aug 27 04:44:59.350714 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1581/3216] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:44:58 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1282 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:00.210428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bab6fec7-b2b5-4e6e-b3a1-8a9b094d9cb0 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:00.211052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bab6fec7-b2b5-4e6e-b3a1-8a9b094d9cb0 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:00.224034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab6fec7-b2b5-4e6e-b3a1-8a9b094d9cb0 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:00.225105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab6fec7-b2b5-4e6e-b3a1-8a9b094d9cb0 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:00.225758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab6fec7-b2b5-4e6e-b3a1-8a9b094d9cb0 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:00.227201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab6fec7-b2b5-4e6e-b3a1-8a9b094d9cb0 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:00.227671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab6fec7-b2b5-4e6e-b3a1-8a9b094d9cb0 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:00.228100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab6fec7-b2b5-4e6e-b3a1-8a9b094d9cb0 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:00.365324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b2154442-fa26-482e-8cba-570c0a451232 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:00.368667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b2154442-fa26-482e-8cba-570c0a451232 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:00.416626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2154442-fa26-482e-8cba-570c0a451232 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:00.418662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2154442-fa26-482e-8cba-570c0a451232 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:00.422438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2154442-fa26-482e-8cba-570c0a451232 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:00.424013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2154442-fa26-482e-8cba-570c0a451232 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:00.424759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2154442-fa26-482e-8cba-570c0a451232 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:00.425668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2154442-fa26-482e-8cba-570c0a451232 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:00.553748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b2154442-fa26-482e-8cba-570c0a451232 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:00.563979 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b2154442-fa26-482e-8cba-570c0a451232 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1280 microversion: 2.1 time: 0.206364 Aug 27 04:45:00.565705 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1582/3217] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:00 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1280 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:00.867467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bab6fec7-b2b5-4e6e-b3a1-8a9b094d9cb0 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:00.886344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bab6fec7-b2b5-4e6e-b3a1-8a9b094d9cb0 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:00.889000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bab6fec7-b2b5-4e6e-b3a1-8a9b094d9cb0 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:00.893105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-37319bcc-5485-4fa5-8edd-bef213891b10 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Calling method '.version_select at 0x7f1f2124a940>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:00.915679 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bab6fec7-b2b5-4e6e-b3a1-8a9b094d9cb0 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.712550 Aug 27 04:45:00.917580 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1636/3218] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:00 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:00.931013 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-37319bcc-5485-4fa5-8edd-bef213891b10 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] HTTP exception thrown: Image not found. Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-37319bcc-5485-4fa5-8edd-bef213891b10 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Request method failure captured: Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/images/b544db6f-1392-4be3-968b-ecb4976c0881/metadata/os_distro HTTP/1.1 Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaFMyJn37zEOe-SITZlN1QqKPb40piL890qFZYqgbMRa8MpXlfJ10EyMgKxQimks1dDk_gAG6BplIu5hQRbIZTmsVaGFMMi09P72Ea3Qyu2whhlu7hzltxOd9YTr0NG4S2AmhCu9R3s4WVexar851fnPjX257rFewkAOlSb1nKAFzmM Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 1d66e9f0c12c45d1ad0cf6562383bfaf Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 1d66e9f0c12c45d1ad0cf6562383bfaf Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesMetadataNegativeTestJSON-617989980-project Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: d8aa426a6ca8488f9dca22e7e0a159d6 Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-617989980-project Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: exception: Image not found. Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'image_id': 'b544db6f-1392-4be3-968b-ecb4976c0881', 'id': 'os_distro'} Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b544db6f-1392-4be3-968b-ecb4976c0881 Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:45:00.937376 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b544db6f-1392-4be3-968b-ecb4976c0881 could not be found. Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:45:00.942057 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:00.947128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-37319bcc-5485-4fa5-8edd-bef213891b10 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Returning 404 to user: Image not found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:00.948013 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-37319bcc-5485-4fa5-8edd-bef213891b10 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] 10.222.0.79 "DELETE /compute/v2.1/images/b544db6f-1392-4be3-968b-ecb4976c0881/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.278941 Aug 27 04:45:00.948796 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1583/3219] 10.222.0.79 () {58 vars in 1293 bytes} [Sat Aug 27 04:45:00 2022] DELETE /compute/v2.1/images/b544db6f-1392-4be3-968b-ecb4976c0881/metadata/os_distro => generated 62 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:45:00.959723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e2c8c4c-9ff6-4d7a-9e7a-36033e4b9025 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Calling method '.version_select at 0x7f1f20e5a5e0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:01.005081 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0e2c8c4c-9ff6-4d7a-9e7a-36033e4b9025 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] HTTP exception thrown: Image not found. Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e2c8c4c-9ff6-4d7a-9e7a-36033e4b9025 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Request method failure captured: Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/images/46529983-64cd-441f-ba4a-aa625d7d18bb/metadata/os_version HTTP/1.1 Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaFMyJn37zEOe-SITZlN1QqKPb40piL890qFZYqgbMRa8MpXlfJ10EyMgKxQimks1dDk_gAG6BplIu5hQRbIZTmsVaGFMMi09P72Ea3Qyu2whhlu7hzltxOd9YTr0NG4S2AmhCu9R3s4WVexar851fnPjX257rFewkAOlSb1nKAFzmM Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 1d66e9f0c12c45d1ad0cf6562383bfaf Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 1d66e9f0c12c45d1ad0cf6562383bfaf Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesMetadataNegativeTestJSON-617989980-project Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: d8aa426a6ca8488f9dca22e7e0a159d6 Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-617989980-project Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: exception: Image not found. Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'image_id': '46529983-64cd-441f-ba4a-aa625d7d18bb', 'id': 'os_version'} Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 46529983-64cd-441f-ba4a-aa625d7d18bb Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:45:01.011572 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 46529983-64cd-441f-ba4a-aa625d7d18bb could not be found. Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e2c8c4c-9ff6-4d7a-9e7a-36033e4b9025 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e2c8c4c-9ff6-4d7a-9e7a-36033e4b9025 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] 10.222.0.79 "GET /compute/v2.1/images/46529983-64cd-441f-ba4a-aa625d7d18bb/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.059696 Aug 27 04:45:01.016488 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1637/3220] 10.222.0.79 () {58 vars in 1293 bytes} [Sat Aug 27 04:45:00 2022] GET /compute/v2.1/images/46529983-64cd-441f-ba4a-aa625d7d18bb/metadata/os_version => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:45:01.034442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-64cf5452-012b-439c-9e11-33cfeb793a6f tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Calling method '.version_select at 0x7f1f2124a9d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:01.093655 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-64cf5452-012b-439c-9e11-33cfeb793a6f tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] HTTP exception thrown: Image not found. Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-64cf5452-012b-439c-9e11-33cfeb793a6f tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Request method failure captured: Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/images/8e37b94d-2609-466d-80ce-a2e755e65887/metadata HTTP/1.1 Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaFMyJn37zEOe-SITZlN1QqKPb40piL890qFZYqgbMRa8MpXlfJ10EyMgKxQimks1dDk_gAG6BplIu5hQRbIZTmsVaGFMMi09P72Ea3Qyu2whhlu7hzltxOd9YTr0NG4S2AmhCu9R3s4WVexar851fnPjX257rFewkAOlSb1nKAFzmM Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 1d66e9f0c12c45d1ad0cf6562383bfaf Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 1d66e9f0c12c45d1ad0cf6562383bfaf Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesMetadataNegativeTestJSON-617989980-project Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: d8aa426a6ca8488f9dca22e7e0a159d6 Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-617989980-project Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: exception: Image not found. Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'image_id': '8e37b94d-2609-466d-80ce-a2e755e65887'} Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8e37b94d-2609-466d-80ce-a2e755e65887 Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:45:01.101460 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8e37b94d-2609-466d-80ce-a2e755e65887 could not be found. Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-64cf5452-012b-439c-9e11-33cfeb793a6f tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Returning 404 to user: Image not found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-64cf5452-012b-439c-9e11-33cfeb793a6f tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] 10.222.0.79 "GET /compute/v2.1/images/8e37b94d-2609-466d-80ce-a2e755e65887/metadata" status: 404 len: 62 microversion: 2.1 time: 0.081436 Aug 27 04:45:01.106913 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1584/3221] 10.222.0.79 () {58 vars in 1260 bytes} [Sat Aug 27 04:45:01 2022] GET /compute/v2.1/images/8e37b94d-2609-466d-80ce-a2e755e65887/metadata => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:45:01.118260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dded9678-f2ca-428e-ba22-e26b68b06c68 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Action: 'update_all', calling method: .version_select at 0x7f1f20e69430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:01.158982 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-dded9678-f2ca-428e-ba22-e26b68b06c68 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] HTTP exception thrown: Image not found. Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dded9678-f2ca-428e-ba22-e26b68b06c68 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Request method failure captured: Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: request: PUT /compute/v2.1/images/ff9ef519-0107-4d11-8a25-9927a6ed7789/metadata HTTP/1.1 Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 57 Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaFMyJn37zEOe-SITZlN1QqKPb40piL890qFZYqgbMRa8MpXlfJ10EyMgKxQimks1dDk_gAG6BplIu5hQRbIZTmsVaGFMMi09P72Ea3Qyu2whhlu7hzltxOd9YTr0NG4S2AmhCu9R3s4WVexar851fnPjX257rFewkAOlSb1nKAFzmM Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 1d66e9f0c12c45d1ad0cf6562383bfaf Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 1d66e9f0c12c45d1ad0cf6562383bfaf Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesMetadataNegativeTestJSON-617989980-project Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: d8aa426a6ca8488f9dca22e7e0a159d6 Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-617989980-project Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: exception: Image not found. Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'image_id': 'ff9ef519-0107-4d11-8a25-9927a6ed7789', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ff9ef519-0107-4d11-8a25-9927a6ed7789 Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:45:01.162909 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ff9ef519-0107-4d11-8a25-9927a6ed7789 could not be found. Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dded9678-f2ca-428e-ba22-e26b68b06c68 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:01.167829 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dded9678-f2ca-428e-ba22-e26b68b06c68 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] 10.222.0.79 "PUT /compute/v2.1/images/ff9ef519-0107-4d11-8a25-9927a6ed7789/metadata" status: 404 len: 62 microversion: 2.1 time: 0.052939 Aug 27 04:45:01.172560 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1638/3222] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:45:01 2022] PUT /compute/v2.1/images/ff9ef519-0107-4d11-8a25-9927a6ed7789/metadata => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:45:01.178299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-76e2108c-3d41-40ce-b032-d5c0b66c93d7 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Action: 'update', calling method: .version_select at 0x7f1f2124a310>, body: {"meta": {"os_distro": "alt"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:01.223351 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-76e2108c-3d41-40ce-b032-d5c0b66c93d7 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] HTTP exception thrown: Image not found. Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-76e2108c-3d41-40ce-b032-d5c0b66c93d7 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Request method failure captured: Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: request: PUT /compute/v2.1/images/f57af87f-2c5d-4cbd-b95a-1f6504b66eda/metadata/os_distro HTTP/1.1 Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 30 Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaFMyJn37zEOe-SITZlN1QqKPb40piL890qFZYqgbMRa8MpXlfJ10EyMgKxQimks1dDk_gAG6BplIu5hQRbIZTmsVaGFMMi09P72Ea3Qyu2whhlu7hzltxOd9YTr0NG4S2AmhCu9R3s4WVexar851fnPjX257rFewkAOlSb1nKAFzmM Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 1d66e9f0c12c45d1ad0cf6562383bfaf Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 1d66e9f0c12c45d1ad0cf6562383bfaf Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesMetadataNegativeTestJSON-617989980-project Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: d8aa426a6ca8488f9dca22e7e0a159d6 Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-617989980-project Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: {"meta": {"os_distro": "alt"}} Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: exception: Image not found. Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'image_id': 'f57af87f-2c5d-4cbd-b95a-1f6504b66eda', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f57af87f-2c5d-4cbd-b95a-1f6504b66eda Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:45:01.226751 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f57af87f-2c5d-4cbd-b95a-1f6504b66eda could not be found. Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-76e2108c-3d41-40ce-b032-d5c0b66c93d7 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Returning 404 to user: Image not found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-76e2108c-3d41-40ce-b032-d5c0b66c93d7 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] 10.222.0.79 "PUT /compute/v2.1/images/f57af87f-2c5d-4cbd-b95a-1f6504b66eda/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.055024 Aug 27 04:45:01.231869 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1585/3223] 10.222.0.79 () {60 vars in 1310 bytes} [Sat Aug 27 04:45:01 2022] PUT /compute/v2.1/images/f57af87f-2c5d-4cbd-b95a-1f6504b66eda/metadata/os_distro => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 04:45:01.242828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a4e0573-a971-4035-a496-f24a72886738 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Action: 'create', calling method: .version_select at 0x7f1f20e955e0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:01.280782 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9a4e0573-a971-4035-a496-f24a72886738 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] HTTP exception thrown: Image not found. Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a4e0573-a971-4035-a496-f24a72886738 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Request method failure captured: Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/images/e3457f95-d5f2-45ce-ba45-bfb56418636a/metadata HTTP/1.1 Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 57 Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaFMyJn37zEOe-SITZlN1QqKPb40piL890qFZYqgbMRa8MpXlfJ10EyMgKxQimks1dDk_gAG6BplIu5hQRbIZTmsVaGFMMi09P72Ea3Qyu2whhlu7hzltxOd9YTr0NG4S2AmhCu9R3s4WVexar851fnPjX257rFewkAOlSb1nKAFzmM Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 1d66e9f0c12c45d1ad0cf6562383bfaf Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d66e9f0c12c45d1ad0cf6562383bfaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 1d66e9f0c12c45d1ad0cf6562383bfaf Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-617989980 Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesMetadataNegativeTestJSON-617989980-project Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: d8aa426a6ca8488f9dca22e7e0a159d6 Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-617989980-project Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: exception: Image not found. Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'image_id': 'e3457f95-d5f2-45ce-ba45-bfb56418636a', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e3457f95-d5f2-45ce-ba45-bfb56418636a Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 04:45:01.283552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e3457f95-d5f2-45ce-ba45-bfb56418636a could not be found. Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a4e0573-a971-4035-a496-f24a72886738 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:01.287957 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a4e0573-a971-4035-a496-f24a72886738 tempest-ImagesMetadataNegativeTestJSON-617989980 tempest-ImagesMetadataNegativeTestJSON-617989980-project] 10.222.0.79 "POST /compute/v2.1/images/e3457f95-d5f2-45ce-ba45-bfb56418636a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.050248 Aug 27 04:45:01.293739 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1639/3224] 10.222.0.79 () {60 vars in 1281 bytes} [Sat Aug 27 04:45:01 2022] POST /compute/v2.1/images/e3457f95-d5f2-45ce-ba45-bfb56418636a/metadata => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:45:01.592056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e965efc3-2bbc-40be-817d-593470eda0dd tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:01.592917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e965efc3-2bbc-40be-817d-593470eda0dd tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:01.603681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e965efc3-2bbc-40be-817d-593470eda0dd tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:01.604587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e965efc3-2bbc-40be-817d-593470eda0dd tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:01.605003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e965efc3-2bbc-40be-817d-593470eda0dd tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:01.606570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e965efc3-2bbc-40be-817d-593470eda0dd tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:01.607040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e965efc3-2bbc-40be-817d-593470eda0dd tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:01.610340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e965efc3-2bbc-40be-817d-593470eda0dd tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:01.713469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e965efc3-2bbc-40be-817d-593470eda0dd tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:01.724244 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e965efc3-2bbc-40be-817d-593470eda0dd tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1280 microversion: 2.1 time: 0.136657 Aug 27 04:45:01.725275 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1586/3225] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:01 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1280 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:01.948493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d7448ec-1580-4820-8378-82c163c1ae63 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:01.951427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d7448ec-1580-4820-8378-82c163c1ae63 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:01.976887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d7448ec-1580-4820-8378-82c163c1ae63 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:01.978894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d7448ec-1580-4820-8378-82c163c1ae63 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:01.981109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d7448ec-1580-4820-8378-82c163c1ae63 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:01.985063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d7448ec-1580-4820-8378-82c163c1ae63 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:01.986348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d7448ec-1580-4820-8378-82c163c1ae63 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:01.986974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d7448ec-1580-4820-8378-82c163c1ae63 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:02.411936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d7448ec-1580-4820-8378-82c163c1ae63 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:02.421938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d7448ec-1580-4820-8378-82c163c1ae63 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:02.423572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d7448ec-1580-4820-8378-82c163c1ae63 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:02.436812 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d7448ec-1580-4820-8378-82c163c1ae63 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.498770 Aug 27 04:45:02.438036 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1640/3226] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:01 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:02.753751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-638923cb-62fa-4ba4-97a8-ed21c5883149 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:02.755717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-638923cb-62fa-4ba4-97a8-ed21c5883149 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:02.769661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-638923cb-62fa-4ba4-97a8-ed21c5883149 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:02.771046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-638923cb-62fa-4ba4-97a8-ed21c5883149 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:02.771685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-638923cb-62fa-4ba4-97a8-ed21c5883149 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:02.772628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-638923cb-62fa-4ba4-97a8-ed21c5883149 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:02.773251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-638923cb-62fa-4ba4-97a8-ed21c5883149 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:02.773840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-638923cb-62fa-4ba4-97a8-ed21c5883149 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:03.265978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-638923cb-62fa-4ba4-97a8-ed21c5883149 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:03.283194 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-638923cb-62fa-4ba4-97a8-ed21c5883149 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1322 microversion: 2.1 time: 0.539563 Aug 27 04:45:03.283783 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1587/3227] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:02 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:03.463618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47b66cba-e8e9-422e-b2e3-3ba722344cb5 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:03.464294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47b66cba-e8e9-422e-b2e3-3ba722344cb5 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:03.477463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b66cba-e8e9-422e-b2e3-3ba722344cb5 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:03.477984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b66cba-e8e9-422e-b2e3-3ba722344cb5 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:03.478435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b66cba-e8e9-422e-b2e3-3ba722344cb5 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:03.479167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b66cba-e8e9-422e-b2e3-3ba722344cb5 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:03.479641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b66cba-e8e9-422e-b2e3-3ba722344cb5 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:03.480077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b66cba-e8e9-422e-b2e3-3ba722344cb5 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:04.069503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47b66cba-e8e9-422e-b2e3-3ba722344cb5 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:04.085795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47b66cba-e8e9-422e-b2e3-3ba722344cb5 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:04.089521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47b66cba-e8e9-422e-b2e3-3ba722344cb5 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:04.122828 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47b66cba-e8e9-422e-b2e3-3ba722344cb5 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.662999 Aug 27 04:45:04.149979 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1641/3228] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:03 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:04.308012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9f4c0bda-d2d7-428e-bb58-3261bb4d6025 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:04.308871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9f4c0bda-d2d7-428e-bb58-3261bb4d6025 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:04.312877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:04.313608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=18 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:04.314284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=13 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:04.346947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f4c0bda-d2d7-428e-bb58-3261bb4d6025 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:04.347483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f4c0bda-d2d7-428e-bb58-3261bb4d6025 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:04.347941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f4c0bda-d2d7-428e-bb58-3261bb4d6025 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:04.348754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f4c0bda-d2d7-428e-bb58-3261bb4d6025 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:04.360977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f4c0bda-d2d7-428e-bb58-3261bb4d6025 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:04.361581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f4c0bda-d2d7-428e-bb58-3261bb4d6025 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:04.765106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9f4c0bda-d2d7-428e-bb58-3261bb4d6025 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:04.807886 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9f4c0bda-d2d7-428e-bb58-3261bb4d6025 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1322 microversion: 2.1 time: 0.502231 Aug 27 04:45:04.812244 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1588/3229] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:04 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:05.154402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f68ef252-f155-49f1-bf1c-7d63c516f501 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:05.156266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f68ef252-f155-49f1-bf1c-7d63c516f501 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:05.174116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f68ef252-f155-49f1-bf1c-7d63c516f501 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:05.176207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f68ef252-f155-49f1-bf1c-7d63c516f501 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:05.177739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f68ef252-f155-49f1-bf1c-7d63c516f501 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:05.179169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f68ef252-f155-49f1-bf1c-7d63c516f501 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:05.182038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f68ef252-f155-49f1-bf1c-7d63c516f501 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:05.183370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f68ef252-f155-49f1-bf1c-7d63c516f501 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:05.368230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:05.393214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a0aee3b0-753e-44f0-9cc6-64c8e826e3d1 req-737057c4-0d41-4632-9a99-a3eee35e53c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d594401f-5a00-4e2f-820a-677442452401", "tag": "7dd7fd58-1ee5-4e35-a79b-dfec1a00eeec"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:05.421204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a0aee3b0-753e-44f0-9cc6-64c8e826e3d1 req-737057c4-0d41-4632-9a99-a3eee35e53c8 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:05.421821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a0aee3b0-753e-44f0-9cc6-64c8e826e3d1 req-737057c4-0d41-4632-9a99-a3eee35e53c8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:05.438020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a0aee3b0-753e-44f0-9cc6-64c8e826e3d1 req-737057c4-0d41-4632-9a99-a3eee35e53c8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:05.482362 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a0aee3b0-753e-44f0-9cc6-64c8e826e3d1 req-737057c4-0d41-4632-9a99-a3eee35e53c8 service nova] Creating event network-changed:7dd7fd58-1ee5-4e35-a79b-dfec1a00eeec for instance d594401f-5a00-4e2f-820a-677442452401 on n-h1-854823-1 Aug 27 04:45:05.501463 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a0aee3b0-753e-44f0-9cc6-64c8e826e3d1 req-737057c4-0d41-4632-9a99-a3eee35e53c8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110304 Aug 27 04:45:05.504155 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1589/3230] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:45:05.626038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f68ef252-f155-49f1-bf1c-7d63c516f501 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:05.640404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f68ef252-f155-49f1-bf1c-7d63c516f501 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:05.649226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f68ef252-f155-49f1-bf1c-7d63c516f501 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:05.656333 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f68ef252-f155-49f1-bf1c-7d63c516f501 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.506345 Aug 27 04:45:05.659325 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1642/3231] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:05 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:05.832216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-15afa77a-62fa-4f02-a973-6af42119372b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:05.834012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-15afa77a-62fa-4f02-a973-6af42119372b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:05.842293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15afa77a-62fa-4f02-a973-6af42119372b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:05.843258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15afa77a-62fa-4f02-a973-6af42119372b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:05.843925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15afa77a-62fa-4f02-a973-6af42119372b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:05.844908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15afa77a-62fa-4f02-a973-6af42119372b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:05.845754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15afa77a-62fa-4f02-a973-6af42119372b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:05.846450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15afa77a-62fa-4f02-a973-6af42119372b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:06.685877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ae7ce46-472e-4bda-870f-ccc630f319be tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:06.686601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ae7ce46-472e-4bda-870f-ccc630f319be tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:06.690929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:06.711446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7ce46-472e-4bda-870f-ccc630f319be tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:06.711953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7ce46-472e-4bda-870f-ccc630f319be tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:06.719596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7ce46-472e-4bda-870f-ccc630f319be tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:06.724807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7ce46-472e-4bda-870f-ccc630f319be tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:06.728890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7ce46-472e-4bda-870f-ccc630f319be tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:06.729535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7ce46-472e-4bda-870f-ccc630f319be tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:07.119869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-15afa77a-62fa-4f02-a973-6af42119372b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:07.130672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=77 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:07.136926 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-15afa77a-62fa-4f02-a973-6af42119372b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1322 microversion: 2.1 time: 1.309929 Aug 27 04:45:07.140185 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1590/3232] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:05 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1322 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:07.212635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ae7ce46-472e-4bda-870f-ccc630f319be tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:07.253059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ae7ce46-472e-4bda-870f-ccc630f319be tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:07.259252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ae7ce46-472e-4bda-870f-ccc630f319be tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:07.274446 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ae7ce46-472e-4bda-870f-ccc630f319be tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.591915 Aug 27 04:45:07.276830 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1643/3233] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:06 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:45:08.158975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d1f4b092-fdc8-4efc-9957-377c5c32a2e8 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:08.159583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d1f4b092-fdc8-4efc-9957-377c5c32a2e8 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:08.180781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1f4b092-fdc8-4efc-9957-377c5c32a2e8 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:08.180781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1f4b092-fdc8-4efc-9957-377c5c32a2e8 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:08.185196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1f4b092-fdc8-4efc-9957-377c5c32a2e8 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:08.189057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1f4b092-fdc8-4efc-9957-377c5c32a2e8 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:08.190341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1f4b092-fdc8-4efc-9957-377c5c32a2e8 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:08.195822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1f4b092-fdc8-4efc-9957-377c5c32a2e8 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:08.318941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84fee09b-cca8-4f72-92c7-3b3e0192b297 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:08.319803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-84fee09b-cca8-4f72-92c7-3b3e0192b297 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:08.347032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84fee09b-cca8-4f72-92c7-3b3e0192b297 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:08.347832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84fee09b-cca8-4f72-92c7-3b3e0192b297 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:08.349588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84fee09b-cca8-4f72-92c7-3b3e0192b297 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:08.350440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84fee09b-cca8-4f72-92c7-3b3e0192b297 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:08.351919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84fee09b-cca8-4f72-92c7-3b3e0192b297 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:08.354795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84fee09b-cca8-4f72-92c7-3b3e0192b297 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:08.612707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84fee09b-cca8-4f72-92c7-3b3e0192b297 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:08.626803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84fee09b-cca8-4f72-92c7-3b3e0192b297 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:08.633556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84fee09b-cca8-4f72-92c7-3b3e0192b297 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:08.644049 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-84fee09b-cca8-4f72-92c7-3b3e0192b297 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.341995 Aug 27 04:45:08.669995 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1644/3234] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:08 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:08.688684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2204a043-4f37-4fb0-97d4-6aecd31123d0 req-3a6aed8e-b72f-4e71-b603-a7a420ff238a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfdfb1e3-2547-470d-a438-4a58bed4fa34", "tag": "a047eec5-6aaf-4e62-94ed-be03213f258f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:08.714223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2204a043-4f37-4fb0-97d4-6aecd31123d0 req-3a6aed8e-b72f-4e71-b603-a7a420ff238a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:08.715684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2204a043-4f37-4fb0-97d4-6aecd31123d0 req-3a6aed8e-b72f-4e71-b603-a7a420ff238a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:08.717211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2204a043-4f37-4fb0-97d4-6aecd31123d0 req-3a6aed8e-b72f-4e71-b603-a7a420ff238a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:08.732079 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2204a043-4f37-4fb0-97d4-6aecd31123d0 req-3a6aed8e-b72f-4e71-b603-a7a420ff238a service nova] Creating event network-changed:a047eec5-6aaf-4e62-94ed-be03213f258f for instance bfdfb1e3-2547-470d-a438-4a58bed4fa34 on n-h2-854823-1 Aug 27 04:45:08.739111 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2204a043-4f37-4fb0-97d4-6aecd31123d0 req-3a6aed8e-b72f-4e71-b603-a7a420ff238a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066283 Aug 27 04:45:08.740879 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1645/3235] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:08.953245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d1f4b092-fdc8-4efc-9957-377c5c32a2e8 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:08.973276 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d1f4b092-fdc8-4efc-9957-377c5c32a2e8 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1322 microversion: 2.1 time: 0.815365 Aug 27 04:45:08.977529 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1591/3236] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:08 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1322 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:09.670713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b5cd2d8-0fb8-4ea0-b54b-9287c6d1872e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:09.673803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b5cd2d8-0fb8-4ea0-b54b-9287c6d1872e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:09.685866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5cd2d8-0fb8-4ea0-b54b-9287c6d1872e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:09.687522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5cd2d8-0fb8-4ea0-b54b-9287c6d1872e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:09.688271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5cd2d8-0fb8-4ea0-b54b-9287c6d1872e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:09.691118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5cd2d8-0fb8-4ea0-b54b-9287c6d1872e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:09.691811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5cd2d8-0fb8-4ea0-b54b-9287c6d1872e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:09.692896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5cd2d8-0fb8-4ea0-b54b-9287c6d1872e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:09.919315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b5cd2d8-0fb8-4ea0-b54b-9287c6d1872e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:09.941579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b5cd2d8-0fb8-4ea0-b54b-9287c6d1872e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:09.946469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b5cd2d8-0fb8-4ea0-b54b-9287c6d1872e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:09.967927 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b5cd2d8-0fb8-4ea0-b54b-9287c6d1872e tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.301475 Aug 27 04:45:09.994844 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1646/3237] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:09 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:09.998623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-86aa2777-812c-4be1-b9cc-b750732d4361 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:09.999295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-86aa2777-812c-4be1-b9cc-b750732d4361 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:10.012866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86aa2777-812c-4be1-b9cc-b750732d4361 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:10.013378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86aa2777-812c-4be1-b9cc-b750732d4361 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:10.013860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86aa2777-812c-4be1-b9cc-b750732d4361 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:10.014660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86aa2777-812c-4be1-b9cc-b750732d4361 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:10.021182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86aa2777-812c-4be1-b9cc-b750732d4361 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:10.021962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86aa2777-812c-4be1-b9cc-b750732d4361 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:10.660802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-86aa2777-812c-4be1-b9cc-b750732d4361 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:10.679882 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-86aa2777-812c-4be1-b9cc-b750732d4361 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1322 microversion: 2.1 time: 0.685727 Aug 27 04:45:10.694000 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1592/3238] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:09 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1322 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:11.001709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f88d2d2-dfdc-4cff-9cc7-dfe5f3cd27c1 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:11.002844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f88d2d2-dfdc-4cff-9cc7-dfe5f3cd27c1 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:11.016150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f88d2d2-dfdc-4cff-9cc7-dfe5f3cd27c1 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:11.018639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f88d2d2-dfdc-4cff-9cc7-dfe5f3cd27c1 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:11.019235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f88d2d2-dfdc-4cff-9cc7-dfe5f3cd27c1 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:11.020108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f88d2d2-dfdc-4cff-9cc7-dfe5f3cd27c1 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:11.021943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f88d2d2-dfdc-4cff-9cc7-dfe5f3cd27c1 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:11.023889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f88d2d2-dfdc-4cff-9cc7-dfe5f3cd27c1 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:11.150220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e4d8397e-a2f9-4efa-8f19-ea26a1e4af4d req-f779782d-041a-4411-bf84-969735d252e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7af3b552-91dc-4362-a577-341d856e2d23", "tag": "53e0cca6-a03d-41af-8b11-d0492a7a20e5"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:11.176257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e4d8397e-a2f9-4efa-8f19-ea26a1e4af4d req-f779782d-041a-4411-bf84-969735d252e6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:11.179249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e4d8397e-a2f9-4efa-8f19-ea26a1e4af4d req-f779782d-041a-4411-bf84-969735d252e6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:11.180279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e4d8397e-a2f9-4efa-8f19-ea26a1e4af4d req-f779782d-041a-4411-bf84-969735d252e6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:11.220405 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e4d8397e-a2f9-4efa-8f19-ea26a1e4af4d req-f779782d-041a-4411-bf84-969735d252e6 service nova] Creating event network-changed:53e0cca6-a03d-41af-8b11-d0492a7a20e5 for instance 7af3b552-91dc-4362-a577-341d856e2d23 on n-h1-854823-1 Aug 27 04:45:11.227691 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e4d8397e-a2f9-4efa-8f19-ea26a1e4af4d req-f779782d-041a-4411-bf84-969735d252e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084781 Aug 27 04:45:11.229010 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1593/3239] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:45:11.366095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f88d2d2-dfdc-4cff-9cc7-dfe5f3cd27c1 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:11.377479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f88d2d2-dfdc-4cff-9cc7-dfe5f3cd27c1 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:11.383712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f88d2d2-dfdc-4cff-9cc7-dfe5f3cd27c1 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:11.395344 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f88d2d2-dfdc-4cff-9cc7-dfe5f3cd27c1 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.397957 Aug 27 04:45:11.401480 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1647/3240] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:10 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:11.702414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-102285c0-4910-4763-8bfb-16bac64d065f tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:11.703187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-102285c0-4910-4763-8bfb-16bac64d065f tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:11.719377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-102285c0-4910-4763-8bfb-16bac64d065f tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:11.721430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-102285c0-4910-4763-8bfb-16bac64d065f tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:11.726962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-102285c0-4910-4763-8bfb-16bac64d065f tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:11.727998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-102285c0-4910-4763-8bfb-16bac64d065f tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:11.730554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-102285c0-4910-4763-8bfb-16bac64d065f tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:11.733127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-102285c0-4910-4763-8bfb-16bac64d065f tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:12.447094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83843822-3f39-44df-b964-609d95961ca9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:12.448129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-83843822-3f39-44df-b964-609d95961ca9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:12.473901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83843822-3f39-44df-b964-609d95961ca9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:12.479873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83843822-3f39-44df-b964-609d95961ca9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:12.480416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83843822-3f39-44df-b964-609d95961ca9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:12.482271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83843822-3f39-44df-b964-609d95961ca9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:12.489557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83843822-3f39-44df-b964-609d95961ca9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:12.490284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83843822-3f39-44df-b964-609d95961ca9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:12.599876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-102285c0-4910-4763-8bfb-16bac64d065f tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:12.620277 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-102285c0-4910-4763-8bfb-16bac64d065f tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1322 microversion: 2.1 time: 0.918808 Aug 27 04:45:12.633877 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1594/3241] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:11 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1322 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:12.760935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83843822-3f39-44df-b964-609d95961ca9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:12.787675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83843822-3f39-44df-b964-609d95961ca9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:12.793743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83843822-3f39-44df-b964-609d95961ca9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:12.808079 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83843822-3f39-44df-b964-609d95961ca9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.376058 Aug 27 04:45:12.809398 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1648/3242] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:12 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:13.647791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-23a0b456-5c52-45c7-ac4c-32b4b25a1a75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:13.650089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-23a0b456-5c52-45c7-ac4c-32b4b25a1a75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:13.668833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23a0b456-5c52-45c7-ac4c-32b4b25a1a75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:13.668833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23a0b456-5c52-45c7-ac4c-32b4b25a1a75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:13.668833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23a0b456-5c52-45c7-ac4c-32b4b25a1a75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:13.669268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23a0b456-5c52-45c7-ac4c-32b4b25a1a75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:13.673310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23a0b456-5c52-45c7-ac4c-32b4b25a1a75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:13.674105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23a0b456-5c52-45c7-ac4c-32b4b25a1a75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:13.841073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5df7fb59-b020-4869-a826-4ff1ae0e9f6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:13.842559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5df7fb59-b020-4869-a826-4ff1ae0e9f6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:13.853036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5df7fb59-b020-4869-a826-4ff1ae0e9f6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:13.853549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5df7fb59-b020-4869-a826-4ff1ae0e9f6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:13.854019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5df7fb59-b020-4869-a826-4ff1ae0e9f6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:13.854746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5df7fb59-b020-4869-a826-4ff1ae0e9f6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:13.855205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5df7fb59-b020-4869-a826-4ff1ae0e9f6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:13.855636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5df7fb59-b020-4869-a826-4ff1ae0e9f6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:13.905151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:14.062001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5df7fb59-b020-4869-a826-4ff1ae0e9f6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:14.081881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5df7fb59-b020-4869-a826-4ff1ae0e9f6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:14.093048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5df7fb59-b020-4869-a826-4ff1ae0e9f6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:14.124626 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5df7fb59-b020-4869-a826-4ff1ae0e9f6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.283786 Aug 27 04:45:14.125703 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1649/3243] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:13 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:14.566469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-23a0b456-5c52-45c7-ac4c-32b4b25a1a75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:14.581912 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-23a0b456-5c52-45c7-ac4c-32b4b25a1a75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1322 microversion: 2.1 time: 0.936964 Aug 27 04:45:14.587933 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1595/3244] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:13 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1322 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:15.151445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af0fce06-0f04-4a2b-9445-8234118fd52b tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:15.152198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af0fce06-0f04-4a2b-9445-8234118fd52b tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:15.168563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af0fce06-0f04-4a2b-9445-8234118fd52b tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:15.169119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af0fce06-0f04-4a2b-9445-8234118fd52b tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:15.169544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af0fce06-0f04-4a2b-9445-8234118fd52b tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:15.170278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af0fce06-0f04-4a2b-9445-8234118fd52b tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:15.170745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af0fce06-0f04-4a2b-9445-8234118fd52b tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:15.171185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af0fce06-0f04-4a2b-9445-8234118fd52b tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:15.610540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ba64a78-f03f-4677-8643-72272a247276 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:15.611583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1ba64a78-f03f-4677-8643-72272a247276 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:15.628559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ba64a78-f03f-4677-8643-72272a247276 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:15.629715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ba64a78-f03f-4677-8643-72272a247276 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:15.630427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ba64a78-f03f-4677-8643-72272a247276 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:15.632275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ba64a78-f03f-4677-8643-72272a247276 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:15.634610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ba64a78-f03f-4677-8643-72272a247276 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:15.645791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ba64a78-f03f-4677-8643-72272a247276 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:15.876438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af0fce06-0f04-4a2b-9445-8234118fd52b tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:15.897555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af0fce06-0f04-4a2b-9445-8234118fd52b tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:15.918033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af0fce06-0f04-4a2b-9445-8234118fd52b tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:15.936230 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af0fce06-0f04-4a2b-9445-8234118fd52b tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.789163 Aug 27 04:45:15.940219 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1650/3245] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:15 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:45:16.620912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-08c820cc-1e11-4b16-b39b-3cbd0ebe0a7b req-ee5b80bc-5d81-42c3-923a-73b07593d3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d594401f-5a00-4e2f-820a-677442452401", "name": "network-vif-plugged", "status": "completed", "tag": "7dd7fd58-1ee5-4e35-a79b-dfec1a00eeec"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:16.638874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=73 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:16.643181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08c820cc-1e11-4b16-b39b-3cbd0ebe0a7b req-ee5b80bc-5d81-42c3-923a-73b07593d3c3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:16.646421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08c820cc-1e11-4b16-b39b-3cbd0ebe0a7b req-ee5b80bc-5d81-42c3-923a-73b07593d3c3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:16.647219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08c820cc-1e11-4b16-b39b-3cbd0ebe0a7b req-ee5b80bc-5d81-42c3-923a-73b07593d3c3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:16.688391 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-08c820cc-1e11-4b16-b39b-3cbd0ebe0a7b req-ee5b80bc-5d81-42c3-923a-73b07593d3c3 service nova] Creating event network-vif-plugged:7dd7fd58-1ee5-4e35-a79b-dfec1a00eeec for instance d594401f-5a00-4e2f-820a-677442452401 on n-h1-854823-1 Aug 27 04:45:16.699187 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-08c820cc-1e11-4b16-b39b-3cbd0ebe0a7b req-ee5b80bc-5d81-42c3-923a-73b07593d3c3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082251 Aug 27 04:45:16.712922 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1651/3246] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:16.838297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1ba64a78-f03f-4677-8643-72272a247276 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:16.855509 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1ba64a78-f03f-4677-8643-72272a247276 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1322 microversion: 2.1 time: 1.245514 Aug 27 04:45:16.887285 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1596/3247] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:15 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1322 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:17.000768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-324b009c-4931-467c-8b54-d6693407fae9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:17.006154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-324b009c-4931-467c-8b54-d6693407fae9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:17.020676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-324b009c-4931-467c-8b54-d6693407fae9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:17.022941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-324b009c-4931-467c-8b54-d6693407fae9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:17.025303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-324b009c-4931-467c-8b54-d6693407fae9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:17.027463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-324b009c-4931-467c-8b54-d6693407fae9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:17.029383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-324b009c-4931-467c-8b54-d6693407fae9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:17.037343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-324b009c-4931-467c-8b54-d6693407fae9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:17.381694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-324b009c-4931-467c-8b54-d6693407fae9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:17.396030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-324b009c-4931-467c-8b54-d6693407fae9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:17.398027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-324b009c-4931-467c-8b54-d6693407fae9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:17.445092 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-324b009c-4931-467c-8b54-d6693407fae9 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.452967 Aug 27 04:45:17.447458 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1652/3248] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:16 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:17.892422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ccc0149b-0835-4383-b123-603a25fbc5c1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:17.893458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ccc0149b-0835-4383-b123-603a25fbc5c1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:17.908605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccc0149b-0835-4383-b123-603a25fbc5c1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:17.909466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccc0149b-0835-4383-b123-603a25fbc5c1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:17.910180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccc0149b-0835-4383-b123-603a25fbc5c1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:17.915030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccc0149b-0835-4383-b123-603a25fbc5c1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:17.917062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccc0149b-0835-4383-b123-603a25fbc5c1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:17.918564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccc0149b-0835-4383-b123-603a25fbc5c1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:18.482792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1fb3c6d3-d47a-43ef-bbf4-c89ea7d36c7c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:18.486288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1fb3c6d3-d47a-43ef-bbf4-c89ea7d36c7c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:18.501270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fb3c6d3-d47a-43ef-bbf4-c89ea7d36c7c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:18.502037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fb3c6d3-d47a-43ef-bbf4-c89ea7d36c7c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:18.502924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fb3c6d3-d47a-43ef-bbf4-c89ea7d36c7c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:18.503858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fb3c6d3-d47a-43ef-bbf4-c89ea7d36c7c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:18.504910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fb3c6d3-d47a-43ef-bbf4-c89ea7d36c7c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:18.505508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fb3c6d3-d47a-43ef-bbf4-c89ea7d36c7c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:18.844479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ccc0149b-0835-4383-b123-603a25fbc5c1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:18.861400 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ccc0149b-0835-4383-b123-603a25fbc5c1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1322 microversion: 2.1 time: 0.975152 Aug 27 04:45:18.880635 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1597/3249] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:17 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1322 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:18.887241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-7fffa7cf-4ecb-4b15-b8f4-94d5cf98452b req-9b531a6a-7453-4089-a2bb-237eba1a3172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfdfb1e3-2547-470d-a438-4a58bed4fa34", "name": "network-vif-plugged", "status": "completed", "tag": "a047eec5-6aaf-4e62-94ed-be03213f258f"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:18.897976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7fffa7cf-4ecb-4b15-b8f4-94d5cf98452b req-9b531a6a-7453-4089-a2bb-237eba1a3172 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:18.900198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7fffa7cf-4ecb-4b15-b8f4-94d5cf98452b req-9b531a6a-7453-4089-a2bb-237eba1a3172 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:18.901346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7fffa7cf-4ecb-4b15-b8f4-94d5cf98452b req-9b531a6a-7453-4089-a2bb-237eba1a3172 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:18.922002 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-7fffa7cf-4ecb-4b15-b8f4-94d5cf98452b req-9b531a6a-7453-4089-a2bb-237eba1a3172 service nova] Creating event network-vif-plugged:a047eec5-6aaf-4e62-94ed-be03213f258f for instance bfdfb1e3-2547-470d-a438-4a58bed4fa34 on n-h2-854823-1 Aug 27 04:45:18.928674 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-7fffa7cf-4ecb-4b15-b8f4-94d5cf98452b req-9b531a6a-7453-4089-a2bb-237eba1a3172 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046342 Aug 27 04:45:18.929925 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1598/3250] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:19.578755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1161674452", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "2548982f-0038-4fde-9ae8-51c14c91a2cf"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:19.638264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1fb3c6d3-d47a-43ef-bbf4-c89ea7d36c7c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:19.649780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1fb3c6d3-d47a-43ef-bbf4-c89ea7d36c7c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:19.655170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1fb3c6d3-d47a-43ef-bbf4-c89ea7d36c7c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:19.675911 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1fb3c6d3-d47a-43ef-bbf4-c89ea7d36c7c tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 1.207084 Aug 27 04:45:19.698710 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1653/3251] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:18 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:19.726804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] validate_networks() for [('2548982f-0038-4fde-9ae8-51c14c91a2cf', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:45:19.890130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2d79f045-a99a-4598-8b24-01794888a05c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:19.891287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2d79f045-a99a-4598-8b24-01794888a05c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:19.906637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d79f045-a99a-4598-8b24-01794888a05c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:19.911315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d79f045-a99a-4598-8b24-01794888a05c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:19.912706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d79f045-a99a-4598-8b24-01794888a05c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:19.915325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d79f045-a99a-4598-8b24-01794888a05c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:19.918055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d79f045-a99a-4598-8b24-01794888a05c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:19.919286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d79f045-a99a-4598-8b24-01794888a05c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:20.458752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2d79f045-a99a-4598-8b24-01794888a05c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:20.471990 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2d79f045-a99a-4598-8b24-01794888a05c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 200 len: 1515 microversion: 2.1 time: 0.588583 Aug 27 04:45:20.473766 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1654/3252] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:19 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 1515 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:20.508841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ea0f6cb-796c-41ea-a13f-7de2cc75cd78 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:20.513733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ea0f6cb-796c-41ea-a13f-7de2cc75cd78 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: bfdfb1e3-2547-470d-a438-4a58bed4fa34] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:20.533368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ea0f6cb-796c-41ea-a13f-7de2cc75cd78 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:20.534347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ea0f6cb-796c-41ea-a13f-7de2cc75cd78 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:20.535191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ea0f6cb-796c-41ea-a13f-7de2cc75cd78 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:20.536018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ea0f6cb-796c-41ea-a13f-7de2cc75cd78 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:20.536490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ea0f6cb-796c-41ea-a13f-7de2cc75cd78 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:20.536939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ea0f6cb-796c-41ea-a13f-7de2cc75cd78 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:20.906143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ea0f6cb-796c-41ea-a13f-7de2cc75cd78 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:20.940863 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ea0f6cb-796c-41ea-a13f-7de2cc75cd78 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/bfdfb1e3-2547-470d-a438-4a58bed4fa34" status: 200 len: 1322 microversion: 2.1 time: 0.438734 Aug 27 04:45:20.968295 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1655/3253] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:20 2022] GET /compute/v2.1/servers/bfdfb1e3-2547-470d-a438-4a58bed4fa34 => generated 1322 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:20.985360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9830d342-47ee-4846-9280-e8a6294e0426 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:20.993320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9830d342-47ee-4846-9280-e8a6294e0426 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:21.015132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9830d342-47ee-4846-9280-e8a6294e0426 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:21.016178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9830d342-47ee-4846-9280-e8a6294e0426 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:21.017524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9830d342-47ee-4846-9280-e8a6294e0426 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:21.018532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9830d342-47ee-4846-9280-e8a6294e0426 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:21.019391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9830d342-47ee-4846-9280-e8a6294e0426 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:21.020439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9830d342-47ee-4846-9280-e8a6294e0426 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:21.208381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9830d342-47ee-4846-9280-e8a6294e0426 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:21.230109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9830d342-47ee-4846-9280-e8a6294e0426 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:21.235618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9830d342-47ee-4846-9280-e8a6294e0426 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:21.255163 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9830d342-47ee-4846-9280-e8a6294e0426 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1447 microversion: 2.75 time: 0.282100 Aug 27 04:45:21.274676 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1656/3254] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:20 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1447 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:21.965963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eafcff90-2f75-473f-8f7f-2efe58329fc0 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:21.968428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eafcff90-2f75-473f-8f7f-2efe58329fc0 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: bfdfb1e3-2547-470d-a438-4a58bed4fa34] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:21.985464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eafcff90-2f75-473f-8f7f-2efe58329fc0 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:21.986701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eafcff90-2f75-473f-8f7f-2efe58329fc0 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:21.989668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eafcff90-2f75-473f-8f7f-2efe58329fc0 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:21.992400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eafcff90-2f75-473f-8f7f-2efe58329fc0 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:21.993169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eafcff90-2f75-473f-8f7f-2efe58329fc0 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:21.994845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eafcff90-2f75-473f-8f7f-2efe58329fc0 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:22.570519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eafcff90-2f75-473f-8f7f-2efe58329fc0 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:22.602420 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eafcff90-2f75-473f-8f7f-2efe58329fc0 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/bfdfb1e3-2547-470d-a438-4a58bed4fa34" status: 200 len: 1515 microversion: 2.1 time: 0.637604 Aug 27 04:45:22.602420 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1657/3255] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:21 2022] GET /compute/v2.1/servers/bfdfb1e3-2547-470d-a438-4a58bed4fa34 => generated 1515 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:22.630715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7c3bb32-1bd0-43f2-87e8-50bec7f2e055 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:22.633224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7c3bb32-1bd0-43f2-87e8-50bec7f2e055 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:22.661335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c3bb32-1bd0-43f2-87e8-50bec7f2e055 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:22.662265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c3bb32-1bd0-43f2-87e8-50bec7f2e055 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:22.663764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c3bb32-1bd0-43f2-87e8-50bec7f2e055 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:22.666543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c3bb32-1bd0-43f2-87e8-50bec7f2e055 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:22.667420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c3bb32-1bd0-43f2-87e8-50bec7f2e055 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:22.668117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c3bb32-1bd0-43f2-87e8-50bec7f2e055 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:22.708999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:45:22.709500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:45:22.709889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:45:22.710300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:45:22.714244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:45:22.734691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:22.735570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:22.736782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:22.756237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:22.761022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:22.764417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:22.885655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7c3bb32-1bd0-43f2-87e8-50bec7f2e055 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:22.887163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Getting quotas for project c64accd79d1e4da99742e21e87799eff. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:45:22.895999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7c3bb32-1bd0-43f2-87e8-50bec7f2e055 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:22.908249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7c3bb32-1bd0-43f2-87e8-50bec7f2e055 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:22.916853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Getting quotas for user f8b044ce4bc246cc9ca5341f05f22615 and project c64accd79d1e4da99742e21e87799eff. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:45:22.918209 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7c3bb32-1bd0-43f2-87e8-50bec7f2e055 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1453 microversion: 2.75 time: 0.297261 Aug 27 04:45:22.921695 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1658/3256] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:22 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1453 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:22.937438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d2aadcd-cc74-446b-aaeb-cf45b31ef5e7 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:22.938618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d2aadcd-cc74-446b-aaeb-cf45b31ef5e7 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: 7af3b552-91dc-4362-a577-341d856e2d23] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:22.954587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d2aadcd-cc74-446b-aaeb-cf45b31ef5e7 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:22.959106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d2aadcd-cc74-446b-aaeb-cf45b31ef5e7 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:22.959892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d2aadcd-cc74-446b-aaeb-cf45b31ef5e7 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:22.961386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d2aadcd-cc74-446b-aaeb-cf45b31ef5e7 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:22.963710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d2aadcd-cc74-446b-aaeb-cf45b31ef5e7 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:22.964395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d2aadcd-cc74-446b-aaeb-cf45b31ef5e7 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:23.003883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:45:23.010335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:45:23.130880 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-64cd3004-318f-4753-bff9-ca46a60015fc tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.784467 Aug 27 04:45:23.131867 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1599/3257] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:45:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:45:23.145547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-5c6d45ae-aff2-4461-b869-ee893651c0ae req-90bc00f8-e122-45e8-9992-8b6d9133ae5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af3b552-91dc-4362-a577-341d856e2d23", "name": "network-vif-plugged", "status": "completed", "tag": "53e0cca6-a03d-41af-8b11-d0492a7a20e5"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:23.173301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5c6d45ae-aff2-4461-b869-ee893651c0ae req-90bc00f8-e122-45e8-9992-8b6d9133ae5e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:23.174835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5c6d45ae-aff2-4461-b869-ee893651c0ae req-90bc00f8-e122-45e8-9992-8b6d9133ae5e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:23.178745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5c6d45ae-aff2-4461-b869-ee893651c0ae req-90bc00f8-e122-45e8-9992-8b6d9133ae5e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:23.232153 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-5c6d45ae-aff2-4461-b869-ee893651c0ae req-90bc00f8-e122-45e8-9992-8b6d9133ae5e service nova] Creating event network-vif-plugged:53e0cca6-a03d-41af-8b11-d0492a7a20e5 for instance 7af3b552-91dc-4362-a577-341d856e2d23 on n-h1-854823-1 Aug 27 04:45:23.263593 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-5c6d45ae-aff2-4461-b869-ee893651c0ae req-90bc00f8-e122-45e8-9992-8b6d9133ae5e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121211 Aug 27 04:45:23.264383 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1600/3258] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:23.299822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fcd39c55-4e8a-460d-b5f6-b4d9cca8c2af tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:23.309056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fcd39c55-4e8a-460d-b5f6-b4d9cca8c2af tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:23.608809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fcd39c55-4e8a-460d-b5f6-b4d9cca8c2af tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:23.624326 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fcd39c55-4e8a-460d-b5f6-b4d9cca8c2af tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1225 microversion: 2.1 time: 0.358329 Aug 27 04:45:23.646063 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1601/3259] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:23 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1225 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:23.931114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d2aadcd-cc74-446b-aaeb-cf45b31ef5e7 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:23.954070 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d2aadcd-cc74-446b-aaeb-cf45b31ef5e7 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23" status: 200 len: 1322 microversion: 2.1 time: 1.026935 Aug 27 04:45:23.959086 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1659/3260] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:22 2022] GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23 => generated 1322 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:23.965694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d22f905a-d850-4fe2-b31c-8d8b56556ce3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:23.966254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d22f905a-d850-4fe2-b31c-8d8b56556ce3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:24.052777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22f905a-d850-4fe2-b31c-8d8b56556ce3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:24.054549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22f905a-d850-4fe2-b31c-8d8b56556ce3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:24.055182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22f905a-d850-4fe2-b31c-8d8b56556ce3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:24.056076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22f905a-d850-4fe2-b31c-8d8b56556ce3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:24.058054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22f905a-d850-4fe2-b31c-8d8b56556ce3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:24.062831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22f905a-d850-4fe2-b31c-8d8b56556ce3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:24.287391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d22f905a-d850-4fe2-b31c-8d8b56556ce3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:24.307827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d22f905a-d850-4fe2-b31c-8d8b56556ce3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:24.311544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d22f905a-d850-4fe2-b31c-8d8b56556ce3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:24.329457 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d22f905a-d850-4fe2-b31c-8d8b56556ce3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1453 microversion: 2.75 time: 0.378030 Aug 27 04:45:24.337847 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1602/3261] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:23 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1453 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:45:24.650838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9aab0273-2886-4a3d-8129-ec021539a823 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:24.651502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9aab0273-2886-4a3d-8129-ec021539a823 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:24.668275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aab0273-2886-4a3d-8129-ec021539a823 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:24.669114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aab0273-2886-4a3d-8129-ec021539a823 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:24.672831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aab0273-2886-4a3d-8129-ec021539a823 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:24.674408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aab0273-2886-4a3d-8129-ec021539a823 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:24.675099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aab0273-2886-4a3d-8129-ec021539a823 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:24.675713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aab0273-2886-4a3d-8129-ec021539a823 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:24.862796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9aab0273-2886-4a3d-8129-ec021539a823 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:24.875596 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9aab0273-2886-4a3d-8129-ec021539a823 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1229 microversion: 2.1 time: 0.228756 Aug 27 04:45:24.879724 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1660/3262] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:24 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1229 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:24.982148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dd348929-70cf-49b7-8fe1-1f21c954da08 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:24.983633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dd348929-70cf-49b7-8fe1-1f21c954da08 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: 7af3b552-91dc-4362-a577-341d856e2d23] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:24.995625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd348929-70cf-49b7-8fe1-1f21c954da08 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:25.004660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd348929-70cf-49b7-8fe1-1f21c954da08 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:25.005119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd348929-70cf-49b7-8fe1-1f21c954da08 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:25.008350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd348929-70cf-49b7-8fe1-1f21c954da08 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:25.009009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd348929-70cf-49b7-8fe1-1f21c954da08 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:25.009879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd348929-70cf-49b7-8fe1-1f21c954da08 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:25.363299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8958920c-171d-4221-9cf8-cc5a27a28fab tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:25.365161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8958920c-171d-4221-9cf8-cc5a27a28fab tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:25.375337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8958920c-171d-4221-9cf8-cc5a27a28fab tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:25.383654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8958920c-171d-4221-9cf8-cc5a27a28fab tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:25.384486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8958920c-171d-4221-9cf8-cc5a27a28fab tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:25.385443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8958920c-171d-4221-9cf8-cc5a27a28fab tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:25.386078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8958920c-171d-4221-9cf8-cc5a27a28fab tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:25.386695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8958920c-171d-4221-9cf8-cc5a27a28fab tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:25.541454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8958920c-171d-4221-9cf8-cc5a27a28fab tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:25.552965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8958920c-171d-4221-9cf8-cc5a27a28fab tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:25.554595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8958920c-171d-4221-9cf8-cc5a27a28fab tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:25.587630 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8958920c-171d-4221-9cf8-cc5a27a28fab tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1438 microversion: 2.75 time: 0.225203 Aug 27 04:45:25.588546 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1661/3263] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:25 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1438 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:45:26.177997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dd348929-70cf-49b7-8fe1-1f21c954da08 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:26.190639 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dd348929-70cf-49b7-8fe1-1f21c954da08 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23" status: 200 len: 1322 microversion: 2.1 time: 1.213444 Aug 27 04:45:26.194455 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1603/3264] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:24 2022] GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23 => generated 1322 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:26.223924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5f9d6c1b-b896-422c-8566-fafa3b4e507c tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:26.226829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5f9d6c1b-b896-422c-8566-fafa3b4e507c tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:26.244621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f9d6c1b-b896-422c-8566-fafa3b4e507c tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:26.245757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f9d6c1b-b896-422c-8566-fafa3b4e507c tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:26.248444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f9d6c1b-b896-422c-8566-fafa3b4e507c tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:26.250030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f9d6c1b-b896-422c-8566-fafa3b4e507c tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:26.250930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f9d6c1b-b896-422c-8566-fafa3b4e507c tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:26.251629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f9d6c1b-b896-422c-8566-fafa3b4e507c tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:26.350001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71228424-9f42-4121-865e-14501cc9b5c0"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:26.353289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:26.372683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:26.373797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:26.376295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:26.377104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:26.379767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:26.380372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:26.556597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5f9d6c1b-b896-422c-8566-fafa3b4e507c tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:26.569768 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5f9d6c1b-b896-422c-8566-fafa3b4e507c tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1285 microversion: 2.1 time: 0.373795 Aug 27 04:45:26.574217 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1604/3265] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:26 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1285 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:26.678423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:45:26.678852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:45:26.679328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:45:26.679741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:45:26.680154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:45:26.872244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:26.899783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:26.900304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:26.900794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:26.905302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:26.912635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:26.913106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:27.223732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-82e20ecc-02a6-42e4-97a3-a58d729e2144 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:27.224467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-82e20ecc-02a6-42e4-97a3-a58d729e2144 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: 7af3b552-91dc-4362-a577-341d856e2d23] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:27.251046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82e20ecc-02a6-42e4-97a3-a58d729e2144 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:27.251046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82e20ecc-02a6-42e4-97a3-a58d729e2144 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:27.251046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82e20ecc-02a6-42e4-97a3-a58d729e2144 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:27.251717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82e20ecc-02a6-42e4-97a3-a58d729e2144 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:27.252188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82e20ecc-02a6-42e4-97a3-a58d729e2144 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:27.258316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82e20ecc-02a6-42e4-97a3-a58d729e2144 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:27.438412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:27.497312 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b20bd40f-a44b-4566-8215-f9342c31e874 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830/action" status: 202 len: 1942 microversion: 2.75 time: 1.881511 Aug 27 04:45:27.502384 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1662/3266] 10.222.0.79 () {62 vars in 1319 bytes} [Sat Aug 27 04:45:25 2022] POST /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830/action => generated 1942 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 27 04:45:27.526772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ceb4b86-9cd0-4a11-9f44-cee9cb7b5abe tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:27.527837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ceb4b86-9cd0-4a11-9f44-cee9cb7b5abe tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:27.540268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ceb4b86-9cd0-4a11-9f44-cee9cb7b5abe tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:27.543304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ceb4b86-9cd0-4a11-9f44-cee9cb7b5abe tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:27.544768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ceb4b86-9cd0-4a11-9f44-cee9cb7b5abe tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:27.545778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ceb4b86-9cd0-4a11-9f44-cee9cb7b5abe tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:27.550584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ceb4b86-9cd0-4a11-9f44-cee9cb7b5abe tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:27.553233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ceb4b86-9cd0-4a11-9f44-cee9cb7b5abe tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:27.788799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-82e20ecc-02a6-42e4-97a3-a58d729e2144 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:27.797568 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-82e20ecc-02a6-42e4-97a3-a58d729e2144 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23" status: 200 len: 1515 microversion: 2.1 time: 0.583727 Aug 27 04:45:27.803284 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1605/3267] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:27 2022] GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23 => generated 1515 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:27.823904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-30ee5bad-4eb2-42f4-aede-bbfcc630caf7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:27.825170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-30ee5bad-4eb2-42f4-aede-bbfcc630caf7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:27.841840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30ee5bad-4eb2-42f4-aede-bbfcc630caf7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:27.843217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30ee5bad-4eb2-42f4-aede-bbfcc630caf7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:27.845307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30ee5bad-4eb2-42f4-aede-bbfcc630caf7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:27.847189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30ee5bad-4eb2-42f4-aede-bbfcc630caf7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:27.861568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30ee5bad-4eb2-42f4-aede-bbfcc630caf7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:27.867099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-5ceb4b86-9cd0-4a11-9f44-cee9cb7b5abe tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:27.867937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30ee5bad-4eb2-42f4-aede-bbfcc630caf7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:27.903937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:27.934002 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ceb4b86-9cd0-4a11-9f44-cee9cb7b5abe tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.408400 Aug 27 04:45:27.948396 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1663/3268] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:27 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:28.049337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-30ee5bad-4eb2-42f4-aede-bbfcc630caf7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:28.068564 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-30ee5bad-4eb2-42f4-aede-bbfcc630caf7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1283 microversion: 2.1 time: 0.263551 Aug 27 04:45:28.073105 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1606/3269] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:27 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1283 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:28.086595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-36baed2f-2e26-40f4-873e-7f04afcd6b18 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:28.087499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-36baed2f-2e26-40f4-873e-7f04afcd6b18 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: 7af3b552-91dc-4362-a577-341d856e2d23] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:28.109288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36baed2f-2e26-40f4-873e-7f04afcd6b18 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:28.111276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36baed2f-2e26-40f4-873e-7f04afcd6b18 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:28.114379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36baed2f-2e26-40f4-873e-7f04afcd6b18 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:28.115426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36baed2f-2e26-40f4-873e-7f04afcd6b18 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:28.118528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36baed2f-2e26-40f4-873e-7f04afcd6b18 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:28.121442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36baed2f-2e26-40f4-873e-7f04afcd6b18 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:28.215784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-36baed2f-2e26-40f4-873e-7f04afcd6b18 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: 7af3b552-91dc-4362-a577-341d856e2d23] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:45:28.439044 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-36baed2f-2e26-40f4-873e-7f04afcd6b18 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23" status: 204 len: 0 microversion: 2.1 time: 0.364211 Aug 27 04:45:28.440430 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1607/3270] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:45:28 2022] DELETE /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:45:28.452835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-60dbd637-51af-4f75-890a-2c47812a7e5b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:28.453888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-60dbd637-51af-4f75-890a-2c47812a7e5b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: 7af3b552-91dc-4362-a577-341d856e2d23] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:28.466984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60dbd637-51af-4f75-890a-2c47812a7e5b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:28.468906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60dbd637-51af-4f75-890a-2c47812a7e5b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:28.469944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60dbd637-51af-4f75-890a-2c47812a7e5b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:28.472513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60dbd637-51af-4f75-890a-2c47812a7e5b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:28.476767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60dbd637-51af-4f75-890a-2c47812a7e5b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:28.477985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60dbd637-51af-4f75-890a-2c47812a7e5b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:28.650173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bb8662f1-8e90-4bbe-98a1-537f25512014 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Action: 'create', calling method: .version_select at 0x7f1f20d88430>, body: {"keypair": {"name": "tempest-keypair-1980650497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHQBKTGQsXF0LxNfxzV8qrA266aMsZbaN1DXisTb8EAX/nwN2NFd5iUyPu+HpiBM+b8UVHhIxZDc4MCI2fE0uF25L0mFQNiTKa46lPveuYyk1xqqNJcxsEgIsWAQTIc/w=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:28.686158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-bb8662f1-8e90-4bbe-98a1-537f25512014 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Getting quotas for project 43debe5241484aa3b2ff9a740385e206. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:45:28.699153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-bb8662f1-8e90-4bbe-98a1-537f25512014 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Getting quotas for user 3a3ef15e74a342f6915052624a0f19a1 and project 43debe5241484aa3b2ff9a740385e206. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:45:28.757816 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bb8662f1-8e90-4bbe-98a1-537f25512014 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.817877 Aug 27 04:45:28.758441 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1664/3271] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:45:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:28.927306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-60dbd637-51af-4f75-890a-2c47812a7e5b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:28.941019 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-60dbd637-51af-4f75-890a-2c47812a7e5b tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23" status: 200 len: 1521 microversion: 2.1 time: 0.490184 Aug 27 04:45:28.942375 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1608/3272] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:28 2022] GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23 => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:28.966326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fde0c3a5-8b4e-4ee1-b46d-58e0579995ff tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:28.967159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fde0c3a5-8b4e-4ee1-b46d-58e0579995ff tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:28.974531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fde0c3a5-8b4e-4ee1-b46d-58e0579995ff tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:28.975186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fde0c3a5-8b4e-4ee1-b46d-58e0579995ff tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:28.975734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fde0c3a5-8b4e-4ee1-b46d-58e0579995ff tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:28.976590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fde0c3a5-8b4e-4ee1-b46d-58e0579995ff tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:28.978477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fde0c3a5-8b4e-4ee1-b46d-58e0579995ff tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:28.979715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fde0c3a5-8b4e-4ee1-b46d-58e0579995ff tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:29.099268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7f021742-aaf8-4304-86f0-33c5204ad969 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:29.100010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7f021742-aaf8-4304-86f0-33c5204ad969 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:29.118007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f021742-aaf8-4304-86f0-33c5204ad969 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:29.121869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f021742-aaf8-4304-86f0-33c5204ad969 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:29.124685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f021742-aaf8-4304-86f0-33c5204ad969 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:29.127841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f021742-aaf8-4304-86f0-33c5204ad969 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:29.131651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f021742-aaf8-4304-86f0-33c5204ad969 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:29.132241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f021742-aaf8-4304-86f0-33c5204ad969 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:29.186472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:29.369475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7f021742-aaf8-4304-86f0-33c5204ad969 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:29.383502 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7f021742-aaf8-4304-86f0-33c5204ad969 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1283 microversion: 2.1 time: 0.289054 Aug 27 04:45:29.391291 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1609/3273] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:29 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1283 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:29.435748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-fde0c3a5-8b4e-4ee1-b46d-58e0579995ff tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:29.491841 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fde0c3a5-8b4e-4ee1-b46d-58e0579995ff tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.529376 Aug 27 04:45:29.496266 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1665/3274] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:28 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:29.964129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b8951cf5-2791-496b-8a67-1e20ab7089c6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:29.965725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b8951cf5-2791-496b-8a67-1e20ab7089c6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: 7af3b552-91dc-4362-a577-341d856e2d23] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:29.981167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8951cf5-2791-496b-8a67-1e20ab7089c6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:29.982228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8951cf5-2791-496b-8a67-1e20ab7089c6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:29.983018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8951cf5-2791-496b-8a67-1e20ab7089c6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:29.985166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8951cf5-2791-496b-8a67-1e20ab7089c6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:29.988513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8951cf5-2791-496b-8a67-1e20ab7089c6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:29.989306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8951cf5-2791-496b-8a67-1e20ab7089c6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:30.409049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05fb47f0-c954-4c58-bc87-3dc305d9d264 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:30.410946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05fb47f0-c954-4c58-bc87-3dc305d9d264 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:30.423760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05fb47f0-c954-4c58-bc87-3dc305d9d264 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:30.427979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05fb47f0-c954-4c58-bc87-3dc305d9d264 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:30.430184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05fb47f0-c954-4c58-bc87-3dc305d9d264 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:30.431166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05fb47f0-c954-4c58-bc87-3dc305d9d264 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:30.434154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05fb47f0-c954-4c58-bc87-3dc305d9d264 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:30.435767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05fb47f0-c954-4c58-bc87-3dc305d9d264 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:31.182944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05fb47f0-c954-4c58-bc87-3dc305d9d264 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:31.203619 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05fb47f0-c954-4c58-bc87-3dc305d9d264 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1325 microversion: 2.1 time: 0.798695 Aug 27 04:45:31.219572 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1666/3275] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:30 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1325 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:31.235025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f4dbdab1-3786-42e1-8206-b533a040809c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:31.236486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f4dbdab1-3786-42e1-8206-b533a040809c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:31.244869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4dbdab1-3786-42e1-8206-b533a040809c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:31.245551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4dbdab1-3786-42e1-8206-b533a040809c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:31.248617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4dbdab1-3786-42e1-8206-b533a040809c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:31.249587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4dbdab1-3786-42e1-8206-b533a040809c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:31.250220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4dbdab1-3786-42e1-8206-b533a040809c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:31.250840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4dbdab1-3786-42e1-8206-b533a040809c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:31.487171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-f4dbdab1-3786-42e1-8206-b533a040809c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:31.549149 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f4dbdab1-3786-42e1-8206-b533a040809c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.325569 Aug 27 04:45:31.566053 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1667/3276] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:31 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:32.107762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b8951cf5-2791-496b-8a67-1e20ab7089c6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:32.134237 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b8951cf5-2791-496b-8a67-1e20ab7089c6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23" status: 200 len: 1521 microversion: 2.1 time: 2.173631 Aug 27 04:45:32.151072 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1610/3277] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:29 2022] GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23 => generated 1521 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:32.233853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22a4831f-b59e-4da1-bf96-f0a9ba5c54c4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:32.235509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22a4831f-b59e-4da1-bf96-f0a9ba5c54c4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:32.248891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22a4831f-b59e-4da1-bf96-f0a9ba5c54c4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:32.250558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22a4831f-b59e-4da1-bf96-f0a9ba5c54c4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:32.253476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22a4831f-b59e-4da1-bf96-f0a9ba5c54c4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:32.256173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22a4831f-b59e-4da1-bf96-f0a9ba5c54c4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:32.257994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22a4831f-b59e-4da1-bf96-f0a9ba5c54c4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:32.262845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22a4831f-b59e-4da1-bf96-f0a9ba5c54c4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:32.581610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2d627d6d-afcd-40e2-a6cf-936edf28e44d tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:32.582502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2d627d6d-afcd-40e2-a6cf-936edf28e44d tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:32.600994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d627d6d-afcd-40e2-a6cf-936edf28e44d tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:32.601165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d627d6d-afcd-40e2-a6cf-936edf28e44d tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:32.604066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d627d6d-afcd-40e2-a6cf-936edf28e44d tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:32.605052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d627d6d-afcd-40e2-a6cf-936edf28e44d tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:32.607319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d627d6d-afcd-40e2-a6cf-936edf28e44d tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:32.608088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d627d6d-afcd-40e2-a6cf-936edf28e44d tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:32.839562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:32.964265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-2d627d6d-afcd-40e2-a6cf-936edf28e44d tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:33.020516 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2d627d6d-afcd-40e2-a6cf-936edf28e44d tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.444466 Aug 27 04:45:33.026854 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1611/3278] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:32 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:45:33.043739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8bfb5040-fb41-4109-afd2-c1c74d0c9795 req-6323fda7-48c6-473d-bd07-c8331bdf22d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af3b552-91dc-4362-a577-341d856e2d23", "name": "network-vif-deleted", "tag": "53e0cca6-a03d-41af-8b11-d0492a7a20e5"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:33.074474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8bfb5040-fb41-4109-afd2-c1c74d0c9795 req-6323fda7-48c6-473d-bd07-c8331bdf22d0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:33.082985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8bfb5040-fb41-4109-afd2-c1c74d0c9795 req-6323fda7-48c6-473d-bd07-c8331bdf22d0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:33.087365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8bfb5040-fb41-4109-afd2-c1c74d0c9795 req-6323fda7-48c6-473d-bd07-c8331bdf22d0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:33.140923 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8bfb5040-fb41-4109-afd2-c1c74d0c9795 req-6323fda7-48c6-473d-bd07-c8331bdf22d0 service nova] Creating event network-vif-deleted:53e0cca6-a03d-41af-8b11-d0492a7a20e5 for instance 7af3b552-91dc-4362-a577-341d856e2d23 on n-h1-854823-1 Aug 27 04:45:33.183966 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8bfb5040-fb41-4109-afd2-c1c74d0c9795 req-6323fda7-48c6-473d-bd07-c8331bdf22d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145339 Aug 27 04:45:33.187991 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1612/3279] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:33.209983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0bde2a6d-ffc3-4d2a-91e9-325ce82668e1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:33.211432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0bde2a6d-ffc3-4d2a-91e9-325ce82668e1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: 7af3b552-91dc-4362-a577-341d856e2d23] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:33.246588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bde2a6d-ffc3-4d2a-91e9-325ce82668e1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:33.248973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bde2a6d-ffc3-4d2a-91e9-325ce82668e1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:33.249665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bde2a6d-ffc3-4d2a-91e9-325ce82668e1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:33.251376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bde2a6d-ffc3-4d2a-91e9-325ce82668e1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:33.254745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bde2a6d-ffc3-4d2a-91e9-325ce82668e1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:33.255380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bde2a6d-ffc3-4d2a-91e9-325ce82668e1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:33.349312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bde2a6d-ffc3-4d2a-91e9-325ce82668e1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:33.363880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bde2a6d-ffc3-4d2a-91e9-325ce82668e1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:33.364957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bde2a6d-ffc3-4d2a-91e9-325ce82668e1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:33.367377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-0bde2a6d-ffc3-4d2a-91e9-325ce82668e1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lazy-loading 'fault' on Instance uuid 7af3b552-91dc-4362-a577-341d856e2d23 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:33.471410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22a4831f-b59e-4da1-bf96-f0a9ba5c54c4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:33.500930 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22a4831f-b59e-4da1-bf96-f0a9ba5c54c4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1325 microversion: 2.1 time: 1.275305 Aug 27 04:45:33.505523 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1668/3280] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:32 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1325 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:33.619981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:33.650807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0bde2a6d-ffc3-4d2a-91e9-325ce82668e1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:33.677083 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0bde2a6d-ffc3-4d2a-91e9-325ce82668e1 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23" status: 200 len: 1312 microversion: 2.1 time: 0.468962 Aug 27 04:45:33.677800 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1613/3281] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:33 2022] GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23 => generated 1312 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:34.063139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5fd9be52-e98c-40c4-b862-c7ebbaf94976 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:34.063863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5fd9be52-e98c-40c4-b862-c7ebbaf94976 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:34.075420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fd9be52-e98c-40c4-b862-c7ebbaf94976 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:34.077675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fd9be52-e98c-40c4-b862-c7ebbaf94976 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:34.079560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fd9be52-e98c-40c4-b862-c7ebbaf94976 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:34.083537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fd9be52-e98c-40c4-b862-c7ebbaf94976 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:34.084484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fd9be52-e98c-40c4-b862-c7ebbaf94976 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:34.085155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fd9be52-e98c-40c4-b862-c7ebbaf94976 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:34.246876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-c7685971-7a27-4cd1-83ce-d7c476d2e5bc req-091d1033-094c-4001-a974-6a5d670655d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a85efe71-d7cc-4d7d-be50-ed00163e8a1b", "tag": "7dd852d5-0e54-4463-93eb-fdabd76a915c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:34.275747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c7685971-7a27-4cd1-83ce-d7c476d2e5bc req-091d1033-094c-4001-a974-6a5d670655d3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:34.276346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c7685971-7a27-4cd1-83ce-d7c476d2e5bc req-091d1033-094c-4001-a974-6a5d670655d3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:34.276821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c7685971-7a27-4cd1-83ce-d7c476d2e5bc req-091d1033-094c-4001-a974-6a5d670655d3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:34.308252 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-c7685971-7a27-4cd1-83ce-d7c476d2e5bc req-091d1033-094c-4001-a974-6a5d670655d3 service nova] Creating event network-changed:7dd852d5-0e54-4463-93eb-fdabd76a915c for instance a85efe71-d7cc-4d7d-be50-ed00163e8a1b on n-h2-854823-1 Aug 27 04:45:34.314595 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-c7685971-7a27-4cd1-83ce-d7c476d2e5bc req-091d1033-094c-4001-a974-6a5d670655d3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075555 Aug 27 04:45:34.315851 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1614/3282] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:45:34.529142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-5fd9be52-e98c-40c4-b862-c7ebbaf94976 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:34.530083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2517647b-4150-4e4f-a8d0-a989ed830af6 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:34.531512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2517647b-4150-4e4f-a8d0-a989ed830af6 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:34.543688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:34.545375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2517647b-4150-4e4f-a8d0-a989ed830af6 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:34.545871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2517647b-4150-4e4f-a8d0-a989ed830af6 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:34.546310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2517647b-4150-4e4f-a8d0-a989ed830af6 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:34.547025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2517647b-4150-4e4f-a8d0-a989ed830af6 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:34.547491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2517647b-4150-4e4f-a8d0-a989ed830af6 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:34.547942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2517647b-4150-4e4f-a8d0-a989ed830af6 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:34.603422 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5fd9be52-e98c-40c4-b862-c7ebbaf94976 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.544498 Aug 27 04:45:34.605279 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1669/3283] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:34 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:34.700881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5c2fef6-0f89-4a43-80ac-85b220156116 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:34.701671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5c2fef6-0f89-4a43-80ac-85b220156116 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: 7af3b552-91dc-4362-a577-341d856e2d23] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:34.713854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5c2fef6-0f89-4a43-80ac-85b220156116 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:34.714515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5c2fef6-0f89-4a43-80ac-85b220156116 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:34.715084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5c2fef6-0f89-4a43-80ac-85b220156116 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:34.715913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5c2fef6-0f89-4a43-80ac-85b220156116 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:34.724622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5c2fef6-0f89-4a43-80ac-85b220156116 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:34.725409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5c2fef6-0f89-4a43-80ac-85b220156116 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:34.749870 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c5c2fef6-0f89-4a43-80ac-85b220156116 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] HTTP exception thrown: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5c2fef6-0f89-4a43-80ac-85b220156116 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Request method failure captured: Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23 HTTP/1.1 Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaFBQjAzjzN9k_hnBr-Wl4fCDWMQGKruAh54ZQ99f5UA-JB5EvKcRfp2S95FOXDtM5qJEg0PhrQYHU03WQCuc2iR5fRvVy-RhkAd9cpRYRt0yboJPZ54ZCH9SEL3ne_EUc1RK6lej-wUNbq1hUBtHWak053sNe8kw6BDBORXhrDPTcA Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b4c2750325a547848214f021f63aecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b4c2750325a547848214f021f63aecb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: aca12246038e4b8e8cf1233d7f14d67a Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '7af3b552-91dc-4362-a577-341d856e2d23'} Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:34.760055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:34.765270 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:34.765270 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:34.765270 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:34.765270 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:34.765270 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:34.765270 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:34.765270 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:34.765270 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:34.765270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5c2fef6-0f89-4a43-80ac-85b220156116 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Returning 404 to user: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:34.765270 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5c2fef6-0f89-4a43-80ac-85b220156116 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23" status: 404 len: 111 microversion: 2.1 time: 0.064940 Aug 27 04:45:34.769187 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1670/3284] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:34 2022] GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:45:34.783170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-961ac114-e48a-4a0b-be9a-ee1dcd8c34a6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:34.789433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-961ac114-e48a-4a0b-be9a-ee1dcd8c34a6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:34.790740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-961ac114-e48a-4a0b-be9a-ee1dcd8c34a6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'b4c2750325a547848214f021f63aecb6'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:45:34.802316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-961ac114-e48a-4a0b-be9a-ee1dcd8c34a6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:34.806084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-961ac114-e48a-4a0b-be9a-ee1dcd8c34a6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:34.806084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-961ac114-e48a-4a0b-be9a-ee1dcd8c34a6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:34.806084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-961ac114-e48a-4a0b-be9a-ee1dcd8c34a6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:34.806084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-961ac114-e48a-4a0b-be9a-ee1dcd8c34a6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:34.812574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-961ac114-e48a-4a0b-be9a-ee1dcd8c34a6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:34.911289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2517647b-4150-4e4f-a8d0-a989ed830af6 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:34.925104 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2517647b-4150-4e4f-a8d0-a989ed830af6 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1325 microversion: 2.1 time: 0.399505 Aug 27 04:45:34.927969 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1615/3285] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:34 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1325 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:34.977929 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-961ac114-e48a-4a0b-be9a-ee1dcd8c34a6 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.199400 Aug 27 04:45:34.988708 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1671/3286] 10.222.0.79 () {58 vars in 1230 bytes} [Sat Aug 27 04:45:34 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:45:34.995690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2b86779a-1710-4d00-aaf9-cc18e23ad8a4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2b86779a-1710-4d00-aaf9-cc18e23ad8a4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Request method failure captured: Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaFBQjAzjzN9k_hnBr-Wl4fCDWMQGKruAh54ZQ99f5UA-JB5EvKcRfp2S95FOXDtM5qJEg0PhrQYHU03WQCuc2iR5fRvVy-RhkAd9cpRYRt0yboJPZ54ZCH9SEL3ne_EUc1RK6lej-wUNbq1hUBtHWak053sNe8kw6BDBORXhrDPTcA Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b4c2750325a547848214f021f63aecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b4c2750325a547848214f021f63aecb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: aca12246038e4b8e8cf1233d7f14d67a Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: action_args: {} Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 04:45:35.000995 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:45:35.008069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:45:35.008069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:45:35.008069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:45:35.008069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 04:45:35.008069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.008069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:35.008069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.008069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:35.008069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:35.008069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:35.008069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:45:35.008069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:45:35.008069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 04:45:35.008069 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.012185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2b86779a-1710-4d00-aaf9-cc18e23ad8a4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:35.013547 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2b86779a-1710-4d00-aaf9-cc18e23ad8a4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.023026 Aug 27 04:45:35.014385 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1616/3287] 10.222.0.79 () {58 vars in 1182 bytes} [Sat Aug 27 04:45:34 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:45:35.033368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe7f0c61-4a12-4dbb-ac4e-c391975f5881 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:35.043042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe7f0c61-4a12-4dbb-ac4e-c391975f5881 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:35.044722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe7f0c61-4a12-4dbb-ac4e-c391975f5881 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Searching by: {'deleted': False, 'project_id': 'b4c2750325a547848214f021f63aecb6'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:45:35.056725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe7f0c61-4a12-4dbb-ac4e-c391975f5881 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:35.057545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe7f0c61-4a12-4dbb-ac4e-c391975f5881 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:35.058234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe7f0c61-4a12-4dbb-ac4e-c391975f5881 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:35.059215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe7f0c61-4a12-4dbb-ac4e-c391975f5881 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:35.061426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe7f0c61-4a12-4dbb-ac4e-c391975f5881 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:35.064479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe7f0c61-4a12-4dbb-ac4e-c391975f5881 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:35.106673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-fe7f0c61-4a12-4dbb-ac4e-c391975f5881 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:45:35.161974 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe7f0c61-4a12-4dbb-ac4e-c391975f5881 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.136811 Aug 27 04:45:35.163043 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1672/3288] 10.222.0.79 () {58 vars in 1125 bytes} [Sat Aug 27 04:45:35 2022] GET /compute/v2.1/servers => generated 681 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:35.176423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a1f7f32-e06f-4402-93ae-72203cbf69cc tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:35.189491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6a1f7f32-e06f-4402-93ae-72203cbf69cc tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:35.193977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.compute.servers [None req-6a1f7f32-e06f-4402-93ae-72203cbf69cc tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Removing options 'limit' from query {{(pid=128870) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 04:45:35.197707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a1f7f32-e06f-4402-93ae-72203cbf69cc tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Searching by: {'deleted': False, 'project_id': 'b4c2750325a547848214f021f63aecb6'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:45:35.229172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a1f7f32-e06f-4402-93ae-72203cbf69cc tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:35.230246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a1f7f32-e06f-4402-93ae-72203cbf69cc tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:35.230858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a1f7f32-e06f-4402-93ae-72203cbf69cc tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:35.237635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a1f7f32-e06f-4402-93ae-72203cbf69cc tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:35.238163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a1f7f32-e06f-4402-93ae-72203cbf69cc tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:35.239352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a1f7f32-e06f-4402-93ae-72203cbf69cc tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:35.332743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-6a1f7f32-e06f-4402-93ae-72203cbf69cc tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:45:35.416605 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a1f7f32-e06f-4402-93ae-72203cbf69cc tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.245893 Aug 27 04:45:35.419547 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1617/3289] 10.222.0.79 () {58 vars in 1144 bytes} [Sat Aug 27 04:45:35 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:35.434305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d5cf9a6-177f-4a6f-bc3f-d445299a35c9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d5cf9a6-177f-4a6f-bc3f-d445299a35c9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Request method failure captured: Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaFBQjAzjzN9k_hnBr-Wl4fCDWMQGKruAh54ZQ99f5UA-JB5EvKcRfp2S95FOXDtM5qJEg0PhrQYHU03WQCuc2iR5fRvVy-RhkAd9cpRYRt0yboJPZ54ZCH9SEL3ne_EUc1RK6lej-wUNbq1hUBtHWak053sNe8kw6BDBORXhrDPTcA Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b4c2750325a547848214f021f63aecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b4c2750325a547848214f021f63aecb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: aca12246038e4b8e8cf1233d7f14d67a Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: action_args: {} Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi '-1' Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 04:45:35.439830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d5cf9a6-177f-4a6f-bc3f-d445299a35c9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d5cf9a6-177f-4a6f-bc3f-d445299a35c9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.014453 Aug 27 04:45:35.445469 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1673/3290] 10.222.0.79 () {58 vars in 1142 bytes} [Sat Aug 27 04:45:35 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:45:35.457347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8a4b5b1-2e6c-400d-93db-3e33d7d1957e tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8a4b5b1-2e6c-400d-93db-3e33d7d1957e tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Request method failure captured: Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaFBQjAzjzN9k_hnBr-Wl4fCDWMQGKruAh54ZQ99f5UA-JB5EvKcRfp2S95FOXDtM5qJEg0PhrQYHU03WQCuc2iR5fRvVy-RhkAd9cpRYRt0yboJPZ54ZCH9SEL3ne_EUc1RK6lej-wUNbq1hUBtHWak053sNe8kw6BDBORXhrDPTcA Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b4c2750325a547848214f021f63aecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b4c2750325a547848214f021f63aecb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: aca12246038e4b8e8cf1233d7f14d67a Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: action_args: {} Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'testing' Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 04:45:35.461803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8a4b5b1-2e6c-400d-93db-3e33d7d1957e tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d8a4b5b1-2e6c-400d-93db-3e33d7d1957e tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.012815 Aug 27 04:45:35.467574 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1618/3291] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:45:35 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:45:35.480041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e7aadc89-cb84-4feb-9923-023c17448b42 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:35.490577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e7aadc89-cb84-4feb-9923-023c17448b42 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:35.491583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e7aadc89-cb84-4feb-9923-023c17448b42 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'b4c2750325a547848214f021f63aecb6'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:45:35.501090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.compute.servers [None req-e7aadc89-cb84-4feb-9923-023c17448b42 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Flavor 'non_existing_flavor' could not be found {{(pid=128869) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 27 04:45:35.503604 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e7aadc89-cb84-4feb-9923-023c17448b42 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.032803 Aug 27 04:45:35.505606 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1674/3292] 10.222.0.79 () {58 vars in 1178 bytes} [Sat Aug 27 04:45:35 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:45:35.522485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2a83e2f0-f283-40ac-8f3c-036159a09024 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:35.528353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a83e2f0-f283-40ac-8f3c-036159a09024 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:35.529309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2a83e2f0-f283-40ac-8f3c-036159a09024 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'b4c2750325a547848214f021f63aecb6'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:45:35.536959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a83e2f0-f283-40ac-8f3c-036159a09024 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:35.538038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a83e2f0-f283-40ac-8f3c-036159a09024 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:35.538708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a83e2f0-f283-40ac-8f3c-036159a09024 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:35.539559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a83e2f0-f283-40ac-8f3c-036159a09024 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:35.539929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a83e2f0-f283-40ac-8f3c-036159a09024 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:35.540363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a83e2f0-f283-40ac-8f3c-036159a09024 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:35.637597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3f3014e-437d-4b86-b88c-f6443bf44373 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:35.638141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3f3014e-437d-4b86-b88c-f6443bf44373 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:35.657658 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2a83e2f0-f283-40ac-8f3c-036159a09024 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.142334 Aug 27 04:45:35.660908 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1619/3293] 10.222.0.79 () {58 vars in 1174 bytes} [Sat Aug 27 04:45:35 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:45:35.670724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-58d7eb0e-7330-4685-b981-74c8d7f4a41d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:35.679386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3f3014e-437d-4b86-b88c-f6443bf44373 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:35.681637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3f3014e-437d-4b86-b88c-f6443bf44373 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:35.682667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3f3014e-437d-4b86-b88c-f6443bf44373 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:35.683445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3f3014e-437d-4b86-b88c-f6443bf44373 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:35.683921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3f3014e-437d-4b86-b88c-f6443bf44373 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:35.684356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3f3014e-437d-4b86-b88c-f6443bf44373 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:35.685842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-58d7eb0e-7330-4685-b981-74c8d7f4a41d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:35.686596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-58d7eb0e-7330-4685-b981-74c8d7f4a41d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'b4c2750325a547848214f021f63aecb6'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:45:35.702405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58d7eb0e-7330-4685-b981-74c8d7f4a41d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:35.702893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58d7eb0e-7330-4685-b981-74c8d7f4a41d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:35.703447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58d7eb0e-7330-4685-b981-74c8d7f4a41d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:35.704189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58d7eb0e-7330-4685-b981-74c8d7f4a41d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:35.704679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58d7eb0e-7330-4685-b981-74c8d7f4a41d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:35.705108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58d7eb0e-7330-4685-b981-74c8d7f4a41d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:35.835084 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-58d7eb0e-7330-4685-b981-74c8d7f4a41d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.168255 Aug 27 04:45:35.836399 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1620/3294] 10.222.0.79 () {58 vars in 1184 bytes} [Sat Aug 27 04:45:35 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:45:35.848772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:35.854082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:35.854902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-f3f3014e-437d-4b86-b88c-f6443bf44373 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:35.855589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Searching by: {'deleted': False, 'project_id': 'b4c2750325a547848214f021f63aecb6'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:45:35.861483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:35.862346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:35.863017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:35.866945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:35.867713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:35.868402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:35.904097 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3f3014e-437d-4b86-b88c-f6443bf44373 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.271226 Aug 27 04:45:35.905494 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1675/3295] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:35 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:35.924740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:45:35.958572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d8be57f-5487-444d-ad43-d1afc187aa99 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:35.962216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d8be57f-5487-444d-ad43-d1afc187aa99 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:35.990291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d8be57f-5487-444d-ad43-d1afc187aa99 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:35.990898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d8be57f-5487-444d-ad43-d1afc187aa99 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:35.992028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d8be57f-5487-444d-ad43-d1afc187aa99 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:35.993228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d8be57f-5487-444d-ad43-d1afc187aa99 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:35.994053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d8be57f-5487-444d-ad43-d1afc187aa99 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:35.994712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d8be57f-5487-444d-ad43-d1afc187aa99 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:36.006828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:36.025287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:36.025782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:36.026218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:36.263244 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-27fb506f-a64a-47bf-8289-92c603dc43f9 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.418674 Aug 27 04:45:36.275891 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1621/3296] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:45:35 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:36.294214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4bda952-9765-4f4a-9a9b-deb1456aadc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:36.300022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f4bda952-9765-4f4a-9a9b-deb1456aadc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:36.309959 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f4bda952-9765-4f4a-9a9b-deb1456aadc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.020018 Aug 27 04:45:36.310786 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1622/3297] 10.222.0.79 () {58 vars in 1178 bytes} [Sat Aug 27 04:45:36 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:45:36.358661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d8be57f-5487-444d-ad43-d1afc187aa99 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:36.371223 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d8be57f-5487-444d-ad43-d1afc187aa99 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1325 microversion: 2.1 time: 0.423461 Aug 27 04:45:36.371849 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1676/3298] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:35 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1325 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:36.393497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ddb8792-5d41-414f-b3c5-f1844e9b6f17 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:36.412887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ddb8792-5d41-414f-b3c5-f1844e9b6f17 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:36.422977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ddb8792-5d41-414f-b3c5-f1844e9b6f17 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Searching by: {'deleted': False, 'project_id': 'b4c2750325a547848214f021f63aecb6'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:45:36.435479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ddb8792-5d41-414f-b3c5-f1844e9b6f17 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:36.435819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ddb8792-5d41-414f-b3c5-f1844e9b6f17 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:36.436264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ddb8792-5d41-414f-b3c5-f1844e9b6f17 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:36.437041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ddb8792-5d41-414f-b3c5-f1844e9b6f17 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:36.437615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ddb8792-5d41-414f-b3c5-f1844e9b6f17 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:36.438340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ddb8792-5d41-414f-b3c5-f1844e9b6f17 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:36.538167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-5ddb8792-5d41-414f-b3c5-f1844e9b6f17 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:45:36.600556 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ddb8792-5d41-414f-b3c5-f1844e9b6f17 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.227577 Aug 27 04:45:36.615371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5644e7c8-23a7-46e3-9e68-aa9d4a90b9a6 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Calling method '.version_select at 0x7f1f2162c3a0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:36.620636 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1677/3299] 10.222.0.79 () {58 vars in 1125 bytes} [Sat Aug 27 04:45:36 2022] GET /compute/v2.1/servers => generated 681 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:36.634802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-454208411", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "defa386b-979a-4be2-93f1-9605a8c758e8"}], "security_groups": [{"name": "tempest-securitygroup--2036990788"}], "key_name": "tempest-keypair-1624376974", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "2fecb2ca-a592-4056-92ce-350a2550ea55", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:36.665558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG neutronclient.v2_0.client [None req-5644e7c8-23a7-46e3-9e68-aa9d4a90b9a6 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5c3bcd46-e343-412f-8f49-82c347264f77 does not exist", "detail": ""}} {{(pid=128870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:45:36.666867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.security_group_api [None req-5644e7c8-23a7-46e3-9e68-aa9d4a90b9a6 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Neutron security group 5c3bcd46-e343-412f-8f49-82c347264f77 not found {{(pid=128870) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:45:36.668023 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-5644e7c8-23a7-46e3-9e68-aa9d4a90b9a6 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] HTTP exception thrown: Security group 5c3bcd46-e343-412f-8f49-82c347264f77 does not exist Aug 27 04:45:36.668023 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-f4420243-fd91-41ea-a7f4-9ce31d7eb495'] Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5644e7c8-23a7-46e3-9e68-aa9d4a90b9a6 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Request method failure captured: Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/os-security-groups/5c3bcd46-e343-412f-8f49-82c347264f77 HTTP/1.1 Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaFwj8iHusxniEITbgY8-jhE1-DM5ANq8NEFbqyjfSSlQ-37dhS7MSAbEQj3cK5jzpqnLA7ElxKfu6bvENFVIwWuAz9oG_o5K5d3gFESbse3Q4dD0dLMw9lp0k5WOVVubc_R7MUxIzuH9uVelqiM5ahfshS13M3CIm8pmp8dnycsoS8 Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 0ec5e6dba9e643e9ac46fe6a303aad33 Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-272359146 Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-272359146 Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 0ec5e6dba9e643e9ac46fe6a303aad33 Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-272359146 Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-SecurityGroupsNegativeTestJSON-272359146-project Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 230bad5fed304be696a29d2871c2203e Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-272359146-project Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: exception: Security group 5c3bcd46-e343-412f-8f49-82c347264f77 does not exist Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-f4420243-fd91-41ea-a7f4-9ce31d7eb495'] Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '5c3bcd46-e343-412f-8f49-82c347264f77'} Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:45:36.672135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5c3bcd46-e343-412f-8f49-82c347264f77 does not exist Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4420243-fd91-41ea-a7f4-9ce31d7eb495'] Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5c3bcd46-e343-412f-8f49-82c347264f77 does not exist Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4420243-fd91-41ea-a7f4-9ce31d7eb495'] Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5c3bcd46-e343-412f-8f49-82c347264f77 does not exist Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4420243-fd91-41ea-a7f4-9ce31d7eb495'] Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5c3bcd46-e343-412f-8f49-82c347264f77 does not exist Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4420243-fd91-41ea-a7f4-9ce31d7eb495'] Aug 27 04:45:36.681756 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:36.697864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5644e7c8-23a7-46e3-9e68-aa9d4a90b9a6 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Returning 404 to user: Security group 5c3bcd46-e343-412f-8f49-82c347264f77 does not exist Aug 27 04:45:36.697864 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-f4420243-fd91-41ea-a7f4-9ce31d7eb495'] {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:36.704307 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5644e7c8-23a7-46e3-9e68-aa9d4a90b9a6 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/5c3bcd46-e343-412f-8f49-82c347264f77" status: 404 len: 194 microversion: 2.1 time: 0.392333 Aug 27 04:45:36.712036 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1623/3300] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:45:36 2022] DELETE /compute/v2.1/os-security-groups/5c3bcd46-e343-412f-8f49-82c347264f77 => generated 194 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:36.741213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dbc64bb7-8795-4fd6-9e47-8b659420a02d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:36.745012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dbc64bb7-8795-4fd6-9e47-8b659420a02d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: 7af3b552-91dc-4362-a577-341d856e2d23] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:36.758211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dbc64bb7-8795-4fd6-9e47-8b659420a02d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:36.760742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dbc64bb7-8795-4fd6-9e47-8b659420a02d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:36.765371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dbc64bb7-8795-4fd6-9e47-8b659420a02d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:36.771295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dbc64bb7-8795-4fd6-9e47-8b659420a02d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:36.772179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dbc64bb7-8795-4fd6-9e47-8b659420a02d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:36.773140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dbc64bb7-8795-4fd6-9e47-8b659420a02d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:36.837044 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-dbc64bb7-8795-4fd6-9e47-8b659420a02d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] HTTP exception thrown: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dbc64bb7-8795-4fd6-9e47-8b659420a02d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Request method failure captured: Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23 HTTP/1.1 Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaFBQjAzjzN9k_hnBr-Wl4fCDWMQGKruAh54ZQ99f5UA-JB5EvKcRfp2S95FOXDtM5qJEg0PhrQYHU03WQCuc2iR5fRvVy-RhkAd9cpRYRt0yboJPZ54ZCH9SEL3ne_EUc1RK6lej-wUNbq1hUBtHWak053sNe8kw6BDBORXhrDPTcA Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b4c2750325a547848214f021f63aecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b4c2750325a547848214f021f63aecb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: aca12246038e4b8e8cf1233d7f14d67a Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '7af3b552-91dc-4362-a577-341d856e2d23'} Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:45:36.839313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:45:36.844351 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:36.844351 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:36.844351 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:36.844351 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:36.844351 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:36.844351 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:36.844351 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:36.844351 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:36.844351 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:36.844351 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:36.844351 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:36.848585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dbc64bb7-8795-4fd6-9e47-8b659420a02d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Returning 404 to user: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:36.850606 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dbc64bb7-8795-4fd6-9e47-8b659420a02d tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23" status: 404 len: 111 microversion: 2.1 time: 0.137570 Aug 27 04:45:36.851677 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1624/3301] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:45:36 2022] DELETE /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:36.862281 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b401c709-5969-4adb-a895-2dfe216ce134 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005656 Aug 27 04:45:36.864014 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1625/3302] 10.222.0.79 () {58 vars in 1164 bytes} [Sat Aug 27 04:45:36 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 04:45:36.870927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4880e80e-7c5c-422e-bfd2-940abf08c59c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:36.871852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4880e80e-7c5c-422e-bfd2-940abf08c59c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: bfdfb1e3-2547-470d-a438-4a58bed4fa34] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:36.882208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4880e80e-7c5c-422e-bfd2-940abf08c59c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:36.888087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4880e80e-7c5c-422e-bfd2-940abf08c59c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:36.890209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4880e80e-7c5c-422e-bfd2-940abf08c59c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:36.891016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4880e80e-7c5c-422e-bfd2-940abf08c59c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:36.891498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4880e80e-7c5c-422e-bfd2-940abf08c59c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:36.891932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4880e80e-7c5c-422e-bfd2-940abf08c59c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:36.968477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4880e80e-7c5c-422e-bfd2-940abf08c59c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: bfdfb1e3-2547-470d-a438-4a58bed4fa34] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:45:37.121415 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4880e80e-7c5c-422e-bfd2-940abf08c59c tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bfdfb1e3-2547-470d-a438-4a58bed4fa34" status: 204 len: 0 microversion: 2.1 time: 0.255857 Aug 27 04:45:37.122409 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1626/3303] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:45:36 2022] DELETE /compute/v2.1/servers/bfdfb1e3-2547-470d-a438-4a58bed4fa34 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:45:37.130729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-93be8a24-ae20-4f9e-848f-7ef25f4084a4 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Calling method '.version_select at 0x7f1f213fe310>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:37.184660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] validate_networks() for [('defa386b-979a-4be2-93f1-9605a8c758e8', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:45:37.484133 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-93be8a24-ae20-4f9e-848f-7ef25f4084a4 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.359744 Aug 27 04:45:37.487001 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1627/3304] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 04:45:37 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:37.494164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5502c2a4-6c6a-4b06-a33d-cb023e079322 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:37.498973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5502c2a4-6c6a-4b06-a33d-cb023e079322 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:37.525215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5502c2a4-6c6a-4b06-a33d-cb023e079322 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:37.525961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5502c2a4-6c6a-4b06-a33d-cb023e079322 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:37.526814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5502c2a4-6c6a-4b06-a33d-cb023e079322 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:37.528549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5502c2a4-6c6a-4b06-a33d-cb023e079322 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:37.529648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5502c2a4-6c6a-4b06-a33d-cb023e079322 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:37.530282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5502c2a4-6c6a-4b06-a33d-cb023e079322 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:37.636874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-5502c2a4-6c6a-4b06-a33d-cb023e079322 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:37.668016 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5502c2a4-6c6a-4b06-a33d-cb023e079322 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.179458 Aug 27 04:45:37.669998 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1628/3305] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:37 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:37.676905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f6b39d23-d1e0-4ba1-9e51-65c70e671793 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:37.677734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f6b39d23-d1e0-4ba1-9e51-65c70e671793 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:37.687744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6b39d23-d1e0-4ba1-9e51-65c70e671793 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:37.689068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6b39d23-d1e0-4ba1-9e51-65c70e671793 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:37.689815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6b39d23-d1e0-4ba1-9e51-65c70e671793 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:37.690850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6b39d23-d1e0-4ba1-9e51-65c70e671793 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:37.691937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6b39d23-d1e0-4ba1-9e51-65c70e671793 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:37.692475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6b39d23-d1e0-4ba1-9e51-65c70e671793 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:37.727907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f6b39d23-d1e0-4ba1-9e51-65c70e671793 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:45:37.840209 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f6b39d23-d1e0-4ba1-9e51-65c70e671793 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 204 len: 0 microversion: 2.1 time: 0.168687 Aug 27 04:45:37.842508 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1629/3306] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:45:37 2022] DELETE /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:45:37.854055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-945369807", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d1ea6fb1-8a06-4d28-8060-80c1328df36f"}], "security_groups": [{"name": "tempest-securitygroup--1890015966"}], "key_name": "tempest-keypair-1980650497", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:38.043955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] validate_networks() for [('d1ea6fb1-8a06-4d28-8060-80c1328df36f', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:45:38.061678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Getting quotas for project 7a05f87ee5fb4d56acc906e2fb616b4a. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:45:38.069693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Getting quotas for user 7381d46a2eb14fa39e645f8459dc4367 and project 7a05f87ee5fb4d56acc906e2fb616b4a. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:45:38.110752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:45:38.111193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:45:38.111685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:45:38.112103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:45:38.112519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:45:38.123205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:38.136186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:38.136749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:38.137192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:38.144920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:38.148616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:38.150816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:38.196654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Getting quotas for project 7a05f87ee5fb4d56acc906e2fb616b4a. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:45:38.205260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Getting quotas for user 7381d46a2eb14fa39e645f8459dc4367 and project 7a05f87ee5fb4d56acc906e2fb616b4a. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:45:38.288178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:45:38.290787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2fecb2ca-a592-4056-92ce-350a2550ea55',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:45:38.579275 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dee370aa-8e2e-42e2-9c88-eb37147b5bfc tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.957188 Aug 27 04:45:38.588185 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1678/3307] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:45:36 2022] POST /compute/v2.1/servers => generated 407 bytes in 1966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:45:38.594172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d1382fe-7792-4013-a559-282dee4abea7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:38.595055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8d1382fe-7792-4013-a559-282dee4abea7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:38.606180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1382fe-7792-4013-a559-282dee4abea7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:38.607316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1382fe-7792-4013-a559-282dee4abea7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:38.608046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1382fe-7792-4013-a559-282dee4abea7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:38.609386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1382fe-7792-4013-a559-282dee4abea7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:38.610304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1382fe-7792-4013-a559-282dee4abea7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:38.611240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1382fe-7792-4013-a559-282dee4abea7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:38.787221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Getting quotas for project 43debe5241484aa3b2ff9a740385e206. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:45:38.803812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Getting quotas for user 3a3ef15e74a342f6915052624a0f19a1 and project 43debe5241484aa3b2ff9a740385e206. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:45:38.841971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:45:38.842447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:45:38.843015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:45:38.843346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:45:38.843945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:45:38.867345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:38.868293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:38.868786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:38.869590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:38.870053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:38.870489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:38.908480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:38.948997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Getting quotas for project 43debe5241484aa3b2ff9a740385e206. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:45:38.961600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Getting quotas for user 3a3ef15e74a342f6915052624a0f19a1 and project 43debe5241484aa3b2ff9a740385e206. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:45:38.978903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:45:38.983024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:45:39.109063 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-12c679b5-fc71-4b0b-a46f-97a6a19f25c0 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.262634 Aug 27 04:45:39.109729 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1630/3308] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:45:37 2022] POST /compute/v2.1/servers => generated 407 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:45:39.118909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd587623-a69b-4271-9a98-3c89f3e69eab tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Calling method '.version_select at 0x7f1f21265280>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:39.268138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8d1382fe-7792-4013-a559-282dee4abea7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:39.281807 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8d1382fe-7792-4013-a559-282dee4abea7 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1325 microversion: 2.1 time: 0.692315 Aug 27 04:45:39.289416 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1679/3309] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:38 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1325 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:39.309772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e91c527-95b5-4508-a3c2-a023d39e2af4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:39.311597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e91c527-95b5-4508-a3c2-a023d39e2af4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: 7af3b552-91dc-4362-a577-341d856e2d23] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:39.331403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e91c527-95b5-4508-a3c2-a023d39e2af4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:39.331965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e91c527-95b5-4508-a3c2-a023d39e2af4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:39.337453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e91c527-95b5-4508-a3c2-a023d39e2af4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:39.338295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e91c527-95b5-4508-a3c2-a023d39e2af4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:39.341634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e91c527-95b5-4508-a3c2-a023d39e2af4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:39.342357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e91c527-95b5-4508-a3c2-a023d39e2af4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:39.380840 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7e91c527-95b5-4508-a3c2-a023d39e2af4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] HTTP exception thrown: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e91c527-95b5-4508-a3c2-a023d39e2af4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Request method failure captured: Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23 HTTP/1.1 Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaFBQjAzjzN9k_hnBr-Wl4fCDWMQGKruAh54ZQ99f5UA-JB5EvKcRfp2S95FOXDtM5qJEg0PhrQYHU03WQCuc2iR5fRvVy-RhkAd9cpRYRt0yboJPZ54ZCH9SEL3ne_EUc1RK6lej-wUNbq1hUBtHWak053sNe8kw6BDBORXhrDPTcA Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b4c2750325a547848214f021f63aecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b4c2750325a547848214f021f63aecb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: aca12246038e4b8e8cf1233d7f14d67a Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '7af3b552-91dc-4362-a577-341d856e2d23'} Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:39.385995 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:39.391406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:39.391406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:39.391406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:39.391406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:39.391406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:39.391406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:39.391406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. Aug 27 04:45:39.391406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:39.393450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e91c527-95b5-4508-a3c2-a023d39e2af4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Returning 404 to user: Instance 7af3b552-91dc-4362-a577-341d856e2d23 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:39.395918 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e91c527-95b5-4508-a3c2-a023d39e2af4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23" status: 404 len: 111 microversion: 2.1 time: 0.105030 Aug 27 04:45:39.396763 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1680/3310] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:39 2022] GET /compute/v2.1/servers/7af3b552-91dc-4362-a577-341d856e2d23 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:39.411663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-110ff307-32b1-4ef8-9948-fb84728ae7cf tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:39.412927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-110ff307-32b1-4ef8-9948-fb84728ae7cf tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:39.789505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-110ff307-32b1-4ef8-9948-fb84728ae7cf tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:39.832878 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-110ff307-32b1-4ef8-9948-fb84728ae7cf tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1121 microversion: 2.1 time: 0.431437 Aug 27 04:45:39.833532 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1681/3311] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:39 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1121 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:39.881187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8d7cff0-2e63-4b8a-a725-a4127e912888 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:39.882083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8d7cff0-2e63-4b8a-a725-a4127e912888 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:39.908104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8d7cff0-2e63-4b8a-a725-a4127e912888 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:39.908660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8d7cff0-2e63-4b8a-a725-a4127e912888 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:39.912072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8d7cff0-2e63-4b8a-a725-a4127e912888 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:39.912928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8d7cff0-2e63-4b8a-a725-a4127e912888 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:39.913416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8d7cff0-2e63-4b8a-a725-a4127e912888 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:39.913865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8d7cff0-2e63-4b8a-a725-a4127e912888 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:39.963661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG neutronclient.v2_0.client [None req-fd587623-a69b-4271-9a98-3c89f3e69eab tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128870) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:45:39.964872 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-fd587623-a69b-4271-9a98-3c89f3e69eab tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 27 04:45:39.964872 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-0327e97b-f25b-495e-8032-57965c1d25c6'] Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd587623-a69b-4271-9a98-3c89f3e69eab tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Request method failure captured: Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/os-security-groups/ecdfbd9b-b2d3-4a1f-8fea-acb7795f85fa HTTP/1.1 Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaFwj8iHusxniEITbgY8-jhE1-DM5ANq8NEFbqyjfSSlQ-37dhS7MSAbEQj3cK5jzpqnLA7ElxKfu6bvENFVIwWuAz9oG_o5K5d3gFESbse3Q4dD0dLMw9lp0k5WOVVubc_R7MUxIzuH9uVelqiM5ahfshS13M3CIm8pmp8dnycsoS8 Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 0ec5e6dba9e643e9ac46fe6a303aad33 Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-272359146 Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-272359146 Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 0ec5e6dba9e643e9ac46fe6a303aad33 Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-272359146 Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-SecurityGroupsNegativeTestJSON-272359146-project Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 230bad5fed304be696a29d2871c2203e Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-272359146-project Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: exception: Insufficient rights for removing default security group. Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-0327e97b-f25b-495e-8032-57965c1d25c6'] Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'ecdfbd9b-b2d3-4a1f-8fea-acb7795f85fa'} Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:45:39.968252 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0327e97b-f25b-495e-8032-57965c1d25c6'] Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0327e97b-f25b-495e-8032-57965c1d25c6'] Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0327e97b-f25b-495e-8032-57965c1d25c6'] Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0327e97b-f25b-495e-8032-57965c1d25c6'] Aug 27 04:45:39.974011 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:39.977911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd587623-a69b-4271-9a98-3c89f3e69eab tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 27 04:45:39.977911 n-d-854823-1 devstack@n-api.service[128870]: Neutron server returns request_ids: ['req-0327e97b-f25b-495e-8032-57965c1d25c6'] {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:39.979164 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fd587623-a69b-4271-9a98-3c89f3e69eab tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/ecdfbd9b-b2d3-4a1f-8fea-acb7795f85fa" status: 400 len: 182 microversion: 2.1 time: 0.868460 Aug 27 04:45:39.981267 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1631/3312] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:45:39 2022] DELETE /compute/v2.1/os-security-groups/ecdfbd9b-b2d3-4a1f-8fea-acb7795f85fa => generated 182 bytes in 871 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:45:40.001193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d71193d9-148c-46bb-85a6-b9201e87c92a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:40.002156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d71193d9-148c-46bb-85a6-b9201e87c92a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:40.192976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d71193d9-148c-46bb-85a6-b9201e87c92a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:40.195304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-f8d7cff0-2e63-4b8a-a725-a4127e912888 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:40.201272 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d71193d9-148c-46bb-85a6-b9201e87c92a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1269 microversion: 2.1 time: 0.218686 Aug 27 04:45:40.207506 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1632/3313] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:39 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1269 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:40.212850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-935743d4-d083-41c5-aad1-48d56ea2fb75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:40.216683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-935743d4-d083-41c5-aad1-48d56ea2fb75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: bfdfb1e3-2547-470d-a438-4a58bed4fa34] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:40.239903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-935743d4-d083-41c5-aad1-48d56ea2fb75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:40.240697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-935743d4-d083-41c5-aad1-48d56ea2fb75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:40.241380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-935743d4-d083-41c5-aad1-48d56ea2fb75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:40.242575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-935743d4-d083-41c5-aad1-48d56ea2fb75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:40.243530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-935743d4-d083-41c5-aad1-48d56ea2fb75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:40.244178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-935743d4-d083-41c5-aad1-48d56ea2fb75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:40.254923 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8d7cff0-2e63-4b8a-a725-a4127e912888 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.400220 Aug 27 04:45:40.255529 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1682/3314] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:39 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:40.273448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d447b35c-4db3-4304-861e-36c86c9dc0fc tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Calling method '.version_select at 0x7f1f20df5af0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:40.320391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-d447b35c-4db3-4304-861e-36c86c9dc0fc tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f611c3d1-a000-4ff3-9adf-958fc7bb1bba does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:45:40.321312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-d447b35c-4db3-4304-861e-36c86c9dc0fc tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Neutron security group f611c3d1-a000-4ff3-9adf-958fc7bb1bba not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:45:40.322209 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d447b35c-4db3-4304-861e-36c86c9dc0fc tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] HTTP exception thrown: Security group f611c3d1-a000-4ff3-9adf-958fc7bb1bba does not exist Aug 27 04:45:40.322209 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-07d570fd-7a5a-4858-a0c7-2b2ec29368df'] Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d447b35c-4db3-4304-861e-36c86c9dc0fc tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Request method failure captured: Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-security-groups/f611c3d1-a000-4ff3-9adf-958fc7bb1bba HTTP/1.1 Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaFwj8iHusxniEITbgY8-jhE1-DM5ANq8NEFbqyjfSSlQ-37dhS7MSAbEQj3cK5jzpqnLA7ElxKfu6bvENFVIwWuAz9oG_o5K5d3gFESbse3Q4dD0dLMw9lp0k5WOVVubc_R7MUxIzuH9uVelqiM5ahfshS13M3CIm8pmp8dnycsoS8 Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 0ec5e6dba9e643e9ac46fe6a303aad33 Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-272359146 Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-272359146 Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 0ec5e6dba9e643e9ac46fe6a303aad33 Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-272359146 Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsNegativeTestJSON-272359146-project Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 230bad5fed304be696a29d2871c2203e Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-272359146-project Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: exception: Security group f611c3d1-a000-4ff3-9adf-958fc7bb1bba does not exist Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-07d570fd-7a5a-4858-a0c7-2b2ec29368df'] Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'f611c3d1-a000-4ff3-9adf-958fc7bb1bba'} Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:45:40.325007 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f611c3d1-a000-4ff3-9adf-958fc7bb1bba does not exist Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07d570fd-7a5a-4858-a0c7-2b2ec29368df'] Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f611c3d1-a000-4ff3-9adf-958fc7bb1bba does not exist Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07d570fd-7a5a-4858-a0c7-2b2ec29368df'] Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f611c3d1-a000-4ff3-9adf-958fc7bb1bba does not exist Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07d570fd-7a5a-4858-a0c7-2b2ec29368df'] Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f611c3d1-a000-4ff3-9adf-958fc7bb1bba does not exist Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07d570fd-7a5a-4858-a0c7-2b2ec29368df'] Aug 27 04:45:40.330069 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:40.339972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d447b35c-4db3-4304-861e-36c86c9dc0fc tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Returning 404 to user: Security group f611c3d1-a000-4ff3-9adf-958fc7bb1bba does not exist Aug 27 04:45:40.339972 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-07d570fd-7a5a-4858-a0c7-2b2ec29368df'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:40.339972 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d447b35c-4db3-4304-861e-36c86c9dc0fc tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/f611c3d1-a000-4ff3-9adf-958fc7bb1bba" status: 404 len: 194 microversion: 2.1 time: 0.075556 Aug 27 04:45:40.339972 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1683/3315] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 04:45:40 2022] GET /compute/v2.1/os-security-groups/f611c3d1-a000-4ff3-9adf-958fc7bb1bba => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:40.346874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92d28c3a-393a-4ab7-8023-8aebc8fcd259 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:40.352196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92d28c3a-393a-4ab7-8023-8aebc8fcd259 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:40.368618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d28c3a-393a-4ab7-8023-8aebc8fcd259 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:40.369764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d28c3a-393a-4ab7-8023-8aebc8fcd259 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:40.370891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d28c3a-393a-4ab7-8023-8aebc8fcd259 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:40.373546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d28c3a-393a-4ab7-8023-8aebc8fcd259 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:40.374843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d28c3a-393a-4ab7-8023-8aebc8fcd259 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:40.376959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d28c3a-393a-4ab7-8023-8aebc8fcd259 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:40.685149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92d28c3a-393a-4ab7-8023-8aebc8fcd259 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:40.696093 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92d28c3a-393a-4ab7-8023-8aebc8fcd259 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1325 microversion: 2.1 time: 0.354492 Aug 27 04:45:40.701438 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1684/3316] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:40 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1325 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:40.716601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1ca3370-3e84-44ca-9d56-96294f796617 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Action: 'update', calling method: .version_select at 0x7f1f21a660d0>, body: {"security_group": {"name": "tempest-sg-771383645", "description": "tempest-description-965391041"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:40.765112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-935743d4-d083-41c5-aad1-48d56ea2fb75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:40.779299 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-935743d4-d083-41c5-aad1-48d56ea2fb75 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/bfdfb1e3-2547-470d-a438-4a58bed4fa34" status: 200 len: 1521 microversion: 2.1 time: 0.570226 Aug 27 04:45:40.779911 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1633/3317] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:40 2022] GET /compute/v2.1/servers/bfdfb1e3-2547-470d-a438-4a58bed4fa34 => generated 1521 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:40.796413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-e1ca3370-3e84-44ca-9d56-96294f796617 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d106727b-7404-443b-a7ba-f83d64dbc91d does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 04:45:40.797310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-e1ca3370-3e84-44ca-9d56-96294f796617 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Neutron security group d106727b-7404-443b-a7ba-f83d64dbc91d not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 04:45:40.797914 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e1ca3370-3e84-44ca-9d56-96294f796617 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] HTTP exception thrown: Security group d106727b-7404-443b-a7ba-f83d64dbc91d does not exist Aug 27 04:45:40.797914 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-4da8c186-7474-41a8-9899-851de17347f7'] Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1ca3370-3e84-44ca-9d56-96294f796617 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Request method failure captured: Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: request: PUT /compute/v2.1/os-security-groups/d106727b-7404-443b-a7ba-f83d64dbc91d HTTP/1.1 Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 100 Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaFwj8iHusxniEITbgY8-jhE1-DM5ANq8NEFbqyjfSSlQ-37dhS7MSAbEQj3cK5jzpqnLA7ElxKfu6bvENFVIwWuAz9oG_o5K5d3gFESbse3Q4dD0dLMw9lp0k5WOVVubc_R7MUxIzuH9uVelqiM5ahfshS13M3CIm8pmp8dnycsoS8 Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 0ec5e6dba9e643e9ac46fe6a303aad33 Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-272359146 Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ec5e6dba9e643e9ac46fe6a303aad33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-272359146 Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 0ec5e6dba9e643e9ac46fe6a303aad33 Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-272359146 Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsNegativeTestJSON-272359146-project Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 230bad5fed304be696a29d2871c2203e Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-272359146-project Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: {"security_group": {"name": "tempest-sg-771383645", "description": "tempest-description-965391041"}} Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: exception: Security group d106727b-7404-443b-a7ba-f83d64dbc91d does not exist Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-4da8c186-7474-41a8-9899-851de17347f7'] Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'd106727b-7404-443b-a7ba-f83d64dbc91d', 'body': {'security_group': {'name': 'tempest-sg-771383645', 'description': 'tempest-description-965391041'}}} Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 04:45:40.800000 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d106727b-7404-443b-a7ba-f83d64dbc91d does not exist Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4da8c186-7474-41a8-9899-851de17347f7'] Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d106727b-7404-443b-a7ba-f83d64dbc91d does not exist Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4da8c186-7474-41a8-9899-851de17347f7'] Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d106727b-7404-443b-a7ba-f83d64dbc91d does not exist Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4da8c186-7474-41a8-9899-851de17347f7'] Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d106727b-7404-443b-a7ba-f83d64dbc91d does not exist Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4da8c186-7474-41a8-9899-851de17347f7'] Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1ca3370-3e84-44ca-9d56-96294f796617 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] Returning 404 to user: Security group d106727b-7404-443b-a7ba-f83d64dbc91d does not exist Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-4da8c186-7474-41a8-9899-851de17347f7'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1ca3370-3e84-44ca-9d56-96294f796617 tempest-SecurityGroupsNegativeTestJSON-272359146 tempest-SecurityGroupsNegativeTestJSON-272359146-project] 10.222.0.79 "PUT /compute/v2.1/os-security-groups/d106727b-7404-443b-a7ba-f83d64dbc91d" status: 404 len: 194 microversion: 2.1 time: 0.098919 Aug 27 04:45:40.806532 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1685/3318] 10.222.0.79 () {60 vars in 1290 bytes} [Sat Aug 27 04:45:40 2022] PUT /compute/v2.1/os-security-groups/d106727b-7404-443b-a7ba-f83d64dbc91d => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:40.861110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aa0a119f-1730-4668-a39d-ba328b13cd21 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:40.861745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aa0a119f-1730-4668-a39d-ba328b13cd21 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:40.880547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa0a119f-1730-4668-a39d-ba328b13cd21 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:40.881175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa0a119f-1730-4668-a39d-ba328b13cd21 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:40.881631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa0a119f-1730-4668-a39d-ba328b13cd21 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:40.882387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa0a119f-1730-4668-a39d-ba328b13cd21 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:40.882851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa0a119f-1730-4668-a39d-ba328b13cd21 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:40.883290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa0a119f-1730-4668-a39d-ba328b13cd21 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:41.139418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-db784eec-a2a3-458a-8075-f1d206deb5a3 req-3c9782f0-0539-4746-9463-eba8dcb34b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfdfb1e3-2547-470d-a438-4a58bed4fa34", "name": "network-vif-deleted", "tag": "a047eec5-6aaf-4e62-94ed-be03213f258f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:41.154005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aa0a119f-1730-4668-a39d-ba328b13cd21 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:41.167759 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aa0a119f-1730-4668-a39d-ba328b13cd21 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1237 microversion: 2.1 time: 0.310686 Aug 27 04:45:41.172205 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1634/3319] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:40 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1237 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:41.212395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-db784eec-a2a3-458a-8075-f1d206deb5a3 req-3c9782f0-0539-4746-9463-eba8dcb34b37 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:41.214626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-db784eec-a2a3-458a-8075-f1d206deb5a3 req-3c9782f0-0539-4746-9463-eba8dcb34b37 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:41.215040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-db784eec-a2a3-458a-8075-f1d206deb5a3 req-3c9782f0-0539-4746-9463-eba8dcb34b37 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:41.228412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4aa870e9-66d1-411c-b7cc-6c3d73db3114 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:41.229345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4aa870e9-66d1-411c-b7cc-6c3d73db3114 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:41.237183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4aa870e9-66d1-411c-b7cc-6c3d73db3114 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:41.243448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4aa870e9-66d1-411c-b7cc-6c3d73db3114 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:41.243448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4aa870e9-66d1-411c-b7cc-6c3d73db3114 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:41.244194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4aa870e9-66d1-411c-b7cc-6c3d73db3114 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:41.244667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4aa870e9-66d1-411c-b7cc-6c3d73db3114 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:41.245068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4aa870e9-66d1-411c-b7cc-6c3d73db3114 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:41.250469 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-db784eec-a2a3-458a-8075-f1d206deb5a3 req-3c9782f0-0539-4746-9463-eba8dcb34b37 service nova] Creating event network-vif-deleted:a047eec5-6aaf-4e62-94ed-be03213f258f for instance bfdfb1e3-2547-470d-a438-4a58bed4fa34 on n-h2-854823-1 Aug 27 04:45:41.270089 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-db784eec-a2a3-458a-8075-f1d206deb5a3 req-3c9782f0-0539-4746-9463-eba8dcb34b37 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135157 Aug 27 04:45:41.275237 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1686/3320] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:41.287052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb0476bf-bc3a-4d72-b220-10e5dac21409 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:41.287953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fb0476bf-bc3a-4d72-b220-10e5dac21409 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:41.310660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb0476bf-bc3a-4d72-b220-10e5dac21409 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:41.312026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb0476bf-bc3a-4d72-b220-10e5dac21409 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:41.312732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb0476bf-bc3a-4d72-b220-10e5dac21409 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:41.313844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb0476bf-bc3a-4d72-b220-10e5dac21409 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:41.314551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb0476bf-bc3a-4d72-b220-10e5dac21409 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:41.315217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb0476bf-bc3a-4d72-b220-10e5dac21409 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:41.362019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:41.392084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4aa870e9-66d1-411c-b7cc-6c3d73db3114 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:41.415751 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4aa870e9-66d1-411c-b7cc-6c3d73db3114 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1321 microversion: 2.1 time: 0.182697 Aug 27 04:45:41.417299 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1635/3321] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:41 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:41.723349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7e087b02-dda7-46b1-b650-f988191bd646 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:41.724781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7e087b02-dda7-46b1-b650-f988191bd646 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:41.729056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-fb0476bf-bc3a-4d72-b220-10e5dac21409 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:41.763102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e087b02-dda7-46b1-b650-f988191bd646 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:41.765795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e087b02-dda7-46b1-b650-f988191bd646 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:41.766433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e087b02-dda7-46b1-b650-f988191bd646 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:41.772232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e087b02-dda7-46b1-b650-f988191bd646 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:41.773810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e087b02-dda7-46b1-b650-f988191bd646 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:41.774286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e087b02-dda7-46b1-b650-f988191bd646 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:41.780212 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fb0476bf-bc3a-4d72-b220-10e5dac21409 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.498360 Aug 27 04:45:41.787223 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1687/3322] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:41 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:41.806195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2266070-ffd5-4385-bc24-f9fd126f74ca tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:41.807457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2266070-ffd5-4385-bc24-f9fd126f74ca tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: bfdfb1e3-2547-470d-a438-4a58bed4fa34] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:41.833876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2266070-ffd5-4385-bc24-f9fd126f74ca tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:41.834466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2266070-ffd5-4385-bc24-f9fd126f74ca tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:41.835847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2266070-ffd5-4385-bc24-f9fd126f74ca tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:41.836954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2266070-ffd5-4385-bc24-f9fd126f74ca tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:41.845675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2266070-ffd5-4385-bc24-f9fd126f74ca tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:41.846383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2266070-ffd5-4385-bc24-f9fd126f74ca tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:41.948654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2266070-ffd5-4385-bc24-f9fd126f74ca tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:41.949333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2266070-ffd5-4385-bc24-f9fd126f74ca tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:41.949977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2266070-ffd5-4385-bc24-f9fd126f74ca tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:41.950639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-b2266070-ffd5-4385-bc24-f9fd126f74ca tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lazy-loading 'fault' on Instance uuid bfdfb1e3-2547-470d-a438-4a58bed4fa34 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:42.084983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b2266070-ffd5-4385-bc24-f9fd126f74ca tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca12246038e4b8e8cf1233d7f14d67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c2750325a547848214f021f63aecb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:42.095158 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2266070-ffd5-4385-bc24-f9fd126f74ca tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/bfdfb1e3-2547-470d-a438-4a58bed4fa34" status: 200 len: 1312 microversion: 2.1 time: 0.297291 Aug 27 04:45:42.100857 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1688/3323] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:41 2022] GET /compute/v2.1/servers/bfdfb1e3-2547-470d-a438-4a58bed4fa34 => generated 1312 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:42.146160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7e087b02-dda7-46b1-b650-f988191bd646 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:42.155298 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7e087b02-dda7-46b1-b650-f988191bd646 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1325 microversion: 2.1 time: 0.436309 Aug 27 04:45:42.163375 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1636/3324] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:41 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:42.200219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-946a019d-8aad-46f5-b13b-89f05b8c7406 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:42.202222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-946a019d-8aad-46f5-b13b-89f05b8c7406 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:42.220763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-946a019d-8aad-46f5-b13b-89f05b8c7406 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:42.223673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-946a019d-8aad-46f5-b13b-89f05b8c7406 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:42.224352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-946a019d-8aad-46f5-b13b-89f05b8c7406 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:42.229115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-946a019d-8aad-46f5-b13b-89f05b8c7406 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:42.229779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-946a019d-8aad-46f5-b13b-89f05b8c7406 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:42.230316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-946a019d-8aad-46f5-b13b-89f05b8c7406 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:42.394501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-3a6899bf-7ecf-4b1a-8a9f-13ba56aba122 req-0dc4dfac-f418-4fb6-affa-3683dfe5ee8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85efe71-d7cc-4d7d-be50-ed00163e8a1b", "name": "network-vif-plugged", "status": "completed", "tag": "7dd852d5-0e54-4463-93eb-fdabd76a915c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:42.410571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3a6899bf-7ecf-4b1a-8a9f-13ba56aba122 req-0dc4dfac-f418-4fb6-affa-3683dfe5ee8e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:42.411197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3a6899bf-7ecf-4b1a-8a9f-13ba56aba122 req-0dc4dfac-f418-4fb6-affa-3683dfe5ee8e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:42.411901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3a6899bf-7ecf-4b1a-8a9f-13ba56aba122 req-0dc4dfac-f418-4fb6-affa-3683dfe5ee8e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:42.435669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-946a019d-8aad-46f5-b13b-89f05b8c7406 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:42.448784 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-946a019d-8aad-46f5-b13b-89f05b8c7406 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1237 microversion: 2.1 time: 0.252430 Aug 27 04:45:42.450143 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1689/3325] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:42 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1237 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:42.465676 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-3a6899bf-7ecf-4b1a-8a9f-13ba56aba122 req-0dc4dfac-f418-4fb6-affa-3683dfe5ee8e service nova] Creating event network-vif-plugged:7dd852d5-0e54-4463-93eb-fdabd76a915c for instance a85efe71-d7cc-4d7d-be50-ed00163e8a1b on n-h2-854823-1 Aug 27 04:45:42.474851 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-3a6899bf-7ecf-4b1a-8a9f-13ba56aba122 req-0dc4dfac-f418-4fb6-affa-3683dfe5ee8e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087403 Aug 27 04:45:42.476766 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1637/3326] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:42.504852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97043485-0f98-426c-b094-f69e95be0bd6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:42.505497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97043485-0f98-426c-b094-f69e95be0bd6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:42.532827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97043485-0f98-426c-b094-f69e95be0bd6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:42.533819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97043485-0f98-426c-b094-f69e95be0bd6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:42.534531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97043485-0f98-426c-b094-f69e95be0bd6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:42.536057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97043485-0f98-426c-b094-f69e95be0bd6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:42.537080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97043485-0f98-426c-b094-f69e95be0bd6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:42.537744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97043485-0f98-426c-b094-f69e95be0bd6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:42.796228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97043485-0f98-426c-b094-f69e95be0bd6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:42.812457 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97043485-0f98-426c-b094-f69e95be0bd6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1327 microversion: 2.1 time: 0.339303 Aug 27 04:45:42.814940 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1690/3327] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:42 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1327 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:42.815286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f92c4946-4fb4-406c-b8ea-4a34e81d7d04 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:42.815991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f92c4946-4fb4-406c-b8ea-4a34e81d7d04 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:42.824074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f92c4946-4fb4-406c-b8ea-4a34e81d7d04 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:42.824591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f92c4946-4fb4-406c-b8ea-4a34e81d7d04 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:42.832440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f92c4946-4fb4-406c-b8ea-4a34e81d7d04 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:42.833405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f92c4946-4fb4-406c-b8ea-4a34e81d7d04 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:42.834194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f92c4946-4fb4-406c-b8ea-4a34e81d7d04 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:42.834821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f92c4946-4fb4-406c-b8ea-4a34e81d7d04 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:42.927986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-f92c4946-4fb4-406c-b8ea-4a34e81d7d04 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:42.947299 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f92c4946-4fb4-406c-b8ea-4a34e81d7d04 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.136989 Aug 27 04:45:42.952593 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1638/3328] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:42 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:43.122979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f9cdc480-003b-4810-a0b9-6923a1472fc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:43.123606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f9cdc480-003b-4810-a0b9-6923a1472fc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: bfdfb1e3-2547-470d-a438-4a58bed4fa34] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:43.130797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9cdc480-003b-4810-a0b9-6923a1472fc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:43.131486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9cdc480-003b-4810-a0b9-6923a1472fc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:43.132424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9cdc480-003b-4810-a0b9-6923a1472fc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:43.132657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9cdc480-003b-4810-a0b9-6923a1472fc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:43.133290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9cdc480-003b-4810-a0b9-6923a1472fc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:43.133747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9cdc480-003b-4810-a0b9-6923a1472fc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:43.148975 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f9cdc480-003b-4810-a0b9-6923a1472fc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] HTTP exception thrown: Instance bfdfb1e3-2547-470d-a438-4a58bed4fa34 could not be found. Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f9cdc480-003b-4810-a0b9-6923a1472fc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Request method failure captured: Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/bfdfb1e3-2547-470d-a438-4a58bed4fa34 HTTP/1.1 Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaFBQjAzjzN9k_hnBr-Wl4fCDWMQGKruAh54ZQ99f5UA-JB5EvKcRfp2S95FOXDtM5qJEg0PhrQYHU03WQCuc2iR5fRvVy-RhkAd9cpRYRt0yboJPZ54ZCH9SEL3ne_EUc1RK6lej-wUNbq1hUBtHWak053sNe8kw6BDBORXhrDPTcA Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b4c2750325a547848214f021f63aecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b4c2750325a547848214f021f63aecb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: aca12246038e4b8e8cf1233d7f14d67a Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance bfdfb1e3-2547-470d-a438-4a58bed4fa34 could not be found. Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'bfdfb1e3-2547-470d-a438-4a58bed4fa34'} Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfdfb1e3-2547-470d-a438-4a58bed4fa34 could not be found. Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfdfb1e3-2547-470d-a438-4a58bed4fa34 could not be found. Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:43.150681 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:43.158566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:43.158566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:43.158566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:43.158566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:43.158566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:43.158566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:43.158566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfdfb1e3-2547-470d-a438-4a58bed4fa34 could not be found. Aug 27 04:45:43.158566 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:43.158566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f9cdc480-003b-4810-a0b9-6923a1472fc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Returning 404 to user: Instance bfdfb1e3-2547-470d-a438-4a58bed4fa34 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:43.158566 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f9cdc480-003b-4810-a0b9-6923a1472fc4 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/bfdfb1e3-2547-470d-a438-4a58bed4fa34" status: 404 len: 111 microversion: 2.1 time: 0.033200 Aug 27 04:45:43.158566 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1691/3329] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:43 2022] GET /compute/v2.1/servers/bfdfb1e3-2547-470d-a438-4a58bed4fa34 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:43.164952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-abf96d08-d4ef-4b1f-86b3-1084433c0596 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:43.165793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-abf96d08-d4ef-4b1f-86b3-1084433c0596 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] [instance: d594401f-5a00-4e2f-820a-677442452401] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:43.171853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abf96d08-d4ef-4b1f-86b3-1084433c0596 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:43.172343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abf96d08-d4ef-4b1f-86b3-1084433c0596 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:43.174263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abf96d08-d4ef-4b1f-86b3-1084433c0596 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:43.174263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abf96d08-d4ef-4b1f-86b3-1084433c0596 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:43.174263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abf96d08-d4ef-4b1f-86b3-1084433c0596 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:43.179380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-919faa74-0966-4283-b5d3-5b8e6455c531 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:43.180002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-919faa74-0966-4283-b5d3-5b8e6455c531 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:43.183360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abf96d08-d4ef-4b1f-86b3-1084433c0596 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:43.187130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-919faa74-0966-4283-b5d3-5b8e6455c531 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:43.187629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-919faa74-0966-4283-b5d3-5b8e6455c531 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:43.188107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-919faa74-0966-4283-b5d3-5b8e6455c531 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:43.188879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-919faa74-0966-4283-b5d3-5b8e6455c531 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:43.189340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-919faa74-0966-4283-b5d3-5b8e6455c531 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:43.189764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-919faa74-0966-4283-b5d3-5b8e6455c531 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:43.211671 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-abf96d08-d4ef-4b1f-86b3-1084433c0596 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] HTTP exception thrown: Instance d594401f-5a00-4e2f-820a-677442452401 could not be found. Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-abf96d08-d4ef-4b1f-86b3-1084433c0596 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Request method failure captured: Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 HTTP/1.1 Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaFBQjAzjzN9k_hnBr-Wl4fCDWMQGKruAh54ZQ99f5UA-JB5EvKcRfp2S95FOXDtM5qJEg0PhrQYHU03WQCuc2iR5fRvVy-RhkAd9cpRYRt0yboJPZ54ZCH9SEL3ne_EUc1RK6lej-wUNbq1hUBtHWak053sNe8kw6BDBORXhrDPTcA Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b4c2750325a547848214f021f63aecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b4c2750325a547848214f021f63aecb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4c2750325a547848214f021f63aecb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: b4c2750325a547848214f021f63aecb6 Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-985306813 Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: aca12246038e4b8e8cf1233d7f14d67a Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ListServersNegativeTestJSON-985306813-project Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance d594401f-5a00-4e2f-820a-677442452401 could not be found. Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'd594401f-5a00-4e2f-820a-677442452401'} Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d594401f-5a00-4e2f-820a-677442452401 could not be found. Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d594401f-5a00-4e2f-820a-677442452401 could not be found. Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:43.214188 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:43.218770 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:43.218770 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:43.218770 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:43.218770 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:43.218770 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:43.218770 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:43.218770 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d594401f-5a00-4e2f-820a-677442452401 could not be found. Aug 27 04:45:43.218770 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:43.220271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-abf96d08-d4ef-4b1f-86b3-1084433c0596 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] Returning 404 to user: Instance d594401f-5a00-4e2f-820a-677442452401 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:43.221376 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-abf96d08-d4ef-4b1f-86b3-1084433c0596 tempest-ListServersNegativeTestJSON-985306813 tempest-ListServersNegativeTestJSON-985306813-project] 10.222.0.79 "GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401" status: 404 len: 111 microversion: 2.1 time: 0.060715 Aug 27 04:45:43.222482 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1639/3330] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:43 2022] GET /compute/v2.1/servers/d594401f-5a00-4e2f-820a-677442452401 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:43.306419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-cd43e024-5655-4dce-b407-b2f7bece2e3b req-0d6084ad-00b9-4a84-a6ff-84132dfc87c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d594401f-5a00-4e2f-820a-677442452401", "name": "network-vif-deleted", "tag": "7dd7fd58-1ee5-4e35-a79b-dfec1a00eeec"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:43.326665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cd43e024-5655-4dce-b407-b2f7bece2e3b req-0d6084ad-00b9-4a84-a6ff-84132dfc87c5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:43.330172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cd43e024-5655-4dce-b407-b2f7bece2e3b req-0d6084ad-00b9-4a84-a6ff-84132dfc87c5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:43.331550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cd43e024-5655-4dce-b407-b2f7bece2e3b req-0d6084ad-00b9-4a84-a6ff-84132dfc87c5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:43.364012 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-cd43e024-5655-4dce-b407-b2f7bece2e3b req-0d6084ad-00b9-4a84-a6ff-84132dfc87c5 service nova] Creating event network-vif-deleted:7dd7fd58-1ee5-4e35-a79b-dfec1a00eeec for instance d594401f-5a00-4e2f-820a-677442452401 on n-h1-854823-1 Aug 27 04:45:43.370152 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-cd43e024-5655-4dce-b407-b2f7bece2e3b req-0d6084ad-00b9-4a84-a6ff-84132dfc87c5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067226 Aug 27 04:45:43.370690 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1640/3331] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:45:43.473642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8bd54b75-0768-4b5d-9398-c101db8786af tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:43.474774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8bd54b75-0768-4b5d-9398-c101db8786af tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:43.482167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bd54b75-0768-4b5d-9398-c101db8786af tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:43.483006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bd54b75-0768-4b5d-9398-c101db8786af tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:43.483670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bd54b75-0768-4b5d-9398-c101db8786af tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:43.484815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bd54b75-0768-4b5d-9398-c101db8786af tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:43.485504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bd54b75-0768-4b5d-9398-c101db8786af tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:43.486142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bd54b75-0768-4b5d-9398-c101db8786af tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:43.714197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8bd54b75-0768-4b5d-9398-c101db8786af tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:43.726643 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8bd54b75-0768-4b5d-9398-c101db8786af tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1237 microversion: 2.1 time: 0.256813 Aug 27 04:45:43.742586 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1641/3332] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:43 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1237 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:43.868965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31575681-51d4-4487-8f2c-ddb381596a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:43.871130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-31575681-51d4-4487-8f2c-ddb381596a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:43.944445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31575681-51d4-4487-8f2c-ddb381596a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:43.955165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-919faa74-0966-4283-b5d3-5b8e6455c531 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:43.965717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31575681-51d4-4487-8f2c-ddb381596a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:43.973531 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-919faa74-0966-4283-b5d3-5b8e6455c531 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1325 microversion: 2.1 time: 0.797872 Aug 27 04:45:43.975799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31575681-51d4-4487-8f2c-ddb381596a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:43.978715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31575681-51d4-4487-8f2c-ddb381596a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:43.979900 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1692/3333] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:43 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1325 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:43.981243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31575681-51d4-4487-8f2c-ddb381596a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:43.981698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31575681-51d4-4487-8f2c-ddb381596a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:43.993041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-081a05b7-bc20-49d7-9c3a-fffd5ad77a57 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:43.994015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-081a05b7-bc20-49d7-9c3a-fffd5ad77a57 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:44.010145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-081a05b7-bc20-49d7-9c3a-fffd5ad77a57 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:44.011141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-081a05b7-bc20-49d7-9c3a-fffd5ad77a57 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:44.013851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-081a05b7-bc20-49d7-9c3a-fffd5ad77a57 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:44.015325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-081a05b7-bc20-49d7-9c3a-fffd5ad77a57 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:44.016243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-081a05b7-bc20-49d7-9c3a-fffd5ad77a57 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:44.018717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-081a05b7-bc20-49d7-9c3a-fffd5ad77a57 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:44.227203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-31575681-51d4-4487-8f2c-ddb381596a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:44.257485 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-31575681-51d4-4487-8f2c-ddb381596a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1327 microversion: 2.1 time: 0.422288 Aug 27 04:45:44.258784 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1642/3334] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:43 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1327 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:44.374262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-081a05b7-bc20-49d7-9c3a-fffd5ad77a57 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:44.395279 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-081a05b7-bc20-49d7-9c3a-fffd5ad77a57 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.412746 Aug 27 04:45:44.412818 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1693/3335] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:43 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:44.756344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8b4f0eda-6638-43f6-9fdb-feda0ca8c1ea tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:44.757338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8b4f0eda-6638-43f6-9fdb-feda0ca8c1ea tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:44.774154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b4f0eda-6638-43f6-9fdb-feda0ca8c1ea tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:44.774975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b4f0eda-6638-43f6-9fdb-feda0ca8c1ea tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:44.776803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b4f0eda-6638-43f6-9fdb-feda0ca8c1ea tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:44.779370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b4f0eda-6638-43f6-9fdb-feda0ca8c1ea tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:44.780049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b4f0eda-6638-43f6-9fdb-feda0ca8c1ea tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:44.781117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b4f0eda-6638-43f6-9fdb-feda0ca8c1ea tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:45.003701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e4ee529-f375-4579-8b03-6760c59206e2 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:45.013040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e4ee529-f375-4579-8b03-6760c59206e2 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:45.028966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e4ee529-f375-4579-8b03-6760c59206e2 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:45.029673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e4ee529-f375-4579-8b03-6760c59206e2 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:45.030308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e4ee529-f375-4579-8b03-6760c59206e2 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:45.032373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e4ee529-f375-4579-8b03-6760c59206e2 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:45.036051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e4ee529-f375-4579-8b03-6760c59206e2 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:45.036715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e4ee529-f375-4579-8b03-6760c59206e2 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:45.209022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8b4f0eda-6638-43f6-9fdb-feda0ca8c1ea tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:45.217124 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8b4f0eda-6638-43f6-9fdb-feda0ca8c1ea tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1305 microversion: 2.1 time: 0.469338 Aug 27 04:45:45.221700 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1643/3336] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:44 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1305 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:45.279241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-057274c3-d0ea-43f1-994b-07affe4dada2 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:45.282823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-057274c3-d0ea-43f1-994b-07affe4dada2 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:45.297173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-057274c3-d0ea-43f1-994b-07affe4dada2 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:45.298064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-057274c3-d0ea-43f1-994b-07affe4dada2 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:45.298676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-057274c3-d0ea-43f1-994b-07affe4dada2 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:45.299547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-057274c3-d0ea-43f1-994b-07affe4dada2 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:45.303177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-057274c3-d0ea-43f1-994b-07affe4dada2 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:45.303817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-057274c3-d0ea-43f1-994b-07affe4dada2 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:45.703472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e4ee529-f375-4579-8b03-6760c59206e2 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:45.719981 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e4ee529-f375-4579-8b03-6760c59206e2 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1523 microversion: 2.1 time: 0.720423 Aug 27 04:45:45.721279 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1694/3337] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:44 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1523 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:45.731787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ebd26b6-6013-41b4-97b6-9d0fe8c01bb4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:45.733083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8ebd26b6-6013-41b4-97b6-9d0fe8c01bb4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:45.744975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ebd26b6-6013-41b4-97b6-9d0fe8c01bb4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:45.745496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ebd26b6-6013-41b4-97b6-9d0fe8c01bb4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:45.745964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ebd26b6-6013-41b4-97b6-9d0fe8c01bb4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:45.749243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ebd26b6-6013-41b4-97b6-9d0fe8c01bb4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:45.749740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ebd26b6-6013-41b4-97b6-9d0fe8c01bb4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:45.750192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ebd26b6-6013-41b4-97b6-9d0fe8c01bb4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:45.815235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-057274c3-d0ea-43f1-994b-07affe4dada2 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:45.824292 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-057274c3-d0ea-43f1-994b-07affe4dada2 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1395 microversion: 2.1 time: 0.548784 Aug 27 04:45:45.825417 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1644/3338] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:45 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1395 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:45.830761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e46b434-7419-4b38-8b90-b98c8760e1fe tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:45.831565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3e46b434-7419-4b38-8b90-b98c8760e1fe tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:45.845432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e46b434-7419-4b38-8b90-b98c8760e1fe tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:45.846252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e46b434-7419-4b38-8b90-b98c8760e1fe tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:45.847144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e46b434-7419-4b38-8b90-b98c8760e1fe tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:45.848200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e46b434-7419-4b38-8b90-b98c8760e1fe tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:45.848942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e46b434-7419-4b38-8b90-b98c8760e1fe tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:45.849542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e46b434-7419-4b38-8b90-b98c8760e1fe tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:45.884292 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-3e46b434-7419-4b38-8b90-b98c8760e1fe tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] HTTP exception thrown: Instance is not a member of specified network Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e46b434-7419-4b38-8b90-b98c8760e1fe tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Request method failure captured: Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b/ips/invalid HTTP/1.1 Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaFeI23QBbvVYBS8niTELPuQnq224aKWNAi3zc3BZqxB3aWdlWOaGZ8rIwgh-cSqdFlOdMjKSRnSYxauKn4NjSrELvIspWJ5sdUDoK_5-8m71DmTo_o69XSgo-ljwMQww4BFL8cbP46jfDmVepih0LP9A1Elf4Hf4aim70I-WFLZr58 Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: c64accd79d1e4da99742e21e87799eff Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1354090223 Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c64accd79d1e4da99742e21e87799eff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c64accd79d1e4da99742e21e87799eff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c64accd79d1e4da99742e21e87799eff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c64accd79d1e4da99742e21e87799eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1354090223 Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: c64accd79d1e4da99742e21e87799eff Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1354090223 Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerAddressesNegativeTestJSON-1354090223-project Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: f8b044ce4bc246cc9ca5341f05f22615 Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1354090223-project Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance is not a member of specified network Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'server_id': 'a85efe71-d7cc-4d7d-be50-ed00163e8a1b', 'id': 'invalid'} Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 27 04:45:45.896124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:45.902273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e46b434-7419-4b38-8b90-b98c8760e1fe tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:45.903418 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3e46b434-7419-4b38-8b90-b98c8760e1fe tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.076483 Aug 27 04:45:45.905226 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1645/3339] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:45:45 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b/ips/invalid => generated 91 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:45:45.915098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8aea6f8b-d194-4d23-8a40-2e0bca0fcc73 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:45.915609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8aea6f8b-d194-4d23-8a40-2e0bca0fcc73 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Failed to fetch instance by id 999 {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 04:45:45.916110 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-8aea6f8b-d194-4d23-8a40-2e0bca0fcc73 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] HTTP exception thrown: Instance 999 could not be found. Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8aea6f8b-d194-4d23-8a40-2e0bca0fcc73 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Request method failure captured: Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaFeI23QBbvVYBS8niTELPuQnq224aKWNAi3zc3BZqxB3aWdlWOaGZ8rIwgh-cSqdFlOdMjKSRnSYxauKn4NjSrELvIspWJ5sdUDoK_5-8m71DmTo_o69XSgo-ljwMQww4BFL8cbP46jfDmVepih0LP9A1Elf4Hf4aim70I-WFLZr58 Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: c64accd79d1e4da99742e21e87799eff Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1354090223 Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c64accd79d1e4da99742e21e87799eff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c64accd79d1e4da99742e21e87799eff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c64accd79d1e4da99742e21e87799eff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c64accd79d1e4da99742e21e87799eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1354090223 Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: c64accd79d1e4da99742e21e87799eff Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1354090223 Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerAddressesNegativeTestJSON-1354090223-project Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: f8b044ce4bc246cc9ca5341f05f22615 Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1354090223-project Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 999 could not be found. Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'server_id': '999'} Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 27 04:45:45.918207 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:45:45.922465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8aea6f8b-d194-4d23-8a40-2e0bca0fcc73 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:45.922465 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8aea6f8b-d194-4d23-8a40-2e0bca0fcc73 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008993 Aug 27 04:45:45.922465 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1646/3340] 10.222.0.79 () {58 vars in 1149 bytes} [Sat Aug 27 04:45:45 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:45:45.937417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a7ebeca5-6562-45e4-99c0-674a01f069e8 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:45.938649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a7ebeca5-6562-45e4-99c0-674a01f069e8 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:45.977018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-8ebd26b6-6013-41b4-97b6-9d0fe8c01bb4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:45.985684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7ebeca5-6562-45e4-99c0-674a01f069e8 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:45.986801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7ebeca5-6562-45e4-99c0-674a01f069e8 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:45.989029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7ebeca5-6562-45e4-99c0-674a01f069e8 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:45.989995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7ebeca5-6562-45e4-99c0-674a01f069e8 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:45.990857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7ebeca5-6562-45e4-99c0-674a01f069e8 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:45.991459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7ebeca5-6562-45e4-99c0-674a01f069e8 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:46.018354 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8ebd26b6-6013-41b4-97b6-9d0fe8c01bb4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.295702 Aug 27 04:45:46.019128 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1695/3341] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:45 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:46.025285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a7ebeca5-6562-45e4-99c0-674a01f069e8 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:45:46.172116 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a7ebeca5-6562-45e4-99c0-674a01f069e8 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 204 len: 0 microversion: 2.1 time: 0.240823 Aug 27 04:45:46.176629 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1647/3342] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:45:45 2022] DELETE /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:45:46.185374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-87f70989-233f-474b-b775-26c27a84c2ef tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:46.187760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-87f70989-233f-474b-b775-26c27a84c2ef tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:46.198553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87f70989-233f-474b-b775-26c27a84c2ef tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:46.199327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87f70989-233f-474b-b775-26c27a84c2ef tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:46.200024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87f70989-233f-474b-b775-26c27a84c2ef tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:46.201365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87f70989-233f-474b-b775-26c27a84c2ef tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:46.202077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87f70989-233f-474b-b775-26c27a84c2ef tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:46.202606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87f70989-233f-474b-b775-26c27a84c2ef tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:46.240959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d51cd4d-b71b-4301-839b-a61104e8cf8b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:46.241957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9d51cd4d-b71b-4301-839b-a61104e8cf8b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:46.244166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:46.257727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d51cd4d-b71b-4301-839b-a61104e8cf8b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:46.258379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d51cd4d-b71b-4301-839b-a61104e8cf8b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:46.258936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d51cd4d-b71b-4301-839b-a61104e8cf8b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:46.260375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d51cd4d-b71b-4301-839b-a61104e8cf8b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:46.260778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d51cd4d-b71b-4301-839b-a61104e8cf8b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:46.261310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d51cd4d-b71b-4301-839b-a61104e8cf8b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:46.507081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9d51cd4d-b71b-4301-839b-a61104e8cf8b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:46.519059 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9d51cd4d-b71b-4301-839b-a61104e8cf8b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1305 microversion: 2.1 time: 0.283343 Aug 27 04:45:46.520562 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1648/3343] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:46 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1305 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:46.753333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-87f70989-233f-474b-b775-26c27a84c2ef tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:46.773536 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-87f70989-233f-474b-b775-26c27a84c2ef tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1529 microversion: 2.1 time: 0.592991 Aug 27 04:45:46.774805 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1696/3344] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:46 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1529 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:46.847786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98473581-c684-44cc-b996-631565506157 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:46.848918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98473581-c684-44cc-b996-631565506157 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:46.861418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98473581-c684-44cc-b996-631565506157 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:46.867036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98473581-c684-44cc-b996-631565506157 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:46.867760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98473581-c684-44cc-b996-631565506157 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:46.868812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98473581-c684-44cc-b996-631565506157 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:46.869445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98473581-c684-44cc-b996-631565506157 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:46.870207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98473581-c684-44cc-b996-631565506157 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:47.052827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e2463747-545d-47f2-a54b-e71f1fd423e5 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:47.053468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e2463747-545d-47f2-a54b-e71f1fd423e5 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:47.078503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2463747-545d-47f2-a54b-e71f1fd423e5 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:47.079035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2463747-545d-47f2-a54b-e71f1fd423e5 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:47.083293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2463747-545d-47f2-a54b-e71f1fd423e5 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:47.086826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2463747-545d-47f2-a54b-e71f1fd423e5 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:47.088810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2463747-545d-47f2-a54b-e71f1fd423e5 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:47.091513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2463747-545d-47f2-a54b-e71f1fd423e5 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:47.314444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-e2463747-545d-47f2-a54b-e71f1fd423e5 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:47.362806 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e2463747-545d-47f2-a54b-e71f1fd423e5 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.322597 Aug 27 04:45:47.363445 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1697/3345] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:47 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:45:47.374054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-017696e0-08d5-4e4c-9fcf-cad9c152cc86 req-0c0fb271-cfa2-4d3b-a0cb-2ed535a9091d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d99a78-7b02-4e10-bfb8-fd64fb224134", "tag": "3e610e54-6fd9-4d24-93cb-18d61eaedb3e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:47.404616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-017696e0-08d5-4e4c-9fcf-cad9c152cc86 req-0c0fb271-cfa2-4d3b-a0cb-2ed535a9091d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:47.409223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-017696e0-08d5-4e4c-9fcf-cad9c152cc86 req-0c0fb271-cfa2-4d3b-a0cb-2ed535a9091d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:47.410728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-017696e0-08d5-4e4c-9fcf-cad9c152cc86 req-0c0fb271-cfa2-4d3b-a0cb-2ed535a9091d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:47.439568 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-017696e0-08d5-4e4c-9fcf-cad9c152cc86 req-0c0fb271-cfa2-4d3b-a0cb-2ed535a9091d service nova] Creating event network-changed:3e610e54-6fd9-4d24-93cb-18d61eaedb3e for instance 59d99a78-7b02-4e10-bfb8-fd64fb224134 on n-h1-854823-1 Aug 27 04:45:47.466820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-98473581-c684-44cc-b996-631565506157 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:47.473603 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-017696e0-08d5-4e4c-9fcf-cad9c152cc86 req-0c0fb271-cfa2-4d3b-a0cb-2ed535a9091d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097483 Aug 27 04:45:47.474527 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1698/3346] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:47.486423 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-98473581-c684-44cc-b996-631565506157 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1395 microversion: 2.1 time: 0.642378 Aug 27 04:45:47.494580 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1649/3347] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:46 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1395 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:47.544027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09c85cb2-a161-4f6b-8300-80bed68ceb06 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:47.544798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-09c85cb2-a161-4f6b-8300-80bed68ceb06 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:47.577609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c85cb2-a161-4f6b-8300-80bed68ceb06 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:47.580732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c85cb2-a161-4f6b-8300-80bed68ceb06 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:47.581360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c85cb2-a161-4f6b-8300-80bed68ceb06 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:47.587155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c85cb2-a161-4f6b-8300-80bed68ceb06 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:47.589457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c85cb2-a161-4f6b-8300-80bed68ceb06 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:47.591473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c85cb2-a161-4f6b-8300-80bed68ceb06 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:47.796251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-16f0d979-0534-4356-a48b-a677bef40126 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:47.797620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-16f0d979-0534-4356-a48b-a677bef40126 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:47.808116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16f0d979-0534-4356-a48b-a677bef40126 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:47.813329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16f0d979-0534-4356-a48b-a677bef40126 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:47.814082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16f0d979-0534-4356-a48b-a677bef40126 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:47.815008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16f0d979-0534-4356-a48b-a677bef40126 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:47.815671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16f0d979-0534-4356-a48b-a677bef40126 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:47.816319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16f0d979-0534-4356-a48b-a677bef40126 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:48.165840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:48.683841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09c85cb2-a161-4f6b-8300-80bed68ceb06 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:48.694817 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09c85cb2-a161-4f6b-8300-80bed68ceb06 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1305 microversion: 2.1 time: 1.156337 Aug 27 04:45:48.711378 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1699/3348] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:47 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1305 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:48.726600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e277cc8-7d19-4d18-9db8-8d248f855feb tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:48.727283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e277cc8-7d19-4d18-9db8-8d248f855feb tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:48.734905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e277cc8-7d19-4d18-9db8-8d248f855feb tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:48.735424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e277cc8-7d19-4d18-9db8-8d248f855feb tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:48.735877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e277cc8-7d19-4d18-9db8-8d248f855feb tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:48.736630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e277cc8-7d19-4d18-9db8-8d248f855feb tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:48.737103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e277cc8-7d19-4d18-9db8-8d248f855feb tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:48.737538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e277cc8-7d19-4d18-9db8-8d248f855feb tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:48.907265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=10 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:48.929810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-2e277cc8-7d19-4d18-9db8-8d248f855feb tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:48.956328 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e277cc8-7d19-4d18-9db8-8d248f855feb tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.242051 Aug 27 04:45:48.958478 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1700/3349] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:48 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:48.965599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d64160f-dd60-47ad-9d48-15d4f8bafa38 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:48.966778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d64160f-dd60-47ad-9d48-15d4f8bafa38 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:48.974219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d64160f-dd60-47ad-9d48-15d4f8bafa38 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:48.974988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d64160f-dd60-47ad-9d48-15d4f8bafa38 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:48.975604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d64160f-dd60-47ad-9d48-15d4f8bafa38 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:48.977074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d64160f-dd60-47ad-9d48-15d4f8bafa38 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:48.977945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d64160f-dd60-47ad-9d48-15d4f8bafa38 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:48.978661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d64160f-dd60-47ad-9d48-15d4f8bafa38 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:49.088051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-16f0d979-0534-4356-a48b-a677bef40126 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:49.090332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:49.112151 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-16f0d979-0534-4356-a48b-a677bef40126 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1529 microversion: 2.1 time: 1.321509 Aug 27 04:45:49.113864 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1650/3350] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:47 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1529 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:49.333521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d64160f-dd60-47ad-9d48-15d4f8bafa38 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:49.341631 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d64160f-dd60-47ad-9d48-15d4f8bafa38 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1395 microversion: 2.1 time: 0.381410 Aug 27 04:45:49.342483 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1701/3351] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:48 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1395 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:49.716999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8ea8aba3-1f40-442a-8d2a-cebbbdb07278 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:49.717818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8ea8aba3-1f40-442a-8d2a-cebbbdb07278 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:49.726097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ea8aba3-1f40-442a-8d2a-cebbbdb07278 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:49.727173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ea8aba3-1f40-442a-8d2a-cebbbdb07278 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:49.727691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ea8aba3-1f40-442a-8d2a-cebbbdb07278 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:49.728560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ea8aba3-1f40-442a-8d2a-cebbbdb07278 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:49.729102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ea8aba3-1f40-442a-8d2a-cebbbdb07278 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:49.729601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ea8aba3-1f40-442a-8d2a-cebbbdb07278 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:49.980453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=16 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:49.987366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec5e8a95-8109-459d-bb07-648ae63161bc tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:49.989024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec5e8a95-8109-459d-bb07-648ae63161bc tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:49.995734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec5e8a95-8109-459d-bb07-648ae63161bc tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:49.996233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec5e8a95-8109-459d-bb07-648ae63161bc tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:49.996715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec5e8a95-8109-459d-bb07-648ae63161bc tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:49.997460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec5e8a95-8109-459d-bb07-648ae63161bc tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:49.998606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec5e8a95-8109-459d-bb07-648ae63161bc tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:49.999209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec5e8a95-8109-459d-bb07-648ae63161bc tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:50.094242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-ec5e8a95-8109-459d-bb07-648ae63161bc tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:50.115185 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec5e8a95-8109-459d-bb07-648ae63161bc tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.135423 Aug 27 04:45:50.115781 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1702/3352] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:49 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:45:50.120423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a303c5dd-d83e-4dd8-a47d-7b0809720dde req-9a4bed17-c591-4b76-849d-abe8be37d545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb9f88cb-3d33-4bb6-b1b1-570e69789a80", "tag": "4116a740-d705-44a1-b1b6-2c0b32385de0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:50.131932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a303c5dd-d83e-4dd8-a47d-7b0809720dde req-9a4bed17-c591-4b76-849d-abe8be37d545 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:50.133196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a303c5dd-d83e-4dd8-a47d-7b0809720dde req-9a4bed17-c591-4b76-849d-abe8be37d545 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:50.133793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a303c5dd-d83e-4dd8-a47d-7b0809720dde req-9a4bed17-c591-4b76-849d-abe8be37d545 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:50.138430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:50.151219 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a303c5dd-d83e-4dd8-a47d-7b0809720dde req-9a4bed17-c591-4b76-849d-abe8be37d545 service nova] Creating event network-changed:4116a740-d705-44a1-b1b6-2c0b32385de0 for instance cb9f88cb-3d33-4bb6-b1b1-570e69789a80 on n-h1-854823-1 Aug 27 04:45:50.157082 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a303c5dd-d83e-4dd8-a47d-7b0809720dde req-9a4bed17-c591-4b76-849d-abe8be37d545 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039911 Aug 27 04:45:50.157913 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1703/3353] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:50.164303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a56cc480-eced-4d8b-a72d-d7ff32766aeb tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:50.165880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a56cc480-eced-4d8b-a72d-d7ff32766aeb tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:50.173192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56cc480-eced-4d8b-a72d-d7ff32766aeb tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:50.173897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56cc480-eced-4d8b-a72d-d7ff32766aeb tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:50.174532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56cc480-eced-4d8b-a72d-d7ff32766aeb tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:50.175944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56cc480-eced-4d8b-a72d-d7ff32766aeb tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:50.176601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56cc480-eced-4d8b-a72d-d7ff32766aeb tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:50.177394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56cc480-eced-4d8b-a72d-d7ff32766aeb tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:50.197600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=14 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:50.274708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a56cc480-eced-4d8b-a72d-d7ff32766aeb tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:50.287418 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a56cc480-eced-4d8b-a72d-d7ff32766aeb tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1487 microversion: 2.1 time: 0.127938 Aug 27 04:45:50.288144 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1704/3354] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:50 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1487 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:50.364137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a3c0723-5c12-469c-923f-32cbbfecf5e3 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:50.364938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a3c0723-5c12-469c-923f-32cbbfecf5e3 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:50.372253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ea8aba3-1f40-442a-8d2a-cebbbdb07278 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:50.380412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a3c0723-5c12-469c-923f-32cbbfecf5e3 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:50.381158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a3c0723-5c12-469c-923f-32cbbfecf5e3 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:50.381861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a3c0723-5c12-469c-923f-32cbbfecf5e3 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:50.382762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a3c0723-5c12-469c-923f-32cbbfecf5e3 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:50.388590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a3c0723-5c12-469c-923f-32cbbfecf5e3 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:50.389220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a3c0723-5c12-469c-923f-32cbbfecf5e3 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:50.419621 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8ea8aba3-1f40-442a-8d2a-cebbbdb07278 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1293 microversion: 2.1 time: 0.706117 Aug 27 04:45:50.421315 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1651/3355] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:49 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1293 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:50.431265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-716ed747-8946-42e0-98f4-dc1742f21c7b req-07cbaba7-c52d-4251-960f-dfbd5ce8a87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85efe71-d7cc-4d7d-be50-ed00163e8a1b", "name": "network-vif-deleted", "tag": "7dd852d5-0e54-4463-93eb-fdabd76a915c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:50.451627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-716ed747-8946-42e0-98f4-dc1742f21c7b req-07cbaba7-c52d-4251-960f-dfbd5ce8a87f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:50.452671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-716ed747-8946-42e0-98f4-dc1742f21c7b req-07cbaba7-c52d-4251-960f-dfbd5ce8a87f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:50.453283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-716ed747-8946-42e0-98f4-dc1742f21c7b req-07cbaba7-c52d-4251-960f-dfbd5ce8a87f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:50.490207 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-716ed747-8946-42e0-98f4-dc1742f21c7b req-07cbaba7-c52d-4251-960f-dfbd5ce8a87f service nova] Creating event network-vif-deleted:7dd852d5-0e54-4463-93eb-fdabd76a915c for instance a85efe71-d7cc-4d7d-be50-ed00163e8a1b on n-h2-854823-1 Aug 27 04:45:50.498974 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-716ed747-8946-42e0-98f4-dc1742f21c7b req-07cbaba7-c52d-4251-960f-dfbd5ce8a87f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076129 Aug 27 04:45:50.500076 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1652/3356] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:50.915328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a3c0723-5c12-469c-923f-32cbbfecf5e3 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:50.924494 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a3c0723-5c12-469c-923f-32cbbfecf5e3 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1395 microversion: 2.1 time: 0.565487 Aug 27 04:45:50.937326 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1705/3357] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:50 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1395 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:51.144287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6b1944da-f468-4ac9-9bb3-4e1ac782e5b4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:51.145647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6b1944da-f468-4ac9-9bb3-4e1ac782e5b4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:51.153386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b1944da-f468-4ac9-9bb3-4e1ac782e5b4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:51.154306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b1944da-f468-4ac9-9bb3-4e1ac782e5b4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:51.154995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b1944da-f468-4ac9-9bb3-4e1ac782e5b4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:51.155890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b1944da-f468-4ac9-9bb3-4e1ac782e5b4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:51.156514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b1944da-f468-4ac9-9bb3-4e1ac782e5b4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:51.157273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b1944da-f468-4ac9-9bb3-4e1ac782e5b4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:51.310239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c6c4c5d1-0346-4bb7-acf1-3830ca51a1b4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:51.310927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c6c4c5d1-0346-4bb7-acf1-3830ca51a1b4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:51.327192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c4c5d1-0346-4bb7-acf1-3830ca51a1b4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:51.327698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c4c5d1-0346-4bb7-acf1-3830ca51a1b4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:51.328137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c4c5d1-0346-4bb7-acf1-3830ca51a1b4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:51.328892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c4c5d1-0346-4bb7-acf1-3830ca51a1b4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:51.329345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c4c5d1-0346-4bb7-acf1-3830ca51a1b4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:51.329774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c4c5d1-0346-4bb7-acf1-3830ca51a1b4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:51.334483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-6b1944da-f468-4ac9-9bb3-4e1ac782e5b4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:51.386683 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6b1944da-f468-4ac9-9bb3-4e1ac782e5b4 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.246747 Aug 27 04:45:51.411974 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1653/3358] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:51 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:51.448547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c4c5d1-0346-4bb7-acf1-3830ca51a1b4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:51.449563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c4c5d1-0346-4bb7-acf1-3830ca51a1b4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:51.452918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3923a9b6-3411-4c24-a136-64bbae410fb5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:51.453460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6c4c5d1-0346-4bb7-acf1-3830ca51a1b4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:51.454480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-c6c4c5d1-0346-4bb7-acf1-3830ca51a1b4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lazy-loading 'fault' on Instance uuid a85efe71-d7cc-4d7d-be50-ed00163e8a1b {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:51.461295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3923a9b6-3411-4c24-a136-64bbae410fb5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:51.487892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3923a9b6-3411-4c24-a136-64bbae410fb5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:51.491055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3923a9b6-3411-4c24-a136-64bbae410fb5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:51.491506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3923a9b6-3411-4c24-a136-64bbae410fb5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:51.496486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3923a9b6-3411-4c24-a136-64bbae410fb5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:51.496998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3923a9b6-3411-4c24-a136-64bbae410fb5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:51.497441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3923a9b6-3411-4c24-a136-64bbae410fb5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:51.571738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c6c4c5d1-0346-4bb7-acf1-3830ca51a1b4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b044ce4bc246cc9ca5341f05f22615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64accd79d1e4da99742e21e87799eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:51.582677 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c6c4c5d1-0346-4bb7-acf1-3830ca51a1b4 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 200 len: 1315 microversion: 2.1 time: 0.276307 Aug 27 04:45:51.584016 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1706/3359] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:51 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:51.921531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3923a9b6-3411-4c24-a136-64bbae410fb5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:51.930874 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3923a9b6-3411-4c24-a136-64bbae410fb5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1293 microversion: 2.1 time: 0.488873 Aug 27 04:45:51.931463 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1654/3360] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:51 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1293 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:51.966056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a7e116d-1295-41ca-8dbe-f8526cb5e49d tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:51.966992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a7e116d-1295-41ca-8dbe-f8526cb5e49d tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:51.976119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7e116d-1295-41ca-8dbe-f8526cb5e49d tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:51.977356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7e116d-1295-41ca-8dbe-f8526cb5e49d tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:51.977985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7e116d-1295-41ca-8dbe-f8526cb5e49d tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:51.978863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7e116d-1295-41ca-8dbe-f8526cb5e49d tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:51.979485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7e116d-1295-41ca-8dbe-f8526cb5e49d tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:51.980081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7e116d-1295-41ca-8dbe-f8526cb5e49d tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:52.422476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e72e0cd5-fbb2-43cc-9dc9-4cd733edf1c8 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:52.423408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e72e0cd5-fbb2-43cc-9dc9-4cd733edf1c8 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:52.446003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e72e0cd5-fbb2-43cc-9dc9-4cd733edf1c8 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:52.446435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e72e0cd5-fbb2-43cc-9dc9-4cd733edf1c8 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:52.446883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e72e0cd5-fbb2-43cc-9dc9-4cd733edf1c8 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:52.448187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e72e0cd5-fbb2-43cc-9dc9-4cd733edf1c8 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:52.449598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e72e0cd5-fbb2-43cc-9dc9-4cd733edf1c8 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:52.461280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e72e0cd5-fbb2-43cc-9dc9-4cd733edf1c8 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:52.532434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a7e116d-1295-41ca-8dbe-f8526cb5e49d tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:52.542321 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a7e116d-1295-41ca-8dbe-f8526cb5e49d tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1395 microversion: 2.1 time: 0.580306 Aug 27 04:45:52.542919 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1707/3361] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:51 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1395 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:52.594690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-e72e0cd5-fbb2-43cc-9dc9-4cd733edf1c8 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:52.611891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8ebc535-2c33-41b9-82e6-ce793faa5f03 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:52.613392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8ebc535-2c33-41b9-82e6-ce793faa5f03 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] [instance: a85efe71-d7cc-4d7d-be50-ed00163e8a1b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:52.619159 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e72e0cd5-fbb2-43cc-9dc9-4cd733edf1c8 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.200520 Aug 27 04:45:52.625030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8ebc535-2c33-41b9-82e6-ce793faa5f03 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:52.625932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8ebc535-2c33-41b9-82e6-ce793faa5f03 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:52.627056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8ebc535-2c33-41b9-82e6-ce793faa5f03 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:52.628014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8ebc535-2c33-41b9-82e6-ce793faa5f03 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:52.629840 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1655/3362] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:52 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:45:52.631262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8ebc535-2c33-41b9-82e6-ce793faa5f03 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:52.632105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8ebc535-2c33-41b9-82e6-ce793faa5f03 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:52.663629 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d8ebc535-2c33-41b9-82e6-ce793faa5f03 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] HTTP exception thrown: Instance a85efe71-d7cc-4d7d-be50-ed00163e8a1b could not be found. Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8ebc535-2c33-41b9-82e6-ce793faa5f03 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Request method failure captured: Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b HTTP/1.1 Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaFeI23QBbvVYBS8niTELPuQnq224aKWNAi3zc3BZqxB3aWdlWOaGZ8rIwgh-cSqdFlOdMjKSRnSYxauKn4NjSrELvIspWJ5sdUDoK_5-8m71DmTo_o69XSgo-ljwMQww4BFL8cbP46jfDmVepih0LP9A1Elf4Hf4aim70I-WFLZr58 Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: c64accd79d1e4da99742e21e87799eff Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1354090223 Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c64accd79d1e4da99742e21e87799eff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c64accd79d1e4da99742e21e87799eff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c64accd79d1e4da99742e21e87799eff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c64accd79d1e4da99742e21e87799eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1354090223 Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: c64accd79d1e4da99742e21e87799eff Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1354090223 Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerAddressesNegativeTestJSON-1354090223-project Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: f8b044ce4bc246cc9ca5341f05f22615 Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1354090223-project Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance a85efe71-d7cc-4d7d-be50-ed00163e8a1b could not be found. Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'a85efe71-d7cc-4d7d-be50-ed00163e8a1b'} Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a85efe71-d7cc-4d7d-be50-ed00163e8a1b could not be found. Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a85efe71-d7cc-4d7d-be50-ed00163e8a1b could not be found. Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:52.666459 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:45:52.671525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:52.671525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:45:52.671525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:45:52.671525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:45:52.671525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:45:52.671525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:45:52.671525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a85efe71-d7cc-4d7d-be50-ed00163e8a1b could not be found. Aug 27 04:45:52.671525 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:45:52.673332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8ebc535-2c33-41b9-82e6-ce793faa5f03 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] Returning 404 to user: Instance a85efe71-d7cc-4d7d-be50-ed00163e8a1b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:45:52.674277 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8ebc535-2c33-41b9-82e6-ce793faa5f03 tempest-ServerAddressesNegativeTestJSON-1354090223 tempest-ServerAddressesNegativeTestJSON-1354090223-project] 10.222.0.79 "GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b" status: 404 len: 111 microversion: 2.1 time: 0.069243 Aug 27 04:45:52.675944 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1708/3363] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:52 2022] GET /compute/v2.1/servers/a85efe71-d7cc-4d7d-be50-ed00163e8a1b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:52.958446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8fdfb130-4898-486a-b76e-10dff467916d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:52.960922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8fdfb130-4898-486a-b76e-10dff467916d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:52.971336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fdfb130-4898-486a-b76e-10dff467916d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:52.972082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fdfb130-4898-486a-b76e-10dff467916d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:52.973382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fdfb130-4898-486a-b76e-10dff467916d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:52.975126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fdfb130-4898-486a-b76e-10dff467916d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:52.975823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fdfb130-4898-486a-b76e-10dff467916d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:52.978036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fdfb130-4898-486a-b76e-10dff467916d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:53.218650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8fdfb130-4898-486a-b76e-10dff467916d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:53.239162 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8fdfb130-4898-486a-b76e-10dff467916d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1293 microversion: 2.1 time: 0.285568 Aug 27 04:45:53.240553 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1656/3364] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:52 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1293 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:53.564672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c6b3524-4f14-4337-b514-a5a97cf6b6f7 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:53.565231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c6b3524-4f14-4337-b514-a5a97cf6b6f7 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:53.584820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c6b3524-4f14-4337-b514-a5a97cf6b6f7 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:53.585369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c6b3524-4f14-4337-b514-a5a97cf6b6f7 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:53.586049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c6b3524-4f14-4337-b514-a5a97cf6b6f7 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:53.586941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c6b3524-4f14-4337-b514-a5a97cf6b6f7 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:53.587486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c6b3524-4f14-4337-b514-a5a97cf6b6f7 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:53.587823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c6b3524-4f14-4337-b514-a5a97cf6b6f7 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:53.652743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-24945ee1-8749-4efc-8050-38cf8833de45 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:53.654095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-24945ee1-8749-4efc-8050-38cf8833de45 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:53.669112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24945ee1-8749-4efc-8050-38cf8833de45 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:53.669896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24945ee1-8749-4efc-8050-38cf8833de45 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:53.672802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24945ee1-8749-4efc-8050-38cf8833de45 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:53.673734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24945ee1-8749-4efc-8050-38cf8833de45 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:53.674927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24945ee1-8749-4efc-8050-38cf8833de45 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:53.676872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24945ee1-8749-4efc-8050-38cf8833de45 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:53.778410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-24945ee1-8749-4efc-8050-38cf8833de45 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:53.803832 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-24945ee1-8749-4efc-8050-38cf8833de45 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.157902 Aug 27 04:45:53.804748 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1657/3365] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:53 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:54.259720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d134fa6-71b2-4f01-b57b-a1360dee0fc7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:54.260338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9d134fa6-71b2-4f01-b57b-a1360dee0fc7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:54.270267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d134fa6-71b2-4f01-b57b-a1360dee0fc7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:54.270892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d134fa6-71b2-4f01-b57b-a1360dee0fc7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:54.271207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d134fa6-71b2-4f01-b57b-a1360dee0fc7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:54.271923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d134fa6-71b2-4f01-b57b-a1360dee0fc7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:54.272385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d134fa6-71b2-4f01-b57b-a1360dee0fc7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:54.272848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d134fa6-71b2-4f01-b57b-a1360dee0fc7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:54.452866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c6b3524-4f14-4337-b514-a5a97cf6b6f7 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:54.464155 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c6b3524-4f14-4337-b514-a5a97cf6b6f7 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1395 microversion: 2.1 time: 0.904521 Aug 27 04:45:54.466426 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1709/3366] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:53 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1395 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:54.502001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9d134fa6-71b2-4f01-b57b-a1360dee0fc7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:54.518318 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9d134fa6-71b2-4f01-b57b-a1360dee0fc7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1293 microversion: 2.1 time: 0.262389 Aug 27 04:45:54.519624 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1658/3367] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:54 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1293 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:54.832899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7c0d475-5e91-4291-8005-93a9deaebb1e tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:54.833618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a7c0d475-5e91-4291-8005-93a9deaebb1e tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:54.842784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7c0d475-5e91-4291-8005-93a9deaebb1e tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:54.843326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7c0d475-5e91-4291-8005-93a9deaebb1e tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:54.843944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7c0d475-5e91-4291-8005-93a9deaebb1e tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:54.845133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7c0d475-5e91-4291-8005-93a9deaebb1e tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:54.845765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7c0d475-5e91-4291-8005-93a9deaebb1e tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:54.846362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7c0d475-5e91-4291-8005-93a9deaebb1e tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:54.961585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-a7c0d475-5e91-4291-8005-93a9deaebb1e tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:54.996906 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a7c0d475-5e91-4291-8005-93a9deaebb1e tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1929 microversion: 2.75 time: 0.170917 Aug 27 04:45:54.998358 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1710/3368] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:54 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1929 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:55.491173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-394046c0-3d72-4aef-8b98-9a4249f385d1 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:55.491946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-394046c0-3d72-4aef-8b98-9a4249f385d1 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:55.499521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394046c0-3d72-4aef-8b98-9a4249f385d1 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:55.500365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394046c0-3d72-4aef-8b98-9a4249f385d1 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:55.501026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394046c0-3d72-4aef-8b98-9a4249f385d1 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:55.501941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394046c0-3d72-4aef-8b98-9a4249f385d1 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:55.502599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394046c0-3d72-4aef-8b98-9a4249f385d1 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:55.504024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394046c0-3d72-4aef-8b98-9a4249f385d1 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:55.540758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43e974d2-5b88-446f-8684-b5ee02d93954 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:55.541691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43e974d2-5b88-446f-8684-b5ee02d93954 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:55.554121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43e974d2-5b88-446f-8684-b5ee02d93954 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:55.555400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43e974d2-5b88-446f-8684-b5ee02d93954 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:55.555927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43e974d2-5b88-446f-8684-b5ee02d93954 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:55.557974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43e974d2-5b88-446f-8684-b5ee02d93954 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:55.558451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43e974d2-5b88-446f-8684-b5ee02d93954 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:55.560639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43e974d2-5b88-446f-8684-b5ee02d93954 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:55.761073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-394046c0-3d72-4aef-8b98-9a4249f385d1 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:55.774434 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-394046c0-3d72-4aef-8b98-9a4249f385d1 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1395 microversion: 2.1 time: 0.287254 Aug 27 04:45:55.789869 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1659/3369] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:55 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1395 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:56.025417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c01c828f-2e6a-4c5a-b17c-896f14bf5605 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:56.026470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c01c828f-2e6a-4c5a-b17c-896f14bf5605 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:56.027680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-43e974d2-5b88-446f-8684-b5ee02d93954 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:56.037191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c01c828f-2e6a-4c5a-b17c-896f14bf5605 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:56.037367 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43e974d2-5b88-446f-8684-b5ee02d93954 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1293 microversion: 2.1 time: 0.501737 Aug 27 04:45:56.037977 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1711/3370] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:55 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1293 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:56.043577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c01c828f-2e6a-4c5a-b17c-896f14bf5605 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:56.044455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c01c828f-2e6a-4c5a-b17c-896f14bf5605 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:56.045988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c01c828f-2e6a-4c5a-b17c-896f14bf5605 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:56.047529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c01c828f-2e6a-4c5a-b17c-896f14bf5605 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:56.048210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c01c828f-2e6a-4c5a-b17c-896f14bf5605 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:56.167346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-c01c828f-2e6a-4c5a-b17c-896f14bf5605 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:56.235664 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c01c828f-2e6a-4c5a-b17c-896f14bf5605 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1935 microversion: 2.75 time: 0.216474 Aug 27 04:45:56.252983 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1660/3371] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:56 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1935 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:56.796907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b06a8050-f7bf-4c8a-ae5c-4c35f3b55df6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:56.797756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b06a8050-f7bf-4c8a-ae5c-4c35f3b55df6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:56.812518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b06a8050-f7bf-4c8a-ae5c-4c35f3b55df6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:56.814265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b06a8050-f7bf-4c8a-ae5c-4c35f3b55df6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:56.814722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b06a8050-f7bf-4c8a-ae5c-4c35f3b55df6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:56.818458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b06a8050-f7bf-4c8a-ae5c-4c35f3b55df6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:56.820811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b06a8050-f7bf-4c8a-ae5c-4c35f3b55df6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:56.821535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b06a8050-f7bf-4c8a-ae5c-4c35f3b55df6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:57.059290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9bcad2ed-c329-41b4-90f4-0dd1ef460865 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:57.059911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9bcad2ed-c329-41b4-90f4-0dd1ef460865 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:57.079749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bcad2ed-c329-41b4-90f4-0dd1ef460865 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:57.080243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bcad2ed-c329-41b4-90f4-0dd1ef460865 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:57.080925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bcad2ed-c329-41b4-90f4-0dd1ef460865 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:57.082467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bcad2ed-c329-41b4-90f4-0dd1ef460865 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:57.083091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bcad2ed-c329-41b4-90f4-0dd1ef460865 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:57.083870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bcad2ed-c329-41b4-90f4-0dd1ef460865 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:57.515433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9bcad2ed-c329-41b4-90f4-0dd1ef460865 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:57.529553 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9bcad2ed-c329-41b4-90f4-0dd1ef460865 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1293 microversion: 2.1 time: 0.473926 Aug 27 04:45:57.530689 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1661/3372] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:57 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1293 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:57.539023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-60cafc37-df23-4861-b41c-126e85d87b6c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:57.539642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-60cafc37-df23-4861-b41c-126e85d87b6c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:57.562299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60cafc37-df23-4861-b41c-126e85d87b6c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:57.563244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60cafc37-df23-4861-b41c-126e85d87b6c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:57.564060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60cafc37-df23-4861-b41c-126e85d87b6c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:57.568157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60cafc37-df23-4861-b41c-126e85d87b6c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:57.570253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60cafc37-df23-4861-b41c-126e85d87b6c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:57.572263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60cafc37-df23-4861-b41c-126e85d87b6c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:57.708832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-60cafc37-df23-4861-b41c-126e85d87b6c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:57.750804 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-60cafc37-df23-4861-b41c-126e85d87b6c tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1935 microversion: 2.75 time: 0.216038 Aug 27 04:45:57.756199 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1662/3373] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:57 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1935 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:57.880647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b06a8050-f7bf-4c8a-ae5c-4c35f3b55df6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:57.889293 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b06a8050-f7bf-4c8a-ae5c-4c35f3b55df6 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1395 microversion: 2.1 time: 1.097179 Aug 27 04:45:57.894721 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1712/3374] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:56 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1395 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:58.381847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-4b729a13-ef0f-47ec-a28a-3db5a49c0c46 req-c3656de3-0a3f-463c-8ea8-728deebbfad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9f88cb-3d33-4bb6-b1b1-570e69789a80", "name": "network-vif-plugged", "status": "completed", "tag": "4116a740-d705-44a1-b1b6-2c0b32385de0"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:58.392465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4b729a13-ef0f-47ec-a28a-3db5a49c0c46 req-c3656de3-0a3f-463c-8ea8-728deebbfad0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:58.392989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4b729a13-ef0f-47ec-a28a-3db5a49c0c46 req-c3656de3-0a3f-463c-8ea8-728deebbfad0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:58.394370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4b729a13-ef0f-47ec-a28a-3db5a49c0c46 req-c3656de3-0a3f-463c-8ea8-728deebbfad0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:58.412155 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-4b729a13-ef0f-47ec-a28a-3db5a49c0c46 req-c3656de3-0a3f-463c-8ea8-728deebbfad0 service nova] Creating event network-vif-plugged:4116a740-d705-44a1-b1b6-2c0b32385de0 for instance cb9f88cb-3d33-4bb6-b1b1-570e69789a80 on n-h1-854823-1 Aug 27 04:45:58.421324 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-4b729a13-ef0f-47ec-a28a-3db5a49c0c46 req-c3656de3-0a3f-463c-8ea8-728deebbfad0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043131 Aug 27 04:45:58.422498 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1663/3375] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:58.550820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7fd4d2f5-10b4-41a6-8061-06fa430a092d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:58.551446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7fd4d2f5-10b4-41a6-8061-06fa430a092d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:58.553563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:58.560393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd4d2f5-10b4-41a6-8061-06fa430a092d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:58.561297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd4d2f5-10b4-41a6-8061-06fa430a092d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:58.562029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd4d2f5-10b4-41a6-8061-06fa430a092d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:58.562987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd4d2f5-10b4-41a6-8061-06fa430a092d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:58.564242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd4d2f5-10b4-41a6-8061-06fa430a092d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:58.564242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fd4d2f5-10b4-41a6-8061-06fa430a092d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:58.784235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6f6f9d48-7b80-4df4-8118-1fc62bb50836 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:58.785158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6f6f9d48-7b80-4df4-8118-1fc62bb50836 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:58.797147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6f9d48-7b80-4df4-8118-1fc62bb50836 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:58.798845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6f9d48-7b80-4df4-8118-1fc62bb50836 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:58.799934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6f9d48-7b80-4df4-8118-1fc62bb50836 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:58.801238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6f9d48-7b80-4df4-8118-1fc62bb50836 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:58.801976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6f9d48-7b80-4df4-8118-1fc62bb50836 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:58.802638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6f9d48-7b80-4df4-8118-1fc62bb50836 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:58.983260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7fd4d2f5-10b4-41a6-8061-06fa430a092d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:58.999409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-6f6f9d48-7b80-4df4-8118-1fc62bb50836 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] Lazy-loading 'services' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:45:59.000862 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7fd4d2f5-10b4-41a6-8061-06fa430a092d tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1293 microversion: 2.1 time: 0.453833 Aug 27 04:45:59.001362 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1713/3376] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:58 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1293 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:59.012689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34e9a058-363b-4fa7-bce2-ca6f09a408fe tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:59.013457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34e9a058-363b-4fa7-bce2-ca6f09a408fe tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:59.040166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34e9a058-363b-4fa7-bce2-ca6f09a408fe tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:59.040723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34e9a058-363b-4fa7-bce2-ca6f09a408fe tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:59.043720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34e9a058-363b-4fa7-bce2-ca6f09a408fe tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:59.044982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34e9a058-363b-4fa7-bce2-ca6f09a408fe tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:59.045892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34e9a058-363b-4fa7-bce2-ca6f09a408fe tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:59.046498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34e9a058-363b-4fa7-bce2-ca6f09a408fe tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:59.060226 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6f6f9d48-7b80-4df4-8118-1fc62bb50836 tempest-ServersAdmin275Test-125669377 tempest-ServersAdmin275Test-125669377-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1920 microversion: 2.75 time: 0.279919 Aug 27 04:45:59.060853 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1664/3377] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:58 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1920 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:45:59.107257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e4a0f546-77b0-4bb3-95cf-c84cadee7d6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:59.108041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e4a0f546-77b0-4bb3-95cf-c84cadee7d6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:59.116245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4a0f546-77b0-4bb3-95cf-c84cadee7d6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:59.117124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4a0f546-77b0-4bb3-95cf-c84cadee7d6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:59.117731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4a0f546-77b0-4bb3-95cf-c84cadee7d6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:59.118634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4a0f546-77b0-4bb3-95cf-c84cadee7d6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:59.119338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4a0f546-77b0-4bb3-95cf-c84cadee7d6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:59.120120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4a0f546-77b0-4bb3-95cf-c84cadee7d6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:59.171270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e4a0f546-77b0-4bb3-95cf-c84cadee7d6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:45:59.242585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:59.320283 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e4a0f546-77b0-4bb3-95cf-c84cadee7d6a tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 204 len: 0 microversion: 2.75 time: 0.217319 Aug 27 04:45:59.321775 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1665/3378] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:45:59 2022] DELETE /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:45:59.338221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cfcec9f7-7cdd-4dcc-a676-ceff69ed7ca3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:59.339970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cfcec9f7-7cdd-4dcc-a676-ceff69ed7ca3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:45:59.351598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfcec9f7-7cdd-4dcc-a676-ceff69ed7ca3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:59.352518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfcec9f7-7cdd-4dcc-a676-ceff69ed7ca3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:59.353168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfcec9f7-7cdd-4dcc-a676-ceff69ed7ca3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:59.354514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfcec9f7-7cdd-4dcc-a676-ceff69ed7ca3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:45:59.355139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfcec9f7-7cdd-4dcc-a676-ceff69ed7ca3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:45:59.355899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfcec9f7-7cdd-4dcc-a676-ceff69ed7ca3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:45:59.465742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34e9a058-363b-4fa7-bce2-ca6f09a408fe tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:59.474532 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34e9a058-363b-4fa7-bce2-ca6f09a408fe tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1395 microversion: 2.1 time: 0.472105 Aug 27 04:45:59.482554 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1714/3379] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:45:59 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1395 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:59.592419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cfcec9f7-7cdd-4dcc-a676-ceff69ed7ca3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:59.604681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cfcec9f7-7cdd-4dcc-a676-ceff69ed7ca3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:59.611151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cfcec9f7-7cdd-4dcc-a676-ceff69ed7ca3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:59.623852 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cfcec9f7-7cdd-4dcc-a676-ceff69ed7ca3 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1444 microversion: 2.75 time: 0.297519 Aug 27 04:45:59.625291 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1666/3380] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:45:59 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1444 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:00.024573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4fc87993-f994-4ee9-be82-7cabc31943b8 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:00.026101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4fc87993-f994-4ee9-be82-7cabc31943b8 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:00.036715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fc87993-f994-4ee9-be82-7cabc31943b8 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:00.037637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fc87993-f994-4ee9-be82-7cabc31943b8 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:00.038320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fc87993-f994-4ee9-be82-7cabc31943b8 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:00.039316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fc87993-f994-4ee9-be82-7cabc31943b8 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:00.040843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fc87993-f994-4ee9-be82-7cabc31943b8 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:00.041704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fc87993-f994-4ee9-be82-7cabc31943b8 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:00.412449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4fc87993-f994-4ee9-be82-7cabc31943b8 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:00.424914 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4fc87993-f994-4ee9-be82-7cabc31943b8 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1293 microversion: 2.1 time: 0.406077 Aug 27 04:46:00.439832 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1715/3381] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:00 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1293 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:00.517370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb90f028-3f5a-4c20-9912-b8717f574143 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:00.518355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eb90f028-3f5a-4c20-9912-b8717f574143 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:00.528699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb90f028-3f5a-4c20-9912-b8717f574143 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:00.529770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb90f028-3f5a-4c20-9912-b8717f574143 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:00.530596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb90f028-3f5a-4c20-9912-b8717f574143 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:00.531533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb90f028-3f5a-4c20-9912-b8717f574143 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:00.532386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb90f028-3f5a-4c20-9912-b8717f574143 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:00.533202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb90f028-3f5a-4c20-9912-b8717f574143 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:00.653807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-754ea829-50a7-42e3-84a7-f0993d61d113 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:00.654655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-754ea829-50a7-42e3-84a7-f0993d61d113 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:00.668278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-754ea829-50a7-42e3-84a7-f0993d61d113 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:00.668817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-754ea829-50a7-42e3-84a7-f0993d61d113 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:00.669266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-754ea829-50a7-42e3-84a7-f0993d61d113 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:00.669999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-754ea829-50a7-42e3-84a7-f0993d61d113 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:00.670476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-754ea829-50a7-42e3-84a7-f0993d61d113 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:00.670896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-754ea829-50a7-42e3-84a7-f0993d61d113 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:00.833082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-754ea829-50a7-42e3-84a7-f0993d61d113 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:00.846010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-754ea829-50a7-42e3-84a7-f0993d61d113 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:00.853108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-754ea829-50a7-42e3-84a7-f0993d61d113 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:00.874468 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-754ea829-50a7-42e3-84a7-f0993d61d113 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1444 microversion: 2.75 time: 0.218752 Aug 27 04:46:00.875722 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1716/3382] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:00 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1444 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:01.003709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb90f028-3f5a-4c20-9912-b8717f574143 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:01.014542 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb90f028-3f5a-4c20-9912-b8717f574143 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1577 microversion: 2.1 time: 0.506127 Aug 27 04:46:01.025682 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1667/3383] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:00 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1577 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:01.056288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7916d467-69db-4764-bec6-2402d7f7723a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:01.057637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7916d467-69db-4764-bec6-2402d7f7723a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:01.072654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7916d467-69db-4764-bec6-2402d7f7723a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:01.073639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7916d467-69db-4764-bec6-2402d7f7723a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:01.074479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7916d467-69db-4764-bec6-2402d7f7723a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:01.075590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7916d467-69db-4764-bec6-2402d7f7723a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:01.076479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7916d467-69db-4764-bec6-2402d7f7723a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:01.077294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7916d467-69db-4764-bec6-2402d7f7723a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:01.266700 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7916d467-69db-4764-bec6-2402d7f7723a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.222946 Aug 27 04:46:01.267316 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1717/3384] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 04:46:01 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80/os-interface => generated 285 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:01.446554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4083fe63-d52a-4771-a849-01d715a3ca7e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:01.447615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4083fe63-d52a-4771-a849-01d715a3ca7e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:01.455049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4083fe63-d52a-4771-a849-01d715a3ca7e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:01.455947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4083fe63-d52a-4771-a849-01d715a3ca7e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:01.456782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4083fe63-d52a-4771-a849-01d715a3ca7e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:01.457857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4083fe63-d52a-4771-a849-01d715a3ca7e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:01.458568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4083fe63-d52a-4771-a849-01d715a3ca7e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:01.459226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4083fe63-d52a-4771-a849-01d715a3ca7e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:01.768688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4083fe63-d52a-4771-a849-01d715a3ca7e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:01.778047 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4083fe63-d52a-4771-a849-01d715a3ca7e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1293 microversion: 2.1 time: 0.335322 Aug 27 04:46:01.795791 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1668/3385] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:01 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1293 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:01.908458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:01.909778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:01.917942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:01.918884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:01.919591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:01.920749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:01.921835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:01.922532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:02.001333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:02.004310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:02.006035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:02.007396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lazy-loading 'fault' on Instance uuid 1495908c-013d-45c4-9559-f5fcd1086830 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:46:02.125524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:02.137073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:02.138709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '546a39f0e78c464db553f22d07a707bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f0761664fd4c0a87bbf5b4d350ce0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:02.152873 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2de95ba2-36aa-4b11-bc86-5b86065054bf tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 200 len: 1449 microversion: 2.75 time: 0.251448 Aug 27 04:46:02.165279 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1718/3386] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:01 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 1449 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:02.809389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-76518016-6afa-47a5-913e-2c2214224b4f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:02.813651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-76518016-6afa-47a5-913e-2c2214224b4f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:02.840489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76518016-6afa-47a5-913e-2c2214224b4f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:02.841985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76518016-6afa-47a5-913e-2c2214224b4f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:02.843447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76518016-6afa-47a5-913e-2c2214224b4f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:02.846974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76518016-6afa-47a5-913e-2c2214224b4f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:02.848328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76518016-6afa-47a5-913e-2c2214224b4f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:02.849636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76518016-6afa-47a5-913e-2c2214224b4f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:03.181549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e174c62d-8f43-40f0-80fa-6df044cae836 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:03.183040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e174c62d-8f43-40f0-80fa-6df044cae836 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] [instance: 1495908c-013d-45c4-9559-f5fcd1086830] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:03.198237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e174c62d-8f43-40f0-80fa-6df044cae836 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:03.203295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e174c62d-8f43-40f0-80fa-6df044cae836 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:03.203975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e174c62d-8f43-40f0-80fa-6df044cae836 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:03.204975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e174c62d-8f43-40f0-80fa-6df044cae836 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:03.206546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e174c62d-8f43-40f0-80fa-6df044cae836 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:03.207281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e174c62d-8f43-40f0-80fa-6df044cae836 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:03.261556 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e174c62d-8f43-40f0-80fa-6df044cae836 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] HTTP exception thrown: Instance 1495908c-013d-45c4-9559-f5fcd1086830 could not be found. Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e174c62d-8f43-40f0-80fa-6df044cae836 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Request method failure captured: Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 HTTP/1.1 Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaE4vvuQDxkmQP27M1-E6Xv8iiT8hrLKy9Dmi4LbhnAkj1E-wNvv7hnhcJsuhPgPeR8G9Kh2K65XW7Qc498O2POlSP3mo_tmXyXKewyioaNLlL7VAPe6NDwjp9YO0LNh4iqnL1s0E_AaTpoStXKY6wI-15SL-TJLA-lN1zx3iiAQ8to Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.75 Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: a7f0761664fd4c0a87bbf5b4d350ce0d Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersAdmin275Test-1210740 Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7f0761664fd4c0a87bbf5b4d350ce0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a7f0761664fd4c0a87bbf5b4d350ce0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a7f0761664fd4c0a87bbf5b4d350ce0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7f0761664fd4c0a87bbf5b4d350ce0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersAdmin275Test-1210740 Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: a7f0761664fd4c0a87bbf5b4d350ce0d Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersAdmin275Test-1210740 Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersAdmin275Test-1210740-project Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 546a39f0e78c464db553f22d07a707bc Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersAdmin275Test-1210740-project Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 1495908c-013d-45c4-9559-f5fcd1086830 could not be found. Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '1495908c-013d-45c4-9559-f5fcd1086830'} Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1495908c-013d-45c4-9559-f5fcd1086830 could not be found. Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1495908c-013d-45c4-9559-f5fcd1086830 could not be found. Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:03.263794 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:03.269403 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:03.269403 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:03.269403 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:03.269403 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:46:03.269403 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:46:03.269403 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1495908c-013d-45c4-9559-f5fcd1086830 could not be found. Aug 27 04:46:03.269403 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:03.276976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e174c62d-8f43-40f0-80fa-6df044cae836 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] Returning 404 to user: Instance 1495908c-013d-45c4-9559-f5fcd1086830 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:03.279512 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e174c62d-8f43-40f0-80fa-6df044cae836 tempest-ServersAdmin275Test-1210740 tempest-ServersAdmin275Test-1210740-project] 10.222.0.79 "GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830" status: 404 len: 111 microversion: 2.75 time: 0.102679 Aug 27 04:46:03.283843 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1719/3387] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:03 2022] GET /compute/v2.1/servers/1495908c-013d-45c4-9559-f5fcd1086830 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:46:03.642415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-76518016-6afa-47a5-913e-2c2214224b4f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:03.676854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28c64296-f494-4bc3-b073-5fab6faf2c2f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:03.678009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-28c64296-f494-4bc3-b073-5fab6faf2c2f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:03.687696 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-76518016-6afa-47a5-913e-2c2214224b4f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1293 microversion: 2.1 time: 0.885831 Aug 27 04:46:03.688366 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1669/3388] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:02 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1293 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:03.692089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28c64296-f494-4bc3-b073-5fab6faf2c2f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:03.696596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28c64296-f494-4bc3-b073-5fab6faf2c2f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:03.697114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28c64296-f494-4bc3-b073-5fab6faf2c2f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:03.697859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28c64296-f494-4bc3-b073-5fab6faf2c2f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:03.714100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28c64296-f494-4bc3-b073-5fab6faf2c2f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:03.717323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28c64296-f494-4bc3-b073-5fab6faf2c2f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:03.717763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-b044ff80-2d3c-4ca8-80df-59c492ae117c req-a0c10f73-d88c-40c9-bb2b-8d1b1f23c1da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb9f88cb-3d33-4bb6-b1b1-570e69789a80", "tag": "4116a740-d705-44a1-b1b6-2c0b32385de0"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:03.758154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b044ff80-2d3c-4ca8-80df-59c492ae117c req-a0c10f73-d88c-40c9-bb2b-8d1b1f23c1da service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:03.758809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b044ff80-2d3c-4ca8-80df-59c492ae117c req-a0c10f73-d88c-40c9-bb2b-8d1b1f23c1da service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:03.760181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b044ff80-2d3c-4ca8-80df-59c492ae117c req-a0c10f73-d88c-40c9-bb2b-8d1b1f23c1da service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:03.792543 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b044ff80-2d3c-4ca8-80df-59c492ae117c req-a0c10f73-d88c-40c9-bb2b-8d1b1f23c1da service nova] Creating event network-changed:4116a740-d705-44a1-b1b6-2c0b32385de0 for instance cb9f88cb-3d33-4bb6-b1b1-570e69789a80 on n-h1-854823-1 Aug 27 04:46:03.806335 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-b044ff80-2d3c-4ca8-80df-59c492ae117c req-a0c10f73-d88c-40c9-bb2b-8d1b1f23c1da service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096599 Aug 27 04:46:03.810280 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1670/3389] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:04.216851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-4e497745-e55d-450b-bfdf-6eb9050a90e7 req-3e60a179-23b7-49e1-813f-c350f62fa30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d99a78-7b02-4e10-bfb8-fd64fb224134", "name": "network-vif-plugged", "status": "completed", "tag": "3e610e54-6fd9-4d24-93cb-18d61eaedb3e"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:04.248547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4e497745-e55d-450b-bfdf-6eb9050a90e7 req-3e60a179-23b7-49e1-813f-c350f62fa30c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:04.251948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4e497745-e55d-450b-bfdf-6eb9050a90e7 req-3e60a179-23b7-49e1-813f-c350f62fa30c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:04.252543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4e497745-e55d-450b-bfdf-6eb9050a90e7 req-3e60a179-23b7-49e1-813f-c350f62fa30c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:04.284391 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-4e497745-e55d-450b-bfdf-6eb9050a90e7 req-3e60a179-23b7-49e1-813f-c350f62fa30c service nova] Creating event network-vif-plugged:3e610e54-6fd9-4d24-93cb-18d61eaedb3e for instance 59d99a78-7b02-4e10-bfb8-fd64fb224134 on n-h1-854823-1 Aug 27 04:46:04.295340 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-4e497745-e55d-450b-bfdf-6eb9050a90e7 req-3e60a179-23b7-49e1-813f-c350f62fa30c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083307 Aug 27 04:46:04.296364 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1671/3390] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:04.320027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-28c64296-f494-4bc3-b073-5fab6faf2c2f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:04.332345 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-28c64296-f494-4bc3-b073-5fab6faf2c2f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1577 microversion: 2.1 time: 0.660620 Aug 27 04:46:04.335574 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1720/3391] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:03 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1577 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:04.716467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-adc96242-e1a0-4679-af9c-4c6ff21efe0b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:04.717990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-adc96242-e1a0-4679-af9c-4c6ff21efe0b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:04.730881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adc96242-e1a0-4679-af9c-4c6ff21efe0b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:04.730881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adc96242-e1a0-4679-af9c-4c6ff21efe0b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:04.731641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adc96242-e1a0-4679-af9c-4c6ff21efe0b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:04.732778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adc96242-e1a0-4679-af9c-4c6ff21efe0b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:04.733444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adc96242-e1a0-4679-af9c-4c6ff21efe0b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:04.734313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adc96242-e1a0-4679-af9c-4c6ff21efe0b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:05.859720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-adc96242-e1a0-4679-af9c-4c6ff21efe0b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:05.902663 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-adc96242-e1a0-4679-af9c-4c6ff21efe0b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1293 microversion: 2.1 time: 1.189955 Aug 27 04:46:05.903385 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1672/3392] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:04 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1293 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:06.637172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-62863994", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": "none"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:06.804833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:46:06.805264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:46:06.805752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:46:06.812901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:46:06.813273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:46:06.845953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:06.849413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:06.851781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:06.853436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:06.855384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:06.856942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:06.886410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:06.925634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-54c54445-8da4-486e-8eda-af0cbecbb01a tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:06.926249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-54c54445-8da4-486e-8eda-af0cbecbb01a tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:06.949747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54c54445-8da4-486e-8eda-af0cbecbb01a tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:06.954765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54c54445-8da4-486e-8eda-af0cbecbb01a tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:06.956282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54c54445-8da4-486e-8eda-af0cbecbb01a tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:06.961675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Getting quotas for project dabf4cd752244d4682cd19e978fb0f41. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:46:06.962143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54c54445-8da4-486e-8eda-af0cbecbb01a tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:06.964177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54c54445-8da4-486e-8eda-af0cbecbb01a tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:06.964878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54c54445-8da4-486e-8eda-af0cbecbb01a tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:06.985620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Getting quotas for user 6282d7051fac4a3cabf71e748e753f26 and project dabf4cd752244d4682cd19e978fb0f41. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:46:07.059662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:46:07.078077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: 7413c71f-a90d-4d56-b127-bcaa215637c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:46:07.212941 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-311f9c15-dd30-4a00-a8a0-9ae8315ac395 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.983062 Aug 27 04:46:07.214382 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1721/3393] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 04:46:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:46:07.229838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52ae41ed-5a4d-4076-b166-1f29be7e5856 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:07.230674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-52ae41ed-5a4d-4076-b166-1f29be7e5856 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: 7413c71f-a90d-4d56-b127-bcaa215637c4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:07.478574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52ae41ed-5a4d-4076-b166-1f29be7e5856 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:07.490932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52ae41ed-5a4d-4076-b166-1f29be7e5856 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:07.492504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52ae41ed-5a4d-4076-b166-1f29be7e5856 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:07.505961 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52ae41ed-5a4d-4076-b166-1f29be7e5856 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/7413c71f-a90d-4d56-b127-bcaa215637c4" status: 200 len: 1276 microversion: 2.47 time: 0.283705 Aug 27 04:46:07.506891 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1722/3394] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:07 2022] GET /compute/v2.1/servers/7413c71f-a90d-4d56-b127-bcaa215637c4 => generated 1276 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:07.694075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-54c54445-8da4-486e-8eda-af0cbecbb01a tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:07.705044 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-54c54445-8da4-486e-8eda-af0cbecbb01a tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1484 microversion: 2.1 time: 0.785298 Aug 27 04:46:07.709054 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1673/3395] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:06 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1484 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:07.733814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8dfb1c3-850a-45e7-8772-eb47f7150118 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:07.734267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8dfb1c3-850a-45e7-8772-eb47f7150118 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:07.749121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8dfb1c3-850a-45e7-8772-eb47f7150118 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:07.753563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8dfb1c3-850a-45e7-8772-eb47f7150118 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:07.754268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8dfb1c3-850a-45e7-8772-eb47f7150118 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:07.755024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8dfb1c3-850a-45e7-8772-eb47f7150118 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:07.755504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8dfb1c3-850a-45e7-8772-eb47f7150118 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:07.755935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8dfb1c3-850a-45e7-8772-eb47f7150118 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:07.836830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-245213306", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": "none"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:07.990546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:46:07.991913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:46:08.002492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:46:08.004161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:46:08.004838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:46:08.030263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:08.031331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:08.032718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:08.033782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:08.035252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:08.036400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:08.071519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Getting quotas for project dabf4cd752244d4682cd19e978fb0f41. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:46:08.074043 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8dfb1c3-850a-45e7-8772-eb47f7150118 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.344350 Aug 27 04:46:08.074976 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1723/3396] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 04:46:07 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134/os-interface => generated 285 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:08.098698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Getting quotas for user 6282d7051fac4a3cabf71e748e753f26 and project dabf4cd752244d4682cd19e978fb0f41. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:46:08.132421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:46:08.143587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:46:08.242189 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ca5babeb-5069-4e0f-aafe-97184a06ab02 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.408883 Aug 27 04:46:08.244406 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1674/3397] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 04:46:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 04:46:08.256684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3ae56d43-9b4e-4021-8d10-0c76fa042c62 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:08.258838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3ae56d43-9b4e-4021-8d10-0c76fa042c62 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:08.342700 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3ae56d43-9b4e-4021-8d10-0c76fa042c62 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "PUT /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 991 microversion: 2.47 time: 0.091831 Aug 27 04:46:08.343625 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1724/3398] 10.222.0.79 () {62 vars in 1297 bytes} [Sat Aug 27 04:46:08 2022] PUT /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:46:08.363145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e31baa0d-a486-4ce5-9473-954682d749e7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:08.363927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e31baa0d-a486-4ce5-9473-954682d749e7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:08.652799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e31baa0d-a486-4ce5-9473-954682d749e7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:08.678043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e31baa0d-a486-4ce5-9473-954682d749e7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:08.679798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e31baa0d-a486-4ce5-9473-954682d749e7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:08.685534 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e31baa0d-a486-4ce5-9473-954682d749e7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1277 microversion: 2.47 time: 0.326201 Aug 27 04:46:08.707613 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1675/3399] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:08 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1277 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:09.732161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94c26446-98db-40ad-b7a1-db98bcd2fa00 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:09.735162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94c26446-98db-40ad-b7a1-db98bcd2fa00 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:09.777748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c26446-98db-40ad-b7a1-db98bcd2fa00 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:09.780983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c26446-98db-40ad-b7a1-db98bcd2fa00 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:09.785617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c26446-98db-40ad-b7a1-db98bcd2fa00 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:09.786776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c26446-98db-40ad-b7a1-db98bcd2fa00 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:09.790201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c26446-98db-40ad-b7a1-db98bcd2fa00 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:09.792356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94c26446-98db-40ad-b7a1-db98bcd2fa00 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:10.142020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94c26446-98db-40ad-b7a1-db98bcd2fa00 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:10.164950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94c26446-98db-40ad-b7a1-db98bcd2fa00 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:10.166535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94c26446-98db-40ad-b7a1-db98bcd2fa00 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:10.167747 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94c26446-98db-40ad-b7a1-db98bcd2fa00 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1273 microversion: 2.47 time: 0.457600 Aug 27 04:46:10.183763 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1725/3400] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:09 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1273 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:10.721372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-63bde60a-66a9-48aa-b7ca-7e4be4a67b06 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] Action: 'create', calling method: .version_select at 0x7f1f219e63a0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:10.773608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-63bde60a-66a9-48aa-b7ca-7e4be4a67b06 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] Getting quotas for project e121bd4c34b747118b7394ca260537c8. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:46:10.790344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-63bde60a-66a9-48aa-b7ca-7e4be4a67b06 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] Getting quotas for user f2e8b53b0974481bbd71419a8df8088b and project e121bd4c34b747118b7394ca260537c8. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:46:10.796894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:10.902508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-63bde60a-66a9-48aa-b7ca-7e4be4a67b06 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] Getting quotas for project e121bd4c34b747118b7394ca260537c8. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:46:10.902916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2591524c-297b-4125-9bf6-75c57f2344f5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:10.903842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2591524c-297b-4125-9bf6-75c57f2344f5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:10.914057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-63bde60a-66a9-48aa-b7ca-7e4be4a67b06 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] Getting quotas for user f2e8b53b0974481bbd71419a8df8088b and project e121bd4c34b747118b7394ca260537c8. Resources: {'server_groups'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:46:10.927302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2591524c-297b-4125-9bf6-75c57f2344f5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:10.932015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2591524c-297b-4125-9bf6-75c57f2344f5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:10.933320 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-63bde60a-66a9-48aa-b7ca-7e4be4a67b06 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.591499 Aug 27 04:46:10.935563 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1676/3401] 10.222.0.79 () {62 vars in 1214 bytes} [Sat Aug 27 04:46:10 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:46:10.936250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2591524c-297b-4125-9bf6-75c57f2344f5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:10.937289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2591524c-297b-4125-9bf6-75c57f2344f5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:10.937790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2591524c-297b-4125-9bf6-75c57f2344f5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:10.942955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2591524c-297b-4125-9bf6-75c57f2344f5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:10.947976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e4d91462-68bc-480a-a428-7b7113366a10 req-d2dfa730-eb9a-4ab6-9f17-a1a28c9ef964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d99a78-7b02-4e10-bfb8-fd64fb224134", "tag": "3e610e54-6fd9-4d24-93cb-18d61eaedb3e"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:10.959595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e4d91462-68bc-480a-a428-7b7113366a10 req-d2dfa730-eb9a-4ab6-9f17-a1a28c9ef964 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:10.960095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e4d91462-68bc-480a-a428-7b7113366a10 req-d2dfa730-eb9a-4ab6-9f17-a1a28c9ef964 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:10.960552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e4d91462-68bc-480a-a428-7b7113366a10 req-d2dfa730-eb9a-4ab6-9f17-a1a28c9ef964 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:10.976503 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e4d91462-68bc-480a-a428-7b7113366a10 req-d2dfa730-eb9a-4ab6-9f17-a1a28c9ef964 service nova] Creating event network-changed:3e610e54-6fd9-4d24-93cb-18d61eaedb3e for instance 59d99a78-7b02-4e10-bfb8-fd64fb224134 on n-h1-854823-1 Aug 27 04:46:10.985700 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e4d91462-68bc-480a-a428-7b7113366a10 req-d2dfa730-eb9a-4ab6-9f17-a1a28c9ef964 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047153 Aug 27 04:46:10.986915 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1677/3402] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:10.995003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-131cfdf4-f4ba-4d0f-9c24-eb37fae7c11b tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:11.009177 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-131cfdf4-f4ba-4d0f-9c24-eb37fae7c11b tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.019608 Aug 27 04:46:11.010345 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1678/3403] 10.222.0.79 () {60 vars in 1193 bytes} [Sat Aug 27 04:46:10 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:46:11.039104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-baf32303-5fa3-4034-adb3-11c9365f3004 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:11.066843 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-baf32303-5fa3-4034-adb3-11c9365f3004 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/ae798945-d2bc-40fe-8485-0659d4e00eed" status: 200 len: 235 microversion: 2.64 time: 0.036863 Aug 27 04:46:11.069653 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1679/3404] 10.222.0.79 () {60 vars in 1304 bytes} [Sat Aug 27 04:46:11 2022] GET /compute/v2.1/os-server-groups/ae798945-d2bc-40fe-8485-0659d4e00eed => generated 235 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:46:11.094592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a66f218b-47f1-40c9-8110-31b06a909784 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:11.146853 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a66f218b-47f1-40c9-8110-31b06a909784 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/ae798945-d2bc-40fe-8485-0659d4e00eed" status: 204 len: 0 microversion: 2.64 time: 0.068106 Aug 27 04:46:11.150595 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1680/3405] 10.222.0.79 () {60 vars in 1307 bytes} [Sat Aug 27 04:46:11 2022] DELETE /compute/v2.1/os-server-groups/ae798945-d2bc-40fe-8485-0659d4e00eed => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:46:11.161710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ba89eb97-29d2-4c05-84af-365c113c69b0 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:11.178331 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-ba89eb97-29d2-4c05-84af-365c113c69b0 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] HTTP exception thrown: Instance group ae798945-d2bc-40fe-8485-0659d4e00eed could not be found. Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ba89eb97-29d2-4c05-84af-365c113c69b0 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] Request method failure captured: Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/os-server-groups/ae798945-d2bc-40fe-8485-0659d4e00eed HTTP/1.1 Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaGSVf6gh2NK15asJ11Oneb1K3BwE2DN2F0pUZ--CuAJeSox7Q1AiVfc8ZvWmaVz3tSHuirtMMcvCvmtx7v-ckuszCD7PZsw5Ji-cTmUojKuGqjR4xgvVYR_Xp8ywDg35VLIm6yM1B4DY6zmP1cE33YpA4p-gjYwzvQ21CakbE_S2bk Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.64 Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: e121bd4c34b747118b7394ca260537c8 Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerGroup264TestJSON-1913520254 Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e121bd4c34b747118b7394ca260537c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e121bd4c34b747118b7394ca260537c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e121bd4c34b747118b7394ca260537c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e121bd4c34b747118b7394ca260537c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerGroup264TestJSON-1913520254 Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: e121bd4c34b747118b7394ca260537c8 Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1913520254 Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerGroup264TestJSON-1913520254-project Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: f2e8b53b0974481bbd71419a8df8088b Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerGroup264TestJSON-1913520254-project Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance group ae798945-d2bc-40fe-8485-0659d4e00eed could not be found. Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'ae798945-d2bc-40fe-8485-0659d4e00eed'} Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ae798945-d2bc-40fe-8485-0659d4e00eed could not be found. Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ae798945-d2bc-40fe-8485-0659d4e00eed could not be found. Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:11.184637 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:11.189993 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:11.189993 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:11.189993 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:46:11.189993 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:46:11.189993 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ae798945-d2bc-40fe-8485-0659d4e00eed could not be found. Aug 27 04:46:11.189993 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:11.193001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ba89eb97-29d2-4c05-84af-365c113c69b0 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] Returning 404 to user: Instance group ae798945-d2bc-40fe-8485-0659d4e00eed could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:11.197201 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ba89eb97-29d2-4c05-84af-365c113c69b0 tempest-ServerGroup264TestJSON-1913520254 tempest-ServerGroup264TestJSON-1913520254-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/ae798945-d2bc-40fe-8485-0659d4e00eed" status: 404 len: 117 microversion: 2.64 time: 0.040103 Aug 27 04:46:11.198387 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1681/3406] 10.222.0.79 () {60 vars in 1307 bytes} [Sat Aug 27 04:46:11 2022] DELETE /compute/v2.1/os-server-groups/ae798945-d2bc-40fe-8485-0659d4e00eed => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:46:11.205249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6b4b3d22-e5a2-4f69-99cb-afae8508c092 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:11.207271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6b4b3d22-e5a2-4f69-99cb-afae8508c092 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:11.215189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b4b3d22-e5a2-4f69-99cb-afae8508c092 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:11.215946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b4b3d22-e5a2-4f69-99cb-afae8508c092 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:11.216584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b4b3d22-e5a2-4f69-99cb-afae8508c092 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:11.217519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b4b3d22-e5a2-4f69-99cb-afae8508c092 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:11.218144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b4b3d22-e5a2-4f69-99cb-afae8508c092 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:11.218745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b4b3d22-e5a2-4f69-99cb-afae8508c092 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:11.943905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6b4b3d22-e5a2-4f69-99cb-afae8508c092 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:11.962655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6b4b3d22-e5a2-4f69-99cb-afae8508c092 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:11.966930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6b4b3d22-e5a2-4f69-99cb-afae8508c092 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:11.971027 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6b4b3d22-e5a2-4f69-99cb-afae8508c092 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1329 microversion: 2.47 time: 0.771256 Aug 27 04:46:11.976627 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1682/3407] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:11 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1329 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:12.422382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-532804728", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "6f0920ec-49cc-4dfa-9dcd-4228f9b8efc6"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:12.511502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2591524c-297b-4125-9bf6-75c57f2344f5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:12.520271 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2591524c-297b-4125-9bf6-75c57f2344f5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1484 microversion: 2.1 time: 1.621953 Aug 27 04:46:12.522871 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1726/3408] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:10 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1484 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:12.557845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] validate_networks() for [('6f0920ec-49cc-4dfa-9dcd-4228f9b8efc6', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:46:13.029542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-44ff05a0-2bd5-43c4-ac16-f2636a59c836 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:13.030717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-44ff05a0-2bd5-43c4-ac16-f2636a59c836 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:13.053489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44ff05a0-2bd5-43c4-ac16-f2636a59c836 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:13.054008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44ff05a0-2bd5-43c4-ac16-f2636a59c836 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:13.054453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44ff05a0-2bd5-43c4-ac16-f2636a59c836 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:13.061642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44ff05a0-2bd5-43c4-ac16-f2636a59c836 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:13.062262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44ff05a0-2bd5-43c4-ac16-f2636a59c836 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:13.062724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44ff05a0-2bd5-43c4-ac16-f2636a59c836 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:13.298319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-44ff05a0-2bd5-43c4-ac16-f2636a59c836 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:13.307221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-44ff05a0-2bd5-43c4-ac16-f2636a59c836 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:13.314665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-44ff05a0-2bd5-43c4-ac16-f2636a59c836 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:13.319188 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-44ff05a0-2bd5-43c4-ac16-f2636a59c836 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1335 microversion: 2.47 time: 0.293904 Aug 27 04:46:13.345015 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1727/3409] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:13 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1335 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:46:14.154205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:46:14.155217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:46:14.156157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:46:14.156796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:46:14.157369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:46:14.175591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:14.181344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:14.183303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:14.184335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:14.187121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:14.187793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:14.243345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Getting quotas for project 35481e527d554cffb51339a61b5b25c0. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:46:14.257324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Getting quotas for user 12e5c6081bd441a4b105b405703b1325 and project 35481e527d554cffb51339a61b5b25c0. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:46:14.287267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:46:14.290894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:46:14.343761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab2fd1a6-f513-480d-86db-b5ef599c1424 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:14.345039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab2fd1a6-f513-480d-86db-b5ef599c1424 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:14.361833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab2fd1a6-f513-480d-86db-b5ef599c1424 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:14.362668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab2fd1a6-f513-480d-86db-b5ef599c1424 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:14.363266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab2fd1a6-f513-480d-86db-b5ef599c1424 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:14.364153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab2fd1a6-f513-480d-86db-b5ef599c1424 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:14.364995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab2fd1a6-f513-480d-86db-b5ef599c1424 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:14.365575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab2fd1a6-f513-480d-86db-b5ef599c1424 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:14.432251 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a93b50c4-5c4c-4e15-9296-bfe9ea5d69b4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.452820 Aug 27 04:46:14.434173 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1683/3410] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:46:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:46:14.461284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6c27047a-5c5b-4f0f-946b-f5ce20226928 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:14.462528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6c27047a-5c5b-4f0f-946b-f5ce20226928 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:14.593418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab2fd1a6-f513-480d-86db-b5ef599c1424 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:14.616470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab2fd1a6-f513-480d-86db-b5ef599c1424 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:14.619128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab2fd1a6-f513-480d-86db-b5ef599c1424 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:14.621311 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab2fd1a6-f513-480d-86db-b5ef599c1424 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1335 microversion: 2.47 time: 0.282379 Aug 27 04:46:14.643359 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1728/3411] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:14 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1335 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:46:14.746945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6c27047a-5c5b-4f0f-946b-f5ce20226928 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:14.784261 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6c27047a-5c5b-4f0f-946b-f5ce20226928 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1217 microversion: 2.1 time: 0.341832 Aug 27 04:46:14.796595 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1684/3412] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:14 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1217 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:15.654802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1abce5cf-c057-4c1f-9378-2c772a0cd41d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:15.655555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1abce5cf-c057-4c1f-9378-2c772a0cd41d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:15.674651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1abce5cf-c057-4c1f-9378-2c772a0cd41d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:15.676794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1abce5cf-c057-4c1f-9378-2c772a0cd41d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:15.677349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1abce5cf-c057-4c1f-9378-2c772a0cd41d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:15.678258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1abce5cf-c057-4c1f-9378-2c772a0cd41d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:15.679386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1abce5cf-c057-4c1f-9378-2c772a0cd41d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:15.680998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1abce5cf-c057-4c1f-9378-2c772a0cd41d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:15.809701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-653a59e9-179a-4c5b-95e8-3e7350d3270f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:15.811868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-653a59e9-179a-4c5b-95e8-3e7350d3270f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:15.820994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-653a59e9-179a-4c5b-95e8-3e7350d3270f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:15.821756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-653a59e9-179a-4c5b-95e8-3e7350d3270f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:15.822553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-653a59e9-179a-4c5b-95e8-3e7350d3270f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:15.823720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-653a59e9-179a-4c5b-95e8-3e7350d3270f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:15.824346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-653a59e9-179a-4c5b-95e8-3e7350d3270f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:15.824973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-653a59e9-179a-4c5b-95e8-3e7350d3270f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:15.914748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1abce5cf-c057-4c1f-9378-2c772a0cd41d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:15.927443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1abce5cf-c057-4c1f-9378-2c772a0cd41d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:15.931235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1abce5cf-c057-4c1f-9378-2c772a0cd41d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:15.935181 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1abce5cf-c057-4c1f-9378-2c772a0cd41d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1356 microversion: 2.47 time: 0.283124 Aug 27 04:46:15.938672 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1729/3413] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:15 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1356 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:15.961193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71228424-9f42-4121-865e-14501cc9b5c0"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:15.968027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:15.986955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:15.988317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:15.991597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:15.992431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:15.997220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:15.997913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:16.071173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-653a59e9-179a-4c5b-95e8-3e7350d3270f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:16.087037 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-653a59e9-179a-4c5b-95e8-3e7350d3270f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1269 microversion: 2.1 time: 0.281101 Aug 27 04:46:16.088452 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1685/3414] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:15 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1269 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:16.194557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:46:16.200257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:46:16.203241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:46:16.203720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:46:16.204159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:46:16.386703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:16.405669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:16.406183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:16.409330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:16.413185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:16.414131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:16.414771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:16.539879 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a69aa1d-5e4e-4da6-a7b3-e16dd1e846c2 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "POST /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e/action" status: 202 len: 1078 microversion: 2.47 time: 0.583313 Aug 27 04:46:16.546810 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1730/3415] 10.222.0.79 () {62 vars in 1319 bytes} [Sat Aug 27 04:46:15 2022] POST /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e/action => generated 1078 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 27 04:46:16.577684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59b4ec1d-1f37-458d-beea-73a6e8f51e35 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:16.579309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-59b4ec1d-1f37-458d-beea-73a6e8f51e35 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:16.610859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59b4ec1d-1f37-458d-beea-73a6e8f51e35 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:16.614994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59b4ec1d-1f37-458d-beea-73a6e8f51e35 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:16.616902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59b4ec1d-1f37-458d-beea-73a6e8f51e35 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:16.620262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59b4ec1d-1f37-458d-beea-73a6e8f51e35 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:16.621008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59b4ec1d-1f37-458d-beea-73a6e8f51e35 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:16.641942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59b4ec1d-1f37-458d-beea-73a6e8f51e35 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:17.036608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-59b4ec1d-1f37-458d-beea-73a6e8f51e35 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:17.054948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-59b4ec1d-1f37-458d-beea-73a6e8f51e35 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:17.058482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-59b4ec1d-1f37-458d-beea-73a6e8f51e35 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:17.063359 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-59b4ec1d-1f37-458d-beea-73a6e8f51e35 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.494616 Aug 27 04:46:17.066895 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1686/3416] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:16 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:17.111467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2b6c159e-ae8c-4155-ad08-6617ff9f082b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:17.113315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2b6c159e-ae8c-4155-ad08-6617ff9f082b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:17.125200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:17.130327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b6c159e-ae8c-4155-ad08-6617ff9f082b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:17.134162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b6c159e-ae8c-4155-ad08-6617ff9f082b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:17.135418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b6c159e-ae8c-4155-ad08-6617ff9f082b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:17.136432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b6c159e-ae8c-4155-ad08-6617ff9f082b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:17.137169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b6c159e-ae8c-4155-ad08-6617ff9f082b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:17.140337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b6c159e-ae8c-4155-ad08-6617ff9f082b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:17.257457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2b6c159e-ae8c-4155-ad08-6617ff9f082b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:17.270762 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2b6c159e-ae8c-4155-ad08-6617ff9f082b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1275 microversion: 2.1 time: 0.164963 Aug 27 04:46:17.288361 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1731/3417] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:17 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:18.097435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f7009e29-18c6-486f-9396-f5a9ddbd8573 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:18.098359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f7009e29-18c6-486f-9396-f5a9ddbd8573 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:18.112295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7009e29-18c6-486f-9396-f5a9ddbd8573 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:18.120220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7009e29-18c6-486f-9396-f5a9ddbd8573 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:18.121051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7009e29-18c6-486f-9396-f5a9ddbd8573 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:18.122513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7009e29-18c6-486f-9396-f5a9ddbd8573 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:18.123247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7009e29-18c6-486f-9396-f5a9ddbd8573 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:18.123996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7009e29-18c6-486f-9396-f5a9ddbd8573 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:18.292491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:18.297934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8409659-0561-46f0-8943-d87e528c9a6b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:18.298822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8409659-0561-46f0-8943-d87e528c9a6b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:18.302614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f7009e29-18c6-486f-9396-f5a9ddbd8573 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:18.315710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8409659-0561-46f0-8943-d87e528c9a6b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:18.319053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8409659-0561-46f0-8943-d87e528c9a6b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:18.320583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8409659-0561-46f0-8943-d87e528c9a6b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:18.323381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8409659-0561-46f0-8943-d87e528c9a6b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:18.324157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8409659-0561-46f0-8943-d87e528c9a6b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:18.326022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8409659-0561-46f0-8943-d87e528c9a6b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:18.333242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f7009e29-18c6-486f-9396-f5a9ddbd8573 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:18.336002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f7009e29-18c6-486f-9396-f5a9ddbd8573 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:18.339633 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f7009e29-18c6-486f-9396-f5a9ddbd8573 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.248171 Aug 27 04:46:18.344139 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1687/3418] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:18 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:18.510204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d8409659-0561-46f0-8943-d87e528c9a6b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:18.520095 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8409659-0561-46f0-8943-d87e528c9a6b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1275 microversion: 2.1 time: 0.228451 Aug 27 04:46:18.539977 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1732/3419] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:18 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1275 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:19.370731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-83a7071d-71b9-4dba-b746-07bd66db6e74 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:19.372431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-83a7071d-71b9-4dba-b746-07bd66db6e74 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:19.386022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83a7071d-71b9-4dba-b746-07bd66db6e74 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:19.387476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83a7071d-71b9-4dba-b746-07bd66db6e74 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:19.388350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83a7071d-71b9-4dba-b746-07bd66db6e74 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:19.389509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83a7071d-71b9-4dba-b746-07bd66db6e74 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:19.394567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83a7071d-71b9-4dba-b746-07bd66db6e74 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:19.396630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83a7071d-71b9-4dba-b746-07bd66db6e74 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:19.558177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c4fb4096-0c24-4d51-b3b3-19d8b2224980 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:19.563524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c4fb4096-0c24-4d51-b3b3-19d8b2224980 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:19.583742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4fb4096-0c24-4d51-b3b3-19d8b2224980 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:19.584294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4fb4096-0c24-4d51-b3b3-19d8b2224980 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:19.584940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4fb4096-0c24-4d51-b3b3-19d8b2224980 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:19.585698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4fb4096-0c24-4d51-b3b3-19d8b2224980 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:19.586243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4fb4096-0c24-4d51-b3b3-19d8b2224980 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:19.587640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4fb4096-0c24-4d51-b3b3-19d8b2224980 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:19.674647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-83a7071d-71b9-4dba-b746-07bd66db6e74 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:19.688947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-83a7071d-71b9-4dba-b746-07bd66db6e74 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:19.692633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-83a7071d-71b9-4dba-b746-07bd66db6e74 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:19.706125 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-83a7071d-71b9-4dba-b746-07bd66db6e74 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.329801 Aug 27 04:46:19.706125 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1688/3420] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:19 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:46:19.759015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c4fb4096-0c24-4d51-b3b3-19d8b2224980 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:19.772224 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c4fb4096-0c24-4d51-b3b3-19d8b2224980 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1275 microversion: 2.1 time: 0.228566 Aug 27 04:46:19.773167 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1733/3421] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:19 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1275 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:20.724514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-575842b3-1795-42e0-abad-adbde85e2c17 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:20.725929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-575842b3-1795-42e0-abad-adbde85e2c17 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:20.742758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-575842b3-1795-42e0-abad-adbde85e2c17 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:20.746127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-575842b3-1795-42e0-abad-adbde85e2c17 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:20.750102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-575842b3-1795-42e0-abad-adbde85e2c17 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:20.751370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-575842b3-1795-42e0-abad-adbde85e2c17 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:20.752121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-575842b3-1795-42e0-abad-adbde85e2c17 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:20.753549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-575842b3-1795-42e0-abad-adbde85e2c17 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:20.797399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-44d94f0e-994e-4b02-bc28-8aae388809ca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:20.800408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-44d94f0e-994e-4b02-bc28-8aae388809ca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:20.810733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44d94f0e-994e-4b02-bc28-8aae388809ca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:20.811732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44d94f0e-994e-4b02-bc28-8aae388809ca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:20.814215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44d94f0e-994e-4b02-bc28-8aae388809ca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:20.815622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44d94f0e-994e-4b02-bc28-8aae388809ca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:20.816314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44d94f0e-994e-4b02-bc28-8aae388809ca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:20.817010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44d94f0e-994e-4b02-bc28-8aae388809ca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:20.978492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-575842b3-1795-42e0-abad-adbde85e2c17 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:21.017140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-575842b3-1795-42e0-abad-adbde85e2c17 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:21.020139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-575842b3-1795-42e0-abad-adbde85e2c17 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:21.026104 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-575842b3-1795-42e0-abad-adbde85e2c17 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.306593 Aug 27 04:46:21.041677 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1689/3422] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:20 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:21.490765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-44d94f0e-994e-4b02-bc28-8aae388809ca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:21.506494 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-44d94f0e-994e-4b02-bc28-8aae388809ca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1317 microversion: 2.1 time: 0.715426 Aug 27 04:46:21.515539 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1734/3423] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:20 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1317 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:22.053768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-02577093-5f74-415c-a5b6-3a0fb559538d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:22.055408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-02577093-5f74-415c-a5b6-3a0fb559538d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:22.072730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02577093-5f74-415c-a5b6-3a0fb559538d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:22.074636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02577093-5f74-415c-a5b6-3a0fb559538d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:22.075633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02577093-5f74-415c-a5b6-3a0fb559538d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:22.079915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02577093-5f74-415c-a5b6-3a0fb559538d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:22.082599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02577093-5f74-415c-a5b6-3a0fb559538d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:22.084094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02577093-5f74-415c-a5b6-3a0fb559538d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:22.257078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-02577093-5f74-415c-a5b6-3a0fb559538d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:22.273236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-02577093-5f74-415c-a5b6-3a0fb559538d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:22.275555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-02577093-5f74-415c-a5b6-3a0fb559538d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:22.277588 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-02577093-5f74-415c-a5b6-3a0fb559538d tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.227876 Aug 27 04:46:22.291698 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1690/3424] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:22 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:22.529811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8705a364-7cc1-4faa-a825-a469c6a00ea3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:22.530613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8705a364-7cc1-4faa-a825-a469c6a00ea3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:22.545499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8705a364-7cc1-4faa-a825-a469c6a00ea3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:22.547461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8705a364-7cc1-4faa-a825-a469c6a00ea3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:22.548110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8705a364-7cc1-4faa-a825-a469c6a00ea3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:22.549131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8705a364-7cc1-4faa-a825-a469c6a00ea3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:22.550767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8705a364-7cc1-4faa-a825-a469c6a00ea3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:22.554805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8705a364-7cc1-4faa-a825-a469c6a00ea3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:22.907196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-106238922", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "807ca60d-b0fc-400c-80ab-75f58961c7d8"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:22.968734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8705a364-7cc1-4faa-a825-a469c6a00ea3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:22.979640 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8705a364-7cc1-4faa-a825-a469c6a00ea3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1317 microversion: 2.1 time: 0.454645 Aug 27 04:46:22.980824 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1735/3425] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:22 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:23.001666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] validate_networks() for [('807ca60d-b0fc-400c-80ab-75f58961c7d8', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:46:23.208636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8fd1142f-bf4e-46d8-83be-99029857a58e req-114d730e-6394-4896-b467-69590d419438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "130e56b9-8431-4e83-a7b1-3bad46f54e33", "tag": "781f778e-35b9-4dc8-8331-1212ae734ea7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:23.222258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8fd1142f-bf4e-46d8-83be-99029857a58e req-114d730e-6394-4896-b467-69590d419438 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:23.222749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8fd1142f-bf4e-46d8-83be-99029857a58e req-114d730e-6394-4896-b467-69590d419438 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:23.223392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8fd1142f-bf4e-46d8-83be-99029857a58e req-114d730e-6394-4896-b467-69590d419438 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:23.237253 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8fd1142f-bf4e-46d8-83be-99029857a58e req-114d730e-6394-4896-b467-69590d419438 service nova] Creating event network-changed:781f778e-35b9-4dc8-8331-1212ae734ea7 for instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 on n-h2-854823-1 Aug 27 04:46:23.243151 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8fd1142f-bf4e-46d8-83be-99029857a58e req-114d730e-6394-4896-b467-69590d419438 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039272 Aug 27 04:46:23.243770 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1736/3426] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:46:23.307524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e534f4d7-57a9-4fca-8f4f-d5c58d7f6066 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:23.308242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e534f4d7-57a9-4fca-8f4f-d5c58d7f6066 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:23.320863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e534f4d7-57a9-4fca-8f4f-d5c58d7f6066 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:23.321861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e534f4d7-57a9-4fca-8f4f-d5c58d7f6066 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:23.322475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e534f4d7-57a9-4fca-8f4f-d5c58d7f6066 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:23.323790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e534f4d7-57a9-4fca-8f4f-d5c58d7f6066 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:23.324883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e534f4d7-57a9-4fca-8f4f-d5c58d7f6066 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:23.327115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e534f4d7-57a9-4fca-8f4f-d5c58d7f6066 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:23.429871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e534f4d7-57a9-4fca-8f4f-d5c58d7f6066 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:23.450420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e534f4d7-57a9-4fca-8f4f-d5c58d7f6066 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:23.452590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e534f4d7-57a9-4fca-8f4f-d5c58d7f6066 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:23.454179 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e534f4d7-57a9-4fca-8f4f-d5c58d7f6066 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.151132 Aug 27 04:46:23.454776 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1737/3427] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:23 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:24.006273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a053ec6a-8d1d-4d6c-8b9e-a264b9fbcea1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:24.009051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a053ec6a-8d1d-4d6c-8b9e-a264b9fbcea1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:24.017258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a053ec6a-8d1d-4d6c-8b9e-a264b9fbcea1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:24.018963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a053ec6a-8d1d-4d6c-8b9e-a264b9fbcea1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:24.019799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a053ec6a-8d1d-4d6c-8b9e-a264b9fbcea1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:24.020727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a053ec6a-8d1d-4d6c-8b9e-a264b9fbcea1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:24.021358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a053ec6a-8d1d-4d6c-8b9e-a264b9fbcea1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:24.021979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a053ec6a-8d1d-4d6c-8b9e-a264b9fbcea1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:24.206792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:24.282909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a053ec6a-8d1d-4d6c-8b9e-a264b9fbcea1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:24.297514 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a053ec6a-8d1d-4d6c-8b9e-a264b9fbcea1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1317 microversion: 2.1 time: 0.295958 Aug 27 04:46:24.317579 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1738/3428] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:24 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:24.478081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b4e1e9ae-05af-42cd-83d8-ddd3f887a57a tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:24.478739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b4e1e9ae-05af-42cd-83d8-ddd3f887a57a tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:24.488440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4e1e9ae-05af-42cd-83d8-ddd3f887a57a tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:24.489012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4e1e9ae-05af-42cd-83d8-ddd3f887a57a tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:24.489799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4e1e9ae-05af-42cd-83d8-ddd3f887a57a tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:24.490590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4e1e9ae-05af-42cd-83d8-ddd3f887a57a tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:24.491863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4e1e9ae-05af-42cd-83d8-ddd3f887a57a tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:24.492344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4e1e9ae-05af-42cd-83d8-ddd3f887a57a tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:24.524296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:24.591965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b4e1e9ae-05af-42cd-83d8-ddd3f887a57a tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:24.605144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b4e1e9ae-05af-42cd-83d8-ddd3f887a57a tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:24.606946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b4e1e9ae-05af-42cd-83d8-ddd3f887a57a tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:24.608340 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b4e1e9ae-05af-42cd-83d8-ddd3f887a57a tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.134366 Aug 27 04:46:24.608964 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1739/3429] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:24 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:46:24.755446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=24 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:24.784930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:46:24.792994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:46:24.792994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:46:24.792994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:46:24.792994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:46:24.797498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:24.798229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:24.798727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:24.800168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:24.800882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:24.802451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:24.835917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Getting quotas for project 595098604fa6447c9408fefd4fb38b96. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:46:24.854529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Getting quotas for user 469c5851c3154ad9b2924b0d5ceb3fd7 and project 595098604fa6447c9408fefd4fb38b96. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:46:24.917291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:46:24.922815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:46:25.004175 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7d25faa7-2475-46be-8da9-0c0ebd01e140 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.334183 Aug 27 04:46:25.005070 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1691/3430] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:46:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:46:25.016941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-686d772f-6bc1-45d9-84fb-34bf30cadbfe tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:25.017991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-686d772f-6bc1-45d9-84fb-34bf30cadbfe tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:25.107905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-686d772f-6bc1-45d9-84fb-34bf30cadbfe tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:25.117181 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-686d772f-6bc1-45d9-84fb-34bf30cadbfe tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1215 microversion: 2.1 time: 0.104897 Aug 27 04:46:25.121328 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1740/3431] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:25 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:25.323559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-48e26159-f4cf-4198-8171-c56148f33d4d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:25.324207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-48e26159-f4cf-4198-8171-c56148f33d4d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:25.338432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48e26159-f4cf-4198-8171-c56148f33d4d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:25.338831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48e26159-f4cf-4198-8171-c56148f33d4d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:25.339278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48e26159-f4cf-4198-8171-c56148f33d4d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:25.366551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48e26159-f4cf-4198-8171-c56148f33d4d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:25.371211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48e26159-f4cf-4198-8171-c56148f33d4d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:25.371754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48e26159-f4cf-4198-8171-c56148f33d4d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:25.638015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35420629-1341-440a-9911-f439ae4ecf31 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:25.640446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35420629-1341-440a-9911-f439ae4ecf31 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:25.666313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35420629-1341-440a-9911-f439ae4ecf31 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:25.667912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35420629-1341-440a-9911-f439ae4ecf31 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:25.669210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35420629-1341-440a-9911-f439ae4ecf31 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:25.679173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-48e26159-f4cf-4198-8171-c56148f33d4d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:25.683571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:25.688730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35420629-1341-440a-9911-f439ae4ecf31 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:25.696737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35420629-1341-440a-9911-f439ae4ecf31 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:25.697532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35420629-1341-440a-9911-f439ae4ecf31 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:25.701012 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-48e26159-f4cf-4198-8171-c56148f33d4d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1317 microversion: 2.1 time: 0.380727 Aug 27 04:46:25.712418 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1692/3432] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:25 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:25.855347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35420629-1341-440a-9911-f439ae4ecf31 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:25.864549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35420629-1341-440a-9911-f439ae4ecf31 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:25.866000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35420629-1341-440a-9911-f439ae4ecf31 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:25.867338 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35420629-1341-440a-9911-f439ae4ecf31 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.239843 Aug 27 04:46:25.878423 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1741/3433] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:25 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:26.143491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e5adbedb-0336-49c7-87cf-a7fc68a2be6f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:26.144306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e5adbedb-0336-49c7-87cf-a7fc68a2be6f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:26.177925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5adbedb-0336-49c7-87cf-a7fc68a2be6f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:26.178430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5adbedb-0336-49c7-87cf-a7fc68a2be6f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:26.192870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5adbedb-0336-49c7-87cf-a7fc68a2be6f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:26.193857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5adbedb-0336-49c7-87cf-a7fc68a2be6f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:26.196588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5adbedb-0336-49c7-87cf-a7fc68a2be6f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:26.197070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5adbedb-0336-49c7-87cf-a7fc68a2be6f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:26.579435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e5adbedb-0336-49c7-87cf-a7fc68a2be6f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:26.600216 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e5adbedb-0336-49c7-87cf-a7fc68a2be6f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1267 microversion: 2.1 time: 0.461492 Aug 27 04:46:26.601755 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1693/3434] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:26 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1267 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:26.726387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cdb5c8d9-01e5-4d21-894c-c75b8e38d97f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:26.728061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cdb5c8d9-01e5-4d21-894c-c75b8e38d97f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:26.745364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdb5c8d9-01e5-4d21-894c-c75b8e38d97f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:26.745867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdb5c8d9-01e5-4d21-894c-c75b8e38d97f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:26.746501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdb5c8d9-01e5-4d21-894c-c75b8e38d97f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:26.747650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdb5c8d9-01e5-4d21-894c-c75b8e38d97f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:26.748289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdb5c8d9-01e5-4d21-894c-c75b8e38d97f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:26.748922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdb5c8d9-01e5-4d21-894c-c75b8e38d97f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:26.897227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd61c1a5-bc3f-42f0-a01b-fcb2de07b880 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:26.898182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fd61c1a5-bc3f-42f0-a01b-fcb2de07b880 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:26.916214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd61c1a5-bc3f-42f0-a01b-fcb2de07b880 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:26.916746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd61c1a5-bc3f-42f0-a01b-fcb2de07b880 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:26.917190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd61c1a5-bc3f-42f0-a01b-fcb2de07b880 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:26.917896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd61c1a5-bc3f-42f0-a01b-fcb2de07b880 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:26.918865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd61c1a5-bc3f-42f0-a01b-fcb2de07b880 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:26.919618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd61c1a5-bc3f-42f0-a01b-fcb2de07b880 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:27.040786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fd61c1a5-bc3f-42f0-a01b-fcb2de07b880 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:27.058319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fd61c1a5-bc3f-42f0-a01b-fcb2de07b880 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:27.060005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fd61c1a5-bc3f-42f0-a01b-fcb2de07b880 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:27.061399 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fd61c1a5-bc3f-42f0-a01b-fcb2de07b880 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.168118 Aug 27 04:46:27.062524 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1694/3435] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:26 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:27.317222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cdb5c8d9-01e5-4d21-894c-c75b8e38d97f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:27.330485 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cdb5c8d9-01e5-4d21-894c-c75b8e38d97f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1317 microversion: 2.1 time: 0.608956 Aug 27 04:46:27.350855 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1742/3436] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:26 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:27.630020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d7fc7741-f981-425d-a1b2-41bb27164a15 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:27.633816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d7fc7741-f981-425d-a1b2-41bb27164a15 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:27.658307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7fc7741-f981-425d-a1b2-41bb27164a15 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:27.661227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7fc7741-f981-425d-a1b2-41bb27164a15 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:27.661981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7fc7741-f981-425d-a1b2-41bb27164a15 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:27.663213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7fc7741-f981-425d-a1b2-41bb27164a15 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:27.664041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7fc7741-f981-425d-a1b2-41bb27164a15 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:27.665118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7fc7741-f981-425d-a1b2-41bb27164a15 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:27.862782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d7fc7741-f981-425d-a1b2-41bb27164a15 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:27.875195 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d7fc7741-f981-425d-a1b2-41bb27164a15 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1273 microversion: 2.1 time: 0.255135 Aug 27 04:46:27.878277 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1695/3437] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:27 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:28.118703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88ceb5b4-aead-461d-b9bc-8c2d52f3d727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:28.120798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88ceb5b4-aead-461d-b9bc-8c2d52f3d727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:28.155396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88ceb5b4-aead-461d-b9bc-8c2d52f3d727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:28.160244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88ceb5b4-aead-461d-b9bc-8c2d52f3d727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:28.161662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88ceb5b4-aead-461d-b9bc-8c2d52f3d727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:28.164778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88ceb5b4-aead-461d-b9bc-8c2d52f3d727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:28.168943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88ceb5b4-aead-461d-b9bc-8c2d52f3d727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:28.191484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88ceb5b4-aead-461d-b9bc-8c2d52f3d727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:28.365390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b9cb0b0d-b2df-49a8-ac6e-d254b5665a50 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:28.369828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b9cb0b0d-b2df-49a8-ac6e-d254b5665a50 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:28.398155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9cb0b0d-b2df-49a8-ac6e-d254b5665a50 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:28.401745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9cb0b0d-b2df-49a8-ac6e-d254b5665a50 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:28.404472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9cb0b0d-b2df-49a8-ac6e-d254b5665a50 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:28.425099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9cb0b0d-b2df-49a8-ac6e-d254b5665a50 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:28.426259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9cb0b0d-b2df-49a8-ac6e-d254b5665a50 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:28.429952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9cb0b0d-b2df-49a8-ac6e-d254b5665a50 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:28.469711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88ceb5b4-aead-461d-b9bc-8c2d52f3d727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:28.494685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88ceb5b4-aead-461d-b9bc-8c2d52f3d727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:28.496477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88ceb5b4-aead-461d-b9bc-8c2d52f3d727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:28.497987 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88ceb5b4-aead-461d-b9bc-8c2d52f3d727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.410236 Aug 27 04:46:28.500924 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1743/3438] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:28 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:28.900763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce824e2e-beb1-4e35-87d5-cae14dbc165a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:28.901484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce824e2e-beb1-4e35-87d5-cae14dbc165a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:28.903788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:28.919034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce824e2e-beb1-4e35-87d5-cae14dbc165a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:28.919848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce824e2e-beb1-4e35-87d5-cae14dbc165a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:28.920401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce824e2e-beb1-4e35-87d5-cae14dbc165a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:28.921408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce824e2e-beb1-4e35-87d5-cae14dbc165a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:28.922077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce824e2e-beb1-4e35-87d5-cae14dbc165a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:28.923296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce824e2e-beb1-4e35-87d5-cae14dbc165a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:29.036980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b9cb0b0d-b2df-49a8-ac6e-d254b5665a50 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:29.054638 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b9cb0b0d-b2df-49a8-ac6e-d254b5665a50 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1317 microversion: 2.1 time: 0.698985 Aug 27 04:46:29.057763 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1696/3439] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:28 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1317 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:29.241939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce824e2e-beb1-4e35-87d5-cae14dbc165a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:29.258073 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce824e2e-beb1-4e35-87d5-cae14dbc165a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1315 microversion: 2.1 time: 0.360525 Aug 27 04:46:29.272799 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1744/3440] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:28 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:29.548021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c967e366-cf69-4d8c-a451-74b80fe15877 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:29.551124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c967e366-cf69-4d8c-a451-74b80fe15877 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:29.559672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c967e366-cf69-4d8c-a451-74b80fe15877 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:29.560921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c967e366-cf69-4d8c-a451-74b80fe15877 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:29.561993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c967e366-cf69-4d8c-a451-74b80fe15877 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:29.563030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c967e366-cf69-4d8c-a451-74b80fe15877 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:29.564901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c967e366-cf69-4d8c-a451-74b80fe15877 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:29.566026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c967e366-cf69-4d8c-a451-74b80fe15877 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:29.820085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c967e366-cf69-4d8c-a451-74b80fe15877 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:29.838728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c967e366-cf69-4d8c-a451-74b80fe15877 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:29.845550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c967e366-cf69-4d8c-a451-74b80fe15877 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:29.849023 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c967e366-cf69-4d8c-a451-74b80fe15877 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.306812 Aug 27 04:46:29.852283 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1697/3441] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:29 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:30.078730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20630f24-0b6f-468f-a333-a94a8c11be51 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:30.079369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20630f24-0b6f-468f-a333-a94a8c11be51 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:30.097466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20630f24-0b6f-468f-a333-a94a8c11be51 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:30.097696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20630f24-0b6f-468f-a333-a94a8c11be51 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:30.098145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20630f24-0b6f-468f-a333-a94a8c11be51 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:30.098865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20630f24-0b6f-468f-a333-a94a8c11be51 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:30.099871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20630f24-0b6f-468f-a333-a94a8c11be51 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:30.100292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20630f24-0b6f-468f-a333-a94a8c11be51 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:30.133371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-40c6141c-89fa-460f-8aa6-e5bc069d7368 req-db1dfb3a-569b-4001-ab31-bcf5a011372a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b095396e-83b3-4733-af37-4cab3655b64e", "tag": "8419740d-2cdd-4f2d-9e9a-6c61385ab032"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:30.167490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-40c6141c-89fa-460f-8aa6-e5bc069d7368 req-db1dfb3a-569b-4001-ab31-bcf5a011372a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:30.168632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-40c6141c-89fa-460f-8aa6-e5bc069d7368 req-db1dfb3a-569b-4001-ab31-bcf5a011372a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:30.169561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-40c6141c-89fa-460f-8aa6-e5bc069d7368 req-db1dfb3a-569b-4001-ab31-bcf5a011372a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:30.214916 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-40c6141c-89fa-460f-8aa6-e5bc069d7368 req-db1dfb3a-569b-4001-ab31-bcf5a011372a service nova] Creating event network-changed:8419740d-2cdd-4f2d-9e9a-6c61385ab032 for instance b095396e-83b3-4733-af37-4cab3655b64e on n-h1-854823-1 Aug 27 04:46:30.226593 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-40c6141c-89fa-460f-8aa6-e5bc069d7368 req-db1dfb3a-569b-4001-ab31-bcf5a011372a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100009 Aug 27 04:46:30.227628 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1698/3442] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:46:30.288912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b0bf4471-5bcd-4497-a45c-3691500a440a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:30.289890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b0bf4471-5bcd-4497-a45c-3691500a440a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:30.299317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:30.307858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0bf4471-5bcd-4497-a45c-3691500a440a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:30.310194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0bf4471-5bcd-4497-a45c-3691500a440a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:30.310595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0bf4471-5bcd-4497-a45c-3691500a440a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:30.311552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0bf4471-5bcd-4497-a45c-3691500a440a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:30.312621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0bf4471-5bcd-4497-a45c-3691500a440a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:30.313281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0bf4471-5bcd-4497-a45c-3691500a440a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:30.533203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-20630f24-0b6f-468f-a333-a94a8c11be51 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:30.543562 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20630f24-0b6f-468f-a333-a94a8c11be51 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1317 microversion: 2.1 time: 0.469195 Aug 27 04:46:30.557316 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1745/3443] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:30 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:30.665582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d521710b-f736-4452-8090-eaf089c53ea7 req-d3c1d615-5d13-4d9f-a368-bb023e2bd115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "130e56b9-8431-4e83-a7b1-3bad46f54e33", "name": "network-vif-plugged", "status": "completed", "tag": "781f778e-35b9-4dc8-8331-1212ae734ea7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:30.688839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d521710b-f736-4452-8090-eaf089c53ea7 req-d3c1d615-5d13-4d9f-a368-bb023e2bd115 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:30.689349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d521710b-f736-4452-8090-eaf089c53ea7 req-d3c1d615-5d13-4d9f-a368-bb023e2bd115 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:30.690573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d521710b-f736-4452-8090-eaf089c53ea7 req-d3c1d615-5d13-4d9f-a368-bb023e2bd115 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:30.707435 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d521710b-f736-4452-8090-eaf089c53ea7 req-d3c1d615-5d13-4d9f-a368-bb023e2bd115 service nova] Creating event network-vif-plugged:781f778e-35b9-4dc8-8331-1212ae734ea7 for instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 on n-h2-854823-1 Aug 27 04:46:30.715216 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d521710b-f736-4452-8090-eaf089c53ea7 req-d3c1d615-5d13-4d9f-a368-bb023e2bd115 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053719 Aug 27 04:46:30.716009 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1746/3444] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:46:30.876944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef08e327-8aff-410f-81ff-c206964f40ab tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:30.878035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef08e327-8aff-410f-81ff-c206964f40ab tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:30.890123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef08e327-8aff-410f-81ff-c206964f40ab tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:30.891146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef08e327-8aff-410f-81ff-c206964f40ab tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:30.891839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef08e327-8aff-410f-81ff-c206964f40ab tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:30.893659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef08e327-8aff-410f-81ff-c206964f40ab tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:30.894456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef08e327-8aff-410f-81ff-c206964f40ab tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:30.895107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef08e327-8aff-410f-81ff-c206964f40ab tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:31.009454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef08e327-8aff-410f-81ff-c206964f40ab tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:31.033317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef08e327-8aff-410f-81ff-c206964f40ab tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:31.035544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b0bf4471-5bcd-4497-a45c-3691500a440a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:31.036206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef08e327-8aff-410f-81ff-c206964f40ab tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:31.038021 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef08e327-8aff-410f-81ff-c206964f40ab tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.166295 Aug 27 04:46:31.039320 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1747/3445] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:30 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:31.051401 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b0bf4471-5bcd-4497-a45c-3691500a440a tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1315 microversion: 2.1 time: 0.769754 Aug 27 04:46:31.057077 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1699/3446] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:30 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:31.579961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-41fd2289-ad0f-4921-839b-3bcf2c812adc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:31.581796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41fd2289-ad0f-4921-839b-3bcf2c812adc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:31.590631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41fd2289-ad0f-4921-839b-3bcf2c812adc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:31.591432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41fd2289-ad0f-4921-839b-3bcf2c812adc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:31.594753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41fd2289-ad0f-4921-839b-3bcf2c812adc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:31.596153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41fd2289-ad0f-4921-839b-3bcf2c812adc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:31.597461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41fd2289-ad0f-4921-839b-3bcf2c812adc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:31.599587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41fd2289-ad0f-4921-839b-3bcf2c812adc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:32.064296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3b596901-2e73-4bbd-98ab-031fa574c6ed tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:32.066097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3b596901-2e73-4bbd-98ab-031fa574c6ed tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:32.074446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b596901-2e73-4bbd-98ab-031fa574c6ed tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:32.075564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b596901-2e73-4bbd-98ab-031fa574c6ed tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:32.076223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b596901-2e73-4bbd-98ab-031fa574c6ed tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:32.077455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b596901-2e73-4bbd-98ab-031fa574c6ed tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:32.078090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b596901-2e73-4bbd-98ab-031fa574c6ed tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:32.078742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b596901-2e73-4bbd-98ab-031fa574c6ed tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:32.182045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3b596901-2e73-4bbd-98ab-031fa574c6ed tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:32.229325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3b596901-2e73-4bbd-98ab-031fa574c6ed tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:32.232288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3b596901-2e73-4bbd-98ab-031fa574c6ed tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:32.238109 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3b596901-2e73-4bbd-98ab-031fa574c6ed tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.175483 Aug 27 04:46:32.240846 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1700/3447] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:32 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:32.258518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-73c3f0da-02bb-4c34-9631-b0f5bcd0f4a4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:32.259389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-73c3f0da-02bb-4c34-9631-b0f5bcd0f4a4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:32.269996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73c3f0da-02bb-4c34-9631-b0f5bcd0f4a4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:32.270516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73c3f0da-02bb-4c34-9631-b0f5bcd0f4a4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:32.270959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73c3f0da-02bb-4c34-9631-b0f5bcd0f4a4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:32.276554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73c3f0da-02bb-4c34-9631-b0f5bcd0f4a4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:32.277272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73c3f0da-02bb-4c34-9631-b0f5bcd0f4a4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:32.277890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73c3f0da-02bb-4c34-9631-b0f5bcd0f4a4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:32.411965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-41fd2289-ad0f-4921-839b-3bcf2c812adc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:32.421062 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-41fd2289-ad0f-4921-839b-3bcf2c812adc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1317 microversion: 2.1 time: 0.854578 Aug 27 04:46:32.430811 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1748/3448] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:31 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1317 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:32.625024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-73c3f0da-02bb-4c34-9631-b0f5bcd0f4a4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:32.639375 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-73c3f0da-02bb-4c34-9631-b0f5bcd0f4a4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1315 microversion: 2.1 time: 0.396870 Aug 27 04:46:32.641513 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1701/3449] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:32 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:33.268654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be2039a5-1e55-4c89-9a87-d0d39b78a1e5 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:33.270130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-be2039a5-1e55-4c89-9a87-d0d39b78a1e5 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:33.279263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be2039a5-1e55-4c89-9a87-d0d39b78a1e5 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:33.280198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be2039a5-1e55-4c89-9a87-d0d39b78a1e5 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:33.281074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be2039a5-1e55-4c89-9a87-d0d39b78a1e5 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:33.282017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be2039a5-1e55-4c89-9a87-d0d39b78a1e5 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:33.282841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be2039a5-1e55-4c89-9a87-d0d39b78a1e5 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:33.283507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be2039a5-1e55-4c89-9a87-d0d39b78a1e5 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:33.376888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be2039a5-1e55-4c89-9a87-d0d39b78a1e5 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:33.403402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be2039a5-1e55-4c89-9a87-d0d39b78a1e5 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:33.407950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be2039a5-1e55-4c89-9a87-d0d39b78a1e5 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:33.411164 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be2039a5-1e55-4c89-9a87-d0d39b78a1e5 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.146483 Aug 27 04:46:33.413660 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1749/3450] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:33 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:33.453031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e3628774-0fea-4a09-af54-0ffeb92672c0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:33.453648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e3628774-0fea-4a09-af54-0ffeb92672c0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:33.463700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3628774-0fea-4a09-af54-0ffeb92672c0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:33.464329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3628774-0fea-4a09-af54-0ffeb92672c0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:33.464807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3628774-0fea-4a09-af54-0ffeb92672c0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:33.465694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3628774-0fea-4a09-af54-0ffeb92672c0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:33.466237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3628774-0fea-4a09-af54-0ffeb92672c0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:33.466717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3628774-0fea-4a09-af54-0ffeb92672c0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:33.666621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47989da9-b037-44d2-81c2-c4beb77274c0 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:33.667567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47989da9-b037-44d2-81c2-c4beb77274c0 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:33.678091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47989da9-b037-44d2-81c2-c4beb77274c0 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:33.678951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47989da9-b037-44d2-81c2-c4beb77274c0 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:33.679588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47989da9-b037-44d2-81c2-c4beb77274c0 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:33.680485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47989da9-b037-44d2-81c2-c4beb77274c0 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:33.681145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47989da9-b037-44d2-81c2-c4beb77274c0 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:33.681951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47989da9-b037-44d2-81c2-c4beb77274c0 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:33.955185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47989da9-b037-44d2-81c2-c4beb77274c0 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:33.965408 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47989da9-b037-44d2-81c2-c4beb77274c0 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1315 microversion: 2.1 time: 0.302681 Aug 27 04:46:33.982734 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1750/3451] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:33 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:34.045218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e3628774-0fea-4a09-af54-0ffeb92672c0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:34.067311 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e3628774-0fea-4a09-af54-0ffeb92672c0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1507 microversion: 2.1 time: 0.619704 Aug 27 04:46:34.071446 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1702/3452] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:33 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1507 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:34.116794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b48cf38c-ba4c-40d9-9628-faf42b07332f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:34.125292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b48cf38c-ba4c-40d9-9628-faf42b07332f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:34.141558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b48cf38c-ba4c-40d9-9628-faf42b07332f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:34.142067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b48cf38c-ba4c-40d9-9628-faf42b07332f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:34.142662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b48cf38c-ba4c-40d9-9628-faf42b07332f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:34.144399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b48cf38c-ba4c-40d9-9628-faf42b07332f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:34.144925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b48cf38c-ba4c-40d9-9628-faf42b07332f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:34.145375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b48cf38c-ba4c-40d9-9628-faf42b07332f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:34.441423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98b9d4bd-3716-49ab-98e6-e2e1a15d606e tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:34.442932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98b9d4bd-3716-49ab-98e6-e2e1a15d606e tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:34.475186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98b9d4bd-3716-49ab-98e6-e2e1a15d606e tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:34.477178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98b9d4bd-3716-49ab-98e6-e2e1a15d606e tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:34.479196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98b9d4bd-3716-49ab-98e6-e2e1a15d606e tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:34.481053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98b9d4bd-3716-49ab-98e6-e2e1a15d606e tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:34.482104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98b9d4bd-3716-49ab-98e6-e2e1a15d606e tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:34.487291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98b9d4bd-3716-49ab-98e6-e2e1a15d606e tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:34.602454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b48cf38c-ba4c-40d9-9628-faf42b07332f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:34.617255 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b48cf38c-ba4c-40d9-9628-faf42b07332f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1507 microversion: 2.1 time: 0.525980 Aug 27 04:46:34.621687 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1751/3453] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:34 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1507 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:34.641747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:34.646341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:34.667994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:34.670381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:34.674703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:34.675554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:34.676045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:34.676624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:34.704636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-98b9d4bd-3716-49ab-98e6-e2e1a15d606e tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:34.721940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-98b9d4bd-3716-49ab-98e6-e2e1a15d606e tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:34.724227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-98b9d4bd-3716-49ab-98e6-e2e1a15d606e tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:34.734958 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-98b9d4bd-3716-49ab-98e6-e2e1a15d606e tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.301585 Aug 27 04:46:34.756900 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1703/3454] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:34 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:46:34.817793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:46:34.819186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:46:34.819927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:46:34.820722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:46:34.821310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:46:34.910812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:34.921374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:34.922243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:34.923121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:34.925260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:34.926050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:34.928448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:34.969649 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2abab3c9-36fb-4ff5-8511-52f8035d40d7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "POST /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33/action" status: 202 len: 1109 microversion: 2.1 time: 0.332070 Aug 27 04:46:34.980764 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1752/3455] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:46:34 2022] POST /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33/action => generated 1109 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 27 04:46:35.000959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7907c00d-f1dd-44ee-8891-f6583dec2350 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:35.002092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7907c00d-f1dd-44ee-8891-f6583dec2350 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:35.006373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed0ba41b-e478-4a8e-b82f-288fa5d3c456 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:35.007061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ed0ba41b-e478-4a8e-b82f-288fa5d3c456 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:35.010086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:35.011064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:35.014886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed0ba41b-e478-4a8e-b82f-288fa5d3c456 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:35.015393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed0ba41b-e478-4a8e-b82f-288fa5d3c456 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:35.015836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed0ba41b-e478-4a8e-b82f-288fa5d3c456 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:35.016671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed0ba41b-e478-4a8e-b82f-288fa5d3c456 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:35.017151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed0ba41b-e478-4a8e-b82f-288fa5d3c456 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:35.017580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed0ba41b-e478-4a8e-b82f-288fa5d3c456 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:35.026850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7907c00d-f1dd-44ee-8891-f6583dec2350 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:35.029380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7907c00d-f1dd-44ee-8891-f6583dec2350 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:35.030882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7907c00d-f1dd-44ee-8891-f6583dec2350 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:35.035518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7907c00d-f1dd-44ee-8891-f6583dec2350 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:35.036879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7907c00d-f1dd-44ee-8891-f6583dec2350 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:35.038011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7907c00d-f1dd-44ee-8891-f6583dec2350 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:35.117249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:35.215758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed0ba41b-e478-4a8e-b82f-288fa5d3c456 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:35.226237 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ed0ba41b-e478-4a8e-b82f-288fa5d3c456 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.230026 Aug 27 04:46:35.229307 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1753/3456] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:34 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:35.362342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7907c00d-f1dd-44ee-8891-f6583dec2350 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:35.380844 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7907c00d-f1dd-44ee-8891-f6583dec2350 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1315 microversion: 2.1 time: 0.393802 Aug 27 04:46:35.381703 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1704/3457] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:34 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:35.766685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8b99de3-91d4-493f-9094-dca0842d0f8c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:35.767445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8b99de3-91d4-493f-9094-dca0842d0f8c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:35.792662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b99de3-91d4-493f-9094-dca0842d0f8c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:35.793414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b99de3-91d4-493f-9094-dca0842d0f8c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:35.794956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b99de3-91d4-493f-9094-dca0842d0f8c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:35.801776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b99de3-91d4-493f-9094-dca0842d0f8c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:35.802608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b99de3-91d4-493f-9094-dca0842d0f8c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:35.803289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b99de3-91d4-493f-9094-dca0842d0f8c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:36.010255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8b99de3-91d4-493f-9094-dca0842d0f8c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:36.031104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8b99de3-91d4-493f-9094-dca0842d0f8c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:36.032618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8b99de3-91d4-493f-9094-dca0842d0f8c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:36.040866 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8b99de3-91d4-493f-9094-dca0842d0f8c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.271905 Aug 27 04:46:36.041531 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1754/3458] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:35 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:36.253832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aaa8e245-c014-4b87-8a72-445d45bd9f9a tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:36.255118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aaa8e245-c014-4b87-8a72-445d45bd9f9a tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:36.279570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaa8e245-c014-4b87-8a72-445d45bd9f9a tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:36.285362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaa8e245-c014-4b87-8a72-445d45bd9f9a tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:36.288699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaa8e245-c014-4b87-8a72-445d45bd9f9a tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:36.290713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaa8e245-c014-4b87-8a72-445d45bd9f9a tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:36.294322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaa8e245-c014-4b87-8a72-445d45bd9f9a tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:36.297138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaa8e245-c014-4b87-8a72-445d45bd9f9a tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:36.405541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-509078a1-9025-43be-b95f-8f02f4b8dcc9 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:36.406484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-509078a1-9025-43be-b95f-8f02f4b8dcc9 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:36.416901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-509078a1-9025-43be-b95f-8f02f4b8dcc9 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:36.420064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-509078a1-9025-43be-b95f-8f02f4b8dcc9 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:36.421165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-509078a1-9025-43be-b95f-8f02f4b8dcc9 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:36.422169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-509078a1-9025-43be-b95f-8f02f4b8dcc9 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:36.430433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-509078a1-9025-43be-b95f-8f02f4b8dcc9 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:36.432309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-509078a1-9025-43be-b95f-8f02f4b8dcc9 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:36.657335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aaa8e245-c014-4b87-8a72-445d45bd9f9a tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:36.668667 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aaa8e245-c014-4b87-8a72-445d45bd9f9a tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.420120 Aug 27 04:46:36.680555 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1705/3459] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:36 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:36.770814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-509078a1-9025-43be-b95f-8f02f4b8dcc9 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:36.776606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:36.790120 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-509078a1-9025-43be-b95f-8f02f4b8dcc9 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1315 microversion: 2.1 time: 0.386309 Aug 27 04:46:36.790822 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1755/3460] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:36 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:37.009493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1901186814", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "8466f1d1-d166-4e3a-9fcf-4d7e96907a52"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:37.069824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a01ba346-2c46-44b9-8670-02142c8224e4 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:37.070485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a01ba346-2c46-44b9-8670-02142c8224e4 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:37.087178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a01ba346-2c46-44b9-8670-02142c8224e4 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:37.087872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a01ba346-2c46-44b9-8670-02142c8224e4 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:37.088335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a01ba346-2c46-44b9-8670-02142c8224e4 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:37.090826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a01ba346-2c46-44b9-8670-02142c8224e4 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:37.095184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a01ba346-2c46-44b9-8670-02142c8224e4 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:37.097197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] validate_networks() for [('8466f1d1-d166-4e3a-9fcf-4d7e96907a52', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:46:37.098932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a01ba346-2c46-44b9-8670-02142c8224e4 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:37.245050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a01ba346-2c46-44b9-8670-02142c8224e4 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:37.260384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a01ba346-2c46-44b9-8670-02142c8224e4 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:37.262577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a01ba346-2c46-44b9-8670-02142c8224e4 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:37.264402 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a01ba346-2c46-44b9-8670-02142c8224e4 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.200833 Aug 27 04:46:37.265456 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1756/3461] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:37 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:46:37.696911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d4e646b-8940-41bf-89d3-ffe5253b111d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:37.697709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d4e646b-8940-41bf-89d3-ffe5253b111d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:37.715214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d4e646b-8940-41bf-89d3-ffe5253b111d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:37.716484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d4e646b-8940-41bf-89d3-ffe5253b111d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:37.717093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d4e646b-8940-41bf-89d3-ffe5253b111d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:37.719894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d4e646b-8940-41bf-89d3-ffe5253b111d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:37.722469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d4e646b-8940-41bf-89d3-ffe5253b111d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:37.723069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d4e646b-8940-41bf-89d3-ffe5253b111d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:37.805974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:46:37.807999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:46:37.807999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:46:37.807999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:46:37.808429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:46:37.824094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:37.824666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:37.825551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:37.826814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:37.827917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:37.828575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:37.851468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Getting quotas for project 35161c722a2341a79e69f467f9eaec10. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:46:37.859715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Getting quotas for user 117b87f36c8d4b269069f920ba7f1f12 and project 35161c722a2341a79e69f467f9eaec10. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:46:37.882350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:46:37.887541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:46:37.956310 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3040274d-81dd-4541-9861-745a74956407 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.283100 Aug 27 04:46:37.957166 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1706/3462] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:46:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:46:37.982289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-49bb6764-e77f-4fe6-afc1-2963b9f0ea1f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:37.983565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-49bb6764-e77f-4fe6-afc1-2963b9f0ea1f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:37.985439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d4e646b-8940-41bf-89d3-ffe5253b111d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:37.993809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49bb6764-e77f-4fe6-afc1-2963b9f0ea1f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:37.994968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49bb6764-e77f-4fe6-afc1-2963b9f0ea1f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:37.995557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49bb6764-e77f-4fe6-afc1-2963b9f0ea1f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:37.996819 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d4e646b-8940-41bf-89d3-ffe5253b111d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.304476 Aug 27 04:46:37.997790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49bb6764-e77f-4fe6-afc1-2963b9f0ea1f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:37.998350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49bb6764-e77f-4fe6-afc1-2963b9f0ea1f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:37.998841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49bb6764-e77f-4fe6-afc1-2963b9f0ea1f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:38.005038 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1757/3463] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:37 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:38.018017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bb166634-26bf-4792-a7c1-a7865857428d tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:38.018646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bb166634-26bf-4792-a7c1-a7865857428d tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:38.098101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bb166634-26bf-4792-a7c1-a7865857428d tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:38.110064 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bb166634-26bf-4792-a7c1-a7865857428d tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1224 microversion: 2.1 time: 0.100724 Aug 27 04:46:38.114366 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1758/3464] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:38 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:38.203757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-49bb6764-e77f-4fe6-afc1-2963b9f0ea1f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:38.218656 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-49bb6764-e77f-4fe6-afc1-2963b9f0ea1f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1315 microversion: 2.1 time: 0.258723 Aug 27 04:46:38.219663 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1707/3465] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:37 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:38.295542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d17712c6-15ec-497b-b9dd-39d56382fbe7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:38.296294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d17712c6-15ec-497b-b9dd-39d56382fbe7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:38.303173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d17712c6-15ec-497b-b9dd-39d56382fbe7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:38.303678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d17712c6-15ec-497b-b9dd-39d56382fbe7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:38.304127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d17712c6-15ec-497b-b9dd-39d56382fbe7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:38.304876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d17712c6-15ec-497b-b9dd-39d56382fbe7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:38.305339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d17712c6-15ec-497b-b9dd-39d56382fbe7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:38.305772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d17712c6-15ec-497b-b9dd-39d56382fbe7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:38.396810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d17712c6-15ec-497b-b9dd-39d56382fbe7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:38.410765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d17712c6-15ec-497b-b9dd-39d56382fbe7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:38.412226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d17712c6-15ec-497b-b9dd-39d56382fbe7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:38.413608 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d17712c6-15ec-497b-b9dd-39d56382fbe7 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.123233 Aug 27 04:46:38.428555 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1759/3466] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:38 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:38.860879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-79385814-8083-4734-9ffc-97e9fedd920c req-b9aa580d-ad1e-4313-9ee7-621134acc076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b095396e-83b3-4733-af37-4cab3655b64e", "name": "network-vif-plugged", "status": "completed", "tag": "8419740d-2cdd-4f2d-9e9a-6c61385ab032"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:38.884976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-79385814-8083-4734-9ffc-97e9fedd920c req-b9aa580d-ad1e-4313-9ee7-621134acc076 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:38.885518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-79385814-8083-4734-9ffc-97e9fedd920c req-b9aa580d-ad1e-4313-9ee7-621134acc076 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:38.885959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-79385814-8083-4734-9ffc-97e9fedd920c req-b9aa580d-ad1e-4313-9ee7-621134acc076 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:38.905707 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-79385814-8083-4734-9ffc-97e9fedd920c req-b9aa580d-ad1e-4313-9ee7-621134acc076 service nova] Creating event network-vif-plugged:8419740d-2cdd-4f2d-9e9a-6c61385ab032 for instance b095396e-83b3-4733-af37-4cab3655b64e on n-h1-854823-1 Aug 27 04:46:38.914660 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-79385814-8083-4734-9ffc-97e9fedd920c req-b9aa580d-ad1e-4313-9ee7-621134acc076 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062109 Aug 27 04:46:38.916620 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1708/3467] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:46:39.025657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bcda39a0-0c27-4a9b-89ec-9366539f9abf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:39.027030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bcda39a0-0c27-4a9b-89ec-9366539f9abf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:39.042013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcda39a0-0c27-4a9b-89ec-9366539f9abf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:39.046443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcda39a0-0c27-4a9b-89ec-9366539f9abf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:39.048655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcda39a0-0c27-4a9b-89ec-9366539f9abf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:39.049742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcda39a0-0c27-4a9b-89ec-9366539f9abf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:39.050644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcda39a0-0c27-4a9b-89ec-9366539f9abf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:39.051458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcda39a0-0c27-4a9b-89ec-9366539f9abf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:39.138783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-09511aab-46d4-49f2-9f5b-ce79040de7a1 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:39.139856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-09511aab-46d4-49f2-9f5b-ce79040de7a1 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:39.148218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09511aab-46d4-49f2-9f5b-ce79040de7a1 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:39.149086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09511aab-46d4-49f2-9f5b-ce79040de7a1 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:39.149763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09511aab-46d4-49f2-9f5b-ce79040de7a1 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:39.150900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09511aab-46d4-49f2-9f5b-ce79040de7a1 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:39.151745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09511aab-46d4-49f2-9f5b-ce79040de7a1 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:39.152849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09511aab-46d4-49f2-9f5b-ce79040de7a1 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:39.236598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-09511aab-46d4-49f2-9f5b-ce79040de7a1 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:39.258845 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-09511aab-46d4-49f2-9f5b-ce79040de7a1 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1276 microversion: 2.1 time: 0.125666 Aug 27 04:46:39.261422 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1709/3468] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:39 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1276 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:39.271326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a8ee77a8-cff1-41bd-a321-0b3bfba8b7bf tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:39.272323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a8ee77a8-cff1-41bd-a321-0b3bfba8b7bf tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:39.280785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8ee77a8-cff1-41bd-a321-0b3bfba8b7bf tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:39.281892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8ee77a8-cff1-41bd-a321-0b3bfba8b7bf tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:39.282495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8ee77a8-cff1-41bd-a321-0b3bfba8b7bf tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:39.283530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8ee77a8-cff1-41bd-a321-0b3bfba8b7bf tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:39.284192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8ee77a8-cff1-41bd-a321-0b3bfba8b7bf tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:39.284917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8ee77a8-cff1-41bd-a321-0b3bfba8b7bf tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:39.453585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bcda39a0-0c27-4a9b-89ec-9366539f9abf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:39.467359 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bcda39a0-0c27-4a9b-89ec-9366539f9abf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.447119 Aug 27 04:46:39.477076 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1760/3469] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:39 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:39.497975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-909ad4a3-4174-4dc7-aed3-373ef100e227 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:39.499963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-909ad4a3-4174-4dc7-aed3-373ef100e227 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:39.531759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-909ad4a3-4174-4dc7-aed3-373ef100e227 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:39.532285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-909ad4a3-4174-4dc7-aed3-373ef100e227 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:39.532746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-909ad4a3-4174-4dc7-aed3-373ef100e227 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:39.533600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-909ad4a3-4174-4dc7-aed3-373ef100e227 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:39.534561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-909ad4a3-4174-4dc7-aed3-373ef100e227 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:39.535114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-909ad4a3-4174-4dc7-aed3-373ef100e227 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:39.597530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a8ee77a8-cff1-41bd-a321-0b3bfba8b7bf tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:39.609876 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a8ee77a8-cff1-41bd-a321-0b3bfba8b7bf tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1315 microversion: 2.1 time: 0.347072 Aug 27 04:46:39.610870 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1710/3470] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:39 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:39.630531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-909ad4a3-4174-4dc7-aed3-373ef100e227 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:39.653113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-909ad4a3-4174-4dc7-aed3-373ef100e227 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:39.655065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-909ad4a3-4174-4dc7-aed3-373ef100e227 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:39.661656 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-909ad4a3-4174-4dc7-aed3-373ef100e227 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.176779 Aug 27 04:46:39.662576 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1761/3471] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:39 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:40.288919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-be4f2def-3d58-44c8-b518-04fb920eba24 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:40.290707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-be4f2def-3d58-44c8-b518-04fb920eba24 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:40.308004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be4f2def-3d58-44c8-b518-04fb920eba24 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:40.310181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be4f2def-3d58-44c8-b518-04fb920eba24 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:40.310636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be4f2def-3d58-44c8-b518-04fb920eba24 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:40.314051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be4f2def-3d58-44c8-b518-04fb920eba24 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:40.315343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be4f2def-3d58-44c8-b518-04fb920eba24 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:40.318101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be4f2def-3d58-44c8-b518-04fb920eba24 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:40.354042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:40.447067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-be4f2def-3d58-44c8-b518-04fb920eba24 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:40.459284 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-be4f2def-3d58-44c8-b518-04fb920eba24 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1282 microversion: 2.1 time: 0.174410 Aug 27 04:46:40.459909 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1711/3472] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:40 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1282 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:40.494863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95d752c7-aa17-4ccb-90c6-53561ed8d1e7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:40.497065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95d752c7-aa17-4ccb-90c6-53561ed8d1e7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:40.506646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95d752c7-aa17-4ccb-90c6-53561ed8d1e7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:40.507527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95d752c7-aa17-4ccb-90c6-53561ed8d1e7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:40.508223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95d752c7-aa17-4ccb-90c6-53561ed8d1e7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:40.509244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95d752c7-aa17-4ccb-90c6-53561ed8d1e7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:40.510065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95d752c7-aa17-4ccb-90c6-53561ed8d1e7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:40.510714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95d752c7-aa17-4ccb-90c6-53561ed8d1e7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:40.635683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0967797-3762-4709-80a1-2b2a53cb843f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:40.636937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c0967797-3762-4709-80a1-2b2a53cb843f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:40.649870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0967797-3762-4709-80a1-2b2a53cb843f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:40.651499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0967797-3762-4709-80a1-2b2a53cb843f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:40.652860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0967797-3762-4709-80a1-2b2a53cb843f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:40.655761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0967797-3762-4709-80a1-2b2a53cb843f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:40.656384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0967797-3762-4709-80a1-2b2a53cb843f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:40.656945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0967797-3762-4709-80a1-2b2a53cb843f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:40.786422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95d752c7-aa17-4ccb-90c6-53561ed8d1e7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:40.801573 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95d752c7-aa17-4ccb-90c6-53561ed8d1e7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.313244 Aug 27 04:46:40.802181 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1762/3473] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:40 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:40.806756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0dfaf783-f4ec-4c05-9746-d641b5d7d42c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:40.807370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0dfaf783-f4ec-4c05-9746-d641b5d7d42c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:40.828296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0dfaf783-f4ec-4c05-9746-d641b5d7d42c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:40.831953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0dfaf783-f4ec-4c05-9746-d641b5d7d42c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:40.832698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0dfaf783-f4ec-4c05-9746-d641b5d7d42c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:40.834637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0dfaf783-f4ec-4c05-9746-d641b5d7d42c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:40.835490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0dfaf783-f4ec-4c05-9746-d641b5d7d42c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:40.836235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0dfaf783-f4ec-4c05-9746-d641b5d7d42c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:40.932400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0dfaf783-f4ec-4c05-9746-d641b5d7d42c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:40.944012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0dfaf783-f4ec-4c05-9746-d641b5d7d42c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:40.946323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0dfaf783-f4ec-4c05-9746-d641b5d7d42c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:40.948180 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0dfaf783-f4ec-4c05-9746-d641b5d7d42c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.145054 Aug 27 04:46:40.953637 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1763/3474] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:40 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:41.248382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c0967797-3762-4709-80a1-2b2a53cb843f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:41.262397 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c0967797-3762-4709-80a1-2b2a53cb843f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1315 microversion: 2.1 time: 0.627296 Aug 27 04:46:41.264509 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1712/3475] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:40 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:41.483320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e36e4cb-761f-4675-94cc-0b3269eb788b tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:41.484459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e36e4cb-761f-4675-94cc-0b3269eb788b tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:41.494962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e36e4cb-761f-4675-94cc-0b3269eb788b tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:41.496511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e36e4cb-761f-4675-94cc-0b3269eb788b tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:41.497265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e36e4cb-761f-4675-94cc-0b3269eb788b tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:41.498336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e36e4cb-761f-4675-94cc-0b3269eb788b tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:41.499009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e36e4cb-761f-4675-94cc-0b3269eb788b tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:41.499627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e36e4cb-761f-4675-94cc-0b3269eb788b tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:41.724547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e36e4cb-761f-4675-94cc-0b3269eb788b tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:41.736140 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e36e4cb-761f-4675-94cc-0b3269eb788b tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1324 microversion: 2.1 time: 0.258525 Aug 27 04:46:41.736854 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1764/3476] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:41 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1324 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:41.823811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e07547c0-ae50-4489-9ccf-30ac5b1b50a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:41.825087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e07547c0-ae50-4489-9ccf-30ac5b1b50a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:41.832818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07547c0-ae50-4489-9ccf-30ac5b1b50a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:41.833511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07547c0-ae50-4489-9ccf-30ac5b1b50a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:41.834115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07547c0-ae50-4489-9ccf-30ac5b1b50a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:41.835019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07547c0-ae50-4489-9ccf-30ac5b1b50a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:41.835650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07547c0-ae50-4489-9ccf-30ac5b1b50a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:41.836326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e07547c0-ae50-4489-9ccf-30ac5b1b50a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:41.981390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-acba9a98-4069-4be2-92d1-dc70cabac5ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:41.982317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-acba9a98-4069-4be2-92d1-dc70cabac5ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:41.989826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acba9a98-4069-4be2-92d1-dc70cabac5ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:41.990498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acba9a98-4069-4be2-92d1-dc70cabac5ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:41.991002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acba9a98-4069-4be2-92d1-dc70cabac5ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:41.991820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acba9a98-4069-4be2-92d1-dc70cabac5ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:41.992351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acba9a98-4069-4be2-92d1-dc70cabac5ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:41.992816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acba9a98-4069-4be2-92d1-dc70cabac5ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:42.064425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-acba9a98-4069-4be2-92d1-dc70cabac5ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:42.073677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-acba9a98-4069-4be2-92d1-dc70cabac5ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:42.075066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-acba9a98-4069-4be2-92d1-dc70cabac5ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:42.076263 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-acba9a98-4069-4be2-92d1-dc70cabac5ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.099383 Aug 27 04:46:42.076983 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1765/3477] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:41 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:46:42.166561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e07547c0-ae50-4489-9ccf-30ac5b1b50a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:42.175062 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e07547c0-ae50-4489-9ccf-30ac5b1b50a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.355576 Aug 27 04:46:42.175653 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1713/3478] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:41 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:42.291404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-adffd6fd-d8ef-4978-b0bf-2f2ceaa82d2d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:42.292026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-adffd6fd-d8ef-4978-b0bf-2f2ceaa82d2d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:42.303827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adffd6fd-d8ef-4978-b0bf-2f2ceaa82d2d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:42.304360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adffd6fd-d8ef-4978-b0bf-2f2ceaa82d2d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:42.304840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adffd6fd-d8ef-4978-b0bf-2f2ceaa82d2d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:42.305752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adffd6fd-d8ef-4978-b0bf-2f2ceaa82d2d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:42.306267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adffd6fd-d8ef-4978-b0bf-2f2ceaa82d2d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:42.306839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adffd6fd-d8ef-4978-b0bf-2f2ceaa82d2d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:42.601461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ef5ebf48-1b0f-4b8c-a835-a916058e0c92 req-bb441f2e-dcf6-4b97-8a4b-5203c3610245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b295d015-572a-44a3-b59d-6a02ced0555b", "tag": "f1c65e51-962e-4c47-9e80-c968e7be5e7b"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:42.643808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ef5ebf48-1b0f-4b8c-a835-a916058e0c92 req-bb441f2e-dcf6-4b97-8a4b-5203c3610245 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:42.645080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ef5ebf48-1b0f-4b8c-a835-a916058e0c92 req-bb441f2e-dcf6-4b97-8a4b-5203c3610245 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:42.645621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ef5ebf48-1b0f-4b8c-a835-a916058e0c92 req-bb441f2e-dcf6-4b97-8a4b-5203c3610245 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:42.659388 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ef5ebf48-1b0f-4b8c-a835-a916058e0c92 req-bb441f2e-dcf6-4b97-8a4b-5203c3610245 service nova] Creating event network-changed:f1c65e51-962e-4c47-9e80-c968e7be5e7b for instance b295d015-572a-44a3-b59d-6a02ced0555b on n-h2-854823-1 Aug 27 04:46:42.666578 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ef5ebf48-1b0f-4b8c-a835-a916058e0c92 req-bb441f2e-dcf6-4b97-8a4b-5203c3610245 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075216 Aug 27 04:46:42.667796 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1714/3479] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:42.744502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-adffd6fd-d8ef-4978-b0bf-2f2ceaa82d2d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:42.765396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4715f381-cf26-4cdd-bbaf-84787fdd18e4 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:42.766432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4715f381-cf26-4cdd-bbaf-84787fdd18e4 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:42.771632 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-adffd6fd-d8ef-4978-b0bf-2f2ceaa82d2d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1503 microversion: 2.1 time: 0.480507 Aug 27 04:46:42.780308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4715f381-cf26-4cdd-bbaf-84787fdd18e4 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:42.781374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4715f381-cf26-4cdd-bbaf-84787fdd18e4 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:42.782325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4715f381-cf26-4cdd-bbaf-84787fdd18e4 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:42.784507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4715f381-cf26-4cdd-bbaf-84787fdd18e4 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:42.786152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4715f381-cf26-4cdd-bbaf-84787fdd18e4 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:42.787549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4715f381-cf26-4cdd-bbaf-84787fdd18e4 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:42.788231 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1766/3480] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:42 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1503 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:42.804915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34a76367-5b00-4925-908a-efaafec0da09 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:42.805421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34a76367-5b00-4925-908a-efaafec0da09 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:42.812237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a76367-5b00-4925-908a-efaafec0da09 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:42.812753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a76367-5b00-4925-908a-efaafec0da09 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:42.813194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a76367-5b00-4925-908a-efaafec0da09 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:42.813968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a76367-5b00-4925-908a-efaafec0da09 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:42.814522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a76367-5b00-4925-908a-efaafec0da09 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:42.814935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a76367-5b00-4925-908a-efaafec0da09 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:42.847815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34a76367-5b00-4925-908a-efaafec0da09 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:46:42.948996 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34a76367-5b00-4925-908a-efaafec0da09 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 204 len: 0 microversion: 2.1 time: 0.157365 Aug 27 04:46:42.950583 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1767/3481] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:46:42 2022] DELETE /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:46:42.960440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3959ec42-c0ae-43f7-bfb1-7b99fef263f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:42.961182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3959ec42-c0ae-43f7-bfb1-7b99fef263f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:42.969272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3959ec42-c0ae-43f7-bfb1-7b99fef263f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:42.970297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3959ec42-c0ae-43f7-bfb1-7b99fef263f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:42.972416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3959ec42-c0ae-43f7-bfb1-7b99fef263f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:42.973239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3959ec42-c0ae-43f7-bfb1-7b99fef263f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:42.973796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3959ec42-c0ae-43f7-bfb1-7b99fef263f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:42.974319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3959ec42-c0ae-43f7-bfb1-7b99fef263f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:43.030193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4715f381-cf26-4cdd-bbaf-84787fdd18e4 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:43.041640 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4715f381-cf26-4cdd-bbaf-84787fdd18e4 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1324 microversion: 2.1 time: 0.286324 Aug 27 04:46:43.043178 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1715/3482] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:42 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1324 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:43.102768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-65dac306-1f54-41f8-ac64-20ee52f14597 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:43.103305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-65dac306-1f54-41f8-ac64-20ee52f14597 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:43.110148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65dac306-1f54-41f8-ac64-20ee52f14597 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:43.110911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65dac306-1f54-41f8-ac64-20ee52f14597 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:43.111666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65dac306-1f54-41f8-ac64-20ee52f14597 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:43.113136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65dac306-1f54-41f8-ac64-20ee52f14597 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:43.113783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65dac306-1f54-41f8-ac64-20ee52f14597 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:43.114398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65dac306-1f54-41f8-ac64-20ee52f14597 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:43.158339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3959ec42-c0ae-43f7-bfb1-7b99fef263f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:43.166461 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3959ec42-c0ae-43f7-bfb1-7b99fef263f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1509 microversion: 2.1 time: 0.210952 Aug 27 04:46:43.167243 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1768/3483] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:42 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:43.197054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aebf6a15-c34d-408e-bf28-2b1d70967bb8 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:43.197726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aebf6a15-c34d-408e-bf28-2b1d70967bb8 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:43.205131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aebf6a15-c34d-408e-bf28-2b1d70967bb8 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:43.206399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aebf6a15-c34d-408e-bf28-2b1d70967bb8 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:43.207018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aebf6a15-c34d-408e-bf28-2b1d70967bb8 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:43.207752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aebf6a15-c34d-408e-bf28-2b1d70967bb8 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:43.208553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aebf6a15-c34d-408e-bf28-2b1d70967bb8 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:43.208989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aebf6a15-c34d-408e-bf28-2b1d70967bb8 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:43.241132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-65dac306-1f54-41f8-ac64-20ee52f14597 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:43.250097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-65dac306-1f54-41f8-ac64-20ee52f14597 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:43.251724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-65dac306-1f54-41f8-ac64-20ee52f14597 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:43.253869 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-65dac306-1f54-41f8-ac64-20ee52f14597 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.155213 Aug 27 04:46:43.270660 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1716/3484] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:43 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:43.390242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aebf6a15-c34d-408e-bf28-2b1d70967bb8 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:43.398036 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aebf6a15-c34d-408e-bf28-2b1d70967bb8 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.205546 Aug 27 04:46:43.398624 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1769/3485] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:43 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:44.066677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-560df411-c64f-44e9-adf2-a2ffc359ef95 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:44.067308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-560df411-c64f-44e9-adf2-a2ffc359ef95 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:44.075251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-560df411-c64f-44e9-adf2-a2ffc359ef95 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:44.075757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-560df411-c64f-44e9-adf2-a2ffc359ef95 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:44.076194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-560df411-c64f-44e9-adf2-a2ffc359ef95 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:44.076946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-560df411-c64f-44e9-adf2-a2ffc359ef95 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:44.077410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-560df411-c64f-44e9-adf2-a2ffc359ef95 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:44.077816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-560df411-c64f-44e9-adf2-a2ffc359ef95 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:44.188594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-404cf7e3-7a91-4fdc-b6ee-bddabf36fd28 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:44.190623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-404cf7e3-7a91-4fdc-b6ee-bddabf36fd28 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:44.200083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-404cf7e3-7a91-4fdc-b6ee-bddabf36fd28 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:44.200083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-404cf7e3-7a91-4fdc-b6ee-bddabf36fd28 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:44.200583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-404cf7e3-7a91-4fdc-b6ee-bddabf36fd28 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:44.201921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-404cf7e3-7a91-4fdc-b6ee-bddabf36fd28 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:44.202492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-404cf7e3-7a91-4fdc-b6ee-bddabf36fd28 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:44.203039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-404cf7e3-7a91-4fdc-b6ee-bddabf36fd28 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:44.268824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-560df411-c64f-44e9-adf2-a2ffc359ef95 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:44.278786 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-560df411-c64f-44e9-adf2-a2ffc359ef95 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1324 microversion: 2.1 time: 0.216564 Aug 27 04:46:44.279463 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1717/3486] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:44 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1324 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:44.284549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-66a01170-3a40-4a39-ad5c-37a9976cfbdc tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:44.285365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-66a01170-3a40-4a39-ad5c-37a9976cfbdc tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:44.293299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66a01170-3a40-4a39-ad5c-37a9976cfbdc tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:44.294189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66a01170-3a40-4a39-ad5c-37a9976cfbdc tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:44.295039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66a01170-3a40-4a39-ad5c-37a9976cfbdc tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:44.296025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66a01170-3a40-4a39-ad5c-37a9976cfbdc tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:44.296807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66a01170-3a40-4a39-ad5c-37a9976cfbdc tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:44.297370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66a01170-3a40-4a39-ad5c-37a9976cfbdc tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:44.484863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-404cf7e3-7a91-4fdc-b6ee-bddabf36fd28 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:44.506692 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-404cf7e3-7a91-4fdc-b6ee-bddabf36fd28 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1509 microversion: 2.1 time: 0.323069 Aug 27 04:46:44.520155 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1770/3487] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:44 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1509 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:44.537452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e57b9e21-88a7-4a1c-bf40-851d0997af62 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:44.538494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e57b9e21-88a7-4a1c-bf40-851d0997af62 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:44.549049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57b9e21-88a7-4a1c-bf40-851d0997af62 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:44.550051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57b9e21-88a7-4a1c-bf40-851d0997af62 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:44.550978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57b9e21-88a7-4a1c-bf40-851d0997af62 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:44.552046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57b9e21-88a7-4a1c-bf40-851d0997af62 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:44.552708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57b9e21-88a7-4a1c-bf40-851d0997af62 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:44.553295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57b9e21-88a7-4a1c-bf40-851d0997af62 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:44.718001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-66a01170-3a40-4a39-ad5c-37a9976cfbdc tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:44.729962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-66a01170-3a40-4a39-ad5c-37a9976cfbdc tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:44.733869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-66a01170-3a40-4a39-ad5c-37a9976cfbdc tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:44.738323 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-66a01170-3a40-4a39-ad5c-37a9976cfbdc tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.457578 Aug 27 04:46:44.739436 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1718/3488] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:44 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:44.880161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e57b9e21-88a7-4a1c-bf40-851d0997af62 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:44.884944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:44.891076 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e57b9e21-88a7-4a1c-bf40-851d0997af62 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.368952 Aug 27 04:46:44.892060 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1771/3489] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:44 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:45.303285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a47b2153-639e-4453-8551-b4396d45951a tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:45.303993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a47b2153-639e-4453-8551-b4396d45951a tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:45.324795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a47b2153-639e-4453-8551-b4396d45951a tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:45.325639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a47b2153-639e-4453-8551-b4396d45951a tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:45.327858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a47b2153-639e-4453-8551-b4396d45951a tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:45.328857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a47b2153-639e-4453-8551-b4396d45951a tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:45.329238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c19ec1b7-2099-4ccc-8e3d-51d35f24d7ec req-0d2cc858-61f2-42cc-9079-23bdc07e8929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b095396e-83b3-4733-af37-4cab3655b64e", "name": "network-vif-deleted", "tag": "8419740d-2cdd-4f2d-9e9a-6c61385ab032"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:45.332679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a47b2153-639e-4453-8551-b4396d45951a tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:45.339796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a47b2153-639e-4453-8551-b4396d45951a tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:45.363085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c19ec1b7-2099-4ccc-8e3d-51d35f24d7ec req-0d2cc858-61f2-42cc-9079-23bdc07e8929 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:45.367216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c19ec1b7-2099-4ccc-8e3d-51d35f24d7ec req-0d2cc858-61f2-42cc-9079-23bdc07e8929 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:45.387292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c19ec1b7-2099-4ccc-8e3d-51d35f24d7ec req-0d2cc858-61f2-42cc-9079-23bdc07e8929 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:45.434038 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c19ec1b7-2099-4ccc-8e3d-51d35f24d7ec req-0d2cc858-61f2-42cc-9079-23bdc07e8929 service nova] Creating event network-vif-deleted:8419740d-2cdd-4f2d-9e9a-6c61385ab032 for instance b095396e-83b3-4733-af37-4cab3655b64e on n-h1-854823-1 Aug 27 04:46:45.449809 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c19ec1b7-2099-4ccc-8e3d-51d35f24d7ec req-0d2cc858-61f2-42cc-9079-23bdc07e8929 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131597 Aug 27 04:46:45.457535 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1772/3490] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:45.550572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e5e4611-9728-48d7-ad8b-a142172e398d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:45.551060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a47b2153-639e-4453-8551-b4396d45951a tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:45.552571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e5e4611-9728-48d7-ad8b-a142172e398d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:45.562442 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a47b2153-639e-4453-8551-b4396d45951a tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1324 microversion: 2.1 time: 0.264030 Aug 27 04:46:45.563593 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1719/3491] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:45 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1324 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:45.566922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5e4611-9728-48d7-ad8b-a142172e398d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:45.568035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5e4611-9728-48d7-ad8b-a142172e398d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:45.570817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5e4611-9728-48d7-ad8b-a142172e398d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:45.571742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5e4611-9728-48d7-ad8b-a142172e398d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:45.573156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5e4611-9728-48d7-ad8b-a142172e398d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:45.574664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5e4611-9728-48d7-ad8b-a142172e398d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:45.623462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5e4611-9728-48d7-ad8b-a142172e398d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:45.624090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5e4611-9728-48d7-ad8b-a142172e398d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:45.624747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5e4611-9728-48d7-ad8b-a142172e398d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:45.625287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-7e5e4611-9728-48d7-ad8b-a142172e398d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lazy-loading 'fault' on Instance uuid b095396e-83b3-4733-af37-4cab3655b64e {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:46:45.683645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7e5e4611-9728-48d7-ad8b-a142172e398d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469c5851c3154ad9b2924b0d5ceb3fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595098604fa6447c9408fefd4fb38b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:45.694524 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e5e4611-9728-48d7-ad8b-a142172e398d tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 200 len: 1305 microversion: 2.1 time: 0.157682 Aug 27 04:46:45.704719 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1773/3492] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:45 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 1305 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:45.765865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-92a956b7-8278-447f-83f7-db168841b766 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:45.766499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-92a956b7-8278-447f-83f7-db168841b766 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:45.776351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92a956b7-8278-447f-83f7-db168841b766 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:45.777100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92a956b7-8278-447f-83f7-db168841b766 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:45.777676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92a956b7-8278-447f-83f7-db168841b766 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:45.778450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92a956b7-8278-447f-83f7-db168841b766 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:45.778913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92a956b7-8278-447f-83f7-db168841b766 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:45.779337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92a956b7-8278-447f-83f7-db168841b766 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:45.855611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-92a956b7-8278-447f-83f7-db168841b766 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:45.864918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-92a956b7-8278-447f-83f7-db168841b766 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:45.866372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-92a956b7-8278-447f-83f7-db168841b766 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:45.867568 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-92a956b7-8278-447f-83f7-db168841b766 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.105854 Aug 27 04:46:45.868150 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1720/3493] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:45 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:46:45.914633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e7c8dba-6ea6-490e-bfe3-989c1ca46e8b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:45.916030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e7c8dba-6ea6-490e-bfe3-989c1ca46e8b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:45.922938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e7c8dba-6ea6-490e-bfe3-989c1ca46e8b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:45.924691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e7c8dba-6ea6-490e-bfe3-989c1ca46e8b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:45.925968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e7c8dba-6ea6-490e-bfe3-989c1ca46e8b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:45.927047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e7c8dba-6ea6-490e-bfe3-989c1ca46e8b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:45.928025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e7c8dba-6ea6-490e-bfe3-989c1ca46e8b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:45.928734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e7c8dba-6ea6-490e-bfe3-989c1ca46e8b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:46.152901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2e7c8dba-6ea6-490e-bfe3-989c1ca46e8b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:46.165371 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e7c8dba-6ea6-490e-bfe3-989c1ca46e8b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.253006 Aug 27 04:46:46.169021 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1774/3494] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:45 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:46.588390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-62b353d0-3a89-46b0-a2f1-b1162eec92df tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:46.590247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-62b353d0-3a89-46b0-a2f1-b1162eec92df tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:46.597299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62b353d0-3a89-46b0-a2f1-b1162eec92df tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:46.598350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62b353d0-3a89-46b0-a2f1-b1162eec92df tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:46.598914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62b353d0-3a89-46b0-a2f1-b1162eec92df tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:46.599866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62b353d0-3a89-46b0-a2f1-b1162eec92df tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:46.600438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62b353d0-3a89-46b0-a2f1-b1162eec92df tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:46.601131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62b353d0-3a89-46b0-a2f1-b1162eec92df tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:46.717254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-349abdc1-d721-41f8-8922-8d2f09c4f227 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:46.718666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-349abdc1-d721-41f8-8922-8d2f09c4f227 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:46.733936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-349abdc1-d721-41f8-8922-8d2f09c4f227 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:46.734659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-349abdc1-d721-41f8-8922-8d2f09c4f227 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:46.735199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-349abdc1-d721-41f8-8922-8d2f09c4f227 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:46.738565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-349abdc1-d721-41f8-8922-8d2f09c4f227 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:46.739074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-349abdc1-d721-41f8-8922-8d2f09c4f227 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:46.739517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-349abdc1-d721-41f8-8922-8d2f09c4f227 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:46.759366 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-349abdc1-d721-41f8-8922-8d2f09c4f227 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] HTTP exception thrown: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-349abdc1-d721-41f8-8922-8d2f09c4f227 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Request method failure captured: Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e HTTP/1.1 Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaGeNRjLWYrzbooLy1h_MtIGByYfyGipgCOc-2PO0ifrBaN8gls0K60OHGmpepTRSADCTg8uZhK8oj2c8-f8dAj6GIwnCtGpSSeRiLq9wF55X7ENZBrPDBlWMZ98FX3efyzSU7cgoBW3XMfF39-4OZD0jTQcGDBotyV7aKfXbei1kJk Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 595098604fa6447c9408fefd4fb38b96 Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_595098604fa6447c9408fefd4fb38b96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 595098604fa6447c9408fefd4fb38b96 Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesNegativeTestJSON-1838426420-project Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 469c5851c3154ad9b2924b0d5ceb3fd7 Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesNegativeTestJSON-1838426420-project Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'b095396e-83b3-4733-af37-4cab3655b64e'} Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:46.761106 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.767052 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.767052 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:46.767052 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:46.767052 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:46:46.767052 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:46:46.767052 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.767052 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.767052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-349abdc1-d721-41f8-8922-8d2f09c4f227 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Returning 404 to user: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:46.767052 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-349abdc1-d721-41f8-8922-8d2f09c4f227 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 404 len: 111 microversion: 2.1 time: 0.050982 Aug 27 04:46:46.767052 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1775/3495] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:46 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:46:46.772728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a114957-9ce3-463a-bab4-cd386c075ef4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1820774615", "metadata": {"image_type": "test"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:46.775372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a114957-9ce3-463a-bab4-cd386c075ef4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:46.781739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a114957-9ce3-463a-bab4-cd386c075ef4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:46.782368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a114957-9ce3-463a-bab4-cd386c075ef4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:46.782920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a114957-9ce3-463a-bab4-cd386c075ef4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:46.784275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a114957-9ce3-463a-bab4-cd386c075ef4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:46.784873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a114957-9ce3-463a-bab4-cd386c075ef4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:46.785401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a114957-9ce3-463a-bab4-cd386c075ef4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:46.811537 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3a114957-9ce3-463a-bab4-cd386c075ef4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] HTTP exception thrown: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a114957-9ce3-463a-bab4-cd386c075ef4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Request method failure captured: Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e/action HTTP/1.1 Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 112 Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaGeNRjLWYrzbooLy1h_MtIGByYfyGipgCOc-2PO0ifrBaN8gls0K60OHGmpepTRSADCTg8uZhK8oj2c8-f8dAj6GIwnCtGpSSeRiLq9wF55X7ENZBrPDBlWMZ98FX3efyzSU7cgoBW3XMfF39-4OZD0jTQcGDBotyV7aKfXbei1kJk Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 595098604fa6447c9408fefd4fb38b96 Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_595098604fa6447c9408fefd4fb38b96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 595098604fa6447c9408fefd4fb38b96 Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesNegativeTestJSON-1838426420-project Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 469c5851c3154ad9b2924b0d5ceb3fd7 Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesNegativeTestJSON-1838426420-project Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1820774615", "metadata": {"image_type": "test"}}} Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'b095396e-83b3-4733-af37-4cab3655b64e', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1820774615', 'metadata': {'image_type': 'test'}}}} Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 04:46:46.816486 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.820922 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.822035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-62b353d0-3a89-46b0-a2f1-b1162eec92df tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:46.823214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a114957-9ce3-463a-bab4-cd386c075ef4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Returning 404 to user: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:46.824422 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a114957-9ce3-463a-bab4-cd386c075ef4 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "POST /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e/action" status: 404 len: 111 microversion: 2.1 time: 0.055896 Aug 27 04:46:46.825354 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1776/3496] 10.222.0.79 () {60 vars in 1279 bytes} [Sat Aug 27 04:46:46 2022] POST /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:46.835688 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-62b353d0-3a89-46b0-a2f1-b1162eec92df tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1324 microversion: 2.1 time: 0.254855 Aug 27 04:46:46.836618 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1721/3497] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:46 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:46.837706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1415b158-befb-4703-bd65-28ce9960303f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-937839421", "metadata": {"image_type": "test"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:46.840391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1415b158-befb-4703-bd65-28ce9960303f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Failed to fetch instance by id tempest-invalid-964590211 {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 04:46:46.840940 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1415b158-befb-4703-bd65-28ce9960303f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] HTTP exception thrown: Instance tempest-invalid-964590211 could not be found. Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1415b158-befb-4703-bd65-28ce9960303f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Request method failure captured: Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/tempest-invalid-964590211/action HTTP/1.1 Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 111 Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaGeNRjLWYrzbooLy1h_MtIGByYfyGipgCOc-2PO0ifrBaN8gls0K60OHGmpepTRSADCTg8uZhK8oj2c8-f8dAj6GIwnCtGpSSeRiLq9wF55X7ENZBrPDBlWMZ98FX3efyzSU7cgoBW3XMfF39-4OZD0jTQcGDBotyV7aKfXbei1kJk Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 595098604fa6447c9408fefd4fb38b96 Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_595098604fa6447c9408fefd4fb38b96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 595098604fa6447c9408fefd4fb38b96 Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesNegativeTestJSON-1838426420-project Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 469c5851c3154ad9b2924b0d5ceb3fd7 Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesNegativeTestJSON-1838426420-project Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-937839421", "metadata": {"image_type": "test"}}} Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance tempest-invalid-964590211 could not be found. Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'tempest-invalid-964590211', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-937839421', 'metadata': {'image_type': 'test'}}}} Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-964590211 could not be found. Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:46:46.842621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-964590211 could not be found. Aug 27 04:46:46.853280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.853280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:46.853280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.853280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.853280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:46.853280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:46.853280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:46:46.853280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:46:46.853280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-964590211 could not be found. Aug 27 04:46:46.853280 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.853280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1415b158-befb-4703-bd65-28ce9960303f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Returning 404 to user: Instance tempest-invalid-964590211 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:46.853280 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1415b158-befb-4703-bd65-28ce9960303f tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "POST /compute/v2.1/servers/tempest-invalid-964590211/action" status: 404 len: 100 microversion: 2.1 time: 0.011199 Aug 27 04:46:46.853280 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1777/3498] 10.222.0.79 () {60 vars in 1246 bytes} [Sat Aug 27 04:46:46 2022] POST /compute/v2.1/servers/tempest-invalid-964590211/action => generated 100 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:46.860105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-58628cc2-6e03-4589-8e0f-838ef35f32f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2128752376"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:46.863522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-58628cc2-6e03-4589-8e0f-838ef35f32f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 04:46:46.864138 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-58628cc2-6e03-4589-8e0f-838ef35f32f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-58628cc2-6e03-4589-8e0f-838ef35f32f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Request method failure captured: Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 57 Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaGeNRjLWYrzbooLy1h_MtIGByYfyGipgCOc-2PO0ifrBaN8gls0K60OHGmpepTRSADCTg8uZhK8oj2c8-f8dAj6GIwnCtGpSSeRiLq9wF55X7ENZBrPDBlWMZ98FX3efyzSU7cgoBW3XMfF39-4OZD0jTQcGDBotyV7aKfXbei1kJk Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 595098604fa6447c9408fefd4fb38b96 Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_595098604fa6447c9408fefd4fb38b96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 595098604fa6447c9408fefd4fb38b96 Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ImagesNegativeTestJSON-1838426420-project Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 469c5851c3154ad9b2924b0d5ceb3fd7 Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ImagesNegativeTestJSON-1838426420-project Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: {"createImage": {"name": "tempest-test-snap-2128752376"}} Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2128752376'}}} Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 04:46:46.866157 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.871667 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:46.871667 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.871667 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.871667 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:46.871667 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:46.871667 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:46:46.871667 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:46:46.871667 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 04:46:46.871667 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.871667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-58628cc2-6e03-4589-8e0f-838ef35f32f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:46.871667 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-58628cc2-6e03-4589-8e0f-838ef35f32f5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011816 Aug 27 04:46:46.873399 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1722/3499] 10.222.0.79 () {60 vars in 1275 bytes} [Sat Aug 27 04:46:46 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:46.878583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25a05590-4ca8-4281-aa23-b8d6c51e23b5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1111117550"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:46.881149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25a05590-4ca8-4281-aa23-b8d6c51e23b5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 04:46:46.881672 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-25a05590-4ca8-4281-aa23-b8d6c51e23b5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25a05590-4ca8-4281-aa23-b8d6c51e23b5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Request method failure captured: Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 57 Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaGeNRjLWYrzbooLy1h_MtIGByYfyGipgCOc-2PO0ifrBaN8gls0K60OHGmpepTRSADCTg8uZhK8oj2c8-f8dAj6GIwnCtGpSSeRiLq9wF55X7ENZBrPDBlWMZ98FX3efyzSU7cgoBW3XMfF39-4OZD0jTQcGDBotyV7aKfXbei1kJk Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 595098604fa6447c9408fefd4fb38b96 Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_595098604fa6447c9408fefd4fb38b96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 595098604fa6447c9408fefd4fb38b96 Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesNegativeTestJSON-1838426420-project Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 469c5851c3154ad9b2924b0d5ceb3fd7 Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesNegativeTestJSON-1838426420-project Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: {"createImage": {"name": "tempest-test-snap-1111117550"}} Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1111117550'}}} Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 04:46:46.884235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.894199 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:46.894199 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.894199 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.894199 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:46.894199 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:46.894199 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:46:46.894199 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:46:46.894199 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 04:46:46.894199 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.894199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25a05590-4ca8-4281-aa23-b8d6c51e23b5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:46.894199 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25a05590-4ca8-4281-aa23-b8d6c51e23b5 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011392 Aug 27 04:46:46.894199 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1778/3500] 10.222.0.79 () {60 vars in 1281 bytes} [Sat Aug 27 04:46:46 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:46.902105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f757d8b7-893a-4f97-ad72-565f1d9f33e1 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:46.902477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f757d8b7-893a-4f97-ad72-565f1d9f33e1 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:46.910674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-efba04f6-e6b7-4a51-9ed9-a444f292a5ca tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:46.911215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f757d8b7-893a-4f97-ad72-565f1d9f33e1 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:46.911882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f757d8b7-893a-4f97-ad72-565f1d9f33e1 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:46.912245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-efba04f6-e6b7-4a51-9ed9-a444f292a5ca tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:46.912794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f757d8b7-893a-4f97-ad72-565f1d9f33e1 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:46.913704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f757d8b7-893a-4f97-ad72-565f1d9f33e1 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:46.914337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f757d8b7-893a-4f97-ad72-565f1d9f33e1 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:46.914940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f757d8b7-893a-4f97-ad72-565f1d9f33e1 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:46.935815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efba04f6-e6b7-4a51-9ed9-a444f292a5ca tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:46.936327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efba04f6-e6b7-4a51-9ed9-a444f292a5ca tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:46.936802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efba04f6-e6b7-4a51-9ed9-a444f292a5ca tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:46.937305 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f757d8b7-893a-4f97-ad72-565f1d9f33e1 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] HTTP exception thrown: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.937517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efba04f6-e6b7-4a51-9ed9-a444f292a5ca tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:46.937979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efba04f6-e6b7-4a51-9ed9-a444f292a5ca tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:46.938403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efba04f6-e6b7-4a51-9ed9-a444f292a5ca tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f757d8b7-893a-4f97-ad72-565f1d9f33e1 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Request method failure captured: Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e HTTP/1.1 Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaGeNRjLWYrzbooLy1h_MtIGByYfyGipgCOc-2PO0ifrBaN8gls0K60OHGmpepTRSADCTg8uZhK8oj2c8-f8dAj6GIwnCtGpSSeRiLq9wF55X7ENZBrPDBlWMZ98FX3efyzSU7cgoBW3XMfF39-4OZD0jTQcGDBotyV7aKfXbei1kJk Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 595098604fa6447c9408fefd4fb38b96 Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_595098604fa6447c9408fefd4fb38b96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 595098604fa6447c9408fefd4fb38b96 Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesNegativeTestJSON-1838426420-project Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 469c5851c3154ad9b2924b0d5ceb3fd7 Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesNegativeTestJSON-1838426420-project Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'b095396e-83b3-4733-af37-4cab3655b64e'} Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:46:46.940140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:46:46.944767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.944767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.944767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:46.944767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.944767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:46.944767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:46.944767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:46.944767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:46:46.944767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:46:46.944767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:46.944767 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:46.947478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f757d8b7-893a-4f97-ad72-565f1d9f33e1 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Returning 404 to user: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:46.948637 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f757d8b7-893a-4f97-ad72-565f1d9f33e1 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 404 len: 111 microversion: 2.1 time: 0.052088 Aug 27 04:46:46.949764 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1779/3501] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:46:46 2022] DELETE /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:46.960594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-180ec373-79b1-4f47-aafe-436b4269de0f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:46.970462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-180ec373-79b1-4f47-aafe-436b4269de0f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:46.972671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-180ec373-79b1-4f47-aafe-436b4269de0f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Searching by: {'deleted': False, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:46:46.979602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-180ec373-79b1-4f47-aafe-436b4269de0f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:46.980501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-180ec373-79b1-4f47-aafe-436b4269de0f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:46.981203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-180ec373-79b1-4f47-aafe-436b4269de0f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:46.982190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-180ec373-79b1-4f47-aafe-436b4269de0f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:46.983068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-180ec373-79b1-4f47-aafe-436b4269de0f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:46.983753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-180ec373-79b1-4f47-aafe-436b4269de0f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:47.024433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-180ec373-79b1-4f47-aafe-436b4269de0f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:46:47.061780 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-180ec373-79b1-4f47-aafe-436b4269de0f tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.110616 Aug 27 04:46:47.062615 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1780/3502] 10.222.0.79 () {58 vars in 1125 bytes} [Sat Aug 27 04:46:46 2022] GET /compute/v2.1/servers => generated 343 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:47.068984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-221a56cc-49c2-4634-bb94-2aa21db2b9b7 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:47.070261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-221a56cc-49c2-4634-bb94-2aa21db2b9b7 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] [instance: b095396e-83b3-4733-af37-4cab3655b64e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:47.078304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-221a56cc-49c2-4634-bb94-2aa21db2b9b7 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:47.078911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-221a56cc-49c2-4634-bb94-2aa21db2b9b7 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:47.079730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-221a56cc-49c2-4634-bb94-2aa21db2b9b7 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:47.081705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-221a56cc-49c2-4634-bb94-2aa21db2b9b7 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:47.082471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-221a56cc-49c2-4634-bb94-2aa21db2b9b7 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:47.083245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-221a56cc-49c2-4634-bb94-2aa21db2b9b7 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:47.101663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-efba04f6-e6b7-4a51-9ed9-a444f292a5ca tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:47.114629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-efba04f6-e6b7-4a51-9ed9-a444f292a5ca tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:47.118489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-efba04f6-e6b7-4a51-9ed9-a444f292a5ca tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:47.123307 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-221a56cc-49c2-4634-bb94-2aa21db2b9b7 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] HTTP exception thrown: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:47.123662 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-efba04f6-e6b7-4a51-9ed9-a444f292a5ca tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.233228 Aug 27 04:46:47.125569 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1723/3503] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:46 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-221a56cc-49c2-4634-bb94-2aa21db2b9b7 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Request method failure captured: Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e HTTP/1.1 Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaGeNRjLWYrzbooLy1h_MtIGByYfyGipgCOc-2PO0ifrBaN8gls0K60OHGmpepTRSADCTg8uZhK8oj2c8-f8dAj6GIwnCtGpSSeRiLq9wF55X7ENZBrPDBlWMZ98FX3efyzSU7cgoBW3XMfF39-4OZD0jTQcGDBotyV7aKfXbei1kJk Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 595098604fa6447c9408fefd4fb38b96 Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_595098604fa6447c9408fefd4fb38b96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/595098604fa6447c9408fefd4fb38b96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 595098604fa6447c9408fefd4fb38b96 Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1838426420 Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ImagesNegativeTestJSON-1838426420-project Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 469c5851c3154ad9b2924b0d5ceb3fd7 Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesNegativeTestJSON-1838426420-project Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'b095396e-83b3-4733-af37-4cab3655b64e'} Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:47.129276 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:47.133868 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:47.133868 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:47.133868 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:47.133868 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:46:47.133868 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:46:47.133868 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. Aug 27 04:46:47.133868 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:47.134596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-221a56cc-49c2-4634-bb94-2aa21db2b9b7 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] Returning 404 to user: Instance b095396e-83b3-4733-af37-4cab3655b64e could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:47.137779 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-221a56cc-49c2-4634-bb94-2aa21db2b9b7 tempest-ImagesNegativeTestJSON-1838426420 tempest-ImagesNegativeTestJSON-1838426420-project] 10.222.0.79 "GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e" status: 404 len: 111 microversion: 2.1 time: 0.073455 Aug 27 04:46:47.140644 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1781/3504] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:47 2022] GET /compute/v2.1/servers/b095396e-83b3-4733-af37-4cab3655b64e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:47.144799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:47.153947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:47.154865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Searching by: {'deleted': False, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:46:47.169399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:47.172633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:47.175209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:47.176247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:47.177758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:47.178602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:47.188949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a681bc1-39ad-41b6-883b-4d8112fbcbd6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:47.190785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a681bc1-39ad-41b6-883b-4d8112fbcbd6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:47.198180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a681bc1-39ad-41b6-883b-4d8112fbcbd6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:47.198712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a681bc1-39ad-41b6-883b-4d8112fbcbd6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:47.199169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a681bc1-39ad-41b6-883b-4d8112fbcbd6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:47.199882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a681bc1-39ad-41b6-883b-4d8112fbcbd6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:47.200658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a681bc1-39ad-41b6-883b-4d8112fbcbd6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:47.201584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a681bc1-39ad-41b6-883b-4d8112fbcbd6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:47.234562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:46:47.278676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:47.287745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:47.288764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:47.289439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:47.614489 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5da50c01-2694-47a3-ad4a-65c652569f1b tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.486296 Aug 27 04:46:47.625162 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1724/3505] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:46:47 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:47.643804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0b09bfc2-9603-4640-9f06-c914cab8b930 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:47.653175 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0b09bfc2-9603-4640-9f06-c914cab8b930 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015026 Aug 27 04:46:47.653763 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1725/3506] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:46:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:47.859282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc47184d-6fe7-4877-a7f9-c6c20cc83e42 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:47.860321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bc47184d-6fe7-4877-a7f9-c6c20cc83e42 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:47.870427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc47184d-6fe7-4877-a7f9-c6c20cc83e42 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:47.871281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc47184d-6fe7-4877-a7f9-c6c20cc83e42 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:47.872069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc47184d-6fe7-4877-a7f9-c6c20cc83e42 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:47.873231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc47184d-6fe7-4877-a7f9-c6c20cc83e42 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:47.874061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc47184d-6fe7-4877-a7f9-c6c20cc83e42 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:47.874538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a681bc1-39ad-41b6-883b-4d8112fbcbd6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:47.875323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc47184d-6fe7-4877-a7f9-c6c20cc83e42 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:47.888455 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a681bc1-39ad-41b6-883b-4d8112fbcbd6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.703395 Aug 27 04:46:47.892498 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1782/3507] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:47 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:48.149844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dca0295e-d4a5-4fc8-9011-b2754bd3b890 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:48.159624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dca0295e-d4a5-4fc8-9011-b2754bd3b890 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:48.162157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:48.174558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dca0295e-d4a5-4fc8-9011-b2754bd3b890 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:48.175329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dca0295e-d4a5-4fc8-9011-b2754bd3b890 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:48.175990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dca0295e-d4a5-4fc8-9011-b2754bd3b890 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:48.176755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dca0295e-d4a5-4fc8-9011-b2754bd3b890 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:48.177627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dca0295e-d4a5-4fc8-9011-b2754bd3b890 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:48.178061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dca0295e-d4a5-4fc8-9011-b2754bd3b890 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:48.201166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bc47184d-6fe7-4877-a7f9-c6c20cc83e42 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:48.217347 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bc47184d-6fe7-4877-a7f9-c6c20cc83e42 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1324 microversion: 2.1 time: 0.362603 Aug 27 04:46:48.219702 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1726/3508] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:47 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1324 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:48.238196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-80e4824c-1152-49c2-9ed4-a69a7786cab7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:48.238812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-80e4824c-1152-49c2-9ed4-a69a7786cab7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:48.248376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80e4824c-1152-49c2-9ed4-a69a7786cab7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:48.249017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80e4824c-1152-49c2-9ed4-a69a7786cab7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:48.250140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80e4824c-1152-49c2-9ed4-a69a7786cab7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:48.252082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80e4824c-1152-49c2-9ed4-a69a7786cab7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:48.253263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80e4824c-1152-49c2-9ed4-a69a7786cab7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:48.254003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80e4824c-1152-49c2-9ed4-a69a7786cab7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:48.301885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-80e4824c-1152-49c2-9ed4-a69a7786cab7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:46:48.378488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dca0295e-d4a5-4fc8-9011-b2754bd3b890 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:48.392763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dca0295e-d4a5-4fc8-9011-b2754bd3b890 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:48.396454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dca0295e-d4a5-4fc8-9011-b2754bd3b890 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:48.403935 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dca0295e-d4a5-4fc8-9011-b2754bd3b890 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1365 microversion: 2.47 time: 0.259064 Aug 27 04:46:48.409032 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1783/3509] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:48 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:46:48.475262 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-80e4824c-1152-49c2-9ed4-a69a7786cab7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "DELETE /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 204 len: 0 microversion: 2.1 time: 0.253282 Aug 27 04:46:48.489946 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1727/3510] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:46:48 2022] DELETE /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:46:48.500759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1efc482e-cb3f-4e1e-bb5f-011c9a8262d1 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:48.501463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1efc482e-cb3f-4e1e-bb5f-011c9a8262d1 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:48.511120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efc482e-cb3f-4e1e-bb5f-011c9a8262d1 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:48.512084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efc482e-cb3f-4e1e-bb5f-011c9a8262d1 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:48.513115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efc482e-cb3f-4e1e-bb5f-011c9a8262d1 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:48.520279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efc482e-cb3f-4e1e-bb5f-011c9a8262d1 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:48.521267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efc482e-cb3f-4e1e-bb5f-011c9a8262d1 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:48.522039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efc482e-cb3f-4e1e-bb5f-011c9a8262d1 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:48.824648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-96408bf7-4122-4fa2-bc91-2c20f8aef4f4 req-cfb68f0e-79af-45cd-8ff5-4362a4938803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b295d015-572a-44a3-b59d-6a02ced0555b", "name": "network-vif-plugged", "status": "completed", "tag": "f1c65e51-962e-4c47-9e80-c968e7be5e7b"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:48.835346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1efc482e-cb3f-4e1e-bb5f-011c9a8262d1 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:48.845425 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1efc482e-cb3f-4e1e-bb5f-011c9a8262d1 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1609 microversion: 2.1 time: 0.351239 Aug 27 04:46:48.847439 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1784/3511] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:48 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1609 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:48.879273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-96408bf7-4122-4fa2-bc91-2c20f8aef4f4 req-cfb68f0e-79af-45cd-8ff5-4362a4938803 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:48.879785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-96408bf7-4122-4fa2-bc91-2c20f8aef4f4 req-cfb68f0e-79af-45cd-8ff5-4362a4938803 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:48.880228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-96408bf7-4122-4fa2-bc91-2c20f8aef4f4 req-cfb68f0e-79af-45cd-8ff5-4362a4938803 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:48.913199 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-96408bf7-4122-4fa2-bc91-2c20f8aef4f4 req-cfb68f0e-79af-45cd-8ff5-4362a4938803 service nova] Creating event network-vif-plugged:f1c65e51-962e-4c47-9e80-c968e7be5e7b for instance b295d015-572a-44a3-b59d-6a02ced0555b on n-h2-854823-1 Aug 27 04:46:48.914689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7aa053b7-2457-4e34-a5da-60e740e4dfca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:48.919897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7aa053b7-2457-4e34-a5da-60e740e4dfca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:48.926809 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-96408bf7-4122-4fa2-bc91-2c20f8aef4f4 req-cfb68f0e-79af-45cd-8ff5-4362a4938803 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106403 Aug 27 04:46:48.928680 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1728/3512] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:48.940120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7aa053b7-2457-4e34-a5da-60e740e4dfca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:48.941274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7aa053b7-2457-4e34-a5da-60e740e4dfca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:48.941898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7aa053b7-2457-4e34-a5da-60e740e4dfca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:48.943188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7aa053b7-2457-4e34-a5da-60e740e4dfca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:48.943829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7aa053b7-2457-4e34-a5da-60e740e4dfca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:48.944514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7aa053b7-2457-4e34-a5da-60e740e4dfca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:49.115990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7aa053b7-2457-4e34-a5da-60e740e4dfca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:49.125903 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7aa053b7-2457-4e34-a5da-60e740e4dfca tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.216608 Aug 27 04:46:49.129604 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1785/3513] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:48 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:49.244564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8aeefd35-c3a9-4e8e-9c12-54fcbd7fb945 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:49.245561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8aeefd35-c3a9-4e8e-9c12-54fcbd7fb945 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:49.254830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aeefd35-c3a9-4e8e-9c12-54fcbd7fb945 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:49.256643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aeefd35-c3a9-4e8e-9c12-54fcbd7fb945 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:49.257393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aeefd35-c3a9-4e8e-9c12-54fcbd7fb945 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:49.258436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aeefd35-c3a9-4e8e-9c12-54fcbd7fb945 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:49.259299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aeefd35-c3a9-4e8e-9c12-54fcbd7fb945 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:49.260145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aeefd35-c3a9-4e8e-9c12-54fcbd7fb945 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:49.264131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:49.428053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cfe17fbb-7e59-494b-8c92-87d3674931a9 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:49.428722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cfe17fbb-7e59-494b-8c92-87d3674931a9 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:49.445788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfe17fbb-7e59-494b-8c92-87d3674931a9 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:49.446305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfe17fbb-7e59-494b-8c92-87d3674931a9 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:49.446773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfe17fbb-7e59-494b-8c92-87d3674931a9 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:49.447490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfe17fbb-7e59-494b-8c92-87d3674931a9 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:49.447959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfe17fbb-7e59-494b-8c92-87d3674931a9 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:49.448382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfe17fbb-7e59-494b-8c92-87d3674931a9 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:49.554298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8aeefd35-c3a9-4e8e-9c12-54fcbd7fb945 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:49.569059 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8aeefd35-c3a9-4e8e-9c12-54fcbd7fb945 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1324 microversion: 2.1 time: 0.327470 Aug 27 04:46:49.571680 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1729/3514] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:49 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1324 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:49.575212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cfe17fbb-7e59-494b-8c92-87d3674931a9 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:49.588971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cfe17fbb-7e59-494b-8c92-87d3674931a9 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:49.590639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cfe17fbb-7e59-494b-8c92-87d3674931a9 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:49.591843 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cfe17fbb-7e59-494b-8c92-87d3674931a9 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1371 microversion: 2.47 time: 0.168513 Aug 27 04:46:49.592419 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1786/3515] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:49 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:46:49.871811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b6f137dd-13f7-4bed-9f74-91e4c55655e5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:49.872717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b6f137dd-13f7-4bed-9f74-91e4c55655e5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:49.891147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6f137dd-13f7-4bed-9f74-91e4c55655e5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:49.895825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6f137dd-13f7-4bed-9f74-91e4c55655e5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:49.896276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6f137dd-13f7-4bed-9f74-91e4c55655e5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:49.897040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6f137dd-13f7-4bed-9f74-91e4c55655e5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:49.899887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6f137dd-13f7-4bed-9f74-91e4c55655e5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:49.904911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6f137dd-13f7-4bed-9f74-91e4c55655e5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:50.154385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d79ad47-8ec5-4219-bb3b-7c181a617ca0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:50.155959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1d79ad47-8ec5-4219-bb3b-7c181a617ca0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:50.165046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d79ad47-8ec5-4219-bb3b-7c181a617ca0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:50.165931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d79ad47-8ec5-4219-bb3b-7c181a617ca0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:50.166556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d79ad47-8ec5-4219-bb3b-7c181a617ca0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:50.167730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d79ad47-8ec5-4219-bb3b-7c181a617ca0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:50.168503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d79ad47-8ec5-4219-bb3b-7c181a617ca0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:50.169249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d79ad47-8ec5-4219-bb3b-7c181a617ca0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:50.194240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b6f137dd-13f7-4bed-9f74-91e4c55655e5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:50.205824 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b6f137dd-13f7-4bed-9f74-91e4c55655e5 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1609 microversion: 2.1 time: 0.339403 Aug 27 04:46:50.206762 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1730/3516] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:49 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1609 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:50.488015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1d79ad47-8ec5-4219-bb3b-7c181a617ca0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:50.501181 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d79ad47-8ec5-4219-bb3b-7c181a617ca0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.351730 Aug 27 04:46:50.503253 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1787/3517] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:50 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:50.594334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8d2c68db-8e82-429e-a5ac-90ff344c5096 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:50.594950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8d2c68db-8e82-429e-a5ac-90ff344c5096 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:50.605288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d2c68db-8e82-429e-a5ac-90ff344c5096 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:50.605959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d2c68db-8e82-429e-a5ac-90ff344c5096 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:50.606336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d2c68db-8e82-429e-a5ac-90ff344c5096 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:50.610803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d2c68db-8e82-429e-a5ac-90ff344c5096 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:50.611547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d2c68db-8e82-429e-a5ac-90ff344c5096 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:50.612086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d2c68db-8e82-429e-a5ac-90ff344c5096 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:50.615749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7184d240-a1e6-44f7-a82f-652c073ae727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:50.616364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7184d240-a1e6-44f7-a82f-652c073ae727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:50.630566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7184d240-a1e6-44f7-a82f-652c073ae727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:50.631423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7184d240-a1e6-44f7-a82f-652c073ae727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:50.632064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7184d240-a1e6-44f7-a82f-652c073ae727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:50.633525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7184d240-a1e6-44f7-a82f-652c073ae727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:50.634301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7184d240-a1e6-44f7-a82f-652c073ae727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:50.634945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7184d240-a1e6-44f7-a82f-652c073ae727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:50.881798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8d2c68db-8e82-429e-a5ac-90ff344c5096 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:50.893830 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8d2c68db-8e82-429e-a5ac-90ff344c5096 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1324 microversion: 2.1 time: 0.303487 Aug 27 04:46:50.895193 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1731/3518] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:50 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:51.089785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7184d240-a1e6-44f7-a82f-652c073ae727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:51.107335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7184d240-a1e6-44f7-a82f-652c073ae727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:51.108832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7184d240-a1e6-44f7-a82f-652c073ae727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:51.110027 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7184d240-a1e6-44f7-a82f-652c073ae727 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1371 microversion: 2.47 time: 0.498210 Aug 27 04:46:51.110799 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1788/3519] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:50 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1371 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:51.227675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8a7dc3a6-5191-46ad-b4a0-ca1958e1d2a7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:51.228723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8a7dc3a6-5191-46ad-b4a0-ca1958e1d2a7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:51.257529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a7dc3a6-5191-46ad-b4a0-ca1958e1d2a7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:51.258485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a7dc3a6-5191-46ad-b4a0-ca1958e1d2a7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:51.259818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a7dc3a6-5191-46ad-b4a0-ca1958e1d2a7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:51.261785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a7dc3a6-5191-46ad-b4a0-ca1958e1d2a7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:51.262497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a7dc3a6-5191-46ad-b4a0-ca1958e1d2a7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:51.263201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a7dc3a6-5191-46ad-b4a0-ca1958e1d2a7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:51.527670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a5dc92cb-74f0-4852-889b-4c39f5b8fc8f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:51.528290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a5dc92cb-74f0-4852-889b-4c39f5b8fc8f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:51.535633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:51.546214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dc92cb-74f0-4852-889b-4c39f5b8fc8f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:51.547277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dc92cb-74f0-4852-889b-4c39f5b8fc8f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:51.550085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dc92cb-74f0-4852-889b-4c39f5b8fc8f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:51.551018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dc92cb-74f0-4852-889b-4c39f5b8fc8f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:51.554825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dc92cb-74f0-4852-889b-4c39f5b8fc8f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:51.555651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dc92cb-74f0-4852-889b-4c39f5b8fc8f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:51.784608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8a7dc3a6-5191-46ad-b4a0-ca1958e1d2a7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:51.799547 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8a7dc3a6-5191-46ad-b4a0-ca1958e1d2a7 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1609 microversion: 2.1 time: 0.572990 Aug 27 04:46:51.801350 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1732/3520] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:51 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1609 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:51.916883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-88fae2cf-2cb8-4e6a-82a6-0ffee02b1ae2 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:51.918650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-88fae2cf-2cb8-4e6a-82a6-0ffee02b1ae2 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:51.930877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88fae2cf-2cb8-4e6a-82a6-0ffee02b1ae2 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:51.931614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88fae2cf-2cb8-4e6a-82a6-0ffee02b1ae2 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:51.932259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88fae2cf-2cb8-4e6a-82a6-0ffee02b1ae2 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:51.933321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88fae2cf-2cb8-4e6a-82a6-0ffee02b1ae2 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:51.933886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88fae2cf-2cb8-4e6a-82a6-0ffee02b1ae2 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:51.934456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88fae2cf-2cb8-4e6a-82a6-0ffee02b1ae2 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:52.396035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a5dc92cb-74f0-4852-889b-4c39f5b8fc8f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:52.404627 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a5dc92cb-74f0-4852-889b-4c39f5b8fc8f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.880899 Aug 27 04:46:52.410236 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1789/3521] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:51 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:52.421082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4117c662-37e9-40a3-8b0f-30e09f0a27ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:52.421966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4117c662-37e9-40a3-8b0f-30e09f0a27ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:52.436648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4117c662-37e9-40a3-8b0f-30e09f0a27ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:52.439906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4117c662-37e9-40a3-8b0f-30e09f0a27ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:52.442115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4117c662-37e9-40a3-8b0f-30e09f0a27ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:52.444800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4117c662-37e9-40a3-8b0f-30e09f0a27ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:52.446475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4117c662-37e9-40a3-8b0f-30e09f0a27ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:52.447098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4117c662-37e9-40a3-8b0f-30e09f0a27ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:52.453201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-88fae2cf-2cb8-4e6a-82a6-0ffee02b1ae2 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:52.464303 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-88fae2cf-2cb8-4e6a-82a6-0ffee02b1ae2 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1519 microversion: 2.1 time: 0.552172 Aug 27 04:46:52.466357 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1733/3522] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:51 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1519 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:52.730960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aae0c983-25d1-4527-8936-aecec3cb4877 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-306197717", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8466f1d1-d166-4e3a-9fcf-4d7e96907a52"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aae0c983-25d1-4527-8936-aecec3cb4877 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Request method failure captured: Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 242 Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaGs3ra6laDVHHzySuPyVQUCYQsmSNorQ6KScR3n5wRJ5XOPLluQeCwvDyyAK9uxV87lLsAbqsmjM0TyUdedOkJ1TQxKDntFOjJVX3x_yo7ezQOGnPphrVktIkszfh9oQxXtvdzdat3u6OEi7KJQD_JKveK_dsD88UTYl86fmYoqcDQ Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35161c722a2341a79e69f467f9eaec10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 117b87f36c8d4b269069f920ba7f1f12 Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-306197717", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8466f1d1-d166-4e3a-9fcf-4d7e96907a52"}]}} Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-306197717', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '8466f1d1-d166-4e3a-9fcf-4d7e96907a52'}]}}} Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:46:52.739904 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:52.744614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.749378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aae0c983-25d1-4527-8936-aecec3cb4877 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:52.750721 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aae0c983-25d1-4527-8936-aecec3cb4877 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.025197 Aug 27 04:46:52.751514 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1734/3523] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:46:52 2022] POST /compute/v2.1/servers => generated 175 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:46:52.773650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c12929c-4cee-431d-aec1-af2ae1fdbdf8 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:52.777286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8c12929c-4cee-431d-aec1-af2ae1fdbdf8 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: 5fdc79d5-8e89-4d9b-bfb8-eb63832bb154] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:52.795123 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-8c12929c-4cee-431d-aec1-af2ae1fdbdf8 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] HTTP exception thrown: Instance 5fdc79d5-8e89-4d9b-bfb8-eb63832bb154 could not be found. Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c12929c-4cee-431d-aec1-af2ae1fdbdf8 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Request method failure captured: Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/5fdc79d5-8e89-4d9b-bfb8-eb63832bb154/metadata HTTP/1.1 Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaGs3ra6laDVHHzySuPyVQUCYQsmSNorQ6KScR3n5wRJ5XOPLluQeCwvDyyAK9uxV87lLsAbqsmjM0TyUdedOkJ1TQxKDntFOjJVX3x_yo7ezQOGnPphrVktIkszfh9oQxXtvdzdat3u6OEi7KJQD_JKveK_dsD88UTYl86fmYoqcDQ Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35161c722a2341a79e69f467f9eaec10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 117b87f36c8d4b269069f920ba7f1f12 Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 5fdc79d5-8e89-4d9b-bfb8-eb63832bb154 could not be found. Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'server_id': '5fdc79d5-8e89-4d9b-bfb8-eb63832bb154'} Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fdc79d5-8e89-4d9b-bfb8-eb63832bb154 could not be found. Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fdc79d5-8e89-4d9b-bfb8-eb63832bb154 could not be found. Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:52.803938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:52.809202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:46:52.809202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:46:52.809202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fdc79d5-8e89-4d9b-bfb8-eb63832bb154 could not be found. Aug 27 04:46:52.809202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.809202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c12929c-4cee-431d-aec1-af2ae1fdbdf8 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Returning 404 to user: Instance 5fdc79d5-8e89-4d9b-bfb8-eb63832bb154 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:52.809202 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8c12929c-4cee-431d-aec1-af2ae1fdbdf8 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/5fdc79d5-8e89-4d9b-bfb8-eb63832bb154/metadata" status: 404 len: 111 microversion: 2.1 time: 0.047076 Aug 27 04:46:52.811553 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1735/3524] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:46:52 2022] GET /compute/v2.1/servers/5fdc79d5-8e89-4d9b-bfb8-eb63832bb154/metadata => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:52.843355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-262f7891-5043-45ef-af5a-92ae21fc4133 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:52.844340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-262f7891-5043-45ef-af5a-92ae21fc4133 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:52.860158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4117c662-37e9-40a3-8b0f-30e09f0a27ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:52.862899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-262f7891-5043-45ef-af5a-92ae21fc4133 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:52.864065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-262f7891-5043-45ef-af5a-92ae21fc4133 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:52.864993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-262f7891-5043-45ef-af5a-92ae21fc4133 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:52.867686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-262f7891-5043-45ef-af5a-92ae21fc4133 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:52.869070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-262f7891-5043-45ef-af5a-92ae21fc4133 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:52.870267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-262f7891-5043-45ef-af5a-92ae21fc4133 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:52.891220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4117c662-37e9-40a3-8b0f-30e09f0a27ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:52.892853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4117c662-37e9-40a3-8b0f-30e09f0a27ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:52.894084 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4117c662-37e9-40a3-8b0f-30e09f0a27ad tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1356 microversion: 2.47 time: 0.482813 Aug 27 04:46:52.906125 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1790/3525] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:52 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1356 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:52.930543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef7bad18-0d37-409b-b165-91d8f54e2cd7 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1868600390", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8466f1d1-d166-4e3a-9fcf-4d7e96907a52"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef7bad18-0d37-409b-b165-91d8f54e2cd7 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Request method failure captured: Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 499 Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaGs3ra6laDVHHzySuPyVQUCYQsmSNorQ6KScR3n5wRJ5XOPLluQeCwvDyyAK9uxV87lLsAbqsmjM0TyUdedOkJ1TQxKDntFOjJVX3x_yo7ezQOGnPphrVktIkszfh9oQxXtvdzdat3u6OEi7KJQD_JKveK_dsD88UTYl86fmYoqcDQ Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35161c722a2341a79e69f467f9eaec10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 117b87f36c8d4b269069f920ba7f1f12 Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1868600390", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8466f1d1-d166-4e3a-9fcf-4d7e96907a52"}]}} Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1868600390', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8466f1d1-d166-4e3a-9fcf-4d7e96907a52'}]}}} Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 04:46:52.946570 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef7bad18-0d37-409b-b165-91d8f54e2cd7 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef7bad18-0d37-409b-b165-91d8f54e2cd7 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.041083 Aug 27 04:46:52.951370 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1791/3526] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:46:52 2022] POST /compute/v2.1/servers => generated 687 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:46:52.962698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:52.975904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:52.987724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Searching by: {'deleted': False, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:46:53.003354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:53.004111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:53.004808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:53.008082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:53.009423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:53.011850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:53.208572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-262f7891-5043-45ef-af5a-92ae21fc4133 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:53.223342 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-262f7891-5043-45ef-af5a-92ae21fc4133 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1541 microversion: 2.1 time: 0.397409 Aug 27 04:46:53.241105 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1736/3527] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:52 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1541 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:53.250128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c504b47-dd43-4358-b0d9-4b8edb108d8a tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-918633525", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8466f1d1-d166-4e3a-9fcf-4d7e96907a52"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c504b47-dd43-4358-b0d9-4b8edb108d8a tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Request method failure captured: Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 499 Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaGs3ra6laDVHHzySuPyVQUCYQsmSNorQ6KScR3n5wRJ5XOPLluQeCwvDyyAK9uxV87lLsAbqsmjM0TyUdedOkJ1TQxKDntFOjJVX3x_yo7ezQOGnPphrVktIkszfh9oQxXtvdzdat3u6OEi7KJQD_JKveK_dsD88UTYl86fmYoqcDQ Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35161c722a2341a79e69f467f9eaec10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 117b87f36c8d4b269069f920ba7f1f12 Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-918633525", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8466f1d1-d166-4e3a-9fcf-4d7e96907a52"}]}} Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-918633525', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8466f1d1-d166-4e3a-9fcf-4d7e96907a52'}]}}} Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 04:46:53.256340 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:53.261127 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.268770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c504b47-dd43-4358-b0d9-4b8edb108d8a tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:53.269952 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1c504b47-dd43-4358-b0d9-4b8edb108d8a tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.029644 Aug 27 04:46:53.270755 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1737/3528] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:46:53 2022] POST /compute/v2.1/servers => generated 689 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:46:53.281293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:46:53.356361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c00407b1-8352-4e10-a409-825f6d50a64d tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1207772954", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8466f1d1-d166-4e3a-9fcf-4d7e96907a52"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c00407b1-8352-4e10-a409-825f6d50a64d tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Request method failure captured: Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 754 Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaGs3ra6laDVHHzySuPyVQUCYQsmSNorQ6KScR3n5wRJ5XOPLluQeCwvDyyAK9uxV87lLsAbqsmjM0TyUdedOkJ1TQxKDntFOjJVX3x_yo7ezQOGnPphrVktIkszfh9oQxXtvdzdat3u6OEi7KJQD_JKveK_dsD88UTYl86fmYoqcDQ Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35161c722a2341a79e69f467f9eaec10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 117b87f36c8d4b269069f920ba7f1f12 Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1207772954", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8466f1d1-d166-4e3a-9fcf-4d7e96907a52"}]}} Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1207772954', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8466f1d1-d166-4e3a-9fcf-4d7e96907a52'}]}}} Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:46:53.362054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:46:53.365062 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:46:53.369353 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:53.369353 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.374430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c00407b1-8352-4e10-a409-825f6d50a64d tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:53.375848 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c00407b1-8352-4e10-a409-825f6d50a64d tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.023931 Aug 27 04:46:53.383212 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1738/3529] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:46:53 2022] POST /compute/v2.1/servers => generated 1197 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 27 04:46:53.432345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-be2effbf-80be-469f-ac34-f33661d79ed0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:53.434062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-be2effbf-80be-469f-ac34-f33661d79ed0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:53.451836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be2effbf-80be-469f-ac34-f33661d79ed0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:53.454081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be2effbf-80be-469f-ac34-f33661d79ed0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:53.455411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be2effbf-80be-469f-ac34-f33661d79ed0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:53.458507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be2effbf-80be-469f-ac34-f33661d79ed0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:53.461369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be2effbf-80be-469f-ac34-f33661d79ed0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:53.468086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be2effbf-80be-469f-ac34-f33661d79ed0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:53.491328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:53.510608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:53.511194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:53.511726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:53.544090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:53.546053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:53.703532 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4edf45c2-3063-42b4-b1a1-bea6080bae41 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 2704 microversion: 2.47 time: 0.751749 Aug 27 04:46:53.704565 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1792/3530] 10.222.0.79 () {60 vars in 1187 bytes} [Sat Aug 27 04:46:52 2022] GET /compute/v2.1/servers/detail => generated 2704 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:53.711530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e30df64-1b07-4971-9e8d-b21ca635d3e2 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1905426178", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8466f1d1-d166-4e3a-9fcf-4d7e96907a52"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e30df64-1b07-4971-9e8d-b21ca635d3e2 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Request method failure captured: Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 1266 Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaGs3ra6laDVHHzySuPyVQUCYQsmSNorQ6KScR3n5wRJ5XOPLluQeCwvDyyAK9uxV87lLsAbqsmjM0TyUdedOkJ1TQxKDntFOjJVX3x_yo7ezQOGnPphrVktIkszfh9oQxXtvdzdat3u6OEi7KJQD_JKveK_dsD88UTYl86fmYoqcDQ Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35161c722a2341a79e69f467f9eaec10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 117b87f36c8d4b269069f920ba7f1f12 Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1905426178", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8466f1d1-d166-4e3a-9fcf-4d7e96907a52"}]}} Aug 27 04:46:53.724373 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1905426178', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8466f1d1-d166-4e3a-9fcf-4d7e96907a52'}]}}} Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.727422 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:46:53.728653 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:46:53.730530 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 04:46:53.730530 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:53.734948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e30df64-1b07-4971-9e8d-b21ca635d3e2 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:53.735985 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e30df64-1b07-4971-9e8d-b21ca635d3e2 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.029826 Aug 27 04:46:53.739649 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1793/3531] 10.222.0.79 () {60 vars in 1148 bytes} [Sat Aug 27 04:46:53 2022] POST /compute/v2.1/servers => generated 2221 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 27 04:46:53.756993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6537f207-6701-44e6-81bd-f434ab69deef tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:53.757526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6537f207-6701-44e6-81bd-f434ab69deef tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:53.778271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6537f207-6701-44e6-81bd-f434ab69deef tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:53.779383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6537f207-6701-44e6-81bd-f434ab69deef tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:53.779845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6537f207-6701-44e6-81bd-f434ab69deef tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:53.780651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6537f207-6701-44e6-81bd-f434ab69deef tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:53.784951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6537f207-6701-44e6-81bd-f434ab69deef tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:53.785530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6537f207-6701-44e6-81bd-f434ab69deef tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:53.837399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:53.858581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6537f207-6701-44e6-81bd-f434ab69deef tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:46:54.089532 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6537f207-6701-44e6-81bd-f434ab69deef tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 204 len: 0 microversion: 2.47 time: 0.348523 Aug 27 04:46:54.093600 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1794/3532] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:46:53 2022] DELETE /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:46:54.106907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cfc788af-291f-42f8-9dfd-a1669afcc959 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:54.107535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cfc788af-291f-42f8-9dfd-a1669afcc959 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: 2b55491b-b6bc-49b1-8dd3-df26a383f681] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:54.116155 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-cfc788af-291f-42f8-9dfd-a1669afcc959 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] HTTP exception thrown: Instance 2b55491b-b6bc-49b1-8dd3-df26a383f681 could not be found. Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cfc788af-291f-42f8-9dfd-a1669afcc959 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Request method failure captured: Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/2b55491b-b6bc-49b1-8dd3-df26a383f681/metadata/test2 HTTP/1.1 Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaGs3ra6laDVHHzySuPyVQUCYQsmSNorQ6KScR3n5wRJ5XOPLluQeCwvDyyAK9uxV87lLsAbqsmjM0TyUdedOkJ1TQxKDntFOjJVX3x_yo7ezQOGnPphrVktIkszfh9oQxXtvdzdat3u6OEi7KJQD_JKveK_dsD88UTYl86fmYoqcDQ Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35161c722a2341a79e69f467f9eaec10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 117b87f36c8d4b269069f920ba7f1f12 Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 2b55491b-b6bc-49b1-8dd3-df26a383f681 could not be found. Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'server_id': '2b55491b-b6bc-49b1-8dd3-df26a383f681', 'id': 'test2'} Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b55491b-b6bc-49b1-8dd3-df26a383f681 could not be found. Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b55491b-b6bc-49b1-8dd3-df26a383f681 could not be found. Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:54.118271 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:54.123940 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:46:54.123940 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:46:54.123940 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b55491b-b6bc-49b1-8dd3-df26a383f681 could not be found. Aug 27 04:46:54.123940 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:46:54.123940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cfc788af-291f-42f8-9dfd-a1669afcc959 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Returning 404 to user: Instance 2b55491b-b6bc-49b1-8dd3-df26a383f681 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:54.123940 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cfc788af-291f-42f8-9dfd-a1669afcc959 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/2b55491b-b6bc-49b1-8dd3-df26a383f681/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.027874 Aug 27 04:46:54.123940 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1795/3533] 10.222.0.79 () {58 vars in 1281 bytes} [Sat Aug 27 04:46:54 2022] GET /compute/v2.1/servers/2b55491b-b6bc-49b1-8dd3-df26a383f681/metadata/test2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:54.150390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ffef1c78-b428-464b-84f7-b003e68b28df req-b1211adf-e41b-49ce-9af6-f84eaea2a510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d99a78-7b02-4e10-bfb8-fd64fb224134", "name": "network-vif-deleted", "tag": "3e610e54-6fd9-4d24-93cb-18d61eaedb3e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:54.166233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ffef1c78-b428-464b-84f7-b003e68b28df req-b1211adf-e41b-49ce-9af6-f84eaea2a510 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:54.166718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ffef1c78-b428-464b-84f7-b003e68b28df req-b1211adf-e41b-49ce-9af6-f84eaea2a510 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:54.167156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ffef1c78-b428-464b-84f7-b003e68b28df req-b1211adf-e41b-49ce-9af6-f84eaea2a510 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:54.196337 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ffef1c78-b428-464b-84f7-b003e68b28df req-b1211adf-e41b-49ce-9af6-f84eaea2a510 service nova] Creating event network-vif-deleted:3e610e54-6fd9-4d24-93cb-18d61eaedb3e for instance 59d99a78-7b02-4e10-bfb8-fd64fb224134 on n-h1-854823-1 Aug 27 04:46:54.207291 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ffef1c78-b428-464b-84f7-b003e68b28df req-b1211adf-e41b-49ce-9af6-f84eaea2a510 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083043 Aug 27 04:46:54.211043 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1796/3534] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:54.222165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-779f3555-dd95-48d3-8cdb-efd733f3eb20 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:54.222887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-779f3555-dd95-48d3-8cdb-efd733f3eb20 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:54.241888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-779f3555-dd95-48d3-8cdb-efd733f3eb20 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:54.242922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-779f3555-dd95-48d3-8cdb-efd733f3eb20 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:54.243381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-779f3555-dd95-48d3-8cdb-efd733f3eb20 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:54.246354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-779f3555-dd95-48d3-8cdb-efd733f3eb20 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:54.249002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-779f3555-dd95-48d3-8cdb-efd733f3eb20 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:54.250030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-779f3555-dd95-48d3-8cdb-efd733f3eb20 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:54.530003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-779f3555-dd95-48d3-8cdb-efd733f3eb20 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:54.546747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-779f3555-dd95-48d3-8cdb-efd733f3eb20 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:54.548226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-779f3555-dd95-48d3-8cdb-efd733f3eb20 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:54.549475 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-779f3555-dd95-48d3-8cdb-efd733f3eb20 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1362 microversion: 2.47 time: 0.337268 Aug 27 04:46:54.561124 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1797/3535] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:54 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:54.567821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ae0eccc-1c8c-485d-b138-005c4efc6cc0 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:54.568345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ae0eccc-1c8c-485d-b138-005c4efc6cc0 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:54.583098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ae0eccc-1c8c-485d-b138-005c4efc6cc0 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:54.583617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ae0eccc-1c8c-485d-b138-005c4efc6cc0 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:54.584063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ae0eccc-1c8c-485d-b138-005c4efc6cc0 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:54.584837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ae0eccc-1c8c-485d-b138-005c4efc6cc0 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:54.585304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ae0eccc-1c8c-485d-b138-005c4efc6cc0 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:54.585732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ae0eccc-1c8c-485d-b138-005c4efc6cc0 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:54.671726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ae0eccc-1c8c-485d-b138-005c4efc6cc0 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:46:54.683508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-be2effbf-80be-469f-ac34-f33661d79ed0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:54.696587 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-be2effbf-80be-469f-ac34-f33661d79ed0 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 1.267041 Aug 27 04:46:54.698502 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1739/3536] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:53 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:54.712803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-66491d66-7736-41dc-9821-f13a3ed4009e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:54.715228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-66491d66-7736-41dc-9821-f13a3ed4009e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:54.730960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66491d66-7736-41dc-9821-f13a3ed4009e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:54.733367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66491d66-7736-41dc-9821-f13a3ed4009e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:54.734019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66491d66-7736-41dc-9821-f13a3ed4009e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:54.737455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66491d66-7736-41dc-9821-f13a3ed4009e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:54.738203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66491d66-7736-41dc-9821-f13a3ed4009e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:54.739217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66491d66-7736-41dc-9821-f13a3ed4009e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:54.912823 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ae0eccc-1c8c-485d-b138-005c4efc6cc0 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 204 len: 0 microversion: 2.1 time: 0.350242 Aug 27 04:46:54.913798 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1798/3537] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:46:54 2022] DELETE /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:46:54.924121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d505edfd-6230-4a49-a8b1-51b4a7342d79 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:54.925255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d505edfd-6230-4a49-a8b1-51b4a7342d79 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:54.940383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d505edfd-6230-4a49-a8b1-51b4a7342d79 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:54.941236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d505edfd-6230-4a49-a8b1-51b4a7342d79 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:54.943046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d505edfd-6230-4a49-a8b1-51b4a7342d79 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:54.943487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-66491d66-7736-41dc-9821-f13a3ed4009e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:54.944722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d505edfd-6230-4a49-a8b1-51b4a7342d79 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:54.945167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d505edfd-6230-4a49-a8b1-51b4a7342d79 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:54.945801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d505edfd-6230-4a49-a8b1-51b4a7342d79 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:54.956021 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-66491d66-7736-41dc-9821-f13a3ed4009e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1252 microversion: 2.1 time: 0.254284 Aug 27 04:46:54.959134 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1740/3538] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:54 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1252 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:55.228487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d505edfd-6230-4a49-a8b1-51b4a7342d79 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:55.242753 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d505edfd-6230-4a49-a8b1-51b4a7342d79 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1525 microversion: 2.1 time: 0.323205 Aug 27 04:46:55.243517 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1799/3539] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:54 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1525 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:55.574879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0c52d65d-2422-49d7-9a7b-04fdee1e8641 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:55.575797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0c52d65d-2422-49d7-9a7b-04fdee1e8641 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:55.586230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c52d65d-2422-49d7-9a7b-04fdee1e8641 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:55.595291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c52d65d-2422-49d7-9a7b-04fdee1e8641 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:55.596066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c52d65d-2422-49d7-9a7b-04fdee1e8641 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:55.597045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c52d65d-2422-49d7-9a7b-04fdee1e8641 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:55.599411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c52d65d-2422-49d7-9a7b-04fdee1e8641 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:55.600048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c52d65d-2422-49d7-9a7b-04fdee1e8641 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:55.721106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73468677-14af-4f93-8623-f3d43dc4c838 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:55.722841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73468677-14af-4f93-8623-f3d43dc4c838 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:55.747503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73468677-14af-4f93-8623-f3d43dc4c838 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:55.748005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73468677-14af-4f93-8623-f3d43dc4c838 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:55.748433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73468677-14af-4f93-8623-f3d43dc4c838 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:55.749168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73468677-14af-4f93-8623-f3d43dc4c838 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:55.749617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73468677-14af-4f93-8623-f3d43dc4c838 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:55.750038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73468677-14af-4f93-8623-f3d43dc4c838 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:55.869430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0c52d65d-2422-49d7-9a7b-04fdee1e8641 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:55.887128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0c52d65d-2422-49d7-9a7b-04fdee1e8641 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:55.897796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0c52d65d-2422-49d7-9a7b-04fdee1e8641 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:55.900114 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0c52d65d-2422-49d7-9a7b-04fdee1e8641 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1362 microversion: 2.47 time: 0.329032 Aug 27 04:46:55.906925 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1741/3540] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:55 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:55.980773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-18eea6d5-e588-49ae-9159-f950f83668d2 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:55.981669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-18eea6d5-e588-49ae-9159-f950f83668d2 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:55.994157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:55.998810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18eea6d5-e588-49ae-9159-f950f83668d2 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:56.000217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18eea6d5-e588-49ae-9159-f950f83668d2 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:56.001634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18eea6d5-e588-49ae-9159-f950f83668d2 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:56.004298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18eea6d5-e588-49ae-9159-f950f83668d2 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:56.005023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18eea6d5-e588-49ae-9159-f950f83668d2 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:56.006434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18eea6d5-e588-49ae-9159-f950f83668d2 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:56.167639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-18eea6d5-e588-49ae-9159-f950f83668d2 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:56.178495 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-18eea6d5-e588-49ae-9159-f950f83668d2 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1252 microversion: 2.1 time: 0.202720 Aug 27 04:46:56.179873 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1742/3541] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:55 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1252 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:56.272458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9a6b1d8e-f385-4758-b4b3-4fdbf4f69760 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:56.274290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9a6b1d8e-f385-4758-b4b3-4fdbf4f69760 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:56.300047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a6b1d8e-f385-4758-b4b3-4fdbf4f69760 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:56.301064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a6b1d8e-f385-4758-b4b3-4fdbf4f69760 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:56.302149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a6b1d8e-f385-4758-b4b3-4fdbf4f69760 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:56.307251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a6b1d8e-f385-4758-b4b3-4fdbf4f69760 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:56.308018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a6b1d8e-f385-4758-b4b3-4fdbf4f69760 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:56.308753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a6b1d8e-f385-4758-b4b3-4fdbf4f69760 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:56.446988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-73468677-14af-4f93-8623-f3d43dc4c838 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:56.461737 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-73468677-14af-4f93-8623-f3d43dc4c838 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.746717 Aug 27 04:46:56.462653 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1800/3542] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:55 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:56.700114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9a6b1d8e-f385-4758-b4b3-4fdbf4f69760 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:56.713057 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9a6b1d8e-f385-4758-b4b3-4fdbf4f69760 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1525 microversion: 2.1 time: 0.448339 Aug 27 04:46:56.713829 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1743/3543] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:56 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1525 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:56.930248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52f2ab8d-1182-4d01-b117-f37f6542c444 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:56.930866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-52f2ab8d-1182-4d01-b117-f37f6542c444 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:56.943106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52f2ab8d-1182-4d01-b117-f37f6542c444 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:56.943617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52f2ab8d-1182-4d01-b117-f37f6542c444 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:56.944054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52f2ab8d-1182-4d01-b117-f37f6542c444 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:56.951903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52f2ab8d-1182-4d01-b117-f37f6542c444 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:56.952705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52f2ab8d-1182-4d01-b117-f37f6542c444 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:56.953162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52f2ab8d-1182-4d01-b117-f37f6542c444 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:57.203137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a0a3ed17-2676-447c-9911-7938d1bd45db tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:57.203845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a0a3ed17-2676-447c-9911-7938d1bd45db tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:57.214244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:57.219201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0a3ed17-2676-447c-9911-7938d1bd45db tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:57.221450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0a3ed17-2676-447c-9911-7938d1bd45db tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:57.222299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0a3ed17-2676-447c-9911-7938d1bd45db tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:57.223253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0a3ed17-2676-447c-9911-7938d1bd45db tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:57.225503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0a3ed17-2676-447c-9911-7938d1bd45db tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:57.228320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0a3ed17-2676-447c-9911-7938d1bd45db tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:57.285461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:57.394425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52f2ab8d-1182-4d01-b117-f37f6542c444 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:57.413752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52f2ab8d-1182-4d01-b117-f37f6542c444 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:57.415991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52f2ab8d-1182-4d01-b117-f37f6542c444 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:57.417714 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52f2ab8d-1182-4d01-b117-f37f6542c444 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1362 microversion: 2.47 time: 0.491621 Aug 27 04:46:57.418973 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1801/3544] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:56 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1362 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:46:57.491394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc6ab8d4-ef19-4ee8-ae86-fe31af07c4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:57.492269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc6ab8d4-ef19-4ee8-ae86-fe31af07c4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:57.506156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc6ab8d4-ef19-4ee8-ae86-fe31af07c4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:57.506669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc6ab8d4-ef19-4ee8-ae86-fe31af07c4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:57.521623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc6ab8d4-ef19-4ee8-ae86-fe31af07c4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:57.522967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc6ab8d4-ef19-4ee8-ae86-fe31af07c4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:57.523700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc6ab8d4-ef19-4ee8-ae86-fe31af07c4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:57.524464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc6ab8d4-ef19-4ee8-ae86-fe31af07c4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:57.603494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a0a3ed17-2676-447c-9911-7938d1bd45db tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:57.622142 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a0a3ed17-2676-447c-9911-7938d1bd45db tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1252 microversion: 2.1 time: 0.424450 Aug 27 04:46:57.623312 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1744/3545] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:57 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1252 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:57.736811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8005ce34-6deb-44cf-8917-be7d2a2cfda9 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:57.737712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8005ce34-6deb-44cf-8917-be7d2a2cfda9 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:57.750168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8005ce34-6deb-44cf-8917-be7d2a2cfda9 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:57.750965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8005ce34-6deb-44cf-8917-be7d2a2cfda9 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:57.751610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8005ce34-6deb-44cf-8917-be7d2a2cfda9 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:57.760920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8005ce34-6deb-44cf-8917-be7d2a2cfda9 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:57.761508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8005ce34-6deb-44cf-8917-be7d2a2cfda9 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:57.762742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8005ce34-6deb-44cf-8917-be7d2a2cfda9 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:58.157332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8005ce34-6deb-44cf-8917-be7d2a2cfda9 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:58.168677 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8005ce34-6deb-44cf-8917-be7d2a2cfda9 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1525 microversion: 2.1 time: 0.435977 Aug 27 04:46:58.184910 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1745/3546] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:57 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1525 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:58.445865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:58.447185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:58.471582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:58.473618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:58.477034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:58.491882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:58.492791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:58.493417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:58.598333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:58.598833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:58.599308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:58.599764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lazy-loading 'fault' on Instance uuid e9f0e3c6-acb6-4ce8-841d-c32ec233911e {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:46:58.716929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:58.733754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:58.736023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:58.743564 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4c094d17-1234-42b1-88d2-7d4c0625e27c tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 200 len: 1367 microversion: 2.47 time: 0.301730 Aug 27 04:46:58.744696 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1746/3547] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:58 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:46:58.766548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aaafc9cf-05a2-47ec-97bb-72cf968eb50e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:58.768133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aaafc9cf-05a2-47ec-97bb-72cf968eb50e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:58.777854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaafc9cf-05a2-47ec-97bb-72cf968eb50e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:58.778376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaafc9cf-05a2-47ec-97bb-72cf968eb50e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:58.783492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cc6ab8d4-ef19-4ee8-ae86-fe31af07c4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:58.788773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaafc9cf-05a2-47ec-97bb-72cf968eb50e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:58.799159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaafc9cf-05a2-47ec-97bb-72cf968eb50e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:58.800492 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc6ab8d4-ef19-4ee8-ae86-fe31af07c4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 1.309979 Aug 27 04:46:58.804469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaafc9cf-05a2-47ec-97bb-72cf968eb50e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:58.805296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aaafc9cf-05a2-47ec-97bb-72cf968eb50e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:58.805629 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1802/3548] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:57 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:58.841766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1ddb7ff1-99f8-45ae-8d29-1b26a7651023 req-30fb4135-9937-4ed9-9db4-c498273de8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b295d015-572a-44a3-b59d-6a02ced0555b", "name": "network-vif-deleted", "tag": "f1c65e51-962e-4c47-9e80-c968e7be5e7b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:58.858651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1ddb7ff1-99f8-45ae-8d29-1b26a7651023 req-30fb4135-9937-4ed9-9db4-c498273de8d1 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:58.859755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1ddb7ff1-99f8-45ae-8d29-1b26a7651023 req-30fb4135-9937-4ed9-9db4-c498273de8d1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:58.860441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1ddb7ff1-99f8-45ae-8d29-1b26a7651023 req-30fb4135-9937-4ed9-9db4-c498273de8d1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:58.931884 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1ddb7ff1-99f8-45ae-8d29-1b26a7651023 req-30fb4135-9937-4ed9-9db4-c498273de8d1 service nova] Creating event network-vif-deleted:f1c65e51-962e-4c47-9e80-c968e7be5e7b for instance b295d015-572a-44a3-b59d-6a02ced0555b on n-h2-854823-1 Aug 27 04:46:58.945707 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1ddb7ff1-99f8-45ae-8d29-1b26a7651023 req-30fb4135-9937-4ed9-9db4-c498273de8d1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107597 Aug 27 04:46:58.946832 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1803/3549] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:58.994693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aaafc9cf-05a2-47ec-97bb-72cf968eb50e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:59.008629 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aaafc9cf-05a2-47ec-97bb-72cf968eb50e tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1252 microversion: 2.1 time: 0.262332 Aug 27 04:46:59.009522 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1747/3550] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:58 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1252 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:59.192218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34ab4df3-f0ca-4553-b18b-268a1fe374c5 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:59.193871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34ab4df3-f0ca-4553-b18b-268a1fe374c5 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:59.208356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ab4df3-f0ca-4553-b18b-268a1fe374c5 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:59.208932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ab4df3-f0ca-4553-b18b-268a1fe374c5 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:59.210970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ab4df3-f0ca-4553-b18b-268a1fe374c5 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:59.214989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ab4df3-f0ca-4553-b18b-268a1fe374c5 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:59.216565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ab4df3-f0ca-4553-b18b-268a1fe374c5 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:59.220892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ab4df3-f0ca-4553-b18b-268a1fe374c5 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:59.304128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ab4df3-f0ca-4553-b18b-268a1fe374c5 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:59.304782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ab4df3-f0ca-4553-b18b-268a1fe374c5 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:59.305236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ab4df3-f0ca-4553-b18b-268a1fe374c5 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:59.305668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-34ab4df3-f0ca-4553-b18b-268a1fe374c5 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lazy-loading 'fault' on Instance uuid b295d015-572a-44a3-b59d-6a02ced0555b {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:46:59.419053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34ab4df3-f0ca-4553-b18b-268a1fe374c5 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117b87f36c8d4b269069f920ba7f1f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35161c722a2341a79e69f467f9eaec10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:59.429956 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34ab4df3-f0ca-4553-b18b-268a1fe374c5 tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 200 len: 1314 microversion: 2.1 time: 0.243163 Aug 27 04:46:59.445808 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1804/3551] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:59 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:59.774474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3bbde885-a4a7-4bde-bc00-75953eb0d311 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:59.775363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3bbde885-a4a7-4bde-bc00-75953eb0d311 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: e9f0e3c6-acb6-4ce8-841d-c32ec233911e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:59.782821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3bbde885-a4a7-4bde-bc00-75953eb0d311 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:59.789190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3bbde885-a4a7-4bde-bc00-75953eb0d311 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:59.791168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3bbde885-a4a7-4bde-bc00-75953eb0d311 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:59.793987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3bbde885-a4a7-4bde-bc00-75953eb0d311 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:59.795708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3bbde885-a4a7-4bde-bc00-75953eb0d311 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:59.796673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3bbde885-a4a7-4bde-bc00-75953eb0d311 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:59.827260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b38a87d2-6cf3-4a73-97ec-84de530e9c32 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:59.827873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b38a87d2-6cf3-4a73-97ec-84de530e9c32 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:59.840419 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-3bbde885-a4a7-4bde-bc00-75953eb0d311 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] HTTP exception thrown: Instance e9f0e3c6-acb6-4ce8-841d-c32ec233911e could not be found. Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3bbde885-a4a7-4bde-bc00-75953eb0d311 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Request method failure captured: Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e HTTP/1.1 Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaGNBNqbT4_BxqWdMszqlZBPJzTkWA-8ix4PZe7rb6UQbQ4aQMnl8qb3H1-broaEkGYF7pz05knAbaazfMdUKRkU43J65BZtnxeLBVJdLOHcfhIfivITYcR_g0wj6mTOUmGJgkwGb8LwADYBraO-pOMEvX8GgFiFub5xH_OVn_yQGKU Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: dabf4cd752244d4682cd19e978fb0f41 Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerShowV247Test-1508686108 Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dabf4cd752244d4682cd19e978fb0f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dabf4cd752244d4682cd19e978fb0f41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dabf4cd752244d4682cd19e978fb0f41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dabf4cd752244d4682cd19e978fb0f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerShowV247Test-1508686108 Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: dabf4cd752244d4682cd19e978fb0f41 Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerShowV247Test-1508686108 Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerShowV247Test-1508686108-project Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6282d7051fac4a3cabf71e748e753f26 Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerShowV247Test-1508686108-project Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance e9f0e3c6-acb6-4ce8-841d-c32ec233911e could not be found. Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'e9f0e3c6-acb6-4ce8-841d-c32ec233911e'} Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f0e3c6-acb6-4ce8-841d-c32ec233911e could not be found. Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f0e3c6-acb6-4ce8-841d-c32ec233911e could not be found. Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:46:59.844135 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:59.849622 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:46:59.849622 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:46:59.849622 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:46:59.849622 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:46:59.849622 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:46:59.849622 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f0e3c6-acb6-4ce8-841d-c32ec233911e could not be found. Aug 27 04:46:59.849622 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:46:59.849622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3bbde885-a4a7-4bde-bc00-75953eb0d311 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Returning 404 to user: Instance e9f0e3c6-acb6-4ce8-841d-c32ec233911e could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:46:59.849622 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3bbde885-a4a7-4bde-bc00-75953eb0d311 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e" status: 404 len: 111 microversion: 2.47 time: 0.075721 Aug 27 04:46:59.850353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b38a87d2-6cf3-4a73-97ec-84de530e9c32 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:59.850353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b38a87d2-6cf3-4a73-97ec-84de530e9c32 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:59.850353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b38a87d2-6cf3-4a73-97ec-84de530e9c32 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:59.850611 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1748/3552] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:46:59 2022] GET /compute/v2.1/servers/e9f0e3c6-acb6-4ce8-841d-c32ec233911e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:46:59.856228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b38a87d2-6cf3-4a73-97ec-84de530e9c32 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:59.856768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b38a87d2-6cf3-4a73-97ec-84de530e9c32 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:59.857221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b38a87d2-6cf3-4a73-97ec-84de530e9c32 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:59.866673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c019c1c-eba7-4679-8801-7ebc99f47c4b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:59.867200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4c019c1c-eba7-4679-8801-7ebc99f47c4b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: 7413c71f-a90d-4d56-b127-bcaa215637c4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:46:59.886742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c019c1c-eba7-4679-8801-7ebc99f47c4b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:59.888293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c019c1c-eba7-4679-8801-7ebc99f47c4b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:59.889533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c019c1c-eba7-4679-8801-7ebc99f47c4b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:59.893375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c019c1c-eba7-4679-8801-7ebc99f47c4b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:46:59.895038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c019c1c-eba7-4679-8801-7ebc99f47c4b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:46:59.896058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c019c1c-eba7-4679-8801-7ebc99f47c4b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:46:59.940638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4c019c1c-eba7-4679-8801-7ebc99f47c4b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: 7413c71f-a90d-4d56-b127-bcaa215637c4] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:46:59.959325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:00.054150 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4c019c1c-eba7-4679-8801-7ebc99f47c4b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7413c71f-a90d-4d56-b127-bcaa215637c4" status: 204 len: 0 microversion: 2.47 time: 0.203179 Aug 27 04:47:00.057982 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1749/3553] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:46:59 2022] DELETE /compute/v2.1/servers/7413c71f-a90d-4d56-b127-bcaa215637c4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:47:00.062871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-85530193-67ee-4f52-8886-59434af44fd6 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:00.063901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-85530193-67ee-4f52-8886-59434af44fd6 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:00.071857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85530193-67ee-4f52-8886-59434af44fd6 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:00.072364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85530193-67ee-4f52-8886-59434af44fd6 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:00.072834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85530193-67ee-4f52-8886-59434af44fd6 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:00.073548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85530193-67ee-4f52-8886-59434af44fd6 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:00.074067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85530193-67ee-4f52-8886-59434af44fd6 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:00.074561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85530193-67ee-4f52-8886-59434af44fd6 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:00.254365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b38a87d2-6cf3-4a73-97ec-84de530e9c32 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:00.260955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-85530193-67ee-4f52-8886-59434af44fd6 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:00.268987 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b38a87d2-6cf3-4a73-97ec-84de530e9c32 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.441518 Aug 27 04:47:00.270486 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1805/3554] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:46:59 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:00.274670 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-85530193-67ee-4f52-8886-59434af44fd6 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1252 microversion: 2.1 time: 0.217788 Aug 27 04:47:00.277217 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1750/3555] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:00 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1252 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:00.278890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c7950536-0709-4ec6-9dbd-bd4976e6fb2b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:00.279774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c7950536-0709-4ec6-9dbd-bd4976e6fb2b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: 7413c71f-a90d-4d56-b127-bcaa215637c4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:00.295742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7950536-0709-4ec6-9dbd-bd4976e6fb2b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:00.296590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7950536-0709-4ec6-9dbd-bd4976e6fb2b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:00.297305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7950536-0709-4ec6-9dbd-bd4976e6fb2b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:00.299755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7950536-0709-4ec6-9dbd-bd4976e6fb2b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:00.300459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7950536-0709-4ec6-9dbd-bd4976e6fb2b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:00.301149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7950536-0709-4ec6-9dbd-bd4976e6fb2b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:00.460146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c66aa372-1678-499b-b967-0d2c72fe6d1f tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:00.464643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c66aa372-1678-499b-b967-0d2c72fe6d1f tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] [instance: b295d015-572a-44a3-b59d-6a02ced0555b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:00.478381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c66aa372-1678-499b-b967-0d2c72fe6d1f tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:00.480517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c66aa372-1678-499b-b967-0d2c72fe6d1f tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:00.481244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c66aa372-1678-499b-b967-0d2c72fe6d1f tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:00.482182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c66aa372-1678-499b-b967-0d2c72fe6d1f tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:00.482843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c66aa372-1678-499b-b967-0d2c72fe6d1f tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:00.483487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c66aa372-1678-499b-b967-0d2c72fe6d1f tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:00.500890 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-c66aa372-1678-499b-b967-0d2c72fe6d1f tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] HTTP exception thrown: Instance b295d015-572a-44a3-b59d-6a02ced0555b could not be found. Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c66aa372-1678-499b-b967-0d2c72fe6d1f tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Request method failure captured: Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b HTTP/1.1 Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaGs3ra6laDVHHzySuPyVQUCYQsmSNorQ6KScR3n5wRJ5XOPLluQeCwvDyyAK9uxV87lLsAbqsmjM0TyUdedOkJ1TQxKDntFOjJVX3x_yo7ezQOGnPphrVktIkszfh9oQxXtvdzdat3u6OEi7KJQD_JKveK_dsD88UTYl86fmYoqcDQ Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35161c722a2341a79e69f467f9eaec10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35161c722a2341a79e69f467f9eaec10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 35161c722a2341a79e69f467f9eaec10 Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-288465528 Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 117b87f36c8d4b269069f920ba7f1f12 Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-288465528-project Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance b295d015-572a-44a3-b59d-6a02ced0555b could not be found. Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'b295d015-572a-44a3-b59d-6a02ced0555b'} Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b295d015-572a-44a3-b59d-6a02ced0555b could not be found. Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b295d015-572a-44a3-b59d-6a02ced0555b could not be found. Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:00.503762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:47:00.508353 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:00.508353 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:47:00.508353 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:47:00.508353 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:47:00.508353 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:47:00.508353 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:47:00.508353 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b295d015-572a-44a3-b59d-6a02ced0555b could not be found. Aug 27 04:47:00.508353 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:00.511518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c66aa372-1678-499b-b967-0d2c72fe6d1f tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] Returning 404 to user: Instance b295d015-572a-44a3-b59d-6a02ced0555b could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:47:00.512671 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c66aa372-1678-499b-b967-0d2c72fe6d1f tempest-ServerMetadataNegativeTestJSON-288465528 tempest-ServerMetadataNegativeTestJSON-288465528-project] 10.222.0.79 "GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b" status: 404 len: 111 microversion: 2.1 time: 0.059549 Aug 27 04:47:00.516344 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1751/3556] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:00 2022] GET /compute/v2.1/servers/b295d015-572a-44a3-b59d-6a02ced0555b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:47:00.589517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7950536-0709-4ec6-9dbd-bd4976e6fb2b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:00.601120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7950536-0709-4ec6-9dbd-bd4976e6fb2b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:00.614233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7950536-0709-4ec6-9dbd-bd4976e6fb2b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:00.616566 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c7950536-0709-4ec6-9dbd-bd4976e6fb2b tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/7413c71f-a90d-4d56-b127-bcaa215637c4" status: 200 len: 1361 microversion: 2.47 time: 0.344776 Aug 27 04:47:00.617521 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1806/3557] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:47:00 2022] GET /compute/v2.1/servers/7413c71f-a90d-4d56-b127-bcaa215637c4 => generated 1361 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:47:01.290658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-746ccd2f-9898-4f29-a0d4-3f4bf3c49eea tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:01.291284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-746ccd2f-9898-4f29-a0d4-3f4bf3c49eea tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:01.306848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-746ccd2f-9898-4f29-a0d4-3f4bf3c49eea tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:01.308102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a17cdc9-a456-410d-a01b-ccea672d3313 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:01.309324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a17cdc9-a456-410d-a01b-ccea672d3313 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:01.310158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-746ccd2f-9898-4f29-a0d4-3f4bf3c49eea tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:01.311855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-746ccd2f-9898-4f29-a0d4-3f4bf3c49eea tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:01.318642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-746ccd2f-9898-4f29-a0d4-3f4bf3c49eea tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:01.319280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-746ccd2f-9898-4f29-a0d4-3f4bf3c49eea tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:01.323167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a17cdc9-a456-410d-a01b-ccea672d3313 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:01.324838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-746ccd2f-9898-4f29-a0d4-3f4bf3c49eea tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:01.325003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a17cdc9-a456-410d-a01b-ccea672d3313 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:01.325532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a17cdc9-a456-410d-a01b-ccea672d3313 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:01.331277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a17cdc9-a456-410d-a01b-ccea672d3313 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:01.331864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a17cdc9-a456-410d-a01b-ccea672d3313 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:01.332439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a17cdc9-a456-410d-a01b-ccea672d3313 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:01.561438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a17cdc9-a456-410d-a01b-ccea672d3313 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:01.583567 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a17cdc9-a456-410d-a01b-ccea672d3313 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1252 microversion: 2.1 time: 0.278596 Aug 27 04:47:01.592958 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1807/3558] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:01 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1252 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:01.647107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89676f8d-3d12-4951-ba9f-973e90b8eb59 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:01.647789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89676f8d-3d12-4951-ba9f-973e90b8eb59 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: 7413c71f-a90d-4d56-b127-bcaa215637c4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:01.664063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89676f8d-3d12-4951-ba9f-973e90b8eb59 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:01.667083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89676f8d-3d12-4951-ba9f-973e90b8eb59 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:01.668006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89676f8d-3d12-4951-ba9f-973e90b8eb59 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:01.687511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89676f8d-3d12-4951-ba9f-973e90b8eb59 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:01.688418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89676f8d-3d12-4951-ba9f-973e90b8eb59 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:01.692886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89676f8d-3d12-4951-ba9f-973e90b8eb59 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:02.115895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-746ccd2f-9898-4f29-a0d4-3f4bf3c49eea tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:02.129424 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-746ccd2f-9898-4f29-a0d4-3f4bf3c49eea tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.842855 Aug 27 04:47:02.130495 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1752/3559] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:01 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:02.605863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c80655dc-6ee8-49f7-a16d-1cfa06a17c70 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:02.606546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c80655dc-6ee8-49f7-a16d-1cfa06a17c70 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:02.620858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c80655dc-6ee8-49f7-a16d-1cfa06a17c70 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:02.621553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c80655dc-6ee8-49f7-a16d-1cfa06a17c70 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:02.623192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c80655dc-6ee8-49f7-a16d-1cfa06a17c70 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:02.624119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c80655dc-6ee8-49f7-a16d-1cfa06a17c70 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:02.626652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c80655dc-6ee8-49f7-a16d-1cfa06a17c70 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:02.627270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c80655dc-6ee8-49f7-a16d-1cfa06a17c70 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:02.684705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89676f8d-3d12-4951-ba9f-973e90b8eb59 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:02.732310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c80655dc-6ee8-49f7-a16d-1cfa06a17c70 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:02.739284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c80655dc-6ee8-49f7-a16d-1cfa06a17c70 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:02.739840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c80655dc-6ee8-49f7-a16d-1cfa06a17c70 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:02.740512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-c80655dc-6ee8-49f7-a16d-1cfa06a17c70 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lazy-loading 'fault' on Instance uuid 59d99a78-7b02-4e10-bfb8-fd64fb224134 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:47:02.741154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89676f8d-3d12-4951-ba9f-973e90b8eb59 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:02.759203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89676f8d-3d12-4951-ba9f-973e90b8eb59 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:02.760930 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89676f8d-3d12-4951-ba9f-973e90b8eb59 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/7413c71f-a90d-4d56-b127-bcaa215637c4" status: 200 len: 1361 microversion: 2.47 time: 1.120315 Aug 27 04:47:02.783566 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1808/3560] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:47:01 2022] GET /compute/v2.1/servers/7413c71f-a90d-4d56-b127-bcaa215637c4 => generated 1361 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:47:03.040972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c80655dc-6ee8-49f7-a16d-1cfa06a17c70 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7381d46a2eb14fa39e645f8459dc4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05f87ee5fb4d56acc906e2fb616b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:03.049764 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c80655dc-6ee8-49f7-a16d-1cfa06a17c70 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 200 len: 1211 microversion: 2.1 time: 0.447903 Aug 27 04:47:03.054177 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1753/3561] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:02 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 1211 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:03.152637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da74a265-c1be-4b47-b958-a6b4011ff1fa tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:03.153324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da74a265-c1be-4b47-b958-a6b4011ff1fa tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:03.156713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:03.171898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da74a265-c1be-4b47-b958-a6b4011ff1fa tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:03.172708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da74a265-c1be-4b47-b958-a6b4011ff1fa tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:03.174309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da74a265-c1be-4b47-b958-a6b4011ff1fa tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:03.177113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da74a265-c1be-4b47-b958-a6b4011ff1fa tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:03.188847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da74a265-c1be-4b47-b958-a6b4011ff1fa tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:03.191813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da74a265-c1be-4b47-b958-a6b4011ff1fa tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:03.484987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:03.557933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da74a265-c1be-4b47-b958-a6b4011ff1fa tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:03.561521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:03.574572 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da74a265-c1be-4b47-b958-a6b4011ff1fa tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.425437 Aug 27 04:47:03.578655 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1809/3562] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:03 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:03.792158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:03.794326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: 7413c71f-a90d-4d56-b127-bcaa215637c4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:03.812613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:03.814641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:03.814641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:03.815134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:03.815997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:03.817263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:03.897449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:03.899397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:03.899897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:03.903554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lazy-loading 'fault' on Instance uuid 7413c71f-a90d-4d56-b127-bcaa215637c4 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:47:04.018447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:04.032204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:04.041277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6282d7051fac4a3cabf71e748e753f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabf4cd752244d4682cd19e978fb0f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:04.052059 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ee942542-9849-426c-9b7b-6c5389c133c8 tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/7413c71f-a90d-4d56-b127-bcaa215637c4" status: 200 len: 1366 microversion: 2.47 time: 0.264744 Aug 27 04:47:04.054262 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1754/3563] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:47:03 2022] GET /compute/v2.1/servers/7413c71f-a90d-4d56-b127-bcaa215637c4 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:47:04.079173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4350b63d-2ad8-4410-b8a2-79de87a1f522 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:04.083245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4350b63d-2ad8-4410-b8a2-79de87a1f522 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] [instance: 59d99a78-7b02-4e10-bfb8-fd64fb224134] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:04.099797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4350b63d-2ad8-4410-b8a2-79de87a1f522 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:04.103201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4350b63d-2ad8-4410-b8a2-79de87a1f522 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:04.105611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4350b63d-2ad8-4410-b8a2-79de87a1f522 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:04.106591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4350b63d-2ad8-4410-b8a2-79de87a1f522 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:04.107100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4350b63d-2ad8-4410-b8a2-79de87a1f522 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:04.107538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4350b63d-2ad8-4410-b8a2-79de87a1f522 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:04.151237 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4350b63d-2ad8-4410-b8a2-79de87a1f522 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] HTTP exception thrown: Instance 59d99a78-7b02-4e10-bfb8-fd64fb224134 could not be found. Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4350b63d-2ad8-4410-b8a2-79de87a1f522 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Request method failure captured: Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 HTTP/1.1 Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaE_lKxHa6Hz7qJ8If7VELdbq9nrrMCT5AbmxzGqfNkXM1AO8WwEHW1DhpC_kG1UC2dfzO-wUFaTPIwq1pM50791o64MxMFB-amhyd0V2B8v3woD7rAHKzFysjbXjm60jHIgULoM1TnznXGpGEIUKlvGf-C0Y7nolXa1GRKETa97zDc Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 7a05f87ee5fb4d56acc906e2fb616b4a Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestBootFromVolume-2110804626 Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7a05f87ee5fb4d56acc906e2fb616b4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7a05f87ee5fb4d56acc906e2fb616b4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7a05f87ee5fb4d56acc906e2fb616b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7a05f87ee5fb4d56acc906e2fb616b4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestBootFromVolume-2110804626 Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 7a05f87ee5fb4d56acc906e2fb616b4a Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestBootFromVolume-2110804626 Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersTestBootFromVolume-2110804626-project Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 7381d46a2eb14fa39e645f8459dc4367 Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestBootFromVolume-2110804626-project Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 59d99a78-7b02-4e10-bfb8-fd64fb224134 could not be found. Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '59d99a78-7b02-4e10-bfb8-fd64fb224134'} Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d99a78-7b02-4e10-bfb8-fd64fb224134 could not be found. Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d99a78-7b02-4e10-bfb8-fd64fb224134 could not be found. Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:47:04.154956 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:47:04.160097 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:47:04.160097 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:47:04.160097 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:47:04.160097 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:47:04.160097 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:47:04.160097 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d99a78-7b02-4e10-bfb8-fd64fb224134 could not be found. Aug 27 04:47:04.160097 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:47:04.163779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4350b63d-2ad8-4410-b8a2-79de87a1f522 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Returning 404 to user: Instance 59d99a78-7b02-4e10-bfb8-fd64fb224134 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:47:04.165553 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4350b63d-2ad8-4410-b8a2-79de87a1f522 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134" status: 404 len: 111 microversion: 2.1 time: 0.094087 Aug 27 04:47:04.171227 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1810/3564] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:04 2022] GET /compute/v2.1/servers/59d99a78-7b02-4e10-bfb8-fd64fb224134 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:47:04.178509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-33a9c742-d786-44d9-9d06-906dd6905a85 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] Calling method '.version_select at 0x7f1f25e1c280>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:04.225309 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-33a9c742-d786-44d9-9d06-906dd6905a85 tempest-ServersTestBootFromVolume-2110804626 tempest-ServersTestBootFromVolume-2110804626-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624376974" status: 202 len: 0 microversion: 2.1 time: 0.052875 Aug 27 04:47:04.227789 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1755/3565] 10.222.0.79 () {58 vars in 1221 bytes} [Sat Aug 27 04:47:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624376974 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:47:04.601041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-213cb287-1c74-494c-949e-fbe7d2f8a51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:04.602002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-213cb287-1c74-494c-949e-fbe7d2f8a51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:04.621842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-213cb287-1c74-494c-949e-fbe7d2f8a51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:04.622685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-213cb287-1c74-494c-949e-fbe7d2f8a51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:04.623309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-213cb287-1c74-494c-949e-fbe7d2f8a51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:04.624384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-213cb287-1c74-494c-949e-fbe7d2f8a51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:04.625262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-213cb287-1c74-494c-949e-fbe7d2f8a51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:04.625863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-213cb287-1c74-494c-949e-fbe7d2f8a51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:05.049479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-213cb287-1c74-494c-949e-fbe7d2f8a51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:05.061285 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-213cb287-1c74-494c-949e-fbe7d2f8a51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.464352 Aug 27 04:47:05.081086 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1811/3566] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:04 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:05.082466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7986ea76-bf86-482c-8fed-8adc7596e21f tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:05.083246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7986ea76-bf86-482c-8fed-8adc7596e21f tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] [instance: 7413c71f-a90d-4d56-b127-bcaa215637c4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:05.101010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7986ea76-bf86-482c-8fed-8adc7596e21f tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:05.101508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7986ea76-bf86-482c-8fed-8adc7596e21f tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:05.102408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7986ea76-bf86-482c-8fed-8adc7596e21f tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:05.109015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7986ea76-bf86-482c-8fed-8adc7596e21f tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:05.112859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7986ea76-bf86-482c-8fed-8adc7596e21f tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:05.113546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7986ea76-bf86-482c-8fed-8adc7596e21f tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:05.142606 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-7986ea76-bf86-482c-8fed-8adc7596e21f tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] HTTP exception thrown: Instance 7413c71f-a90d-4d56-b127-bcaa215637c4 could not be found. Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7986ea76-bf86-482c-8fed-8adc7596e21f tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Request method failure captured: Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/7413c71f-a90d-4d56-b127-bcaa215637c4 HTTP/1.1 Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaGNBNqbT4_BxqWdMszqlZBPJzTkWA-8ix4PZe7rb6UQbQ4aQMnl8qb3H1-broaEkGYF7pz05knAbaazfMdUKRkU43J65BZtnxeLBVJdLOHcfhIfivITYcR_g0wj6mTOUmGJgkwGb8LwADYBraO-pOMEvX8GgFiFub5xH_OVn_yQGKU Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: dabf4cd752244d4682cd19e978fb0f41 Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerShowV247Test-1508686108 Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dabf4cd752244d4682cd19e978fb0f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dabf4cd752244d4682cd19e978fb0f41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dabf4cd752244d4682cd19e978fb0f41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dabf4cd752244d4682cd19e978fb0f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerShowV247Test-1508686108 Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: dabf4cd752244d4682cd19e978fb0f41 Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerShowV247Test-1508686108 Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerShowV247Test-1508686108-project Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6282d7051fac4a3cabf71e748e753f26 Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerShowV247Test-1508686108-project Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 7413c71f-a90d-4d56-b127-bcaa215637c4 could not be found. Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '7413c71f-a90d-4d56-b127-bcaa215637c4'} Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7413c71f-a90d-4d56-b127-bcaa215637c4 could not be found. Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7413c71f-a90d-4d56-b127-bcaa215637c4 could not be found. Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:47:05.152100 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:05.157664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:47:05.157664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:47:05.157664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:47:05.157664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:47:05.157664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:47:05.157664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7413c71f-a90d-4d56-b127-bcaa215637c4 could not be found. Aug 27 04:47:05.157664 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:05.169422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7986ea76-bf86-482c-8fed-8adc7596e21f tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] Returning 404 to user: Instance 7413c71f-a90d-4d56-b127-bcaa215637c4 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:47:05.170838 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7986ea76-bf86-482c-8fed-8adc7596e21f tempest-ServerShowV247Test-1508686108 tempest-ServerShowV247Test-1508686108-project] 10.222.0.79 "GET /compute/v2.1/servers/7413c71f-a90d-4d56-b127-bcaa215637c4" status: 404 len: 111 microversion: 2.47 time: 0.092932 Aug 27 04:47:05.171746 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1756/3567] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:47:05 2022] GET /compute/v2.1/servers/7413c71f-a90d-4d56-b127-bcaa215637c4 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:47:06.088857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3143e19-d6e9-4493-a0b5-1171599055af tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:06.091466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3143e19-d6e9-4493-a0b5-1171599055af tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:06.108261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3143e19-d6e9-4493-a0b5-1171599055af tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:06.110654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3143e19-d6e9-4493-a0b5-1171599055af tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:06.113390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3143e19-d6e9-4493-a0b5-1171599055af tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:06.114465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3143e19-d6e9-4493-a0b5-1171599055af tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:06.116426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3143e19-d6e9-4493-a0b5-1171599055af tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:06.117136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3143e19-d6e9-4493-a0b5-1171599055af tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:06.672869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3143e19-d6e9-4493-a0b5-1171599055af tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:06.684981 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3143e19-d6e9-4493-a0b5-1171599055af tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1514 microversion: 2.1 time: 0.601248 Aug 27 04:47:06.690509 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1812/3568] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:06 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1514 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:07.708720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-628f7b99-01d5-4437-a930-a67fb4860a1e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:07.709357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-628f7b99-01d5-4437-a930-a67fb4860a1e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:07.724672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-628f7b99-01d5-4437-a930-a67fb4860a1e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:07.737496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-628f7b99-01d5-4437-a930-a67fb4860a1e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:07.750766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-628f7b99-01d5-4437-a930-a67fb4860a1e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:07.751730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-628f7b99-01d5-4437-a930-a67fb4860a1e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:07.752339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-628f7b99-01d5-4437-a930-a67fb4860a1e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:07.753126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-628f7b99-01d5-4437-a930-a67fb4860a1e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:08.580778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-628f7b99-01d5-4437-a930-a67fb4860a1e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:08.601722 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-628f7b99-01d5-4437-a930-a67fb4860a1e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1520 microversion: 2.1 time: 0.898254 Aug 27 04:47:08.604927 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1757/3569] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:07 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1520 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:09.638709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05eb88b1-cb4d-4862-87be-f13a07544c9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:09.640067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05eb88b1-cb4d-4862-87be-f13a07544c9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:09.649360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05eb88b1-cb4d-4862-87be-f13a07544c9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:09.650136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05eb88b1-cb4d-4862-87be-f13a07544c9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:09.650914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05eb88b1-cb4d-4862-87be-f13a07544c9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:09.651985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05eb88b1-cb4d-4862-87be-f13a07544c9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:09.652655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05eb88b1-cb4d-4862-87be-f13a07544c9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:09.653248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05eb88b1-cb4d-4862-87be-f13a07544c9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:10.006556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05eb88b1-cb4d-4862-87be-f13a07544c9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:10.020079 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05eb88b1-cb4d-4862-87be-f13a07544c9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1520 microversion: 2.1 time: 0.398558 Aug 27 04:47:10.039410 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1813/3570] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:09 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:11.050971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-91a9e9ff-7b3b-4136-bc6e-55cdc62bd368 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:11.053024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-91a9e9ff-7b3b-4136-bc6e-55cdc62bd368 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:11.069152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91a9e9ff-7b3b-4136-bc6e-55cdc62bd368 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:11.069850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91a9e9ff-7b3b-4136-bc6e-55cdc62bd368 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:11.071319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91a9e9ff-7b3b-4136-bc6e-55cdc62bd368 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:11.075322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91a9e9ff-7b3b-4136-bc6e-55cdc62bd368 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:11.076013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91a9e9ff-7b3b-4136-bc6e-55cdc62bd368 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:11.077587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91a9e9ff-7b3b-4136-bc6e-55cdc62bd368 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:11.572709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-91a9e9ff-7b3b-4136-bc6e-55cdc62bd368 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:11.601058 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-91a9e9ff-7b3b-4136-bc6e-55cdc62bd368 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1520 microversion: 2.1 time: 0.561538 Aug 27 04:47:11.618367 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1758/3571] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:11 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1520 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:12.315712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8eda698b-3c3b-473d-bd7f-f2598960ba91 req-b01b2957-5a74-4ffe-abef-327bf9e07c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "130e56b9-8431-4e83-a7b1-3bad46f54e33", "name": "network-vif-unplugged", "status": "completed", "tag": "781f778e-35b9-4dc8-8331-1212ae734ea7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:12.339535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8eda698b-3c3b-473d-bd7f-f2598960ba91 req-b01b2957-5a74-4ffe-abef-327bf9e07c25 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:12.340023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8eda698b-3c3b-473d-bd7f-f2598960ba91 req-b01b2957-5a74-4ffe-abef-327bf9e07c25 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:12.340518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8eda698b-3c3b-473d-bd7f-f2598960ba91 req-b01b2957-5a74-4ffe-abef-327bf9e07c25 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:12.354605 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8eda698b-3c3b-473d-bd7f-f2598960ba91 req-b01b2957-5a74-4ffe-abef-327bf9e07c25 service nova] Creating event network-vif-unplugged:781f778e-35b9-4dc8-8331-1212ae734ea7 for instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 on n-h2-854823-1 Aug 27 04:47:12.371226 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8eda698b-3c3b-473d-bd7f-f2598960ba91 req-b01b2957-5a74-4ffe-abef-327bf9e07c25 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059593 Aug 27 04:47:12.374645 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1814/3572] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:12.626761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cc0f17a3-f749-4b20-b631-9f5c19659f20 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:12.627380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cc0f17a3-f749-4b20-b631-9f5c19659f20 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:12.641110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc0f17a3-f749-4b20-b631-9f5c19659f20 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:12.641619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc0f17a3-f749-4b20-b631-9f5c19659f20 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:12.642671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc0f17a3-f749-4b20-b631-9f5c19659f20 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:12.643392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc0f17a3-f749-4b20-b631-9f5c19659f20 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:12.646432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc0f17a3-f749-4b20-b631-9f5c19659f20 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:12.646911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc0f17a3-f749-4b20-b631-9f5c19659f20 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:13.624915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cc0f17a3-f749-4b20-b631-9f5c19659f20 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:13.645843 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cc0f17a3-f749-4b20-b631-9f5c19659f20 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1520 microversion: 2.1 time: 1.022997 Aug 27 04:47:13.661089 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1759/3573] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:12 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1520 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:14.674846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcfbfa57-5e69-4f99-83f0-4edb09e77a4f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:14.675638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fcfbfa57-5e69-4f99-83f0-4edb09e77a4f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:14.709323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcfbfa57-5e69-4f99-83f0-4edb09e77a4f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:14.709829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcfbfa57-5e69-4f99-83f0-4edb09e77a4f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:14.710277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcfbfa57-5e69-4f99-83f0-4edb09e77a4f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:14.711000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcfbfa57-5e69-4f99-83f0-4edb09e77a4f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:14.711459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcfbfa57-5e69-4f99-83f0-4edb09e77a4f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:14.711910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcfbfa57-5e69-4f99-83f0-4edb09e77a4f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:15.006338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-58ddc6c3-8c08-4143-99aa-e577b7bc01b2 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Action: 'create', calling method: .version_select at 0x7f1f2182f1f0>, body: {"keypair": {"name": "tempest-keypair-1303231670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFtPN9lcrIDe30Ieg08L3bE7nBN8q8TA3e3m1uf2XOm2ACkqCEN3d5lRcu352+DF84o5GA2XBiD60xF+lDoYHDcBrYcxnpE+WEXjqy2jl0MJxJ6INeRkveK4AbuJjPhqA=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:15.048995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-58ddc6c3-8c08-4143-99aa-e577b7bc01b2 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Getting quotas for project 15f71b93ab8e4df8a74a33ca47530ffd. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:47:15.055165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-58ddc6c3-8c08-4143-99aa-e577b7bc01b2 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Getting quotas for user d4826941efc443aba3e8ce6f2b67ac55 and project 15f71b93ab8e4df8a74a33ca47530ffd. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:47:15.118273 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-58ddc6c3-8c08-4143-99aa-e577b7bc01b2 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.325277 Aug 27 04:47:15.118891 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1760/3574] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:47:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:47:15.258676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fcfbfa57-5e69-4f99-83f0-4edb09e77a4f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:15.267715 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fcfbfa57-5e69-4f99-83f0-4edb09e77a4f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1520 microversion: 2.1 time: 0.597409 Aug 27 04:47:15.268312 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1815/3575] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:14 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1520 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:16.290852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7db353b4-afec-485c-a652-d4a043c3d3df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:16.292417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7db353b4-afec-485c-a652-d4a043c3d3df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:16.311648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7db353b4-afec-485c-a652-d4a043c3d3df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:16.312731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7db353b4-afec-485c-a652-d4a043c3d3df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:16.314593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7db353b4-afec-485c-a652-d4a043c3d3df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:16.316419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7db353b4-afec-485c-a652-d4a043c3d3df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:16.319950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7db353b4-afec-485c-a652-d4a043c3d3df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:16.322076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7db353b4-afec-485c-a652-d4a043c3d3df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:16.904765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7db353b4-afec-485c-a652-d4a043c3d3df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:16.917115 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7db353b4-afec-485c-a652-d4a043c3d3df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1520 microversion: 2.1 time: 0.629909 Aug 27 04:47:16.921403 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1761/3576] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:16 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1520 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:17.446128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f709e551-6487-43bf-baa3-2a147a551bcf req-20ef0ae3-ecb4-4328-bed6-890296eebcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "130e56b9-8431-4e83-a7b1-3bad46f54e33", "name": "network-vif-plugged", "status": "completed", "tag": "781f778e-35b9-4dc8-8331-1212ae734ea7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:17.475307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f709e551-6487-43bf-baa3-2a147a551bcf req-20ef0ae3-ecb4-4328-bed6-890296eebcd1 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:17.490291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f709e551-6487-43bf-baa3-2a147a551bcf req-20ef0ae3-ecb4-4328-bed6-890296eebcd1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:17.492729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f709e551-6487-43bf-baa3-2a147a551bcf req-20ef0ae3-ecb4-4328-bed6-890296eebcd1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:17.549799 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f709e551-6487-43bf-baa3-2a147a551bcf req-20ef0ae3-ecb4-4328-bed6-890296eebcd1 service nova] Creating event network-vif-plugged:781f778e-35b9-4dc8-8331-1212ae734ea7 for instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 on n-h2-854823-1 Aug 27 04:47:17.567819 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f709e551-6487-43bf-baa3-2a147a551bcf req-20ef0ae3-ecb4-4328-bed6-890296eebcd1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126971 Aug 27 04:47:17.574490 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1816/3577] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:17.948030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-82b38cca-6873-431a-8363-9fdb6e7ce128 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:17.951367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-82b38cca-6873-431a-8363-9fdb6e7ce128 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:17.993450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82b38cca-6873-431a-8363-9fdb6e7ce128 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:18.000043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82b38cca-6873-431a-8363-9fdb6e7ce128 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:18.000719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82b38cca-6873-431a-8363-9fdb6e7ce128 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:18.008836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82b38cca-6873-431a-8363-9fdb6e7ce128 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:18.014631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82b38cca-6873-431a-8363-9fdb6e7ce128 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:18.015692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82b38cca-6873-431a-8363-9fdb6e7ce128 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:18.502044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-82b38cca-6873-431a-8363-9fdb6e7ce128 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:18.518118 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-82b38cca-6873-431a-8363-9fdb6e7ce128 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1520 microversion: 2.1 time: 0.575901 Aug 27 04:47:18.532054 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1762/3578] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:17 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1520 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:19.541561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c46d7ddb-472d-457b-9d93-53afa698593d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:19.542961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c46d7ddb-472d-457b-9d93-53afa698593d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:19.559477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c46d7ddb-472d-457b-9d93-53afa698593d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:19.563281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c46d7ddb-472d-457b-9d93-53afa698593d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:19.563794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c46d7ddb-472d-457b-9d93-53afa698593d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:19.564566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c46d7ddb-472d-457b-9d93-53afa698593d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:19.567099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c46d7ddb-472d-457b-9d93-53afa698593d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:19.567513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c46d7ddb-472d-457b-9d93-53afa698593d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:19.746297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2bcf506b-cd8d-4f48-ad33-6fc40a74eb1a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:19.761505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2bcf506b-cd8d-4f48-ad33-6fc40a74eb1a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:19.762968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2bcf506b-cd8d-4f48-ad33-6fc40a74eb1a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Searching by: {'deleted': False, 'project_id': '43debe5241484aa3b2ff9a740385e206'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:47:19.799112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bcf506b-cd8d-4f48-ad33-6fc40a74eb1a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:19.799603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bcf506b-cd8d-4f48-ad33-6fc40a74eb1a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:19.800040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bcf506b-cd8d-4f48-ad33-6fc40a74eb1a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:19.806269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bcf506b-cd8d-4f48-ad33-6fc40a74eb1a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:19.807805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bcf506b-cd8d-4f48-ad33-6fc40a74eb1a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:19.808267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bcf506b-cd8d-4f48-ad33-6fc40a74eb1a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:19.896807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-2bcf506b-cd8d-4f48-ad33-6fc40a74eb1a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:47:19.971278 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2bcf506b-cd8d-4f48-ad33-6fc40a74eb1a tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.231009 Aug 27 04:47:19.971889 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1763/3579] 10.222.0.79 () {58 vars in 1125 bytes} [Sat Aug 27 04:47:19 2022] GET /compute/v2.1/servers => generated 333 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:47:19.988490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:19.998693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:19.999387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Searching by: {'deleted': False, 'project_id': '43debe5241484aa3b2ff9a740385e206'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:47:20.017187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:20.017750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:20.018200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:20.019027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:20.019536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:20.019969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:20.071448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:47:20.147915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:20.158555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:20.159547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:20.160842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:20.452235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c46d7ddb-472d-457b-9d93-53afa698593d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:20.470572 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c46d7ddb-472d-457b-9d93-53afa698593d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1520 microversion: 2.1 time: 0.932731 Aug 27 04:47:20.472089 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1817/3580] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:19 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1520 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:20.936341 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-34c793f8-c23f-4b7c-92c8-165c2c965f08 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.952629 Aug 27 04:47:20.937066 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1764/3581] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:47:19 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:20.961287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b8379ae-9a38-412d-bdba-28e8d1e0f062 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:20.976953 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b8379ae-9a38-412d-bdba-28e8d1e0f062 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020554 Aug 27 04:47:20.977530 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1818/3582] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:47:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:21.193910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "67708b25-0f42-4b68-bae3-48b3464c38dd"}], "security_groups": [{"name": "tempest-securitygroup--1815933218"}], "key_name": "tempest-keypair-1303231670", "user_data": "}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:21.349376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b02ee7ff-ed14-4b1e-b64e-7759b13f9a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:21.350280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b02ee7ff-ed14-4b1e-b64e-7759b13f9a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:21.357369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02ee7ff-ed14-4b1e-b64e-7759b13f9a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:21.358199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02ee7ff-ed14-4b1e-b64e-7759b13f9a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:21.358926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02ee7ff-ed14-4b1e-b64e-7759b13f9a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:21.359851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02ee7ff-ed14-4b1e-b64e-7759b13f9a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:21.361125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02ee7ff-ed14-4b1e-b64e-7759b13f9a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:21.361823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02ee7ff-ed14-4b1e-b64e-7759b13f9a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:21.391141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b02ee7ff-ed14-4b1e-b64e-7759b13f9a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:47:21.518157 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b02ee7ff-ed14-4b1e-b64e-7759b13f9a3f tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 204 len: 0 microversion: 2.1 time: 0.172285 Aug 27 04:47:21.518883 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1819/3583] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:47:21 2022] DELETE /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:47:21.531731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ccc6e359-d4a1-4daa-bdeb-aa67c308633e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:21.534525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ccc6e359-d4a1-4daa-bdeb-aa67c308633e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:21.553126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccc6e359-d4a1-4daa-bdeb-aa67c308633e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:21.553674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccc6e359-d4a1-4daa-bdeb-aa67c308633e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:21.554132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccc6e359-d4a1-4daa-bdeb-aa67c308633e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:21.554872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccc6e359-d4a1-4daa-bdeb-aa67c308633e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:21.557529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccc6e359-d4a1-4daa-bdeb-aa67c308633e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:21.558164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccc6e359-d4a1-4daa-bdeb-aa67c308633e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:21.721589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] validate_networks() for [('67708b25-0f42-4b68-bae3-48b3464c38dd', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:47:21.991025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ccc6e359-d4a1-4daa-bdeb-aa67c308633e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:22.002691 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ccc6e359-d4a1-4daa-bdeb-aa67c308633e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1505 microversion: 2.1 time: 0.482507 Aug 27 04:47:22.009295 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1820/3584] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:21 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1505 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:22.014250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20930d1d-da94-4c7e-9455-806522407702 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:22.025449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20930d1d-da94-4c7e-9455-806522407702 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:22.028347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:22.033703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20930d1d-da94-4c7e-9455-806522407702 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:22.034470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20930d1d-da94-4c7e-9455-806522407702 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:22.035079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20930d1d-da94-4c7e-9455-806522407702 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:22.035996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20930d1d-da94-4c7e-9455-806522407702 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:22.036647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20930d1d-da94-4c7e-9455-806522407702 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:22.037253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20930d1d-da94-4c7e-9455-806522407702 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:22.462569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-20930d1d-da94-4c7e-9455-806522407702 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:22.477270 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20930d1d-da94-4c7e-9455-806522407702 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1701 microversion: 2.1 time: 0.466684 Aug 27 04:47:22.478077 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1821/3585] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:22 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1701 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:22.482778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3bf1685e-dce8-4714-bfc7-a2ab465da32b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:22.484855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3bf1685e-dce8-4714-bfc7-a2ab465da32b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:22.500485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bf1685e-dce8-4714-bfc7-a2ab465da32b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:22.501238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bf1685e-dce8-4714-bfc7-a2ab465da32b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:22.502070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bf1685e-dce8-4714-bfc7-a2ab465da32b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:22.502784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bf1685e-dce8-4714-bfc7-a2ab465da32b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:22.503570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bf1685e-dce8-4714-bfc7-a2ab465da32b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:22.513553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bf1685e-dce8-4714-bfc7-a2ab465da32b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:22.725018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3bf1685e-dce8-4714-bfc7-a2ab465da32b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:22.750081 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3bf1685e-dce8-4714-bfc7-a2ab465da32b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 200 len: 1505 microversion: 2.1 time: 0.270587 Aug 27 04:47:22.765718 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1822/3586] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:22 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 1505 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:22.771917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ee180b3-5628-4a55-96ae-cf7ef3342396 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:22.773717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ee180b3-5628-4a55-96ae-cf7ef3342396 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:22.781732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ee180b3-5628-4a55-96ae-cf7ef3342396 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:22.783069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ee180b3-5628-4a55-96ae-cf7ef3342396 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:22.783896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ee180b3-5628-4a55-96ae-cf7ef3342396 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:22.785148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ee180b3-5628-4a55-96ae-cf7ef3342396 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:22.785790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ee180b3-5628-4a55-96ae-cf7ef3342396 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:22.786392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ee180b3-5628-4a55-96ae-cf7ef3342396 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:22.843150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ee180b3-5628-4a55-96ae-cf7ef3342396 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:47:23.051428 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ee180b3-5628-4a55-96ae-cf7ef3342396 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "DELETE /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 204 len: 0 microversion: 2.1 time: 0.282787 Aug 27 04:47:23.053095 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1823/3587] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:47:22 2022] DELETE /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:47:23.250838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:47:23.252388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:47:23.253363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:47:23.253988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:47:23.254612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:47:23.283715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:23.284596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:23.285267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:23.287432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:23.290728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1586894053", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "6f0920ec-49cc-4dfa-9dcd-4228f9b8efc6"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:23.291436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:23.292074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:23.336909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Getting quotas for project 15f71b93ab8e4df8a74a33ca47530ffd. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:47:23.356107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Getting quotas for user d4826941efc443aba3e8ce6f2b67ac55 and project 15f71b93ab8e4df8a74a33ca47530ffd. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:47:23.391194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] validate_networks() for [('6f0920ec-49cc-4dfa-9dcd-4228f9b8efc6', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:47:23.394078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:47:23.397061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:47:23.516090 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6f9164a7-853c-4bb2-b0ad-17476759234b tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.327407 Aug 27 04:47:23.518716 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1765/3588] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:47:21 2022] POST /compute/v2.1/servers => generated 409 bytes in 2331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:47:23.535758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b42cc44e-b896-4555-a4d0-f4d7d433d4dc tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:23.536742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b42cc44e-b896-4555-a4d0-f4d7d433d4dc tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:23.561129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b42cc44e-b896-4555-a4d0-f4d7d433d4dc tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:23.565904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b42cc44e-b896-4555-a4d0-f4d7d433d4dc tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:23.566527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b42cc44e-b896-4555-a4d0-f4d7d433d4dc tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:23.567472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b42cc44e-b896-4555-a4d0-f4d7d433d4dc tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:23.568299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b42cc44e-b896-4555-a4d0-f4d7d433d4dc tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:23.569504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b42cc44e-b896-4555-a4d0-f4d7d433d4dc tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:23.970581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b42cc44e-b896-4555-a4d0-f4d7d433d4dc tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:23.980590 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b42cc44e-b896-4555-a4d0-f4d7d433d4dc tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1701 microversion: 2.1 time: 0.456176 Aug 27 04:47:24.010516 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1766/3589] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:23 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1701 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:24.022837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b5deae4b-36fa-4630-a215-82439ef5d4a6 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:24.023852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b5deae4b-36fa-4630-a215-82439ef5d4a6 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:24.126529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b5deae4b-36fa-4630-a215-82439ef5d4a6 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:24.136820 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b5deae4b-36fa-4630-a215-82439ef5d4a6 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1226 microversion: 2.1 time: 0.124207 Aug 27 04:47:24.140971 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1767/3590] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:24 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1226 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:25.003900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dcf6a2ad-7968-430d-ab62-65140fdf5940 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:25.004781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dcf6a2ad-7968-430d-ab62-65140fdf5940 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:25.013745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcf6a2ad-7968-430d-ab62-65140fdf5940 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:25.024955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcf6a2ad-7968-430d-ab62-65140fdf5940 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:25.025609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcf6a2ad-7968-430d-ab62-65140fdf5940 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:25.026515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcf6a2ad-7968-430d-ab62-65140fdf5940 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:25.027074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcf6a2ad-7968-430d-ab62-65140fdf5940 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:25.027597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcf6a2ad-7968-430d-ab62-65140fdf5940 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:25.068006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:25.728499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dcf6a2ad-7968-430d-ab62-65140fdf5940 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:25.739308 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dcf6a2ad-7968-430d-ab62-65140fdf5940 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1701 microversion: 2.1 time: 0.740625 Aug 27 04:47:25.756623 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1768/3591] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:24 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1701 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:25.761967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4b5dbc28-e6bf-4691-8288-b55e28cdecfd tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:25.772104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4b5dbc28-e6bf-4691-8288-b55e28cdecfd tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:25.780023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b5dbc28-e6bf-4691-8288-b55e28cdecfd tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:25.789370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b5dbc28-e6bf-4691-8288-b55e28cdecfd tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:25.790127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b5dbc28-e6bf-4691-8288-b55e28cdecfd tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:25.791057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b5dbc28-e6bf-4691-8288-b55e28cdecfd tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:25.791907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b5dbc28-e6bf-4691-8288-b55e28cdecfd tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:25.792546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b5dbc28-e6bf-4691-8288-b55e28cdecfd tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:25.992621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4b5dbc28-e6bf-4691-8288-b55e28cdecfd tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:26.011596 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4b5dbc28-e6bf-4691-8288-b55e28cdecfd tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1284 microversion: 2.1 time: 0.252039 Aug 27 04:47:26.013077 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1769/3592] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:25 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:26.107557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-85361cbd-e221-49a8-bb61-ec8e20a9def1 req-b42e3bb4-5d0b-4ff2-ab05-f0b3a6a25cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "130e56b9-8431-4e83-a7b1-3bad46f54e33", "name": "network-vif-deleted", "tag": "781f778e-35b9-4dc8-8331-1212ae734ea7"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:26.113731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:26.137751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-85361cbd-e221-49a8-bb61-ec8e20a9def1 req-b42e3bb4-5d0b-4ff2-ab05-f0b3a6a25cd4 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:26.138355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-85361cbd-e221-49a8-bb61-ec8e20a9def1 req-b42e3bb4-5d0b-4ff2-ab05-f0b3a6a25cd4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:26.139066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-85361cbd-e221-49a8-bb61-ec8e20a9def1 req-b42e3bb4-5d0b-4ff2-ab05-f0b3a6a25cd4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:26.175173 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-85361cbd-e221-49a8-bb61-ec8e20a9def1 req-b42e3bb4-5d0b-4ff2-ab05-f0b3a6a25cd4 service nova] Creating event network-vif-deleted:781f778e-35b9-4dc8-8331-1212ae734ea7 for instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 on n-h2-854823-1 Aug 27 04:47:26.215337 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-85361cbd-e221-49a8-bb61-ec8e20a9def1 req-b42e3bb4-5d0b-4ff2-ab05-f0b3a6a25cd4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111943 Aug 27 04:47:26.221681 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1770/3593] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:47:26.784605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ab013b5a-f119-4dc4-8243-cb638054d163 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:26.786539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ab013b5a-f119-4dc4-8243-cb638054d163 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:26.824135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab013b5a-f119-4dc4-8243-cb638054d163 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:26.824701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab013b5a-f119-4dc4-8243-cb638054d163 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:26.825719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab013b5a-f119-4dc4-8243-cb638054d163 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:26.834248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab013b5a-f119-4dc4-8243-cb638054d163 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:26.835859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab013b5a-f119-4dc4-8243-cb638054d163 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:26.837050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab013b5a-f119-4dc4-8243-cb638054d163 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:26.964045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:47:26.964481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:47:26.964981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:47:26.965399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:47:26.965987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:47:26.989048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:26.990059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:26.997834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:26.999669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:27.000859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:27.001695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:27.081673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Getting quotas for project 35481e527d554cffb51339a61b5b25c0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:47:27.120521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Getting quotas for user 12e5c6081bd441a4b105b405703b1325 and project 35481e527d554cffb51339a61b5b25c0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:47:27.177012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:47:27.181695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:47:27.337734 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2eceea4f-5ee3-4364-a333-ed32960a5190 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.052264 Aug 27 04:47:27.339785 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1824/3594] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:47:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 4055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:47:28.069607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ab22c5a4-a8e4-4de5-98f7-a4c191e88ed8 req-9712fec6-1df1-42b5-acca-04c0ced3bdab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9f88cb-3d33-4bb6-b1b1-570e69789a80", "name": "network-vif-unplugged", "status": "completed", "tag": "4116a740-d705-44a1-b1b6-2c0b32385de0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:28.117242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ab22c5a4-a8e4-4de5-98f7-a4c191e88ed8 req-9712fec6-1df1-42b5-acca-04c0ced3bdab service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:28.119069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ab22c5a4-a8e4-4de5-98f7-a4c191e88ed8 req-9712fec6-1df1-42b5-acca-04c0ced3bdab service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:28.122566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ab22c5a4-a8e4-4de5-98f7-a4c191e88ed8 req-9712fec6-1df1-42b5-acca-04c0ced3bdab service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:28.155979 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ab22c5a4-a8e4-4de5-98f7-a4c191e88ed8 req-9712fec6-1df1-42b5-acca-04c0ced3bdab service nova] Creating event network-vif-unplugged:4116a740-d705-44a1-b1b6-2c0b32385de0 for instance cb9f88cb-3d33-4bb6-b1b1-570e69789a80 on n-h1-854823-1 Aug 27 04:47:28.169705 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ab22c5a4-a8e4-4de5-98f7-a4c191e88ed8 req-9712fec6-1df1-42b5-acca-04c0ced3bdab service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.827303 Aug 27 04:47:28.170138 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1825/3595] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:28.192033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a820e7b2-926e-4017-9fc6-80b57c00c422 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:28.193143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a820e7b2-926e-4017-9fc6-80b57c00c422 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:28.208939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a820e7b2-926e-4017-9fc6-80b57c00c422 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:28.209830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a820e7b2-926e-4017-9fc6-80b57c00c422 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:28.210529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a820e7b2-926e-4017-9fc6-80b57c00c422 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:28.212278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a820e7b2-926e-4017-9fc6-80b57c00c422 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:28.214790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a820e7b2-926e-4017-9fc6-80b57c00c422 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:28.216081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a820e7b2-926e-4017-9fc6-80b57c00c422 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:28.433843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ab013b5a-f119-4dc4-8243-cb638054d163 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:28.454567 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ab013b5a-f119-4dc4-8243-cb638054d163 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1701 microversion: 2.1 time: 1.686095 Aug 27 04:47:28.455803 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1771/3596] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:26 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1701 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:28.481824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a820e7b2-926e-4017-9fc6-80b57c00c422 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:28.501571 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a820e7b2-926e-4017-9fc6-80b57c00c422 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1284 microversion: 2.1 time: 0.315215 Aug 27 04:47:28.524257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7b065159-013c-47b4-bb4d-0112c6c47160 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:28.526923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7b065159-013c-47b4-bb4d-0112c6c47160 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:28.527073 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1826/3597] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:28 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1284 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:28.924823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b065159-013c-47b4-bb4d-0112c6c47160 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:28.933835 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7b065159-013c-47b4-bb4d-0112c6c47160 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1218 microversion: 2.1 time: 0.446862 Aug 27 04:47:28.934472 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1772/3598] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:28 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1218 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:29.477135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8408535-6d29-48e8-8a9d-881fdc631168 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:29.477746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b8408535-6d29-48e8-8a9d-881fdc631168 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:29.491183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8408535-6d29-48e8-8a9d-881fdc631168 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:29.491464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8408535-6d29-48e8-8a9d-881fdc631168 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:29.491890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8408535-6d29-48e8-8a9d-881fdc631168 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:29.503975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8408535-6d29-48e8-8a9d-881fdc631168 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:29.504711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8408535-6d29-48e8-8a9d-881fdc631168 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:29.505163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8408535-6d29-48e8-8a9d-881fdc631168 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:29.534764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e98319b4-c1b0-4ffc-9538-52e77cd148e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:29.536083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e98319b4-c1b0-4ffc-9538-52e77cd148e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:29.552241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e98319b4-c1b0-4ffc-9538-52e77cd148e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:29.557299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e98319b4-c1b0-4ffc-9538-52e77cd148e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:29.558007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e98319b4-c1b0-4ffc-9538-52e77cd148e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:29.558949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e98319b4-c1b0-4ffc-9538-52e77cd148e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:29.559430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e98319b4-c1b0-4ffc-9538-52e77cd148e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:29.559866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e98319b4-c1b0-4ffc-9538-52e77cd148e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:29.580284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:30.005861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e98319b4-c1b0-4ffc-9538-52e77cd148e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:30.027238 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e98319b4-c1b0-4ffc-9538-52e77cd148e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1284 microversion: 2.1 time: 0.496611 Aug 27 04:47:30.034994 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1773/3599] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:29 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1284 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:30.048427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f0b2c220-7eeb-4315-b1b6-6f754da039fd tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:30.049598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f0b2c220-7eeb-4315-b1b6-6f754da039fd tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:30.082833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0b2c220-7eeb-4315-b1b6-6f754da039fd tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:30.084523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0b2c220-7eeb-4315-b1b6-6f754da039fd tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:30.085793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0b2c220-7eeb-4315-b1b6-6f754da039fd tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:30.086883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0b2c220-7eeb-4315-b1b6-6f754da039fd tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:30.087550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0b2c220-7eeb-4315-b1b6-6f754da039fd tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:30.090113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0b2c220-7eeb-4315-b1b6-6f754da039fd tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:30.317198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b8408535-6d29-48e8-8a9d-881fdc631168 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3ef15e74a342f6915052624a0f19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43debe5241484aa3b2ff9a740385e206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:30.340409 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b8408535-6d29-48e8-8a9d-881fdc631168 tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 200 len: 1354 microversion: 2.1 time: 0.867101 Aug 27 04:47:30.341045 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1827/3600] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:29 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 1354 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:30.551040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-56ac5a40-9cb1-4cfb-989d-3af128094c2b req-bad9df9d-5d90-491f-bd82-d5ee5fdd0442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9f88cb-3d33-4bb6-b1b1-570e69789a80", "name": "network-vif-deleted", "tag": "4116a740-d705-44a1-b1b6-2c0b32385de0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:30.565538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-56ac5a40-9cb1-4cfb-989d-3af128094c2b req-bad9df9d-5d90-491f-bd82-d5ee5fdd0442 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:30.566290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-56ac5a40-9cb1-4cfb-989d-3af128094c2b req-bad9df9d-5d90-491f-bd82-d5ee5fdd0442 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:30.566926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-56ac5a40-9cb1-4cfb-989d-3af128094c2b req-bad9df9d-5d90-491f-bd82-d5ee5fdd0442 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:30.581895 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-56ac5a40-9cb1-4cfb-989d-3af128094c2b req-bad9df9d-5d90-491f-bd82-d5ee5fdd0442 service nova] Creating event network-vif-deleted:4116a740-d705-44a1-b1b6-2c0b32385de0 for instance cb9f88cb-3d33-4bb6-b1b1-570e69789a80 on n-h1-854823-1 Aug 27 04:47:30.588382 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-56ac5a40-9cb1-4cfb-989d-3af128094c2b req-bad9df9d-5d90-491f-bd82-d5ee5fdd0442 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245294 Aug 27 04:47:30.589503 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1828/3601] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:30.872301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f0b2c220-7eeb-4315-b1b6-6f754da039fd tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:30.892467 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f0b2c220-7eeb-4315-b1b6-6f754da039fd tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1288 microversion: 2.1 time: 0.854512 Aug 27 04:47:30.893416 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1774/3602] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:30 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1288 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:31.055664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aedb756b-39ea-4e37-b2b6-83a10aa09518 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:31.056376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aedb756b-39ea-4e37-b2b6-83a10aa09518 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:31.071306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aedb756b-39ea-4e37-b2b6-83a10aa09518 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:31.071866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aedb756b-39ea-4e37-b2b6-83a10aa09518 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:31.072312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aedb756b-39ea-4e37-b2b6-83a10aa09518 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:31.073090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aedb756b-39ea-4e37-b2b6-83a10aa09518 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:31.073743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aedb756b-39ea-4e37-b2b6-83a10aa09518 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:31.074341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aedb756b-39ea-4e37-b2b6-83a10aa09518 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:31.363608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a0002022-19dc-4a3c-b716-956d18f432da tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:31.364229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a0002022-19dc-4a3c-b716-956d18f432da tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] [instance: cb9f88cb-3d33-4bb6-b1b1-570e69789a80] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:31.376671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0002022-19dc-4a3c-b716-956d18f432da tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:31.377175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0002022-19dc-4a3c-b716-956d18f432da tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:31.383857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0002022-19dc-4a3c-b716-956d18f432da tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:31.384782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0002022-19dc-4a3c-b716-956d18f432da tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:31.385430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0002022-19dc-4a3c-b716-956d18f432da tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:31.388106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0002022-19dc-4a3c-b716-956d18f432da tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:31.459253 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-a0002022-19dc-4a3c-b716-956d18f432da tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] HTTP exception thrown: Instance cb9f88cb-3d33-4bb6-b1b1-570e69789a80 could not be found. Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a0002022-19dc-4a3c-b716-956d18f432da tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Request method failure captured: Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 HTTP/1.1 Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaFnKQAqHkOs0BEfJj3s4kvXf-OqgUi5zbX9YRX_OY2t1_EsfhkeRFaZSLwZgW-UVuA-jx9y-Kg-r4SDP70wrqvcXxw8RqkygAp3M0H4jUCV6hZlIeeyvNWoqkitQN5Rq561sgUizO5hUREWRrBxuln2z1k7ialW5S_inoJCMRvyNBs Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 43debe5241484aa3b2ff9a740385e206 Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestJSON-786424846 Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/43debe5241484aa3b2ff9a740385e206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_43debe5241484aa3b2ff9a740385e206"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/43debe5241484aa3b2ff9a740385e206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/43debe5241484aa3b2ff9a740385e206"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestJSON-786424846 Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 43debe5241484aa3b2ff9a740385e206 Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestJSON-786424846 Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestJSON-786424846-project Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3a3ef15e74a342f6915052624a0f19a1 Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestJSON-786424846-project Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance cb9f88cb-3d33-4bb6-b1b1-570e69789a80 could not be found. Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'cb9f88cb-3d33-4bb6-b1b1-570e69789a80'} Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb9f88cb-3d33-4bb6-b1b1-570e69789a80 could not be found. Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb9f88cb-3d33-4bb6-b1b1-570e69789a80 could not be found. Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:31.466516 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:47:31.472124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:47:31.472124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:47:31.472124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:47:31.472124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:47:31.472124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb9f88cb-3d33-4bb6-b1b1-570e69789a80 could not be found. Aug 27 04:47:31.472124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:47:31.477152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a0002022-19dc-4a3c-b716-956d18f432da tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Returning 404 to user: Instance cb9f88cb-3d33-4bb6-b1b1-570e69789a80 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:47:31.483406 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a0002022-19dc-4a3c-b716-956d18f432da tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80" status: 404 len: 111 microversion: 2.1 time: 0.124659 Aug 27 04:47:31.484690 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1775/3603] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:31 2022] GET /compute/v2.1/servers/cb9f88cb-3d33-4bb6-b1b1-570e69789a80 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:47:31.502236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-530dd301-8fc6-4bfb-9c34-347c1abefdcd tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] Calling method '.version_select at 0x7f1f2174bf70>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:31.552390 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-530dd301-8fc6-4bfb-9c34-347c1abefdcd tempest-ServersTestJSON-786424846 tempest-ServersTestJSON-786424846-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980650497" status: 202 len: 0 microversion: 2.1 time: 0.056135 Aug 27 04:47:31.553265 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1776/3604] 10.222.0.79 () {58 vars in 1221 bytes} [Sat Aug 27 04:47:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980650497 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:47:31.628197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aedb756b-39ea-4e37-b2b6-83a10aa09518 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:31.644966 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aedb756b-39ea-4e37-b2b6-83a10aa09518 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1352 microversion: 2.1 time: 0.590325 Aug 27 04:47:31.645810 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1829/3605] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:31 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1352 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:31.918222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fa7c2636-4f8d-4927-8757-1098f57a458f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:31.919695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fa7c2636-4f8d-4927-8757-1098f57a458f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:31.939330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa7c2636-4f8d-4927-8757-1098f57a458f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:31.940764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa7c2636-4f8d-4927-8757-1098f57a458f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:31.941561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa7c2636-4f8d-4927-8757-1098f57a458f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:31.942814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa7c2636-4f8d-4927-8757-1098f57a458f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:31.944146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa7c2636-4f8d-4927-8757-1098f57a458f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:31.945874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa7c2636-4f8d-4927-8757-1098f57a458f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:32.679093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95c945c2-22b9-41fe-8fb7-ad1c47ac3aa0 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:32.681845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95c945c2-22b9-41fe-8fb7-ad1c47ac3aa0 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:32.707274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95c945c2-22b9-41fe-8fb7-ad1c47ac3aa0 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:32.709610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95c945c2-22b9-41fe-8fb7-ad1c47ac3aa0 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:32.710582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95c945c2-22b9-41fe-8fb7-ad1c47ac3aa0 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:32.711494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95c945c2-22b9-41fe-8fb7-ad1c47ac3aa0 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:32.712300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95c945c2-22b9-41fe-8fb7-ad1c47ac3aa0 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:32.713143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95c945c2-22b9-41fe-8fb7-ad1c47ac3aa0 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:33.300262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:33.351841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95c945c2-22b9-41fe-8fb7-ad1c47ac3aa0 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:33.394977 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95c945c2-22b9-41fe-8fb7-ad1c47ac3aa0 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1352 microversion: 2.1 time: 0.729106 Aug 27 04:47:33.396476 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1830/3606] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:32 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1352 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:33.524112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4661b6a3-ce3b-418c-82df-bfedb3c54abd req-2dab7af6-ef20-47d5-b85d-bcf0c9c5947f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "423f7d58-0ec5-452f-8c1b-558fd0d10293", "tag": "47a9aae8-84c6-4e31-bdff-f23bce77ca6c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:33.550991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4661b6a3-ce3b-418c-82df-bfedb3c54abd req-2dab7af6-ef20-47d5-b85d-bcf0c9c5947f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:33.552594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4661b6a3-ce3b-418c-82df-bfedb3c54abd req-2dab7af6-ef20-47d5-b85d-bcf0c9c5947f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:33.553202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4661b6a3-ce3b-418c-82df-bfedb3c54abd req-2dab7af6-ef20-47d5-b85d-bcf0c9c5947f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:33.614900 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4661b6a3-ce3b-418c-82df-bfedb3c54abd req-2dab7af6-ef20-47d5-b85d-bcf0c9c5947f service nova] Creating event network-changed:47a9aae8-84c6-4e31-bdff-f23bce77ca6c for instance 423f7d58-0ec5-452f-8c1b-558fd0d10293 on n-h1-854823-1 Aug 27 04:47:33.627097 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4661b6a3-ce3b-418c-82df-bfedb3c54abd req-2dab7af6-ef20-47d5-b85d-bcf0c9c5947f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117684 Aug 27 04:47:33.628929 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1831/3607] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:33.689883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fa7c2636-4f8d-4927-8757-1098f57a458f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:33.700819 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fa7c2636-4f8d-4927-8757-1098f57a458f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1318 microversion: 2.1 time: 1.787251 Aug 27 04:47:33.717294 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1777/3608] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:31 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1318 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:34.425101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13fde24b-f294-4894-9ae9-9fb55184e039 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:34.426165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13fde24b-f294-4894-9ae9-9fb55184e039 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:34.464029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13fde24b-f294-4894-9ae9-9fb55184e039 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:34.466855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13fde24b-f294-4894-9ae9-9fb55184e039 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:34.467304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13fde24b-f294-4894-9ae9-9fb55184e039 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:34.470670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13fde24b-f294-4894-9ae9-9fb55184e039 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:34.471145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13fde24b-f294-4894-9ae9-9fb55184e039 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:34.473023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13fde24b-f294-4894-9ae9-9fb55184e039 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:34.724759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-70d260f1-3fca-456c-b020-fc595e9f5495 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:34.732381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-70d260f1-3fca-456c-b020-fc595e9f5495 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:34.757260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70d260f1-3fca-456c-b020-fc595e9f5495 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:34.758225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70d260f1-3fca-456c-b020-fc595e9f5495 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:34.758850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70d260f1-3fca-456c-b020-fc595e9f5495 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:34.759745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70d260f1-3fca-456c-b020-fc595e9f5495 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:34.762307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70d260f1-3fca-456c-b020-fc595e9f5495 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:34.762951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70d260f1-3fca-456c-b020-fc595e9f5495 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:35.634171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-70d260f1-3fca-456c-b020-fc595e9f5495 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:35.642775 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-70d260f1-3fca-456c-b020-fc595e9f5495 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1318 microversion: 2.1 time: 0.921943 Aug 27 04:47:35.643380 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1778/3609] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:34 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1318 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:36.061348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13fde24b-f294-4894-9ae9-9fb55184e039 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:36.074749 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13fde24b-f294-4894-9ae9-9fb55184e039 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1352 microversion: 2.1 time: 1.658252 Aug 27 04:47:36.076181 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1832/3610] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:34 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1352 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:36.667718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-839ffc7e-de92-4e4e-aa96-be9b320f0e4b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:36.670095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-839ffc7e-de92-4e4e-aa96-be9b320f0e4b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:36.686818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-839ffc7e-de92-4e4e-aa96-be9b320f0e4b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:36.687541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-839ffc7e-de92-4e4e-aa96-be9b320f0e4b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:36.688301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-839ffc7e-de92-4e4e-aa96-be9b320f0e4b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:36.689360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-839ffc7e-de92-4e4e-aa96-be9b320f0e4b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:36.689938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-839ffc7e-de92-4e4e-aa96-be9b320f0e4b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:36.690765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-839ffc7e-de92-4e4e-aa96-be9b320f0e4b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:37.033248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:37.110575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1388626830", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:37.144139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:37.294889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] validate_networks() for [('cc0608a5-bc7b-480a-bfdf-5a46c273626a', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:47:38.697073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:47:38.698443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:47:38.699655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:47:38.701581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:47:38.702723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:47:38.734169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:38.735107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:38.738776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:38.739992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:38.742155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:38.744618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:38.793852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Getting quotas for project 0ce5800ecb484a6ca7a9894cc4530bf4. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:47:38.812366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Getting quotas for user 81b0ef617031436484e9e987f972ae0a and project 0ce5800ecb484a6ca7a9894cc4530bf4. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:47:38.835927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:47:38.838879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:47:38.925445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-839ffc7e-de92-4e4e-aa96-be9b320f0e4b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:38.929081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=16 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:38.947266 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-839ffc7e-de92-4e4e-aa96-be9b320f0e4b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1318 microversion: 2.1 time: 2.275285 Aug 27 04:47:38.947949 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1779/3611] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:36 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1318 bytes in 2288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:38.974437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a461a6d1-1bbc-4004-932f-d6a4f12f44e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:38.975062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a461a6d1-1bbc-4004-932f-d6a4f12f44e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:38.991974 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60cb851b-d3e1-4c5f-988b-589fd512b453 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.982529 Aug 27 04:47:38.998297 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1833/3612] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:47:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:47:39.004394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb13dce2-b000-4de8-9e60-2ffdfaa9d8a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:39.005133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb13dce2-b000-4de8-9e60-2ffdfaa9d8a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:39.005277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a461a6d1-1bbc-4004-932f-d6a4f12f44e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:39.005655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a461a6d1-1bbc-4004-932f-d6a4f12f44e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:39.006104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a461a6d1-1bbc-4004-932f-d6a4f12f44e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:39.015563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a461a6d1-1bbc-4004-932f-d6a4f12f44e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:39.016149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a461a6d1-1bbc-4004-932f-d6a4f12f44e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:39.021721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a461a6d1-1bbc-4004-932f-d6a4f12f44e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:39.303339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eb13dce2-b000-4de8-9e60-2ffdfaa9d8a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:39.316222 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb13dce2-b000-4de8-9e60-2ffdfaa9d8a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1222 microversion: 2.1 time: 0.316508 Aug 27 04:47:39.316981 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1834/3613] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:38 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1222 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:39.471897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a461a6d1-1bbc-4004-932f-d6a4f12f44e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:39.480506 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a461a6d1-1bbc-4004-932f-d6a4f12f44e3 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1352 microversion: 2.1 time: 0.510083 Aug 27 04:47:39.481135 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1780/3614] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:38 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1352 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:39.519482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-550345270", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:39.632685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] validate_networks() for [('cc0608a5-bc7b-480a-bfdf-5a46c273626a', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:47:39.973074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fb1ecbf6-b21e-4a07-be73-b3824dfcd994 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:39.974548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fb1ecbf6-b21e-4a07-be73-b3824dfcd994 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:39.991419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1ecbf6-b21e-4a07-be73-b3824dfcd994 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:39.992314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1ecbf6-b21e-4a07-be73-b3824dfcd994 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:39.993033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1ecbf6-b21e-4a07-be73-b3824dfcd994 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:39.994027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1ecbf6-b21e-4a07-be73-b3824dfcd994 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:39.994845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1ecbf6-b21e-4a07-be73-b3824dfcd994 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:39.995385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1ecbf6-b21e-4a07-be73-b3824dfcd994 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:40.958996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:47:40.961024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:47:40.961945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:47:40.962584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:47:40.963214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:47:40.988544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:40.989090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:40.989729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:40.991155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fb1ecbf6-b21e-4a07-be73-b3824dfcd994 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:40.994920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:41.004551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:41.005197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:41.020986 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fb1ecbf6-b21e-4a07-be73-b3824dfcd994 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1318 microversion: 2.1 time: 1.051722 Aug 27 04:47:41.023112 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1781/3615] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:39 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1318 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:41.034787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-076b8327-fc21-44d0-9e78-615ee310e324 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:41.035516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-076b8327-fc21-44d0-9e78-615ee310e324 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:41.053538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-076b8327-fc21-44d0-9e78-615ee310e324 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:41.056463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-076b8327-fc21-44d0-9e78-615ee310e324 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:41.059489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-076b8327-fc21-44d0-9e78-615ee310e324 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:41.060884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-076b8327-fc21-44d0-9e78-615ee310e324 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:41.064186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-076b8327-fc21-44d0-9e78-615ee310e324 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:41.064682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-076b8327-fc21-44d0-9e78-615ee310e324 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:41.075542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Getting quotas for project 0ce5800ecb484a6ca7a9894cc4530bf4. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:47:41.083442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Getting quotas for user 81b0ef617031436484e9e987f972ae0a and project 0ce5800ecb484a6ca7a9894cc4530bf4. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:47:41.106108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:47:41.109295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:47:41.192217 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0685b6f1-a56b-4aaa-9f1d-cd50885998f0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.677747 Aug 27 04:47:41.193537 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1835/3616] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:47:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:47:41.199468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-498b7ad1-9505-4258-b970-fd5a26985033 req-bc4a0177-d787-4047-975f-e8c450eba5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60af8f98-57c0-40d9-bbeb-76c6590b5ab8", "tag": "8d25edcd-e60e-49d5-8bc2-fe022383be5b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:41.214160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-498b7ad1-9505-4258-b970-fd5a26985033 req-bc4a0177-d787-4047-975f-e8c450eba5f3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:41.214961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-498b7ad1-9505-4258-b970-fd5a26985033 req-bc4a0177-d787-4047-975f-e8c450eba5f3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:41.215614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-498b7ad1-9505-4258-b970-fd5a26985033 req-bc4a0177-d787-4047-975f-e8c450eba5f3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:41.270406 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-498b7ad1-9505-4258-b970-fd5a26985033 req-bc4a0177-d787-4047-975f-e8c450eba5f3 service nova] Creating event network-changed:8d25edcd-e60e-49d5-8bc2-fe022383be5b for instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 on n-h2-854823-1 Aug 27 04:47:41.327340 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-498b7ad1-9505-4258-b970-fd5a26985033 req-bc4a0177-d787-4047-975f-e8c450eba5f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126160 Aug 27 04:47:41.332148 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1836/3617] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:41.350878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-11b2ba64-b212-44b1-907f-be448bccbbc4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:41.351764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-11b2ba64-b212-44b1-907f-be448bccbbc4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:41.658760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11b2ba64-b212-44b1-907f-be448bccbbc4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:41.671757 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-11b2ba64-b212-44b1-907f-be448bccbbc4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1221 microversion: 2.1 time: 0.338189 Aug 27 04:47:41.681790 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1837/3618] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:41 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1221 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:41.681790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1596900811", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "180cd323-2b16-4579-8ea5-c386f62d81fb"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:41.765412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] validate_networks() for [('180cd323-2b16-4579-8ea5-c386f62d81fb', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:47:42.293525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-076b8327-fc21-44d0-9e78-615ee310e324 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:42.320094 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-076b8327-fc21-44d0-9e78-615ee310e324 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1352 microversion: 2.1 time: 1.287234 Aug 27 04:47:42.323088 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1782/3619] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:41 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1352 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:42.331790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb48058a-4947-4b22-96e4-1e51cbf72ffc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:42.333282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eb48058a-4947-4b22-96e4-1e51cbf72ffc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:42.343799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb48058a-4947-4b22-96e4-1e51cbf72ffc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:42.345540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb48058a-4947-4b22-96e4-1e51cbf72ffc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:42.346403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb48058a-4947-4b22-96e4-1e51cbf72ffc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:42.348757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb48058a-4947-4b22-96e4-1e51cbf72ffc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:42.349523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb48058a-4947-4b22-96e4-1e51cbf72ffc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:42.350521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb48058a-4947-4b22-96e4-1e51cbf72ffc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:43.123457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb48058a-4947-4b22-96e4-1e51cbf72ffc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:43.133571 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb48058a-4947-4b22-96e4-1e51cbf72ffc tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1318 microversion: 2.1 time: 0.808945 Aug 27 04:47:43.134613 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1783/3620] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:42 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1318 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:43.141678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7f9b3fb-5d91-4adf-8dab-f17a5a2a9333 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:43.142892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c7f9b3fb-5d91-4adf-8dab-f17a5a2a9333 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:43.152892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7f9b3fb-5d91-4adf-8dab-f17a5a2a9333 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:43.153477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7f9b3fb-5d91-4adf-8dab-f17a5a2a9333 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:43.154218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7f9b3fb-5d91-4adf-8dab-f17a5a2a9333 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:43.156105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7f9b3fb-5d91-4adf-8dab-f17a5a2a9333 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:43.158323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7f9b3fb-5d91-4adf-8dab-f17a5a2a9333 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:43.159053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7f9b3fb-5d91-4adf-8dab-f17a5a2a9333 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:43.409388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c7f9b3fb-5d91-4adf-8dab-f17a5a2a9333 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:43.422118 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7f9b3fb-5d91-4adf-8dab-f17a5a2a9333 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1281 microversion: 2.1 time: 0.285805 Aug 27 04:47:43.423739 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1784/3621] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:43 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1281 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:43.429428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-739fd866-deb2-4d9d-a854-321a2c804e08 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:43.430364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-739fd866-deb2-4d9d-a854-321a2c804e08 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:43.437158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-739fd866-deb2-4d9d-a854-321a2c804e08 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:43.438537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-739fd866-deb2-4d9d-a854-321a2c804e08 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:43.439525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-739fd866-deb2-4d9d-a854-321a2c804e08 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:43.440505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-739fd866-deb2-4d9d-a854-321a2c804e08 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:43.441389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-739fd866-deb2-4d9d-a854-321a2c804e08 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:43.442048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-739fd866-deb2-4d9d-a854-321a2c804e08 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:43.916040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:47:43.917322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:47:43.917823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:47:43.918558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:47:43.918999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:47:43.952513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:43.953237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:43.954447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:43.955403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:43.956216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:43.956853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:44.048623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Getting quotas for project 889a88a84a944f8d9330720e0134f0aa. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:47:44.062575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Getting quotas for user 6e30d1322c924a3d979d7c3bd647ecab and project 889a88a84a944f8d9330720e0134f0aa. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:47:44.083360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:47:44.087631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:47:44.122853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=11 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:44.145271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-739fd866-deb2-4d9d-a854-321a2c804e08 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:44.155558 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f48bcf0b-fba5-497e-97e5-93601d64ee14 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.479473 Aug 27 04:47:44.156832 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1838/3622] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:47:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:47:44.162016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54d8ca9d-bee2-45e5-b20b-67905bce013c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:44.163030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-54d8ca9d-bee2-45e5-b20b-67905bce013c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:44.165100 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-739fd866-deb2-4d9d-a854-321a2c804e08 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1352 microversion: 2.1 time: 0.739666 Aug 27 04:47:44.166019 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1785/3623] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:43 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1352 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:44.175440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-41a10811-3560-4d01-8470-6f4811ef335d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:44.182525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-41a10811-3560-4d01-8470-6f4811ef335d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:44.191707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54d8ca9d-bee2-45e5-b20b-67905bce013c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:44.192355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54d8ca9d-bee2-45e5-b20b-67905bce013c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:44.193506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54d8ca9d-bee2-45e5-b20b-67905bce013c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:44.193506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54d8ca9d-bee2-45e5-b20b-67905bce013c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:44.193935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54d8ca9d-bee2-45e5-b20b-67905bce013c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:44.194241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54d8ca9d-bee2-45e5-b20b-67905bce013c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:44.425269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-41a10811-3560-4d01-8470-6f4811ef335d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:44.439463 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-41a10811-3560-4d01-8470-6f4811ef335d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1214 microversion: 2.1 time: 0.271852 Aug 27 04:47:44.440339 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1786/3624] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:44 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1214 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:44.465547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd0bf5d0-e7b1-4f13-ae0f-08f306cb974e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:44.466577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fd0bf5d0-e7b1-4f13-ae0f-08f306cb974e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:44.491738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd0bf5d0-e7b1-4f13-ae0f-08f306cb974e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:44.492519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd0bf5d0-e7b1-4f13-ae0f-08f306cb974e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:44.493239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd0bf5d0-e7b1-4f13-ae0f-08f306cb974e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:44.494346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd0bf5d0-e7b1-4f13-ae0f-08f306cb974e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:44.495066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd0bf5d0-e7b1-4f13-ae0f-08f306cb974e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:44.495728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd0bf5d0-e7b1-4f13-ae0f-08f306cb974e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:44.976484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-54d8ca9d-bee2-45e5-b20b-67905bce013c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:44.991581 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-54d8ca9d-bee2-45e5-b20b-67905bce013c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1318 microversion: 2.1 time: 0.833260 Aug 27 04:47:45.005201 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1839/3625] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:44 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1318 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:45.189410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-889fc89e-3636-480c-99c9-354d6482836c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:45.190065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-889fc89e-3636-480c-99c9-354d6482836c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:45.210512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889fc89e-3636-480c-99c9-354d6482836c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:45.211747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889fc89e-3636-480c-99c9-354d6482836c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:45.213094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889fc89e-3636-480c-99c9-354d6482836c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:45.215235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889fc89e-3636-480c-99c9-354d6482836c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:45.217711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889fc89e-3636-480c-99c9-354d6482836c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:45.218182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889fc89e-3636-480c-99c9-354d6482836c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:45.268222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fd0bf5d0-e7b1-4f13-ae0f-08f306cb974e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:45.290346 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fd0bf5d0-e7b1-4f13-ae0f-08f306cb974e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1279 microversion: 2.1 time: 0.832601 Aug 27 04:47:45.295166 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1787/3626] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:44 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1279 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:45.317724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-66c94594-6a2c-445f-a987-d3d65d691eef req-cb1529f4-432f-4ca0-a10b-b1678c7953fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423f7d58-0ec5-452f-8c1b-558fd0d10293", "name": "network-vif-plugged", "status": "completed", "tag": "47a9aae8-84c6-4e31-bdff-f23bce77ca6c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:45.333339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-66c94594-6a2c-445f-a987-d3d65d691eef req-cb1529f4-432f-4ca0-a10b-b1678c7953fe service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:45.349096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-66c94594-6a2c-445f-a987-d3d65d691eef req-cb1529f4-432f-4ca0-a10b-b1678c7953fe service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:45.350626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-66c94594-6a2c-445f-a987-d3d65d691eef req-cb1529f4-432f-4ca0-a10b-b1678c7953fe service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:45.397702 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-66c94594-6a2c-445f-a987-d3d65d691eef req-cb1529f4-432f-4ca0-a10b-b1678c7953fe service nova] Creating event network-vif-plugged:47a9aae8-84c6-4e31-bdff-f23bce77ca6c for instance 423f7d58-0ec5-452f-8c1b-558fd0d10293 on n-h1-854823-1 Aug 27 04:47:45.403802 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-66c94594-6a2c-445f-a987-d3d65d691eef req-cb1529f4-432f-4ca0-a10b-b1678c7953fe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101074 Aug 27 04:47:45.404446 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1788/3627] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:45.466917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6623f9ac-f1a6-43db-9c68-4cf54f717157 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:45.467659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6623f9ac-f1a6-43db-9c68-4cf54f717157 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:45.480163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6623f9ac-f1a6-43db-9c68-4cf54f717157 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:45.481206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6623f9ac-f1a6-43db-9c68-4cf54f717157 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:45.504507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6623f9ac-f1a6-43db-9c68-4cf54f717157 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:45.512263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6623f9ac-f1a6-43db-9c68-4cf54f717157 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:45.513755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6623f9ac-f1a6-43db-9c68-4cf54f717157 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:45.514220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6623f9ac-f1a6-43db-9c68-4cf54f717157 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:45.792444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6623f9ac-f1a6-43db-9c68-4cf54f717157 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:45.809348 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6623f9ac-f1a6-43db-9c68-4cf54f717157 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1266 microversion: 2.1 time: 0.348640 Aug 27 04:47:45.810663 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1789/3628] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:45 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:45.953017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-889fc89e-3636-480c-99c9-354d6482836c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:45.969736 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-889fc89e-3636-480c-99c9-354d6482836c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1352 microversion: 2.1 time: 0.783673 Aug 27 04:47:45.971397 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1840/3629] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:45 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1352 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:46.018199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7f526a95-4514-4818-b466-471353a102e3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:46.019232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7f526a95-4514-4818-b466-471353a102e3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:46.032584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f526a95-4514-4818-b466-471353a102e3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:46.034986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f526a95-4514-4818-b466-471353a102e3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:46.036728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f526a95-4514-4818-b466-471353a102e3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:46.037886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f526a95-4514-4818-b466-471353a102e3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:46.041033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f526a95-4514-4818-b466-471353a102e3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:46.042674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f526a95-4514-4818-b466-471353a102e3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:46.055367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:46.316192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1fabe758-ac7e-4bb0-a5ad-6d278b524248 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:46.319677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1fabe758-ac7e-4bb0-a5ad-6d278b524248 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:46.335958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fabe758-ac7e-4bb0-a5ad-6d278b524248 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:46.337208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fabe758-ac7e-4bb0-a5ad-6d278b524248 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:46.337929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fabe758-ac7e-4bb0-a5ad-6d278b524248 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:46.338992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fabe758-ac7e-4bb0-a5ad-6d278b524248 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:46.340016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fabe758-ac7e-4bb0-a5ad-6d278b524248 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:46.341549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fabe758-ac7e-4bb0-a5ad-6d278b524248 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:46.995055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1fabe758-ac7e-4bb0-a5ad-6d278b524248 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:47.015368 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1fabe758-ac7e-4bb0-a5ad-6d278b524248 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1321 microversion: 2.1 time: 0.703674 Aug 27 04:47:47.016753 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1841/3630] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:46 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1321 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:47.037978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a1695cfb-8c9d-4f64-87e1-0a5de8fc5a6c req-97038134-efc4-4794-8f0b-74d12d5407a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e9ed635-f034-40b0-8914-1e1b0ecdfa8b", "tag": "54acff45-168a-4158-9a19-e66b0074eb3f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:47.065015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a1695cfb-8c9d-4f64-87e1-0a5de8fc5a6c req-97038134-efc4-4794-8f0b-74d12d5407a2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:47.066730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a1695cfb-8c9d-4f64-87e1-0a5de8fc5a6c req-97038134-efc4-4794-8f0b-74d12d5407a2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:47.068036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a1695cfb-8c9d-4f64-87e1-0a5de8fc5a6c req-97038134-efc4-4794-8f0b-74d12d5407a2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:47.088100 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a1695cfb-8c9d-4f64-87e1-0a5de8fc5a6c req-97038134-efc4-4794-8f0b-74d12d5407a2 service nova] Creating event network-changed:54acff45-168a-4158-9a19-e66b0074eb3f for instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b on n-h1-854823-1 Aug 27 04:47:47.114900 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a1695cfb-8c9d-4f64-87e1-0a5de8fc5a6c req-97038134-efc4-4794-8f0b-74d12d5407a2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087569 Aug 27 04:47:47.116141 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1842/3631] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:47.127830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5fa08a8f-892b-4644-bc4c-08974ca28f32 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:47.131446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5fa08a8f-892b-4644-bc4c-08974ca28f32 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:47.147524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fa08a8f-892b-4644-bc4c-08974ca28f32 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:47.150886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fa08a8f-892b-4644-bc4c-08974ca28f32 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:47.151500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fa08a8f-892b-4644-bc4c-08974ca28f32 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:47.154441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fa08a8f-892b-4644-bc4c-08974ca28f32 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:47.159469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fa08a8f-892b-4644-bc4c-08974ca28f32 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:47.160284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fa08a8f-892b-4644-bc4c-08974ca28f32 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:47.232617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7f526a95-4514-4818-b466-471353a102e3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:47.246504 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7f526a95-4514-4818-b466-471353a102e3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1318 microversion: 2.1 time: 1.233245 Aug 27 04:47:47.247124 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1790/3632] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:46 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1318 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:47.263739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9ae16efc-011f-447b-8337-780a5e5a170e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:47.264731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9ae16efc-011f-447b-8337-780a5e5a170e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:47.274231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ae16efc-011f-447b-8337-780a5e5a170e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:47.277224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ae16efc-011f-447b-8337-780a5e5a170e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:47.278061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ae16efc-011f-447b-8337-780a5e5a170e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:47.279004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ae16efc-011f-447b-8337-780a5e5a170e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:47.288758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ae16efc-011f-447b-8337-780a5e5a170e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:47.289529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ae16efc-011f-447b-8337-780a5e5a170e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:47.325918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5fa08a8f-892b-4644-bc4c-08974ca28f32 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:47.335067 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5fa08a8f-892b-4644-bc4c-08974ca28f32 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1272 microversion: 2.1 time: 0.216053 Aug 27 04:47:47.335692 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1843/3633] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:47 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:48.039133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4fc1bfae-9186-4f50-9f2e-b4870d55b1b6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:48.040132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4fc1bfae-9186-4f50-9f2e-b4870d55b1b6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:48.055804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fc1bfae-9186-4f50-9f2e-b4870d55b1b6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:48.056941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fc1bfae-9186-4f50-9f2e-b4870d55b1b6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:48.058478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fc1bfae-9186-4f50-9f2e-b4870d55b1b6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:48.059240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fc1bfae-9186-4f50-9f2e-b4870d55b1b6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:48.059710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fc1bfae-9186-4f50-9f2e-b4870d55b1b6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:48.064677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fc1bfae-9186-4f50-9f2e-b4870d55b1b6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:48.303659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9ae16efc-011f-447b-8337-780a5e5a170e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:48.319517 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9ae16efc-011f-447b-8337-780a5e5a170e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1352 microversion: 2.1 time: 1.069267 Aug 27 04:47:48.340124 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1791/3634] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:47 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1352 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:48.353241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d1eb86c3-e960-4e35-a224-ab0a7305433c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:48.359384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d1eb86c3-e960-4e35-a224-ab0a7305433c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:48.381904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1eb86c3-e960-4e35-a224-ab0a7305433c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:48.384561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1eb86c3-e960-4e35-a224-ab0a7305433c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:48.389472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1eb86c3-e960-4e35-a224-ab0a7305433c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:48.390475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1eb86c3-e960-4e35-a224-ab0a7305433c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:48.391587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1eb86c3-e960-4e35-a224-ab0a7305433c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:48.392429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1eb86c3-e960-4e35-a224-ab0a7305433c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:48.399936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4fc1bfae-9186-4f50-9f2e-b4870d55b1b6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:48.417009 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4fc1bfae-9186-4f50-9f2e-b4870d55b1b6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1321 microversion: 2.1 time: 0.382104 Aug 27 04:47:48.418239 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1844/3635] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:48 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:48.425086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-889611c7-8904-4707-a630-4f16556e21c7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:48.426007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-889611c7-8904-4707-a630-4f16556e21c7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:48.433221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889611c7-8904-4707-a630-4f16556e21c7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:48.434370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889611c7-8904-4707-a630-4f16556e21c7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:48.434993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889611c7-8904-4707-a630-4f16556e21c7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:48.435955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889611c7-8904-4707-a630-4f16556e21c7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:48.436749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889611c7-8904-4707-a630-4f16556e21c7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:48.437384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889611c7-8904-4707-a630-4f16556e21c7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:48.656105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-889611c7-8904-4707-a630-4f16556e21c7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:48.667476 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-889611c7-8904-4707-a630-4f16556e21c7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1272 microversion: 2.1 time: 0.247599 Aug 27 04:47:48.668088 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1845/3636] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:48 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:49.138266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d1eb86c3-e960-4e35-a224-ab0a7305433c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:49.154896 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d1eb86c3-e960-4e35-a224-ab0a7305433c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1318 microversion: 2.1 time: 0.813482 Aug 27 04:47:49.160562 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1792/3637] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:48 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1318 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:49.243877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8c2ec0a6-5649-4343-9858-6d0c7c0c4461 req-f96bf749-6a41-4155-84e6-8d3f650b6665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "686e7e13-0c27-41b1-b620-87a1410ac5bc", "tag": "b9e91c19-b6c3-40a3-87ed-9af5a2d0526b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:49.263148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8c2ec0a6-5649-4343-9858-6d0c7c0c4461 req-f96bf749-6a41-4155-84e6-8d3f650b6665 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:49.266417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8c2ec0a6-5649-4343-9858-6d0c7c0c4461 req-f96bf749-6a41-4155-84e6-8d3f650b6665 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:49.267111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8c2ec0a6-5649-4343-9858-6d0c7c0c4461 req-f96bf749-6a41-4155-84e6-8d3f650b6665 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:49.294434 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8c2ec0a6-5649-4343-9858-6d0c7c0c4461 req-f96bf749-6a41-4155-84e6-8d3f650b6665 service nova] Creating event network-changed:b9e91c19-b6c3-40a3-87ed-9af5a2d0526b for instance 686e7e13-0c27-41b1-b620-87a1410ac5bc on n-h2-854823-1 Aug 27 04:47:49.307397 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8c2ec0a6-5649-4343-9858-6d0c7c0c4461 req-f96bf749-6a41-4155-84e6-8d3f650b6665 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064111 Aug 27 04:47:49.308562 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1846/3638] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:49.348572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-74ad4fdb-6397-498d-aa52-203795affee2 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:49.349381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-74ad4fdb-6397-498d-aa52-203795affee2 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:49.372881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ad4fdb-6397-498d-aa52-203795affee2 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:49.373399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ad4fdb-6397-498d-aa52-203795affee2 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:49.376211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ad4fdb-6397-498d-aa52-203795affee2 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:49.377275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ad4fdb-6397-498d-aa52-203795affee2 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:49.377812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ad4fdb-6397-498d-aa52-203795affee2 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:49.380908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ad4fdb-6397-498d-aa52-203795affee2 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:49.440371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-995b3427-32ee-452d-b24b-92dba6266c46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:49.441876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-995b3427-32ee-452d-b24b-92dba6266c46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:49.453622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-995b3427-32ee-452d-b24b-92dba6266c46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:49.461252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-995b3427-32ee-452d-b24b-92dba6266c46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:49.462081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-995b3427-32ee-452d-b24b-92dba6266c46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:49.463076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-995b3427-32ee-452d-b24b-92dba6266c46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:49.463852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-995b3427-32ee-452d-b24b-92dba6266c46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:49.464558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-995b3427-32ee-452d-b24b-92dba6266c46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:50.032889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-995b3427-32ee-452d-b24b-92dba6266c46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:50.045299 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-995b3427-32ee-452d-b24b-92dba6266c46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1321 microversion: 2.1 time: 0.610483 Aug 27 04:47:50.046248 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1847/3639] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:49 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1321 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:50.054642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52fa24c3-2f28-4159-b585-2972bace1b5f tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:50.055583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-52fa24c3-2f28-4159-b585-2972bace1b5f tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:50.073966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52fa24c3-2f28-4159-b585-2972bace1b5f tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:50.075264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52fa24c3-2f28-4159-b585-2972bace1b5f tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:50.076688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52fa24c3-2f28-4159-b585-2972bace1b5f tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:50.077528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52fa24c3-2f28-4159-b585-2972bace1b5f tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:50.079842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52fa24c3-2f28-4159-b585-2972bace1b5f tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:50.082488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52fa24c3-2f28-4159-b585-2972bace1b5f tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:50.154631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-74ad4fdb-6397-498d-aa52-203795affee2 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:50.167354 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-74ad4fdb-6397-498d-aa52-203795affee2 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1542 microversion: 2.1 time: 0.823939 Aug 27 04:47:50.172151 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1793/3640] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:49 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1542 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:50.185114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3c87d902-7941-42db-b982-90b29e99da88 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:50.186264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3c87d902-7941-42db-b982-90b29e99da88 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:50.207605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c87d902-7941-42db-b982-90b29e99da88 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:50.215123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c87d902-7941-42db-b982-90b29e99da88 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:50.216259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c87d902-7941-42db-b982-90b29e99da88 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:50.217646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c87d902-7941-42db-b982-90b29e99da88 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:50.218513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c87d902-7941-42db-b982-90b29e99da88 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:50.219425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c87d902-7941-42db-b982-90b29e99da88 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:50.486781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52fa24c3-2f28-4159-b585-2972bace1b5f tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:50.515433 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52fa24c3-2f28-4159-b585-2972bace1b5f tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1272 microversion: 2.1 time: 0.449645 Aug 27 04:47:50.516701 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1848/3641] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:50 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1272 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:50.533371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d740102d-b64a-48f9-b7e7-a8dbf602555e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:50.536955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d740102d-b64a-48f9-b7e7-a8dbf602555e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:50.554706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d740102d-b64a-48f9-b7e7-a8dbf602555e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:50.565829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d740102d-b64a-48f9-b7e7-a8dbf602555e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:50.566779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d740102d-b64a-48f9-b7e7-a8dbf602555e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:50.567752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d740102d-b64a-48f9-b7e7-a8dbf602555e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:50.568647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d740102d-b64a-48f9-b7e7-a8dbf602555e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:50.569097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d740102d-b64a-48f9-b7e7-a8dbf602555e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:50.897264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3c87d902-7941-42db-b982-90b29e99da88 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:50.932978 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3c87d902-7941-42db-b982-90b29e99da88 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1318 microversion: 2.1 time: 0.751507 Aug 27 04:47:50.936664 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1794/3642] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:50 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1318 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:51.071228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-90726a7f-c03d-452e-9531-5ed0328e87a9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:51.072035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-90726a7f-c03d-452e-9531-5ed0328e87a9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:51.093179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90726a7f-c03d-452e-9531-5ed0328e87a9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:51.093713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90726a7f-c03d-452e-9531-5ed0328e87a9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:51.099453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90726a7f-c03d-452e-9531-5ed0328e87a9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:51.100727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90726a7f-c03d-452e-9531-5ed0328e87a9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:51.101416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90726a7f-c03d-452e-9531-5ed0328e87a9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:51.103338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90726a7f-c03d-452e-9531-5ed0328e87a9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:51.421275 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d740102d-b64a-48f9-b7e7-a8dbf602555e tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.901999 Aug 27 04:47:51.423229 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1849/3643] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 04:47:50 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293/os-interface => generated 284 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:51.542331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-668274a2-67b4-4002-8b57-f07e28fb9aa9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:51.545711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-668274a2-67b4-4002-8b57-f07e28fb9aa9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:51.571009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-668274a2-67b4-4002-8b57-f07e28fb9aa9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:51.571938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-668274a2-67b4-4002-8b57-f07e28fb9aa9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:51.573355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-668274a2-67b4-4002-8b57-f07e28fb9aa9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:51.577355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-668274a2-67b4-4002-8b57-f07e28fb9aa9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:51.578209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-668274a2-67b4-4002-8b57-f07e28fb9aa9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:51.580755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-668274a2-67b4-4002-8b57-f07e28fb9aa9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:52.751380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-668274a2-67b4-4002-8b57-f07e28fb9aa9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:52.769777 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-668274a2-67b4-4002-8b57-f07e28fb9aa9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1314 microversion: 2.1 time: 1.232609 Aug 27 04:47:52.772027 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1850/3644] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:51 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1314 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:52.796254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-591f5e8d-f282-44c6-84a9-93e1d2d61220 req-de964a36-6b8f-433f-a841-33434b800c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60af8f98-57c0-40d9-bbeb-76c6590b5ab8", "name": "network-vif-plugged", "status": "completed", "tag": "8d25edcd-e60e-49d5-8bc2-fe022383be5b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:52.867227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-591f5e8d-f282-44c6-84a9-93e1d2d61220 req-de964a36-6b8f-433f-a841-33434b800c10 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:52.873448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-591f5e8d-f282-44c6-84a9-93e1d2d61220 req-de964a36-6b8f-433f-a841-33434b800c10 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:52.876586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-591f5e8d-f282-44c6-84a9-93e1d2d61220 req-de964a36-6b8f-433f-a841-33434b800c10 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:52.941741 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-591f5e8d-f282-44c6-84a9-93e1d2d61220 req-de964a36-6b8f-433f-a841-33434b800c10 service nova] Creating event network-vif-plugged:8d25edcd-e60e-49d5-8bc2-fe022383be5b for instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 on n-h2-854823-1 Aug 27 04:47:52.984367 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-591f5e8d-f282-44c6-84a9-93e1d2d61220 req-de964a36-6b8f-433f-a841-33434b800c10 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204190 Aug 27 04:47:52.985969 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1851/3645] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:53.011412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59cd8de2-bb22-4fc3-993d-4fbf6b48940d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:53.016499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59cd8de2-bb22-4fc3-993d-4fbf6b48940d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:53.044963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59cd8de2-bb22-4fc3-993d-4fbf6b48940d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:53.045587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59cd8de2-bb22-4fc3-993d-4fbf6b48940d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:53.046142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59cd8de2-bb22-4fc3-993d-4fbf6b48940d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:53.046789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59cd8de2-bb22-4fc3-993d-4fbf6b48940d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:53.047783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59cd8de2-bb22-4fc3-993d-4fbf6b48940d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:53.048216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59cd8de2-bb22-4fc3-993d-4fbf6b48940d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:53.113057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:53.311992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-90726a7f-c03d-452e-9531-5ed0328e87a9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:53.323023 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-90726a7f-c03d-452e-9531-5ed0328e87a9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1321 microversion: 2.1 time: 2.256826 Aug 27 04:47:53.340820 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1795/3646] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:51 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1321 bytes in 2274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:53.537002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-59cd8de2-bb22-4fc3-993d-4fbf6b48940d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:53.549971 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59cd8de2-bb22-4fc3-993d-4fbf6b48940d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1318 microversion: 2.1 time: 0.559500 Aug 27 04:47:53.564822 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1852/3647] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:52 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:53.795016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e1ca1dca-2dc0-4e43-bdac-8418b1911078 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:53.795719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e1ca1dca-2dc0-4e43-bdac-8418b1911078 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:53.811780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1ca1dca-2dc0-4e43-bdac-8418b1911078 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:53.813414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1ca1dca-2dc0-4e43-bdac-8418b1911078 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:53.814129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1ca1dca-2dc0-4e43-bdac-8418b1911078 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:53.815083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1ca1dca-2dc0-4e43-bdac-8418b1911078 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:53.815774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1ca1dca-2dc0-4e43-bdac-8418b1911078 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:53.816421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1ca1dca-2dc0-4e43-bdac-8418b1911078 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:54.348260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4405b35d-3ccb-4ade-979c-b68d54210aa0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:54.348968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4405b35d-3ccb-4ade-979c-b68d54210aa0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:54.351527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:54.352621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=22 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:54.367682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4405b35d-3ccb-4ade-979c-b68d54210aa0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:54.369227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4405b35d-3ccb-4ade-979c-b68d54210aa0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:54.370390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4405b35d-3ccb-4ade-979c-b68d54210aa0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:54.372450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4405b35d-3ccb-4ade-979c-b68d54210aa0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:54.386257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4405b35d-3ccb-4ade-979c-b68d54210aa0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:54.388111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4405b35d-3ccb-4ade-979c-b68d54210aa0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:54.430392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:54.621443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e1ca1dca-2dc0-4e43-bdac-8418b1911078 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:54.638290 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e1ca1dca-2dc0-4e43-bdac-8418b1911078 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1314 microversion: 2.1 time: 0.848342 Aug 27 04:47:54.653613 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1796/3648] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:53 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1314 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:54.660757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-23381a45-3ef1-486c-8b52-cd002b2bed1f req-63eaf2e3-dedc-4b85-9ad8-d095176feb41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "423f7d58-0ec5-452f-8c1b-558fd0d10293", "tag": "47a9aae8-84c6-4e31-bdff-f23bce77ca6c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:54.671589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-23381a45-3ef1-486c-8b52-cd002b2bed1f req-63eaf2e3-dedc-4b85-9ad8-d095176feb41 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:54.673108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-23381a45-3ef1-486c-8b52-cd002b2bed1f req-63eaf2e3-dedc-4b85-9ad8-d095176feb41 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:54.673847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-23381a45-3ef1-486c-8b52-cd002b2bed1f req-63eaf2e3-dedc-4b85-9ad8-d095176feb41 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:54.695404 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-23381a45-3ef1-486c-8b52-cd002b2bed1f req-63eaf2e3-dedc-4b85-9ad8-d095176feb41 service nova] Creating event network-changed:47a9aae8-84c6-4e31-bdff-f23bce77ca6c for instance 423f7d58-0ec5-452f-8c1b-558fd0d10293 on n-h1-854823-1 Aug 27 04:47:54.702367 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-23381a45-3ef1-486c-8b52-cd002b2bed1f req-63eaf2e3-dedc-4b85-9ad8-d095176feb41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047108 Aug 27 04:47:54.704162 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1797/3649] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:54.715951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a0f1778-b0c6-43c5-b9cd-1cb6b343cb01 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:54.717115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a0f1778-b0c6-43c5-b9cd-1cb6b343cb01 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:54.740311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a0f1778-b0c6-43c5-b9cd-1cb6b343cb01 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:54.741095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a0f1778-b0c6-43c5-b9cd-1cb6b343cb01 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:54.741784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a0f1778-b0c6-43c5-b9cd-1cb6b343cb01 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:54.742805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4405b35d-3ccb-4ade-979c-b68d54210aa0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:54.743531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a0f1778-b0c6-43c5-b9cd-1cb6b343cb01 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:54.744269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a0f1778-b0c6-43c5-b9cd-1cb6b343cb01 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:54.744980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a0f1778-b0c6-43c5-b9cd-1cb6b343cb01 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:54.781085 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4405b35d-3ccb-4ade-979c-b68d54210aa0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1321 microversion: 2.1 time: 0.421846 Aug 27 04:47:54.782643 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1853/3650] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:54 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:55.659062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6a0f1778-b0c6-43c5-b9cd-1cb6b343cb01 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:55.659699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cab31ecd-15d3-4f16-8988-48d362ea9bbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:55.660902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cab31ecd-15d3-4f16-8988-48d362ea9bbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:55.670947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cab31ecd-15d3-4f16-8988-48d362ea9bbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:55.671452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cab31ecd-15d3-4f16-8988-48d362ea9bbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:55.671923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cab31ecd-15d3-4f16-8988-48d362ea9bbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:55.678331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cab31ecd-15d3-4f16-8988-48d362ea9bbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:55.678825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cab31ecd-15d3-4f16-8988-48d362ea9bbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:55.679273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cab31ecd-15d3-4f16-8988-48d362ea9bbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:55.693709 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a0f1778-b0c6-43c5-b9cd-1cb6b343cb01 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1318 microversion: 2.1 time: 0.982285 Aug 27 04:47:55.695550 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1798/3651] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:54 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1318 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:55.805163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-88060ebd-bad2-4d27-9925-0dcb9a320746 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:55.806597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-88060ebd-bad2-4d27-9925-0dcb9a320746 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:55.816315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88060ebd-bad2-4d27-9925-0dcb9a320746 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:55.817191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88060ebd-bad2-4d27-9925-0dcb9a320746 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:55.817837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88060ebd-bad2-4d27-9925-0dcb9a320746 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:55.819012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88060ebd-bad2-4d27-9925-0dcb9a320746 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:55.819646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88060ebd-bad2-4d27-9925-0dcb9a320746 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:55.820494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88060ebd-bad2-4d27-9925-0dcb9a320746 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:56.018055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cab31ecd-15d3-4f16-8988-48d362ea9bbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:56.040906 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cab31ecd-15d3-4f16-8988-48d362ea9bbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1314 microversion: 2.1 time: 0.382534 Aug 27 04:47:56.048049 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1854/3652] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:55 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:56.231436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1480974323", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "4683dc06-3bf2-40d1-9ab9-43da227f5608"}, {"uuid": "a6f6d43e-f3a0-443e-bf53-4a3b29524a58"}, {"uuid": "4683dc06-3bf2-40d1-9ab9-43da227f5608"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:56.334467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] validate_networks() for [('4683dc06-3bf2-40d1-9ab9-43da227f5608', None, None, None, None, None), ('a6f6d43e-f3a0-443e-bf53-4a3b29524a58', None, None, None, None, None), ('4683dc06-3bf2-40d1-9ab9-43da227f5608', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:47:56.845720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-88060ebd-bad2-4d27-9925-0dcb9a320746 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:56.858904 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-88060ebd-bad2-4d27-9925-0dcb9a320746 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1321 microversion: 2.1 time: 1.058922 Aug 27 04:47:56.883180 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1799/3653] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:55 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1321 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:56.910022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8340ad7c-7686-45b7-a76d-8ab07b2c2b3c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:56.910674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8340ad7c-7686-45b7-a76d-8ab07b2c2b3c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:56.932675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:56.934788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8340ad7c-7686-45b7-a76d-8ab07b2c2b3c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:56.935455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8340ad7c-7686-45b7-a76d-8ab07b2c2b3c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:56.936056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8340ad7c-7686-45b7-a76d-8ab07b2c2b3c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:56.936999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8340ad7c-7686-45b7-a76d-8ab07b2c2b3c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:56.937917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8340ad7c-7686-45b7-a76d-8ab07b2c2b3c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:56.938740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8340ad7c-7686-45b7-a76d-8ab07b2c2b3c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:57.603853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8340ad7c-7686-45b7-a76d-8ab07b2c2b3c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:57.617105 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8340ad7c-7686-45b7-a76d-8ab07b2c2b3c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1508 microversion: 2.1 time: 0.730028 Aug 27 04:47:57.634588 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1800/3654] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:56 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1508 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:57.644915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d58675cc-9419-4834-b141-9da6bcf1358d req-4335701f-1557-4e71-b2cc-4c38f48aa9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49de8d6e-89fa-41c7-8c49-132644205b12", "tag": "5ec0d056-7cfe-4018-804a-37783c60c2ac"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:57.704296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d58675cc-9419-4834-b141-9da6bcf1358d req-4335701f-1557-4e71-b2cc-4c38f48aa9d9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:57.708752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d58675cc-9419-4834-b141-9da6bcf1358d req-4335701f-1557-4e71-b2cc-4c38f48aa9d9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:57.711319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d58675cc-9419-4834-b141-9da6bcf1358d req-4335701f-1557-4e71-b2cc-4c38f48aa9d9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:57.761843 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d58675cc-9419-4834-b141-9da6bcf1358d req-4335701f-1557-4e71-b2cc-4c38f48aa9d9 service nova] Creating event network-changed:5ec0d056-7cfe-4018-804a-37783c60c2ac for instance 49de8d6e-89fa-41c7-8c49-132644205b12 on n-h1-854823-1 Aug 27 04:47:57.773332 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d58675cc-9419-4834-b141-9da6bcf1358d req-4335701f-1557-4e71-b2cc-4c38f48aa9d9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136861 Aug 27 04:47:57.774467 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1801/3655] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:57.788912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8322d3f-fe1e-4635-86a4-aa2f6747b5e1 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:57.789839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d8322d3f-fe1e-4635-86a4-aa2f6747b5e1 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:57.804150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8322d3f-fe1e-4635-86a4-aa2f6747b5e1 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:57.806066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8322d3f-fe1e-4635-86a4-aa2f6747b5e1 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:57.807924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8322d3f-fe1e-4635-86a4-aa2f6747b5e1 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:57.813498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8322d3f-fe1e-4635-86a4-aa2f6747b5e1 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:57.814222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8322d3f-fe1e-4635-86a4-aa2f6747b5e1 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:57.814846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8322d3f-fe1e-4635-86a4-aa2f6747b5e1 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:58.070318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:47:58.071566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:47:58.072882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:47:58.073971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:47:58.074881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:47:58.102135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:58.104209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:58.109094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:58.110409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:58.113052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:58.114498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:58.164193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Getting quotas for project 56803ee2fee048d09b8ec44ae76d1c9e. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:47:58.171659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Getting quotas for user 4dae41c63374401f81d297f03fd55d57 and project 56803ee2fee048d09b8ec44ae76d1c9e. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:47:58.187688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:47:58.190343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:47:58.253299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d8322d3f-fe1e-4635-86a4-aa2f6747b5e1 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:58.272512 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d8322d3f-fe1e-4635-86a4-aa2f6747b5e1 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1314 microversion: 2.1 time: 0.489224 Aug 27 04:47:58.278695 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1802/3656] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:57 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:58.290600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aeab2210-3ff0-425e-80a1-a5256c2ede14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:58.294235 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b9d9b04-1368-40ab-82bb-1cc89c491831 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.069057 Aug 27 04:47:58.295200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aeab2210-3ff0-425e-80a1-a5256c2ede14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:58.297586 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1855/3657] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:47:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:47:58.308380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36969a28-57d1-449d-92a8-c6d8c00d4d97 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:58.309124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36969a28-57d1-449d-92a8-c6d8c00d4d97 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:58.312927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aeab2210-3ff0-425e-80a1-a5256c2ede14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:58.316960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aeab2210-3ff0-425e-80a1-a5256c2ede14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:58.322080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aeab2210-3ff0-425e-80a1-a5256c2ede14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:58.322866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36969a28-57d1-449d-92a8-c6d8c00d4d97 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:58.323376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36969a28-57d1-449d-92a8-c6d8c00d4d97 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:58.323814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36969a28-57d1-449d-92a8-c6d8c00d4d97 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:58.324433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aeab2210-3ff0-425e-80a1-a5256c2ede14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:58.325646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aeab2210-3ff0-425e-80a1-a5256c2ede14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:58.327126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aeab2210-3ff0-425e-80a1-a5256c2ede14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:58.329104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36969a28-57d1-449d-92a8-c6d8c00d4d97 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:58.330860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36969a28-57d1-449d-92a8-c6d8c00d4d97 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:58.331309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36969a28-57d1-449d-92a8-c6d8c00d4d97 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:58.684049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36969a28-57d1-449d-92a8-c6d8c00d4d97 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:58.699105 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36969a28-57d1-449d-92a8-c6d8c00d4d97 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1321 microversion: 2.1 time: 0.400331 Aug 27 04:47:58.699738 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1856/3658] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:58 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:58.924347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aeab2210-3ff0-425e-80a1-a5256c2ede14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:58.936478 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aeab2210-3ff0-425e-80a1-a5256c2ede14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1508 microversion: 2.1 time: 0.651886 Aug 27 04:47:58.937371 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1803/3659] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:58 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1508 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:58.946825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fcf41136-d1c9-4169-acae-b5f841554529 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:58.952305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fcf41136-d1c9-4169-acae-b5f841554529 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:59.039014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-229334031", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "ddd4b418-ca64-4693-9c44-9003e0459c0d"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:59.163592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] validate_networks() for [('ddd4b418-ca64-4693-9c44-9003e0459c0d', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:47:59.204870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fcf41136-d1c9-4169-acae-b5f841554529 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:59.212286 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fcf41136-d1c9-4169-acae-b5f841554529 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1213 microversion: 2.1 time: 0.273667 Aug 27 04:47:59.217920 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1804/3660] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:58 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1213 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:59.234505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-559977d3-703b-41cd-805e-a8e6f40de99e req-50a8052f-d3da-464e-a765-8e8175eea062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9ed635-f034-40b0-8914-1e1b0ecdfa8b", "name": "network-vif-plugged", "status": "completed", "tag": "54acff45-168a-4158-9a19-e66b0074eb3f"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:59.258067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-559977d3-703b-41cd-805e-a8e6f40de99e req-50a8052f-d3da-464e-a765-8e8175eea062 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:59.266475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-559977d3-703b-41cd-805e-a8e6f40de99e req-50a8052f-d3da-464e-a765-8e8175eea062 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:59.274722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-559977d3-703b-41cd-805e-a8e6f40de99e req-50a8052f-d3da-464e-a765-8e8175eea062 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:59.304274 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-559977d3-703b-41cd-805e-a8e6f40de99e req-50a8052f-d3da-464e-a765-8e8175eea062 service nova] Creating event network-vif-plugged:54acff45-168a-4158-9a19-e66b0074eb3f for instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b on n-h1-854823-1 Aug 27 04:47:59.317584 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-559977d3-703b-41cd-805e-a8e6f40de99e req-50a8052f-d3da-464e-a765-8e8175eea062 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097955 Aug 27 04:47:59.318266 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1805/3661] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:59.344703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d43774b5-ef79-42ed-ace0-33c81e0438df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:59.353334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d43774b5-ef79-42ed-ace0-33c81e0438df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:59.361658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d43774b5-ef79-42ed-ace0-33c81e0438df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:59.362503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d43774b5-ef79-42ed-ace0-33c81e0438df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:59.363167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d43774b5-ef79-42ed-ace0-33c81e0438df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:59.365092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d43774b5-ef79-42ed-ace0-33c81e0438df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:59.365596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d43774b5-ef79-42ed-ace0-33c81e0438df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:59.366252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d43774b5-ef79-42ed-ace0-33c81e0438df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:59.535973 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d43774b5-ef79-42ed-ace0-33c81e0438df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "PUT /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1080 microversion: 2.1 time: 0.198620 Aug 27 04:47:59.548557 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1806/3662] 10.222.0.79 () {60 vars in 1256 bytes} [Sat Aug 27 04:47:59 2022] PUT /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1080 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:59.548557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f808f74e-dfc1-4a7b-8c68-a1bb1010bbbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:59.548557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f808f74e-dfc1-4a7b-8c68-a1bb1010bbbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:47:59.571124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f808f74e-dfc1-4a7b-8c68-a1bb1010bbbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:59.571629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f808f74e-dfc1-4a7b-8c68-a1bb1010bbbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:59.572132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f808f74e-dfc1-4a7b-8c68-a1bb1010bbbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:47:59.572892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f808f74e-dfc1-4a7b-8c68-a1bb1010bbbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:47:59.573348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f808f74e-dfc1-4a7b-8c68-a1bb1010bbbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:47:59.573775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f808f74e-dfc1-4a7b-8c68-a1bb1010bbbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:00.010889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f808f74e-dfc1-4a7b-8c68-a1bb1010bbbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:00.023491 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f808f74e-dfc1-4a7b-8c68-a1bb1010bbbb tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1314 microversion: 2.1 time: 0.485714 Aug 27 04:48:00.024103 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1807/3663] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:47:59 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:00.036287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7c077800-b938-4382-8b2f-6365d424e228 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:00.036838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7c077800-b938-4382-8b2f-6365d424e228 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:00.068840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c077800-b938-4382-8b2f-6365d424e228 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:00.069362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c077800-b938-4382-8b2f-6365d424e228 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:00.069819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c077800-b938-4382-8b2f-6365d424e228 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:00.070556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c077800-b938-4382-8b2f-6365d424e228 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:00.071022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c077800-b938-4382-8b2f-6365d424e228 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:00.071454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c077800-b938-4382-8b2f-6365d424e228 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:00.549545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7c077800-b938-4382-8b2f-6365d424e228 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:00.590349 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7c077800-b938-4382-8b2f-6365d424e228 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1506 microversion: 2.1 time: 0.554571 Aug 27 04:48:00.592941 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1808/3664] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:00 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1506 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:00.606093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-21240b11-209d-48c4-8ae0-518e6c27f4d4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:00.607418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-21240b11-209d-48c4-8ae0-518e6c27f4d4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:00.632463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21240b11-209d-48c4-8ae0-518e6c27f4d4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:00.634610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21240b11-209d-48c4-8ae0-518e6c27f4d4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:00.636240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21240b11-209d-48c4-8ae0-518e6c27f4d4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:00.638399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21240b11-209d-48c4-8ae0-518e6c27f4d4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:00.639260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21240b11-209d-48c4-8ae0-518e6c27f4d4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:00.641530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-21240b11-209d-48c4-8ae0-518e6c27f4d4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:00.646030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:01.050795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:48:01.053180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:48:01.054701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:48:01.055121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:48:01.056215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:48:01.078550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:01.079583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:01.080165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:01.082089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:01.082681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:01.083232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:01.104371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-21240b11-209d-48c4-8ae0-518e6c27f4d4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:01.119764 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-21240b11-209d-48c4-8ae0-518e6c27f4d4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1321 microversion: 2.1 time: 0.524956 Aug 27 04:48:01.141405 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1809/3665] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:00 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1321 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:01.155937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0da960f-3cd7-40d9-843a-364c7e701b53 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:01.157507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c0da960f-3cd7-40d9-843a-364c7e701b53 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:01.164848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0da960f-3cd7-40d9-843a-364c7e701b53 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:01.165632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0da960f-3cd7-40d9-843a-364c7e701b53 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:01.165825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Getting quotas for project 4a36b5e1a40746d387ea97d5fe2939d0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:48:01.166437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0da960f-3cd7-40d9-843a-364c7e701b53 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:01.167334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0da960f-3cd7-40d9-843a-364c7e701b53 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:01.167933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0da960f-3cd7-40d9-843a-364c7e701b53 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:01.169133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0da960f-3cd7-40d9-843a-364c7e701b53 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:01.178314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Getting quotas for user a5770f96537b42bf9db631c051b321ae and project 4a36b5e1a40746d387ea97d5fe2939d0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:48:01.203177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:48:01.210220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:48:01.273761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c0da960f-3cd7-40d9-843a-364c7e701b53 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:01.287128 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c0da960f-3cd7-40d9-843a-364c7e701b53 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1271 microversion: 2.1 time: 0.144471 Aug 27 04:48:01.290987 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1810/3666] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:01 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:01.305424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-48d6fbcb-ecb2-407f-8138-fe098539cd14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:01.306848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-48d6fbcb-ecb2-407f-8138-fe098539cd14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:01.342727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48d6fbcb-ecb2-407f-8138-fe098539cd14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:01.343249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48d6fbcb-ecb2-407f-8138-fe098539cd14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:01.344364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48d6fbcb-ecb2-407f-8138-fe098539cd14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:01.360615 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01eadaab-91db-44c2-8b8f-0e4966cff7d5 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.659780 Aug 27 04:48:01.361298 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1857/3667] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:47:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:48:01.367903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48d6fbcb-ecb2-407f-8138-fe098539cd14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:01.368425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48d6fbcb-ecb2-407f-8138-fe098539cd14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:01.368915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-48d6fbcb-ecb2-407f-8138-fe098539cd14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:01.373127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f010ce35-c69c-4ee0-8b9c-6c321497f6a7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:01.400518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f010ce35-c69c-4ee0-8b9c-6c321497f6a7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:01.411270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f010ce35-c69c-4ee0-8b9c-6c321497f6a7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:01.411785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f010ce35-c69c-4ee0-8b9c-6c321497f6a7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:01.412227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f010ce35-c69c-4ee0-8b9c-6c321497f6a7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:01.417381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f010ce35-c69c-4ee0-8b9c-6c321497f6a7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:01.418339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f010ce35-c69c-4ee0-8b9c-6c321497f6a7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:01.419001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f010ce35-c69c-4ee0-8b9c-6c321497f6a7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:01.700284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-48d6fbcb-ecb2-407f-8138-fe098539cd14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:01.712051 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-48d6fbcb-ecb2-407f-8138-fe098539cd14 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1506 microversion: 2.1 time: 0.419717 Aug 27 04:48:01.723224 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1811/3668] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:01 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:01.738663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-586aed60-54a9-4b60-b52f-de0dd1cdf3b4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:01.740373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-586aed60-54a9-4b60-b52f-de0dd1cdf3b4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:01.886917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-586aed60-54a9-4b60-b52f-de0dd1cdf3b4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:01.905817 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-586aed60-54a9-4b60-b52f-de0dd1cdf3b4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1227 microversion: 2.1 time: 0.174642 Aug 27 04:48:01.907482 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1812/3669] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:01 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1227 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:01.928983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-69e4f792-7173-43a8-bcda-fa7e8cd105b2 req-7031ec8d-f856-4072-84eb-fdd6e901bf37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686e7e13-0c27-41b1-b620-87a1410ac5bc", "name": "network-vif-plugged", "status": "completed", "tag": "b9e91c19-b6c3-40a3-87ed-9af5a2d0526b"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:01.979588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-69e4f792-7173-43a8-bcda-fa7e8cd105b2 req-7031ec8d-f856-4072-84eb-fdd6e901bf37 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:02.000607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-69e4f792-7173-43a8-bcda-fa7e8cd105b2 req-7031ec8d-f856-4072-84eb-fdd6e901bf37 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:02.001572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-69e4f792-7173-43a8-bcda-fa7e8cd105b2 req-7031ec8d-f856-4072-84eb-fdd6e901bf37 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:02.042532 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-69e4f792-7173-43a8-bcda-fa7e8cd105b2 req-7031ec8d-f856-4072-84eb-fdd6e901bf37 service nova] Creating event network-vif-plugged:b9e91c19-b6c3-40a3-87ed-9af5a2d0526b for instance 686e7e13-0c27-41b1-b620-87a1410ac5bc on n-h2-854823-1 Aug 27 04:48:02.059959 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-69e4f792-7173-43a8-bcda-fa7e8cd105b2 req-7031ec8d-f856-4072-84eb-fdd6e901bf37 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146303 Aug 27 04:48:02.061813 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1813/3670] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:02.071441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f010ce35-c69c-4ee0-8b9c-6c321497f6a7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:02.079611 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f010ce35-c69c-4ee0-8b9c-6c321497f6a7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1314 microversion: 2.1 time: 0.717224 Aug 27 04:48:02.081442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:02.089738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:02.091691 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1858/3671] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:01 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:02.117152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:02.117584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:02.118507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:02.126376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:02.126928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:02.127395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:02.154097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-258e4722-d81b-47b1-b24d-bd1c46370aa6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:02.155103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-258e4722-d81b-47b1-b24d-bd1c46370aa6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:02.164333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258e4722-d81b-47b1-b24d-bd1c46370aa6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:02.165127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258e4722-d81b-47b1-b24d-bd1c46370aa6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:02.165746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258e4722-d81b-47b1-b24d-bd1c46370aa6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:02.167900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258e4722-d81b-47b1-b24d-bd1c46370aa6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:02.168632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258e4722-d81b-47b1-b24d-bd1c46370aa6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:02.169291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258e4722-d81b-47b1-b24d-bd1c46370aa6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:02.346515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:48:02.347767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:48:02.350190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:48:02.352576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:48:02.353634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:48:02.455443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:02.467054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:02.468051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:02.469526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:02.470607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:02.471516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:02.472347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:02.511449 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e853dc64-8e60-4485-9300-fd759ff08823 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "POST /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8/action" status: 202 len: 1112 microversion: 2.1 time: 0.445610 Aug 27 04:48:02.527701 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1814/3672] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:48:02 2022] POST /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8/action => generated 1112 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 04:48:02.535756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e3e0e726-ada5-4314-9dc7-72663ce9eba9 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:02.536830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e3e0e726-ada5-4314-9dc7-72663ce9eba9 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:02.547550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3e0e726-ada5-4314-9dc7-72663ce9eba9 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:02.548501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3e0e726-ada5-4314-9dc7-72663ce9eba9 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:02.549427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3e0e726-ada5-4314-9dc7-72663ce9eba9 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:02.550302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3e0e726-ada5-4314-9dc7-72663ce9eba9 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:02.550958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3e0e726-ada5-4314-9dc7-72663ce9eba9 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:02.551564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3e0e726-ada5-4314-9dc7-72663ce9eba9 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:02.786088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e3e0e726-ada5-4314-9dc7-72663ce9eba9 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:02.817763 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e3e0e726-ada5-4314-9dc7-72663ce9eba9 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1271 microversion: 2.1 time: 0.285023 Aug 27 04:48:02.820482 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1815/3673] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:02 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1271 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:02.834716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-555d702e-2c75-4d45-a2c3-e4dec3c0c49f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:02.835590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-555d702e-2c75-4d45-a2c3-e4dec3c0c49f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:02.843421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-555d702e-2c75-4d45-a2c3-e4dec3c0c49f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:02.845453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-555d702e-2c75-4d45-a2c3-e4dec3c0c49f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:02.846101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-555d702e-2c75-4d45-a2c3-e4dec3c0c49f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:02.847005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-555d702e-2c75-4d45-a2c3-e4dec3c0c49f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:02.847635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-555d702e-2c75-4d45-a2c3-e4dec3c0c49f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:02.848234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-555d702e-2c75-4d45-a2c3-e4dec3c0c49f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:03.227879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-555d702e-2c75-4d45-a2c3-e4dec3c0c49f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:03.240476 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-555d702e-2c75-4d45-a2c3-e4dec3c0c49f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.418636 Aug 27 04:48:03.253495 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1816/3674] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:02 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:03.281673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eff5ab33-bded-4403-9a65-701eec2a2282 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:03.295838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eff5ab33-bded-4403-9a65-701eec2a2282 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:03.307341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eff5ab33-bded-4403-9a65-701eec2a2282 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:03.308256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eff5ab33-bded-4403-9a65-701eec2a2282 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:03.309311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eff5ab33-bded-4403-9a65-701eec2a2282 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:03.311179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eff5ab33-bded-4403-9a65-701eec2a2282 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:03.316157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eff5ab33-bded-4403-9a65-701eec2a2282 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:03.317331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eff5ab33-bded-4403-9a65-701eec2a2282 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:03.426630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eff5ab33-bded-4403-9a65-701eec2a2282 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:03.442062 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eff5ab33-bded-4403-9a65-701eec2a2282 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1279 microversion: 2.1 time: 0.184580 Aug 27 04:48:03.445872 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1817/3675] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:03 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:03.451892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dc7a534c-7b1d-4ec3-8c05-1a667f5109e9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:03.452560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dc7a534c-7b1d-4ec3-8c05-1a667f5109e9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:03.463830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7a534c-7b1d-4ec3-8c05-1a667f5109e9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:03.464338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7a534c-7b1d-4ec3-8c05-1a667f5109e9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:03.464818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7a534c-7b1d-4ec3-8c05-1a667f5109e9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:03.465672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7a534c-7b1d-4ec3-8c05-1a667f5109e9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:03.466984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7a534c-7b1d-4ec3-8c05-1a667f5109e9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:03.468896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7a534c-7b1d-4ec3-8c05-1a667f5109e9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:03.490357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-258e4722-d81b-47b1-b24d-bd1c46370aa6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:03.500387 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-258e4722-d81b-47b1-b24d-bd1c46370aa6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1321 microversion: 2.1 time: 1.357684 Aug 27 04:48:03.501061 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1859/3676] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:02 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1321 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:03.843503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa588375-b119-4e00-a039-67e45cf4dd16 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:03.844127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fa588375-b119-4e00-a039-67e45cf4dd16 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:03.856670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa588375-b119-4e00-a039-67e45cf4dd16 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:03.857177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa588375-b119-4e00-a039-67e45cf4dd16 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:03.857618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa588375-b119-4e00-a039-67e45cf4dd16 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:03.858330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa588375-b119-4e00-a039-67e45cf4dd16 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:03.866856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa588375-b119-4e00-a039-67e45cf4dd16 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:03.867585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa588375-b119-4e00-a039-67e45cf4dd16 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:03.923005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dc7a534c-7b1d-4ec3-8c05-1a667f5109e9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:03.938601 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dc7a534c-7b1d-4ec3-8c05-1a667f5109e9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1314 microversion: 2.1 time: 0.491297 Aug 27 04:48:03.949292 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1818/3677] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:03 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:04.266976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aa75ecd9-41d9-4a99-9031-1d2e32ca57ae tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:04.267600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aa75ecd9-41d9-4a99-9031-1d2e32ca57ae tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:04.274439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa75ecd9-41d9-4a99-9031-1d2e32ca57ae tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:04.275189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa75ecd9-41d9-4a99-9031-1d2e32ca57ae tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:04.275632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa75ecd9-41d9-4a99-9031-1d2e32ca57ae tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:04.276584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa75ecd9-41d9-4a99-9031-1d2e32ca57ae tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:04.276999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa75ecd9-41d9-4a99-9031-1d2e32ca57ae tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:04.277281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa75ecd9-41d9-4a99-9031-1d2e32ca57ae tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:04.430062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aa75ecd9-41d9-4a99-9031-1d2e32ca57ae tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:04.437892 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aa75ecd9-41d9-4a99-9031-1d2e32ca57ae tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.175218 Aug 27 04:48:04.438470 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1819/3678] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:04 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:04.464038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cec6d76e-f453-4ae0-a28b-817d36b6d589 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:04.464723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cec6d76e-f453-4ae0-a28b-817d36b6d589 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:04.471378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cec6d76e-f453-4ae0-a28b-817d36b6d589 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:04.471936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cec6d76e-f453-4ae0-a28b-817d36b6d589 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:04.472433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cec6d76e-f453-4ae0-a28b-817d36b6d589 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:04.473217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cec6d76e-f453-4ae0-a28b-817d36b6d589 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:04.473776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cec6d76e-f453-4ae0-a28b-817d36b6d589 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:04.474309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cec6d76e-f453-4ae0-a28b-817d36b6d589 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:04.500751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa588375-b119-4e00-a039-67e45cf4dd16 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:04.509806 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa588375-b119-4e00-a039-67e45cf4dd16 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1313 microversion: 2.1 time: 0.670106 Aug 27 04:48:04.512080 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1860/3679] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:03 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:04.527162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c2f794c-0ff8-4cc2-aec4-dd25a2f4bc65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:04.527876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c2f794c-0ff8-4cc2-aec4-dd25a2f4bc65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:04.537061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c2f794c-0ff8-4cc2-aec4-dd25a2f4bc65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:04.537625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c2f794c-0ff8-4cc2-aec4-dd25a2f4bc65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:04.538155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c2f794c-0ff8-4cc2-aec4-dd25a2f4bc65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:04.538961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c2f794c-0ff8-4cc2-aec4-dd25a2f4bc65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:04.539626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c2f794c-0ff8-4cc2-aec4-dd25a2f4bc65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:04.540225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c2f794c-0ff8-4cc2-aec4-dd25a2f4bc65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:04.567330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cec6d76e-f453-4ae0-a28b-817d36b6d589 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:04.582733 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cec6d76e-f453-4ae0-a28b-817d36b6d589 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1285 microversion: 2.1 time: 0.122507 Aug 27 04:48:04.597904 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1820/3680] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:04 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:04.959761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0067ace-9870-442d-814e-7ca8c84814df tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:04.960397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c0067ace-9870-442d-814e-7ca8c84814df tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:04.974957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0067ace-9870-442d-814e-7ca8c84814df tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:04.975518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0067ace-9870-442d-814e-7ca8c84814df tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:04.976255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0067ace-9870-442d-814e-7ca8c84814df tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:04.977001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0067ace-9870-442d-814e-7ca8c84814df tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:04.977783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0067ace-9870-442d-814e-7ca8c84814df tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:04.978409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0067ace-9870-442d-814e-7ca8c84814df tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:05.032332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c2f794c-0ff8-4cc2-aec4-dd25a2f4bc65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:05.053727 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c2f794c-0ff8-4cc2-aec4-dd25a2f4bc65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1515 microversion: 2.1 time: 0.531811 Aug 27 04:48:05.054974 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1861/3681] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:04 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1515 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:05.074919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d41bd4a7-ccf1-4014-9c83-4af548105bdd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:05.077674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d41bd4a7-ccf1-4014-9c83-4af548105bdd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:05.084717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d41bd4a7-ccf1-4014-9c83-4af548105bdd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:05.085509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d41bd4a7-ccf1-4014-9c83-4af548105bdd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:05.086193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d41bd4a7-ccf1-4014-9c83-4af548105bdd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:05.087130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d41bd4a7-ccf1-4014-9c83-4af548105bdd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:05.087829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d41bd4a7-ccf1-4014-9c83-4af548105bdd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:05.088478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d41bd4a7-ccf1-4014-9c83-4af548105bdd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:05.145766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-d41bd4a7-ccf1-4014-9c83-4af548105bdd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lazy-loading 'flavor' on Instance uuid 686e7e13-0c27-41b1-b620-87a1410ac5bc {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:48:05.181793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c0067ace-9870-442d-814e-7ca8c84814df tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:05.192434 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c0067ace-9870-442d-814e-7ca8c84814df tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1314 microversion: 2.1 time: 0.236138 Aug 27 04:48:05.193654 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1821/3682] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:04 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:05.239252 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d41bd4a7-ccf1-4014-9c83-4af548105bdd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc/action" status: 200 len: 32 microversion: 2.1 time: 0.168314 Aug 27 04:48:05.240129 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1862/3683] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:48:05 2022] POST /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:48:05.258947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ebd04380-f2c1-42b0-804a-b45d69f68f83 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:05.259811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ebd04380-f2c1-42b0-804a-b45d69f68f83 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:05.267345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebd04380-f2c1-42b0-804a-b45d69f68f83 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:05.268046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebd04380-f2c1-42b0-804a-b45d69f68f83 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:05.269075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebd04380-f2c1-42b0-804a-b45d69f68f83 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:05.269862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebd04380-f2c1-42b0-804a-b45d69f68f83 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:05.270412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebd04380-f2c1-42b0-804a-b45d69f68f83 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:05.270910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebd04380-f2c1-42b0-804a-b45d69f68f83 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:05.462074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c0944ef-bad7-435a-9412-a1396b3519be tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:05.462895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7c0944ef-bad7-435a-9412-a1396b3519be tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:05.472841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c0944ef-bad7-435a-9412-a1396b3519be tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:05.484891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c0944ef-bad7-435a-9412-a1396b3519be tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:05.485620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c0944ef-bad7-435a-9412-a1396b3519be tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:05.486611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c0944ef-bad7-435a-9412-a1396b3519be tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:05.487309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c0944ef-bad7-435a-9412-a1396b3519be tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:05.487972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c0944ef-bad7-435a-9412-a1396b3519be tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:05.599999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ebd04380-f2c1-42b0-804a-b45d69f68f83 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:05.609767 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ebd04380-f2c1-42b0-804a-b45d69f68f83 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.355974 Aug 27 04:48:05.611060 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1822/3684] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:05 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:05.622204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a9caba8b-5537-4172-b7b1-097c10b411bd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:05.623230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a9caba8b-5537-4172-b7b1-097c10b411bd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:05.630971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9caba8b-5537-4172-b7b1-097c10b411bd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:05.631799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9caba8b-5537-4172-b7b1-097c10b411bd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:05.632920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9caba8b-5537-4172-b7b1-097c10b411bd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:05.634718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9caba8b-5537-4172-b7b1-097c10b411bd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:05.635206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9caba8b-5537-4172-b7b1-097c10b411bd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:05.635705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9caba8b-5537-4172-b7b1-097c10b411bd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:05.928736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7c0944ef-bad7-435a-9412-a1396b3519be tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:05.942680 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7c0944ef-bad7-435a-9412-a1396b3519be tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.485238 Aug 27 04:48:05.944398 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1863/3685] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:05 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:05.950988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b135f3d0-0635-4de5-98e1-eca18e9351ec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:05.951929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b135f3d0-0635-4de5-98e1-eca18e9351ec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:05.961583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b135f3d0-0635-4de5-98e1-eca18e9351ec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:05.962458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b135f3d0-0635-4de5-98e1-eca18e9351ec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:05.963566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b135f3d0-0635-4de5-98e1-eca18e9351ec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:05.964673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b135f3d0-0635-4de5-98e1-eca18e9351ec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:05.965629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b135f3d0-0635-4de5-98e1-eca18e9351ec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:05.966312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b135f3d0-0635-4de5-98e1-eca18e9351ec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:06.186913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b135f3d0-0635-4de5-98e1-eca18e9351ec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:06.188988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a9caba8b-5537-4172-b7b1-097c10b411bd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:06.197471 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a9caba8b-5537-4172-b7b1-097c10b411bd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1313 microversion: 2.1 time: 0.585121 Aug 27 04:48:06.198595 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1823/3686] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:05 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1313 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:06.201279 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b135f3d0-0635-4de5-98e1-eca18e9351ec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1285 microversion: 2.1 time: 0.255352 Aug 27 04:48:06.216554 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1864/3687] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:05 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1285 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:06.220707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3a3a53ca-7c92-4857-8f22-16803e0fabe5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:06.222406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3a3a53ca-7c92-4857-8f22-16803e0fabe5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:06.231769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a3a53ca-7c92-4857-8f22-16803e0fabe5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:06.232835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a3a53ca-7c92-4857-8f22-16803e0fabe5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:06.234731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a3a53ca-7c92-4857-8f22-16803e0fabe5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:06.237173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a3a53ca-7c92-4857-8f22-16803e0fabe5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:06.237939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a3a53ca-7c92-4857-8f22-16803e0fabe5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:06.238948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a3a53ca-7c92-4857-8f22-16803e0fabe5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:06.482534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3a3a53ca-7c92-4857-8f22-16803e0fabe5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:06.495162 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3a3a53ca-7c92-4857-8f22-16803e0fabe5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1314 microversion: 2.1 time: 0.284529 Aug 27 04:48:06.495767 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1824/3688] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:06 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:06.633933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c7011c9d-8783-4186-8099-762850e25148 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:06.634989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c7011c9d-8783-4186-8099-762850e25148 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:06.643027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7011c9d-8783-4186-8099-762850e25148 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:06.643811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7011c9d-8783-4186-8099-762850e25148 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:06.644352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7011c9d-8783-4186-8099-762850e25148 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:06.645252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7011c9d-8783-4186-8099-762850e25148 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:06.645999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7011c9d-8783-4186-8099-762850e25148 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:06.646648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7011c9d-8783-4186-8099-762850e25148 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:06.970910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59ab206d-8c5b-4797-99da-bbbcd164dfff tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:06.971531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-59ab206d-8c5b-4797-99da-bbbcd164dfff tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:06.980425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59ab206d-8c5b-4797-99da-bbbcd164dfff tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:06.980947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59ab206d-8c5b-4797-99da-bbbcd164dfff tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:06.981392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59ab206d-8c5b-4797-99da-bbbcd164dfff tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:06.982096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59ab206d-8c5b-4797-99da-bbbcd164dfff tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:06.982551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59ab206d-8c5b-4797-99da-bbbcd164dfff tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:06.982977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59ab206d-8c5b-4797-99da-bbbcd164dfff tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:07.003986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:07.188473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-59ab206d-8c5b-4797-99da-bbbcd164dfff tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:07.197506 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-59ab206d-8c5b-4797-99da-bbbcd164dfff tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.232653 Aug 27 04:48:07.210537 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1825/3689] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:06 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:07.229506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-efa22460-ec2d-4f9d-9a6a-350833d4a6c4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:07.230544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-efa22460-ec2d-4f9d-9a6a-350833d4a6c4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:07.247404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efa22460-ec2d-4f9d-9a6a-350833d4a6c4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:07.248212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efa22460-ec2d-4f9d-9a6a-350833d4a6c4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:07.248575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efa22460-ec2d-4f9d-9a6a-350833d4a6c4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:07.249344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efa22460-ec2d-4f9d-9a6a-350833d4a6c4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:07.250833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efa22460-ec2d-4f9d-9a6a-350833d4a6c4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:07.252652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efa22460-ec2d-4f9d-9a6a-350833d4a6c4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:07.429863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7011c9d-8783-4186-8099-762850e25148 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:07.441272 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c7011c9d-8783-4186-8099-762850e25148 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.813386 Aug 27 04:48:07.442545 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1865/3690] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:06 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:07.452020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4125b108-a886-4efc-b56c-569d02bbca22 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:07.453750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4125b108-a886-4efc-b56c-569d02bbca22 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:07.463706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4125b108-a886-4efc-b56c-569d02bbca22 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:07.464468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4125b108-a886-4efc-b56c-569d02bbca22 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:07.465161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4125b108-a886-4efc-b56c-569d02bbca22 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:07.466140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4125b108-a886-4efc-b56c-569d02bbca22 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:07.466861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4125b108-a886-4efc-b56c-569d02bbca22 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:07.467515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4125b108-a886-4efc-b56c-569d02bbca22 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:07.501406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-efa22460-ec2d-4f9d-9a6a-350833d4a6c4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:07.515311 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-efa22460-ec2d-4f9d-9a6a-350833d4a6c4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1334 microversion: 2.1 time: 0.295681 Aug 27 04:48:07.516364 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1826/3691] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:07 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1334 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:07.522528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ecbd4888-966f-4d60-9890-6bc4ebdf507f req-111b4319-d1f7-425f-b433-01f7a18c14fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49de8d6e-89fa-41c7-8c49-132644205b12", "name": "network-vif-plugged", "status": "completed", "tag": "5ec0d056-7cfe-4018-804a-37783c60c2ac"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:07.532794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ecbd4888-966f-4d60-9890-6bc4ebdf507f req-111b4319-d1f7-425f-b433-01f7a18c14fc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:07.533285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ecbd4888-966f-4d60-9890-6bc4ebdf507f req-111b4319-d1f7-425f-b433-01f7a18c14fc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:07.533723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ecbd4888-966f-4d60-9890-6bc4ebdf507f req-111b4319-d1f7-425f-b433-01f7a18c14fc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:07.545472 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ecbd4888-966f-4d60-9890-6bc4ebdf507f req-111b4319-d1f7-425f-b433-01f7a18c14fc service nova] Creating event network-vif-plugged:5ec0d056-7cfe-4018-804a-37783c60c2ac for instance 49de8d6e-89fa-41c7-8c49-132644205b12 on n-h1-854823-1 Aug 27 04:48:07.552387 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ecbd4888-966f-4d60-9890-6bc4ebdf507f req-111b4319-d1f7-425f-b433-01f7a18c14fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034672 Aug 27 04:48:07.553126 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1827/3692] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:07.558678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-16ce2c72-c332-46a8-b67b-046da5df3b28 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:07.559398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-16ce2c72-c332-46a8-b67b-046da5df3b28 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:07.566482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16ce2c72-c332-46a8-b67b-046da5df3b28 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:07.567380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16ce2c72-c332-46a8-b67b-046da5df3b28 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:07.567995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16ce2c72-c332-46a8-b67b-046da5df3b28 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:07.568930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16ce2c72-c332-46a8-b67b-046da5df3b28 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:07.569565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16ce2c72-c332-46a8-b67b-046da5df3b28 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:07.570187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16ce2c72-c332-46a8-b67b-046da5df3b28 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:07.878328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-16ce2c72-c332-46a8-b67b-046da5df3b28 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:07.887156 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-16ce2c72-c332-46a8-b67b-046da5df3b28 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1314 microversion: 2.1 time: 0.332626 Aug 27 04:48:07.887847 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1828/3693] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:07 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:07.918209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4125b108-a886-4efc-b56c-569d02bbca22 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:07.926733 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4125b108-a886-4efc-b56c-569d02bbca22 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1327 microversion: 2.1 time: 0.482903 Aug 27 04:48:07.940332 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1866/3694] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:07 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1327 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:08.220055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b86cef4f-b504-4042-abd9-4520aff05d86 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:08.221440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b86cef4f-b504-4042-abd9-4520aff05d86 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:08.272796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b86cef4f-b504-4042-abd9-4520aff05d86 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:08.274744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b86cef4f-b504-4042-abd9-4520aff05d86 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:08.279178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b86cef4f-b504-4042-abd9-4520aff05d86 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:08.282982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b86cef4f-b504-4042-abd9-4520aff05d86 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:08.283885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b86cef4f-b504-4042-abd9-4520aff05d86 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:08.288275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b86cef4f-b504-4042-abd9-4520aff05d86 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:08.463424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f26f663e-e4a4-4816-8ff3-83e7c635e834 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:08.463991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f26f663e-e4a4-4816-8ff3-83e7c635e834 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:08.478692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26f663e-e4a4-4816-8ff3-83e7c635e834 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:08.479205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26f663e-e4a4-4816-8ff3-83e7c635e834 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:08.479652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26f663e-e4a4-4816-8ff3-83e7c635e834 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:08.480563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26f663e-e4a4-4816-8ff3-83e7c635e834 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:08.480936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26f663e-e4a4-4816-8ff3-83e7c635e834 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:08.481370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26f663e-e4a4-4816-8ff3-83e7c635e834 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:08.682257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b86cef4f-b504-4042-abd9-4520aff05d86 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:08.709453 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b86cef4f-b504-4042-abd9-4520aff05d86 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.492945 Aug 27 04:48:08.711370 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1829/3695] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:08 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:08.729716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bd3fac4e-8d9b-46b7-85fc-6bd66441a99c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:08.731002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bd3fac4e-8d9b-46b7-85fc-6bd66441a99c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:08.741905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd3fac4e-8d9b-46b7-85fc-6bd66441a99c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:08.742679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd3fac4e-8d9b-46b7-85fc-6bd66441a99c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:08.743311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd3fac4e-8d9b-46b7-85fc-6bd66441a99c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:08.744251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd3fac4e-8d9b-46b7-85fc-6bd66441a99c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:08.745213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd3fac4e-8d9b-46b7-85fc-6bd66441a99c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:08.746521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd3fac4e-8d9b-46b7-85fc-6bd66441a99c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:08.946615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f26f663e-e4a4-4816-8ff3-83e7c635e834 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:08.964302 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f26f663e-e4a4-4816-8ff3-83e7c635e834 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.504733 Aug 27 04:48:08.965609 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1867/3696] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:08 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:08.973418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-173e0054-1fd3-4a64-bcca-559604595a81 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:08.975840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-173e0054-1fd3-4a64-bcca-559604595a81 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:08.985943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173e0054-1fd3-4a64-bcca-559604595a81 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:08.987291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173e0054-1fd3-4a64-bcca-559604595a81 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:08.989424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173e0054-1fd3-4a64-bcca-559604595a81 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:08.990581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173e0054-1fd3-4a64-bcca-559604595a81 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:08.991266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173e0054-1fd3-4a64-bcca-559604595a81 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:08.991900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173e0054-1fd3-4a64-bcca-559604595a81 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:09.025357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:09.215415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bd3fac4e-8d9b-46b7-85fc-6bd66441a99c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:09.223806 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bd3fac4e-8d9b-46b7-85fc-6bd66441a99c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1334 microversion: 2.1 time: 0.511148 Aug 27 04:48:09.224421 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1830/3697] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:08 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1334 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:09.292906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e4368ca5-249d-4483-879f-1376836aa84e tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:09.293711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e4368ca5-249d-4483-879f-1376836aa84e tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:09.311477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4368ca5-249d-4483-879f-1376836aa84e tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:09.321402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4368ca5-249d-4483-879f-1376836aa84e tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:09.323012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4368ca5-249d-4483-879f-1376836aa84e tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:09.327083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4368ca5-249d-4483-879f-1376836aa84e tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:09.327850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4368ca5-249d-4483-879f-1376836aa84e tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:09.328399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4368ca5-249d-4483-879f-1376836aa84e tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:09.594326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-173e0054-1fd3-4a64-bcca-559604595a81 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:09.607726 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-173e0054-1fd3-4a64-bcca-559604595a81 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1314 microversion: 2.1 time: 0.640349 Aug 27 04:48:09.611251 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1868/3698] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:08 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:09.632798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5edfc4ee-c40a-4c4f-9e4d-767a14287eae req-0504e8cd-bd8a-4124-bac1-81c62c3aa989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb357c1b-f703-4128-928f-96562649e22c", "tag": "a71b4cd8-6147-4aa6-bf38-baf2e4b36b7e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:09.652917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5edfc4ee-c40a-4c4f-9e4d-767a14287eae req-0504e8cd-bd8a-4124-bac1-81c62c3aa989 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:09.653427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5edfc4ee-c40a-4c4f-9e4d-767a14287eae req-0504e8cd-bd8a-4124-bac1-81c62c3aa989 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:09.654547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5edfc4ee-c40a-4c4f-9e4d-767a14287eae req-0504e8cd-bd8a-4124-bac1-81c62c3aa989 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:09.673535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e4368ca5-249d-4483-879f-1376836aa84e tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:09.678683 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5edfc4ee-c40a-4c4f-9e4d-767a14287eae req-0504e8cd-bd8a-4124-bac1-81c62c3aa989 service nova] Creating event network-changed:a71b4cd8-6147-4aa6-bf38-baf2e4b36b7e for instance eb357c1b-f703-4128-928f-96562649e22c on n-h1-854823-1 Aug 27 04:48:09.682166 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e4368ca5-249d-4483-879f-1376836aa84e tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1327 microversion: 2.1 time: 0.445828 Aug 27 04:48:09.689359 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1831/3699] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:09 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1327 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:09.693716 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5edfc4ee-c40a-4c4f-9e4d-767a14287eae req-0504e8cd-bd8a-4124-bac1-81c62c3aa989 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066555 Aug 27 04:48:09.696371 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1869/3700] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:09.735151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-23adbf99-fa8b-4a1a-9a7d-ee084e406f11 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:09.736209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-23adbf99-fa8b-4a1a-9a7d-ee084e406f11 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:09.748468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23adbf99-fa8b-4a1a-9a7d-ee084e406f11 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:09.750166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23adbf99-fa8b-4a1a-9a7d-ee084e406f11 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:09.750935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23adbf99-fa8b-4a1a-9a7d-ee084e406f11 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:09.752318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23adbf99-fa8b-4a1a-9a7d-ee084e406f11 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:09.754191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23adbf99-fa8b-4a1a-9a7d-ee084e406f11 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:09.755015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23adbf99-fa8b-4a1a-9a7d-ee084e406f11 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:09.986029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-23adbf99-fa8b-4a1a-9a7d-ee084e406f11 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:09.989367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e2577a23-deb3-4884-b286-2638c14fcc7f tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:09.994122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e2577a23-deb3-4884-b286-2638c14fcc7f tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:10.005974 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-23adbf99-fa8b-4a1a-9a7d-ee084e406f11 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.278111 Aug 27 04:48:10.009772 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1832/3701] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:09 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:10.010735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2577a23-deb3-4884-b286-2638c14fcc7f tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:10.011558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2577a23-deb3-4884-b286-2638c14fcc7f tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:10.013190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2577a23-deb3-4884-b286-2638c14fcc7f tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:10.014904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2577a23-deb3-4884-b286-2638c14fcc7f tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:10.015935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2577a23-deb3-4884-b286-2638c14fcc7f tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:10.016689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2577a23-deb3-4884-b286-2638c14fcc7f tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:10.255271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-10749a8a-ba83-45eb-b35d-cf2846223bbb tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:10.256257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-10749a8a-ba83-45eb-b35d-cf2846223bbb tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:10.271035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10749a8a-ba83-45eb-b35d-cf2846223bbb tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:10.272602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10749a8a-ba83-45eb-b35d-cf2846223bbb tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:10.273961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10749a8a-ba83-45eb-b35d-cf2846223bbb tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:10.277222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10749a8a-ba83-45eb-b35d-cf2846223bbb tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:10.278789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10749a8a-ba83-45eb-b35d-cf2846223bbb tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:10.279598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10749a8a-ba83-45eb-b35d-cf2846223bbb tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:10.580633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10749a8a-ba83-45eb-b35d-cf2846223bbb tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:10.596276 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-10749a8a-ba83-45eb-b35d-cf2846223bbb tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1355 microversion: 2.1 time: 0.352073 Aug 27 04:48:10.614390 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1833/3702] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:10 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1355 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:10.620289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e2577a23-deb3-4884-b286-2638c14fcc7f tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:10.633388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-259dd5c8-87f9-48f7-a758-e93af98a36e7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:10.634832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-259dd5c8-87f9-48f7-a758-e93af98a36e7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:10.639857 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e2577a23-deb3-4884-b286-2638c14fcc7f tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.656698 Aug 27 04:48:10.644583 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1870/3703] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:09 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:10.655704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-259dd5c8-87f9-48f7-a758-e93af98a36e7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:10.658592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-259dd5c8-87f9-48f7-a758-e93af98a36e7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:10.659363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-259dd5c8-87f9-48f7-a758-e93af98a36e7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:10.661481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-259dd5c8-87f9-48f7-a758-e93af98a36e7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:10.663922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-259dd5c8-87f9-48f7-a758-e93af98a36e7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:10.664642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-259dd5c8-87f9-48f7-a758-e93af98a36e7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:10.717987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3d7f9ec-3e07-4ba5-b0e8-09d91796a3a4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:10.718716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e3d7f9ec-3e07-4ba5-b0e8-09d91796a3a4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:10.733775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3d7f9ec-3e07-4ba5-b0e8-09d91796a3a4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:10.734852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3d7f9ec-3e07-4ba5-b0e8-09d91796a3a4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:10.735309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3d7f9ec-3e07-4ba5-b0e8-09d91796a3a4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:10.736054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3d7f9ec-3e07-4ba5-b0e8-09d91796a3a4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:10.736522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3d7f9ec-3e07-4ba5-b0e8-09d91796a3a4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:10.736975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3d7f9ec-3e07-4ba5-b0e8-09d91796a3a4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:10.947508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-259dd5c8-87f9-48f7-a758-e93af98a36e7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:10.956790 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-259dd5c8-87f9-48f7-a758-e93af98a36e7 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1498 microversion: 2.1 time: 0.327919 Aug 27 04:48:10.958359 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1834/3704] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:10 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1498 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:11.030561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-95b49cd9-ce25-49be-bcdc-c7b1f1581988 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:11.033152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-95b49cd9-ce25-49be-bcdc-c7b1f1581988 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:11.043942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95b49cd9-ce25-49be-bcdc-c7b1f1581988 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:11.045268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95b49cd9-ce25-49be-bcdc-c7b1f1581988 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:11.045950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95b49cd9-ce25-49be-bcdc-c7b1f1581988 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:11.049284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95b49cd9-ce25-49be-bcdc-c7b1f1581988 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:11.051549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95b49cd9-ce25-49be-bcdc-c7b1f1581988 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:11.051549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95b49cd9-ce25-49be-bcdc-c7b1f1581988 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:11.121135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:11.197370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:11.447568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-95b49cd9-ce25-49be-bcdc-c7b1f1581988 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:11.457556 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-95b49cd9-ce25-49be-bcdc-c7b1f1581988 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.431016 Aug 27 04:48:11.480304 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1835/3705] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:11 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:11.541428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e3d7f9ec-3e07-4ba5-b0e8-09d91796a3a4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:11.563227 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3d7f9ec-3e07-4ba5-b0e8-09d91796a3a4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1327 microversion: 2.1 time: 0.856681 Aug 27 04:48:11.564618 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1871/3706] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:10 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1327 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:11.622887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2af8fc7c-59fc-468c-9eb1-e015f83d3493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:11.623511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2af8fc7c-59fc-468c-9eb1-e015f83d3493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:11.645432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2af8fc7c-59fc-468c-9eb1-e015f83d3493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:11.646189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2af8fc7c-59fc-468c-9eb1-e015f83d3493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:11.646811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2af8fc7c-59fc-468c-9eb1-e015f83d3493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:11.647689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2af8fc7c-59fc-468c-9eb1-e015f83d3493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:11.647827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-21a33b95-f72f-42a7-827d-6a5d3badc3d5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:11.648469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-21a33b95-f72f-42a7-827d-6a5d3badc3d5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:11.648990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2af8fc7c-59fc-468c-9eb1-e015f83d3493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:11.649741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2af8fc7c-59fc-468c-9eb1-e015f83d3493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:11.656771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21a33b95-f72f-42a7-827d-6a5d3badc3d5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:11.657396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21a33b95-f72f-42a7-827d-6a5d3badc3d5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:11.658081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21a33b95-f72f-42a7-827d-6a5d3badc3d5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:11.659272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21a33b95-f72f-42a7-827d-6a5d3badc3d5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:11.659967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21a33b95-f72f-42a7-827d-6a5d3badc3d5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:11.660781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21a33b95-f72f-42a7-827d-6a5d3badc3d5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:11.693191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-21a33b95-f72f-42a7-827d-6a5d3badc3d5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:48:11.798338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:11.809253 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-21a33b95-f72f-42a7-827d-6a5d3badc3d5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "DELETE /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 204 len: 0 microversion: 2.1 time: 0.166262 Aug 27 04:48:11.810041 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1872/3707] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:48:11 2022] DELETE /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:48:11.816939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6752c455-3ce3-4b5a-8e28-bb29459b613a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:11.817805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6752c455-3ce3-4b5a-8e28-bb29459b613a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:11.824458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6752c455-3ce3-4b5a-8e28-bb29459b613a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:11.825255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6752c455-3ce3-4b5a-8e28-bb29459b613a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:11.825884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6752c455-3ce3-4b5a-8e28-bb29459b613a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:11.827141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6752c455-3ce3-4b5a-8e28-bb29459b613a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:11.827866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6752c455-3ce3-4b5a-8e28-bb29459b613a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:11.828563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6752c455-3ce3-4b5a-8e28-bb29459b613a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:11.894428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:11.978176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2af8fc7c-59fc-468c-9eb1-e015f83d3493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:11.991714 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2af8fc7c-59fc-468c-9eb1-e015f83d3493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1355 microversion: 2.1 time: 0.372378 Aug 27 04:48:12.005386 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1836/3708] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:11 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1355 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:12.012169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8a6bc2ba-bfd3-4361-9c24-249ed1ea71ef tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:12.013107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8a6bc2ba-bfd3-4361-9c24-249ed1ea71ef tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:12.020287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a6bc2ba-bfd3-4361-9c24-249ed1ea71ef tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:12.021096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a6bc2ba-bfd3-4361-9c24-249ed1ea71ef tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:12.021713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a6bc2ba-bfd3-4361-9c24-249ed1ea71ef tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:12.022750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a6bc2ba-bfd3-4361-9c24-249ed1ea71ef tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:12.023487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a6bc2ba-bfd3-4361-9c24-249ed1ea71ef tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:12.025457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a6bc2ba-bfd3-4361-9c24-249ed1ea71ef tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:12.200471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8a6bc2ba-bfd3-4361-9c24-249ed1ea71ef tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:12.210275 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8a6bc2ba-bfd3-4361-9c24-249ed1ea71ef tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1504 microversion: 2.1 time: 0.203751 Aug 27 04:48:12.211592 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1837/3709] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:12 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:12.216910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-5c43ab3b-7f07-4882-8c9c-6ca918bfa61f req-77d869ad-d51b-421c-bbd6-0902e8a66d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed03d537-8672-4059-88f4-b1f4399727b7", "tag": "7cf7405a-773f-40a7-b15b-4341558451b0"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:12.228906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5c43ab3b-7f07-4882-8c9c-6ca918bfa61f req-77d869ad-d51b-421c-bbd6-0902e8a66d24 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:12.229667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5c43ab3b-7f07-4882-8c9c-6ca918bfa61f req-77d869ad-d51b-421c-bbd6-0902e8a66d24 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:12.230444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5c43ab3b-7f07-4882-8c9c-6ca918bfa61f req-77d869ad-d51b-421c-bbd6-0902e8a66d24 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:12.252253 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-5c43ab3b-7f07-4882-8c9c-6ca918bfa61f req-77d869ad-d51b-421c-bbd6-0902e8a66d24 service nova] Creating event network-changed:7cf7405a-773f-40a7-b15b-4341558451b0 for instance ed03d537-8672-4059-88f4-b1f4399727b7 on n-h2-854823-1 Aug 27 04:48:12.257933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6752c455-3ce3-4b5a-8e28-bb29459b613a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:12.260606 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-5c43ab3b-7f07-4882-8c9c-6ca918bfa61f req-77d869ad-d51b-421c-bbd6-0902e8a66d24 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047289 Aug 27 04:48:12.261862 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1838/3710] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:12.280320 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6752c455-3ce3-4b5a-8e28-bb29459b613a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.468717 Aug 27 04:48:12.281498 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1873/3711] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:11 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:12.374152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1715247012", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:12.478572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] validate_networks() for [('a5ef70fe-ea4b-40c8-a687-276e93bfa08f', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:48:12.488833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-efd12a84-7d2d-4623-a1cf-39101b6df4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:12.489700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-efd12a84-7d2d-4623-a1cf-39101b6df4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:12.496672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efd12a84-7d2d-4623-a1cf-39101b6df4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:12.509405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efd12a84-7d2d-4623-a1cf-39101b6df4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:12.510287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efd12a84-7d2d-4623-a1cf-39101b6df4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:12.511443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efd12a84-7d2d-4623-a1cf-39101b6df4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:12.512190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efd12a84-7d2d-4623-a1cf-39101b6df4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:12.513061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efd12a84-7d2d-4623-a1cf-39101b6df4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:12.740094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-efd12a84-7d2d-4623-a1cf-39101b6df4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:12.755677 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-efd12a84-7d2d-4623-a1cf-39101b6df4cf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.267587 Aug 27 04:48:12.756767 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1874/3712] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:12 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:12.767670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a28b402d-6435-40f0-ad54-cdd796873523 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:12.768687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a28b402d-6435-40f0-ad54-cdd796873523 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:12.777069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a28b402d-6435-40f0-ad54-cdd796873523 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:12.777935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a28b402d-6435-40f0-ad54-cdd796873523 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:12.778629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a28b402d-6435-40f0-ad54-cdd796873523 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:12.779580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a28b402d-6435-40f0-ad54-cdd796873523 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:12.780272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a28b402d-6435-40f0-ad54-cdd796873523 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:12.780981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a28b402d-6435-40f0-ad54-cdd796873523 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:13.056071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a28b402d-6435-40f0-ad54-cdd796873523 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:13.064812 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a28b402d-6435-40f0-ad54-cdd796873523 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1327 microversion: 2.1 time: 0.306813 Aug 27 04:48:13.065664 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1875/3713] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:12 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1327 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:13.074454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc1886ca-98a1-4352-8cb6-d66754feae2b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:13.077345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc1886ca-98a1-4352-8cb6-d66754feae2b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:13.088059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc1886ca-98a1-4352-8cb6-d66754feae2b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:13.088473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc1886ca-98a1-4352-8cb6-d66754feae2b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:13.089014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc1886ca-98a1-4352-8cb6-d66754feae2b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:13.089686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc1886ca-98a1-4352-8cb6-d66754feae2b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:13.090110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc1886ca-98a1-4352-8cb6-d66754feae2b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:13.090544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc1886ca-98a1-4352-8cb6-d66754feae2b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:13.345432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cc1886ca-98a1-4352-8cb6-d66754feae2b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:13.362179 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc1886ca-98a1-4352-8cb6-d66754feae2b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1355 microversion: 2.1 time: 0.291086 Aug 27 04:48:13.376912 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1876/3714] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:13 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1355 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:13.387626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57cd505e-e42e-4b2c-a233-e54c6952e618 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:13.392372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57cd505e-e42e-4b2c-a233-e54c6952e618 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:13.408192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57cd505e-e42e-4b2c-a233-e54c6952e618 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:13.411642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57cd505e-e42e-4b2c-a233-e54c6952e618 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:13.412193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57cd505e-e42e-4b2c-a233-e54c6952e618 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:13.414277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57cd505e-e42e-4b2c-a233-e54c6952e618 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:13.415547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57cd505e-e42e-4b2c-a233-e54c6952e618 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:13.418206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57cd505e-e42e-4b2c-a233-e54c6952e618 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:13.717163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57cd505e-e42e-4b2c-a233-e54c6952e618 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:13.727944 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57cd505e-e42e-4b2c-a233-e54c6952e618 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1504 microversion: 2.1 time: 0.348756 Aug 27 04:48:13.728482 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1877/3715] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:13 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:13.740841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d013961-d11e-4130-8d64-b2d897b2f317 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:13.740841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d013961-d11e-4130-8d64-b2d897b2f317 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:13.745001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:48:13.745662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:48:13.745887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:48:13.746299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:48:13.746708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:48:13.763498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:13.764367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:13.764967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d013961-d11e-4130-8d64-b2d897b2f317 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:13.765804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:13.766621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d013961-d11e-4130-8d64-b2d897b2f317 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:13.767043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:13.767170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d013961-d11e-4130-8d64-b2d897b2f317 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:13.767831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:13.768269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:13.768412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d013961-d11e-4130-8d64-b2d897b2f317 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:13.768787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d013961-d11e-4130-8d64-b2d897b2f317 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:13.769381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d013961-d11e-4130-8d64-b2d897b2f317 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:13.810912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Getting quotas for project ff524508e53d4e69bc37ffb928486e1c. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:48:13.817400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Getting quotas for user 902983c84d2f4c60a469ae3be1795646 and project ff524508e53d4e69bc37ffb928486e1c. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:48:13.830699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:48:13.833132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:48:13.861960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:13.890078 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6fd12b22-78db-46b5-a67c-68d9fd536b76 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.626446 Aug 27 04:48:13.891047 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1839/3716] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:48:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:48:13.903313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-701fdbbd-da79-4f17-a8be-db5da25be723 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:13.904237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-701fdbbd-da79-4f17-a8be-db5da25be723 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:13.913560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-701fdbbd-da79-4f17-a8be-db5da25be723 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:13.915343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-701fdbbd-da79-4f17-a8be-db5da25be723 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:13.915774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-701fdbbd-da79-4f17-a8be-db5da25be723 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:13.916508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-701fdbbd-da79-4f17-a8be-db5da25be723 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:13.917148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-701fdbbd-da79-4f17-a8be-db5da25be723 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:13.918357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-701fdbbd-da79-4f17-a8be-db5da25be723 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:14.029629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d013961-d11e-4130-8d64-b2d897b2f317 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:14.042101 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d013961-d11e-4130-8d64-b2d897b2f317 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.307076 Aug 27 04:48:14.042704 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1878/3717] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:13 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:14.058373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3dee0940-fa7c-443b-8a3c-0e20b7513cb9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:14.059535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3dee0940-fa7c-443b-8a3c-0e20b7513cb9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:14.144785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-701fdbbd-da79-4f17-a8be-db5da25be723 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:14.156035 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-701fdbbd-da79-4f17-a8be-db5da25be723 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.263456 Aug 27 04:48:14.157244 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1840/3718] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:13 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:14.164218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-55f96f33-31e8-4c25-ad4f-eac632fbbaec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:14.165154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-55f96f33-31e8-4c25-ad4f-eac632fbbaec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:14.185736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55f96f33-31e8-4c25-ad4f-eac632fbbaec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:14.187891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55f96f33-31e8-4c25-ad4f-eac632fbbaec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:14.190917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55f96f33-31e8-4c25-ad4f-eac632fbbaec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:14.194026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55f96f33-31e8-4c25-ad4f-eac632fbbaec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:14.194859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55f96f33-31e8-4c25-ad4f-eac632fbbaec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:14.197185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55f96f33-31e8-4c25-ad4f-eac632fbbaec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:14.217041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3dee0940-fa7c-443b-8a3c-0e20b7513cb9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:14.226933 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3dee0940-fa7c-443b-8a3c-0e20b7513cb9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1214 microversion: 2.1 time: 0.182543 Aug 27 04:48:14.229968 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1879/3719] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:14 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:14.305683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0d7e0df8-842c-490f-b480-40e3dc689557 req-ef244824-9ac8-4958-8dcd-8c24f945fad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed03d537-8672-4059-88f4-b1f4399727b7", "tag": "609ea5bc-0f2d-4153-a59d-4a006013477f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:14.326850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0d7e0df8-842c-490f-b480-40e3dc689557 req-ef244824-9ac8-4958-8dcd-8c24f945fad7 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:14.327358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0d7e0df8-842c-490f-b480-40e3dc689557 req-ef244824-9ac8-4958-8dcd-8c24f945fad7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:14.328413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0d7e0df8-842c-490f-b480-40e3dc689557 req-ef244824-9ac8-4958-8dcd-8c24f945fad7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:14.358257 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0d7e0df8-842c-490f-b480-40e3dc689557 req-ef244824-9ac8-4958-8dcd-8c24f945fad7 service nova] Creating event network-changed:609ea5bc-0f2d-4153-a59d-4a006013477f for instance ed03d537-8672-4059-88f4-b1f4399727b7 on n-h2-854823-1 Aug 27 04:48:14.386564 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0d7e0df8-842c-490f-b480-40e3dc689557 req-ef244824-9ac8-4958-8dcd-8c24f945fad7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073312 Aug 27 04:48:14.387997 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1880/3720] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:48:14.405227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b0b6384-b9f4-48e5-afb1-f75b9f111493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:14.406623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b0b6384-b9f4-48e5-afb1-f75b9f111493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:14.421300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b0b6384-b9f4-48e5-afb1-f75b9f111493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:14.425033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b0b6384-b9f4-48e5-afb1-f75b9f111493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:14.425542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b0b6384-b9f4-48e5-afb1-f75b9f111493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:14.432150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b0b6384-b9f4-48e5-afb1-f75b9f111493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:14.432951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b0b6384-b9f4-48e5-afb1-f75b9f111493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:14.433606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b0b6384-b9f4-48e5-afb1-f75b9f111493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:14.631486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-55f96f33-31e8-4c25-ad4f-eac632fbbaec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:14.651881 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-55f96f33-31e8-4c25-ad4f-eac632fbbaec tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1327 microversion: 2.1 time: 0.491654 Aug 27 04:48:14.652914 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1841/3721] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:14 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1327 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:14.753631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-974b1692-56f3-429a-8092-8e91284d3031 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:14.758068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-974b1692-56f3-429a-8092-8e91284d3031 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:14.775140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-974b1692-56f3-429a-8092-8e91284d3031 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:14.779417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-974b1692-56f3-429a-8092-8e91284d3031 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:14.782035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-974b1692-56f3-429a-8092-8e91284d3031 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:14.783045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-974b1692-56f3-429a-8092-8e91284d3031 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:14.785056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-974b1692-56f3-429a-8092-8e91284d3031 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:14.791189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-974b1692-56f3-429a-8092-8e91284d3031 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:14.821378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0b0b6384-b9f4-48e5-afb1-f75b9f111493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:14.836012 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b0b6384-b9f4-48e5-afb1-f75b9f111493 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1355 microversion: 2.1 time: 0.446632 Aug 27 04:48:14.838197 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1881/3722] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:14 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1355 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:15.047982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-974b1692-56f3-429a-8092-8e91284d3031 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:15.057859 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-974b1692-56f3-429a-8092-8e91284d3031 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1504 microversion: 2.1 time: 0.309335 Aug 27 04:48:15.073057 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1842/3723] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:14 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1504 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:15.079829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-add2cc09-efa6-457d-b66c-572d8f82d691 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:15.080840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-add2cc09-efa6-457d-b66c-572d8f82d691 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:15.093961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-add2cc09-efa6-457d-b66c-572d8f82d691 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:15.097424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-add2cc09-efa6-457d-b66c-572d8f82d691 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:15.098221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-add2cc09-efa6-457d-b66c-572d8f82d691 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:15.099471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-add2cc09-efa6-457d-b66c-572d8f82d691 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:15.100881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-add2cc09-efa6-457d-b66c-572d8f82d691 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:15.101729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-add2cc09-efa6-457d-b66c-572d8f82d691 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:15.178650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d07add9d-7971-49c8-8fc7-a19556a77c24 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:15.179284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d07add9d-7971-49c8-8fc7-a19556a77c24 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:15.195527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d07add9d-7971-49c8-8fc7-a19556a77c24 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:15.196036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d07add9d-7971-49c8-8fc7-a19556a77c24 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:15.196481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d07add9d-7971-49c8-8fc7-a19556a77c24 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:15.197232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d07add9d-7971-49c8-8fc7-a19556a77c24 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:15.201198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d07add9d-7971-49c8-8fc7-a19556a77c24 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:15.201661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d07add9d-7971-49c8-8fc7-a19556a77c24 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:15.420967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-add2cc09-efa6-457d-b66c-572d8f82d691 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:15.439314 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-add2cc09-efa6-457d-b66c-572d8f82d691 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.375344 Aug 27 04:48:15.440890 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1882/3724] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:15 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:15.447345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3056aaa-b048-41d3-96d3-032ab550b5ca tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:15.450450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c3056aaa-b048-41d3-96d3-032ab550b5ca tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:15.466182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3056aaa-b048-41d3-96d3-032ab550b5ca tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:15.466926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3056aaa-b048-41d3-96d3-032ab550b5ca tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:15.469818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3056aaa-b048-41d3-96d3-032ab550b5ca tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:15.472072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3056aaa-b048-41d3-96d3-032ab550b5ca tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:15.473844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3056aaa-b048-41d3-96d3-032ab550b5ca tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:15.476150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3056aaa-b048-41d3-96d3-032ab550b5ca tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:15.536311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d07add9d-7971-49c8-8fc7-a19556a77c24 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:15.551873 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d07add9d-7971-49c8-8fc7-a19556a77c24 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.377487 Aug 27 04:48:15.555324 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1843/3725] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:15 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:15.662526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3056aaa-b048-41d3-96d3-032ab550b5ca tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:15.671967 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3056aaa-b048-41d3-96d3-032ab550b5ca tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1266 microversion: 2.1 time: 0.229447 Aug 27 04:48:15.672845 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1883/3726] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:15 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:15.674224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-73fdf28a-6bd8-407f-af4e-764bd6ac3db4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:15.674845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-73fdf28a-6bd8-407f-af4e-764bd6ac3db4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:15.683927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73fdf28a-6bd8-407f-af4e-764bd6ac3db4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:15.685271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73fdf28a-6bd8-407f-af4e-764bd6ac3db4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:15.685787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73fdf28a-6bd8-407f-af4e-764bd6ac3db4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:15.686566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73fdf28a-6bd8-407f-af4e-764bd6ac3db4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:15.687419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73fdf28a-6bd8-407f-af4e-764bd6ac3db4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:15.687851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73fdf28a-6bd8-407f-af4e-764bd6ac3db4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:15.693117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:15.869244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4706310b-738a-4a7d-b99d-d7ff3d3f7999 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:15.869873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4706310b-738a-4a7d-b99d-d7ff3d3f7999 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:15.884361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4706310b-738a-4a7d-b99d-d7ff3d3f7999 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:15.884968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4706310b-738a-4a7d-b99d-d7ff3d3f7999 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:15.886160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4706310b-738a-4a7d-b99d-d7ff3d3f7999 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:15.887161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4706310b-738a-4a7d-b99d-d7ff3d3f7999 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:15.888380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4706310b-738a-4a7d-b99d-d7ff3d3f7999 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:15.889048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4706310b-738a-4a7d-b99d-d7ff3d3f7999 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:15.936296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-73fdf28a-6bd8-407f-af4e-764bd6ac3db4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:15.966059 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-73fdf28a-6bd8-407f-af4e-764bd6ac3db4 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1327 microversion: 2.1 time: 0.290241 Aug 27 04:48:15.967350 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1844/3727] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:15 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1327 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:16.083727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-84d7ffba-c652-4937-bdf0-cb2d3ed32e86 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:16.085246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-84d7ffba-c652-4937-bdf0-cb2d3ed32e86 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:16.108716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84d7ffba-c652-4937-bdf0-cb2d3ed32e86 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:16.112972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84d7ffba-c652-4937-bdf0-cb2d3ed32e86 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:16.113441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84d7ffba-c652-4937-bdf0-cb2d3ed32e86 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:16.119967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84d7ffba-c652-4937-bdf0-cb2d3ed32e86 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:16.120574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84d7ffba-c652-4937-bdf0-cb2d3ed32e86 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:16.123882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84d7ffba-c652-4937-bdf0-cb2d3ed32e86 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:16.488355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4706310b-738a-4a7d-b99d-d7ff3d3f7999 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:16.500425 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4706310b-738a-4a7d-b99d-d7ff3d3f7999 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1355 microversion: 2.1 time: 0.636141 Aug 27 04:48:16.502095 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1884/3728] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:15 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1355 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:16.509084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c04d4b24-e903-4050-b576-d6be7978cdb3 req-1adf6c24-deb4-4538-97d1-eb83d64dd2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed03d537-8672-4059-88f4-b1f4399727b7", "tag": "c84faf0c-e8ca-4220-baee-3ca2659d5d63"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:16.525233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c04d4b24-e903-4050-b576-d6be7978cdb3 req-1adf6c24-deb4-4538-97d1-eb83d64dd2b7 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:16.526151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c04d4b24-e903-4050-b576-d6be7978cdb3 req-1adf6c24-deb4-4538-97d1-eb83d64dd2b7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:16.526707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c04d4b24-e903-4050-b576-d6be7978cdb3 req-1adf6c24-deb4-4538-97d1-eb83d64dd2b7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:16.538281 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c04d4b24-e903-4050-b576-d6be7978cdb3 req-1adf6c24-deb4-4538-97d1-eb83d64dd2b7 service nova] Creating event network-changed:c84faf0c-e8ca-4220-baee-3ca2659d5d63 for instance ed03d537-8672-4059-88f4-b1f4399727b7 on n-h2-854823-1 Aug 27 04:48:16.543511 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c04d4b24-e903-4050-b576-d6be7978cdb3 req-1adf6c24-deb4-4538-97d1-eb83d64dd2b7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039388 Aug 27 04:48:16.544577 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1885/3729] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:16.550024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eaf2d27b-fb66-4fcf-8e15-f46d383fcee5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:16.551093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eaf2d27b-fb66-4fcf-8e15-f46d383fcee5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:16.558594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaf2d27b-fb66-4fcf-8e15-f46d383fcee5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:16.558594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaf2d27b-fb66-4fcf-8e15-f46d383fcee5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:16.558934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaf2d27b-fb66-4fcf-8e15-f46d383fcee5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:16.560166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaf2d27b-fb66-4fcf-8e15-f46d383fcee5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:16.560905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaf2d27b-fb66-4fcf-8e15-f46d383fcee5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:16.561497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaf2d27b-fb66-4fcf-8e15-f46d383fcee5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:16.575216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-84d7ffba-c652-4937-bdf0-cb2d3ed32e86 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:16.584700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:16.603760 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-84d7ffba-c652-4937-bdf0-cb2d3ed32e86 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1504 microversion: 2.1 time: 0.523954 Aug 27 04:48:16.610833 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1845/3730] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:16 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1504 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:16.625088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d00631a2-381b-411d-96df-ce18565d5b9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:16.626010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d00631a2-381b-411d-96df-ce18565d5b9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:16.636482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d00631a2-381b-411d-96df-ce18565d5b9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:16.637487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d00631a2-381b-411d-96df-ce18565d5b9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:16.638375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d00631a2-381b-411d-96df-ce18565d5b9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:16.639317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d00631a2-381b-411d-96df-ce18565d5b9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:16.640683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d00631a2-381b-411d-96df-ce18565d5b9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:16.641999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d00631a2-381b-411d-96df-ce18565d5b9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:16.958422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d00631a2-381b-411d-96df-ce18565d5b9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:16.968980 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d00631a2-381b-411d-96df-ce18565d5b9e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.355864 Aug 27 04:48:16.983578 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1846/3731] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:16 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:16.989910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8baf8b7c-98c0-468b-a35b-87f736a5ba2a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:16.990861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8baf8b7c-98c0-468b-a35b-87f736a5ba2a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:16.998368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8baf8b7c-98c0-468b-a35b-87f736a5ba2a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:16.999964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8baf8b7c-98c0-468b-a35b-87f736a5ba2a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:17.000677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8baf8b7c-98c0-468b-a35b-87f736a5ba2a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:17.002134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8baf8b7c-98c0-468b-a35b-87f736a5ba2a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:17.002869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8baf8b7c-98c0-468b-a35b-87f736a5ba2a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:17.004263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8baf8b7c-98c0-468b-a35b-87f736a5ba2a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:17.025623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eaf2d27b-fb66-4fcf-8e15-f46d383fcee5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:17.062955 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eaf2d27b-fb66-4fcf-8e15-f46d383fcee5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.513560 Aug 27 04:48:17.077248 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1886/3732] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:16 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:17.083427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cd61457-8a03-485e-86c8-1f116f612838 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:17.093825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2cd61457-8a03-485e-86c8-1f116f612838 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:17.115315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cd61457-8a03-485e-86c8-1f116f612838 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:17.117419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cd61457-8a03-485e-86c8-1f116f612838 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:17.118472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cd61457-8a03-485e-86c8-1f116f612838 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:17.119231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cd61457-8a03-485e-86c8-1f116f612838 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:17.119709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cd61457-8a03-485e-86c8-1f116f612838 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:17.120143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cd61457-8a03-485e-86c8-1f116f612838 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:17.138967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8baf8b7c-98c0-468b-a35b-87f736a5ba2a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:17.147033 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8baf8b7c-98c0-468b-a35b-87f736a5ba2a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1272 microversion: 2.1 time: 0.160987 Aug 27 04:48:17.151437 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1847/3733] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:16 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:17.240261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d35453f1-5a2c-45f5-982b-88e19ee330e2 req-2804be81-b4c9-4600-8adb-6e7a88a73e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49de8d6e-89fa-41c7-8c49-132644205b12", "name": "network-vif-deleted", "tag": "5ec0d056-7cfe-4018-804a-37783c60c2ac"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:17.252507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d35453f1-5a2c-45f5-982b-88e19ee330e2 req-2804be81-b4c9-4600-8adb-6e7a88a73e4e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:17.253280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d35453f1-5a2c-45f5-982b-88e19ee330e2 req-2804be81-b4c9-4600-8adb-6e7a88a73e4e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:17.253903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d35453f1-5a2c-45f5-982b-88e19ee330e2 req-2804be81-b4c9-4600-8adb-6e7a88a73e4e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:17.285810 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d35453f1-5a2c-45f5-982b-88e19ee330e2 req-2804be81-b4c9-4600-8adb-6e7a88a73e4e service nova] Creating event network-vif-deleted:5ec0d056-7cfe-4018-804a-37783c60c2ac for instance 49de8d6e-89fa-41c7-8c49-132644205b12 on n-h1-854823-1 Aug 27 04:48:17.294699 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d35453f1-5a2c-45f5-982b-88e19ee330e2 req-2804be81-b4c9-4600-8adb-6e7a88a73e4e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061267 Aug 27 04:48:17.299125 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1848/3734] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:17.475264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a3d1e52d-5702-4455-accb-fc596f019311 req-4f14f17a-98b2-436c-8548-04f0eebcf1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb357c1b-f703-4128-928f-96562649e22c", "name": "network-vif-plugged", "status": "completed", "tag": "a71b4cd8-6147-4aa6-bf38-baf2e4b36b7e"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:17.488101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a3d1e52d-5702-4455-accb-fc596f019311 req-4f14f17a-98b2-436c-8548-04f0eebcf1a7 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:17.488880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a3d1e52d-5702-4455-accb-fc596f019311 req-4f14f17a-98b2-436c-8548-04f0eebcf1a7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:17.489532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a3d1e52d-5702-4455-accb-fc596f019311 req-4f14f17a-98b2-436c-8548-04f0eebcf1a7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:17.501949 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a3d1e52d-5702-4455-accb-fc596f019311 req-4f14f17a-98b2-436c-8548-04f0eebcf1a7 service nova] Creating event network-vif-plugged:a71b4cd8-6147-4aa6-bf38-baf2e4b36b7e for instance eb357c1b-f703-4128-928f-96562649e22c on n-h1-854823-1 Aug 27 04:48:17.507892 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a3d1e52d-5702-4455-accb-fc596f019311 req-4f14f17a-98b2-436c-8548-04f0eebcf1a7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037677 Aug 27 04:48:17.509323 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1849/3735] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:48:17.530387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2cd61457-8a03-485e-86c8-1f116f612838 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:17.543229 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2cd61457-8a03-485e-86c8-1f116f612838 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1327 microversion: 2.1 time: 0.474354 Aug 27 04:48:17.544168 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1887/3736] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:17 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1327 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:17.553267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-39127d4a-d787-4873-936c-a3074a5c8bc5 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:17.555175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-39127d4a-d787-4873-936c-a3074a5c8bc5 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:17.570152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39127d4a-d787-4873-936c-a3074a5c8bc5 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:17.570660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39127d4a-d787-4873-936c-a3074a5c8bc5 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:17.573389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39127d4a-d787-4873-936c-a3074a5c8bc5 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:17.574096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39127d4a-d787-4873-936c-a3074a5c8bc5 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:17.576275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39127d4a-d787-4873-936c-a3074a5c8bc5 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:17.578669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39127d4a-d787-4873-936c-a3074a5c8bc5 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:17.632802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9cdf542c-dc5e-419b-8c3b-ae5c031dcc5a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:17.633870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9cdf542c-dc5e-419b-8c3b-ae5c031dcc5a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:17.642671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cdf542c-dc5e-419b-8c3b-ae5c031dcc5a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:17.643905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cdf542c-dc5e-419b-8c3b-ae5c031dcc5a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:17.646074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cdf542c-dc5e-419b-8c3b-ae5c031dcc5a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:17.647116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cdf542c-dc5e-419b-8c3b-ae5c031dcc5a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:17.649374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cdf542c-dc5e-419b-8c3b-ae5c031dcc5a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:17.650438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cdf542c-dc5e-419b-8c3b-ae5c031dcc5a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:17.695448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cdf542c-dc5e-419b-8c3b-ae5c031dcc5a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:17.696393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cdf542c-dc5e-419b-8c3b-ae5c031dcc5a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:17.697078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cdf542c-dc5e-419b-8c3b-ae5c031dcc5a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:17.697891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-9cdf542c-dc5e-419b-8c3b-ae5c031dcc5a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lazy-loading 'fault' on Instance uuid 49de8d6e-89fa-41c7-8c49-132644205b12 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:48:17.749240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9cdf542c-dc5e-419b-8c3b-ae5c031dcc5a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:17.759713 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9cdf542c-dc5e-419b-8c3b-ae5c031dcc5a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 200 len: 1304 microversion: 2.1 time: 0.132303 Aug 27 04:48:17.760779 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1888/3737] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:17 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:17.851592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-39127d4a-d787-4873-936c-a3074a5c8bc5 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:17.862860 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-39127d4a-d787-4873-936c-a3074a5c8bc5 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1355 microversion: 2.1 time: 0.340014 Aug 27 04:48:17.863618 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1850/3738] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:17 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1355 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:17.993488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32490974-8e13-475c-af8f-5bd9f65cb866 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:17.994240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32490974-8e13-475c-af8f-5bd9f65cb866 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:18.002909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32490974-8e13-475c-af8f-5bd9f65cb866 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:18.003835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32490974-8e13-475c-af8f-5bd9f65cb866 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:18.004362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32490974-8e13-475c-af8f-5bd9f65cb866 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:18.005366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32490974-8e13-475c-af8f-5bd9f65cb866 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:18.005928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32490974-8e13-475c-af8f-5bd9f65cb866 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:18.006483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32490974-8e13-475c-af8f-5bd9f65cb866 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:18.090475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1e1d596a-e146-44e2-9813-2faa51e62041 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:18.091082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1e1d596a-e146-44e2-9813-2faa51e62041 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:18.099922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e1d596a-e146-44e2-9813-2faa51e62041 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:18.100967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e1d596a-e146-44e2-9813-2faa51e62041 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:18.101396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e1d596a-e146-44e2-9813-2faa51e62041 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:18.102568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e1d596a-e146-44e2-9813-2faa51e62041 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:18.103053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e1d596a-e146-44e2-9813-2faa51e62041 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:18.103478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e1d596a-e146-44e2-9813-2faa51e62041 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:18.173173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32490974-8e13-475c-af8f-5bd9f65cb866 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:18.182635 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32490974-8e13-475c-af8f-5bd9f65cb866 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.193361 Aug 27 04:48:18.183542 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1889/3739] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:17 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:18.189034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-678d0511-1fb0-46f7-8697-485761def22a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:18.189861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-678d0511-1fb0-46f7-8697-485761def22a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:18.196131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678d0511-1fb0-46f7-8697-485761def22a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:18.199325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678d0511-1fb0-46f7-8697-485761def22a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:18.199780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678d0511-1fb0-46f7-8697-485761def22a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:18.200512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678d0511-1fb0-46f7-8697-485761def22a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:18.202313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678d0511-1fb0-46f7-8697-485761def22a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:18.203347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678d0511-1fb0-46f7-8697-485761def22a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:18.346504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-678d0511-1fb0-46f7-8697-485761def22a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:18.351852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e1d596a-e146-44e2-9813-2faa51e62041 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:18.355850 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-678d0511-1fb0-46f7-8697-485761def22a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1314 microversion: 2.1 time: 0.169869 Aug 27 04:48:18.356471 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1890/3740] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:18 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:18.367165 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1e1d596a-e146-44e2-9813-2faa51e62041 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.274424 Aug 27 04:48:18.367165 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1851/3741] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:18 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:18.570075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-748bbcde-757f-4a7b-a1cd-70d20e031bef tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:18.570687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-748bbcde-757f-4a7b-a1cd-70d20e031bef tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:18.577689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748bbcde-757f-4a7b-a1cd-70d20e031bef tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:18.578175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748bbcde-757f-4a7b-a1cd-70d20e031bef tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:18.578794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748bbcde-757f-4a7b-a1cd-70d20e031bef tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:18.579748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748bbcde-757f-4a7b-a1cd-70d20e031bef tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:18.580149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748bbcde-757f-4a7b-a1cd-70d20e031bef tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:18.580843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748bbcde-757f-4a7b-a1cd-70d20e031bef tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:18.766111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-748bbcde-757f-4a7b-a1cd-70d20e031bef tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:18.779236 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-748bbcde-757f-4a7b-a1cd-70d20e031bef tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1327 microversion: 2.1 time: 0.213416 Aug 27 04:48:18.779603 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1852/3742] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:18 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1327 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:18.794728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-21104e9f-9ad2-48a2-a999-378789fa475c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:18.795448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-21104e9f-9ad2-48a2-a999-378789fa475c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: 49de8d6e-89fa-41c7-8c49-132644205b12] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:18.802753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21104e9f-9ad2-48a2-a999-378789fa475c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:18.803282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21104e9f-9ad2-48a2-a999-378789fa475c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:18.803723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21104e9f-9ad2-48a2-a999-378789fa475c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:18.804429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21104e9f-9ad2-48a2-a999-378789fa475c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:18.805016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21104e9f-9ad2-48a2-a999-378789fa475c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:18.805350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21104e9f-9ad2-48a2-a999-378789fa475c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:18.820684 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-21104e9f-9ad2-48a2-a999-378789fa475c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] HTTP exception thrown: Instance 49de8d6e-89fa-41c7-8c49-132644205b12 could not be found. Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-21104e9f-9ad2-48a2-a999-378789fa475c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Request method failure captured: Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 HTTP/1.1 Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaHo8oUM02H-cPzhw-iTyFnN6RwIpiNkMCaXfPJYRvUm4DW-HAGPtfO6ai0JXc63q1WSeBEQTDK0wzc5ufYmVPB9Yb5IhvKkt24I60e-0GmsESVof9dBaJR8kMNRylfW0N4eFTQ9ixViQGRwfKS_whm7yoea_dUx1T5TJHjyp_Uffd0 Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 889a88a84a944f8d9330720e0134f0aa Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesActionsTest-876583057 Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/889a88a84a944f8d9330720e0134f0aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_889a88a84a944f8d9330720e0134f0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/889a88a84a944f8d9330720e0134f0aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/889a88a84a944f8d9330720e0134f0aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesActionsTest-876583057 Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 889a88a84a944f8d9330720e0134f0aa Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesActionsTest-876583057 Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-VolumesActionsTest-876583057-project Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 6e30d1322c924a3d979d7c3bd647ecab Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesActionsTest-876583057-project Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 49de8d6e-89fa-41c7-8c49-132644205b12 could not be found. Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '49de8d6e-89fa-41c7-8c49-132644205b12'} Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49de8d6e-89fa-41c7-8c49-132644205b12 could not be found. Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49de8d6e-89fa-41c7-8c49-132644205b12 could not be found. Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:18.822468 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:18.828900 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:18.828900 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:18.828900 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:18.828900 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:48:18.828900 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:48:18.828900 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49de8d6e-89fa-41c7-8c49-132644205b12 could not be found. Aug 27 04:48:18.828900 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:18.828900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-21104e9f-9ad2-48a2-a999-378789fa475c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Returning 404 to user: Instance 49de8d6e-89fa-41c7-8c49-132644205b12 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:48:18.828900 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-21104e9f-9ad2-48a2-a999-378789fa475c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12" status: 404 len: 111 microversion: 2.1 time: 0.045149 Aug 27 04:48:18.828900 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1891/3743] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:18 2022] GET /compute/v2.1/servers/49de8d6e-89fa-41c7-8c49-132644205b12 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:48:18.883929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e4c698f9-57b8-4525-ae7c-3de0faa3e614 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:18.884865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e4c698f9-57b8-4525-ae7c-3de0faa3e614 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:18.894080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4c698f9-57b8-4525-ae7c-3de0faa3e614 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:18.895525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4c698f9-57b8-4525-ae7c-3de0faa3e614 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:18.896520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4c698f9-57b8-4525-ae7c-3de0faa3e614 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:18.897604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4c698f9-57b8-4525-ae7c-3de0faa3e614 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:18.898484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4c698f9-57b8-4525-ae7c-3de0faa3e614 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:18.899173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4c698f9-57b8-4525-ae7c-3de0faa3e614 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:18.948848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1151106162", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "180cd323-2b16-4579-8ea5-c386f62d81fb"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:19.012081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] validate_networks() for [('180cd323-2b16-4579-8ea5-c386f62d81fb', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:48:19.279636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e4c698f9-57b8-4525-ae7c-3de0faa3e614 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:19.293277 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e4c698f9-57b8-4525-ae7c-3de0faa3e614 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1355 microversion: 2.1 time: 0.412911 Aug 27 04:48:19.308734 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1853/3744] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:18 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1355 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:19.314545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0968225f-48f1-4c4c-a9fc-65af1be208df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:19.315555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0968225f-48f1-4c4c-a9fc-65af1be208df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:19.325200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0968225f-48f1-4c4c-a9fc-65af1be208df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:19.326071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0968225f-48f1-4c4c-a9fc-65af1be208df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:19.326775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0968225f-48f1-4c4c-a9fc-65af1be208df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:19.330513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0968225f-48f1-4c4c-a9fc-65af1be208df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:19.331755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0968225f-48f1-4c4c-a9fc-65af1be208df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:19.332365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0968225f-48f1-4c4c-a9fc-65af1be208df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:19.719688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0968225f-48f1-4c4c-a9fc-65af1be208df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:19.729216 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0968225f-48f1-4c4c-a9fc-65af1be208df tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.418813 Aug 27 04:48:19.743915 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1854/3745] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:19 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:19.749181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5ebf8208-b40f-4d2b-9f37-b2f80972c485 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:19.750019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5ebf8208-b40f-4d2b-9f37-b2f80972c485 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:19.756828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ebf8208-b40f-4d2b-9f37-b2f80972c485 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:19.757385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ebf8208-b40f-4d2b-9f37-b2f80972c485 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:19.757881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ebf8208-b40f-4d2b-9f37-b2f80972c485 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:19.758647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ebf8208-b40f-4d2b-9f37-b2f80972c485 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:19.759165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ebf8208-b40f-4d2b-9f37-b2f80972c485 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:19.759663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ebf8208-b40f-4d2b-9f37-b2f80972c485 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:20.042613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:48:20.043194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:48:20.043962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:48:20.044478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:48:20.045026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:48:20.056270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:20.056916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:20.057424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:20.058239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:20.058806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:20.059307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:20.080655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Getting quotas for project 889a88a84a944f8d9330720e0134f0aa. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:48:20.086675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Getting quotas for user 6e30d1322c924a3d979d7c3bd647ecab and project 889a88a84a944f8d9330720e0134f0aa. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:48:20.102455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:48:20.104973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:48:20.164765 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e25e5155-1458-4075-8cfa-7d5f72fe83a9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.220007 Aug 27 04:48:20.166037 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1892/3746] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:48:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:48:20.171065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79d5f005-1c11-4b42-9528-ec49c7ad799d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:20.171997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-79d5f005-1c11-4b42-9528-ec49c7ad799d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:20.180010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79d5f005-1c11-4b42-9528-ec49c7ad799d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:20.180907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79d5f005-1c11-4b42-9528-ec49c7ad799d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:20.181577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79d5f005-1c11-4b42-9528-ec49c7ad799d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:20.182684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79d5f005-1c11-4b42-9528-ec49c7ad799d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:20.183509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79d5f005-1c11-4b42-9528-ec49c7ad799d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:20.184298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79d5f005-1c11-4b42-9528-ec49c7ad799d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:20.326494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5ebf8208-b40f-4d2b-9f37-b2f80972c485 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:20.335403 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5ebf8208-b40f-4d2b-9f37-b2f80972c485 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1314 microversion: 2.1 time: 0.589857 Aug 27 04:48:20.336282 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1855/3747] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:19 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:20.348940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-185536b4-e71f-404c-9dd6-863cc02ffd68 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:20.348940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-185536b4-e71f-404c-9dd6-863cc02ffd68 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:20.354383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-185536b4-e71f-404c-9dd6-863cc02ffd68 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:20.355269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-185536b4-e71f-404c-9dd6-863cc02ffd68 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:20.355898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-185536b4-e71f-404c-9dd6-863cc02ffd68 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:20.356950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-185536b4-e71f-404c-9dd6-863cc02ffd68 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:20.357607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-185536b4-e71f-404c-9dd6-863cc02ffd68 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:20.358207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-185536b4-e71f-404c-9dd6-863cc02ffd68 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:20.455469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-79d5f005-1c11-4b42-9528-ec49c7ad799d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:20.468439 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-79d5f005-1c11-4b42-9528-ec49c7ad799d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.300914 Aug 27 04:48:20.469420 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1893/3748] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:20 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:20.485680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f239eeb8-eb63-4a1e-bbb2-0825976c79d6 req-458e6a82-1673-40a0-9473-1fae381e27e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d03e47-76ad-42b8-a14b-3649ca01e838", "tag": "9a7c7ec0-fc16-4e6b-849f-9bb422d6cb75"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:20.499360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f239eeb8-eb63-4a1e-bbb2-0825976c79d6 req-458e6a82-1673-40a0-9473-1fae381e27e0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:20.500659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f239eeb8-eb63-4a1e-bbb2-0825976c79d6 req-458e6a82-1673-40a0-9473-1fae381e27e0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:20.501268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f239eeb8-eb63-4a1e-bbb2-0825976c79d6 req-458e6a82-1673-40a0-9473-1fae381e27e0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:20.530451 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f239eeb8-eb63-4a1e-bbb2-0825976c79d6 req-458e6a82-1673-40a0-9473-1fae381e27e0 service nova] Creating event network-changed:9a7c7ec0-fc16-4e6b-849f-9bb422d6cb75 for instance b0d03e47-76ad-42b8-a14b-3649ca01e838 on n-h2-854823-1 Aug 27 04:48:20.535738 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f239eeb8-eb63-4a1e-bbb2-0825976c79d6 req-458e6a82-1673-40a0-9473-1fae381e27e0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064840 Aug 27 04:48:20.537099 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1894/3749] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:20.542870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d41b7ca-75f0-4f1a-813e-b34b5ddfd8d0 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:20.543763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d41b7ca-75f0-4f1a-813e-b34b5ddfd8d0 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:20.631982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-185536b4-e71f-404c-9dd6-863cc02ffd68 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:20.644260 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-185536b4-e71f-404c-9dd6-863cc02ffd68 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1528 microversion: 2.1 time: 0.306653 Aug 27 04:48:20.656555 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1856/3750] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:20 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1528 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:20.656555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-918da121-ecd2-4087-839d-4fde78dde469 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:20.656555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-918da121-ecd2-4087-839d-4fde78dde469 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:20.660875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-918da121-ecd2-4087-839d-4fde78dde469 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:20.661767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-918da121-ecd2-4087-839d-4fde78dde469 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:20.663250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-918da121-ecd2-4087-839d-4fde78dde469 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:20.664296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-918da121-ecd2-4087-839d-4fde78dde469 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:20.665069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-918da121-ecd2-4087-839d-4fde78dde469 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:20.665958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-918da121-ecd2-4087-839d-4fde78dde469 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:20.676573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d41b7ca-75f0-4f1a-813e-b34b5ddfd8d0 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:20.680385 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:48:20.680731 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 04:48:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f (ip 10.222.0.79) !!! Aug 27 04:48:20.687439 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d41b7ca-75f0-4f1a-813e-b34b5ddfd8d0 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1214 microversion: 2.1 time: 0.148382 Aug 27 04:48:20.688036 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1895/3751] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:20 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:20.708109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-357c4560-4f17-4a87-950d-ed3464905a29 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:20.708834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-357c4560-4f17-4a87-950d-ed3464905a29 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:20.717194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-357c4560-4f17-4a87-950d-ed3464905a29 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:20.717487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-357c4560-4f17-4a87-950d-ed3464905a29 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:20.717921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-357c4560-4f17-4a87-950d-ed3464905a29 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:20.718707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-357c4560-4f17-4a87-950d-ed3464905a29 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:20.719213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-357c4560-4f17-4a87-950d-ed3464905a29 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:20.719689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-357c4560-4f17-4a87-950d-ed3464905a29 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:20.856835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-918da121-ecd2-4087-839d-4fde78dde469 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:20.866062 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-918da121-ecd2-4087-839d-4fde78dde469 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1355 microversion: 2.1 time: 0.219337 Aug 27 04:48:20.866655 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1857/3752] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:20 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1355 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:20.871472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-456124d4-7088-470d-b010-eaf0b1a1142b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:20.872325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-456124d4-7088-470d-b010-eaf0b1a1142b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:20.879162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-456124d4-7088-470d-b010-eaf0b1a1142b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:20.879973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-456124d4-7088-470d-b010-eaf0b1a1142b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:20.880414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-456124d4-7088-470d-b010-eaf0b1a1142b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:20.881327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-456124d4-7088-470d-b010-eaf0b1a1142b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:20.881784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-456124d4-7088-470d-b010-eaf0b1a1142b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:20.882414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-456124d4-7088-470d-b010-eaf0b1a1142b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.052489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-456124d4-7088-470d-b010-eaf0b1a1142b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:21.063334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-357c4560-4f17-4a87-950d-ed3464905a29 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:21.064226 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-456124d4-7088-470d-b010-eaf0b1a1142b tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.196399 Aug 27 04:48:21.064950 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1858/3753] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:20 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:21.072516 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-357c4560-4f17-4a87-950d-ed3464905a29 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1528 microversion: 2.1 time: 0.376855 Aug 27 04:48:21.084710 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1896/3754] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:20 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1528 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:21.311611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f51a2f54-1e89-4a7c-a77e-7c99254da226 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:21.312870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f51a2f54-1e89-4a7c-a77e-7c99254da226 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:21.319404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f51a2f54-1e89-4a7c-a77e-7c99254da226 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.319904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f51a2f54-1e89-4a7c-a77e-7c99254da226 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.320354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f51a2f54-1e89-4a7c-a77e-7c99254da226 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.321490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f51a2f54-1e89-4a7c-a77e-7c99254da226 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.321641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f51a2f54-1e89-4a7c-a77e-7c99254da226 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.322036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f51a2f54-1e89-4a7c-a77e-7c99254da226 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.336000 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-f51a2f54-1e89-4a7c-a77e-7c99254da226 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] HTTP exception thrown: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f51a2f54-1e89-4a7c-a77e-7c99254da226 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Request method failure captured: Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c HTTP/1.1 Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaH985e_wcPLoBejx4Wgufl5Mm8K9mDpAb2fYg-0GqQSxGmdqPpFs2pHI5yGcJHG3oUSzV7FC2Tc7-OblTgduJQ_nffAGh969-nAJq6YYDdqmOo7vFsqotF5wKw67lLdL2JOp6f_faYnagefDxHNvevvOzogETd1uZea3l3_BRGef_8 Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 125bd26203d345fea307f4e49168ff33 Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1513604437 Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/125bd26203d345fea307f4e49168ff33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_125bd26203d345fea307f4e49168ff33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/125bd26203d345fea307f4e49168ff33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/125bd26203d345fea307f4e49168ff33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1513604437 Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 125bd26203d345fea307f4e49168ff33 Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1513604437 Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1513604437-project Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: bdd9bff7843f4f16b6c2dde5bd54466d Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1513604437-project Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'eb357c1b-f703-4128-928f-96562649e22c'} Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:48:21.337719 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:48:21.342614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:21.342614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:21.342614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:21.342614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:21.342614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:21.342614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:21.342614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:21.342614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:48:21.342614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:48:21.342614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:21.342614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:21.342614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f51a2f54-1e89-4a7c-a77e-7c99254da226 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Returning 404 to user: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:48:21.342614 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f51a2f54-1e89-4a7c-a77e-7c99254da226 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] 10.222.0.79 "DELETE /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 404 len: 111 microversion: 2.1 time: 0.249759 Aug 27 04:48:21.342614 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1859/3755] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:48:21 2022] DELETE /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 111 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:48:21.348580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b06cdc6-fc32-4228-9b5b-96711b4208ca tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:21.349204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b06cdc6-fc32-4228-9b5b-96711b4208ca tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:21.356167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b06cdc6-fc32-4228-9b5b-96711b4208ca tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.356815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dc55dc1e-71a4-477b-8a25-92fe3cd09142 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:21.356979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b06cdc6-fc32-4228-9b5b-96711b4208ca tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.357350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b06cdc6-fc32-4228-9b5b-96711b4208ca tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.357481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dc55dc1e-71a4-477b-8a25-92fe3cd09142 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:21.358057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b06cdc6-fc32-4228-9b5b-96711b4208ca tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.359056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b06cdc6-fc32-4228-9b5b-96711b4208ca tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.359819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b06cdc6-fc32-4228-9b5b-96711b4208ca tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.364035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc55dc1e-71a4-477b-8a25-92fe3cd09142 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.364557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc55dc1e-71a4-477b-8a25-92fe3cd09142 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.365163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc55dc1e-71a4-477b-8a25-92fe3cd09142 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.365907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc55dc1e-71a4-477b-8a25-92fe3cd09142 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.366369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc55dc1e-71a4-477b-8a25-92fe3cd09142 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.366801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc55dc1e-71a4-477b-8a25-92fe3cd09142 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.508654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dc55dc1e-71a4-477b-8a25-92fe3cd09142 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:21.519225 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dc55dc1e-71a4-477b-8a25-92fe3cd09142 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1314 microversion: 2.1 time: 0.167156 Aug 27 04:48:21.519814 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1860/3756] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:21 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:21.524790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1cf15a79-8db8-4ac0-8fc8-532e9f75f343 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:21.525391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1cf15a79-8db8-4ac0-8fc8-532e9f75f343 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:21.531525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cf15a79-8db8-4ac0-8fc8-532e9f75f343 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.532011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cf15a79-8db8-4ac0-8fc8-532e9f75f343 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.532472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cf15a79-8db8-4ac0-8fc8-532e9f75f343 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.533193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cf15a79-8db8-4ac0-8fc8-532e9f75f343 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.533809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cf15a79-8db8-4ac0-8fc8-532e9f75f343 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.534351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cf15a79-8db8-4ac0-8fc8-532e9f75f343 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.634028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b06cdc6-fc32-4228-9b5b-96711b4208ca tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:21.649714 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b06cdc6-fc32-4228-9b5b-96711b4208ca tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1528 microversion: 2.1 time: 0.304729 Aug 27 04:48:21.651086 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1897/3757] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:21 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1528 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:21.679511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55af57f2-c6bd-4388-a92f-8cb01792c3b7 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Action: 'update', calling method: >, body: {"server": {"name": "eb357c1b-f703-4128-928f-96562649e22c_new"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:21.682451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55af57f2-c6bd-4388-a92f-8cb01792c3b7 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:21.703227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55af57f2-c6bd-4388-a92f-8cb01792c3b7 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.703722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55af57f2-c6bd-4388-a92f-8cb01792c3b7 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.704159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55af57f2-c6bd-4388-a92f-8cb01792c3b7 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.704892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55af57f2-c6bd-4388-a92f-8cb01792c3b7 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.705344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55af57f2-c6bd-4388-a92f-8cb01792c3b7 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.705771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55af57f2-c6bd-4388-a92f-8cb01792c3b7 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.745750 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-55af57f2-c6bd-4388-a92f-8cb01792c3b7 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] HTTP exception thrown: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55af57f2-c6bd-4388-a92f-8cb01792c3b7 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Request method failure captured: Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: request: PUT /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c HTTP/1.1 Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 64 Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaH985e_wcPLoBejx4Wgufl5Mm8K9mDpAb2fYg-0GqQSxGmdqPpFs2pHI5yGcJHG3oUSzV7FC2Tc7-OblTgduJQ_nffAGh969-nAJq6YYDdqmOo7vFsqotF5wKw67lLdL2JOp6f_faYnagefDxHNvevvOzogETd1uZea3l3_BRGef_8 Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 125bd26203d345fea307f4e49168ff33 Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1513604437 Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/125bd26203d345fea307f4e49168ff33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_125bd26203d345fea307f4e49168ff33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/125bd26203d345fea307f4e49168ff33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/125bd26203d345fea307f4e49168ff33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1513604437 Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 125bd26203d345fea307f4e49168ff33 Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1513604437 Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1513604437-project Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: bdd9bff7843f4f16b6c2dde5bd54466d Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1513604437-project Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "eb357c1b-f703-4128-928f-96562649e22c_new"}} Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'eb357c1b-f703-4128-928f-96562649e22c', 'body': {'server': {'name': 'eb357c1b-f703-4128-928f-96562649e22c_new'}}} Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:48:21.747559 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55af57f2-c6bd-4388-a92f-8cb01792c3b7 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] Returning 404 to user: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55af57f2-c6bd-4388-a92f-8cb01792c3b7 tempest-ServersNegativeTestMultiTenantJSON-1513604437 tempest-ServersNegativeTestMultiTenantJSON-1513604437-project] 10.222.0.79 "PUT /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 404 len: 111 microversion: 2.1 time: 0.074999 Aug 27 04:48:21.752377 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1898/3758] 10.222.0.79 () {60 vars in 1256 bytes} [Sat Aug 27 04:48:21 2022] PUT /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:48:21.754389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac66f805-4c2b-4c64-8e37-b000da6157c5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:21.762380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac66f805-4c2b-4c64-8e37-b000da6157c5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:21.769895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac66f805-4c2b-4c64-8e37-b000da6157c5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.770641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac66f805-4c2b-4c64-8e37-b000da6157c5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.771177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac66f805-4c2b-4c64-8e37-b000da6157c5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.772647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac66f805-4c2b-4c64-8e37-b000da6157c5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.773214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac66f805-4c2b-4c64-8e37-b000da6157c5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.773757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac66f805-4c2b-4c64-8e37-b000da6157c5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.798668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1cf15a79-8db8-4ac0-8fc8-532e9f75f343 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:21.808133 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1cf15a79-8db8-4ac0-8fc8-532e9f75f343 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.287276 Aug 27 04:48:21.808768 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1861/3759] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:21 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:21.828901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9c715b81-f8eb-4a73-93b8-c18923606633 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:21.829673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9c715b81-f8eb-4a73-93b8-c18923606633 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:21.837589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c715b81-f8eb-4a73-93b8-c18923606633 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.838396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c715b81-f8eb-4a73-93b8-c18923606633 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.839040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c715b81-f8eb-4a73-93b8-c18923606633 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.839960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c715b81-f8eb-4a73-93b8-c18923606633 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.840681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c715b81-f8eb-4a73-93b8-c18923606633 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.841296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c715b81-f8eb-4a73-93b8-c18923606633 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.872730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9c715b81-f8eb-4a73-93b8-c18923606633 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:48:21.877241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:21.911737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac66f805-4c2b-4c64-8e37-b000da6157c5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:21.920614 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac66f805-4c2b-4c64-8e37-b000da6157c5 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1284 microversion: 2.1 time: 0.169950 Aug 27 04:48:21.924744 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1899/3760] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:21 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:21.938040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c9fb466-ac99-4c93-9252-ab07e90b8b41 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:21.938715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c9fb466-ac99-4c93-9252-ab07e90b8b41 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:21.961879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c9fb466-ac99-4c93-9252-ab07e90b8b41 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.963957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c9fb466-ac99-4c93-9252-ab07e90b8b41 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.964672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c9fb466-ac99-4c93-9252-ab07e90b8b41 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:21.965414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c9fb466-ac99-4c93-9252-ab07e90b8b41 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:21.967742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c9fb466-ac99-4c93-9252-ab07e90b8b41 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:21.970611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c9fb466-ac99-4c93-9252-ab07e90b8b41 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:22.005323 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9c715b81-f8eb-4a73-93b8-c18923606633 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "DELETE /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 204 len: 0 microversion: 2.1 time: 0.181013 Aug 27 04:48:22.006359 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1862/3761] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:48:21 2022] DELETE /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:48:22.030110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-14fbd339-195f-486d-b8bf-8155bc15adba tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:22.031538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-14fbd339-195f-486d-b8bf-8155bc15adba tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:22.042077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fbd339-195f-486d-b8bf-8155bc15adba tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:22.042584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fbd339-195f-486d-b8bf-8155bc15adba tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:22.043031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fbd339-195f-486d-b8bf-8155bc15adba tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:22.044162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fbd339-195f-486d-b8bf-8155bc15adba tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:22.044659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fbd339-195f-486d-b8bf-8155bc15adba tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:22.045091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fbd339-195f-486d-b8bf-8155bc15adba tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:22.234616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c9fb466-ac99-4c93-9252-ab07e90b8b41 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:22.247873 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c9fb466-ac99-4c93-9252-ab07e90b8b41 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1355 microversion: 2.1 time: 0.321854 Aug 27 04:48:22.250817 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1900/3762] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:21 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1355 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:22.259853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-316ca995-ee16-4ca9-a859-396fb63019a4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:22.263617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-316ca995-ee16-4ca9-a859-396fb63019a4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:22.272674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-316ca995-ee16-4ca9-a859-396fb63019a4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:22.273559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-316ca995-ee16-4ca9-a859-396fb63019a4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:22.274210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-316ca995-ee16-4ca9-a859-396fb63019a4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:22.275178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-316ca995-ee16-4ca9-a859-396fb63019a4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:22.275834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-316ca995-ee16-4ca9-a859-396fb63019a4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:22.276462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-316ca995-ee16-4ca9-a859-396fb63019a4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:22.403523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-14fbd339-195f-486d-b8bf-8155bc15adba tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:22.418799 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-14fbd339-195f-486d-b8bf-8155bc15adba tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1534 microversion: 2.1 time: 0.407237 Aug 27 04:48:22.435211 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1863/3763] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:22 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1534 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:22.539265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-673f47f4-7149-42db-928c-794b6c67e96c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:22.540267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-673f47f4-7149-42db-928c-794b6c67e96c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:22.548451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-673f47f4-7149-42db-928c-794b6c67e96c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:22.549308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-673f47f4-7149-42db-928c-794b6c67e96c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:22.551366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-673f47f4-7149-42db-928c-794b6c67e96c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:22.552326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-673f47f4-7149-42db-928c-794b6c67e96c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:22.553058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-673f47f4-7149-42db-928c-794b6c67e96c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:22.553729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-673f47f4-7149-42db-928c-794b6c67e96c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:22.584940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-316ca995-ee16-4ca9-a859-396fb63019a4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:22.594527 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-316ca995-ee16-4ca9-a859-396fb63019a4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.342306 Aug 27 04:48:22.595120 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1901/3764] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:22 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:22.795854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-673f47f4-7149-42db-928c-794b6c67e96c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:22.807201 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-673f47f4-7149-42db-928c-794b6c67e96c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1314 microversion: 2.1 time: 0.271757 Aug 27 04:48:22.820218 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1864/3765] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:22 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:22.831019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e159017-be23-4dc3-b877-55b17a9dbd81 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:22.831642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e159017-be23-4dc3-b877-55b17a9dbd81 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:22.838838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e159017-be23-4dc3-b877-55b17a9dbd81 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:22.839592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e159017-be23-4dc3-b877-55b17a9dbd81 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:22.840030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e159017-be23-4dc3-b877-55b17a9dbd81 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:22.840948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e159017-be23-4dc3-b877-55b17a9dbd81 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:22.841611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e159017-be23-4dc3-b877-55b17a9dbd81 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:22.842255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e159017-be23-4dc3-b877-55b17a9dbd81 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:22.946688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-542fc8f5-08e2-4573-9411-de0340f5974d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:22.950418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-542fc8f5-08e2-4573-9411-de0340f5974d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:22.973475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-542fc8f5-08e2-4573-9411-de0340f5974d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:22.973977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-542fc8f5-08e2-4573-9411-de0340f5974d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:22.974411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-542fc8f5-08e2-4573-9411-de0340f5974d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:22.975114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-542fc8f5-08e2-4573-9411-de0340f5974d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:22.975568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-542fc8f5-08e2-4573-9411-de0340f5974d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:22.975990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-542fc8f5-08e2-4573-9411-de0340f5974d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:23.082567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e159017-be23-4dc3-b877-55b17a9dbd81 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:23.095064 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e159017-be23-4dc3-b877-55b17a9dbd81 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.266399 Aug 27 04:48:23.101897 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1902/3766] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:22 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:23.154788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-542fc8f5-08e2-4573-9411-de0340f5974d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:23.164238 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-542fc8f5-08e2-4573-9411-de0340f5974d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1314 microversion: 2.1 time: 0.221997 Aug 27 04:48:23.165046 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1865/3767] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:22 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:23.278415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcf25070-8e14-46db-b88b-014a874d82ab tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:23.279624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fcf25070-8e14-46db-b88b-014a874d82ab tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:23.288879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcf25070-8e14-46db-b88b-014a874d82ab tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:23.289656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcf25070-8e14-46db-b88b-014a874d82ab tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:23.290440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcf25070-8e14-46db-b88b-014a874d82ab tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:23.291412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcf25070-8e14-46db-b88b-014a874d82ab tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:23.293063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcf25070-8e14-46db-b88b-014a874d82ab tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:23.294957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcf25070-8e14-46db-b88b-014a874d82ab tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:23.439707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b3dd36cf-6a99-4796-b733-4a3398441f64 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:23.441410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b3dd36cf-6a99-4796-b733-4a3398441f64 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:23.448430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3dd36cf-6a99-4796-b733-4a3398441f64 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:23.449238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3dd36cf-6a99-4796-b733-4a3398441f64 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:23.449881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3dd36cf-6a99-4796-b733-4a3398441f64 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:23.450772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3dd36cf-6a99-4796-b733-4a3398441f64 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:23.451398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3dd36cf-6a99-4796-b733-4a3398441f64 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:23.451994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3dd36cf-6a99-4796-b733-4a3398441f64 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:23.549252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fcf25070-8e14-46db-b88b-014a874d82ab tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:23.558317 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fcf25070-8e14-46db-b88b-014a874d82ab tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1355 microversion: 2.1 time: 0.286096 Aug 27 04:48:23.566284 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1903/3768] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:23 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1355 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:23.615643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab3a95d4-be69-4e2f-b64b-2db5ec0b36e6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:23.616507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab3a95d4-be69-4e2f-b64b-2db5ec0b36e6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:23.623051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab3a95d4-be69-4e2f-b64b-2db5ec0b36e6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:23.623776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab3a95d4-be69-4e2f-b64b-2db5ec0b36e6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:23.624988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab3a95d4-be69-4e2f-b64b-2db5ec0b36e6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:23.625885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab3a95d4-be69-4e2f-b64b-2db5ec0b36e6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:23.626509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab3a95d4-be69-4e2f-b64b-2db5ec0b36e6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:23.627102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab3a95d4-be69-4e2f-b64b-2db5ec0b36e6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:23.692233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b3dd36cf-6a99-4796-b733-4a3398441f64 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:23.705616 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b3dd36cf-6a99-4796-b733-4a3398441f64 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1534 microversion: 2.1 time: 0.269928 Aug 27 04:48:23.708812 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1866/3769] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:23 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1534 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:23.837718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ca1b523b-ae36-4338-ad61-6208c013a657 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:23.838644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ca1b523b-ae36-4338-ad61-6208c013a657 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:23.845849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:23.846828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:23.858315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca1b523b-ae36-4338-ad61-6208c013a657 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:23.860235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca1b523b-ae36-4338-ad61-6208c013a657 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:23.861017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca1b523b-ae36-4338-ad61-6208c013a657 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:23.862626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca1b523b-ae36-4338-ad61-6208c013a657 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:23.863257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca1b523b-ae36-4338-ad61-6208c013a657 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:23.864343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca1b523b-ae36-4338-ad61-6208c013a657 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:23.905964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab3a95d4-be69-4e2f-b64b-2db5ec0b36e6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:23.914152 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab3a95d4-be69-4e2f-b64b-2db5ec0b36e6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.302277 Aug 27 04:48:23.914756 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1904/3770] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:23 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:24.110739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ca1b523b-ae36-4338-ad61-6208c013a657 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:24.118925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a17794ff-6a83-4aee-a4b4-03c9d342a793 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:24.119551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a17794ff-6a83-4aee-a4b4-03c9d342a793 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:24.132422 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ca1b523b-ae36-4338-ad61-6208c013a657 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1314 microversion: 2.1 time: 0.303784 Aug 27 04:48:24.132682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a17794ff-6a83-4aee-a4b4-03c9d342a793 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:24.133318 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1867/3771] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:23 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:24.133548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a17794ff-6a83-4aee-a4b4-03c9d342a793 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:24.138650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a17794ff-6a83-4aee-a4b4-03c9d342a793 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:24.139551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a17794ff-6a83-4aee-a4b4-03c9d342a793 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:24.140129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a17794ff-6a83-4aee-a4b4-03c9d342a793 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:24.140590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a17794ff-6a83-4aee-a4b4-03c9d342a793 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:24.184325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8f3fd4a3-6f5b-4140-a182-790d012d15bc req-5d1cd572-b3a6-49f0-b18e-36c63117f41e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12179ea-bed6-4c2e-b92b-0a73f274707f", "tag": "b194726d-ce48-414e-aeb4-cc71b7f21b14"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:24.208248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8f3fd4a3-6f5b-4140-a182-790d012d15bc req-5d1cd572-b3a6-49f0-b18e-36c63117f41e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:24.209424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8f3fd4a3-6f5b-4140-a182-790d012d15bc req-5d1cd572-b3a6-49f0-b18e-36c63117f41e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:24.210135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8f3fd4a3-6f5b-4140-a182-790d012d15bc req-5d1cd572-b3a6-49f0-b18e-36c63117f41e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:24.245991 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8f3fd4a3-6f5b-4140-a182-790d012d15bc req-5d1cd572-b3a6-49f0-b18e-36c63117f41e service nova] Creating event network-changed:b194726d-ce48-414e-aeb4-cc71b7f21b14 for instance f12179ea-bed6-4c2e-b92b-0a73f274707f on n-h1-854823-1 Aug 27 04:48:24.252865 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8f3fd4a3-6f5b-4140-a182-790d012d15bc req-5d1cd572-b3a6-49f0-b18e-36c63117f41e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077176 Aug 27 04:48:24.254200 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1868/3772] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:24.263084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d5eb2df0-7ba6-4d8b-96dd-7157b73ef905 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:24.264244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d5eb2df0-7ba6-4d8b-96dd-7157b73ef905 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:24.274939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5eb2df0-7ba6-4d8b-96dd-7157b73ef905 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:24.276242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5eb2df0-7ba6-4d8b-96dd-7157b73ef905 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:24.276973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5eb2df0-7ba6-4d8b-96dd-7157b73ef905 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:24.278083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5eb2df0-7ba6-4d8b-96dd-7157b73ef905 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:24.278713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5eb2df0-7ba6-4d8b-96dd-7157b73ef905 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:24.279521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5eb2df0-7ba6-4d8b-96dd-7157b73ef905 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:24.446067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a17794ff-6a83-4aee-a4b4-03c9d342a793 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:24.460623 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a17794ff-6a83-4aee-a4b4-03c9d342a793 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.345937 Aug 27 04:48:24.462285 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1905/3773] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:24 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:24.502652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d5eb2df0-7ba6-4d8b-96dd-7157b73ef905 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:24.512309 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d5eb2df0-7ba6-4d8b-96dd-7157b73ef905 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1314 microversion: 2.1 time: 0.256783 Aug 27 04:48:24.513373 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1869/3774] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:24 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:24.580266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec2e6584-ddac-4960-adca-7752bcfb367e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:24.582154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec2e6584-ddac-4960-adca-7752bcfb367e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:24.599098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec2e6584-ddac-4960-adca-7752bcfb367e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:24.599705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec2e6584-ddac-4960-adca-7752bcfb367e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:24.600245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec2e6584-ddac-4960-adca-7752bcfb367e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:24.602078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec2e6584-ddac-4960-adca-7752bcfb367e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:24.603177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec2e6584-ddac-4960-adca-7752bcfb367e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:24.607227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec2e6584-ddac-4960-adca-7752bcfb367e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:24.641423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:24.735047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c26706c9-18be-4dc4-b009-a30902bb5407 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:24.736025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c26706c9-18be-4dc4-b009-a30902bb5407 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:24.749569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c26706c9-18be-4dc4-b009-a30902bb5407 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:24.750525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c26706c9-18be-4dc4-b009-a30902bb5407 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:24.750974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c26706c9-18be-4dc4-b009-a30902bb5407 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:24.751703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c26706c9-18be-4dc4-b009-a30902bb5407 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:24.752329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c26706c9-18be-4dc4-b009-a30902bb5407 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:24.752812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c26706c9-18be-4dc4-b009-a30902bb5407 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:24.904710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec2e6584-ddac-4960-adca-7752bcfb367e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:24.913873 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec2e6584-ddac-4960-adca-7752bcfb367e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1355 microversion: 2.1 time: 0.338301 Aug 27 04:48:24.919833 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1906/3775] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:24 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1355 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:24.925883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e73063d9-2194-41a1-a9d9-8efdf8d811a3 req-c7ed5010-5a77-4210-8943-64500f0df7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb357c1b-f703-4128-928f-96562649e22c", "name": "network-vif-deleted", "tag": "a71b4cd8-6147-4aa6-bf38-baf2e4b36b7e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:24.936117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e73063d9-2194-41a1-a9d9-8efdf8d811a3 req-c7ed5010-5a77-4210-8943-64500f0df7b5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:24.937195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e73063d9-2194-41a1-a9d9-8efdf8d811a3 req-c7ed5010-5a77-4210-8943-64500f0df7b5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:24.937847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e73063d9-2194-41a1-a9d9-8efdf8d811a3 req-c7ed5010-5a77-4210-8943-64500f0df7b5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:24.950153 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e73063d9-2194-41a1-a9d9-8efdf8d811a3 req-c7ed5010-5a77-4210-8943-64500f0df7b5 service nova] Creating event network-vif-deleted:a71b4cd8-6147-4aa6-bf38-baf2e4b36b7e for instance eb357c1b-f703-4128-928f-96562649e22c on n-h1-854823-1 Aug 27 04:48:24.956061 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e73063d9-2194-41a1-a9d9-8efdf8d811a3 req-c7ed5010-5a77-4210-8943-64500f0df7b5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034703 Aug 27 04:48:24.957445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c26706c9-18be-4dc4-b009-a30902bb5407 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:24.960918 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1907/3776] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:24.970129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ca73969-80a0-475b-ad4b-b24c26c16ccf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:24.971193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8ca73969-80a0-475b-ad4b-b24c26c16ccf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:24.973403 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c26706c9-18be-4dc4-b009-a30902bb5407 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1492 microversion: 2.1 time: 0.241021 Aug 27 04:48:24.978130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ca73969-80a0-475b-ad4b-b24c26c16ccf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:24.978630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ca73969-80a0-475b-ad4b-b24c26c16ccf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:24.979124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ca73969-80a0-475b-ad4b-b24c26c16ccf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:24.979839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ca73969-80a0-475b-ad4b-b24c26c16ccf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:24.980296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ca73969-80a0-475b-ad4b-b24c26c16ccf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:24.980752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ca73969-80a0-475b-ad4b-b24c26c16ccf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:24.989491 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1870/3777] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:24 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1492 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:25.156976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a008eb73-5ed7-453e-87ac-5c8966370921 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:25.157623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a008eb73-5ed7-453e-87ac-5c8966370921 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:25.166364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8ca73969-80a0-475b-ad4b-b24c26c16ccf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:25.172942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a008eb73-5ed7-453e-87ac-5c8966370921 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:25.174949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a008eb73-5ed7-453e-87ac-5c8966370921 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:25.176229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a008eb73-5ed7-453e-87ac-5c8966370921 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:25.176675 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8ca73969-80a0-475b-ad4b-b24c26c16ccf tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1517 microversion: 2.1 time: 0.210458 Aug 27 04:48:25.177318 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1908/3778] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:24 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1517 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:25.178758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a008eb73-5ed7-453e-87ac-5c8966370921 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:25.179533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a008eb73-5ed7-453e-87ac-5c8966370921 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:25.179982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a008eb73-5ed7-453e-87ac-5c8966370921 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:25.291937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-000a7814-9d93-48a1-a3fe-c1b6ae15b2dd req-d984b804-2432-461e-a756-2d083cc82f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed03d537-8672-4059-88f4-b1f4399727b7", "name": "network-vif-plugged", "status": "completed", "tag": "7cf7405a-773f-40a7-b15b-4341558451b0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:25.311265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-000a7814-9d93-48a1-a3fe-c1b6ae15b2dd req-d984b804-2432-461e-a756-2d083cc82f33 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:25.311505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-000a7814-9d93-48a1-a3fe-c1b6ae15b2dd req-d984b804-2432-461e-a756-2d083cc82f33 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:25.312306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-000a7814-9d93-48a1-a3fe-c1b6ae15b2dd req-d984b804-2432-461e-a756-2d083cc82f33 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:25.339968 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-000a7814-9d93-48a1-a3fe-c1b6ae15b2dd req-d984b804-2432-461e-a756-2d083cc82f33 service nova] Creating event network-vif-plugged:7cf7405a-773f-40a7-b15b-4341558451b0 for instance ed03d537-8672-4059-88f4-b1f4399727b7 on n-h2-854823-1 Aug 27 04:48:25.354400 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-000a7814-9d93-48a1-a3fe-c1b6ae15b2dd req-d984b804-2432-461e-a756-2d083cc82f33 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066734 Aug 27 04:48:25.355384 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1909/3779] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:48:25.484183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a008eb73-5ed7-453e-87ac-5c8966370921 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:25.492926 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a008eb73-5ed7-453e-87ac-5c8966370921 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1314 microversion: 2.1 time: 0.342470 Aug 27 04:48:25.493925 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1871/3780] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:25 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:25.498376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73fa1ef7-e674-4ea5-b915-6c72edf600b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:25.500290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73fa1ef7-e674-4ea5-b915-6c72edf600b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:25.517834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73fa1ef7-e674-4ea5-b915-6c72edf600b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:25.518897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73fa1ef7-e674-4ea5-b915-6c72edf600b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:25.519498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73fa1ef7-e674-4ea5-b915-6c72edf600b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:25.520341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73fa1ef7-e674-4ea5-b915-6c72edf600b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:25.521048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73fa1ef7-e674-4ea5-b915-6c72edf600b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:25.521677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73fa1ef7-e674-4ea5-b915-6c72edf600b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:25.534217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-79e0d8b7-70c9-4504-8b89-a7f992ad403c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:25.536036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-79e0d8b7-70c9-4504-8b89-a7f992ad403c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:25.548488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79e0d8b7-70c9-4504-8b89-a7f992ad403c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:25.551526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79e0d8b7-70c9-4504-8b89-a7f992ad403c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:25.552802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79e0d8b7-70c9-4504-8b89-a7f992ad403c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:25.553888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79e0d8b7-70c9-4504-8b89-a7f992ad403c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:25.554604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79e0d8b7-70c9-4504-8b89-a7f992ad403c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:25.555268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79e0d8b7-70c9-4504-8b89-a7f992ad403c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:25.700900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-73fa1ef7-e674-4ea5-b915-6c72edf600b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:25.712248 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-73fa1ef7-e674-4ea5-b915-6c72edf600b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.232699 Aug 27 04:48:25.714202 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1910/3781] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:25 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:25.861684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-79e0d8b7-70c9-4504-8b89-a7f992ad403c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:25.872088 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-79e0d8b7-70c9-4504-8b89-a7f992ad403c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1314 microversion: 2.1 time: 0.341870 Aug 27 04:48:25.873095 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1872/3782] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:25 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:25.944621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d3ae17a3-4044-4eb4-85fc-05f95d4a61d3 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:25.945476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d3ae17a3-4044-4eb4-85fc-05f95d4a61d3 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:25.952919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:25.954922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ae17a3-4044-4eb4-85fc-05f95d4a61d3 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:25.955683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ae17a3-4044-4eb4-85fc-05f95d4a61d3 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:25.956323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ae17a3-4044-4eb4-85fc-05f95d4a61d3 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:25.957314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ae17a3-4044-4eb4-85fc-05f95d4a61d3 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:25.958118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ae17a3-4044-4eb4-85fc-05f95d4a61d3 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:25.959218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ae17a3-4044-4eb4-85fc-05f95d4a61d3 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:25.997265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4b0a498b-7beb-4861-a756-0ac29676d707 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:25.998192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4b0a498b-7beb-4861-a756-0ac29676d707 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:26.005830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0a498b-7beb-4861-a756-0ac29676d707 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:26.006651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0a498b-7beb-4861-a756-0ac29676d707 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:26.007585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0a498b-7beb-4861-a756-0ac29676d707 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:26.008484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0a498b-7beb-4861-a756-0ac29676d707 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:26.009752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0a498b-7beb-4861-a756-0ac29676d707 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:26.010780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0a498b-7beb-4861-a756-0ac29676d707 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:26.053691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0a498b-7beb-4861-a756-0ac29676d707 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:26.054481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0a498b-7beb-4861-a756-0ac29676d707 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:26.055616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0a498b-7beb-4861-a756-0ac29676d707 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:26.056095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-4b0a498b-7beb-4861-a756-0ac29676d707 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lazy-loading 'fault' on Instance uuid eb357c1b-f703-4128-928f-96562649e22c {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:48:26.114028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4b0a498b-7beb-4861-a756-0ac29676d707 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:26.123565 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4b0a498b-7beb-4861-a756-0ac29676d707 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1317 microversion: 2.1 time: 0.130440 Aug 27 04:48:26.125306 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1873/3783] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:25 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1317 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:26.202960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0eb13645-8168-40d9-9ea2-e235a1fa7d64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:26.203879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0eb13645-8168-40d9-9ea2-e235a1fa7d64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:26.211056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0eb13645-8168-40d9-9ea2-e235a1fa7d64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:26.211696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0eb13645-8168-40d9-9ea2-e235a1fa7d64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:26.213417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0eb13645-8168-40d9-9ea2-e235a1fa7d64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:26.213938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0eb13645-8168-40d9-9ea2-e235a1fa7d64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:26.214532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0eb13645-8168-40d9-9ea2-e235a1fa7d64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:26.215506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0eb13645-8168-40d9-9ea2-e235a1fa7d64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:26.233320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3ae17a3-4044-4eb4-85fc-05f95d4a61d3 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:26.247727 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d3ae17a3-4044-4eb4-85fc-05f95d4a61d3 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1355 microversion: 2.1 time: 0.307236 Aug 27 04:48:26.250658 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1911/3784] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:25 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1355 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:26.371229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0eb13645-8168-40d9-9ea2-e235a1fa7d64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:26.385510 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0eb13645-8168-40d9-9ea2-e235a1fa7d64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1523 microversion: 2.1 time: 0.189030 Aug 27 04:48:26.386763 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1874/3785] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:26 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:26.518512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f568d86-a46e-45e5-ac5d-0c4d806922ac tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:26.519769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f568d86-a46e-45e5-ac5d-0c4d806922ac tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:26.526908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f568d86-a46e-45e5-ac5d-0c4d806922ac tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:26.528879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f568d86-a46e-45e5-ac5d-0c4d806922ac tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:26.529955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f568d86-a46e-45e5-ac5d-0c4d806922ac tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:26.531187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f568d86-a46e-45e5-ac5d-0c4d806922ac tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:26.532120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f568d86-a46e-45e5-ac5d-0c4d806922ac tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:26.532758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f568d86-a46e-45e5-ac5d-0c4d806922ac tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:26.714856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8f568d86-a46e-45e5-ac5d-0c4d806922ac tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:26.724704 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f568d86-a46e-45e5-ac5d-0c4d806922ac tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1314 microversion: 2.1 time: 0.212450 Aug 27 04:48:26.725638 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1912/3786] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:26 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:26.743521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7fa7fe09-39be-4171-a5dd-e371ff36df8d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:26.744181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7fa7fe09-39be-4171-a5dd-e371ff36df8d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:26.750440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa7fe09-39be-4171-a5dd-e371ff36df8d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:26.750871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa7fe09-39be-4171-a5dd-e371ff36df8d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:26.751311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa7fe09-39be-4171-a5dd-e371ff36df8d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:26.752012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa7fe09-39be-4171-a5dd-e371ff36df8d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:26.752470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa7fe09-39be-4171-a5dd-e371ff36df8d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:26.752938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fa7fe09-39be-4171-a5dd-e371ff36df8d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:26.899327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73f2ddd4-557d-4dbb-89a9-b8efe11716d6 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:26.900304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73f2ddd4-557d-4dbb-89a9-b8efe11716d6 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:26.920617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73f2ddd4-557d-4dbb-89a9-b8efe11716d6 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:26.921681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73f2ddd4-557d-4dbb-89a9-b8efe11716d6 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:26.922344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73f2ddd4-557d-4dbb-89a9-b8efe11716d6 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:26.923056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73f2ddd4-557d-4dbb-89a9-b8efe11716d6 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:26.923514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73f2ddd4-557d-4dbb-89a9-b8efe11716d6 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:26.923936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73f2ddd4-557d-4dbb-89a9-b8efe11716d6 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:27.011890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7fa7fe09-39be-4171-a5dd-e371ff36df8d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:27.025645 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7fa7fe09-39be-4171-a5dd-e371ff36df8d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.286089 Aug 27 04:48:27.026270 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1875/3787] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:26 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:27.070182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-73f2ddd4-557d-4dbb-89a9-b8efe11716d6 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:27.083145 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-73f2ddd4-557d-4dbb-89a9-b8efe11716d6 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1314 microversion: 2.1 time: 0.187735 Aug 27 04:48:27.083145 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1913/3788] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:26 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:27.145179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bff40475-4c5b-4717-9469-a6e4970f8c07 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:27.145905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bff40475-4c5b-4717-9469-a6e4970f8c07 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:27.152722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff40475-4c5b-4717-9469-a6e4970f8c07 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:27.153224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff40475-4c5b-4717-9469-a6e4970f8c07 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:27.153666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff40475-4c5b-4717-9469-a6e4970f8c07 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:27.154373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff40475-4c5b-4717-9469-a6e4970f8c07 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:27.154834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff40475-4c5b-4717-9469-a6e4970f8c07 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:27.155818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff40475-4c5b-4717-9469-a6e4970f8c07 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:27.193664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff40475-4c5b-4717-9469-a6e4970f8c07 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:27.194416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff40475-4c5b-4717-9469-a6e4970f8c07 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:27.195119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bff40475-4c5b-4717-9469-a6e4970f8c07 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:27.195579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-bff40475-4c5b-4717-9469-a6e4970f8c07 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lazy-loading 'fault' on Instance uuid eb357c1b-f703-4128-928f-96562649e22c {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:48:27.239175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bff40475-4c5b-4717-9469-a6e4970f8c07 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:27.247014 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bff40475-4c5b-4717-9469-a6e4970f8c07 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1317 microversion: 2.1 time: 0.106345 Aug 27 04:48:27.247759 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1876/3789] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:27 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1317 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:27.270182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8806d474-b987-4142-baa5-d65530d1940d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:27.270927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8806d474-b987-4142-baa5-d65530d1940d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:27.278693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8806d474-b987-4142-baa5-d65530d1940d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:27.279200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8806d474-b987-4142-baa5-d65530d1940d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:27.279641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8806d474-b987-4142-baa5-d65530d1940d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:27.280990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8806d474-b987-4142-baa5-d65530d1940d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:27.281455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8806d474-b987-4142-baa5-d65530d1940d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:27.281889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8806d474-b987-4142-baa5-d65530d1940d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:27.400388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-28d050f9-d4af-49fc-a438-15eb313d67a0 req-7f0cdb5b-c726-493f-be8d-cb3e3aee670a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed03d537-8672-4059-88f4-b1f4399727b7", "name": "network-vif-plugged", "status": "completed", "tag": "609ea5bc-0f2d-4153-a59d-4a006013477f"}, {"server_uuid": "ed03d537-8672-4059-88f4-b1f4399727b7", "name": "network-vif-plugged", "status": "completed", "tag": "c84faf0c-e8ca-4220-baee-3ca2659d5d63"}, {"server_uuid": "b0d03e47-76ad-42b8-a14b-3649ca01e838", "name": "network-vif-plugged", "status": "completed", "tag": "9a7c7ec0-fc16-4e6b-849f-9bb422d6cb75"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:27.412428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-28d050f9-d4af-49fc-a438-15eb313d67a0 req-7f0cdb5b-c726-493f-be8d-cb3e3aee670a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:27.413108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-28d050f9-d4af-49fc-a438-15eb313d67a0 req-7f0cdb5b-c726-493f-be8d-cb3e3aee670a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:27.413554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-28d050f9-d4af-49fc-a438-15eb313d67a0 req-7f0cdb5b-c726-493f-be8d-cb3e3aee670a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:27.428668 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-28d050f9-d4af-49fc-a438-15eb313d67a0 req-7f0cdb5b-c726-493f-be8d-cb3e3aee670a service nova] Creating event network-vif-plugged:609ea5bc-0f2d-4153-a59d-4a006013477f for instance ed03d537-8672-4059-88f4-b1f4399727b7 on n-h2-854823-1 Aug 27 04:48:27.429184 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-28d050f9-d4af-49fc-a438-15eb313d67a0 req-7f0cdb5b-c726-493f-be8d-cb3e3aee670a service nova] Creating event network-vif-plugged:c84faf0c-e8ca-4220-baee-3ca2659d5d63 for instance ed03d537-8672-4059-88f4-b1f4399727b7 on n-h2-854823-1 Aug 27 04:48:27.429688 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-28d050f9-d4af-49fc-a438-15eb313d67a0 req-7f0cdb5b-c726-493f-be8d-cb3e3aee670a service nova] Creating event network-vif-plugged:9a7c7ec0-fc16-4e6b-849f-9bb422d6cb75 for instance b0d03e47-76ad-42b8-a14b-3649ca01e838 on n-h2-854823-1 Aug 27 04:48:27.436433 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-28d050f9-d4af-49fc-a438-15eb313d67a0 req-7f0cdb5b-c726-493f-be8d-cb3e3aee670a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039882 Aug 27 04:48:27.437780 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1877/3790] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:27.443499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6de554c3-9559-4f2a-8b5c-ed8b016bdb64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:27.444105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6de554c3-9559-4f2a-8b5c-ed8b016bdb64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:27.451426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6de554c3-9559-4f2a-8b5c-ed8b016bdb64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:27.452185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6de554c3-9559-4f2a-8b5c-ed8b016bdb64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:27.452841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6de554c3-9559-4f2a-8b5c-ed8b016bdb64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:27.453740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6de554c3-9559-4f2a-8b5c-ed8b016bdb64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:27.454481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6de554c3-9559-4f2a-8b5c-ed8b016bdb64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:27.455905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6de554c3-9559-4f2a-8b5c-ed8b016bdb64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:27.473176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:27.566453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8806d474-b987-4142-baa5-d65530d1940d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:27.583792 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8806d474-b987-4142-baa5-d65530d1940d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1355 microversion: 2.1 time: 0.317063 Aug 27 04:48:27.584574 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1914/3791] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:27 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1355 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:27.731003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6de554c3-9559-4f2a-8b5c-ed8b016bdb64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:27.746364 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6de554c3-9559-4f2a-8b5c-ed8b016bdb64 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1523 microversion: 2.1 time: 0.307011 Aug 27 04:48:27.747041 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1878/3792] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:27 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:27.747239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2a33e40-f59b-4492-a77d-3830e04b8959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:27.748050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2a33e40-f59b-4492-a77d-3830e04b8959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:27.755408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a33e40-f59b-4492-a77d-3830e04b8959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:27.756116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a33e40-f59b-4492-a77d-3830e04b8959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:27.757915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a33e40-f59b-4492-a77d-3830e04b8959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:27.759320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a33e40-f59b-4492-a77d-3830e04b8959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:27.760562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a33e40-f59b-4492-a77d-3830e04b8959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:27.761646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a33e40-f59b-4492-a77d-3830e04b8959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:27.901478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2a33e40-f59b-4492-a77d-3830e04b8959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:27.911284 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2a33e40-f59b-4492-a77d-3830e04b8959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1314 microversion: 2.1 time: 0.168871 Aug 27 04:48:27.911869 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1915/3793] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:27 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:28.048336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2ebcd878-a104-4dd0-b731-98ef6dafcd95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:28.048982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2ebcd878-a104-4dd0-b731-98ef6dafcd95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:28.056169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ebcd878-a104-4dd0-b731-98ef6dafcd95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:28.056679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ebcd878-a104-4dd0-b731-98ef6dafcd95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:28.057127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ebcd878-a104-4dd0-b731-98ef6dafcd95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:28.057926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ebcd878-a104-4dd0-b731-98ef6dafcd95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:28.058383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ebcd878-a104-4dd0-b731-98ef6dafcd95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:28.058823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ebcd878-a104-4dd0-b731-98ef6dafcd95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:28.102157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c0e7acb-753b-4769-b35e-34f76575248c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:28.104012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c0e7acb-753b-4769-b35e-34f76575248c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:28.111432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c0e7acb-753b-4769-b35e-34f76575248c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:28.112239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c0e7acb-753b-4769-b35e-34f76575248c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:28.112706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c0e7acb-753b-4769-b35e-34f76575248c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:28.114030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c0e7acb-753b-4769-b35e-34f76575248c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:28.114564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c0e7acb-753b-4769-b35e-34f76575248c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:28.115262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c0e7acb-753b-4769-b35e-34f76575248c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:28.307714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c0e7acb-753b-4769-b35e-34f76575248c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:28.317468 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c0e7acb-753b-4769-b35e-34f76575248c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1314 microversion: 2.1 time: 0.221094 Aug 27 04:48:28.329555 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1916/3794] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:28 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:28.338358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e897c5b-c9b1-4e01-ae32-e20dfe667a71 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:28.339820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e897c5b-c9b1-4e01-ae32-e20dfe667a71 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:28.347967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e897c5b-c9b1-4e01-ae32-e20dfe667a71 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:28.348960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e897c5b-c9b1-4e01-ae32-e20dfe667a71 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:28.349824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e897c5b-c9b1-4e01-ae32-e20dfe667a71 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:28.350547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2ebcd878-a104-4dd0-b731-98ef6dafcd95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:28.351044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e897c5b-c9b1-4e01-ae32-e20dfe667a71 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:28.352003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e897c5b-c9b1-4e01-ae32-e20dfe667a71 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:28.352865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e897c5b-c9b1-4e01-ae32-e20dfe667a71 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:28.363663 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2ebcd878-a104-4dd0-b731-98ef6dafcd95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.320311 Aug 27 04:48:28.365188 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1879/3795] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:28 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:28.396295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e897c5b-c9b1-4e01-ae32-e20dfe667a71 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:28.397243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e897c5b-c9b1-4e01-ae32-e20dfe667a71 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:28.398312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e897c5b-c9b1-4e01-ae32-e20dfe667a71 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:28.399108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-8e897c5b-c9b1-4e01-ae32-e20dfe667a71 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lazy-loading 'fault' on Instance uuid eb357c1b-f703-4128-928f-96562649e22c {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:48:28.461927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e897c5b-c9b1-4e01-ae32-e20dfe667a71 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5770f96537b42bf9db631c051b321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a36b5e1a40746d387ea97d5fe2939d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:28.472454 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e897c5b-c9b1-4e01-ae32-e20dfe667a71 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 200 len: 1317 microversion: 2.1 time: 0.141298 Aug 27 04:48:28.473689 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1917/3796] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:28 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:28.609147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-50c4b34c-b9b9-4d08-b27d-0f86e9efc6a2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:28.610297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-50c4b34c-b9b9-4d08-b27d-0f86e9efc6a2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:28.618507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50c4b34c-b9b9-4d08-b27d-0f86e9efc6a2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:28.619268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50c4b34c-b9b9-4d08-b27d-0f86e9efc6a2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:28.619894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50c4b34c-b9b9-4d08-b27d-0f86e9efc6a2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:28.620938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50c4b34c-b9b9-4d08-b27d-0f86e9efc6a2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:28.621848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50c4b34c-b9b9-4d08-b27d-0f86e9efc6a2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:28.622863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50c4b34c-b9b9-4d08-b27d-0f86e9efc6a2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:28.770461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e522d39-a38d-4822-8e7b-201871c04618 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:28.772068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e522d39-a38d-4822-8e7b-201871c04618 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:28.779057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e522d39-a38d-4822-8e7b-201871c04618 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:28.779741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e522d39-a38d-4822-8e7b-201871c04618 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:28.781066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e522d39-a38d-4822-8e7b-201871c04618 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:28.782051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e522d39-a38d-4822-8e7b-201871c04618 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:28.782627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e522d39-a38d-4822-8e7b-201871c04618 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:28.783159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e522d39-a38d-4822-8e7b-201871c04618 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:29.315898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e522d39-a38d-4822-8e7b-201871c04618 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:29.341023 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e522d39-a38d-4822-8e7b-201871c04618 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1523 microversion: 2.1 time: 0.574514 Aug 27 04:48:29.344651 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1918/3797] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:28 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1523 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:29.354994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ca62550-c846-47d9-a89e-dcbf2286bdd6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:29.355758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ca62550-c846-47d9-a89e-dcbf2286bdd6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:29.367131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ca62550-c846-47d9-a89e-dcbf2286bdd6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:29.368651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-50c4b34c-b9b9-4d08-b27d-0f86e9efc6a2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:29.369139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ca62550-c846-47d9-a89e-dcbf2286bdd6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:29.369367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ca62550-c846-47d9-a89e-dcbf2286bdd6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:29.370835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ca62550-c846-47d9-a89e-dcbf2286bdd6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:29.371432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ca62550-c846-47d9-a89e-dcbf2286bdd6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:29.371947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ca62550-c846-47d9-a89e-dcbf2286bdd6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:29.391763 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-50c4b34c-b9b9-4d08-b27d-0f86e9efc6a2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1355 microversion: 2.1 time: 0.787376 Aug 27 04:48:29.394275 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1880/3798] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:28 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1355 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:29.401458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5633575d-2852-42d4-af28-8fb787af863d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:29.402263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5633575d-2852-42d4-af28-8fb787af863d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:29.412822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5633575d-2852-42d4-af28-8fb787af863d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:29.413563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5633575d-2852-42d4-af28-8fb787af863d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:29.414017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5633575d-2852-42d4-af28-8fb787af863d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:29.432668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5633575d-2852-42d4-af28-8fb787af863d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:29.435993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5633575d-2852-42d4-af28-8fb787af863d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:29.436861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5633575d-2852-42d4-af28-8fb787af863d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:29.594340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ca62550-c846-47d9-a89e-dcbf2286bdd6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:29.602805 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ca62550-c846-47d9-a89e-dcbf2286bdd6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1499 microversion: 2.1 time: 0.255755 Aug 27 04:48:29.603417 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1919/3799] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:29 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1499 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:29.608257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94b6c131-0b14-4749-b65b-1aecebc2e1ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:29.609161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94b6c131-0b14-4749-b65b-1aecebc2e1ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:29.616916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94b6c131-0b14-4749-b65b-1aecebc2e1ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:29.618789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94b6c131-0b14-4749-b65b-1aecebc2e1ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:29.619557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94b6c131-0b14-4749-b65b-1aecebc2e1ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:29.621121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94b6c131-0b14-4749-b65b-1aecebc2e1ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:29.621480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94b6c131-0b14-4749-b65b-1aecebc2e1ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:29.621912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94b6c131-0b14-4749-b65b-1aecebc2e1ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:29.770538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5633575d-2852-42d4-af28-8fb787af863d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:29.782104 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5633575d-2852-42d4-af28-8fb787af863d tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1314 microversion: 2.1 time: 0.386622 Aug 27 04:48:29.782719 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1881/3800] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:29 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:29.787544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4b8707f4-e699-4628-b161-316bf6909767 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:29.788164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4b8707f4-e699-4628-b161-316bf6909767 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] [instance: eb357c1b-f703-4128-928f-96562649e22c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:29.803381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b8707f4-e699-4628-b161-316bf6909767 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:29.803880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b8707f4-e699-4628-b161-316bf6909767 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:29.804323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b8707f4-e699-4628-b161-316bf6909767 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:29.805259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b8707f4-e699-4628-b161-316bf6909767 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:29.805980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b8707f4-e699-4628-b161-316bf6909767 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:29.806838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b8707f4-e699-4628-b161-316bf6909767 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:29.824915 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-4b8707f4-e699-4628-b161-316bf6909767 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] HTTP exception thrown: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4b8707f4-e699-4628-b161-316bf6909767 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Request method failure captured: Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c HTTP/1.1 Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaHeQWkInoyoUDxoRC0hG2jjgi5Z67_qsgTAodazaonuOLVybqpEdeXUbySZwymeJsXDyaYILP7ao8_8yDrpeq0Sut_J-RA37koaljPlnYtu9s0hGqlQ_G7zDhI-7XcC9D6wmiw_KGoiRavkdrPUubhtKxrgeZ7xtdfv1q6d7lZEtrg Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 4a36b5e1a40746d387ea97d5fe2939d0 Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2136515423 Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4a36b5e1a40746d387ea97d5fe2939d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4a36b5e1a40746d387ea97d5fe2939d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4a36b5e1a40746d387ea97d5fe2939d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4a36b5e1a40746d387ea97d5fe2939d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2136515423 Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 4a36b5e1a40746d387ea97d5fe2939d0 Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2136515423 Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2136515423-project Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a5770f96537b42bf9db631c051b321ae Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2136515423-project Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'eb357c1b-f703-4128-928f-96562649e22c'} Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:29.828798 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:29.834173 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:29.834173 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:29.834173 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:29.834173 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:29.834173 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:29.834173 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:48:29.834173 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:48:29.834173 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. Aug 27 04:48:29.834173 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:29.835914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4b8707f4-e699-4628-b161-316bf6909767 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] Returning 404 to user: Instance eb357c1b-f703-4128-928f-96562649e22c could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:48:29.838277 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4b8707f4-e699-4628-b161-316bf6909767 tempest-ServersNegativeTestMultiTenantJSON-2136515423 tempest-ServersNegativeTestMultiTenantJSON-2136515423-project] 10.222.0.79 "GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c" status: 404 len: 111 microversion: 2.1 time: 0.053385 Aug 27 04:48:29.838869 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1882/3801] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:29 2022] GET /compute/v2.1/servers/eb357c1b-f703-4128-928f-96562649e22c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:48:29.844869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94b6c131-0b14-4749-b65b-1aecebc2e1ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:29.845763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8eac06fc-192f-46c0-819c-5ff3f6edee2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:29.848073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8eac06fc-192f-46c0-819c-5ff3f6edee2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:29.853851 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94b6c131-0b14-4749-b65b-1aecebc2e1ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.248787 Aug 27 04:48:29.856325 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1920/3802] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:29 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:29.862616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8eac06fc-192f-46c0-819c-5ff3f6edee2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:29.863332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8eac06fc-192f-46c0-819c-5ff3f6edee2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:29.863894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8eac06fc-192f-46c0-819c-5ff3f6edee2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:29.864714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8eac06fc-192f-46c0-819c-5ff3f6edee2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:29.865238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8eac06fc-192f-46c0-819c-5ff3f6edee2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:29.865766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8eac06fc-192f-46c0-819c-5ff3f6edee2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:29.896027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-8eac06fc-192f-46c0-819c-5ff3f6edee2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lazy-loading 'flavor' on Instance uuid b0d03e47-76ad-42b8-a14b-3649ca01e838 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:48:29.974697 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8eac06fc-192f-46c0-819c-5ff3f6edee2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "POST /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838/action" status: 200 len: 32 microversion: 2.1 time: 0.134232 Aug 27 04:48:29.975582 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1883/3803] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:48:29 2022] POST /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838/action => generated 32 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:48:29.985748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3ef655a1-9ddd-469e-bfcc-5cd6f5a54959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:29.986368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3ef655a1-9ddd-469e-bfcc-5cd6f5a54959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:29.992784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ef655a1-9ddd-469e-bfcc-5cd6f5a54959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:29.993537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ef655a1-9ddd-469e-bfcc-5cd6f5a54959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:29.994157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ef655a1-9ddd-469e-bfcc-5cd6f5a54959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:29.995440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ef655a1-9ddd-469e-bfcc-5cd6f5a54959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:29.995912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ef655a1-9ddd-469e-bfcc-5cd6f5a54959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:29.996616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ef655a1-9ddd-469e-bfcc-5cd6f5a54959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:30.069152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:30.147334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3ef655a1-9ddd-469e-bfcc-5cd6f5a54959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:30.155289 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3ef655a1-9ddd-469e-bfcc-5cd6f5a54959 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.173455 Aug 27 04:48:30.155880 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1921/3804] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:29 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:30.366102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e9484493-a1e1-4209-983b-0efd2eb8eb4e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:30.367135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e9484493-a1e1-4209-983b-0efd2eb8eb4e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:30.374743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:30.383493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9484493-a1e1-4209-983b-0efd2eb8eb4e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:30.385932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9484493-a1e1-4209-983b-0efd2eb8eb4e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:30.386570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9484493-a1e1-4209-983b-0efd2eb8eb4e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:30.387503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9484493-a1e1-4209-983b-0efd2eb8eb4e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:30.388157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9484493-a1e1-4209-983b-0efd2eb8eb4e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:30.388295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e5f6d62d-5443-443e-815e-c8f7d79b98ba req-3803c74f-09e0-4e91-9efd-ce3cf0227747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60af8f98-57c0-40d9-bbeb-76c6590b5ab8", "name": "network-vif-plugged", "status": "completed", "tag": "8d25edcd-e60e-49d5-8bc2-fe022383be5b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:30.388944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9484493-a1e1-4209-983b-0efd2eb8eb4e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:30.409098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e5f6d62d-5443-443e-815e-c8f7d79b98ba req-3803c74f-09e0-4e91-9efd-ce3cf0227747 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:30.409387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e5f6d62d-5443-443e-815e-c8f7d79b98ba req-3803c74f-09e0-4e91-9efd-ce3cf0227747 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:30.410078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e5f6d62d-5443-443e-815e-c8f7d79b98ba req-3803c74f-09e0-4e91-9efd-ce3cf0227747 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:30.433842 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e5f6d62d-5443-443e-815e-c8f7d79b98ba req-3803c74f-09e0-4e91-9efd-ce3cf0227747 service nova] Creating event network-vif-plugged:8d25edcd-e60e-49d5-8bc2-fe022383be5b for instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 on n-h2-854823-1 Aug 27 04:48:30.443618 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e5f6d62d-5443-443e-815e-c8f7d79b98ba req-3803c74f-09e0-4e91-9efd-ce3cf0227747 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059479 Aug 27 04:48:30.445686 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1922/3805] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:48:30.453843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-595b9077-8be8-4878-b69b-2006160cf467 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:30.455051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-595b9077-8be8-4878-b69b-2006160cf467 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:30.463626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-595b9077-8be8-4878-b69b-2006160cf467 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:30.464520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-595b9077-8be8-4878-b69b-2006160cf467 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:30.465761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-595b9077-8be8-4878-b69b-2006160cf467 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:30.469897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-595b9077-8be8-4878-b69b-2006160cf467 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:30.471983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-595b9077-8be8-4878-b69b-2006160cf467 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:30.471983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-595b9077-8be8-4878-b69b-2006160cf467 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:30.684161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:30.732600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-595b9077-8be8-4878-b69b-2006160cf467 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:30.744706 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-595b9077-8be8-4878-b69b-2006160cf467 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1806 microversion: 2.1 time: 0.297275 Aug 27 04:48:30.757378 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1923/3806] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:30 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1806 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:30.769059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0d1bede-e2cd-4b05-9f3e-561e02ae7346 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:30.769830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a0d1bede-e2cd-4b05-9f3e-561e02ae7346 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:30.777882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0d1bede-e2cd-4b05-9f3e-561e02ae7346 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:30.778941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0d1bede-e2cd-4b05-9f3e-561e02ae7346 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:30.779802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0d1bede-e2cd-4b05-9f3e-561e02ae7346 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:30.781014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0d1bede-e2cd-4b05-9f3e-561e02ae7346 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:30.781799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0d1bede-e2cd-4b05-9f3e-561e02ae7346 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:30.782513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0d1bede-e2cd-4b05-9f3e-561e02ae7346 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:30.818607 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0d1bede-e2cd-4b05-9f3e-561e02ae7346 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7/ips" status: 200 len: 219 microversion: 2.1 time: 0.054913 Aug 27 04:48:30.825818 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1924/3807] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 04:48:30 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7/ips => generated 219 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:48:30.829384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e452611-3e25-4b98-a619-f786ca151b6a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:30.830195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e452611-3e25-4b98-a619-f786ca151b6a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:30.837811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e452611-3e25-4b98-a619-f786ca151b6a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:30.838432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e452611-3e25-4b98-a619-f786ca151b6a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:30.838974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e452611-3e25-4b98-a619-f786ca151b6a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:30.839945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e452611-3e25-4b98-a619-f786ca151b6a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:30.840519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e452611-3e25-4b98-a619-f786ca151b6a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:30.841057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e452611-3e25-4b98-a619-f786ca151b6a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:30.846642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:30.893542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e9484493-a1e1-4209-983b-0efd2eb8eb4e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:30.906270 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e9484493-a1e1-4209-983b-0efd2eb8eb4e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1523 microversion: 2.1 time: 0.544040 Aug 27 04:48:30.907486 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1884/3808] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:30 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1523 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:30.914908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6f23f9b2-7eab-4d8e-a0a9-26b20d2fb5ba tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:30.915745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6f23f9b2-7eab-4d8e-a0a9-26b20d2fb5ba tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:30.935711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f23f9b2-7eab-4d8e-a0a9-26b20d2fb5ba tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:30.936145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f23f9b2-7eab-4d8e-a0a9-26b20d2fb5ba tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:30.937152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f23f9b2-7eab-4d8e-a0a9-26b20d2fb5ba tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:30.938067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f23f9b2-7eab-4d8e-a0a9-26b20d2fb5ba tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:30.939226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f23f9b2-7eab-4d8e-a0a9-26b20d2fb5ba tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:30.939865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f23f9b2-7eab-4d8e-a0a9-26b20d2fb5ba tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:30.977405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6f23f9b2-7eab-4d8e-a0a9-26b20d2fb5ba tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:48:31.050504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2e452611-3e25-4b98-a619-f786ca151b6a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:31.066475 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e452611-3e25-4b98-a619-f786ca151b6a tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1314 microversion: 2.1 time: 0.244323 Aug 27 04:48:31.073882 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1925/3809] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:30 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:31.086968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ccd77df-0f39-46a8-991f-bc6aa50867fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:31.089288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ccd77df-0f39-46a8-991f-bc6aa50867fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:31.099509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccd77df-0f39-46a8-991f-bc6aa50867fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:31.100274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccd77df-0f39-46a8-991f-bc6aa50867fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:31.101056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccd77df-0f39-46a8-991f-bc6aa50867fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:31.102398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccd77df-0f39-46a8-991f-bc6aa50867fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:31.103139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccd77df-0f39-46a8-991f-bc6aa50867fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:31.103832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccd77df-0f39-46a8-991f-bc6aa50867fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:31.165965 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6f23f9b2-7eab-4d8e-a0a9-26b20d2fb5ba tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 204 len: 0 microversion: 2.1 time: 0.256203 Aug 27 04:48:31.172824 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1885/3810] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:48:30 2022] DELETE /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:48:31.183137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c9ab64c-fe63-4d0c-8368-1e0903cea085 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:31.184057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1c9ab64c-fe63-4d0c-8368-1e0903cea085 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:31.193474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c9ab64c-fe63-4d0c-8368-1e0903cea085 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:31.195127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c9ab64c-fe63-4d0c-8368-1e0903cea085 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:31.195595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c9ab64c-fe63-4d0c-8368-1e0903cea085 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:31.198154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c9ab64c-fe63-4d0c-8368-1e0903cea085 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:31.203491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c9ab64c-fe63-4d0c-8368-1e0903cea085 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:31.204035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c9ab64c-fe63-4d0c-8368-1e0903cea085 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:31.360566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ccd77df-0f39-46a8-991f-bc6aa50867fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:31.377446 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ccd77df-0f39-46a8-991f-bc6aa50867fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.300955 Aug 27 04:48:31.378309 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1926/3811] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:31 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:31.382904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27a131de-4d15-477f-a6d0-9610d71cbaa7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:31.383553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-27a131de-4d15-477f-a6d0-9610d71cbaa7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:31.397096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27a131de-4d15-477f-a6d0-9610d71cbaa7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:31.401274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27a131de-4d15-477f-a6d0-9610d71cbaa7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:31.402589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27a131de-4d15-477f-a6d0-9610d71cbaa7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:31.403600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27a131de-4d15-477f-a6d0-9610d71cbaa7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:31.404433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27a131de-4d15-477f-a6d0-9610d71cbaa7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:31.405874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27a131de-4d15-477f-a6d0-9610d71cbaa7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:31.696154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-27a131de-4d15-477f-a6d0-9610d71cbaa7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:31.700278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1c9ab64c-fe63-4d0c-8368-1e0903cea085 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:31.712317 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-27a131de-4d15-477f-a6d0-9610d71cbaa7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1812 microversion: 2.1 time: 0.328791 Aug 27 04:48:31.712886 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1927/3812] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:31 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1812 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:31.726633 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1c9ab64c-fe63-4d0c-8368-1e0903cea085 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.554806 Aug 27 04:48:31.729209 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1886/3813] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:31 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:31.927978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2b4f16a-118f-4f49-88ef-be357bebd6d6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:31.929543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2b4f16a-118f-4f49-88ef-be357bebd6d6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:31.942059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b4f16a-118f-4f49-88ef-be357bebd6d6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:31.942811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b4f16a-118f-4f49-88ef-be357bebd6d6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:31.943438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b4f16a-118f-4f49-88ef-be357bebd6d6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:31.944320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b4f16a-118f-4f49-88ef-be357bebd6d6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:31.944803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b4f16a-118f-4f49-88ef-be357bebd6d6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:31.945424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b4f16a-118f-4f49-88ef-be357bebd6d6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:32.095088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-63428126-d586-4fce-a378-7a954d02490c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:32.095720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-63428126-d586-4fce-a378-7a954d02490c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:32.108867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63428126-d586-4fce-a378-7a954d02490c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:32.111673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63428126-d586-4fce-a378-7a954d02490c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:32.112354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63428126-d586-4fce-a378-7a954d02490c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:32.113427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63428126-d586-4fce-a378-7a954d02490c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:32.114571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63428126-d586-4fce-a378-7a954d02490c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:32.115834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63428126-d586-4fce-a378-7a954d02490c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:32.266487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2b4f16a-118f-4f49-88ef-be357bebd6d6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:32.275781 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2b4f16a-118f-4f49-88ef-be357bebd6d6 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1523 microversion: 2.1 time: 0.351675 Aug 27 04:48:32.284039 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1928/3814] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:31 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:32.392715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-63428126-d586-4fce-a378-7a954d02490c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:32.399041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d3621fb6-fded-447a-9961-f0c84dadbfbb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:32.400036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d3621fb6-fded-447a-9961-f0c84dadbfbb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:32.404724 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-63428126-d586-4fce-a378-7a954d02490c tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1314 microversion: 2.1 time: 0.314485 Aug 27 04:48:32.406589 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1887/3815] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:32 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:32.408961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3621fb6-fded-447a-9961-f0c84dadbfbb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:32.413070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3621fb6-fded-447a-9961-f0c84dadbfbb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:32.413608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3621fb6-fded-447a-9961-f0c84dadbfbb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:32.414482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3621fb6-fded-447a-9961-f0c84dadbfbb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:32.415028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3621fb6-fded-447a-9961-f0c84dadbfbb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:32.415579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3621fb6-fded-447a-9961-f0c84dadbfbb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:32.674717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3621fb6-fded-447a-9961-f0c84dadbfbb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:32.688139 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d3621fb6-fded-447a-9961-f0c84dadbfbb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.292582 Aug 27 04:48:32.689286 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1929/3816] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:32 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:32.739143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a29802af-c386-469f-ae28-b53d3927994e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:32.740116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a29802af-c386-469f-ae28-b53d3927994e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:32.748140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a29802af-c386-469f-ae28-b53d3927994e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:32.750332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a9a65d03-f8b7-410e-9897-6fdb7ffd6f61 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:32.751059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a9a65d03-f8b7-410e-9897-6fdb7ffd6f61 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:32.756369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a29802af-c386-469f-ae28-b53d3927994e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:32.756795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a29802af-c386-469f-ae28-b53d3927994e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:32.757562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a29802af-c386-469f-ae28-b53d3927994e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:32.758044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a29802af-c386-469f-ae28-b53d3927994e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:32.758558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a29802af-c386-469f-ae28-b53d3927994e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:32.760573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9a65d03-f8b7-410e-9897-6fdb7ffd6f61 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:32.761153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9a65d03-f8b7-410e-9897-6fdb7ffd6f61 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:32.761659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9a65d03-f8b7-410e-9897-6fdb7ffd6f61 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:32.762439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9a65d03-f8b7-410e-9897-6fdb7ffd6f61 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:32.762964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9a65d03-f8b7-410e-9897-6fdb7ffd6f61 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:32.763738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9a65d03-f8b7-410e-9897-6fdb7ffd6f61 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:33.051345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a9a65d03-f8b7-410e-9897-6fdb7ffd6f61 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:33.067912 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a9a65d03-f8b7-410e-9897-6fdb7ffd6f61 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.322249 Aug 27 04:48:33.069120 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1930/3817] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:32 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:33.298079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1c302546-f6d0-46b5-9dd3-a41dd1476ff4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:33.298814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1c302546-f6d0-46b5-9dd3-a41dd1476ff4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:33.313377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c302546-f6d0-46b5-9dd3-a41dd1476ff4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:33.314301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c302546-f6d0-46b5-9dd3-a41dd1476ff4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:33.314931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c302546-f6d0-46b5-9dd3-a41dd1476ff4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:33.315780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c302546-f6d0-46b5-9dd3-a41dd1476ff4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:33.316354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c302546-f6d0-46b5-9dd3-a41dd1476ff4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:33.318323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c302546-f6d0-46b5-9dd3-a41dd1476ff4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:33.434446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a29802af-c386-469f-ae28-b53d3927994e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:33.446896 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a29802af-c386-469f-ae28-b53d3927994e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1812 microversion: 2.1 time: 0.714305 Aug 27 04:48:33.449476 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1888/3818] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:32 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1812 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:33.459317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2077e4e4-9f29-4b09-abb7-ba2d17b57177 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:33.459942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2077e4e4-9f29-4b09-abb7-ba2d17b57177 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:33.471355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2077e4e4-9f29-4b09-abb7-ba2d17b57177 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:33.472003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2077e4e4-9f29-4b09-abb7-ba2d17b57177 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:33.473067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2077e4e4-9f29-4b09-abb7-ba2d17b57177 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:33.473913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2077e4e4-9f29-4b09-abb7-ba2d17b57177 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:33.474603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2077e4e4-9f29-4b09-abb7-ba2d17b57177 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:33.475092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2077e4e4-9f29-4b09-abb7-ba2d17b57177 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:33.670378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2077e4e4-9f29-4b09-abb7-ba2d17b57177 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:33.680453 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2077e4e4-9f29-4b09-abb7-ba2d17b57177 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1314 microversion: 2.1 time: 0.229066 Aug 27 04:48:33.681155 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1889/3819] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:33 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:33.686186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ea3791b1-658f-41bd-88d8-fdadfc6e082f req-fce5bcd1-9c82-40c3-8480-018708da3eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12179ea-bed6-4c2e-b92b-0a73f274707f", "name": "network-vif-plugged", "status": "completed", "tag": "b194726d-ce48-414e-aeb4-cc71b7f21b14"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:33.696759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ea3791b1-658f-41bd-88d8-fdadfc6e082f req-fce5bcd1-9c82-40c3-8480-018708da3eec service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:33.697232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ea3791b1-658f-41bd-88d8-fdadfc6e082f req-fce5bcd1-9c82-40c3-8480-018708da3eec service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:33.697774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ea3791b1-658f-41bd-88d8-fdadfc6e082f req-fce5bcd1-9c82-40c3-8480-018708da3eec service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:33.711005 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ea3791b1-658f-41bd-88d8-fdadfc6e082f req-fce5bcd1-9c82-40c3-8480-018708da3eec service nova] Creating event network-vif-plugged:b194726d-ce48-414e-aeb4-cc71b7f21b14 for instance f12179ea-bed6-4c2e-b92b-0a73f274707f on n-h1-854823-1 Aug 27 04:48:33.718722 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ea3791b1-658f-41bd-88d8-fdadfc6e082f req-fce5bcd1-9c82-40c3-8480-018708da3eec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035279 Aug 27 04:48:33.723037 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1890/3820] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:33.738546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c302546-f6d0-46b5-9dd3-a41dd1476ff4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:33.738774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c42b347e-8951-4a89-b460-17af3982560e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:33.739243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c42b347e-8951-4a89-b460-17af3982560e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:33.752663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c42b347e-8951-4a89-b460-17af3982560e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:33.753421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c42b347e-8951-4a89-b460-17af3982560e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:33.753856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c42b347e-8951-4a89-b460-17af3982560e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:33.754557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c42b347e-8951-4a89-b460-17af3982560e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:33.755008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c42b347e-8951-4a89-b460-17af3982560e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:33.755428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c42b347e-8951-4a89-b460-17af3982560e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:33.763109 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1c302546-f6d0-46b5-9dd3-a41dd1476ff4 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1508 microversion: 2.1 time: 0.469976 Aug 27 04:48:33.766606 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1931/3821] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:33 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1508 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:33.787521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f573e18d-6d45-4825-854f-b84ab3fb3bf2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:33.788492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f573e18d-6d45-4825-854f-b84ab3fb3bf2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:33.799048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f573e18d-6d45-4825-854f-b84ab3fb3bf2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:33.799978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f573e18d-6d45-4825-854f-b84ab3fb3bf2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:33.801755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f573e18d-6d45-4825-854f-b84ab3fb3bf2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:33.802920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f573e18d-6d45-4825-854f-b84ab3fb3bf2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:33.803876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f573e18d-6d45-4825-854f-b84ab3fb3bf2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:33.805078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f573e18d-6d45-4825-854f-b84ab3fb3bf2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:34.051199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f573e18d-6d45-4825-854f-b84ab3fb3bf2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:34.059322 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f573e18d-6d45-4825-854f-b84ab3fb3bf2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 200 len: 1508 microversion: 2.1 time: 0.277882 Aug 27 04:48:34.064617 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1932/3822] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:33 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:34.083119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-561a579a-4995-41bc-819b-60646b820c28 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:34.083635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-561a579a-4995-41bc-819b-60646b820c28 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:34.094712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-561a579a-4995-41bc-819b-60646b820c28 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:34.098472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-561a579a-4995-41bc-819b-60646b820c28 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:34.102297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-561a579a-4995-41bc-819b-60646b820c28 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:34.103998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-561a579a-4995-41bc-819b-60646b820c28 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:34.104921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-561a579a-4995-41bc-819b-60646b820c28 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:34.105631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-561a579a-4995-41bc-819b-60646b820c28 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:34.143874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-561a579a-4995-41bc-819b-60646b820c28 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:48:34.204585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c42b347e-8951-4a89-b460-17af3982560e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:34.215538 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c42b347e-8951-4a89-b460-17af3982560e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.491155 Aug 27 04:48:34.216443 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1891/3823] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:33 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:34.235400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-46d7d58d-22ea-4146-92f4-c6d265da584b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:34.236306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-46d7d58d-22ea-4146-92f4-c6d265da584b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:34.242654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46d7d58d-22ea-4146-92f4-c6d265da584b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:34.243460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46d7d58d-22ea-4146-92f4-c6d265da584b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:34.244093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46d7d58d-22ea-4146-92f4-c6d265da584b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:34.245023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46d7d58d-22ea-4146-92f4-c6d265da584b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:34.245553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46d7d58d-22ea-4146-92f4-c6d265da584b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:34.246048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46d7d58d-22ea-4146-92f4-c6d265da584b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:34.288190 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-561a579a-4995-41bc-819b-60646b820c28 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "DELETE /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 204 len: 0 microversion: 2.1 time: 0.209172 Aug 27 04:48:34.290034 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1933/3824] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:48:34 2022] DELETE /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:48:34.457122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1258497133", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "6f0920ec-49cc-4dfa-9dcd-4228f9b8efc6"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:34.518768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] validate_networks() for [('6f0920ec-49cc-4dfa-9dcd-4228f9b8efc6', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:48:34.526958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-46d7d58d-22ea-4146-92f4-c6d265da584b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:34.529522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:34.538412 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-46d7d58d-22ea-4146-92f4-c6d265da584b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.307223 Aug 27 04:48:34.539678 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1892/3825] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:34 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:34.544652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3c2e32ab-c47e-48d3-a717-cfce58b008f4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:34.545456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3c2e32ab-c47e-48d3-a717-cfce58b008f4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:34.553323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c2e32ab-c47e-48d3-a717-cfce58b008f4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:34.554510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c2e32ab-c47e-48d3-a717-cfce58b008f4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:34.554798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c2e32ab-c47e-48d3-a717-cfce58b008f4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:34.556139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c2e32ab-c47e-48d3-a717-cfce58b008f4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:34.556634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c2e32ab-c47e-48d3-a717-cfce58b008f4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:34.557235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c2e32ab-c47e-48d3-a717-cfce58b008f4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:34.834019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3c2e32ab-c47e-48d3-a717-cfce58b008f4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:34.842486 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3c2e32ab-c47e-48d3-a717-cfce58b008f4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1812 microversion: 2.1 time: 0.301359 Aug 27 04:48:34.844086 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1893/3826] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:34 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1812 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:34.850269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-362d5dd0-c5ae-43ab-8228-6d57f69f6358 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:34.852638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-362d5dd0-c5ae-43ab-8228-6d57f69f6358 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:34.861872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-362d5dd0-c5ae-43ab-8228-6d57f69f6358 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:34.862749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-362d5dd0-c5ae-43ab-8228-6d57f69f6358 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:34.863938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-362d5dd0-c5ae-43ab-8228-6d57f69f6358 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:34.864786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-362d5dd0-c5ae-43ab-8228-6d57f69f6358 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:34.865318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-362d5dd0-c5ae-43ab-8228-6d57f69f6358 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:34.866684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-362d5dd0-c5ae-43ab-8228-6d57f69f6358 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:35.063302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-362d5dd0-c5ae-43ab-8228-6d57f69f6358 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:35.072964 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-362d5dd0-c5ae-43ab-8228-6d57f69f6358 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1314 microversion: 2.1 time: 0.227202 Aug 27 04:48:35.073636 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1894/3827] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:34 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:35.241820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f0c6ca9a-df19-4dca-bee9-de30c7d092fd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:35.242844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f0c6ca9a-df19-4dca-bee9-de30c7d092fd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:35.251677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c6ca9a-df19-4dca-bee9-de30c7d092fd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:35.252419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c6ca9a-df19-4dca-bee9-de30c7d092fd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:35.253386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c6ca9a-df19-4dca-bee9-de30c7d092fd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:35.254339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c6ca9a-df19-4dca-bee9-de30c7d092fd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:35.255040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c6ca9a-df19-4dca-bee9-de30c7d092fd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:35.255759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c6ca9a-df19-4dca-bee9-de30c7d092fd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:35.352776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:48:35.354276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:48:35.355133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:48:35.356004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:48:35.356889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:48:35.392427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:35.395411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:35.397779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:35.400272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:35.402530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:35.403379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:35.448965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Getting quotas for project 35481e527d554cffb51339a61b5b25c0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:48:35.457838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Getting quotas for user 12e5c6081bd441a4b105b405703b1325 and project 35481e527d554cffb51339a61b5b25c0. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:48:35.477095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:48:35.479555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:48:35.636681 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6f886a9d-ddde-43ea-8d29-69bcc0c32470 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.185616 Aug 27 04:48:35.661020 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1934/3828] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:48:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:48:35.667768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f9c6ee11-2772-4146-b6cc-d22e553a1dc2 req-018ee4d7-9d06-4e60-8160-3ed126b7bf7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed03d537-8672-4059-88f4-b1f4399727b7", "name": "network-vif-deleted", "tag": "609ea5bc-0f2d-4153-a59d-4a006013477f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:35.679381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f9c6ee11-2772-4146-b6cc-d22e553a1dc2 req-018ee4d7-9d06-4e60-8160-3ed126b7bf7f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:35.680352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f9c6ee11-2772-4146-b6cc-d22e553a1dc2 req-018ee4d7-9d06-4e60-8160-3ed126b7bf7f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:35.681106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f9c6ee11-2772-4146-b6cc-d22e553a1dc2 req-018ee4d7-9d06-4e60-8160-3ed126b7bf7f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:35.696983 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f9c6ee11-2772-4146-b6cc-d22e553a1dc2 req-018ee4d7-9d06-4e60-8160-3ed126b7bf7f service nova] Creating event network-vif-deleted:609ea5bc-0f2d-4153-a59d-4a006013477f for instance ed03d537-8672-4059-88f4-b1f4399727b7 on n-h2-854823-1 Aug 27 04:48:35.705501 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f9c6ee11-2772-4146-b6cc-d22e553a1dc2 req-018ee4d7-9d06-4e60-8160-3ed126b7bf7f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042044 Aug 27 04:48:35.706394 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1935/3829] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:35.711998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a4819241-74f2-4ed0-8774-a1f24e83f83b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:35.713089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a4819241-74f2-4ed0-8774-a1f24e83f83b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:35.723845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4819241-74f2-4ed0-8774-a1f24e83f83b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:35.724663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4819241-74f2-4ed0-8774-a1f24e83f83b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:35.725231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4819241-74f2-4ed0-8774-a1f24e83f83b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:35.726046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4819241-74f2-4ed0-8774-a1f24e83f83b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:35.726608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4819241-74f2-4ed0-8774-a1f24e83f83b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:35.727132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4819241-74f2-4ed0-8774-a1f24e83f83b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:35.743647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f0c6ca9a-df19-4dca-bee9-de30c7d092fd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:35.753556 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f0c6ca9a-df19-4dca-bee9-de30c7d092fd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.518781 Aug 27 04:48:35.757397 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1895/3830] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:35 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:35.771353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-506fc349-f1ef-44b2-8735-bcc097860075 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:35.773542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-506fc349-f1ef-44b2-8735-bcc097860075 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:35.931153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-506fc349-f1ef-44b2-8735-bcc097860075 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:35.958378 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-506fc349-f1ef-44b2-8735-bcc097860075 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1218 microversion: 2.1 time: 0.198511 Aug 27 04:48:35.975703 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1896/3831] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:35 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:35.986594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-36bb442a-a801-432a-b76a-2746d517a4dd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:35.987220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-36bb442a-a801-432a-b76a-2746d517a4dd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:36.006749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36bb442a-a801-432a-b76a-2746d517a4dd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:36.006981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36bb442a-a801-432a-b76a-2746d517a4dd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:36.007401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36bb442a-a801-432a-b76a-2746d517a4dd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:36.008145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36bb442a-a801-432a-b76a-2746d517a4dd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:36.008889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36bb442a-a801-432a-b76a-2746d517a4dd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:36.009467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-36bb442a-a801-432a-b76a-2746d517a4dd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:36.281074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a4819241-74f2-4ed0-8774-a1f24e83f83b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:36.292456 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a4819241-74f2-4ed0-8774-a1f24e83f83b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.584493 Aug 27 04:48:36.297166 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1936/3832] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:35 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:36.305227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f42626a3-f449-4451-a0eb-7705470790ca tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:36.306306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f42626a3-f449-4451-a0eb-7705470790ca tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:36.324593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42626a3-f449-4451-a0eb-7705470790ca tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:36.325110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42626a3-f449-4451-a0eb-7705470790ca tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:36.325554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42626a3-f449-4451-a0eb-7705470790ca tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:36.326265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42626a3-f449-4451-a0eb-7705470790ca tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:36.326729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42626a3-f449-4451-a0eb-7705470790ca tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:36.327194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42626a3-f449-4451-a0eb-7705470790ca tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:36.418956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-36bb442a-a801-432a-b76a-2746d517a4dd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:36.430728 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-36bb442a-a801-432a-b76a-2746d517a4dd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1633 microversion: 2.1 time: 0.452935 Aug 27 04:48:36.432821 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1897/3833] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:35 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1633 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:36.682023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f42626a3-f449-4451-a0eb-7705470790ca tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:36.697259 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f42626a3-f449-4451-a0eb-7705470790ca tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1498 microversion: 2.1 time: 0.397406 Aug 27 04:48:36.714450 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1937/3834] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:36 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1498 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:36.782405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b3b9aa4f-7c3d-45a8-aef1-7debc9bc97e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:36.783108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b3b9aa4f-7c3d-45a8-aef1-7debc9bc97e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:36.794780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3b9aa4f-7c3d-45a8-aef1-7debc9bc97e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:36.795271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3b9aa4f-7c3d-45a8-aef1-7debc9bc97e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:36.802791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3b9aa4f-7c3d-45a8-aef1-7debc9bc97e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:36.804343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3b9aa4f-7c3d-45a8-aef1-7debc9bc97e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:36.805113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3b9aa4f-7c3d-45a8-aef1-7debc9bc97e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:36.805797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3b9aa4f-7c3d-45a8-aef1-7debc9bc97e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:36.987534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9da22dfc-3ca6-4ae6-9191-0931fef5da6c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:36.988200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9da22dfc-3ca6-4ae6-9191-0931fef5da6c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:36.999956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9da22dfc-3ca6-4ae6-9191-0931fef5da6c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:37.000461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9da22dfc-3ca6-4ae6-9191-0931fef5da6c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:37.000925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9da22dfc-3ca6-4ae6-9191-0931fef5da6c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:37.001642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9da22dfc-3ca6-4ae6-9191-0931fef5da6c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:37.002100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9da22dfc-3ca6-4ae6-9191-0931fef5da6c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:37.002526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9da22dfc-3ca6-4ae6-9191-0931fef5da6c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:37.159020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9da22dfc-3ca6-4ae6-9191-0931fef5da6c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:37.167537 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9da22dfc-3ca6-4ae6-9191-0931fef5da6c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1270 microversion: 2.1 time: 0.184884 Aug 27 04:48:37.171093 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1938/3835] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:36 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1270 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:37.319349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd264596-1ef0-447e-8e5c-1e318be3e71e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:37.320646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd264596-1ef0-447e-8e5c-1e318be3e71e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:37.334947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd264596-1ef0-447e-8e5c-1e318be3e71e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:37.337841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd264596-1ef0-447e-8e5c-1e318be3e71e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:37.339814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd264596-1ef0-447e-8e5c-1e318be3e71e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:37.342073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd264596-1ef0-447e-8e5c-1e318be3e71e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:37.343453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd264596-1ef0-447e-8e5c-1e318be3e71e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:37.345487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd264596-1ef0-447e-8e5c-1e318be3e71e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:37.595586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b3b9aa4f-7c3d-45a8-aef1-7debc9bc97e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:37.609242 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b3b9aa4f-7c3d-45a8-aef1-7debc9bc97e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1521 microversion: 2.1 time: 0.832736 Aug 27 04:48:37.611242 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1898/3836] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:36 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1521 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:37.616467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f7f80459-9e6e-45b8-95fe-b933c2e01de9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:37.617606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f7f80459-9e6e-45b8-95fe-b933c2e01de9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:37.625182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7f80459-9e6e-45b8-95fe-b933c2e01de9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:37.626088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7f80459-9e6e-45b8-95fe-b933c2e01de9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:37.626746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7f80459-9e6e-45b8-95fe-b933c2e01de9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:37.628404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7f80459-9e6e-45b8-95fe-b933c2e01de9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:37.629153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7f80459-9e6e-45b8-95fe-b933c2e01de9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:37.629650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7f80459-9e6e-45b8-95fe-b933c2e01de9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:37.661198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f7f80459-9e6e-45b8-95fe-b933c2e01de9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:48:37.802197 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f7f80459-9e6e-45b8-95fe-b933c2e01de9 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 204 len: 0 microversion: 2.1 time: 0.189308 Aug 27 04:48:37.803608 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1899/3837] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:48:37 2022] DELETE /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:48:37.812549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-81a257bb-a0e2-452d-9657-787ad7aa47e2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:37.813370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-81a257bb-a0e2-452d-9657-787ad7aa47e2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:37.822526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81a257bb-a0e2-452d-9657-787ad7aa47e2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:37.823162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81a257bb-a0e2-452d-9657-787ad7aa47e2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:37.823640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81a257bb-a0e2-452d-9657-787ad7aa47e2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:37.825728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81a257bb-a0e2-452d-9657-787ad7aa47e2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:37.826200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81a257bb-a0e2-452d-9657-787ad7aa47e2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:37.826629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81a257bb-a0e2-452d-9657-787ad7aa47e2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:38.057494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bd264596-1ef0-447e-8e5c-1e318be3e71e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:38.073345 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd264596-1ef0-447e-8e5c-1e318be3e71e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.758929 Aug 27 04:48:38.087117 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1939/3838] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:37 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:38.087117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3101a623-bac4-4d7f-958e-4459464f5564 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:38.087117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3101a623-bac4-4d7f-958e-4459464f5564 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:38.110646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3101a623-bac4-4d7f-958e-4459464f5564 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:38.111156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3101a623-bac4-4d7f-958e-4459464f5564 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:38.111737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3101a623-bac4-4d7f-958e-4459464f5564 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:38.112885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3101a623-bac4-4d7f-958e-4459464f5564 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:38.113562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3101a623-bac4-4d7f-958e-4459464f5564 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:38.114476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3101a623-bac4-4d7f-958e-4459464f5564 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:38.489013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3101a623-bac4-4d7f-958e-4459464f5564 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:38.506121 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3101a623-bac4-4d7f-958e-4459464f5564 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1504 microversion: 2.1 time: 0.423534 Aug 27 04:48:38.511543 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1940/3839] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:38 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1504 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:38.525395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dd647a24-4745-4975-bd7c-1593bdd11ebb req-8127172a-83f2-4ab1-a2bf-55f089a72dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed03d537-8672-4059-88f4-b1f4399727b7", "name": "network-vif-deleted", "tag": "c84faf0c-e8ca-4220-baee-3ca2659d5d63"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:38.557846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dd647a24-4745-4975-bd7c-1593bdd11ebb req-8127172a-83f2-4ab1-a2bf-55f089a72dfa service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:38.558477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dd647a24-4745-4975-bd7c-1593bdd11ebb req-8127172a-83f2-4ab1-a2bf-55f089a72dfa service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:38.559194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dd647a24-4745-4975-bd7c-1593bdd11ebb req-8127172a-83f2-4ab1-a2bf-55f089a72dfa service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:38.583027 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dd647a24-4745-4975-bd7c-1593bdd11ebb req-8127172a-83f2-4ab1-a2bf-55f089a72dfa service nova] Creating event network-vif-deleted:c84faf0c-e8ca-4220-baee-3ca2659d5d63 for instance ed03d537-8672-4059-88f4-b1f4399727b7 on n-h2-854823-1 Aug 27 04:48:38.590705 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dd647a24-4745-4975-bd7c-1593bdd11ebb req-8127172a-83f2-4ab1-a2bf-55f089a72dfa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077200 Aug 27 04:48:38.591931 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1941/3840] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:38.660775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-81a257bb-a0e2-452d-9657-787ad7aa47e2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:38.676174 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-81a257bb-a0e2-452d-9657-787ad7aa47e2 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 200 len: 1612 microversion: 2.1 time: 0.870888 Aug 27 04:48:38.680787 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1900/3841] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:37 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 1612 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:38.695312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-66d5da12-a9bd-4b4e-834e-27d7eddbae10 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:38.696328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-66d5da12-a9bd-4b4e-834e-27d7eddbae10 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:38.709179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66d5da12-a9bd-4b4e-834e-27d7eddbae10 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:38.709690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66d5da12-a9bd-4b4e-834e-27d7eddbae10 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:38.710149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66d5da12-a9bd-4b4e-834e-27d7eddbae10 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:38.710867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66d5da12-a9bd-4b4e-834e-27d7eddbae10 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:38.711337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66d5da12-a9bd-4b4e-834e-27d7eddbae10 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:38.711762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66d5da12-a9bd-4b4e-834e-27d7eddbae10 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:38.798486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-adb451c9-7318-4366-8cbd-b9a3d2c80824 req-5fddf981-63c7-4012-9ecd-0a424e0ac360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60af8f98-57c0-40d9-bbeb-76c6590b5ab8", "name": "network-vif-deleted", "tag": "8d25edcd-e60e-49d5-8bc2-fe022383be5b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:38.830731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-adb451c9-7318-4366-8cbd-b9a3d2c80824 req-5fddf981-63c7-4012-9ecd-0a424e0ac360 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:38.831916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-66d5da12-a9bd-4b4e-834e-27d7eddbae10 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:38.832673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-adb451c9-7318-4366-8cbd-b9a3d2c80824 req-5fddf981-63c7-4012-9ecd-0a424e0ac360 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:38.833461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-adb451c9-7318-4366-8cbd-b9a3d2c80824 req-5fddf981-63c7-4012-9ecd-0a424e0ac360 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:38.840225 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-66d5da12-a9bd-4b4e-834e-27d7eddbae10 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1276 microversion: 2.1 time: 0.158773 Aug 27 04:48:38.844219 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1901/3842] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:38 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:38.861973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-94b09cf5-0b70-4a77-91fe-f03d03111ca2 req-47fd837a-80a1-4acf-8e9e-6f31252cc4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed03d537-8672-4059-88f4-b1f4399727b7", "name": "network-vif-unplugged", "status": "completed", "tag": "7cf7405a-773f-40a7-b15b-4341558451b0"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:38.864766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:38.871238 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-adb451c9-7318-4366-8cbd-b9a3d2c80824 req-5fddf981-63c7-4012-9ecd-0a424e0ac360 service nova] Creating event network-vif-deleted:8d25edcd-e60e-49d5-8bc2-fe022383be5b for instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 on n-h2-854823-1 Aug 27 04:48:38.883675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-94b09cf5-0b70-4a77-91fe-f03d03111ca2 req-47fd837a-80a1-4acf-8e9e-6f31252cc4f5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:38.884337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-94b09cf5-0b70-4a77-91fe-f03d03111ca2 req-47fd837a-80a1-4acf-8e9e-6f31252cc4f5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:38.884631 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-adb451c9-7318-4366-8cbd-b9a3d2c80824 req-5fddf981-63c7-4012-9ecd-0a424e0ac360 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.287134 Aug 27 04:48:38.885013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-94b09cf5-0b70-4a77-91fe-f03d03111ca2 req-47fd837a-80a1-4acf-8e9e-6f31252cc4f5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:38.885300 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1942/3843] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:38.899445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1dd5c85-5137-4ba6-ae05-f4e4aaf91242 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:38.900518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e1dd5c85-5137-4ba6-ae05-f4e4aaf91242 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:38.907304 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-94b09cf5-0b70-4a77-91fe-f03d03111ca2 req-47fd837a-80a1-4acf-8e9e-6f31252cc4f5 service nova] Creating event network-vif-unplugged:7cf7405a-773f-40a7-b15b-4341558451b0 for instance ed03d537-8672-4059-88f4-b1f4399727b7 on n-h2-854823-1 Aug 27 04:48:38.914395 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-94b09cf5-0b70-4a77-91fe-f03d03111ca2 req-47fd837a-80a1-4acf-8e9e-6f31252cc4f5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056451 Aug 27 04:48:38.918188 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1902/3844] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:38.922262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1dd5c85-5137-4ba6-ae05-f4e4aaf91242 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:38.923150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1dd5c85-5137-4ba6-ae05-f4e4aaf91242 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:38.929417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1dd5c85-5137-4ba6-ae05-f4e4aaf91242 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:38.930609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1dd5c85-5137-4ba6-ae05-f4e4aaf91242 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:38.931778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1dd5c85-5137-4ba6-ae05-f4e4aaf91242 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:38.933203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1dd5c85-5137-4ba6-ae05-f4e4aaf91242 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:39.095466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b864a6d6-89cd-4e00-b71e-ff248e90496f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:39.096092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b864a6d6-89cd-4e00-b71e-ff248e90496f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:39.107303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b864a6d6-89cd-4e00-b71e-ff248e90496f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:39.107973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b864a6d6-89cd-4e00-b71e-ff248e90496f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:39.109214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b864a6d6-89cd-4e00-b71e-ff248e90496f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:39.109954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b864a6d6-89cd-4e00-b71e-ff248e90496f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:39.110394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b864a6d6-89cd-4e00-b71e-ff248e90496f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:39.111010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b864a6d6-89cd-4e00-b71e-ff248e90496f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:39.155087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e1dd5c85-5137-4ba6-ae05-f4e4aaf91242 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:39.165293 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1dd5c85-5137-4ba6-ae05-f4e4aaf91242 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1501 microversion: 2.1 time: 0.276058 Aug 27 04:48:39.166123 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1943/3845] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:38 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1501 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:39.185914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7ee2467-c25e-4da0-afe1-951ebf2b40b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:39.187221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7ee2467-c25e-4da0-afe1-951ebf2b40b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:39.193870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7ee2467-c25e-4da0-afe1-951ebf2b40b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:39.194371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7ee2467-c25e-4da0-afe1-951ebf2b40b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:39.194808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7ee2467-c25e-4da0-afe1-951ebf2b40b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:39.195514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7ee2467-c25e-4da0-afe1-951ebf2b40b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:39.195977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7ee2467-c25e-4da0-afe1-951ebf2b40b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:39.196409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7ee2467-c25e-4da0-afe1-951ebf2b40b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:39.449931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7ee2467-c25e-4da0-afe1-951ebf2b40b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:39.471283 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7ee2467-c25e-4da0-afe1-951ebf2b40b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1516 microversion: 2.1 time: 0.288612 Aug 27 04:48:39.472565 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1944/3846] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:39 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1516 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:39.493150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-496927da-78b3-4a00-9d3b-7e24beccbf0d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:39.496121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-496927da-78b3-4a00-9d3b-7e24beccbf0d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: c6aa033a-3311-4352-a91f-cfbe7bdddc37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:39.503956 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-496927da-78b3-4a00-9d3b-7e24beccbf0d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] HTTP exception thrown: Instance c6aa033a-3311-4352-a91f-cfbe7bdddc37 could not be found. Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-496927da-78b3-4a00-9d3b-7e24beccbf0d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Request method failure captured: Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/c6aa033a-3311-4352-a91f-cfbe7bdddc37/action HTTP/1.1 Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 14 Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaHoFwgV4INwTRL8hXoYwjmWlLrRc_QJzw9nkZAvRSAfT__IxsIMw8Suy-GjIzNFt5R-NLcBI-KbU0p7XTxgVryxRdpnu39d1-w87dFtSDYLg2-wm7KAO7Nu1eVLF-CaLCIJrg2b0bchRGMkFWgTVQ8wFhLKBmW9T3OHuZJNVIJBUXo Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 81b0ef617031436484e9e987f972ae0a Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: {"rescue": {}} Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance c6aa033a-3311-4352-a91f-cfbe7bdddc37 could not be found. Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'c6aa033a-3311-4352-a91f-cfbe7bdddc37', 'body': {'rescue': {}}} Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6aa033a-3311-4352-a91f-cfbe7bdddc37 could not be found. Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6aa033a-3311-4352-a91f-cfbe7bdddc37 could not be found. Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:39.517339 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:39.524694 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:39.524694 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:39.524694 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:48:39.524694 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:48:39.524694 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6aa033a-3311-4352-a91f-cfbe7bdddc37 could not be found. Aug 27 04:48:39.524694 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:48:39.526604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-496927da-78b3-4a00-9d3b-7e24beccbf0d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Returning 404 to user: Instance c6aa033a-3311-4352-a91f-cfbe7bdddc37 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:48:39.529402 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-496927da-78b3-4a00-9d3b-7e24beccbf0d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers/c6aa033a-3311-4352-a91f-cfbe7bdddc37/action" status: 404 len: 111 microversion: 2.1 time: 0.040464 Aug 27 04:48:39.537215 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1945/3847] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:48:39 2022] POST /compute/v2.1/servers/c6aa033a-3311-4352-a91f-cfbe7bdddc37/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:48:39.544386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-173d9ea0-d4b4-4974-aca3-91a18cdd7e5e tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:39.547004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-173d9ea0-d4b4-4974-aca3-91a18cdd7e5e tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:39.558551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173d9ea0-d4b4-4974-aca3-91a18cdd7e5e tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:39.559592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173d9ea0-d4b4-4974-aca3-91a18cdd7e5e tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:39.560277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173d9ea0-d4b4-4974-aca3-91a18cdd7e5e tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:39.561807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173d9ea0-d4b4-4974-aca3-91a18cdd7e5e tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:39.562499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173d9ea0-d4b4-4974-aca3-91a18cdd7e5e tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:39.563261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173d9ea0-d4b4-4974-aca3-91a18cdd7e5e tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:39.581918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b864a6d6-89cd-4e00-b71e-ff248e90496f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:39.602767 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b864a6d6-89cd-4e00-b71e-ff248e90496f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.512277 Aug 27 04:48:39.604422 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1903/3848] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:39 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:39.613344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d7ae6798-d544-4a55-82fb-dc705633e0e1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:39.613898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d7ae6798-d544-4a55-82fb-dc705633e0e1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:39.631081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7ae6798-d544-4a55-82fb-dc705633e0e1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:39.631796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7ae6798-d544-4a55-82fb-dc705633e0e1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:39.632710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7ae6798-d544-4a55-82fb-dc705633e0e1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:39.633982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7ae6798-d544-4a55-82fb-dc705633e0e1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:39.634837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7ae6798-d544-4a55-82fb-dc705633e0e1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:39.635622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7ae6798-d544-4a55-82fb-dc705633e0e1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:39.725240 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d7ae6798-d544-4a55-82fb-dc705633e0e1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b/action" status: 202 len: 0 microversion: 2.1 time: 0.119355 Aug 27 04:48:39.730700 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1904/3849] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:48:39 2022] POST /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:48:39.736848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68c5b929-52ca-4b32-a6db-2dbe5524594e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:39.737565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-68c5b929-52ca-4b32-a6db-2dbe5524594e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:39.744316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68c5b929-52ca-4b32-a6db-2dbe5524594e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:39.745102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68c5b929-52ca-4b32-a6db-2dbe5524594e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:39.745553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68c5b929-52ca-4b32-a6db-2dbe5524594e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:39.746611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68c5b929-52ca-4b32-a6db-2dbe5524594e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:39.747081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68c5b929-52ca-4b32-a6db-2dbe5524594e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:39.747512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68c5b929-52ca-4b32-a6db-2dbe5524594e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:39.766743 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-68c5b929-52ca-4b32-a6db-2dbe5524594e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] HTTP exception thrown: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68c5b929-52ca-4b32-a6db-2dbe5524594e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Request method failure captured: Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 HTTP/1.1 Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaH0QJEf1VwTYX1WbOyl1lJS_4GA_TPY1nmosvbE00eGfaJbEQo2Qw_jxEO4keoLTth8eXz2vhcznPT0cuPP9xUrebEr1KQYDo2q5mw7nKz_lUFk_2oz4S0jlbES03R0E289pnjtG95z4OY1YgXTQrWLE_G73rpzTJAtZL-lKpVGTRM Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 56803ee2fee048d09b8ec44ae76d1c9e Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestMultiNic-1549200309 Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestMultiNic-1549200309 Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 56803ee2fee048d09b8ec44ae76d1c9e Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestMultiNic-1549200309 Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestMultiNic-1549200309-project Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 4dae41c63374401f81d297f03fd55d57 Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestMultiNic-1549200309-project Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'ed03d537-8672-4059-88f4-b1f4399727b7'} Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:39.768491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:39.774544 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:39.774544 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:39.774544 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:39.774544 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:48:39.774544 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:48:39.774544 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:48:39.774544 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:39.774544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68c5b929-52ca-4b32-a6db-2dbe5524594e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Returning 404 to user: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:48:39.774544 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-68c5b929-52ca-4b32-a6db-2dbe5524594e tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 404 len: 111 microversion: 2.1 time: 0.037910 Aug 27 04:48:39.774544 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1905/3850] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:39 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:48:39.776184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7f448d78-1efd-4e63-8d1c-b980f1c3bb19 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:39.776969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7f448d78-1efd-4e63-8d1c-b980f1c3bb19 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:39.785029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f448d78-1efd-4e63-8d1c-b980f1c3bb19 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:39.785637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f448d78-1efd-4e63-8d1c-b980f1c3bb19 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:39.786085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f448d78-1efd-4e63-8d1c-b980f1c3bb19 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:39.786797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f448d78-1efd-4e63-8d1c-b980f1c3bb19 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:39.787261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f448d78-1efd-4e63-8d1c-b980f1c3bb19 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:39.787692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f448d78-1efd-4e63-8d1c-b980f1c3bb19 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:39.868572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-173d9ea0-d4b4-4974-aca3-91a18cdd7e5e tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e30d1322c924a3d979d7c3bd647ecab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889a88a84a944f8d9330720e0134f0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:39.876826 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-173d9ea0-d4b4-4974-aca3-91a18cdd7e5e tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 200 len: 1504 microversion: 2.1 time: 0.338160 Aug 27 04:48:39.877768 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1946/3851] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:39 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:39.882922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74d9840d-527f-4fa4-86dd-bb4f9b3c29f5 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:39.884971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74d9840d-527f-4fa4-86dd-bb4f9b3c29f5 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:39.895157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74d9840d-527f-4fa4-86dd-bb4f9b3c29f5 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:39.895947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74d9840d-527f-4fa4-86dd-bb4f9b3c29f5 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:39.896780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74d9840d-527f-4fa4-86dd-bb4f9b3c29f5 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:39.897930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74d9840d-527f-4fa4-86dd-bb4f9b3c29f5 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:39.898503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74d9840d-527f-4fa4-86dd-bb4f9b3c29f5 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:39.899054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74d9840d-527f-4fa4-86dd-bb4f9b3c29f5 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:40.133386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-74d9840d-527f-4fa4-86dd-bb4f9b3c29f5 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:40.144204 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74d9840d-527f-4fa4-86dd-bb4f9b3c29f5 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1318 microversion: 2.1 time: 0.264878 Aug 27 04:48:40.144829 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1947/3852] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:39 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:40.386311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7f448d78-1efd-4e63-8d1c-b980f1c3bb19 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:40.401427 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7f448d78-1efd-4e63-8d1c-b980f1c3bb19 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1521 microversion: 2.1 time: 0.629490 Aug 27 04:48:40.402025 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1906/3853] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:39 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1521 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:40.634052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9228dc1-2dc3-4760-bae1-1f5109187f9b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:40.634672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9228dc1-2dc3-4760-bae1-1f5109187f9b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:40.648824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-60a7b74b-905a-43f4-acad-6c0996986d5d req-199b8f88-fc92-4bc2-bfef-3d7bfcea482a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed03d537-8672-4059-88f4-b1f4399727b7", "name": "network-vif-deleted", "tag": "7cf7405a-773f-40a7-b15b-4341558451b0"}, {"server_uuid": "f12179ea-bed6-4c2e-b92b-0a73f274707f", "name": "network-vif-deleted", "tag": "b194726d-ce48-414e-aeb4-cc71b7f21b14"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:40.660945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9228dc1-2dc3-4760-bae1-1f5109187f9b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:40.662992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9228dc1-2dc3-4760-bae1-1f5109187f9b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:40.663911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9228dc1-2dc3-4760-bae1-1f5109187f9b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:40.666915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9228dc1-2dc3-4760-bae1-1f5109187f9b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:40.667408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9228dc1-2dc3-4760-bae1-1f5109187f9b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:40.667849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9228dc1-2dc3-4760-bae1-1f5109187f9b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:40.675763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-60a7b74b-905a-43f4-acad-6c0996986d5d req-199b8f88-fc92-4bc2-bfef-3d7bfcea482a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:40.676255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-60a7b74b-905a-43f4-acad-6c0996986d5d req-199b8f88-fc92-4bc2-bfef-3d7bfcea482a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:40.677055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-60a7b74b-905a-43f4-acad-6c0996986d5d req-199b8f88-fc92-4bc2-bfef-3d7bfcea482a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:40.694787 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-60a7b74b-905a-43f4-acad-6c0996986d5d req-199b8f88-fc92-4bc2-bfef-3d7bfcea482a service nova] Creating event network-vif-deleted:7cf7405a-773f-40a7-b15b-4341558451b0 for instance ed03d537-8672-4059-88f4-b1f4399727b7 on n-h2-854823-1 Aug 27 04:48:40.695697 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-60a7b74b-905a-43f4-acad-6c0996986d5d req-199b8f88-fc92-4bc2-bfef-3d7bfcea482a service nova] Creating event network-vif-deleted:b194726d-ce48-414e-aeb4-cc71b7f21b14 for instance f12179ea-bed6-4c2e-b92b-0a73f274707f on n-h1-854823-1 Aug 27 04:48:40.706339 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-60a7b74b-905a-43f4-acad-6c0996986d5d req-199b8f88-fc92-4bc2-bfef-3d7bfcea482a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060998 Aug 27 04:48:40.709048 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1907/3854] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:40.900656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9228dc1-2dc3-4760-bae1-1f5109187f9b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:40.905464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f4c5d67-3f2f-47f3-9a4e-a6092ad4ce48 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:40.906187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4f4c5d67-3f2f-47f3-9a4e-a6092ad4ce48 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] [instance: f12179ea-bed6-4c2e-b92b-0a73f274707f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:40.918204 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9228dc1-2dc3-4760-bae1-1f5109187f9b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.286077 Aug 27 04:48:40.919147 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1948/3855] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:40 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:40.927993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f4c5d67-3f2f-47f3-9a4e-a6092ad4ce48 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:40.929147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f4c5d67-3f2f-47f3-9a4e-a6092ad4ce48 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:40.929949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f4c5d67-3f2f-47f3-9a4e-a6092ad4ce48 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:40.931418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f4c5d67-3f2f-47f3-9a4e-a6092ad4ce48 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:40.932074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f4c5d67-3f2f-47f3-9a4e-a6092ad4ce48 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:40.932739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f4c5d67-3f2f-47f3-9a4e-a6092ad4ce48 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:40.957348 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-4f4c5d67-3f2f-47f3-9a4e-a6092ad4ce48 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] HTTP exception thrown: Instance f12179ea-bed6-4c2e-b92b-0a73f274707f could not be found. Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f4c5d67-3f2f-47f3-9a4e-a6092ad4ce48 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Request method failure captured: Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f HTTP/1.1 Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaHo8oUM02H-cPzhw-iTyFnN6RwIpiNkMCaXfPJYRvUm4DW-HAGPtfO6ai0JXc63q1WSeBEQTDK0wzc5ufYmVPB9Yb5IhvKkt24I60e-0GmsESVof9dBaJR8kMNRylfW0N4eFTQ9ixViQGRwfKS_whm7yoea_dUx1T5TJHjyp_Uffd0 Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 889a88a84a944f8d9330720e0134f0aa Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-VolumesActionsTest-876583057 Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/889a88a84a944f8d9330720e0134f0aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_889a88a84a944f8d9330720e0134f0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/889a88a84a944f8d9330720e0134f0aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/889a88a84a944f8d9330720e0134f0aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-VolumesActionsTest-876583057 Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 889a88a84a944f8d9330720e0134f0aa Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-VolumesActionsTest-876583057 Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-VolumesActionsTest-876583057-project Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 6e30d1322c924a3d979d7c3bd647ecab Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-VolumesActionsTest-876583057-project Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance f12179ea-bed6-4c2e-b92b-0a73f274707f could not be found. Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'f12179ea-bed6-4c2e-b92b-0a73f274707f'} Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f12179ea-bed6-4c2e-b92b-0a73f274707f could not be found. Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12179ea-bed6-4c2e-b92b-0a73f274707f could not be found. Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:40.959181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:40.965803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:40.965803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:40.965803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:40.965803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:48:40.965803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:48:40.965803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12179ea-bed6-4c2e-b92b-0a73f274707f could not be found. Aug 27 04:48:40.965803 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:40.965803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f4c5d67-3f2f-47f3-9a4e-a6092ad4ce48 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] Returning 404 to user: Instance f12179ea-bed6-4c2e-b92b-0a73f274707f could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:48:40.965803 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4f4c5d67-3f2f-47f3-9a4e-a6092ad4ce48 tempest-VolumesActionsTest-876583057 tempest-VolumesActionsTest-876583057-project] 10.222.0.79 "GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f" status: 404 len: 111 microversion: 2.1 time: 0.068914 Aug 27 04:48:40.967636 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1908/3856] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:40 2022] GET /compute/v2.1/servers/f12179ea-bed6-4c2e-b92b-0a73f274707f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:48:41.165601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9baf775a-d1e1-45de-b176-d4d2491803b7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:41.166788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9baf775a-d1e1-45de-b176-d4d2491803b7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:41.175961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9baf775a-d1e1-45de-b176-d4d2491803b7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:41.176486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9baf775a-d1e1-45de-b176-d4d2491803b7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:41.176940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9baf775a-d1e1-45de-b176-d4d2491803b7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:41.180824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9baf775a-d1e1-45de-b176-d4d2491803b7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:41.181318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9baf775a-d1e1-45de-b176-d4d2491803b7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:41.181764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9baf775a-d1e1-45de-b176-d4d2491803b7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:41.427565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e977889-a7c0-4eb0-9eb5-7f1186d2c6cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:41.428179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4e977889-a7c0-4eb0-9eb5-7f1186d2c6cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:41.439821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e977889-a7c0-4eb0-9eb5-7f1186d2c6cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:41.440311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e977889-a7c0-4eb0-9eb5-7f1186d2c6cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:41.440769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e977889-a7c0-4eb0-9eb5-7f1186d2c6cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:41.441690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e977889-a7c0-4eb0-9eb5-7f1186d2c6cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:41.442315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e977889-a7c0-4eb0-9eb5-7f1186d2c6cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:41.442909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e977889-a7c0-4eb0-9eb5-7f1186d2c6cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:41.541430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9baf775a-d1e1-45de-b176-d4d2491803b7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:41.551172 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9baf775a-d1e1-45de-b176-d4d2491803b7 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1318 microversion: 2.1 time: 0.389300 Aug 27 04:48:41.557373 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1949/3857] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:41 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:41.940988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5fc54dd7-f70a-4030-81e9-29e6d27b2528 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:41.941650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5fc54dd7-f70a-4030-81e9-29e6d27b2528 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:41.944712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:41.952926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fc54dd7-f70a-4030-81e9-29e6d27b2528 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:41.953891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fc54dd7-f70a-4030-81e9-29e6d27b2528 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:41.954603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fc54dd7-f70a-4030-81e9-29e6d27b2528 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:41.956079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fc54dd7-f70a-4030-81e9-29e6d27b2528 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:41.957240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fc54dd7-f70a-4030-81e9-29e6d27b2528 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:41.957899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fc54dd7-f70a-4030-81e9-29e6d27b2528 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:42.030548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4e977889-a7c0-4eb0-9eb5-7f1186d2c6cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:42.042414 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4e977889-a7c0-4eb0-9eb5-7f1186d2c6cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1501 microversion: 2.1 time: 0.618546 Aug 27 04:48:42.072319 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1909/3858] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:41 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1501 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:42.100355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9be95b14-f0ae-417f-b964-a6a71ed6164a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:42.109920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9be95b14-f0ae-417f-b964-a6a71ed6164a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:42.126329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9be95b14-f0ae-417f-b964-a6a71ed6164a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:42.127049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9be95b14-f0ae-417f-b964-a6a71ed6164a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:42.127520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9be95b14-f0ae-417f-b964-a6a71ed6164a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:42.130749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9be95b14-f0ae-417f-b964-a6a71ed6164a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:42.131275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9be95b14-f0ae-417f-b964-a6a71ed6164a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:42.131725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9be95b14-f0ae-417f-b964-a6a71ed6164a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:42.189216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:42.204555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-9be95b14-f0ae-417f-b964-a6a71ed6164a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lazy-loading 'flavor' on Instance uuid 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:48:42.242209 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-9be95b14-f0ae-417f-b964-a6a71ed6164a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] HTTP exception thrown: Cannot 'rescue' instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b while it is in vm_state paused Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9be95b14-f0ae-417f-b964-a6a71ed6164a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Request method failure captured: Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b/action HTTP/1.1 Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 14 Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaHoFwgV4INwTRL8hXoYwjmWlLrRc_QJzw9nkZAvRSAfT__IxsIMw8Suy-GjIzNFt5R-NLcBI-KbU0p7XTxgVryxRdpnu39d1-w87dFtSDYLg2-wm7KAO7Nu1eVLF-CaLCIJrg2b0bchRGMkFWgTVQ8wFhLKBmW9T3OHuZJNVIJBUXo Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 81b0ef617031436484e9e987f972ae0a Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: {"rescue": {}} Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: exception: Cannot 'rescue' instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b while it is in vm_state paused Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '7e9ed635-f034-40b0-8914-1e1b0ecdfa8b', 'body': {'rescue': {}}} Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b in vm_state paused. Cannot rescue while the instance is in this state. Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b while it is in vm_state paused Aug 27 04:48:42.247827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:42.255038 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:48:42.255038 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:42.255038 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:48:42.255038 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:48:42.255038 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:48:42.255038 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:48:42.255038 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:48:42.255038 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b while it is in vm_state paused Aug 27 04:48:42.255038 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:48:42.263543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9be95b14-f0ae-417f-b964-a6a71ed6164a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Returning 409 to user: Cannot 'rescue' instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b while it is in vm_state paused {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:48:42.265181 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9be95b14-f0ae-417f-b964-a6a71ed6164a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b/action" status: 409 len: 144 microversion: 2.1 time: 0.189972 Aug 27 04:48:42.270864 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1910/3859] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:48:42 2022] POST /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b/action => generated 144 bytes in 196 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:48:42.278373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-78bbb8a2-a942-4bff-b91b-22685a85ee0a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:42.279413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-78bbb8a2-a942-4bff-b91b-22685a85ee0a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:42.288409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78bbb8a2-a942-4bff-b91b-22685a85ee0a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:42.298837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78bbb8a2-a942-4bff-b91b-22685a85ee0a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:42.299409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78bbb8a2-a942-4bff-b91b-22685a85ee0a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:42.300209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78bbb8a2-a942-4bff-b91b-22685a85ee0a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:42.300745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78bbb8a2-a942-4bff-b91b-22685a85ee0a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:42.301174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78bbb8a2-a942-4bff-b91b-22685a85ee0a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:42.409740 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-78bbb8a2-a942-4bff-b91b-22685a85ee0a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b/action" status: 202 len: 0 microversion: 2.1 time: 0.137038 Aug 27 04:48:42.416694 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1911/3860] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:48:42 2022] POST /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:48:42.424437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-636f08cc-bf02-49f6-b90d-1457d610a644 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:42.425463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-636f08cc-bf02-49f6-b90d-1457d610a644 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:42.441072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636f08cc-bf02-49f6-b90d-1457d610a644 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:42.441638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636f08cc-bf02-49f6-b90d-1457d610a644 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:42.442091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636f08cc-bf02-49f6-b90d-1457d610a644 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:42.442851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636f08cc-bf02-49f6-b90d-1457d610a644 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:42.443294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636f08cc-bf02-49f6-b90d-1457d610a644 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:42.443729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-636f08cc-bf02-49f6-b90d-1457d610a644 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:42.533309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5fc54dd7-f70a-4030-81e9-29e6d27b2528 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:42.568144 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5fc54dd7-f70a-4030-81e9-29e6d27b2528 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.628284 Aug 27 04:48:42.570408 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1950/3861] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:41 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:42.633089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75e35375-697f-4a94-b697-e5baf528e5c3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:42.633821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75e35375-697f-4a94-b697-e5baf528e5c3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:42.660386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e35375-697f-4a94-b697-e5baf528e5c3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:42.663573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e35375-697f-4a94-b697-e5baf528e5c3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:42.665820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e35375-697f-4a94-b697-e5baf528e5c3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:42.674961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e35375-697f-4a94-b697-e5baf528e5c3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:42.680316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e35375-697f-4a94-b697-e5baf528e5c3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:42.681188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e35375-697f-4a94-b697-e5baf528e5c3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:42.991029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75e35375-697f-4a94-b697-e5baf528e5c3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:43.011102 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75e35375-697f-4a94-b697-e5baf528e5c3 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1318 microversion: 2.1 time: 0.406069 Aug 27 04:48:43.013376 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1951/3862] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:42 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:43.348739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-636f08cc-bf02-49f6-b90d-1457d610a644 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:43.360841 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-636f08cc-bf02-49f6-b90d-1457d610a644 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1508 microversion: 2.1 time: 0.942483 Aug 27 04:48:43.361435 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1912/3863] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:42 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1508 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:43.591784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-71cb7bd3-8aa3-4165-a3db-263e7891c75f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:43.593050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-71cb7bd3-8aa3-4165-a3db-263e7891c75f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:43.606059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71cb7bd3-8aa3-4165-a3db-263e7891c75f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:43.609048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71cb7bd3-8aa3-4165-a3db-263e7891c75f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:43.609497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71cb7bd3-8aa3-4165-a3db-263e7891c75f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:43.610223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71cb7bd3-8aa3-4165-a3db-263e7891c75f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:43.610680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71cb7bd3-8aa3-4165-a3db-263e7891c75f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:43.611103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71cb7bd3-8aa3-4165-a3db-263e7891c75f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:43.926441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-052be64e-07fa-435a-87c0-fdd6f4dd18a5 req-c4391ad2-55da-4fb0-9242-9eaf2e2f894c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af531663-20b2-4444-8be7-e134fe51de3d", "tag": "ad1b4bd9-7980-4bd8-9b9d-b4a3c908e439"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:43.965815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-052be64e-07fa-435a-87c0-fdd6f4dd18a5 req-c4391ad2-55da-4fb0-9242-9eaf2e2f894c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:43.969594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-052be64e-07fa-435a-87c0-fdd6f4dd18a5 req-c4391ad2-55da-4fb0-9242-9eaf2e2f894c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:43.971689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-052be64e-07fa-435a-87c0-fdd6f4dd18a5 req-c4391ad2-55da-4fb0-9242-9eaf2e2f894c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:44.016757 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-052be64e-07fa-435a-87c0-fdd6f4dd18a5 req-c4391ad2-55da-4fb0-9242-9eaf2e2f894c service nova] Creating event network-changed:ad1b4bd9-7980-4bd8-9b9d-b4a3c908e439 for instance af531663-20b2-4444-8be7-e134fe51de3d on n-h1-854823-1 Aug 27 04:48:44.034594 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-052be64e-07fa-435a-87c0-fdd6f4dd18a5 req-c4391ad2-55da-4fb0-9242-9eaf2e2f894c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113110 Aug 27 04:48:44.039907 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1913/3864] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:44.046297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f63168a-28a0-4d62-8cf1-efa5750e438c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:44.048954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4f63168a-28a0-4d62-8cf1-efa5750e438c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:44.065089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f63168a-28a0-4d62-8cf1-efa5750e438c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:44.066812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f63168a-28a0-4d62-8cf1-efa5750e438c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:44.068810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f63168a-28a0-4d62-8cf1-efa5750e438c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:44.074065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f63168a-28a0-4d62-8cf1-efa5750e438c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:44.075485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f63168a-28a0-4d62-8cf1-efa5750e438c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:44.076361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f63168a-28a0-4d62-8cf1-efa5750e438c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:44.586231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4f63168a-28a0-4d62-8cf1-efa5750e438c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:44.618824 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4f63168a-28a0-4d62-8cf1-efa5750e438c tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1318 microversion: 2.1 time: 0.577219 Aug 27 04:48:44.624695 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1914/3865] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:44 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:44.640849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c29a82c4-bbfb-49f3-9953-1f1acd29843c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:44.641842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c29a82c4-bbfb-49f3-9953-1f1acd29843c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:44.670983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c29a82c4-bbfb-49f3-9953-1f1acd29843c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:44.672491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c29a82c4-bbfb-49f3-9953-1f1acd29843c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:44.681356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c29a82c4-bbfb-49f3-9953-1f1acd29843c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:44.682246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c29a82c4-bbfb-49f3-9953-1f1acd29843c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:44.682612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c29a82c4-bbfb-49f3-9953-1f1acd29843c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:44.683048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c29a82c4-bbfb-49f3-9953-1f1acd29843c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:44.958768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c29a82c4-bbfb-49f3-9953-1f1acd29843c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:44.969853 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c29a82c4-bbfb-49f3-9953-1f1acd29843c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1516 microversion: 2.1 time: 0.343256 Aug 27 04:48:44.970734 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1915/3866] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:44 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1516 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:45.138481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71cb7bd3-8aa3-4165-a3db-263e7891c75f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:45.151312 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-71cb7bd3-8aa3-4165-a3db-263e7891c75f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 1.561450 Aug 27 04:48:45.155720 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1952/3867] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:43 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:45.666661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-46782b12-5067-4ac6-bcf8-d1951ab50950 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:45.670061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-46782b12-5067-4ac6-bcf8-d1951ab50950 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:45.688769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46782b12-5067-4ac6-bcf8-d1951ab50950 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:45.689945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46782b12-5067-4ac6-bcf8-d1951ab50950 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:45.691033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46782b12-5067-4ac6-bcf8-d1951ab50950 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:45.692026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46782b12-5067-4ac6-bcf8-d1951ab50950 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:45.692760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46782b12-5067-4ac6-bcf8-d1951ab50950 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:45.696191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46782b12-5067-4ac6-bcf8-d1951ab50950 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:45.950094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:46.180019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ce88d18-39cd-428a-927f-f987dd2fcd09 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:46.180664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9ce88d18-39cd-428a-927f-f987dd2fcd09 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:46.185008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:46.187322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:46.210538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-46782b12-5067-4ac6-bcf8-d1951ab50950 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:46.227134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce88d18-39cd-428a-927f-f987dd2fcd09 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:46.230255 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-46782b12-5067-4ac6-bcf8-d1951ab50950 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1318 microversion: 2.1 time: 0.569870 Aug 27 04:48:46.231079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce88d18-39cd-428a-927f-f987dd2fcd09 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:46.234546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce88d18-39cd-428a-927f-f987dd2fcd09 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:46.251290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce88d18-39cd-428a-927f-f987dd2fcd09 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:46.254935 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1916/3868] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:45 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:46.262015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce88d18-39cd-428a-927f-f987dd2fcd09 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:46.267299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce88d18-39cd-428a-927f-f987dd2fcd09 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:47.231460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9ce88d18-39cd-428a-927f-f987dd2fcd09 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:47.246309 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ce88d18-39cd-428a-927f-f987dd2fcd09 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 1.072182 Aug 27 04:48:47.263118 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1953/3869] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:46 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:47.269876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9dd322af-6bec-4217-a80a-c4282756dc3d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:47.271554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9dd322af-6bec-4217-a80a-c4282756dc3d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:47.280459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dd322af-6bec-4217-a80a-c4282756dc3d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:47.281767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dd322af-6bec-4217-a80a-c4282756dc3d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:47.282552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dd322af-6bec-4217-a80a-c4282756dc3d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:47.283736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dd322af-6bec-4217-a80a-c4282756dc3d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:47.284477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dd322af-6bec-4217-a80a-c4282756dc3d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:47.285168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dd322af-6bec-4217-a80a-c4282756dc3d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:47.900224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32be51d7-a76b-4119-aec9-fb687f5ea1b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:47.902977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32be51d7-a76b-4119-aec9-fb687f5ea1b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:47.913899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32be51d7-a76b-4119-aec9-fb687f5ea1b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:47.916635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32be51d7-a76b-4119-aec9-fb687f5ea1b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:47.918356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32be51d7-a76b-4119-aec9-fb687f5ea1b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:47.919325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32be51d7-a76b-4119-aec9-fb687f5ea1b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:47.921533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32be51d7-a76b-4119-aec9-fb687f5ea1b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:47.922210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32be51d7-a76b-4119-aec9-fb687f5ea1b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:47.988007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-32be51d7-a76b-4119-aec9-fb687f5ea1b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lazy-loading 'flavor' on Instance uuid 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:48:48.164078 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32be51d7-a76b-4119-aec9-fb687f5ea1b5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b/action" status: 200 len: 32 microversion: 2.1 time: 0.267897 Aug 27 04:48:48.165055 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1954/3870] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:48:47 2022] POST /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b/action => generated 32 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:48:48.185903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e72d7976-0ef2-4e5e-94e3-989bb312cbc2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:48.186930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e72d7976-0ef2-4e5e-94e3-989bb312cbc2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:48.204271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9dd322af-6bec-4217-a80a-c4282756dc3d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:48.212977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e72d7976-0ef2-4e5e-94e3-989bb312cbc2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:48.213621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e72d7976-0ef2-4e5e-94e3-989bb312cbc2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:48.213959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e72d7976-0ef2-4e5e-94e3-989bb312cbc2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:48.217906 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9dd322af-6bec-4217-a80a-c4282756dc3d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1318 microversion: 2.1 time: 0.952990 Aug 27 04:48:48.218092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e72d7976-0ef2-4e5e-94e3-989bb312cbc2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:48.218433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e72d7976-0ef2-4e5e-94e3-989bb312cbc2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:48.218883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e72d7976-0ef2-4e5e-94e3-989bb312cbc2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:48.245737 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1917/3871] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:47 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1318 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:48.272675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9027b804-0228-44b3-a6d5-039c5b024a36 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:48.275131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9027b804-0228-44b3-a6d5-039c5b024a36 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:48.285355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9027b804-0228-44b3-a6d5-039c5b024a36 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:48.286116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9027b804-0228-44b3-a6d5-039c5b024a36 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:48.286836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9027b804-0228-44b3-a6d5-039c5b024a36 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:48.287735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9027b804-0228-44b3-a6d5-039c5b024a36 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:48.288384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9027b804-0228-44b3-a6d5-039c5b024a36 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:48.289003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9027b804-0228-44b3-a6d5-039c5b024a36 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:48.760464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9027b804-0228-44b3-a6d5-039c5b024a36 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:48.783238 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9027b804-0228-44b3-a6d5-039c5b024a36 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.512129 Aug 27 04:48:48.794432 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1918/3872] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:48 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:49.259074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-662e88a3-31fd-4b48-9d4e-dd4ac4d56b2e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:49.267725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e72d7976-0ef2-4e5e-94e3-989bb312cbc2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:49.271959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-662e88a3-31fd-4b48-9d4e-dd4ac4d56b2e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:49.291697 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e72d7976-0ef2-4e5e-94e3-989bb312cbc2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1522 microversion: 2.1 time: 1.112188 Aug 27 04:48:49.293236 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1955/3873] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:48 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1522 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:49.299424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-662e88a3-31fd-4b48-9d4e-dd4ac4d56b2e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:49.302686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-662e88a3-31fd-4b48-9d4e-dd4ac4d56b2e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:49.304026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-662e88a3-31fd-4b48-9d4e-dd4ac4d56b2e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:49.305761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-662e88a3-31fd-4b48-9d4e-dd4ac4d56b2e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:49.309041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-662e88a3-31fd-4b48-9d4e-dd4ac4d56b2e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:49.312783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-662e88a3-31fd-4b48-9d4e-dd4ac4d56b2e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:49.802037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-662e88a3-31fd-4b48-9d4e-dd4ac4d56b2e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:49.809067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e6f5928-91b5-4474-b3f2-e70d0aae8210 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:49.810027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e6f5928-91b5-4474-b3f2-e70d0aae8210 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:49.826847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e6f5928-91b5-4474-b3f2-e70d0aae8210 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:49.827765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e6f5928-91b5-4474-b3f2-e70d0aae8210 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:49.828432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e6f5928-91b5-4474-b3f2-e70d0aae8210 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:49.829943 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-662e88a3-31fd-4b48-9d4e-dd4ac4d56b2e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1318 microversion: 2.1 time: 0.578301 Aug 27 04:48:49.831541 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1919/3874] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:49 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1318 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:49.832634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e6f5928-91b5-4474-b3f2-e70d0aae8210 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:49.839787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e6f5928-91b5-4474-b3f2-e70d0aae8210 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:49.841337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e6f5928-91b5-4474-b3f2-e70d0aae8210 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:50.316086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-078401c9-bfde-44c0-848a-539713fd5d01 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:50.317442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-078401c9-bfde-44c0-848a-539713fd5d01 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:50.330094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-078401c9-bfde-44c0-848a-539713fd5d01 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:50.331746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-078401c9-bfde-44c0-848a-539713fd5d01 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:50.336427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-078401c9-bfde-44c0-848a-539713fd5d01 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:50.339965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-078401c9-bfde-44c0-848a-539713fd5d01 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:50.341471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-078401c9-bfde-44c0-848a-539713fd5d01 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:50.343049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-078401c9-bfde-44c0-848a-539713fd5d01 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:50.762984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7e6f5928-91b5-4474-b3f2-e70d0aae8210 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:50.781926 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e6f5928-91b5-4474-b3f2-e70d0aae8210 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.976303 Aug 27 04:48:50.783797 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1956/3875] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:49 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:50.859101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-095e993d-c80f-490c-a2fd-21102c97382f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:50.860035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-095e993d-c80f-490c-a2fd-21102c97382f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:50.871879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-095e993d-c80f-490c-a2fd-21102c97382f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:50.872410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-095e993d-c80f-490c-a2fd-21102c97382f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:50.874010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-095e993d-c80f-490c-a2fd-21102c97382f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:50.875233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-095e993d-c80f-490c-a2fd-21102c97382f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:50.877183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-095e993d-c80f-490c-a2fd-21102c97382f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:50.878440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-095e993d-c80f-490c-a2fd-21102c97382f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:51.528013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-095e993d-c80f-490c-a2fd-21102c97382f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:51.540347 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-095e993d-c80f-490c-a2fd-21102c97382f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1318 microversion: 2.1 time: 0.686678 Aug 27 04:48:51.559574 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1957/3876] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:50 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1318 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:51.659489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-078401c9-bfde-44c0-848a-539713fd5d01 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:51.683444 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-078401c9-bfde-44c0-848a-539713fd5d01 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1522 microversion: 2.1 time: 1.372775 Aug 27 04:48:51.684685 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1920/3877] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:50 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1522 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:51.804245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70d3b251-ba27-4943-a675-0a37eac6c933 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:51.805056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-70d3b251-ba27-4943-a675-0a37eac6c933 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:51.827538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70d3b251-ba27-4943-a675-0a37eac6c933 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:51.837686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70d3b251-ba27-4943-a675-0a37eac6c933 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:51.838383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70d3b251-ba27-4943-a675-0a37eac6c933 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:51.840955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70d3b251-ba27-4943-a675-0a37eac6c933 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:51.841818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70d3b251-ba27-4943-a675-0a37eac6c933 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:51.845053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70d3b251-ba27-4943-a675-0a37eac6c933 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:51.942512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:52.311980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-805fac1d-f712-4ef9-99a2-6df4078d8629 req-ae60aa6e-eb2e-466f-980d-45d48ade302d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af531663-20b2-4444-8be7-e134fe51de3d", "name": "network-vif-plugged", "status": "completed", "tag": "ad1b4bd9-7980-4bd8-9b9d-b4a3c908e439"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:52.332171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-805fac1d-f712-4ef9-99a2-6df4078d8629 req-ae60aa6e-eb2e-466f-980d-45d48ade302d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:52.334639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-805fac1d-f712-4ef9-99a2-6df4078d8629 req-ae60aa6e-eb2e-466f-980d-45d48ade302d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:52.337105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-805fac1d-f712-4ef9-99a2-6df4078d8629 req-ae60aa6e-eb2e-466f-980d-45d48ade302d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:52.375780 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-805fac1d-f712-4ef9-99a2-6df4078d8629 req-ae60aa6e-eb2e-466f-980d-45d48ade302d service nova] Creating event network-vif-plugged:ad1b4bd9-7980-4bd8-9b9d-b4a3c908e439 for instance af531663-20b2-4444-8be7-e134fe51de3d on n-h1-854823-1 Aug 27 04:48:52.390296 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-805fac1d-f712-4ef9-99a2-6df4078d8629 req-ae60aa6e-eb2e-466f-980d-45d48ade302d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081448 Aug 27 04:48:52.400307 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1921/3878] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:52.567609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1989ab70-898b-4341-ae3e-4f3885aab033 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:52.569369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1989ab70-898b-4341-ae3e-4f3885aab033 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:52.584812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1989ab70-898b-4341-ae3e-4f3885aab033 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:52.607657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1989ab70-898b-4341-ae3e-4f3885aab033 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:52.608842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-70d3b251-ba27-4943-a675-0a37eac6c933 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:52.611966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1989ab70-898b-4341-ae3e-4f3885aab033 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:52.617152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1989ab70-898b-4341-ae3e-4f3885aab033 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:52.617714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1989ab70-898b-4341-ae3e-4f3885aab033 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:52.620932 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-70d3b251-ba27-4943-a675-0a37eac6c933 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.821395 Aug 27 04:48:52.622118 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1958/3879] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:51 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:52.639078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1989ab70-898b-4341-ae3e-4f3885aab033 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:52.708411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9893fec-85c1-4491-821d-913e220557af tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:52.709082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e9893fec-85c1-4491-821d-913e220557af tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:52.729071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9893fec-85c1-4491-821d-913e220557af tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:52.729648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9893fec-85c1-4491-821d-913e220557af tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:52.732995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9893fec-85c1-4491-821d-913e220557af tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:52.735557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9893fec-85c1-4491-821d-913e220557af tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:52.736058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9893fec-85c1-4491-821d-913e220557af tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:52.736501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9893fec-85c1-4491-821d-913e220557af tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:53.062804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e9893fec-85c1-4491-821d-913e220557af tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:53.074249 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9893fec-85c1-4491-821d-913e220557af tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1522 microversion: 2.1 time: 0.370173 Aug 27 04:48:53.077312 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1959/3880] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:52 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:53.628523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1989ab70-898b-4341-ae3e-4f3885aab033 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:53.644010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4deff32d-415d-41dd-8ee3-510d28b11d4e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:53.645012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4deff32d-415d-41dd-8ee3-510d28b11d4e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:53.658830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4deff32d-415d-41dd-8ee3-510d28b11d4e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:53.659329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4deff32d-415d-41dd-8ee3-510d28b11d4e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:53.669294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4deff32d-415d-41dd-8ee3-510d28b11d4e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:53.670143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4deff32d-415d-41dd-8ee3-510d28b11d4e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:53.670630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4deff32d-415d-41dd-8ee3-510d28b11d4e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:53.671061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4deff32d-415d-41dd-8ee3-510d28b11d4e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:53.680055 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1989ab70-898b-4341-ae3e-4f3885aab033 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1318 microversion: 2.1 time: 1.117185 Aug 27 04:48:53.689992 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1922/3881] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:52 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1318 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:53.771504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-931768816", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "2629d86b-c78d-4059-9ebd-3f47198b6646"}, {"uuid": "7dbc60ea-9d4d-4fb3-acc8-46e2ea6ee4ae"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:53.980259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] validate_networks() for [('2629d86b-c78d-4059-9ebd-3f47198b6646', None, None, None, None, None), ('7dbc60ea-9d4d-4fb3-acc8-46e2ea6ee4ae', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:48:54.107385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4deff32d-415d-41dd-8ee3-510d28b11d4e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:54.134600 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4deff32d-415d-41dd-8ee3-510d28b11d4e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.492873 Aug 27 04:48:54.153458 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1960/3882] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:53 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:54.173671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1078392-d131-4c14-ac73-3e79e3f382ee tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:54.174470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1078392-d131-4c14-ac73-3e79e3f382ee tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:54.193838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1078392-d131-4c14-ac73-3e79e3f382ee tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:54.197922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1078392-d131-4c14-ac73-3e79e3f382ee tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:54.198921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1078392-d131-4c14-ac73-3e79e3f382ee tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:54.205479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1078392-d131-4c14-ac73-3e79e3f382ee tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:54.206468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1078392-d131-4c14-ac73-3e79e3f382ee tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:54.207643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1078392-d131-4c14-ac73-3e79e3f382ee tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:55.037671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1078392-d131-4c14-ac73-3e79e3f382ee tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:55.047220 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1078392-d131-4c14-ac73-3e79e3f382ee tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1522 microversion: 2.1 time: 0.892216 Aug 27 04:48:55.051033 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1961/3883] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:54 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1522 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:55.066450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f00be62-f4bb-47be-8b41-b972c32fa4f2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:55.067372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f00be62-f4bb-47be-8b41-b972c32fa4f2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:55.080159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f00be62-f4bb-47be-8b41-b972c32fa4f2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:55.080660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f00be62-f4bb-47be-8b41-b972c32fa4f2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:55.081104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f00be62-f4bb-47be-8b41-b972c32fa4f2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:55.081817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f00be62-f4bb-47be-8b41-b972c32fa4f2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:55.082279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f00be62-f4bb-47be-8b41-b972c32fa4f2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:55.082826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f00be62-f4bb-47be-8b41-b972c32fa4f2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:55.312480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:48:55.313691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:48:55.314405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:48:55.315041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:48:55.315671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:48:55.327541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:55.330130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:55.330695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:55.331577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:55.332332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:55.332916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:55.355053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Getting quotas for project 56803ee2fee048d09b8ec44ae76d1c9e. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:48:55.362128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Getting quotas for user 4dae41c63374401f81d297f03fd55d57 and project 56803ee2fee048d09b8ec44ae76d1c9e. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:48:55.368427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:55.383015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:48:55.387006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:48:55.447496 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-08c5e073-f88f-45c7-a75d-b6f4b8274f7a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.679624 Aug 27 04:48:55.449181 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1923/3884] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:48:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:48:55.463214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-289c140f-77af-41cc-9359-63a9a24d03a1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:55.464322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-289c140f-77af-41cc-9359-63a9a24d03a1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:55.473545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-289c140f-77af-41cc-9359-63a9a24d03a1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:55.474530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-289c140f-77af-41cc-9359-63a9a24d03a1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:55.475232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-289c140f-77af-41cc-9359-63a9a24d03a1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:55.476425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-289c140f-77af-41cc-9359-63a9a24d03a1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:55.477389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-289c140f-77af-41cc-9359-63a9a24d03a1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:55.478209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-289c140f-77af-41cc-9359-63a9a24d03a1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:55.746881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-289c140f-77af-41cc-9359-63a9a24d03a1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:55.762910 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-289c140f-77af-41cc-9359-63a9a24d03a1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.311332 Aug 27 04:48:55.766854 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1924/3885] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:55 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:55.784226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-55fc1b49-5c3b-4977-8fcd-f47edaefa2da tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:55.785870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-55fc1b49-5c3b-4977-8fcd-f47edaefa2da tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:55.890807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-55fc1b49-5c3b-4977-8fcd-f47edaefa2da tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:55.915854 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-55fc1b49-5c3b-4977-8fcd-f47edaefa2da tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1212 microversion: 2.1 time: 0.147852 Aug 27 04:48:55.927496 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1925/3886] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:55 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1212 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:56.078832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-801c42fd-b35c-4098-8aaf-be06307f26e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:56.080002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-801c42fd-b35c-4098-8aaf-be06307f26e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:56.093218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-801c42fd-b35c-4098-8aaf-be06307f26e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:56.094420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-801c42fd-b35c-4098-8aaf-be06307f26e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:56.096090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-801c42fd-b35c-4098-8aaf-be06307f26e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:56.100879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-801c42fd-b35c-4098-8aaf-be06307f26e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:56.103025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-801c42fd-b35c-4098-8aaf-be06307f26e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:56.103698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-801c42fd-b35c-4098-8aaf-be06307f26e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:56.231137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f00be62-f4bb-47be-8b41-b972c32fa4f2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:56.241481 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f00be62-f4bb-47be-8b41-b972c32fa4f2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1508 microversion: 2.1 time: 1.188009 Aug 27 04:48:56.263217 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1962/3887] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:55 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1508 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:56.272797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba7b420a-a566-48da-a88d-7dce3a97826e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:56.276746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba7b420a-a566-48da-a88d-7dce3a97826e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:56.292624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7b420a-a566-48da-a88d-7dce3a97826e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:56.293538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7b420a-a566-48da-a88d-7dce3a97826e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:56.294205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7b420a-a566-48da-a88d-7dce3a97826e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:56.298906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7b420a-a566-48da-a88d-7dce3a97826e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:56.299713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7b420a-a566-48da-a88d-7dce3a97826e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:56.300508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7b420a-a566-48da-a88d-7dce3a97826e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:56.505164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-801c42fd-b35c-4098-8aaf-be06307f26e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:56.521666 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-801c42fd-b35c-4098-8aaf-be06307f26e6 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1522 microversion: 2.1 time: 0.447752 Aug 27 04:48:56.524760 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1926/3888] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:56 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:56.787928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ac5cd87a-e544-4d2a-8538-5693e0050c7d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:56.788564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ac5cd87a-e544-4d2a-8538-5693e0050c7d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:56.798404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac5cd87a-e544-4d2a-8538-5693e0050c7d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:56.803941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac5cd87a-e544-4d2a-8538-5693e0050c7d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:56.804875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac5cd87a-e544-4d2a-8538-5693e0050c7d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:56.812628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac5cd87a-e544-4d2a-8538-5693e0050c7d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:56.815038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac5cd87a-e544-4d2a-8538-5693e0050c7d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:56.816048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac5cd87a-e544-4d2a-8538-5693e0050c7d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:56.844651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba7b420a-a566-48da-a88d-7dce3a97826e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:56.859176 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba7b420a-a566-48da-a88d-7dce3a97826e tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1508 microversion: 2.1 time: 0.590575 Aug 27 04:48:56.859782 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1963/3889] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:56 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1508 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:56.884075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69871859-13c1-4d8d-b402-6b152cd9160d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:56.895955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69871859-13c1-4d8d-b402-6b152cd9160d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:56.922611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69871859-13c1-4d8d-b402-6b152cd9160d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:56.923118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69871859-13c1-4d8d-b402-6b152cd9160d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:56.923557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69871859-13c1-4d8d-b402-6b152cd9160d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:56.924271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69871859-13c1-4d8d-b402-6b152cd9160d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:56.924765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69871859-13c1-4d8d-b402-6b152cd9160d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:56.929609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69871859-13c1-4d8d-b402-6b152cd9160d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:57.156568 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69871859-13c1-4d8d-b402-6b152cd9160d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "PUT /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1080 microversion: 2.1 time: 0.277333 Aug 27 04:48:57.162443 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1964/3890] 10.222.0.79 () {60 vars in 1256 bytes} [Sat Aug 27 04:48:56 2022] PUT /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1080 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:57.178277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4668fd02-edf8-4303-b027-7a12cf85adfd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:57.178578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4668fd02-edf8-4303-b027-7a12cf85adfd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:57.195715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4668fd02-edf8-4303-b027-7a12cf85adfd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:57.196226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4668fd02-edf8-4303-b027-7a12cf85adfd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:57.196722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4668fd02-edf8-4303-b027-7a12cf85adfd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:57.197409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4668fd02-edf8-4303-b027-7a12cf85adfd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:57.209508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4668fd02-edf8-4303-b027-7a12cf85adfd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:57.210265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4668fd02-edf8-4303-b027-7a12cf85adfd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:57.268082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac5cd87a-e544-4d2a-8538-5693e0050c7d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:57.299561 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ac5cd87a-e544-4d2a-8538-5693e0050c7d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.517609 Aug 27 04:48:57.300160 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1927/3891] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:56 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:57.317890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68b74d2b-06fc-4585-8394-46fae9215b25 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:57.324895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-68b74d2b-06fc-4585-8394-46fae9215b25 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:57.364181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68b74d2b-06fc-4585-8394-46fae9215b25 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:57.368046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68b74d2b-06fc-4585-8394-46fae9215b25 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:57.371096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68b74d2b-06fc-4585-8394-46fae9215b25 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:57.375520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68b74d2b-06fc-4585-8394-46fae9215b25 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:57.377876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68b74d2b-06fc-4585-8394-46fae9215b25 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:57.379790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68b74d2b-06fc-4585-8394-46fae9215b25 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:57.439106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4668fd02-edf8-4303-b027-7a12cf85adfd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:57.450467 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4668fd02-edf8-4303-b027-7a12cf85adfd tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1264 microversion: 2.1 time: 0.284657 Aug 27 04:48:57.457067 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1965/3892] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:57 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1264 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:57.553226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6e18a86-e03a-467d-bb1c-d92b4c808add tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:57.555164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e6e18a86-e03a-467d-bb1c-d92b4c808add tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:57.565922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6e18a86-e03a-467d-bb1c-d92b4c808add tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:57.571924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6e18a86-e03a-467d-bb1c-d92b4c808add tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:57.572700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6e18a86-e03a-467d-bb1c-d92b4c808add tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:57.573869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6e18a86-e03a-467d-bb1c-d92b4c808add tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:57.574514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6e18a86-e03a-467d-bb1c-d92b4c808add tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:57.575110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6e18a86-e03a-467d-bb1c-d92b4c808add tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:57.898506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-68b74d2b-06fc-4585-8394-46fae9215b25 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:57.911690 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-68b74d2b-06fc-4585-8394-46fae9215b25 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1506 microversion: 2.1 time: 0.608289 Aug 27 04:48:57.912934 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1928/3893] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:57 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1506 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:57.933396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0554741f-76a3-42a2-a50f-fc8f54a76ab2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:57.934717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0554741f-76a3-42a2-a50f-fc8f54a76ab2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:57.950782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0554741f-76a3-42a2-a50f-fc8f54a76ab2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:57.954908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0554741f-76a3-42a2-a50f-fc8f54a76ab2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:57.958840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0554741f-76a3-42a2-a50f-fc8f54a76ab2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:57.959889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0554741f-76a3-42a2-a50f-fc8f54a76ab2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:57.960737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0554741f-76a3-42a2-a50f-fc8f54a76ab2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:57.965103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0554741f-76a3-42a2-a50f-fc8f54a76ab2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:57.972713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:58.412746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0554741f-76a3-42a2-a50f-fc8f54a76ab2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:58.433014 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0554741f-76a3-42a2-a50f-fc8f54a76ab2 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1506 microversion: 2.1 time: 0.503304 Aug 27 04:48:58.450911 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1929/3894] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:57 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:58.460704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5143429f-85db-4dc0-a3f2-a3359a1327bb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:58.469290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5143429f-85db-4dc0-a3f2-a3359a1327bb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:58.481029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5143429f-85db-4dc0-a3f2-a3359a1327bb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:58.482015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5143429f-85db-4dc0-a3f2-a3359a1327bb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:58.483330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5143429f-85db-4dc0-a3f2-a3359a1327bb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:58.484327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5143429f-85db-4dc0-a3f2-a3359a1327bb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:58.484931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5143429f-85db-4dc0-a3f2-a3359a1327bb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:58.485520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5143429f-85db-4dc0-a3f2-a3359a1327bb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:58.645264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e6e18a86-e03a-467d-bb1c-d92b4c808add tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:58.677056 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6e18a86-e03a-467d-bb1c-d92b4c808add tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1522 microversion: 2.1 time: 1.118365 Aug 27 04:48:58.679942 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1966/3895] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:57 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1522 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:48:58.696842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ecaa385d-ee48-49ca-b653-3b62c8081086 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:58.702030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ecaa385d-ee48-49ca-b653-3b62c8081086 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:58.714957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecaa385d-ee48-49ca-b653-3b62c8081086 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:58.715828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecaa385d-ee48-49ca-b653-3b62c8081086 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:58.716558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecaa385d-ee48-49ca-b653-3b62c8081086 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:58.717912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecaa385d-ee48-49ca-b653-3b62c8081086 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:58.719101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecaa385d-ee48-49ca-b653-3b62c8081086 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:58.719778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecaa385d-ee48-49ca-b653-3b62c8081086 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:58.880903 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ecaa385d-ee48-49ca-b653-3b62c8081086 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "PUT /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1082 microversion: 2.1 time: 0.198859 Aug 27 04:48:58.893010 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1967/3896] 10.222.0.79 () {60 vars in 1256 bytes} [Sat Aug 27 04:48:58 2022] PUT /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1082 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:58.893010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-591d09da-100d-47a5-9cf0-18e060839946 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:58.893010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-591d09da-100d-47a5-9cf0-18e060839946 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:58.904228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-591d09da-100d-47a5-9cf0-18e060839946 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:58.904797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-591d09da-100d-47a5-9cf0-18e060839946 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:58.905235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-591d09da-100d-47a5-9cf0-18e060839946 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:58.905945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-591d09da-100d-47a5-9cf0-18e060839946 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:58.906449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-591d09da-100d-47a5-9cf0-18e060839946 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:58.906829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-591d09da-100d-47a5-9cf0-18e060839946 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:59.045844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-591d09da-100d-47a5-9cf0-18e060839946 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:59.062346 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-591d09da-100d-47a5-9cf0-18e060839946 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1270 microversion: 2.1 time: 0.176068 Aug 27 04:48:59.063929 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1968/3897] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:58 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:59.082891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-697626ca-1a19-4be3-bf4f-e003562ef9c9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:59.086631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-697626ca-1a19-4be3-bf4f-e003562ef9c9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:59.106042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-697626ca-1a19-4be3-bf4f-e003562ef9c9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:59.108345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-697626ca-1a19-4be3-bf4f-e003562ef9c9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:59.108982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-697626ca-1a19-4be3-bf4f-e003562ef9c9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:59.111997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-697626ca-1a19-4be3-bf4f-e003562ef9c9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:59.127556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-697626ca-1a19-4be3-bf4f-e003562ef9c9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:59.131188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-697626ca-1a19-4be3-bf4f-e003562ef9c9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:59.181568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5143429f-85db-4dc0-a3f2-a3359a1327bb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:59.198822 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5143429f-85db-4dc0-a3f2-a3359a1327bb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.744296 Aug 27 04:48:59.200562 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1930/3898] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:58 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:59.705272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d89fc864-1677-4632-8850-95b7d0a10e2d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:59.706094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d89fc864-1677-4632-8850-95b7d0a10e2d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:48:59.713501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d89fc864-1677-4632-8850-95b7d0a10e2d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:59.714213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d89fc864-1677-4632-8850-95b7d0a10e2d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:59.714809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d89fc864-1677-4632-8850-95b7d0a10e2d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:59.715676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d89fc864-1677-4632-8850-95b7d0a10e2d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:48:59.716280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d89fc864-1677-4632-8850-95b7d0a10e2d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:48:59.716970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d89fc864-1677-4632-8850-95b7d0a10e2d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:48:59.947159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d89fc864-1677-4632-8850-95b7d0a10e2d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:59.957384 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d89fc864-1677-4632-8850-95b7d0a10e2d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1522 microversion: 2.1 time: 0.255655 Aug 27 04:48:59.976406 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1931/3899] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:59 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:00.061565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-697626ca-1a19-4be3-bf4f-e003562ef9c9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:00.090285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b20a7935-00c6-4076-afe2-3da3c7e46f89 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:00.091142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b20a7935-00c6-4076-afe2-3da3c7e46f89 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:00.120476 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-697626ca-1a19-4be3-bf4f-e003562ef9c9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1508 microversion: 2.1 time: 1.054217 Aug 27 04:49:00.122718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b20a7935-00c6-4076-afe2-3da3c7e46f89 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:00.129577 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1969/3900] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:48:59 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1508 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:00.131209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b20a7935-00c6-4076-afe2-3da3c7e46f89 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:00.132833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b20a7935-00c6-4076-afe2-3da3c7e46f89 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:00.138442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b20a7935-00c6-4076-afe2-3da3c7e46f89 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:00.143120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b20a7935-00c6-4076-afe2-3da3c7e46f89 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:00.152304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b20a7935-00c6-4076-afe2-3da3c7e46f89 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:00.157776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55fe104e-a6f1-4203-aae8-62ba4bb52008 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:00.167955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55fe104e-a6f1-4203-aae8-62ba4bb52008 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:00.198406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55fe104e-a6f1-4203-aae8-62ba4bb52008 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:00.202768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55fe104e-a6f1-4203-aae8-62ba4bb52008 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:00.206028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55fe104e-a6f1-4203-aae8-62ba4bb52008 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:00.210319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55fe104e-a6f1-4203-aae8-62ba4bb52008 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:00.211684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55fe104e-a6f1-4203-aae8-62ba4bb52008 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:00.212345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55fe104e-a6f1-4203-aae8-62ba4bb52008 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:00.593622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b20a7935-00c6-4076-afe2-3da3c7e46f89 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:00.628346 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b20a7935-00c6-4076-afe2-3da3c7e46f89 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1312 microversion: 2.1 time: 0.542298 Aug 27 04:49:00.631448 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1932/3901] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:00 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1312 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:00.636858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-49b17ee7-1c1e-4baa-afb8-1ed6842cbb10 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:00.637479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-49b17ee7-1c1e-4baa-afb8-1ed6842cbb10 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:00.645518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49b17ee7-1c1e-4baa-afb8-1ed6842cbb10 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:00.646024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49b17ee7-1c1e-4baa-afb8-1ed6842cbb10 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:00.646466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49b17ee7-1c1e-4baa-afb8-1ed6842cbb10 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:00.649774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49b17ee7-1c1e-4baa-afb8-1ed6842cbb10 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:00.650986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49b17ee7-1c1e-4baa-afb8-1ed6842cbb10 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:00.651599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49b17ee7-1c1e-4baa-afb8-1ed6842cbb10 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:00.813022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-55fe104e-a6f1-4203-aae8-62ba4bb52008 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:00.828489 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55fe104e-a6f1-4203-aae8-62ba4bb52008 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1508 microversion: 2.1 time: 0.681872 Aug 27 04:49:00.832172 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1970/3902] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:00 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1508 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:00.852309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96546716-1420-41b2-bbe4-cf67db94dfa1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:00.852988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-96546716-1420-41b2-bbe4-cf67db94dfa1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:00.860004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96546716-1420-41b2-bbe4-cf67db94dfa1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:00.860997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96546716-1420-41b2-bbe4-cf67db94dfa1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:00.860997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96546716-1420-41b2-bbe4-cf67db94dfa1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:00.861566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96546716-1420-41b2-bbe4-cf67db94dfa1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:00.862020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96546716-1420-41b2-bbe4-cf67db94dfa1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:00.862910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96546716-1420-41b2-bbe4-cf67db94dfa1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:00.896149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-96546716-1420-41b2-bbe4-cf67db94dfa1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:49:00.965446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-49b17ee7-1c1e-4baa-afb8-1ed6842cbb10 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:00.974668 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-49b17ee7-1c1e-4baa-afb8-1ed6842cbb10 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1505 microversion: 2.1 time: 0.342095 Aug 27 04:49:00.976427 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1933/3903] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:00 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:00.984110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b09e108c-2e81-4a93-8fc2-f2c4e3a75da3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:00.984993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b09e108c-2e81-4a93-8fc2-f2c4e3a75da3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:00.992908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b09e108c-2e81-4a93-8fc2-f2c4e3a75da3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:00.993559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b09e108c-2e81-4a93-8fc2-f2c4e3a75da3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:00.994216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b09e108c-2e81-4a93-8fc2-f2c4e3a75da3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:00.995224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b09e108c-2e81-4a93-8fc2-f2c4e3a75da3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:00.995886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b09e108c-2e81-4a93-8fc2-f2c4e3a75da3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:00.996559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b09e108c-2e81-4a93-8fc2-f2c4e3a75da3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:01.048805 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96546716-1420-41b2-bbe4-cf67db94dfa1 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "DELETE /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 204 len: 0 microversion: 2.1 time: 0.200175 Aug 27 04:49:01.049596 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1971/3904] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:49:00 2022] DELETE /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:49:01.061336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac5ff4e7-b1e0-4b25-a4c1-096373a41372 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:01.067667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac5ff4e7-b1e0-4b25-a4c1-096373a41372 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:01.095549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac5ff4e7-b1e0-4b25-a4c1-096373a41372 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:01.096194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac5ff4e7-b1e0-4b25-a4c1-096373a41372 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:01.096782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac5ff4e7-b1e0-4b25-a4c1-096373a41372 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:01.097598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac5ff4e7-b1e0-4b25-a4c1-096373a41372 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:01.099456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac5ff4e7-b1e0-4b25-a4c1-096373a41372 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:01.100862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac5ff4e7-b1e0-4b25-a4c1-096373a41372 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:01.113564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:01.209732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac5ff4e7-b1e0-4b25-a4c1-096373a41372 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:49:01.315998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b09e108c-2e81-4a93-8fc2-f2c4e3a75da3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:01.353039 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b09e108c-2e81-4a93-8fc2-f2c4e3a75da3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1522 microversion: 2.1 time: 0.371468 Aug 27 04:49:01.355888 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1934/3905] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:00 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:01.370552 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.compute.api [None req-ac5ff4e7-b1e0-4b25-a4c1-096373a41372 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Instance is already in deleting state, ignoring this request Aug 27 04:49:01.378528 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac5ff4e7-b1e0-4b25-a4c1-096373a41372 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "DELETE /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 204 len: 0 microversion: 2.1 time: 0.318568 Aug 27 04:49:01.380696 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1972/3906] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:49:01 2022] DELETE /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:49:01.390800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d871914f-626b-4087-aea3-fff006dd8391 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:01.391431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d871914f-626b-4087-aea3-fff006dd8391 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:01.413523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d871914f-626b-4087-aea3-fff006dd8391 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:01.414264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d871914f-626b-4087-aea3-fff006dd8391 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:01.414895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d871914f-626b-4087-aea3-fff006dd8391 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:01.416353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d871914f-626b-4087-aea3-fff006dd8391 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:01.417018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d871914f-626b-4087-aea3-fff006dd8391 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:01.417580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d871914f-626b-4087-aea3-fff006dd8391 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:01.657184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50915ee1-1396-4ae4-baa0-7a44e6382524 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:01.659488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50915ee1-1396-4ae4-baa0-7a44e6382524 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:01.683490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50915ee1-1396-4ae4-baa0-7a44e6382524 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:01.684334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50915ee1-1396-4ae4-baa0-7a44e6382524 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:01.687704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50915ee1-1396-4ae4-baa0-7a44e6382524 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:01.691363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50915ee1-1396-4ae4-baa0-7a44e6382524 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:01.693634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50915ee1-1396-4ae4-baa0-7a44e6382524 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:01.695563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50915ee1-1396-4ae4-baa0-7a44e6382524 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:01.715788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d871914f-626b-4087-aea3-fff006dd8391 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:01.746782 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d871914f-626b-4087-aea3-fff006dd8391 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1514 microversion: 2.1 time: 0.358589 Aug 27 04:49:01.748071 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1935/3907] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:01 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1514 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:02.001891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-192943ea-59e9-4e7c-b69c-60676918cd93 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:02.002702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-192943ea-59e9-4e7c-b69c-60676918cd93 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:02.019302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-192943ea-59e9-4e7c-b69c-60676918cd93 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:02.020145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-192943ea-59e9-4e7c-b69c-60676918cd93 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:02.025403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-192943ea-59e9-4e7c-b69c-60676918cd93 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:02.026377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-192943ea-59e9-4e7c-b69c-60676918cd93 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:02.027446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-192943ea-59e9-4e7c-b69c-60676918cd93 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:02.036877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-192943ea-59e9-4e7c-b69c-60676918cd93 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:02.181321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50915ee1-1396-4ae4-baa0-7a44e6382524 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:02.192579 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50915ee1-1396-4ae4-baa0-7a44e6382524 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1312 microversion: 2.1 time: 0.546675 Aug 27 04:49:02.204551 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1973/3908] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:01 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1312 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:02.380902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42b32add-4ec0-41f0-ab65-464edff07d12 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:02.382186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-42b32add-4ec0-41f0-ab65-464edff07d12 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:02.392228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b32add-4ec0-41f0-ab65-464edff07d12 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:02.394177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b32add-4ec0-41f0-ab65-464edff07d12 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:02.396494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b32add-4ec0-41f0-ab65-464edff07d12 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:02.397523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b32add-4ec0-41f0-ab65-464edff07d12 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:02.400750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b32add-4ec0-41f0-ab65-464edff07d12 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:02.401428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b32add-4ec0-41f0-ab65-464edff07d12 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:02.424751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-192943ea-59e9-4e7c-b69c-60676918cd93 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:02.436325 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-192943ea-59e9-4e7c-b69c-60676918cd93 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1485 microversion: 2.1 time: 0.439656 Aug 27 04:49:02.438203 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1936/3909] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:01 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1485 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:02.696020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-507924564", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:02.816515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] validate_networks() for [('a5ef70fe-ea4b-40c8-a687-276e93bfa08f', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:49:03.541827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-42b32add-4ec0-41f0-ab65-464edff07d12 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:03.554421 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42b32add-4ec0-41f0-ab65-464edff07d12 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1522 microversion: 2.1 time: 1.177722 Aug 27 04:49:03.556337 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1974/3910] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:02 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1522 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:03.605354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b52869a6-0609-4f9e-809b-0b76fa4a75db tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:03.606606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b52869a6-0609-4f9e-809b-0b76fa4a75db tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:03.617987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:49:03.618836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:49:03.619538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:49:03.620149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:49:03.620907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:49:03.634363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:03.635247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:03.635895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:03.636851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:03.637529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:03.638148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:03.644930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b52869a6-0609-4f9e-809b-0b76fa4a75db tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:03.645550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b52869a6-0609-4f9e-809b-0b76fa4a75db tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:03.646211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b52869a6-0609-4f9e-809b-0b76fa4a75db tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:03.646963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b52869a6-0609-4f9e-809b-0b76fa4a75db tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:03.647431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b52869a6-0609-4f9e-809b-0b76fa4a75db tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:03.647867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b52869a6-0609-4f9e-809b-0b76fa4a75db tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:03.676012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Getting quotas for project ff524508e53d4e69bc37ffb928486e1c. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:49:03.684173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Getting quotas for user 902983c84d2f4c60a469ae3be1795646 and project ff524508e53d4e69bc37ffb928486e1c. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:49:03.745267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:49:03.755316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:49:03.867553 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0eabbebe-b808-4a38-a600-267ecf89c0ea tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.181981 Aug 27 04:49:03.868304 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1937/3911] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:49:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:49:03.903519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-09637938-c053-4757-85bb-e473e47b0149 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:03.904972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-09637938-c053-4757-85bb-e473e47b0149 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:03.928403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09637938-c053-4757-85bb-e473e47b0149 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:03.928941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09637938-c053-4757-85bb-e473e47b0149 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:03.929931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09637938-c053-4757-85bb-e473e47b0149 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:03.932928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09637938-c053-4757-85bb-e473e47b0149 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:03.934851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09637938-c053-4757-85bb-e473e47b0149 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:03.937971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09637938-c053-4757-85bb-e473e47b0149 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:04.197206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-09637938-c053-4757-85bb-e473e47b0149 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:04.208224 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-09637938-c053-4757-85bb-e473e47b0149 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1333 microversion: 2.1 time: 0.325823 Aug 27 04:49:04.209901 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1938/3912] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:03 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1333 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:04.227353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-285af0f6-dd33-40f1-986d-063fd8441e03 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:04.227966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-285af0f6-dd33-40f1-986d-063fd8441e03 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:04.426903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-285af0f6-dd33-40f1-986d-063fd8441e03 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:04.434379 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-285af0f6-dd33-40f1-986d-063fd8441e03 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1213 microversion: 2.1 time: 0.223031 Aug 27 04:49:04.435210 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1939/3913] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:04 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1213 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:04.440503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a9e1d79a-7e1d-49d6-b921-136fb5195e11 tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] Calling method '.version_select at 0x7f1f215640d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:04.508728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b52869a6-0609-4f9e-809b-0b76fa4a75db tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:04.510898 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a9e1d79a-7e1d-49d6-b921-136fb5195e11 tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/0bb24bfc-a702-4540-8263-b069c13e80ad" status: 200 len: 351 microversion: 2.1 time: 0.074389 Aug 27 04:49:04.511824 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1940/3914] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 04:49:04 2022] GET /compute/v2.1/os-volumes/0bb24bfc-a702-4540-8263-b069c13e80ad => generated 351 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:04.525377 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b52869a6-0609-4f9e-809b-0b76fa4a75db tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1514 microversion: 2.1 time: 0.967446 Aug 27 04:49:04.528004 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1975/3915] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:03 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1514 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:04.579121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-436ad914-2d84-4e42-959b-65adbf8d54e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:04.579744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-436ad914-2d84-4e42-959b-65adbf8d54e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:04.596188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-436ad914-2d84-4e42-959b-65adbf8d54e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:04.600045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-436ad914-2d84-4e42-959b-65adbf8d54e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:04.600224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-436ad914-2d84-4e42-959b-65adbf8d54e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:04.601015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-436ad914-2d84-4e42-959b-65adbf8d54e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:04.601487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-436ad914-2d84-4e42-959b-65adbf8d54e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:04.610009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-436ad914-2d84-4e42-959b-65adbf8d54e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:05.191851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-436ad914-2d84-4e42-959b-65adbf8d54e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:05.204487 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-436ad914-2d84-4e42-959b-65adbf8d54e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1522 microversion: 2.1 time: 0.627043 Aug 27 04:49:05.219372 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1941/3916] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:04 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1522 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:05.254979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59b1e0e7-e5ef-4ec2-b0f3-bb345f314771 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:05.258243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59b1e0e7-e5ef-4ec2-b0f3-bb345f314771 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:05.331616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59b1e0e7-e5ef-4ec2-b0f3-bb345f314771 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:05.342447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59b1e0e7-e5ef-4ec2-b0f3-bb345f314771 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:05.344302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59b1e0e7-e5ef-4ec2-b0f3-bb345f314771 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:05.353241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59b1e0e7-e5ef-4ec2-b0f3-bb345f314771 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:05.356850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59b1e0e7-e5ef-4ec2-b0f3-bb345f314771 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:05.357387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59b1e0e7-e5ef-4ec2-b0f3-bb345f314771 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:05.457101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1e46fd20-fdb5-4325-91d1-c19733384837 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:05.458149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1e46fd20-fdb5-4325-91d1-c19733384837 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:05.473430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e46fd20-fdb5-4325-91d1-c19733384837 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:05.490400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e46fd20-fdb5-4325-91d1-c19733384837 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:05.497718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e46fd20-fdb5-4325-91d1-c19733384837 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:05.501598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e46fd20-fdb5-4325-91d1-c19733384837 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:05.502488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e46fd20-fdb5-4325-91d1-c19733384837 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:05.506964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e46fd20-fdb5-4325-91d1-c19733384837 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:05.715460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e46fd20-fdb5-4325-91d1-c19733384837 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:05.725860 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1e46fd20-fdb5-4325-91d1-c19733384837 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1217 microversion: 2.1 time: 0.273563 Aug 27 04:49:05.743078 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1942/3917] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:05 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1217 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:05.759743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-76589f37-c8af-4cc7-8646-9600b4e13e69 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:05.760909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-76589f37-c8af-4cc7-8646-9600b4e13e69 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:05.778880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76589f37-c8af-4cc7-8646-9600b4e13e69 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:05.780584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76589f37-c8af-4cc7-8646-9600b4e13e69 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:05.785419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76589f37-c8af-4cc7-8646-9600b4e13e69 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:05.786319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76589f37-c8af-4cc7-8646-9600b4e13e69 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:05.790803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76589f37-c8af-4cc7-8646-9600b4e13e69 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:05.791967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76589f37-c8af-4cc7-8646-9600b4e13e69 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:06.080153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-76589f37-c8af-4cc7-8646-9600b4e13e69 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:06.100892 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-76589f37-c8af-4cc7-8646-9600b4e13e69 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1472 microversion: 2.1 time: 0.355281 Aug 27 04:49:06.105525 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1943/3918] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:05 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1472 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:06.131604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-f5faf056-e9a7-4149-8e9f-298e0ee03ddf req-f8e7d5c7-8a60-4568-bc15-1bcd4d082e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43540a8b-08c3-4aef-99dc-28b6ecbddbc7", "tag": "62cd6a46-478e-49c0-9ba3-ef06c30a25ba"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:06.164235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f5faf056-e9a7-4149-8e9f-298e0ee03ddf req-f8e7d5c7-8a60-4568-bc15-1bcd4d082e3e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:06.165192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f5faf056-e9a7-4149-8e9f-298e0ee03ddf req-f8e7d5c7-8a60-4568-bc15-1bcd4d082e3e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:06.165813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f5faf056-e9a7-4149-8e9f-298e0ee03ddf req-f8e7d5c7-8a60-4568-bc15-1bcd4d082e3e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:06.200470 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f5faf056-e9a7-4149-8e9f-298e0ee03ddf req-f8e7d5c7-8a60-4568-bc15-1bcd4d082e3e service nova] Creating event network-changed:62cd6a46-478e-49c0-9ba3-ef06c30a25ba for instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 on n-h2-854823-1 Aug 27 04:49:06.213331 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-f5faf056-e9a7-4149-8e9f-298e0ee03ddf req-f8e7d5c7-8a60-4568-bc15-1bcd4d082e3e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105792 Aug 27 04:49:06.216458 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1944/3919] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:06.236402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ead20f20-2883-4ae9-844a-49a3a389d2d0 req-db820c25-f216-4f58-bd54-2c1db81e2f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af531663-20b2-4444-8be7-e134fe51de3d", "name": "network-vif-deleted", "tag": "ad1b4bd9-7980-4bd8-9b9d-b4a3c908e439"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:06.253416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ead20f20-2883-4ae9-844a-49a3a389d2d0 req-db820c25-f216-4f58-bd54-2c1db81e2f39 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:06.260793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ead20f20-2883-4ae9-844a-49a3a389d2d0 req-db820c25-f216-4f58-bd54-2c1db81e2f39 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:06.261767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ead20f20-2883-4ae9-844a-49a3a389d2d0 req-db820c25-f216-4f58-bd54-2c1db81e2f39 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:06.276375 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ead20f20-2883-4ae9-844a-49a3a389d2d0 req-db820c25-f216-4f58-bd54-2c1db81e2f39 service nova] Creating event network-vif-deleted:ad1b4bd9-7980-4bd8-9b9d-b4a3c908e439 for instance af531663-20b2-4444-8be7-e134fe51de3d on n-h1-854823-1 Aug 27 04:49:06.283231 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ead20f20-2883-4ae9-844a-49a3a389d2d0 req-db820c25-f216-4f58-bd54-2c1db81e2f39 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063918 Aug 27 04:49:06.289657 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1945/3920] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:06.297129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-017f2dfb-d78c-4cd6-b90c-ad366e8fce14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:06.298327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-017f2dfb-d78c-4cd6-b90c-ad366e8fce14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:06.307527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-017f2dfb-d78c-4cd6-b90c-ad366e8fce14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:06.308253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-017f2dfb-d78c-4cd6-b90c-ad366e8fce14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:06.309108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-017f2dfb-d78c-4cd6-b90c-ad366e8fce14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:06.311487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-017f2dfb-d78c-4cd6-b90c-ad366e8fce14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:06.312592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-017f2dfb-d78c-4cd6-b90c-ad366e8fce14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:06.313211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-017f2dfb-d78c-4cd6-b90c-ad366e8fce14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:06.396188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-59b1e0e7-e5ef-4ec2-b0f3-bb345f314771 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:06.453196 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59b1e0e7-e5ef-4ec2-b0f3-bb345f314771 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1333 microversion: 2.1 time: 1.218112 Aug 27 04:49:06.456314 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1976/3921] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:05 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1333 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:06.769801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5530995-08b6-44c1-b49d-3f1a7e7b4207 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:06.770702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5530995-08b6-44c1-b49d-3f1a7e7b4207 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:06.791658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5530995-08b6-44c1-b49d-3f1a7e7b4207 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:06.792674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5530995-08b6-44c1-b49d-3f1a7e7b4207 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:06.793301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5530995-08b6-44c1-b49d-3f1a7e7b4207 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:06.796943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5530995-08b6-44c1-b49d-3f1a7e7b4207 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:06.797625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5530995-08b6-44c1-b49d-3f1a7e7b4207 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:06.798158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5530995-08b6-44c1-b49d-3f1a7e7b4207 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:07.167488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-017f2dfb-d78c-4cd6-b90c-ad366e8fce14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:07.177624 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-017f2dfb-d78c-4cd6-b90c-ad366e8fce14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1522 microversion: 2.1 time: 0.885888 Aug 27 04:49:07.182113 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1946/3922] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:06 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1522 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:07.195084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-12ede822-b30c-47dd-b29b-cebcb6b12069 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:07.197864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-12ede822-b30c-47dd-b29b-cebcb6b12069 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:07.213912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12ede822-b30c-47dd-b29b-cebcb6b12069 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:07.215351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12ede822-b30c-47dd-b29b-cebcb6b12069 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:07.216029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12ede822-b30c-47dd-b29b-cebcb6b12069 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:07.217374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12ede822-b30c-47dd-b29b-cebcb6b12069 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:07.218027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12ede822-b30c-47dd-b29b-cebcb6b12069 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:07.218664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12ede822-b30c-47dd-b29b-cebcb6b12069 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:07.268668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12ede822-b30c-47dd-b29b-cebcb6b12069 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:07.269493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12ede822-b30c-47dd-b29b-cebcb6b12069 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:07.270150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12ede822-b30c-47dd-b29b-cebcb6b12069 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:07.270806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-12ede822-b30c-47dd-b29b-cebcb6b12069 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lazy-loading 'fault' on Instance uuid af531663-20b2-4444-8be7-e134fe51de3d {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:49:07.290309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f5530995-08b6-44c1-b49d-3f1a7e7b4207 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:07.300634 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5530995-08b6-44c1-b49d-3f1a7e7b4207 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1283 microversion: 2.1 time: 0.537259 Aug 27 04:49:07.301882 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1977/3923] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:06 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1283 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:07.394694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-12ede822-b30c-47dd-b29b-cebcb6b12069 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e5c6081bd441a4b105b405703b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35481e527d554cffb51339a61b5b25c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:07.407945 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-12ede822-b30c-47dd-b29b-cebcb6b12069 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 200 len: 1308 microversion: 2.1 time: 0.222577 Aug 27 04:49:07.408829 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1947/3924] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:07 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:07.481831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d528a599-ba2e-49fb-9476-8c31b1e9ebf1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:07.486828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d528a599-ba2e-49fb-9476-8c31b1e9ebf1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:07.528706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d528a599-ba2e-49fb-9476-8c31b1e9ebf1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:07.531592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d528a599-ba2e-49fb-9476-8c31b1e9ebf1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:07.536097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d528a599-ba2e-49fb-9476-8c31b1e9ebf1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:07.557334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d528a599-ba2e-49fb-9476-8c31b1e9ebf1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:07.563421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d528a599-ba2e-49fb-9476-8c31b1e9ebf1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:07.566244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d528a599-ba2e-49fb-9476-8c31b1e9ebf1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:07.630752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b7f221cd-524d-4fae-83ba-04a40a3112fb tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] Calling method '.version_select at 0x7f1f2123dee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:07.721909 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b7f221cd-524d-4fae-83ba-04a40a3112fb tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/ad9911e2-528b-4190-a210-1379fb6d9fad" status: 200 len: 351 microversion: 2.1 time: 0.096371 Aug 27 04:49:07.731976 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1948/3925] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 04:49:07 2022] GET /compute/v2.1/os-volumes/ad9911e2-528b-4190-a210-1379fb6d9fad => generated 351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:08.210911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68f1d6ac-a144-47ef-9bf0-150c80b6b72d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:08.211540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-68f1d6ac-a144-47ef-9bf0-150c80b6b72d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:08.230767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68f1d6ac-a144-47ef-9bf0-150c80b6b72d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:08.231413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68f1d6ac-a144-47ef-9bf0-150c80b6b72d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:08.241975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68f1d6ac-a144-47ef-9bf0-150c80b6b72d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:08.242865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68f1d6ac-a144-47ef-9bf0-150c80b6b72d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:08.243360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68f1d6ac-a144-47ef-9bf0-150c80b6b72d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:08.247189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68f1d6ac-a144-47ef-9bf0-150c80b6b72d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:08.412083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d528a599-ba2e-49fb-9476-8c31b1e9ebf1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:08.427432 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d528a599-ba2e-49fb-9476-8c31b1e9ebf1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1333 microversion: 2.1 time: 0.945695 Aug 27 04:49:08.432020 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1978/3926] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:07 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1333 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:08.451797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26da8364-01a5-4b74-8f2f-805b689d5562 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:08.452961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26da8364-01a5-4b74-8f2f-805b689d5562 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:08.468883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26da8364-01a5-4b74-8f2f-805b689d5562 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:08.470502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26da8364-01a5-4b74-8f2f-805b689d5562 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:08.472329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26da8364-01a5-4b74-8f2f-805b689d5562 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:08.475241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26da8364-01a5-4b74-8f2f-805b689d5562 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:08.476945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26da8364-01a5-4b74-8f2f-805b689d5562 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:08.477916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26da8364-01a5-4b74-8f2f-805b689d5562 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.023763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26da8364-01a5-4b74-8f2f-805b689d5562 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:09.036005 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26da8364-01a5-4b74-8f2f-805b689d5562 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1313 microversion: 2.1 time: 0.601457 Aug 27 04:49:09.036962 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1979/3927] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:08 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1313 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:09.053251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-484db45e-a8c5-4a3a-82bf-3a64f8d0ba0d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:09.054142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-484db45e-a8c5-4a3a-82bf-3a64f8d0ba0d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: af531663-20b2-4444-8be7-e134fe51de3d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:09.075382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484db45e-a8c5-4a3a-82bf-3a64f8d0ba0d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.081142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484db45e-a8c5-4a3a-82bf-3a64f8d0ba0d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.084624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484db45e-a8c5-4a3a-82bf-3a64f8d0ba0d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.086432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484db45e-a8c5-4a3a-82bf-3a64f8d0ba0d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.098481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484db45e-a8c5-4a3a-82bf-3a64f8d0ba0d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.100715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484db45e-a8c5-4a3a-82bf-3a64f8d0ba0d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.154525 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-484db45e-a8c5-4a3a-82bf-3a64f8d0ba0d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] HTTP exception thrown: Instance af531663-20b2-4444-8be7-e134fe51de3d could not be found. Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-484db45e-a8c5-4a3a-82bf-3a64f8d0ba0d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Request method failure captured: Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d HTTP/1.1 Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaGSOBSr4Ymrje9jGrhRqhs5xV_zpv7V4eDbRBesJFrqQsgq6hlMkjS4A5Z_qz8hdSxRW2AqbB7XQKGxizeVHFmwP0_qddUadVgCkg_xk6te1NXgZVbFuCVDR36hV5GhPjTzZq6EHIjTTAPoAKqZTpxY2WfMXvYjRm5NJjPkFRi2CaI Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 35481e527d554cffb51339a61b5b25c0 Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35481e527d554cffb51339a61b5b25c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 35481e527d554cffb51339a61b5b25c0 Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerDiskConfigTestJSON-343588965-project Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 12e5c6081bd441a4b105b405703b1325 Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerDiskConfigTestJSON-343588965-project Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance af531663-20b2-4444-8be7-e134fe51de3d could not be found. Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'af531663-20b2-4444-8be7-e134fe51de3d'} Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af531663-20b2-4444-8be7-e134fe51de3d could not be found. Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af531663-20b2-4444-8be7-e134fe51de3d could not be found. Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:09.156153 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.159661 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.159661 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:09.159661 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:09.159661 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:09.159661 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:09.159661 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af531663-20b2-4444-8be7-e134fe51de3d could not be found. Aug 27 04:49:09.159661 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.159661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-484db45e-a8c5-4a3a-82bf-3a64f8d0ba0d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Returning 404 to user: Instance af531663-20b2-4444-8be7-e134fe51de3d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:09.159661 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-484db45e-a8c5-4a3a-82bf-3a64f8d0ba0d tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d" status: 404 len: 111 microversion: 2.1 time: 0.119482 Aug 27 04:49:09.159661 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1980/3928] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:09 2022] GET /compute/v2.1/servers/af531663-20b2-4444-8be7-e134fe51de3d => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:09.174107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cfc61bd7-053e-4fe7-8eb5-29daea6a30a5 req-ff86b370-161e-46e2-b8f5-a340decc9580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43540a8b-08c3-4aef-99dc-28b6ecbddbc7", "tag": "16e04044-0803-4347-a58d-835ee0b2a554"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:09.190273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cfc61bd7-053e-4fe7-8eb5-29daea6a30a5 req-ff86b370-161e-46e2-b8f5-a340decc9580 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.190763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cfc61bd7-053e-4fe7-8eb5-29daea6a30a5 req-ff86b370-161e-46e2-b8f5-a340decc9580 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.191218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cfc61bd7-053e-4fe7-8eb5-29daea6a30a5 req-ff86b370-161e-46e2-b8f5-a340decc9580 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.212065 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cfc61bd7-053e-4fe7-8eb5-29daea6a30a5 req-ff86b370-161e-46e2-b8f5-a340decc9580 service nova] Creating event network-changed:16e04044-0803-4347-a58d-835ee0b2a554 for instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 on n-h2-854823-1 Aug 27 04:49:09.226373 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cfc61bd7-053e-4fe7-8eb5-29daea6a30a5 req-ff86b370-161e-46e2-b8f5-a340decc9580 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066991 Aug 27 04:49:09.226993 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1981/3929] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:09.242015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2d603cf-177a-4f66-b73e-c448b30645a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:09.242631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2d603cf-177a-4f66-b73e-c448b30645a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:09.253904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2d603cf-177a-4f66-b73e-c448b30645a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.254403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2d603cf-177a-4f66-b73e-c448b30645a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.254846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2d603cf-177a-4f66-b73e-c448b30645a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.270585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2d603cf-177a-4f66-b73e-c448b30645a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.271305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2d603cf-177a-4f66-b73e-c448b30645a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.271762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2d603cf-177a-4f66-b73e-c448b30645a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.296372 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c2d603cf-177a-4f66-b73e-c448b30645a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] HTTP exception thrown: Instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 could not be found. Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2d603cf-177a-4f66-b73e-c448b30645a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Request method failure captured: Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 HTTP/1.1 Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaGSOBSr4Ymrje9jGrhRqhs5xV_zpv7V4eDbRBesJFrqQsgq6hlMkjS4A5Z_qz8hdSxRW2AqbB7XQKGxizeVHFmwP0_qddUadVgCkg_xk6te1NXgZVbFuCVDR36hV5GhPjTzZq6EHIjTTAPoAKqZTpxY2WfMXvYjRm5NJjPkFRi2CaI Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 35481e527d554cffb51339a61b5b25c0 Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35481e527d554cffb51339a61b5b25c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 35481e527d554cffb51339a61b5b25c0 Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerDiskConfigTestJSON-343588965-project Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 12e5c6081bd441a4b105b405703b1325 Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerDiskConfigTestJSON-343588965-project Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 could not be found. Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '60af8f98-57c0-40d9-bbeb-76c6590b5ab8'} Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 could not be found. Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:49:09.298082 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:49:09.301926 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 could not be found. Aug 27 04:49:09.301926 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.301926 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:09.301926 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.301926 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.301926 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:09.301926 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:09.301926 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:09.301926 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:09.301926 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 could not be found. Aug 27 04:49:09.301926 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.303505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2d603cf-177a-4f66-b73e-c448b30645a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Returning 404 to user: Instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:09.304658 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2d603cf-177a-4f66-b73e-c448b30645a9 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "DELETE /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 404 len: 111 microversion: 2.1 time: 0.066852 Aug 27 04:49:09.316898 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1982/3930] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:49:09 2022] DELETE /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:09.324664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f89c59a-ec75-4cd2-80f8-6771f849b51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:09.325456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f89c59a-ec75-4cd2-80f8-6771f849b51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 60af8f98-57c0-40d9-bbeb-76c6590b5ab8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:09.336806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f89c59a-ec75-4cd2-80f8-6771f849b51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.337559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f89c59a-ec75-4cd2-80f8-6771f849b51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.338351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f89c59a-ec75-4cd2-80f8-6771f849b51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.339225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f89c59a-ec75-4cd2-80f8-6771f849b51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.339831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f89c59a-ec75-4cd2-80f8-6771f849b51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.354222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-68f1d6ac-a144-47ef-9bf0-150c80b6b72d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:09.359609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f89c59a-ec75-4cd2-80f8-6771f849b51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.364097 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-68f1d6ac-a144-47ef-9bf0-150c80b6b72d tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1502 microversion: 2.1 time: 1.159578 Aug 27 04:49:09.385020 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1949/3931] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:08 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1502 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:09.400379 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8f89c59a-ec75-4cd2-80f8-6771f849b51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] HTTP exception thrown: Instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 could not be found. Aug 27 04:49:09.400707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e70530a4-b3dd-4e9f-a677-5fa80c34f977 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab877900-ecec-421c-b7ca-c3cf400c5db1"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:09.403499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e70530a4-b3dd-4e9f-a677-5fa80c34f977 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f89c59a-ec75-4cd2-80f8-6771f849b51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Request method failure captured: Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 HTTP/1.1 Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaGSOBSr4Ymrje9jGrhRqhs5xV_zpv7V4eDbRBesJFrqQsgq6hlMkjS4A5Z_qz8hdSxRW2AqbB7XQKGxizeVHFmwP0_qddUadVgCkg_xk6te1NXgZVbFuCVDR36hV5GhPjTzZq6EHIjTTAPoAKqZTpxY2WfMXvYjRm5NJjPkFRi2CaI Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 35481e527d554cffb51339a61b5b25c0 Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35481e527d554cffb51339a61b5b25c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 35481e527d554cffb51339a61b5b25c0 Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerDiskConfigTestJSON-343588965-project Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 12e5c6081bd441a4b105b405703b1325 Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerDiskConfigTestJSON-343588965-project Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 could not be found. Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '60af8f98-57c0-40d9-bbeb-76c6590b5ab8'} Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 could not be found. Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 could not be found. Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:09.410514 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.414107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.414107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:09.414107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:09.414107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:09.414107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:09.414107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 could not be found. Aug 27 04:49:09.414107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.416589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e70530a4-b3dd-4e9f-a677-5fa80c34f977 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.417462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f89c59a-ec75-4cd2-80f8-6771f849b51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Returning 404 to user: Instance 60af8f98-57c0-40d9-bbeb-76c6590b5ab8 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:09.418168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e70530a4-b3dd-4e9f-a677-5fa80c34f977 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.419244 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f89c59a-ec75-4cd2-80f8-6771f849b51f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8" status: 404 len: 111 microversion: 2.1 time: 0.098671 Aug 27 04:49:09.420501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e70530a4-b3dd-4e9f-a677-5fa80c34f977 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.422402 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1983/3932] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:09 2022] GET /compute/v2.1/servers/60af8f98-57c0-40d9-bbeb-76c6590b5ab8 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:09.422882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e70530a4-b3dd-4e9f-a677-5fa80c34f977 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.423563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e70530a4-b3dd-4e9f-a677-5fa80c34f977 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.424351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e70530a4-b3dd-4e9f-a677-5fa80c34f977 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.433640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76efd511-bb46-4850-a20e-9f82769d6361 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:09.434147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76efd511-bb46-4850-a20e-9f82769d6361 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:09.455354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:09.456792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76efd511-bb46-4850-a20e-9f82769d6361 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.457291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76efd511-bb46-4850-a20e-9f82769d6361 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.457903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76efd511-bb46-4850-a20e-9f82769d6361 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.458870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76efd511-bb46-4850-a20e-9f82769d6361 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.460726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76efd511-bb46-4850-a20e-9f82769d6361 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.461473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76efd511-bb46-4850-a20e-9f82769d6361 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.484512 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-e70530a4-b3dd-4e9f-a677-5fa80c34f977 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] HTTP exception thrown: Cannot 'attach_volume' instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b while it is in vm_state rescued Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e70530a4-b3dd-4e9f-a677-5fa80c34f977 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Request method failure captured: Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b/os-volume_attachments HTTP/1.1 Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 74 Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaHoFwgV4INwTRL8hXoYwjmWlLrRc_QJzw9nkZAvRSAfT__IxsIMw8Suy-GjIzNFt5R-NLcBI-KbU0p7XTxgVryxRdpnu39d1-w87dFtSDYLg2-wm7KAO7Nu1eVLF-CaLCIJrg2b0bchRGMkFWgTVQ8wFhLKBmW9T3OHuZJNVIJBUXo Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 81b0ef617031436484e9e987f972ae0a Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: {"volumeAttachment": {"volumeId": "ab877900-ecec-421c-b7ca-c3cf400c5db1"}} Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: exception: Cannot 'attach_volume' instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b while it is in vm_state rescued Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'server_id': '7e9ed635-f034-40b0-8914-1e1b0ecdfa8b', 'body': {'volumeAttachment': {'volumeId': 'ab877900-ecec-421c-b7ca-c3cf400c5db1'}}} Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 27 04:49:09.486937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 04:49:09.490726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:49:09.490726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:49:09.490726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b while it is in vm_state rescued Aug 27 04:49:09.490726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.490726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:09.490726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.490726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.490726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:09.490726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:09.490726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:09.490726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:09.490726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b while it is in vm_state rescued Aug 27 04:49:09.490726 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.490726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e70530a4-b3dd-4e9f-a677-5fa80c34f977 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Returning 409 to user: Cannot 'attach_volume' instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b while it is in vm_state rescued {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:09.492296 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e70530a4-b3dd-4e9f-a677-5fa80c34f977 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.102902 Aug 27 04:49:09.496811 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1950/3933] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 04:49:09 2022] POST /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b/os-volume_attachments => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:49:09.502491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4608331d-e856-47cd-a0da-316770e8d1b1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:09.503771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4608331d-e856-47cd-a0da-316770e8d1b1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:09.504583 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-76efd511-bb46-4850-a20e-9f82769d6361 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] HTTP exception thrown: Instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 could not be found. Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76efd511-bb46-4850-a20e-9f82769d6361 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Request method failure captured: Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 HTTP/1.1 Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaGSOBSr4Ymrje9jGrhRqhs5xV_zpv7V4eDbRBesJFrqQsgq6hlMkjS4A5Z_qz8hdSxRW2AqbB7XQKGxizeVHFmwP0_qddUadVgCkg_xk6te1NXgZVbFuCVDR36hV5GhPjTzZq6EHIjTTAPoAKqZTpxY2WfMXvYjRm5NJjPkFRi2CaI Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 35481e527d554cffb51339a61b5b25c0 Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35481e527d554cffb51339a61b5b25c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 35481e527d554cffb51339a61b5b25c0 Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerDiskConfigTestJSON-343588965-project Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 12e5c6081bd441a4b105b405703b1325 Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerDiskConfigTestJSON-343588965-project Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 could not be found. Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '130e56b9-8431-4e83-a7b1-3bad46f54e33'} Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 could not be found. Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:49:09.509202 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:49:09.513124 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 could not be found. Aug 27 04:49:09.513124 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.513124 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:09.513124 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.513124 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.513124 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:09.513124 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:09.513124 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:09.513124 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:09.513124 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 could not be found. Aug 27 04:49:09.513124 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.515318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76efd511-bb46-4850-a20e-9f82769d6361 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Returning 404 to user: Instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:09.517836 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76efd511-bb46-4850-a20e-9f82769d6361 tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "DELETE /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 404 len: 111 microversion: 2.1 time: 0.091787 Aug 27 04:49:09.520437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4608331d-e856-47cd-a0da-316770e8d1b1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.520804 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1984/3934] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:49:09 2022] DELETE /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:09.521557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4608331d-e856-47cd-a0da-316770e8d1b1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.522360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4608331d-e856-47cd-a0da-316770e8d1b1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.523528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4608331d-e856-47cd-a0da-316770e8d1b1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.524183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4608331d-e856-47cd-a0da-316770e8d1b1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.524842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4608331d-e856-47cd-a0da-316770e8d1b1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.528846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ddd6c2c3-6987-48aa-925d-8e31e416c6be tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:09.531919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ddd6c2c3-6987-48aa-925d-8e31e416c6be tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:09.551688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddd6c2c3-6987-48aa-925d-8e31e416c6be tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.554376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddd6c2c3-6987-48aa-925d-8e31e416c6be tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.555133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddd6c2c3-6987-48aa-925d-8e31e416c6be tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.557980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddd6c2c3-6987-48aa-925d-8e31e416c6be tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.559778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddd6c2c3-6987-48aa-925d-8e31e416c6be tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.561029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddd6c2c3-6987-48aa-925d-8e31e416c6be tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.799746 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ddd6c2c3-6987-48aa-925d-8e31e416c6be tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b/action" status: 202 len: 0 microversion: 2.1 time: 0.277535 Aug 27 04:49:09.802729 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1985/3935] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:49:09 2022] POST /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:49:09.829196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b3c7ce2-d7f3-46d8-9791-b517b4368a6f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:09.830354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b3c7ce2-d7f3-46d8-9791-b517b4368a6f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] [instance: 130e56b9-8431-4e83-a7b1-3bad46f54e33] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:09.873188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b3c7ce2-d7f3-46d8-9791-b517b4368a6f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.873776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b3c7ce2-d7f3-46d8-9791-b517b4368a6f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.874000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4608331d-e856-47cd-a0da-316770e8d1b1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:09.874237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b3c7ce2-d7f3-46d8-9791-b517b4368a6f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.876450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b3c7ce2-d7f3-46d8-9791-b517b4368a6f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.876963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b3c7ce2-d7f3-46d8-9791-b517b4368a6f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.877424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b3c7ce2-d7f3-46d8-9791-b517b4368a6f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.888910 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4608331d-e856-47cd-a0da-316770e8d1b1 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1333 microversion: 2.1 time: 0.390476 Aug 27 04:49:09.889895 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1951/3936] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:09 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1333 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:09.896399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1b591549-a843-420e-90be-1ea4afd59a15 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:09.898524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1b591549-a843-420e-90be-1ea4afd59a15 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:09.911837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b591549-a843-420e-90be-1ea4afd59a15 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.911837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b591549-a843-420e-90be-1ea4afd59a15 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.911837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b591549-a843-420e-90be-1ea4afd59a15 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.914600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b591549-a843-420e-90be-1ea4afd59a15 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:09.916490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b591549-a843-420e-90be-1ea4afd59a15 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:09.917464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b591549-a843-420e-90be-1ea4afd59a15 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:09.939488 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8b3c7ce2-d7f3-46d8-9791-b517b4368a6f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] HTTP exception thrown: Instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 could not be found. Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b3c7ce2-d7f3-46d8-9791-b517b4368a6f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Request method failure captured: Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 HTTP/1.1 Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaGSOBSr4Ymrje9jGrhRqhs5xV_zpv7V4eDbRBesJFrqQsgq6hlMkjS4A5Z_qz8hdSxRW2AqbB7XQKGxizeVHFmwP0_qddUadVgCkg_xk6te1NXgZVbFuCVDR36hV5GhPjTzZq6EHIjTTAPoAKqZTpxY2WfMXvYjRm5NJjPkFRi2CaI Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 35481e527d554cffb51339a61b5b25c0 Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35481e527d554cffb51339a61b5b25c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35481e527d554cffb51339a61b5b25c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 35481e527d554cffb51339a61b5b25c0 Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-343588965 Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerDiskConfigTestJSON-343588965-project Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 12e5c6081bd441a4b105b405703b1325 Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerDiskConfigTestJSON-343588965-project Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 could not be found. Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '130e56b9-8431-4e83-a7b1-3bad46f54e33'} Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 could not be found. Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 could not be found. Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:09.941225 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.945237 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:09.945237 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:09.945237 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:09.945237 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:09.945237 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:09.945237 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 could not be found. Aug 27 04:49:09.945237 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:09.945237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b3c7ce2-d7f3-46d8-9791-b517b4368a6f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] Returning 404 to user: Instance 130e56b9-8431-4e83-a7b1-3bad46f54e33 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:09.945237 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b3c7ce2-d7f3-46d8-9791-b517b4368a6f tempest-ServerDiskConfigTestJSON-343588965 tempest-ServerDiskConfigTestJSON-343588965-project] 10.222.0.79 "GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33" status: 404 len: 111 microversion: 2.1 time: 0.135510 Aug 27 04:49:09.951716 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1986/3937] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:09 2022] GET /compute/v2.1/servers/130e56b9-8431-4e83-a7b1-3bad46f54e33 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:10.063136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a60ece3-f52f-4816-ab2f-8e4a6e899271 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:10.063764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a60ece3-f52f-4816-ab2f-8e4a6e899271 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:10.072269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a60ece3-f52f-4816-ab2f-8e4a6e899271 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:10.074951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a60ece3-f52f-4816-ab2f-8e4a6e899271 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:10.077180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a60ece3-f52f-4816-ab2f-8e4a6e899271 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:10.078516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a60ece3-f52f-4816-ab2f-8e4a6e899271 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:10.080130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a60ece3-f52f-4816-ab2f-8e4a6e899271 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:10.081732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a60ece3-f52f-4816-ab2f-8e4a6e899271 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:10.283416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1b591549-a843-420e-90be-1ea4afd59a15 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:10.297865 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1b591549-a843-420e-90be-1ea4afd59a15 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1510 microversion: 2.1 time: 0.406842 Aug 27 04:49:10.298454 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1952/3938] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:09 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1510 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:10.507236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1a60ece3-f52f-4816-ab2f-8e4a6e899271 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:10.522198 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a60ece3-f52f-4816-ab2f-8e4a6e899271 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1313 microversion: 2.1 time: 0.462455 Aug 27 04:49:10.539428 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1987/3939] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:10 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:10.734606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-72d3b7b9-b9c7-4a93-a5b5-941e5839e64a tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] Calling method '.version_select at 0x7f1f21107700>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:10.817598 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-72d3b7b9-b9c7-4a93-a5b5-941e5839e64a tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/e1aac524-3027-43d2-84aa-ed610b38110b" status: 200 len: 351 microversion: 2.1 time: 0.092969 Aug 27 04:49:10.829002 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1953/3940] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 04:49:10 2022] GET /compute/v2.1/os-volumes/e1aac524-3027-43d2-84aa-ed610b38110b => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:10.832958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a495bcd-11f0-4f77-8c35-33cd6da05a8d tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] Calling method '.version_select at 0x7f1f20ba3550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:10.911686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7cf153da-7c13-4b31-98fa-03751702c791 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:10.912520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7cf153da-7c13-4b31-98fa-03751702c791 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:10.938519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cf153da-7c13-4b31-98fa-03751702c791 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:10.939881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cf153da-7c13-4b31-98fa-03751702c791 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:10.940356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cf153da-7c13-4b31-98fa-03751702c791 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:10.945641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cf153da-7c13-4b31-98fa-03751702c791 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:10.946229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cf153da-7c13-4b31-98fa-03751702c791 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:10.947232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cf153da-7c13-4b31-98fa-03751702c791 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:11.080613 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a495bcd-11f0-4f77-8c35-33cd6da05a8d tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.252764 Aug 27 04:49:11.082014 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1988/3941] 10.222.0.79 () {58 vars in 1134 bytes} [Sat Aug 27 04:49:10 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:11.100733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6e403847-0676-4e5b-97a5-cf2037773aef tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] Calling method '.version_select at 0x7f1f20b4d550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:11.248062 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6e403847-0676-4e5b-97a5-cf2037773aef tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.152831 Aug 27 04:49:11.259107 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1989/3942] 10.222.0.79 () {58 vars in 1149 bytes} [Sat Aug 27 04:49:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:11.265550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-91245f39-9841-4198-ab6c-2557da1b079f tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] Calling method '.version_select at 0x7f1f20bb6e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:11.376897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7cf153da-7c13-4b31-98fa-03751702c791 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:11.393834 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7cf153da-7c13-4b31-98fa-03751702c791 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1333 microversion: 2.1 time: 0.486521 Aug 27 04:49:11.407673 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1954/3943] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:10 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1333 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:11.412692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-04cf831e-4160-4a32-9593-3a9a4981cad0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:11.413320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-04cf831e-4160-4a32-9593-3a9a4981cad0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:11.423904 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-91245f39-9841-4198-ab6c-2557da1b079f tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.163251 Aug 27 04:49:11.424589 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1990/3944] 10.222.0.79 () {58 vars in 1134 bytes} [Sat Aug 27 04:49:11 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:11.427342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-04cf831e-4160-4a32-9593-3a9a4981cad0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:11.427844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-04cf831e-4160-4a32-9593-3a9a4981cad0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:11.428476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-04cf831e-4160-4a32-9593-3a9a4981cad0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:11.433040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-04cf831e-4160-4a32-9593-3a9a4981cad0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:11.433703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-04cf831e-4160-4a32-9593-3a9a4981cad0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:11.434303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-04cf831e-4160-4a32-9593-3a9a4981cad0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:11.441047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20e8a415-fe8b-4dc7-a4f5-c970a7c1c49e tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] Calling method '.version_select at 0x7f1f20dcbdc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:11.566067 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20e8a415-fe8b-4dc7-a4f5-c970a7c1c49e tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.130123 Aug 27 04:49:11.566067 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1991/3945] 10.222.0.79 () {58 vars in 1167 bytes} [Sat Aug 27 04:49:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:11.573609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0da7352a-e326-4f9a-9e1f-cb4d69fcca3b req-6a2fc727-4248-4139-b95a-2a69fe8ffb93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c1d304-3585-4b2b-bde6-282014fb3245", "tag": "f649fe61-cad6-4f1d-835a-d614f680ab8f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:11.585756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0da7352a-e326-4f9a-9e1f-cb4d69fcca3b req-6a2fc727-4248-4139-b95a-2a69fe8ffb93 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:11.586609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0da7352a-e326-4f9a-9e1f-cb4d69fcca3b req-6a2fc727-4248-4139-b95a-2a69fe8ffb93 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:11.587398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0da7352a-e326-4f9a-9e1f-cb4d69fcca3b req-6a2fc727-4248-4139-b95a-2a69fe8ffb93 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:11.600940 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0da7352a-e326-4f9a-9e1f-cb4d69fcca3b req-6a2fc727-4248-4139-b95a-2a69fe8ffb93 service nova] Creating event network-changed:f649fe61-cad6-4f1d-835a-d614f680ab8f for instance f7c1d304-3585-4b2b-bde6-282014fb3245 on n-h2-854823-1 Aug 27 04:49:11.606819 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0da7352a-e326-4f9a-9e1f-cb4d69fcca3b req-6a2fc727-4248-4139-b95a-2a69fe8ffb93 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036947 Aug 27 04:49:11.608590 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1992/3946] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:11.614681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a22db25-c0c9-463a-b85f-91ce4261aaa2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:11.615544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a22db25-c0c9-463a-b85f-91ce4261aaa2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:11.636180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a22db25-c0c9-463a-b85f-91ce4261aaa2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:11.637869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a22db25-c0c9-463a-b85f-91ce4261aaa2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:11.639677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a22db25-c0c9-463a-b85f-91ce4261aaa2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:11.640667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a22db25-c0c9-463a-b85f-91ce4261aaa2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:11.641320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a22db25-c0c9-463a-b85f-91ce4261aaa2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:11.641969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a22db25-c0c9-463a-b85f-91ce4261aaa2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:11.820796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-04cf831e-4160-4a32-9593-3a9a4981cad0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:11.830016 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-04cf831e-4160-4a32-9593-3a9a4981cad0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1510 microversion: 2.1 time: 0.421035 Aug 27 04:49:11.837073 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1955/3947] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:11 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1510 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:11.842533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-400d3215-7899-4b0f-86d5-f135f68efc3f tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] Calling method '.version_select at 0x7f1f20f6d040>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:11.936839 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-400d3215-7899-4b0f-86d5-f135f68efc3f tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.098405 Aug 27 04:49:11.938196 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1956/3948] 10.222.0.79 () {58 vars in 1170 bytes} [Sat Aug 27 04:49:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:11.954768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3762f65d-0e71-480a-ad4e-adb98ed426dd tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] Calling method '.version_select at 0x7f1f20f599d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:11.956192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a22db25-c0c9-463a-b85f-91ce4261aaa2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:11.968309 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a22db25-c0c9-463a-b85f-91ce4261aaa2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1313 microversion: 2.1 time: 0.358142 Aug 27 04:49:11.981933 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1993/3949] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:11 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:12.097122 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3762f65d-0e71-480a-ad4e-adb98ed426dd tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.146953 Aug 27 04:49:12.098256 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1957/3950] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:49:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:12.112816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc648585-4a45-4357-84d4-616e5257a238 tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] Calling method '.version_select at 0x7f1f20beda60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:12.303330 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc648585-4a45-4357-84d4-616e5257a238 tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.194533 Aug 27 04:49:12.304048 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1994/3951] 10.222.0.79 () {58 vars in 1188 bytes} [Sat Aug 27 04:49:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:12.319254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b444eccc-67c7-44bd-a3c3-bd1828d2d98a tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] Calling method '.version_select at 0x7f1f224629d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:12.417950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3366d09f-aa52-4050-a868-84fb7d5878e6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:12.418829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3366d09f-aa52-4050-a868-84fb7d5878e6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:12.436041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:12.437871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3366d09f-aa52-4050-a868-84fb7d5878e6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:12.438524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3366d09f-aa52-4050-a868-84fb7d5878e6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:12.439089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3366d09f-aa52-4050-a868-84fb7d5878e6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:12.439952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3366d09f-aa52-4050-a868-84fb7d5878e6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:12.441055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3366d09f-aa52-4050-a868-84fb7d5878e6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:12.445276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3366d09f-aa52-4050-a868-84fb7d5878e6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:12.503697 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b444eccc-67c7-44bd-a3c3-bd1828d2d98a tempest-VolumesTestJSON-486199063 tempest-VolumesTestJSON-486199063-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.188175 Aug 27 04:49:12.504241 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1958/3952] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:49:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:12.862431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-16355002-cbe3-45f0-bd5e-2559ef1c851e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:12.864991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-16355002-cbe3-45f0-bd5e-2559ef1c851e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:12.902071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16355002-cbe3-45f0-bd5e-2559ef1c851e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:12.906060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16355002-cbe3-45f0-bd5e-2559ef1c851e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:12.907040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16355002-cbe3-45f0-bd5e-2559ef1c851e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:12.907801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16355002-cbe3-45f0-bd5e-2559ef1c851e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:12.908853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16355002-cbe3-45f0-bd5e-2559ef1c851e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:12.910882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16355002-cbe3-45f0-bd5e-2559ef1c851e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:13.356964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-16355002-cbe3-45f0-bd5e-2559ef1c851e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:13.369300 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-16355002-cbe3-45f0-bd5e-2559ef1c851e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1510 microversion: 2.1 time: 0.513134 Aug 27 04:49:13.381252 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1959/3953] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:12 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1510 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:13.396823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-66aa3ca1-8a56-4b70-a21a-d646e5200877 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:13.397842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-66aa3ca1-8a56-4b70-a21a-d646e5200877 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:13.427431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66aa3ca1-8a56-4b70-a21a-d646e5200877 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:13.428312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66aa3ca1-8a56-4b70-a21a-d646e5200877 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:13.429009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66aa3ca1-8a56-4b70-a21a-d646e5200877 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:13.429954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66aa3ca1-8a56-4b70-a21a-d646e5200877 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:13.430632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66aa3ca1-8a56-4b70-a21a-d646e5200877 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:13.431279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66aa3ca1-8a56-4b70-a21a-d646e5200877 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:13.485512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3366d09f-aa52-4050-a868-84fb7d5878e6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:13.517498 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3366d09f-aa52-4050-a868-84fb7d5878e6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1333 microversion: 2.1 time: 1.104146 Aug 27 04:49:13.518512 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1995/3954] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:12 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1333 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:13.659442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:13.795952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-66aa3ca1-8a56-4b70-a21a-d646e5200877 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:13.807390 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-66aa3ca1-8a56-4b70-a21a-d646e5200877 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1313 microversion: 2.1 time: 0.424367 Aug 27 04:49:13.808239 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1960/3955] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:13 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:14.406315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1a97e0a-22e3-4264-90c6-169e016996cd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:14.406955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e1a97e0a-22e3-4264-90c6-169e016996cd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:14.419245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1a97e0a-22e3-4264-90c6-169e016996cd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:14.420302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1a97e0a-22e3-4264-90c6-169e016996cd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:14.434956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1a97e0a-22e3-4264-90c6-169e016996cd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:14.440859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1a97e0a-22e3-4264-90c6-169e016996cd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:14.444178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1a97e0a-22e3-4264-90c6-169e016996cd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:14.454296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1a97e0a-22e3-4264-90c6-169e016996cd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:14.460288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:14.540083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ec80e8e8-2cd8-4491-9fb3-957d3200fd21 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:14.546230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ec80e8e8-2cd8-4491-9fb3-957d3200fd21 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:14.571981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=16 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:14.580361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec80e8e8-2cd8-4491-9fb3-957d3200fd21 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:14.583479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec80e8e8-2cd8-4491-9fb3-957d3200fd21 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:14.584667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec80e8e8-2cd8-4491-9fb3-957d3200fd21 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:14.585625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec80e8e8-2cd8-4491-9fb3-957d3200fd21 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:14.587534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec80e8e8-2cd8-4491-9fb3-957d3200fd21 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:14.588557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec80e8e8-2cd8-4491-9fb3-957d3200fd21 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:15.135236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e1a97e0a-22e3-4264-90c6-169e016996cd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:15.152603 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1a97e0a-22e3-4264-90c6-169e016996cd tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1510 microversion: 2.1 time: 0.743164 Aug 27 04:49:15.153172 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1996/3956] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:14 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1510 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:15.162008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f0af59b-d63c-4594-9a46-1337152130f2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:15.177910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6f0af59b-d63c-4594-9a46-1337152130f2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:15.204834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f0af59b-d63c-4594-9a46-1337152130f2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:15.212951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f0af59b-d63c-4594-9a46-1337152130f2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:15.213418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f0af59b-d63c-4594-9a46-1337152130f2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:15.220891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f0af59b-d63c-4594-9a46-1337152130f2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:15.221406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f0af59b-d63c-4594-9a46-1337152130f2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:15.221858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f0af59b-d63c-4594-9a46-1337152130f2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:15.234044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ec80e8e8-2cd8-4491-9fb3-957d3200fd21 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:15.252805 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ec80e8e8-2cd8-4491-9fb3-957d3200fd21 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1333 microversion: 2.1 time: 0.717715 Aug 27 04:49:15.261270 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1961/3957] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:14 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1333 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:16.180220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4d00eb3f-c1ab-4407-8871-633a766805ad tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:16.182464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4d00eb3f-c1ab-4407-8871-633a766805ad tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:16.206373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d00eb3f-c1ab-4407-8871-633a766805ad tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:16.211240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d00eb3f-c1ab-4407-8871-633a766805ad tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:16.211977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d00eb3f-c1ab-4407-8871-633a766805ad tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:16.212943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d00eb3f-c1ab-4407-8871-633a766805ad tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:16.214573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d00eb3f-c1ab-4407-8871-633a766805ad tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:16.215170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d00eb3f-c1ab-4407-8871-633a766805ad tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:16.436942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6f0af59b-d63c-4594-9a46-1337152130f2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:16.464775 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6f0af59b-d63c-4594-9a46-1337152130f2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1313 microversion: 2.1 time: 1.302180 Aug 27 04:49:16.469714 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1997/3958] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:15 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1313 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:16.476998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5db459b4-33fd-4b5b-8abb-b86ff48864e4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:16.477858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5db459b4-33fd-4b5b-8abb-b86ff48864e4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:16.494208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5db459b4-33fd-4b5b-8abb-b86ff48864e4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:16.495180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5db459b4-33fd-4b5b-8abb-b86ff48864e4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:16.495762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5db459b4-33fd-4b5b-8abb-b86ff48864e4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:16.496809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5db459b4-33fd-4b5b-8abb-b86ff48864e4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:16.497414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5db459b4-33fd-4b5b-8abb-b86ff48864e4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:16.498519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5db459b4-33fd-4b5b-8abb-b86ff48864e4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:16.897844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4d00eb3f-c1ab-4407-8871-633a766805ad tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:16.909118 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4d00eb3f-c1ab-4407-8871-633a766805ad tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1516 microversion: 2.1 time: 0.734439 Aug 27 04:49:16.912301 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1962/3959] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:16 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1516 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:17.256141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5db459b4-33fd-4b5b-8abb-b86ff48864e4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:17.282219 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5db459b4-33fd-4b5b-8abb-b86ff48864e4 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1333 microversion: 2.1 time: 0.809728 Aug 27 04:49:17.301390 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1998/3960] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:16 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1333 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:17.493816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c076c270-24ee-4d1e-84b6-5d8fe2b115cb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:17.494556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c076c270-24ee-4d1e-84b6-5d8fe2b115cb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:17.518728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c076c270-24ee-4d1e-84b6-5d8fe2b115cb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:17.520975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c076c270-24ee-4d1e-84b6-5d8fe2b115cb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:17.521592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c076c270-24ee-4d1e-84b6-5d8fe2b115cb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:17.523352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c076c270-24ee-4d1e-84b6-5d8fe2b115cb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:17.526858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c076c270-24ee-4d1e-84b6-5d8fe2b115cb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:17.527481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c076c270-24ee-4d1e-84b6-5d8fe2b115cb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:18.036294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c076c270-24ee-4d1e-84b6-5d8fe2b115cb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:18.047825 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c076c270-24ee-4d1e-84b6-5d8fe2b115cb tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1313 microversion: 2.1 time: 0.558782 Aug 27 04:49:18.052754 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1963/3961] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:17 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1313 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:18.306094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab6e8007-fd3f-4d5b-857c-32a9d42b09cf tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:18.306879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab6e8007-fd3f-4d5b-857c-32a9d42b09cf tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:18.318315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab6e8007-fd3f-4d5b-857c-32a9d42b09cf tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:18.321004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab6e8007-fd3f-4d5b-857c-32a9d42b09cf tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:18.321581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab6e8007-fd3f-4d5b-857c-32a9d42b09cf tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:18.322438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab6e8007-fd3f-4d5b-857c-32a9d42b09cf tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:18.323022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab6e8007-fd3f-4d5b-857c-32a9d42b09cf tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:18.325220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab6e8007-fd3f-4d5b-857c-32a9d42b09cf tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:18.689956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab6e8007-fd3f-4d5b-857c-32a9d42b09cf tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:18.705304 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab6e8007-fd3f-4d5b-857c-32a9d42b09cf tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1333 microversion: 2.1 time: 0.402777 Aug 27 04:49:18.725745 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1999/3962] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:18 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1333 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:19.073480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-73dc1c24-ecf8-4cac-987d-442947541f6b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:19.074677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-73dc1c24-ecf8-4cac-987d-442947541f6b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:19.101687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73dc1c24-ecf8-4cac-987d-442947541f6b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:19.105380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73dc1c24-ecf8-4cac-987d-442947541f6b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:19.108486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73dc1c24-ecf8-4cac-987d-442947541f6b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:19.110616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73dc1c24-ecf8-4cac-987d-442947541f6b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:19.114027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73dc1c24-ecf8-4cac-987d-442947541f6b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:19.118262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73dc1c24-ecf8-4cac-987d-442947541f6b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:19.734255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-628dfa84-2983-4d31-b73c-cbf5cfb8d08c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:19.735202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-628dfa84-2983-4d31-b73c-cbf5cfb8d08c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:19.745561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-628dfa84-2983-4d31-b73c-cbf5cfb8d08c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:19.746226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-628dfa84-2983-4d31-b73c-cbf5cfb8d08c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:19.746787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-628dfa84-2983-4d31-b73c-cbf5cfb8d08c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:19.749343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-628dfa84-2983-4d31-b73c-cbf5cfb8d08c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:19.749962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-628dfa84-2983-4d31-b73c-cbf5cfb8d08c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:19.753581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-628dfa84-2983-4d31-b73c-cbf5cfb8d08c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:19.863590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-73dc1c24-ecf8-4cac-987d-442947541f6b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:19.881837 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-73dc1c24-ecf8-4cac-987d-442947541f6b tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1313 microversion: 2.1 time: 0.811866 Aug 27 04:49:19.885725 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1964/3963] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:19 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1313 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:20.119363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-74515fe7-e389-4c37-bcd3-fe4571aa1562 req-4c50cd2c-3b9d-4dcb-b594-1d11dcb14bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43540a8b-08c3-4aef-99dc-28b6ecbddbc7", "name": "network-vif-plugged", "status": "completed", "tag": "16e04044-0803-4347-a58d-835ee0b2a554"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:20.155498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-74515fe7-e389-4c37-bcd3-fe4571aa1562 req-4c50cd2c-3b9d-4dcb-b594-1d11dcb14bde service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:20.158602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-74515fe7-e389-4c37-bcd3-fe4571aa1562 req-4c50cd2c-3b9d-4dcb-b594-1d11dcb14bde service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:20.161270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-74515fe7-e389-4c37-bcd3-fe4571aa1562 req-4c50cd2c-3b9d-4dcb-b594-1d11dcb14bde service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:20.226613 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-74515fe7-e389-4c37-bcd3-fe4571aa1562 req-4c50cd2c-3b9d-4dcb-b594-1d11dcb14bde service nova] Creating event network-vif-plugged:16e04044-0803-4347-a58d-835ee0b2a554 for instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 on n-h2-854823-1 Aug 27 04:49:20.251014 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-74515fe7-e389-4c37-bcd3-fe4571aa1562 req-4c50cd2c-3b9d-4dcb-b594-1d11dcb14bde service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135221 Aug 27 04:49:20.252333 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1965/3964] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:20.396135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-628dfa84-2983-4d31-b73c-cbf5cfb8d08c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:20.404765 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-628dfa84-2983-4d31-b73c-cbf5cfb8d08c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1333 microversion: 2.1 time: 0.674856 Aug 27 04:49:20.423956 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2000/3965] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:19 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1333 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:20.908082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf281156-5dba-4aa4-aa91-58ce45e395bd tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:20.909120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bf281156-5dba-4aa4-aa91-58ce45e395bd tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:20.922282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:20.957495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf281156-5dba-4aa4-aa91-58ce45e395bd tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:20.975350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf281156-5dba-4aa4-aa91-58ce45e395bd tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:20.983370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf281156-5dba-4aa4-aa91-58ce45e395bd tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:20.987283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf281156-5dba-4aa4-aa91-58ce45e395bd tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:21.006585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf281156-5dba-4aa4-aa91-58ce45e395bd tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:21.008307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf281156-5dba-4aa4-aa91-58ce45e395bd tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:21.149526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dcc23d6f-698c-4037-b7e5-fd18cf4ad8eb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'create', calling method: .version_select at 0x7f1f20b5eb80>, body: {"keypair": {"name": "tempest-keypair-1154650439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA75lmue1XBPxWpqi+nhO3/xkuVvp50yA2gWiIAYujprwDlySIWqp2KETVsPN/JWXVpVpo9rRDD5PYCZmPILkBBdSAHMIsD+Fh84d5MtaNTdS2NUazqRHg5JzDJ+kTft7g=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:21.204181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-dcc23d6f-698c-4037-b7e5-fd18cf4ad8eb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Getting quotas for project 0ce5800ecb484a6ca7a9894cc4530bf4. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:49:21.219669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-dcc23d6f-698c-4037-b7e5-fd18cf4ad8eb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Getting quotas for user 81b0ef617031436484e9e987f972ae0a and project 0ce5800ecb484a6ca7a9894cc4530bf4. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:49:21.281958 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dcc23d6f-698c-4037-b7e5-fd18cf4ad8eb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.136647 Aug 27 04:49:21.283187 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2001/3966] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:49:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:21.418679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bf281156-5dba-4aa4-aa91-58ce45e395bd tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:21.434942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6e68a704-bf56-4eab-82ee-d8dce931e77d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:21.437034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6e68a704-bf56-4eab-82ee-d8dce931e77d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:21.454496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e68a704-bf56-4eab-82ee-d8dce931e77d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:21.455720 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bf281156-5dba-4aa4-aa91-58ce45e395bd tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1313 microversion: 2.1 time: 0.555726 Aug 27 04:49:21.457234 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1966/3967] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:20 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:21.457895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e68a704-bf56-4eab-82ee-d8dce931e77d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:21.458653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e68a704-bf56-4eab-82ee-d8dce931e77d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:21.459661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e68a704-bf56-4eab-82ee-d8dce931e77d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:21.460791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e68a704-bf56-4eab-82ee-d8dce931e77d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:21.461603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e68a704-bf56-4eab-82ee-d8dce931e77d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:21.540287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bedb4308-f365-4d50-9068-095e81b9ea1c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:21.541592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bedb4308-f365-4d50-9068-095e81b9ea1c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:21.552250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bedb4308-f365-4d50-9068-095e81b9ea1c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:21.553183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bedb4308-f365-4d50-9068-095e81b9ea1c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:21.553882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bedb4308-f365-4d50-9068-095e81b9ea1c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:21.554830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bedb4308-f365-4d50-9068-095e81b9ea1c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:21.555549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bedb4308-f365-4d50-9068-095e81b9ea1c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:21.556346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bedb4308-f365-4d50-9068-095e81b9ea1c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:21.593803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bedb4308-f365-4d50-9068-095e81b9ea1c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:49:21.812421 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bedb4308-f365-4d50-9068-095e81b9ea1c tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "DELETE /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 204 len: 0 microversion: 2.1 time: 0.281434 Aug 27 04:49:21.816261 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1967/3968] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:49:21 2022] DELETE /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:49:21.822967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8dfca2bc-b87e-4b1c-ae18-7b02902779e9 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:21.826247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8dfca2bc-b87e-4b1c-ae18-7b02902779e9 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:21.830206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6e68a704-bf56-4eab-82ee-d8dce931e77d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:21.841172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dfca2bc-b87e-4b1c-ae18-7b02902779e9 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:21.844519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dfca2bc-b87e-4b1c-ae18-7b02902779e9 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:21.845910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dfca2bc-b87e-4b1c-ae18-7b02902779e9 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:21.851104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dfca2bc-b87e-4b1c-ae18-7b02902779e9 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:21.851615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dfca2bc-b87e-4b1c-ae18-7b02902779e9 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:21.852060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dfca2bc-b87e-4b1c-ae18-7b02902779e9 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:21.876757 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6e68a704-bf56-4eab-82ee-d8dce931e77d tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1333 microversion: 2.1 time: 0.432814 Aug 27 04:49:21.880334 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2002/3969] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:21 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1333 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:22.301555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-bb70391e-a9ec-4965-b4f5-9c939bec353c req-af8452eb-5519-450e-ba35-01ce00395170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43540a8b-08c3-4aef-99dc-28b6ecbddbc7", "name": "network-vif-plugged", "status": "completed", "tag": "62cd6a46-478e-49c0-9ba3-ef06c30a25ba"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:22.339986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bb70391e-a9ec-4965-b4f5-9c939bec353c req-af8452eb-5519-450e-ba35-01ce00395170 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:22.340813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bb70391e-a9ec-4965-b4f5-9c939bec353c req-af8452eb-5519-450e-ba35-01ce00395170 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:22.342090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bb70391e-a9ec-4965-b4f5-9c939bec353c req-af8452eb-5519-450e-ba35-01ce00395170 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:22.393880 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-bb70391e-a9ec-4965-b4f5-9c939bec353c req-af8452eb-5519-450e-ba35-01ce00395170 service nova] Creating event network-vif-plugged:62cd6a46-478e-49c0-9ba3-ef06c30a25ba for instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 on n-h2-854823-1 Aug 27 04:49:22.417596 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-bb70391e-a9ec-4965-b4f5-9c939bec353c req-af8452eb-5519-450e-ba35-01ce00395170 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126239 Aug 27 04:49:22.426473 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2003/3970] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:49:22.442044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8dfca2bc-b87e-4b1c-ae18-7b02902779e9 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:22.485283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db7eb666-8eff-4ed1-a325-aa01f8b919c9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:22.486414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db7eb666-8eff-4ed1-a325-aa01f8b919c9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:22.488281 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8dfca2bc-b87e-4b1c-ae18-7b02902779e9 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1665 microversion: 2.1 time: 0.670490 Aug 27 04:49:22.510697 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1968/3971] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:21 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1665 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:22.537700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7eb666-8eff-4ed1-a325-aa01f8b919c9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:22.538808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7eb666-8eff-4ed1-a325-aa01f8b919c9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:22.539524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7eb666-8eff-4ed1-a325-aa01f8b919c9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:22.540506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7eb666-8eff-4ed1-a325-aa01f8b919c9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:22.541273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7eb666-8eff-4ed1-a325-aa01f8b919c9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:22.542083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7eb666-8eff-4ed1-a325-aa01f8b919c9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:22.903829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2e01f0ec-0410-486a-b16a-8f2692f3ea55 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:22.904884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2e01f0ec-0410-486a-b16a-8f2692f3ea55 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:22.917030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e01f0ec-0410-486a-b16a-8f2692f3ea55 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:22.925759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e01f0ec-0410-486a-b16a-8f2692f3ea55 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:22.929117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e01f0ec-0410-486a-b16a-8f2692f3ea55 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:22.931276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e01f0ec-0410-486a-b16a-8f2692f3ea55 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:22.939062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e01f0ec-0410-486a-b16a-8f2692f3ea55 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:22.939873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e01f0ec-0410-486a-b16a-8f2692f3ea55 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:23.510431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2e01f0ec-0410-486a-b16a-8f2692f3ea55 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:23.524388 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2e01f0ec-0410-486a-b16a-8f2692f3ea55 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1333 microversion: 2.1 time: 0.624383 Aug 27 04:49:23.526509 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1969/3972] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:22 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1333 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:23.543421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8353884-8963-4283-9548-be18c8649137 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:23.545819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d8353884-8963-4283-9548-be18c8649137 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:23.560821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8353884-8963-4283-9548-be18c8649137 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:23.565839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8353884-8963-4283-9548-be18c8649137 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:23.567274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8353884-8963-4283-9548-be18c8649137 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:23.568193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8353884-8963-4283-9548-be18c8649137 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:23.574231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8353884-8963-4283-9548-be18c8649137 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:23.575068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8353884-8963-4283-9548-be18c8649137 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:23.646972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:23.986926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d8353884-8963-4283-9548-be18c8649137 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:23.998631 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d8353884-8963-4283-9548-be18c8649137 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1665 microversion: 2.1 time: 0.470698 Aug 27 04:49:24.002136 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1970/3973] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:23 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1665 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:24.352311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db7eb666-8eff-4ed1-a325-aa01f8b919c9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:24.366151 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db7eb666-8eff-4ed1-a325-aa01f8b919c9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1313 microversion: 2.1 time: 1.886380 Aug 27 04:49:24.374288 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2004/3974] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:22 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1313 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:24.554508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dc7acc61-8bd6-4e6f-be23-0b44db705bb6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:24.555378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dc7acc61-8bd6-4e6f-be23-0b44db705bb6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:24.567256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7acc61-8bd6-4e6f-be23-0b44db705bb6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:24.569991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7acc61-8bd6-4e6f-be23-0b44db705bb6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:24.572056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7acc61-8bd6-4e6f-be23-0b44db705bb6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:24.573092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7acc61-8bd6-4e6f-be23-0b44db705bb6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:24.575099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7acc61-8bd6-4e6f-be23-0b44db705bb6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:24.577808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc7acc61-8bd6-4e6f-be23-0b44db705bb6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:24.730511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-fcf160ba-7335-4d3e-9e01-13a6bae3ba51 req-8ab72f56-1caa-4ca9-b240-8b4c487ad089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c1d304-3585-4b2b-bde6-282014fb3245", "name": "network-vif-plugged", "status": "completed", "tag": "f649fe61-cad6-4f1d-835a-d614f680ab8f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:24.763913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fcf160ba-7335-4d3e-9e01-13a6bae3ba51 req-8ab72f56-1caa-4ca9-b240-8b4c487ad089 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:24.769299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fcf160ba-7335-4d3e-9e01-13a6bae3ba51 req-8ab72f56-1caa-4ca9-b240-8b4c487ad089 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:24.769974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fcf160ba-7335-4d3e-9e01-13a6bae3ba51 req-8ab72f56-1caa-4ca9-b240-8b4c487ad089 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:24.820929 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-fcf160ba-7335-4d3e-9e01-13a6bae3ba51 req-8ab72f56-1caa-4ca9-b240-8b4c487ad089 service nova] Creating event network-vif-plugged:f649fe61-cad6-4f1d-835a-d614f680ab8f for instance f7c1d304-3585-4b2b-bde6-282014fb3245 on n-h2-854823-1 Aug 27 04:49:24.835983 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-fcf160ba-7335-4d3e-9e01-13a6bae3ba51 req-8ab72f56-1caa-4ca9-b240-8b4c487ad089 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108576 Aug 27 04:49:24.839717 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2005/3975] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:25.024365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-21268d55-2579-46f0-bc61-39c575117958 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:25.025329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-21268d55-2579-46f0-bc61-39c575117958 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:25.041199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21268d55-2579-46f0-bc61-39c575117958 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:25.042385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21268d55-2579-46f0-bc61-39c575117958 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:25.044841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21268d55-2579-46f0-bc61-39c575117958 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:25.048862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21268d55-2579-46f0-bc61-39c575117958 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:25.050853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21268d55-2579-46f0-bc61-39c575117958 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:25.051372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21268d55-2579-46f0-bc61-39c575117958 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:25.086325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dc7acc61-8bd6-4e6f-be23-0b44db705bb6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:25.116963 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dc7acc61-8bd6-4e6f-be23-0b44db705bb6 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1333 microversion: 2.1 time: 0.555962 Aug 27 04:49:25.118891 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1971/3976] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:24 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1333 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:25.395100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f903d17-c8dc-455a-b934-685e73ff9486 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:25.396487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4f903d17-c8dc-455a-b934-685e73ff9486 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:25.407692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f903d17-c8dc-455a-b934-685e73ff9486 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:25.420401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f903d17-c8dc-455a-b934-685e73ff9486 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:25.421414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f903d17-c8dc-455a-b934-685e73ff9486 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:25.422350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f903d17-c8dc-455a-b934-685e73ff9486 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:25.430272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f903d17-c8dc-455a-b934-685e73ff9486 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:25.430720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f903d17-c8dc-455a-b934-685e73ff9486 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:26.026374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-21268d55-2579-46f0-bc61-39c575117958 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:26.041461 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-21268d55-2579-46f0-bc61-39c575117958 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1665 microversion: 2.1 time: 1.021740 Aug 27 04:49:26.046695 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2006/3977] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:25 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1665 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:26.143110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c62299f3-57ca-42fa-a18e-b7de5a86ec5f tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:26.144055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c62299f3-57ca-42fa-a18e-b7de5a86ec5f tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:26.165758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c62299f3-57ca-42fa-a18e-b7de5a86ec5f tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:26.166593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c62299f3-57ca-42fa-a18e-b7de5a86ec5f tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:26.167231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c62299f3-57ca-42fa-a18e-b7de5a86ec5f tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:26.168358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c62299f3-57ca-42fa-a18e-b7de5a86ec5f tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:26.171703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c62299f3-57ca-42fa-a18e-b7de5a86ec5f tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:26.172512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c62299f3-57ca-42fa-a18e-b7de5a86ec5f tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:27.098506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4f903d17-c8dc-455a-b934-685e73ff9486 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:27.116587 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4f903d17-c8dc-455a-b934-685e73ff9486 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1313 microversion: 2.1 time: 1.725412 Aug 27 04:49:27.118460 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1972/3978] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:25 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1313 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:27.148032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fb13c2b8-baa9-4caa-991c-86b42002d5f6 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:27.150836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fb13c2b8-baa9-4caa-991c-86b42002d5f6 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:27.161169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb13c2b8-baa9-4caa-991c-86b42002d5f6 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:27.161759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb13c2b8-baa9-4caa-991c-86b42002d5f6 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:27.162290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb13c2b8-baa9-4caa-991c-86b42002d5f6 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:27.163221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb13c2b8-baa9-4caa-991c-86b42002d5f6 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:27.163750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb13c2b8-baa9-4caa-991c-86b42002d5f6 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:27.164243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb13c2b8-baa9-4caa-991c-86b42002d5f6 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:27.686662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fb13c2b8-baa9-4caa-991c-86b42002d5f6 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:27.700250 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fb13c2b8-baa9-4caa-991c-86b42002d5f6 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1665 microversion: 2.1 time: 0.575386 Aug 27 04:49:27.701153 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1973/3979] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:27 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1665 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:27.831316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c62299f3-57ca-42fa-a18e-b7de5a86ec5f tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:27.845848 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c62299f3-57ca-42fa-a18e-b7de5a86ec5f tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1669 microversion: 2.1 time: 1.706025 Aug 27 04:49:27.861619 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2007/3980] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:26 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1669 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:27.874072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-72640981-1a56-4f81-ade3-eba5f1e04b0b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:27.874859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-72640981-1a56-4f81-ade3-eba5f1e04b0b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:27.885258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72640981-1a56-4f81-ade3-eba5f1e04b0b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:27.886780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72640981-1a56-4f81-ade3-eba5f1e04b0b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:27.893321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72640981-1a56-4f81-ade3-eba5f1e04b0b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:27.894331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72640981-1a56-4f81-ade3-eba5f1e04b0b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:27.894973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72640981-1a56-4f81-ade3-eba5f1e04b0b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:27.895567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72640981-1a56-4f81-ade3-eba5f1e04b0b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:27.955804 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-72640981-1a56-4f81-ade3-eba5f1e04b0b tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7/ips" status: 200 len: 180 microversion: 2.1 time: 0.086116 Aug 27 04:49:27.957788 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1974/3981] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 04:49:27 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7/ips => generated 180 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:27.969335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05285ef2-9fe6-41ed-baeb-1f092e8c7e07 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:27.970084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05285ef2-9fe6-41ed-baeb-1f092e8c7e07 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:27.979219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05285ef2-9fe6-41ed-baeb-1f092e8c7e07 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:27.979989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05285ef2-9fe6-41ed-baeb-1f092e8c7e07 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:27.981095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05285ef2-9fe6-41ed-baeb-1f092e8c7e07 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:27.984244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05285ef2-9fe6-41ed-baeb-1f092e8c7e07 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:27.985864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05285ef2-9fe6-41ed-baeb-1f092e8c7e07 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:27.988242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05285ef2-9fe6-41ed-baeb-1f092e8c7e07 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:28.140766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7d35d081-d151-4045-9e81-b2c9fb2fa81c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:28.142423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7d35d081-d151-4045-9e81-b2c9fb2fa81c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:28.174620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d35d081-d151-4045-9e81-b2c9fb2fa81c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:28.189745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d35d081-d151-4045-9e81-b2c9fb2fa81c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:28.193358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d35d081-d151-4045-9e81-b2c9fb2fa81c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:28.210417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d35d081-d151-4045-9e81-b2c9fb2fa81c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:28.212638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d35d081-d151-4045-9e81-b2c9fb2fa81c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:28.215687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d35d081-d151-4045-9e81-b2c9fb2fa81c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:28.378309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05285ef2-9fe6-41ed-baeb-1f092e8c7e07 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:49:28.637663 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05285ef2-9fe6-41ed-baeb-1f092e8c7e07 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "DELETE /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 204 len: 0 microversion: 2.1 time: 0.672393 Aug 27 04:49:28.649035 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2008/3982] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:49:27 2022] DELETE /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:49:28.656152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1621235077", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc0608a5-bc7b-480a-bfdf-5a46c273626a"}], "security_groups": [{"name": "tempest-securitygroup--862783265"}], "key_name": "tempest-keypair-1154650439", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:28.963684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7d35d081-d151-4045-9e81-b2c9fb2fa81c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:28.977846 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7d35d081-d151-4045-9e81-b2c9fb2fa81c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1498 microversion: 2.1 time: 0.841961 Aug 27 04:49:28.988642 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1975/3983] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:28 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1498 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:29.003427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-77c83aab-1a99-4263-a3f0-f67590d3c7d7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:29.005545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-77c83aab-1a99-4263-a3f0-f67590d3c7d7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:29.033490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77c83aab-1a99-4263-a3f0-f67590d3c7d7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:29.036704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77c83aab-1a99-4263-a3f0-f67590d3c7d7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:29.037209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77c83aab-1a99-4263-a3f0-f67590d3c7d7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:29.037957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77c83aab-1a99-4263-a3f0-f67590d3c7d7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:29.038438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77c83aab-1a99-4263-a3f0-f67590d3c7d7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:29.038872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77c83aab-1a99-4263-a3f0-f67590d3c7d7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:29.129118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] validate_networks() for [('cc0608a5-bc7b-480a-bfdf-5a46c273626a', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:49:29.486601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-77c83aab-1a99-4263-a3f0-f67590d3c7d7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:29.496228 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-77c83aab-1a99-4263-a3f0-f67590d3c7d7 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1675 microversion: 2.1 time: 0.510403 Aug 27 04:49:29.500574 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1976/3984] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:28 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1675 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:29.512574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-17ddb2f4-8b52-453d-b806-fdf780c06258 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:29.513884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-17ddb2f4-8b52-453d-b806-fdf780c06258 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:29.530553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ddb2f4-8b52-453d-b806-fdf780c06258 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:29.531435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ddb2f4-8b52-453d-b806-fdf780c06258 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:29.532104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ddb2f4-8b52-453d-b806-fdf780c06258 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:29.533078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ddb2f4-8b52-453d-b806-fdf780c06258 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:29.533758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ddb2f4-8b52-453d-b806-fdf780c06258 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:29.534400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ddb2f4-8b52-453d-b806-fdf780c06258 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:29.611314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ddb2f4-8b52-453d-b806-fdf780c06258 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:29.612241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ddb2f4-8b52-453d-b806-fdf780c06258 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:29.615132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ddb2f4-8b52-453d-b806-fdf780c06258 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:29.615899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-17ddb2f4-8b52-453d-b806-fdf780c06258 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lazy-loading 'fault' on Instance uuid 423f7d58-0ec5-452f-8c1b-558fd0d10293 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:49:29.727125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-17ddb2f4-8b52-453d-b806-fdf780c06258 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4826941efc443aba3e8ce6f2b67ac55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f71b93ab8e4df8a74a33ca47530ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:29.750039 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-17ddb2f4-8b52-453d-b806-fdf780c06258 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 200 len: 1316 microversion: 2.1 time: 0.245950 Aug 27 04:49:29.755098 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1977/3985] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:29 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:29.764219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1dbd4fc8-dd39-44d2-aba4-e24e22dbdeab tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:29.784363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1dbd4fc8-dd39-44d2-aba4-e24e22dbdeab tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:29.805962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dbd4fc8-dd39-44d2-aba4-e24e22dbdeab tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:29.807401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dbd4fc8-dd39-44d2-aba4-e24e22dbdeab tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:29.809230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dbd4fc8-dd39-44d2-aba4-e24e22dbdeab tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:29.815220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dbd4fc8-dd39-44d2-aba4-e24e22dbdeab tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:29.816090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dbd4fc8-dd39-44d2-aba4-e24e22dbdeab tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:29.818324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dbd4fc8-dd39-44d2-aba4-e24e22dbdeab tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:29.906393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-1dbd4fc8-dd39-44d2-aba4-e24e22dbdeab tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lazy-loading 'flavor' on Instance uuid f7c1d304-3585-4b2b-bde6-282014fb3245 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:49:30.109546 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1dbd4fc8-dd39-44d2-aba4-e24e22dbdeab tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "POST /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245/action" status: 200 len: 32 microversion: 2.1 time: 0.352731 Aug 27 04:49:30.110186 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1978/3986] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:49:29 2022] POST /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245/action => generated 32 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:49:30.129417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-bb0e45c1-2468-44fe-a2ae-9b6206096cd9 req-64c1dcb6-8ecb-4d6e-9313-8596f1c2d1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423f7d58-0ec5-452f-8c1b-558fd0d10293", "name": "network-vif-deleted", "tag": "47a9aae8-84c6-4e31-bdff-f23bce77ca6c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:30.174273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bb0e45c1-2468-44fe-a2ae-9b6206096cd9 req-64c1dcb6-8ecb-4d6e-9313-8596f1c2d1f5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:30.174831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bb0e45c1-2468-44fe-a2ae-9b6206096cd9 req-64c1dcb6-8ecb-4d6e-9313-8596f1c2d1f5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:30.175309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bb0e45c1-2468-44fe-a2ae-9b6206096cd9 req-64c1dcb6-8ecb-4d6e-9313-8596f1c2d1f5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:30.205485 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-bb0e45c1-2468-44fe-a2ae-9b6206096cd9 req-64c1dcb6-8ecb-4d6e-9313-8596f1c2d1f5 service nova] Creating event network-vif-deleted:47a9aae8-84c6-4e31-bdff-f23bce77ca6c for instance 423f7d58-0ec5-452f-8c1b-558fd0d10293 on n-h1-854823-1 Aug 27 04:49:30.221593 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-bb0e45c1-2468-44fe-a2ae-9b6206096cd9 req-64c1dcb6-8ecb-4d6e-9313-8596f1c2d1f5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102070 Aug 27 04:49:30.222464 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1979/3987] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:30.239649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-78d1f029-4aea-401f-99f3-fb46df806337 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:30.240438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-78d1f029-4aea-401f-99f3-fb46df806337 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:30.260498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78d1f029-4aea-401f-99f3-fb46df806337 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:30.261843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78d1f029-4aea-401f-99f3-fb46df806337 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:30.263363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78d1f029-4aea-401f-99f3-fb46df806337 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:30.263609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78d1f029-4aea-401f-99f3-fb46df806337 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:30.264017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78d1f029-4aea-401f-99f3-fb46df806337 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:30.268752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78d1f029-4aea-401f-99f3-fb46df806337 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:30.716490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:49:30.719857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:49:30.720644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:49:30.721146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:49:30.721661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:49:30.746204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:30.746909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:30.748854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:30.753963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:30.754800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:30.757146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:30.805917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Getting quotas for project 0ce5800ecb484a6ca7a9894cc4530bf4. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:49:30.813218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Getting quotas for user 81b0ef617031436484e9e987f972ae0a and project 0ce5800ecb484a6ca7a9894cc4530bf4. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:49:30.833669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:49:30.837895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:49:30.952947 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3e90f96-fd13-4138-ac4e-790386cee302 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.302197 Aug 27 04:49:30.953614 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2009/3988] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:49:28 2022] POST /compute/v2.1/servers => generated 408 bytes in 2304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:49:30.958389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1dfd187-8477-42b5-a66b-9f1cc658e317 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:30.959008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c1dfd187-8477-42b5-a66b-9f1cc658e317 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:30.987805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1dfd187-8477-42b5-a66b-9f1cc658e317 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:30.988315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1dfd187-8477-42b5-a66b-9f1cc658e317 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:30.988794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1dfd187-8477-42b5-a66b-9f1cc658e317 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:30.989516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1dfd187-8477-42b5-a66b-9f1cc658e317 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:30.993324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1dfd187-8477-42b5-a66b-9f1cc658e317 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:30.994509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1dfd187-8477-42b5-a66b-9f1cc658e317 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:31.035368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-78d1f029-4aea-401f-99f3-fb46df806337 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:31.047667 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-78d1f029-4aea-401f-99f3-fb46df806337 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.824121 Aug 27 04:49:31.064778 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1980/3989] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:30 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:31.082273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3fd4e916-2c92-4cfc-bca5-988cbb753851 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:31.082916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3fd4e916-2c92-4cfc-bca5-988cbb753851 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] [instance: 423f7d58-0ec5-452f-8c1b-558fd0d10293] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:31.095682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fd4e916-2c92-4cfc-bca5-988cbb753851 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:31.101432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fd4e916-2c92-4cfc-bca5-988cbb753851 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:31.102441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fd4e916-2c92-4cfc-bca5-988cbb753851 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:31.104132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fd4e916-2c92-4cfc-bca5-988cbb753851 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:31.105076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fd4e916-2c92-4cfc-bca5-988cbb753851 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:31.105581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fd4e916-2c92-4cfc-bca5-988cbb753851 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:31.161049 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-3fd4e916-2c92-4cfc-bca5-988cbb753851 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] HTTP exception thrown: Instance 423f7d58-0ec5-452f-8c1b-558fd0d10293 could not be found. Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3fd4e916-2c92-4cfc-bca5-988cbb753851 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Request method failure captured: Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 HTTP/1.1 Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaHSNVFnmpDuRP3WwzSxQ0OoSvspEF2HohH1A1masyzlGYryEC6DLVWA6yQoTkf_hkFC5WN9doFEj6v7HcbtWdRS2fin3lGdxkiBwhAASyuePZnK-Eljh1PlEZ1dUhNHMRGha96cZQHvuqjO41jG-uesXCuLFPe79UvA1YYM-J33Srg Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 15f71b93ab8e4df8a74a33ca47530ffd Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestFqdnHostnames-917758105 Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/15f71b93ab8e4df8a74a33ca47530ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_15f71b93ab8e4df8a74a33ca47530ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/15f71b93ab8e4df8a74a33ca47530ffd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/15f71b93ab8e4df8a74a33ca47530ffd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestFqdnHostnames-917758105 Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 15f71b93ab8e4df8a74a33ca47530ffd Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-917758105 Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestFqdnHostnames-917758105-project Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: d4826941efc443aba3e8ce6f2b67ac55 Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestFqdnHostnames-917758105-project Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 423f7d58-0ec5-452f-8c1b-558fd0d10293 could not be found. Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '423f7d58-0ec5-452f-8c1b-558fd0d10293'} Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 423f7d58-0ec5-452f-8c1b-558fd0d10293 could not be found. Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 423f7d58-0ec5-452f-8c1b-558fd0d10293 could not be found. Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:31.162938 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:31.166475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:31.166475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:31.166475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:31.166475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:31.166475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:31.166475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 423f7d58-0ec5-452f-8c1b-558fd0d10293 could not be found. Aug 27 04:49:31.166475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:31.166475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3fd4e916-2c92-4cfc-bca5-988cbb753851 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Returning 404 to user: Instance 423f7d58-0ec5-452f-8c1b-558fd0d10293 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:31.166475 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3fd4e916-2c92-4cfc-bca5-988cbb753851 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293" status: 404 len: 111 microversion: 2.1 time: 0.098293 Aug 27 04:49:31.167990 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1981/3990] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:31 2022] GET /compute/v2.1/servers/423f7d58-0ec5-452f-8c1b-558fd0d10293 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:31.183254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dca95e3d-8bf0-4034-b1bc-08c51aa90094 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:31.184085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dca95e3d-8bf0-4034-b1bc-08c51aa90094 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:31.435688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dca95e3d-8bf0-4034-b1bc-08c51aa90094 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:31.445122 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dca95e3d-8bf0-4034-b1bc-08c51aa90094 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1246 microversion: 2.1 time: 0.273054 Aug 27 04:49:31.445805 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1982/3991] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:31 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1246 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:31.465544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a6fb4895-5ad5-4220-944a-1edb5f1e3506 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] Calling method '.version_select at 0x7f1f20f77ca0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:31.603569 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a6fb4895-5ad5-4220-944a-1edb5f1e3506 tempest-ServersTestFqdnHostnames-917758105 tempest-ServersTestFqdnHostnames-917758105-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1303231670" status: 202 len: 0 microversion: 2.1 time: 0.138628 Aug 27 04:49:31.609510 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1983/3992] 10.222.0.79 () {58 vars in 1221 bytes} [Sat Aug 27 04:49:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1303231670 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:49:31.842933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c1dfd187-8477-42b5-a66b-9f1cc658e317 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:31.861471 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c1dfd187-8477-42b5-a66b-9f1cc658e317 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1675 microversion: 2.1 time: 0.902919 Aug 27 04:49:31.863777 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2010/3993] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:30 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1675 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:32.071588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cd18f69d-49ad-4346-a3ff-711e15b03872 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:32.072291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cd18f69d-49ad-4346-a3ff-711e15b03872 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:32.088635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd18f69d-49ad-4346-a3ff-711e15b03872 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:32.089679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd18f69d-49ad-4346-a3ff-711e15b03872 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:32.090103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd18f69d-49ad-4346-a3ff-711e15b03872 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:32.094810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd18f69d-49ad-4346-a3ff-711e15b03872 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:32.096315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd18f69d-49ad-4346-a3ff-711e15b03872 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:32.097038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd18f69d-49ad-4346-a3ff-711e15b03872 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:32.477088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b7504b1-57ae-4af3-bda3-1f9027268b89 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:32.478187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b7504b1-57ae-4af3-bda3-1f9027268b89 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:32.502027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b7504b1-57ae-4af3-bda3-1f9027268b89 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:32.503198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b7504b1-57ae-4af3-bda3-1f9027268b89 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:32.503924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b7504b1-57ae-4af3-bda3-1f9027268b89 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:32.504957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b7504b1-57ae-4af3-bda3-1f9027268b89 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:32.505825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b7504b1-57ae-4af3-bda3-1f9027268b89 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:32.534595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b7504b1-57ae-4af3-bda3-1f9027268b89 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:32.910800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cd18f69d-49ad-4346-a3ff-711e15b03872 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:32.937164 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cd18f69d-49ad-4346-a3ff-711e15b03872 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.870159 Aug 27 04:49:32.937774 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1984/3994] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:32 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:32.953230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8581d46b-05f6-4094-a540-e5beb10aef8c req-8880871b-f524-4837-8b9b-65f3858399ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43540a8b-08c3-4aef-99dc-28b6ecbddbc7", "name": "network-vif-deleted", "tag": "16e04044-0803-4347-a58d-835ee0b2a554"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:32.980419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8581d46b-05f6-4094-a540-e5beb10aef8c req-8880871b-f524-4837-8b9b-65f3858399ef service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:32.982417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8581d46b-05f6-4094-a540-e5beb10aef8c req-8880871b-f524-4837-8b9b-65f3858399ef service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:32.982882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8581d46b-05f6-4094-a540-e5beb10aef8c req-8880871b-f524-4837-8b9b-65f3858399ef service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:33.019827 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8581d46b-05f6-4094-a540-e5beb10aef8c req-8880871b-f524-4837-8b9b-65f3858399ef service nova] Creating event network-vif-deleted:16e04044-0803-4347-a58d-835ee0b2a554 for instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 on n-h2-854823-1 Aug 27 04:49:33.039382 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8581d46b-05f6-4094-a540-e5beb10aef8c req-8880871b-f524-4837-8b9b-65f3858399ef service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090394 Aug 27 04:49:33.041946 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1985/3995] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:33.054886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2e99dc98-7ac1-44fc-b0dc-ad93a400a2ff tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:33.056888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2e99dc98-7ac1-44fc-b0dc-ad93a400a2ff tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:33.074966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e99dc98-7ac1-44fc-b0dc-ad93a400a2ff tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:33.076074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e99dc98-7ac1-44fc-b0dc-ad93a400a2ff tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:33.078563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e99dc98-7ac1-44fc-b0dc-ad93a400a2ff tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:33.079312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e99dc98-7ac1-44fc-b0dc-ad93a400a2ff tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:33.079782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e99dc98-7ac1-44fc-b0dc-ad93a400a2ff tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:33.083149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e99dc98-7ac1-44fc-b0dc-ad93a400a2ff tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:33.148650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0b7504b1-57ae-4af3-bda3-1f9027268b89 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:33.161709 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b7504b1-57ae-4af3-bda3-1f9027268b89 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1298 microversion: 2.1 time: 0.699885 Aug 27 04:49:33.187335 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2011/3996] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:32 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1298 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:33.362129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82ceaedd-c8c7-459d-855e-c76018529128 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Action: 'create', calling method: .version_select at 0x7f1f20e588b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1551656244", "metadata": {"Type": "work"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82ceaedd-c8c7-459d-855e-c76018529128 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Request method failure captured: Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 122 Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaJcUZiGu3awkoe-hKNHQl0UdwFyU0jrQ9T_Yp-I69em1_1tzKr5PKOQalqDnkq0qJUpNMhus1RqC_qfo6qC6sjaV6eog5t9K1EZuu5gKEYn_ve5D7afg8UHuboQWY-dwMVHB9OOlJo6XZbpMbl_0elloTKTWgFarRIhmDVEs8JlSKw Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 75b8c17b10f341f4920bc6e6adf8ee05 Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 75b8c17b10f341f4920bc6e6adf8ee05 Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-VolumesNegativeTest-90218782-project Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: afdd9fb7ad054a6dbf7acf066c4d1e61 Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesNegativeTest-90218782-project Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1551656244", "metadata": {"Type": "work"}}} Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1551656244', 'metadata': {'Type': 'work'}}}} Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi '#$%' Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:49:33.370670 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:49:33.374806 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 04:49:33.374806 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.374806 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.374806 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.374806 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.374806 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:33.374806 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:33.374806 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:49:33.374806 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:49:33.374806 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 04:49:33.374806 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.376645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82ceaedd-c8c7-459d-855e-c76018529128 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:33.377712 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-82ceaedd-c8c7-459d-855e-c76018529128 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.188482 Aug 27 04:49:33.378906 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2012/3997] 10.222.0.79 () {60 vars in 1156 bytes} [Sat Aug 27 04:49:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:49:33.392317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc89a2d9-fb6e-439a-ba07-980023454c56 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Action: 'create', calling method: .version_select at 0x7f1f20b768b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1996584938", "metadata": {"Type": "work"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc89a2d9-fb6e-439a-ba07-980023454c56 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Request method failure captured: Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 120 Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaJcUZiGu3awkoe-hKNHQl0UdwFyU0jrQ9T_Yp-I69em1_1tzKr5PKOQalqDnkq0qJUpNMhus1RqC_qfo6qC6sjaV6eog5t9K1EZuu5gKEYn_ve5D7afg8UHuboQWY-dwMVHB9OOlJo6XZbpMbl_0elloTKTWgFarRIhmDVEs8JlSKw Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 75b8c17b10f341f4920bc6e6adf8ee05 Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 75b8c17b10f341f4920bc6e6adf8ee05 Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-VolumesNegativeTest-90218782-project Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: afdd9fb7ad054a6dbf7acf066c4d1e61 Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesNegativeTest-90218782-project Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1996584938", "metadata": {"Type": "work"}}} Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1996584938', 'metadata': {'Type': 'work'}}}} Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi '0' Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:49:33.398844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:49:33.403239 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 04:49:33.403239 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.403239 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.403239 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.403239 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.403239 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:33.403239 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:33.403239 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:49:33.403239 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:49:33.403239 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 04:49:33.403239 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.406932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc89a2d9-fb6e-439a-ba07-980023454c56 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:33.408003 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc89a2d9-fb6e-439a-ba07-980023454c56 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021569 Aug 27 04:49:33.414244 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2013/3998] 10.222.0.79 () {60 vars in 1156 bytes} [Sat Aug 27 04:49:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:49:33.431219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b65d20c-15f2-413b-b66e-641d18230079 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Action: 'create', calling method: .version_select at 0x7f1f20b76790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-156232161", "metadata": {"Type": "work"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b65d20c-15f2-413b-b66e-641d18230079 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Request method failure captured: Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 118 Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaJcUZiGu3awkoe-hKNHQl0UdwFyU0jrQ9T_Yp-I69em1_1tzKr5PKOQalqDnkq0qJUpNMhus1RqC_qfo6qC6sjaV6eog5t9K1EZuu5gKEYn_ve5D7afg8UHuboQWY-dwMVHB9OOlJo6XZbpMbl_0elloTKTWgFarRIhmDVEs8JlSKw Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 75b8c17b10f341f4920bc6e6adf8ee05 Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 75b8c17b10f341f4920bc6e6adf8ee05 Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-VolumesNegativeTest-90218782-project Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: afdd9fb7ad054a6dbf7acf066c4d1e61 Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesNegativeTest-90218782-project Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-156232161", "metadata": {"Type": "work"}}} Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-156232161', 'metadata': {'Type': 'work'}}}} Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi '' Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:49:33.441743 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:49:33.446538 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 04:49:33.446538 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.446538 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.446538 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.446538 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.446538 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:33.446538 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:33.446538 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:49:33.446538 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:49:33.446538 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 04:49:33.446538 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.446538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b65d20c-15f2-413b-b66e-641d18230079 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:33.447333 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b65d20c-15f2-413b-b66e-641d18230079 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030357 Aug 27 04:49:33.447876 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2014/3999] 10.222.0.79 () {60 vars in 1156 bytes} [Sat Aug 27 04:49:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:49:33.458431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-701e44c9-8445-421b-bb34-9a9115050267 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Calling method '.version_select at 0x7f1f20e58670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:33.526646 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-701e44c9-8445-421b-bb34-9a9115050267 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] HTTP exception thrown: Volume tempest-invalid-1559516531 could not be found. Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-701e44c9-8445-421b-bb34-9a9115050267 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Request method failure captured: Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1559516531 HTTP/1.1 Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaJcUZiGu3awkoe-hKNHQl0UdwFyU0jrQ9T_Yp-I69em1_1tzKr5PKOQalqDnkq0qJUpNMhus1RqC_qfo6qC6sjaV6eog5t9K1EZuu5gKEYn_ve5D7afg8UHuboQWY-dwMVHB9OOlJo6XZbpMbl_0elloTKTWgFarRIhmDVEs8JlSKw Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 75b8c17b10f341f4920bc6e6adf8ee05 Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 75b8c17b10f341f4920bc6e6adf8ee05 Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-VolumesNegativeTest-90218782-project Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: afdd9fb7ad054a6dbf7acf066c4d1e61 Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesNegativeTest-90218782-project Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: exception: Volume tempest-invalid-1559516531 could not be found. Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'tempest-invalid-1559516531'} Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1559516531 could not be found. (HTTP 404) (Request-ID: req-7f6affd6-164e-494a-9809-64c53727c5fa) Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:49:33.530114 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1559516531 could not be found. Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1559516531 could not be found. Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1559516531 could not be found. Aug 27 04:49:33.533992 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.541145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-701e44c9-8445-421b-bb34-9a9115050267 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Returning 404 to user: Volume tempest-invalid-1559516531 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:33.544446 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-701e44c9-8445-421b-bb34-9a9115050267 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1559516531" status: 404 len: 99 microversion: 2.1 time: 0.090849 Aug 27 04:49:33.552098 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2015/4000] 10.222.0.79 () {58 vars in 1218 bytes} [Sat Aug 27 04:49:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1559516531 => generated 99 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 04:49:33.575206 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47e729a3-cf06-4224-b256-14c837b31d00 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011308 Aug 27 04:49:33.576166 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2016/4001] 10.222.0.79 () {58 vars in 1140 bytes} [Sat Aug 27 04:49:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 04:49:33.591554 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8fd240fc-f467-4094-873f-87940f6d918c tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005222 Aug 27 04:49:33.592689 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2017/4002] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:49:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 04:49:33.606342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f11e0d1-6878-44de-834c-d2dc03f76640 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Calling method '.version_select at 0x7f1f20f525e0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:33.660118 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6f11e0d1-6878-44de-834c-d2dc03f76640 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] HTTP exception thrown: Volume 3360758f-66f0-4cb2-a7eb-54265dec5632 could not be found. Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f11e0d1-6878-44de-834c-d2dc03f76640 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Request method failure captured: Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-volumes/3360758f-66f0-4cb2-a7eb-54265dec5632 HTTP/1.1 Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaJcUZiGu3awkoe-hKNHQl0UdwFyU0jrQ9T_Yp-I69em1_1tzKr5PKOQalqDnkq0qJUpNMhus1RqC_qfo6qC6sjaV6eog5t9K1EZuu5gKEYn_ve5D7afg8UHuboQWY-dwMVHB9OOlJo6XZbpMbl_0elloTKTWgFarRIhmDVEs8JlSKw Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 75b8c17b10f341f4920bc6e6adf8ee05 Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 75b8c17b10f341f4920bc6e6adf8ee05 Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-VolumesNegativeTest-90218782-project Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: afdd9fb7ad054a6dbf7acf066c4d1e61 Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesNegativeTest-90218782-project Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: exception: Volume 3360758f-66f0-4cb2-a7eb-54265dec5632 could not be found. Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '3360758f-66f0-4cb2-a7eb-54265dec5632'} Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3360758f-66f0-4cb2-a7eb-54265dec5632 could not be found. (HTTP 404) (Request-ID: req-4e7855b3-ed80-4871-85a6-8a07a112456b) Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 04:49:33.663287 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3360758f-66f0-4cb2-a7eb-54265dec5632 could not be found. Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3360758f-66f0-4cb2-a7eb-54265dec5632 could not be found. Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3360758f-66f0-4cb2-a7eb-54265dec5632 could not be found. Aug 27 04:49:33.667181 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.672549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f11e0d1-6878-44de-834c-d2dc03f76640 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Returning 404 to user: Volume 3360758f-66f0-4cb2-a7eb-54265dec5632 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:33.672549 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6f11e0d1-6878-44de-834c-d2dc03f76640 tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/3360758f-66f0-4cb2-a7eb-54265dec5632" status: 404 len: 109 microversion: 2.1 time: 0.072543 Aug 27 04:49:33.672549 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2018/4003] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 04:49:33 2022] DELETE /compute/v2.1/os-volumes/3360758f-66f0-4cb2-a7eb-54265dec5632 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:33.695065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef8bb7db-8e54-4ba1-b9a9-0801b5560ceb tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Calling method '.version_select at 0x7f1f20e589d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:33.770092 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ef8bb7db-8e54-4ba1-b9a9-0801b5560ceb tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] HTTP exception thrown: Volume 7f095ae4-ba9b-4bd0-b230-1d3e8510921a could not be found. Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef8bb7db-8e54-4ba1-b9a9-0801b5560ceb tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Request method failure captured: Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-volumes/7f095ae4-ba9b-4bd0-b230-1d3e8510921a HTTP/1.1 Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaJcUZiGu3awkoe-hKNHQl0UdwFyU0jrQ9T_Yp-I69em1_1tzKr5PKOQalqDnkq0qJUpNMhus1RqC_qfo6qC6sjaV6eog5t9K1EZuu5gKEYn_ve5D7afg8UHuboQWY-dwMVHB9OOlJo6XZbpMbl_0elloTKTWgFarRIhmDVEs8JlSKw Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 75b8c17b10f341f4920bc6e6adf8ee05 Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/75b8c17b10f341f4920bc6e6adf8ee05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 75b8c17b10f341f4920bc6e6adf8ee05 Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesNegativeTest-90218782 Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-VolumesNegativeTest-90218782-project Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: afdd9fb7ad054a6dbf7acf066c4d1e61 Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesNegativeTest-90218782-project Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: exception: Volume 7f095ae4-ba9b-4bd0-b230-1d3e8510921a could not be found. Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '7f095ae4-ba9b-4bd0-b230-1d3e8510921a'} Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f095ae4-ba9b-4bd0-b230-1d3e8510921a could not be found. (HTTP 404) (Request-ID: req-08c5590d-6ba6-4412-8046-1063c111ccc2) Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 04:49:33.772484 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f095ae4-ba9b-4bd0-b230-1d3e8510921a could not be found. Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f095ae4-ba9b-4bd0-b230-1d3e8510921a could not be found. Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f095ae4-ba9b-4bd0-b230-1d3e8510921a could not be found. Aug 27 04:49:33.776750 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:33.781791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef8bb7db-8e54-4ba1-b9a9-0801b5560ceb tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] Returning 404 to user: Volume 7f095ae4-ba9b-4bd0-b230-1d3e8510921a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:33.781791 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef8bb7db-8e54-4ba1-b9a9-0801b5560ceb tempest-VolumesNegativeTest-90218782 tempest-VolumesNegativeTest-90218782-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/7f095ae4-ba9b-4bd0-b230-1d3e8510921a" status: 404 len: 109 microversion: 2.1 time: 0.102749 Aug 27 04:49:33.784563 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2019/4004] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 04:49:33 2022] GET /compute/v2.1/os-volumes/7f095ae4-ba9b-4bd0-b230-1d3e8510921a => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:49:33.960423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-833f27f1-f7f6-4f1c-ba58-20fe25779928 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:33.961675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-833f27f1-f7f6-4f1c-ba58-20fe25779928 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:33.975566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-833f27f1-f7f6-4f1c-ba58-20fe25779928 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:33.978352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-833f27f1-f7f6-4f1c-ba58-20fe25779928 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:33.979792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-833f27f1-f7f6-4f1c-ba58-20fe25779928 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:33.984255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-833f27f1-f7f6-4f1c-ba58-20fe25779928 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:33.987021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-833f27f1-f7f6-4f1c-ba58-20fe25779928 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:33.987885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-833f27f1-f7f6-4f1c-ba58-20fe25779928 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:34.117383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2e99dc98-7ac1-44fc-b0dc-ad93a400a2ff tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:34.132127 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2e99dc98-7ac1-44fc-b0dc-ad93a400a2ff tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1495 microversion: 2.1 time: 1.088231 Aug 27 04:49:34.145803 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1986/4005] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:33 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1495 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:34.186680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8754c919-eb71-414b-acd5-8c73424de24e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:34.187923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8754c919-eb71-414b-acd5-8c73424de24e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:34.214754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8754c919-eb71-414b-acd5-8c73424de24e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:34.215981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8754c919-eb71-414b-acd5-8c73424de24e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:34.216596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8754c919-eb71-414b-acd5-8c73424de24e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:34.218040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8754c919-eb71-414b-acd5-8c73424de24e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:34.218659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8754c919-eb71-414b-acd5-8c73424de24e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:34.225503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8754c919-eb71-414b-acd5-8c73424de24e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:34.370458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-833f27f1-f7f6-4f1c-ba58-20fe25779928 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:34.390423 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-833f27f1-f7f6-4f1c-ba58-20fe25779928 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.430880 Aug 27 04:49:34.407633 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2020/4006] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:33 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:34.468104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8754c919-eb71-414b-acd5-8c73424de24e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:34.494038 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8754c919-eb71-414b-acd5-8c73424de24e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1304 microversion: 2.1 time: 0.311815 Aug 27 04:49:34.496865 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1987/4007] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:34 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1304 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:35.132080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dd5c6d34-1b69-412a-b0e6-1953772dc6f5 req-9aed2c93-aa1c-4955-970e-d3251d11cfea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43540a8b-08c3-4aef-99dc-28b6ecbddbc7", "name": "network-vif-deleted", "tag": "62cd6a46-478e-49c0-9ba3-ef06c30a25ba"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:35.155922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6022a983-6b72-469f-b522-4a5ca264955a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:35.156570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6022a983-6b72-469f-b522-4a5ca264955a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:35.162876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dd5c6d34-1b69-412a-b0e6-1953772dc6f5 req-9aed2c93-aa1c-4955-970e-d3251d11cfea service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:35.163365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dd5c6d34-1b69-412a-b0e6-1953772dc6f5 req-9aed2c93-aa1c-4955-970e-d3251d11cfea service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:35.163802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dd5c6d34-1b69-412a-b0e6-1953772dc6f5 req-9aed2c93-aa1c-4955-970e-d3251d11cfea service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:35.175971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6022a983-6b72-469f-b522-4a5ca264955a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:35.176489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6022a983-6b72-469f-b522-4a5ca264955a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:35.178119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6022a983-6b72-469f-b522-4a5ca264955a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:35.179271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6022a983-6b72-469f-b522-4a5ca264955a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:35.181602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6022a983-6b72-469f-b522-4a5ca264955a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:35.186147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6022a983-6b72-469f-b522-4a5ca264955a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:35.218920 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dd5c6d34-1b69-412a-b0e6-1953772dc6f5 req-9aed2c93-aa1c-4955-970e-d3251d11cfea service nova] Creating event network-vif-deleted:62cd6a46-478e-49c0-9ba3-ef06c30a25ba for instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 on n-h2-854823-1 Aug 27 04:49:35.245208 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dd5c6d34-1b69-412a-b0e6-1953772dc6f5 req-9aed2c93-aa1c-4955-970e-d3251d11cfea service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111818 Aug 27 04:49:35.246624 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2021/4008] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:35.307188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6022a983-6b72-469f-b522-4a5ca264955a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:35.308936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6022a983-6b72-469f-b522-4a5ca264955a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:35.309395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6022a983-6b72-469f-b522-4a5ca264955a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:35.312552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-6022a983-6b72-469f-b522-4a5ca264955a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lazy-loading 'fault' on Instance uuid 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:49:35.414522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-053cd21c-63ec-43b7-b3c2-623726a0227a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:35.415301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-053cd21c-63ec-43b7-b3c2-623726a0227a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:35.429407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053cd21c-63ec-43b7-b3c2-623726a0227a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:35.429977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053cd21c-63ec-43b7-b3c2-623726a0227a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:35.431090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053cd21c-63ec-43b7-b3c2-623726a0227a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:35.433525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053cd21c-63ec-43b7-b3c2-623726a0227a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:35.434771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053cd21c-63ec-43b7-b3c2-623726a0227a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:35.435762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053cd21c-63ec-43b7-b3c2-623726a0227a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:35.459614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6022a983-6b72-469f-b522-4a5ca264955a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dae41c63374401f81d297f03fd55d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56803ee2fee048d09b8ec44ae76d1c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:35.462517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:35.469810 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6022a983-6b72-469f-b522-4a5ca264955a tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 200 len: 1302 microversion: 2.1 time: 0.318411 Aug 27 04:49:35.480622 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1988/4009] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:35 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 1302 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:35.517086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f72ec053-82b0-46ea-9e38-58b65ea75f46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:35.518556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f72ec053-82b0-46ea-9e38-58b65ea75f46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:35.533439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f72ec053-82b0-46ea-9e38-58b65ea75f46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:35.534165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f72ec053-82b0-46ea-9e38-58b65ea75f46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:35.534906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f72ec053-82b0-46ea-9e38-58b65ea75f46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:35.535833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f72ec053-82b0-46ea-9e38-58b65ea75f46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:35.544987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f72ec053-82b0-46ea-9e38-58b65ea75f46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:35.545807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f72ec053-82b0-46ea-9e38-58b65ea75f46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:36.016198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f72ec053-82b0-46ea-9e38-58b65ea75f46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:36.030520 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f72ec053-82b0-46ea-9e38-58b65ea75f46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1371 microversion: 2.1 time: 0.515815 Aug 27 04:49:36.044574 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1989/4010] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:35 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1371 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:36.507790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59b5b366-b3d8-4cbd-adb2-d0237087d886 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:36.508311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-59b5b366-b3d8-4cbd-adb2-d0237087d886 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:36.530869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59b5b366-b3d8-4cbd-adb2-d0237087d886 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:36.531348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59b5b366-b3d8-4cbd-adb2-d0237087d886 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:36.531815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59b5b366-b3d8-4cbd-adb2-d0237087d886 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:36.532606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59b5b366-b3d8-4cbd-adb2-d0237087d886 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:36.533032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59b5b366-b3d8-4cbd-adb2-d0237087d886 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:36.533544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59b5b366-b3d8-4cbd-adb2-d0237087d886 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:36.556076 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-59b5b366-b3d8-4cbd-adb2-d0237087d886 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] HTTP exception thrown: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59b5b366-b3d8-4cbd-adb2-d0237087d886 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Request method failure captured: Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 HTTP/1.1 Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaH0QJEf1VwTYX1WbOyl1lJS_4GA_TPY1nmosvbE00eGfaJbEQo2Qw_jxEO4keoLTth8eXz2vhcznPT0cuPP9xUrebEr1KQYDo2q5mw7nKz_lUFk_2oz4S0jlbES03R0E289pnjtG95z4OY1YgXTQrWLE_G73rpzTJAtZL-lKpVGTRM Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 56803ee2fee048d09b8ec44ae76d1c9e Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 56803ee2fee048d09b8ec44ae76d1c9e Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestMultiNic-1549200309-project Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 4dae41c63374401f81d297f03fd55d57 Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestMultiNic-1549200309-project Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '43540a8b-08c3-4aef-99dc-28b6ecbddbc7'} Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:36.562087 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:36.565683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:36.565683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:36.565683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:36.565683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:36.565683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:36.565683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:36.565683 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:36.565683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59b5b366-b3d8-4cbd-adb2-d0237087d886 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Returning 404 to user: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:36.565683 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-59b5b366-b3d8-4cbd-adb2-d0237087d886 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 404 len: 111 microversion: 2.1 time: 0.059767 Aug 27 04:49:36.569503 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1990/4011] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:36 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:49:36.866879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-053cd21c-63ec-43b7-b3c2-623726a0227a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:36.874368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:36.892467 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-053cd21c-63ec-43b7-b3c2-623726a0227a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 1.483179 Aug 27 04:49:36.907558 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2022/4012] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:35 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:37.061071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b88f3ec2-7dca-4267-a25b-13d5742e835c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:37.061757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b88f3ec2-7dca-4267-a25b-13d5742e835c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:37.075793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88f3ec2-7dca-4267-a25b-13d5742e835c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:37.076602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88f3ec2-7dca-4267-a25b-13d5742e835c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:37.077195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88f3ec2-7dca-4267-a25b-13d5742e835c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:37.078117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88f3ec2-7dca-4267-a25b-13d5742e835c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:37.082157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88f3ec2-7dca-4267-a25b-13d5742e835c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:37.082812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b88f3ec2-7dca-4267-a25b-13d5742e835c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:37.708904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b88f3ec2-7dca-4267-a25b-13d5742e835c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:37.728215 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b88f3ec2-7dca-4267-a25b-13d5742e835c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1371 microversion: 2.1 time: 0.670626 Aug 27 04:49:37.742940 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1991/4013] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:37 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1371 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:37.917947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85620558-e1d2-4940-8db5-cf3b725610f7 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:37.918572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-85620558-e1d2-4940-8db5-cf3b725610f7 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:37.938067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85620558-e1d2-4940-8db5-cf3b725610f7 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:37.939687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85620558-e1d2-4940-8db5-cf3b725610f7 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:37.940668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85620558-e1d2-4940-8db5-cf3b725610f7 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:37.943064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85620558-e1d2-4940-8db5-cf3b725610f7 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:37.944723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85620558-e1d2-4940-8db5-cf3b725610f7 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:37.951508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85620558-e1d2-4940-8db5-cf3b725610f7 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:38.750243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8a95a9c-7c24-44b0-bd9a-1b9882f6bec3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:38.751633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d8a95a9c-7c24-44b0-bd9a-1b9882f6bec3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:38.766394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8a95a9c-7c24-44b0-bd9a-1b9882f6bec3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:38.766912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8a95a9c-7c24-44b0-bd9a-1b9882f6bec3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:38.767359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8a95a9c-7c24-44b0-bd9a-1b9882f6bec3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:38.768083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8a95a9c-7c24-44b0-bd9a-1b9882f6bec3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:38.768561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8a95a9c-7c24-44b0-bd9a-1b9882f6bec3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:38.769003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8a95a9c-7c24-44b0-bd9a-1b9882f6bec3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:39.125952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d8a95a9c-7c24-44b0-bd9a-1b9882f6bec3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:39.137524 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d8a95a9c-7c24-44b0-bd9a-1b9882f6bec3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1371 microversion: 2.1 time: 0.389293 Aug 27 04:49:39.141856 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1992/4014] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:38 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1371 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:39.248751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-85620558-e1d2-4940-8db5-cf3b725610f7 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:39.266791 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-85620558-e1d2-4940-8db5-cf3b725610f7 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 1.351527 Aug 27 04:49:39.269544 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2023/4015] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:37 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:40.162944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0c887741-2e91-4139-bcc5-0c43740d62ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:40.164450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0c887741-2e91-4139-bcc5-0c43740d62ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:40.177947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c887741-2e91-4139-bcc5-0c43740d62ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:40.181044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c887741-2e91-4139-bcc5-0c43740d62ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:40.181695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c887741-2e91-4139-bcc5-0c43740d62ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:40.183727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c887741-2e91-4139-bcc5-0c43740d62ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:40.185166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c887741-2e91-4139-bcc5-0c43740d62ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:40.187426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c887741-2e91-4139-bcc5-0c43740d62ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:40.261314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-246dd916-a79d-46b4-b995-2c55f9d8d80c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:40.262344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-246dd916-a79d-46b4-b995-2c55f9d8d80c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:40.274299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-246dd916-a79d-46b4-b995-2c55f9d8d80c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:40.275472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-246dd916-a79d-46b4-b995-2c55f9d8d80c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:40.275921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-246dd916-a79d-46b4-b995-2c55f9d8d80c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:40.276686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-246dd916-a79d-46b4-b995-2c55f9d8d80c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:40.277322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-246dd916-a79d-46b4-b995-2c55f9d8d80c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:40.277897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-246dd916-a79d-46b4-b995-2c55f9d8d80c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:40.301827 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-246dd916-a79d-46b4-b995-2c55f9d8d80c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] HTTP exception thrown: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-246dd916-a79d-46b4-b995-2c55f9d8d80c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Request method failure captured: Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 HTTP/1.1 Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaH0QJEf1VwTYX1WbOyl1lJS_4GA_TPY1nmosvbE00eGfaJbEQo2Qw_jxEO4keoLTth8eXz2vhcznPT0cuPP9xUrebEr1KQYDo2q5mw7nKz_lUFk_2oz4S0jlbES03R0E289pnjtG95z4OY1YgXTQrWLE_G73rpzTJAtZL-lKpVGTRM Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 56803ee2fee048d09b8ec44ae76d1c9e Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 56803ee2fee048d09b8ec44ae76d1c9e Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersTestMultiNic-1549200309-project Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 4dae41c63374401f81d297f03fd55d57 Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestMultiNic-1549200309-project Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '43540a8b-08c3-4aef-99dc-28b6ecbddbc7'} Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:49:40.304056 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:49:40.307915 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:40.307915 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.307915 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:40.307915 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.307915 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:40.307915 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:40.307915 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:40.307915 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:40.307915 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:40.307915 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:40.307915 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.312558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-246dd916-a79d-46b4-b995-2c55f9d8d80c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Returning 404 to user: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:40.328560 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-246dd916-a79d-46b4-b995-2c55f9d8d80c tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "DELETE /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 404 len: 111 microversion: 2.1 time: 0.057572 Aug 27 04:49:40.330005 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2024/4016] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:49:40 2022] DELETE /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:40.362959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1fdc7ccb-3d0a-4658-bd76-0a2a0e77bc54 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:40.364028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1fdc7ccb-3d0a-4658-bd76-0a2a0e77bc54 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:40.374848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fdc7ccb-3d0a-4658-bd76-0a2a0e77bc54 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:40.375563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fdc7ccb-3d0a-4658-bd76-0a2a0e77bc54 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:40.376255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fdc7ccb-3d0a-4658-bd76-0a2a0e77bc54 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:40.377582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fdc7ccb-3d0a-4658-bd76-0a2a0e77bc54 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:40.379985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fdc7ccb-3d0a-4658-bd76-0a2a0e77bc54 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:40.380848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fdc7ccb-3d0a-4658-bd76-0a2a0e77bc54 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:40.452088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0c887741-2e91-4139-bcc5-0c43740d62ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:40.460807 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0c887741-2e91-4139-bcc5-0c43740d62ff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1371 microversion: 2.1 time: 0.301699 Aug 27 04:49:40.461395 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1993/4017] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:40 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:40.470150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-b8ab059a-e3bf-4341-8d68-474ce50c6e2a req-63e85f63-f97b-4cbc-82ec-17f001ba94e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f74e4f7-e0b8-41cb-88a2-98aff82b1d98", "tag": "63e52c18-d4a3-457e-9877-9a1d70646169"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:40.494313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b8ab059a-e3bf-4341-8d68-474ce50c6e2a req-63e85f63-f97b-4cbc-82ec-17f001ba94e2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:40.495139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b8ab059a-e3bf-4341-8d68-474ce50c6e2a req-63e85f63-f97b-4cbc-82ec-17f001ba94e2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:40.495769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b8ab059a-e3bf-4341-8d68-474ce50c6e2a req-63e85f63-f97b-4cbc-82ec-17f001ba94e2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:40.521543 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b8ab059a-e3bf-4341-8d68-474ce50c6e2a req-63e85f63-f97b-4cbc-82ec-17f001ba94e2 service nova] Creating event network-changed:63e52c18-d4a3-457e-9877-9a1d70646169 for instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 on n-h1-854823-1 Aug 27 04:49:40.529090 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-b8ab059a-e3bf-4341-8d68-474ce50c6e2a req-63e85f63-f97b-4cbc-82ec-17f001ba94e2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065633 Aug 27 04:49:40.530809 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1994/4018] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:40.538644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31a315f3-f916-4e40-acd8-6b5250eb9244 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:40.539670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-31a315f3-f916-4e40-acd8-6b5250eb9244 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: 43540a8b-08c3-4aef-99dc-28b6ecbddbc7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:40.548464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31a315f3-f916-4e40-acd8-6b5250eb9244 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:40.549475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31a315f3-f916-4e40-acd8-6b5250eb9244 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:40.550134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31a315f3-f916-4e40-acd8-6b5250eb9244 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:40.551097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31a315f3-f916-4e40-acd8-6b5250eb9244 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:40.551649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31a315f3-f916-4e40-acd8-6b5250eb9244 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:40.552265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31a315f3-f916-4e40-acd8-6b5250eb9244 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:40.567202 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-31a315f3-f916-4e40-acd8-6b5250eb9244 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] HTTP exception thrown: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31a315f3-f916-4e40-acd8-6b5250eb9244 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Request method failure captured: Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 HTTP/1.1 Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaH0QJEf1VwTYX1WbOyl1lJS_4GA_TPY1nmosvbE00eGfaJbEQo2Qw_jxEO4keoLTth8eXz2vhcznPT0cuPP9xUrebEr1KQYDo2q5mw7nKz_lUFk_2oz4S0jlbES03R0E289pnjtG95z4OY1YgXTQrWLE_G73rpzTJAtZL-lKpVGTRM Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 56803ee2fee048d09b8ec44ae76d1c9e Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 56803ee2fee048d09b8ec44ae76d1c9e Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestMultiNic-1549200309-project Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 4dae41c63374401f81d297f03fd55d57 Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestMultiNic-1549200309-project Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '43540a8b-08c3-4aef-99dc-28b6ecbddbc7'} Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:40.569723 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.573985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:40.573985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:40.573985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:40.573985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:40.573985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:40.573985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. Aug 27 04:49:40.573985 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.576107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31a315f3-f916-4e40-acd8-6b5250eb9244 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Returning 404 to user: Instance 43540a8b-08c3-4aef-99dc-28b6ecbddbc7 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:40.577645 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-31a315f3-f916-4e40-acd8-6b5250eb9244 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7" status: 404 len: 111 microversion: 2.1 time: 0.045296 Aug 27 04:49:40.581516 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1995/4019] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:40 2022] GET /compute/v2.1/servers/43540a8b-08c3-4aef-99dc-28b6ecbddbc7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:40.589167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-823dcb70-9671-47b9-a8ff-005ace68ca83 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:40.589167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-823dcb70-9671-47b9-a8ff-005ace68ca83 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:40.598087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-823dcb70-9671-47b9-a8ff-005ace68ca83 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:40.599010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-823dcb70-9671-47b9-a8ff-005ace68ca83 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:40.599607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-823dcb70-9671-47b9-a8ff-005ace68ca83 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:40.600487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-823dcb70-9671-47b9-a8ff-005ace68ca83 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:40.601539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-823dcb70-9671-47b9-a8ff-005ace68ca83 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:40.602131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-823dcb70-9671-47b9-a8ff-005ace68ca83 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:40.620992 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-823dcb70-9671-47b9-a8ff-005ace68ca83 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] HTTP exception thrown: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-823dcb70-9671-47b9-a8ff-005ace68ca83 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Request method failure captured: Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 HTTP/1.1 Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaH0QJEf1VwTYX1WbOyl1lJS_4GA_TPY1nmosvbE00eGfaJbEQo2Qw_jxEO4keoLTth8eXz2vhcznPT0cuPP9xUrebEr1KQYDo2q5mw7nKz_lUFk_2oz4S0jlbES03R0E289pnjtG95z4OY1YgXTQrWLE_G73rpzTJAtZL-lKpVGTRM Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 56803ee2fee048d09b8ec44ae76d1c9e Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 56803ee2fee048d09b8ec44ae76d1c9e Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestMultiNic-1549200309-project Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 4dae41c63374401f81d297f03fd55d57 Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestMultiNic-1549200309-project Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'ed03d537-8672-4059-88f4-b1f4399727b7'} Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:49:40.622944 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:49:40.630788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:49:40.630788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.630788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:40.630788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.630788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:40.630788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:40.630788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:40.630788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:40.630788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:40.630788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:49:40.630788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.630788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-823dcb70-9671-47b9-a8ff-005ace68ca83 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Returning 404 to user: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:40.630788 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-823dcb70-9671-47b9-a8ff-005ace68ca83 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 404 len: 111 microversion: 2.1 time: 0.041690 Aug 27 04:49:40.630788 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1996/4020] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:49:40 2022] DELETE /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:40.634835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-be64f5e0-d77a-45bb-a0ee-5e75b8fd6df8 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:40.635628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-be64f5e0-d77a-45bb-a0ee-5e75b8fd6df8 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] [instance: ed03d537-8672-4059-88f4-b1f4399727b7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:40.643602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be64f5e0-d77a-45bb-a0ee-5e75b8fd6df8 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:40.656144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be64f5e0-d77a-45bb-a0ee-5e75b8fd6df8 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:40.656640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be64f5e0-d77a-45bb-a0ee-5e75b8fd6df8 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:40.657586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be64f5e0-d77a-45bb-a0ee-5e75b8fd6df8 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:40.658151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be64f5e0-d77a-45bb-a0ee-5e75b8fd6df8 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:40.661427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be64f5e0-d77a-45bb-a0ee-5e75b8fd6df8 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:40.679008 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-be64f5e0-d77a-45bb-a0ee-5e75b8fd6df8 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] HTTP exception thrown: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-be64f5e0-d77a-45bb-a0ee-5e75b8fd6df8 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Request method failure captured: Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 HTTP/1.1 Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaH0QJEf1VwTYX1WbOyl1lJS_4GA_TPY1nmosvbE00eGfaJbEQo2Qw_jxEO4keoLTth8eXz2vhcznPT0cuPP9xUrebEr1KQYDo2q5mw7nKz_lUFk_2oz4S0jlbES03R0E289pnjtG95z4OY1YgXTQrWLE_G73rpzTJAtZL-lKpVGTRM Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 56803ee2fee048d09b8ec44ae76d1c9e Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/56803ee2fee048d09b8ec44ae76d1c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 56803ee2fee048d09b8ec44ae76d1c9e Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestMultiNic-1549200309 Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestMultiNic-1549200309-project Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 4dae41c63374401f81d297f03fd55d57 Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestMultiNic-1549200309-project Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'ed03d537-8672-4059-88f4-b1f4399727b7'} Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:49:40.680857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.684079 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:49:40.684079 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:49:40.684079 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:49:40.684079 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:49:40.684079 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:49:40.684079 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. Aug 27 04:49:40.684079 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:49:40.684079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-be64f5e0-d77a-45bb-a0ee-5e75b8fd6df8 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] Returning 404 to user: Instance ed03d537-8672-4059-88f4-b1f4399727b7 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:49:40.684079 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-be64f5e0-d77a-45bb-a0ee-5e75b8fd6df8 tempest-ServersTestMultiNic-1549200309 tempest-ServersTestMultiNic-1549200309-project] 10.222.0.79 "GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7" status: 404 len: 111 microversion: 2.1 time: 0.052886 Aug 27 04:49:40.684079 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1997/4021] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:40 2022] GET /compute/v2.1/servers/ed03d537-8672-4059-88f4-b1f4399727b7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:49:40.786374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:40.827606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:40.885400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1fdc7ccb-3d0a-4658-bd76-0a2a0e77bc54 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:40.899344 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1fdc7ccb-3d0a-4658-bd76-0a2a0e77bc54 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.566998 Aug 27 04:49:40.900844 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2025/4022] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:40 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:41.486293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:41.488114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b63fd4c2-3c78-437d-ba0e-5ae4b74cd721 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:41.489064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b63fd4c2-3c78-437d-ba0e-5ae4b74cd721 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:41.508166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b63fd4c2-3c78-437d-ba0e-5ae4b74cd721 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:41.513265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b63fd4c2-3c78-437d-ba0e-5ae4b74cd721 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:41.516653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b63fd4c2-3c78-437d-ba0e-5ae4b74cd721 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:41.517521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b63fd4c2-3c78-437d-ba0e-5ae4b74cd721 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:41.520406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b63fd4c2-3c78-437d-ba0e-5ae4b74cd721 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:41.520975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b63fd4c2-3c78-437d-ba0e-5ae4b74cd721 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:41.920683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25ab3c53-a157-4a97-a745-40d80691f23c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:41.921943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25ab3c53-a157-4a97-a745-40d80691f23c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:41.933228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25ab3c53-a157-4a97-a745-40d80691f23c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:41.936687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25ab3c53-a157-4a97-a745-40d80691f23c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:41.937328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25ab3c53-a157-4a97-a745-40d80691f23c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:41.939739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25ab3c53-a157-4a97-a745-40d80691f23c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:41.940162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25ab3c53-a157-4a97-a745-40d80691f23c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:41.941776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25ab3c53-a157-4a97-a745-40d80691f23c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:41.949117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b63fd4c2-3c78-437d-ba0e-5ae4b74cd721 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:41.970640 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b63fd4c2-3c78-437d-ba0e-5ae4b74cd721 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1371 microversion: 2.1 time: 0.487554 Aug 27 04:49:41.971826 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1998/4023] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:41 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1371 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:42.889836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25ab3c53-a157-4a97-a745-40d80691f23c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:42.903010 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25ab3c53-a157-4a97-a745-40d80691f23c tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.986039 Aug 27 04:49:42.903836 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2026/4024] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:41 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:42.993125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c4e3285-46c5-47c7-b2c0-5398192cfe65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:42.994199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8c4e3285-46c5-47c7-b2c0-5398192cfe65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:43.009337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c4e3285-46c5-47c7-b2c0-5398192cfe65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:43.015356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c4e3285-46c5-47c7-b2c0-5398192cfe65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:43.025707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c4e3285-46c5-47c7-b2c0-5398192cfe65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:43.032736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c4e3285-46c5-47c7-b2c0-5398192cfe65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:43.033321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c4e3285-46c5-47c7-b2c0-5398192cfe65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:43.033773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c4e3285-46c5-47c7-b2c0-5398192cfe65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:43.924229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fec70b25-7cb7-47a0-a077-604b81935f45 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:43.925469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fec70b25-7cb7-47a0-a077-604b81935f45 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:43.929830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:43.942952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fec70b25-7cb7-47a0-a077-604b81935f45 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:43.943702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fec70b25-7cb7-47a0-a077-604b81935f45 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:43.944888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fec70b25-7cb7-47a0-a077-604b81935f45 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:43.949483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fec70b25-7cb7-47a0-a077-604b81935f45 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:43.954245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fec70b25-7cb7-47a0-a077-604b81935f45 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:43.955025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fec70b25-7cb7-47a0-a077-604b81935f45 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:44.334435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8c4e3285-46c5-47c7-b2c0-5398192cfe65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:44.345646 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8c4e3285-46c5-47c7-b2c0-5398192cfe65 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1371 microversion: 2.1 time: 1.356329 Aug 27 04:49:44.350103 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 1999/4025] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:42 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1371 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:44.644224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fec70b25-7cb7-47a0-a077-604b81935f45 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:44.655715 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fec70b25-7cb7-47a0-a077-604b81935f45 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.735338 Aug 27 04:49:44.660481 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2027/4026] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:43 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:45.188443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-629426644", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:45.315425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] validate_networks() for None {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:49:45.383611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef7e4d84-ca95-448e-bac1-6cec91e85fe2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:45.384224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef7e4d84-ca95-448e-bac1-6cec91e85fe2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:45.405895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef7e4d84-ca95-448e-bac1-6cec91e85fe2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:45.406561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef7e4d84-ca95-448e-bac1-6cec91e85fe2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:45.407176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef7e4d84-ca95-448e-bac1-6cec91e85fe2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:45.414811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef7e4d84-ca95-448e-bac1-6cec91e85fe2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:45.415593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef7e4d84-ca95-448e-bac1-6cec91e85fe2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:45.416074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef7e4d84-ca95-448e-bac1-6cec91e85fe2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:46.091736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:49:46.092319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:49:46.092960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:49:46.093255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:49:46.093674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:49:46.123823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:46.124896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:46.126178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:46.127259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:46.129130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:46.129936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:46.184496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Getting quotas for project f1cad2481dba4789acfb928380a0575f. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:49:46.207588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Getting quotas for user b431bcf9fb7c41b6a3d68de10e68bede and project f1cad2481dba4789acfb928380a0575f. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:49:46.225168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:49:46.228610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:49:46.300788 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f8076a9d-5f56-4c2a-8331-bf91693b9feb tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116682 Aug 27 04:49:46.303307 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2000/4027] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:49:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:49:46.316445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ec4ec389-01bd-467b-8a8a-abb92e87b54f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:46.317363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ec4ec389-01bd-467b-8a8a-abb92e87b54f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:46.325990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec4ec389-01bd-467b-8a8a-abb92e87b54f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:46.342847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec4ec389-01bd-467b-8a8a-abb92e87b54f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:46.343311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec4ec389-01bd-467b-8a8a-abb92e87b54f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:46.344074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec4ec389-01bd-467b-8a8a-abb92e87b54f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:46.344557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec4ec389-01bd-467b-8a8a-abb92e87b54f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:46.344996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec4ec389-01bd-467b-8a8a-abb92e87b54f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:46.813553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ec4ec389-01bd-467b-8a8a-abb92e87b54f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:46.825640 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ec4ec389-01bd-467b-8a8a-abb92e87b54f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.519916 Aug 27 04:49:46.828416 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2001/4028] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:46 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:46.845755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7eb9e636-9dc8-4b77-aedf-7b984e00f284 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:46.849193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7eb9e636-9dc8-4b77-aedf-7b984e00f284 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:46.861580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:46.984228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7eb9e636-9dc8-4b77-aedf-7b984e00f284 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:46.998903 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7eb9e636-9dc8-4b77-aedf-7b984e00f284 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1213 microversion: 2.1 time: 0.165858 Aug 27 04:49:46.999602 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2002/4029] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:46 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:47.176456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef7e4d84-ca95-448e-bac1-6cec91e85fe2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:47.200675 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef7e4d84-ca95-448e-bac1-6cec91e85fe2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1371 microversion: 2.1 time: 1.821550 Aug 27 04:49:47.202048 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2028/4030] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:45 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1371 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:47.857913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ea16e41b-0c2a-4c24-9b1f-318be2856e3d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:47.859834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ea16e41b-0c2a-4c24-9b1f-318be2856e3d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:47.884675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea16e41b-0c2a-4c24-9b1f-318be2856e3d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:47.888624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea16e41b-0c2a-4c24-9b1f-318be2856e3d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:47.889580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea16e41b-0c2a-4c24-9b1f-318be2856e3d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:47.892274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea16e41b-0c2a-4c24-9b1f-318be2856e3d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:47.897869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea16e41b-0c2a-4c24-9b1f-318be2856e3d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:47.899532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea16e41b-0c2a-4c24-9b1f-318be2856e3d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:48.022943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e7b71ab-d98c-4b37-a48d-c70a33200501 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:48.024238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e7b71ab-d98c-4b37-a48d-c70a33200501 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:48.037066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e7b71ab-d98c-4b37-a48d-c70a33200501 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:48.041220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e7b71ab-d98c-4b37-a48d-c70a33200501 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:48.042338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e7b71ab-d98c-4b37-a48d-c70a33200501 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:48.045862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e7b71ab-d98c-4b37-a48d-c70a33200501 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:48.050733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e7b71ab-d98c-4b37-a48d-c70a33200501 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:48.051302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e7b71ab-d98c-4b37-a48d-c70a33200501 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:48.389950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e7b71ab-d98c-4b37-a48d-c70a33200501 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:48.403714 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e7b71ab-d98c-4b37-a48d-c70a33200501 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1265 microversion: 2.1 time: 0.387489 Aug 27 04:49:48.408271 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2029/4031] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:48 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1265 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:48.740173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ea16e41b-0c2a-4c24-9b1f-318be2856e3d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:48.751695 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ea16e41b-0c2a-4c24-9b1f-318be2856e3d tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.904343 Aug 27 04:49:48.768959 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2003/4032] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:47 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:48.779869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-394c771d-0c99-4fce-a7ad-1077b53f34e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:48.780503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-394c771d-0c99-4fce-a7ad-1077b53f34e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:48.798462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394c771d-0c99-4fce-a7ad-1077b53f34e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:48.806178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394c771d-0c99-4fce-a7ad-1077b53f34e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:48.806986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394c771d-0c99-4fce-a7ad-1077b53f34e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:48.809860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394c771d-0c99-4fce-a7ad-1077b53f34e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:48.812113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394c771d-0c99-4fce-a7ad-1077b53f34e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:48.818624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394c771d-0c99-4fce-a7ad-1077b53f34e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:48.937799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-878366839", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "edc428fb-21f1-41d6-a87e-ef412b78e52a"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:49.020590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] validate_networks() for [('edc428fb-21f1-41d6-a87e-ef412b78e52a', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:49:49.463248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-394c771d-0c99-4fce-a7ad-1077b53f34e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:49.472508 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-394c771d-0c99-4fce-a7ad-1077b53f34e9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1371 microversion: 2.1 time: 0.702318 Aug 27 04:49:49.473110 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2004/4033] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:48 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1371 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:49.506610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dca44191-254c-4d13-91e8-e826d6a02ca1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:49.507504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dca44191-254c-4d13-91e8-e826d6a02ca1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:49.520053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dca44191-254c-4d13-91e8-e826d6a02ca1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:49.522691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dca44191-254c-4d13-91e8-e826d6a02ca1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:49.523143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dca44191-254c-4d13-91e8-e826d6a02ca1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:49.523878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dca44191-254c-4d13-91e8-e826d6a02ca1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:49.524335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dca44191-254c-4d13-91e8-e826d6a02ca1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:49.524801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dca44191-254c-4d13-91e8-e826d6a02ca1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:50.036591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dca44191-254c-4d13-91e8-e826d6a02ca1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:50.055304 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dca44191-254c-4d13-91e8-e826d6a02ca1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1271 microversion: 2.1 time: 0.557235 Aug 27 04:49:50.068871 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2005/4034] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:49 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1271 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:50.078496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6604aba6-6a38-4893-9121-9295f8a0c1e1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:50.079234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6604aba6-6a38-4893-9121-9295f8a0c1e1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:50.086403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6604aba6-6a38-4893-9121-9295f8a0c1e1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:50.087212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6604aba6-6a38-4893-9121-9295f8a0c1e1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:50.087792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6604aba6-6a38-4893-9121-9295f8a0c1e1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:50.088721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6604aba6-6a38-4893-9121-9295f8a0c1e1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:50.089403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6604aba6-6a38-4893-9121-9295f8a0c1e1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:50.089969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6604aba6-6a38-4893-9121-9295f8a0c1e1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:50.538757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:49:50.539249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:49:50.539661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:49:50.547375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:49:50.548439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:49:50.561817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:50.564893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:50.566670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:50.569541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:50.570680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:50.573026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:50.633701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Getting quotas for project e4e15086534346c0879634ead7c115bb. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:49:50.679809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Getting quotas for user d11e7e1547e6435a9868c3cc0efbd684 and project e4e15086534346c0879634ead7c115bb. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:49:50.717451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:49:50.728602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:49:50.861863 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-725fafea-c231-47a6-83a5-22bb03d26922 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.452227 Aug 27 04:49:50.862761 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2030/4035] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:49:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:49:50.867800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b1521cc8-9875-4e82-9c9c-ba721cc058b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:50.868674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b1521cc8-9875-4e82-9c9c-ba721cc058b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:50.878369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1521cc8-9875-4e82-9c9c-ba721cc058b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:50.879074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1521cc8-9875-4e82-9c9c-ba721cc058b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:50.879652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1521cc8-9875-4e82-9c9c-ba721cc058b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:50.880654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1521cc8-9875-4e82-9c9c-ba721cc058b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:50.881271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1521cc8-9875-4e82-9c9c-ba721cc058b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:50.881845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1521cc8-9875-4e82-9c9c-ba721cc058b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:51.002794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6604aba6-6a38-4893-9121-9295f8a0c1e1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:51.011655 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6604aba6-6a38-4893-9121-9295f8a0c1e1 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.942921 Aug 27 04:49:51.012903 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2006/4036] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:50 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:51.018256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8082c03b-7f8c-4e4b-a5ce-eee75e867b36 req-cc4cca71-6300-4625-b851-1e3bb978093f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f74e4f7-e0b8-41cb-88a2-98aff82b1d98", "name": "network-vif-plugged", "status": "completed", "tag": "63e52c18-d4a3-457e-9877-9a1d70646169"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:51.030689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8082c03b-7f8c-4e4b-a5ce-eee75e867b36 req-cc4cca71-6300-4625-b851-1e3bb978093f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:51.031406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8082c03b-7f8c-4e4b-a5ce-eee75e867b36 req-cc4cca71-6300-4625-b851-1e3bb978093f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:51.031981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8082c03b-7f8c-4e4b-a5ce-eee75e867b36 req-cc4cca71-6300-4625-b851-1e3bb978093f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:51.051211 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8082c03b-7f8c-4e4b-a5ce-eee75e867b36 req-cc4cca71-6300-4625-b851-1e3bb978093f service nova] Creating event network-vif-plugged:63e52c18-d4a3-457e-9877-9a1d70646169 for instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 on n-h1-854823-1 Aug 27 04:49:51.059501 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8082c03b-7f8c-4e4b-a5ce-eee75e867b36 req-cc4cca71-6300-4625-b851-1e3bb978093f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044530 Aug 27 04:49:51.060901 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2007/4037] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:51.068295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-29b122fb-483e-459b-b84c-4374b5a842ae tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:51.069425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-29b122fb-483e-459b-b84c-4374b5a842ae tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:51.411063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-29b122fb-483e-459b-b84c-4374b5a842ae tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:51.426318 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-29b122fb-483e-459b-b84c-4374b5a842ae tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1215 microversion: 2.1 time: 0.360646 Aug 27 04:49:51.429392 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2008/4038] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:51 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1215 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:51.453964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-493ac772-851f-490a-a43c-69f5493ccde0 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:51.454648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-493ac772-851f-490a-a43c-69f5493ccde0 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:51.485124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-493ac772-851f-490a-a43c-69f5493ccde0 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:51.485124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-493ac772-851f-490a-a43c-69f5493ccde0 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:51.486503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-493ac772-851f-490a-a43c-69f5493ccde0 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:51.491226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-493ac772-851f-490a-a43c-69f5493ccde0 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:51.491733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-493ac772-851f-490a-a43c-69f5493ccde0 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:51.492595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-493ac772-851f-490a-a43c-69f5493ccde0 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:51.851220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-493ac772-851f-490a-a43c-69f5493ccde0 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:51.861877 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-493ac772-851f-490a-a43c-69f5493ccde0 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1271 microversion: 2.1 time: 0.430432 Aug 27 04:49:51.868643 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2009/4039] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:51 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1271 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:52.034636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-abd5d213-c55f-4586-8c86-03b5ebbd6191 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:52.036391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-abd5d213-c55f-4586-8c86-03b5ebbd6191 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:52.053151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abd5d213-c55f-4586-8c86-03b5ebbd6191 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:52.055231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abd5d213-c55f-4586-8c86-03b5ebbd6191 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:52.056320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abd5d213-c55f-4586-8c86-03b5ebbd6191 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:52.060944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abd5d213-c55f-4586-8c86-03b5ebbd6191 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:52.067496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abd5d213-c55f-4586-8c86-03b5ebbd6191 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:52.069164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abd5d213-c55f-4586-8c86-03b5ebbd6191 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:52.807634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b1521cc8-9875-4e82-9c9c-ba721cc058b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:52.817286 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b1521cc8-9875-4e82-9c9c-ba721cc058b4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1371 microversion: 2.1 time: 1.953309 Aug 27 04:49:52.822637 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2031/4040] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:50 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1371 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:52.831814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-347725ea-42a1-41d1-bcda-f01e906113ec tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:52.841103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-347725ea-42a1-41d1-bcda-f01e906113ec tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:52.850896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-347725ea-42a1-41d1-bcda-f01e906113ec tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:52.851659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-347725ea-42a1-41d1-bcda-f01e906113ec tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:52.852262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-347725ea-42a1-41d1-bcda-f01e906113ec tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:52.853157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-347725ea-42a1-41d1-bcda-f01e906113ec tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:52.854698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-347725ea-42a1-41d1-bcda-f01e906113ec tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:52.855280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-347725ea-42a1-41d1-bcda-f01e906113ec tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:52.856873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-abd5d213-c55f-4586-8c86-03b5ebbd6191 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:52.866640 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-abd5d213-c55f-4586-8c86-03b5ebbd6191 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.837312 Aug 27 04:49:52.873536 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2010/4041] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:52 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:52.891058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a80d562f-de91-48e0-a951-d1ceb4cbcbbc tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:52.891635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a80d562f-de91-48e0-a951-d1ceb4cbcbbc tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:52.909470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a80d562f-de91-48e0-a951-d1ceb4cbcbbc tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:52.910799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a80d562f-de91-48e0-a951-d1ceb4cbcbbc tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:52.911263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a80d562f-de91-48e0-a951-d1ceb4cbcbbc tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:52.912316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a80d562f-de91-48e0-a951-d1ceb4cbcbbc tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:52.912822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a80d562f-de91-48e0-a951-d1ceb4cbcbbc tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:52.913259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a80d562f-de91-48e0-a951-d1ceb4cbcbbc tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:52.995223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-347725ea-42a1-41d1-bcda-f01e906113ec tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:53.008192 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-347725ea-42a1-41d1-bcda-f01e906113ec tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1211 microversion: 2.1 time: 0.180902 Aug 27 04:49:53.009137 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2032/4042] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:52 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1211 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:53.134041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a80d562f-de91-48e0-a951-d1ceb4cbcbbc tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:53.147736 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a80d562f-de91-48e0-a951-d1ceb4cbcbbc tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1271 microversion: 2.1 time: 0.260310 Aug 27 04:49:53.162565 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2011/4043] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:52 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1271 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:53.846620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2844948e-57cb-49bb-ab02-2cec4b05f9a5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:53.850027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2844948e-57cb-49bb-ab02-2cec4b05f9a5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:53.878652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2844948e-57cb-49bb-ab02-2cec4b05f9a5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:53.879587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2844948e-57cb-49bb-ab02-2cec4b05f9a5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:53.880239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2844948e-57cb-49bb-ab02-2cec4b05f9a5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:53.881140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2844948e-57cb-49bb-ab02-2cec4b05f9a5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:53.881796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2844948e-57cb-49bb-ab02-2cec4b05f9a5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:53.882726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2844948e-57cb-49bb-ab02-2cec4b05f9a5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:53.902473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c9c90d57-b02c-43c7-ab66-6c4bbdbc3117 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:53.906943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c9c90d57-b02c-43c7-ab66-6c4bbdbc3117 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:53.938053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9c90d57-b02c-43c7-ab66-6c4bbdbc3117 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:53.939837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9c90d57-b02c-43c7-ab66-6c4bbdbc3117 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:53.943769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9c90d57-b02c-43c7-ab66-6c4bbdbc3117 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:53.945556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9c90d57-b02c-43c7-ab66-6c4bbdbc3117 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:53.948789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9c90d57-b02c-43c7-ab66-6c4bbdbc3117 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:53.949944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9c90d57-b02c-43c7-ab66-6c4bbdbc3117 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:53.975128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:54.660378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2844948e-57cb-49bb-ab02-2cec4b05f9a5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:54.688490 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2844948e-57cb-49bb-ab02-2cec4b05f9a5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1371 microversion: 2.1 time: 0.850886 Aug 27 04:49:54.694186 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2033/4044] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:53 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1371 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:54.717658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a3a7a652-6d86-4131-afb7-02972ab5b363 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:54.718723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a3a7a652-6d86-4131-afb7-02972ab5b363 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:54.729023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3a7a652-6d86-4131-afb7-02972ab5b363 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:54.736045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3a7a652-6d86-4131-afb7-02972ab5b363 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:54.737749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3a7a652-6d86-4131-afb7-02972ab5b363 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:54.738773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3a7a652-6d86-4131-afb7-02972ab5b363 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:54.739538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3a7a652-6d86-4131-afb7-02972ab5b363 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:54.740207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3a7a652-6d86-4131-afb7-02972ab5b363 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:54.862835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a3a7a652-6d86-4131-afb7-02972ab5b363 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:54.886170 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a3a7a652-6d86-4131-afb7-02972ab5b363 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1273 microversion: 2.1 time: 0.182326 Aug 27 04:49:54.890891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c9c90d57-b02c-43c7-ab66-6c4bbdbc3117 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:54.891630 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2034/4045] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:54 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:54.902854 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c9c90d57-b02c-43c7-ab66-6c4bbdbc3117 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 1.005758 Aug 27 04:49:54.903953 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2012/4046] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:53 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:54.921050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9757749a-eccd-40f7-9817-effb3f412495 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:54.923195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9757749a-eccd-40f7-9817-effb3f412495 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:54.964636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9757749a-eccd-40f7-9817-effb3f412495 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:54.965531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9757749a-eccd-40f7-9817-effb3f412495 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:54.966239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9757749a-eccd-40f7-9817-effb3f412495 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:54.967154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9757749a-eccd-40f7-9817-effb3f412495 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:54.968580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9757749a-eccd-40f7-9817-effb3f412495 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:54.969165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9757749a-eccd-40f7-9817-effb3f412495 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:55.501673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9757749a-eccd-40f7-9817-effb3f412495 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:55.535584 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9757749a-eccd-40f7-9817-effb3f412495 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1313 microversion: 2.1 time: 0.642473 Aug 27 04:49:55.536821 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2035/4047] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:54 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1313 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:55.715773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7908f6d4-c863-473e-a9f2-eda131aa36e8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:55.716392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7908f6d4-c863-473e-a9f2-eda131aa36e8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:55.723533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7908f6d4-c863-473e-a9f2-eda131aa36e8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:55.724265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7908f6d4-c863-473e-a9f2-eda131aa36e8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:55.724898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7908f6d4-c863-473e-a9f2-eda131aa36e8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:55.725940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7908f6d4-c863-473e-a9f2-eda131aa36e8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:55.726551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7908f6d4-c863-473e-a9f2-eda131aa36e8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:55.727130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7908f6d4-c863-473e-a9f2-eda131aa36e8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:55.912632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2405a995-a401-47a8-83ab-3d4f9ad42d0d tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:55.914494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2405a995-a401-47a8-83ab-3d4f9ad42d0d tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:55.948011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2405a995-a401-47a8-83ab-3d4f9ad42d0d tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:55.951400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2405a995-a401-47a8-83ab-3d4f9ad42d0d tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:55.951945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2405a995-a401-47a8-83ab-3d4f9ad42d0d tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:55.955921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2405a995-a401-47a8-83ab-3d4f9ad42d0d tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:55.957790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2405a995-a401-47a8-83ab-3d4f9ad42d0d tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:55.959690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2405a995-a401-47a8-83ab-3d4f9ad42d0d tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:56.122616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7908f6d4-c863-473e-a9f2-eda131aa36e8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:56.142771 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7908f6d4-c863-473e-a9f2-eda131aa36e8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1566 microversion: 2.1 time: 0.430726 Aug 27 04:49:56.145037 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2013/4048] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:55 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1566 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:56.155171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c783ce53-03ba-4f03-a11a-9fcc2e4429a9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:56.157621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c783ce53-03ba-4f03-a11a-9fcc2e4429a9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:56.166701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:56.169479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c783ce53-03ba-4f03-a11a-9fcc2e4429a9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:56.170502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c783ce53-03ba-4f03-a11a-9fcc2e4429a9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:56.173393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c783ce53-03ba-4f03-a11a-9fcc2e4429a9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:56.174550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c783ce53-03ba-4f03-a11a-9fcc2e4429a9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:56.176223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c783ce53-03ba-4f03-a11a-9fcc2e4429a9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:56.176904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c783ce53-03ba-4f03-a11a-9fcc2e4429a9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:56.487059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2405a995-a401-47a8-83ab-3d4f9ad42d0d tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:56.498034 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2405a995-a401-47a8-83ab-3d4f9ad42d0d tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1315 microversion: 2.1 time: 0.591278 Aug 27 04:49:56.498670 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2036/4049] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:55 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:56.510454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d36247f3-882b-43bd-9064-a37328cb12e8 req-ab4bb683-5629-4d03-bf7a-369d3eabe11c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42269482-fde5-4428-83f0-351a3b561a4c", "tag": "9b9eca72-142f-4710-929c-ca1a9b01ab1d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:56.526974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d36247f3-882b-43bd-9064-a37328cb12e8 req-ab4bb683-5629-4d03-bf7a-369d3eabe11c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:56.534924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d36247f3-882b-43bd-9064-a37328cb12e8 req-ab4bb683-5629-4d03-bf7a-369d3eabe11c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:56.535435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d36247f3-882b-43bd-9064-a37328cb12e8 req-ab4bb683-5629-4d03-bf7a-369d3eabe11c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:56.565955 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d36247f3-882b-43bd-9064-a37328cb12e8 req-ab4bb683-5629-4d03-bf7a-369d3eabe11c service nova] Creating event network-changed:9b9eca72-142f-4710-929c-ca1a9b01ab1d for instance 42269482-fde5-4428-83f0-351a3b561a4c on n-h1-854823-1 Aug 27 04:49:56.577968 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d36247f3-882b-43bd-9064-a37328cb12e8 req-ab4bb683-5629-4d03-bf7a-369d3eabe11c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078055 Aug 27 04:49:56.580809 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2037/4050] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:56.587018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42b542fc-d7d2-4ba0-97c2-9499ad9f7869 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:56.588033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-42b542fc-d7d2-4ba0-97c2-9499ad9f7869 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:56.614292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b542fc-d7d2-4ba0-97c2-9499ad9f7869 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:56.616353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b542fc-d7d2-4ba0-97c2-9499ad9f7869 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:56.617693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b542fc-d7d2-4ba0-97c2-9499ad9f7869 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:56.623425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b542fc-d7d2-4ba0-97c2-9499ad9f7869 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:56.625390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b542fc-d7d2-4ba0-97c2-9499ad9f7869 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:56.626264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b542fc-d7d2-4ba0-97c2-9499ad9f7869 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:56.733143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c783ce53-03ba-4f03-a11a-9fcc2e4429a9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:56.767164 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c783ce53-03ba-4f03-a11a-9fcc2e4429a9 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.617473 Aug 27 04:49:56.789268 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2014/4051] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:56 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:56.796142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-56a100b2-ef3c-48d9-90f4-fd55b8001979 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:56.797382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-56a100b2-ef3c-48d9-90f4-fd55b8001979 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:56.808125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a100b2-ef3c-48d9-90f4-fd55b8001979 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:56.808950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a100b2-ef3c-48d9-90f4-fd55b8001979 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:56.809722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a100b2-ef3c-48d9-90f4-fd55b8001979 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:56.810583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a100b2-ef3c-48d9-90f4-fd55b8001979 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:56.811257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a100b2-ef3c-48d9-90f4-fd55b8001979 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:56.811881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a100b2-ef3c-48d9-90f4-fd55b8001979 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:56.909092 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42b542fc-d7d2-4ba0-97c2-9499ad9f7869 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.326783 Aug 27 04:49:56.910097 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2038/4052] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 04:49:56 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-interface => generated 285 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:57.336147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-56a100b2-ef3c-48d9-90f4-fd55b8001979 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:57.344132 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-56a100b2-ef3c-48d9-90f4-fd55b8001979 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1313 microversion: 2.1 time: 0.553469 Aug 27 04:49:57.356893 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2015/4053] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:56 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:57.524479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-10fe6669-b45f-48bd-8c1f-b84e60ed20ed tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:57.525179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-10fe6669-b45f-48bd-8c1f-b84e60ed20ed tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:57.534625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10fe6669-b45f-48bd-8c1f-b84e60ed20ed tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:57.535037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10fe6669-b45f-48bd-8c1f-b84e60ed20ed tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:57.536156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10fe6669-b45f-48bd-8c1f-b84e60ed20ed tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:57.537098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10fe6669-b45f-48bd-8c1f-b84e60ed20ed tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:57.537716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10fe6669-b45f-48bd-8c1f-b84e60ed20ed tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:57.538297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10fe6669-b45f-48bd-8c1f-b84e60ed20ed tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:57.793855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-80bbd54f-1951-4c05-9361-b11eb4b0f7d4 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:57.794482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-80bbd54f-1951-4c05-9361-b11eb4b0f7d4 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:57.801475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80bbd54f-1951-4c05-9361-b11eb4b0f7d4 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:57.801973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80bbd54f-1951-4c05-9361-b11eb4b0f7d4 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:57.802417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80bbd54f-1951-4c05-9361-b11eb4b0f7d4 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:57.803148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80bbd54f-1951-4c05-9361-b11eb4b0f7d4 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:57.803617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80bbd54f-1951-4c05-9361-b11eb4b0f7d4 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:57.804054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80bbd54f-1951-4c05-9361-b11eb4b0f7d4 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:58.090960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-80bbd54f-1951-4c05-9361-b11eb4b0f7d4 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:58.107589 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-80bbd54f-1951-4c05-9361-b11eb4b0f7d4 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.314101 Aug 27 04:49:58.108384 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2016/4054] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:57 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:49:58.371849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cde443cd-84fb-4a87-8197-d88b34830272 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:58.372483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cde443cd-84fb-4a87-8197-d88b34830272 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:58.381701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cde443cd-84fb-4a87-8197-d88b34830272 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:58.383081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cde443cd-84fb-4a87-8197-d88b34830272 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:58.383638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cde443cd-84fb-4a87-8197-d88b34830272 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:58.385203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cde443cd-84fb-4a87-8197-d88b34830272 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:58.385787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cde443cd-84fb-4a87-8197-d88b34830272 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:58.386322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cde443cd-84fb-4a87-8197-d88b34830272 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:58.472333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-10fe6669-b45f-48bd-8c1f-b84e60ed20ed tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:58.480518 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-10fe6669-b45f-48bd-8c1f-b84e60ed20ed tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1315 microversion: 2.1 time: 0.963366 Aug 27 04:49:58.494138 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2039/4055] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:57 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1315 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:58.716174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cde443cd-84fb-4a87-8197-d88b34830272 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:58.738018 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cde443cd-84fb-4a87-8197-d88b34830272 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1313 microversion: 2.1 time: 0.373186 Aug 27 04:49:58.738623 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2017/4056] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:58 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:58.867517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-fdffd9f0-aebe-4272-8699-c9a5883b3575 req-62a9648c-3a8e-46a8-b67a-c16fcbc838df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8c8fed-8c77-4276-a9ba-21f1f67280f7", "tag": "17e085ad-fe9d-4aee-95d5-31ed0361f0a9"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:58.885820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fdffd9f0-aebe-4272-8699-c9a5883b3575 req-62a9648c-3a8e-46a8-b67a-c16fcbc838df service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:58.886295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fdffd9f0-aebe-4272-8699-c9a5883b3575 req-62a9648c-3a8e-46a8-b67a-c16fcbc838df service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:58.887430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fdffd9f0-aebe-4272-8699-c9a5883b3575 req-62a9648c-3a8e-46a8-b67a-c16fcbc838df service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:58.903394 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-fdffd9f0-aebe-4272-8699-c9a5883b3575 req-62a9648c-3a8e-46a8-b67a-c16fcbc838df service nova] Creating event network-changed:17e085ad-fe9d-4aee-95d5-31ed0361f0a9 for instance 2b8c8fed-8c77-4276-a9ba-21f1f67280f7 on n-h2-854823-1 Aug 27 04:49:58.909501 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-fdffd9f0-aebe-4272-8699-c9a5883b3575 req-62a9648c-3a8e-46a8-b67a-c16fcbc838df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048342 Aug 27 04:49:58.910387 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2040/4057] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:59.133173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf20df97-7440-4ee6-9115-72c181c5eb42 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:59.134047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bf20df97-7440-4ee6-9115-72c181c5eb42 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:59.141846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf20df97-7440-4ee6-9115-72c181c5eb42 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:59.142629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf20df97-7440-4ee6-9115-72c181c5eb42 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:59.143266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf20df97-7440-4ee6-9115-72c181c5eb42 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:59.144133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf20df97-7440-4ee6-9115-72c181c5eb42 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:59.144775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf20df97-7440-4ee6-9115-72c181c5eb42 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:59.145361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf20df97-7440-4ee6-9115-72c181c5eb42 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:59.506197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-41ceb64e-1f38-400e-ba64-9e81cd8616c9 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:59.507542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41ceb64e-1f38-400e-ba64-9e81cd8616c9 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:49:59.538635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ceb64e-1f38-400e-ba64-9e81cd8616c9 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:59.539546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ceb64e-1f38-400e-ba64-9e81cd8616c9 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:59.541758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ceb64e-1f38-400e-ba64-9e81cd8616c9 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:49:59.544491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ceb64e-1f38-400e-ba64-9e81cd8616c9 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:49:59.547747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ceb64e-1f38-400e-ba64-9e81cd8616c9 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:49:59.549555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ceb64e-1f38-400e-ba64-9e81cd8616c9 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:00.113827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bf20df97-7440-4ee6-9115-72c181c5eb42 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:00.123024 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bf20df97-7440-4ee6-9115-72c181c5eb42 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.993636 Aug 27 04:50:00.123977 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2018/4058] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:59 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:50:00.134315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-892d7a1a-0c65-400f-a297-45b3fc4a89e1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:00.135636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-892d7a1a-0c65-400f-a297-45b3fc4a89e1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:00.147320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-892d7a1a-0c65-400f-a297-45b3fc4a89e1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:00.148151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-892d7a1a-0c65-400f-a297-45b3fc4a89e1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:00.149548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-892d7a1a-0c65-400f-a297-45b3fc4a89e1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:00.150960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-892d7a1a-0c65-400f-a297-45b3fc4a89e1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:00.151617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-892d7a1a-0c65-400f-a297-45b3fc4a89e1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:00.153290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-892d7a1a-0c65-400f-a297-45b3fc4a89e1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:00.162928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-41ceb64e-1f38-400e-ba64-9e81cd8616c9 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:00.210110 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-41ceb64e-1f38-400e-ba64-9e81cd8616c9 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1315 microversion: 2.1 time: 0.712164 Aug 27 04:50:00.211320 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2041/4059] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:59 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:00.964421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cda9a719-0a74-4f3f-929f-9deacb6413ca req-ec681975-f107-4f5a-b4f3-5148e8421228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f74e4f7-e0b8-41cb-88a2-98aff82b1d98", "tag": "63e52c18-d4a3-457e-9877-9a1d70646169"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:00.972078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:00.981198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:00.990434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cda9a719-0a74-4f3f-929f-9deacb6413ca req-ec681975-f107-4f5a-b4f3-5148e8421228 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:00.990918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cda9a719-0a74-4f3f-929f-9deacb6413ca req-ec681975-f107-4f5a-b4f3-5148e8421228 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:00.991351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cda9a719-0a74-4f3f-929f-9deacb6413ca req-ec681975-f107-4f5a-b4f3-5148e8421228 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:01.015099 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cda9a719-0a74-4f3f-929f-9deacb6413ca req-ec681975-f107-4f5a-b4f3-5148e8421228 service nova] Creating event network-changed:63e52c18-d4a3-457e-9877-9a1d70646169 for instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 on n-h1-854823-1 Aug 27 04:50:01.034274 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cda9a719-0a74-4f3f-929f-9deacb6413ca req-ec681975-f107-4f5a-b4f3-5148e8421228 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073581 Aug 27 04:50:01.035114 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2042/4060] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:01.324246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-892d7a1a-0c65-400f-a297-45b3fc4a89e1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:01.354071 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-892d7a1a-0c65-400f-a297-45b3fc4a89e1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1313 microversion: 2.1 time: 1.224978 Aug 27 04:50:01.356412 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2019/4061] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:00 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1313 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:01.376813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5add468a-b5c4-4513-a1c7-1282fd6230fa tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:01.379347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5add468a-b5c4-4513-a1c7-1282fd6230fa tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:01.395178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5add468a-b5c4-4513-a1c7-1282fd6230fa tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:01.397255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1702605915", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1924af5b-d45d-4a6f-8e22-d9bfdab3f645"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:01.397857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5add468a-b5c4-4513-a1c7-1282fd6230fa tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:01.397857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5add468a-b5c4-4513-a1c7-1282fd6230fa tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:01.398861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5add468a-b5c4-4513-a1c7-1282fd6230fa tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:01.399589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5add468a-b5c4-4513-a1c7-1282fd6230fa tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:01.400212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5add468a-b5c4-4513-a1c7-1282fd6230fa tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:01.434952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=10 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:01.488153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] validate_networks() for [('1924af5b-d45d-4a6f-8e22-d9bfdab3f645', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:50:01.942641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5add468a-b5c4-4513-a1c7-1282fd6230fa tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:01.958827 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5add468a-b5c4-4513-a1c7-1282fd6230fa tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1484 microversion: 2.1 time: 0.597287 Aug 27 04:50:01.963525 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2020/4062] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:01 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1484 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:01.977827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e0462fe7-04e1-48b0-9e97-0c3483954a49 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:01.979355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e0462fe7-04e1-48b0-9e97-0c3483954a49 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:01.992897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e0462fe7-04e1-48b0-9e97-0c3483954a49 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:01.993399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e0462fe7-04e1-48b0-9e97-0c3483954a49 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:01.993842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e0462fe7-04e1-48b0-9e97-0c3483954a49 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:01.994631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e0462fe7-04e1-48b0-9e97-0c3483954a49 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:01.997418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e0462fe7-04e1-48b0-9e97-0c3483954a49 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:01.999272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e0462fe7-04e1-48b0-9e97-0c3483954a49 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:02.508457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e0462fe7-04e1-48b0-9e97-0c3483954a49 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:02.530273 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e0462fe7-04e1-48b0-9e97-0c3483954a49 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1315 microversion: 2.1 time: 0.565274 Aug 27 04:50:02.533043 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2021/4063] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:01 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:02.543547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e1a3970d-8076-4c08-a1cc-a1e56eb7535a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:02.546088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e1a3970d-8076-4c08-a1cc-a1e56eb7535a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:02.561708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1a3970d-8076-4c08-a1cc-a1e56eb7535a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:02.562211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1a3970d-8076-4c08-a1cc-a1e56eb7535a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:02.564882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1a3970d-8076-4c08-a1cc-a1e56eb7535a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:02.565861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1a3970d-8076-4c08-a1cc-a1e56eb7535a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:02.566420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1a3970d-8076-4c08-a1cc-a1e56eb7535a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:02.566868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1a3970d-8076-4c08-a1cc-a1e56eb7535a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:02.598575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:50:02.599187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:50:02.599737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:50:02.600211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:50:02.600805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:50:02.635355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:02.638759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:02.639286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:02.642185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:02.644769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:02.646532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:02.678034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:02.725490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Getting quotas for project 2296363eddb045d4abbe01a40e8a76b7. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:50:02.739963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Getting quotas for user 4a2acdb05d6b4e3e9a0102e18cfb8bbb and project 2296363eddb045d4abbe01a40e8a76b7. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:50:02.778628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:50:02.784846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:50:02.821199 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e1a3970d-8076-4c08-a1cc-a1e56eb7535a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "POST /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245/action" status: 202 len: 0 microversion: 2.1 time: 0.286165 Aug 27 04:50:02.828959 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2022/4064] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:50:02 2022] POST /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:50:02.837461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c8b529f0-fb97-439c-b233-a45da7e01cac tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:02.839990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c8b529f0-fb97-439c-b233-a45da7e01cac tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:02.857181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8b529f0-fb97-439c-b233-a45da7e01cac tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:02.858027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8b529f0-fb97-439c-b233-a45da7e01cac tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:02.873870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8b529f0-fb97-439c-b233-a45da7e01cac tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:02.875845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8b529f0-fb97-439c-b233-a45da7e01cac tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:02.879441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8b529f0-fb97-439c-b233-a45da7e01cac tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:02.882391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8b529f0-fb97-439c-b233-a45da7e01cac tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:02.941822 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca7c2861-49a9-45b8-8976-b3c38816c6ad tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.823937 Aug 27 04:50:02.954275 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2043/4065] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:50:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:50:02.958246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97b94557-2b73-42ef-8eb8-010662d39c2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:02.958927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97b94557-2b73-42ef-8eb8-010662d39c2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:02.977944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97b94557-2b73-42ef-8eb8-010662d39c2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:02.982007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97b94557-2b73-42ef-8eb8-010662d39c2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:02.982642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97b94557-2b73-42ef-8eb8-010662d39c2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:02.984670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97b94557-2b73-42ef-8eb8-010662d39c2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:02.998391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97b94557-2b73-42ef-8eb8-010662d39c2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:02.998864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97b94557-2b73-42ef-8eb8-010662d39c2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:03.510052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97b94557-2b73-42ef-8eb8-010662d39c2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:03.523004 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97b94557-2b73-42ef-8eb8-010662d39c2f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1492 microversion: 2.1 time: 0.566912 Aug 27 04:50:03.524381 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2044/4066] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:02 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1492 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:03.531799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-698991642", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1924af5b-d45d-4a6f-8e22-d9bfdab3f645"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:03.655749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] validate_networks() for [('1924af5b-d45d-4a6f-8e22-d9bfdab3f645', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:50:03.907222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c8b529f0-fb97-439c-b233-a45da7e01cac tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:03.921059 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c8b529f0-fb97-439c-b233-a45da7e01cac tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1313 microversion: 2.1 time: 1.090341 Aug 27 04:50:03.934283 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2023/4067] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:02 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1313 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:03.939887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-16b2a103-e424-47fb-9ea0-6ff63594d3ce tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:03.940581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-16b2a103-e424-47fb-9ea0-6ff63594d3ce tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:03.958135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16b2a103-e424-47fb-9ea0-6ff63594d3ce tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:03.961475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16b2a103-e424-47fb-9ea0-6ff63594d3ce tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:03.962327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16b2a103-e424-47fb-9ea0-6ff63594d3ce tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:03.964872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16b2a103-e424-47fb-9ea0-6ff63594d3ce tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:03.966215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16b2a103-e424-47fb-9ea0-6ff63594d3ce tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:03.967554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16b2a103-e424-47fb-9ea0-6ff63594d3ce tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:05.022717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:50:05.024185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:50:05.024709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:50:05.025124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:50:05.025539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:50:05.030535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-16b2a103-e424-47fb-9ea0-6ff63594d3ce tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:05.044358 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-16b2a103-e424-47fb-9ea0-6ff63594d3ce tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1315 microversion: 2.1 time: 1.112445 Aug 27 04:50:05.046434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:05.047684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:05.050248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:05.051094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:05.051572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:05.053826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:05.058422 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2024/4068] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:03 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1315 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:05.066361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ad716847-66bb-4978-b1ef-63554bec306a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:05.067349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ad716847-66bb-4978-b1ef-63554bec306a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:05.076068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad716847-66bb-4978-b1ef-63554bec306a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:05.076953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad716847-66bb-4978-b1ef-63554bec306a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:05.077615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad716847-66bb-4978-b1ef-63554bec306a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:05.079790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad716847-66bb-4978-b1ef-63554bec306a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:05.080497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad716847-66bb-4978-b1ef-63554bec306a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:05.081218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad716847-66bb-4978-b1ef-63554bec306a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:05.117467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Getting quotas for project 2296363eddb045d4abbe01a40e8a76b7. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:50:05.131340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Getting quotas for user 4a2acdb05d6b4e3e9a0102e18cfb8bbb and project 2296363eddb045d4abbe01a40e8a76b7. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:50:05.150660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:50:05.154114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 925af2b3-d33a-4284-ad7b-56e22964c16a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:50:05.250576 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-345daebc-6c76-4c8b-bc06-910c525d0d75 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.723325 Aug 27 04:50:05.251594 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2045/4069] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:50:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:50:05.265799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f10cf0e-a3d3-4431-b7f2-8a39c9e25b13 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:05.266923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f10cf0e-a3d3-4431-b7f2-8a39c9e25b13 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:05.291204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f10cf0e-a3d3-4431-b7f2-8a39c9e25b13 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:05.296060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f10cf0e-a3d3-4431-b7f2-8a39c9e25b13 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:05.299386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f10cf0e-a3d3-4431-b7f2-8a39c9e25b13 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:05.300784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f10cf0e-a3d3-4431-b7f2-8a39c9e25b13 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:05.302552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f10cf0e-a3d3-4431-b7f2-8a39c9e25b13 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:05.315891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f10cf0e-a3d3-4431-b7f2-8a39c9e25b13 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:05.647997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ad716847-66bb-4978-b1ef-63554bec306a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:05.668072 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ad716847-66bb-4978-b1ef-63554bec306a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1492 microversion: 2.1 time: 0.603196 Aug 27 04:50:05.668402 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2025/4070] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:05 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1492 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:05.683642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1365815887", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "451", "networks": [{"uuid": "1924af5b-d45d-4a6f-8e22-d9bfdab3f645"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:05.787204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] validate_networks() for [('1924af5b-d45d-4a6f-8e22-d9bfdab3f645', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:50:06.588071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f10cf0e-a3d3-4431-b7f2-8a39c9e25b13 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:06.618521 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f10cf0e-a3d3-4431-b7f2-8a39c9e25b13 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1313 microversion: 2.1 time: 1.364022 Aug 27 04:50:06.651736 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2046/4071] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:05 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1313 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:06.718163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d5b7cfe-2c90-4b7b-81f3-8a1859135b87 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:06.718803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d5b7cfe-2c90-4b7b-81f3-8a1859135b87 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:06.748961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d5b7cfe-2c90-4b7b-81f3-8a1859135b87 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:06.755385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d5b7cfe-2c90-4b7b-81f3-8a1859135b87 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:06.756635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d5b7cfe-2c90-4b7b-81f3-8a1859135b87 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:06.757726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d5b7cfe-2c90-4b7b-81f3-8a1859135b87 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:06.758476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d5b7cfe-2c90-4b7b-81f3-8a1859135b87 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:06.764716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d5b7cfe-2c90-4b7b-81f3-8a1859135b87 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:07.623202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d5b7cfe-2c90-4b7b-81f3-8a1859135b87 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:07.633669 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d5b7cfe-2c90-4b7b-81f3-8a1859135b87 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1315 microversion: 2.1 time: 0.978058 Aug 27 04:50:07.646112 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2047/4072] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:06 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1315 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:07.649745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdcb2de4-2b07-45ed-9ff4-e6b58e3ebac2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:07.649745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bdcb2de4-2b07-45ed-9ff4-e6b58e3ebac2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:07.672453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdcb2de4-2b07-45ed-9ff4-e6b58e3ebac2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:07.672981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdcb2de4-2b07-45ed-9ff4-e6b58e3ebac2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:07.673419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdcb2de4-2b07-45ed-9ff4-e6b58e3ebac2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:07.676335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdcb2de4-2b07-45ed-9ff4-e6b58e3ebac2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:07.678049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdcb2de4-2b07-45ed-9ff4-e6b58e3ebac2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:07.679154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdcb2de4-2b07-45ed-9ff4-e6b58e3ebac2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:08.964330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdcb2de4-2b07-45ed-9ff4-e6b58e3ebac2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:08.975486 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdcb2de4-2b07-45ed-9ff4-e6b58e3ebac2 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1498 microversion: 2.1 time: 1.335112 Aug 27 04:50:08.979479 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2048/4073] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:07 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1498 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:08.991198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-188f2870-7296-4e88-81bd-1ea89084249a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:08.992298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-188f2870-7296-4e88-81bd-1ea89084249a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:09.012666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:50:09.013237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:50:09.013560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:50:09.014289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:50:09.016078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:50:09.016703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-188f2870-7296-4e88-81bd-1ea89084249a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:09.017319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-188f2870-7296-4e88-81bd-1ea89084249a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:09.020137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-188f2870-7296-4e88-81bd-1ea89084249a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:09.021014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-188f2870-7296-4e88-81bd-1ea89084249a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:09.021800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-188f2870-7296-4e88-81bd-1ea89084249a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:09.023620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-188f2870-7296-4e88-81bd-1ea89084249a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:09.034791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:09.035491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:09.036115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:09.037500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:09.038533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:09.039124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:09.067506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Getting quotas for project 2296363eddb045d4abbe01a40e8a76b7. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:50:09.078277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Getting quotas for user 4a2acdb05d6b4e3e9a0102e18cfb8bbb and project 2296363eddb045d4abbe01a40e8a76b7. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:50:09.107047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:50:09.110303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:50:09.213770 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9acc12db-9bd5-42f0-8a58-a51c781f8e47 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.540439 Aug 27 04:50:09.215623 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2026/4074] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:50:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:50:09.230815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-cd735032-55e7-40eb-a16c-b21b3c856c3a req-1c143ba5-36a0-4ef6-8781-c651b0efb616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42269482-fde5-4428-83f0-351a3b561a4c", "name": "network-vif-plugged", "status": "completed", "tag": "9b9eca72-142f-4710-929c-ca1a9b01ab1d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:09.248911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cd735032-55e7-40eb-a16c-b21b3c856c3a req-1c143ba5-36a0-4ef6-8781-c651b0efb616 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:09.249626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cd735032-55e7-40eb-a16c-b21b3c856c3a req-1c143ba5-36a0-4ef6-8781-c651b0efb616 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:09.250338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cd735032-55e7-40eb-a16c-b21b3c856c3a req-1c143ba5-36a0-4ef6-8781-c651b0efb616 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:09.268817 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-cd735032-55e7-40eb-a16c-b21b3c856c3a req-1c143ba5-36a0-4ef6-8781-c651b0efb616 service nova] Creating event network-vif-plugged:9b9eca72-142f-4710-929c-ca1a9b01ab1d for instance 42269482-fde5-4428-83f0-351a3b561a4c on n-h1-854823-1 Aug 27 04:50:09.275150 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-cd735032-55e7-40eb-a16c-b21b3c856c3a req-1c143ba5-36a0-4ef6-8781-c651b0efb616 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056844 Aug 27 04:50:09.278354 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2027/4075] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:09.284308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31defbe0-fabd-459e-b70e-3cf9891e77c6 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:09.285253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-31defbe0-fabd-459e-b70e-3cf9891e77c6 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:09.309988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31defbe0-fabd-459e-b70e-3cf9891e77c6 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:09.310797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31defbe0-fabd-459e-b70e-3cf9891e77c6 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:09.311390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31defbe0-fabd-459e-b70e-3cf9891e77c6 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:09.312281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31defbe0-fabd-459e-b70e-3cf9891e77c6 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:09.312959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31defbe0-fabd-459e-b70e-3cf9891e77c6 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:09.313533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31defbe0-fabd-459e-b70e-3cf9891e77c6 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:09.862399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-188f2870-7296-4e88-81bd-1ea89084249a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:09.872464 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-188f2870-7296-4e88-81bd-1ea89084249a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1313 microversion: 2.1 time: 0.890252 Aug 27 04:50:09.875293 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2049/4076] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:08 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1313 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:09.896457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60928442-ba3d-44f6-8ebc-d90dc8b8bcb6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:09.898169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60928442-ba3d-44f6-8ebc-d90dc8b8bcb6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:09.905823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60928442-ba3d-44f6-8ebc-d90dc8b8bcb6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:09.907104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60928442-ba3d-44f6-8ebc-d90dc8b8bcb6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:09.907776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60928442-ba3d-44f6-8ebc-d90dc8b8bcb6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:09.908928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60928442-ba3d-44f6-8ebc-d90dc8b8bcb6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:09.909614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60928442-ba3d-44f6-8ebc-d90dc8b8bcb6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:09.910280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60928442-ba3d-44f6-8ebc-d90dc8b8bcb6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:09.986287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60928442-ba3d-44f6-8ebc-d90dc8b8bcb6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:50:10.249410 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60928442-ba3d-44f6-8ebc-d90dc8b8bcb6 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 204 len: 0 microversion: 2.1 time: 0.358284 Aug 27 04:50:10.250190 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2050/4077] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:50:09 2022] DELETE /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:50:10.274152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e133500-7a38-4884-bf3e-cf5eef844d71 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:10.275768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e133500-7a38-4884-bf3e-cf5eef844d71 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:10.290140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e133500-7a38-4884-bf3e-cf5eef844d71 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:10.316035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e133500-7a38-4884-bf3e-cf5eef844d71 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:10.317825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e133500-7a38-4884-bf3e-cf5eef844d71 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:10.318670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e133500-7a38-4884-bf3e-cf5eef844d71 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:10.319466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e133500-7a38-4884-bf3e-cf5eef844d71 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:10.320015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e133500-7a38-4884-bf3e-cf5eef844d71 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:10.491170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-31defbe0-fabd-459e-b70e-3cf9891e77c6 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:10.499690 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-31defbe0-fabd-459e-b70e-3cf9891e77c6 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1315 microversion: 2.1 time: 1.219903 Aug 27 04:50:10.500280 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2028/4078] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:09 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1315 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:10.516633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53a3fa46-fa02-4cc2-bbd5-d9f005f3b62e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:10.517466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-53a3fa46-fa02-4cc2-bbd5-d9f005f3b62e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:10.528163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a3fa46-fa02-4cc2-bbd5-d9f005f3b62e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:10.532647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a3fa46-fa02-4cc2-bbd5-d9f005f3b62e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:10.533386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a3fa46-fa02-4cc2-bbd5-d9f005f3b62e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:10.536629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a3fa46-fa02-4cc2-bbd5-d9f005f3b62e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:10.537365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a3fa46-fa02-4cc2-bbd5-d9f005f3b62e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:10.539951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a3fa46-fa02-4cc2-bbd5-d9f005f3b62e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:10.555055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:10.677473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7e133500-7a38-4884-bf3e-cf5eef844d71 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:10.690727 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e133500-7a38-4884-bf3e-cf5eef844d71 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1217 microversion: 2.1 time: 0.438816 Aug 27 04:50:10.692550 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2051/4079] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:10 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1217 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:10.900087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-51cb1930-8f45-4377-a2bd-d7d992523556 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:10.900761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-51cb1930-8f45-4377-a2bd-d7d992523556 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:10.913637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51cb1930-8f45-4377-a2bd-d7d992523556 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:10.913637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51cb1930-8f45-4377-a2bd-d7d992523556 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:10.913981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51cb1930-8f45-4377-a2bd-d7d992523556 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:10.914700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51cb1930-8f45-4377-a2bd-d7d992523556 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:10.915384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51cb1930-8f45-4377-a2bd-d7d992523556 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:10.916510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51cb1930-8f45-4377-a2bd-d7d992523556 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:11.076098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53a3fa46-fa02-4cc2-bbd5-d9f005f3b62e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:11.087572 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-53a3fa46-fa02-4cc2-bbd5-d9f005f3b62e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.577540 Aug 27 04:50:11.091671 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2029/4080] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:10 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:11.361277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-51cb1930-8f45-4377-a2bd-d7d992523556 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:11.371532 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-51cb1930-8f45-4377-a2bd-d7d992523556 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1313 microversion: 2.1 time: 0.475005 Aug 27 04:50:11.373896 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2052/4081] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:10 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:11.537286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c3652156-502d-461b-852b-f6b4b00f8949 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:11.537942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c3652156-502d-461b-852b-f6b4b00f8949 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:11.560941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3652156-502d-461b-852b-f6b4b00f8949 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:11.563118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3652156-502d-461b-852b-f6b4b00f8949 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:11.564893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3652156-502d-461b-852b-f6b4b00f8949 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:11.581218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3652156-502d-461b-852b-f6b4b00f8949 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:11.583681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3652156-502d-461b-852b-f6b4b00f8949 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:11.584911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3652156-502d-461b-852b-f6b4b00f8949 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:11.721036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f253ae67-a471-44cb-9dcb-daaa92d887c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:11.721717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f253ae67-a471-44cb-9dcb-daaa92d887c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:11.724184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:11.739566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f253ae67-a471-44cb-9dcb-daaa92d887c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:11.740256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f253ae67-a471-44cb-9dcb-daaa92d887c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:11.741822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f253ae67-a471-44cb-9dcb-daaa92d887c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:11.743311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f253ae67-a471-44cb-9dcb-daaa92d887c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:11.744396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f253ae67-a471-44cb-9dcb-daaa92d887c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:11.745095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f253ae67-a471-44cb-9dcb-daaa92d887c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:11.969677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f253ae67-a471-44cb-9dcb-daaa92d887c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:11.985038 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f253ae67-a471-44cb-9dcb-daaa92d887c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1273 microversion: 2.1 time: 0.267543 Aug 27 04:50:11.985697 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2053/4082] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:11 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1273 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:50:11.999843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-914372f6-2bde-4d1f-9d61-c7b56edfd7a6 req-2eecc78b-df73-4b27-b0e8-3581065bccb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8c8fed-8c77-4276-a9ba-21f1f67280f7", "name": "network-vif-plugged", "status": "completed", "tag": "17e085ad-fe9d-4aee-95d5-31ed0361f0a9"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:12.002264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c3652156-502d-461b-852b-f6b4b00f8949 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:12.020248 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c3652156-502d-461b-852b-f6b4b00f8949 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1315 microversion: 2.1 time: 0.501349 Aug 27 04:50:12.033729 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2030/4083] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:11 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:12.036212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-914372f6-2bde-4d1f-9d61-c7b56edfd7a6 req-2eecc78b-df73-4b27-b0e8-3581065bccb4 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:12.044503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-914372f6-2bde-4d1f-9d61-c7b56edfd7a6 req-2eecc78b-df73-4b27-b0e8-3581065bccb4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:12.045068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-914372f6-2bde-4d1f-9d61-c7b56edfd7a6 req-2eecc78b-df73-4b27-b0e8-3581065bccb4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:12.090446 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-914372f6-2bde-4d1f-9d61-c7b56edfd7a6 req-2eecc78b-df73-4b27-b0e8-3581065bccb4 service nova] Creating event network-vif-plugged:17e085ad-fe9d-4aee-95d5-31ed0361f0a9 for instance 2b8c8fed-8c77-4276-a9ba-21f1f67280f7 on n-h2-854823-1 Aug 27 04:50:12.103529 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-914372f6-2bde-4d1f-9d61-c7b56edfd7a6 req-2eecc78b-df73-4b27-b0e8-3581065bccb4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116131 Aug 27 04:50:12.107644 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2054/4084] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:12.113838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dd86d018-edfd-43aa-b3be-7338b4989b91 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:12.114545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dd86d018-edfd-43aa-b3be-7338b4989b91 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:12.133752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd86d018-edfd-43aa-b3be-7338b4989b91 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:12.134274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd86d018-edfd-43aa-b3be-7338b4989b91 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:12.138533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd86d018-edfd-43aa-b3be-7338b4989b91 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:12.139692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd86d018-edfd-43aa-b3be-7338b4989b91 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:12.141352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd86d018-edfd-43aa-b3be-7338b4989b91 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:12.142713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd86d018-edfd-43aa-b3be-7338b4989b91 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:12.367410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-56679022-0ee5-4f0e-b927-57a620ec8d14 req-22d18ac0-da67-4b20-af10-60439eea71ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3487346f-0dd9-4f96-8767-7a6a92608ea5", "tag": "a70e0fee-0241-48bc-90b8-53d756c94971"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:12.416975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-56679022-0ee5-4f0e-b927-57a620ec8d14 req-22d18ac0-da67-4b20-af10-60439eea71ba service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:12.425147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-56679022-0ee5-4f0e-b927-57a620ec8d14 req-22d18ac0-da67-4b20-af10-60439eea71ba service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:12.425644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-56679022-0ee5-4f0e-b927-57a620ec8d14 req-22d18ac0-da67-4b20-af10-60439eea71ba service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:12.461177 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-56679022-0ee5-4f0e-b927-57a620ec8d14 req-22d18ac0-da67-4b20-af10-60439eea71ba service nova] Creating event network-changed:a70e0fee-0241-48bc-90b8-53d756c94971 for instance 3487346f-0dd9-4f96-8767-7a6a92608ea5 on n-h1-854823-1 Aug 27 04:50:12.471287 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-56679022-0ee5-4f0e-b927-57a620ec8d14 req-22d18ac0-da67-4b20-af10-60439eea71ba service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108046 Aug 27 04:50:12.475156 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2055/4085] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:12.484841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7fa6fe40-c264-4296-988e-acd54b1bafc1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:12.485565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7fa6fe40-c264-4296-988e-acd54b1bafc1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:12.513725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fa6fe40-c264-4296-988e-acd54b1bafc1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:12.516255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fa6fe40-c264-4296-988e-acd54b1bafc1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:12.517005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fa6fe40-c264-4296-988e-acd54b1bafc1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:12.519560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fa6fe40-c264-4296-988e-acd54b1bafc1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:12.520273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fa6fe40-c264-4296-988e-acd54b1bafc1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:12.521516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fa6fe40-c264-4296-988e-acd54b1bafc1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:13.151942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dd86d018-edfd-43aa-b3be-7338b4989b91 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:13.162493 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dd86d018-edfd-43aa-b3be-7338b4989b91 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 1.053710 Aug 27 04:50:13.175423 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2031/4086] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:12 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:13.241083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fabfbba6-38f4-423b-befb-b93ad3177c33 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:13.243417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fabfbba6-38f4-423b-befb-b93ad3177c33 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:13.274648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabfbba6-38f4-423b-befb-b93ad3177c33 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:13.275334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabfbba6-38f4-423b-befb-b93ad3177c33 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:13.276299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabfbba6-38f4-423b-befb-b93ad3177c33 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:13.279375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabfbba6-38f4-423b-befb-b93ad3177c33 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:13.280168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabfbba6-38f4-423b-befb-b93ad3177c33 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:13.280792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabfbba6-38f4-423b-befb-b93ad3177c33 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:13.459886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fabfbba6-38f4-423b-befb-b93ad3177c33 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:13.464422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7fa6fe40-c264-4296-988e-acd54b1bafc1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:13.492459 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7fa6fe40-c264-4296-988e-acd54b1bafc1 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1463 microversion: 2.1 time: 1.016760 Aug 27 04:50:13.494443 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fabfbba6-38f4-423b-befb-b93ad3177c33 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1279 microversion: 2.1 time: 0.317619 Aug 27 04:50:13.496857 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2032/4087] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:13 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1279 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:13.497273 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2056/4088] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:12 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1463 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:13.502840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0272c342-1b5a-409d-b6fd-e5bf01968ddd tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:13.503952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0272c342-1b5a-409d-b6fd-e5bf01968ddd tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:13.532586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0272c342-1b5a-409d-b6fd-e5bf01968ddd tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:13.532586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0272c342-1b5a-409d-b6fd-e5bf01968ddd tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:13.532983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0272c342-1b5a-409d-b6fd-e5bf01968ddd tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:13.536027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c8a40787-34d7-4c87-8c92-0f825f98f559 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6663a08f-d2ea-40f5-bb32-22c6b595f289", "device": "/dev/sdb"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:13.538009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0272c342-1b5a-409d-b6fd-e5bf01968ddd tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:13.538730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0272c342-1b5a-409d-b6fd-e5bf01968ddd tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:13.539186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0272c342-1b5a-409d-b6fd-e5bf01968ddd tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:13.540150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c8a40787-34d7-4c87-8c92-0f825f98f559 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:13.549150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8a40787-34d7-4c87-8c92-0f825f98f559 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:13.549854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8a40787-34d7-4c87-8c92-0f825f98f559 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:13.550564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8a40787-34d7-4c87-8c92-0f825f98f559 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:13.551478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8a40787-34d7-4c87-8c92-0f825f98f559 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:13.552123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8a40787-34d7-4c87-8c92-0f825f98f559 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:13.552770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8a40787-34d7-4c87-8c92-0f825f98f559 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:14.109804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0272c342-1b5a-409d-b6fd-e5bf01968ddd tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:14.134755 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0272c342-1b5a-409d-b6fd-e5bf01968ddd tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1315 microversion: 2.1 time: 0.627147 Aug 27 04:50:14.151708 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2057/4089] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:13 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:14.184064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2a85d31-3580-4829-abcc-395257d7cf72 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:14.184727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2a85d31-3580-4829-abcc-395257d7cf72 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:14.201254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a85d31-3580-4829-abcc-395257d7cf72 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:14.201606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a85d31-3580-4829-abcc-395257d7cf72 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:14.202221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a85d31-3580-4829-abcc-395257d7cf72 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:14.203180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a85d31-3580-4829-abcc-395257d7cf72 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:14.203804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a85d31-3580-4829-abcc-395257d7cf72 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:14.204405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a85d31-3580-4829-abcc-395257d7cf72 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:14.226968 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c8a40787-34d7-4c87-8c92-0f825f98f559 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "POST /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.696219 Aug 27 04:50:14.229454 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2033/4090] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 04:50:13 2022] POST /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:14.536414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1d379507-d16e-4415-8c97-62a368013131 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:14.537783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1d379507-d16e-4415-8c97-62a368013131 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:14.549949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d379507-d16e-4415-8c97-62a368013131 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:14.554602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d379507-d16e-4415-8c97-62a368013131 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:14.555531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d379507-d16e-4415-8c97-62a368013131 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:14.556436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d379507-d16e-4415-8c97-62a368013131 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:14.557092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d379507-d16e-4415-8c97-62a368013131 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:14.559266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d379507-d16e-4415-8c97-62a368013131 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:14.582847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2a85d31-3580-4829-abcc-395257d7cf72 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:14.600364 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2a85d31-3580-4829-abcc-395257d7cf72 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.420824 Aug 27 04:50:14.615079 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2058/4091] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:14 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:14.869822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1d379507-d16e-4415-8c97-62a368013131 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:14.886109 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1d379507-d16e-4415-8c97-62a368013131 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1279 microversion: 2.1 time: 0.354464 Aug 27 04:50:14.887010 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2034/4092] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:14 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1279 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:50:15.158543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c9218d6-75ac-4b5e-a9c2-69a515c37173 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:15.159667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c9218d6-75ac-4b5e-a9c2-69a515c37173 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:15.162388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:15.166310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:15.189667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9218d6-75ac-4b5e-a9c2-69a515c37173 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:15.191623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9218d6-75ac-4b5e-a9c2-69a515c37173 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:15.194566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9218d6-75ac-4b5e-a9c2-69a515c37173 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:15.196098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9218d6-75ac-4b5e-a9c2-69a515c37173 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:15.203649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9218d6-75ac-4b5e-a9c2-69a515c37173 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:15.205778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9218d6-75ac-4b5e-a9c2-69a515c37173 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:15.623257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a133b48e-d5e1-4a6f-8684-b2b95322ed68 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:15.628712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a133b48e-d5e1-4a6f-8684-b2b95322ed68 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:15.646514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a133b48e-d5e1-4a6f-8684-b2b95322ed68 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:15.647198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a133b48e-d5e1-4a6f-8684-b2b95322ed68 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:15.647803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a133b48e-d5e1-4a6f-8684-b2b95322ed68 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:15.652478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a133b48e-d5e1-4a6f-8684-b2b95322ed68 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:15.653214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a133b48e-d5e1-4a6f-8684-b2b95322ed68 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:15.653846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a133b48e-d5e1-4a6f-8684-b2b95322ed68 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:16.043396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c9218d6-75ac-4b5e-a9c2-69a515c37173 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:16.084303 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c9218d6-75ac-4b5e-a9c2-69a515c37173 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1315 microversion: 2.1 time: 0.930538 Aug 27 04:50:16.104554 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2059/4093] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:15 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1315 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:16.114160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dce8af90-88c3-419d-8332-5491850bceb8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:16.115223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dce8af90-88c3-419d-8332-5491850bceb8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:16.133402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dce8af90-88c3-419d-8332-5491850bceb8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:16.133916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dce8af90-88c3-419d-8332-5491850bceb8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:16.134366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dce8af90-88c3-419d-8332-5491850bceb8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:16.135171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dce8af90-88c3-419d-8332-5491850bceb8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:16.135893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dce8af90-88c3-419d-8332-5491850bceb8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:16.136000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dce8af90-88c3-419d-8332-5491850bceb8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:16.481121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a133b48e-d5e1-4a6f-8684-b2b95322ed68 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:16.505383 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a133b48e-d5e1-4a6f-8684-b2b95322ed68 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 200 len: 1504 microversion: 2.1 time: 0.884532 Aug 27 04:50:16.506933 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2035/4094] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:15 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 1504 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:16.511933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-cecb81c7-b87a-4266-8376-864a3d572854 req-b65f84ba-371a-4fec-a362-51154d258f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c1d304-3585-4b2b-bde6-282014fb3245", "name": "network-vif-deleted", "tag": "f649fe61-cad6-4f1d-835a-d614f680ab8f"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:16.549588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cecb81c7-b87a-4266-8376-864a3d572854 req-b65f84ba-371a-4fec-a362-51154d258f21 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:16.549588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cecb81c7-b87a-4266-8376-864a3d572854 req-b65f84ba-371a-4fec-a362-51154d258f21 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:16.549588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cecb81c7-b87a-4266-8376-864a3d572854 req-b65f84ba-371a-4fec-a362-51154d258f21 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:16.582945 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-cecb81c7-b87a-4266-8376-864a3d572854 req-b65f84ba-371a-4fec-a362-51154d258f21 service nova] Creating event network-vif-deleted:f649fe61-cad6-4f1d-835a-d614f680ab8f for instance f7c1d304-3585-4b2b-bde6-282014fb3245 on n-h2-854823-1 Aug 27 04:50:16.587899 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-cecb81c7-b87a-4266-8376-864a3d572854 req-b65f84ba-371a-4fec-a362-51154d258f21 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079758 Aug 27 04:50:16.588844 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2036/4095] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:16.972876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dce8af90-88c3-419d-8332-5491850bceb8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:16.976630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:16.986665 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dce8af90-88c3-419d-8332-5491850bceb8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1321 microversion: 2.1 time: 0.889476 Aug 27 04:50:16.990994 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2060/4096] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:16 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1321 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:17.113356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-412aa674-f0b0-4394-916a-aab4120b3795 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:17.114198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-412aa674-f0b0-4394-916a-aab4120b3795 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:17.125428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:17.128954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-412aa674-f0b0-4394-916a-aab4120b3795 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:17.133134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-412aa674-f0b0-4394-916a-aab4120b3795 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:17.133702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-412aa674-f0b0-4394-916a-aab4120b3795 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:17.134594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-412aa674-f0b0-4394-916a-aab4120b3795 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:17.140651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-412aa674-f0b0-4394-916a-aab4120b3795 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:17.142082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-412aa674-f0b0-4394-916a-aab4120b3795 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:17.517987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-412aa674-f0b0-4394-916a-aab4120b3795 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:17.526519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c502b95d-0752-48a7-8049-18121b4cb5ed tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:17.528249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c502b95d-0752-48a7-8049-18121b4cb5ed tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: f7c1d304-3585-4b2b-bde6-282014fb3245] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:17.541823 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-412aa674-f0b0-4394-916a-aab4120b3795 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1503 microversion: 2.1 time: 0.433730 Aug 27 04:50:17.571361 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2037/4097] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:17 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1503 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:17.576379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c502b95d-0752-48a7-8049-18121b4cb5ed tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:17.576982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c502b95d-0752-48a7-8049-18121b4cb5ed tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:17.577455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c502b95d-0752-48a7-8049-18121b4cb5ed tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:17.594513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c502b95d-0752-48a7-8049-18121b4cb5ed tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:17.595142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c502b95d-0752-48a7-8049-18121b4cb5ed tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:17.595654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c502b95d-0752-48a7-8049-18121b4cb5ed tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:17.597600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-78e41c33-0e83-4117-9936-43760d990725 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:17.598101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-78e41c33-0e83-4117-9936-43760d990725 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:17.616816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78e41c33-0e83-4117-9936-43760d990725 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:17.617287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78e41c33-0e83-4117-9936-43760d990725 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:17.634884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78e41c33-0e83-4117-9936-43760d990725 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:17.641540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78e41c33-0e83-4117-9936-43760d990725 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:17.642032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78e41c33-0e83-4117-9936-43760d990725 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:17.642468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78e41c33-0e83-4117-9936-43760d990725 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:17.669057 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c502b95d-0752-48a7-8049-18121b4cb5ed tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] HTTP exception thrown: Instance f7c1d304-3585-4b2b-bde6-282014fb3245 could not be found. Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c502b95d-0752-48a7-8049-18121b4cb5ed tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Request method failure captured: Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 HTTP/1.1 Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaILlHpHnECQ-VAUyUizxijO1yjHUYHLwCUBHpG26rVE34GZ6HsiR1DLT7CbrV6mvytjT8T-fPJYgCUyl5Eo67eX1QdlcimUYQ2eqak0hFflYznLzGWuXDTaG4zSk9hMeap82K1oyDeB_cYt3KPKDlaZc_5b4i-CEa631RsiyVUYe8c Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: ff524508e53d4e69bc37ffb928486e1c Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerRescueTestJSON-259594059 Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff524508e53d4e69bc37ffb928486e1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ff524508e53d4e69bc37ffb928486e1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ff524508e53d4e69bc37ffb928486e1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff524508e53d4e69bc37ffb928486e1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerRescueTestJSON-259594059 Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: ff524508e53d4e69bc37ffb928486e1c Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerRescueTestJSON-259594059 Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerRescueTestJSON-259594059-project Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 902983c84d2f4c60a469ae3be1795646 Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerRescueTestJSON-259594059-project Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance f7c1d304-3585-4b2b-bde6-282014fb3245 could not be found. Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'f7c1d304-3585-4b2b-bde6-282014fb3245'} Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7c1d304-3585-4b2b-bde6-282014fb3245 could not be found. Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7c1d304-3585-4b2b-bde6-282014fb3245 could not be found. Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:50:17.670831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:50:17.674916 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:50:17.674916 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:50:17.674916 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:50:17.674916 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:50:17.674916 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:50:17.674916 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7c1d304-3585-4b2b-bde6-282014fb3245 could not be found. Aug 27 04:50:17.674916 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:50:17.674916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c502b95d-0752-48a7-8049-18121b4cb5ed tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Returning 404 to user: Instance f7c1d304-3585-4b2b-bde6-282014fb3245 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:50:17.674916 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c502b95d-0752-48a7-8049-18121b4cb5ed tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245" status: 404 len: 111 microversion: 2.1 time: 0.150055 Aug 27 04:50:17.691493 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2061/4098] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:17 2022] GET /compute/v2.1/servers/f7c1d304-3585-4b2b-bde6-282014fb3245 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:50:17.702888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c834fe5a-77e8-48c2-a3e9-244e0986c632 req-7c7d29fc-34e8-423d-b08e-9883fd0af500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "925af2b3-d33a-4284-ad7b-56e22964c16a", "tag": "65bc142a-6e78-4b74-804d-815d545a3f03"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:17.742340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c834fe5a-77e8-48c2-a3e9-244e0986c632 req-7c7d29fc-34e8-423d-b08e-9883fd0af500 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:17.742851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c834fe5a-77e8-48c2-a3e9-244e0986c632 req-7c7d29fc-34e8-423d-b08e-9883fd0af500 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:17.743300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c834fe5a-77e8-48c2-a3e9-244e0986c632 req-7c7d29fc-34e8-423d-b08e-9883fd0af500 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:17.779854 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c834fe5a-77e8-48c2-a3e9-244e0986c632 req-7c7d29fc-34e8-423d-b08e-9883fd0af500 service nova] Creating event network-changed:65bc142a-6e78-4b74-804d-815d545a3f03 for instance 925af2b3-d33a-4284-ad7b-56e22964c16a on n-h2-854823-1 Aug 27 04:50:17.794368 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c834fe5a-77e8-48c2-a3e9-244e0986c632 req-7c7d29fc-34e8-423d-b08e-9883fd0af500 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101505 Aug 27 04:50:17.795607 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2062/4099] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:17.801210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9013c75-ea2b-4b7e-a1ad-efbc39058c19 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:17.807446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9013c75-ea2b-4b7e-a1ad-efbc39058c19 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:17.819735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9013c75-ea2b-4b7e-a1ad-efbc39058c19 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:17.820510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9013c75-ea2b-4b7e-a1ad-efbc39058c19 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:17.825183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9013c75-ea2b-4b7e-a1ad-efbc39058c19 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:17.826472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9013c75-ea2b-4b7e-a1ad-efbc39058c19 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:17.827132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9013c75-ea2b-4b7e-a1ad-efbc39058c19 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:17.827904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9013c75-ea2b-4b7e-a1ad-efbc39058c19 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:17.830212 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-78e41c33-0e83-4117-9936-43760d990725 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.257664 Aug 27 04:50:17.830841 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2038/4100] 10.222.0.79 () {58 vars in 1296 bytes} [Sat Aug 27 04:50:17 2022] DELETE /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7/os-server-password => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:50:17.841369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0d6fe9fa-e634-4f1b-8081-599513ce9db2 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:17.841871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0d6fe9fa-e634-4f1b-8081-599513ce9db2 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:17.861609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d6fe9fa-e634-4f1b-8081-599513ce9db2 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:17.862311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d6fe9fa-e634-4f1b-8081-599513ce9db2 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:17.862754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d6fe9fa-e634-4f1b-8081-599513ce9db2 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:17.863658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d6fe9fa-e634-4f1b-8081-599513ce9db2 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:17.864587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d6fe9fa-e634-4f1b-8081-599513ce9db2 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:17.865180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d6fe9fa-e634-4f1b-8081-599513ce9db2 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:17.892944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9013c75-ea2b-4b7e-a1ad-efbc39058c19 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:50:17.921571 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0d6fe9fa-e634-4f1b-8081-599513ce9db2 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.084802 Aug 27 04:50:17.927859 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2039/4101] 10.222.0.79 () {58 vars in 1293 bytes} [Sat Aug 27 04:50:17 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7/os-server-password => generated 16 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:50:17.933040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e71135f6-6de1-4c48-b831-fccf37fc5dbe tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:17.933831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e71135f6-6de1-4c48-b831-fccf37fc5dbe tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:17.947496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e71135f6-6de1-4c48-b831-fccf37fc5dbe tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:17.948255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e71135f6-6de1-4c48-b831-fccf37fc5dbe tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:17.949552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e71135f6-6de1-4c48-b831-fccf37fc5dbe tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:17.950562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e71135f6-6de1-4c48-b831-fccf37fc5dbe tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:17.953143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e71135f6-6de1-4c48-b831-fccf37fc5dbe tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:17.953773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e71135f6-6de1-4c48-b831-fccf37fc5dbe tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:18.004243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e71135f6-6de1-4c48-b831-fccf37fc5dbe tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:50:18.074960 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9013c75-ea2b-4b7e-a1ad-efbc39058c19 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 204 len: 0 microversion: 2.1 time: 0.277161 Aug 27 04:50:18.075967 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2063/4102] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:50:17 2022] DELETE /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:50:18.083365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4977fe52-1756-4b13-a2d5-0c14dcee4e07 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:18.084302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4977fe52-1756-4b13-a2d5-0c14dcee4e07 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:18.101036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4977fe52-1756-4b13-a2d5-0c14dcee4e07 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:18.101827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4977fe52-1756-4b13-a2d5-0c14dcee4e07 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:18.102496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4977fe52-1756-4b13-a2d5-0c14dcee4e07 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:18.103543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4977fe52-1756-4b13-a2d5-0c14dcee4e07 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:18.104207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4977fe52-1756-4b13-a2d5-0c14dcee4e07 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:18.109190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4977fe52-1756-4b13-a2d5-0c14dcee4e07 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:18.218895 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e71135f6-6de1-4c48-b831-fccf37fc5dbe tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 204 len: 0 microversion: 2.1 time: 0.289445 Aug 27 04:50:18.219787 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2040/4103] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:50:17 2022] DELETE /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:50:18.229587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7fbb03dc-dbe7-4d98-b9e9-1e689cf64e12 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:18.230854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7fbb03dc-dbe7-4d98-b9e9-1e689cf64e12 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:18.247015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fbb03dc-dbe7-4d98-b9e9-1e689cf64e12 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:18.247710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fbb03dc-dbe7-4d98-b9e9-1e689cf64e12 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:18.249624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fbb03dc-dbe7-4d98-b9e9-1e689cf64e12 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:18.252234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fbb03dc-dbe7-4d98-b9e9-1e689cf64e12 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:18.252805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fbb03dc-dbe7-4d98-b9e9-1e689cf64e12 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:18.254002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fbb03dc-dbe7-4d98-b9e9-1e689cf64e12 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:18.810646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7fbb03dc-dbe7-4d98-b9e9-1e689cf64e12 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:18.820796 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7fbb03dc-dbe7-4d98-b9e9-1e689cf64e12 tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1491 microversion: 2.1 time: 0.599560 Aug 27 04:50:18.821390 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2041/4104] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:18 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1491 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:18.851030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-202cee30-e24b-464e-81da-d165b20efd5f tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:18.852350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4977fe52-1756-4b13-a2d5-0c14dcee4e07 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:18.854267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-202cee30-e24b-464e-81da-d165b20efd5f tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:18.864851 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4977fe52-1756-4b13-a2d5-0c14dcee4e07 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1321 microversion: 2.1 time: 0.787246 Aug 27 04:50:18.865489 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2064/4105] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:18 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1321 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:18.868492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-202cee30-e24b-464e-81da-d165b20efd5f tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:18.870504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-202cee30-e24b-464e-81da-d165b20efd5f tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:18.872122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-202cee30-e24b-464e-81da-d165b20efd5f tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:18.873175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-202cee30-e24b-464e-81da-d165b20efd5f tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:18.874105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-202cee30-e24b-464e-81da-d165b20efd5f tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:18.874738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-202cee30-e24b-464e-81da-d165b20efd5f tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:18.933018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:19.056399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:19.094520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:19.453816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-202cee30-e24b-464e-81da-d165b20efd5f tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:19.462258 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-202cee30-e24b-464e-81da-d165b20efd5f tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1509 microversion: 2.1 time: 0.636173 Aug 27 04:50:19.463422 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2042/4106] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:18 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1509 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:19.847336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ac06fc7-75bf-4629-bead-3a00d72add8e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:19.848324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ac06fc7-75bf-4629-bead-3a00d72add8e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:19.865520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ac06fc7-75bf-4629-bead-3a00d72add8e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:19.868566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ac06fc7-75bf-4629-bead-3a00d72add8e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:19.869085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ac06fc7-75bf-4629-bead-3a00d72add8e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:19.871651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ac06fc7-75bf-4629-bead-3a00d72add8e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:19.872335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ac06fc7-75bf-4629-bead-3a00d72add8e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:19.872970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ac06fc7-75bf-4629-bead-3a00d72add8e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:19.895724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c75f7fa-200a-44fa-b434-2ff806c4e450 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:19.900816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1c75f7fa-200a-44fa-b434-2ff806c4e450 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:19.926324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c75f7fa-200a-44fa-b434-2ff806c4e450 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:19.927009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c75f7fa-200a-44fa-b434-2ff806c4e450 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:19.927840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c75f7fa-200a-44fa-b434-2ff806c4e450 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:19.929951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c75f7fa-200a-44fa-b434-2ff806c4e450 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:19.932406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c75f7fa-200a-44fa-b434-2ff806c4e450 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:19.934209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c75f7fa-200a-44fa-b434-2ff806c4e450 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:20.541674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1c75f7fa-200a-44fa-b434-2ff806c4e450 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:20.552634 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1c75f7fa-200a-44fa-b434-2ff806c4e450 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1321 microversion: 2.1 time: 0.666671 Aug 27 04:50:20.554730 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2043/4107] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:19 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1321 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:20.572613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-fb19150e-4d8b-4a97-af10-8ef2f553c8a5 req-69d378df-d923-46f8-a7b3-b8b4c0c2dd8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1fbd99f-a94d-44e4-a4d2-496f0d6e880c", "tag": "753dd3c4-628d-42fc-90be-9f2377e05174"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:20.597907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fb19150e-4d8b-4a97-af10-8ef2f553c8a5 req-69d378df-d923-46f8-a7b3-b8b4c0c2dd8a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:20.600975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fb19150e-4d8b-4a97-af10-8ef2f553c8a5 req-69d378df-d923-46f8-a7b3-b8b4c0c2dd8a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:20.601637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fb19150e-4d8b-4a97-af10-8ef2f553c8a5 req-69d378df-d923-46f8-a7b3-b8b4c0c2dd8a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:20.633182 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-fb19150e-4d8b-4a97-af10-8ef2f553c8a5 req-69d378df-d923-46f8-a7b3-b8b4c0c2dd8a service nova] Creating event network-changed:753dd3c4-628d-42fc-90be-9f2377e05174 for instance b1fbd99f-a94d-44e4-a4d2-496f0d6e880c on n-h1-854823-1 Aug 27 04:50:20.643501 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-fb19150e-4d8b-4a97-af10-8ef2f553c8a5 req-69d378df-d923-46f8-a7b3-b8b4c0c2dd8a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087396 Aug 27 04:50:20.648786 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2044/4108] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:20.670704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-27301c45-ecb8-4fb3-bcbd-a9e637fe9e8e tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:20.671514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-27301c45-ecb8-4fb3-bcbd-a9e637fe9e8e tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:20.690917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27301c45-ecb8-4fb3-bcbd-a9e637fe9e8e tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:20.691758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27301c45-ecb8-4fb3-bcbd-a9e637fe9e8e tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:20.692397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27301c45-ecb8-4fb3-bcbd-a9e637fe9e8e tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:20.693421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27301c45-ecb8-4fb3-bcbd-a9e637fe9e8e tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:20.707108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27301c45-ecb8-4fb3-bcbd-a9e637fe9e8e tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:20.707912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27301c45-ecb8-4fb3-bcbd-a9e637fe9e8e tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:21.219513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-27301c45-ecb8-4fb3-bcbd-a9e637fe9e8e tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:21.229045 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-27301c45-ecb8-4fb3-bcbd-a9e637fe9e8e tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1509 microversion: 2.1 time: 0.578585 Aug 27 04:50:21.230810 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2045/4109] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:20 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1509 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:21.274250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-49d4eb33-cf20-40eb-bac5-bfba44358914 req-26a54f41-e268-4822-9b1b-e5d1c3568bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3487346f-0dd9-4f96-8767-7a6a92608ea5", "name": "network-vif-plugged", "status": "completed", "tag": "a70e0fee-0241-48bc-90b8-53d756c94971"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:21.284105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-49d4eb33-cf20-40eb-bac5-bfba44358914 req-26a54f41-e268-4822-9b1b-e5d1c3568bd4 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:21.285433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-49d4eb33-cf20-40eb-bac5-bfba44358914 req-26a54f41-e268-4822-9b1b-e5d1c3568bd4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:21.286063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-49d4eb33-cf20-40eb-bac5-bfba44358914 req-26a54f41-e268-4822-9b1b-e5d1c3568bd4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:21.300918 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-49d4eb33-cf20-40eb-bac5-bfba44358914 req-26a54f41-e268-4822-9b1b-e5d1c3568bd4 service nova] Creating event network-vif-plugged:a70e0fee-0241-48bc-90b8-53d756c94971 for instance 3487346f-0dd9-4f96-8767-7a6a92608ea5 on n-h1-854823-1 Aug 27 04:50:21.309164 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-49d4eb33-cf20-40eb-bac5-bfba44358914 req-26a54f41-e268-4822-9b1b-e5d1c3568bd4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038084 Aug 27 04:50:21.310804 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2046/4110] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:50:21.420466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4ac06fc7-75bf-4629-bead-3a00d72add8e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:21.434932 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ac06fc7-75bf-4629-bead-3a00d72add8e tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1491 microversion: 2.1 time: 1.590566 Aug 27 04:50:21.436619 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2065/4111] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:19 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1491 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:21.580273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-01501903-3634-47c0-bc87-78534c897ba3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:21.581604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-01501903-3634-47c0-bc87-78534c897ba3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:21.595219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01501903-3634-47c0-bc87-78534c897ba3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:21.599227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01501903-3634-47c0-bc87-78534c897ba3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:21.599837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01501903-3634-47c0-bc87-78534c897ba3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:21.602070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01501903-3634-47c0-bc87-78534c897ba3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:21.603602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01501903-3634-47c0-bc87-78534c897ba3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:21.606451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01501903-3634-47c0-bc87-78534c897ba3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:22.254705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-edef7f7e-b38c-4a43-8465-96ef52431aa3 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:22.256105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-edef7f7e-b38c-4a43-8465-96ef52431aa3 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:22.296033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edef7f7e-b38c-4a43-8465-96ef52431aa3 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:22.296033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edef7f7e-b38c-4a43-8465-96ef52431aa3 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:22.296578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edef7f7e-b38c-4a43-8465-96ef52431aa3 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:22.297611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edef7f7e-b38c-4a43-8465-96ef52431aa3 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:22.298224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edef7f7e-b38c-4a43-8465-96ef52431aa3 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:22.298893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edef7f7e-b38c-4a43-8465-96ef52431aa3 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:22.566505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-edef7f7e-b38c-4a43-8465-96ef52431aa3 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:22.577291 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-edef7f7e-b38c-4a43-8465-96ef52431aa3 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1509 microversion: 2.1 time: 0.330218 Aug 27 04:50:22.586896 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2066/4112] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:22 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1509 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:50:22.592579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc434193-6281-4dd8-9a99-4b05e6b15b1a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:22.606141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bc434193-6281-4dd8-9a99-4b05e6b15b1a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:22.612884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc434193-6281-4dd8-9a99-4b05e6b15b1a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:22.613722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc434193-6281-4dd8-9a99-4b05e6b15b1a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:22.614352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc434193-6281-4dd8-9a99-4b05e6b15b1a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:22.615229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc434193-6281-4dd8-9a99-4b05e6b15b1a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:22.615864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc434193-6281-4dd8-9a99-4b05e6b15b1a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:22.616452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc434193-6281-4dd8-9a99-4b05e6b15b1a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:22.637884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-01501903-3634-47c0-bc87-78534c897ba3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:22.646545 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-01501903-3634-47c0-bc87-78534c897ba3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1321 microversion: 2.1 time: 1.075336 Aug 27 04:50:22.649530 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2047/4113] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:21 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1321 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:22.938713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bc434193-6281-4dd8-9a99-4b05e6b15b1a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:22.948322 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc434193-6281-4dd8-9a99-4b05e6b15b1a tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1491 microversion: 2.1 time: 0.359915 Aug 27 04:50:22.950279 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2067/4114] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:22 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1491 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:23.427046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-cb7417ed-e808-434a-b1d2-fa3626df79f7 req-02b0861e-f2fa-4110-ae51-cfc42adbd8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d03e47-76ad-42b8-a14b-3649ca01e838", "name": "network-vif-deleted", "tag": "9a7c7ec0-fc16-4e6b-849f-9bb422d6cb75"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:23.442030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cb7417ed-e808-434a-b1d2-fa3626df79f7 req-02b0861e-f2fa-4110-ae51-cfc42adbd8c6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:23.442813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cb7417ed-e808-434a-b1d2-fa3626df79f7 req-02b0861e-f2fa-4110-ae51-cfc42adbd8c6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:23.443400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cb7417ed-e808-434a-b1d2-fa3626df79f7 req-02b0861e-f2fa-4110-ae51-cfc42adbd8c6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:23.468731 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-cb7417ed-e808-434a-b1d2-fa3626df79f7 req-02b0861e-f2fa-4110-ae51-cfc42adbd8c6 service nova] Creating event network-vif-deleted:9a7c7ec0-fc16-4e6b-849f-9bb422d6cb75 for instance b0d03e47-76ad-42b8-a14b-3649ca01e838 on n-h2-854823-1 Aug 27 04:50:23.474707 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-cb7417ed-e808-434a-b1d2-fa3626df79f7 req-02b0861e-f2fa-4110-ae51-cfc42adbd8c6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051764 Aug 27 04:50:23.483217 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2048/4115] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:23.608064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db743dcc-c9f1-462d-ac1f-5d42a9c64f11 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:23.609897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db743dcc-c9f1-462d-ac1f-5d42a9c64f11 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:23.634942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db743dcc-c9f1-462d-ac1f-5d42a9c64f11 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:23.638437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db743dcc-c9f1-462d-ac1f-5d42a9c64f11 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:23.639343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db743dcc-c9f1-462d-ac1f-5d42a9c64f11 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:23.640345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db743dcc-c9f1-462d-ac1f-5d42a9c64f11 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:23.641907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db743dcc-c9f1-462d-ac1f-5d42a9c64f11 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:23.647086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db743dcc-c9f1-462d-ac1f-5d42a9c64f11 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:23.674163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d0fa2cef-40b9-457e-84f8-ba29fee3a489 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:23.675036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d0fa2cef-40b9-457e-84f8-ba29fee3a489 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:23.694517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0fa2cef-40b9-457e-84f8-ba29fee3a489 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:23.695025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0fa2cef-40b9-457e-84f8-ba29fee3a489 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:23.695499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0fa2cef-40b9-457e-84f8-ba29fee3a489 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:23.696215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0fa2cef-40b9-457e-84f8-ba29fee3a489 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:23.697005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0fa2cef-40b9-457e-84f8-ba29fee3a489 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:23.697193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0fa2cef-40b9-457e-84f8-ba29fee3a489 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:23.899810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db743dcc-c9f1-462d-ac1f-5d42a9c64f11 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11e7e1547e6435a9868c3cc0efbd684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e15086534346c0879634ead7c115bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:23.913226 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db743dcc-c9f1-462d-ac1f-5d42a9c64f11 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 200 len: 1467 microversion: 2.1 time: 0.309623 Aug 27 04:50:23.913843 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2068/4116] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:23 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 1467 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:23.971754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba1f227f-671e-454d-a2a9-93714be5b97f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:23.972904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba1f227f-671e-454d-a2a9-93714be5b97f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:23.985762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1f227f-671e-454d-a2a9-93714be5b97f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:23.986266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1f227f-671e-454d-a2a9-93714be5b97f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:23.986714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1f227f-671e-454d-a2a9-93714be5b97f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:23.987418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1f227f-671e-454d-a2a9-93714be5b97f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:23.988049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1f227f-671e-454d-a2a9-93714be5b97f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:23.988662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1f227f-671e-454d-a2a9-93714be5b97f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:24.066132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1f227f-671e-454d-a2a9-93714be5b97f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:24.066381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1f227f-671e-454d-a2a9-93714be5b97f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:24.073231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba1f227f-671e-454d-a2a9-93714be5b97f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:24.074659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-ba1f227f-671e-454d-a2a9-93714be5b97f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lazy-loading 'fault' on Instance uuid b0d03e47-76ad-42b8-a14b-3649ca01e838 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:50:24.248982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba1f227f-671e-454d-a2a9-93714be5b97f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902983c84d2f4c60a469ae3be1795646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff524508e53d4e69bc37ffb928486e1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:24.260715 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba1f227f-671e-454d-a2a9-93714be5b97f tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 200 len: 1304 microversion: 2.1 time: 0.292852 Aug 27 04:50:24.261957 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2069/4117] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:23 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 1304 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:50:24.265816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d0fa2cef-40b9-457e-84f8-ba29fee3a489 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:24.288910 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d0fa2cef-40b9-457e-84f8-ba29fee3a489 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1321 microversion: 2.1 time: 0.609627 Aug 27 04:50:24.292667 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2049/4118] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:23 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1321 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:50:24.938632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30fe635e-ab4d-43f1-a444-4f93c3efaac8 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:24.939262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-30fe635e-ab4d-43f1-a444-4f93c3efaac8 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] [instance: 2b8c8fed-8c77-4276-a9ba-21f1f67280f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:24.946699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30fe635e-ab4d-43f1-a444-4f93c3efaac8 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:24.947448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30fe635e-ab4d-43f1-a444-4f93c3efaac8 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:24.948167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30fe635e-ab4d-43f1-a444-4f93c3efaac8 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:24.949639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30fe635e-ab4d-43f1-a444-4f93c3efaac8 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:24.950259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30fe635e-ab4d-43f1-a444-4f93c3efaac8 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:24.953099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30fe635e-ab4d-43f1-a444-4f93c3efaac8 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:24.979559 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-30fe635e-ab4d-43f1-a444-4f93c3efaac8 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] HTTP exception thrown: Instance 2b8c8fed-8c77-4276-a9ba-21f1f67280f7 could not be found. Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30fe635e-ab4d-43f1-a444-4f93c3efaac8 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Request method failure captured: Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 HTTP/1.1 Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaJraCAtn-P5lk3fCY2GLOeVgxDoXvaNZxAmFglO1wxlX5KiqbeYa7B27yiryv2oB3jkITh5Vme6T1tN0ChyipKAMRIQrx91xZCj1CzdPnEGOioHK6jzqFr0nSq4hiiuH0Q0HB0wlXiEl8Li6hanhaQV6H-jgv72-VdRHsAoKBuFveY Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: e4e15086534346c0879634ead7c115bb Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerPasswordTestJSON-643974076 Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e4e15086534346c0879634ead7c115bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e4e15086534346c0879634ead7c115bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e4e15086534346c0879634ead7c115bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e4e15086534346c0879634ead7c115bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerPasswordTestJSON-643974076 Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: e4e15086534346c0879634ead7c115bb Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerPasswordTestJSON-643974076 Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerPasswordTestJSON-643974076-project Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: d11e7e1547e6435a9868c3cc0efbd684 Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerPasswordTestJSON-643974076-project Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 2b8c8fed-8c77-4276-a9ba-21f1f67280f7 could not be found. Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '2b8c8fed-8c77-4276-a9ba-21f1f67280f7'} Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8c8fed-8c77-4276-a9ba-21f1f67280f7 could not be found. Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8c8fed-8c77-4276-a9ba-21f1f67280f7 could not be found. Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:50:24.998802 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:50:25.003785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:50:25.003785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:50:25.003785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:50:25.003785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:50:25.003785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:50:25.003785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8c8fed-8c77-4276-a9ba-21f1f67280f7 could not be found. Aug 27 04:50:25.003785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:50:25.005444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30fe635e-ab4d-43f1-a444-4f93c3efaac8 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] Returning 404 to user: Instance 2b8c8fed-8c77-4276-a9ba-21f1f67280f7 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:50:25.007488 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-30fe635e-ab4d-43f1-a444-4f93c3efaac8 tempest-ServerPasswordTestJSON-643974076 tempest-ServerPasswordTestJSON-643974076-project] 10.222.0.79 "GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7" status: 404 len: 111 microversion: 2.1 time: 0.074214 Aug 27 04:50:25.015397 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2070/4119] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:24 2022] GET /compute/v2.1/servers/2b8c8fed-8c77-4276-a9ba-21f1f67280f7 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:50:25.282294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cc8988e1-d78e-48a8-a118-007066c772af tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:25.282918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cc8988e1-d78e-48a8-a118-007066c772af tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] [instance: b0d03e47-76ad-42b8-a14b-3649ca01e838] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:25.299281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc8988e1-d78e-48a8-a118-007066c772af tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:25.299791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc8988e1-d78e-48a8-a118-007066c772af tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:25.300234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc8988e1-d78e-48a8-a118-007066c772af tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:25.300979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc8988e1-d78e-48a8-a118-007066c772af tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:25.301442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc8988e1-d78e-48a8-a118-007066c772af tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:25.301996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc8988e1-d78e-48a8-a118-007066c772af tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:25.319766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5541d431-accf-48b5-9014-f97ca5d58702 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:25.319872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5541d431-accf-48b5-9014-f97ca5d58702 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:25.335081 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-cc8988e1-d78e-48a8-a118-007066c772af tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] HTTP exception thrown: Instance b0d03e47-76ad-42b8-a14b-3649ca01e838 could not be found. Aug 27 04:50:25.338323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5541d431-accf-48b5-9014-f97ca5d58702 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:25.338827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5541d431-accf-48b5-9014-f97ca5d58702 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:25.339345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5541d431-accf-48b5-9014-f97ca5d58702 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cc8988e1-d78e-48a8-a118-007066c772af tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Request method failure captured: Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 HTTP/1.1 Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaILlHpHnECQ-VAUyUizxijO1yjHUYHLwCUBHpG26rVE34GZ6HsiR1DLT7CbrV6mvytjT8T-fPJYgCUyl5Eo67eX1QdlcimUYQ2eqak0hFflYznLzGWuXDTaG4zSk9hMeap82K1oyDeB_cYt3KPKDlaZc_5b4i-CEa631RsiyVUYe8c Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: ff524508e53d4e69bc37ffb928486e1c Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerRescueTestJSON-259594059 Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff524508e53d4e69bc37ffb928486e1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ff524508e53d4e69bc37ffb928486e1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ff524508e53d4e69bc37ffb928486e1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff524508e53d4e69bc37ffb928486e1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerRescueTestJSON-259594059 Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: ff524508e53d4e69bc37ffb928486e1c Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerRescueTestJSON-259594059 Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerRescueTestJSON-259594059-project Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 902983c84d2f4c60a469ae3be1795646 Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerRescueTestJSON-259594059-project Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance b0d03e47-76ad-42b8-a14b-3649ca01e838 could not be found. Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'b0d03e47-76ad-42b8-a14b-3649ca01e838'} Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d03e47-76ad-42b8-a14b-3649ca01e838 could not be found. Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d03e47-76ad-42b8-a14b-3649ca01e838 could not be found. Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:50:25.340145 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:50:25.344668 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:50:25.344668 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:50:25.344668 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:50:25.344668 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:50:25.344668 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:50:25.344668 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d03e47-76ad-42b8-a14b-3649ca01e838 could not be found. Aug 27 04:50:25.344668 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:50:25.345151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5541d431-accf-48b5-9014-f97ca5d58702 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:25.345151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5541d431-accf-48b5-9014-f97ca5d58702 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:25.345151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5541d431-accf-48b5-9014-f97ca5d58702 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:25.346796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cc8988e1-d78e-48a8-a118-007066c772af tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] Returning 404 to user: Instance b0d03e47-76ad-42b8-a14b-3649ca01e838 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:50:25.347339 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cc8988e1-d78e-48a8-a118-007066c772af tempest-ServerRescueTestJSON-259594059 tempest-ServerRescueTestJSON-259594059-project] 10.222.0.79 "GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838" status: 404 len: 111 microversion: 2.1 time: 0.068950 Aug 27 04:50:25.348793 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2050/4120] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:25 2022] GET /compute/v2.1/servers/b0d03e47-76ad-42b8-a14b-3649ca01e838 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:50:25.531585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-9b5b7a3e-b0e5-4f04-9a9a-11065ea145bc req-01b726b0-9085-4b53-807f-e3fbd2d5ada3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8c8fed-8c77-4276-a9ba-21f1f67280f7", "name": "network-vif-deleted", "tag": "17e085ad-fe9d-4aee-95d5-31ed0361f0a9"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:25.552821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9b5b7a3e-b0e5-4f04-9a9a-11065ea145bc req-01b726b0-9085-4b53-807f-e3fbd2d5ada3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:25.553317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9b5b7a3e-b0e5-4f04-9a9a-11065ea145bc req-01b726b0-9085-4b53-807f-e3fbd2d5ada3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:25.553752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9b5b7a3e-b0e5-4f04-9a9a-11065ea145bc req-01b726b0-9085-4b53-807f-e3fbd2d5ada3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:25.569447 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-9b5b7a3e-b0e5-4f04-9a9a-11065ea145bc req-01b726b0-9085-4b53-807f-e3fbd2d5ada3 service nova] Creating event network-vif-deleted:17e085ad-fe9d-4aee-95d5-31ed0361f0a9 for instance 2b8c8fed-8c77-4276-a9ba-21f1f67280f7 on n-h2-854823-1 Aug 27 04:50:25.591167 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-9b5b7a3e-b0e5-4f04-9a9a-11065ea145bc req-01b726b0-9085-4b53-807f-e3fbd2d5ada3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060589 Aug 27 04:50:25.592034 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2051/4121] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:25.802579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5541d431-accf-48b5-9014-f97ca5d58702 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:25.816059 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5541d431-accf-48b5-9014-f97ca5d58702 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1321 microversion: 2.1 time: 0.500729 Aug 27 04:50:25.819600 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2071/4122] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:25 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1321 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:50:26.845071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5827fbd7-6302-41c8-add6-5dd89212e195 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:26.845777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5827fbd7-6302-41c8-add6-5dd89212e195 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:26.854248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5827fbd7-6302-41c8-add6-5dd89212e195 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:26.854957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5827fbd7-6302-41c8-add6-5dd89212e195 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:26.855559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5827fbd7-6302-41c8-add6-5dd89212e195 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:26.856494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5827fbd7-6302-41c8-add6-5dd89212e195 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:26.857472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5827fbd7-6302-41c8-add6-5dd89212e195 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:26.858066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5827fbd7-6302-41c8-add6-5dd89212e195 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:27.915951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5827fbd7-6302-41c8-add6-5dd89212e195 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:27.946587 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5827fbd7-6302-41c8-add6-5dd89212e195 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1321 microversion: 2.1 time: 1.108103 Aug 27 04:50:27.949990 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2052/4123] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:26 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1321 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:28.970502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69265980-1bff-4e58-b6f7-d6a9a3cb38ab tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:28.977413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69265980-1bff-4e58-b6f7-d6a9a3cb38ab tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:28.985827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69265980-1bff-4e58-b6f7-d6a9a3cb38ab tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:28.986680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69265980-1bff-4e58-b6f7-d6a9a3cb38ab tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:28.988912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69265980-1bff-4e58-b6f7-d6a9a3cb38ab tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:28.989992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69265980-1bff-4e58-b6f7-d6a9a3cb38ab tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:28.992462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69265980-1bff-4e58-b6f7-d6a9a3cb38ab tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:28.993302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69265980-1bff-4e58-b6f7-d6a9a3cb38ab tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:29.529854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-44bb056e-c4dd-40c5-8131-b0d959e9808b req-50f90b0d-45c0-42fa-ae25-56cf959eb627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1fbd99f-a94d-44e4-a4d2-496f0d6e880c", "name": "network-vif-plugged", "status": "completed", "tag": "753dd3c4-628d-42fc-90be-9f2377e05174"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:29.546695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-44bb056e-c4dd-40c5-8131-b0d959e9808b req-50f90b0d-45c0-42fa-ae25-56cf959eb627 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:29.548564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-44bb056e-c4dd-40c5-8131-b0d959e9808b req-50f90b0d-45c0-42fa-ae25-56cf959eb627 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:29.549606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-44bb056e-c4dd-40c5-8131-b0d959e9808b req-50f90b0d-45c0-42fa-ae25-56cf959eb627 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:29.590066 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-44bb056e-c4dd-40c5-8131-b0d959e9808b req-50f90b0d-45c0-42fa-ae25-56cf959eb627 service nova] Creating event network-vif-plugged:753dd3c4-628d-42fc-90be-9f2377e05174 for instance b1fbd99f-a94d-44e4-a4d2-496f0d6e880c on n-h1-854823-1 Aug 27 04:50:29.601266 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-44bb056e-c4dd-40c5-8131-b0d959e9808b req-50f90b0d-45c0-42fa-ae25-56cf959eb627 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080719 Aug 27 04:50:29.602873 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2053/4124] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:29.726761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-69265980-1bff-4e58-b6f7-d6a9a3cb38ab tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:29.736411 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69265980-1bff-4e58-b6f7-d6a9a3cb38ab tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1321 microversion: 2.1 time: 0.770661 Aug 27 04:50:29.738950 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2072/4125] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:28 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1321 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:30.760283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fe67be58-f0da-4583-b083-4b644fbc6d73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:30.762466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fe67be58-f0da-4583-b083-4b644fbc6d73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:30.774917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe67be58-f0da-4583-b083-4b644fbc6d73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:30.777266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe67be58-f0da-4583-b083-4b644fbc6d73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:30.777910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe67be58-f0da-4583-b083-4b644fbc6d73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:30.780654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe67be58-f0da-4583-b083-4b644fbc6d73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:30.783276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe67be58-f0da-4583-b083-4b644fbc6d73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:30.784228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe67be58-f0da-4583-b083-4b644fbc6d73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:31.221393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fe67be58-f0da-4583-b083-4b644fbc6d73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:31.236626 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fe67be58-f0da-4583-b083-4b644fbc6d73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1321 microversion: 2.1 time: 0.475242 Aug 27 04:50:31.241457 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2054/4126] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:30 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:31.727687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d59b3135-129b-462e-bc2a-b1d1c796560f req-d4799a65-11bf-48ed-8228-dd51d6dac96f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925af2b3-d33a-4284-ad7b-56e22964c16a", "name": "network-vif-plugged", "status": "completed", "tag": "65bc142a-6e78-4b74-804d-815d545a3f03"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:31.751721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d59b3135-129b-462e-bc2a-b1d1c796560f req-d4799a65-11bf-48ed-8228-dd51d6dac96f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:31.756822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d59b3135-129b-462e-bc2a-b1d1c796560f req-d4799a65-11bf-48ed-8228-dd51d6dac96f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:31.757282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d59b3135-129b-462e-bc2a-b1d1c796560f req-d4799a65-11bf-48ed-8228-dd51d6dac96f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:31.782211 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d59b3135-129b-462e-bc2a-b1d1c796560f req-d4799a65-11bf-48ed-8228-dd51d6dac96f service nova] Creating event network-vif-plugged:65bc142a-6e78-4b74-804d-815d545a3f03 for instance 925af2b3-d33a-4284-ad7b-56e22964c16a on n-h2-854823-1 Aug 27 04:50:31.799809 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d59b3135-129b-462e-bc2a-b1d1c796560f req-d4799a65-11bf-48ed-8228-dd51d6dac96f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072435 Aug 27 04:50:31.800995 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2073/4127] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:32.262602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9799a855-a62a-4f03-b8ec-3dedab642c97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:32.263459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9799a855-a62a-4f03-b8ec-3dedab642c97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:32.277346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9799a855-a62a-4f03-b8ec-3dedab642c97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:32.277909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9799a855-a62a-4f03-b8ec-3dedab642c97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:32.278492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9799a855-a62a-4f03-b8ec-3dedab642c97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:32.281240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9799a855-a62a-4f03-b8ec-3dedab642c97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:32.282801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9799a855-a62a-4f03-b8ec-3dedab642c97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:32.287287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9799a855-a62a-4f03-b8ec-3dedab642c97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:32.660598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9799a855-a62a-4f03-b8ec-3dedab642c97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:32.672771 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9799a855-a62a-4f03-b8ec-3dedab642c97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1513 microversion: 2.1 time: 0.414826 Aug 27 04:50:32.709184 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2055/4128] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:32 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1513 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:32.723703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:32.724842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:32.758357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:32.766796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:32.767538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:32.769174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:32.769798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:32.778084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:33.716111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:33.731873 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1512 microversion: 2.1 time: 1.015508 Aug 27 04:50:33.737332 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2074/4129] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:32 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1512 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:33.754622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cd829496-53fe-4416-b986-b0eb21e9bad3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:33.755868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cd829496-53fe-4416-b986-b0eb21e9bad3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 925af2b3-d33a-4284-ad7b-56e22964c16a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:33.783847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd829496-53fe-4416-b986-b0eb21e9bad3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:33.785088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd829496-53fe-4416-b986-b0eb21e9bad3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:33.785879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd829496-53fe-4416-b986-b0eb21e9bad3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:33.787282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd829496-53fe-4416-b986-b0eb21e9bad3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:33.787993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd829496-53fe-4416-b986-b0eb21e9bad3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:33.788681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd829496-53fe-4416-b986-b0eb21e9bad3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:34.016877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:34.018467 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001945 Aug 27 04:50:34.018799 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2075/4130] 10.222.0.79 () {56 vars in 886 bytes} [Sat Aug 27 04:50:34 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 04:50:34.025396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cd829496-53fe-4416-b986-b0eb21e9bad3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:34.027010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:34.028140 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001932 Aug 27 04:50:34.028564 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2076/4131] 10.222.0.79 () {54 vars in 1035 bytes} [Sat Aug 27 04:50:34 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Aug 27 04:50:34.035664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:34.037574 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002597 Aug 27 04:50:34.040115 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2077/4132] 10.222.0.79 () {54 vars in 1041 bytes} [Sat Aug 27 04:50:34 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:34.044863 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cd829496-53fe-4416-b986-b0eb21e9bad3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a" status: 200 len: 1511 microversion: 2.1 time: 0.294082 Aug 27 04:50:34.062057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:34.063772 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aaf57543-bf4a-44c4-9b1a-800b965fa822 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002048 Aug 27 04:50:34.065772 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2078/4133] 10.222.0.79 () {56 vars in 886 bytes} [Sat Aug 27 04:50:34 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 04:50:34.072464 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2056/4134] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:33 2022] GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a => generated 1511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:34.083185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:34.100188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:34.101473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:50:34.135371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:34.139297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:34.140037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:34.143538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:34.144432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:34.145124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:34.437977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:50:34.574152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:34.589848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:34.593192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:34.593892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:35.622531 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96570cde-206e-46af-b6fb-d4a70db1f36f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 1.555261 Aug 27 04:50:35.623233 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2079/4135] 10.222.0.79 () {58 vars in 1167 bytes} [Sat Aug 27 04:50:34 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:35.660296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:35.671620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:35.677743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1702605915', 'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:50:35.691010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:35.696255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:35.697149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:35.699434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:35.700175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:35.700968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:35.898852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:50:36.167568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:36.189576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:36.190183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:36.190806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:36.570428 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ddecfcb5-7b72-4beb-af34-f3f443befb37 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1702605915" status: 200 len: 1515 microversion: 2.1 time: 0.914735 Aug 27 04:50:36.571439 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2057/4136] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:50:35 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1702605915 => generated 1515 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:36.597948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:36.608431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:36.614958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:50:36.643184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:36.646660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:36.649247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:36.650916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:36.653189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:36.653820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:37.065387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:50:37.333799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:37.359014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:37.360855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:37.361614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:37.374553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:38.019627 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23f73491-173d-4541-a192-4d10ef070ad9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 1.430697 Aug 27 04:50:38.020938 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2080/4137] 10.222.0.79 () {58 vars in 1173 bytes} [Sat Aug 27 04:50:36 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:38.049054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:38.064438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:38.066804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.compute.servers [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Removing options 'limit' from query {{(pid=128870) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 04:50:38.067990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:50:38.094960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:38.095840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:38.096672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:38.098825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:38.101046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:38.101720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:38.271747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:38.302736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:38.306647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:38.307251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:39.463236 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4292eefb-2ca0-4665-81e1-00a6fc478ab6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 1.420922 Aug 27 04:50:39.464489 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2058/4138] 10.222.0.79 () {58 vars in 1161 bytes} [Sat Aug 27 04:50:38 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:39.497144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66f91f25-090d-42eb-afb8-c6e5bce7286c tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:39.506343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66f91f25-090d-42eb-afb8-c6e5bce7286c tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:39.508798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66f91f25-090d-42eb-afb8-c6e5bce7286c tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:50:39.534593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66f91f25-090d-42eb-afb8-c6e5bce7286c tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:39.535567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66f91f25-090d-42eb-afb8-c6e5bce7286c tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:39.538337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66f91f25-090d-42eb-afb8-c6e5bce7286c tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:39.543026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66f91f25-090d-42eb-afb8-c6e5bce7286c tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:39.544500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66f91f25-090d-42eb-afb8-c6e5bce7286c tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:39.545256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66f91f25-090d-42eb-afb8-c6e5bce7286c tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:39.608321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-66f91f25-090d-42eb-afb8-c6e5bce7286c tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:50:39.693282 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66f91f25-090d-42eb-afb8-c6e5bce7286c tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.202329 Aug 27 04:50:39.701720 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2081/4139] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:50:39 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:39.717556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-addddbbe-7ff7-4396-83c3-7acd1b17c50e tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:39.725733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-addddbbe-7ff7-4396-83c3-7acd1b17c50e tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:39.727243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.compute.servers [None req-addddbbe-7ff7-4396-83c3-7acd1b17c50e tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Removing options 'limit' from query {{(pid=128870) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 04:50:39.728264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-addddbbe-7ff7-4396-83c3-7acd1b17c50e tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:50:39.741661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-addddbbe-7ff7-4396-83c3-7acd1b17c50e tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:39.745365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-addddbbe-7ff7-4396-83c3-7acd1b17c50e tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:39.746352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-addddbbe-7ff7-4396-83c3-7acd1b17c50e tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:39.747348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-addddbbe-7ff7-4396-83c3-7acd1b17c50e tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:39.747995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-addddbbe-7ff7-4396-83c3-7acd1b17c50e tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:39.757442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-addddbbe-7ff7-4396-83c3-7acd1b17c50e tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:39.804738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-addddbbe-7ff7-4396-83c3-7acd1b17c50e tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:50:39.883263 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-addddbbe-7ff7-4396-83c3-7acd1b17c50e tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.171032 Aug 27 04:50:39.884570 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2059/4140] 10.222.0.79 () {58 vars in 1150 bytes} [Sat Aug 27 04:50:39 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:39.898918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-93e8eac2-1da8-4fcd-84bc-fa8c8315e021 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:39.905462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-93e8eac2-1da8-4fcd-84bc-fa8c8315e021 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:39.906921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-93e8eac2-1da8-4fcd-84bc-fa8c8315e021 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:50:39.914003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e8eac2-1da8-4fcd-84bc-fa8c8315e021 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:39.914781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e8eac2-1da8-4fcd-84bc-fa8c8315e021 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:39.915943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e8eac2-1da8-4fcd-84bc-fa8c8315e021 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:39.917042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e8eac2-1da8-4fcd-84bc-fa8c8315e021 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:39.917721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e8eac2-1da8-4fcd-84bc-fa8c8315e021 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:39.918338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e8eac2-1da8-4fcd-84bc-fa8c8315e021 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:39.952337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-93e8eac2-1da8-4fcd-84bc-fa8c8315e021 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:50:40.081546 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-93e8eac2-1da8-4fcd-84bc-fa8c8315e021 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.183791 Aug 27 04:50:40.085134 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2082/4141] 10.222.0.79 () {58 vars in 1125 bytes} [Sat Aug 27 04:50:39 2022] GET /compute/v2.1/servers => generated 1011 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:40.097163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0721b9c7-5df3-406e-82e9-4e92fc60da09 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:40.111709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0721b9c7-5df3-406e-82e9-4e92fc60da09 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:40.113571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0721b9c7-5df3-406e-82e9-4e92fc60da09 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:50:40.171845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0721b9c7-5df3-406e-82e9-4e92fc60da09 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:40.172402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0721b9c7-5df3-406e-82e9-4e92fc60da09 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:40.172880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0721b9c7-5df3-406e-82e9-4e92fc60da09 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:40.173646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0721b9c7-5df3-406e-82e9-4e92fc60da09 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:40.179588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0721b9c7-5df3-406e-82e9-4e92fc60da09 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:40.180340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0721b9c7-5df3-406e-82e9-4e92fc60da09 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:40.425207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-0721b9c7-5df3-406e-82e9-4e92fc60da09 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:50:40.576850 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0721b9c7-5df3-406e-82e9-4e92fc60da09 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.476387 Aug 27 04:50:40.584824 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2060/4142] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:50:40 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:40.591338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1eb3439d-2cfc-4dfb-b45f-7fc8e7aafb61 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:40.597760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1eb3439d-2cfc-4dfb-b45f-7fc8e7aafb61 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:40.610368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.compute.servers [None req-1eb3439d-2cfc-4dfb-b45f-7fc8e7aafb61 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Removing options 'limit' from query {{(pid=128869) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 04:50:40.611308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1eb3439d-2cfc-4dfb-b45f-7fc8e7aafb61 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:50:40.631258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1eb3439d-2cfc-4dfb-b45f-7fc8e7aafb61 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:40.634719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1eb3439d-2cfc-4dfb-b45f-7fc8e7aafb61 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:40.635425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1eb3439d-2cfc-4dfb-b45f-7fc8e7aafb61 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:40.636621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1eb3439d-2cfc-4dfb-b45f-7fc8e7aafb61 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:40.638411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1eb3439d-2cfc-4dfb-b45f-7fc8e7aafb61 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:40.640252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1eb3439d-2cfc-4dfb-b45f-7fc8e7aafb61 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:40.708164 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1eb3439d-2cfc-4dfb-b45f-7fc8e7aafb61 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.121646 Aug 27 04:50:40.719995 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2083/4143] 10.222.0.79 () {58 vars in 1140 bytes} [Sat Aug 27 04:50:40 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:40.722990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-79560e4d-8ca7-4c37-a2e5-abd9788e281b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:40.736639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-79560e4d-8ca7-4c37-a2e5-abd9788e281b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:40.738103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-79560e4d-8ca7-4c37-a2e5-abd9788e281b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1702605915', 'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:50:40.758273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79560e4d-8ca7-4c37-a2e5-abd9788e281b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:40.758796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79560e4d-8ca7-4c37-a2e5-abd9788e281b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:40.759244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79560e4d-8ca7-4c37-a2e5-abd9788e281b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:40.766958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79560e4d-8ca7-4c37-a2e5-abd9788e281b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:40.767471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79560e4d-8ca7-4c37-a2e5-abd9788e281b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:40.767916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79560e4d-8ca7-4c37-a2e5-abd9788e281b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:41.035600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-79560e4d-8ca7-4c37-a2e5-abd9788e281b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:50:41.078512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:41.246658 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-79560e4d-8ca7-4c37-a2e5-abd9788e281b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1702605915" status: 200 len: 346 microversion: 2.1 time: 0.522430 Aug 27 04:50:41.250318 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2061/4144] 10.222.0.79 () {58 vars in 1242 bytes} [Sat Aug 27 04:50:40 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1702605915 => generated 346 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:50:41.262735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a7fc604-e1b5-4423-9f84-cd06892504b2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:41.271538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a7fc604-e1b5-4423-9f84-cd06892504b2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:41.275745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a7fc604-e1b5-4423-9f84-cd06892504b2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:41.279237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a7fc604-e1b5-4423-9f84-cd06892504b2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:41.364103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a7fc604-e1b5-4423-9f84-cd06892504b2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Going to try to stop instance {{(pid=128869) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 04:50:41.451010 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a7fc604-e1b5-4423-9f84-cd06892504b2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "POST /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5/action" status: 202 len: 0 microversion: 2.1 time: 0.191144 Aug 27 04:50:41.452487 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2084/4145] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:50:41 2022] POST /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:50:41.461106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ed3bf3a4-b403-4374-a9e6-dc5f017f5585 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:41.461730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ed3bf3a4-b403-4374-a9e6-dc5f017f5585 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:41.486919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed3bf3a4-b403-4374-a9e6-dc5f017f5585 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:41.487438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed3bf3a4-b403-4374-a9e6-dc5f017f5585 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:41.487879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed3bf3a4-b403-4374-a9e6-dc5f017f5585 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:41.488837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed3bf3a4-b403-4374-a9e6-dc5f017f5585 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:41.489460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed3bf3a4-b403-4374-a9e6-dc5f017f5585 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:41.491121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed3bf3a4-b403-4374-a9e6-dc5f017f5585 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:41.891162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed3bf3a4-b403-4374-a9e6-dc5f017f5585 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:41.926837 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ed3bf3a4-b403-4374-a9e6-dc5f017f5585 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1522 microversion: 2.1 time: 0.469586 Aug 27 04:50:41.928085 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2062/4146] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:41 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:42.949771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5d9f4b29-f027-4a65-91dd-5b9d80998214 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:42.951327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5d9f4b29-f027-4a65-91dd-5b9d80998214 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:42.968406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d9f4b29-f027-4a65-91dd-5b9d80998214 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:42.969196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d9f4b29-f027-4a65-91dd-5b9d80998214 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:42.973731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d9f4b29-f027-4a65-91dd-5b9d80998214 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:42.974856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d9f4b29-f027-4a65-91dd-5b9d80998214 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:42.977671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d9f4b29-f027-4a65-91dd-5b9d80998214 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:42.980846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d9f4b29-f027-4a65-91dd-5b9d80998214 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:43.054253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-54231341", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": "none"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:43.135581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:43.263533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:50:43.264343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:50:43.265618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:50:43.266241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:50:43.266967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:50:43.298133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:43.298890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:43.299394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:43.300195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:43.300769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:43.301525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:43.331881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Getting quotas for project 39caf602bc9c47e4a7eb1c6ab6bc162e. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:50:43.339680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Getting quotas for user 2b6d5a9e8e8e4dc8a454c04ca26da2c3 and project 39caf602bc9c47e4a7eb1c6ab6bc162e. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:50:43.357356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:50:43.360810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:50:43.446882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5d9f4b29-f027-4a65-91dd-5b9d80998214 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:43.458381 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-389df73b-97ba-4d5c-96eb-965dc336f260 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.780749 Aug 27 04:50:43.459971 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5d9f4b29-f027-4a65-91dd-5b9d80998214 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1522 microversion: 2.1 time: 0.511210 Aug 27 04:50:43.461220 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2063/4147] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:42 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:43.493102 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2085/4148] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 04:50:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:50:43.496544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ac377e93-c067-4890-930a-f9bf8854a771 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:43.497434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ac377e93-c067-4890-930a-f9bf8854a771 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:43.683629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac377e93-c067-4890-930a-f9bf8854a771 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:43.692050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac377e93-c067-4890-930a-f9bf8854a771 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:43.702296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac377e93-c067-4890-930a-f9bf8854a771 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:43.703747 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ac377e93-c067-4890-930a-f9bf8854a771 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1276 microversion: 2.57 time: 0.213542 Aug 27 04:50:43.705152 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2064/4149] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:50:43 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:50:44.496868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df1f46d1-9510-4344-af3b-ad4821ebd3b6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:44.497458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-df1f46d1-9510-4344-af3b-ad4821ebd3b6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:44.517757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df1f46d1-9510-4344-af3b-ad4821ebd3b6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:44.518259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df1f46d1-9510-4344-af3b-ad4821ebd3b6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:44.523678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df1f46d1-9510-4344-af3b-ad4821ebd3b6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:44.524658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df1f46d1-9510-4344-af3b-ad4821ebd3b6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:44.525336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df1f46d1-9510-4344-af3b-ad4821ebd3b6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:44.530868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df1f46d1-9510-4344-af3b-ad4821ebd3b6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:44.753891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b67be039-01b1-44ca-9e16-10cc1ddb48cb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:44.755388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b67be039-01b1-44ca-9e16-10cc1ddb48cb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:44.791380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b67be039-01b1-44ca-9e16-10cc1ddb48cb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:44.793086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b67be039-01b1-44ca-9e16-10cc1ddb48cb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:44.793737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b67be039-01b1-44ca-9e16-10cc1ddb48cb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:44.795986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b67be039-01b1-44ca-9e16-10cc1ddb48cb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:44.798699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b67be039-01b1-44ca-9e16-10cc1ddb48cb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:44.802278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b67be039-01b1-44ca-9e16-10cc1ddb48cb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:44.926666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-df1f46d1-9510-4344-af3b-ad4821ebd3b6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:44.957179 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-df1f46d1-9510-4344-af3b-ad4821ebd3b6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1522 microversion: 2.1 time: 0.461674 Aug 27 04:50:44.967261 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2086/4150] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:44 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:45.089711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b67be039-01b1-44ca-9e16-10cc1ddb48cb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:45.123824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b67be039-01b1-44ca-9e16-10cc1ddb48cb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:45.130182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b67be039-01b1-44ca-9e16-10cc1ddb48cb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:45.138853 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b67be039-01b1-44ca-9e16-10cc1ddb48cb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1280 microversion: 2.57 time: 0.387773 Aug 27 04:50:45.141904 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2065/4151] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:50:44 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1280 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:50:45.995514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a94868b-ca51-4baf-9676-5a09306e3e94 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:45.997513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a94868b-ca51-4baf-9676-5a09306e3e94 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:46.012862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a94868b-ca51-4baf-9676-5a09306e3e94 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:46.016962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a94868b-ca51-4baf-9676-5a09306e3e94 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:46.017445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a94868b-ca51-4baf-9676-5a09306e3e94 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:46.018207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a94868b-ca51-4baf-9676-5a09306e3e94 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:46.018670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a94868b-ca51-4baf-9676-5a09306e3e94 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:46.019099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a94868b-ca51-4baf-9676-5a09306e3e94 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:46.172138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8fb4b4fa-112a-46a7-a7e4-219235edba9f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:46.173447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8fb4b4fa-112a-46a7-a7e4-219235edba9f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:46.212658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fb4b4fa-112a-46a7-a7e4-219235edba9f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:46.213095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fb4b4fa-112a-46a7-a7e4-219235edba9f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:46.217290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fb4b4fa-112a-46a7-a7e4-219235edba9f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:46.222401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fb4b4fa-112a-46a7-a7e4-219235edba9f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:46.227881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fb4b4fa-112a-46a7-a7e4-219235edba9f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:46.228617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fb4b4fa-112a-46a7-a7e4-219235edba9f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:46.332612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a94868b-ca51-4baf-9676-5a09306e3e94 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:46.347134 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a94868b-ca51-4baf-9676-5a09306e3e94 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1522 microversion: 2.1 time: 0.355975 Aug 27 04:50:46.348635 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2087/4152] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:45 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:46.428143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8fb4b4fa-112a-46a7-a7e4-219235edba9f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:46.469673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8fb4b4fa-112a-46a7-a7e4-219235edba9f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:46.481438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8fb4b4fa-112a-46a7-a7e4-219235edba9f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:46.483998 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8fb4b4fa-112a-46a7-a7e4-219235edba9f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1334 microversion: 2.57 time: 0.317265 Aug 27 04:50:46.492656 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2066/4153] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:50:46 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1334 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:50:47.380720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f6b01f6-e608-46b1-bec6-77b5488e0516 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:47.382974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f6b01f6-e608-46b1-bec6-77b5488e0516 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:47.403302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f6b01f6-e608-46b1-bec6-77b5488e0516 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:47.405598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f6b01f6-e608-46b1-bec6-77b5488e0516 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:47.407741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f6b01f6-e608-46b1-bec6-77b5488e0516 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:47.409854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f6b01f6-e608-46b1-bec6-77b5488e0516 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:47.412114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f6b01f6-e608-46b1-bec6-77b5488e0516 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:47.413121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f6b01f6-e608-46b1-bec6-77b5488e0516 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:47.516849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf6f2e96-1103-4782-8b4e-48f130106b45 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:47.518877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bf6f2e96-1103-4782-8b4e-48f130106b45 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:47.539494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:47.545060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf6f2e96-1103-4782-8b4e-48f130106b45 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:47.548285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf6f2e96-1103-4782-8b4e-48f130106b45 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:47.548695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf6f2e96-1103-4782-8b4e-48f130106b45 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:47.552404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf6f2e96-1103-4782-8b4e-48f130106b45 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:47.553077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf6f2e96-1103-4782-8b4e-48f130106b45 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:47.553679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf6f2e96-1103-4782-8b4e-48f130106b45 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:47.618210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f6b01f6-e608-46b1-bec6-77b5488e0516 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:47.637346 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f6b01f6-e608-46b1-bec6-77b5488e0516 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1522 microversion: 2.1 time: 0.266048 Aug 27 04:50:47.649696 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2088/4154] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:47 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:47.705441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bf6f2e96-1103-4782-8b4e-48f130106b45 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:47.714417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bf6f2e96-1103-4782-8b4e-48f130106b45 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:47.717384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bf6f2e96-1103-4782-8b4e-48f130106b45 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:47.718772 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bf6f2e96-1103-4782-8b4e-48f130106b45 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1334 microversion: 2.57 time: 0.209222 Aug 27 04:50:47.735188 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2067/4155] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:50:47 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1334 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:50:48.663095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0640c6a9-0cad-4ce8-b58c-38a1c5e451f8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:48.663774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0640c6a9-0cad-4ce8-b58c-38a1c5e451f8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:48.676734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0640c6a9-0cad-4ce8-b58c-38a1c5e451f8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:48.680122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0640c6a9-0cad-4ce8-b58c-38a1c5e451f8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:48.684218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0640c6a9-0cad-4ce8-b58c-38a1c5e451f8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:48.684461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0640c6a9-0cad-4ce8-b58c-38a1c5e451f8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:48.686111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0640c6a9-0cad-4ce8-b58c-38a1c5e451f8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:48.686564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0640c6a9-0cad-4ce8-b58c-38a1c5e451f8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:48.748934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3f1ae09e-4f0b-4d89-a57d-d687d07ddb33 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:48.752175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3f1ae09e-4f0b-4d89-a57d-d687d07ddb33 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:48.781941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f1ae09e-4f0b-4d89-a57d-d687d07ddb33 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:48.782453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f1ae09e-4f0b-4d89-a57d-d687d07ddb33 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:48.782903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f1ae09e-4f0b-4d89-a57d-d687d07ddb33 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:48.783622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f1ae09e-4f0b-4d89-a57d-d687d07ddb33 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:48.784087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f1ae09e-4f0b-4d89-a57d-d687d07ddb33 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:48.784523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f1ae09e-4f0b-4d89-a57d-d687d07ddb33 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:48.951675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0640c6a9-0cad-4ce8-b58c-38a1c5e451f8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:48.962257 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0640c6a9-0cad-4ce8-b58c-38a1c5e451f8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1522 microversion: 2.1 time: 0.304904 Aug 27 04:50:48.970852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3f1ae09e-4f0b-4d89-a57d-d687d07ddb33 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:48.973234 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2089/4156] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:48 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:48.981552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3f1ae09e-4f0b-4d89-a57d-d687d07ddb33 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:48.989389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3f1ae09e-4f0b-4d89-a57d-d687d07ddb33 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:48.993456 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3f1ae09e-4f0b-4d89-a57d-d687d07ddb33 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1355 microversion: 2.57 time: 0.253563 Aug 27 04:50:48.995516 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2068/4157] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:50:48 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1355 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:50:49.030688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:50:49.041647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:49.059124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:49.059871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:49.060597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:49.061716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:49.062625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:49.063293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:49.177649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:50:49.191532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:50:49.193143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:50:49.195094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:50:49.198203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:50:49.395301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:49.410137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:49.410896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:49.411537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:49.412486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:49.413476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:49.414122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:49.498160 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a7f64909-1f50-4518-af89-d71b8b1ccadb tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "POST /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda/action" status: 202 len: 1136 microversion: 2.57 time: 0.472294 Aug 27 04:50:49.498841 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2090/4158] 10.222.0.79 () {62 vars in 1320 bytes} [Sat Aug 27 04:50:49 2022] POST /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda/action => generated 1136 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 04:50:49.522668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-19bdc58c-0201-4138-bad9-620fb638687a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:49.525169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-19bdc58c-0201-4138-bad9-620fb638687a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:49.547499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19bdc58c-0201-4138-bad9-620fb638687a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:49.547999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19bdc58c-0201-4138-bad9-620fb638687a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:49.548438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19bdc58c-0201-4138-bad9-620fb638687a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:49.549900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19bdc58c-0201-4138-bad9-620fb638687a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:49.552936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19bdc58c-0201-4138-bad9-620fb638687a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:49.553439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19bdc58c-0201-4138-bad9-620fb638687a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:49.725303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-19bdc58c-0201-4138-bad9-620fb638687a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:49.737575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-19bdc58c-0201-4138-bad9-620fb638687a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:49.739222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-19bdc58c-0201-4138-bad9-620fb638687a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:49.740499 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-19bdc58c-0201-4138-bad9-620fb638687a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.224858 Aug 27 04:50:49.741591 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2069/4159] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:50:49 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:50:49.987556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a81354a7-81ac-4258-a438-6f674d1609f4 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:49.988655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a81354a7-81ac-4258-a438-6f674d1609f4 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:50.004622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81354a7-81ac-4258-a438-6f674d1609f4 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:50.007293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81354a7-81ac-4258-a438-6f674d1609f4 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:50.009064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81354a7-81ac-4258-a438-6f674d1609f4 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:50.011629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81354a7-81ac-4258-a438-6f674d1609f4 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:50.013304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81354a7-81ac-4258-a438-6f674d1609f4 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:50.015016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81354a7-81ac-4258-a438-6f674d1609f4 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:50.327211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a81354a7-81ac-4258-a438-6f674d1609f4 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:50.343057 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a81354a7-81ac-4258-a438-6f674d1609f4 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1522 microversion: 2.1 time: 0.360934 Aug 27 04:50:50.344261 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2091/4160] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:49 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:50.771237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2509a227-26ba-49fc-9336-0bbafe3bda2b tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:50.772858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2509a227-26ba-49fc-9336-0bbafe3bda2b tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:50.787997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2509a227-26ba-49fc-9336-0bbafe3bda2b tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:50.788823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2509a227-26ba-49fc-9336-0bbafe3bda2b tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:50.790728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2509a227-26ba-49fc-9336-0bbafe3bda2b tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:50.792847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2509a227-26ba-49fc-9336-0bbafe3bda2b tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:50.794272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2509a227-26ba-49fc-9336-0bbafe3bda2b tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:50.795289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2509a227-26ba-49fc-9336-0bbafe3bda2b tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:50.870557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=10 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:51.001140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2509a227-26ba-49fc-9336-0bbafe3bda2b tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:51.015669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2509a227-26ba-49fc-9336-0bbafe3bda2b tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:51.025419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2509a227-26ba-49fc-9336-0bbafe3bda2b tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:51.027836 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2509a227-26ba-49fc-9336-0bbafe3bda2b tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.263107 Aug 27 04:50:51.029557 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2070/4161] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:50:50 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:50:51.367592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b6ff317-b9ce-4dc9-892d-59497da4bb73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:51.370292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b6ff317-b9ce-4dc9-892d-59497da4bb73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:51.385943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b6ff317-b9ce-4dc9-892d-59497da4bb73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:51.386935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b6ff317-b9ce-4dc9-892d-59497da4bb73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:51.391325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b6ff317-b9ce-4dc9-892d-59497da4bb73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:51.391325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b6ff317-b9ce-4dc9-892d-59497da4bb73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:51.391687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b6ff317-b9ce-4dc9-892d-59497da4bb73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:51.392935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b6ff317-b9ce-4dc9-892d-59497da4bb73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:52.067488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cbf003dd-1e9e-4b21-870b-5c4742fb6c7a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:52.081755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cbf003dd-1e9e-4b21-870b-5c4742fb6c7a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:52.116276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbf003dd-1e9e-4b21-870b-5c4742fb6c7a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:52.117081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbf003dd-1e9e-4b21-870b-5c4742fb6c7a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:52.119521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbf003dd-1e9e-4b21-870b-5c4742fb6c7a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:52.120324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbf003dd-1e9e-4b21-870b-5c4742fb6c7a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:52.120867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbf003dd-1e9e-4b21-870b-5c4742fb6c7a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:52.121291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbf003dd-1e9e-4b21-870b-5c4742fb6c7a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:52.510167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cbf003dd-1e9e-4b21-870b-5c4742fb6c7a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:52.533265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cbf003dd-1e9e-4b21-870b-5c4742fb6c7a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:52.538681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cbf003dd-1e9e-4b21-870b-5c4742fb6c7a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:52.547065 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cbf003dd-1e9e-4b21-870b-5c4742fb6c7a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.489977 Aug 27 04:50:52.547682 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2071/4162] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:50:52 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:50:52.618660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b6ff317-b9ce-4dc9-892d-59497da4bb73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:52.631255 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b6ff317-b9ce-4dc9-892d-59497da4bb73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1522 microversion: 2.1 time: 1.268536 Aug 27 04:50:52.634268 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2092/4163] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:51 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1522 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:53.574355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f44341ee-52a1-4e31-9c6d-56194243d74f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:53.575882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f44341ee-52a1-4e31-9c6d-56194243d74f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:53.610537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f44341ee-52a1-4e31-9c6d-56194243d74f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:53.623401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f44341ee-52a1-4e31-9c6d-56194243d74f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:53.625248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f44341ee-52a1-4e31-9c6d-56194243d74f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:53.627167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f44341ee-52a1-4e31-9c6d-56194243d74f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:53.636460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f44341ee-52a1-4e31-9c6d-56194243d74f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:53.637668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f44341ee-52a1-4e31-9c6d-56194243d74f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:53.655793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50b84428-c5d8-4432-9f4c-8edc1dc48376 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:53.656748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50b84428-c5d8-4432-9f4c-8edc1dc48376 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:53.659378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:53.664007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:53.689253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b84428-c5d8-4432-9f4c-8edc1dc48376 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:53.690996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b84428-c5d8-4432-9f4c-8edc1dc48376 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:53.695425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b84428-c5d8-4432-9f4c-8edc1dc48376 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:53.717501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b84428-c5d8-4432-9f4c-8edc1dc48376 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:53.718730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b84428-c5d8-4432-9f4c-8edc1dc48376 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:53.721717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b84428-c5d8-4432-9f4c-8edc1dc48376 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:53.727880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:53.988161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f44341ee-52a1-4e31-9c6d-56194243d74f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:54.030446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f44341ee-52a1-4e31-9c6d-56194243d74f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:54.032324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f44341ee-52a1-4e31-9c6d-56194243d74f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:54.036398 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f44341ee-52a1-4e31-9c6d-56194243d74f tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.467007 Aug 27 04:50:54.060038 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2072/4164] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:50:53 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:50:54.116129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50b84428-c5d8-4432-9f4c-8edc1dc48376 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:54.126793 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50b84428-c5d8-4432-9f4c-8edc1dc48376 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1522 microversion: 2.1 time: 0.476502 Aug 27 04:50:54.129279 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2093/4165] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:53 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:50:55.064175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4cef6a09-3314-491f-9cd7-2f980c6b8558 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:55.065959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4cef6a09-3314-491f-9cd7-2f980c6b8558 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:55.079296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cef6a09-3314-491f-9cd7-2f980c6b8558 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:55.081335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cef6a09-3314-491f-9cd7-2f980c6b8558 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:55.083257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cef6a09-3314-491f-9cd7-2f980c6b8558 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:55.087200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cef6a09-3314-491f-9cd7-2f980c6b8558 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:55.088038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cef6a09-3314-491f-9cd7-2f980c6b8558 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:55.089619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4cef6a09-3314-491f-9cd7-2f980c6b8558 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:55.156581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a2cb55f2-1a9a-4fb0-a787-501c3d65bdc5 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:55.160408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a2cb55f2-1a9a-4fb0-a787-501c3d65bdc5 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:55.185475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2cb55f2-1a9a-4fb0-a787-501c3d65bdc5 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:55.189256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2cb55f2-1a9a-4fb0-a787-501c3d65bdc5 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:55.190917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2cb55f2-1a9a-4fb0-a787-501c3d65bdc5 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:55.193997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2cb55f2-1a9a-4fb0-a787-501c3d65bdc5 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:55.196469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2cb55f2-1a9a-4fb0-a787-501c3d65bdc5 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:55.200011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2cb55f2-1a9a-4fb0-a787-501c3d65bdc5 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:55.388903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4cef6a09-3314-491f-9cd7-2f980c6b8558 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:55.413675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4cef6a09-3314-491f-9cd7-2f980c6b8558 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:55.418421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4cef6a09-3314-491f-9cd7-2f980c6b8558 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:55.423348 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4cef6a09-3314-491f-9cd7-2f980c6b8558 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.362855 Aug 27 04:50:55.450523 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2073/4166] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:50:55 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:50:55.568491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a2cb55f2-1a9a-4fb0-a787-501c3d65bdc5 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:55.577114 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a2cb55f2-1a9a-4fb0-a787-501c3d65bdc5 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1522 microversion: 2.1 time: 0.430387 Aug 27 04:50:55.582820 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2094/4167] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:55 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:56.455533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-54e1466f-8a4f-42db-9017-fb73b1244b8a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:56.458955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-54e1466f-8a4f-42db-9017-fb73b1244b8a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:56.477765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54e1466f-8a4f-42db-9017-fb73b1244b8a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:56.479562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54e1466f-8a4f-42db-9017-fb73b1244b8a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:56.486131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54e1466f-8a4f-42db-9017-fb73b1244b8a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:56.487305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54e1466f-8a4f-42db-9017-fb73b1244b8a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:56.490336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54e1466f-8a4f-42db-9017-fb73b1244b8a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:56.491658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54e1466f-8a4f-42db-9017-fb73b1244b8a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:56.645577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b21c7b6f-bb95-433e-bd3f-cda493489855 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:56.646373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b21c7b6f-bb95-433e-bd3f-cda493489855 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:56.682760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b21c7b6f-bb95-433e-bd3f-cda493489855 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:56.683423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b21c7b6f-bb95-433e-bd3f-cda493489855 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:56.684844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b21c7b6f-bb95-433e-bd3f-cda493489855 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:56.689836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b21c7b6f-bb95-433e-bd3f-cda493489855 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:56.691215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b21c7b6f-bb95-433e-bd3f-cda493489855 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:56.693749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b21c7b6f-bb95-433e-bd3f-cda493489855 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:56.702784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:57.009630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b21c7b6f-bb95-433e-bd3f-cda493489855 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:57.018671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-54e1466f-8a4f-42db-9017-fb73b1244b8a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:57.027264 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b21c7b6f-bb95-433e-bd3f-cda493489855 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1522 microversion: 2.1 time: 0.427739 Aug 27 04:50:57.027859 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2095/4168] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:56 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:57.052209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-54e1466f-8a4f-42db-9017-fb73b1244b8a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:57.056447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-54e1466f-8a4f-42db-9017-fb73b1244b8a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:57.059545 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-54e1466f-8a4f-42db-9017-fb73b1244b8a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.607882 Aug 27 04:50:57.078816 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2074/4169] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:50:56 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:50:58.058237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7701b9fa-5119-4dc6-8126-df562f4ef6e6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:58.059736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7701b9fa-5119-4dc6-8126-df562f4ef6e6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:58.087289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8ef06872-e9b9-439b-a3c3-1fb4e5e375c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:58.091396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8ef06872-e9b9-439b-a3c3-1fb4e5e375c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:58.103096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7701b9fa-5119-4dc6-8126-df562f4ef6e6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:58.121044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7701b9fa-5119-4dc6-8126-df562f4ef6e6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:58.124151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7701b9fa-5119-4dc6-8126-df562f4ef6e6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:58.125396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7701b9fa-5119-4dc6-8126-df562f4ef6e6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:58.128890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ef06872-e9b9-439b-a3c3-1fb4e5e375c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:58.138816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ef06872-e9b9-439b-a3c3-1fb4e5e375c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:58.139599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ef06872-e9b9-439b-a3c3-1fb4e5e375c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:58.140468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ef06872-e9b9-439b-a3c3-1fb4e5e375c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:58.141088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7701b9fa-5119-4dc6-8126-df562f4ef6e6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:58.141751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7701b9fa-5119-4dc6-8126-df562f4ef6e6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:58.142389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ef06872-e9b9-439b-a3c3-1fb4e5e375c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:58.148189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ef06872-e9b9-439b-a3c3-1fb4e5e375c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:58.556301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7701b9fa-5119-4dc6-8126-df562f4ef6e6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:58.567548 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7701b9fa-5119-4dc6-8126-df562f4ef6e6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1522 microversion: 2.1 time: 0.514383 Aug 27 04:50:58.573802 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2096/4170] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:58 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:58.741525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ef06872-e9b9-439b-a3c3-1fb4e5e375c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:58.751818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ef06872-e9b9-439b-a3c3-1fb4e5e375c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:58.754485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ef06872-e9b9-439b-a3c3-1fb4e5e375c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:58.756134 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8ef06872-e9b9-439b-a3c3-1fb4e5e375c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.674298 Aug 27 04:50:58.757039 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2075/4171] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:50:58 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:50:59.598824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef37a1a0-d607-405e-b849-51d23005aa87 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:59.600110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef37a1a0-d607-405e-b849-51d23005aa87 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:59.623033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef37a1a0-d607-405e-b849-51d23005aa87 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:59.625246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef37a1a0-d607-405e-b849-51d23005aa87 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:59.625884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef37a1a0-d607-405e-b849-51d23005aa87 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:59.626758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef37a1a0-d607-405e-b849-51d23005aa87 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:59.632907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef37a1a0-d607-405e-b849-51d23005aa87 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:59.633890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef37a1a0-d607-405e-b849-51d23005aa87 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:59.779960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d5c1b738-b45b-4a51-b174-b4321c74d2b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:50:59.780598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d5c1b738-b45b-4a51-b174-b4321c74d2b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:50:59.798429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5c1b738-b45b-4a51-b174-b4321c74d2b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:59.798996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5c1b738-b45b-4a51-b174-b4321c74d2b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:59.799441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5c1b738-b45b-4a51-b174-b4321c74d2b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:59.800197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5c1b738-b45b-4a51-b174-b4321c74d2b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:50:59.800730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5c1b738-b45b-4a51-b174-b4321c74d2b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:50:59.801169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5c1b738-b45b-4a51-b174-b4321c74d2b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:50:59.908938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef37a1a0-d607-405e-b849-51d23005aa87 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:59.919239 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef37a1a0-d607-405e-b849-51d23005aa87 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1522 microversion: 2.1 time: 0.325246 Aug 27 04:50:59.936555 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2097/4172] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:59 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:50:59.976786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d5c1b738-b45b-4a51-b174-b4321c74d2b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:59.992810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d5c1b738-b45b-4a51-b174-b4321c74d2b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:59.994273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d5c1b738-b45b-4a51-b174-b4321c74d2b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:50:59.996003 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d5c1b738-b45b-4a51-b174-b4321c74d2b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.220093 Aug 27 04:51:00.008565 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2076/4173] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:50:59 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:51:00.949755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-256d77de-3790-450b-80b5-df0cd4454a16 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:00.950626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-256d77de-3790-450b-80b5-df0cd4454a16 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:00.968216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-256d77de-3790-450b-80b5-df0cd4454a16 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:00.969013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-256d77de-3790-450b-80b5-df0cd4454a16 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:00.972701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-256d77de-3790-450b-80b5-df0cd4454a16 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:00.975995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-256d77de-3790-450b-80b5-df0cd4454a16 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:00.977141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-256d77de-3790-450b-80b5-df0cd4454a16 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:00.978172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-256d77de-3790-450b-80b5-df0cd4454a16 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:01.045291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb9d9374-737b-4b75-a9c2-a2fdb47e840d tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:01.050185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eb9d9374-737b-4b75-a9c2-a2fdb47e840d tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:01.074240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb9d9374-737b-4b75-a9c2-a2fdb47e840d tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:01.076314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb9d9374-737b-4b75-a9c2-a2fdb47e840d tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:01.080040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb9d9374-737b-4b75-a9c2-a2fdb47e840d tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:01.083036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb9d9374-737b-4b75-a9c2-a2fdb47e840d tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:01.084641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb9d9374-737b-4b75-a9c2-a2fdb47e840d tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:01.085366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb9d9374-737b-4b75-a9c2-a2fdb47e840d tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:01.284272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb9d9374-737b-4b75-a9c2-a2fdb47e840d tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:01.303166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb9d9374-737b-4b75-a9c2-a2fdb47e840d tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:01.308323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-256d77de-3790-450b-80b5-df0cd4454a16 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:01.309222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb9d9374-737b-4b75-a9c2-a2fdb47e840d tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:01.312366 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb9d9374-737b-4b75-a9c2-a2fdb47e840d tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.283003 Aug 27 04:51:01.315972 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2077/4174] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:01 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:01.319402 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-256d77de-3790-450b-80b5-df0cd4454a16 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1522 microversion: 2.1 time: 0.374628 Aug 27 04:51:01.320821 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2098/4175] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:00 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:02.340105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c864c090-a77e-4982-b9da-8b6fa92c00b1 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:02.346064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b027c0c-b24d-4d9b-9e47-771c653a2080 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:02.346689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b027c0c-b24d-4d9b-9e47-771c653a2080 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:02.349456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c864c090-a77e-4982-b9da-8b6fa92c00b1 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:02.371611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c864c090-a77e-4982-b9da-8b6fa92c00b1 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:02.374545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b027c0c-b24d-4d9b-9e47-771c653a2080 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:02.375144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b027c0c-b24d-4d9b-9e47-771c653a2080 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:02.375611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b027c0c-b24d-4d9b-9e47-771c653a2080 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:02.376356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b027c0c-b24d-4d9b-9e47-771c653a2080 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:02.377292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c864c090-a77e-4982-b9da-8b6fa92c00b1 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:02.377797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c864c090-a77e-4982-b9da-8b6fa92c00b1 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:02.378699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c864c090-a77e-4982-b9da-8b6fa92c00b1 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:02.379174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c864c090-a77e-4982-b9da-8b6fa92c00b1 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:02.379596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c864c090-a77e-4982-b9da-8b6fa92c00b1 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:02.387440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b027c0c-b24d-4d9b-9e47-771c653a2080 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:02.387986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b027c0c-b24d-4d9b-9e47-771c653a2080 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:02.540582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c864c090-a77e-4982-b9da-8b6fa92c00b1 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:02.552830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c864c090-a77e-4982-b9da-8b6fa92c00b1 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:02.556807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c864c090-a77e-4982-b9da-8b6fa92c00b1 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:02.559809 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c864c090-a77e-4982-b9da-8b6fa92c00b1 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.225640 Aug 27 04:51:02.560745 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2078/4176] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:02 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:03.061151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b027c0c-b24d-4d9b-9e47-771c653a2080 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:03.076136 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b027c0c-b24d-4d9b-9e47-771c653a2080 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1499 microversion: 2.1 time: 0.733113 Aug 27 04:51:03.080486 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2099/4177] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:02 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1499 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:03.115536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-da72a530-cb19-47f5-9ac4-b7bcfa9a29c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:03.134449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-da72a530-cb19-47f5-9ac4-b7bcfa9a29c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:03.136310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-da72a530-cb19-47f5-9ac4-b7bcfa9a29c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:51:03.157187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da72a530-cb19-47f5-9ac4-b7bcfa9a29c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:03.160477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da72a530-cb19-47f5-9ac4-b7bcfa9a29c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:03.161369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da72a530-cb19-47f5-9ac4-b7bcfa9a29c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:03.164361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da72a530-cb19-47f5-9ac4-b7bcfa9a29c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:03.166111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da72a530-cb19-47f5-9ac4-b7bcfa9a29c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:03.168939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da72a530-cb19-47f5-9ac4-b7bcfa9a29c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:03.382522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:03.388014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-da72a530-cb19-47f5-9ac4-b7bcfa9a29c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:51:03.487853 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-da72a530-cb19-47f5-9ac4-b7bcfa9a29c2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.389835 Aug 27 04:51:03.495082 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2079/4178] 10.222.0.79 () {58 vars in 1154 bytes} [Sat Aug 27 04:51:03 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:03.502087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2b8a06b6-0363-47f9-bdb5-196a617a1c98 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:03.512273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b8a06b6-0363-47f9-bdb5-196a617a1c98 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:03.513340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b8a06b6-0363-47f9-bdb5-196a617a1c98 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:03.513995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b8a06b6-0363-47f9-bdb5-196a617a1c98 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:03.544966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2b8a06b6-0363-47f9-bdb5-196a617a1c98 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Going to try to start instance {{(pid=128869) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 04:51:03.586116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-58c9bd08-a953-4a92-b255-53bc483a4efe tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:03.586746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-58c9bd08-a953-4a92-b255-53bc483a4efe tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:03.599247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58c9bd08-a953-4a92-b255-53bc483a4efe tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:03.599755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58c9bd08-a953-4a92-b255-53bc483a4efe tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:03.600203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58c9bd08-a953-4a92-b255-53bc483a4efe tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:03.606955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58c9bd08-a953-4a92-b255-53bc483a4efe tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:03.617137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58c9bd08-a953-4a92-b255-53bc483a4efe tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:03.618445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58c9bd08-a953-4a92-b255-53bc483a4efe tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:03.651550 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2b8a06b6-0363-47f9-bdb5-196a617a1c98 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "POST /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5/action" status: 202 len: 0 microversion: 2.1 time: 0.150557 Aug 27 04:51:03.652809 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2100/4179] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:51:03 2022] POST /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:51:03.664503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6c01ad7-a47b-45aa-a801-5cb57ae791f9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:03.665187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6c01ad7-a47b-45aa-a801-5cb57ae791f9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:03.693831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6c01ad7-a47b-45aa-a801-5cb57ae791f9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:03.694344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6c01ad7-a47b-45aa-a801-5cb57ae791f9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:03.694846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6c01ad7-a47b-45aa-a801-5cb57ae791f9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:03.695523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6c01ad7-a47b-45aa-a801-5cb57ae791f9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:03.695978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6c01ad7-a47b-45aa-a801-5cb57ae791f9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:03.696406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6c01ad7-a47b-45aa-a801-5cb57ae791f9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:03.770924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-58c9bd08-a953-4a92-b255-53bc483a4efe tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:03.783541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-58c9bd08-a953-4a92-b255-53bc483a4efe tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:03.787152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-58c9bd08-a953-4a92-b255-53bc483a4efe tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:03.788677 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-58c9bd08-a953-4a92-b255-53bc483a4efe tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.207818 Aug 27 04:51:03.789741 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2080/4180] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:03 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:04.122252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a6c01ad7-a47b-45aa-a801-5cb57ae791f9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:04.138387 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6c01ad7-a47b-45aa-a801-5cb57ae791f9 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1508 microversion: 2.1 time: 0.475492 Aug 27 04:51:04.140735 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2101/4181] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:03 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1508 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:51:04.816177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0d7858f-9cd8-414e-bb4f-118306b199b9 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:04.816932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c0d7858f-9cd8-414e-bb4f-118306b199b9 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:04.836026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0d7858f-9cd8-414e-bb4f-118306b199b9 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:04.841199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0d7858f-9cd8-414e-bb4f-118306b199b9 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:04.842748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0d7858f-9cd8-414e-bb4f-118306b199b9 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:04.845883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0d7858f-9cd8-414e-bb4f-118306b199b9 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:04.846470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0d7858f-9cd8-414e-bb4f-118306b199b9 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:04.849224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0d7858f-9cd8-414e-bb4f-118306b199b9 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:05.037876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c0d7858f-9cd8-414e-bb4f-118306b199b9 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:05.044916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c0d7858f-9cd8-414e-bb4f-118306b199b9 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:05.046895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c0d7858f-9cd8-414e-bb4f-118306b199b9 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:05.048211 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c0d7858f-9cd8-414e-bb4f-118306b199b9 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.237126 Aug 27 04:51:05.072146 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2081/4182] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:04 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:05.161782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c9d78c5-2a6a-46e8-9f0b-b4b12a656a90 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:05.162400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c9d78c5-2a6a-46e8-9f0b-b4b12a656a90 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:05.169805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c9d78c5-2a6a-46e8-9f0b-b4b12a656a90 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:05.172793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c9d78c5-2a6a-46e8-9f0b-b4b12a656a90 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:05.173494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c9d78c5-2a6a-46e8-9f0b-b4b12a656a90 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:05.174933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c9d78c5-2a6a-46e8-9f0b-b4b12a656a90 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:05.177673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c9d78c5-2a6a-46e8-9f0b-b4b12a656a90 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:05.178317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c9d78c5-2a6a-46e8-9f0b-b4b12a656a90 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:05.537850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5c9d78c5-2a6a-46e8-9f0b-b4b12a656a90 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:05.549777 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c9d78c5-2a6a-46e8-9f0b-b4b12a656a90 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1508 microversion: 2.1 time: 0.391739 Aug 27 04:51:05.568568 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2102/4183] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:05 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1508 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:06.097948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d4ef611e-8ecf-4c1c-9de9-c24f6b0ffd78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:06.099161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d4ef611e-8ecf-4c1c-9de9-c24f6b0ffd78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:06.109869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4ef611e-8ecf-4c1c-9de9-c24f6b0ffd78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:06.114260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4ef611e-8ecf-4c1c-9de9-c24f6b0ffd78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:06.115961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4ef611e-8ecf-4c1c-9de9-c24f6b0ffd78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:06.117859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4ef611e-8ecf-4c1c-9de9-c24f6b0ffd78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:06.118661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4ef611e-8ecf-4c1c-9de9-c24f6b0ffd78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:06.120048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4ef611e-8ecf-4c1c-9de9-c24f6b0ffd78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:06.326786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d4ef611e-8ecf-4c1c-9de9-c24f6b0ffd78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:06.344304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d4ef611e-8ecf-4c1c-9de9-c24f6b0ffd78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:06.359670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d4ef611e-8ecf-4c1c-9de9-c24f6b0ffd78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:06.361916 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d4ef611e-8ecf-4c1c-9de9-c24f6b0ffd78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.269244 Aug 27 04:51:06.367551 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2082/4184] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:06 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:06.583037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b708192-c465-4756-822c-3d0374753020 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:06.584304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b708192-c465-4756-822c-3d0374753020 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:06.601761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b708192-c465-4756-822c-3d0374753020 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:06.604292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b708192-c465-4756-822c-3d0374753020 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:06.606002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b708192-c465-4756-822c-3d0374753020 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:06.607805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b708192-c465-4756-822c-3d0374753020 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:06.608948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b708192-c465-4756-822c-3d0374753020 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:06.609395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b708192-c465-4756-822c-3d0374753020 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:06.867219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0b708192-c465-4756-822c-3d0374753020 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:06.879796 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b708192-c465-4756-822c-3d0374753020 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1512 microversion: 2.1 time: 0.300589 Aug 27 04:51:06.880833 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2103/4185] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:06 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:06.906580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5ae6e616-f20e-43dc-880a-392683662250 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:06.912733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5ae6e616-f20e-43dc-880a-392683662250 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:06.913531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.compute.servers [None req-5ae6e616-f20e-43dc-880a-392683662250 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Removing options 'limit' from query {{(pid=128870) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 04:51:06.914859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5ae6e616-f20e-43dc-880a-392683662250 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:51:06.916829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ae6e616-f20e-43dc-880a-392683662250 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:06.917742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ae6e616-f20e-43dc-880a-392683662250 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:06.918995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ae6e616-f20e-43dc-880a-392683662250 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:06.920157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ae6e616-f20e-43dc-880a-392683662250 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:06.920950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ae6e616-f20e-43dc-880a-392683662250 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:06.922584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ae6e616-f20e-43dc-880a-392683662250 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:06.924813 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5ae6e616-f20e-43dc-880a-392683662250 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.022316 Aug 27 04:51:06.925759 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2083/4186] 10.222.0.79 () {58 vars in 1140 bytes} [Sat Aug 27 04:51:06 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:51:06.937971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95d9812a-5ae5-415c-b570-8241c773050f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:06.938595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95d9812a-5ae5-415c-b570-8241c773050f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:06.945063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95d9812a-5ae5-415c-b570-8241c773050f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:06.946070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95d9812a-5ae5-415c-b570-8241c773050f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:06.946818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95d9812a-5ae5-415c-b570-8241c773050f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:06.948087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95d9812a-5ae5-415c-b570-8241c773050f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:06.948739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95d9812a-5ae5-415c-b570-8241c773050f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:06.949398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95d9812a-5ae5-415c-b570-8241c773050f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:07.148080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95d9812a-5ae5-415c-b570-8241c773050f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:07.165335 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95d9812a-5ae5-415c-b570-8241c773050f tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1512 microversion: 2.1 time: 0.228874 Aug 27 04:51:07.165335 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2104/4187] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:06 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:07.185762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-96c6d80f-7aaf-42f4-9ca9-0da23ef04a24 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:07.186375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-96c6d80f-7aaf-42f4-9ca9-0da23ef04a24 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 925af2b3-d33a-4284-ad7b-56e22964c16a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:07.193622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96c6d80f-7aaf-42f4-9ca9-0da23ef04a24 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:07.194303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96c6d80f-7aaf-42f4-9ca9-0da23ef04a24 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:07.194922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96c6d80f-7aaf-42f4-9ca9-0da23ef04a24 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:07.195796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96c6d80f-7aaf-42f4-9ca9-0da23ef04a24 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:07.196608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96c6d80f-7aaf-42f4-9ca9-0da23ef04a24 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:07.197281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96c6d80f-7aaf-42f4-9ca9-0da23ef04a24 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:07.389279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-96c6d80f-7aaf-42f4-9ca9-0da23ef04a24 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:07.399685 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-96c6d80f-7aaf-42f4-9ca9-0da23ef04a24 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a" status: 200 len: 1511 microversion: 2.1 time: 0.218344 Aug 27 04:51:07.401120 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2084/4188] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:07 2022] GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:07.424007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c98890a-9aa2-437c-802e-011c261f2205 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:07.424720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7c98890a-9aa2-437c-802e-011c261f2205 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:07.428243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1de67031-d0ce-4d86-ae2b-9a96ba35a745 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:07.429014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1de67031-d0ce-4d86-ae2b-9a96ba35a745 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:07.435550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c98890a-9aa2-437c-802e-011c261f2205 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:07.436089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c98890a-9aa2-437c-802e-011c261f2205 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:07.440503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c98890a-9aa2-437c-802e-011c261f2205 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:07.443072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c98890a-9aa2-437c-802e-011c261f2205 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:07.444716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1de67031-d0ce-4d86-ae2b-9a96ba35a745 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:07.445220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c98890a-9aa2-437c-802e-011c261f2205 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:07.445692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1de67031-d0ce-4d86-ae2b-9a96ba35a745 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:07.446159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1de67031-d0ce-4d86-ae2b-9a96ba35a745 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:07.446769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c98890a-9aa2-437c-802e-011c261f2205 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:07.446879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1de67031-d0ce-4d86-ae2b-9a96ba35a745 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:07.447382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1de67031-d0ce-4d86-ae2b-9a96ba35a745 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:07.449949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1de67031-d0ce-4d86-ae2b-9a96ba35a745 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:07.560746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7c98890a-9aa2-437c-802e-011c261f2205 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:07.572050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7c98890a-9aa2-437c-802e-011c261f2205 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:07.573492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7c98890a-9aa2-437c-802e-011c261f2205 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:07.580088 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7c98890a-9aa2-437c-802e-011c261f2205 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.167742 Aug 27 04:51:07.581008 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2105/4189] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:07 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:07.876812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1de67031-d0ce-4d86-ae2b-9a96ba35a745 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:07.892914 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1de67031-d0ce-4d86-ae2b-9a96ba35a745 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1513 microversion: 2.1 time: 0.473675 Aug 27 04:51:07.895942 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2085/4190] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:07 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1513 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:07.916988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af5166d9-b23f-49af-898f-ccf71637034a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:07.922984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af5166d9-b23f-49af-898f-ccf71637034a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:07.931382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af5166d9-b23f-49af-898f-ccf71637034a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:51:08.154603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5166d9-b23f-49af-898f-ccf71637034a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:08.155091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5166d9-b23f-49af-898f-ccf71637034a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:08.155526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5166d9-b23f-49af-898f-ccf71637034a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:08.156266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5166d9-b23f-49af-898f-ccf71637034a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:08.156770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5166d9-b23f-49af-898f-ccf71637034a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:08.157195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5166d9-b23f-49af-898f-ccf71637034a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:08.261775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-af5166d9-b23f-49af-898f-ccf71637034a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:51:08.343702 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af5166d9-b23f-49af-898f-ccf71637034a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 0.430751 Aug 27 04:51:08.353722 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2106/4191] 10.222.0.79 () {58 vars in 1154 bytes} [Sat Aug 27 04:51:07 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:08.366751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-768564f9-ae12-4442-9894-80395b36e774 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:08.368324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-768564f9-ae12-4442-9894-80395b36e774 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:08.380120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-768564f9-ae12-4442-9894-80395b36e774 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:08.382663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-768564f9-ae12-4442-9894-80395b36e774 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:08.383490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-768564f9-ae12-4442-9894-80395b36e774 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:08.384449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-768564f9-ae12-4442-9894-80395b36e774 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:08.386087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-768564f9-ae12-4442-9894-80395b36e774 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:08.386962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-768564f9-ae12-4442-9894-80395b36e774 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:08.606874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32436c01-a187-472e-b032-2978d581675e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:08.607804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32436c01-a187-472e-b032-2978d581675e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:08.622294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32436c01-a187-472e-b032-2978d581675e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:08.625156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32436c01-a187-472e-b032-2978d581675e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:08.626660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32436c01-a187-472e-b032-2978d581675e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:08.628517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32436c01-a187-472e-b032-2978d581675e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:08.630850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32436c01-a187-472e-b032-2978d581675e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:08.632457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32436c01-a187-472e-b032-2978d581675e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:08.769110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32436c01-a187-472e-b032-2978d581675e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:08.782229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32436c01-a187-472e-b032-2978d581675e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:08.784490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32436c01-a187-472e-b032-2978d581675e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:08.786505 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32436c01-a187-472e-b032-2978d581675e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.184436 Aug 27 04:51:08.787305 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2107/4192] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:08 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:51:08.819157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-768564f9-ae12-4442-9894-80395b36e774 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:08.840975 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-768564f9-ae12-4442-9894-80395b36e774 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1512 microversion: 2.1 time: 0.473697 Aug 27 04:51:08.840975 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2086/4193] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:08 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1512 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:08.857752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1e38080-4981-4989-ae43-7b74f1bf76d2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:08.860220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1e38080-4981-4989-ae43-7b74f1bf76d2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 925af2b3-d33a-4284-ad7b-56e22964c16a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:08.876992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1e38080-4981-4989-ae43-7b74f1bf76d2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:08.878803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1e38080-4981-4989-ae43-7b74f1bf76d2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:08.879565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1e38080-4981-4989-ae43-7b74f1bf76d2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:08.880828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1e38080-4981-4989-ae43-7b74f1bf76d2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:08.881713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1e38080-4981-4989-ae43-7b74f1bf76d2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:08.882615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1e38080-4981-4989-ae43-7b74f1bf76d2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:09.261385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1e38080-4981-4989-ae43-7b74f1bf76d2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:09.272935 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1e38080-4981-4989-ae43-7b74f1bf76d2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a" status: 200 len: 1511 microversion: 2.1 time: 0.420067 Aug 27 04:51:09.273839 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2108/4194] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:08 2022] GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a => generated 1511 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:09.299241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-33856c87-2543-42ee-9ac6-04e53496aa74 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:09.300079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-33856c87-2543-42ee-9ac6-04e53496aa74 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:09.309600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33856c87-2543-42ee-9ac6-04e53496aa74 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:09.310322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33856c87-2543-42ee-9ac6-04e53496aa74 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:09.310784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33856c87-2543-42ee-9ac6-04e53496aa74 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:09.312666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33856c87-2543-42ee-9ac6-04e53496aa74 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:09.313377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33856c87-2543-42ee-9ac6-04e53496aa74 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:09.314293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33856c87-2543-42ee-9ac6-04e53496aa74 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:09.813453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bb9970ae-94ad-4d2e-903e-fb59c74b5ee6 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:09.814266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bb9970ae-94ad-4d2e-903e-fb59c74b5ee6 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:09.842049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb9970ae-94ad-4d2e-903e-fb59c74b5ee6 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:09.842565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb9970ae-94ad-4d2e-903e-fb59c74b5ee6 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:09.843014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb9970ae-94ad-4d2e-903e-fb59c74b5ee6 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:09.850307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb9970ae-94ad-4d2e-903e-fb59c74b5ee6 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:09.850817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb9970ae-94ad-4d2e-903e-fb59c74b5ee6 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:09.851264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb9970ae-94ad-4d2e-903e-fb59c74b5ee6 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:10.008519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bb9970ae-94ad-4d2e-903e-fb59c74b5ee6 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:10.018613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bb9970ae-94ad-4d2e-903e-fb59c74b5ee6 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:10.022397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bb9970ae-94ad-4d2e-903e-fb59c74b5ee6 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:10.024287 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bb9970ae-94ad-4d2e-903e-fb59c74b5ee6 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.216252 Aug 27 04:51:10.029490 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2109/4195] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:09 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:51:10.074646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-33856c87-2543-42ee-9ac6-04e53496aa74 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:10.087268 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-33856c87-2543-42ee-9ac6-04e53496aa74 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1513 microversion: 2.1 time: 0.792431 Aug 27 04:51:10.088223 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2087/4196] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:09 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1513 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:10.115956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:10.131438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:10.132453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:51:10.140006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:10.141869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:10.142667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:10.144581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:10.145095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:10.146472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:10.390680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:10.404472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:51:10.519620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:10.529816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:10.530321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:10.530769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:10.895168 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-07d08c72-3648-4148-944f-50fc54afd270 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.786914 Aug 27 04:51:10.895531 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2110/4197] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:51:10 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:10.925809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-58cacc80-6e5f-447f-9698-5fe756f5d266 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:10.932505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-58cacc80-6e5f-447f-9698-5fe756f5d266 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:10.936426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-58cacc80-6e5f-447f-9698-5fe756f5d266 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:51:11.055882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-91f33a63-84fc-457c-baaa-caa45feed9ba tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:11.057573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-91f33a63-84fc-457c-baaa-caa45feed9ba tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:11.070374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91f33a63-84fc-457c-baaa-caa45feed9ba tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:11.070874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91f33a63-84fc-457c-baaa-caa45feed9ba tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:11.074109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91f33a63-84fc-457c-baaa-caa45feed9ba tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:11.079052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91f33a63-84fc-457c-baaa-caa45feed9ba tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:11.080185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91f33a63-84fc-457c-baaa-caa45feed9ba tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:11.080768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91f33a63-84fc-457c-baaa-caa45feed9ba tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:11.094112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58cacc80-6e5f-447f-9698-5fe756f5d266 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:11.094675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58cacc80-6e5f-447f-9698-5fe756f5d266 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:11.095336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58cacc80-6e5f-447f-9698-5fe756f5d266 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:11.096242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58cacc80-6e5f-447f-9698-5fe756f5d266 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:11.098365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58cacc80-6e5f-447f-9698-5fe756f5d266 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:11.101647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-58cacc80-6e5f-447f-9698-5fe756f5d266 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:11.269729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-58cacc80-6e5f-447f-9698-5fe756f5d266 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:51:11.348215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-91f33a63-84fc-457c-baaa-caa45feed9ba tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:11.359343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-91f33a63-84fc-457c-baaa-caa45feed9ba tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:11.361145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-91f33a63-84fc-457c-baaa-caa45feed9ba tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:11.366842 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-91f33a63-84fc-457c-baaa-caa45feed9ba tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.317231 Aug 27 04:51:11.367650 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2111/4198] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:11 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:11.412139 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-58cacc80-6e5f-447f-9698-5fe756f5d266 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.493089 Aug 27 04:51:11.412778 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2088/4199] 10.222.0.79 () {58 vars in 1150 bytes} [Sat Aug 27 04:51:10 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:11.428258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e748e4ca-6d7c-42a5-a846-3e18c6cb233d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:11.435098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e748e4ca-6d7c-42a5-a846-3e18c6cb233d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:11.435971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e748e4ca-6d7c-42a5-a846-3e18c6cb233d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:51:11.441783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e748e4ca-6d7c-42a5-a846-3e18c6cb233d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:11.442488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e748e4ca-6d7c-42a5-a846-3e18c6cb233d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:11.443075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e748e4ca-6d7c-42a5-a846-3e18c6cb233d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:11.444052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e748e4ca-6d7c-42a5-a846-3e18c6cb233d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:11.444729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e748e4ca-6d7c-42a5-a846-3e18c6cb233d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:11.445294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e748e4ca-6d7c-42a5-a846-3e18c6cb233d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:11.732131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-e748e4ca-6d7c-42a5-a846-3e18c6cb233d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:51:11.810615 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e748e4ca-6d7c-42a5-a846-3e18c6cb233d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.387143 Aug 27 04:51:11.812188 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2112/4200] 10.222.0.79 () {58 vars in 1212 bytes} [Sat Aug 27 04:51:11 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:11.825123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f93df57c-5a23-4d6f-9ac4-8f92bfcc24e8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:11.835120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f93df57c-5a23-4d6f-9ac4-8f92bfcc24e8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:11.836068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f93df57c-5a23-4d6f-9ac4-8f92bfcc24e8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:51:11.842450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93df57c-5a23-4d6f-9ac4-8f92bfcc24e8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:11.843553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93df57c-5a23-4d6f-9ac4-8f92bfcc24e8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:11.844211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93df57c-5a23-4d6f-9ac4-8f92bfcc24e8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:11.845261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93df57c-5a23-4d6f-9ac4-8f92bfcc24e8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:11.845938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93df57c-5a23-4d6f-9ac4-8f92bfcc24e8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:11.846611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93df57c-5a23-4d6f-9ac4-8f92bfcc24e8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:12.021351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-f93df57c-5a23-4d6f-9ac4-8f92bfcc24e8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:51:12.097346 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f93df57c-5a23-4d6f-9ac4-8f92bfcc24e8 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.276222 Aug 27 04:51:12.100814 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2089/4201] 10.222.0.79 () {58 vars in 1196 bytes} [Sat Aug 27 04:51:11 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:51:12.110685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d802d480-5bba-470b-9508-9b25dc4d690a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:12.119929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d802d480-5bba-470b-9508-9b25dc4d690a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:12.120709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d802d480-5bba-470b-9508-9b25dc4d690a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'name': '1702605915', 'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:51:12.132093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d802d480-5bba-470b-9508-9b25dc4d690a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:12.133238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d802d480-5bba-470b-9508-9b25dc4d690a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:12.133873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d802d480-5bba-470b-9508-9b25dc4d690a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:12.134877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d802d480-5bba-470b-9508-9b25dc4d690a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:12.139429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d802d480-5bba-470b-9508-9b25dc4d690a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:12.140167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d802d480-5bba-470b-9508-9b25dc4d690a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:12.265664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-d802d480-5bba-470b-9508-9b25dc4d690a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:51:12.393954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ebc1571a-2d4a-4fa7-a15b-1d0a65a76f34 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:12.394602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ebc1571a-2d4a-4fa7-a15b-1d0a65a76f34 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:12.405865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebc1571a-2d4a-4fa7-a15b-1d0a65a76f34 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:12.406370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebc1571a-2d4a-4fa7-a15b-1d0a65a76f34 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:12.406797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebc1571a-2d4a-4fa7-a15b-1d0a65a76f34 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:12.411902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebc1571a-2d4a-4fa7-a15b-1d0a65a76f34 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:12.412895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebc1571a-2d4a-4fa7-a15b-1d0a65a76f34 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:12.417347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebc1571a-2d4a-4fa7-a15b-1d0a65a76f34 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:12.422561 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d802d480-5bba-470b-9508-9b25dc4d690a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers?name=1702605915" status: 200 len: 346 microversion: 2.1 time: 0.315495 Aug 27 04:51:12.423389 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2113/4202] 10.222.0.79 () {58 vars in 1156 bytes} [Sat Aug 27 04:51:12 2022] GET /compute/v2.1/servers?name=1702605915 => generated 346 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:12.455919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1365764-04d7-48ee-9cd5-b24e545e5a6d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:12.464227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1365764-04d7-48ee-9cd5-b24e545e5a6d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:12.465310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1365764-04d7-48ee-9cd5-b24e545e5a6d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:51:12.471676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1365764-04d7-48ee-9cd5-b24e545e5a6d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:12.472510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1365764-04d7-48ee-9cd5-b24e545e5a6d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:12.473412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1365764-04d7-48ee-9cd5-b24e545e5a6d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:12.474425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1365764-04d7-48ee-9cd5-b24e545e5a6d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:12.475096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1365764-04d7-48ee-9cd5-b24e545e5a6d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:12.476471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1365764-04d7-48ee-9cd5-b24e545e5a6d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:12.619455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-d1365764-04d7-48ee-9cd5-b24e545e5a6d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:51:12.626255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ebc1571a-2d4a-4fa7-a15b-1d0a65a76f34 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:12.636325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ebc1571a-2d4a-4fa7-a15b-1d0a65a76f34 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:12.637807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ebc1571a-2d4a-4fa7-a15b-1d0a65a76f34 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:12.639134 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ebc1571a-2d4a-4fa7-a15b-1d0a65a76f34 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.249239 Aug 27 04:51:12.649072 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2090/4203] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:12 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:12.735743 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1365764-04d7-48ee-9cd5-b24e545e5a6d tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.294803 Aug 27 04:51:12.737416 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2114/4204] 10.222.0.79 () {58 vars in 1154 bytes} [Sat Aug 27 04:51:12 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:12.749716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-704e8aa3-13f1-4fef-aee8-7a82266f3f73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:12.755344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-704e8aa3-13f1-4fef-aee8-7a82266f3f73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:12.756021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-704e8aa3-13f1-4fef-aee8-7a82266f3f73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-170260591', 'deleted': False, 'project_id': '2296363eddb045d4abbe01a40e8a76b7'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:51:12.773419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-704e8aa3-13f1-4fef-aee8-7a82266f3f73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:12.773905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-704e8aa3-13f1-4fef-aee8-7a82266f3f73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:12.774339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-704e8aa3-13f1-4fef-aee8-7a82266f3f73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:12.775067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-704e8aa3-13f1-4fef-aee8-7a82266f3f73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:12.775828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-704e8aa3-13f1-4fef-aee8-7a82266f3f73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:12.776704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-704e8aa3-13f1-4fef-aee8-7a82266f3f73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:12.973711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-704e8aa3-13f1-4fef-aee8-7a82266f3f73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:51:13.065050 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-704e8aa3-13f1-4fef-aee8-7a82266f3f73 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-170260591" status: 200 len: 346 microversion: 2.1 time: 0.319173 Aug 27 04:51:13.066198 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2091/4205] 10.222.0.79 () {58 vars in 1228 bytes} [Sat Aug 27 04:51:12 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-170260591 => generated 346 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:13.082340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34070239-ce61-4149-b7f1-6c201595d8fe tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:13.083130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34070239-ce61-4149-b7f1-6c201595d8fe tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:13.090555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34070239-ce61-4149-b7f1-6c201595d8fe tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:13.091279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34070239-ce61-4149-b7f1-6c201595d8fe tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:13.091902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34070239-ce61-4149-b7f1-6c201595d8fe tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:13.092987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34070239-ce61-4149-b7f1-6c201595d8fe tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:13.093623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34070239-ce61-4149-b7f1-6c201595d8fe tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:13.094267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34070239-ce61-4149-b7f1-6c201595d8fe tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:13.140261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34070239-ce61-4149-b7f1-6c201595d8fe tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:51:13.266896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:13.299666 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34070239-ce61-4149-b7f1-6c201595d8fe tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 204 len: 0 microversion: 2.1 time: 0.221008 Aug 27 04:51:13.301280 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2115/4206] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:51:13 2022] DELETE /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:51:13.315466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d6a9cf06-6be0-472b-aa3d-0b89b288557a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:13.316209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d6a9cf06-6be0-472b-aa3d-0b89b288557a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:13.335529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6a9cf06-6be0-472b-aa3d-0b89b288557a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:13.336035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6a9cf06-6be0-472b-aa3d-0b89b288557a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:13.337046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6a9cf06-6be0-472b-aa3d-0b89b288557a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:13.338621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6a9cf06-6be0-472b-aa3d-0b89b288557a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:13.339260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6a9cf06-6be0-472b-aa3d-0b89b288557a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:13.339842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6a9cf06-6be0-472b-aa3d-0b89b288557a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:13.675853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-934ebd01-d40e-49fe-b6d2-4163cb6f61e8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:13.677314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-934ebd01-d40e-49fe-b6d2-4163cb6f61e8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:13.689132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-934ebd01-d40e-49fe-b6d2-4163cb6f61e8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:13.689953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-934ebd01-d40e-49fe-b6d2-4163cb6f61e8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:13.690793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-934ebd01-d40e-49fe-b6d2-4163cb6f61e8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:13.691818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-934ebd01-d40e-49fe-b6d2-4163cb6f61e8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:13.692854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-934ebd01-d40e-49fe-b6d2-4163cb6f61e8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:13.694866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-934ebd01-d40e-49fe-b6d2-4163cb6f61e8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:13.702190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d6a9cf06-6be0-472b-aa3d-0b89b288557a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:13.712906 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d6a9cf06-6be0-472b-aa3d-0b89b288557a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1519 microversion: 2.1 time: 0.407065 Aug 27 04:51:13.730101 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2092/4207] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:13 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1519 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:13.889986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-934ebd01-d40e-49fe-b6d2-4163cb6f61e8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:13.903732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-934ebd01-d40e-49fe-b6d2-4163cb6f61e8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:13.906173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-934ebd01-d40e-49fe-b6d2-4163cb6f61e8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:13.908564 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-934ebd01-d40e-49fe-b6d2-4163cb6f61e8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.236331 Aug 27 04:51:13.910098 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2116/4208] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:13 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:14.745861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-44dcce9d-2edf-4f9e-9702-872f879035e3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:14.746777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-44dcce9d-2edf-4f9e-9702-872f879035e3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:14.758766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44dcce9d-2edf-4f9e-9702-872f879035e3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:14.759448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44dcce9d-2edf-4f9e-9702-872f879035e3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:14.761106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44dcce9d-2edf-4f9e-9702-872f879035e3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:14.762975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44dcce9d-2edf-4f9e-9702-872f879035e3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:14.763667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44dcce9d-2edf-4f9e-9702-872f879035e3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:14.764345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44dcce9d-2edf-4f9e-9702-872f879035e3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:14.946291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef8cb81e-cfd7-458a-82b0-576a7d87bfc8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:14.948290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef8cb81e-cfd7-458a-82b0-576a7d87bfc8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:14.958601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef8cb81e-cfd7-458a-82b0-576a7d87bfc8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:14.959936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef8cb81e-cfd7-458a-82b0-576a7d87bfc8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:14.960837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef8cb81e-cfd7-458a-82b0-576a7d87bfc8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:14.961825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef8cb81e-cfd7-458a-82b0-576a7d87bfc8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:14.963502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef8cb81e-cfd7-458a-82b0-576a7d87bfc8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:14.964807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef8cb81e-cfd7-458a-82b0-576a7d87bfc8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:15.347961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef8cb81e-cfd7-458a-82b0-576a7d87bfc8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:15.360200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef8cb81e-cfd7-458a-82b0-576a7d87bfc8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:15.372785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef8cb81e-cfd7-458a-82b0-576a7d87bfc8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:15.375197 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef8cb81e-cfd7-458a-82b0-576a7d87bfc8 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.446451 Aug 27 04:51:15.375921 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2117/4209] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:14 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:15.658246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-44dcce9d-2edf-4f9e-9702-872f879035e3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:15.674586 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-44dcce9d-2edf-4f9e-9702-872f879035e3 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1519 microversion: 2.1 time: 0.929470 Aug 27 04:51:15.675930 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2093/4210] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:14 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1519 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:16.403995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0648022d-f391-4da0-9572-86ad1e1bac6e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:16.404791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0648022d-f391-4da0-9572-86ad1e1bac6e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:16.421255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0648022d-f391-4da0-9572-86ad1e1bac6e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:16.423248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0648022d-f391-4da0-9572-86ad1e1bac6e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:16.423917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0648022d-f391-4da0-9572-86ad1e1bac6e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:16.424873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0648022d-f391-4da0-9572-86ad1e1bac6e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:16.426927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0648022d-f391-4da0-9572-86ad1e1bac6e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:16.429352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0648022d-f391-4da0-9572-86ad1e1bac6e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:16.706753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1d816da1-9bc6-4f81-b688-dbdd540a043a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:16.708413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1d816da1-9bc6-4f81-b688-dbdd540a043a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:16.729304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0648022d-f391-4da0-9572-86ad1e1bac6e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:16.733391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d816da1-9bc6-4f81-b688-dbdd540a043a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:16.738075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d816da1-9bc6-4f81-b688-dbdd540a043a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:16.741414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d816da1-9bc6-4f81-b688-dbdd540a043a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:16.745413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d816da1-9bc6-4f81-b688-dbdd540a043a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:16.746072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d816da1-9bc6-4f81-b688-dbdd540a043a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:16.746688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d816da1-9bc6-4f81-b688-dbdd540a043a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:16.748058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0648022d-f391-4da0-9572-86ad1e1bac6e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:16.754092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0648022d-f391-4da0-9572-86ad1e1bac6e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:16.761551 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0648022d-f391-4da0-9572-86ad1e1bac6e tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.356585 Aug 27 04:51:16.762250 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2118/4211] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:16 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:16.791324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8aca4ff0-3c5d-4b3d-887c-9f7cdc1692eb req-af287300-714e-4dc8-a59e-a6d6421b1e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1fbd99f-a94d-44e4-a4d2-496f0d6e880c", "name": "network-vif-deleted", "tag": "753dd3c4-628d-42fc-90be-9f2377e05174"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:16.850511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8aca4ff0-3c5d-4b3d-887c-9f7cdc1692eb req-af287300-714e-4dc8-a59e-a6d6421b1e36 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:16.862642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8aca4ff0-3c5d-4b3d-887c-9f7cdc1692eb req-af287300-714e-4dc8-a59e-a6d6421b1e36 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:16.863233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8aca4ff0-3c5d-4b3d-887c-9f7cdc1692eb req-af287300-714e-4dc8-a59e-a6d6421b1e36 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:16.904875 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8aca4ff0-3c5d-4b3d-887c-9f7cdc1692eb req-af287300-714e-4dc8-a59e-a6d6421b1e36 service nova] Creating event network-vif-deleted:753dd3c4-628d-42fc-90be-9f2377e05174 for instance b1fbd99f-a94d-44e4-a4d2-496f0d6e880c on n-h1-854823-1 Aug 27 04:51:16.913413 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8aca4ff0-3c5d-4b3d-887c-9f7cdc1692eb req-af287300-714e-4dc8-a59e-a6d6421b1e36 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142066 Aug 27 04:51:16.924976 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2119/4212] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:17.152825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1d816da1-9bc6-4f81-b688-dbdd540a043a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:17.172516 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1d816da1-9bc6-4f81-b688-dbdd540a043a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 200 len: 1477 microversion: 2.1 time: 0.470659 Aug 27 04:51:17.174242 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2094/4213] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:16 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 1477 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:51:17.800382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a24ecbb9-41b5-4e82-af42-69aa5b6d6da0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:17.801276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a24ecbb9-41b5-4e82-af42-69aa5b6d6da0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:17.823112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a24ecbb9-41b5-4e82-af42-69aa5b6d6da0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:17.826142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a24ecbb9-41b5-4e82-af42-69aa5b6d6da0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:17.831027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a24ecbb9-41b5-4e82-af42-69aa5b6d6da0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:17.856877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a24ecbb9-41b5-4e82-af42-69aa5b6d6da0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:17.858435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a24ecbb9-41b5-4e82-af42-69aa5b6d6da0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:17.874754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a24ecbb9-41b5-4e82-af42-69aa5b6d6da0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:18.195570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0f681bd1-1798-4aa2-927c-5b3b8e009cf1 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:18.196422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0f681bd1-1798-4aa2-927c-5b3b8e009cf1 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: b1fbd99f-a94d-44e4-a4d2-496f0d6e880c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:18.210284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=52 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:18.212735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f681bd1-1798-4aa2-927c-5b3b8e009cf1 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:18.217600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f681bd1-1798-4aa2-927c-5b3b8e009cf1 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:18.218407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f681bd1-1798-4aa2-927c-5b3b8e009cf1 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:18.224716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f681bd1-1798-4aa2-927c-5b3b8e009cf1 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:18.230161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f681bd1-1798-4aa2-927c-5b3b8e009cf1 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:18.231125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f681bd1-1798-4aa2-927c-5b3b8e009cf1 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:18.282070 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-0f681bd1-1798-4aa2-927c-5b3b8e009cf1 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] HTTP exception thrown: Instance b1fbd99f-a94d-44e4-a4d2-496f0d6e880c could not be found. Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0f681bd1-1798-4aa2-927c-5b3b8e009cf1 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Request method failure captured: Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c HTTP/1.1 Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaJ42GDm6Svtn2sS-Uit-aaAVVXFrWdKSde1VOH9JpQ0XmMUJC0OSiZ0P5IJw0zyW54P5p2U6cNS5K7XhjjmSf2Yh0EiK9ZE2ynDRdDCZL81v1qrZ-lpqOmSESD6wYXMha4wnb0OgZST-nb4ATRjZZ6V5w2K42-kgJYsxRaTVUlvK4c Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 2296363eddb045d4abbe01a40e8a76b7 Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ListServerFiltersTestJSON-111571250 Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2296363eddb045d4abbe01a40e8a76b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2296363eddb045d4abbe01a40e8a76b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2296363eddb045d4abbe01a40e8a76b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2296363eddb045d4abbe01a40e8a76b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ListServerFiltersTestJSON-111571250 Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 2296363eddb045d4abbe01a40e8a76b7 Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-111571250 Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ListServerFiltersTestJSON-111571250-project Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 4a2acdb05d6b4e3e9a0102e18cfb8bbb Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ListServerFiltersTestJSON-111571250-project Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance b1fbd99f-a94d-44e4-a4d2-496f0d6e880c could not be found. Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'b1fbd99f-a94d-44e4-a4d2-496f0d6e880c'} Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1fbd99f-a94d-44e4-a4d2-496f0d6e880c could not be found. Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1fbd99f-a94d-44e4-a4d2-496f0d6e880c could not be found. Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:18.289133 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:51:18.294227 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:18.294227 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:18.294227 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:18.294227 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:51:18.294227 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:51:18.294227 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1fbd99f-a94d-44e4-a4d2-496f0d6e880c could not be found. Aug 27 04:51:18.294227 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:51:18.294747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a24ecbb9-41b5-4e82-af42-69aa5b6d6da0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:18.296696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0f681bd1-1798-4aa2-927c-5b3b8e009cf1 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Returning 404 to user: Instance b1fbd99f-a94d-44e4-a4d2-496f0d6e880c could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:18.301270 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0f681bd1-1798-4aa2-927c-5b3b8e009cf1 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c" status: 404 len: 111 microversion: 2.1 time: 0.110767 Aug 27 04:51:18.302361 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2095/4214] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:18 2022] GET /compute/v2.1/servers/b1fbd99f-a94d-44e4-a4d2-496f0d6e880c => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:51:18.310967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a24ecbb9-41b5-4e82-af42-69aa5b6d6da0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:18.312970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a24ecbb9-41b5-4e82-af42-69aa5b6d6da0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:18.314357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5cca0d43-d341-4cbf-94fa-0da0748b1d22 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:18.318180 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a24ecbb9-41b5-4e82-af42-69aa5b6d6da0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.528889 Aug 27 04:51:18.318715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5cca0d43-d341-4cbf-94fa-0da0748b1d22 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 925af2b3-d33a-4284-ad7b-56e22964c16a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:18.318833 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2120/4215] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:17 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:18.336468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cca0d43-d341-4cbf-94fa-0da0748b1d22 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:18.337212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cca0d43-d341-4cbf-94fa-0da0748b1d22 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:18.340071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cca0d43-d341-4cbf-94fa-0da0748b1d22 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:18.341011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cca0d43-d341-4cbf-94fa-0da0748b1d22 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:18.342228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cca0d43-d341-4cbf-94fa-0da0748b1d22 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:18.345793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cca0d43-d341-4cbf-94fa-0da0748b1d22 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:18.407358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:18.419861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5cca0d43-d341-4cbf-94fa-0da0748b1d22 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 925af2b3-d33a-4284-ad7b-56e22964c16a] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:51:18.653386 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5cca0d43-d341-4cbf-94fa-0da0748b1d22 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "DELETE /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a" status: 204 len: 0 microversion: 2.1 time: 0.346472 Aug 27 04:51:18.659219 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2096/4216] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:51:18 2022] DELETE /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:51:18.666767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-adbfccd6-4925-49c0-9344-e90381ff8523 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:18.667596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-adbfccd6-4925-49c0-9344-e90381ff8523 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 925af2b3-d33a-4284-ad7b-56e22964c16a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:18.682855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adbfccd6-4925-49c0-9344-e90381ff8523 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:18.689407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adbfccd6-4925-49c0-9344-e90381ff8523 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:18.691544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adbfccd6-4925-49c0-9344-e90381ff8523 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:18.693054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adbfccd6-4925-49c0-9344-e90381ff8523 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:18.698073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adbfccd6-4925-49c0-9344-e90381ff8523 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:18.698803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adbfccd6-4925-49c0-9344-e90381ff8523 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:19.357733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2c43b01e-44fb-422f-8882-029c5c271599 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:19.359177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2c43b01e-44fb-422f-8882-029c5c271599 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:19.389635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c43b01e-44fb-422f-8882-029c5c271599 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:19.393900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c43b01e-44fb-422f-8882-029c5c271599 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:19.395493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c43b01e-44fb-422f-8882-029c5c271599 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:19.403602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c43b01e-44fb-422f-8882-029c5c271599 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:19.404188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c43b01e-44fb-422f-8882-029c5c271599 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:19.406887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c43b01e-44fb-422f-8882-029c5c271599 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:19.418293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-adbfccd6-4925-49c0-9344-e90381ff8523 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:19.438842 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-adbfccd6-4925-49c0-9344-e90381ff8523 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a" status: 200 len: 1517 microversion: 2.1 time: 0.774459 Aug 27 04:51:19.452436 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2121/4217] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:18 2022] GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a => generated 1517 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:19.599857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2c43b01e-44fb-422f-8882-029c5c271599 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:19.608282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2c43b01e-44fb-422f-8882-029c5c271599 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:19.613504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2c43b01e-44fb-422f-8882-029c5c271599 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:19.616973 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2c43b01e-44fb-422f-8882-029c5c271599 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.272553 Aug 27 04:51:19.623268 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2097/4218] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:19 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:20.461978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c96acda9-2e84-414d-8801-d6914dce27f6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:20.463525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c96acda9-2e84-414d-8801-d6914dce27f6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 925af2b3-d33a-4284-ad7b-56e22964c16a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:20.492013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c96acda9-2e84-414d-8801-d6914dce27f6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:20.493008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c96acda9-2e84-414d-8801-d6914dce27f6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:20.496176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c96acda9-2e84-414d-8801-d6914dce27f6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:20.497308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c96acda9-2e84-414d-8801-d6914dce27f6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:20.498014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c96acda9-2e84-414d-8801-d6914dce27f6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:20.499912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c96acda9-2e84-414d-8801-d6914dce27f6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:20.520316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:20.646426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3d4a76a9-e507-40d4-a6a9-fb6b432861c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:20.647155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3d4a76a9-e507-40d4-a6a9-fb6b432861c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:20.700444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3d4a76a9-e507-40d4-a6a9-fb6b432861c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:20.701127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3d4a76a9-e507-40d4-a6a9-fb6b432861c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:20.701991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3d4a76a9-e507-40d4-a6a9-fb6b432861c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:20.702842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3d4a76a9-e507-40d4-a6a9-fb6b432861c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:20.703416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3d4a76a9-e507-40d4-a6a9-fb6b432861c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:20.704024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3d4a76a9-e507-40d4-a6a9-fb6b432861c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:20.988406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3d4a76a9-e507-40d4-a6a9-fb6b432861c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:21.008015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3d4a76a9-e507-40d4-a6a9-fb6b432861c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:21.016292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3d4a76a9-e507-40d4-a6a9-fb6b432861c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:21.026570 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3d4a76a9-e507-40d4-a6a9-fb6b432861c0 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1364 microversion: 2.57 time: 0.384907 Aug 27 04:51:21.028054 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2098/4219] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:20 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1364 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:21.152015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-07730df7-8786-4338-8d54-a84972db0b6a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Action: 'create', calling method: .version_select at 0x7f1f215fa670>, body: {"keypair": {"name": "tempest-keypair-1760453593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdPvsrhN0AgcHjL0QlU97NElfxKpsrUwWqY1BdH88uXATRvTPgHZu2eSVyxGpSXHhdOktEdtKIIfYqC02cVBSQr8IOsiKsUTwbJAbbOvCj9XNnnWRVuFKAn3j6MADEh5g=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:21.194908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-07730df7-8786-4338-8d54-a84972db0b6a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Getting quotas for project 26ab30a8d5fa4da892b06bc09b00d56b. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:51:21.216772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-07730df7-8786-4338-8d54-a84972db0b6a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Getting quotas for user c5a9d453b9894b15b3ce0ed9613617b0 and project 26ab30a8d5fa4da892b06bc09b00d56b. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:51:21.306050 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-07730df7-8786-4338-8d54-a84972db0b6a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.159901 Aug 27 04:51:21.308377 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2099/4220] 10.222.0.79 () {62 vars in 1200 bytes} [Sat Aug 27 04:51:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 163 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 04:51:21.859887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c96acda9-2e84-414d-8801-d6914dce27f6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:21.870865 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c96acda9-2e84-414d-8801-d6914dce27f6 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a" status: 200 len: 1517 microversion: 2.1 time: 1.413753 Aug 27 04:51:21.875410 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2122/4221] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:20 2022] GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a => generated 1517 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:51:22.057016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d7aacd79-ec6b-41ee-90f0-70c6d4e19800 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:22.058460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d7aacd79-ec6b-41ee-90f0-70c6d4e19800 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:22.093744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7aacd79-ec6b-41ee-90f0-70c6d4e19800 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:22.096028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7aacd79-ec6b-41ee-90f0-70c6d4e19800 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:22.101665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7aacd79-ec6b-41ee-90f0-70c6d4e19800 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:22.102686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7aacd79-ec6b-41ee-90f0-70c6d4e19800 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:22.106040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7aacd79-ec6b-41ee-90f0-70c6d4e19800 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:22.107634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7aacd79-ec6b-41ee-90f0-70c6d4e19800 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:22.370096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d7aacd79-ec6b-41ee-90f0-70c6d4e19800 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:22.400825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d7aacd79-ec6b-41ee-90f0-70c6d4e19800 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:22.407672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d7aacd79-ec6b-41ee-90f0-70c6d4e19800 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:22.409750 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d7aacd79-ec6b-41ee-90f0-70c6d4e19800 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1382 microversion: 2.57 time: 0.359858 Aug 27 04:51:22.414792 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2100/4222] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:22 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1382 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:22.904208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e238e944-3bde-4d52-b06c-b426dd840934 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:22.905077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e238e944-3bde-4d52-b06c-b426dd840934 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 925af2b3-d33a-4284-ad7b-56e22964c16a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:22.911900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:22.922469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e238e944-3bde-4d52-b06c-b426dd840934 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:22.922968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e238e944-3bde-4d52-b06c-b426dd840934 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:22.923412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e238e944-3bde-4d52-b06c-b426dd840934 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:22.935771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e238e944-3bde-4d52-b06c-b426dd840934 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:22.936558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e238e944-3bde-4d52-b06c-b426dd840934 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:22.937192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e238e944-3bde-4d52-b06c-b426dd840934 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:23.441971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a66e4254-9ee0-4884-8486-c5536e93d860 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:23.442591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a66e4254-9ee0-4884-8486-c5536e93d860 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:23.461750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:23.465716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a66e4254-9ee0-4884-8486-c5536e93d860 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:23.466219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a66e4254-9ee0-4884-8486-c5536e93d860 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:23.466660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a66e4254-9ee0-4884-8486-c5536e93d860 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:23.467377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a66e4254-9ee0-4884-8486-c5536e93d860 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:23.467835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a66e4254-9ee0-4884-8486-c5536e93d860 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:23.468260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a66e4254-9ee0-4884-8486-c5536e93d860 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:23.871660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a66e4254-9ee0-4884-8486-c5536e93d860 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:23.891838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a66e4254-9ee0-4884-8486-c5536e93d860 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:23.893310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a66e4254-9ee0-4884-8486-c5536e93d860 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:23.910287 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a66e4254-9ee0-4884-8486-c5536e93d860 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1370 microversion: 2.57 time: 0.465178 Aug 27 04:51:23.911573 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2101/4223] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:23 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1370 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:23.958482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e238e944-3bde-4d52-b06c-b426dd840934 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:23.969300 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e238e944-3bde-4d52-b06c-b426dd840934 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a" status: 200 len: 1517 microversion: 2.1 time: 1.071815 Aug 27 04:51:23.972022 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2123/4224] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:22 2022] GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a => generated 1517 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:23.991454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-657b2313-1744-4b96-a737-80f5120821c3 req-8c6606af-8330-4acf-b09f-eda46c2c1429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925af2b3-d33a-4284-ad7b-56e22964c16a", "name": "network-vif-deleted", "tag": "65bc142a-6e78-4b74-804d-815d545a3f03"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:24.023351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-657b2313-1744-4b96-a737-80f5120821c3 req-8c6606af-8330-4acf-b09f-eda46c2c1429 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:24.026622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-657b2313-1744-4b96-a737-80f5120821c3 req-8c6606af-8330-4acf-b09f-eda46c2c1429 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:24.027716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-657b2313-1744-4b96-a737-80f5120821c3 req-8c6606af-8330-4acf-b09f-eda46c2c1429 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:24.062596 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-657b2313-1744-4b96-a737-80f5120821c3 req-8c6606af-8330-4acf-b09f-eda46c2c1429 service nova] Creating event network-vif-deleted:65bc142a-6e78-4b74-804d-815d545a3f03 for instance 925af2b3-d33a-4284-ad7b-56e22964c16a on n-h2-854823-1 Aug 27 04:51:24.073399 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-657b2313-1744-4b96-a737-80f5120821c3 req-8c6606af-8330-4acf-b09f-eda46c2c1429 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085585 Aug 27 04:51:24.077235 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2102/4225] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:24.942216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1658af2a-5a8d-48bb-9d3a-37f499eed68a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:24.943236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1658af2a-5a8d-48bb-9d3a-37f499eed68a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:24.955219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1658af2a-5a8d-48bb-9d3a-37f499eed68a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:24.960717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1658af2a-5a8d-48bb-9d3a-37f499eed68a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:24.962093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1658af2a-5a8d-48bb-9d3a-37f499eed68a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:24.963112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1658af2a-5a8d-48bb-9d3a-37f499eed68a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:24.963995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1658af2a-5a8d-48bb-9d3a-37f499eed68a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:24.982158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1658af2a-5a8d-48bb-9d3a-37f499eed68a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:24.994337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e2525e4a-38e8-4ac6-9f3a-f5a52614a95b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:24.995773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e2525e4a-38e8-4ac6-9f3a-f5a52614a95b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 925af2b3-d33a-4284-ad7b-56e22964c16a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:25.008839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2525e4a-38e8-4ac6-9f3a-f5a52614a95b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:25.009377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2525e4a-38e8-4ac6-9f3a-f5a52614a95b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:25.009824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2525e4a-38e8-4ac6-9f3a-f5a52614a95b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:25.010544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2525e4a-38e8-4ac6-9f3a-f5a52614a95b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:25.011017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2525e4a-38e8-4ac6-9f3a-f5a52614a95b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:25.022210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2525e4a-38e8-4ac6-9f3a-f5a52614a95b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:25.055965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:25.148962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2525e4a-38e8-4ac6-9f3a-f5a52614a95b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:25.150752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2525e4a-38e8-4ac6-9f3a-f5a52614a95b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:25.151400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2525e4a-38e8-4ac6-9f3a-f5a52614a95b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:25.152089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-e2525e4a-38e8-4ac6-9f3a-f5a52614a95b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lazy-loading 'fault' on Instance uuid 925af2b3-d33a-4284-ad7b-56e22964c16a {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:51:25.343686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1658af2a-5a8d-48bb-9d3a-37f499eed68a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:25.379661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e2525e4a-38e8-4ac6-9f3a-f5a52614a95b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:25.384517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1658af2a-5a8d-48bb-9d3a-37f499eed68a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:25.392005 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e2525e4a-38e8-4ac6-9f3a-f5a52614a95b tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a" status: 200 len: 1310 microversion: 2.1 time: 0.402954 Aug 27 04:51:25.393012 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2103/4226] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:24 2022] GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a => generated 1310 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:25.419403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1277244879", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "66ea1505-721e-4180-8d0d-1bcd0c0b485d"}, {"port": "5217d8e2-0080-4d4f-adc5-5605b9551bd4", "tag": "port-1"}, {"port": "eac13bb8-53a4-4fc4-b9eb-498a1de166dc", "tag": "port-2"}, {"uuid": "37dfa722-39dd-4f37-9bc3-2dd97c0d4c14", "tag": "net-1"}, {"uuid": "37dfa722-39dd-4f37-9bc3-2dd97c0d4c14"}, {"uuid": "3b7e03ac-d0fc-4bb3-af09-3560b0d3e95f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3b7e03ac-d0fc-4bb3-af09-3560b0d3e95f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "90e986dc-691b-47a5-851f-6611c14e8871", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "966a0344-f405-4bc5-ac92-d41990c85850", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6a98d3ac-c3cf-416c-bdae-9b007e00acc9", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1996202720"}], "key_name": "tempest-keypair-1760453593", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:25.422064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1658af2a-5a8d-48bb-9d3a-37f499eed68a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:25.433231 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1658af2a-5a8d-48bb-9d3a-37f499eed68a tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1355 microversion: 2.57 time: 0.493513 Aug 27 04:51:25.435029 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2124/4227] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:24 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1355 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:25.466987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcfd5bb2-56a6-4273-8a51-2a8a499d0a78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:25.467483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fcfd5bb2-56a6-4273-8a51-2a8a499d0a78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:25.500038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcfd5bb2-56a6-4273-8a51-2a8a499d0a78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:25.501726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcfd5bb2-56a6-4273-8a51-2a8a499d0a78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:25.505122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcfd5bb2-56a6-4273-8a51-2a8a499d0a78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:25.506072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcfd5bb2-56a6-4273-8a51-2a8a499d0a78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:25.506957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcfd5bb2-56a6-4273-8a51-2a8a499d0a78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:25.507547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcfd5bb2-56a6-4273-8a51-2a8a499d0a78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:25.606350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fcfd5bb2-56a6-4273-8a51-2a8a499d0a78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:51:25.761187 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fcfd5bb2-56a6-4273-8a51-2a8a499d0a78 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 204 len: 0 microversion: 2.57 time: 0.296155 Aug 27 04:51:25.764784 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2125/4228] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:51:25 2022] DELETE /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:51:25.781781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dae9ef8a-7864-4890-8e2e-397c5c0a43b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:25.785434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dae9ef8a-7864-4890-8e2e-397c5c0a43b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:25.800305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae9ef8a-7864-4890-8e2e-397c5c0a43b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:25.801793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae9ef8a-7864-4890-8e2e-397c5c0a43b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:25.803923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae9ef8a-7864-4890-8e2e-397c5c0a43b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:25.806137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae9ef8a-7864-4890-8e2e-397c5c0a43b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:25.806937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae9ef8a-7864-4890-8e2e-397c5c0a43b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:25.808639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae9ef8a-7864-4890-8e2e-397c5c0a43b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:26.017677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dae9ef8a-7864-4890-8e2e-397c5c0a43b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:26.049927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dae9ef8a-7864-4890-8e2e-397c5c0a43b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:26.056175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dae9ef8a-7864-4890-8e2e-397c5c0a43b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b6d5a9e8e8e4dc8a454c04ca26da2c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39caf602bc9c47e4a7eb1c6ab6bc162e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:26.061820 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dae9ef8a-7864-4890-8e2e-397c5c0a43b3 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 200 len: 1361 microversion: 2.57 time: 0.291714 Aug 27 04:51:26.080293 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2126/4229] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:25 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 1361 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:26.418650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb2da100-441c-4ff8-82ce-ee662d2b9e97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:26.419281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fb2da100-441c-4ff8-82ce-ee662d2b9e97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 925af2b3-d33a-4284-ad7b-56e22964c16a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:26.439649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2da100-441c-4ff8-82ce-ee662d2b9e97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:26.443898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2da100-441c-4ff8-82ce-ee662d2b9e97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:26.448323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2da100-441c-4ff8-82ce-ee662d2b9e97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:26.452017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2da100-441c-4ff8-82ce-ee662d2b9e97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:26.454257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2da100-441c-4ff8-82ce-ee662d2b9e97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:26.454987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2da100-441c-4ff8-82ce-ee662d2b9e97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:26.574648 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-fb2da100-441c-4ff8-82ce-ee662d2b9e97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] HTTP exception thrown: Instance 925af2b3-d33a-4284-ad7b-56e22964c16a could not be found. Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb2da100-441c-4ff8-82ce-ee662d2b9e97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Request method failure captured: Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a HTTP/1.1 Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaJ42GDm6Svtn2sS-Uit-aaAVVXFrWdKSde1VOH9JpQ0XmMUJC0OSiZ0P5IJw0zyW54P5p2U6cNS5K7XhjjmSf2Yh0EiK9ZE2ynDRdDCZL81v1qrZ-lpqOmSESD6wYXMha4wnb0OgZST-nb4ATRjZZ6V5w2K42-kgJYsxRaTVUlvK4c Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 2296363eddb045d4abbe01a40e8a76b7 Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ListServerFiltersTestJSON-111571250 Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2296363eddb045d4abbe01a40e8a76b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2296363eddb045d4abbe01a40e8a76b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2296363eddb045d4abbe01a40e8a76b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2296363eddb045d4abbe01a40e8a76b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ListServerFiltersTestJSON-111571250 Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 2296363eddb045d4abbe01a40e8a76b7 Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-111571250 Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ListServerFiltersTestJSON-111571250-project Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 4a2acdb05d6b4e3e9a0102e18cfb8bbb Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ListServerFiltersTestJSON-111571250-project Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 925af2b3-d33a-4284-ad7b-56e22964c16a could not be found. Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '925af2b3-d33a-4284-ad7b-56e22964c16a'} Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925af2b3-d33a-4284-ad7b-56e22964c16a could not be found. Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925af2b3-d33a-4284-ad7b-56e22964c16a could not be found. Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:26.576334 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:26.584308 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:26.584308 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:26.584308 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:26.584308 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:51:26.584308 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:51:26.584308 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925af2b3-d33a-4284-ad7b-56e22964c16a could not be found. Aug 27 04:51:26.584308 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:26.584308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb2da100-441c-4ff8-82ce-ee662d2b9e97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Returning 404 to user: Instance 925af2b3-d33a-4284-ad7b-56e22964c16a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:26.584308 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fb2da100-441c-4ff8-82ce-ee662d2b9e97 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a" status: 404 len: 111 microversion: 2.1 time: 0.167779 Aug 27 04:51:26.591505 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2127/4230] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:26 2022] GET /compute/v2.1/servers/925af2b3-d33a-4284-ad7b-56e22964c16a => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:26.608678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-785c9c52-3a8b-44a9-9c7c-280e4a438361 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:26.609787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-785c9c52-3a8b-44a9-9c7c-280e4a438361 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:26.621124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] validate_networks() for [('66ea1505-721e-4180-8d0d-1bcd0c0b485d', None, None, None, None, None), (None, None, '5217d8e2-0080-4d4f-adc5-5605b9551bd4', None, None, None), (None, None, 'eac13bb8-53a4-4fc4-b9eb-498a1de166dc', None, None, None), ('37dfa722-39dd-4f37-9bc3-2dd97c0d4c14', None, None, None, None, None), ('37dfa722-39dd-4f37-9bc3-2dd97c0d4c14', None, None, None, None, None), ('3b7e03ac-d0fc-4bb3-af09-3560b0d3e95f', '10.2.2.100', None, None, None, None), ('3b7e03ac-d0fc-4bb3-af09-3560b0d3e95f', '10.2.2.200', None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:51:26.636145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785c9c52-3a8b-44a9-9c7c-280e4a438361 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:26.636694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785c9c52-3a8b-44a9-9c7c-280e4a438361 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:26.637133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785c9c52-3a8b-44a9-9c7c-280e4a438361 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:26.641330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785c9c52-3a8b-44a9-9c7c-280e4a438361 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:26.641330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785c9c52-3a8b-44a9-9c7c-280e4a438361 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:26.641330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785c9c52-3a8b-44a9-9c7c-280e4a438361 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:26.707594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-785c9c52-3a8b-44a9-9c7c-280e4a438361 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:51:26.957283 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-785c9c52-3a8b-44a9-9c7c-280e4a438361 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 204 len: 0 microversion: 2.1 time: 0.363929 Aug 27 04:51:26.959251 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2128/4231] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:51:26 2022] DELETE /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:51:26.984055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc40dfaf-87f5-4feb-9a47-6c23d0770175 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e854b487-e034-49a4-a5a1-30cbda3ec6d5"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:26.997779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fc40dfaf-87f5-4feb-9a47-6c23d0770175 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:27.025232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc40dfaf-87f5-4feb-9a47-6c23d0770175 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:27.028609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc40dfaf-87f5-4feb-9a47-6c23d0770175 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:27.029117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc40dfaf-87f5-4feb-9a47-6c23d0770175 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:27.029879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc40dfaf-87f5-4feb-9a47-6c23d0770175 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:27.030353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc40dfaf-87f5-4feb-9a47-6c23d0770175 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:27.034097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc40dfaf-87f5-4feb-9a47-6c23d0770175 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:28.583873 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc40dfaf-87f5-4feb-9a47-6c23d0770175 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.621598 Aug 27 04:51:28.584648 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2129/4232] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 04:51:26 2022] POST /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments => generated 194 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:28.589765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c109ea92-9d62-4793-9ca0-337b4244f34a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:28.590453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c109ea92-9d62-4793-9ca0-337b4244f34a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:28.607145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c109ea92-9d62-4793-9ca0-337b4244f34a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:28.607646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c109ea92-9d62-4793-9ca0-337b4244f34a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:28.609646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c109ea92-9d62-4793-9ca0-337b4244f34a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:28.615866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c109ea92-9d62-4793-9ca0-337b4244f34a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:28.616370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c109ea92-9d62-4793-9ca0-337b4244f34a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:28.616846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c109ea92-9d62-4793-9ca0-337b4244f34a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.277680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c109ea92-9d62-4793-9ca0-337b4244f34a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:29.285934 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c109ea92-9d62-4793-9ca0-337b4244f34a tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1518 microversion: 2.1 time: 0.700065 Aug 27 04:51:29.287789 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2130/4233] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:28 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1518 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:29.295304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54c7034b-0e2c-40e4-8123-b5d21b889839 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.302455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-54c7034b-0e2c-40e4-8123-b5d21b889839 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] [instance: d28817a2-56aa-49de-a613-58f9b1356fda] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:29.317580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c7034b-0e2c-40e4-8123-b5d21b889839 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.318365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c7034b-0e2c-40e4-8123-b5d21b889839 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.321698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c7034b-0e2c-40e4-8123-b5d21b889839 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.322886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c7034b-0e2c-40e4-8123-b5d21b889839 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:29.323362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c7034b-0e2c-40e4-8123-b5d21b889839 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:29.323794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54c7034b-0e2c-40e4-8123-b5d21b889839 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:29.352359 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-54c7034b-0e2c-40e4-8123-b5d21b889839 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] HTTP exception thrown: Instance d28817a2-56aa-49de-a613-58f9b1356fda could not be found. Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54c7034b-0e2c-40e4-8123-b5d21b889839 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Request method failure captured: Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda HTTP/1.1 Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaKi_XK1raNsb11_4wnXPWT9LriYZ7IE-x4iIPBof4ITawyW3qWIGr1-AFqnkWlUN5k6SJ7noC6PNFdxq9BO1MwynqLMjZs0gnAwJ-2XHQrMlPS_lS8RaDUdMfhcqqvOGprz9kXa1GaJdj9z81E_tYDGV5z4uW4feWxIZBmeYnf-z34 Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.57 Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 39caf602bc9c47e4a7eb1c6ab6bc162e Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerShowV257Test-1425808272 Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/39caf602bc9c47e4a7eb1c6ab6bc162e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_39caf602bc9c47e4a7eb1c6ab6bc162e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/39caf602bc9c47e4a7eb1c6ab6bc162e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/39caf602bc9c47e4a7eb1c6ab6bc162e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerShowV257Test-1425808272 Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 39caf602bc9c47e4a7eb1c6ab6bc162e Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerShowV257Test-1425808272 Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerShowV257Test-1425808272-project Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 2b6d5a9e8e8e4dc8a454c04ca26da2c3 Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerShowV257Test-1425808272-project Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance d28817a2-56aa-49de-a613-58f9b1356fda could not be found. Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'd28817a2-56aa-49de-a613-58f9b1356fda'} Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28817a2-56aa-49de-a613-58f9b1356fda could not be found. Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28817a2-56aa-49de-a613-58f9b1356fda could not be found. Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:29.356190 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:29.360877 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:29.360877 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:29.360877 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:29.360877 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:51:29.360877 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:51:29.360877 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28817a2-56aa-49de-a613-58f9b1356fda could not be found. Aug 27 04:51:29.360877 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:29.373430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54c7034b-0e2c-40e4-8123-b5d21b889839 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] Returning 404 to user: Instance d28817a2-56aa-49de-a613-58f9b1356fda could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:29.376371 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-54c7034b-0e2c-40e4-8123-b5d21b889839 tempest-ServerShowV257Test-1425808272 tempest-ServerShowV257Test-1425808272-project] 10.222.0.79 "GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda" status: 404 len: 111 microversion: 2.57 time: 0.085588 Aug 27 04:51:29.382073 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2131/4234] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:29 2022] GET /compute/v2.1/servers/d28817a2-56aa-49de-a613-58f9b1356fda => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:51:30.307911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c5b31e1-3b90-4dc1-bf16-d6c6a64ca767 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:30.309611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c5b31e1-3b90-4dc1-bf16-d6c6a64ca767 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:30.319547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c5b31e1-3b90-4dc1-bf16-d6c6a64ca767 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:30.321338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c5b31e1-3b90-4dc1-bf16-d6c6a64ca767 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:30.323105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c5b31e1-3b90-4dc1-bf16-d6c6a64ca767 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:30.325798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c5b31e1-3b90-4dc1-bf16-d6c6a64ca767 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:30.327528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c5b31e1-3b90-4dc1-bf16-d6c6a64ca767 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:30.329231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c5b31e1-3b90-4dc1-bf16-d6c6a64ca767 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:30.555386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c5b31e1-3b90-4dc1-bf16-d6c6a64ca767 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:30.564761 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c5b31e1-3b90-4dc1-bf16-d6c6a64ca767 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1518 microversion: 2.1 time: 0.261239 Aug 27 04:51:30.566037 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2132/4235] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:30 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1518 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:31.238389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:31.587805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f369937-1d5a-477f-85e8-a1e814bd2d19 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:31.588350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f369937-1d5a-477f-85e8-a1e814bd2d19 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:31.605614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f369937-1d5a-477f-85e8-a1e814bd2d19 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:31.607939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f369937-1d5a-477f-85e8-a1e814bd2d19 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:31.608396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f369937-1d5a-477f-85e8-a1e814bd2d19 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:31.609158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f369937-1d5a-477f-85e8-a1e814bd2d19 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:31.611124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f369937-1d5a-477f-85e8-a1e814bd2d19 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:31.611618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f369937-1d5a-477f-85e8-a1e814bd2d19 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:32.115045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:51:32.116737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:51:32.117308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:51:32.117860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:51:32.119069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:51:32.173968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:32.174331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:32.174806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:32.186526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:32.187151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:32.191973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:32.264953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Getting quotas for project 26ab30a8d5fa4da892b06bc09b00d56b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:51:32.277731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Getting quotas for user c5a9d453b9894b15b3ce0ed9613617b0 and project 26ab30a8d5fa4da892b06bc09b00d56b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:51:32.323107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f369937-1d5a-477f-85e8-a1e814bd2d19 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2acdb05d6b4e3e9a0102e18cfb8bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2296363eddb045d4abbe01a40e8a76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:32.334670 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f369937-1d5a-477f-85e8-a1e814bd2d19 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 200 len: 1476 microversion: 2.1 time: 0.750815 Aug 27 04:51:32.337730 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2133/4236] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:31 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 1476 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:32.349750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1e5df891-b0b4-44db-874e-85da7962142b req-6a1ea4fa-5a51-405b-825e-5ffa54fb12ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3487346f-0dd9-4f96-8767-7a6a92608ea5", "name": "network-vif-deleted", "tag": "a70e0fee-0241-48bc-90b8-53d756c94971"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:32.389587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1e5df891-b0b4-44db-874e-85da7962142b req-6a1ea4fa-5a51-405b-825e-5ffa54fb12ea service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:32.390323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1e5df891-b0b4-44db-874e-85da7962142b req-6a1ea4fa-5a51-405b-825e-5ffa54fb12ea service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:32.392327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1e5df891-b0b4-44db-874e-85da7962142b req-6a1ea4fa-5a51-405b-825e-5ffa54fb12ea service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:32.425886 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1e5df891-b0b4-44db-874e-85da7962142b req-6a1ea4fa-5a51-405b-825e-5ffa54fb12ea service nova] Creating event network-vif-deleted:a70e0fee-0241-48bc-90b8-53d756c94971 for instance 3487346f-0dd9-4f96-8767-7a6a92608ea5 on n-h1-854823-1 Aug 27 04:51:32.448234 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1e5df891-b0b4-44db-874e-85da7962142b req-6a1ea4fa-5a51-405b-825e-5ffa54fb12ea service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106627 Aug 27 04:51:32.449932 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2134/4237] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:32.759748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:51:32.765730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='90e986dc-691b-47a5-851f-6611c14e8871',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='966a0344-f405-4bc5-ac92-d41990c85850',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a98d3ac-c3cf-416c-bdae-9b007e00acc9',volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:51:33.360467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c30b0b3d-13fe-46d0-815e-f4af545baca2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:33.361819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c30b0b3d-13fe-46d0-815e-f4af545baca2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] [instance: 3487346f-0dd9-4f96-8767-7a6a92608ea5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:33.374689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c30b0b3d-13fe-46d0-815e-f4af545baca2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:33.375440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c30b0b3d-13fe-46d0-815e-f4af545baca2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:33.376019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c30b0b3d-13fe-46d0-815e-f4af545baca2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:33.379374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c30b0b3d-13fe-46d0-815e-f4af545baca2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:33.380080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c30b0b3d-13fe-46d0-815e-f4af545baca2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:33.380893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c30b0b3d-13fe-46d0-815e-f4af545baca2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:33.411942 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c30b0b3d-13fe-46d0-815e-f4af545baca2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] HTTP exception thrown: Instance 3487346f-0dd9-4f96-8767-7a6a92608ea5 could not be found. Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c30b0b3d-13fe-46d0-815e-f4af545baca2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Request method failure captured: Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 HTTP/1.1 Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaJ42GDm6Svtn2sS-Uit-aaAVVXFrWdKSde1VOH9JpQ0XmMUJC0OSiZ0P5IJw0zyW54P5p2U6cNS5K7XhjjmSf2Yh0EiK9ZE2ynDRdDCZL81v1qrZ-lpqOmSESD6wYXMha4wnb0OgZST-nb4ATRjZZ6V5w2K42-kgJYsxRaTVUlvK4c Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 2296363eddb045d4abbe01a40e8a76b7 Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ListServerFiltersTestJSON-111571250 Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2296363eddb045d4abbe01a40e8a76b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2296363eddb045d4abbe01a40e8a76b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2296363eddb045d4abbe01a40e8a76b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2296363eddb045d4abbe01a40e8a76b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ListServerFiltersTestJSON-111571250 Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 2296363eddb045d4abbe01a40e8a76b7 Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-111571250 Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ListServerFiltersTestJSON-111571250-project Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 4a2acdb05d6b4e3e9a0102e18cfb8bbb Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ListServerFiltersTestJSON-111571250-project Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 3487346f-0dd9-4f96-8767-7a6a92608ea5 could not be found. Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '3487346f-0dd9-4f96-8767-7a6a92608ea5'} Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3487346f-0dd9-4f96-8767-7a6a92608ea5 could not be found. Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3487346f-0dd9-4f96-8767-7a6a92608ea5 could not be found. Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:51:33.419639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:33.423642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:51:33.423642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:51:33.423642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:51:33.423642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:51:33.423642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:51:33.423642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3487346f-0dd9-4f96-8767-7a6a92608ea5 could not be found. Aug 27 04:51:33.423642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:51:33.425914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c30b0b3d-13fe-46d0-815e-f4af545baca2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] Returning 404 to user: Instance 3487346f-0dd9-4f96-8767-7a6a92608ea5 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:51:33.429090 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c30b0b3d-13fe-46d0-815e-f4af545baca2 tempest-ListServerFiltersTestJSON-111571250 tempest-ListServerFiltersTestJSON-111571250-project] 10.222.0.79 "GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5" status: 404 len: 111 microversion: 2.1 time: 0.074234 Aug 27 04:51:33.431555 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2135/4238] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:33 2022] GET /compute/v2.1/servers/3487346f-0dd9-4f96-8767-7a6a92608ea5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:51:33.614772 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2eed13c9-5f41-4958-88a7-85b752dfcee9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.220181 Aug 27 04:51:33.615888 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2104/4239] 10.222.0.79 () {62 vars in 1189 bytes} [Sat Aug 27 04:51:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 8222 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:51:33.630789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a54dded0-d67e-4a0c-aba1-d205bf6c37bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:33.631743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a54dded0-d67e-4a0c-aba1-d205bf6c37bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:33.894754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a54dded0-d67e-4a0c-aba1-d205bf6c37bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:33.908413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a54dded0-d67e-4a0c-aba1-d205bf6c37bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:33.917380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a54dded0-d67e-4a0c-aba1-d205bf6c37bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:33.919262 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a54dded0-d67e-4a0c-aba1-d205bf6c37bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1286 microversion: 2.32 time: 0.294842 Aug 27 04:51:33.928639 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2136/4240] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:33 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1286 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:34.948756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1e1fb5c6-18f6-4472-9abb-bc397df8967f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:34.949383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1e1fb5c6-18f6-4472-9abb-bc397df8967f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:35.732571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e1fb5c6-18f6-4472-9abb-bc397df8967f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:35.744495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e1fb5c6-18f6-4472-9abb-bc397df8967f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:35.747187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e1fb5c6-18f6-4472-9abb-bc397df8967f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:35.769252 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1e1fb5c6-18f6-4472-9abb-bc397df8967f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1286 microversion: 2.32 time: 0.809628 Aug 27 04:51:35.772134 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2105/4241] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:34 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1286 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:51:36.798454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba7e028b-91ec-40a5-9101-47bb54234ce7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:36.800362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba7e028b-91ec-40a5-9101-47bb54234ce7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:36.831947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7e028b-91ec-40a5-9101-47bb54234ce7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:36.839559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7e028b-91ec-40a5-9101-47bb54234ce7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:36.840667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7e028b-91ec-40a5-9101-47bb54234ce7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:36.843137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7e028b-91ec-40a5-9101-47bb54234ce7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:36.844195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7e028b-91ec-40a5-9101-47bb54234ce7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:36.845616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7e028b-91ec-40a5-9101-47bb54234ce7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:37.118384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba7e028b-91ec-40a5-9101-47bb54234ce7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:37.130021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba7e028b-91ec-40a5-9101-47bb54234ce7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:37.137932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba7e028b-91ec-40a5-9101-47bb54234ce7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:37.141770 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba7e028b-91ec-40a5-9101-47bb54234ce7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1576 microversion: 2.32 time: 0.349774 Aug 27 04:51:37.144726 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2137/4242] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:36 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1576 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:51:38.176212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-65b30a83-f6d9-4abb-811b-1bb30a36f82a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:38.176945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-65b30a83-f6d9-4abb-811b-1bb30a36f82a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:38.213952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65b30a83-f6d9-4abb-811b-1bb30a36f82a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:38.216902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65b30a83-f6d9-4abb-811b-1bb30a36f82a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:38.217388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65b30a83-f6d9-4abb-811b-1bb30a36f82a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:38.218134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65b30a83-f6d9-4abb-811b-1bb30a36f82a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:38.239026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65b30a83-f6d9-4abb-811b-1bb30a36f82a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:38.240758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65b30a83-f6d9-4abb-811b-1bb30a36f82a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:38.847414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-65b30a83-f6d9-4abb-811b-1bb30a36f82a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:38.868962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-65b30a83-f6d9-4abb-811b-1bb30a36f82a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:38.870753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-65b30a83-f6d9-4abb-811b-1bb30a36f82a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:38.885287 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-65b30a83-f6d9-4abb-811b-1bb30a36f82a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1594 microversion: 2.32 time: 0.703351 Aug 27 04:51:38.886259 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2106/4243] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:38 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1594 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:39.917576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdab34c2-8385-4543-a402-d787172a76c3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:39.918060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bdab34c2-8385-4543-a402-d787172a76c3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:39.931587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdab34c2-8385-4543-a402-d787172a76c3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:39.932081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdab34c2-8385-4543-a402-d787172a76c3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:39.932518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdab34c2-8385-4543-a402-d787172a76c3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:39.933237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdab34c2-8385-4543-a402-d787172a76c3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:39.933701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdab34c2-8385-4543-a402-d787172a76c3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:39.934121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdab34c2-8385-4543-a402-d787172a76c3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:40.078086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdab34c2-8385-4543-a402-d787172a76c3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:40.097842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdab34c2-8385-4543-a402-d787172a76c3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:40.105093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdab34c2-8385-4543-a402-d787172a76c3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:40.106656 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdab34c2-8385-4543-a402-d787172a76c3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1594 microversion: 2.32 time: 0.193653 Aug 27 04:51:40.109055 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2138/4244] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:39 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1594 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:41.146727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-804fbabe-96e2-4293-aa9e-66c64bfe62fe tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:41.149119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-804fbabe-96e2-4293-aa9e-66c64bfe62fe tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:41.158033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-804fbabe-96e2-4293-aa9e-66c64bfe62fe tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:41.166561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-804fbabe-96e2-4293-aa9e-66c64bfe62fe tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:41.169248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-804fbabe-96e2-4293-aa9e-66c64bfe62fe tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:41.171909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-804fbabe-96e2-4293-aa9e-66c64bfe62fe tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:41.172608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-804fbabe-96e2-4293-aa9e-66c64bfe62fe tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:41.173390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-804fbabe-96e2-4293-aa9e-66c64bfe62fe tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:41.448560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-804fbabe-96e2-4293-aa9e-66c64bfe62fe tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:41.502495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-804fbabe-96e2-4293-aa9e-66c64bfe62fe tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:41.510338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-804fbabe-96e2-4293-aa9e-66c64bfe62fe tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:41.511820 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-804fbabe-96e2-4293-aa9e-66c64bfe62fe tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1594 microversion: 2.32 time: 0.377869 Aug 27 04:51:41.548460 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2107/4245] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:41 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1594 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:42.543882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1044ece-6561-499d-ab43-9abd9fd1ed0b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:42.545622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c1044ece-6561-499d-ab43-9abd9fd1ed0b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:42.567035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1044ece-6561-499d-ab43-9abd9fd1ed0b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:42.572342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1044ece-6561-499d-ab43-9abd9fd1ed0b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:42.574622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1044ece-6561-499d-ab43-9abd9fd1ed0b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:42.579830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1044ece-6561-499d-ab43-9abd9fd1ed0b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:42.580939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1044ece-6561-499d-ab43-9abd9fd1ed0b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:42.581400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1044ece-6561-499d-ab43-9abd9fd1ed0b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:43.899394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:44.201852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c1044ece-6561-499d-ab43-9abd9fd1ed0b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:44.221895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c1044ece-6561-499d-ab43-9abd9fd1ed0b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:44.225809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c1044ece-6561-499d-ab43-9abd9fd1ed0b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:44.228502 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c1044ece-6561-499d-ab43-9abd9fd1ed0b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1662 microversion: 2.32 time: 1.688382 Aug 27 04:51:44.244652 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2139/4246] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:42 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1662 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:45.014859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8aa10a64-3add-4ffb-abbf-ae1c5279be43 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:45.017860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8aa10a64-3add-4ffb-abbf-ae1c5279be43 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:45.038923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:45.046419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa10a64-3add-4ffb-abbf-ae1c5279be43 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:45.051696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa10a64-3add-4ffb-abbf-ae1c5279be43 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:45.052162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa10a64-3add-4ffb-abbf-ae1c5279be43 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:45.054819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa10a64-3add-4ffb-abbf-ae1c5279be43 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:45.061670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa10a64-3add-4ffb-abbf-ae1c5279be43 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:45.062422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa10a64-3add-4ffb-abbf-ae1c5279be43 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:45.139029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-8aa10a64-3add-4ffb-abbf-ae1c5279be43 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lazy-loading 'flavor' on Instance uuid 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:51:45.251581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b733d3b-b672-4f2c-866a-316a1ff84458 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:45.253298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b733d3b-b672-4f2c-866a-316a1ff84458 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:45.258398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:45.298882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b733d3b-b672-4f2c-866a-316a1ff84458 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:45.299403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b733d3b-b672-4f2c-866a-316a1ff84458 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:45.299853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b733d3b-b672-4f2c-866a-316a1ff84458 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:45.301889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b733d3b-b672-4f2c-866a-316a1ff84458 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:45.302613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b733d3b-b672-4f2c-866a-316a1ff84458 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:45.304145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b733d3b-b672-4f2c-866a-316a1ff84458 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:45.435514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:45.511054 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8aa10a64-3add-4ffb-abbf-ae1c5279be43 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/action" status: 200 len: 32 microversion: 2.1 time: 0.500831 Aug 27 04:51:45.516500 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2108/4247] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:51:45 2022] POST /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/action => generated 32 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:51:45.523007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-44b85a53-cf36-476d-a712-5719ef4cf1cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:45.530529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-44b85a53-cf36-476d-a712-5719ef4cf1cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:45.551581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44b85a53-cf36-476d-a712-5719ef4cf1cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:45.566062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44b85a53-cf36-476d-a712-5719ef4cf1cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:45.567464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44b85a53-cf36-476d-a712-5719ef4cf1cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:45.570785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44b85a53-cf36-476d-a712-5719ef4cf1cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:45.572973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44b85a53-cf36-476d-a712-5719ef4cf1cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:45.575127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44b85a53-cf36-476d-a712-5719ef4cf1cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:45.741233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:46.725453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-44b85a53-cf36-476d-a712-5719ef4cf1cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:46.735844 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-44b85a53-cf36-476d-a712-5719ef4cf1cc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1737 microversion: 2.1 time: 1.216902 Aug 27 04:51:46.740837 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2109/4248] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:45 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1737 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:47.768716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a235a627-6825-43c9-8a47-22ea7cad9c7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:47.774907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a235a627-6825-43c9-8a47-22ea7cad9c7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:47.786040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a235a627-6825-43c9-8a47-22ea7cad9c7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:47.786962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a235a627-6825-43c9-8a47-22ea7cad9c7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:47.787566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a235a627-6825-43c9-8a47-22ea7cad9c7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:47.788450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a235a627-6825-43c9-8a47-22ea7cad9c7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:47.789157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a235a627-6825-43c9-8a47-22ea7cad9c7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:47.790399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a235a627-6825-43c9-8a47-22ea7cad9c7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:47.999622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b733d3b-b672-4f2c-866a-316a1ff84458 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:48.025192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b733d3b-b672-4f2c-866a-316a1ff84458 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:48.026900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b733d3b-b672-4f2c-866a-316a1ff84458 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:48.028314 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b733d3b-b672-4f2c-866a-316a1ff84458 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1709 microversion: 2.32 time: 2.780751 Aug 27 04:51:48.029411 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2140/4249] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:45 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1709 bytes in 2782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:48.336348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a235a627-6825-43c9-8a47-22ea7cad9c7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:48.349289 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a235a627-6825-43c9-8a47-22ea7cad9c7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1737 microversion: 2.1 time: 0.589872 Aug 27 04:51:48.365200 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2110/4250] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:47 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1737 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:51:49.054979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27987fc9-a2c9-47c9-a042-2f5d2ff62437 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:49.056295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-27987fc9-a2c9-47c9-a042-2f5d2ff62437 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:49.066181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27987fc9-a2c9-47c9-a042-2f5d2ff62437 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:49.075844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27987fc9-a2c9-47c9-a042-2f5d2ff62437 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:49.077530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27987fc9-a2c9-47c9-a042-2f5d2ff62437 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:49.078496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27987fc9-a2c9-47c9-a042-2f5d2ff62437 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:49.080187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27987fc9-a2c9-47c9-a042-2f5d2ff62437 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:49.083819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27987fc9-a2c9-47c9-a042-2f5d2ff62437 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:49.377441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7b6084ad-5858-4652-a824-0588e7b55621 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:49.378432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7b6084ad-5858-4652-a824-0588e7b55621 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:49.400135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:49.412794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b6084ad-5858-4652-a824-0588e7b55621 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:49.415737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b6084ad-5858-4652-a824-0588e7b55621 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:49.416256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b6084ad-5858-4652-a824-0588e7b55621 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:49.417154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b6084ad-5858-4652-a824-0588e7b55621 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:49.417547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b6084ad-5858-4652-a824-0588e7b55621 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:49.421272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b6084ad-5858-4652-a824-0588e7b55621 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:49.453489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:49.913651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-27987fc9-a2c9-47c9-a042-2f5d2ff62437 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:49.931283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-27987fc9-a2c9-47c9-a042-2f5d2ff62437 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:49.945467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-27987fc9-a2c9-47c9-a042-2f5d2ff62437 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:49.947527 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-27987fc9-a2c9-47c9-a042-2f5d2ff62437 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1709 microversion: 2.32 time: 0.897090 Aug 27 04:51:49.949056 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2141/4251] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:49 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1709 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:50.905610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b6084ad-5858-4652-a824-0588e7b55621 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:50.914213 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7b6084ad-5858-4652-a824-0588e7b55621 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1737 microversion: 2.1 time: 1.542166 Aug 27 04:51:50.915353 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2111/4252] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:49 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1737 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:50.978583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97997f9c-3a50-460d-a192-44e27f86460f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:50.979262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97997f9c-3a50-460d-a192-44e27f86460f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:50.988927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97997f9c-3a50-460d-a192-44e27f86460f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:50.989431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97997f9c-3a50-460d-a192-44e27f86460f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:50.990028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97997f9c-3a50-460d-a192-44e27f86460f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:50.990754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97997f9c-3a50-460d-a192-44e27f86460f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:50.991254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97997f9c-3a50-460d-a192-44e27f86460f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:50.991745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97997f9c-3a50-460d-a192-44e27f86460f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:51.726785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97997f9c-3a50-460d-a192-44e27f86460f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:51.758484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97997f9c-3a50-460d-a192-44e27f86460f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:51.766892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97997f9c-3a50-460d-a192-44e27f86460f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:51.770406 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97997f9c-3a50-460d-a192-44e27f86460f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1756 microversion: 2.32 time: 0.798092 Aug 27 04:51:51.772954 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2142/4253] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:50 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1756 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:51:51.945193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c5105e61-a47f-4d4d-897d-d00ca2c985c9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:51.946395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c5105e61-a47f-4d4d-897d-d00ca2c985c9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:51.965825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5105e61-a47f-4d4d-897d-d00ca2c985c9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:51.966410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5105e61-a47f-4d4d-897d-d00ca2c985c9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:51.966918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5105e61-a47f-4d4d-897d-d00ca2c985c9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:51.967937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5105e61-a47f-4d4d-897d-d00ca2c985c9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:51.968402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5105e61-a47f-4d4d-897d-d00ca2c985c9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:51.969060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5105e61-a47f-4d4d-897d-d00ca2c985c9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:52.798956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0adc2c4d-3446-4d3f-b28c-67ae21fa5743 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:52.801110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0adc2c4d-3446-4d3f-b28c-67ae21fa5743 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:52.817339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0adc2c4d-3446-4d3f-b28c-67ae21fa5743 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:52.825188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0adc2c4d-3446-4d3f-b28c-67ae21fa5743 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:52.825863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0adc2c4d-3446-4d3f-b28c-67ae21fa5743 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:52.828644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0adc2c4d-3446-4d3f-b28c-67ae21fa5743 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:52.846091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0adc2c4d-3446-4d3f-b28c-67ae21fa5743 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:52.846561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0adc2c4d-3446-4d3f-b28c-67ae21fa5743 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:52.948062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c5105e61-a47f-4d4d-897d-d00ca2c985c9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:52.956940 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c5105e61-a47f-4d4d-897d-d00ca2c985c9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1737 microversion: 2.1 time: 1.016258 Aug 27 04:51:52.981150 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2112/4254] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:51 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1737 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:53.997977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-719276c4-353a-42ba-89da-1efb9f488736 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:53.999279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-719276c4-353a-42ba-89da-1efb9f488736 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:54.006627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-719276c4-353a-42ba-89da-1efb9f488736 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:54.017348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-719276c4-353a-42ba-89da-1efb9f488736 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:54.018247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-719276c4-353a-42ba-89da-1efb9f488736 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:54.019234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-719276c4-353a-42ba-89da-1efb9f488736 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:54.019947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-719276c4-353a-42ba-89da-1efb9f488736 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:54.020686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-719276c4-353a-42ba-89da-1efb9f488736 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:54.085369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0adc2c4d-3446-4d3f-b28c-67ae21fa5743 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:54.105115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0adc2c4d-3446-4d3f-b28c-67ae21fa5743 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:54.113450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0adc2c4d-3446-4d3f-b28c-67ae21fa5743 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:54.117482 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0adc2c4d-3446-4d3f-b28c-67ae21fa5743 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1756 microversion: 2.32 time: 1.322548 Aug 27 04:51:54.124611 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2143/4255] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:52 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1756 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:51:55.149117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2591dd4-f750-457d-b0a5-14c042fa162d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:55.149830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2591dd4-f750-457d-b0a5-14c042fa162d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:55.170448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2591dd4-f750-457d-b0a5-14c042fa162d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:55.170790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2591dd4-f750-457d-b0a5-14c042fa162d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:55.171457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2591dd4-f750-457d-b0a5-14c042fa162d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:55.172341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2591dd4-f750-457d-b0a5-14c042fa162d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:55.172985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2591dd4-f750-457d-b0a5-14c042fa162d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:55.173592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2591dd4-f750-457d-b0a5-14c042fa162d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:55.432321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-719276c4-353a-42ba-89da-1efb9f488736 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:55.454389 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-719276c4-353a-42ba-89da-1efb9f488736 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1737 microversion: 2.1 time: 1.460593 Aug 27 04:51:55.458691 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2113/4256] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:53 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1737 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:51:56.006951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2591dd4-f750-457d-b0a5-14c042fa162d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:56.029811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2591dd4-f750-457d-b0a5-14c042fa162d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:56.037968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2591dd4-f750-457d-b0a5-14c042fa162d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:56.039705 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2591dd4-f750-457d-b0a5-14c042fa162d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1803 microversion: 2.32 time: 0.896203 Aug 27 04:51:56.040779 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2144/4257] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:55 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1803 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:51:56.480943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e75ad935-1e77-4e45-bae8-4e1c62717701 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:56.482283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e75ad935-1e77-4e45-bae8-4e1c62717701 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:56.492077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e75ad935-1e77-4e45-bae8-4e1c62717701 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:56.493617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e75ad935-1e77-4e45-bae8-4e1c62717701 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:56.494380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e75ad935-1e77-4e45-bae8-4e1c62717701 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:56.495623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e75ad935-1e77-4e45-bae8-4e1c62717701 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:56.496772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e75ad935-1e77-4e45-bae8-4e1c62717701 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:56.497452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e75ad935-1e77-4e45-bae8-4e1c62717701 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:57.063781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-031f26b6-5ecd-4bec-92be-741536efb99d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:57.064399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-031f26b6-5ecd-4bec-92be-741536efb99d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:57.074142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-031f26b6-5ecd-4bec-92be-741536efb99d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:57.080248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-031f26b6-5ecd-4bec-92be-741536efb99d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:57.080909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-031f26b6-5ecd-4bec-92be-741536efb99d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:57.081844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-031f26b6-5ecd-4bec-92be-741536efb99d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:57.082466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-031f26b6-5ecd-4bec-92be-741536efb99d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:57.083051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-031f26b6-5ecd-4bec-92be-741536efb99d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:57.696003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e75ad935-1e77-4e45-bae8-4e1c62717701 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:57.713892 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e75ad935-1e77-4e45-bae8-4e1c62717701 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1737 microversion: 2.1 time: 1.238244 Aug 27 04:51:57.731618 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2114/4258] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:56 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1737 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:58.237025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-031f26b6-5ecd-4bec-92be-741536efb99d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:58.265859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-031f26b6-5ecd-4bec-92be-741536efb99d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:58.269816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-031f26b6-5ecd-4bec-92be-741536efb99d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:58.290917 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-031f26b6-5ecd-4bec-92be-741536efb99d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1850 microversion: 2.32 time: 1.214734 Aug 27 04:51:58.329502 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2145/4259] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:57 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1850 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:51:58.738058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7fbea155-139a-43e5-be63-a089beb5a35a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:58.738678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7fbea155-139a-43e5-be63-a089beb5a35a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:58.750643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fbea155-139a-43e5-be63-a089beb5a35a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:58.753395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fbea155-139a-43e5-be63-a089beb5a35a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:58.755834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fbea155-139a-43e5-be63-a089beb5a35a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:58.757007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fbea155-139a-43e5-be63-a089beb5a35a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:58.761192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fbea155-139a-43e5-be63-a089beb5a35a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:58.761949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fbea155-139a-43e5-be63-a089beb5a35a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:59.130399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7fbea155-139a-43e5-be63-a089beb5a35a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:59.147749 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7fbea155-139a-43e5-be63-a089beb5a35a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1737 microversion: 2.1 time: 0.412706 Aug 27 04:51:59.151046 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2115/4260] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:51:58 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1737 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:59.328732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26070f36-437a-4ff7-89a2-a6dfaf1dd9e9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:59.329447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26070f36-437a-4ff7-89a2-a6dfaf1dd9e9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:51:59.345564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26070f36-437a-4ff7-89a2-a6dfaf1dd9e9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:59.349765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26070f36-437a-4ff7-89a2-a6dfaf1dd9e9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:59.352824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26070f36-437a-4ff7-89a2-a6dfaf1dd9e9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:51:59.353794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26070f36-437a-4ff7-89a2-a6dfaf1dd9e9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:51:59.355526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26070f36-437a-4ff7-89a2-a6dfaf1dd9e9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:51:59.355998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26070f36-437a-4ff7-89a2-a6dfaf1dd9e9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:00.182262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e32e58b3-5e5c-4c4d-af08-611949bfa56e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:00.182991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e32e58b3-5e5c-4c4d-af08-611949bfa56e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:00.189474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26070f36-437a-4ff7-89a2-a6dfaf1dd9e9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:00.199409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e32e58b3-5e5c-4c4d-af08-611949bfa56e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:00.200235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e32e58b3-5e5c-4c4d-af08-611949bfa56e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:00.202331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e32e58b3-5e5c-4c4d-af08-611949bfa56e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:00.204219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e32e58b3-5e5c-4c4d-af08-611949bfa56e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:00.206580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e32e58b3-5e5c-4c4d-af08-611949bfa56e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:00.207245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e32e58b3-5e5c-4c4d-af08-611949bfa56e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:00.212371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26070f36-437a-4ff7-89a2-a6dfaf1dd9e9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:00.218393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26070f36-437a-4ff7-89a2-a6dfaf1dd9e9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:00.221347 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26070f36-437a-4ff7-89a2-a6dfaf1dd9e9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1850 microversion: 2.32 time: 0.901164 Aug 27 04:52:00.230918 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2146/4261] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:51:59 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1850 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:00.400496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26070f36-437a-4ff7-89a2-a6dfaf1dd9e9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:00.402300 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26070f36-437a-4ff7-89a2-a6dfaf1dd9e9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002239 Aug 27 04:52:00.402830 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2147/4262] 10.222.0.79 () {56 vars in 886 bytes} [Sat Aug 27 04:52:00 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 04:52:01.249430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0df197c7-6cc8-4212-bda3-4e65b30f65e8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:01.250346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0df197c7-6cc8-4212-bda3-4e65b30f65e8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:01.265324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0df197c7-6cc8-4212-bda3-4e65b30f65e8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:01.267080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0df197c7-6cc8-4212-bda3-4e65b30f65e8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:01.267742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0df197c7-6cc8-4212-bda3-4e65b30f65e8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:01.271805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0df197c7-6cc8-4212-bda3-4e65b30f65e8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:01.272610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0df197c7-6cc8-4212-bda3-4e65b30f65e8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:01.273514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0df197c7-6cc8-4212-bda3-4e65b30f65e8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:01.665177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e32e58b3-5e5c-4c4d-af08-611949bfa56e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:01.677499 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e32e58b3-5e5c-4c4d-af08-611949bfa56e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1737 microversion: 2.1 time: 1.506278 Aug 27 04:52:01.678854 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2116/4263] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:00 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1737 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:02.077968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-74ce3520-83aa-4392-a514-a67da5ffef60 req-ced3cf89-c890-4177-9579-6947a755e5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "tag": "0da450d6-15cd-4605-89dd-19e1ab8d2cf8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:02.104269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-74ce3520-83aa-4392-a514-a67da5ffef60 req-ced3cf89-c890-4177-9579-6947a755e5b0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:02.105605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-74ce3520-83aa-4392-a514-a67da5ffef60 req-ced3cf89-c890-4177-9579-6947a755e5b0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:02.108813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-74ce3520-83aa-4392-a514-a67da5ffef60 req-ced3cf89-c890-4177-9579-6947a755e5b0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:02.157715 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-74ce3520-83aa-4392-a514-a67da5ffef60 req-ced3cf89-c890-4177-9579-6947a755e5b0 service nova] Creating event network-changed:0da450d6-15cd-4605-89dd-19e1ab8d2cf8 for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:52:02.169821 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-74ce3520-83aa-4392-a514-a67da5ffef60 req-ced3cf89-c890-4177-9579-6947a755e5b0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106310 Aug 27 04:52:02.191842 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2117/4264] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:02.314986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0df197c7-6cc8-4212-bda3-4e65b30f65e8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:02.339121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0df197c7-6cc8-4212-bda3-4e65b30f65e8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:02.348241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0df197c7-6cc8-4212-bda3-4e65b30f65e8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:02.350694 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0df197c7-6cc8-4212-bda3-4e65b30f65e8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1850 microversion: 2.32 time: 1.105930 Aug 27 04:52:02.356425 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2148/4265] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:01 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1850 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:02.706555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-91e1cfa1-8fbf-43c0-a654-9bf15393dd47 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:02.718123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-91e1cfa1-8fbf-43c0-a654-9bf15393dd47 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:02.737138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91e1cfa1-8fbf-43c0-a654-9bf15393dd47 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:02.738339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91e1cfa1-8fbf-43c0-a654-9bf15393dd47 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:02.739078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91e1cfa1-8fbf-43c0-a654-9bf15393dd47 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:02.740051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91e1cfa1-8fbf-43c0-a654-9bf15393dd47 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:02.743514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91e1cfa1-8fbf-43c0-a654-9bf15393dd47 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:02.744438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-91e1cfa1-8fbf-43c0-a654-9bf15393dd47 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:03.379509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d513390f-1d41-449e-8eb9-d52d2a02c208 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:03.380126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d513390f-1d41-449e-8eb9-d52d2a02c208 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:03.395604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d513390f-1d41-449e-8eb9-d52d2a02c208 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:03.399315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d513390f-1d41-449e-8eb9-d52d2a02c208 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:03.405184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d513390f-1d41-449e-8eb9-d52d2a02c208 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:03.407527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d513390f-1d41-449e-8eb9-d52d2a02c208 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:03.409103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d513390f-1d41-449e-8eb9-d52d2a02c208 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:03.411189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d513390f-1d41-449e-8eb9-d52d2a02c208 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:03.608804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-91e1cfa1-8fbf-43c0-a654-9bf15393dd47 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:03.642179 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-91e1cfa1-8fbf-43c0-a654-9bf15393dd47 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1737 microversion: 2.1 time: 0.941418 Aug 27 04:52:03.643475 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2118/4266] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:02 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1737 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:04.586367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d513390f-1d41-449e-8eb9-d52d2a02c208 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:04.620303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d513390f-1d41-449e-8eb9-d52d2a02c208 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:04.628087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d513390f-1d41-449e-8eb9-d52d2a02c208 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:04.632682 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d513390f-1d41-449e-8eb9-d52d2a02c208 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1850 microversion: 2.32 time: 1.257283 Aug 27 04:52:04.647533 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2149/4267] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:03 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1850 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:04.667732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1e43216f-f4d7-48c9-947c-763b12ae89b1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:04.668476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1e43216f-f4d7-48c9-947c-763b12ae89b1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:04.686200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e43216f-f4d7-48c9-947c-763b12ae89b1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:04.687359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e43216f-f4d7-48c9-947c-763b12ae89b1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:04.688594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e43216f-f4d7-48c9-947c-763b12ae89b1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:04.690328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e43216f-f4d7-48c9-947c-763b12ae89b1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:04.692002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e43216f-f4d7-48c9-947c-763b12ae89b1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:04.692931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e43216f-f4d7-48c9-947c-763b12ae89b1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:05.507780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e43216f-f4d7-48c9-947c-763b12ae89b1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:05.538703 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1e43216f-f4d7-48c9-947c-763b12ae89b1 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1737 microversion: 2.1 time: 0.876157 Aug 27 04:52:05.540383 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2119/4268] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:04 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1737 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:05.661124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e5bfd1e-12bc-443a-96c1-39b466f904c9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:05.661782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e5bfd1e-12bc-443a-96c1-39b466f904c9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:05.679657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e5bfd1e-12bc-443a-96c1-39b466f904c9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:05.683072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e5bfd1e-12bc-443a-96c1-39b466f904c9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:05.683897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e5bfd1e-12bc-443a-96c1-39b466f904c9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:05.684912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e5bfd1e-12bc-443a-96c1-39b466f904c9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:05.691476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e5bfd1e-12bc-443a-96c1-39b466f904c9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:05.692511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e5bfd1e-12bc-443a-96c1-39b466f904c9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:06.200137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1362655665", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:06.313977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] validate_networks() for [('6f291964-1331-4043-a3c9-e171dbfc9b5a', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:52:06.613908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e5bfd1e-12bc-443a-96c1-39b466f904c9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:06.646287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e5bfd1e-12bc-443a-96c1-39b466f904c9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:06.652720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e5bfd1e-12bc-443a-96c1-39b466f904c9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:06.654330 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e5bfd1e-12bc-443a-96c1-39b466f904c9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1871 microversion: 2.32 time: 0.997229 Aug 27 04:52:06.669317 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2150/4269] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:05 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1871 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:06.670196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-93c44e6f-3f68-40b5-b63e-439b86f81471 req-96d86eb3-3fa5-42d3-913d-bcb8f6f2ceae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "tag": "5217d8e2-0080-4d4f-adc5-5605b9551bd4"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:06.724052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-93c44e6f-3f68-40b5-b63e-439b86f81471 req-96d86eb3-3fa5-42d3-913d-bcb8f6f2ceae service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:06.727486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-93c44e6f-3f68-40b5-b63e-439b86f81471 req-96d86eb3-3fa5-42d3-913d-bcb8f6f2ceae service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:06.730311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-93c44e6f-3f68-40b5-b63e-439b86f81471 req-96d86eb3-3fa5-42d3-913d-bcb8f6f2ceae service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:06.761496 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-93c44e6f-3f68-40b5-b63e-439b86f81471 req-96d86eb3-3fa5-42d3-913d-bcb8f6f2ceae service nova] Creating event network-changed:5217d8e2-0080-4d4f-adc5-5605b9551bd4 for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:52:06.774611 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-93c44e6f-3f68-40b5-b63e-439b86f81471 req-96d86eb3-3fa5-42d3-913d-bcb8f6f2ceae service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111817 Aug 27 04:52:06.776509 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2151/4270] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:06.787905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-862cf612-9e58-4a50-944d-402a3388d975 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:06.788763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-862cf612-9e58-4a50-944d-402a3388d975 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:06.807827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-862cf612-9e58-4a50-944d-402a3388d975 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:06.809316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-862cf612-9e58-4a50-944d-402a3388d975 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:06.809788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-862cf612-9e58-4a50-944d-402a3388d975 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:06.810546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-862cf612-9e58-4a50-944d-402a3388d975 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:06.814893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-862cf612-9e58-4a50-944d-402a3388d975 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:06.815457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-862cf612-9e58-4a50-944d-402a3388d975 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:07.913938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-862cf612-9e58-4a50-944d-402a3388d975 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:07.929474 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-862cf612-9e58-4a50-944d-402a3388d975 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1737 microversion: 2.1 time: 1.146066 Aug 27 04:52:07.933224 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2152/4271] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:06 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1737 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:07.953741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf833f8c-1211-49a4-b3e3-2c3186d32fd9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:07.956187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf833f8c-1211-49a4-b3e3-2c3186d32fd9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:07.973053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf833f8c-1211-49a4-b3e3-2c3186d32fd9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:07.973564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf833f8c-1211-49a4-b3e3-2c3186d32fd9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:07.974013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf833f8c-1211-49a4-b3e3-2c3186d32fd9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:07.975081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf833f8c-1211-49a4-b3e3-2c3186d32fd9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:07.975550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf833f8c-1211-49a4-b3e3-2c3186d32fd9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:07.979939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf833f8c-1211-49a4-b3e3-2c3186d32fd9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:08.600559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bf833f8c-1211-49a4-b3e3-2c3186d32fd9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:08.618836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bf833f8c-1211-49a4-b3e3-2c3186d32fd9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:08.631502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bf833f8c-1211-49a4-b3e3-2c3186d32fd9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:08.635354 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf833f8c-1211-49a4-b3e3-2c3186d32fd9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1892 microversion: 2.32 time: 0.696096 Aug 27 04:52:08.650889 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2153/4272] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:07 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1892 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:08.983414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:52:08.983942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:52:08.989303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a4eff43-a31d-453e-9477-589e1a813acc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:08.989938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a4eff43-a31d-453e-9477-589e1a813acc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:08.995230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:52:08.995677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:52:08.996108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:52:09.054349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a4eff43-a31d-453e-9477-589e1a813acc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:09.061047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a4eff43-a31d-453e-9477-589e1a813acc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:09.061424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a4eff43-a31d-453e-9477-589e1a813acc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:09.071070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:09.071636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:09.074253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a4eff43-a31d-453e-9477-589e1a813acc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:09.077313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a4eff43-a31d-453e-9477-589e1a813acc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:09.081838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a4eff43-a31d-453e-9477-589e1a813acc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:09.083715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:09.094204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:09.099123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:09.099683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:09.234252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Getting quotas for project e27a367de7f44a74a18de15d1919fd3e. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:52:09.263382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Getting quotas for user ab8d181537df4d9496c35291811c2f26 and project e27a367de7f44a74a18de15d1919fd3e. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:52:09.308443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:52:09.311464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:52:09.451766 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-72ee4ec3-6eda-41cf-944f-9f73f2bbdc30 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.518793 Aug 27 04:52:09.460825 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2120/4273] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:52:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 3535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:52:09.485777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-322a8fda-21dc-480e-9a46-a85665c61743 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:09.487560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-322a8fda-21dc-480e-9a46-a85665c61743 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:09.729949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-322a8fda-21dc-480e-9a46-a85665c61743 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:09.740175 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-322a8fda-21dc-480e-9a46-a85665c61743 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1223 microversion: 2.1 time: 0.274175 Aug 27 04:52:09.743940 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2121/4274] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:09 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1223 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:09.762262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-aa333f12-8777-4405-bd74-ebfeb34e5de4 req-9ab3a964-de90-4920-b1f6-d531d4107b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "tag": "eac13bb8-53a4-4fc4-b9eb-498a1de166dc"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:09.798266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-aa333f12-8777-4405-bd74-ebfeb34e5de4 req-9ab3a964-de90-4920-b1f6-d531d4107b18 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:09.803677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-aa333f12-8777-4405-bd74-ebfeb34e5de4 req-9ab3a964-de90-4920-b1f6-d531d4107b18 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:09.806249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-aa333f12-8777-4405-bd74-ebfeb34e5de4 req-9ab3a964-de90-4920-b1f6-d531d4107b18 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:09.857692 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-aa333f12-8777-4405-bd74-ebfeb34e5de4 req-9ab3a964-de90-4920-b1f6-d531d4107b18 service nova] Creating event network-changed:eac13bb8-53a4-4fc4-b9eb-498a1de166dc for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:52:09.890841 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-aa333f12-8777-4405-bd74-ebfeb34e5de4 req-9ab3a964-de90-4920-b1f6-d531d4107b18 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131951 Aug 27 04:52:09.891762 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2122/4275] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:09.926783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-57722460-36a0-461a-b9e1-7c0c4da15c23 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:09.928438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-57722460-36a0-461a-b9e1-7c0c4da15c23 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:09.965137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57722460-36a0-461a-b9e1-7c0c4da15c23 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:09.974801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57722460-36a0-461a-b9e1-7c0c4da15c23 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:09.977273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57722460-36a0-461a-b9e1-7c0c4da15c23 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:09.983243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57722460-36a0-461a-b9e1-7c0c4da15c23 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:09.983870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57722460-36a0-461a-b9e1-7c0c4da15c23 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:09.984386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57722460-36a0-461a-b9e1-7c0c4da15c23 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:10.621895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a4eff43-a31d-453e-9477-589e1a813acc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:10.638928 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a4eff43-a31d-453e-9477-589e1a813acc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1737 microversion: 2.1 time: 1.679473 Aug 27 04:52:10.651195 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2154/4276] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:08 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1737 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:10.771356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db264a54-4d08-4710-85bd-82489c36b62b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:10.772261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db264a54-4d08-4710-85bd-82489c36b62b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:10.794603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db264a54-4d08-4710-85bd-82489c36b62b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:10.812728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db264a54-4d08-4710-85bd-82489c36b62b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:10.813642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db264a54-4d08-4710-85bd-82489c36b62b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:10.815292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db264a54-4d08-4710-85bd-82489c36b62b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:10.815897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db264a54-4d08-4710-85bd-82489c36b62b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:10.816448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db264a54-4d08-4710-85bd-82489c36b62b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:11.047336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db264a54-4d08-4710-85bd-82489c36b62b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:11.060053 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db264a54-4d08-4710-85bd-82489c36b62b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1227 microversion: 2.1 time: 0.293529 Aug 27 04:52:11.066906 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2155/4277] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:10 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1227 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:11.649958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-57722460-36a0-461a-b9e1-7c0c4da15c23 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:11.668411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-57722460-36a0-461a-b9e1-7c0c4da15c23 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:11.670846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-57722460-36a0-461a-b9e1-7c0c4da15c23 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:11.673248 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-57722460-36a0-461a-b9e1-7c0c4da15c23 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1892 microversion: 2.32 time: 1.778625 Aug 27 04:52:11.701480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1a3ff12-833d-43b6-b51f-be27f7045054 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:11.702106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f1a3ff12-833d-43b6-b51f-be27f7045054 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:11.710233 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2123/4278] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:09 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1892 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:11.713459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1a3ff12-833d-43b6-b51f-be27f7045054 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:11.717293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1a3ff12-833d-43b6-b51f-be27f7045054 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:11.717984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1a3ff12-833d-43b6-b51f-be27f7045054 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:11.718930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1a3ff12-833d-43b6-b51f-be27f7045054 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:11.719722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1a3ff12-833d-43b6-b51f-be27f7045054 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:11.721051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1a3ff12-833d-43b6-b51f-be27f7045054 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:12.099416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d6258631-188e-4504-a754-9ab2e693b9b3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:12.100147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d6258631-188e-4504-a754-9ab2e693b9b3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:12.115372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6258631-188e-4504-a754-9ab2e693b9b3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:12.119680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6258631-188e-4504-a754-9ab2e693b9b3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:12.120460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6258631-188e-4504-a754-9ab2e693b9b3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:12.122275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6258631-188e-4504-a754-9ab2e693b9b3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:12.123466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6258631-188e-4504-a754-9ab2e693b9b3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:12.124250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6258631-188e-4504-a754-9ab2e693b9b3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:12.287605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d6258631-188e-4504-a754-9ab2e693b9b3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:12.337871 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d6258631-188e-4504-a754-9ab2e693b9b3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1281 microversion: 2.1 time: 0.238387 Aug 27 04:52:12.339280 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2124/4279] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:12 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1281 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:12.365542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-0ad75408-f37b-46f6-9ad3-5f73e2e8c7cc req-4cb0132d-35fc-4741-8ccd-0db3dbddfd77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "tag": "a874eeb0-33af-4e93-929c-569c031939d0"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:12.380410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0ad75408-f37b-46f6-9ad3-5f73e2e8c7cc req-4cb0132d-35fc-4741-8ccd-0db3dbddfd77 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:12.381208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0ad75408-f37b-46f6-9ad3-5f73e2e8c7cc req-4cb0132d-35fc-4741-8ccd-0db3dbddfd77 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:12.381979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0ad75408-f37b-46f6-9ad3-5f73e2e8c7cc req-4cb0132d-35fc-4741-8ccd-0db3dbddfd77 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:12.396758 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-0ad75408-f37b-46f6-9ad3-5f73e2e8c7cc req-4cb0132d-35fc-4741-8ccd-0db3dbddfd77 service nova] Creating event network-changed:a874eeb0-33af-4e93-929c-569c031939d0 for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:52:12.404725 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-0ad75408-f37b-46f6-9ad3-5f73e2e8c7cc req-4cb0132d-35fc-4741-8ccd-0db3dbddfd77 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043249 Aug 27 04:52:12.405943 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2125/4280] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:52:12.705041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0b6636d0-b662-4d79-a996-0d695e55dedb tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:12.706890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0b6636d0-b662-4d79-a996-0d695e55dedb tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:12.716110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b6636d0-b662-4d79-a996-0d695e55dedb tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:12.716960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b6636d0-b662-4d79-a996-0d695e55dedb tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:12.717577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b6636d0-b662-4d79-a996-0d695e55dedb tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:12.718307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b6636d0-b662-4d79-a996-0d695e55dedb tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:12.720977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b6636d0-b662-4d79-a996-0d695e55dedb tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:12.721717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b6636d0-b662-4d79-a996-0d695e55dedb tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:12.830549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1a3ff12-833d-43b6-b51f-be27f7045054 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:12.841338 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1a3ff12-833d-43b6-b51f-be27f7045054 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1737 microversion: 2.1 time: 1.142875 Aug 27 04:52:12.856714 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2156/4281] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:11 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1737 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:13.362938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea6db808-e7b3-41bd-97f5-03c4955087cd tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:13.363893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea6db808-e7b3-41bd-97f5-03c4955087cd tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:13.384604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea6db808-e7b3-41bd-97f5-03c4955087cd tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:13.390111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea6db808-e7b3-41bd-97f5-03c4955087cd tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:13.391920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea6db808-e7b3-41bd-97f5-03c4955087cd tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:13.403449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea6db808-e7b3-41bd-97f5-03c4955087cd tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:13.405705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea6db808-e7b3-41bd-97f5-03c4955087cd tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:13.408491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea6db808-e7b3-41bd-97f5-03c4955087cd tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:13.819101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ea6db808-e7b3-41bd-97f5-03c4955087cd tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:13.834566 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea6db808-e7b3-41bd-97f5-03c4955087cd tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1281 microversion: 2.1 time: 0.476970 Aug 27 04:52:13.839350 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2157/4282] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:13 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1281 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:13.864795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-67dc5e47-129b-47a0-b0dd-a1b6615006bf tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:13.865655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-67dc5e47-129b-47a0-b0dd-a1b6615006bf tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:13.878344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67dc5e47-129b-47a0-b0dd-a1b6615006bf tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:13.879592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67dc5e47-129b-47a0-b0dd-a1b6615006bf tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:13.880470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67dc5e47-129b-47a0-b0dd-a1b6615006bf tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:13.881398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67dc5e47-129b-47a0-b0dd-a1b6615006bf tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:13.882028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67dc5e47-129b-47a0-b0dd-a1b6615006bf tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:13.882685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67dc5e47-129b-47a0-b0dd-a1b6615006bf tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:13.918762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:13.921750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0b6636d0-b662-4d79-a996-0d695e55dedb tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:13.946234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0b6636d0-b662-4d79-a996-0d695e55dedb tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:13.968674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0b6636d0-b662-4d79-a996-0d695e55dedb tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:13.973971 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0b6636d0-b662-4d79-a996-0d695e55dedb tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1892 microversion: 2.32 time: 1.273223 Aug 27 04:52:13.977509 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2126/4283] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:12 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1892 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:14.295718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-67dc5e47-129b-47a0-b0dd-a1b6615006bf tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:14.306450 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-67dc5e47-129b-47a0-b0dd-a1b6615006bf tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1717 microversion: 2.1 time: 0.445753 Aug 27 04:52:14.313859 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2158/4284] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:13 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1717 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:14.537036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4d0dda7a-f044-4fa8-a541-9aa54e7e09fc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:14.537548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4d0dda7a-f044-4fa8-a541-9aa54e7e09fc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:14.554351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d0dda7a-f044-4fa8-a541-9aa54e7e09fc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:14.554932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d0dda7a-f044-4fa8-a541-9aa54e7e09fc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:14.555332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d0dda7a-f044-4fa8-a541-9aa54e7e09fc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:14.561886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d0dda7a-f044-4fa8-a541-9aa54e7e09fc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:14.562056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d0dda7a-f044-4fa8-a541-9aa54e7e09fc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:14.562365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d0dda7a-f044-4fa8-a541-9aa54e7e09fc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:14.835128 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-4d0dda7a-f044-4fa8-a541-9aa54e7e09fc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] HTTP exception thrown: Cannot 'detach_volume' instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 while it is in vm_state rescued Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4d0dda7a-f044-4fa8-a541-9aa54e7e09fc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Request method failure captured: Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments/e854b487-e034-49a4-a5a1-30cbda3ec6d5 HTTP/1.1 Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaHoFwgV4INwTRL8hXoYwjmWlLrRc_QJzw9nkZAvRSAfT__IxsIMw8Suy-GjIzNFt5R-NLcBI-KbU0p7XTxgVryxRdpnu39d1-w87dFtSDYLg2-wm7KAO7Nu1eVLF-CaLCIJrg2b0bchRGMkFWgTVQ8wFhLKBmW9T3OHuZJNVIJBUXo Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 81b0ef617031436484e9e987f972ae0a Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: exception: Cannot 'detach_volume' instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 while it is in vm_state rescued Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'server_id': '9f74e4f7-e0b8-41cb-88a2-98aff82b1d98', 'id': 'e854b487-e034-49a4-a5a1-30cbda3ec6d5'} Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 while it is in vm_state rescued Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:52:14.837543 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:14.841515 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:14.841515 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:14.841515 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:14.841515 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:14.841515 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 while it is in vm_state rescued Aug 27 04:52:14.841515 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:52:14.849507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4d0dda7a-f044-4fa8-a541-9aa54e7e09fc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Returning 409 to user: Cannot 'detach_volume' instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 while it is in vm_state rescued {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:14.850693 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4d0dda7a-f044-4fa8-a541-9aa54e7e09fc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments/e854b487-e034-49a4-a5a1-30cbda3ec6d5" status: 409 len: 152 microversion: 2.1 time: 0.317849 Aug 27 04:52:14.851830 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2127/4285] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 04:52:14 2022] DELETE /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments/e854b487-e034-49a4-a5a1-30cbda3ec6d5 => generated 152 bytes in 319 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:52:14.859215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-613962f1-a38c-4c5e-8651-0a2622bbda8b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:14.859834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-613962f1-a38c-4c5e-8651-0a2622bbda8b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:14.863588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f79b3844-fca5-49ad-83f5-f2b02c1ccaf4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:14.864229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f79b3844-fca5-49ad-83f5-f2b02c1ccaf4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:14.876096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-613962f1-a38c-4c5e-8651-0a2622bbda8b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:14.876799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-613962f1-a38c-4c5e-8651-0a2622bbda8b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:14.877286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-613962f1-a38c-4c5e-8651-0a2622bbda8b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:14.878492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-613962f1-a38c-4c5e-8651-0a2622bbda8b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:14.878961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-613962f1-a38c-4c5e-8651-0a2622bbda8b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:14.879426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-613962f1-a38c-4c5e-8651-0a2622bbda8b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:14.879561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f79b3844-fca5-49ad-83f5-f2b02c1ccaf4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:14.880029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f79b3844-fca5-49ad-83f5-f2b02c1ccaf4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:14.880573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f79b3844-fca5-49ad-83f5-f2b02c1ccaf4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:14.881342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f79b3844-fca5-49ad-83f5-f2b02c1ccaf4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:14.881874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f79b3844-fca5-49ad-83f5-f2b02c1ccaf4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:14.889742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f79b3844-fca5-49ad-83f5-f2b02c1ccaf4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:15.114327 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f79b3844-fca5-49ad-83f5-f2b02c1ccaf4 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/action" status: 202 len: 0 microversion: 2.1 time: 0.255467 Aug 27 04:52:15.126603 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2128/4286] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:52:14 2022] POST /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:52:15.149773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c50d2c66-fe55-48fe-869c-cf8290463365 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:15.150513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c50d2c66-fe55-48fe-869c-cf8290463365 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:15.176634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c50d2c66-fe55-48fe-869c-cf8290463365 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:15.177142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c50d2c66-fe55-48fe-869c-cf8290463365 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:15.177591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c50d2c66-fe55-48fe-869c-cf8290463365 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:15.189495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c50d2c66-fe55-48fe-869c-cf8290463365 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:15.190009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c50d2c66-fe55-48fe-869c-cf8290463365 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:15.198573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c50d2c66-fe55-48fe-869c-cf8290463365 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:15.310340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-613962f1-a38c-4c5e-8651-0a2622bbda8b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:15.321239 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-613962f1-a38c-4c5e-8651-0a2622bbda8b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1323 microversion: 2.1 time: 0.465842 Aug 27 04:52:15.321928 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2159/4287] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:14 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1323 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:15.341965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5339a6e-0271-4835-b7e9-91304c5db0a0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:15.342586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b5339a6e-0271-4835-b7e9-91304c5db0a0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:15.389241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5339a6e-0271-4835-b7e9-91304c5db0a0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:15.391595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5339a6e-0271-4835-b7e9-91304c5db0a0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:15.393367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5339a6e-0271-4835-b7e9-91304c5db0a0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:15.396767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5339a6e-0271-4835-b7e9-91304c5db0a0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:15.400241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5339a6e-0271-4835-b7e9-91304c5db0a0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:15.402659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5339a6e-0271-4835-b7e9-91304c5db0a0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:16.274628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5339a6e-0271-4835-b7e9-91304c5db0a0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:16.286789 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5339a6e-0271-4835-b7e9-91304c5db0a0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1725 microversion: 2.1 time: 0.948728 Aug 27 04:52:16.291040 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2160/4288] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:15 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1725 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:16.298989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4f79ce8a-2ffb-404a-9559-2682e7d048bb req-b67059b8-c01d-4e57-822b-72ee8ce69a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "tag": "08ec2a03-4224-4482-9e2b-0c33bc4adbca"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:16.322105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=40 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:16.328316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4f79ce8a-2ffb-404a-9559-2682e7d048bb req-b67059b8-c01d-4e57-822b-72ee8ce69a12 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:16.328770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4f79ce8a-2ffb-404a-9559-2682e7d048bb req-b67059b8-c01d-4e57-822b-72ee8ce69a12 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:16.329223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4f79ce8a-2ffb-404a-9559-2682e7d048bb req-b67059b8-c01d-4e57-822b-72ee8ce69a12 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:16.373494 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4f79ce8a-2ffb-404a-9559-2682e7d048bb req-b67059b8-c01d-4e57-822b-72ee8ce69a12 service nova] Creating event network-changed:08ec2a03-4224-4482-9e2b-0c33bc4adbca for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:52:16.379328 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4f79ce8a-2ffb-404a-9559-2682e7d048bb req-b67059b8-c01d-4e57-822b-72ee8ce69a12 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087373 Aug 27 04:52:16.380356 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2161/4289] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:16.396058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-422f7d1a-3825-4027-b997-044eb1e7ddf3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:16.397410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-422f7d1a-3825-4027-b997-044eb1e7ddf3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:16.408107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-422f7d1a-3825-4027-b997-044eb1e7ddf3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:16.408635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-422f7d1a-3825-4027-b997-044eb1e7ddf3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:16.409093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-422f7d1a-3825-4027-b997-044eb1e7ddf3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:16.409800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-422f7d1a-3825-4027-b997-044eb1e7ddf3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:16.415478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-422f7d1a-3825-4027-b997-044eb1e7ddf3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:16.415956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-422f7d1a-3825-4027-b997-044eb1e7ddf3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:16.740707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-422f7d1a-3825-4027-b997-044eb1e7ddf3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:16.754291 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-422f7d1a-3825-4027-b997-044eb1e7ddf3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1323 microversion: 2.1 time: 0.372653 Aug 27 04:52:16.755246 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2162/4290] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:16 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1323 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:17.311964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-853a1085-6c69-4a53-824f-5599480cdcd8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:17.312828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-853a1085-6c69-4a53-824f-5599480cdcd8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:17.324867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-853a1085-6c69-4a53-824f-5599480cdcd8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:17.325410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-853a1085-6c69-4a53-824f-5599480cdcd8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:17.326879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-853a1085-6c69-4a53-824f-5599480cdcd8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:17.333264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-853a1085-6c69-4a53-824f-5599480cdcd8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:17.334058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-853a1085-6c69-4a53-824f-5599480cdcd8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:17.334725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-853a1085-6c69-4a53-824f-5599480cdcd8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:17.592173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c50d2c66-fe55-48fe-869c-cf8290463365 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:17.660627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c50d2c66-fe55-48fe-869c-cf8290463365 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:17.664935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c50d2c66-fe55-48fe-869c-cf8290463365 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:17.673966 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c50d2c66-fe55-48fe-869c-cf8290463365 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 2.540429 Aug 27 04:52:17.691500 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2129/4291] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:15 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 2564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:17.775877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c8f07f1e-d301-4ed9-962a-34fda64888aa tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:17.776501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c8f07f1e-d301-4ed9-962a-34fda64888aa tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:17.793610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8f07f1e-d301-4ed9-962a-34fda64888aa tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:17.794394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8f07f1e-d301-4ed9-962a-34fda64888aa tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:17.795023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8f07f1e-d301-4ed9-962a-34fda64888aa tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:17.795902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8f07f1e-d301-4ed9-962a-34fda64888aa tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:17.796617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8f07f1e-d301-4ed9-962a-34fda64888aa tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:17.797212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c8f07f1e-d301-4ed9-962a-34fda64888aa tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:17.857717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:17.947222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-853a1085-6c69-4a53-824f-5599480cdcd8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:17.962197 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-853a1085-6c69-4a53-824f-5599480cdcd8 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1725 microversion: 2.1 time: 0.654336 Aug 27 04:52:17.966566 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2163/4292] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:17 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1725 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:18.698810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54b8c1e1-c013-40c0-a0a6-54ace584e981 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:18.699432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-54b8c1e1-c013-40c0-a0a6-54ace584e981 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:18.727405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54b8c1e1-c013-40c0-a0a6-54ace584e981 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:18.727886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54b8c1e1-c013-40c0-a0a6-54ace584e981 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:18.728548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54b8c1e1-c013-40c0-a0a6-54ace584e981 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:18.729664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54b8c1e1-c013-40c0-a0a6-54ace584e981 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:18.730292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54b8c1e1-c013-40c0-a0a6-54ace584e981 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:18.730886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54b8c1e1-c013-40c0-a0a6-54ace584e981 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:19.087890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c8f07f1e-d301-4ed9-962a-34fda64888aa tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:19.095903 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c8f07f1e-d301-4ed9-962a-34fda64888aa tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1323 microversion: 2.1 time: 1.324513 Aug 27 04:52:19.114102 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2130/4293] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:17 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1323 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:19.119577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-653531b5-87ef-4913-9a3d-8ef67cd761a3 req-952669c1-a6c1-451b-b720-8c89d06bbfbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "tag": "17bdccd1-ac80-487e-affd-5d9c98c1239a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:19.141636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-653531b5-87ef-4913-9a3d-8ef67cd761a3 req-952669c1-a6c1-451b-b720-8c89d06bbfbe service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:19.142646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-653531b5-87ef-4913-9a3d-8ef67cd761a3 req-952669c1-a6c1-451b-b720-8c89d06bbfbe service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:19.143474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-653531b5-87ef-4913-9a3d-8ef67cd761a3 req-952669c1-a6c1-451b-b720-8c89d06bbfbe service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:19.158435 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-653531b5-87ef-4913-9a3d-8ef67cd761a3 req-952669c1-a6c1-451b-b720-8c89d06bbfbe service nova] Creating event network-changed:17bdccd1-ac80-487e-affd-5d9c98c1239a for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:52:19.166030 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-653531b5-87ef-4913-9a3d-8ef67cd761a3 req-952669c1-a6c1-451b-b720-8c89d06bbfbe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049448 Aug 27 04:52:19.166987 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2131/4294] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:19.169677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:19.176196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-11669654-a4cb-41dc-9fe8-7d793001211b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:19.182227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-11669654-a4cb-41dc-9fe8-7d793001211b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:19.199931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11669654-a4cb-41dc-9fe8-7d793001211b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:19.200720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11669654-a4cb-41dc-9fe8-7d793001211b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:19.201406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11669654-a4cb-41dc-9fe8-7d793001211b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:19.202349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11669654-a4cb-41dc-9fe8-7d793001211b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:19.203088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11669654-a4cb-41dc-9fe8-7d793001211b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:19.204135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11669654-a4cb-41dc-9fe8-7d793001211b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:19.446143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-54b8c1e1-c013-40c0-a0a6-54ace584e981 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:19.471531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-54b8c1e1-c013-40c0-a0a6-54ace584e981 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:19.484042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-54b8c1e1-c013-40c0-a0a6-54ace584e981 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:19.497538 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-54b8c1e1-c013-40c0-a0a6-54ace584e981 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.803080 Aug 27 04:52:19.513398 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2164/4295] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:18 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:19.734760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:20.119809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1d40240-3ea5-4f84-a16f-a705da88ffdc tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:20.122870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1d40240-3ea5-4f84-a16f-a705da88ffdc tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:20.144103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d40240-3ea5-4f84-a16f-a705da88ffdc tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:20.153439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d40240-3ea5-4f84-a16f-a705da88ffdc tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:20.154323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d40240-3ea5-4f84-a16f-a705da88ffdc tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:20.155263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d40240-3ea5-4f84-a16f-a705da88ffdc tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:20.155908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d40240-3ea5-4f84-a16f-a705da88ffdc tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:20.156738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d40240-3ea5-4f84-a16f-a705da88ffdc tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:20.636478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1d40240-3ea5-4f84-a16f-a705da88ffdc tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:20.660935 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1d40240-3ea5-4f84-a16f-a705da88ffdc tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1323 microversion: 2.1 time: 0.541180 Aug 27 04:52:20.668886 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2165/4296] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:20 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1323 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:20.687738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7cc6668-4f83-48a4-9a59-a0cb39bb6e8b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:20.688681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7cc6668-4f83-48a4-9a59-a0cb39bb6e8b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:20.717577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7cc6668-4f83-48a4-9a59-a0cb39bb6e8b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:20.721406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7cc6668-4f83-48a4-9a59-a0cb39bb6e8b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:20.724892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7cc6668-4f83-48a4-9a59-a0cb39bb6e8b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:20.726790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7cc6668-4f83-48a4-9a59-a0cb39bb6e8b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:20.729190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7cc6668-4f83-48a4-9a59-a0cb39bb6e8b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:20.730888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7cc6668-4f83-48a4-9a59-a0cb39bb6e8b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:21.634116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7cc6668-4f83-48a4-9a59-a0cb39bb6e8b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:21.648674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7cc6668-4f83-48a4-9a59-a0cb39bb6e8b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:21.654073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7cc6668-4f83-48a4-9a59-a0cb39bb6e8b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:21.656705 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7cc6668-4f83-48a4-9a59-a0cb39bb6e8b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.985295 Aug 27 04:52:21.657618 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2166/4297] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:20 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:21.683218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-053d4007-9354-43fe-919f-ff37f94ae34a req-07797d64-ef76-4a61-9bc2-088b46593c8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa76344-e5ad-4214-93b2-47a019d27cd7", "tag": "b1acbc40-1d0a-4606-9b83-abe3d978775d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:21.694564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-053d4007-9354-43fe-919f-ff37f94ae34a req-07797d64-ef76-4a61-9bc2-088b46593c8c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:21.695329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-053d4007-9354-43fe-919f-ff37f94ae34a req-07797d64-ef76-4a61-9bc2-088b46593c8c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:21.695913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-053d4007-9354-43fe-919f-ff37f94ae34a req-07797d64-ef76-4a61-9bc2-088b46593c8c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:21.727311 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-053d4007-9354-43fe-919f-ff37f94ae34a req-07797d64-ef76-4a61-9bc2-088b46593c8c service nova] Creating event network-changed:b1acbc40-1d0a-4606-9b83-abe3d978775d for instance 4fa76344-e5ad-4214-93b2-47a019d27cd7 on n-h2-854823-1 Aug 27 04:52:21.735860 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-053d4007-9354-43fe-919f-ff37f94ae34a req-07797d64-ef76-4a61-9bc2-088b46593c8c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055826 Aug 27 04:52:21.737924 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2167/4298] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:21.746515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f72916d0-b800-4caa-9d45-9a7c465784cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:21.749398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f72916d0-b800-4caa-9d45-9a7c465784cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:21.769567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f72916d0-b800-4caa-9d45-9a7c465784cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:21.769984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f72916d0-b800-4caa-9d45-9a7c465784cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:21.770426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f72916d0-b800-4caa-9d45-9a7c465784cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:21.771147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f72916d0-b800-4caa-9d45-9a7c465784cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:21.771602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f72916d0-b800-4caa-9d45-9a7c465784cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:21.772163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f72916d0-b800-4caa-9d45-9a7c465784cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:22.352271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-11669654-a4cb-41dc-9fe8-7d793001211b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:22.368551 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-11669654-a4cb-41dc-9fe8-7d793001211b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1725 microversion: 2.1 time: 3.199501 Aug 27 04:52:22.369492 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2132/4299] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:19 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1725 bytes in 3202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:22.423148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f72916d0-b800-4caa-9d45-9a7c465784cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:22.436070 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f72916d0-b800-4caa-9d45-9a7c465784cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1323 microversion: 2.1 time: 0.696339 Aug 27 04:52:22.437502 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2168/4300] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:21 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1323 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:22.673577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-6e47fa23-ce33-4314-897a-7d49a136a7a0 req-cb23402a-b3e8-4425-aeb5-a49b998a0004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "tag": "be33a009-98cd-48e8-9d40-6cb18faec1d1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:22.688116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f9a263a2-daac-401a-ae77-4abd42b2d824 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:22.691198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:22.695616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6e47fa23-ce33-4314-897a-7d49a136a7a0 req-cb23402a-b3e8-4425-aeb5-a49b998a0004 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:22.696106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6e47fa23-ce33-4314-897a-7d49a136a7a0 req-cb23402a-b3e8-4425-aeb5-a49b998a0004 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:22.696571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6e47fa23-ce33-4314-897a-7d49a136a7a0 req-cb23402a-b3e8-4425-aeb5-a49b998a0004 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:22.698192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f9a263a2-daac-401a-ae77-4abd42b2d824 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:22.711985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a263a2-daac-401a-ae77-4abd42b2d824 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:22.712798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a263a2-daac-401a-ae77-4abd42b2d824 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:22.715387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a263a2-daac-401a-ae77-4abd42b2d824 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:22.716364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a263a2-daac-401a-ae77-4abd42b2d824 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:22.717340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a263a2-daac-401a-ae77-4abd42b2d824 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:22.718176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a263a2-daac-401a-ae77-4abd42b2d824 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:22.728919 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-6e47fa23-ce33-4314-897a-7d49a136a7a0 req-cb23402a-b3e8-4425-aeb5-a49b998a0004 service nova] Creating event network-changed:be33a009-98cd-48e8-9d40-6cb18faec1d1 for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:52:22.739215 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-6e47fa23-ce33-4314-897a-7d49a136a7a0 req-cb23402a-b3e8-4425-aeb5-a49b998a0004 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070022 Aug 27 04:52:22.743994 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2133/4301] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:52:23.202363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f9a263a2-daac-401a-ae77-4abd42b2d824 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:23.226274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f9a263a2-daac-401a-ae77-4abd42b2d824 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:23.229084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f9a263a2-daac-401a-ae77-4abd42b2d824 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:23.233456 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f9a263a2-daac-401a-ae77-4abd42b2d824 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.552572 Aug 27 04:52:23.237884 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2169/4302] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:22 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:23.393661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d470d26-9230-4501-80c5-7ea309eef4c5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:23.395077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9d470d26-9230-4501-80c5-7ea309eef4c5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:23.414794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d470d26-9230-4501-80c5-7ea309eef4c5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:23.415576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d470d26-9230-4501-80c5-7ea309eef4c5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:23.417597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d470d26-9230-4501-80c5-7ea309eef4c5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:23.420677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d470d26-9230-4501-80c5-7ea309eef4c5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:23.422006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d470d26-9230-4501-80c5-7ea309eef4c5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:23.422628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d470d26-9230-4501-80c5-7ea309eef4c5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:23.460514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26a377d3-4ec6-474b-8f9a-35b9be97cddf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:23.461736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26a377d3-4ec6-474b-8f9a-35b9be97cddf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:23.468968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26a377d3-4ec6-474b-8f9a-35b9be97cddf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:23.471409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26a377d3-4ec6-474b-8f9a-35b9be97cddf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:23.472728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26a377d3-4ec6-474b-8f9a-35b9be97cddf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:23.475402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26a377d3-4ec6-474b-8f9a-35b9be97cddf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:23.475927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26a377d3-4ec6-474b-8f9a-35b9be97cddf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:23.476403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26a377d3-4ec6-474b-8f9a-35b9be97cddf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:23.908728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26a377d3-4ec6-474b-8f9a-35b9be97cddf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:23.917807 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26a377d3-4ec6-474b-8f9a-35b9be97cddf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1323 microversion: 2.1 time: 0.461052 Aug 27 04:52:23.935413 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2170/4303] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:23 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1323 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:24.224457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9d470d26-9230-4501-80c5-7ea309eef4c5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:24.238631 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9d470d26-9230-4501-80c5-7ea309eef4c5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1725 microversion: 2.1 time: 0.852044 Aug 27 04:52:24.254254 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2134/4304] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:23 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1725 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:24.262071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a724c04-d8ea-4f6c-9c47-ade38981c81e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:24.262684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a724c04-d8ea-4f6c-9c47-ade38981c81e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:24.275249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a724c04-d8ea-4f6c-9c47-ade38981c81e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:24.275856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a724c04-d8ea-4f6c-9c47-ade38981c81e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:24.276230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a724c04-d8ea-4f6c-9c47-ade38981c81e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:24.277365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a724c04-d8ea-4f6c-9c47-ade38981c81e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:24.277834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a724c04-d8ea-4f6c-9c47-ade38981c81e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:24.278308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a724c04-d8ea-4f6c-9c47-ade38981c81e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:24.946887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-432d3b4a-e2b7-4862-9eca-342c37defbeb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:24.948050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-432d3b4a-e2b7-4862-9eca-342c37defbeb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:24.975084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-432d3b4a-e2b7-4862-9eca-342c37defbeb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:24.975084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-432d3b4a-e2b7-4862-9eca-342c37defbeb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:24.975084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-432d3b4a-e2b7-4862-9eca-342c37defbeb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:24.975866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-432d3b4a-e2b7-4862-9eca-342c37defbeb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:24.976882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-432d3b4a-e2b7-4862-9eca-342c37defbeb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:24.977217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-432d3b4a-e2b7-4862-9eca-342c37defbeb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:25.056038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a724c04-d8ea-4f6c-9c47-ade38981c81e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:25.069397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a724c04-d8ea-4f6c-9c47-ade38981c81e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:25.071473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a724c04-d8ea-4f6c-9c47-ade38981c81e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:25.082783 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a724c04-d8ea-4f6c-9c47-ade38981c81e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.825259 Aug 27 04:52:25.083396 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2171/4305] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:24 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:25.280268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b9fd7da-a73f-475f-8bac-704e4affdca9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:25.280915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b9fd7da-a73f-475f-8bac-704e4affdca9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:25.287622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b9fd7da-a73f-475f-8bac-704e4affdca9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:25.288196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b9fd7da-a73f-475f-8bac-704e4affdca9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:25.288591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b9fd7da-a73f-475f-8bac-704e4affdca9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:25.297502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b9fd7da-a73f-475f-8bac-704e4affdca9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:25.298779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b9fd7da-a73f-475f-8bac-704e4affdca9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:25.298779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b9fd7da-a73f-475f-8bac-704e4affdca9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:25.676172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b9fd7da-a73f-475f-8bac-704e4affdca9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:25.687249 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b9fd7da-a73f-475f-8bac-704e4affdca9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1731 microversion: 2.1 time: 0.410724 Aug 27 04:52:25.700899 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2172/4306] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:25 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1731 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:25.709301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f8b79c5-d3e9-45cb-9353-a56074f025fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:25.710231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f8b79c5-d3e9-45cb-9353-a56074f025fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:25.718532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f8b79c5-d3e9-45cb-9353-a56074f025fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:25.718995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f8b79c5-d3e9-45cb-9353-a56074f025fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:25.719428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f8b79c5-d3e9-45cb-9353-a56074f025fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:25.725915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f8b79c5-d3e9-45cb-9353-a56074f025fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:25.727077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f8b79c5-d3e9-45cb-9353-a56074f025fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:25.728639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f8b79c5-d3e9-45cb-9353-a56074f025fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:25.890849 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f8b79c5-d3e9-45cb-9353-a56074f025fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.185339 Aug 27 04:52:25.898794 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2173/4307] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 04:52:25 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:25.972966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f8b79c5-d3e9-45cb-9353-a56074f025fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:25.973902 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f8b79c5-d3e9-45cb-9353-a56074f025fa tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001341 Aug 27 04:52:25.980888 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2174/4308] 10.222.0.79 () {56 vars in 886 bytes} [Sat Aug 27 04:52:25 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 04:52:26.110619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b76bd848-1165-44ee-953e-05e3222f789e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:26.111265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b76bd848-1165-44ee-953e-05e3222f789e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:26.123038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76bd848-1165-44ee-953e-05e3222f789e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:26.123602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76bd848-1165-44ee-953e-05e3222f789e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:26.124048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76bd848-1165-44ee-953e-05e3222f789e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:26.124800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76bd848-1165-44ee-953e-05e3222f789e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:26.125260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76bd848-1165-44ee-953e-05e3222f789e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:26.125779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76bd848-1165-44ee-953e-05e3222f789e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:26.186366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-432d3b4a-e2b7-4862-9eca-342c37defbeb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:26.206650 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-432d3b4a-e2b7-4862-9eca-342c37defbeb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1323 microversion: 2.1 time: 1.265459 Aug 27 04:52:26.207265 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2135/4309] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:24 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1323 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:26.282948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae38f053-6dc1-4fc6-bf19-42f85d10f253 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:26.284078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ae38f053-6dc1-4fc6-bf19-42f85d10f253 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:26.311021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae38f053-6dc1-4fc6-bf19-42f85d10f253 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:26.312026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae38f053-6dc1-4fc6-bf19-42f85d10f253 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:26.314593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae38f053-6dc1-4fc6-bf19-42f85d10f253 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:26.317871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae38f053-6dc1-4fc6-bf19-42f85d10f253 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:26.319225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae38f053-6dc1-4fc6-bf19-42f85d10f253 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:26.319711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae38f053-6dc1-4fc6-bf19-42f85d10f253 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:26.461955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-ae38f053-6dc1-4fc6-bf19-42f85d10f253 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lazy-loading 'services' on Instance uuid 42269482-fde5-4428-83f0-351a3b561a4c {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:52:26.582060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b76bd848-1165-44ee-953e-05e3222f789e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:26.598880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b76bd848-1165-44ee-953e-05e3222f789e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:26.600373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b76bd848-1165-44ee-953e-05e3222f789e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:26.602211 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b76bd848-1165-44ee-953e-05e3222f789e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.495491 Aug 27 04:52:26.604853 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2175/4310] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:26 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:26.606938 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ae38f053-6dc1-4fc6-bf19-42f85d10f253 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "DELETE /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c/os-volume_attachments/6663a08f-d2ea-40f5-bb32-22c6b595f289" status: 202 len: 0 microversion: 2.1 time: 0.327455 Aug 27 04:52:26.633514 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2136/4311] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 04:52:26 2022] DELETE /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c/os-volume_attachments/6663a08f-d2ea-40f5-bb32-22c6b595f289 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:52:27.229036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-301b1007-dbb8-481c-8ca0-63fa87268ede tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:27.229642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-301b1007-dbb8-481c-8ca0-63fa87268ede tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:27.236357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-301b1007-dbb8-481c-8ca0-63fa87268ede tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:27.236900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-301b1007-dbb8-481c-8ca0-63fa87268ede tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:27.237592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-301b1007-dbb8-481c-8ca0-63fa87268ede tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:27.239032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-301b1007-dbb8-481c-8ca0-63fa87268ede tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:27.239032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-301b1007-dbb8-481c-8ca0-63fa87268ede tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:27.239251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-301b1007-dbb8-481c-8ca0-63fa87268ede tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:27.631867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b525e407-a3cd-4a6c-9a86-8700c2f2f2d4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:27.634300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b525e407-a3cd-4a6c-9a86-8700c2f2f2d4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:27.654378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b525e407-a3cd-4a6c-9a86-8700c2f2f2d4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:27.655727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b525e407-a3cd-4a6c-9a86-8700c2f2f2d4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:27.656391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b525e407-a3cd-4a6c-9a86-8700c2f2f2d4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:27.657689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b525e407-a3cd-4a6c-9a86-8700c2f2f2d4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:27.659182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b525e407-a3cd-4a6c-9a86-8700c2f2f2d4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:27.660493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b525e407-a3cd-4a6c-9a86-8700c2f2f2d4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:27.848283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-301b1007-dbb8-481c-8ca0-63fa87268ede tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:27.861777 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-301b1007-dbb8-481c-8ca0-63fa87268ede tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1323 microversion: 2.1 time: 0.636369 Aug 27 04:52:27.864435 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2176/4312] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:27 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1323 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:28.177964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b525e407-a3cd-4a6c-9a86-8700c2f2f2d4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:28.200272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b525e407-a3cd-4a6c-9a86-8700c2f2f2d4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:28.209169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b525e407-a3cd-4a6c-9a86-8700c2f2f2d4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:28.212413 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b525e407-a3cd-4a6c-9a86-8700c2f2f2d4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.588769 Aug 27 04:52:28.214675 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2137/4313] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:27 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:28.441155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6e8b89ff-a19e-42c9-9509-02286dc34cd2 req-309ee43c-9d9f-4208-bb10-409abfdf4993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f74e4f7-e0b8-41cb-88a2-98aff82b1d98", "tag": "63e52c18-d4a3-457e-9877-9a1d70646169"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:28.465523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6e8b89ff-a19e-42c9-9509-02286dc34cd2 req-309ee43c-9d9f-4208-bb10-409abfdf4993 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:28.488551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6e8b89ff-a19e-42c9-9509-02286dc34cd2 req-309ee43c-9d9f-4208-bb10-409abfdf4993 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:28.494257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6e8b89ff-a19e-42c9-9509-02286dc34cd2 req-309ee43c-9d9f-4208-bb10-409abfdf4993 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:28.525466 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6e8b89ff-a19e-42c9-9509-02286dc34cd2 req-309ee43c-9d9f-4208-bb10-409abfdf4993 service nova] Creating event network-changed:63e52c18-d4a3-457e-9877-9a1d70646169 for instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 on n-h1-854823-1 Aug 27 04:52:28.531080 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6e8b89ff-a19e-42c9-9509-02286dc34cd2 req-309ee43c-9d9f-4208-bb10-409abfdf4993 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093922 Aug 27 04:52:28.532318 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2177/4314] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:28.888643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c450b008-08de-43cb-92e4-b9a08036eb9f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:28.889588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c450b008-08de-43cb-92e4-b9a08036eb9f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:28.910867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c450b008-08de-43cb-92e4-b9a08036eb9f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:28.912353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c450b008-08de-43cb-92e4-b9a08036eb9f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:28.912991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c450b008-08de-43cb-92e4-b9a08036eb9f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:28.916041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c450b008-08de-43cb-92e4-b9a08036eb9f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:28.917460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c450b008-08de-43cb-92e4-b9a08036eb9f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:28.918380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c450b008-08de-43cb-92e4-b9a08036eb9f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:29.238408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7db44fb9-fb04-4547-8f68-bdfe3472153c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:29.240074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7db44fb9-fb04-4547-8f68-bdfe3472153c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:29.253131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7db44fb9-fb04-4547-8f68-bdfe3472153c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:29.253637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7db44fb9-fb04-4547-8f68-bdfe3472153c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:29.254079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7db44fb9-fb04-4547-8f68-bdfe3472153c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:29.254800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7db44fb9-fb04-4547-8f68-bdfe3472153c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:29.255260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7db44fb9-fb04-4547-8f68-bdfe3472153c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:29.255689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7db44fb9-fb04-4547-8f68-bdfe3472153c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:29.292773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:29.456626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c450b008-08de-43cb-92e4-b9a08036eb9f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:29.470816 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c450b008-08de-43cb-92e4-b9a08036eb9f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1323 microversion: 2.1 time: 0.589740 Aug 27 04:52:29.484128 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2138/4315] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:28 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1323 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:29.567367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7db44fb9-fb04-4547-8f68-bdfe3472153c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:29.580075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7db44fb9-fb04-4547-8f68-bdfe3472153c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:29.581898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7db44fb9-fb04-4547-8f68-bdfe3472153c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:29.583635 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7db44fb9-fb04-4547-8f68-bdfe3472153c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.349627 Aug 27 04:52:29.598571 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2178/4316] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:29 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:30.494647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47319eda-d787-4e90-9a43-934dd8a75f94 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:30.495436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47319eda-d787-4e90-9a43-934dd8a75f94 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:30.522767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47319eda-d787-4e90-9a43-934dd8a75f94 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:30.525179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47319eda-d787-4e90-9a43-934dd8a75f94 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:30.527085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47319eda-d787-4e90-9a43-934dd8a75f94 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:30.530077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47319eda-d787-4e90-9a43-934dd8a75f94 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:30.530806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47319eda-d787-4e90-9a43-934dd8a75f94 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:30.533819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47319eda-d787-4e90-9a43-934dd8a75f94 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:30.814217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47319eda-d787-4e90-9a43-934dd8a75f94 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:30.827053 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47319eda-d787-4e90-9a43-934dd8a75f94 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1323 microversion: 2.1 time: 0.337559 Aug 27 04:52:30.830406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8d342811-2253-46e9-adb9-ebdecaf6f07b req-66fc025e-8f86-4f72-992a-18e4244cc2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa76344-e5ad-4214-93b2-47a019d27cd7", "name": "network-vif-plugged", "status": "completed", "tag": "b1acbc40-1d0a-4606-9b83-abe3d978775d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:30.836716 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2179/4317] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:30 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1323 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:30.849931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8d342811-2253-46e9-adb9-ebdecaf6f07b req-66fc025e-8f86-4f72-992a-18e4244cc2bc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:30.855111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8d342811-2253-46e9-adb9-ebdecaf6f07b req-66fc025e-8f86-4f72-992a-18e4244cc2bc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:30.855516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8d342811-2253-46e9-adb9-ebdecaf6f07b req-66fc025e-8f86-4f72-992a-18e4244cc2bc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:30.882555 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8d342811-2253-46e9-adb9-ebdecaf6f07b req-66fc025e-8f86-4f72-992a-18e4244cc2bc service nova] Creating event network-vif-plugged:b1acbc40-1d0a-4606-9b83-abe3d978775d for instance 4fa76344-e5ad-4214-93b2-47a019d27cd7 on n-h2-854823-1 Aug 27 04:52:30.909015 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8d342811-2253-46e9-adb9-ebdecaf6f07b req-66fc025e-8f86-4f72-992a-18e4244cc2bc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.668528 Aug 27 04:52:30.909636 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2139/4318] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:30.918468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-37d317a0-4f91-4406-8afd-0687e06f12b7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:30.922238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-37d317a0-4f91-4406-8afd-0687e06f12b7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:30.943266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37d317a0-4f91-4406-8afd-0687e06f12b7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:30.943771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37d317a0-4f91-4406-8afd-0687e06f12b7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:30.944210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37d317a0-4f91-4406-8afd-0687e06f12b7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:30.951218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37d317a0-4f91-4406-8afd-0687e06f12b7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:30.951945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37d317a0-4f91-4406-8afd-0687e06f12b7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:30.953393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37d317a0-4f91-4406-8afd-0687e06f12b7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:31.323252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c9135022-508e-49f7-98df-b40a15c3eb2a req-983334d2-152e-4db8-9f32-165451cebbc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f74e4f7-e0b8-41cb-88a2-98aff82b1d98", "tag": "63e52c18-d4a3-457e-9877-9a1d70646169"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:31.339693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9135022-508e-49f7-98df-b40a15c3eb2a req-983334d2-152e-4db8-9f32-165451cebbc0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:31.343919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9135022-508e-49f7-98df-b40a15c3eb2a req-983334d2-152e-4db8-9f32-165451cebbc0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:31.344572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9135022-508e-49f7-98df-b40a15c3eb2a req-983334d2-152e-4db8-9f32-165451cebbc0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:31.369607 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c9135022-508e-49f7-98df-b40a15c3eb2a req-983334d2-152e-4db8-9f32-165451cebbc0 service nova] Creating event network-changed:63e52c18-d4a3-457e-9877-9a1d70646169 for instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 on n-h1-854823-1 Aug 27 04:52:31.390967 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c9135022-508e-49f7-98df-b40a15c3eb2a req-983334d2-152e-4db8-9f32-165451cebbc0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.551630 Aug 27 04:52:31.391780 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2180/4319] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:31.852202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca6e4c50-dda3-49ba-81b5-bb9af9c7c3a8 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:31.852930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca6e4c50-dda3-49ba-81b5-bb9af9c7c3a8 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:31.863302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca6e4c50-dda3-49ba-81b5-bb9af9c7c3a8 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:31.873339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca6e4c50-dda3-49ba-81b5-bb9af9c7c3a8 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:31.874032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca6e4c50-dda3-49ba-81b5-bb9af9c7c3a8 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:31.874791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca6e4c50-dda3-49ba-81b5-bb9af9c7c3a8 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:31.875257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca6e4c50-dda3-49ba-81b5-bb9af9c7c3a8 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:31.875691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca6e4c50-dda3-49ba-81b5-bb9af9c7c3a8 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:32.107389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca6e4c50-dda3-49ba-81b5-bb9af9c7c3a8 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:32.117177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-37d317a0-4f91-4406-8afd-0687e06f12b7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:32.119411 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca6e4c50-dda3-49ba-81b5-bb9af9c7c3a8 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1323 microversion: 2.1 time: 0.269800 Aug 27 04:52:32.122019 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2181/4320] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:31 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1323 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:32.143581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-37d317a0-4f91-4406-8afd-0687e06f12b7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:32.157526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-37d317a0-4f91-4406-8afd-0687e06f12b7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:32.161988 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-37d317a0-4f91-4406-8afd-0687e06f12b7 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 1.248597 Aug 27 04:52:32.162923 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2140/4321] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:30 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:33.143475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea298aaa-7fa9-4180-8219-21366c5e4e87 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:33.144220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea298aaa-7fa9-4180-8219-21366c5e4e87 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:33.168069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea298aaa-7fa9-4180-8219-21366c5e4e87 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:33.168802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea298aaa-7fa9-4180-8219-21366c5e4e87 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:33.169517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea298aaa-7fa9-4180-8219-21366c5e4e87 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:33.172101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea298aaa-7fa9-4180-8219-21366c5e4e87 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:33.174232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea298aaa-7fa9-4180-8219-21366c5e4e87 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:33.175344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea298aaa-7fa9-4180-8219-21366c5e4e87 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:33.189231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f6b64914-f9c0-4d48-a875-989be307ed86 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:33.189955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f6b64914-f9c0-4d48-a875-989be307ed86 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:33.208479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6b64914-f9c0-4d48-a875-989be307ed86 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:33.211858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6b64914-f9c0-4d48-a875-989be307ed86 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:33.213430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6b64914-f9c0-4d48-a875-989be307ed86 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:33.214816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6b64914-f9c0-4d48-a875-989be307ed86 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:33.216452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6b64914-f9c0-4d48-a875-989be307ed86 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:33.217959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6b64914-f9c0-4d48-a875-989be307ed86 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:33.481580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ea298aaa-7fa9-4180-8219-21366c5e4e87 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:33.497370 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea298aaa-7fa9-4180-8219-21366c5e4e87 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1323 microversion: 2.1 time: 0.358599 Aug 27 04:52:33.498236 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2182/4322] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:33 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1323 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:33.883659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f6b64914-f9c0-4d48-a875-989be307ed86 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:33.898207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f6b64914-f9c0-4d48-a875-989be307ed86 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:33.902571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f6b64914-f9c0-4d48-a875-989be307ed86 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:33.903969 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f6b64914-f9c0-4d48-a875-989be307ed86 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.719122 Aug 27 04:52:33.916554 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2141/4323] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:33 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:34.522128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30b98a85-f120-48c4-afb6-81b6cd2030c1 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:34.524604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-30b98a85-f120-48c4-afb6-81b6cd2030c1 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:34.533734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b98a85-f120-48c4-afb6-81b6cd2030c1 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:34.534239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b98a85-f120-48c4-afb6-81b6cd2030c1 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:34.534674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b98a85-f120-48c4-afb6-81b6cd2030c1 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:34.535391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b98a85-f120-48c4-afb6-81b6cd2030c1 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:34.535850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b98a85-f120-48c4-afb6-81b6cd2030c1 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:34.536278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b98a85-f120-48c4-afb6-81b6cd2030c1 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:34.656777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5ad11cfb-6edb-43e1-a66f-5d56497cfa7d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:34.657372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5ad11cfb-6edb-43e1-a66f-5d56497cfa7d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:34.676281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ad11cfb-6edb-43e1-a66f-5d56497cfa7d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:34.676847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ad11cfb-6edb-43e1-a66f-5d56497cfa7d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:34.677429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ad11cfb-6edb-43e1-a66f-5d56497cfa7d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:34.693004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ad11cfb-6edb-43e1-a66f-5d56497cfa7d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:34.693513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ad11cfb-6edb-43e1-a66f-5d56497cfa7d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:34.693963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ad11cfb-6edb-43e1-a66f-5d56497cfa7d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:34.758563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5ad11cfb-6edb-43e1-a66f-5d56497cfa7d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:52:34.935560 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5ad11cfb-6edb-43e1-a66f-5d56497cfa7d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "DELETE /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 204 len: 0 microversion: 2.1 time: 0.282320 Aug 27 04:52:34.940518 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2142/4324] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:52:34 2022] DELETE /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:34.954635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2624fdbc-c9aa-42d7-bd53-ff0d3b5db250 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:34.958813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2624fdbc-c9aa-42d7-bd53-ff0d3b5db250 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:34.982358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2624fdbc-c9aa-42d7-bd53-ff0d3b5db250 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:34.983379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2624fdbc-c9aa-42d7-bd53-ff0d3b5db250 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:34.984634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2624fdbc-c9aa-42d7-bd53-ff0d3b5db250 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:34.987089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2624fdbc-c9aa-42d7-bd53-ff0d3b5db250 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:34.987847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2624fdbc-c9aa-42d7-bd53-ff0d3b5db250 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:34.989566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2624fdbc-c9aa-42d7-bd53-ff0d3b5db250 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.016875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-30b98a85-f120-48c4-afb6-81b6cd2030c1 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:35.036017 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-30b98a85-f120-48c4-afb6-81b6cd2030c1 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1518 microversion: 2.1 time: 0.515977 Aug 27 04:52:35.040973 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2183/4325] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:34 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1518 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:35.056499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66d4df7c-4bc4-45fc-ae1d-0ed2dc66e99a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:35.059566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66d4df7c-4bc4-45fc-ae1d-0ed2dc66e99a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:35.067755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66d4df7c-4bc4-45fc-ae1d-0ed2dc66e99a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.068759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66d4df7c-4bc4-45fc-ae1d-0ed2dc66e99a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.070271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66d4df7c-4bc4-45fc-ae1d-0ed2dc66e99a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.071917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66d4df7c-4bc4-45fc-ae1d-0ed2dc66e99a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.072698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66d4df7c-4bc4-45fc-ae1d-0ed2dc66e99a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.073480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66d4df7c-4bc4-45fc-ae1d-0ed2dc66e99a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.344558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66d4df7c-4bc4-45fc-ae1d-0ed2dc66e99a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:35.370561 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66d4df7c-4bc4-45fc-ae1d-0ed2dc66e99a tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1469 microversion: 2.1 time: 0.323471 Aug 27 04:52:35.388601 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2184/4326] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:35 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1469 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:35.407407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4d46e5a0-54bc-4e89-8728-73fbaef50f27 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:35.410938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4d46e5a0-54bc-4e89-8728-73fbaef50f27 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:35.427101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d46e5a0-54bc-4e89-8728-73fbaef50f27 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.427690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d46e5a0-54bc-4e89-8728-73fbaef50f27 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.428355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d46e5a0-54bc-4e89-8728-73fbaef50f27 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.430202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d46e5a0-54bc-4e89-8728-73fbaef50f27 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.434781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d46e5a0-54bc-4e89-8728-73fbaef50f27 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.435413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d46e5a0-54bc-4e89-8728-73fbaef50f27 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.488032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-4d46e5a0-54bc-4e89-8728-73fbaef50f27 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lazy-loading 'flavor' on Instance uuid 4fa76344-e5ad-4214-93b2-47a019d27cd7 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:52:35.626186 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4d46e5a0-54bc-4e89-8728-73fbaef50f27 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "POST /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7/action" status: 200 len: 32 microversion: 2.1 time: 0.234220 Aug 27 04:52:35.634122 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2185/4327] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:52:35 2022] POST /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7/action => generated 32 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:52:35.648233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90c2d53c-08f8-41c0-82fb-7e60bb925e64 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:35.649427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90c2d53c-08f8-41c0-82fb-7e60bb925e64 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:35.657001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90c2d53c-08f8-41c0-82fb-7e60bb925e64 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.658136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90c2d53c-08f8-41c0-82fb-7e60bb925e64 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.659015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90c2d53c-08f8-41c0-82fb-7e60bb925e64 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.659991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90c2d53c-08f8-41c0-82fb-7e60bb925e64 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:35.660717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90c2d53c-08f8-41c0-82fb-7e60bb925e64 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:35.661366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90c2d53c-08f8-41c0-82fb-7e60bb925e64 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:35.689398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2624fdbc-c9aa-42d7-bd53-ff0d3b5db250 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:35.702186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2624fdbc-c9aa-42d7-bd53-ff0d3b5db250 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:35.705258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2624fdbc-c9aa-42d7-bd53-ff0d3b5db250 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:35.706745 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2624fdbc-c9aa-42d7-bd53-ff0d3b5db250 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.764282 Aug 27 04:52:35.713645 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2143/4328] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:34 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:35.896279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-90c2d53c-08f8-41c0-82fb-7e60bb925e64 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:35.908759 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90c2d53c-08f8-41c0-82fb-7e60bb925e64 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 0.271637 Aug 27 04:52:35.916596 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2186/4329] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:35 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:36.394476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae7c294f-8f42-4667-8f21-6546f9eebc0b tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:36.395358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ae7c294f-8f42-4667-8f21-6546f9eebc0b tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:36.404188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae7c294f-8f42-4667-8f21-6546f9eebc0b tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.404996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae7c294f-8f42-4667-8f21-6546f9eebc0b tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.405597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae7c294f-8f42-4667-8f21-6546f9eebc0b tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.406532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae7c294f-8f42-4667-8f21-6546f9eebc0b tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.407238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae7c294f-8f42-4667-8f21-6546f9eebc0b tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.407820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae7c294f-8f42-4667-8f21-6546f9eebc0b tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.733030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eaac6e9f-2252-446a-a3b6-89e72c5e04ac tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:36.734164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eaac6e9f-2252-446a-a3b6-89e72c5e04ac tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:36.748936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaac6e9f-2252-446a-a3b6-89e72c5e04ac tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.749949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaac6e9f-2252-446a-a3b6-89e72c5e04ac tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.752611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaac6e9f-2252-446a-a3b6-89e72c5e04ac tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:36.753899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaac6e9f-2252-446a-a3b6-89e72c5e04ac tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:36.755168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaac6e9f-2252-446a-a3b6-89e72c5e04ac tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:36.755932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaac6e9f-2252-446a-a3b6-89e72c5e04ac tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:37.099513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eaac6e9f-2252-446a-a3b6-89e72c5e04ac tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:37.110856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eaac6e9f-2252-446a-a3b6-89e72c5e04ac tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:37.112641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eaac6e9f-2252-446a-a3b6-89e72c5e04ac tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:37.113950 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eaac6e9f-2252-446a-a3b6-89e72c5e04ac tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.387090 Aug 27 04:52:37.115309 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2187/4330] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:36 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:37.121224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-305285b9-14c7-48fa-920d-a2f6b32271f3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:37.122805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-305285b9-14c7-48fa-920d-a2f6b32271f3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:37.134048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-305285b9-14c7-48fa-920d-a2f6b32271f3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:37.134540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-305285b9-14c7-48fa-920d-a2f6b32271f3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:37.135203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-305285b9-14c7-48fa-920d-a2f6b32271f3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:37.136265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-305285b9-14c7-48fa-920d-a2f6b32271f3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:37.136760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-305285b9-14c7-48fa-920d-a2f6b32271f3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:37.137199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-305285b9-14c7-48fa-920d-a2f6b32271f3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:37.227128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ae7c294f-8f42-4667-8f21-6546f9eebc0b tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:37.236023 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ae7c294f-8f42-4667-8f21-6546f9eebc0b tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1469 microversion: 2.1 time: 0.845988 Aug 27 04:52:37.237361 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2144/4331] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:36 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1469 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:37.318394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-305285b9-14c7-48fa-920d-a2f6b32271f3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:37.328060 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-305285b9-14c7-48fa-920d-a2f6b32271f3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 0.211414 Aug 27 04:52:37.328712 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2188/4332] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:37 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:38.149229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e8817dd-e363-4481-abb5-7b99bb9e4d25 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:38.150129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3e8817dd-e363-4481-abb5-7b99bb9e4d25 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:38.157715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e8817dd-e363-4481-abb5-7b99bb9e4d25 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.158470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e8817dd-e363-4481-abb5-7b99bb9e4d25 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.159109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e8817dd-e363-4481-abb5-7b99bb9e4d25 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.159867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e8817dd-e363-4481-abb5-7b99bb9e4d25 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.160488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e8817dd-e363-4481-abb5-7b99bb9e4d25 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.161140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e8817dd-e363-4481-abb5-7b99bb9e4d25 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.266594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66806e40-cdb7-470e-ac5e-55cdbcffe37d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:38.267262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66806e40-cdb7-470e-ac5e-55cdbcffe37d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:38.280177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66806e40-cdb7-470e-ac5e-55cdbcffe37d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.280711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66806e40-cdb7-470e-ac5e-55cdbcffe37d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.283376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66806e40-cdb7-470e-ac5e-55cdbcffe37d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.284255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66806e40-cdb7-470e-ac5e-55cdbcffe37d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.285083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66806e40-cdb7-470e-ac5e-55cdbcffe37d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.285902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66806e40-cdb7-470e-ac5e-55cdbcffe37d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.452925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66806e40-cdb7-470e-ac5e-55cdbcffe37d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:38.462396 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66806e40-cdb7-470e-ac5e-55cdbcffe37d tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1427 microversion: 2.1 time: 0.199990 Aug 27 04:52:38.467267 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2189/4333] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:38 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1427 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:38.479583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9d55309-2a01-4e25-87fa-017a5dffde8f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:38.481895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9d55309-2a01-4e25-87fa-017a5dffde8f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:38.499851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9d55309-2a01-4e25-87fa-017a5dffde8f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.500575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9d55309-2a01-4e25-87fa-017a5dffde8f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.502417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9d55309-2a01-4e25-87fa-017a5dffde8f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.505235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9d55309-2a01-4e25-87fa-017a5dffde8f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:38.505888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9d55309-2a01-4e25-87fa-017a5dffde8f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:38.507363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9d55309-2a01-4e25-87fa-017a5dffde8f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:38.850807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9d55309-2a01-4e25-87fa-017a5dffde8f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:38.865660 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9d55309-2a01-4e25-87fa-017a5dffde8f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 0.396838 Aug 27 04:52:38.867835 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2190/4334] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:38 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:39.346022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-12ceeaeb-97e7-4c14-822b-cf64899c3a4b req-a60455fd-725f-452f-82b9-905e0882ac10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42269482-fde5-4428-83f0-351a3b561a4c", "name": "network-vif-deleted", "tag": "9b9eca72-142f-4710-929c-ca1a9b01ab1d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:52:39.378907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-12ceeaeb-97e7-4c14-822b-cf64899c3a4b req-a60455fd-725f-452f-82b9-905e0882ac10 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.382595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-12ceeaeb-97e7-4c14-822b-cf64899c3a4b req-a60455fd-725f-452f-82b9-905e0882ac10 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.383122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-12ceeaeb-97e7-4c14-822b-cf64899c3a4b req-a60455fd-725f-452f-82b9-905e0882ac10 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.414862 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-12ceeaeb-97e7-4c14-822b-cf64899c3a4b req-a60455fd-725f-452f-82b9-905e0882ac10 service nova] Creating event network-vif-deleted:9b9eca72-142f-4710-929c-ca1a9b01ab1d for instance 42269482-fde5-4428-83f0-351a3b561a4c on n-h1-854823-1 Aug 27 04:52:39.426896 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-12ceeaeb-97e7-4c14-822b-cf64899c3a4b req-a60455fd-725f-452f-82b9-905e0882ac10 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096688 Aug 27 04:52:39.431101 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2191/4335] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:39.474297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3e8817dd-e363-4481-abb5-7b99bb9e4d25 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:39.492028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b49bd6ff-007a-4f6e-b0c8-b564f074e2f9 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:39.493164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b49bd6ff-007a-4f6e-b0c8-b564f074e2f9 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:39.494443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3e8817dd-e363-4481-abb5-7b99bb9e4d25 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:39.501417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3e8817dd-e363-4481-abb5-7b99bb9e4d25 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:39.503460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b49bd6ff-007a-4f6e-b0c8-b564f074e2f9 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.504258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b49bd6ff-007a-4f6e-b0c8-b564f074e2f9 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.505587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b49bd6ff-007a-4f6e-b0c8-b564f074e2f9 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.506606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b49bd6ff-007a-4f6e-b0c8-b564f074e2f9 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.507908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b49bd6ff-007a-4f6e-b0c8-b564f074e2f9 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.509116 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3e8817dd-e363-4481-abb5-7b99bb9e4d25 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 1.366805 Aug 27 04:52:39.511115 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2145/4336] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:38 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:39.513263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b49bd6ff-007a-4f6e-b0c8-b564f074e2f9 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.602471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b49bd6ff-007a-4f6e-b0c8-b564f074e2f9 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.602962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b49bd6ff-007a-4f6e-b0c8-b564f074e2f9 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.603398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b49bd6ff-007a-4f6e-b0c8-b564f074e2f9 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.603896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-b49bd6ff-007a-4f6e-b0c8-b564f074e2f9 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lazy-loading 'fault' on Instance uuid 42269482-fde5-4428-83f0-351a3b561a4c {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:52:39.764179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b49bd6ff-007a-4f6e-b0c8-b564f074e2f9 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b431bcf9fb7c41b6a3d68de10e68bede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad2481dba4789acfb928380a0575f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:39.775869 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b49bd6ff-007a-4f6e-b0c8-b564f074e2f9 tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 200 len: 1303 microversion: 2.1 time: 0.288027 Aug 27 04:52:39.778875 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2192/4337] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:39 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 1303 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:39.890454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0d18112f-6085-4568-8ff7-48c286475f17 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:39.891946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0d18112f-6085-4568-8ff7-48c286475f17 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:39.902622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d18112f-6085-4568-8ff7-48c286475f17 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.904344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d18112f-6085-4568-8ff7-48c286475f17 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.905195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d18112f-6085-4568-8ff7-48c286475f17 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:39.909042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d18112f-6085-4568-8ff7-48c286475f17 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:39.909402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d18112f-6085-4568-8ff7-48c286475f17 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:39.909838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d18112f-6085-4568-8ff7-48c286475f17 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:40.502006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0d18112f-6085-4568-8ff7-48c286475f17 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:40.518225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:40.529431 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0d18112f-6085-4568-8ff7-48c286475f17 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 0.643528 Aug 27 04:52:40.532837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9dfa7e99-131f-4538-8750-f9016cbc858b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:40.533568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9dfa7e99-131f-4538-8750-f9016cbc858b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:40.534297 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2146/4338] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:39 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:40.562121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dfa7e99-131f-4538-8750-f9016cbc858b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:40.562732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dfa7e99-131f-4538-8750-f9016cbc858b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:40.563179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dfa7e99-131f-4538-8750-f9016cbc858b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:40.563934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dfa7e99-131f-4538-8750-f9016cbc858b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:40.564392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dfa7e99-131f-4538-8750-f9016cbc858b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:40.571083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dfa7e99-131f-4538-8750-f9016cbc858b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:40.800396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6908512f-1684-43c3-8b74-592d68438c6f tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:40.801247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6908512f-1684-43c3-8b74-592d68438c6f tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] [instance: 42269482-fde5-4428-83f0-351a3b561a4c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:40.812876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6908512f-1684-43c3-8b74-592d68438c6f tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:40.813466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6908512f-1684-43c3-8b74-592d68438c6f tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:40.815674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6908512f-1684-43c3-8b74-592d68438c6f tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:40.816450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6908512f-1684-43c3-8b74-592d68438c6f tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:40.816971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6908512f-1684-43c3-8b74-592d68438c6f tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:40.817412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6908512f-1684-43c3-8b74-592d68438c6f tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:40.870122 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-6908512f-1684-43c3-8b74-592d68438c6f tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] HTTP exception thrown: Instance 42269482-fde5-4428-83f0-351a3b561a4c could not be found. Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6908512f-1684-43c3-8b74-592d68438c6f tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Request method failure captured: Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c HTTP/1.1 Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaJlwXw2v2wnMwLCnU-BYZEJqeLR8BH68blW19wSqmjhJZs7dDyZDRUH8Gl1NnfePwlBBt_BEP_JCF4OQNeNFETjrZTdmX1J1MpyOQCmBhgU1k1V-nvS-rzLTj75rBI5E53Ci7vPUt0g4N4LeGo3K0R2QMdEz2nzqdqrEGhY8ZCQo9w Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: f1cad2481dba4789acfb928380a0575f Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-VolumesBackupsTest-2086852988 Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f1cad2481dba4789acfb928380a0575f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f1cad2481dba4789acfb928380a0575f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f1cad2481dba4789acfb928380a0575f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f1cad2481dba4789acfb928380a0575f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-VolumesBackupsTest-2086852988 Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: f1cad2481dba4789acfb928380a0575f Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-VolumesBackupsTest-2086852988 Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-VolumesBackupsTest-2086852988-project Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: b431bcf9fb7c41b6a3d68de10e68bede Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-VolumesBackupsTest-2086852988-project Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 42269482-fde5-4428-83f0-351a3b561a4c could not be found. Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '42269482-fde5-4428-83f0-351a3b561a4c'} Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42269482-fde5-4428-83f0-351a3b561a4c could not be found. Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42269482-fde5-4428-83f0-351a3b561a4c could not be found. Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:52:40.874914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:52:40.882003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:52:40.882003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:52:40.882003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:52:40.882003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:52:40.882003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:52:40.882003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42269482-fde5-4428-83f0-351a3b561a4c could not be found. Aug 27 04:52:40.882003 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:52:40.882003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6908512f-1684-43c3-8b74-592d68438c6f tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] Returning 404 to user: Instance 42269482-fde5-4428-83f0-351a3b561a4c could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:52:40.882003 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6908512f-1684-43c3-8b74-592d68438c6f tempest-VolumesBackupsTest-2086852988 tempest-VolumesBackupsTest-2086852988-project] 10.222.0.79 "GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c" status: 404 len: 111 microversion: 2.1 time: 0.082834 Aug 27 04:52:40.893725 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2147/4339] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:40 2022] GET /compute/v2.1/servers/42269482-fde5-4428-83f0-351a3b561a4c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:52:41.126549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9dfa7e99-131f-4538-8750-f9016cbc858b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:41.140869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9dfa7e99-131f-4538-8750-f9016cbc858b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:41.142357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9dfa7e99-131f-4538-8750-f9016cbc858b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:41.143756 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9dfa7e99-131f-4538-8750-f9016cbc858b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.615053 Aug 27 04:52:41.157866 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2193/4340] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:40 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:41.557068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb7897f3-feb2-498a-88d8-e99486723615 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:41.557734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eb7897f3-feb2-498a-88d8-e99486723615 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:41.570605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7897f3-feb2-498a-88d8-e99486723615 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:41.581124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7897f3-feb2-498a-88d8-e99486723615 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:41.582310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7897f3-feb2-498a-88d8-e99486723615 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:41.587049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7897f3-feb2-498a-88d8-e99486723615 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:41.596435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7897f3-feb2-498a-88d8-e99486723615 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:41.598265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7897f3-feb2-498a-88d8-e99486723615 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:42.168097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a36cf986-d467-4348-b084-e0c52c7750a0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:42.170100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a36cf986-d467-4348-b084-e0c52c7750a0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:42.180299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a36cf986-d467-4348-b084-e0c52c7750a0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:42.185264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a36cf986-d467-4348-b084-e0c52c7750a0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:42.185976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a36cf986-d467-4348-b084-e0c52c7750a0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:42.197281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a36cf986-d467-4348-b084-e0c52c7750a0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:42.198028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a36cf986-d467-4348-b084-e0c52c7750a0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:42.200249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a36cf986-d467-4348-b084-e0c52c7750a0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:42.208564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:42.686596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb7897f3-feb2-498a-88d8-e99486723615 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:42.706817 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb7897f3-feb2-498a-88d8-e99486723615 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 1.153923 Aug 27 04:52:42.707968 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2148/4341] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:41 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:43.524602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a36cf986-d467-4348-b084-e0c52c7750a0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:43.547902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a36cf986-d467-4348-b084-e0c52c7750a0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:43.550083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a36cf986-d467-4348-b084-e0c52c7750a0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:43.553100 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a36cf986-d467-4348-b084-e0c52c7750a0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 1.389432 Aug 27 04:52:43.559074 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2194/4342] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:42 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:43.729006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-da36a0b5-ec40-41b3-bd12-1a9bd192ff48 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:43.731029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-da36a0b5-ec40-41b3-bd12-1a9bd192ff48 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:43.768919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da36a0b5-ec40-41b3-bd12-1a9bd192ff48 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:43.769950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da36a0b5-ec40-41b3-bd12-1a9bd192ff48 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:43.770650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da36a0b5-ec40-41b3-bd12-1a9bd192ff48 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:43.771646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da36a0b5-ec40-41b3-bd12-1a9bd192ff48 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:43.774246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da36a0b5-ec40-41b3-bd12-1a9bd192ff48 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:43.774995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da36a0b5-ec40-41b3-bd12-1a9bd192ff48 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:44.384690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-da36a0b5-ec40-41b3-bd12-1a9bd192ff48 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:44.399688 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-da36a0b5-ec40-41b3-bd12-1a9bd192ff48 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 0.675193 Aug 27 04:52:44.402848 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2149/4343] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:43 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:44.592292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f938cd29-27fc-4e35-a8d8-678af64a348d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:44.592956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f938cd29-27fc-4e35-a8d8-678af64a348d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:44.617443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f938cd29-27fc-4e35-a8d8-678af64a348d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:44.618238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f938cd29-27fc-4e35-a8d8-678af64a348d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:44.619346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f938cd29-27fc-4e35-a8d8-678af64a348d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:44.620237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f938cd29-27fc-4e35-a8d8-678af64a348d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:44.620879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f938cd29-27fc-4e35-a8d8-678af64a348d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:44.621472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f938cd29-27fc-4e35-a8d8-678af64a348d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:45.024375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f938cd29-27fc-4e35-a8d8-678af64a348d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:45.045979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f938cd29-27fc-4e35-a8d8-678af64a348d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:45.047513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f938cd29-27fc-4e35-a8d8-678af64a348d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:45.048737 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f938cd29-27fc-4e35-a8d8-678af64a348d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.463023 Aug 27 04:52:45.049288 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2195/4344] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:44 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:45.427655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-18a4d677-2120-4ba8-b815-0fcebc552f93 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:45.428269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-18a4d677-2120-4ba8-b815-0fcebc552f93 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:45.443481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18a4d677-2120-4ba8-b815-0fcebc552f93 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.451862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18a4d677-2120-4ba8-b815-0fcebc552f93 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:45.454107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18a4d677-2120-4ba8-b815-0fcebc552f93 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:45.457880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18a4d677-2120-4ba8-b815-0fcebc552f93 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:45.458562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18a4d677-2120-4ba8-b815-0fcebc552f93 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:45.460320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18a4d677-2120-4ba8-b815-0fcebc552f93 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:46.075072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7730bb29-c7e9-4b92-be49-f98fe70e87df tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:46.075694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7730bb29-c7e9-4b92-be49-f98fe70e87df tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:46.092853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7730bb29-c7e9-4b92-be49-f98fe70e87df tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:46.093412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7730bb29-c7e9-4b92-be49-f98fe70e87df tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:46.093995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7730bb29-c7e9-4b92-be49-f98fe70e87df tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:46.095142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7730bb29-c7e9-4b92-be49-f98fe70e87df tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:46.097118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7730bb29-c7e9-4b92-be49-f98fe70e87df tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:46.098387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7730bb29-c7e9-4b92-be49-f98fe70e87df tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:46.467503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-18a4d677-2120-4ba8-b815-0fcebc552f93 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:46.476457 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-18a4d677-2120-4ba8-b815-0fcebc552f93 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 1.052840 Aug 27 04:52:46.480954 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2150/4345] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:45 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:46.648043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7730bb29-c7e9-4b92-be49-f98fe70e87df tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:46.674664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7730bb29-c7e9-4b92-be49-f98fe70e87df tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:46.677358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7730bb29-c7e9-4b92-be49-f98fe70e87df tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:46.684559 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7730bb29-c7e9-4b92-be49-f98fe70e87df tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.612302 Aug 27 04:52:46.692920 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2196/4346] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:46 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:47.503542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-07c7932b-d880-48d5-8bf1-ec423c272911 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:47.504118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-07c7932b-d880-48d5-8bf1-ec423c272911 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:47.516629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c7932b-d880-48d5-8bf1-ec423c272911 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:47.517134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c7932b-d880-48d5-8bf1-ec423c272911 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:47.517568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c7932b-d880-48d5-8bf1-ec423c272911 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:47.518289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c7932b-d880-48d5-8bf1-ec423c272911 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:47.518752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c7932b-d880-48d5-8bf1-ec423c272911 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:47.519178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c7932b-d880-48d5-8bf1-ec423c272911 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:47.712479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d6c9ae8-0cb7-4180-a206-55553194ec12 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:47.713825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3d6c9ae8-0cb7-4180-a206-55553194ec12 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:47.716823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=72 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:47.730740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d6c9ae8-0cb7-4180-a206-55553194ec12 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:47.731489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d6c9ae8-0cb7-4180-a206-55553194ec12 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:47.732107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d6c9ae8-0cb7-4180-a206-55553194ec12 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:47.733040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d6c9ae8-0cb7-4180-a206-55553194ec12 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:47.734003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d6c9ae8-0cb7-4180-a206-55553194ec12 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:47.734602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d6c9ae8-0cb7-4180-a206-55553194ec12 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:48.182122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d6c9ae8-0cb7-4180-a206-55553194ec12 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:48.197682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d6c9ae8-0cb7-4180-a206-55553194ec12 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:48.221311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d6c9ae8-0cb7-4180-a206-55553194ec12 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:48.224399 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d6c9ae8-0cb7-4180-a206-55553194ec12 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.515793 Aug 27 04:52:48.226495 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2197/4347] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:47 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:48.379020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-07c7932b-d880-48d5-8bf1-ec423c272911 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:48.392873 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-07c7932b-d880-48d5-8bf1-ec423c272911 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 0.893311 Aug 27 04:52:48.394099 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2151/4348] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:47 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:49.271704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a07bc99-378f-46da-a377-b1d4a3e22bfa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:49.277542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a07bc99-378f-46da-a377-b1d4a3e22bfa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:49.303620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a07bc99-378f-46da-a377-b1d4a3e22bfa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:49.305957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a07bc99-378f-46da-a377-b1d4a3e22bfa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:49.312140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a07bc99-378f-46da-a377-b1d4a3e22bfa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:49.315863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a07bc99-378f-46da-a377-b1d4a3e22bfa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:49.339437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a07bc99-378f-46da-a377-b1d4a3e22bfa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:49.347292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a07bc99-378f-46da-a377-b1d4a3e22bfa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:49.438061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-93d703e3-1d5f-4a1b-aa71-2dd6d4eaaaad tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:49.443372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-93d703e3-1d5f-4a1b-aa71-2dd6d4eaaaad tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:49.466930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93d703e3-1d5f-4a1b-aa71-2dd6d4eaaaad tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:49.467427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93d703e3-1d5f-4a1b-aa71-2dd6d4eaaaad tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:49.468437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93d703e3-1d5f-4a1b-aa71-2dd6d4eaaaad tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:49.468601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93d703e3-1d5f-4a1b-aa71-2dd6d4eaaaad tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:49.469068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93d703e3-1d5f-4a1b-aa71-2dd6d4eaaaad tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:49.469507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93d703e3-1d5f-4a1b-aa71-2dd6d4eaaaad tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:50.071419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-93d703e3-1d5f-4a1b-aa71-2dd6d4eaaaad tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:50.079936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a07bc99-378f-46da-a377-b1d4a3e22bfa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:50.087827 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-93d703e3-1d5f-4a1b-aa71-2dd6d4eaaaad tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 0.666178 Aug 27 04:52:50.093297 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2152/4349] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:49 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:50.141767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a07bc99-378f-46da-a377-b1d4a3e22bfa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:50.147549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a07bc99-378f-46da-a377-b1d4a3e22bfa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:50.163285 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a07bc99-378f-46da-a377-b1d4a3e22bfa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.898113 Aug 27 04:52:50.167232 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2198/4350] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:49 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:51.114438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-97c2ca3f-ef44-40e3-9e1c-48dd9ba0efcf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:51.115661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-97c2ca3f-ef44-40e3-9e1c-48dd9ba0efcf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:51.137666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97c2ca3f-ef44-40e3-9e1c-48dd9ba0efcf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:51.142950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97c2ca3f-ef44-40e3-9e1c-48dd9ba0efcf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:51.143834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97c2ca3f-ef44-40e3-9e1c-48dd9ba0efcf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:51.156280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97c2ca3f-ef44-40e3-9e1c-48dd9ba0efcf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:51.160446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97c2ca3f-ef44-40e3-9e1c-48dd9ba0efcf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:51.161749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97c2ca3f-ef44-40e3-9e1c-48dd9ba0efcf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:51.196280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6354574f-bf93-41d1-a9c1-bd2bf6ddc66b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:51.197535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6354574f-bf93-41d1-a9c1-bd2bf6ddc66b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:51.212393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6354574f-bf93-41d1-a9c1-bd2bf6ddc66b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:51.213134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6354574f-bf93-41d1-a9c1-bd2bf6ddc66b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:51.214302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6354574f-bf93-41d1-a9c1-bd2bf6ddc66b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:51.217362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6354574f-bf93-41d1-a9c1-bd2bf6ddc66b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:51.225432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6354574f-bf93-41d1-a9c1-bd2bf6ddc66b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:51.228728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6354574f-bf93-41d1-a9c1-bd2bf6ddc66b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:51.967333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6354574f-bf93-41d1-a9c1-bd2bf6ddc66b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:51.985303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6354574f-bf93-41d1-a9c1-bd2bf6ddc66b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:51.991887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6354574f-bf93-41d1-a9c1-bd2bf6ddc66b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:51.997733 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6354574f-bf93-41d1-a9c1-bd2bf6ddc66b tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.806275 Aug 27 04:52:52.008077 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2199/4351] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:51 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:52.864881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-97c2ca3f-ef44-40e3-9e1c-48dd9ba0efcf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:52.919074 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-97c2ca3f-ef44-40e3-9e1c-48dd9ba0efcf tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 1.803409 Aug 27 04:52:52.926449 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2153/4352] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:51 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:53.046020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9b38af6d-1d22-4af5-9de0-b9f5b9053e78 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:53.047186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9b38af6d-1d22-4af5-9de0-b9f5b9053e78 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:53.061738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b38af6d-1d22-4af5-9de0-b9f5b9053e78 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:53.062296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b38af6d-1d22-4af5-9de0-b9f5b9053e78 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:53.064768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b38af6d-1d22-4af5-9de0-b9f5b9053e78 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:53.066100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b38af6d-1d22-4af5-9de0-b9f5b9053e78 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:53.067581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b38af6d-1d22-4af5-9de0-b9f5b9053e78 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:53.068304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b38af6d-1d22-4af5-9de0-b9f5b9053e78 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:53.948486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5117c9fd-3560-4cfa-b92c-c68faf048669 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:53.949193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5117c9fd-3560-4cfa-b92c-c68faf048669 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:53.968554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:53.986399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5117c9fd-3560-4cfa-b92c-c68faf048669 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:53.987093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5117c9fd-3560-4cfa-b92c-c68faf048669 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:53.987559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5117c9fd-3560-4cfa-b92c-c68faf048669 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:53.988314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5117c9fd-3560-4cfa-b92c-c68faf048669 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:53.988816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5117c9fd-3560-4cfa-b92c-c68faf048669 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:53.989250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5117c9fd-3560-4cfa-b92c-c68faf048669 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:54.691052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5117c9fd-3560-4cfa-b92c-c68faf048669 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:54.709670 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5117c9fd-3560-4cfa-b92c-c68faf048669 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 0.761053 Aug 27 04:52:54.711843 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2154/4353] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:53 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:54.769163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b38af6d-1d22-4af5-9de0-b9f5b9053e78 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:54.789679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b38af6d-1d22-4af5-9de0-b9f5b9053e78 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:54.799976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b38af6d-1d22-4af5-9de0-b9f5b9053e78 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:54.818977 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9b38af6d-1d22-4af5-9de0-b9f5b9053e78 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 1.776480 Aug 27 04:52:54.824459 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2200/4354] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:53 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:55.747159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-54aeb870-f24d-4cdc-ae2e-e5aa7edd1fe5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:55.747773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-54aeb870-f24d-4cdc-ae2e-e5aa7edd1fe5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:55.767620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54aeb870-f24d-4cdc-ae2e-e5aa7edd1fe5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:55.769725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54aeb870-f24d-4cdc-ae2e-e5aa7edd1fe5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:55.776506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54aeb870-f24d-4cdc-ae2e-e5aa7edd1fe5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:55.777671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54aeb870-f24d-4cdc-ae2e-e5aa7edd1fe5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:55.778313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54aeb870-f24d-4cdc-ae2e-e5aa7edd1fe5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:55.780257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54aeb870-f24d-4cdc-ae2e-e5aa7edd1fe5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:55.859293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31bf9d4e-a030-4a32-9251-1f3b10c29b96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:55.860839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31bf9d4e-a030-4a32-9251-1f3b10c29b96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:55.880697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31bf9d4e-a030-4a32-9251-1f3b10c29b96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:55.887752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31bf9d4e-a030-4a32-9251-1f3b10c29b96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:55.889106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31bf9d4e-a030-4a32-9251-1f3b10c29b96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:55.893684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31bf9d4e-a030-4a32-9251-1f3b10c29b96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:55.899623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31bf9d4e-a030-4a32-9251-1f3b10c29b96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:55.902423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31bf9d4e-a030-4a32-9251-1f3b10c29b96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:56.409297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31bf9d4e-a030-4a32-9251-1f3b10c29b96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:56.419504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31bf9d4e-a030-4a32-9251-1f3b10c29b96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:56.435421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31bf9d4e-a030-4a32-9251-1f3b10c29b96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:56.436445 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31bf9d4e-a030-4a32-9251-1f3b10c29b96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.581238 Aug 27 04:52:56.445584 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2201/4355] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:55 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:52:56.766660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-54aeb870-f24d-4cdc-ae2e-e5aa7edd1fe5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:56.776783 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-54aeb870-f24d-4cdc-ae2e-e5aa7edd1fe5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 1.034742 Aug 27 04:52:56.777784 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2155/4356] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:55 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:57.470288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99f193d6-732c-456a-a1b5-e0256b74d069 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:57.471008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99f193d6-732c-456a-a1b5-e0256b74d069 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:57.481478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99f193d6-732c-456a-a1b5-e0256b74d069 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:57.482805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99f193d6-732c-456a-a1b5-e0256b74d069 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:57.487386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99f193d6-732c-456a-a1b5-e0256b74d069 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:57.489588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99f193d6-732c-456a-a1b5-e0256b74d069 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:57.492060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99f193d6-732c-456a-a1b5-e0256b74d069 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:57.493581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99f193d6-732c-456a-a1b5-e0256b74d069 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:57.798805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4d1e557f-ed2c-48b1-8532-bdf1b256a4c5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:57.800844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4d1e557f-ed2c-48b1-8532-bdf1b256a4c5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:57.810401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99f193d6-732c-456a-a1b5-e0256b74d069 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:57.835666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d1e557f-ed2c-48b1-8532-bdf1b256a4c5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:57.836146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99f193d6-732c-456a-a1b5-e0256b74d069 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:57.838595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99f193d6-732c-456a-a1b5-e0256b74d069 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:57.847331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d1e557f-ed2c-48b1-8532-bdf1b256a4c5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:57.848188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d1e557f-ed2c-48b1-8532-bdf1b256a4c5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:57.852361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d1e557f-ed2c-48b1-8532-bdf1b256a4c5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:57.853503 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99f193d6-732c-456a-a1b5-e0256b74d069 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.382608 Aug 27 04:52:57.854193 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2202/4357] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:57 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:52:57.867558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d1e557f-ed2c-48b1-8532-bdf1b256a4c5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:57.874540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d1e557f-ed2c-48b1-8532-bdf1b256a4c5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:58.142305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4d1e557f-ed2c-48b1-8532-bdf1b256a4c5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:58.158969 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4d1e557f-ed2c-48b1-8532-bdf1b256a4c5 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 0.365021 Aug 27 04:52:58.160801 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2156/4358] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:57 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:52:58.881696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c2702e3-597c-475b-8b71-0cacd63a4d64 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:58.882556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c2702e3-597c-475b-8b71-0cacd63a4d64 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:58.897177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c2702e3-597c-475b-8b71-0cacd63a4d64 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:58.898068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c2702e3-597c-475b-8b71-0cacd63a4d64 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:58.898685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c2702e3-597c-475b-8b71-0cacd63a4d64 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:58.899612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c2702e3-597c-475b-8b71-0cacd63a4d64 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:58.900226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c2702e3-597c-475b-8b71-0cacd63a4d64 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:58.902371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c2702e3-597c-475b-8b71-0cacd63a4d64 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:59.187496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c69eacc8-1d84-4a71-9d0d-7817060d6c26 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:52:59.188809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c69eacc8-1d84-4a71-9d0d-7817060d6c26 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:52:59.206540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c69eacc8-1d84-4a71-9d0d-7817060d6c26 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:59.209010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c69eacc8-1d84-4a71-9d0d-7817060d6c26 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:59.210593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c69eacc8-1d84-4a71-9d0d-7817060d6c26 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:59.212561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c69eacc8-1d84-4a71-9d0d-7817060d6c26 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:52:59.215689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c69eacc8-1d84-4a71-9d0d-7817060d6c26 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:52:59.217801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c69eacc8-1d84-4a71-9d0d-7817060d6c26 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:52:59.361798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c2702e3-597c-475b-8b71-0cacd63a4d64 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:59.399481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c2702e3-597c-475b-8b71-0cacd63a4d64 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:59.401055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c2702e3-597c-475b-8b71-0cacd63a4d64 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:52:59.406528 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c2702e3-597c-475b-8b71-0cacd63a4d64 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.528764 Aug 27 04:52:59.407138 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2203/4359] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:52:58 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:00.079510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c69eacc8-1d84-4a71-9d0d-7817060d6c26 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:00.101441 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c69eacc8-1d84-4a71-9d0d-7817060d6c26 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 0.916652 Aug 27 04:53:00.119938 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2157/4360] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:52:59 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:00.432703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-508b838a-a35f-4418-9553-1e6388771667 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:00.433440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-508b838a-a35f-4418-9553-1e6388771667 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:00.449577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-508b838a-a35f-4418-9553-1e6388771667 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:00.453780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-508b838a-a35f-4418-9553-1e6388771667 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:00.455241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-508b838a-a35f-4418-9553-1e6388771667 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:00.460102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-508b838a-a35f-4418-9553-1e6388771667 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:00.462056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-508b838a-a35f-4418-9553-1e6388771667 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:00.462523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-508b838a-a35f-4418-9553-1e6388771667 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:01.071712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-508b838a-a35f-4418-9553-1e6388771667 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:01.099909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-508b838a-a35f-4418-9553-1e6388771667 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:01.107654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-508b838a-a35f-4418-9553-1e6388771667 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:01.116885 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-508b838a-a35f-4418-9553-1e6388771667 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.682421 Aug 27 04:53:01.119685 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2204/4361] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:00 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:01.124241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3a872f9a-0841-449e-a9eb-cdaf3e3cb826 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:01.126014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3a872f9a-0841-449e-a9eb-cdaf3e3cb826 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:01.144483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a872f9a-0841-449e-a9eb-cdaf3e3cb826 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:01.146553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a872f9a-0841-449e-a9eb-cdaf3e3cb826 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:01.150819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a872f9a-0841-449e-a9eb-cdaf3e3cb826 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:01.152156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a872f9a-0841-449e-a9eb-cdaf3e3cb826 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:01.152965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a872f9a-0841-449e-a9eb-cdaf3e3cb826 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:01.154648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a872f9a-0841-449e-a9eb-cdaf3e3cb826 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:01.522860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3a872f9a-0841-449e-a9eb-cdaf3e3cb826 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:01.531898 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3a872f9a-0841-449e-a9eb-cdaf3e3cb826 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 0.412374 Aug 27 04:53:01.532490 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2158/4362] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:01 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:53:02.146173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50c7ea97-a8f5-482e-8055-5ecca3273014 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:02.146887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50c7ea97-a8f5-482e-8055-5ecca3273014 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:02.164623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50c7ea97-a8f5-482e-8055-5ecca3273014 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:02.171106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50c7ea97-a8f5-482e-8055-5ecca3273014 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:02.171905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50c7ea97-a8f5-482e-8055-5ecca3273014 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:02.172891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50c7ea97-a8f5-482e-8055-5ecca3273014 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:02.173526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50c7ea97-a8f5-482e-8055-5ecca3273014 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:02.174134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50c7ea97-a8f5-482e-8055-5ecca3273014 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:02.557921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf01d4cc-aa62-46b5-9b4d-71635d4a329d tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:02.559756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bf01d4cc-aa62-46b5-9b4d-71635d4a329d tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:02.572024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf01d4cc-aa62-46b5-9b4d-71635d4a329d tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:02.575335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf01d4cc-aa62-46b5-9b4d-71635d4a329d tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:02.578383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf01d4cc-aa62-46b5-9b4d-71635d4a329d tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:02.580730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf01d4cc-aa62-46b5-9b4d-71635d4a329d tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:02.581453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf01d4cc-aa62-46b5-9b4d-71635d4a329d tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:02.583335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf01d4cc-aa62-46b5-9b4d-71635d4a329d tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:02.725897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50c7ea97-a8f5-482e-8055-5ecca3273014 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:02.744353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50c7ea97-a8f5-482e-8055-5ecca3273014 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:02.746061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50c7ea97-a8f5-482e-8055-5ecca3273014 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:02.751084 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50c7ea97-a8f5-482e-8055-5ecca3273014 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.608368 Aug 27 04:53:02.754336 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2205/4363] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:02 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:03.783617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94bbac0b-6b5f-4e77-8cb0-55c663340bd4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:03.784412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94bbac0b-6b5f-4e77-8cb0-55c663340bd4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:03.795789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94bbac0b-6b5f-4e77-8cb0-55c663340bd4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:03.798029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94bbac0b-6b5f-4e77-8cb0-55c663340bd4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:03.799447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94bbac0b-6b5f-4e77-8cb0-55c663340bd4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:03.801508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94bbac0b-6b5f-4e77-8cb0-55c663340bd4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:03.804064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94bbac0b-6b5f-4e77-8cb0-55c663340bd4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:03.805474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94bbac0b-6b5f-4e77-8cb0-55c663340bd4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:04.129551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bf01d4cc-aa62-46b5-9b4d-71635d4a329d tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:04.152075 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bf01d4cc-aa62-46b5-9b4d-71635d4a329d tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 1.588438 Aug 27 04:53:04.152797 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2159/4364] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:02 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:05.111230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94bbac0b-6b5f-4e77-8cb0-55c663340bd4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:05.133589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94bbac0b-6b5f-4e77-8cb0-55c663340bd4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:05.136005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94bbac0b-6b5f-4e77-8cb0-55c663340bd4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:05.142267 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94bbac0b-6b5f-4e77-8cb0-55c663340bd4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 1.366308 Aug 27 04:53:05.145742 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2206/4365] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:03 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:05.176154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4ee279f7-7e03-4f33-a9d2-c42ad5175e6c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:05.177361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4ee279f7-7e03-4f33-a9d2-c42ad5175e6c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:05.190159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ee279f7-7e03-4f33-a9d2-c42ad5175e6c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:05.195289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ee279f7-7e03-4f33-a9d2-c42ad5175e6c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:05.196290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ee279f7-7e03-4f33-a9d2-c42ad5175e6c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:05.197272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ee279f7-7e03-4f33-a9d2-c42ad5175e6c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:05.200383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ee279f7-7e03-4f33-a9d2-c42ad5175e6c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:05.201105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ee279f7-7e03-4f33-a9d2-c42ad5175e6c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:05.971715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-efda4031-3e64-46a5-8ac5-e9007a0ef4a3 req-e6f04d11-ff8b-4fad-b404-896c4a0cd1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "name": "network-vif-plugged", "status": "completed", "tag": "5217d8e2-0080-4d4f-adc5-5605b9551bd4"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:05.991519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-efda4031-3e64-46a5-8ac5-e9007a0ef4a3 req-e6f04d11-ff8b-4fad-b404-896c4a0cd1d5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:05.995356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4ee279f7-7e03-4f33-a9d2-c42ad5175e6c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:06.006673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-efda4031-3e64-46a5-8ac5-e9007a0ef4a3 req-e6f04d11-ff8b-4fad-b404-896c4a0cd1d5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:06.010174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-efda4031-3e64-46a5-8ac5-e9007a0ef4a3 req-e6f04d11-ff8b-4fad-b404-896c4a0cd1d5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:06.013957 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4ee279f7-7e03-4f33-a9d2-c42ad5175e6c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 0.839802 Aug 27 04:53:06.029043 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2160/4366] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:05 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:06.075825 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-efda4031-3e64-46a5-8ac5-e9007a0ef4a3 req-e6f04d11-ff8b-4fad-b404-896c4a0cd1d5 service nova] Creating event network-vif-plugged:5217d8e2-0080-4d4f-adc5-5605b9551bd4 for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:53:06.098842 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-efda4031-3e64-46a5-8ac5-e9007a0ef4a3 req-e6f04d11-ff8b-4fad-b404-896c4a0cd1d5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131171 Aug 27 04:53:06.106942 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2207/4367] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:06.171325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2c882e3a-bcd5-4a4c-b850-2a43a44aeb04 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:06.172007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2c882e3a-bcd5-4a4c-b850-2a43a44aeb04 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:06.184957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c882e3a-bcd5-4a4c-b850-2a43a44aeb04 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:06.188498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c882e3a-bcd5-4a4c-b850-2a43a44aeb04 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:06.188860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c882e3a-bcd5-4a4c-b850-2a43a44aeb04 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:06.189613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c882e3a-bcd5-4a4c-b850-2a43a44aeb04 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:06.190154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c882e3a-bcd5-4a4c-b850-2a43a44aeb04 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:06.190525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c882e3a-bcd5-4a4c-b850-2a43a44aeb04 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:06.672446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2c882e3a-bcd5-4a4c-b850-2a43a44aeb04 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:06.683272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2c882e3a-bcd5-4a4c-b850-2a43a44aeb04 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:06.688961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2c882e3a-bcd5-4a4c-b850-2a43a44aeb04 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:06.690582 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2c882e3a-bcd5-4a4c-b850-2a43a44aeb04 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.523259 Aug 27 04:53:06.691812 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2161/4368] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:06 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:07.036248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e40b8d9-cf68-4f56-bec9-bcdc62f71a7f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:07.038264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e40b8d9-cf68-4f56-bec9-bcdc62f71a7f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:07.049758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e40b8d9-cf68-4f56-bec9-bcdc62f71a7f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:07.055170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e40b8d9-cf68-4f56-bec9-bcdc62f71a7f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:07.055738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e40b8d9-cf68-4f56-bec9-bcdc62f71a7f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:07.056965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e40b8d9-cf68-4f56-bec9-bcdc62f71a7f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:07.058802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e40b8d9-cf68-4f56-bec9-bcdc62f71a7f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:07.060084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e40b8d9-cf68-4f56-bec9-bcdc62f71a7f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:07.401646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2e40b8d9-cf68-4f56-bec9-bcdc62f71a7f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:07.413321 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e40b8d9-cf68-4f56-bec9-bcdc62f71a7f tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 0.380331 Aug 27 04:53:07.429495 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2208/4369] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:07 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:07.718507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8ccfdae3-29a7-403a-ad55-f940cf8a7a07 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:07.720630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8ccfdae3-29a7-403a-ad55-f940cf8a7a07 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:07.730311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ccfdae3-29a7-403a-ad55-f940cf8a7a07 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:07.731415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ccfdae3-29a7-403a-ad55-f940cf8a7a07 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:07.732078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ccfdae3-29a7-403a-ad55-f940cf8a7a07 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:07.745587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ccfdae3-29a7-403a-ad55-f940cf8a7a07 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:07.746490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ccfdae3-29a7-403a-ad55-f940cf8a7a07 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:07.747443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ccfdae3-29a7-403a-ad55-f940cf8a7a07 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.138445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ccfdae3-29a7-403a-ad55-f940cf8a7a07 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:08.171733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ccfdae3-29a7-403a-ad55-f940cf8a7a07 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:08.177417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ccfdae3-29a7-403a-ad55-f940cf8a7a07 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:08.182754 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8ccfdae3-29a7-403a-ad55-f940cf8a7a07 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.469631 Aug 27 04:53:08.183993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d07a5ca3-d8e2-4ca0-9882-9b60a493fa6d req-94f1be94-0338-4124-9dfa-3af83cb23237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "name": "network-vif-plugged", "status": "completed", "tag": "0da450d6-15cd-4605-89dd-19e1ab8d2cf8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:08.199728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d07a5ca3-d8e2-4ca0-9882-9b60a493fa6d req-94f1be94-0338-4124-9dfa-3af83cb23237 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.200222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d07a5ca3-d8e2-4ca0-9882-9b60a493fa6d req-94f1be94-0338-4124-9dfa-3af83cb23237 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.200688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d07a5ca3-d8e2-4ca0-9882-9b60a493fa6d req-94f1be94-0338-4124-9dfa-3af83cb23237 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.208026 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2162/4370] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:07 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:08.230399 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d07a5ca3-d8e2-4ca0-9882-9b60a493fa6d req-94f1be94-0338-4124-9dfa-3af83cb23237 service nova] Creating event network-vif-plugged:0da450d6-15cd-4605-89dd-19e1ab8d2cf8 for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:53:08.248989 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d07a5ca3-d8e2-4ca0-9882-9b60a493fa6d req-94f1be94-0338-4124-9dfa-3af83cb23237 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067991 Aug 27 04:53:08.254435 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2209/4371] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:08.442466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2dddc4e0-4e71-40e0-9431-d6e10c4e7fdb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:08.443202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2dddc4e0-4e71-40e0-9431-d6e10c4e7fdb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:08.467309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2dddc4e0-4e71-40e0-9431-d6e10c4e7fdb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.468171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2dddc4e0-4e71-40e0-9431-d6e10c4e7fdb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.471067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2dddc4e0-4e71-40e0-9431-d6e10c4e7fdb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.489299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2dddc4e0-4e71-40e0-9431-d6e10c4e7fdb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:08.489915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2dddc4e0-4e71-40e0-9431-d6e10c4e7fdb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:08.490395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2dddc4e0-4e71-40e0-9431-d6e10c4e7fdb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:08.887472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2dddc4e0-4e71-40e0-9431-d6e10c4e7fdb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:08.901763 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2dddc4e0-4e71-40e0-9431-d6e10c4e7fdb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 0.464613 Aug 27 04:53:08.906353 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2163/4372] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:08 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:53:09.154553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-02fd1948-1d8b-4f12-bb8f-4cb326b74c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088-project-admin] Calling method '.version_select at 0x7f1f2199ca60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:09.156675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd1948-1d8b-4f12-bb8f-4cb326b74c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.158121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd1948-1d8b-4f12-bb8f-4cb326b74c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.158580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd1948-1d8b-4f12-bb8f-4cb326b74c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.212077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6129a4f1-868f-4ac7-9d7e-1c527e229638 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:09.212740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6129a4f1-868f-4ac7-9d7e-1c527e229638 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:09.218371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd1948-1d8b-4f12-bb8f-4cb326b74c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.224416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6129a4f1-868f-4ac7-9d7e-1c527e229638 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.225916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd1948-1d8b-4f12-bb8f-4cb326b74c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.226848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd1948-1d8b-4f12-bb8f-4cb326b74c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.229209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6129a4f1-868f-4ac7-9d7e-1c527e229638 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.231029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6129a4f1-868f-4ac7-9d7e-1c527e229638 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.244489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6129a4f1-868f-4ac7-9d7e-1c527e229638 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.245276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6129a4f1-868f-4ac7-9d7e-1c527e229638 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.245863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6129a4f1-868f-4ac7-9d7e-1c527e229638 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.250595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd1948-1d8b-4f12-bb8f-4cb326b74c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.251505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd1948-1d8b-4f12-bb8f-4cb326b74c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.261416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:09.267407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd1948-1d8b-4f12-bb8f-4cb326b74c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.277384 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-02fd1948-1d8b-4f12-bb8f-4cb326b74c18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1244120088-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.553654 Aug 27 04:53:09.280759 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2210/4373] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:53:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:09.934969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90d2db32-15fb-47af-b3a7-1ad555439c7c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:09.937007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90d2db32-15fb-47af-b3a7-1ad555439c7c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:09.951724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90d2db32-15fb-47af-b3a7-1ad555439c7c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.953628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90d2db32-15fb-47af-b3a7-1ad555439c7c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.954910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90d2db32-15fb-47af-b3a7-1ad555439c7c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:09.956629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90d2db32-15fb-47af-b3a7-1ad555439c7c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:09.957399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90d2db32-15fb-47af-b3a7-1ad555439c7c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:09.958104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90d2db32-15fb-47af-b3a7-1ad555439c7c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:10.001645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6129a4f1-868f-4ac7-9d7e-1c527e229638 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:10.012116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6129a4f1-868f-4ac7-9d7e-1c527e229638 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:10.026551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6129a4f1-868f-4ac7-9d7e-1c527e229638 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:10.027723 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6129a4f1-868f-4ac7-9d7e-1c527e229638 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.819986 Aug 27 04:53:10.039908 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2164/4374] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:09 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:10.325835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-5597928a-4cef-4a29-b097-c9c6db74a484 req-fd6f8ff7-c854-4158-b68a-6a8144aeb4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "name": "network-vif-plugged", "status": "completed", "tag": "be33a009-98cd-48e8-9d40-6cb18faec1d1"}, {"server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "name": "network-vif-plugged", "status": "completed", "tag": "eac13bb8-53a4-4fc4-b9eb-498a1de166dc"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:10.358656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5597928a-4cef-4a29-b097-c9c6db74a484 req-fd6f8ff7-c854-4158-b68a-6a8144aeb4fc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:10.359192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5597928a-4cef-4a29-b097-c9c6db74a484 req-fd6f8ff7-c854-4158-b68a-6a8144aeb4fc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:10.369296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5597928a-4cef-4a29-b097-c9c6db74a484 req-fd6f8ff7-c854-4158-b68a-6a8144aeb4fc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:10.395215 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-5597928a-4cef-4a29-b097-c9c6db74a484 req-fd6f8ff7-c854-4158-b68a-6a8144aeb4fc service nova] Creating event network-vif-plugged:be33a009-98cd-48e8-9d40-6cb18faec1d1 for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:53:10.395733 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-5597928a-4cef-4a29-b097-c9c6db74a484 req-fd6f8ff7-c854-4158-b68a-6a8144aeb4fc service nova] Creating event network-vif-plugged:eac13bb8-53a4-4fc4-b9eb-498a1de166dc for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:53:10.431963 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-5597928a-4cef-4a29-b097-c9c6db74a484 req-fd6f8ff7-c854-4158-b68a-6a8144aeb4fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110611 Aug 27 04:53:10.433099 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2165/4375] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:10.939898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-90d2db32-15fb-47af-b3a7-1ad555439c7c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:10.957309 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90d2db32-15fb-47af-b3a7-1ad555439c7c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1524 microversion: 2.1 time: 1.034466 Aug 27 04:53:10.958444 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2211/4376] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:09 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1524 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:11.072402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-16a7bc4b-11fb-4975-a729-47248a8799e3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:11.074881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-16a7bc4b-11fb-4975-a729-47248a8799e3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:11.098074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16a7bc4b-11fb-4975-a729-47248a8799e3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:11.100940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16a7bc4b-11fb-4975-a729-47248a8799e3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:11.120284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16a7bc4b-11fb-4975-a729-47248a8799e3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:11.121867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16a7bc4b-11fb-4975-a729-47248a8799e3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:11.122356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16a7bc4b-11fb-4975-a729-47248a8799e3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:11.130203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16a7bc4b-11fb-4975-a729-47248a8799e3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:11.982574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47e67f75-b03e-4af9-9304-c3af5f8c3260 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:11.983739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47e67f75-b03e-4af9-9304-c3af5f8c3260 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:12.004826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e67f75-b03e-4af9-9304-c3af5f8c3260 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:12.005331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e67f75-b03e-4af9-9304-c3af5f8c3260 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:12.005830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e67f75-b03e-4af9-9304-c3af5f8c3260 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:12.006555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e67f75-b03e-4af9-9304-c3af5f8c3260 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:12.007017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e67f75-b03e-4af9-9304-c3af5f8c3260 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:12.007441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e67f75-b03e-4af9-9304-c3af5f8c3260 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:12.039699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:12.307709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-16a7bc4b-11fb-4975-a729-47248a8799e3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:12.323122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-16a7bc4b-11fb-4975-a729-47248a8799e3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:12.346047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-16a7bc4b-11fb-4975-a729-47248a8799e3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:12.352100 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-16a7bc4b-11fb-4975-a729-47248a8799e3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 1.290452 Aug 27 04:53:12.360481 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2166/4377] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:11 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:12.520553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-af6542fa-7356-4ea0-8e80-73f840e21734 req-765b5c5e-c0b4-4048-b1b3-c05b5958aa22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "name": "network-vif-plugged", "status": "completed", "tag": "a874eeb0-33af-4e93-929c-569c031939d0"}, {"server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "name": "network-vif-plugged", "status": "completed", "tag": "17bdccd1-ac80-487e-affd-5d9c98c1239a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:12.568943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-af6542fa-7356-4ea0-8e80-73f840e21734 req-765b5c5e-c0b4-4048-b1b3-c05b5958aa22 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:12.569816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-af6542fa-7356-4ea0-8e80-73f840e21734 req-765b5c5e-c0b4-4048-b1b3-c05b5958aa22 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:12.572829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-af6542fa-7356-4ea0-8e80-73f840e21734 req-765b5c5e-c0b4-4048-b1b3-c05b5958aa22 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:12.606907 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-af6542fa-7356-4ea0-8e80-73f840e21734 req-765b5c5e-c0b4-4048-b1b3-c05b5958aa22 service nova] Creating event network-vif-plugged:a874eeb0-33af-4e93-929c-569c031939d0 for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:53:12.612979 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-af6542fa-7356-4ea0-8e80-73f840e21734 req-765b5c5e-c0b4-4048-b1b3-c05b5958aa22 service nova] Creating event network-vif-plugged:17bdccd1-ac80-487e-affd-5d9c98c1239a for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:53:12.625088 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-af6542fa-7356-4ea0-8e80-73f840e21734 req-765b5c5e-c0b4-4048-b1b3-c05b5958aa22 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.108076 Aug 27 04:53:12.627252 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2167/4378] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:12.655001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47e67f75-b03e-4af9-9304-c3af5f8c3260 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:12.667330 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47e67f75-b03e-4af9-9304-c3af5f8c3260 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1504 microversion: 2.1 time: 0.690573 Aug 27 04:53:12.683136 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2212/4379] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:11 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1504 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:53:12.695896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fad4ece4-6490-42fd-9f2b-13dcbbfeef21 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Action: 'create', calling method: .version_select at 0x7f1f21f7c1f0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-701008994", "description": "tempest-description-544093501"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:13.385077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fee31b78-cd24-41dc-b97c-e86d0a2cc0c8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:13.385839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fee31b78-cd24-41dc-b97c-e86d0a2cc0c8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:13.406131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee31b78-cd24-41dc-b97c-e86d0a2cc0c8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:13.412681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee31b78-cd24-41dc-b97c-e86d0a2cc0c8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:13.422066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee31b78-cd24-41dc-b97c-e86d0a2cc0c8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:13.424202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee31b78-cd24-41dc-b97c-e86d0a2cc0c8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:13.428081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee31b78-cd24-41dc-b97c-e86d0a2cc0c8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:13.438213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee31b78-cd24-41dc-b97c-e86d0a2cc0c8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:14.125877 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fad4ece4-6490-42fd-9f2b-13dcbbfeef21 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 1.436237 Aug 27 04:53:14.127088 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2168/4380] 10.222.0.79 () {60 vars in 1180 bytes} [Sat Aug 27 04:53:12 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:14.143427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d843b0f8-a49a-4de0-a500-21a4ff4be6cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-701008994"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:14.152096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d843b0f8-a49a-4de0-a500-21a4ff4be6cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:14.171595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d843b0f8-a49a-4de0-a500-21a4ff4be6cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:14.174186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d843b0f8-a49a-4de0-a500-21a4ff4be6cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:14.176455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d843b0f8-a49a-4de0-a500-21a4ff4be6cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:14.182421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d843b0f8-a49a-4de0-a500-21a4ff4be6cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:14.185336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d843b0f8-a49a-4de0-a500-21a4ff4be6cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:14.187407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d843b0f8-a49a-4de0-a500-21a4ff4be6cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:15.128893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fee31b78-cd24-41dc-b97c-e86d0a2cc0c8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:15.163048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fee31b78-cd24-41dc-b97c-e86d0a2cc0c8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:15.167039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fee31b78-cd24-41dc-b97c-e86d0a2cc0c8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:15.169894 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fee31b78-cd24-41dc-b97c-e86d0a2cc0c8 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 1.790558 Aug 27 04:53:15.174454 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2213/4381] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:13 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:15.181144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d2924a5c-1f27-4e1e-92cf-b98c84360876 req-48a0f0fe-f272-4865-bc15-25ad23dddb9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "name": "network-vif-plugged", "status": "completed", "tag": "08ec2a03-4224-4482-9e2b-0c33bc4adbca"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:15.216557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d2924a5c-1f27-4e1e-92cf-b98c84360876 req-48a0f0fe-f272-4865-bc15-25ad23dddb9f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:15.216988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d2924a5c-1f27-4e1e-92cf-b98c84360876 req-48a0f0fe-f272-4865-bc15-25ad23dddb9f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:15.217619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d2924a5c-1f27-4e1e-92cf-b98c84360876 req-48a0f0fe-f272-4865-bc15-25ad23dddb9f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:15.250025 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d2924a5c-1f27-4e1e-92cf-b98c84360876 req-48a0f0fe-f272-4865-bc15-25ad23dddb9f service nova] Creating event network-vif-plugged:08ec2a03-4224-4482-9e2b-0c33bc4adbca for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:53:15.263740 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d2924a5c-1f27-4e1e-92cf-b98c84360876 req-48a0f0fe-f272-4865-bc15-25ad23dddb9f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087821 Aug 27 04:53:15.290303 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2214/4382] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:15.497487 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.network.security_group_api [None req-d843b0f8-a49a-4de0-a500-21a4ff4be6cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Adding security group df9bf09a-32a9-41e4-8efc-aef30cb97350 to port b1acbc40-1d0a-4606-9b83-abe3d978775d Aug 27 04:53:16.199918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d204da62-2fb1-4c65-aa7a-e72e296f8ef6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:16.201281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d204da62-2fb1-4c65-aa7a-e72e296f8ef6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:16.229404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d204da62-2fb1-4c65-aa7a-e72e296f8ef6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:16.230627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d204da62-2fb1-4c65-aa7a-e72e296f8ef6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:16.232309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d204da62-2fb1-4c65-aa7a-e72e296f8ef6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:16.236100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d204da62-2fb1-4c65-aa7a-e72e296f8ef6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:16.239167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d204da62-2fb1-4c65-aa7a-e72e296f8ef6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:16.240199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d204da62-2fb1-4c65-aa7a-e72e296f8ef6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:16.544814 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d843b0f8-a49a-4de0-a500-21a4ff4be6cb tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "POST /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7/action" status: 202 len: 0 microversion: 2.1 time: 2.405740 Aug 27 04:53:16.549401 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2169/4383] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:53:14 2022] POST /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7/action => generated 0 bytes in 2411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:53:16.555886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99ac2652-71be-4076-b17f-55dade1b9211 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-701008994"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:16.556737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-99ac2652-71be-4076-b17f-55dade1b9211 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:16.566161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99ac2652-71be-4076-b17f-55dade1b9211 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:16.567417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99ac2652-71be-4076-b17f-55dade1b9211 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:16.569035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99ac2652-71be-4076-b17f-55dade1b9211 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:16.570587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99ac2652-71be-4076-b17f-55dade1b9211 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:16.571504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99ac2652-71be-4076-b17f-55dade1b9211 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:16.575381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99ac2652-71be-4076-b17f-55dade1b9211 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:16.713070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d204da62-2fb1-4c65-aa7a-e72e296f8ef6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:16.726087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d204da62-2fb1-4c65-aa7a-e72e296f8ef6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:16.727743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d204da62-2fb1-4c65-aa7a-e72e296f8ef6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:16.729664 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d204da62-2fb1-4c65-aa7a-e72e296f8ef6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1880 microversion: 2.32 time: 0.534727 Aug 27 04:53:16.745910 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2215/4384] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:16 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1880 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:53:16.762196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3fae33a3-c2d9-4b33-8f94-5ded29fc2add req-8ad2a9bc-4af1-4a41-8ce6-78da67991638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa76344-e5ad-4214-93b2-47a019d27cd7", "tag": "b1acbc40-1d0a-4606-9b83-abe3d978775d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:16.792958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3fae33a3-c2d9-4b33-8f94-5ded29fc2add req-8ad2a9bc-4af1-4a41-8ce6-78da67991638 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:16.795221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3fae33a3-c2d9-4b33-8f94-5ded29fc2add req-8ad2a9bc-4af1-4a41-8ce6-78da67991638 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:16.796375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3fae33a3-c2d9-4b33-8f94-5ded29fc2add req-8ad2a9bc-4af1-4a41-8ce6-78da67991638 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:16.825473 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3fae33a3-c2d9-4b33-8f94-5ded29fc2add req-8ad2a9bc-4af1-4a41-8ce6-78da67991638 service nova] Creating event network-changed:b1acbc40-1d0a-4606-9b83-abe3d978775d for instance 4fa76344-e5ad-4214-93b2-47a019d27cd7 on n-h2-854823-1 Aug 27 04:53:16.833049 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3fae33a3-c2d9-4b33-8f94-5ded29fc2add req-8ad2a9bc-4af1-4a41-8ce6-78da67991638 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085418 Aug 27 04:53:16.834574 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2216/4385] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:17.720625 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.network.security_group_api [None req-99ac2652-71be-4076-b17f-55dade1b9211 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Removing security group df9bf09a-32a9-41e4-8efc-aef30cb97350 from port b1acbc40-1d0a-4606-9b83-abe3d978775d Aug 27 04:53:17.777426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc3465f1-f270-4540-b589-949a4257be95 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:17.778744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bc3465f1-f270-4540-b589-949a4257be95 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:17.793030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=42 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:17.797162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3465f1-f270-4540-b589-949a4257be95 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:17.797870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3465f1-f270-4540-b589-949a4257be95 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:17.798942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3465f1-f270-4540-b589-949a4257be95 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:17.801800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3465f1-f270-4540-b589-949a4257be95 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:17.803596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3465f1-f270-4540-b589-949a4257be95 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:17.804216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3465f1-f270-4540-b589-949a4257be95 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:18.654474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bc3465f1-f270-4540-b589-949a4257be95 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:18.698710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bc3465f1-f270-4540-b589-949a4257be95 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:18.700167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bc3465f1-f270-4540-b589-949a4257be95 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:18.701542 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc3465f1-f270-4540-b589-949a4257be95 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 2831 microversion: 2.32 time: 0.947029 Aug 27 04:53:18.702225 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2217/4386] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:53:17 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 2831 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:53:18.728271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97e282f4-8e2e-431b-a3e2-1003343eaed6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:18.729060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97e282f4-8e2e-431b-a3e2-1003343eaed6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:18.735733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e282f4-8e2e-431b-a3e2-1003343eaed6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:18.736593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e282f4-8e2e-431b-a3e2-1003343eaed6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:18.737265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e282f4-8e2e-431b-a3e2-1003343eaed6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:18.738200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e282f4-8e2e-431b-a3e2-1003343eaed6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:18.738861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e282f4-8e2e-431b-a3e2-1003343eaed6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:18.739474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97e282f4-8e2e-431b-a3e2-1003343eaed6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:18.998228 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97e282f4-8e2e-431b-a3e2-1003343eaed6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.273313 Aug 27 04:53:18.998904 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2218/4387] 10.222.0.79 () {60 vars in 1316 bytes} [Sat Aug 27 04:53:18 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999/os-interface => generated 1829 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:53:19.409223 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-99ac2652-71be-4076-b17f-55dade1b9211 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "POST /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7/action" status: 202 len: 0 microversion: 2.1 time: 2.858288 Aug 27 04:53:19.409829 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2170/4388] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:53:16 2022] POST /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7/action => generated 0 bytes in 2860 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:53:19.426506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01a949da-b0cf-441c-bfcc-714a2aabb71d tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Action: 'create', calling method: .version_select at 0x7f1f21977f70>, body: {"pool": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:19.483766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-50784ea7-05b6-47f7-85ce-ea1c98737019 req-e83b9ce4-9d44-4329-af39-6809dc73b202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa76344-e5ad-4214-93b2-47a019d27cd7", "tag": "b1acbc40-1d0a-4606-9b83-abe3d978775d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:19.503601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-50784ea7-05b6-47f7-85ce-ea1c98737019 req-e83b9ce4-9d44-4329-af39-6809dc73b202 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:19.513294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-50784ea7-05b6-47f7-85ce-ea1c98737019 req-e83b9ce4-9d44-4329-af39-6809dc73b202 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:19.514151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-50784ea7-05b6-47f7-85ce-ea1c98737019 req-e83b9ce4-9d44-4329-af39-6809dc73b202 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:19.539496 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-50784ea7-05b6-47f7-85ce-ea1c98737019 req-e83b9ce4-9d44-4329-af39-6809dc73b202 service nova] Creating event network-changed:b1acbc40-1d0a-4606-9b83-abe3d978775d for instance 4fa76344-e5ad-4214-93b2-47a019d27cd7 on n-h2-854823-1 Aug 27 04:53:19.550150 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-50784ea7-05b6-47f7-85ce-ea1c98737019 req-e83b9ce4-9d44-4329-af39-6809dc73b202 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070369 Aug 27 04:53:19.557045 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2171/4389] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:23.604836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e8c70c95-2a6b-41c4-9735-6b89691020c5 req-de03498a-f990-4f08-bfc2-182e6ffda89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "tag": "0da450d6-15cd-4605-89dd-19e1ab8d2cf8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:23.620274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e8c70c95-2a6b-41c4-9735-6b89691020c5 req-de03498a-f990-4f08-bfc2-182e6ffda89d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:23.620808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e8c70c95-2a6b-41c4-9735-6b89691020c5 req-de03498a-f990-4f08-bfc2-182e6ffda89d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:23.621266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e8c70c95-2a6b-41c4-9735-6b89691020c5 req-de03498a-f990-4f08-bfc2-182e6ffda89d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:23.643118 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e8c70c95-2a6b-41c4-9735-6b89691020c5 req-de03498a-f990-4f08-bfc2-182e6ffda89d service nova] Creating event network-changed:0da450d6-15cd-4605-89dd-19e1ab8d2cf8 for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:53:23.648454 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e8c70c95-2a6b-41c4-9735-6b89691020c5 req-de03498a-f990-4f08-bfc2-182e6ffda89d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049455 Aug 27 04:53:23.649629 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2172/4390] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:24.293014 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01a949da-b0cf-441c-bfcc-714a2aabb71d tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.870979 Aug 27 04:53:24.293606 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2219/4391] 10.222.0.79 () {60 vars in 1170 bytes} [Sat Aug 27 04:53:19 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:24.307584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d23322ad-8fca-4c15-94fa-2d935056e319 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.72"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:24.310207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d23322ad-8fca-4c15-94fa-2d935056e319 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:24.312216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=36 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:24.326505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d23322ad-8fca-4c15-94fa-2d935056e319 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:24.327080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d23322ad-8fca-4c15-94fa-2d935056e319 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:24.328337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d23322ad-8fca-4c15-94fa-2d935056e319 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:24.332979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d23322ad-8fca-4c15-94fa-2d935056e319 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:24.333531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d23322ad-8fca-4c15-94fa-2d935056e319 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:24.333990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d23322ad-8fca-4c15-94fa-2d935056e319 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:24.390744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d23322ad-8fca-4c15-94fa-2d935056e319 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "refresh_cache-4fa76344-e5ad-4214-93b2-47a019d27cd7" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:53:24.394301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d23322ad-8fca-4c15-94fa-2d935056e319 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquired lock "refresh_cache-4fa76344-e5ad-4214-93b2-47a019d27cd7" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:53:28.646769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-d23322ad-8fca-4c15-94fa-2d935056e319 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Building network info cache for instance {{(pid=128870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:53:28.696960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a0785fbc-7124-437f-9d5f-80982a6904b4 req-18622f25-8ee2-45e8-aeac-0c04ed80334c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa76344-e5ad-4214-93b2-47a019d27cd7", "tag": "b1acbc40-1d0a-4606-9b83-abe3d978775d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:28.726133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a0785fbc-7124-437f-9d5f-80982a6904b4 req-18622f25-8ee2-45e8-aeac-0c04ed80334c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:28.727102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a0785fbc-7124-437f-9d5f-80982a6904b4 req-18622f25-8ee2-45e8-aeac-0c04ed80334c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:28.727771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a0785fbc-7124-437f-9d5f-80982a6904b4 req-18622f25-8ee2-45e8-aeac-0c04ed80334c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:28.794250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=31 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:28.830176 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a0785fbc-7124-437f-9d5f-80982a6904b4 req-18622f25-8ee2-45e8-aeac-0c04ed80334c service nova] Creating event network-changed:b1acbc40-1d0a-4606-9b83-abe3d978775d for instance 4fa76344-e5ad-4214-93b2-47a019d27cd7 on n-h2-854823-1 Aug 27 04:53:28.837710 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a0785fbc-7124-437f-9d5f-80982a6904b4 req-18622f25-8ee2-45e8-aeac-0c04ed80334c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149971 Aug 27 04:53:28.839224 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2220/4392] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 04:53:30.808731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-d23322ad-8fca-4c15-94fa-2d935056e319 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Updating instance_info_cache with network_info: [{"id": "b1acbc40-1d0a-4606-9b83-abe3d978775d", "address": "fa:16:3e:33:f3:84", "network": {"id": "6f291964-1331-4043-a3c9-e171dbfc9b5a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1173560479-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e27a367de7f44a74a18de15d1919fd3e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb1acbc40-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:53:30.820156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d23322ad-8fca-4c15-94fa-2d935056e319 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Releasing lock "refresh_cache-4fa76344-e5ad-4214-93b2-47a019d27cd7" {{(pid=128870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:53:30.825362 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d23322ad-8fca-4c15-94fa-2d935056e319 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "POST /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7/action" status: 202 len: 0 microversion: 2.1 time: 6.519816 Aug 27 04:53:30.838834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1cdb00f-6a35-4267-9458-d727b3fd56c7 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Action: 'action', calling method: .version_select at 0x7f1f240c53a0>, body: {"removeFloatingIp": {"address": "172.25.3.72"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:30.842950 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2173/4393] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:53:24 2022] POST /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7/action => generated 0 bytes in 6541 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 04:53:31.287149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1cdb00f-6a35-4267-9458-d727b3fd56c7 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:31.313902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1cdb00f-6a35-4267-9458-d727b3fd56c7 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:31.319443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1cdb00f-6a35-4267-9458-d727b3fd56c7 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:31.319903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1cdb00f-6a35-4267-9458-d727b3fd56c7 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:31.320686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1cdb00f-6a35-4267-9458-d727b3fd56c7 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:31.321194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1cdb00f-6a35-4267-9458-d727b3fd56c7 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:31.329180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1cdb00f-6a35-4267-9458-d727b3fd56c7 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:32.126308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5c32b251-4975-48d5-af62-0b72cea0d7e5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:32.126832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5c32b251-4975-48d5-af62-0b72cea0d7e5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:32.136869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c32b251-4975-48d5-af62-0b72cea0d7e5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:32.137726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c32b251-4975-48d5-af62-0b72cea0d7e5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:32.138379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c32b251-4975-48d5-af62-0b72cea0d7e5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:32.139286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c32b251-4975-48d5-af62-0b72cea0d7e5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:32.140042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c32b251-4975-48d5-af62-0b72cea0d7e5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:32.140791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c32b251-4975-48d5-af62-0b72cea0d7e5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:32.269825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-5c32b251-4975-48d5-af62-0b72cea0d7e5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lazy-loading 'services' on Instance uuid 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:32.393907 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5c32b251-4975-48d5-af62-0b72cea0d7e5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments/e854b487-e034-49a4-a5a1-30cbda3ec6d5" status: 202 len: 0 microversion: 2.1 time: 0.271909 Aug 27 04:53:32.396409 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2174/4394] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 04:53:32 2022] DELETE /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments/e854b487-e034-49a4-a5a1-30cbda3ec6d5 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:53:32.405421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-babac572-b510-4d38-8519-99662bb34c95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:32.408598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-babac572-b510-4d38-8519-99662bb34c95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:32.426540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-babac572-b510-4d38-8519-99662bb34c95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:32.428802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-babac572-b510-4d38-8519-99662bb34c95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:32.432011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-babac572-b510-4d38-8519-99662bb34c95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:32.437351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-babac572-b510-4d38-8519-99662bb34c95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:32.438925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-babac572-b510-4d38-8519-99662bb34c95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:32.439752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-babac572-b510-4d38-8519-99662bb34c95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:32.533334 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-babac572-b510-4d38-8519-99662bb34c95 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132612 Aug 27 04:53:32.535206 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2175/4395] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:53:32 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:32.594626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1cdb00f-6a35-4267-9458-d727b3fd56c7 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "refresh_cache-4fa76344-e5ad-4214-93b2-47a019d27cd7" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 04:53:32.595639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1cdb00f-6a35-4267-9458-d727b3fd56c7 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquired lock "refresh_cache-4fa76344-e5ad-4214-93b2-47a019d27cd7" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 04:53:33.549649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-311fa62b-7e25-49c8-99e5-e50475659540 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:33.553143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-311fa62b-7e25-49c8-99e5-e50475659540 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:33.582743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-311fa62b-7e25-49c8-99e5-e50475659540 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:33.589332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-311fa62b-7e25-49c8-99e5-e50475659540 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:33.589794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-311fa62b-7e25-49c8-99e5-e50475659540 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:33.590766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-311fa62b-7e25-49c8-99e5-e50475659540 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:33.597713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-311fa62b-7e25-49c8-99e5-e50475659540 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:33.598642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-311fa62b-7e25-49c8-99e5-e50475659540 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:33.674467 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-311fa62b-7e25-49c8-99e5-e50475659540 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129222 Aug 27 04:53:33.679076 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2176/4396] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:53:33 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:34.540480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-a1cdb00f-6a35-4267-9458-d727b3fd56c7 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Building network info cache for instance {{(pid=128869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 04:53:34.557495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e640220f-db9b-4d8f-8795-acbc9f74a00c req-00fa7a84-6dc7-41b0-843a-ca5660aec2bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa76344-e5ad-4214-93b2-47a019d27cd7", "tag": "b1acbc40-1d0a-4606-9b83-abe3d978775d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:34.575426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e640220f-db9b-4d8f-8795-acbc9f74a00c req-00fa7a84-6dc7-41b0-843a-ca5660aec2bc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:34.575859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e640220f-db9b-4d8f-8795-acbc9f74a00c req-00fa7a84-6dc7-41b0-843a-ca5660aec2bc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:34.576274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e640220f-db9b-4d8f-8795-acbc9f74a00c req-00fa7a84-6dc7-41b0-843a-ca5660aec2bc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:34.621446 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e640220f-db9b-4d8f-8795-acbc9f74a00c req-00fa7a84-6dc7-41b0-843a-ca5660aec2bc service nova] Creating event network-changed:b1acbc40-1d0a-4606-9b83-abe3d978775d for instance 4fa76344-e5ad-4214-93b2-47a019d27cd7 on n-h2-854823-1 Aug 27 04:53:34.633157 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e640220f-db9b-4d8f-8795-acbc9f74a00c req-00fa7a84-6dc7-41b0-843a-ca5660aec2bc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079542 Aug 27 04:53:34.634105 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2177/4397] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:34.690203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7956ccef-f23c-43eb-8a7f-4aada1309dba tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:34.694592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7956ccef-f23c-43eb-8a7f-4aada1309dba tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:34.730876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7956ccef-f23c-43eb-8a7f-4aada1309dba tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:34.733436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7956ccef-f23c-43eb-8a7f-4aada1309dba tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:34.742334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7956ccef-f23c-43eb-8a7f-4aada1309dba tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:34.743262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7956ccef-f23c-43eb-8a7f-4aada1309dba tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:34.743763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7956ccef-f23c-43eb-8a7f-4aada1309dba tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:34.744214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7956ccef-f23c-43eb-8a7f-4aada1309dba tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:34.868133 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7956ccef-f23c-43eb-8a7f-4aada1309dba tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182274 Aug 27 04:53:34.879563 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2178/4398] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:53:34 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:35.892574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4613f58e-d863-4a90-b096-9a6e6047e4ab tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:35.895555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4613f58e-d863-4a90-b096-9a6e6047e4ab tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:35.905659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4613f58e-d863-4a90-b096-9a6e6047e4ab tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:35.906429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4613f58e-d863-4a90-b096-9a6e6047e4ab tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:35.907096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4613f58e-d863-4a90-b096-9a6e6047e4ab tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:35.908017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4613f58e-d863-4a90-b096-9a6e6047e4ab tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:35.908783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4613f58e-d863-4a90-b096-9a6e6047e4ab tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:35.909594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4613f58e-d863-4a90-b096-9a6e6047e4ab tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:35.949414 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4613f58e-d863-4a90-b096-9a6e6047e4ab tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062360 Aug 27 04:53:35.956107 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2179/4399] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:53:35 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:36.970003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a82fcca7-82e6-4282-90e7-57c17f22702a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:36.974605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a82fcca7-82e6-4282-90e7-57c17f22702a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:36.991884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a82fcca7-82e6-4282-90e7-57c17f22702a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:36.993041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a82fcca7-82e6-4282-90e7-57c17f22702a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:36.995255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a82fcca7-82e6-4282-90e7-57c17f22702a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:36.998548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a82fcca7-82e6-4282-90e7-57c17f22702a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:36.999150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a82fcca7-82e6-4282-90e7-57c17f22702a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:36.999744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a82fcca7-82e6-4282-90e7-57c17f22702a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:37.108916 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a82fcca7-82e6-4282-90e7-57c17f22702a tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149232 Aug 27 04:53:37.109710 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2180/4400] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:53:36 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:37.944263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-a1cdb00f-6a35-4267-9458-d727b3fd56c7 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Updating instance_info_cache with network_info: [{"id": "b1acbc40-1d0a-4606-9b83-abe3d978775d", "address": "fa:16:3e:33:f3:84", "network": {"id": "6f291964-1331-4043-a3c9-e171dbfc9b5a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1173560479-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e27a367de7f44a74a18de15d1919fd3e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb1acbc40-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 04:53:37.954787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1cdb00f-6a35-4267-9458-d727b3fd56c7 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Releasing lock "refresh_cache-4fa76344-e5ad-4214-93b2-47a019d27cd7" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 04:53:37.957608 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1cdb00f-6a35-4267-9458-d727b3fd56c7 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "POST /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7/action" status: 202 len: 0 microversion: 2.1 time: 7.125013 Aug 27 04:53:37.971946 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2221/4401] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:53:30 2022] POST /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7/action => generated 0 bytes in 7141 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 04:53:37.982297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f1b9ec16-42f4-4fbf-8aaf-97e9f905dc87 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '.version_select at 0x7f1f25e9bb80>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:38.122882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e831bbf-486e-47bd-85c6-c79586347283 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:38.125638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e831bbf-486e-47bd-85c6-c79586347283 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:38.150409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e831bbf-486e-47bd-85c6-c79586347283 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:38.152840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e831bbf-486e-47bd-85c6-c79586347283 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:38.153676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e831bbf-486e-47bd-85c6-c79586347283 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:38.157166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e831bbf-486e-47bd-85c6-c79586347283 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:38.158957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e831bbf-486e-47bd-85c6-c79586347283 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:38.163317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e831bbf-486e-47bd-85c6-c79586347283 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:38.254607 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e831bbf-486e-47bd-85c6-c79586347283 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136831 Aug 27 04:53:38.260187 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2222/4402] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:53:38 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:39.271234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c9374c0-954d-46a8-9acb-8c27dc4c4bff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:39.273832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c9374c0-954d-46a8-9acb-8c27dc4c4bff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:39.293054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c9374c0-954d-46a8-9acb-8c27dc4c4bff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:39.293566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c9374c0-954d-46a8-9acb-8c27dc4c4bff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:39.294018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c9374c0-954d-46a8-9acb-8c27dc4c4bff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:39.294752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c9374c0-954d-46a8-9acb-8c27dc4c4bff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:39.295220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c9374c0-954d-46a8-9acb-8c27dc4c4bff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:39.295730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c9374c0-954d-46a8-9acb-8c27dc4c4bff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:39.385838 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c9374c0-954d-46a8-9acb-8c27dc4c4bff tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119267 Aug 27 04:53:39.389902 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2223/4403] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:53:39 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:40.409556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c0195862-4783-433e-b3fc-4bf4c3ba8b46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:40.423307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c0195862-4783-433e-b3fc-4bf4c3ba8b46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:40.444697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0195862-4783-433e-b3fc-4bf4c3ba8b46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:40.445523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0195862-4783-433e-b3fc-4bf4c3ba8b46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:40.447389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0195862-4783-433e-b3fc-4bf4c3ba8b46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:40.451246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0195862-4783-433e-b3fc-4bf4c3ba8b46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:40.452053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0195862-4783-433e-b3fc-4bf4c3ba8b46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:40.452769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0195862-4783-433e-b3fc-4bf4c3ba8b46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:40.570421 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c0195862-4783-433e-b3fc-4bf4c3ba8b46 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170804 Aug 27 04:53:40.585326 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2224/4404] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:53:40 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:40.719676 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f1b9ec16-42f4-4fbf-8aaf-97e9f905dc87 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/6c722afb-6a84-4b52-b795-090e89b85bc6" status: 202 len: 0 microversion: 2.1 time: 2.741408 Aug 27 04:53:40.720967 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2181/4405] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 04:53:37 2022] DELETE /compute/v2.1/os-floating-ips/6c722afb-6a84-4b52-b795-090e89b85bc6 => generated 0 bytes in 2748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:53:40.732109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39cc530f-081e-4abb-a56c-989291f0710b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '.version_select at 0x7f1f21008c10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:41.391608 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39cc530f-081e-4abb-a56c-989291f0710b tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/df9bf09a-32a9-41e4-8efc-aef30cb97350" status: 202 len: 0 microversion: 2.1 time: 0.663640 Aug 27 04:53:41.392197 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2225/4406] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 04:53:40 2022] DELETE /compute/v2.1/os-security-groups/df9bf09a-32a9-41e4-8efc-aef30cb97350 => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:53:41.403094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-912431a8-902c-4250-a98b-421e73cb13b9 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:41.404202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-912431a8-902c-4250-a98b-421e73cb13b9 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:41.426489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-912431a8-902c-4250-a98b-421e73cb13b9 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:41.429009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-912431a8-902c-4250-a98b-421e73cb13b9 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:41.432138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-912431a8-902c-4250-a98b-421e73cb13b9 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:41.433190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-912431a8-902c-4250-a98b-421e73cb13b9 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:41.433809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-912431a8-902c-4250-a98b-421e73cb13b9 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:41.434493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-912431a8-902c-4250-a98b-421e73cb13b9 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:41.492780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=77,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:41.501049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-912431a8-902c-4250-a98b-421e73cb13b9 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:53:41.597095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c6f044f5-b0b2-4dde-9f20-51cc4d4f2d52 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:41.599996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c6f044f5-b0b2-4dde-9f20-51cc4d4f2d52 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:41.618765 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-912431a8-902c-4250-a98b-421e73cb13b9 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 204 len: 0 microversion: 2.1 time: 0.221384 Aug 27 04:53:41.620096 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2182/4407] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:53:41 2022] DELETE /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:53:41.629019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6f044f5-b0b2-4dde-9f20-51cc4d4f2d52 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:41.633955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6f044f5-b0b2-4dde-9f20-51cc4d4f2d52 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:41.637908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6f044f5-b0b2-4dde-9f20-51cc4d4f2d52 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:41.641070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6f044f5-b0b2-4dde-9f20-51cc4d4f2d52 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:41.642362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6f044f5-b0b2-4dde-9f20-51cc4d4f2d52 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:41.642760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c279738-b40c-4538-a2b6-7eaa7cf034c3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:41.643762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1c279738-b40c-4538-a2b6-7eaa7cf034c3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:41.643992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6f044f5-b0b2-4dde-9f20-51cc4d4f2d52 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:41.665087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c279738-b40c-4538-a2b6-7eaa7cf034c3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:41.667962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c279738-b40c-4538-a2b6-7eaa7cf034c3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:41.669998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c279738-b40c-4538-a2b6-7eaa7cf034c3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:41.672351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c279738-b40c-4538-a2b6-7eaa7cf034c3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:41.673995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c279738-b40c-4538-a2b6-7eaa7cf034c3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:41.675612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c279738-b40c-4538-a2b6-7eaa7cf034c3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:41.707852 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c6f044f5-b0b2-4dde-9f20-51cc4d4f2d52 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115952 Aug 27 04:53:41.709933 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2226/4408] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:53:41 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:42.043962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1c279738-b40c-4538-a2b6-7eaa7cf034c3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:42.058780 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1c279738-b40c-4538-a2b6-7eaa7cf034c3 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1510 microversion: 2.1 time: 0.430927 Aug 27 04:53:42.061332 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2183/4409] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:41 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:42.723648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92d13aa2-c70f-4141-ab80-df3556e44f7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:42.726461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92d13aa2-c70f-4141-ab80-df3556e44f7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:42.740944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d13aa2-c70f-4141-ab80-df3556e44f7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:42.744049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d13aa2-c70f-4141-ab80-df3556e44f7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:42.745005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d13aa2-c70f-4141-ab80-df3556e44f7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:42.745768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d13aa2-c70f-4141-ab80-df3556e44f7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:42.750409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d13aa2-c70f-4141-ab80-df3556e44f7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:42.750912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d13aa2-c70f-4141-ab80-df3556e44f7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:42.799846 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92d13aa2-c70f-4141-ab80-df3556e44f7c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082893 Aug 27 04:53:42.801171 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2227/4410] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 04:53:42 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:53:42.951787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bb39682-806d-4709-89a8-c7b65ec3cd8e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:42.954360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6bb39682-806d-4709-89a8-c7b65ec3cd8e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:42.965161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb39682-806d-4709-89a8-c7b65ec3cd8e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:42.966312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb39682-806d-4709-89a8-c7b65ec3cd8e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:42.967098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb39682-806d-4709-89a8-c7b65ec3cd8e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:42.968842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb39682-806d-4709-89a8-c7b65ec3cd8e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:42.970628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb39682-806d-4709-89a8-c7b65ec3cd8e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:42.971490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb39682-806d-4709-89a8-c7b65ec3cd8e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.007601 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6bb39682-806d-4709-89a8-c7b65ec3cd8e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] HTTP exception thrown: Cannot 'reboot' instance 686e7e13-0c27-41b1-b620-87a1410ac5bc while it is in vm_state rescued Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bb39682-806d-4709-89a8-c7b65ec3cd8e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Request method failure captured: Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc/action HTTP/1.1 Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 28 Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaHoFwgV4INwTRL8hXoYwjmWlLrRc_QJzw9nkZAvRSAfT__IxsIMw8Suy-GjIzNFt5R-NLcBI-KbU0p7XTxgVryxRdpnu39d1-w87dFtSDYLg2-wm7KAO7Nu1eVLF-CaLCIJrg2b0bchRGMkFWgTVQ8wFhLKBmW9T3OHuZJNVIJBUXo Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 81b0ef617031436484e9e987f972ae0a Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: {"reboot": {"type": "HARD"}} Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: exception: Cannot 'reboot' instance 686e7e13-0c27-41b1-b620-87a1410ac5bc while it is in vm_state rescued Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '686e7e13-0c27-41b1-b620-87a1410ac5bc', 'body': {'reboot': {'type': 'HARD'}}} Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 686e7e13-0c27-41b1-b620-87a1410ac5bc in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:53:43.009609 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:53:43.014483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 686e7e13-0c27-41b1-b620-87a1410ac5bc while it is in vm_state rescued Aug 27 04:53:43.014483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:43.014483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:43.014483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:43.014483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:43.014483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:43.014483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:43.014483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:43.014483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:43.014483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 686e7e13-0c27-41b1-b620-87a1410ac5bc while it is in vm_state rescued Aug 27 04:53:43.014483 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:43.016799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bb39682-806d-4709-89a8-c7b65ec3cd8e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Returning 409 to user: Cannot 'reboot' instance 686e7e13-0c27-41b1-b620-87a1410ac5bc while it is in vm_state rescued {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:43.018019 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6bb39682-806d-4709-89a8-c7b65ec3cd8e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc/action" status: 409 len: 145 microversion: 2.1 time: 0.071664 Aug 27 04:53:43.019062 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2228/4411] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:53:42 2022] POST /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc/action => generated 145 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:53:43.030239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1586277a-9797-46bb-a839-f7761c2d64f9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71228424-9f42-4121-865e-14501cc9b5c0"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:43.033461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1586277a-9797-46bb-a839-f7761c2d64f9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:43.041042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1586277a-9797-46bb-a839-f7761c2d64f9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.041929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1586277a-9797-46bb-a839-f7761c2d64f9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.042243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1586277a-9797-46bb-a839-f7761c2d64f9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.043195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1586277a-9797-46bb-a839-f7761c2d64f9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.043978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1586277a-9797-46bb-a839-f7761c2d64f9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.044496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1586277a-9797-46bb-a839-f7761c2d64f9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.048106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-52d86f37-3495-48cb-a1b1-d7a16eece1ff tempest-PortsAdminExtendedAttrsTestJSON-477136446 tempest-PortsAdminExtendedAttrsTestJSON-477136446-project-admin] Calling method '.version_select at 0x7f1f215f5310>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:43.049919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52d86f37-3495-48cb-a1b1-d7a16eece1ff tempest-PortsAdminExtendedAttrsTestJSON-477136446 tempest-PortsAdminExtendedAttrsTestJSON-477136446-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.050586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52d86f37-3495-48cb-a1b1-d7a16eece1ff tempest-PortsAdminExtendedAttrsTestJSON-477136446 tempest-PortsAdminExtendedAttrsTestJSON-477136446-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.051039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52d86f37-3495-48cb-a1b1-d7a16eece1ff tempest-PortsAdminExtendedAttrsTestJSON-477136446 tempest-PortsAdminExtendedAttrsTestJSON-477136446-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.074637 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1586277a-9797-46bb-a839-f7761c2d64f9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] HTTP exception thrown: Cannot 'rebuild' instance 686e7e13-0c27-41b1-b620-87a1410ac5bc while it is in vm_state rescued Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1586277a-9797-46bb-a839-f7761c2d64f9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Request method failure captured: Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc/action HTTP/1.1 Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 65 Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaHoFwgV4INwTRL8hXoYwjmWlLrRc_QJzw9nkZAvRSAfT__IxsIMw8Suy-GjIzNFt5R-NLcBI-KbU0p7XTxgVryxRdpnu39d1-w87dFtSDYLg2-wm7KAO7Nu1eVLF-CaLCIJrg2b0bchRGMkFWgTVQ8wFhLKBmW9T3OHuZJNVIJBUXo Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 81b0ef617031436484e9e987f972ae0a Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: {"rebuild": {"imageRef": "71228424-9f42-4121-865e-14501cc9b5c0"}} Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: exception: Cannot 'rebuild' instance 686e7e13-0c27-41b1-b620-87a1410ac5bc while it is in vm_state rescued Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '686e7e13-0c27-41b1-b620-87a1410ac5bc', 'body': {'rebuild': {'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0'}}} Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 686e7e13-0c27-41b1-b620-87a1410ac5bc in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:53:43.076639 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 686e7e13-0c27-41b1-b620-87a1410ac5bc while it is in vm_state rescued Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 686e7e13-0c27-41b1-b620-87a1410ac5bc while it is in vm_state rescued Aug 27 04:53:43.083551 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:43.089896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1586277a-9797-46bb-a839-f7761c2d64f9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Returning 409 to user: Cannot 'rebuild' instance 686e7e13-0c27-41b1-b620-87a1410ac5bc while it is in vm_state rescued {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:43.092451 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1586277a-9797-46bb-a839-f7761c2d64f9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "POST /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc/action" status: 409 len: 146 microversion: 2.1 time: 0.066632 Aug 27 04:53:43.097869 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2229/4412] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:53:43 2022] POST /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc/action => generated 146 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:53:43.102987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52d86f37-3495-48cb-a1b1-d7a16eece1ff tempest-PortsAdminExtendedAttrsTestJSON-477136446 tempest-PortsAdminExtendedAttrsTestJSON-477136446-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.103491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52d86f37-3495-48cb-a1b1-d7a16eece1ff tempest-PortsAdminExtendedAttrsTestJSON-477136446 tempest-PortsAdminExtendedAttrsTestJSON-477136446-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.103940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52d86f37-3495-48cb-a1b1-d7a16eece1ff tempest-PortsAdminExtendedAttrsTestJSON-477136446 tempest-PortsAdminExtendedAttrsTestJSON-477136446-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.105498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f9b9333-b4c3-4911-92b2-48dede52bc0c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:43.107062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f9b9333-b4c3-4911-92b2-48dede52bc0c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:43.115315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f9b9333-b4c3-4911-92b2-48dede52bc0c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.116239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f9b9333-b4c3-4911-92b2-48dede52bc0c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.116974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f9b9333-b4c3-4911-92b2-48dede52bc0c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.118137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f9b9333-b4c3-4911-92b2-48dede52bc0c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.119120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f9b9333-b4c3-4911-92b2-48dede52bc0c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.119821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f9b9333-b4c3-4911-92b2-48dede52bc0c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.141903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52d86f37-3495-48cb-a1b1-d7a16eece1ff tempest-PortsAdminExtendedAttrsTestJSON-477136446 tempest-PortsAdminExtendedAttrsTestJSON-477136446-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.142340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52d86f37-3495-48cb-a1b1-d7a16eece1ff tempest-PortsAdminExtendedAttrsTestJSON-477136446 tempest-PortsAdminExtendedAttrsTestJSON-477136446-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.142787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52d86f37-3495-48cb-a1b1-d7a16eece1ff tempest-PortsAdminExtendedAttrsTestJSON-477136446 tempest-PortsAdminExtendedAttrsTestJSON-477136446-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.152403 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-52d86f37-3495-48cb-a1b1-d7a16eece1ff tempest-PortsAdminExtendedAttrsTestJSON-477136446 tempest-PortsAdminExtendedAttrsTestJSON-477136446-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.327567 Aug 27 04:53:43.161065 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2184/4413] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 04:53:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:43.172081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-25498d1e-8723-4f55-8684-6b8747d3d36b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:43.173284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-25498d1e-8723-4f55-8684-6b8747d3d36b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:43.184899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25498d1e-8723-4f55-8684-6b8747d3d36b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.185771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25498d1e-8723-4f55-8684-6b8747d3d36b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.186503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25498d1e-8723-4f55-8684-6b8747d3d36b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.187704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25498d1e-8723-4f55-8684-6b8747d3d36b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.188631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25498d1e-8723-4f55-8684-6b8747d3d36b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.189468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25498d1e-8723-4f55-8684-6b8747d3d36b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.226738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-25498d1e-8723-4f55-8684-6b8747d3d36b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:53:43.426278 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-25498d1e-8723-4f55-8684-6b8747d3d36b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 204 len: 0 microversion: 2.1 time: 0.266040 Aug 27 04:53:43.428057 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2185/4414] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:53:43 2022] DELETE /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:53:43.440746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d132afb5-fa93-4867-8dc8-4c9eca8c3c1e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:43.441472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d132afb5-fa93-4867-8dc8-4c9eca8c3c1e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:43.458653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d132afb5-fa93-4867-8dc8-4c9eca8c3c1e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.461855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d132afb5-fa93-4867-8dc8-4c9eca8c3c1e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.462349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d132afb5-fa93-4867-8dc8-4c9eca8c3c1e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.464274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d132afb5-fa93-4867-8dc8-4c9eca8c3c1e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:43.466126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d132afb5-fa93-4867-8dc8-4c9eca8c3c1e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:43.466586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d132afb5-fa93-4867-8dc8-4c9eca8c3c1e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:43.584789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f9b9333-b4c3-4911-92b2-48dede52bc0c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:43.595194 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f9b9333-b4c3-4911-92b2-48dede52bc0c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1510 microversion: 2.1 time: 0.494996 Aug 27 04:53:43.596003 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2230/4415] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:43 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1510 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:43.784726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d132afb5-fa93-4867-8dc8-4c9eca8c3c1e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:43.794168 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d132afb5-fa93-4867-8dc8-4c9eca8c3c1e tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1691 microversion: 2.1 time: 0.359780 Aug 27 04:53:43.800451 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2186/4416] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:43 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1691 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:44.619458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e350360f-f461-4672-a049-212cc9c4055a tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:44.620241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e350360f-f461-4672-a049-212cc9c4055a tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:44.634661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e350360f-f461-4672-a049-212cc9c4055a tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:44.635166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e350360f-f461-4672-a049-212cc9c4055a tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:44.635605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e350360f-f461-4672-a049-212cc9c4055a tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:44.636321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e350360f-f461-4672-a049-212cc9c4055a tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:44.636807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e350360f-f461-4672-a049-212cc9c4055a tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:44.637231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e350360f-f461-4672-a049-212cc9c4055a tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:44.832723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f596e9d2-ee61-47cd-bce0-44932ad8a3dc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:44.835544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f596e9d2-ee61-47cd-bce0-44932ad8a3dc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:44.866058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f596e9d2-ee61-47cd-bce0-44932ad8a3dc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:44.870080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f596e9d2-ee61-47cd-bce0-44932ad8a3dc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:44.870844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f596e9d2-ee61-47cd-bce0-44932ad8a3dc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:44.872139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f596e9d2-ee61-47cd-bce0-44932ad8a3dc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:44.876651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f596e9d2-ee61-47cd-bce0-44932ad8a3dc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:44.877354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f596e9d2-ee61-47cd-bce0-44932ad8a3dc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:45.175276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e350360f-f461-4672-a049-212cc9c4055a tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:45.196619 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e350360f-f461-4672-a049-212cc9c4055a tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1510 microversion: 2.1 time: 0.579532 Aug 27 04:53:45.199364 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2231/4417] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:44 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1510 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:45.933937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f596e9d2-ee61-47cd-bce0-44932ad8a3dc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:45.949547 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f596e9d2-ee61-47cd-bce0-44932ad8a3dc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1691 microversion: 2.1 time: 1.123149 Aug 27 04:53:45.950648 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2187/4418] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:44 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1691 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:53:46.224770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52e75385-005c-40e2-b214-a4321c144842 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:46.226093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-52e75385-005c-40e2-b214-a4321c144842 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:46.237677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52e75385-005c-40e2-b214-a4321c144842 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:46.241388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52e75385-005c-40e2-b214-a4321c144842 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:46.242220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52e75385-005c-40e2-b214-a4321c144842 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:46.243203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52e75385-005c-40e2-b214-a4321c144842 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:46.243866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52e75385-005c-40e2-b214-a4321c144842 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:46.248951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52e75385-005c-40e2-b214-a4321c144842 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:46.529164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52e75385-005c-40e2-b214-a4321c144842 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:46.553161 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52e75385-005c-40e2-b214-a4321c144842 tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1510 microversion: 2.1 time: 0.331508 Aug 27 04:53:46.569061 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2232/4419] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:46 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1510 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:46.914291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-dadd1b3a-ec65-415d-b9f0-8589ce2948d1 req-0a77b7ea-bb40-472d-b060-0888d604757e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa76344-e5ad-4214-93b2-47a019d27cd7", "name": "network-vif-deleted", "tag": "b1acbc40-1d0a-4606-9b83-abe3d978775d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:46.953606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-dadd1b3a-ec65-415d-b9f0-8589ce2948d1 req-0a77b7ea-bb40-472d-b060-0888d604757e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:46.956791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-dadd1b3a-ec65-415d-b9f0-8589ce2948d1 req-0a77b7ea-bb40-472d-b060-0888d604757e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:46.957510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-dadd1b3a-ec65-415d-b9f0-8589ce2948d1 req-0a77b7ea-bb40-472d-b060-0888d604757e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:46.987141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a1c76b8-55f6-46b8-af57-e6350407c16c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:46.987867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a1c76b8-55f6-46b8-af57-e6350407c16c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:47.006600 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-dadd1b3a-ec65-415d-b9f0-8589ce2948d1 req-0a77b7ea-bb40-472d-b060-0888d604757e service nova] Creating event network-vif-deleted:b1acbc40-1d0a-4606-9b83-abe3d978775d for instance 4fa76344-e5ad-4214-93b2-47a019d27cd7 on n-h2-854823-1 Aug 27 04:53:47.012375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a1c76b8-55f6-46b8-af57-e6350407c16c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:47.013020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a1c76b8-55f6-46b8-af57-e6350407c16c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:47.014224 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-dadd1b3a-ec65-415d-b9f0-8589ce2948d1 req-0a77b7ea-bb40-472d-b060-0888d604757e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266517 Aug 27 04:53:47.015373 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2188/4420] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:47.017152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a1c76b8-55f6-46b8-af57-e6350407c16c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:47.021361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a1c76b8-55f6-46b8-af57-e6350407c16c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:47.023387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a1c76b8-55f6-46b8-af57-e6350407c16c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:47.024053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a1c76b8-55f6-46b8-af57-e6350407c16c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:47.522297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a1c76b8-55f6-46b8-af57-e6350407c16c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:47.544194 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a1c76b8-55f6-46b8-af57-e6350407c16c tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1691 microversion: 2.1 time: 0.566059 Aug 27 04:53:47.562967 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2233/4421] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:46 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1691 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:53:47.576935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c87c372c-889c-4d59-b716-b7322ac581ba tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:47.578583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c87c372c-889c-4d59-b716-b7322ac581ba tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:47.595292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c87c372c-889c-4d59-b716-b7322ac581ba tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:47.595292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c87c372c-889c-4d59-b716-b7322ac581ba tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:47.597045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c87c372c-889c-4d59-b716-b7322ac581ba tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:47.598019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c87c372c-889c-4d59-b716-b7322ac581ba tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:47.600846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c87c372c-889c-4d59-b716-b7322ac581ba tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:47.603798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c87c372c-889c-4d59-b716-b7322ac581ba tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:47.672009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c87c372c-889c-4d59-b716-b7322ac581ba tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:47.672809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c87c372c-889c-4d59-b716-b7322ac581ba tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:47.674017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c87c372c-889c-4d59-b716-b7322ac581ba tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:47.675074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-c87c372c-889c-4d59-b716-b7322ac581ba tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lazy-loading 'fault' on Instance uuid 4fa76344-e5ad-4214-93b2-47a019d27cd7 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:47.854331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c87c372c-889c-4d59-b716-b7322ac581ba tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8d181537df4d9496c35291811c2f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27a367de7f44a74a18de15d1919fd3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:47.864993 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c87c372c-889c-4d59-b716-b7322ac581ba tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 200 len: 1313 microversion: 2.1 time: 0.293385 Aug 27 04:53:47.865800 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2189/4422] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:47 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:48.572401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2683203c-9990-468f-8068-2a55bc79d98b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:48.574116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2683203c-9990-468f-8068-2a55bc79d98b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:48.586924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=30 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:48.589158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2683203c-9990-468f-8068-2a55bc79d98b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:48.591392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2683203c-9990-468f-8068-2a55bc79d98b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:48.593463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2683203c-9990-468f-8068-2a55bc79d98b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:48.595001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2683203c-9990-468f-8068-2a55bc79d98b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:48.596236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2683203c-9990-468f-8068-2a55bc79d98b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:48.598375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2683203c-9990-468f-8068-2a55bc79d98b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:48.887909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6ca859d4-8395-4252-9f9e-a8253899da5c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:48.888721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6ca859d4-8395-4252-9f9e-a8253899da5c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] [instance: 4fa76344-e5ad-4214-93b2-47a019d27cd7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:48.909442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ca859d4-8395-4252-9f9e-a8253899da5c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:48.909774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ca859d4-8395-4252-9f9e-a8253899da5c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:48.910280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ca859d4-8395-4252-9f9e-a8253899da5c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:48.911052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ca859d4-8395-4252-9f9e-a8253899da5c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:48.911521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ca859d4-8395-4252-9f9e-a8253899da5c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:48.912041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ca859d4-8395-4252-9f9e-a8253899da5c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:48.962812 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-6ca859d4-8395-4252-9f9e-a8253899da5c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] HTTP exception thrown: Instance 4fa76344-e5ad-4214-93b2-47a019d27cd7 could not be found. Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6ca859d4-8395-4252-9f9e-a8253899da5c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Request method failure captured: Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 HTTP/1.1 Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaL1rZFZvIHIc3gR68Hz_kSgRLMCTMYK0JO5VUgcmBvJgE-976S_VIVIIueCf0xZ0-k4WJ1A8Ky_w43FIkD2ow80xqUduuMMEizHxbb2d9fICap8ppPKVg0V-n_GkCIRe0KSxY1ce6ZrSIbjaDTWZbJ-RtsXyIDsLDIeB3MdPHzIOck Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: e27a367de7f44a74a18de15d1919fd3e Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1158827745 Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e27a367de7f44a74a18de15d1919fd3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e27a367de7f44a74a18de15d1919fd3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e27a367de7f44a74a18de15d1919fd3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e27a367de7f44a74a18de15d1919fd3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1158827745 Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: e27a367de7f44a74a18de15d1919fd3e Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1158827745 Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerRescueTestJSONUnderV235-1158827745-project Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: ab8d181537df4d9496c35291811c2f26 Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1158827745-project Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 4fa76344-e5ad-4214-93b2-47a019d27cd7 could not be found. Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '4fa76344-e5ad-4214-93b2-47a019d27cd7'} Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fa76344-e5ad-4214-93b2-47a019d27cd7 could not be found. Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fa76344-e5ad-4214-93b2-47a019d27cd7 could not be found. Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:53:48.964686 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:48.970491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:53:48.970491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:48.970491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:48.970491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:48.970491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:48.970491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:48.970491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fa76344-e5ad-4214-93b2-47a019d27cd7 could not be found. Aug 27 04:53:48.970491 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:53:48.972242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6ca859d4-8395-4252-9f9e-a8253899da5c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] Returning 404 to user: Instance 4fa76344-e5ad-4214-93b2-47a019d27cd7 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:48.973972 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6ca859d4-8395-4252-9f9e-a8253899da5c tempest-ServerRescueTestJSONUnderV235-1158827745 tempest-ServerRescueTestJSONUnderV235-1158827745-project] 10.222.0.79 "GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7" status: 404 len: 111 microversion: 2.1 time: 0.090061 Aug 27 04:53:48.975496 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2190/4423] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:48 2022] GET /compute/v2.1/servers/4fa76344-e5ad-4214-93b2-47a019d27cd7 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:49.080813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2683203c-9990-468f-8068-2a55bc79d98b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:49.094967 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2683203c-9990-468f-8068-2a55bc79d98b tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1691 microversion: 2.1 time: 0.528260 Aug 27 04:53:49.097287 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2234/4424] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:48 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1691 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:50.117998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3fc28a7c-51ec-42b5-a460-24b0107ac8fb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:50.119228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3fc28a7c-51ec-42b5-a460-24b0107ac8fb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:50.143106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fc28a7c-51ec-42b5-a460-24b0107ac8fb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:50.143223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fc28a7c-51ec-42b5-a460-24b0107ac8fb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:50.143596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fc28a7c-51ec-42b5-a460-24b0107ac8fb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:50.144333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fc28a7c-51ec-42b5-a460-24b0107ac8fb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:50.148831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fc28a7c-51ec-42b5-a460-24b0107ac8fb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:50.149390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fc28a7c-51ec-42b5-a460-24b0107ac8fb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:50.351162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3fc28a7c-51ec-42b5-a460-24b0107ac8fb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:50.387123 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3fc28a7c-51ec-42b5-a460-24b0107ac8fb tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1624 microversion: 2.1 time: 0.273397 Aug 27 04:53:50.390833 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2191/4425] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:50 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1624 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:51.117944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-865e5554-151c-4fb9-aced-75f86038f235 req-1b2b0047-dc06-4f98-a76e-73832e211f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f74e4f7-e0b8-41cb-88a2-98aff82b1d98", "name": "network-vif-deleted", "tag": "63e52c18-d4a3-457e-9877-9a1d70646169"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:51.157260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-865e5554-151c-4fb9-aced-75f86038f235 req-1b2b0047-dc06-4f98-a76e-73832e211f7c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:51.177663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-865e5554-151c-4fb9-aced-75f86038f235 req-1b2b0047-dc06-4f98-a76e-73832e211f7c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:51.178579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-865e5554-151c-4fb9-aced-75f86038f235 req-1b2b0047-dc06-4f98-a76e-73832e211f7c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:51.197093 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-865e5554-151c-4fb9-aced-75f86038f235 req-1b2b0047-dc06-4f98-a76e-73832e211f7c service nova] Creating event network-vif-deleted:63e52c18-d4a3-457e-9877-9a1d70646169 for instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 on n-h1-854823-1 Aug 27 04:53:51.224966 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-865e5554-151c-4fb9-aced-75f86038f235 req-1b2b0047-dc06-4f98-a76e-73832e211f7c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109369 Aug 27 04:53:51.225628 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2235/4426] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:51.415571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5bb05aa1-7de4-4852-b2e0-410c0b28cefc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:51.416940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5bb05aa1-7de4-4852-b2e0-410c0b28cefc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:51.446907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bb05aa1-7de4-4852-b2e0-410c0b28cefc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:51.447714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bb05aa1-7de4-4852-b2e0-410c0b28cefc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:51.448176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bb05aa1-7de4-4852-b2e0-410c0b28cefc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:51.456417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bb05aa1-7de4-4852-b2e0-410c0b28cefc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:51.457356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bb05aa1-7de4-4852-b2e0-410c0b28cefc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:51.458380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bb05aa1-7de4-4852-b2e0-410c0b28cefc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:51.593767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bb05aa1-7de4-4852-b2e0-410c0b28cefc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:51.595156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bb05aa1-7de4-4852-b2e0-410c0b28cefc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:51.597852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bb05aa1-7de4-4852-b2e0-410c0b28cefc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:51.599323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-5bb05aa1-7de4-4852-b2e0-410c0b28cefc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lazy-loading 'fault' on Instance uuid 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:53:52.034993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5bb05aa1-7de4-4852-b2e0-410c0b28cefc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:52.046667 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5bb05aa1-7de4-4852-b2e0-410c0b28cefc tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 200 len: 1336 microversion: 2.1 time: 0.638034 Aug 27 04:53:52.047274 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2192/4427] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:51 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 1336 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:53.074177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb9bdf45-d803-4e6e-9806-2f9544c9bfe9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:53.074927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb9bdf45-d803-4e6e-9806-2f9544c9bfe9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:53:53.105329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9bdf45-d803-4e6e-9806-2f9544c9bfe9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:53.106634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9bdf45-d803-4e6e-9806-2f9544c9bfe9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:53.109583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9bdf45-d803-4e6e-9806-2f9544c9bfe9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:53.113286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9bdf45-d803-4e6e-9806-2f9544c9bfe9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:53:53.114860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9bdf45-d803-4e6e-9806-2f9544c9bfe9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:53:53.117764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9bdf45-d803-4e6e-9806-2f9544c9bfe9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:53:53.174397 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-eb9bdf45-d803-4e6e-9806-2f9544c9bfe9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] HTTP exception thrown: Instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 could not be found. Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb9bdf45-d803-4e6e-9806-2f9544c9bfe9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Request method failure captured: Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 HTTP/1.1 Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaHoFwgV4INwTRL8hXoYwjmWlLrRc_QJzw9nkZAvRSAfT__IxsIMw8Suy-GjIzNFt5R-NLcBI-KbU0p7XTxgVryxRdpnu39d1-w87dFtSDYLg2-wm7KAO7Nu1eVLF-CaLCIJrg2b0bchRGMkFWgTVQ8wFhLKBmW9T3OHuZJNVIJBUXo Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 81b0ef617031436484e9e987f972ae0a Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 could not be found. Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '9f74e4f7-e0b8-41cb-88a2-98aff82b1d98'} Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 could not be found. Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 could not be found. Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:53.177099 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:53:53.181985 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:53.181985 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:53:53.181985 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:53:53.181985 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:53:53.181985 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:53:53.181985 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:53:53.181985 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 could not be found. Aug 27 04:53:53.181985 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:53:53.186772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb9bdf45-d803-4e6e-9806-2f9544c9bfe9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Returning 404 to user: Instance 9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:53:53.190967 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb9bdf45-d803-4e6e-9806-2f9544c9bfe9 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98" status: 404 len: 111 microversion: 2.1 time: 0.123797 Aug 27 04:53:53.192688 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2236/4428] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:53:53 2022] GET /compute/v2.1/servers/9f74e4f7-e0b8-41cb-88a2-98aff82b1d98 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:53.202562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-55b1296f-39e3-4c8f-b90f-dd19771d4965 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '.version_select at 0x7f1f220810d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:53.243986 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-55b1296f-39e3-4c8f-b90f-dd19771d4965 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1154650439" status: 202 len: 0 microversion: 2.1 time: 0.045377 Aug 27 04:53:53.245404 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2193/4429] 10.222.0.79 () {58 vars in 1221 bytes} [Sat Aug 27 04:53:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1154650439 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:54:10.007502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-882bc0de-66f1-439d-b2cc-b48573196c14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:10.011265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-882bc0de-66f1-439d-b2cc-b48573196c14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:10.018074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=5 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:10.023875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=82,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:10.053823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-882bc0de-66f1-439d-b2cc-b48573196c14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:10.054699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-882bc0de-66f1-439d-b2cc-b48573196c14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:10.056899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-882bc0de-66f1-439d-b2cc-b48573196c14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:10.060087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-882bc0de-66f1-439d-b2cc-b48573196c14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:10.060849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-882bc0de-66f1-439d-b2cc-b48573196c14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:10.063072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-882bc0de-66f1-439d-b2cc-b48573196c14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:10.159645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-882bc0de-66f1-439d-b2cc-b48573196c14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:54:10.489875 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-882bc0de-66f1-439d-b2cc-b48573196c14 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "DELETE /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 204 len: 0 microversion: 2.1 time: 0.490765 Aug 27 04:54:10.491855 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2237/4430] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:54:09 2022] DELETE /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:54:10.499182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:10.500353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:10.507353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-15c14a6c-ce63-49f1-ac51-a2f7846bc5f5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:10.508199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-15c14a6c-ce63-49f1-ac51-a2f7846bc5f5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:10.523870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15c14a6c-ce63-49f1-ac51-a2f7846bc5f5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:10.525338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15c14a6c-ce63-49f1-ac51-a2f7846bc5f5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:10.532517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15c14a6c-ce63-49f1-ac51-a2f7846bc5f5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:10.533577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15c14a6c-ce63-49f1-ac51-a2f7846bc5f5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:10.535380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15c14a6c-ce63-49f1-ac51-a2f7846bc5f5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:10.536396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-15c14a6c-ce63-49f1-ac51-a2f7846bc5f5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:12.686044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-15c14a6c-ce63-49f1-ac51-a2f7846bc5f5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:12.695577 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-15c14a6c-ce63-49f1-ac51-a2f7846bc5f5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1507 microversion: 2.1 time: 2.199363 Aug 27 04:54:12.701938 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2194/4431] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:10 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1507 bytes in 2206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:13.067730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c916e012-32be-4db0-987d-8c88428c989e req-40606164-2d03-4a32-8e9f-3d99e2ce0d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686e7e13-0c27-41b1-b620-87a1410ac5bc", "name": "network-vif-deleted", "tag": "b9e91c19-b6c3-40a3-87ed-9af5a2d0526b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:13.125797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c916e012-32be-4db0-987d-8c88428c989e req-40606164-2d03-4a32-8e9f-3d99e2ce0d78 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:13.126727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c916e012-32be-4db0-987d-8c88428c989e req-40606164-2d03-4a32-8e9f-3d99e2ce0d78 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:13.132580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c916e012-32be-4db0-987d-8c88428c989e req-40606164-2d03-4a32-8e9f-3d99e2ce0d78 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.198214 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c916e012-32be-4db0-987d-8c88428c989e req-40606164-2d03-4a32-8e9f-3d99e2ce0d78 service nova] Creating event network-vif-deleted:b9e91c19-b6c3-40a3-87ed-9af5a2d0526b for instance 686e7e13-0c27-41b1-b620-87a1410ac5bc on n-h2-854823-1 Aug 27 04:54:13.216331 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c916e012-32be-4db0-987d-8c88428c989e req-40606164-2d03-4a32-8e9f-3d99e2ce0d78 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155432 Aug 27 04:54:13.217999 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2238/4432] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:13.724061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0bbceb36-9004-4984-8f5e-18818042e2a3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:13.725322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0bbceb36-9004-4984-8f5e-18818042e2a3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:13.747207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbceb36-9004-4984-8f5e-18818042e2a3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:13.747720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbceb36-9004-4984-8f5e-18818042e2a3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:13.748168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbceb36-9004-4984-8f5e-18818042e2a3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.748950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbceb36-9004-4984-8f5e-18818042e2a3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:13.749417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbceb36-9004-4984-8f5e-18818042e2a3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:13.749900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbceb36-9004-4984-8f5e-18818042e2a3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.918991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbceb36-9004-4984-8f5e-18818042e2a3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:13.919680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbceb36-9004-4984-8f5e-18818042e2a3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:13.920188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbceb36-9004-4984-8f5e-18818042e2a3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:13.920695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-0bbceb36-9004-4984-8f5e-18818042e2a3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lazy-loading 'fault' on Instance uuid 686e7e13-0c27-41b1-b620-87a1410ac5bc {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:54:14.233882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0bbceb36-9004-4984-8f5e-18818042e2a3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:14.246192 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0bbceb36-9004-4984-8f5e-18818042e2a3 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 200 len: 1311 microversion: 2.1 time: 0.524940 Aug 27 04:54:14.253958 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2195/4433] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:13 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 1311 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:15.290359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38570c95-685b-4cfb-beba-549406164cda tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:15.290865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38570c95-685b-4cfb-beba-549406164cda tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 686e7e13-0c27-41b1-b620-87a1410ac5bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:15.312310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38570c95-685b-4cfb-beba-549406164cda tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:15.313579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38570c95-685b-4cfb-beba-549406164cda tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:15.314232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38570c95-685b-4cfb-beba-549406164cda tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:15.315172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38570c95-685b-4cfb-beba-549406164cda tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:15.315802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38570c95-685b-4cfb-beba-549406164cda tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:15.316985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38570c95-685b-4cfb-beba-549406164cda tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:15.371898 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-38570c95-685b-4cfb-beba-549406164cda tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] HTTP exception thrown: Instance 686e7e13-0c27-41b1-b620-87a1410ac5bc could not be found. Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38570c95-685b-4cfb-beba-549406164cda tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Request method failure captured: Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc HTTP/1.1 Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaHoFwgV4INwTRL8hXoYwjmWlLrRc_QJzw9nkZAvRSAfT__IxsIMw8Suy-GjIzNFt5R-NLcBI-KbU0p7XTxgVryxRdpnu39d1-w87dFtSDYLg2-wm7KAO7Nu1eVLF-CaLCIJrg2b0bchRGMkFWgTVQ8wFhLKBmW9T3OHuZJNVIJBUXo Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 81b0ef617031436484e9e987f972ae0a Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 686e7e13-0c27-41b1-b620-87a1410ac5bc could not be found. Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '686e7e13-0c27-41b1-b620-87a1410ac5bc'} Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 686e7e13-0c27-41b1-b620-87a1410ac5bc could not be found. Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 686e7e13-0c27-41b1-b620-87a1410ac5bc could not be found. Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:54:15.373621 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:15.378182 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:54:15.378182 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:15.378182 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:15.378182 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:15.378182 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:54:15.378182 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:54:15.378182 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 686e7e13-0c27-41b1-b620-87a1410ac5bc could not be found. Aug 27 04:54:15.378182 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:54:15.378182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38570c95-685b-4cfb-beba-549406164cda tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Returning 404 to user: Instance 686e7e13-0c27-41b1-b620-87a1410ac5bc could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:54:15.378182 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-38570c95-685b-4cfb-beba-549406164cda tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc" status: 404 len: 111 microversion: 2.1 time: 0.105695 Aug 27 04:54:15.390268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f075e723-fff0-4913-ba85-ed0044ef62f2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:15.391266 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2239/4434] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:15 2022] GET /compute/v2.1/servers/686e7e13-0c27-41b1-b620-87a1410ac5bc => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:54:15.392137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f075e723-fff0-4913-ba85-ed0044ef62f2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:15.415167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f075e723-fff0-4913-ba85-ed0044ef62f2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:15.417327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f075e723-fff0-4913-ba85-ed0044ef62f2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:15.418072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f075e723-fff0-4913-ba85-ed0044ef62f2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:15.420557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f075e723-fff0-4913-ba85-ed0044ef62f2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:15.421472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f075e723-fff0-4913-ba85-ed0044ef62f2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:15.422299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f075e723-fff0-4913-ba85-ed0044ef62f2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:15.479049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f075e723-fff0-4913-ba85-ed0044ef62f2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:54:15.735143 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f075e723-fff0-4913-ba85-ed0044ef62f2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 204 len: 0 microversion: 2.1 time: 0.350371 Aug 27 04:54:15.735760 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2196/4435] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:54:15 2022] DELETE /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:54:15.745956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a1c39e6-273f-4f4d-b567-296dcecf2908 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:15.746845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a1c39e6-273f-4f4d-b567-296dcecf2908 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:15.756415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a1c39e6-273f-4f4d-b567-296dcecf2908 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:15.759897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a1c39e6-273f-4f4d-b567-296dcecf2908 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:15.760628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a1c39e6-273f-4f4d-b567-296dcecf2908 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:15.769001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a1c39e6-273f-4f4d-b567-296dcecf2908 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:15.770213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a1c39e6-273f-4f4d-b567-296dcecf2908 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:15.770828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a1c39e6-273f-4f4d-b567-296dcecf2908 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:16.383088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2a1c39e6-273f-4f4d-b567-296dcecf2908 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:16.394925 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a1c39e6-273f-4f4d-b567-296dcecf2908 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1522 microversion: 2.1 time: 0.652782 Aug 27 04:54:16.395527 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2240/4436] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:15 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1522 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:17.421446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b434e968-c147-48f3-b14d-48d608dc25d5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:17.422408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b434e968-c147-48f3-b14d-48d608dc25d5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:17.431229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b434e968-c147-48f3-b14d-48d608dc25d5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:17.431831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b434e968-c147-48f3-b14d-48d608dc25d5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:17.432607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b434e968-c147-48f3-b14d-48d608dc25d5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:17.433526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b434e968-c147-48f3-b14d-48d608dc25d5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:17.434096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b434e968-c147-48f3-b14d-48d608dc25d5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:17.434636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b434e968-c147-48f3-b14d-48d608dc25d5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:17.956399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-078f4937-8e6c-47a2-822f-9939bc1db459 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:17.958229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-078f4937-8e6c-47a2-822f-9939bc1db459 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:17.967431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-078f4937-8e6c-47a2-822f-9939bc1db459 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:17.969125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-078f4937-8e6c-47a2-822f-9939bc1db459 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:17.970697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-078f4937-8e6c-47a2-822f-9939bc1db459 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:17.972015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-078f4937-8e6c-47a2-822f-9939bc1db459 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:17.974412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-078f4937-8e6c-47a2-822f-9939bc1db459 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:17.975204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-078f4937-8e6c-47a2-822f-9939bc1db459 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:18.185272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b434e968-c147-48f3-b14d-48d608dc25d5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:18.198500 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b434e968-c147-48f3-b14d-48d608dc25d5 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1480 microversion: 2.1 time: 0.784167 Aug 27 04:54:18.199842 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2197/4437] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:17 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1480 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:18.337492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-078f4937-8e6c-47a2-822f-9939bc1db459 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:18.351614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-078f4937-8e6c-47a2-822f-9939bc1db459 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:18.353389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-078f4937-8e6c-47a2-822f-9939bc1db459 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:18.354939 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-078f4937-8e6c-47a2-822f-9939bc1db459 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 2949 microversion: 2.32 time: 0.402580 Aug 27 04:54:18.356068 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2241/4438] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:54:17 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 2949 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:54:18.389309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c108e5d-be3e-4426-a04e-c218825aae2e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:18.390834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1c108e5d-be3e-4426-a04e-c218825aae2e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:18.404865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c108e5d-be3e-4426-a04e-c218825aae2e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:18.407289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c108e5d-be3e-4426-a04e-c218825aae2e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:18.408074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c108e5d-be3e-4426-a04e-c218825aae2e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:18.411200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c108e5d-be3e-4426-a04e-c218825aae2e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:18.412021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c108e5d-be3e-4426-a04e-c218825aae2e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:18.413707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c108e5d-be3e-4426-a04e-c218825aae2e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:18.696882 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1c108e5d-be3e-4426-a04e-c218825aae2e tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.312284 Aug 27 04:54:18.697924 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2198/4439] 10.222.0.79 () {60 vars in 1316 bytes} [Sat Aug 27 04:54:18 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999/os-interface => generated 1829 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:54:18.786646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0c3b57b3-c095-4ac5-95ca-a60509f2a096 req-1fecbb93-87b6-401c-904a-f968299c0cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9ed635-f034-40b0-8914-1e1b0ecdfa8b", "name": "network-vif-deleted", "tag": "54acff45-168a-4158-9a19-e66b0074eb3f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:18.810471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0c3b57b3-c095-4ac5-95ca-a60509f2a096 req-1fecbb93-87b6-401c-904a-f968299c0cee service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:18.812011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0c3b57b3-c095-4ac5-95ca-a60509f2a096 req-1fecbb93-87b6-401c-904a-f968299c0cee service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:18.812011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0c3b57b3-c095-4ac5-95ca-a60509f2a096 req-1fecbb93-87b6-401c-904a-f968299c0cee service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:18.873808 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0c3b57b3-c095-4ac5-95ca-a60509f2a096 req-1fecbb93-87b6-401c-904a-f968299c0cee service nova] Creating event network-vif-deleted:54acff45-168a-4158-9a19-e66b0074eb3f for instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b on n-h1-854823-1 Aug 27 04:54:18.883010 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0c3b57b3-c095-4ac5-95ca-a60509f2a096 req-1fecbb93-87b6-401c-904a-f968299c0cee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101832 Aug 27 04:54:18.883955 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2242/4440] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:19.220057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-278141fa-e497-49d7-84ff-06f88e8eb1a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:19.220806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-278141fa-e497-49d7-84ff-06f88e8eb1a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:19.232971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-278141fa-e497-49d7-84ff-06f88e8eb1a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:19.232971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-278141fa-e497-49d7-84ff-06f88e8eb1a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:19.232971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-278141fa-e497-49d7-84ff-06f88e8eb1a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:19.232971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-278141fa-e497-49d7-84ff-06f88e8eb1a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:19.232971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-278141fa-e497-49d7-84ff-06f88e8eb1a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:19.259089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-278141fa-e497-49d7-84ff-06f88e8eb1a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:19.411303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-278141fa-e497-49d7-84ff-06f88e8eb1a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:19.411982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-278141fa-e497-49d7-84ff-06f88e8eb1a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:19.415253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-278141fa-e497-49d7-84ff-06f88e8eb1a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:19.415808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-278141fa-e497-49d7-84ff-06f88e8eb1a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lazy-loading 'fault' on Instance uuid 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:54:19.786563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-278141fa-e497-49d7-84ff-06f88e8eb1a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b0ef617031436484e9e987f972ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce5800ecb484a6ca7a9894cc4530bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:19.794130 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-278141fa-e497-49d7-84ff-06f88e8eb1a2 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 200 len: 1312 microversion: 2.1 time: 0.578006 Aug 27 04:54:19.795015 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2199/4441] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:19 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 1312 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:20.824858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76bc53a8-ac63-452d-a418-519f897da8c0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:20.825694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76bc53a8-ac63-452d-a418-519f897da8c0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] [instance: 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:20.843305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76bc53a8-ac63-452d-a418-519f897da8c0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:20.843904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76bc53a8-ac63-452d-a418-519f897da8c0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:20.844425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76bc53a8-ac63-452d-a418-519f897da8c0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:20.845186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76bc53a8-ac63-452d-a418-519f897da8c0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:20.845652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76bc53a8-ac63-452d-a418-519f897da8c0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:20.846382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76bc53a8-ac63-452d-a418-519f897da8c0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:20.888080 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-76bc53a8-ac63-452d-a418-519f897da8c0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] HTTP exception thrown: Instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b could not be found. Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76bc53a8-ac63-452d-a418-519f897da8c0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Request method failure captured: Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b HTTP/1.1 Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaHoFwgV4INwTRL8hXoYwjmWlLrRc_QJzw9nkZAvRSAfT__IxsIMw8Suy-GjIzNFt5R-NLcBI-KbU0p7XTxgVryxRdpnu39d1-w87dFtSDYLg2-wm7KAO7Nu1eVLF-CaLCIJrg2b0bchRGMkFWgTVQ8wFhLKBmW9T3OHuZJNVIJBUXo Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0ce5800ecb484a6ca7a9894cc4530bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 0ce5800ecb484a6ca7a9894cc4530bf4 Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-827572756 Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 81b0ef617031436484e9e987f972ae0a Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-827572756-project Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b could not be found. Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '7e9ed635-f034-40b0-8914-1e1b0ecdfa8b'} Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b could not be found. Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b could not be found. Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:54:20.889792 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:54:20.896554 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:54:20.896554 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:54:20.896554 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:54:20.896554 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:54:20.896554 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:54:20.896554 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:54:20.896554 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b could not be found. Aug 27 04:54:20.896554 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:54:20.896554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76bc53a8-ac63-452d-a418-519f897da8c0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] Returning 404 to user: Instance 7e9ed635-f034-40b0-8914-1e1b0ecdfa8b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:54:20.896554 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76bc53a8-ac63-452d-a418-519f897da8c0 tempest-ServerRescueNegativeTestJSON-827572756 tempest-ServerRescueNegativeTestJSON-827572756-project] 10.222.0.79 "GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b" status: 404 len: 111 microversion: 2.1 time: 0.071723 Aug 27 04:54:20.909241 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2243/4442] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:20 2022] GET /compute/v2.1/servers/7e9ed635-f034-40b0-8914-1e1b0ecdfa8b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:54:22.840043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-01eac59b-24e6-47e4-9d62-508d0c230b53 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Action: 'create', calling method: .version_select at 0x7f1f219d7160>, body: {"keypair": {"name": "tempest-keypair-252219775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPd6GOu3wch4kzcYaEr9EcaXtCdqLU8cXvWkdXcw/tb+FSAniYXwqxHN99U0ECzl9l1FjkOF+c6/SIsMwyRjzABjIVQAL8w7bgxE4A/PnqFROsnpT1Yv7QWD+I70Pak0rw=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:22.878172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-01eac59b-24e6-47e4-9d62-508d0c230b53 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Getting quotas for project 8fe84461cde7445dbf0d1a98df3aeb15. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:22.897776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-01eac59b-24e6-47e4-9d62-508d0c230b53 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Getting quotas for user 18c5a89d81c64bdaad17d7005434f01f and project 8fe84461cde7445dbf0d1a98df3aeb15. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:22.933128 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-01eac59b-24e6-47e4-9d62-508d0c230b53 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.531065 Aug 27 04:54:22.934628 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2200/4443] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:54:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:28.826101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-653423079", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db72d00a-dd07-4f92-8b87-ad6efb8c8c8c"}], "security_groups": [{"name": "tempest-securitygroup--433950145"}], "key_name": "tempest-keypair-252219775", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:29.613418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] validate_networks() for [('db72d00a-dd07-4f92-8b87-ad6efb8c8c8c', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:54:30.863683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:33.327385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:54:33.328025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:54:33.328425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:54:33.328867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:54:33.329489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:54:33.354885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:33.355380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:33.355823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:33.356592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:33.357064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:33.357495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:33.395639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Getting quotas for project 8fe84461cde7445dbf0d1a98df3aeb15. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:33.426850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Getting quotas for user 18c5a89d81c64bdaad17d7005434f01f and project 8fe84461cde7445dbf0d1a98df3aeb15. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:33.477220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:54:33.486193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:54:33.681948 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-105f9845-f14c-4f45-b0d5-9917bcdca6f2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.859285 Aug 27 04:54:33.692877 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2244/4444] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:54:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 4872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:54:33.694967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:33.695803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:33.696787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:33.700829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ebdb43c1-a268-45c8-a9ee-99e34c3ac8a0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:33.701496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ebdb43c1-a268-45c8-a9ee-99e34c3ac8a0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:33.980587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ebdb43c1-a268-45c8-a9ee-99e34c3ac8a0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:34.000269 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ebdb43c1-a268-45c8-a9ee-99e34c3ac8a0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1236 microversion: 2.1 time: 0.306918 Aug 27 04:54:34.004262 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2201/4445] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:33 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1236 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:35.022046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b57a754-e28e-4986-b485-956345876ecb tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:35.022688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4b57a754-e28e-4986-b485-956345876ecb tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:35.036136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b57a754-e28e-4986-b485-956345876ecb tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:35.037535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b57a754-e28e-4986-b485-956345876ecb tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:35.040032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b57a754-e28e-4986-b485-956345876ecb tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:35.041453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b57a754-e28e-4986-b485-956345876ecb tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:35.044445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b57a754-e28e-4986-b485-956345876ecb tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:35.046102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b57a754-e28e-4986-b485-956345876ecb tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:35.358143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4b57a754-e28e-4986-b485-956345876ecb tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:35.395566 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b57a754-e28e-4986-b485-956345876ecb tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1240 microversion: 2.1 time: 0.378059 Aug 27 04:54:35.398846 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2245/4446] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:35 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1240 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:36.428161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ce95c3e1-c4b5-4de2-b83a-63753ab368b7 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:36.429169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ce95c3e1-c4b5-4de2-b83a-63753ab368b7 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:36.443976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce95c3e1-c4b5-4de2-b83a-63753ab368b7 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:36.444480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce95c3e1-c4b5-4de2-b83a-63753ab368b7 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:36.444944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce95c3e1-c4b5-4de2-b83a-63753ab368b7 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:36.448665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce95c3e1-c4b5-4de2-b83a-63753ab368b7 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:36.449386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce95c3e1-c4b5-4de2-b83a-63753ab368b7 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:36.450105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce95c3e1-c4b5-4de2-b83a-63753ab368b7 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:36.577742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ce95c3e1-c4b5-4de2-b83a-63753ab368b7 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:36.592826 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ce95c3e1-c4b5-4de2-b83a-63753ab368b7 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1294 microversion: 2.1 time: 0.175595 Aug 27 04:54:36.593928 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2202/4447] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:36 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1294 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:37.621464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af2ef708-26bd-4abb-a415-0423e9b0e317 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:37.622292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af2ef708-26bd-4abb-a415-0423e9b0e317 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:37.646550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af2ef708-26bd-4abb-a415-0423e9b0e317 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:37.651767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af2ef708-26bd-4abb-a415-0423e9b0e317 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:37.652292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af2ef708-26bd-4abb-a415-0423e9b0e317 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:37.657616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af2ef708-26bd-4abb-a415-0423e9b0e317 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:37.658116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af2ef708-26bd-4abb-a415-0423e9b0e317 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:37.658556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af2ef708-26bd-4abb-a415-0423e9b0e317 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:38.011469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af2ef708-26bd-4abb-a415-0423e9b0e317 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:38.021613 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af2ef708-26bd-4abb-a415-0423e9b0e317 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1294 microversion: 2.1 time: 0.404544 Aug 27 04:54:38.029034 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2246/4448] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:37 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1294 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:39.047761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7a8af65e-3723-40ef-944d-98bf17f9a103 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:39.048371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7a8af65e-3723-40ef-944d-98bf17f9a103 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:39.057288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a8af65e-3723-40ef-944d-98bf17f9a103 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:39.057787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a8af65e-3723-40ef-944d-98bf17f9a103 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:39.058233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a8af65e-3723-40ef-944d-98bf17f9a103 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:39.058943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a8af65e-3723-40ef-944d-98bf17f9a103 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:39.059416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a8af65e-3723-40ef-944d-98bf17f9a103 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:39.059848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a8af65e-3723-40ef-944d-98bf17f9a103 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:40.366524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7a8af65e-3723-40ef-944d-98bf17f9a103 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:40.402056 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7a8af65e-3723-40ef-944d-98bf17f9a103 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1361 microversion: 2.1 time: 1.331955 Aug 27 04:54:40.425343 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2203/4449] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:39 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1361 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:41.439394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc3f8ddd-3960-420e-aa53-9525ce9caba5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:41.440029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc3f8ddd-3960-420e-aa53-9525ce9caba5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:41.450088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:41.472454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc3f8ddd-3960-420e-aa53-9525ce9caba5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:41.473006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc3f8ddd-3960-420e-aa53-9525ce9caba5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:41.487204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc3f8ddd-3960-420e-aa53-9525ce9caba5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:41.490646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc3f8ddd-3960-420e-aa53-9525ce9caba5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:41.501650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc3f8ddd-3960-420e-aa53-9525ce9caba5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:41.503827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc3f8ddd-3960-420e-aa53-9525ce9caba5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:42.418237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dc3f8ddd-3960-420e-aa53-9525ce9caba5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:42.425274 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc3f8ddd-3960-420e-aa53-9525ce9caba5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1361 microversion: 2.1 time: 0.989141 Aug 27 04:54:42.428749 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2247/4450] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:41 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1361 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:43.450761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f404620f-0e6f-4d88-92a4-50ed1e30a79c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:43.452798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f404620f-0e6f-4d88-92a4-50ed1e30a79c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:43.481350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f404620f-0e6f-4d88-92a4-50ed1e30a79c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:43.486091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f404620f-0e6f-4d88-92a4-50ed1e30a79c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:43.489767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f404620f-0e6f-4d88-92a4-50ed1e30a79c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:43.494435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f404620f-0e6f-4d88-92a4-50ed1e30a79c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:43.496045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f404620f-0e6f-4d88-92a4-50ed1e30a79c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:43.499914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f404620f-0e6f-4d88-92a4-50ed1e30a79c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:43.622530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cb4a9f3c-ded0-4b60-a930-c3a99c2ebe7f req-bb2adc03-476c-46b1-ac09-0efec1bac933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c612c67-453a-48d4-8f78-97a00213ab46", "tag": "97b740d0-8a58-4ce5-9a2e-87124b4851c6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:43.647851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:43.648589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:43.653109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cb4a9f3c-ded0-4b60-a930-c3a99c2ebe7f req-bb2adc03-476c-46b1-ac09-0efec1bac933 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:43.653554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cb4a9f3c-ded0-4b60-a930-c3a99c2ebe7f req-bb2adc03-476c-46b1-ac09-0efec1bac933 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:43.653991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cb4a9f3c-ded0-4b60-a930-c3a99c2ebe7f req-bb2adc03-476c-46b1-ac09-0efec1bac933 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:43.723168 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cb4a9f3c-ded0-4b60-a930-c3a99c2ebe7f req-bb2adc03-476c-46b1-ac09-0efec1bac933 service nova] Creating event network-changed:97b740d0-8a58-4ce5-9a2e-87124b4851c6 for instance 4c612c67-453a-48d4-8f78-97a00213ab46 on n-h1-854823-1 Aug 27 04:54:43.738988 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cb4a9f3c-ded0-4b60-a930-c3a99c2ebe7f req-bb2adc03-476c-46b1-ac09-0efec1bac933 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120307 Aug 27 04:54:43.739638 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2248/4451] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:54:44.000312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:45.296047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f404620f-0e6f-4d88-92a4-50ed1e30a79c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:45.310888 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f404620f-0e6f-4d88-92a4-50ed1e30a79c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1361 microversion: 2.1 time: 1.866338 Aug 27 04:54:45.319047 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2204/4452] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:43 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1361 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:46.335731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab86ab8f-17b2-487c-b818-2d07f52234a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:46.337113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab86ab8f-17b2-487c-b818-2d07f52234a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:46.347995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab86ab8f-17b2-487c-b818-2d07f52234a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:46.349803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab86ab8f-17b2-487c-b818-2d07f52234a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:46.356505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab86ab8f-17b2-487c-b818-2d07f52234a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:46.357871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab86ab8f-17b2-487c-b818-2d07f52234a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:46.358510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab86ab8f-17b2-487c-b818-2d07f52234a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:46.359113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab86ab8f-17b2-487c-b818-2d07f52234a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:47.234275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab86ab8f-17b2-487c-b818-2d07f52234a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:47.263843 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab86ab8f-17b2-487c-b818-2d07f52234a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1361 microversion: 2.1 time: 0.933668 Aug 27 04:54:47.264469 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2249/4453] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:46 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1361 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:48.290283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f238611d-fa74-4cdd-a9de-e9521b4bf35b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:48.290901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f238611d-fa74-4cdd-a9de-e9521b4bf35b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:48.310025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f238611d-fa74-4cdd-a9de-e9521b4bf35b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:48.316011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f238611d-fa74-4cdd-a9de-e9521b4bf35b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:48.319269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f238611d-fa74-4cdd-a9de-e9521b4bf35b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:48.328114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f238611d-fa74-4cdd-a9de-e9521b4bf35b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:48.328981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f238611d-fa74-4cdd-a9de-e9521b4bf35b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:48.329722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f238611d-fa74-4cdd-a9de-e9521b4bf35b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:48.742720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f238611d-fa74-4cdd-a9de-e9521b4bf35b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:48.755196 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f238611d-fa74-4cdd-a9de-e9521b4bf35b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1361 microversion: 2.1 time: 0.469056 Aug 27 04:54:48.771045 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2205/4454] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:48 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1361 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:49.778450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c059a062-2a31-420b-bc6d-8e5e7993c11d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:49.779902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c059a062-2a31-420b-bc6d-8e5e7993c11d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:49.792837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c059a062-2a31-420b-bc6d-8e5e7993c11d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:49.793598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c059a062-2a31-420b-bc6d-8e5e7993c11d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:49.794599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c059a062-2a31-420b-bc6d-8e5e7993c11d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:49.795525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c059a062-2a31-420b-bc6d-8e5e7993c11d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:49.802658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c059a062-2a31-420b-bc6d-8e5e7993c11d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:49.805239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c059a062-2a31-420b-bc6d-8e5e7993c11d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:50.475948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c059a062-2a31-420b-bc6d-8e5e7993c11d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:50.492829 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c059a062-2a31-420b-bc6d-8e5e7993c11d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1361 microversion: 2.1 time: 0.711545 Aug 27 04:54:50.493897 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2250/4455] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:49 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1361 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:51.516558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c5ea901-b021-41ff-a6e6-56a5ada1f826 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:51.517989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c5ea901-b021-41ff-a6e6-56a5ada1f826 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:51.530352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c5ea901-b021-41ff-a6e6-56a5ada1f826 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:51.532254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c5ea901-b021-41ff-a6e6-56a5ada1f826 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:51.532910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c5ea901-b021-41ff-a6e6-56a5ada1f826 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:51.535876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c5ea901-b021-41ff-a6e6-56a5ada1f826 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:51.536630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c5ea901-b021-41ff-a6e6-56a5ada1f826 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:51.541148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c5ea901-b021-41ff-a6e6-56a5ada1f826 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:51.848161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-619186392", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:51.960079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] validate_networks() for [('1a15eb61-6c3a-49c3-9906-c4c8e2c9b393', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:54:52.671698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c5ea901-b021-41ff-a6e6-56a5ada1f826 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:52.691278 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c5ea901-b021-41ff-a6e6-56a5ada1f826 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1361 microversion: 2.1 time: 1.176466 Aug 27 04:54:52.695876 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2251/4456] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:51 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1361 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:53.142865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:54:53.143941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:54:53.144557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:54:53.145133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:54:53.145651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:54:53.181099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:53.204858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:53.206930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:53.209953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:53.215877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:53.216659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:53.335071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Getting quotas for project db0e87425d89463daa72c44543a13f37. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:54:53.364189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Getting quotas for user a1d403bc0f014a2b9c89e2edf2426ea3 and project db0e87425d89463daa72c44543a13f37. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:54:53.431611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:54:53.455199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:54:53.632296 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [f9e48dfe-41f1-433f-8932-d9ae34e52b54] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:54:53.715267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c9e19be-b778-4133-b91a-fe673937a355 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:53.716761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c9e19be-b778-4133-b91a-fe673937a355 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:53.729666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9e19be-b778-4133-b91a-fe673937a355 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:53.733775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9e19be-b778-4133-b91a-fe673937a355 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:53.735983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9e19be-b778-4133-b91a-fe673937a355 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:53.737914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9e19be-b778-4133-b91a-fe673937a355 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:53.738726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9e19be-b778-4133-b91a-fe673937a355 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:53.750833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9e19be-b778-4133-b91a-fe673937a355 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:54.072668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c9e19be-b778-4133-b91a-fe673937a355 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:54.088423 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c9e19be-b778-4133-b91a-fe673937a355 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1361 microversion: 2.1 time: 0.377386 Aug 27 04:54:54.091076 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2252/4457] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:53 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1361 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:54:54.554422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a05aaa6f-3db8-4224-834e-6cfc439ea4f2 req-7c67441c-ef6d-4eee-b312-5608a9fc82c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c612c67-453a-48d4-8f78-97a00213ab46", "name": "network-vif-plugged", "status": "completed", "tag": "97b740d0-8a58-4ce5-9a2e-87124b4851c6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:54:54.577208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a05aaa6f-3db8-4224-834e-6cfc439ea4f2 req-7c67441c-ef6d-4eee-b312-5608a9fc82c1 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:54.580148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a05aaa6f-3db8-4224-834e-6cfc439ea4f2 req-7c67441c-ef6d-4eee-b312-5608a9fc82c1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:54.584065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a05aaa6f-3db8-4224-834e-6cfc439ea4f2 req-7c67441c-ef6d-4eee-b312-5608a9fc82c1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:54.641540 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [f9e48dfe-41f1-433f-8932-d9ae34e52b54] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 38258. Aug 27 04:54:54.647115 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-770f4200-0f2f-45d3-ab2f-aafd63e16459 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.297407 Aug 27 04:54:54.656893 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2206/4458] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:54:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:54:54.663120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-590b6af2-0edc-4933-a286-5a6a2dc3e32f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:54.663797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-590b6af2-0edc-4933-a286-5a6a2dc3e32f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:54.693816 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a05aaa6f-3db8-4224-834e-6cfc439ea4f2 req-7c67441c-ef6d-4eee-b312-5608a9fc82c1 service nova] Creating event network-vif-plugged:97b740d0-8a58-4ce5-9a2e-87124b4851c6 for instance 4c612c67-453a-48d4-8f78-97a00213ab46 on n-h1-854823-1 Aug 27 04:54:54.702128 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a05aaa6f-3db8-4224-834e-6cfc439ea4f2 req-7c67441c-ef6d-4eee-b312-5608a9fc82c1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154423 Aug 27 04:54:54.703208 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2253/4459] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:54:54.931379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-590b6af2-0edc-4933-a286-5a6a2dc3e32f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:54.950068 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-590b6af2-0edc-4933-a286-5a6a2dc3e32f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1216 microversion: 2.1 time: 0.291770 Aug 27 04:54:54.953878 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2207/4460] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:54 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1216 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:55.112436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-855a7136-b47b-4d9b-abdc-3bfad009fcda tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:55.115876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-855a7136-b47b-4d9b-abdc-3bfad009fcda tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:55.139351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-855a7136-b47b-4d9b-abdc-3bfad009fcda tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:55.142755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-855a7136-b47b-4d9b-abdc-3bfad009fcda tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:55.143547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-855a7136-b47b-4d9b-abdc-3bfad009fcda tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:55.147119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-855a7136-b47b-4d9b-abdc-3bfad009fcda tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:55.149151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-855a7136-b47b-4d9b-abdc-3bfad009fcda tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:55.149824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-855a7136-b47b-4d9b-abdc-3bfad009fcda tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:55.627180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-855a7136-b47b-4d9b-abdc-3bfad009fcda tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:55.645696 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-855a7136-b47b-4d9b-abdc-3bfad009fcda tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1361 microversion: 2.1 time: 0.535569 Aug 27 04:54:55.649479 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2254/4461] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:55 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1361 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:55.976306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4f84661-a629-4155-b86a-31c147432916 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:55.976988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f4f84661-a629-4155-b86a-31c147432916 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:56.089641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f4f84661-a629-4155-b86a-31c147432916 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:56.098344 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f4f84661-a629-4155-b86a-31c147432916 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1216 microversion: 2.1 time: 0.127695 Aug 27 04:54:56.121812 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2208/4462] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:55 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:56.673007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c564633b-25bb-4690-9f5c-1d49e3f4ba81 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:56.673652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c564633b-25bb-4690-9f5c-1d49e3f4ba81 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:56.694351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c564633b-25bb-4690-9f5c-1d49e3f4ba81 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.700824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c564633b-25bb-4690-9f5c-1d49e3f4ba81 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.701378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c564633b-25bb-4690-9f5c-1d49e3f4ba81 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:56.702216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c564633b-25bb-4690-9f5c-1d49e3f4ba81 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:56.702766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c564633b-25bb-4690-9f5c-1d49e3f4ba81 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:56.703269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c564633b-25bb-4690-9f5c-1d49e3f4ba81 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:57.134252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7bdf97d4-26d4-40b6-ae69-2ce5d1d0c64b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:57.134702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7bdf97d4-26d4-40b6-ae69-2ce5d1d0c64b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:57.174693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c564633b-25bb-4690-9f5c-1d49e3f4ba81 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:57.185429 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c564633b-25bb-4690-9f5c-1d49e3f4ba81 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1361 microversion: 2.1 time: 0.516061 Aug 27 04:54:57.200083 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2255/4463] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:56 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1361 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:57.358779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7bdf97d4-26d4-40b6-ae69-2ce5d1d0c64b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:57.367651 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7bdf97d4-26d4-40b6-ae69-2ce5d1d0c64b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1216 microversion: 2.1 time: 0.240144 Aug 27 04:54:57.372644 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2209/4464] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:57 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1216 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:54:58.207488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3865d72-71e8-4e30-8821-091509b797d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:58.208412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3865d72-71e8-4e30-8821-091509b797d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:58.222647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3865d72-71e8-4e30-8821-091509b797d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:58.223239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3865d72-71e8-4e30-8821-091509b797d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:58.223696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3865d72-71e8-4e30-8821-091509b797d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:58.229376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3865d72-71e8-4e30-8821-091509b797d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:58.229876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3865d72-71e8-4e30-8821-091509b797d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:58.230333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3865d72-71e8-4e30-8821-091509b797d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:58.392580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8c1adf9-1bb6-4f50-b71b-7429e9e7fb82 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:58.393853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d8c1adf9-1bb6-4f50-b71b-7429e9e7fb82 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:58.583852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d8c1adf9-1bb6-4f50-b71b-7429e9e7fb82 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:58.591633 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d8c1adf9-1bb6-4f50-b71b-7429e9e7fb82 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1216 microversion: 2.1 time: 0.203621 Aug 27 04:54:58.614070 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2210/4465] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:58 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1216 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:58.827042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3865d72-71e8-4e30-8821-091509b797d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:58.839000 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3865d72-71e8-4e30-8821-091509b797d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1546 microversion: 2.1 time: 0.635887 Aug 27 04:54:58.843073 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2256/4466] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:58 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1546 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:54:58.870338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-69c0cf19-1dfe-4d88-9633-02b9378fa883 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:58.871265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-69c0cf19-1dfe-4d88-9633-02b9378fa883 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:58.887033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69c0cf19-1dfe-4d88-9633-02b9378fa883 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:58.888164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69c0cf19-1dfe-4d88-9633-02b9378fa883 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:58.888795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69c0cf19-1dfe-4d88-9633-02b9378fa883 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:58.889681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69c0cf19-1dfe-4d88-9633-02b9378fa883 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:58.890565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69c0cf19-1dfe-4d88-9633-02b9378fa883 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:58.890933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69c0cf19-1dfe-4d88-9633-02b9378fa883 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:59.210847 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-69c0cf19-1dfe-4d88-9633-02b9378fa883 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.349216 Aug 27 04:54:59.212780 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2211/4467] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 04:54:58 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/os-interface => generated 284 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:54:59.625508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-981f04cf-e8d0-44a8-b513-39d3e1d37609 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:54:59.626012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-981f04cf-e8d0-44a8-b513-39d3e1d37609 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:54:59.647064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-981f04cf-e8d0-44a8-b513-39d3e1d37609 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:59.647332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-981f04cf-e8d0-44a8-b513-39d3e1d37609 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:59.651998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-981f04cf-e8d0-44a8-b513-39d3e1d37609 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:59.653303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-981f04cf-e8d0-44a8-b513-39d3e1d37609 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:54:59.656303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-981f04cf-e8d0-44a8-b513-39d3e1d37609 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:54:59.656796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-981f04cf-e8d0-44a8-b513-39d3e1d37609 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:54:59.794585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-981f04cf-e8d0-44a8-b513-39d3e1d37609 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:54:59.824291 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-981f04cf-e8d0-44a8-b513-39d3e1d37609 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1220 microversion: 2.1 time: 0.197764 Aug 27 04:54:59.827267 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2257/4468] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:54:59 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1220 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:00.846933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e53369b4-bc93-465d-83d8-d220379b4650 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:00.848185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e53369b4-bc93-465d-83d8-d220379b4650 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:00.862583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e53369b4-bc93-465d-83d8-d220379b4650 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:00.863330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e53369b4-bc93-465d-83d8-d220379b4650 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:00.865076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e53369b4-bc93-465d-83d8-d220379b4650 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:00.866001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e53369b4-bc93-465d-83d8-d220379b4650 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:00.867704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e53369b4-bc93-465d-83d8-d220379b4650 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:00.870010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e53369b4-bc93-465d-83d8-d220379b4650 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:00.978428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e53369b4-bc93-465d-83d8-d220379b4650 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:01.027014 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e53369b4-bc93-465d-83d8-d220379b4650 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1268 microversion: 2.1 time: 0.162249 Aug 27 04:55:01.068648 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2212/4469] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:00 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1268 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:02.085464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8341d3c-20c1-4f30-8658-ae568bc8ebea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:02.086181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b8341d3c-20c1-4f30-8658-ae568bc8ebea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:02.115794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8341d3c-20c1-4f30-8658-ae568bc8ebea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.116295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8341d3c-20c1-4f30-8658-ae568bc8ebea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.116766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8341d3c-20c1-4f30-8658-ae568bc8ebea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.117488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8341d3c-20c1-4f30-8658-ae568bc8ebea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.121807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8341d3c-20c1-4f30-8658-ae568bc8ebea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.130252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8341d3c-20c1-4f30-8658-ae568bc8ebea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.145998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=73 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:02.589779 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:55:02.590216 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 04:55:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f (ip 10.222.0.79) !!! Aug 27 04:55:02.594534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b8341d3c-20c1-4f30-8658-ae568bc8ebea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:02.623561 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b8341d3c-20c1-4f30-8658-ae568bc8ebea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1274 microversion: 2.1 time: 0.544848 Aug 27 04:55:02.627703 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2258/4470] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:02 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1274 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:02.657338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1ca7a651-f385-40a1-879c-d86227852585 req-5204a93a-7096-46ec-82de-75ea6c918ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c612c67-453a-48d4-8f78-97a00213ab46", "tag": "97b740d0-8a58-4ce5-9a2e-87124b4851c6"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:02.686882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1ca7a651-f385-40a1-879c-d86227852585 req-5204a93a-7096-46ec-82de-75ea6c918ab8 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:02.688352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1ca7a651-f385-40a1-879c-d86227852585 req-5204a93a-7096-46ec-82de-75ea6c918ab8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:02.689631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1ca7a651-f385-40a1-879c-d86227852585 req-5204a93a-7096-46ec-82de-75ea6c918ab8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:02.711816 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1ca7a651-f385-40a1-879c-d86227852585 req-5204a93a-7096-46ec-82de-75ea6c918ab8 service nova] Creating event network-changed:97b740d0-8a58-4ce5-9a2e-87124b4851c6 for instance 4c612c67-453a-48d4-8f78-97a00213ab46 on n-h1-854823-1 Aug 27 04:55:02.719328 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1ca7a651-f385-40a1-879c-d86227852585 req-5204a93a-7096-46ec-82de-75ea6c918ab8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065930 Aug 27 04:55:02.723569 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2213/4471] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:03.648776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9782876c-7473-4afc-975a-9bebd78fd3b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:03.650055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9782876c-7473-4afc-975a-9bebd78fd3b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:03.672371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9782876c-7473-4afc-975a-9bebd78fd3b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.676077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9782876c-7473-4afc-975a-9bebd78fd3b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.677474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9782876c-7473-4afc-975a-9bebd78fd3b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:03.681401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9782876c-7473-4afc-975a-9bebd78fd3b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:03.683998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9782876c-7473-4afc-975a-9bebd78fd3b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:03.684727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9782876c-7473-4afc-975a-9bebd78fd3b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:04.133576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9782876c-7473-4afc-975a-9bebd78fd3b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:04.165244 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9782876c-7473-4afc-975a-9bebd78fd3b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1316 microversion: 2.1 time: 0.514759 Aug 27 04:55:04.187645 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2259/4472] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:03 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:05.184349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:05.198970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1034b1d6-caa7-48fb-83b5-24fd8cecb4f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:05.208071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1034b1d6-caa7-48fb-83b5-24fd8cecb4f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:05.215542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:05.231950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1034b1d6-caa7-48fb-83b5-24fd8cecb4f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:05.232839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1034b1d6-caa7-48fb-83b5-24fd8cecb4f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:05.233500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1034b1d6-caa7-48fb-83b5-24fd8cecb4f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:05.234653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1034b1d6-caa7-48fb-83b5-24fd8cecb4f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:05.235328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1034b1d6-caa7-48fb-83b5-24fd8cecb4f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:05.236987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1034b1d6-caa7-48fb-83b5-24fd8cecb4f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:05.304735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=39 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:06.739145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1034b1d6-caa7-48fb-83b5-24fd8cecb4f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:06.766520 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1034b1d6-caa7-48fb-83b5-24fd8cecb4f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1316 microversion: 2.1 time: 1.568808 Aug 27 04:55:06.767215 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2214/4473] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:05 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1316 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:07.787421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e0cb24b-15e1-40a7-8b74-03c925338fee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:07.789698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e0cb24b-15e1-40a7-8b74-03c925338fee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:07.802187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e0cb24b-15e1-40a7-8b74-03c925338fee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:07.817324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e0cb24b-15e1-40a7-8b74-03c925338fee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:07.818038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e0cb24b-15e1-40a7-8b74-03c925338fee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:07.819263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e0cb24b-15e1-40a7-8b74-03c925338fee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:07.819884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e0cb24b-15e1-40a7-8b74-03c925338fee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:07.820496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e0cb24b-15e1-40a7-8b74-03c925338fee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:08.356721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1e0cb24b-15e1-40a7-8b74-03c925338fee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:08.373951 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e0cb24b-15e1-40a7-8b74-03c925338fee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1316 microversion: 2.1 time: 0.590384 Aug 27 04:55:08.393015 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2260/4474] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:07 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1316 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:09.102405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-706a672d-c0c5-4f57-a8a6-d638e7b540bb req-70cdfddd-be9f-4155-90a4-70e4da174520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228b4767-bbe2-41d0-a7d4-a6670e79043f", "tag": "1b95ce59-5e34-4673-9606-3f53d8d7b9d1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:09.158545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=14 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:09.163863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-706a672d-c0c5-4f57-a8a6-d638e7b540bb req-70cdfddd-be9f-4155-90a4-70e4da174520 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:09.176686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-706a672d-c0c5-4f57-a8a6-d638e7b540bb req-70cdfddd-be9f-4155-90a4-70e4da174520 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:09.178742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-706a672d-c0c5-4f57-a8a6-d638e7b540bb req-70cdfddd-be9f-4155-90a4-70e4da174520 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:09.215380 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-706a672d-c0c5-4f57-a8a6-d638e7b540bb req-70cdfddd-be9f-4155-90a4-70e4da174520 service nova] Creating event network-changed:1b95ce59-5e34-4673-9606-3f53d8d7b9d1 for instance 228b4767-bbe2-41d0-a7d4-a6670e79043f on n-h2-854823-1 Aug 27 04:55:09.230759 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-706a672d-c0c5-4f57-a8a6-d638e7b540bb req-70cdfddd-be9f-4155-90a4-70e4da174520 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140031 Aug 27 04:55:09.237598 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2215/4475] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:09.399195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d3b34884-055b-4b5e-98ba-dd673d7d91b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:09.399762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d3b34884-055b-4b5e-98ba-dd673d7d91b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:09.428682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3b34884-055b-4b5e-98ba-dd673d7d91b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:09.429207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3b34884-055b-4b5e-98ba-dd673d7d91b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:09.429776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3b34884-055b-4b5e-98ba-dd673d7d91b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:09.430375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3b34884-055b-4b5e-98ba-dd673d7d91b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:09.430833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3b34884-055b-4b5e-98ba-dd673d7d91b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:09.431259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3b34884-055b-4b5e-98ba-dd673d7d91b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:10.006786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3b34884-055b-4b5e-98ba-dd673d7d91b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:10.027307 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d3b34884-055b-4b5e-98ba-dd673d7d91b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1316 microversion: 2.1 time: 0.627448 Aug 27 04:55:10.031343 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2261/4476] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:09 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1316 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:11.053243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-28a40a9a-0f66-44c5-ae6c-405c0654e328 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:11.053940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-28a40a9a-0f66-44c5-ae6c-405c0654e328 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:11.069011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28a40a9a-0f66-44c5-ae6c-405c0654e328 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:11.069256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28a40a9a-0f66-44c5-ae6c-405c0654e328 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:11.069670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28a40a9a-0f66-44c5-ae6c-405c0654e328 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:11.070382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28a40a9a-0f66-44c5-ae6c-405c0654e328 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:11.070981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28a40a9a-0f66-44c5-ae6c-405c0654e328 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:11.071407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28a40a9a-0f66-44c5-ae6c-405c0654e328 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:11.490163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-28a40a9a-0f66-44c5-ae6c-405c0654e328 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:11.498433 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-28a40a9a-0f66-44c5-ae6c-405c0654e328 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1316 microversion: 2.1 time: 0.450459 Aug 27 04:55:11.499032 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2216/4477] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:11 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:12.522259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0a1eacc-60b1-41ff-a74b-d03d54734e52 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:12.522802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0a1eacc-60b1-41ff-a74b-d03d54734e52 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:12.525568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=30 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:12.541882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0a1eacc-60b1-41ff-a74b-d03d54734e52 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:12.542548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0a1eacc-60b1-41ff-a74b-d03d54734e52 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:12.543004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0a1eacc-60b1-41ff-a74b-d03d54734e52 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:12.547254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0a1eacc-60b1-41ff-a74b-d03d54734e52 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:12.547802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0a1eacc-60b1-41ff-a74b-d03d54734e52 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:12.548247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0a1eacc-60b1-41ff-a74b-d03d54734e52 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:12.926867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0a1eacc-60b1-41ff-a74b-d03d54734e52 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:12.937368 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0a1eacc-60b1-41ff-a74b-d03d54734e52 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1316 microversion: 2.1 time: 0.419246 Aug 27 04:55:12.938792 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2262/4478] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:12 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:13.962626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e7f09db-a2e2-44f6-8b50-9bcf3c4c9f44 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:13.963582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4e7f09db-a2e2-44f6-8b50-9bcf3c4c9f44 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:13.978659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e7f09db-a2e2-44f6-8b50-9bcf3c4c9f44 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:13.980202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e7f09db-a2e2-44f6-8b50-9bcf3c4c9f44 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:13.982483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e7f09db-a2e2-44f6-8b50-9bcf3c4c9f44 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:13.987077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e7f09db-a2e2-44f6-8b50-9bcf3c4c9f44 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:13.987861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e7f09db-a2e2-44f6-8b50-9bcf3c4c9f44 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:13.988561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e7f09db-a2e2-44f6-8b50-9bcf3c4c9f44 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:14.290667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4e7f09db-a2e2-44f6-8b50-9bcf3c4c9f44 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:14.316779 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4e7f09db-a2e2-44f6-8b50-9bcf3c4c9f44 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1316 microversion: 2.1 time: 0.358295 Aug 27 04:55:14.326062 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2217/4479] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:13 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:15.354860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-506549ab-d583-4040-b88a-65c0769d866c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:15.356066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-506549ab-d583-4040-b88a-65c0769d866c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:15.369698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-506549ab-d583-4040-b88a-65c0769d866c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:15.371310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-506549ab-d583-4040-b88a-65c0769d866c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:15.372171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-506549ab-d583-4040-b88a-65c0769d866c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:15.374066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-506549ab-d583-4040-b88a-65c0769d866c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:15.376068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-506549ab-d583-4040-b88a-65c0769d866c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:15.377961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-506549ab-d583-4040-b88a-65c0769d866c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:15.746983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-506549ab-d583-4040-b88a-65c0769d866c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:15.758451 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-506549ab-d583-4040-b88a-65c0769d866c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1316 microversion: 2.1 time: 0.407590 Aug 27 04:55:15.776077 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2263/4480] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:15 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:16.786243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-771e2dcf-126f-43e3-ae23-4c32edca4064 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:16.787324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-771e2dcf-126f-43e3-ae23-4c32edca4064 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:16.797108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-771e2dcf-126f-43e3-ae23-4c32edca4064 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:16.801372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-771e2dcf-126f-43e3-ae23-4c32edca4064 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:16.801954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-771e2dcf-126f-43e3-ae23-4c32edca4064 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:16.805581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-771e2dcf-126f-43e3-ae23-4c32edca4064 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:16.805581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-771e2dcf-126f-43e3-ae23-4c32edca4064 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:16.805581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-771e2dcf-126f-43e3-ae23-4c32edca4064 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:17.131186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-771e2dcf-126f-43e3-ae23-4c32edca4064 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:17.147087 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-771e2dcf-126f-43e3-ae23-4c32edca4064 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1316 microversion: 2.1 time: 0.365595 Aug 27 04:55:17.148178 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2218/4481] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:16 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:17.710928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-959ff20f-1f3f-47e9-9ad3-d63978dff147 req-b07ce2d8-a6a1-4a1b-8f7f-78c11fd1d858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228b4767-bbe2-41d0-a7d4-a6670e79043f", "name": "network-vif-plugged", "status": "completed", "tag": "1b95ce59-5e34-4673-9606-3f53d8d7b9d1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:17.730313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-959ff20f-1f3f-47e9-9ad3-d63978dff147 req-b07ce2d8-a6a1-4a1b-8f7f-78c11fd1d858 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:17.731113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-959ff20f-1f3f-47e9-9ad3-d63978dff147 req-b07ce2d8-a6a1-4a1b-8f7f-78c11fd1d858 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:17.731900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-959ff20f-1f3f-47e9-9ad3-d63978dff147 req-b07ce2d8-a6a1-4a1b-8f7f-78c11fd1d858 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:17.778586 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-959ff20f-1f3f-47e9-9ad3-d63978dff147 req-b07ce2d8-a6a1-4a1b-8f7f-78c11fd1d858 service nova] Creating event network-vif-plugged:1b95ce59-5e34-4673-9606-3f53d8d7b9d1 for instance 228b4767-bbe2-41d0-a7d4-a6670e79043f on n-h2-854823-1 Aug 27 04:55:17.817064 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-959ff20f-1f3f-47e9-9ad3-d63978dff147 req-b07ce2d8-a6a1-4a1b-8f7f-78c11fd1d858 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110973 Aug 27 04:55:17.817737 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2264/4482] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:18.169556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-42a92b7d-3355-4c88-a8a3-dab3d9f5e51c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:18.170860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-42a92b7d-3355-4c88-a8a3-dab3d9f5e51c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:18.182218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42a92b7d-3355-4c88-a8a3-dab3d9f5e51c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:18.183816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42a92b7d-3355-4c88-a8a3-dab3d9f5e51c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:18.184662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42a92b7d-3355-4c88-a8a3-dab3d9f5e51c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:18.186800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42a92b7d-3355-4c88-a8a3-dab3d9f5e51c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:18.188220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42a92b7d-3355-4c88-a8a3-dab3d9f5e51c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:18.189704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42a92b7d-3355-4c88-a8a3-dab3d9f5e51c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:18.422205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-42a92b7d-3355-4c88-a8a3-dab3d9f5e51c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:18.437530 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-42a92b7d-3355-4c88-a8a3-dab3d9f5e51c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1316 microversion: 2.1 time: 0.269311 Aug 27 04:55:18.438798 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2219/4483] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:18 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:19.463848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9905e7b-24cc-4649-8fa2-4836878ed8d2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:19.464721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9905e7b-24cc-4649-8fa2-4836878ed8d2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:19.476258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9905e7b-24cc-4649-8fa2-4836878ed8d2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:19.477081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9905e7b-24cc-4649-8fa2-4836878ed8d2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:19.477834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9905e7b-24cc-4649-8fa2-4836878ed8d2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:19.478717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9905e7b-24cc-4649-8fa2-4836878ed8d2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:19.479313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9905e7b-24cc-4649-8fa2-4836878ed8d2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:19.480920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9905e7b-24cc-4649-8fa2-4836878ed8d2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:19.746194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9905e7b-24cc-4649-8fa2-4836878ed8d2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:19.755842 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9905e7b-24cc-4649-8fa2-4836878ed8d2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.298997 Aug 27 04:55:19.771113 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2265/4484] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:19 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:19.952217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-685698679", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:20.067584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] validate_networks() for [('1a15eb61-6c3a-49c3-9906-c4c8e2c9b393', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:55:21.894625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:55:21.895219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:55:21.896386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:55:21.896860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:55:21.897280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:55:21.915940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:21.918650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:21.919163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:21.920005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:21.921298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:21.921741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:22.004974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Getting quotas for project db0e87425d89463daa72c44543a13f37. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:55:22.024322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Getting quotas for user a1d403bc0f014a2b9c89e2edf2426ea3 and project db0e87425d89463daa72c44543a13f37. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:55:22.044388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:55:22.046735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:55:22.162480 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e934e3b-d15a-4afc-a358-fff57fbb832c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.212510 Aug 27 04:55:22.168997 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2220/4485] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:55:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:55:22.173911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff5b0f1a-4477-4fda-9188-3eb88a08cc57 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:22.174529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ff5b0f1a-4477-4fda-9188-3eb88a08cc57 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:22.407962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ff5b0f1a-4477-4fda-9188-3eb88a08cc57 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:22.418591 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff5b0f1a-4477-4fda-9188-3eb88a08cc57 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1216 microversion: 2.1 time: 0.248451 Aug 27 04:55:22.421353 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2266/4486] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:22 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1216 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:23.456449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4215507e-711e-41f6-985a-89d97f2ca1d4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:23.460078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4215507e-711e-41f6-985a-89d97f2ca1d4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:23.496019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4215507e-711e-41f6-985a-89d97f2ca1d4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:23.498996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4215507e-711e-41f6-985a-89d97f2ca1d4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:23.499469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4215507e-711e-41f6-985a-89d97f2ca1d4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:23.502421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4215507e-711e-41f6-985a-89d97f2ca1d4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:23.505515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4215507e-711e-41f6-985a-89d97f2ca1d4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:23.507283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4215507e-711e-41f6-985a-89d97f2ca1d4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:23.670577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4215507e-711e-41f6-985a-89d97f2ca1d4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:23.687823 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4215507e-711e-41f6-985a-89d97f2ca1d4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1268 microversion: 2.1 time: 0.244933 Aug 27 04:55:23.702071 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2221/4487] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:23 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1268 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:24.711930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2927790c-8021-440d-8a1a-f7cd9b9a72a1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:24.712522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2927790c-8021-440d-8a1a-f7cd9b9a72a1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:24.726060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2927790c-8021-440d-8a1a-f7cd9b9a72a1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:24.730735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2927790c-8021-440d-8a1a-f7cd9b9a72a1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:24.731201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2927790c-8021-440d-8a1a-f7cd9b9a72a1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:24.733687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2927790c-8021-440d-8a1a-f7cd9b9a72a1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:24.733687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2927790c-8021-440d-8a1a-f7cd9b9a72a1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:24.735247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2927790c-8021-440d-8a1a-f7cd9b9a72a1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:24.835747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2927790c-8021-440d-8a1a-f7cd9b9a72a1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:24.847402 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2927790c-8021-440d-8a1a-f7cd9b9a72a1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1274 microversion: 2.1 time: 0.139270 Aug 27 04:55:24.848981 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2267/4488] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:24 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1274 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:25.873877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d1d6deef-a6ae-4b71-9384-acb797b11c1f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:25.875531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d1d6deef-a6ae-4b71-9384-acb797b11c1f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:25.896447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1d6deef-a6ae-4b71-9384-acb797b11c1f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.896987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1d6deef-a6ae-4b71-9384-acb797b11c1f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.897428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1d6deef-a6ae-4b71-9384-acb797b11c1f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:25.898183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1d6deef-a6ae-4b71-9384-acb797b11c1f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:25.898579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1d6deef-a6ae-4b71-9384-acb797b11c1f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:25.911180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1d6deef-a6ae-4b71-9384-acb797b11c1f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:26.154597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d1d6deef-a6ae-4b71-9384-acb797b11c1f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:26.167945 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d1d6deef-a6ae-4b71-9384-acb797b11c1f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1274 microversion: 2.1 time: 0.299239 Aug 27 04:55:26.173777 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2222/4489] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:25 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1274 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:27.199630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3dc7a71a-df3e-4443-a7c4-f2795b9e8f60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:27.201245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3dc7a71a-df3e-4443-a7c4-f2795b9e8f60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:27.211922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dc7a71a-df3e-4443-a7c4-f2795b9e8f60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:27.221080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dc7a71a-df3e-4443-a7c4-f2795b9e8f60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:27.229068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dc7a71a-df3e-4443-a7c4-f2795b9e8f60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:27.243983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dc7a71a-df3e-4443-a7c4-f2795b9e8f60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:27.244497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dc7a71a-df3e-4443-a7c4-f2795b9e8f60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:27.245587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dc7a71a-df3e-4443-a7c4-f2795b9e8f60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:27.695942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3dc7a71a-df3e-4443-a7c4-f2795b9e8f60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:27.706046 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3dc7a71a-df3e-4443-a7c4-f2795b9e8f60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1316 microversion: 2.1 time: 0.512610 Aug 27 04:55:27.707263 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2268/4490] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:27 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:28.001980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-9505f1c7-e697-4870-8e48-1fb0ab67e721 req-a55cc279-36dd-4088-ba6f-dc74c048365f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ce8444-1fbd-4b28-90bb-a5a472e04486", "tag": "8798690d-62eb-484c-8c55-076f3b5ca3af"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:28.027139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9505f1c7-e697-4870-8e48-1fb0ab67e721 req-a55cc279-36dd-4088-ba6f-dc74c048365f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:28.027642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9505f1c7-e697-4870-8e48-1fb0ab67e721 req-a55cc279-36dd-4088-ba6f-dc74c048365f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:28.042219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9505f1c7-e697-4870-8e48-1fb0ab67e721 req-a55cc279-36dd-4088-ba6f-dc74c048365f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:28.076320 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-9505f1c7-e697-4870-8e48-1fb0ab67e721 req-a55cc279-36dd-4088-ba6f-dc74c048365f service nova] Creating event network-changed:8798690d-62eb-484c-8c55-076f3b5ca3af for instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 on n-h1-854823-1 Aug 27 04:55:28.098785 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-9505f1c7-e697-4870-8e48-1fb0ab67e721 req-a55cc279-36dd-4088-ba6f-dc74c048365f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101504 Aug 27 04:55:28.100129 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2223/4491] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:28.732997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c9ab27e9-bc6e-4bf4-9e26-501e6274a67c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:28.734161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c9ab27e9-bc6e-4bf4-9e26-501e6274a67c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:28.753243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9ab27e9-bc6e-4bf4-9e26-501e6274a67c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:28.755018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9ab27e9-bc6e-4bf4-9e26-501e6274a67c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:28.769750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9ab27e9-bc6e-4bf4-9e26-501e6274a67c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:28.770652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9ab27e9-bc6e-4bf4-9e26-501e6274a67c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:28.771154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9ab27e9-bc6e-4bf4-9e26-501e6274a67c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:28.771593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9ab27e9-bc6e-4bf4-9e26-501e6274a67c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:29.136793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c9ab27e9-bc6e-4bf4-9e26-501e6274a67c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:29.145580 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c9ab27e9-bc6e-4bf4-9e26-501e6274a67c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1316 microversion: 2.1 time: 0.417892 Aug 27 04:55:29.147404 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2269/4492] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:28 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:30.175263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1b4ea6a6-8ab1-44c5-9534-7505a3d24af1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:30.175980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1b4ea6a6-8ab1-44c5-9534-7505a3d24af1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:30.205122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b4ea6a6-8ab1-44c5-9534-7505a3d24af1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:30.209345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b4ea6a6-8ab1-44c5-9534-7505a3d24af1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:30.210017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b4ea6a6-8ab1-44c5-9534-7505a3d24af1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:30.211668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b4ea6a6-8ab1-44c5-9534-7505a3d24af1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:30.213080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b4ea6a6-8ab1-44c5-9534-7505a3d24af1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:30.215406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b4ea6a6-8ab1-44c5-9534-7505a3d24af1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:30.497584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1b4ea6a6-8ab1-44c5-9534-7505a3d24af1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:30.509842 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1b4ea6a6-8ab1-44c5-9534-7505a3d24af1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1316 microversion: 2.1 time: 0.344952 Aug 27 04:55:30.525170 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2224/4493] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:30 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:31.535539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36de0b7b-8bbe-4a7c-9393-a97495f43e5b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:31.536803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36de0b7b-8bbe-4a7c-9393-a97495f43e5b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:31.548935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36de0b7b-8bbe-4a7c-9393-a97495f43e5b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:31.550223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36de0b7b-8bbe-4a7c-9393-a97495f43e5b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:31.555808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36de0b7b-8bbe-4a7c-9393-a97495f43e5b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:31.556842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36de0b7b-8bbe-4a7c-9393-a97495f43e5b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:31.557881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36de0b7b-8bbe-4a7c-9393-a97495f43e5b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:31.558488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36de0b7b-8bbe-4a7c-9393-a97495f43e5b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:31.946776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36de0b7b-8bbe-4a7c-9393-a97495f43e5b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:31.958602 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36de0b7b-8bbe-4a7c-9393-a97495f43e5b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1316 microversion: 2.1 time: 0.427074 Aug 27 04:55:31.970580 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2270/4494] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:31 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:32.992194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-00696648-f6f9-4a85-9b62-51d5cf2cd237 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:32.993265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-00696648-f6f9-4a85-9b62-51d5cf2cd237 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:32.996520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:33.000095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:33.016684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2125552500", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:33.028935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00696648-f6f9-4a85-9b62-51d5cf2cd237 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:33.032339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00696648-f6f9-4a85-9b62-51d5cf2cd237 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:33.036336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00696648-f6f9-4a85-9b62-51d5cf2cd237 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:33.038291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00696648-f6f9-4a85-9b62-51d5cf2cd237 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:33.041273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00696648-f6f9-4a85-9b62-51d5cf2cd237 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:33.045443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00696648-f6f9-4a85-9b62-51d5cf2cd237 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:33.051617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:33.167827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:55:33.599977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-00696648-f6f9-4a85-9b62-51d5cf2cd237 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:33.615369 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-00696648-f6f9-4a85-9b62-51d5cf2cd237 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1316 microversion: 2.1 time: 0.626482 Aug 27 04:55:33.617434 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2225/4495] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:32 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1316 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:33.661931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:55:33.662467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:55:33.663156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:55:33.663783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:55:33.664364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:55:33.680918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:33.681434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:33.681871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:33.682782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:33.683825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:33.684606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:33.695852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=68 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:33.718047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Getting quotas for project 1d1c83f3e41a4006a8ca519bbd777c9b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:55:33.729918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Getting quotas for user 720d586dba5a4dc1affd3ac9e509e63e and project 1d1c83f3e41a4006a8ca519bbd777c9b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:55:33.749109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:55:33.752785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:55:33.818475 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-08dc868f-a7b3-48b4-b6d6-64d5edeb2fdb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806602 Aug 27 04:55:33.819429 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2271/4496] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:55:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:55:33.830651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2a6ff936-ffb7-4b4c-8b64-4ed81ac40e96 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:33.831558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2a6ff936-ffb7-4b4c-8b64-4ed81ac40e96 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:33.955319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a6ff936-ffb7-4b4c-8b64-4ed81ac40e96 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:33.964738 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2a6ff936-ffb7-4b4c-8b64-4ed81ac40e96 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1215 microversion: 2.1 time: 0.137939 Aug 27 04:55:33.965749 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2226/4497] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:33 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:34.642646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd224130-4355-4d6d-b947-cbcf1e3db4b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:34.643964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd224130-4355-4d6d-b947-cbcf1e3db4b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:34.668142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd224130-4355-4d6d-b947-cbcf1e3db4b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:34.673662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd224130-4355-4d6d-b947-cbcf1e3db4b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:34.675452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd224130-4355-4d6d-b947-cbcf1e3db4b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:34.692198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd224130-4355-4d6d-b947-cbcf1e3db4b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:34.696182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd224130-4355-4d6d-b947-cbcf1e3db4b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:34.697168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd224130-4355-4d6d-b947-cbcf1e3db4b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:34.989047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7b46fd84-4586-4e69-a708-ea65724249e1 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:34.990717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7b46fd84-4586-4e69-a708-ea65724249e1 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:35.011785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd224130-4355-4d6d-b947-cbcf1e3db4b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:35.014489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b46fd84-4586-4e69-a708-ea65724249e1 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:35.015007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b46fd84-4586-4e69-a708-ea65724249e1 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:35.015590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b46fd84-4586-4e69-a708-ea65724249e1 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:35.016179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b46fd84-4586-4e69-a708-ea65724249e1 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:35.016686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b46fd84-4586-4e69-a708-ea65724249e1 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:35.017102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b46fd84-4586-4e69-a708-ea65724249e1 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:35.028919 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd224130-4355-4d6d-b947-cbcf1e3db4b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1316 microversion: 2.1 time: 0.391520 Aug 27 04:55:35.030493 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2272/4498] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:34 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:35.166935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b46fd84-4586-4e69-a708-ea65724249e1 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:35.175594 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7b46fd84-4586-4e69-a708-ea65724249e1 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1267 microversion: 2.1 time: 0.192210 Aug 27 04:55:35.179402 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2227/4499] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:34 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:36.060084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2fa12f06-376f-4af7-aa8b-4c19e1e41c82 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:36.060744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2fa12f06-376f-4af7-aa8b-4c19e1e41c82 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:36.072168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fa12f06-376f-4af7-aa8b-4c19e1e41c82 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:36.074382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fa12f06-376f-4af7-aa8b-4c19e1e41c82 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:36.074843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fa12f06-376f-4af7-aa8b-4c19e1e41c82 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:36.076943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fa12f06-376f-4af7-aa8b-4c19e1e41c82 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:36.078507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fa12f06-376f-4af7-aa8b-4c19e1e41c82 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:36.079254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fa12f06-376f-4af7-aa8b-4c19e1e41c82 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:36.203605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-362796f0-72dc-426b-9e8d-18ca73110338 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:36.205070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-362796f0-72dc-426b-9e8d-18ca73110338 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:36.211027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:36.224236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-362796f0-72dc-426b-9e8d-18ca73110338 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:36.224758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-362796f0-72dc-426b-9e8d-18ca73110338 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:36.225438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-362796f0-72dc-426b-9e8d-18ca73110338 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:36.226331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-362796f0-72dc-426b-9e8d-18ca73110338 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:36.226965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-362796f0-72dc-426b-9e8d-18ca73110338 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:36.227566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-362796f0-72dc-426b-9e8d-18ca73110338 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:36.232954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=66 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:36.291108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2fa12f06-376f-4af7-aa8b-4c19e1e41c82 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:36.308050 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2fa12f06-376f-4af7-aa8b-4c19e1e41c82 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1316 microversion: 2.1 time: 0.252814 Aug 27 04:55:36.312751 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2273/4500] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:36 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:36.326939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-362796f0-72dc-426b-9e8d-18ca73110338 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:36.337305 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-362796f0-72dc-426b-9e8d-18ca73110338 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1273 microversion: 2.1 time: 0.140013 Aug 27 04:55:36.354337 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2228/4501] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:36 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:36.874575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-10b1917e-043d-4ddd-bd7d-e8969737f920 req-3c4ac8a1-bf7a-4eb4-8f79-c773031c35b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ce8444-1fbd-4b28-90bb-a5a472e04486", "name": "network-vif-plugged", "status": "completed", "tag": "8798690d-62eb-484c-8c55-076f3b5ca3af"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:36.900596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10b1917e-043d-4ddd-bd7d-e8969737f920 req-3c4ac8a1-bf7a-4eb4-8f79-c773031c35b8 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:36.901380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10b1917e-043d-4ddd-bd7d-e8969737f920 req-3c4ac8a1-bf7a-4eb4-8f79-c773031c35b8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:36.901838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10b1917e-043d-4ddd-bd7d-e8969737f920 req-3c4ac8a1-bf7a-4eb4-8f79-c773031c35b8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:36.919740 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-10b1917e-043d-4ddd-bd7d-e8969737f920 req-3c4ac8a1-bf7a-4eb4-8f79-c773031c35b8 service nova] Creating event network-vif-plugged:8798690d-62eb-484c-8c55-076f3b5ca3af for instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 on n-h1-854823-1 Aug 27 04:55:36.931730 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-10b1917e-043d-4ddd-bd7d-e8969737f920 req-3c4ac8a1-bf7a-4eb4-8f79-c773031c35b8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061296 Aug 27 04:55:36.933065 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2274/4502] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:37.333940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b4aac0d8-ffac-41ec-980c-e4dc71e610de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:37.334797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b4aac0d8-ffac-41ec-980c-e4dc71e610de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:37.343970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4aac0d8-ffac-41ec-980c-e4dc71e610de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:37.345301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4aac0d8-ffac-41ec-980c-e4dc71e610de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:37.346502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4aac0d8-ffac-41ec-980c-e4dc71e610de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:37.347322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4aac0d8-ffac-41ec-980c-e4dc71e610de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:37.347982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4aac0d8-ffac-41ec-980c-e4dc71e610de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:37.348496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4aac0d8-ffac-41ec-980c-e4dc71e610de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:37.366357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53b1b5e2-5371-4362-a160-36364848371a tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:37.368848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-53b1b5e2-5371-4362-a160-36364848371a tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:37.383034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b1b5e2-5371-4362-a160-36364848371a tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:37.384146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b1b5e2-5371-4362-a160-36364848371a tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:37.384840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b1b5e2-5371-4362-a160-36364848371a tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:37.385782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b1b5e2-5371-4362-a160-36364848371a tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:37.386453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b1b5e2-5371-4362-a160-36364848371a tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:37.387168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b1b5e2-5371-4362-a160-36364848371a tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:37.622494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-53b1b5e2-5371-4362-a160-36364848371a tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:37.632354 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-53b1b5e2-5371-4362-a160-36364848371a tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1315 microversion: 2.1 time: 0.273405 Aug 27 04:55:37.633901 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2275/4503] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:37 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:37.884322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b4aac0d8-ffac-41ec-980c-e4dc71e610de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:37.892783 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b4aac0d8-ffac-41ec-980c-e4dc71e610de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1316 microversion: 2.1 time: 0.564064 Aug 27 04:55:37.901380 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2229/4504] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:37 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1316 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:38.661788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d34eb502-31fe-4ef1-be40-601f5f36f7bb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:38.662420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d34eb502-31fe-4ef1-be40-601f5f36f7bb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:38.693048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d34eb502-31fe-4ef1-be40-601f5f36f7bb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:38.693823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d34eb502-31fe-4ef1-be40-601f5f36f7bb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:38.694283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d34eb502-31fe-4ef1-be40-601f5f36f7bb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:38.696254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d34eb502-31fe-4ef1-be40-601f5f36f7bb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:38.700086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d34eb502-31fe-4ef1-be40-601f5f36f7bb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:38.701195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d34eb502-31fe-4ef1-be40-601f5f36f7bb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:38.790591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-6bfabf4e-8885-4b13-82f6-d1aef2c9d79a req-56d6c80c-a969-4764-8b57-457f487bfdda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82b82f3-34f9-40a4-b833-3898c51c0369", "tag": "fe21fcf0-3cf8-4583-ae08-fc43ec9eaab9"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:38.817662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6bfabf4e-8885-4b13-82f6-d1aef2c9d79a req-56d6c80c-a969-4764-8b57-457f487bfdda service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:38.818337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6bfabf4e-8885-4b13-82f6-d1aef2c9d79a req-56d6c80c-a969-4764-8b57-457f487bfdda service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:38.818611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6bfabf4e-8885-4b13-82f6-d1aef2c9d79a req-56d6c80c-a969-4764-8b57-457f487bfdda service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:38.859017 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-6bfabf4e-8885-4b13-82f6-d1aef2c9d79a req-56d6c80c-a969-4764-8b57-457f487bfdda service nova] Creating event network-changed:fe21fcf0-3cf8-4583-ae08-fc43ec9eaab9 for instance c82b82f3-34f9-40a4-b833-3898c51c0369 on n-h2-854823-1 Aug 27 04:55:38.868589 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-6bfabf4e-8885-4b13-82f6-d1aef2c9d79a req-56d6c80c-a969-4764-8b57-457f487bfdda service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081324 Aug 27 04:55:38.869670 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2230/4505] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:38.922295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b6b2ec94-161d-494f-8b59-c8f7fd0cabaa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:38.924703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b6b2ec94-161d-494f-8b59-c8f7fd0cabaa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:38.933566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6b2ec94-161d-494f-8b59-c8f7fd0cabaa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:38.949638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6b2ec94-161d-494f-8b59-c8f7fd0cabaa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:38.955814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6b2ec94-161d-494f-8b59-c8f7fd0cabaa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:38.957374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6b2ec94-161d-494f-8b59-c8f7fd0cabaa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:38.957930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6b2ec94-161d-494f-8b59-c8f7fd0cabaa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:38.961305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6b2ec94-161d-494f-8b59-c8f7fd0cabaa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:39.010310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d34eb502-31fe-4ef1-be40-601f5f36f7bb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:39.020345 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d34eb502-31fe-4ef1-be40-601f5f36f7bb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1315 microversion: 2.1 time: 0.366611 Aug 27 04:55:39.034116 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2276/4506] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:38 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:39.262239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b6b2ec94-161d-494f-8b59-c8f7fd0cabaa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:39.304832 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b6b2ec94-161d-494f-8b59-c8f7fd0cabaa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1504 microversion: 2.1 time: 0.387800 Aug 27 04:55:39.305441 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2231/4507] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:38 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:39.330649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e21b93e-eb97-4dee-86a5-6746d6f67fe7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:39.334724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e21b93e-eb97-4dee-86a5-6746d6f67fe7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:39.352522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e21b93e-eb97-4dee-86a5-6746d6f67fe7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:39.352522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e21b93e-eb97-4dee-86a5-6746d6f67fe7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:39.353609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e21b93e-eb97-4dee-86a5-6746d6f67fe7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:39.354371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e21b93e-eb97-4dee-86a5-6746d6f67fe7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:39.354841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e21b93e-eb97-4dee-86a5-6746d6f67fe7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:39.355279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e21b93e-eb97-4dee-86a5-6746d6f67fe7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:39.420702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e21b93e-eb97-4dee-86a5-6746d6f67fe7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:55:39.567835 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e21b93e-eb97-4dee-86a5-6746d6f67fe7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "DELETE /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 204 len: 0 microversion: 2.1 time: 0.241843 Aug 27 04:55:39.570031 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2277/4508] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:55:39 2022] DELETE /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:55:39.578695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3afc52f3-9549-4c3e-99cb-61041a7efe12 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:39.579952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3afc52f3-9549-4c3e-99cb-61041a7efe12 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:39.593039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3afc52f3-9549-4c3e-99cb-61041a7efe12 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:39.593731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3afc52f3-9549-4c3e-99cb-61041a7efe12 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:39.595243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3afc52f3-9549-4c3e-99cb-61041a7efe12 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:39.596066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3afc52f3-9549-4c3e-99cb-61041a7efe12 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:39.596560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3afc52f3-9549-4c3e-99cb-61041a7efe12 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:39.596990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3afc52f3-9549-4c3e-99cb-61041a7efe12 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:40.074883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f4724b0f-5e9c-4bdf-bcf0-6988ba9eccc5 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:40.077338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f4724b0f-5e9c-4bdf-bcf0-6988ba9eccc5 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:40.095014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4724b0f-5e9c-4bdf-bcf0-6988ba9eccc5 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:40.104133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4724b0f-5e9c-4bdf-bcf0-6988ba9eccc5 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:40.104858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4724b0f-5e9c-4bdf-bcf0-6988ba9eccc5 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:40.107134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4724b0f-5e9c-4bdf-bcf0-6988ba9eccc5 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:40.107800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4724b0f-5e9c-4bdf-bcf0-6988ba9eccc5 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:40.109095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4724b0f-5e9c-4bdf-bcf0-6988ba9eccc5 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:40.332869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3afc52f3-9549-4c3e-99cb-61041a7efe12 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:40.347344 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3afc52f3-9549-4c3e-99cb-61041a7efe12 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1510 microversion: 2.1 time: 0.772682 Aug 27 04:55:40.347955 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2232/4509] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:39 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1510 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:40.362436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f4724b0f-5e9c-4bdf-bcf0-6988ba9eccc5 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:40.373983 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f4724b0f-5e9c-4bdf-bcf0-6988ba9eccc5 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1315 microversion: 2.1 time: 0.334076 Aug 27 04:55:40.378308 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2278/4510] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:40 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:41.371255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b11487b5-1d85-4389-8c6b-55a22fb12712 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:41.372582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b11487b5-1d85-4389-8c6b-55a22fb12712 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:41.387720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b11487b5-1d85-4389-8c6b-55a22fb12712 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:41.388437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b11487b5-1d85-4389-8c6b-55a22fb12712 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:41.390717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b11487b5-1d85-4389-8c6b-55a22fb12712 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:41.391896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b11487b5-1d85-4389-8c6b-55a22fb12712 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:41.393094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b11487b5-1d85-4389-8c6b-55a22fb12712 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:41.398992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc679572-6cdf-4ae3-8932-6ebc7157a947 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:41.400156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc679572-6cdf-4ae3-8932-6ebc7157a947 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:41.410369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b11487b5-1d85-4389-8c6b-55a22fb12712 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:41.423655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc679572-6cdf-4ae3-8932-6ebc7157a947 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:41.428437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc679572-6cdf-4ae3-8932-6ebc7157a947 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:41.429007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc679572-6cdf-4ae3-8932-6ebc7157a947 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:41.429783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc679572-6cdf-4ae3-8932-6ebc7157a947 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:41.430267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc679572-6cdf-4ae3-8932-6ebc7157a947 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:41.430703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc679572-6cdf-4ae3-8932-6ebc7157a947 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:41.692891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cc679572-6cdf-4ae3-8932-6ebc7157a947 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:41.710995 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc679572-6cdf-4ae3-8932-6ebc7157a947 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1315 microversion: 2.1 time: 0.315112 Aug 27 04:55:41.713575 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2279/4511] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:41 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:41.950773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b11487b5-1d85-4389-8c6b-55a22fb12712 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:41.973441 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b11487b5-1d85-4389-8c6b-55a22fb12712 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1510 microversion: 2.1 time: 0.605991 Aug 27 04:55:41.992445 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2233/4512] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:41 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1510 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:42.592512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-88728bf0-fe4f-4dfb-84a2-effa51d9e08f req-9a961c44-8916-4daa-a7a6-05f56c119f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ce8444-1fbd-4b28-90bb-a5a472e04486", "name": "network-vif-deleted", "tag": "8798690d-62eb-484c-8c55-076f3b5ca3af"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:42.606521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:42.609575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-88728bf0-fe4f-4dfb-84a2-effa51d9e08f req-9a961c44-8916-4daa-a7a6-05f56c119f46 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:42.610491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-88728bf0-fe4f-4dfb-84a2-effa51d9e08f req-9a961c44-8916-4daa-a7a6-05f56c119f46 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:42.611189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-88728bf0-fe4f-4dfb-84a2-effa51d9e08f req-9a961c44-8916-4daa-a7a6-05f56c119f46 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:42.627701 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-88728bf0-fe4f-4dfb-84a2-effa51d9e08f req-9a961c44-8916-4daa-a7a6-05f56c119f46 service nova] Creating event network-vif-deleted:8798690d-62eb-484c-8c55-076f3b5ca3af for instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 on n-h1-854823-1 Aug 27 04:55:42.648395 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-88728bf0-fe4f-4dfb-84a2-effa51d9e08f req-9a961c44-8916-4daa-a7a6-05f56c119f46 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056204 Aug 27 04:55:42.649435 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2280/4513] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:55:42.734570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9a2fcb31-215d-4ea4-8e6d-e1351d89e2c7 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:42.735820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9a2fcb31-215d-4ea4-8e6d-e1351d89e2c7 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:42.764062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a2fcb31-215d-4ea4-8e6d-e1351d89e2c7 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:42.764600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a2fcb31-215d-4ea4-8e6d-e1351d89e2c7 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:42.765466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a2fcb31-215d-4ea4-8e6d-e1351d89e2c7 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:42.766962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a2fcb31-215d-4ea4-8e6d-e1351d89e2c7 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:42.767599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a2fcb31-215d-4ea4-8e6d-e1351d89e2c7 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:42.768213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a2fcb31-215d-4ea4-8e6d-e1351d89e2c7 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:43.003506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac81bf52-b79a-49ac-b34e-3faa58201eca tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:43.004318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac81bf52-b79a-49ac-b34e-3faa58201eca tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:43.016050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac81bf52-b79a-49ac-b34e-3faa58201eca tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:43.016665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac81bf52-b79a-49ac-b34e-3faa58201eca tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:43.019377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac81bf52-b79a-49ac-b34e-3faa58201eca tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:43.020133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac81bf52-b79a-49ac-b34e-3faa58201eca tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:43.024094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9a2fcb31-215d-4ea4-8e6d-e1351d89e2c7 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:43.034285 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9a2fcb31-215d-4ea4-8e6d-e1351d89e2c7 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1315 microversion: 2.1 time: 0.303907 Aug 27 04:55:43.035343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac81bf52-b79a-49ac-b34e-3faa58201eca tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:43.035889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac81bf52-b79a-49ac-b34e-3faa58201eca tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:43.038532 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2234/4514] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:42 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:43.074926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac81bf52-b79a-49ac-b34e-3faa58201eca tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:43.075430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac81bf52-b79a-49ac-b34e-3faa58201eca tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:43.075889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac81bf52-b79a-49ac-b34e-3faa58201eca tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:43.076307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-ac81bf52-b79a-49ac-b34e-3faa58201eca tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lazy-loading 'fault' on Instance uuid 71ce8444-1fbd-4b28-90bb-a5a472e04486 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:55:43.144569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac81bf52-b79a-49ac-b34e-3faa58201eca tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:43.155434 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac81bf52-b79a-49ac-b34e-3faa58201eca tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 200 len: 1306 microversion: 2.1 time: 0.159828 Aug 27 04:55:43.168613 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2281/4515] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:42 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 1306 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:44.058598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e914c8a9-8ecf-4079-a54c-9095f58309d9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:44.059518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e914c8a9-8ecf-4079-a54c-9095f58309d9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:44.070683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:44.072173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e914c8a9-8ecf-4079-a54c-9095f58309d9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.076899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e914c8a9-8ecf-4079-a54c-9095f58309d9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.077426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e914c8a9-8ecf-4079-a54c-9095f58309d9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.078176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e914c8a9-8ecf-4079-a54c-9095f58309d9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.079912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e914c8a9-8ecf-4079-a54c-9095f58309d9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.080358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e914c8a9-8ecf-4079-a54c-9095f58309d9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.184807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-923c8a9d-f4ea-408a-9256-f411bb8b085c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:44.186113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-923c8a9d-f4ea-408a-9256-f411bb8b085c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:44.189559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:44.191850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:44.211105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-923c8a9d-f4ea-408a-9256-f411bb8b085c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.211940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-923c8a9d-f4ea-408a-9256-f411bb8b085c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.214335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-923c8a9d-f4ea-408a-9256-f411bb8b085c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.215515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-923c8a9d-f4ea-408a-9256-f411bb8b085c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.217045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-923c8a9d-f4ea-408a-9256-f411bb8b085c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.221970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-923c8a9d-f4ea-408a-9256-f411bb8b085c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.258212 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-923c8a9d-f4ea-408a-9256-f411bb8b085c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-923c8a9d-f4ea-408a-9256-f411bb8b085c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 HTTP/1.1 Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '71ce8444-1fbd-4b28-90bb-a5a472e04486'} Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:44.268038 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:44.274531 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:44.274531 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:44.274531 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:44.274531 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:44.274531 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:44.274531 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:55:44.274531 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:44.274531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-923c8a9d-f4ea-408a-9256-f411bb8b085c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:44.274531 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-923c8a9d-f4ea-408a-9256-f411bb8b085c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 404 len: 111 microversion: 2.1 time: 0.093785 Aug 27 04:55:44.276634 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2282/4516] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:44 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:55:44.293779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-054d28ea-7264-447b-95e2-9dbf0f8fc381 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:44.294415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-054d28ea-7264-447b-95e2-9dbf0f8fc381 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:44.311861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-054d28ea-7264-447b-95e2-9dbf0f8fc381 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.314292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-054d28ea-7264-447b-95e2-9dbf0f8fc381 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.314748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-054d28ea-7264-447b-95e2-9dbf0f8fc381 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.320654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-054d28ea-7264-447b-95e2-9dbf0f8fc381 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.323105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-054d28ea-7264-447b-95e2-9dbf0f8fc381 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.324447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-054d28ea-7264-447b-95e2-9dbf0f8fc381 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.382627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e914c8a9-8ecf-4079-a54c-9095f58309d9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:44.398461 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e914c8a9-8ecf-4079-a54c-9095f58309d9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1315 microversion: 2.1 time: 0.343491 Aug 27 04:55:44.401405 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2235/4517] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:44 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:44.566103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-054d28ea-7264-447b-95e2-9dbf0f8fc381 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:44.576355 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-054d28ea-7264-447b-95e2-9dbf0f8fc381 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.294645 Aug 27 04:55:44.577755 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2283/4518] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:44 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:44.701435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc6b3aaa-f55b-4f54-9d6a-d1ea42978073 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc6b3aaa-f55b-4f54-9d6a-d1ea42978073 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 163 Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": 12345, "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'networks': [{'uuid': '1a15eb61-6c3a-49c3-9906-c4c8e2c9b393'}]}}} Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 12345 Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:55:44.705260 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:55:44.710582 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:55:44.710582 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 04:55:44.710582 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:44.710582 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:44.710582 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:44.710582 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:44.710582 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:44.710582 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:44.710582 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:55:44.710582 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:55:44.710582 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 04:55:44.710582 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:44.712461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc6b3aaa-f55b-4f54-9d6a-d1ea42978073 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:44.713338 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bc6b3aaa-f55b-4f54-9d6a-d1ea42978073 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.015949 Aug 27 04:55:44.713925 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2236/4519] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:55:44 2022] POST /compute/v2.1/servers => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:55:44.722888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-19855cbc-e518-403a-88ba-b8f229ae5537 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:44.723819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-19855cbc-e518-403a-88ba-b8f229ae5537 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:44.736469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19855cbc-e518-403a-88ba-b8f229ae5537 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.737010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19855cbc-e518-403a-88ba-b8f229ae5537 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.737481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19855cbc-e518-403a-88ba-b8f229ae5537 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.738298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19855cbc-e518-403a-88ba-b8f229ae5537 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.738755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19855cbc-e518-403a-88ba-b8f229ae5537 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.739184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19855cbc-e518-403a-88ba-b8f229ae5537 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.893137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-19855cbc-e518-403a-88ba-b8f229ae5537 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:44.902624 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-19855cbc-e518-403a-88ba-b8f229ae5537 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.184202 Aug 27 04:55:44.903436 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2284/4520] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:44 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:44.926437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9f334d40-69b1-4bef-9f31-f970286405b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:44.928738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9f334d40-69b1-4bef-9f31-f970286405b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:44.936907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f334d40-69b1-4bef-9f31-f970286405b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.937740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f334d40-69b1-4bef-9f31-f970286405b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.938888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f334d40-69b1-4bef-9f31-f970286405b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:44.939673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f334d40-69b1-4bef-9f31-f970286405b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:44.940246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f334d40-69b1-4bef-9f31-f970286405b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:44.940810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f334d40-69b1-4bef-9f31-f970286405b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:45.227217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9f334d40-69b1-4bef-9f31-f970286405b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:45.266468 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9f334d40-69b1-4bef-9f31-f970286405b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.344975 Aug 27 04:55:45.280637 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2237/4521] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:44 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:45.424003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69b566df-026f-401d-8e04-931587df6850 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:45.426462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69b566df-026f-401d-8e04-931587df6850 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:45.445823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69b566df-026f-401d-8e04-931587df6850 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:45.446411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69b566df-026f-401d-8e04-931587df6850 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:45.447065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69b566df-026f-401d-8e04-931587df6850 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:45.450064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69b566df-026f-401d-8e04-931587df6850 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:45.450895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69b566df-026f-401d-8e04-931587df6850 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:45.454089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69b566df-026f-401d-8e04-931587df6850 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:45.712774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-69b566df-026f-401d-8e04-931587df6850 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:45.724974 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69b566df-026f-401d-8e04-931587df6850 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1315 microversion: 2.1 time: 0.309209 Aug 27 04:55:45.726448 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2285/4522] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:45 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:45.861030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-2be19204-b94c-4ea4-93e6-1f8dd436f59c req-2d805c54-c580-4213-b896-53bfaf4b6e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82b82f3-34f9-40a4-b833-3898c51c0369", "name": "network-vif-plugged", "status": "completed", "tag": "fe21fcf0-3cf8-4583-ae08-fc43ec9eaab9"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:45.889669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2be19204-b94c-4ea4-93e6-1f8dd436f59c req-2d805c54-c580-4213-b896-53bfaf4b6e5a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:45.894397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2be19204-b94c-4ea4-93e6-1f8dd436f59c req-2d805c54-c580-4213-b896-53bfaf4b6e5a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:45.896065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2be19204-b94c-4ea4-93e6-1f8dd436f59c req-2d805c54-c580-4213-b896-53bfaf4b6e5a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:45.932217 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-2be19204-b94c-4ea4-93e6-1f8dd436f59c req-2d805c54-c580-4213-b896-53bfaf4b6e5a service nova] Creating event network-vif-plugged:fe21fcf0-3cf8-4583-ae08-fc43ec9eaab9 for instance c82b82f3-34f9-40a4-b833-3898c51c0369 on n-h2-854823-1 Aug 27 04:55:45.953865 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-2be19204-b94c-4ea4-93e6-1f8dd436f59c req-2d805c54-c580-4213-b896-53bfaf4b6e5a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094732 Aug 27 04:55:45.960416 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2238/4523] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:46.754160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5fbfa13d-2a94-43d0-8f51-25c219db1dcb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:46.755401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5fbfa13d-2a94-43d0-8f51-25c219db1dcb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:46.778146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fbfa13d-2a94-43d0-8f51-25c219db1dcb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:46.781089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fbfa13d-2a94-43d0-8f51-25c219db1dcb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:46.781682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fbfa13d-2a94-43d0-8f51-25c219db1dcb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:46.785450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fbfa13d-2a94-43d0-8f51-25c219db1dcb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:46.786047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fbfa13d-2a94-43d0-8f51-25c219db1dcb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:46.786595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fbfa13d-2a94-43d0-8f51-25c219db1dcb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:47.127878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5fbfa13d-2a94-43d0-8f51-25c219db1dcb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:47.141006 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5fbfa13d-2a94-43d0-8f51-25c219db1dcb tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1315 microversion: 2.1 time: 0.397797 Aug 27 04:55:47.142182 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2286/4524] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:46 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:48.164134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d9fa68e-d87a-4b5b-9192-521b39dad360 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:48.164898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9d9fa68e-d87a-4b5b-9192-521b39dad360 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:48.175471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d9fa68e-d87a-4b5b-9192-521b39dad360 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.176625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d9fa68e-d87a-4b5b-9192-521b39dad360 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.177418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d9fa68e-d87a-4b5b-9192-521b39dad360 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.178361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d9fa68e-d87a-4b5b-9192-521b39dad360 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.179058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d9fa68e-d87a-4b5b-9192-521b39dad360 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.179696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d9fa68e-d87a-4b5b-9192-521b39dad360 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.365208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9d9fa68e-d87a-4b5b-9192-521b39dad360 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:48.379345 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9d9fa68e-d87a-4b5b-9192-521b39dad360 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1465 microversion: 2.1 time: 0.220388 Aug 27 04:55:48.393204 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2239/4525] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:48 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1465 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:48.430751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da9e086c-508c-4960-914a-da7c264b7592 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-797727469", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b3cef0d4-e905-4beb-bac5-959c0991c082", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:48.439176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-56a56914-5d50-4162-afac-eb85a2174ba9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:48.439674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-56a56914-5d50-4162-afac-eb85a2174ba9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:48.452081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a56914-5d50-4162-afac-eb85a2174ba9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.452636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a56914-5d50-4162-afac-eb85a2174ba9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.453078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a56914-5d50-4162-afac-eb85a2174ba9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.453864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a56914-5d50-4162-afac-eb85a2174ba9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.454391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a56914-5d50-4162-afac-eb85a2174ba9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.454924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a56914-5d50-4162-afac-eb85a2174ba9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.500969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-56a56914-5d50-4162-afac-eb85a2174ba9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:55:48.550363 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-da9e086c-508c-4960-914a-da7c264b7592 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Block Device b3cef0d4-e905-4beb-bac5-959c0991c082 is not bootable. Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da9e086c-508c-4960-914a-da7c264b7592 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 357 Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-797727469", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b3cef0d4-e905-4beb-bac5-959c0991c082", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: exception: Block Device b3cef0d4-e905-4beb-bac5-959c0991c082 is not bootable. Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-797727469', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'b3cef0d4-e905-4beb-bac5-959c0991c082'}], 'networks': [{'uuid': '1a15eb61-6c3a-49c3-9906-c4c8e2c9b393'}]}}} Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device b3cef0d4-e905-4beb-bac5-959c0991c082 is not bootable. Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:48.565178 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device b3cef0d4-e905-4beb-bac5-959c0991c082 is not bootable. Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device b3cef0d4-e905-4beb-bac5-959c0991c082 is not bootable. Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da9e086c-508c-4960-914a-da7c264b7592 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Block Device b3cef0d4-e905-4beb-bac5-959c0991c082 is not bootable. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:48.570196 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da9e086c-508c-4960-914a-da7c264b7592 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.140104 Aug 27 04:55:48.571567 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2287/4526] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:55:48 2022] POST /compute/v2.1/servers => generated 110 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:55:48.583803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-520c1fef-00cc-4b0e-88a5-60e60d440131 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:48.584365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-520c1fef-00cc-4b0e-88a5-60e60d440131 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:48.601372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-520c1fef-00cc-4b0e-88a5-60e60d440131 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.601882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-520c1fef-00cc-4b0e-88a5-60e60d440131 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.603024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-520c1fef-00cc-4b0e-88a5-60e60d440131 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.603888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-520c1fef-00cc-4b0e-88a5-60e60d440131 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.604412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-520c1fef-00cc-4b0e-88a5-60e60d440131 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.604929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-520c1fef-00cc-4b0e-88a5-60e60d440131 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.704931 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-56a56914-5d50-4162-afac-eb85a2174ba9 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 204 len: 0 microversion: 2.1 time: 0.270036 Aug 27 04:55:48.705709 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2240/4527] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:55:48 2022] DELETE /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:55:48.739499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-30450de0-953b-4a38-96bb-9f7db4b99c35 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:48.740668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-30450de0-953b-4a38-96bb-9f7db4b99c35 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:48.747211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30450de0-953b-4a38-96bb-9f7db4b99c35 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.747918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30450de0-953b-4a38-96bb-9f7db4b99c35 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.748561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30450de0-953b-4a38-96bb-9f7db4b99c35 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.749718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30450de0-953b-4a38-96bb-9f7db4b99c35 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.750571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30450de0-953b-4a38-96bb-9f7db4b99c35 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.753601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30450de0-953b-4a38-96bb-9f7db4b99c35 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.823794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-520c1fef-00cc-4b0e-88a5-60e60d440131 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:48.856108 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-520c1fef-00cc-4b0e-88a5-60e60d440131 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.282576 Aug 27 04:55:48.863946 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2288/4528] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:48 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:48.901516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1d9a5e3-18a7-46cc-b40f-7dea8fd64226 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:48.904521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1d9a5e3-18a7-46cc-b40f-7dea8fd64226 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:48.924991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-30450de0-953b-4a38-96bb-9f7db4b99c35 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:48.930596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d9a5e3-18a7-46cc-b40f-7dea8fd64226 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.931115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d9a5e3-18a7-46cc-b40f-7dea8fd64226 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.931566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d9a5e3-18a7-46cc-b40f-7dea8fd64226 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.933633 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-30450de0-953b-4a38-96bb-9f7db4b99c35 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1471 microversion: 2.1 time: 0.214185 Aug 27 04:55:48.934552 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2241/4529] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:48 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:48.944591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d9a5e3-18a7-46cc-b40f-7dea8fd64226 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:48.945688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d9a5e3-18a7-46cc-b40f-7dea8fd64226 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:48.946031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d9a5e3-18a7-46cc-b40f-7dea8fd64226 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:48.974290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:49.170254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1d9a5e3-18a7-46cc-b40f-7dea8fd64226 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:49.181863 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1d9a5e3-18a7-46cc-b40f-7dea8fd64226 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.296391 Aug 27 04:55:49.183340 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2289/4530] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:48 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:49.956679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6bb7b5df-cd1a-4895-b9f2-3f7709ceecdd tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:49.958067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6bb7b5df-cd1a-4895-b9f2-3f7709ceecdd tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:49.987071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bb7b5df-cd1a-4895-b9f2-3f7709ceecdd tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:49.987611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bb7b5df-cd1a-4895-b9f2-3f7709ceecdd tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:49.988070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bb7b5df-cd1a-4895-b9f2-3f7709ceecdd tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:49.988842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bb7b5df-cd1a-4895-b9f2-3f7709ceecdd tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:49.993246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bb7b5df-cd1a-4895-b9f2-3f7709ceecdd tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:49.993932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bb7b5df-cd1a-4895-b9f2-3f7709ceecdd tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:50.868746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6bb7b5df-cd1a-4895-b9f2-3f7709ceecdd tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:50.887115 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6bb7b5df-cd1a-4895-b9f2-3f7709ceecdd tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1471 microversion: 2.1 time: 0.933287 Aug 27 04:55:50.888184 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2242/4531] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:49 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1471 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:51.916822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3d74e2e-aff5-4737-a01e-58074622571c tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:51.918061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b3d74e2e-aff5-4737-a01e-58074622571c tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:51.945497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d74e2e-aff5-4737-a01e-58074622571c tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:51.946109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d74e2e-aff5-4737-a01e-58074622571c tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:51.947676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d74e2e-aff5-4737-a01e-58074622571c tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:51.953612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d74e2e-aff5-4737-a01e-58074622571c tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:51.955370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d74e2e-aff5-4737-a01e-58074622571c tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:51.956029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3d74e2e-aff5-4737-a01e-58074622571c tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:51.971610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d35cf1d2-8a96-4a99-86ab-99b996d7792a req-bac0940e-3de3-4f45-933e-38d353fa30fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82b82f3-34f9-40a4-b833-3898c51c0369", "name": "network-vif-deleted", "tag": "fe21fcf0-3cf8-4583-ae08-fc43ec9eaab9"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:52.075668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d35cf1d2-8a96-4a99-86ab-99b996d7792a req-bac0940e-3de3-4f45-933e-38d353fa30fc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:52.078263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d35cf1d2-8a96-4a99-86ab-99b996d7792a req-bac0940e-3de3-4f45-933e-38d353fa30fc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:52.079474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d35cf1d2-8a96-4a99-86ab-99b996d7792a req-bac0940e-3de3-4f45-933e-38d353fa30fc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:52.131619 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d35cf1d2-8a96-4a99-86ab-99b996d7792a req-bac0940e-3de3-4f45-933e-38d353fa30fc service nova] Creating event network-vif-deleted:fe21fcf0-3cf8-4583-ae08-fc43ec9eaab9 for instance c82b82f3-34f9-40a4-b833-3898c51c0369 on n-h2-854823-1 Aug 27 04:55:52.148912 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d35cf1d2-8a96-4a99-86ab-99b996d7792a req-bac0940e-3de3-4f45-933e-38d353fa30fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197520 Aug 27 04:55:52.176774 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2243/4532] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:55:52.201709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b3d74e2e-aff5-4737-a01e-58074622571c tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:52.215961 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3d74e2e-aff5-4737-a01e-58074622571c tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1429 microversion: 2.1 time: 0.309691 Aug 27 04:55:52.217497 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2290/4533] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:51 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1429 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:53.248072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-14fa21f5-c5da-4193-881f-6081ab98dff3 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:53.253082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-14fa21f5-c5da-4193-881f-6081ab98dff3 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:53.292565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fa21f5-c5da-4193-881f-6081ab98dff3 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:53.293421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fa21f5-c5da-4193-881f-6081ab98dff3 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:53.293893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fa21f5-c5da-4193-881f-6081ab98dff3 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:53.303155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fa21f5-c5da-4193-881f-6081ab98dff3 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:53.306903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fa21f5-c5da-4193-881f-6081ab98dff3 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:53.310002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fa21f5-c5da-4193-881f-6081ab98dff3 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:53.431192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fa21f5-c5da-4193-881f-6081ab98dff3 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:53.431806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fa21f5-c5da-4193-881f-6081ab98dff3 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:53.445445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14fa21f5-c5da-4193-881f-6081ab98dff3 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:53.449016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-14fa21f5-c5da-4193-881f-6081ab98dff3 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lazy-loading 'fault' on Instance uuid c82b82f3-34f9-40a4-b833-3898c51c0369 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:55:53.637521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5d7468b-69ad-489f-b646-c7e4e50039c1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-592104411", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "71228424-9f42-4121-865e-14501cc9b5c0", "destination_type": "local"}, {"source_type": "volume", "uuid": "cf269536-3422-45c8-84d3-84add4b700b3", "destination_type": "invalid"}], "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5d7468b-69ad-489f-b646-c7e4e50039c1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 494 Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-592104411", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "71228424-9f42-4121-865e-14501cc9b5c0", "destination_type": "local"}, {"source_type": "volume", "uuid": "cf269536-3422-45c8-84d3-84add4b700b3", "destination_type": "invalid"}], "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-592104411', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '71228424-9f42-4121-865e-14501cc9b5c0', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'cf269536-3422-45c8-84d3-84add4b700b3', 'destination_type': 'invalid'}], 'networks': [{'uuid': '1a15eb61-6c3a-49c3-9906-c4c8e2c9b393'}]}}} Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:53.649552 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5d7468b-69ad-489f-b646-c7e4e50039c1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:53.654395 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5d7468b-69ad-489f-b646-c7e4e50039c1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.023336 Aug 27 04:55:53.657093 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2291/4534] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:55:53 2022] POST /compute/v2.1/servers => generated 155 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:55:53.661269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-14fa21f5-c5da-4193-881f-6081ab98dff3 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720d586dba5a4dc1affd3ac9e509e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1c83f3e41a4006a8ca519bbd777c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:53.689220 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-14fa21f5-c5da-4193-881f-6081ab98dff3 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 200 len: 1305 microversion: 2.1 time: 0.450876 Aug 27 04:55:53.701879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9087e93a-3e0a-4ab5-87e2-10a7a6961c09 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:53.705190 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2244/4535] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:53 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 1305 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:53.710160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9087e93a-3e0a-4ab5-87e2-10a7a6961c09 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:53.748298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9087e93a-3e0a-4ab5-87e2-10a7a6961c09 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:53.760355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9087e93a-3e0a-4ab5-87e2-10a7a6961c09 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:53.761123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9087e93a-3e0a-4ab5-87e2-10a7a6961c09 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:53.761905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9087e93a-3e0a-4ab5-87e2-10a7a6961c09 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:53.762571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9087e93a-3e0a-4ab5-87e2-10a7a6961c09 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:53.763022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9087e93a-3e0a-4ab5-87e2-10a7a6961c09 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.262363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9087e93a-3e0a-4ab5-87e2-10a7a6961c09 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:54.282359 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9087e93a-3e0a-4ab5-87e2-10a7a6961c09 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.601399 Aug 27 04:55:54.297811 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2292/4536] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:53 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:54.310569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-97e6946d-0fb9-4f63-92d6-38de2caa796a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:54.312197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-97e6946d-0fb9-4f63-92d6-38de2caa796a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:54.325645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97e6946d-0fb9-4f63-92d6-38de2caa796a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.326261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97e6946d-0fb9-4f63-92d6-38de2caa796a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.327510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97e6946d-0fb9-4f63-92d6-38de2caa796a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.328278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97e6946d-0fb9-4f63-92d6-38de2caa796a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.328918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97e6946d-0fb9-4f63-92d6-38de2caa796a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.329454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97e6946d-0fb9-4f63-92d6-38de2caa796a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.685369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-97e6946d-0fb9-4f63-92d6-38de2caa796a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:54.687841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:54.696381 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-97e6946d-0fb9-4f63-92d6-38de2caa796a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.390664 Aug 27 04:55:54.709897 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2245/4537] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:54 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:54.733128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ff600e4-2c0d-42f5-9331-e6c0a1627026 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:54.735230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ff600e4-2c0d-42f5-9331-e6c0a1627026 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] [instance: c82b82f3-34f9-40a4-b833-3898c51c0369] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:54.756339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ff600e4-2c0d-42f5-9331-e6c0a1627026 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.757555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ff600e4-2c0d-42f5-9331-e6c0a1627026 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.759163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ff600e4-2c0d-42f5-9331-e6c0a1627026 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.760630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ff600e4-2c0d-42f5-9331-e6c0a1627026 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.763256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ff600e4-2c0d-42f5-9331-e6c0a1627026 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.767086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ff600e4-2c0d-42f5-9331-e6c0a1627026 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.795378 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7ff600e4-2c0d-42f5-9331-e6c0a1627026 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] HTTP exception thrown: Instance c82b82f3-34f9-40a4-b833-3898c51c0369 could not be found. Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ff600e4-2c0d-42f5-9331-e6c0a1627026 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Request method failure captured: Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 HTTP/1.1 Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaPBUrDUi7JAFJY3cNkuerbHK-1Ipya2PhwlkaApLZgfE4DPpFa8uY9Hqb133cMyH97pQvUUaHJ_zPmmX4_icSBI6G4iK7NQYRRm4HqbaZvH6WYlIFzzIxyrABc9V389GpKTOV4CF4e2B3l0xzpp8uGIssaG8ws2NnoZBGIS8GL1Kr4 Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 1d1c83f3e41a4006a8ca519bbd777c9b Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesNegativeTest-2059903355 Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d1c83f3e41a4006a8ca519bbd777c9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1d1c83f3e41a4006a8ca519bbd777c9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1d1c83f3e41a4006a8ca519bbd777c9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d1c83f3e41a4006a8ca519bbd777c9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesNegativeTest-2059903355 Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 1d1c83f3e41a4006a8ca519bbd777c9b Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesNegativeTest-2059903355 Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-VolumesNegativeTest-2059903355-project Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 720d586dba5a4dc1affd3ac9e509e63e Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesNegativeTest-2059903355-project Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance c82b82f3-34f9-40a4-b833-3898c51c0369 could not be found. Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'c82b82f3-34f9-40a4-b833-3898c51c0369'} Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c82b82f3-34f9-40a4-b833-3898c51c0369 could not be found. Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c82b82f3-34f9-40a4-b833-3898c51c0369 could not be found. Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:54.797451 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.802733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:54.802733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:54.802733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:54.802733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:54.802733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:54.802733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c82b82f3-34f9-40a4-b833-3898c51c0369 could not be found. Aug 27 04:55:54.802733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.805844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ff600e4-2c0d-42f5-9331-e6c0a1627026 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] Returning 404 to user: Instance c82b82f3-34f9-40a4-b833-3898c51c0369 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:54.807086 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ff600e4-2c0d-42f5-9331-e6c0a1627026 tempest-VolumesNegativeTest-2059903355 tempest-VolumesNegativeTest-2059903355-project] 10.222.0.79 "GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369" status: 404 len: 111 microversion: 2.1 time: 0.083714 Aug 27 04:55:54.808488 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2293/4538] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:54 2022] GET /compute/v2.1/servers/c82b82f3-34f9-40a4-b833-3898c51c0369 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:55:54.930149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e6fef9b-9182-4d68-9687-47487a72b39d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1187324703", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e6fef9b-9182-4d68-9687-47487a72b39d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 492 Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1187324703", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1187324703', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '1a15eb61-6c3a-49c3-9906-c4c8e2c9b393'}]}}} Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.938650 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e6fef9b-9182-4d68-9687-47487a72b39d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:54.942700 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e6fef9b-9182-4d68-9687-47487a72b39d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.016688 Aug 27 04:55:54.945502 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2246/4539] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:55:54 2022] POST /compute/v2.1/servers => generated 624 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:55:54.954034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4087298-3ecf-4828-8b76-fac1bb13e208 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:54.955302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4087298-3ecf-4828-8b76-fac1bb13e208 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:54.963964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4087298-3ecf-4828-8b76-fac1bb13e208 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.964480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4087298-3ecf-4828-8b76-fac1bb13e208 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.965062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4087298-3ecf-4828-8b76-fac1bb13e208 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:54.966224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4087298-3ecf-4828-8b76-fac1bb13e208 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:54.966748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4087298-3ecf-4828-8b76-fac1bb13e208 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:54.968075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4087298-3ecf-4828-8b76-fac1bb13e208 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.294412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4087298-3ecf-4828-8b76-fac1bb13e208 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:55.340240 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4087298-3ecf-4828-8b76-fac1bb13e208 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.388505 Aug 27 04:55:55.344745 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2294/4540] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:54 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:55.379252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1addd25d-d1d0-4194-af51-7608386a6351 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:55.380625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1addd25d-d1d0-4194-af51-7608386a6351 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:55.398042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1addd25d-d1d0-4194-af51-7608386a6351 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:55.398746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1addd25d-d1d0-4194-af51-7608386a6351 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:55.399585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1addd25d-d1d0-4194-af51-7608386a6351 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.400564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1addd25d-d1d0-4194-af51-7608386a6351 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:55.402488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1addd25d-d1d0-4194-af51-7608386a6351 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:55.403292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1addd25d-d1d0-4194-af51-7608386a6351 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:55.704805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1addd25d-d1d0-4194-af51-7608386a6351 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:55.721618 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1addd25d-d1d0-4194-af51-7608386a6351 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.358761 Aug 27 04:55:55.736715 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2247/4541] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:55 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:55.990678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57d4f2f5-147e-4b79-83ba-4b42d851bc12 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57d4f2f5-147e-4b79-83ba-4b42d851bc12 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 416 Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'networks': [{'uuid': '1a15eb61-6c3a-49c3-9906-c4c8e2c9b393'}]}}} Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:55.995532 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:55:56.000029 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:56.003220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57d4f2f5-147e-4b79-83ba-4b42d851bc12 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:56.004463 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57d4f2f5-147e-4b79-83ba-4b42d851bc12 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.018228 Aug 27 04:55:56.005001 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2295/4542] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:55:55 2022] POST /compute/v2.1/servers => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:55:56.017152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2dfd04f4-69ad-4c7c-8b11-c949a0fddf70 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:56.017850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2dfd04f4-69ad-4c7c-8b11-c949a0fddf70 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:56.041376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2dfd04f4-69ad-4c7c-8b11-c949a0fddf70 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:56.041951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2dfd04f4-69ad-4c7c-8b11-c949a0fddf70 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:56.042527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2dfd04f4-69ad-4c7c-8b11-c949a0fddf70 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:56.043653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2dfd04f4-69ad-4c7c-8b11-c949a0fddf70 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:56.044189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2dfd04f4-69ad-4c7c-8b11-c949a0fddf70 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:56.045693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2dfd04f4-69ad-4c7c-8b11-c949a0fddf70 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:56.329490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2dfd04f4-69ad-4c7c-8b11-c949a0fddf70 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:56.352810 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2dfd04f4-69ad-4c7c-8b11-c949a0fddf70 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.342366 Aug 27 04:55:56.364764 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2248/4543] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:56 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:56.377256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7466f0c5-2972-4257-91f8-45fdfb293e92 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:56.378013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7466f0c5-2972-4257-91f8-45fdfb293e92 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:56.385781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7466f0c5-2972-4257-91f8-45fdfb293e92 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:56.386656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7466f0c5-2972-4257-91f8-45fdfb293e92 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:56.387236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7466f0c5-2972-4257-91f8-45fdfb293e92 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:56.388507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7466f0c5-2972-4257-91f8-45fdfb293e92 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:56.407690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7466f0c5-2972-4257-91f8-45fdfb293e92 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:56.408277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7466f0c5-2972-4257-91f8-45fdfb293e92 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:56.673358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7466f0c5-2972-4257-91f8-45fdfb293e92 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:56.692652 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7466f0c5-2972-4257-91f8-45fdfb293e92 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.321266 Aug 27 04:55:56.695326 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2296/4544] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:56 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:56.972801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-12b9ef7d-b179-4b74-afb5-2b7431d78a2d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1722516153", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": -1, "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:57.033914 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-12b9ef7d-b179-4b74-afb5-2b7431d78a2d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Flavor -1 could not be found. Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-12b9ef7d-b179-4b74-afb5-2b7431d78a2d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 206 Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1722516153", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": -1, "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: exception: Flavor -1 could not be found. Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1722516153', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': -1, 'networks': [{'uuid': '1a15eb61-6c3a-49c3-9906-c4c8e2c9b393'}]}}} Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:57.039605 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:57.046352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-12b9ef7d-b179-4b74-afb5-2b7431d78a2d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:57.048963 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-12b9ef7d-b179-4b74-afb5-2b7431d78a2d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.087428 Aug 27 04:55:57.054034 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2249/4545] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:55:56 2022] POST /compute/v2.1/servers => generated 73 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:57.062867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0969c2ac-9412-4445-9363-3c0bdfcaf11e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:57.064176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0969c2ac-9412-4445-9363-3c0bdfcaf11e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:57.082157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0969c2ac-9412-4445-9363-3c0bdfcaf11e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:57.091852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0969c2ac-9412-4445-9363-3c0bdfcaf11e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:57.092470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0969c2ac-9412-4445-9363-3c0bdfcaf11e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:57.097853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0969c2ac-9412-4445-9363-3c0bdfcaf11e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:57.101088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0969c2ac-9412-4445-9363-3c0bdfcaf11e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:57.103791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0969c2ac-9412-4445-9363-3c0bdfcaf11e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:57.408022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0969c2ac-9412-4445-9363-3c0bdfcaf11e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:57.434672 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0969c2ac-9412-4445-9363-3c0bdfcaf11e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.375993 Aug 27 04:55:57.435278 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2297/4546] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:57 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:57.463171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d2ff0695-eb6f-4ca9-b7e0-2dad13fe16e4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:57.464019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d2ff0695-eb6f-4ca9-b7e0-2dad13fe16e4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:57.473913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2ff0695-eb6f-4ca9-b7e0-2dad13fe16e4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:57.474415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2ff0695-eb6f-4ca9-b7e0-2dad13fe16e4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:57.474854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2ff0695-eb6f-4ca9-b7e0-2dad13fe16e4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:57.480966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2ff0695-eb6f-4ca9-b7e0-2dad13fe16e4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:57.481543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2ff0695-eb6f-4ca9-b7e0-2dad13fe16e4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:57.481998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2ff0695-eb6f-4ca9-b7e0-2dad13fe16e4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:57.778478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d2ff0695-eb6f-4ca9-b7e0-2dad13fe16e4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:57.819916 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d2ff0695-eb6f-4ca9-b7e0-2dad13fe16e4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.360384 Aug 27 04:55:57.835559 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2250/4547] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:57 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:57.954458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0fc9882f-8d1d-493d-9b03-596f984e5a72 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1780414300", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0fc9882f-8d1d-493d-9b03-596f984e5a72 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 173 Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1780414300", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1780414300', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '1a15eb61-6c3a-49c3-9906-c4c8e2c9b393'}]}}} Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi -1 Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:55:57.958930 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:55:57.965831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:55:57.965831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:55:57.965831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 04:55:57.965831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:57.965831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:57.965831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:57.965831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:57.965831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:57.965831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:57.965831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:55:57.965831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:55:57.965831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 04:55:57.965831 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:55:57.970482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0fc9882f-8d1d-493d-9b03-596f984e5a72 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:57.971580 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0fc9882f-8d1d-493d-9b03-596f984e5a72 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.022413 Aug 27 04:55:57.975521 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2298/4548] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:55:57 2022] POST /compute/v2.1/servers => generated 145 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:55:57.984398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6ebef82a-6d2f-41ff-9f13-f07e470fae3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:57.985982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6ebef82a-6d2f-41ff-9f13-f07e470fae3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:58.023371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ebef82a-6d2f-41ff-9f13-f07e470fae3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:58.023797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ebef82a-6d2f-41ff-9f13-f07e470fae3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:58.024240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ebef82a-6d2f-41ff-9f13-f07e470fae3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:58.028089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ebef82a-6d2f-41ff-9f13-f07e470fae3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:58.029303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ebef82a-6d2f-41ff-9f13-f07e470fae3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:58.030588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ebef82a-6d2f-41ff-9f13-f07e470fae3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:58.355436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6ebef82a-6d2f-41ff-9f13-f07e470fae3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:58.370779 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6ebef82a-6d2f-41ff-9f13-f07e470fae3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.391110 Aug 27 04:55:58.376852 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2251/4549] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:57 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:58.402172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c01ed5a4-1fec-448a-9c31-f6e0700f27f6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:58.405858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c01ed5a4-1fec-448a-9c31-f6e0700f27f6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:58.422611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01ed5a4-1fec-448a-9c31-f6e0700f27f6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:58.426942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01ed5a4-1fec-448a-9c31-f6e0700f27f6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:58.427608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01ed5a4-1fec-448a-9c31-f6e0700f27f6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:58.429531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01ed5a4-1fec-448a-9c31-f6e0700f27f6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:58.432065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01ed5a4-1fec-448a-9c31-f6e0700f27f6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:58.441356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01ed5a4-1fec-448a-9c31-f6e0700f27f6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:58.763595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c01ed5a4-1fec-448a-9c31-f6e0700f27f6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:58.772462 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c01ed5a4-1fec-448a-9c31-f6e0700f27f6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.374460 Aug 27 04:55:58.776581 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2299/4550] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:58 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:55:59.122225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4dd6e193-ae19-4f5b-adfa-55ff7021f9e2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1200950929", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:55:59.128234 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-4dd6e193-ae19-4f5b-adfa-55ff7021f9e2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4dd6e193-ae19-4f5b-adfa-55ff7021f9e2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 216 Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1200950929", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1200950929', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:55:59.132937 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:59.138574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:55:59.138574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:55:59.138574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:55:59.138574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:55:59.138574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:55:59.138574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 04:55:59.138574 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:55:59.140865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4dd6e193-ae19-4f5b-adfa-55ff7021f9e2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:55:59.146154 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4dd6e193-ae19-4f5b-adfa-55ff7021f9e2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.028384 Aug 27 04:55:59.150275 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2252/4551] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:55:59 2022] POST /compute/v2.1/servers => generated 123 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:55:59.159422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9959022e-0be4-40f9-9995-f1a37199bd4f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:59.160710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9959022e-0be4-40f9-9995-f1a37199bd4f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:59.173938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9959022e-0be4-40f9-9995-f1a37199bd4f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:59.175634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9959022e-0be4-40f9-9995-f1a37199bd4f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:59.177868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9959022e-0be4-40f9-9995-f1a37199bd4f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:59.179068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9959022e-0be4-40f9-9995-f1a37199bd4f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:59.182650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9959022e-0be4-40f9-9995-f1a37199bd4f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:59.185311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9959022e-0be4-40f9-9995-f1a37199bd4f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:59.456370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9959022e-0be4-40f9-9995-f1a37199bd4f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:55:59.468931 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9959022e-0be4-40f9-9995-f1a37199bd4f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.313856 Aug 27 04:55:59.470656 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2300/4552] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:59 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:55:59.497124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5ca1bfaf-c7ef-4f71-8af8-95b3f5375eee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:55:59.502875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5ca1bfaf-c7ef-4f71-8af8-95b3f5375eee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:55:59.510856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ca1bfaf-c7ef-4f71-8af8-95b3f5375eee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:59.519278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ca1bfaf-c7ef-4f71-8af8-95b3f5375eee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:59.520291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ca1bfaf-c7ef-4f71-8af8-95b3f5375eee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:59.521354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ca1bfaf-c7ef-4f71-8af8-95b3f5375eee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:55:59.522106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ca1bfaf-c7ef-4f71-8af8-95b3f5375eee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:55:59.522780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ca1bfaf-c7ef-4f71-8af8-95b3f5375eee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:55:59.995433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5ca1bfaf-c7ef-4f71-8af8-95b3f5375eee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:00.016820 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5ca1bfaf-c7ef-4f71-8af8-95b3f5375eee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.523644 Aug 27 04:56:00.021974 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2253/4553] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:55:59 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:00.336371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-559e6ac2-281e-48ac-a8b6-db36aa0e687e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1631650102", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "key_name": "tempest-key-811464299", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:00.469543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-559e6ac2-281e-48ac-a8b6-db36aa0e687e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] validate_networks() for [('1a15eb61-6c3a-49c3-9906-c4c8e2c9b393', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:56:01.079082 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-559e6ac2-281e-48ac-a8b6-db36aa0e687e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Invalid key_name provided. Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-559e6ac2-281e-48ac-a8b6-db36aa0e687e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 246 Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1631650102", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "key_name": "tempest-key-811464299", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid key_name provided. Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1631650102', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'key_name': 'tempest-key-811464299', 'networks': [{'uuid': '1a15eb61-6c3a-49c3-9906-c4c8e2c9b393'}]}}} Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-811464299 not found for user a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:01.083717 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:01.088076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-559e6ac2-281e-48ac-a8b6-db36aa0e687e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Invalid key_name provided. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:01.094420 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-559e6ac2-281e-48ac-a8b6-db36aa0e687e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.764450 Aug 27 04:56:01.094420 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2301/4554] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:56:00 2022] POST /compute/v2.1/servers => generated 70 bytes in 766 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:01.097958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-28fd817d-529a-4dd3-a326-fe49ee688741 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:01.098676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-28fd817d-529a-4dd3-a326-fe49ee688741 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:01.120275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28fd817d-529a-4dd3-a326-fe49ee688741 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:01.121508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28fd817d-529a-4dd3-a326-fe49ee688741 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:01.121803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28fd817d-529a-4dd3-a326-fe49ee688741 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:01.128331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28fd817d-529a-4dd3-a326-fe49ee688741 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:01.128921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28fd817d-529a-4dd3-a326-fe49ee688741 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:01.129385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28fd817d-529a-4dd3-a326-fe49ee688741 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:01.573057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-28fd817d-529a-4dd3-a326-fe49ee688741 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:01.582032 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-28fd817d-529a-4dd3-a326-fe49ee688741 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.488349 Aug 27 04:56:01.583151 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2254/4555] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:01 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:01.606179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce952e15-ec6e-4a49-822a-e1da346c6b3e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:01.607643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce952e15-ec6e-4a49-822a-e1da346c6b3e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:01.622726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce952e15-ec6e-4a49-822a-e1da346c6b3e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:01.623494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce952e15-ec6e-4a49-822a-e1da346c6b3e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:01.624233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce952e15-ec6e-4a49-822a-e1da346c6b3e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:01.625716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce952e15-ec6e-4a49-822a-e1da346c6b3e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:01.626381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce952e15-ec6e-4a49-822a-e1da346c6b3e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:01.627875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce952e15-ec6e-4a49-822a-e1da346c6b3e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:03.058268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce952e15-ec6e-4a49-822a-e1da346c6b3e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:03.084338 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce952e15-ec6e-4a49-822a-e1da346c6b3e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 1.470356 Aug 27 04:56:03.092187 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2302/4556] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:01 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:03.342416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-721f5f4c-67fe-4497-8d66-0eb3a2092ed8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1934740232", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:03.653727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.security_group_api [None req-721f5f4c-67fe-4497-8d66-0eb3a2092ed8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Neutron security group does_not_exist not found {{(pid=128870) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 27 04:56:03.654681 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-721f5f4c-67fe-4497-8d66-0eb3a2092ed8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-721f5f4c-67fe-4497-8d66-0eb3a2092ed8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 258 Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1934740232", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1934740232', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '1a15eb61-6c3a-49c3-9906-c4c8e2c9b393'}]}}} Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 27 04:56:03.670706 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:03.680194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-721f5f4c-67fe-4497-8d66-0eb3a2092ed8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:03.691595 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-721f5f4c-67fe-4497-8d66-0eb3a2092ed8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.336727 Aug 27 04:56:03.691595 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2255/4557] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:56:03 2022] POST /compute/v2.1/servers => generated 106 bytes in 339 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:56:03.692097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-017965a6-8041-4c24-b5c7-ecf57fde43b6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:03.692097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-017965a6-8041-4c24-b5c7-ecf57fde43b6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:03.708685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017965a6-8041-4c24-b5c7-ecf57fde43b6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:03.710345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017965a6-8041-4c24-b5c7-ecf57fde43b6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:03.712072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017965a6-8041-4c24-b5c7-ecf57fde43b6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:03.713032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017965a6-8041-4c24-b5c7-ecf57fde43b6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:03.715018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017965a6-8041-4c24-b5c7-ecf57fde43b6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:03.718344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017965a6-8041-4c24-b5c7-ecf57fde43b6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:04.128381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-017965a6-8041-4c24-b5c7-ecf57fde43b6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:04.158094 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-017965a6-8041-4c24-b5c7-ecf57fde43b6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.475846 Aug 27 04:56:04.162569 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2303/4558] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:03 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:04.186238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d090bcda-2825-43c7-aa1b-1f5fc48aaa74 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:04.187239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d090bcda-2825-43c7-aa1b-1f5fc48aaa74 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:04.205753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d090bcda-2825-43c7-aa1b-1f5fc48aaa74 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:04.208254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d090bcda-2825-43c7-aa1b-1f5fc48aaa74 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:04.210142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d090bcda-2825-43c7-aa1b-1f5fc48aaa74 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:04.212679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d090bcda-2825-43c7-aa1b-1f5fc48aaa74 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:04.214653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d090bcda-2825-43c7-aa1b-1f5fc48aaa74 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:04.217730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d090bcda-2825-43c7-aa1b-1f5fc48aaa74 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:04.705029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d090bcda-2825-43c7-aa1b-1f5fc48aaa74 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:04.720613 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d090bcda-2825-43c7-aa1b-1f5fc48aaa74 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.531789 Aug 27 04:56:04.721213 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2256/4559] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:04 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:04.745107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a5497d0-5bf9-4bc5-afbe-02cece943fdb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:04.745901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a5497d0-5bf9-4bc5-afbe-02cece943fdb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: e10eb5b7-8051-4e6a-8fc2-3600c6fb49ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:04.766262 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1a5497d0-5bf9-4bc5-afbe-02cece943fdb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance e10eb5b7-8051-4e6a-8fc2-3600c6fb49ce could not be found. Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a5497d0-5bf9-4bc5-afbe-02cece943fdb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/e10eb5b7-8051-4e6a-8fc2-3600c6fb49ce HTTP/1.1 Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance e10eb5b7-8051-4e6a-8fc2-3600c6fb49ce could not be found. Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'e10eb5b7-8051-4e6a-8fc2-3600c6fb49ce'} Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10eb5b7-8051-4e6a-8fc2-3600c6fb49ce could not be found. Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10eb5b7-8051-4e6a-8fc2-3600c6fb49ce could not be found. Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:04.768311 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:04.776350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:04.776350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:04.776350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:04.776350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:04.776350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:04.776350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:04.776350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10eb5b7-8051-4e6a-8fc2-3600c6fb49ce could not be found. Aug 27 04:56:04.776350 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:04.779258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a5497d0-5bf9-4bc5-afbe-02cece943fdb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance e10eb5b7-8051-4e6a-8fc2-3600c6fb49ce could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:04.781596 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a5497d0-5bf9-4bc5-afbe-02cece943fdb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e10eb5b7-8051-4e6a-8fc2-3600c6fb49ce" status: 404 len: 111 microversion: 2.1 time: 0.040684 Aug 27 04:56:04.784552 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2304/4560] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:56:04 2022] DELETE /compute/v2.1/servers/e10eb5b7-8051-4e6a-8fc2-3600c6fb49ce => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:04.792908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-822fbfd9-663e-45f9-a15a-29cbe101ca37 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:04.793855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-822fbfd9-663e-45f9-a15a-29cbe101ca37 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:04.805076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-822fbfd9-663e-45f9-a15a-29cbe101ca37 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:04.806542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-822fbfd9-663e-45f9-a15a-29cbe101ca37 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:04.807074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-822fbfd9-663e-45f9-a15a-29cbe101ca37 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:04.807904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-822fbfd9-663e-45f9-a15a-29cbe101ca37 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:04.808447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-822fbfd9-663e-45f9-a15a-29cbe101ca37 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:04.808993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-822fbfd9-663e-45f9-a15a-29cbe101ca37 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:05.710237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-822fbfd9-663e-45f9-a15a-29cbe101ca37 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:05.733806 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-822fbfd9-663e-45f9-a15a-29cbe101ca37 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.944856 Aug 27 04:56:05.734660 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2257/4561] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:04 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:05.778255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03717b8f-0105-4628-88b7-74c8db4d6c19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:05.779655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03717b8f-0105-4628-88b7-74c8db4d6c19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:05.816390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03717b8f-0105-4628-88b7-74c8db4d6c19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:05.816986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03717b8f-0105-4628-88b7-74c8db4d6c19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:05.817435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03717b8f-0105-4628-88b7-74c8db4d6c19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:05.818179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03717b8f-0105-4628-88b7-74c8db4d6c19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:05.818677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03717b8f-0105-4628-88b7-74c8db4d6c19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:05.822477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03717b8f-0105-4628-88b7-74c8db4d6c19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:06.191182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-03717b8f-0105-4628-88b7-74c8db4d6c19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:06.207607 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03717b8f-0105-4628-88b7-74c8db4d6c19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.447037 Aug 27 04:56:06.208464 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2305/4562] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:05 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:06.228131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a410a80f-58fe-4c2e-9c2e-6d65e86813d1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:06.229484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a410a80f-58fe-4c2e-9c2e-6d65e86813d1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 04:56:06.230546 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-a410a80f-58fe-4c2e-9c2e-6d65e86813d1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a410a80f-58fe-4c2e-9c2e-6d65e86813d1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 9223372036854775808 could not be found. Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '9223372036854775808'} Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:06.232055 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:06.237265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:06.237265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:06.237265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:06.237265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 27 04:56:06.237265 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:06.237265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a410a80f-58fe-4c2e-9c2e-6d65e86813d1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:06.237265 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a410a80f-58fe-4c2e-9c2e-6d65e86813d1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009391 Aug 27 04:56:06.237265 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2258/4563] 10.222.0.79 () {58 vars in 1188 bytes} [Sat Aug 27 04:56:06 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:56:06.244208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3e55758-0298-4097-a819-c78bc486d6f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:06.244860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e3e55758-0298-4097-a819-c78bc486d6f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:06.259809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3e55758-0298-4097-a819-c78bc486d6f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:06.260325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3e55758-0298-4097-a819-c78bc486d6f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:06.260796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3e55758-0298-4097-a819-c78bc486d6f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:06.261522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3e55758-0298-4097-a819-c78bc486d6f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:06.261982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3e55758-0298-4097-a819-c78bc486d6f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:06.262405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3e55758-0298-4097-a819-c78bc486d6f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:06.556228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e3e55758-0298-4097-a819-c78bc486d6f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:06.571981 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3e55758-0298-4097-a819-c78bc486d6f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.331835 Aug 27 04:56:06.585293 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2306/4564] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:06 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:06.639214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7f8e059a-a88a-4553-8c62-e54673dc2454 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:06.640307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7f8e059a-a88a-4553-8c62-e54673dc2454 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:06.644571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:06.679371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f8e059a-a88a-4553-8c62-e54673dc2454 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:06.684677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f8e059a-a88a-4553-8c62-e54673dc2454 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:06.686001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f8e059a-a88a-4553-8c62-e54673dc2454 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:06.691777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f8e059a-a88a-4553-8c62-e54673dc2454 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:06.693026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f8e059a-a88a-4553-8c62-e54673dc2454 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:06.693954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f8e059a-a88a-4553-8c62-e54673dc2454 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:07.256751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7f8e059a-a88a-4553-8c62-e54673dc2454 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:07.271916 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7f8e059a-a88a-4553-8c62-e54673dc2454 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.648087 Aug 27 04:56:07.288917 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2259/4565] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:06 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:07.297967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3914d99d-dced-4761-956f-5a9dc89c8bb9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:07.300453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3914d99d-dced-4761-956f-5a9dc89c8bb9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Failed to fetch instance by id -1 {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 04:56:07.301399 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3914d99d-dced-4761-956f-5a9dc89c8bb9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance -1 could not be found. Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3914d99d-dced-4761-956f-5a9dc89c8bb9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance -1 could not be found. Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '-1'} Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:07.304220 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:07.310001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:07.310001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:07.310001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 27 04:56:07.310001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:07.311841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3914d99d-dced-4761-956f-5a9dc89c8bb9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:07.313986 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3914d99d-dced-4761-956f-5a9dc89c8bb9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.023316 Aug 27 04:56:07.314934 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2307/4566] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 04:56:07 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 04:56:07.323361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5df406d2-917f-4c34-a2d7-5c8f04959795 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:07.324648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5df406d2-917f-4c34-a2d7-5c8f04959795 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:07.335555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5df406d2-917f-4c34-a2d7-5c8f04959795 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:07.338191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5df406d2-917f-4c34-a2d7-5c8f04959795 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:07.340246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5df406d2-917f-4c34-a2d7-5c8f04959795 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:07.341330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5df406d2-917f-4c34-a2d7-5c8f04959795 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:07.345872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5df406d2-917f-4c34-a2d7-5c8f04959795 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:07.346606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5df406d2-917f-4c34-a2d7-5c8f04959795 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:07.684339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5df406d2-917f-4c34-a2d7-5c8f04959795 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:07.695974 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5df406d2-917f-4c34-a2d7-5c8f04959795 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.376608 Aug 27 04:56:07.709376 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2260/4567] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:07 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:07.727439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-71e1e002-85c3-434d-949f-3a49932827db tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:07.728211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-71e1e002-85c3-434d-949f-3a49932827db tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:07.742901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e1e002-85c3-434d-949f-3a49932827db tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:07.743448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e1e002-85c3-434d-949f-3a49932827db tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:07.744145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e1e002-85c3-434d-949f-3a49932827db tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:07.747453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e1e002-85c3-434d-949f-3a49932827db tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:07.748161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e1e002-85c3-434d-949f-3a49932827db tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:07.748827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e1e002-85c3-434d-949f-3a49932827db tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:08.231769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71e1e002-85c3-434d-949f-3a49932827db tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:08.248945 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-71e1e002-85c3-434d-949f-3a49932827db tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.526882 Aug 27 04:56:08.265632 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2308/4568] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:07 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:08.288059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-640669c7-4309-40e7-9a99-438a4da43b73 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:08.289726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-640669c7-4309-40e7-9a99-438a4da43b73 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: c70f3322-3785-4f71-8214-924bac407dbb] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:08.332610 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-640669c7-4309-40e7-9a99-438a4da43b73 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance c70f3322-3785-4f71-8214-924bac407dbb could not be found. Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-640669c7-4309-40e7-9a99-438a4da43b73 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/c70f3322-3785-4f71-8214-924bac407dbb/action HTTP/1.1 Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 19 Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: {"forceDelete": {}} Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance c70f3322-3785-4f71-8214-924bac407dbb could not be found. Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'c70f3322-3785-4f71-8214-924bac407dbb', 'body': {'forceDelete': {}}} Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70f3322-3785-4f71-8214-924bac407dbb could not be found. Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70f3322-3785-4f71-8214-924bac407dbb could not be found. Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:08.342495 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:08.347960 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:08.347960 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:08.347960 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70f3322-3785-4f71-8214-924bac407dbb could not be found. Aug 27 04:56:08.347960 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:08.347960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-640669c7-4309-40e7-9a99-438a4da43b73 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance c70f3322-3785-4f71-8214-924bac407dbb could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:08.347960 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-640669c7-4309-40e7-9a99-438a4da43b73 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/c70f3322-3785-4f71-8214-924bac407dbb/action" status: 404 len: 111 microversion: 2.1 time: 0.074731 Aug 27 04:56:08.348796 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2261/4569] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:08 2022] POST /compute/v2.1/servers/c70f3322-3785-4f71-8214-924bac407dbb/action => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:08.358051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3444979-2b3e-45d1-914d-c0eff16bf00b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:08.360120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c3444979-2b3e-45d1-914d-c0eff16bf00b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:08.370593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3444979-2b3e-45d1-914d-c0eff16bf00b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:08.378341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3444979-2b3e-45d1-914d-c0eff16bf00b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:08.379121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3444979-2b3e-45d1-914d-c0eff16bf00b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:08.381101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3444979-2b3e-45d1-914d-c0eff16bf00b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:08.381775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3444979-2b3e-45d1-914d-c0eff16bf00b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:08.382431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3444979-2b3e-45d1-914d-c0eff16bf00b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:09.428432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3444979-2b3e-45d1-914d-c0eff16bf00b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:09.449652 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3444979-2b3e-45d1-914d-c0eff16bf00b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 1.096201 Aug 27 04:56:09.455788 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2309/4570] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:08 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:09.480096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d63fac4c-0ba6-4a4d-964b-dbfd321c25d7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:09.480895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d63fac4c-0ba6-4a4d-964b-dbfd321c25d7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:09.498877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d63fac4c-0ba6-4a4d-964b-dbfd321c25d7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:09.503512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d63fac4c-0ba6-4a4d-964b-dbfd321c25d7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:09.503789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d63fac4c-0ba6-4a4d-964b-dbfd321c25d7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:09.507558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d63fac4c-0ba6-4a4d-964b-dbfd321c25d7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:09.508915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d63fac4c-0ba6-4a4d-964b-dbfd321c25d7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:09.509361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d63fac4c-0ba6-4a4d-964b-dbfd321c25d7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:09.872568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d63fac4c-0ba6-4a4d-964b-dbfd321c25d7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:09.883710 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d63fac4c-0ba6-4a4d-964b-dbfd321c25d7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.408848 Aug 27 04:56:09.905420 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2262/4571] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:09 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:09.932268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cbf30b0c-dc5e-42f7-8cc7-728b29c39b5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:09.935591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cbf30b0c-dc5e-42f7-8cc7-728b29c39b5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 83195474-e3fe-4435-9003-5e73503acf1f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:09.957009 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-cbf30b0c-dc5e-42f7-8cc7-728b29c39b5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 83195474-e3fe-4435-9003-5e73503acf1f could not be found. Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cbf30b0c-dc5e-42f7-8cc7-728b29c39b5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/83195474-e3fe-4435-9003-5e73503acf1f/action HTTP/1.1 Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 39 Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: {"os-getConsoleOutput": {"length": 10}} Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 83195474-e3fe-4435-9003-5e73503acf1f could not be found. Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '83195474-e3fe-4435-9003-5e73503acf1f', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83195474-e3fe-4435-9003-5e73503acf1f could not be found. Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83195474-e3fe-4435-9003-5e73503acf1f could not be found. Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:09.971150 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:09.976808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:09.976808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:09.976808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:09.976808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:09.976808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83195474-e3fe-4435-9003-5e73503acf1f could not be found. Aug 27 04:56:09.976808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:09.976808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cbf30b0c-dc5e-42f7-8cc7-728b29c39b5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 83195474-e3fe-4435-9003-5e73503acf1f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:09.976808 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cbf30b0c-dc5e-42f7-8cc7-728b29c39b5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/83195474-e3fe-4435-9003-5e73503acf1f/action" status: 404 len: 111 microversion: 2.1 time: 0.046648 Aug 27 04:56:09.976808 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2310/4572] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:09 2022] POST /compute/v2.1/servers/83195474-e3fe-4435-9003-5e73503acf1f/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:09.986269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8ad2f30c-185c-4b38-acb2-358aa9008676 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:09.986269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8ad2f30c-185c-4b38-acb2-358aa9008676 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:10.001268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ad2f30c-185c-4b38-acb2-358aa9008676 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:10.005550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ad2f30c-185c-4b38-acb2-358aa9008676 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:10.006944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ad2f30c-185c-4b38-acb2-358aa9008676 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:10.008711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ad2f30c-185c-4b38-acb2-358aa9008676 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:10.012721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ad2f30c-185c-4b38-acb2-358aa9008676 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:10.013237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ad2f30c-185c-4b38-acb2-358aa9008676 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:10.365456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ad2f30c-185c-4b38-acb2-358aa9008676 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:10.379726 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8ad2f30c-185c-4b38-acb2-358aa9008676 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.401203 Aug 27 04:56:10.388625 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2263/4573] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:09 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:10.410934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63ce2a16-1714-49d4-ba7f-8106591fb3a2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:10.411812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-63ce2a16-1714-49d4-ba7f-8106591fb3a2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:10.423139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63ce2a16-1714-49d4-ba7f-8106591fb3a2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:10.433967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63ce2a16-1714-49d4-ba7f-8106591fb3a2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:10.434548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63ce2a16-1714-49d4-ba7f-8106591fb3a2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:10.435153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63ce2a16-1714-49d4-ba7f-8106591fb3a2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:10.435614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63ce2a16-1714-49d4-ba7f-8106591fb3a2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:10.436042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63ce2a16-1714-49d4-ba7f-8106591fb3a2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:10.711212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63ce2a16-1714-49d4-ba7f-8106591fb3a2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:10.725178 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63ce2a16-1714-49d4-ba7f-8106591fb3a2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.318297 Aug 27 04:56:10.726082 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2311/4574] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:10 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:10.758420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae2a62cd-edc6-4b03-8d4d-5434bfe95ac0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:10.759700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ae2a62cd-edc6-4b03-8d4d-5434bfe95ac0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 26349043-4ccc-4552-832a-4bec38292b9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:10.770014 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-ae2a62cd-edc6-4b03-8d4d-5434bfe95ac0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 26349043-4ccc-4552-832a-4bec38292b9c could not be found. Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae2a62cd-edc6-4b03-8d4d-5434bfe95ac0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/26349043-4ccc-4552-832a-4bec38292b9c HTTP/1.1 Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 26349043-4ccc-4552-832a-4bec38292b9c could not be found. Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '26349043-4ccc-4552-832a-4bec38292b9c'} Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26349043-4ccc-4552-832a-4bec38292b9c could not be found. Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26349043-4ccc-4552-832a-4bec38292b9c could not be found. Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:10.779341 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:10.785061 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:10.785061 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:10.785061 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:10.785061 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26349043-4ccc-4552-832a-4bec38292b9c could not be found. Aug 27 04:56:10.785061 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:10.785061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae2a62cd-edc6-4b03-8d4d-5434bfe95ac0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 26349043-4ccc-4552-832a-4bec38292b9c could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:10.785061 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ae2a62cd-edc6-4b03-8d4d-5434bfe95ac0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/26349043-4ccc-4552-832a-4bec38292b9c" status: 404 len: 111 microversion: 2.1 time: 0.033269 Aug 27 04:56:10.790132 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2264/4575] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:10 2022] GET /compute/v2.1/servers/26349043-4ccc-4552-832a-4bec38292b9c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:10.791012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf247e93-ca3b-4fab-901b-2105fb606245 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:10.791755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf247e93-ca3b-4fab-901b-2105fb606245 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:10.810686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf247e93-ca3b-4fab-901b-2105fb606245 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:10.811187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf247e93-ca3b-4fab-901b-2105fb606245 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:10.811629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf247e93-ca3b-4fab-901b-2105fb606245 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:10.812604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf247e93-ca3b-4fab-901b-2105fb606245 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:10.813071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf247e93-ca3b-4fab-901b-2105fb606245 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:10.813498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf247e93-ca3b-4fab-901b-2105fb606245 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:11.092179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf247e93-ca3b-4fab-901b-2105fb606245 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:11.101084 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf247e93-ca3b-4fab-901b-2105fb606245 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.314512 Aug 27 04:56:11.113987 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2312/4576] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:10 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:11.125880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c415df41-8925-41bf-8346-ce81afd2b1a4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:11.126739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c415df41-8925-41bf-8346-ce81afd2b1a4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:11.139752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c415df41-8925-41bf-8346-ce81afd2b1a4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:11.143999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c415df41-8925-41bf-8346-ce81afd2b1a4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:11.149733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c415df41-8925-41bf-8346-ce81afd2b1a4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:11.151172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c415df41-8925-41bf-8346-ce81afd2b1a4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:11.153519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c415df41-8925-41bf-8346-ce81afd2b1a4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:11.154651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c415df41-8925-41bf-8346-ce81afd2b1a4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:11.577270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c415df41-8925-41bf-8346-ce81afd2b1a4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:11.601512 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c415df41-8925-41bf-8346-ce81afd2b1a4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.479192 Aug 27 04:56:11.607279 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2265/4577] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:11 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:11.853384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de3effce-9a58-4775-a277-d6ec2e84ef8a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1709847279", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de3effce-9a58-4775-a277-d6ec2e84ef8a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 238 Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1709847279", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1709847279', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '1a15eb61-6c3a-49c3-9906-c4c8e2c9b393'}]}}} Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:11.884859 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de3effce-9a58-4775-a277-d6ec2e84ef8a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:11.892004 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de3effce-9a58-4775-a277-d6ec2e84ef8a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.037722 Aug 27 04:56:11.896224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0085f562-6376-48c4-a81f-a432390c6249 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:11.897089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0085f562-6376-48c4-a81f-a432390c6249 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:11.901989 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2313/4578] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:56:11 2022] POST /compute/v2.1/servers => generated 139 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:56:11.905094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0085f562-6376-48c4-a81f-a432390c6249 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:11.905593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0085f562-6376-48c4-a81f-a432390c6249 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:11.906204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0085f562-6376-48c4-a81f-a432390c6249 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:11.906948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0085f562-6376-48c4-a81f-a432390c6249 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:11.907405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0085f562-6376-48c4-a81f-a432390c6249 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:11.907833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0085f562-6376-48c4-a81f-a432390c6249 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:12.171775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0085f562-6376-48c4-a81f-a432390c6249 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:12.182864 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0085f562-6376-48c4-a81f-a432390c6249 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.290313 Aug 27 04:56:12.205625 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2266/4579] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:11 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:12.206665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc3be7b8-d6ec-4d0b-9b5e-6ba1e69e8d47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:12.220014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fc3be7b8-d6ec-4d0b-9b5e-6ba1e69e8d47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:12.242165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc3be7b8-d6ec-4d0b-9b5e-6ba1e69e8d47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:12.246781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc3be7b8-d6ec-4d0b-9b5e-6ba1e69e8d47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:12.247926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc3be7b8-d6ec-4d0b-9b5e-6ba1e69e8d47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:12.248931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc3be7b8-d6ec-4d0b-9b5e-6ba1e69e8d47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:12.252315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc3be7b8-d6ec-4d0b-9b5e-6ba1e69e8d47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:12.253096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc3be7b8-d6ec-4d0b-9b5e-6ba1e69e8d47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:12.658997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fc3be7b8-d6ec-4d0b-9b5e-6ba1e69e8d47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:12.675906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:12.679294 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc3be7b8-d6ec-4d0b-9b5e-6ba1e69e8d47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.477977 Aug 27 04:56:12.693462 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2314/4580] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:12 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:12.787796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8216a35c-d4bf-42f6-b45f-8c28b363731f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1276772677", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8216a35c-d4bf-42f6-b45f-8c28b363731f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 235 Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1276772677", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1276772677', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '1a15eb61-6c3a-49c3-9906-c4c8e2c9b393'}]}}} Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:12.798840 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8216a35c-d4bf-42f6-b45f-8c28b363731f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8216a35c-d4bf-42f6-b45f-8c28b363731f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.017616 Aug 27 04:56:12.805031 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2267/4581] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:56:12 2022] POST /compute/v2.1/servers => generated 133 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:56:12.811040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3197666f-f994-496d-a751-492cac680d02 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:12.811502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3197666f-f994-496d-a751-492cac680d02 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:12.827552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3197666f-f994-496d-a751-492cac680d02 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:12.828178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3197666f-f994-496d-a751-492cac680d02 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:12.828619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3197666f-f994-496d-a751-492cac680d02 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:12.829324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3197666f-f994-496d-a751-492cac680d02 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:12.829785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3197666f-f994-496d-a751-492cac680d02 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:12.830212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3197666f-f994-496d-a751-492cac680d02 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:13.440595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3197666f-f994-496d-a751-492cac680d02 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:13.453040 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3197666f-f994-496d-a751-492cac680d02 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.645057 Aug 27 04:56:13.453673 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2315/4582] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:12 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:13.477308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d21d7117-4ba3-413e-87a4-80e75945ed2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:13.478348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d21d7117-4ba3-413e-87a4-80e75945ed2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:13.499257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d21d7117-4ba3-413e-87a4-80e75945ed2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:13.500744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d21d7117-4ba3-413e-87a4-80e75945ed2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:13.503003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d21d7117-4ba3-413e-87a4-80e75945ed2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:13.504235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d21d7117-4ba3-413e-87a4-80e75945ed2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:13.504920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d21d7117-4ba3-413e-87a4-80e75945ed2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:13.506305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d21d7117-4ba3-413e-87a4-80e75945ed2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:13.849305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d21d7117-4ba3-413e-87a4-80e75945ed2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:13.858227 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d21d7117-4ba3-413e-87a4-80e75945ed2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.387468 Aug 27 04:56:13.861388 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2268/4583] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:13 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:13.869001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-759354790", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "ee88b0d5-acce-4c5e-a41a-140bdd133fe5"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:13.891500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-20859336-26c4-467d-bca7-36ab1d810fd2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:13.892227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-20859336-26c4-467d-bca7-36ab1d810fd2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: a7645084-ff19-4f1a-abb0-b594a37b8930] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:13.895467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=66 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:13.903631 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-20859336-26c4-467d-bca7-36ab1d810fd2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance a7645084-ff19-4f1a-abb0-b594a37b8930 could not be found. Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-20859336-26c4-467d-bca7-36ab1d810fd2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/a7645084-ff19-4f1a-abb0-b594a37b8930/action HTTP/1.1 Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 13 Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: {"pause": {}} Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance a7645084-ff19-4f1a-abb0-b594a37b8930 could not be found. Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'a7645084-ff19-4f1a-abb0-b594a37b8930', 'body': {'pause': {}}} Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7645084-ff19-4f1a-abb0-b594a37b8930 could not be found. Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7645084-ff19-4f1a-abb0-b594a37b8930 could not be found. Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:13.919286 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:13.925202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:13.925202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:13.925202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7645084-ff19-4f1a-abb0-b594a37b8930 could not be found. Aug 27 04:56:13.925202 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:13.925202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-20859336-26c4-467d-bca7-36ab1d810fd2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance a7645084-ff19-4f1a-abb0-b594a37b8930 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:13.925202 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-20859336-26c4-467d-bca7-36ab1d810fd2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/a7645084-ff19-4f1a-abb0-b594a37b8930/action" status: 404 len: 111 microversion: 2.1 time: 0.044019 Aug 27 04:56:13.925202 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2269/4584] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:13 2022] POST /compute/v2.1/servers/a7645084-ff19-4f1a-abb0-b594a37b8930/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:56:13.929343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cedf793b-c5b1-4365-ae7c-0d7929e78546 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:13.930260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cedf793b-c5b1-4365-ae7c-0d7929e78546 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:13.964264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cedf793b-c5b1-4365-ae7c-0d7929e78546 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:13.964859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cedf793b-c5b1-4365-ae7c-0d7929e78546 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:13.965267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cedf793b-c5b1-4365-ae7c-0d7929e78546 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:13.965970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cedf793b-c5b1-4365-ae7c-0d7929e78546 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:13.966503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cedf793b-c5b1-4365-ae7c-0d7929e78546 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:13.966934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cedf793b-c5b1-4365-ae7c-0d7929e78546 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:14.038637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] validate_networks() for [('ee88b0d5-acce-4c5e-a41a-140bdd133fe5', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:56:14.320382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cedf793b-c5b1-4365-ae7c-0d7929e78546 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:14.336004 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cedf793b-c5b1-4365-ae7c-0d7929e78546 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.407686 Aug 27 04:56:14.338768 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2270/4585] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:13 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:14.364399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a6b6f9d6-a7a3-4ff3-9668-1b589714dca3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:14.365433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a6b6f9d6-a7a3-4ff3-9668-1b589714dca3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:14.381753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6b6f9d6-a7a3-4ff3-9668-1b589714dca3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:14.385155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6b6f9d6-a7a3-4ff3-9668-1b589714dca3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:14.386388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6b6f9d6-a7a3-4ff3-9668-1b589714dca3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:14.390765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6b6f9d6-a7a3-4ff3-9668-1b589714dca3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:14.391718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6b6f9d6-a7a3-4ff3-9668-1b589714dca3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:14.393852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6b6f9d6-a7a3-4ff3-9668-1b589714dca3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:14.443910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:14.735709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a6b6f9d6-a7a3-4ff3-9668-1b589714dca3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:14.746458 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a6b6f9d6-a7a3-4ff3-9668-1b589714dca3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.386914 Aug 27 04:56:14.747624 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2271/4586] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:14 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:14.775551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7cb925d4-2201-4c29-95bd-019e3d219180 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:14.776573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7cb925d4-2201-4c29-95bd-019e3d219180 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:14.799850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cb925d4-2201-4c29-95bd-019e3d219180 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:14.806412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cb925d4-2201-4c29-95bd-019e3d219180 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:14.806727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cb925d4-2201-4c29-95bd-019e3d219180 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:14.807478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cb925d4-2201-4c29-95bd-019e3d219180 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:14.810159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cb925d4-2201-4c29-95bd-019e3d219180 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:14.811476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cb925d4-2201-4c29-95bd-019e3d219180 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:14.971100 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7cb925d4-2201-4c29-95bd-019e3d219180 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action" status: 202 len: 0 microversion: 2.1 time: 0.200411 Aug 27 04:56:14.973631 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2272/4587] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:14 2022] POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:56:15.005174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b147be90-25c0-48e4-ac81-2d2eb99c9f3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:15.008257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b147be90-25c0-48e4-ac81-2d2eb99c9f3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:15.040755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b147be90-25c0-48e4-ac81-2d2eb99c9f3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:15.047141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b147be90-25c0-48e4-ac81-2d2eb99c9f3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:15.055306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b147be90-25c0-48e4-ac81-2d2eb99c9f3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:15.056250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b147be90-25c0-48e4-ac81-2d2eb99c9f3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:15.062860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b147be90-25c0-48e4-ac81-2d2eb99c9f3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:15.065670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b147be90-25c0-48e4-ac81-2d2eb99c9f3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:15.456045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b147be90-25c0-48e4-ac81-2d2eb99c9f3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:15.473364 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b147be90-25c0-48e4-ac81-2d2eb99c9f3b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1510 microversion: 2.1 time: 0.484584 Aug 27 04:56:15.474652 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2273/4588] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:14 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1510 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:16.491639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:56:16.492594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:56:16.492736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:56:16.493126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:56:16.496800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:56:16.503674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-598ef64c-708d-4437-bb59-456c2c7a708d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:16.518636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:16.521017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:16.521589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:16.522499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:16.526109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:16.527462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:16.528494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-598ef64c-708d-4437-bb59-456c2c7a708d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:16.547479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-598ef64c-708d-4437-bb59-456c2c7a708d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:16.549192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-598ef64c-708d-4437-bb59-456c2c7a708d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:16.549663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-598ef64c-708d-4437-bb59-456c2c7a708d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:16.550457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-598ef64c-708d-4437-bb59-456c2c7a708d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:16.550826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-598ef64c-708d-4437-bb59-456c2c7a708d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:16.551250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-598ef64c-708d-4437-bb59-456c2c7a708d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:16.576736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Getting quotas for project b952f425c6a244faadf7e8507a75f2a5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:56:16.595660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Getting quotas for user a052261afeb243018b05277cec626ee8 and project b952f425c6a244faadf7e8507a75f2a5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:56:16.633860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:56:16.636263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:56:16.724628 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4338fd02-7895-49a2-a1ab-6d416bd0c998 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.166784 Aug 27 04:56:16.730352 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2316/4589] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:56:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:56:16.740179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f83faa8-3b78-407a-bb39-ef6324abf9ad tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:16.740815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f83faa8-3b78-407a-bb39-ef6324abf9ad tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:16.913901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f83faa8-3b78-407a-bb39-ef6324abf9ad tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:16.921937 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f83faa8-3b78-407a-bb39-ef6324abf9ad tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1213 microversion: 2.1 time: 0.185558 Aug 27 04:56:16.926622 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2317/4590] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:16 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1213 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:17.054259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-598ef64c-708d-4437-bb59-456c2c7a708d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:17.070745 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-598ef64c-708d-4437-bb59-456c2c7a708d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1490 microversion: 2.1 time: 0.578753 Aug 27 04:56:17.071394 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2274/4591] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:16 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1490 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:17.101304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3250d963-6032-487f-bfb8-d1fb797faa67 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:17.101858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3250d963-6032-487f-bfb8-d1fb797faa67 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:17.120346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3250d963-6032-487f-bfb8-d1fb797faa67 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:17.121181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3250d963-6032-487f-bfb8-d1fb797faa67 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:17.121822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3250d963-6032-487f-bfb8-d1fb797faa67 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:17.122725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3250d963-6032-487f-bfb8-d1fb797faa67 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:17.125090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3250d963-6032-487f-bfb8-d1fb797faa67 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:17.125735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3250d963-6032-487f-bfb8-d1fb797faa67 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:17.192449 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3250d963-6032-487f-bfb8-d1fb797faa67 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Cannot 'pause' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state paused Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3250d963-6032-487f-bfb8-d1fb797faa67 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action HTTP/1.1 Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 13 Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: {"pause": {}} Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: exception: Cannot 'pause' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state paused Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '228b4767-bbe2-41d0-a7d4-a6670e79043f', 'body': {'pause': {}}} Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 228b4767-bbe2-41d0-a7d4-a6670e79043f in vm_state paused. Cannot pause while the instance is in this state. Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state paused Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:17.212737 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:17.219018 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:17.219018 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:17.219018 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:17.219018 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state paused Aug 27 04:56:17.219018 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:17.219018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3250d963-6032-487f-bfb8-d1fb797faa67 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 409 to user: Cannot 'pause' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state paused {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:17.219018 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3250d963-6032-487f-bfb8-d1fb797faa67 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action" status: 409 len: 143 microversion: 2.1 time: 0.124224 Aug 27 04:56:17.220518 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2318/4592] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:17 2022] POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action => generated 143 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:56:17.229038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dcf7139b-3f3e-4db4-8b51-240597de2e4b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:17.229725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dcf7139b-3f3e-4db4-8b51-240597de2e4b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:17.258535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcf7139b-3f3e-4db4-8b51-240597de2e4b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:17.260698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcf7139b-3f3e-4db4-8b51-240597de2e4b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:17.261558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcf7139b-3f3e-4db4-8b51-240597de2e4b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:17.278252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcf7139b-3f3e-4db4-8b51-240597de2e4b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:17.280418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcf7139b-3f3e-4db4-8b51-240597de2e4b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:17.283096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dcf7139b-3f3e-4db4-8b51-240597de2e4b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:17.402892 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dcf7139b-3f3e-4db4-8b51-240597de2e4b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action" status: 202 len: 0 microversion: 2.1 time: 0.177494 Aug 27 04:56:17.404565 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2275/4593] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:17 2022] POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:56:17.413089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe4b3778-061d-41b8-afad-9b0dc54f44c5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:17.413627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe4b3778-061d-41b8-afad-9b0dc54f44c5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:17.432625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe4b3778-061d-41b8-afad-9b0dc54f44c5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:17.437584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe4b3778-061d-41b8-afad-9b0dc54f44c5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:17.438040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe4b3778-061d-41b8-afad-9b0dc54f44c5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:17.438780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe4b3778-061d-41b8-afad-9b0dc54f44c5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:17.439241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe4b3778-061d-41b8-afad-9b0dc54f44c5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:17.439664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe4b3778-061d-41b8-afad-9b0dc54f44c5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:17.900620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe4b3778-061d-41b8-afad-9b0dc54f44c5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:17.912768 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe4b3778-061d-41b8-afad-9b0dc54f44c5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1497 microversion: 2.1 time: 0.503522 Aug 27 04:56:17.914759 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2319/4594] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:17 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1497 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:17.945345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d17c0091-f9e9-438b-bd58-fe70c486af80 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:17.946780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d17c0091-f9e9-438b-bd58-fe70c486af80 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:17.961898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d17c0091-f9e9-438b-bd58-fe70c486af80 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:17.964117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d17c0091-f9e9-438b-bd58-fe70c486af80 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:17.964975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d17c0091-f9e9-438b-bd58-fe70c486af80 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:17.965924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d17c0091-f9e9-438b-bd58-fe70c486af80 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:17.966576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d17c0091-f9e9-438b-bd58-fe70c486af80 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:17.967177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d17c0091-f9e9-438b-bd58-fe70c486af80 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:18.086791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d17c0091-f9e9-438b-bd58-fe70c486af80 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:18.100314 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d17c0091-f9e9-438b-bd58-fe70c486af80 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1209 microversion: 2.1 time: 0.159612 Aug 27 04:56:18.102413 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2276/4595] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:17 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1209 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:18.936371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ce40035-1a5f-4284-86cf-d8edfce00331 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:18.937927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0ce40035-1a5f-4284-86cf-d8edfce00331 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:18.954582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ce40035-1a5f-4284-86cf-d8edfce00331 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:18.957146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ce40035-1a5f-4284-86cf-d8edfce00331 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:18.957627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ce40035-1a5f-4284-86cf-d8edfce00331 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:18.958393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ce40035-1a5f-4284-86cf-d8edfce00331 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:18.958838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ce40035-1a5f-4284-86cf-d8edfce00331 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:18.961081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ce40035-1a5f-4284-86cf-d8edfce00331 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:19.123243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9bb52f33-9bfd-45c7-a691-1883f37038fe tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:19.125156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9bb52f33-9bfd-45c7-a691-1883f37038fe tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:19.139829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bb52f33-9bfd-45c7-a691-1883f37038fe tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:19.140947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bb52f33-9bfd-45c7-a691-1883f37038fe tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:19.141652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bb52f33-9bfd-45c7-a691-1883f37038fe tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:19.144287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bb52f33-9bfd-45c7-a691-1883f37038fe tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:19.147004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bb52f33-9bfd-45c7-a691-1883f37038fe tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:19.147697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bb52f33-9bfd-45c7-a691-1883f37038fe tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:19.169209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0ce40035-1a5f-4284-86cf-d8edfce00331 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:19.205616 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ce40035-1a5f-4284-86cf-d8edfce00331 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.268355 Aug 27 04:56:19.222396 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2320/4596] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:18 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:19.237464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bfddb196-4df2-4e38-be64-41f30adfb09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:19.243304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bfddb196-4df2-4e38-be64-41f30adfb09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:19.259159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfddb196-4df2-4e38-be64-41f30adfb09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:19.260143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfddb196-4df2-4e38-be64-41f30adfb09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:19.260862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfddb196-4df2-4e38-be64-41f30adfb09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:19.261843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfddb196-4df2-4e38-be64-41f30adfb09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:19.265783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfddb196-4df2-4e38-be64-41f30adfb09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:19.266546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfddb196-4df2-4e38-be64-41f30adfb09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:19.511988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bfddb196-4df2-4e38-be64-41f30adfb09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:19.529746 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bfddb196-4df2-4e38-be64-41f30adfb09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.296570 Aug 27 04:56:19.545992 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2321/4597] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:19 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:19.551372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-738f4d28-2134-42df-af3a-f0debdf932a6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:19.554969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-738f4d28-2134-42df-af3a-f0debdf932a6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:19.566197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-738f4d28-2134-42df-af3a-f0debdf932a6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:19.566720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-738f4d28-2134-42df-af3a-f0debdf932a6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:19.567156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-738f4d28-2134-42df-af3a-f0debdf932a6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:19.567858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-738f4d28-2134-42df-af3a-f0debdf932a6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:19.568309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-738f4d28-2134-42df-af3a-f0debdf932a6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:19.568760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-738f4d28-2134-42df-af3a-f0debdf932a6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:19.609577 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-738f4d28-2134-42df-af3a-f0debdf932a6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-738f4d28-2134-42df-af3a-f0debdf932a6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486/action HTTP/1.1 Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 28 Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: {"reboot": {"type": "SOFT"}} Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '71ce8444-1fbd-4b28-90bb-a5a472e04486', 'body': {'reboot': {'type': 'SOFT'}}} Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:19.611443 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:19.619721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:56:19.619721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:19.619721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:19.619721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:19.619721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:19.619721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:19.619721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:19.619721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:19.619721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:19.619721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:56:19.619721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:19.619721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-738f4d28-2134-42df-af3a-f0debdf932a6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:19.619721 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-738f4d28-2134-42df-af3a-f0debdf932a6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486/action" status: 404 len: 111 microversion: 2.1 time: 0.065532 Aug 27 04:56:19.619721 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2322/4598] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:19 2022] POST /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:19.621527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e786229-6d07-468a-94bf-50084935bf60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:19.622100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e786229-6d07-468a-94bf-50084935bf60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:19.632910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e786229-6d07-468a-94bf-50084935bf60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:19.633410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e786229-6d07-468a-94bf-50084935bf60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:19.633853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e786229-6d07-468a-94bf-50084935bf60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:19.634563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e786229-6d07-468a-94bf-50084935bf60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:19.635021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e786229-6d07-468a-94bf-50084935bf60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:19.635449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e786229-6d07-468a-94bf-50084935bf60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:19.850713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9bb52f33-9bfd-45c7-a691-1883f37038fe tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:19.916404 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9bb52f33-9bfd-45c7-a691-1883f37038fe tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1283 microversion: 2.1 time: 0.796981 Aug 27 04:56:19.968858 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2277/4599] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:19 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1283 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:20.136912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4e786229-6d07-468a-94bf-50084935bf60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:20.149457 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e786229-6d07-468a-94bf-50084935bf60 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.531720 Aug 27 04:56:20.158627 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2323/4600] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:19 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:20.185309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0303c3ec-6ca7-4b54-b2e6-38cc7e13eeb5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:20.186962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0303c3ec-6ca7-4b54-b2e6-38cc7e13eeb5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:20.195869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0303c3ec-6ca7-4b54-b2e6-38cc7e13eeb5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:20.197324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0303c3ec-6ca7-4b54-b2e6-38cc7e13eeb5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:20.197946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0303c3ec-6ca7-4b54-b2e6-38cc7e13eeb5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:20.198845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0303c3ec-6ca7-4b54-b2e6-38cc7e13eeb5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:20.199989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0303c3ec-6ca7-4b54-b2e6-38cc7e13eeb5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:20.200873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0303c3ec-6ca7-4b54-b2e6-38cc7e13eeb5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:20.669720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0303c3ec-6ca7-4b54-b2e6-38cc7e13eeb5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:20.682032 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0303c3ec-6ca7-4b54-b2e6-38cc7e13eeb5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.501152 Aug 27 04:56:20.683172 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2278/4601] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:20 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:20.705811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3256fae5-b119-4fbe-8d04-8b84fc63317b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:20.708423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3256fae5-b119-4fbe-8d04-8b84fc63317b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 6e350d8c-504a-4a49-97f0-5745f5b0a037] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:20.714442 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3256fae5-b119-4fbe-8d04-8b84fc63317b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 6e350d8c-504a-4a49-97f0-5745f5b0a037 could not be found. Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3256fae5-b119-4fbe-8d04-8b84fc63317b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/6e350d8c-504a-4a49-97f0-5745f5b0a037/action HTTP/1.1 Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 28 Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: {"reboot": {"type": "SOFT"}} Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 6e350d8c-504a-4a49-97f0-5745f5b0a037 could not be found. Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '6e350d8c-504a-4a49-97f0-5745f5b0a037', 'body': {'reboot': {'type': 'SOFT'}}} Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e350d8c-504a-4a49-97f0-5745f5b0a037 could not be found. Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e350d8c-504a-4a49-97f0-5745f5b0a037 could not be found. Aug 27 04:56:20.716283 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:20.721687 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:20.721687 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:20.721687 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:20.721687 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:20.721687 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:20.721687 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:20.721687 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:20.721687 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e350d8c-504a-4a49-97f0-5745f5b0a037 could not be found. Aug 27 04:56:20.721687 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:20.723198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3256fae5-b119-4fbe-8d04-8b84fc63317b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 6e350d8c-504a-4a49-97f0-5745f5b0a037 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:20.724375 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3256fae5-b119-4fbe-8d04-8b84fc63317b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/6e350d8c-504a-4a49-97f0-5745f5b0a037/action" status: 404 len: 111 microversion: 2.1 time: 0.023829 Aug 27 04:56:20.725186 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2324/4602] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:20 2022] POST /compute/v2.1/servers/6e350d8c-504a-4a49-97f0-5745f5b0a037/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:20.733834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7bb59be0-6fe6-4912-a804-6a91c756881c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:20.734454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7bb59be0-6fe6-4912-a804-6a91c756881c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:20.747140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bb59be0-6fe6-4912-a804-6a91c756881c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:20.747701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bb59be0-6fe6-4912-a804-6a91c756881c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:20.755505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bb59be0-6fe6-4912-a804-6a91c756881c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:20.756775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bb59be0-6fe6-4912-a804-6a91c756881c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:20.757432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bb59be0-6fe6-4912-a804-6a91c756881c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:20.758033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7bb59be0-6fe6-4912-a804-6a91c756881c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:20.991225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f32d17e-2437-427f-afe6-2a73fb22502e tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:20.991854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f32d17e-2437-427f-afe6-2a73fb22502e tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:21.014451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f32d17e-2437-427f-afe6-2a73fb22502e tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.015481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f32d17e-2437-427f-afe6-2a73fb22502e tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.015931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f32d17e-2437-427f-afe6-2a73fb22502e tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.016695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f32d17e-2437-427f-afe6-2a73fb22502e tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.017164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f32d17e-2437-427f-afe6-2a73fb22502e tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.017593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f32d17e-2437-427f-afe6-2a73fb22502e tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.152275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f32d17e-2437-427f-afe6-2a73fb22502e tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:21.174632 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f32d17e-2437-427f-afe6-2a73fb22502e tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1271 microversion: 2.1 time: 0.187883 Aug 27 04:56:21.197437 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2325/4603] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:20 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1271 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:21.392146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7bb59be0-6fe6-4912-a804-6a91c756881c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:21.405488 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7bb59be0-6fe6-4912-a804-6a91c756881c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.675618 Aug 27 04:56:21.407513 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2279/4604] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:20 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:21.436455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ede6a257-0a03-4a29-9cdf-4cb155ba78b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:21.437975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ede6a257-0a03-4a29-9cdf-4cb155ba78b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:21.455810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ede6a257-0a03-4a29-9cdf-4cb155ba78b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.456308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ede6a257-0a03-4a29-9cdf-4cb155ba78b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.456799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ede6a257-0a03-4a29-9cdf-4cb155ba78b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.465476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ede6a257-0a03-4a29-9cdf-4cb155ba78b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.466078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ede6a257-0a03-4a29-9cdf-4cb155ba78b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.466543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ede6a257-0a03-4a29-9cdf-4cb155ba78b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.743582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ede6a257-0a03-4a29-9cdf-4cb155ba78b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:21.757215 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ede6a257-0a03-4a29-9cdf-4cb155ba78b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.325126 Aug 27 04:56:21.762792 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2326/4605] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:21 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:21.783779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d9330c9c-40a3-4eee-bb33-12e5976100ef tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71228424-9f42-4121-865e-14501cc9b5c0"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:21.786939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d9330c9c-40a3-4eee-bb33-12e5976100ef tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:21.799719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9330c9c-40a3-4eee-bb33-12e5976100ef tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.800522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9330c9c-40a3-4eee-bb33-12e5976100ef tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.801488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9330c9c-40a3-4eee-bb33-12e5976100ef tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.802487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9330c9c-40a3-4eee-bb33-12e5976100ef tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.803135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9330c9c-40a3-4eee-bb33-12e5976100ef tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.804282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9330c9c-40a3-4eee-bb33-12e5976100ef tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.823967 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-d9330c9c-40a3-4eee-bb33-12e5976100ef tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d9330c9c-40a3-4eee-bb33-12e5976100ef tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486/action HTTP/1.1 Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 65 Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: {"rebuild": {"imageRef": "71228424-9f42-4121-865e-14501cc9b5c0"}} Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '71ce8444-1fbd-4b28-90bb-a5a472e04486', 'body': {'rebuild': {'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0'}}} Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 04:56:21.826148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:56:21.831618 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:21.834502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d9330c9c-40a3-4eee-bb33-12e5976100ef tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:21.835911 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d9330c9c-40a3-4eee-bb33-12e5976100ef tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486/action" status: 404 len: 111 microversion: 2.1 time: 0.058502 Aug 27 04:56:21.840421 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2280/4606] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:21 2022] POST /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:21.851439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-004c75eb-a353-41c6-b54b-d984edafec34 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:21.853446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-004c75eb-a353-41c6-b54b-d984edafec34 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:21.879021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-004c75eb-a353-41c6-b54b-d984edafec34 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.879504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-004c75eb-a353-41c6-b54b-d984edafec34 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.879953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-004c75eb-a353-41c6-b54b-d984edafec34 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:21.880718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-004c75eb-a353-41c6-b54b-d984edafec34 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:21.881209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-004c75eb-a353-41c6-b54b-d984edafec34 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:21.881641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-004c75eb-a353-41c6-b54b-d984edafec34 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:22.211162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6e8a2aa2-889f-4d64-90bc-ca5fe733e486 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:22.212354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6e8a2aa2-889f-4d64-90bc-ca5fe733e486 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:22.226818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e8a2aa2-889f-4d64-90bc-ca5fe733e486 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:22.227956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e8a2aa2-889f-4d64-90bc-ca5fe733e486 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:22.230025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e8a2aa2-889f-4d64-90bc-ca5fe733e486 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:22.231138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e8a2aa2-889f-4d64-90bc-ca5fe733e486 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:22.233369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e8a2aa2-889f-4d64-90bc-ca5fe733e486 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:22.234146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e8a2aa2-889f-4d64-90bc-ca5fe733e486 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:22.384025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6e8a2aa2-889f-4d64-90bc-ca5fe733e486 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:22.408056 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6e8a2aa2-889f-4d64-90bc-ca5fe733e486 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1271 microversion: 2.1 time: 0.188359 Aug 27 04:56:22.427491 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2281/4607] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:22 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:22.486623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-004c75eb-a353-41c6-b54b-d984edafec34 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:22.495966 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-004c75eb-a353-41c6-b54b-d984edafec34 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.654483 Aug 27 04:56:22.508920 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2327/4608] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:21 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:22.536017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a7136927-a30e-457c-ad53-2374a916064a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:22.536670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a7136927-a30e-457c-ad53-2374a916064a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:22.549934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7136927-a30e-457c-ad53-2374a916064a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:22.554759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7136927-a30e-457c-ad53-2374a916064a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:22.555266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7136927-a30e-457c-ad53-2374a916064a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:22.558495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7136927-a30e-457c-ad53-2374a916064a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:22.570685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7136927-a30e-457c-ad53-2374a916064a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:22.571346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7136927-a30e-457c-ad53-2374a916064a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:23.058015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a7136927-a30e-457c-ad53-2374a916064a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:23.075603 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a7136927-a30e-457c-ad53-2374a916064a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.543618 Aug 27 04:56:23.079883 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2282/4609] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:22 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:23.102095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f84279b6-0fbc-41af-b265-be9c8c0f8694 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71228424-9f42-4121-865e-14501cc9b5c0"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:23.105824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f84279b6-0fbc-41af-b265-be9c8c0f8694 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 9e849f22-30c0-4ffd-9e62-b08e4361ccc1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:23.121901 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f84279b6-0fbc-41af-b265-be9c8c0f8694 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 9e849f22-30c0-4ffd-9e62-b08e4361ccc1 could not be found. Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f84279b6-0fbc-41af-b265-be9c8c0f8694 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/9e849f22-30c0-4ffd-9e62-b08e4361ccc1/action HTTP/1.1 Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 65 Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: {"rebuild": {"imageRef": "71228424-9f42-4121-865e-14501cc9b5c0"}} Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 9e849f22-30c0-4ffd-9e62-b08e4361ccc1 could not be found. Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '9e849f22-30c0-4ffd-9e62-b08e4361ccc1', 'body': {'rebuild': {'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0'}}} Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e849f22-30c0-4ffd-9e62-b08e4361ccc1 could not be found. Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 04:56:23.130375 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:23.135211 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:23.135211 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:23.135211 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:23.135211 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e849f22-30c0-4ffd-9e62-b08e4361ccc1 could not be found. Aug 27 04:56:23.135211 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:23.135211 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:23.135211 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:23.135211 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:23.135211 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:23.135211 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:23.135211 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:23.135211 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:23.135211 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e849f22-30c0-4ffd-9e62-b08e4361ccc1 could not be found. Aug 27 04:56:23.135211 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:23.140138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f84279b6-0fbc-41af-b265-be9c8c0f8694 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 9e849f22-30c0-4ffd-9e62-b08e4361ccc1 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:23.142329 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f84279b6-0fbc-41af-b265-be9c8c0f8694 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/9e849f22-30c0-4ffd-9e62-b08e4361ccc1/action" status: 404 len: 111 microversion: 2.1 time: 0.046194 Aug 27 04:56:23.145514 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2328/4610] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:23 2022] POST /compute/v2.1/servers/9e849f22-30c0-4ffd-9e62-b08e4361ccc1/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:23.152894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-396e60a6-f661-4c6f-89cf-298d93c45487 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:23.153738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-396e60a6-f661-4c6f-89cf-298d93c45487 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:23.167517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-396e60a6-f661-4c6f-89cf-298d93c45487 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:23.168208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-396e60a6-f661-4c6f-89cf-298d93c45487 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:23.174167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-396e60a6-f661-4c6f-89cf-298d93c45487 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:23.175682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-396e60a6-f661-4c6f-89cf-298d93c45487 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:23.176426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-396e60a6-f661-4c6f-89cf-298d93c45487 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:23.177205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-396e60a6-f661-4c6f-89cf-298d93c45487 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:23.433144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b41ba05c-283a-4b0d-9f89-2680398a7ef4 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:23.433950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b41ba05c-283a-4b0d-9f89-2680398a7ef4 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:23.460197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b41ba05c-283a-4b0d-9f89-2680398a7ef4 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:23.461173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b41ba05c-283a-4b0d-9f89-2680398a7ef4 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:23.462929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b41ba05c-283a-4b0d-9f89-2680398a7ef4 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:23.463684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b41ba05c-283a-4b0d-9f89-2680398a7ef4 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:23.466144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b41ba05c-283a-4b0d-9f89-2680398a7ef4 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:23.466612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b41ba05c-283a-4b0d-9f89-2680398a7ef4 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:23.601837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-396e60a6-f661-4c6f-89cf-298d93c45487 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:23.615794 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-396e60a6-f661-4c6f-89cf-298d93c45487 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.467952 Aug 27 04:56:23.629186 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2283/4611] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:23 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:24.080439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b41ba05c-283a-4b0d-9f89-2680398a7ef4 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:24.091780 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b41ba05c-283a-4b0d-9f89-2680398a7ef4 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1313 microversion: 2.1 time: 0.663540 Aug 27 04:56:24.095502 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2329/4612] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:23 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1313 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:24.107912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60ff477e-3c5a-4b81-a432-ff196efdf284 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:24.118439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60ff477e-3c5a-4b81-a432-ff196efdf284 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:24.152819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60ff477e-3c5a-4b81-a432-ff196efdf284 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:24.156288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60ff477e-3c5a-4b81-a432-ff196efdf284 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:24.157482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60ff477e-3c5a-4b81-a432-ff196efdf284 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:24.159427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60ff477e-3c5a-4b81-a432-ff196efdf284 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:24.162131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60ff477e-3c5a-4b81-a432-ff196efdf284 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:24.166306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60ff477e-3c5a-4b81-a432-ff196efdf284 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:24.525420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3ea47d1f-cd12-4b8c-b70a-d6bc561cb648 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:24.526641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3ea47d1f-cd12-4b8c-b70a-d6bc561cb648 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:24.538632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ea47d1f-cd12-4b8c-b70a-d6bc561cb648 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:24.539572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ea47d1f-cd12-4b8c-b70a-d6bc561cb648 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:24.542451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ea47d1f-cd12-4b8c-b70a-d6bc561cb648 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:24.544138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ea47d1f-cd12-4b8c-b70a-d6bc561cb648 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:24.545614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ea47d1f-cd12-4b8c-b70a-d6bc561cb648 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:24.547547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ea47d1f-cd12-4b8c-b70a-d6bc561cb648 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:24.584592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3ea47d1f-cd12-4b8c-b70a-d6bc561cb648 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:56:24.699211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60ff477e-3c5a-4b81-a432-ff196efdf284 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:24.710675 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60ff477e-3c5a-4b81-a432-ff196efdf284 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.611465 Aug 27 04:56:24.720970 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2330/4613] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:24 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:24.740458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fba491e-6958-439e-a969-44c04b0e9653 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:24.747785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6fba491e-6958-439e-a969-44c04b0e9653 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: fb6a7355-cdfa-4799-8f4b-3644d1e640d3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:24.763837 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6fba491e-6958-439e-a969-44c04b0e9653 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance fb6a7355-cdfa-4799-8f4b-3644d1e640d3 could not be found. Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fba491e-6958-439e-a969-44c04b0e9653 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/fb6a7355-cdfa-4799-8f4b-3644d1e640d3/action HTTP/1.1 Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 15 Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: {"restore": {}} Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance fb6a7355-cdfa-4799-8f4b-3644d1e640d3 could not be found. Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'fb6a7355-cdfa-4799-8f4b-3644d1e640d3', 'body': {'restore': {}}} Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb6a7355-cdfa-4799-8f4b-3644d1e640d3 could not be found. Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb6a7355-cdfa-4799-8f4b-3644d1e640d3 could not be found. Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:24.766421 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:24.771914 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:24.771914 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:24.771914 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb6a7355-cdfa-4799-8f4b-3644d1e640d3 could not be found. Aug 27 04:56:24.771914 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:24.776186 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3ea47d1f-cd12-4b8c-b70a-d6bc561cb648 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 204 len: 0 microversion: 2.32 time: 1.142416 Aug 27 04:56:24.777728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fba491e-6958-439e-a969-44c04b0e9653 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance fb6a7355-cdfa-4799-8f4b-3644d1e640d3 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:24.777893 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2284/4614] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:56:23 2022] DELETE /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 0 bytes in 1147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:56:24.779768 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6fba491e-6958-439e-a969-44c04b0e9653 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/fb6a7355-cdfa-4799-8f4b-3644d1e640d3/action" status: 404 len: 111 microversion: 2.1 time: 0.050107 Aug 27 04:56:24.787929 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2331/4615] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:24 2022] POST /compute/v2.1/servers/fb6a7355-cdfa-4799-8f4b-3644d1e640d3/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:24.794059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8358aa02-2b73-4494-b7e7-fd83020a7e92 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:24.796756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8358aa02-2b73-4494-b7e7-fd83020a7e92 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:24.800645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6a10c40-f4a8-4915-8492-53a66fa2da47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:24.804128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6a10c40-f4a8-4915-8492-53a66fa2da47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:24.810273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8358aa02-2b73-4494-b7e7-fd83020a7e92 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:24.813457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8358aa02-2b73-4494-b7e7-fd83020a7e92 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:24.814881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8358aa02-2b73-4494-b7e7-fd83020a7e92 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:24.816853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8358aa02-2b73-4494-b7e7-fd83020a7e92 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:24.818617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8358aa02-2b73-4494-b7e7-fd83020a7e92 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:24.819876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8358aa02-2b73-4494-b7e7-fd83020a7e92 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:24.822867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a10c40-f4a8-4915-8492-53a66fa2da47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:24.825597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a10c40-f4a8-4915-8492-53a66fa2da47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:24.826236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a10c40-f4a8-4915-8492-53a66fa2da47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:24.829068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a10c40-f4a8-4915-8492-53a66fa2da47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:24.829746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a10c40-f4a8-4915-8492-53a66fa2da47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:24.832416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a10c40-f4a8-4915-8492-53a66fa2da47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:24.835399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:25.161545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d6a10c40-f4a8-4915-8492-53a66fa2da47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:25.173701 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6a10c40-f4a8-4915-8492-53a66fa2da47 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.384126 Aug 27 04:56:25.193364 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2332/4616] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:24 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:25.203572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-355eecf6-cb3f-40d1-a7d0-892590cd7bdf req-e2196b41-788b-44af-89dd-30fb9b5d0290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c952536b-2682-46ff-9623-9ca8e992eb96", "tag": "cbc6a9b5-d543-4b1d-a522-41fc6d42bc9d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:25.225719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-355eecf6-cb3f-40d1-a7d0-892590cd7bdf req-e2196b41-788b-44af-89dd-30fb9b5d0290 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:25.226277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-355eecf6-cb3f-40d1-a7d0-892590cd7bdf req-e2196b41-788b-44af-89dd-30fb9b5d0290 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:25.226711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-355eecf6-cb3f-40d1-a7d0-892590cd7bdf req-e2196b41-788b-44af-89dd-30fb9b5d0290 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:25.250799 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-355eecf6-cb3f-40d1-a7d0-892590cd7bdf req-e2196b41-788b-44af-89dd-30fb9b5d0290 service nova] Creating event network-changed:cbc6a9b5-d543-4b1d-a522-41fc6d42bc9d for instance c952536b-2682-46ff-9623-9ca8e992eb96 on n-h1-854823-1 Aug 27 04:56:25.261035 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-355eecf6-cb3f-40d1-a7d0-892590cd7bdf req-e2196b41-788b-44af-89dd-30fb9b5d0290 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064732 Aug 27 04:56:25.263569 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2333/4617] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:25.270010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d82a5082-6d2b-483e-b960-0140a4fcb18c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:25.273270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d82a5082-6d2b-483e-b960-0140a4fcb18c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:25.290336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82a5082-6d2b-483e-b960-0140a4fcb18c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:25.295336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82a5082-6d2b-483e-b960-0140a4fcb18c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:25.296177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82a5082-6d2b-483e-b960-0140a4fcb18c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:25.302871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82a5082-6d2b-483e-b960-0140a4fcb18c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:25.303583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82a5082-6d2b-483e-b960-0140a4fcb18c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:25.304441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82a5082-6d2b-483e-b960-0140a4fcb18c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:25.600949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d82a5082-6d2b-483e-b960-0140a4fcb18c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:25.611591 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d82a5082-6d2b-483e-b960-0140a4fcb18c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1313 microversion: 2.1 time: 0.346528 Aug 27 04:56:25.626771 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2334/4618] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:25 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:25.634393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cddfce9d-4651-47bb-801c-12c104bfb3bf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:25.636142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cddfce9d-4651-47bb-801c-12c104bfb3bf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:25.650044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cddfce9d-4651-47bb-801c-12c104bfb3bf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:25.651050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cddfce9d-4651-47bb-801c-12c104bfb3bf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:25.651682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cddfce9d-4651-47bb-801c-12c104bfb3bf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:25.652752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cddfce9d-4651-47bb-801c-12c104bfb3bf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:25.653523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cddfce9d-4651-47bb-801c-12c104bfb3bf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:25.654199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cddfce9d-4651-47bb-801c-12c104bfb3bf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:25.883520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8358aa02-2b73-4494-b7e7-fd83020a7e92 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:25.909897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8358aa02-2b73-4494-b7e7-fd83020a7e92 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:25.911931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8358aa02-2b73-4494-b7e7-fd83020a7e92 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:25.913277 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8358aa02-2b73-4494-b7e7-fd83020a7e92 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 2955 microversion: 2.32 time: 1.129599 Aug 27 04:56:25.913857 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2285/4619] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:24 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 2955 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:26.225311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cddfce9d-4651-47bb-801c-12c104bfb3bf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:26.234558 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cddfce9d-4651-47bb-801c-12c104bfb3bf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.605777 Aug 27 04:56:26.237858 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2335/4620] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:25 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:26.268402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae529667-5eb6-4d07-ae90-919827cd659e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:26.270780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ae529667-5eb6-4d07-ae90-919827cd659e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:26.292846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae529667-5eb6-4d07-ae90-919827cd659e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:26.301892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae529667-5eb6-4d07-ae90-919827cd659e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:26.303726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae529667-5eb6-4d07-ae90-919827cd659e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:26.306062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae529667-5eb6-4d07-ae90-919827cd659e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:26.311786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae529667-5eb6-4d07-ae90-919827cd659e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:26.312922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae529667-5eb6-4d07-ae90-919827cd659e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:26.347786 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-ae529667-5eb6-4d07-ae90-919827cd659e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Cannot 'restore' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae529667-5eb6-4d07-ae90-919827cd659e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action HTTP/1.1 Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 15 Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: {"restore": {}} Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: exception: Cannot 'restore' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '228b4767-bbe2-41d0-a7d4-a6670e79043f', 'body': {'restore': {}}} Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 228b4767-bbe2-41d0-a7d4-a6670e79043f in vm_state active. Cannot restore while the instance is in this state. Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:26.350480 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:26.355965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:26.355965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:26.355965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:26.355965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:56:26.355965 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:26.357287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae529667-5eb6-4d07-ae90-919827cd659e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 409 to user: Cannot 'restore' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:26.358176 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ae529667-5eb6-4d07-ae90-919827cd659e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action" status: 409 len: 145 microversion: 2.1 time: 0.098820 Aug 27 04:56:26.360239 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2286/4621] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:26 2022] POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action => generated 145 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:56:26.372924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09ca9189-f047-44a0-8114-3a84d255b7ff tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:26.373668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-09ca9189-f047-44a0-8114-3a84d255b7ff tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:26.384472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09ca9189-f047-44a0-8114-3a84d255b7ff tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:26.384987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09ca9189-f047-44a0-8114-3a84d255b7ff tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:26.386136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09ca9189-f047-44a0-8114-3a84d255b7ff tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:26.388022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09ca9189-f047-44a0-8114-3a84d255b7ff tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:26.398151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09ca9189-f047-44a0-8114-3a84d255b7ff tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:26.401289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09ca9189-f047-44a0-8114-3a84d255b7ff tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:26.541716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:26.640979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9251e254-02da-4fed-bbda-e51df59e8931 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:26.642140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9251e254-02da-4fed-bbda-e51df59e8931 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:26.664555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09ca9189-f047-44a0-8114-3a84d255b7ff tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:26.676011 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09ca9189-f047-44a0-8114-3a84d255b7ff tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.311965 Aug 27 04:56:26.676943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9251e254-02da-4fed-bbda-e51df59e8931 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:26.677890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9251e254-02da-4fed-bbda-e51df59e8931 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:26.678651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9251e254-02da-4fed-bbda-e51df59e8931 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:26.679931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9251e254-02da-4fed-bbda-e51df59e8931 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:26.680843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9251e254-02da-4fed-bbda-e51df59e8931 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:26.681636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9251e254-02da-4fed-bbda-e51df59e8931 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:26.682938 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2336/4622] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:26 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:26.702842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f5e65c3-d3eb-418b-82b4-f8bc55b784ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:26.703818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f5e65c3-d3eb-418b-82b4-f8bc55b784ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:26.713773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f5e65c3-d3eb-418b-82b4-f8bc55b784ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:26.714858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f5e65c3-d3eb-418b-82b4-f8bc55b784ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:26.720462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f5e65c3-d3eb-418b-82b4-f8bc55b784ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:26.722795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f5e65c3-d3eb-418b-82b4-f8bc55b784ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:26.723990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f5e65c3-d3eb-418b-82b4-f8bc55b784ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:26.725455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f5e65c3-d3eb-418b-82b4-f8bc55b784ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:26.919661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:27.091320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f5e65c3-d3eb-418b-82b4-f8bc55b784ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:27.094757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:27.105633 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f5e65c3-d3eb-418b-82b4-f8bc55b784ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.407635 Aug 27 04:56:27.111413 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2337/4623] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:26 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:27.144709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26af3c26-a558-40bf-88a1-707c3f5975bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:27.149637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26af3c26-a558-40bf-88a1-707c3f5975bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:27.183910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9251e254-02da-4fed-bbda-e51df59e8931 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:27.200137 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9251e254-02da-4fed-bbda-e51df59e8931 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1313 microversion: 2.1 time: 0.568792 Aug 27 04:56:27.202674 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2287/4624] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:26 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1313 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:27.206142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26af3c26-a558-40bf-88a1-707c3f5975bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:27.206881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26af3c26-a558-40bf-88a1-707c3f5975bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:27.207506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26af3c26-a558-40bf-88a1-707c3f5975bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:27.213760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26af3c26-a558-40bf-88a1-707c3f5975bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:27.214497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26af3c26-a558-40bf-88a1-707c3f5975bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:27.215118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26af3c26-a558-40bf-88a1-707c3f5975bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:27.216123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4a27ccc4-9613-4253-bb7a-dbcbddcf8dd3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:27.216970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4a27ccc4-9613-4253-bb7a-dbcbddcf8dd3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 70ddab49-e628-4543-863d-68a41e03b22d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:27.233336 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-4a27ccc4-9613-4253-bb7a-dbcbddcf8dd3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 70ddab49-e628-4543-863d-68a41e03b22d could not be found. Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4a27ccc4-9613-4253-bb7a-dbcbddcf8dd3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/70ddab49-e628-4543-863d-68a41e03b22d/action HTTP/1.1 Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 14 Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: {"resume": {}} Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 70ddab49-e628-4543-863d-68a41e03b22d could not be found. Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '70ddab49-e628-4543-863d-68a41e03b22d', 'body': {'resume': {}}} Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70ddab49-e628-4543-863d-68a41e03b22d could not be found. Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70ddab49-e628-4543-863d-68a41e03b22d could not be found. Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:27.241194 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:27.247427 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:27.247427 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:27.247427 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70ddab49-e628-4543-863d-68a41e03b22d could not be found. Aug 27 04:56:27.247427 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:27.247427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4a27ccc4-9613-4253-bb7a-dbcbddcf8dd3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 70ddab49-e628-4543-863d-68a41e03b22d could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:27.247427 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4a27ccc4-9613-4253-bb7a-dbcbddcf8dd3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/70ddab49-e628-4543-863d-68a41e03b22d/action" status: 404 len: 111 microversion: 2.1 time: 0.038481 Aug 27 04:56:27.256372 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2288/4625] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:27 2022] POST /compute/v2.1/servers/70ddab49-e628-4543-863d-68a41e03b22d/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:27.271704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8daac61a-513c-4c97-b7a5-4b9e621dc2aa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:27.276811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8daac61a-513c-4c97-b7a5-4b9e621dc2aa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:27.317931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8daac61a-513c-4c97-b7a5-4b9e621dc2aa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:27.318511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8daac61a-513c-4c97-b7a5-4b9e621dc2aa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:27.318959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8daac61a-513c-4c97-b7a5-4b9e621dc2aa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:27.322045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8daac61a-513c-4c97-b7a5-4b9e621dc2aa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:27.323245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8daac61a-513c-4c97-b7a5-4b9e621dc2aa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:27.324383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8daac61a-513c-4c97-b7a5-4b9e621dc2aa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:27.948797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8daac61a-513c-4c97-b7a5-4b9e621dc2aa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:27.975916 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8daac61a-513c-4c97-b7a5-4b9e621dc2aa tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.713782 Aug 27 04:56:27.977056 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2289/4626] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:27 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:28.001408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-337c64a3-2daf-4281-a35a-0ae5a664bf19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:28.003059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-337c64a3-2daf-4281-a35a-0ae5a664bf19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:28.010484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-337c64a3-2daf-4281-a35a-0ae5a664bf19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:28.011623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-337c64a3-2daf-4281-a35a-0ae5a664bf19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:28.012336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-337c64a3-2daf-4281-a35a-0ae5a664bf19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:28.013254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-337c64a3-2daf-4281-a35a-0ae5a664bf19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:28.013884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-337c64a3-2daf-4281-a35a-0ae5a664bf19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:28.014642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-337c64a3-2daf-4281-a35a-0ae5a664bf19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:28.324855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-337c64a3-2daf-4281-a35a-0ae5a664bf19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:28.338902 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-337c64a3-2daf-4281-a35a-0ae5a664bf19 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.342173 Aug 27 04:56:28.355659 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2290/4627] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:27 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:28.361861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0398a93c-b318-4317-b7a4-fbb36d7b113f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:28.362840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0398a93c-b318-4317-b7a4-fbb36d7b113f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:28.390807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0398a93c-b318-4317-b7a4-fbb36d7b113f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:28.397150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0398a93c-b318-4317-b7a4-fbb36d7b113f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:28.398054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0398a93c-b318-4317-b7a4-fbb36d7b113f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:28.400155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0398a93c-b318-4317-b7a4-fbb36d7b113f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:28.400898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0398a93c-b318-4317-b7a4-fbb36d7b113f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:28.405196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0398a93c-b318-4317-b7a4-fbb36d7b113f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:28.640046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26af3c26-a558-40bf-88a1-707c3f5975bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:28.660701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26af3c26-a558-40bf-88a1-707c3f5975bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:28.662231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26af3c26-a558-40bf-88a1-707c3f5975bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:28.663516 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26af3c26-a558-40bf-88a1-707c3f5975bf tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 2955 microversion: 2.32 time: 1.550883 Aug 27 04:56:28.670753 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2338/4628] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:27 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 2955 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:28.676369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d6f6dcb-63fc-4bf4-af7a-48225552a735 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:28.676939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8d6f6dcb-63fc-4bf4-af7a-48225552a735 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:28.707860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d6f6dcb-63fc-4bf4-af7a-48225552a735 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:28.708379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d6f6dcb-63fc-4bf4-af7a-48225552a735 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:28.708866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d6f6dcb-63fc-4bf4-af7a-48225552a735 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:28.709598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d6f6dcb-63fc-4bf4-af7a-48225552a735 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:28.710072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d6f6dcb-63fc-4bf4-af7a-48225552a735 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:28.710506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d6f6dcb-63fc-4bf4-af7a-48225552a735 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:28.746736 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8d6f6dcb-63fc-4bf4-af7a-48225552a735 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Cannot 'resume' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d6f6dcb-63fc-4bf4-af7a-48225552a735 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action HTTP/1.1 Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 14 Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: {"resume": {}} Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: exception: Cannot 'resume' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '228b4767-bbe2-41d0-a7d4-a6670e79043f', 'body': {'resume': {}}} Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 228b4767-bbe2-41d0-a7d4-a6670e79043f in vm_state active. Cannot resume while the instance is in this state. Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:28.749952 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:28.755477 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:28.755477 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:28.755477 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:28.755477 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:28.755477 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:28.755477 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:56:28.755477 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:28.761135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d6f6dcb-63fc-4bf4-af7a-48225552a735 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 409 to user: Cannot 'resume' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:28.762843 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8d6f6dcb-63fc-4bf4-af7a-48225552a735 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action" status: 409 len: 144 microversion: 2.1 time: 0.090235 Aug 27 04:56:28.763995 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2339/4629] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:28 2022] POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action => generated 144 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:56:28.776004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bab978ae-f104-4e68-904f-b9a57837990b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:28.776766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bab978ae-f104-4e68-904f-b9a57837990b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:28.795449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab978ae-f104-4e68-904f-b9a57837990b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:28.795996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab978ae-f104-4e68-904f-b9a57837990b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:28.799364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab978ae-f104-4e68-904f-b9a57837990b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:28.800610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab978ae-f104-4e68-904f-b9a57837990b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:28.801040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab978ae-f104-4e68-904f-b9a57837990b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:28.801485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab978ae-f104-4e68-904f-b9a57837990b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:29.095035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0398a93c-b318-4317-b7a4-fbb36d7b113f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:29.119865 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0398a93c-b318-4317-b7a4-fbb36d7b113f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1313 microversion: 2.1 time: 0.759773 Aug 27 04:56:29.134611 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2291/4630] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:28 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1313 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:29.400775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bab978ae-f104-4e68-904f-b9a57837990b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:29.417831 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bab978ae-f104-4e68-904f-b9a57837990b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.646415 Aug 27 04:56:29.418942 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2340/4631] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:28 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:29.446904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2db66ee3-79d9-44d4-8193-c7f97510d41e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:29.447522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2db66ee3-79d9-44d4-8193-c7f97510d41e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:29.457684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2db66ee3-79d9-44d4-8193-c7f97510d41e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:29.460848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2db66ee3-79d9-44d4-8193-c7f97510d41e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:29.462831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2db66ee3-79d9-44d4-8193-c7f97510d41e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:29.464944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2db66ee3-79d9-44d4-8193-c7f97510d41e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:29.467643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2db66ee3-79d9-44d4-8193-c7f97510d41e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:29.469057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2db66ee3-79d9-44d4-8193-c7f97510d41e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:29.691564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4df45f75-7912-4d42-9eb0-ccfc0e15cd70 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:29.692327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4df45f75-7912-4d42-9eb0-ccfc0e15cd70 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:29.708670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df45f75-7912-4d42-9eb0-ccfc0e15cd70 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:29.709493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df45f75-7912-4d42-9eb0-ccfc0e15cd70 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:29.711678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df45f75-7912-4d42-9eb0-ccfc0e15cd70 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:29.712696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df45f75-7912-4d42-9eb0-ccfc0e15cd70 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:29.715747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df45f75-7912-4d42-9eb0-ccfc0e15cd70 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:29.716415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df45f75-7912-4d42-9eb0-ccfc0e15cd70 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:30.579676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2db66ee3-79d9-44d4-8193-c7f97510d41e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:30.590772 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2db66ee3-79d9-44d4-8193-c7f97510d41e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 1.146038 Aug 27 04:56:30.594694 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2292/4632] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:29 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:30.599517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fed17437-4b76-47a5-bc5b-0023847ef1f3 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:30.600120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fed17437-4b76-47a5-bc5b-0023847ef1f3 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:30.630509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fed17437-4b76-47a5-bc5b-0023847ef1f3 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:30.631008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fed17437-4b76-47a5-bc5b-0023847ef1f3 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:30.631446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fed17437-4b76-47a5-bc5b-0023847ef1f3 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:30.632165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fed17437-4b76-47a5-bc5b-0023847ef1f3 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:30.632649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fed17437-4b76-47a5-bc5b-0023847ef1f3 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:30.633263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fed17437-4b76-47a5-bc5b-0023847ef1f3 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:30.675031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4df45f75-7912-4d42-9eb0-ccfc0e15cd70 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:30.684578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4df45f75-7912-4d42-9eb0-ccfc0e15cd70 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:30.686037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4df45f75-7912-4d42-9eb0-ccfc0e15cd70 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:30.687347 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4df45f75-7912-4d42-9eb0-ccfc0e15cd70 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 2955 microversion: 2.32 time: 1.001147 Aug 27 04:56:30.708207 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2341/4633] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:29 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 2955 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:56:30.813807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a30427db-afe1-4065-bd11-5540a20fd313 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a30427db-afe1-4065-bd11-5540a20fd313 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 160 Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: {"server": {"name": "", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1a15eb61-6c3a-49c3-9906-c4c8e2c9b393"}]}} Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': '', 'imageRef': '71228424-9f42-4121-865e-14501cc9b5c0', 'flavorRef': '452', 'networks': [{'uuid': '1a15eb61-6c3a-49c3-9906-c4c8e2c9b393'}]}}} Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi '' Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:56:30.818726 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:56:30.825235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:56:30.825235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:56:30.825235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:30.825235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:30.825235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:30.825235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:30.825235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:30.825235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:30.825235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:56:30.825235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:56:30.825235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:56:30.825235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:30.829855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a30427db-afe1-4065-bd11-5540a20fd313 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:30.832793 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a30427db-afe1-4065-bd11-5540a20fd313 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.023288 Aug 27 04:56:30.836338 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2342/4634] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:56:30 2022] POST /compute/v2.1/servers => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:56:30.863087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55c7b2b2-d5bc-49e3-8475-fc8f5096e4b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:30.864217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55c7b2b2-d5bc-49e3-8475-fc8f5096e4b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:30.882650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c7b2b2-d5bc-49e3-8475-fc8f5096e4b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:30.883387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c7b2b2-d5bc-49e3-8475-fc8f5096e4b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:30.884036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c7b2b2-d5bc-49e3-8475-fc8f5096e4b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:30.885009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c7b2b2-d5bc-49e3-8475-fc8f5096e4b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:30.885680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c7b2b2-d5bc-49e3-8475-fc8f5096e4b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:30.886314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c7b2b2-d5bc-49e3-8475-fc8f5096e4b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:31.366010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-55c7b2b2-d5bc-49e3-8475-fc8f5096e4b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:31.377988 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55c7b2b2-d5bc-49e3-8475-fc8f5096e4b1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.531260 Aug 27 04:56:31.392396 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2343/4635] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:30 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:31.411099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1065ac49-b731-43bc-9754-55c28cf09a8a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:31.411895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1065ac49-b731-43bc-9754-55c28cf09a8a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:31.432590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1065ac49-b731-43bc-9754-55c28cf09a8a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:31.433100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1065ac49-b731-43bc-9754-55c28cf09a8a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:31.435728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1065ac49-b731-43bc-9754-55c28cf09a8a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:31.436632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1065ac49-b731-43bc-9754-55c28cf09a8a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:31.438041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1065ac49-b731-43bc-9754-55c28cf09a8a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:31.438488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1065ac49-b731-43bc-9754-55c28cf09a8a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:31.750187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1065ac49-b731-43bc-9754-55c28cf09a8a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:31.760983 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1065ac49-b731-43bc-9754-55c28cf09a8a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.354075 Aug 27 04:56:31.773778 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2344/4636] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:31 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:31.790916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f487f34e-896c-4cf6-b590-0208dc8e1227 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:31.794654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f487f34e-896c-4cf6-b590-0208dc8e1227 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:31.813642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f487f34e-896c-4cf6-b590-0208dc8e1227 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:31.816512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f487f34e-896c-4cf6-b590-0208dc8e1227 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:31.818723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f487f34e-896c-4cf6-b590-0208dc8e1227 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:31.819715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f487f34e-896c-4cf6-b590-0208dc8e1227 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:31.821750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f487f34e-896c-4cf6-b590-0208dc8e1227 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:31.823131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f487f34e-896c-4cf6-b590-0208dc8e1227 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:31.910394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fed17437-4b76-47a5-bc5b-0023847ef1f3 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:31.923074 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fed17437-4b76-47a5-bc5b-0023847ef1f3 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1313 microversion: 2.1 time: 1.324930 Aug 27 04:56:31.923933 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2293/4637] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:30 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1313 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:31.937298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68b39a70-9146-433a-8d02-430a1d66a76c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:31.941485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-68b39a70-9146-433a-8d02-430a1d66a76c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 93690565-0478-449f-8a84-fa35d0c86cb9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:31.954739 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-68b39a70-9146-433a-8d02-430a1d66a76c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 93690565-0478-449f-8a84-fa35d0c86cb9 could not be found. Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68b39a70-9146-433a-8d02-430a1d66a76c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/93690565-0478-449f-8a84-fa35d0c86cb9/action HTTP/1.1 Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 14 Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: {"shelve": {}} Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 93690565-0478-449f-8a84-fa35d0c86cb9 could not be found. Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '93690565-0478-449f-8a84-fa35d0c86cb9', 'body': {'shelve': {}}} Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93690565-0478-449f-8a84-fa35d0c86cb9 could not be found. Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93690565-0478-449f-8a84-fa35d0c86cb9 could not be found. Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:31.965428 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:31.970649 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:31.970649 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:31.970649 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93690565-0478-449f-8a84-fa35d0c86cb9 could not be found. Aug 27 04:56:31.970649 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:56:31.970649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68b39a70-9146-433a-8d02-430a1d66a76c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 93690565-0478-449f-8a84-fa35d0c86cb9 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:31.970649 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-68b39a70-9146-433a-8d02-430a1d66a76c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/93690565-0478-449f-8a84-fa35d0c86cb9/action" status: 404 len: 111 microversion: 2.1 time: 0.041321 Aug 27 04:56:31.971808 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2294/4638] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:31 2022] POST /compute/v2.1/servers/93690565-0478-449f-8a84-fa35d0c86cb9/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:31.981044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c719a8c3-f66a-42fb-bd79-2ac176c3a67a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:31.981845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c719a8c3-f66a-42fb-bd79-2ac176c3a67a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:31.989559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c719a8c3-f66a-42fb-bd79-2ac176c3a67a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:31.990310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c719a8c3-f66a-42fb-bd79-2ac176c3a67a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:31.990952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c719a8c3-f66a-42fb-bd79-2ac176c3a67a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:31.991837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c719a8c3-f66a-42fb-bd79-2ac176c3a67a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:31.992501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c719a8c3-f66a-42fb-bd79-2ac176c3a67a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:31.993219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c719a8c3-f66a-42fb-bd79-2ac176c3a67a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:32.455284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c719a8c3-f66a-42fb-bd79-2ac176c3a67a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:32.468253 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c719a8c3-f66a-42fb-bd79-2ac176c3a67a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.491876 Aug 27 04:56:32.470830 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2295/4639] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:31 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:32.489421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f487f34e-896c-4cf6-b590-0208dc8e1227 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:32.499959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-85d120fd-1b56-4a5f-a151-ab8d6ac069f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:32.501399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-85d120fd-1b56-4a5f-a151-ab8d6ac069f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:32.502986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f487f34e-896c-4cf6-b590-0208dc8e1227 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:32.518041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f487f34e-896c-4cf6-b590-0208dc8e1227 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:32.519384 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f487f34e-896c-4cf6-b590-0208dc8e1227 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 2934 microversion: 2.32 time: 0.743838 Aug 27 04:56:32.524212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85d120fd-1b56-4a5f-a151-ab8d6ac069f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:32.527131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85d120fd-1b56-4a5f-a151-ab8d6ac069f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:32.527459 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2345/4640] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:31 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 2934 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:32.529463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85d120fd-1b56-4a5f-a151-ab8d6ac069f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:32.546930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85d120fd-1b56-4a5f-a151-ab8d6ac069f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:32.550379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85d120fd-1b56-4a5f-a151-ab8d6ac069f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:32.551140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85d120fd-1b56-4a5f-a151-ab8d6ac069f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:32.949261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-009e9717-cdde-4e87-a9b7-45e9a0d92f8a tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:32.950564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-009e9717-cdde-4e87-a9b7-45e9a0d92f8a tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:32.961723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-009e9717-cdde-4e87-a9b7-45e9a0d92f8a tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:32.962435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-009e9717-cdde-4e87-a9b7-45e9a0d92f8a tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:32.965099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-009e9717-cdde-4e87-a9b7-45e9a0d92f8a tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:32.969543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-009e9717-cdde-4e87-a9b7-45e9a0d92f8a tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:32.971305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-009e9717-cdde-4e87-a9b7-45e9a0d92f8a tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:32.974126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-009e9717-cdde-4e87-a9b7-45e9a0d92f8a tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:33.256276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-85d120fd-1b56-4a5f-a151-ab8d6ac069f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:33.274619 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-85d120fd-1b56-4a5f-a151-ab8d6ac069f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.779877 Aug 27 04:56:33.277978 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2296/4641] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:32 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:33.312282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9ce1a456-c500-46da-87cf-3ccea4bff7ac tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:33.324255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9ce1a456-c500-46da-87cf-3ccea4bff7ac tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:33.342537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ce1a456-c500-46da-87cf-3ccea4bff7ac tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:33.345685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ce1a456-c500-46da-87cf-3ccea4bff7ac tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:33.346446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ce1a456-c500-46da-87cf-3ccea4bff7ac tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:33.348767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ce1a456-c500-46da-87cf-3ccea4bff7ac tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:33.350835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ce1a456-c500-46da-87cf-3ccea4bff7ac tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:33.357883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ce1a456-c500-46da-87cf-3ccea4bff7ac tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:33.403896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-9ce1a456-c500-46da-87cf-3ccea4bff7ac tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lazy-loading 'flavor' on Instance uuid 228b4767-bbe2-41d0-a7d4-a6670e79043f {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:56:33.464362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-009e9717-cdde-4e87-a9b7-45e9a0d92f8a tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:33.475588 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-009e9717-cdde-4e87-a9b7-45e9a0d92f8a tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1313 microversion: 2.1 time: 0.528267 Aug 27 04:56:33.478512 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2346/4642] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:32 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:33.571908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef535589-4784-4085-baf8-615a00e3d2e0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:33.576314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef535589-4784-4085-baf8-615a00e3d2e0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:33.606242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef535589-4784-4085-baf8-615a00e3d2e0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:33.616975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef535589-4784-4085-baf8-615a00e3d2e0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:33.619201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef535589-4784-4085-baf8-615a00e3d2e0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:33.620623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef535589-4784-4085-baf8-615a00e3d2e0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:33.624784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef535589-4784-4085-baf8-615a00e3d2e0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:33.625497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef535589-4784-4085-baf8-615a00e3d2e0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:34.008150 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9ce1a456-c500-46da-87cf-3ccea4bff7ac tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action" status: 202 len: 0 microversion: 2.1 time: 0.709173 Aug 27 04:56:34.008913 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2297/4643] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:56:33 2022] POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:56:34.036954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9dee95b0-e2c1-4de1-a150-3740f3c4ba06 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:34.040255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9dee95b0-e2c1-4de1-a150-3740f3c4ba06 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:34.091014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dee95b0-e2c1-4de1-a150-3740f3c4ba06 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:34.101073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dee95b0-e2c1-4de1-a150-3740f3c4ba06 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:34.101927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dee95b0-e2c1-4de1-a150-3740f3c4ba06 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:34.109385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dee95b0-e2c1-4de1-a150-3740f3c4ba06 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:34.110267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dee95b0-e2c1-4de1-a150-3740f3c4ba06 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:34.111052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dee95b0-e2c1-4de1-a150-3740f3c4ba06 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:34.328927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef535589-4784-4085-baf8-615a00e3d2e0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:34.349053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef535589-4784-4085-baf8-615a00e3d2e0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:34.352297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef535589-4784-4085-baf8-615a00e3d2e0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:34.361180 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef535589-4784-4085-baf8-615a00e3d2e0 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 2913 microversion: 2.32 time: 0.803563 Aug 27 04:56:34.363506 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2347/4644] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:33 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 2913 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:34.425500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-066d636e-c580-4f9d-8916-ddd30cdc519f req-61d77ae6-fa1c-487b-b10a-62aa526b1757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "name": "network-vif-deleted", "tag": "08ec2a03-4224-4482-9e2b-0c33bc4adbca"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:34.473245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-066d636e-c580-4f9d-8916-ddd30cdc519f req-61d77ae6-fa1c-487b-b10a-62aa526b1757 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:34.473727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-066d636e-c580-4f9d-8916-ddd30cdc519f req-61d77ae6-fa1c-487b-b10a-62aa526b1757 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:34.474158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-066d636e-c580-4f9d-8916-ddd30cdc519f req-61d77ae6-fa1c-487b-b10a-62aa526b1757 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:34.519007 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-066d636e-c580-4f9d-8916-ddd30cdc519f req-61d77ae6-fa1c-487b-b10a-62aa526b1757 service nova] Creating event network-vif-deleted:08ec2a03-4224-4482-9e2b-0c33bc4adbca for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:56:34.543508 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-066d636e-c580-4f9d-8916-ddd30cdc519f req-61d77ae6-fa1c-487b-b10a-62aa526b1757 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124661 Aug 27 04:56:34.546357 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2348/4645] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:34.579378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe7c47ff-44df-4c19-b5db-52e7254e2d3f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:34.587849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe7c47ff-44df-4c19-b5db-52e7254e2d3f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:34.622180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe7c47ff-44df-4c19-b5db-52e7254e2d3f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:34.629225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe7c47ff-44df-4c19-b5db-52e7254e2d3f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:34.630309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe7c47ff-44df-4c19-b5db-52e7254e2d3f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:34.631945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe7c47ff-44df-4c19-b5db-52e7254e2d3f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:34.633605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe7c47ff-44df-4c19-b5db-52e7254e2d3f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:34.636974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe7c47ff-44df-4c19-b5db-52e7254e2d3f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:34.829666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9dee95b0-e2c1-4de1-a150-3740f3c4ba06 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:34.839159 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9dee95b0-e2c1-4de1-a150-3740f3c4ba06 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 0.823478 Aug 27 04:56:34.839757 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2298/4646] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:34 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:34.855204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-31863bb1-fd1d-4445-b2f1-fd4903d72187 req-da90370a-2eae-4b03-87a7-9c5265e60806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "name": "network-vif-unplugged", "status": "completed", "tag": "be33a009-98cd-48e8-9d40-6cb18faec1d1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:34.879321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-31863bb1-fd1d-4445-b2f1-fd4903d72187 req-da90370a-2eae-4b03-87a7-9c5265e60806 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:34.883211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-31863bb1-fd1d-4445-b2f1-fd4903d72187 req-da90370a-2eae-4b03-87a7-9c5265e60806 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:34.884021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-31863bb1-fd1d-4445-b2f1-fd4903d72187 req-da90370a-2eae-4b03-87a7-9c5265e60806 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:34.913656 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-31863bb1-fd1d-4445-b2f1-fd4903d72187 req-da90370a-2eae-4b03-87a7-9c5265e60806 service nova] Creating event network-vif-unplugged:be33a009-98cd-48e8-9d40-6cb18faec1d1 for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:56:34.926149 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-31863bb1-fd1d-4445-b2f1-fd4903d72187 req-da90370a-2eae-4b03-87a7-9c5265e60806 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081933 Aug 27 04:56:34.926808 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2299/4647] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:35.146786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe7c47ff-44df-4c19-b5db-52e7254e2d3f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:35.156887 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe7c47ff-44df-4c19-b5db-52e7254e2d3f tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1313 microversion: 2.1 time: 0.609152 Aug 27 04:56:35.161160 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2349/4648] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:34 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:35.392497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-825bcd7d-c019-4bf5-aa30-f218860d5a3f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:35.393245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-825bcd7d-c019-4bf5-aa30-f218860d5a3f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:35.403297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-825bcd7d-c019-4bf5-aa30-f218860d5a3f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:35.418211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-825bcd7d-c019-4bf5-aa30-f218860d5a3f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:35.421815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-825bcd7d-c019-4bf5-aa30-f218860d5a3f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:35.422603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-825bcd7d-c019-4bf5-aa30-f218860d5a3f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:35.423091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-825bcd7d-c019-4bf5-aa30-f218860d5a3f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:35.423532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-825bcd7d-c019-4bf5-aa30-f218860d5a3f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:35.864186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-798bbd25-920e-42be-8789-6e0d3dc30e58 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:35.865479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-798bbd25-920e-42be-8789-6e0d3dc30e58 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:35.878785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-798bbd25-920e-42be-8789-6e0d3dc30e58 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:35.881578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-798bbd25-920e-42be-8789-6e0d3dc30e58 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:35.884568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-798bbd25-920e-42be-8789-6e0d3dc30e58 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:35.885619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-798bbd25-920e-42be-8789-6e0d3dc30e58 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:35.886405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-798bbd25-920e-42be-8789-6e0d3dc30e58 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:35.890990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-798bbd25-920e-42be-8789-6e0d3dc30e58 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.513171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-825bcd7d-c019-4bf5-aa30-f218860d5a3f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:36.559720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-825bcd7d-c019-4bf5-aa30-f218860d5a3f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:36.563218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-825bcd7d-c019-4bf5-aa30-f218860d5a3f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:36.565485 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-825bcd7d-c019-4bf5-aa30-f218860d5a3f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 2706 microversion: 2.32 time: 1.177608 Aug 27 04:56:36.566728 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2300/4649] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:35 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 2706 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:36.571948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-50ffd19d-6cf2-495c-9292-2a71489bb9cd tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:36.573448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-50ffd19d-6cf2-495c-9292-2a71489bb9cd tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:36.580901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50ffd19d-6cf2-495c-9292-2a71489bb9cd tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.581728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50ffd19d-6cf2-495c-9292-2a71489bb9cd tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.582347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50ffd19d-6cf2-495c-9292-2a71489bb9cd tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.583742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50ffd19d-6cf2-495c-9292-2a71489bb9cd tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.622271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50ffd19d-6cf2-495c-9292-2a71489bb9cd tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.625170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50ffd19d-6cf2-495c-9292-2a71489bb9cd tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.653424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-798bbd25-920e-42be-8789-6e0d3dc30e58 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:36.672971 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-798bbd25-920e-42be-8789-6e0d3dc30e58 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 0.809866 Aug 27 04:56:36.677042 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2350/4650] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:35 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:36.693642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-29f4663b-4f07-447d-afc0-b1f49b3b6a64 req-a83a3e4d-f2ed-4cf8-a85b-217139562839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "name": "network-vif-deleted", "tag": "17bdccd1-ac80-487e-affd-5d9c98c1239a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:36.738942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-29f4663b-4f07-447d-afc0-b1f49b3b6a64 req-a83a3e4d-f2ed-4cf8-a85b-217139562839 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:36.739530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-29f4663b-4f07-447d-afc0-b1f49b3b6a64 req-a83a3e4d-f2ed-4cf8-a85b-217139562839 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:36.739984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-29f4663b-4f07-447d-afc0-b1f49b3b6a64 req-a83a3e4d-f2ed-4cf8-a85b-217139562839 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:36.797280 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-29f4663b-4f07-447d-afc0-b1f49b3b6a64 req-a83a3e4d-f2ed-4cf8-a85b-217139562839 service nova] Creating event network-vif-deleted:17bdccd1-ac80-487e-affd-5d9c98c1239a for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:56:36.821211 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-29f4663b-4f07-447d-afc0-b1f49b3b6a64 req-a83a3e4d-f2ed-4cf8-a85b-217139562839 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141172 Aug 27 04:56:36.821912 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2351/4651] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:37.190518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-10f3c0f6-2e73-4c68-9aca-0d7acc43e674 req-5710b1dd-2ba6-4978-bc32-14d01b835db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "name": "network-vif-unplugged", "status": "completed", "tag": "a874eeb0-33af-4e93-929c-569c031939d0"}, {"server_uuid": "c952536b-2682-46ff-9623-9ca8e992eb96", "name": "network-vif-plugged", "status": "completed", "tag": "cbc6a9b5-d543-4b1d-a522-41fc6d42bc9d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:37.220049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10f3c0f6-2e73-4c68-9aca-0d7acc43e674 req-5710b1dd-2ba6-4978-bc32-14d01b835db9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:37.220576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10f3c0f6-2e73-4c68-9aca-0d7acc43e674 req-5710b1dd-2ba6-4978-bc32-14d01b835db9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:37.221007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10f3c0f6-2e73-4c68-9aca-0d7acc43e674 req-5710b1dd-2ba6-4978-bc32-14d01b835db9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:37.274835 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-10f3c0f6-2e73-4c68-9aca-0d7acc43e674 req-5710b1dd-2ba6-4978-bc32-14d01b835db9 service nova] Creating event network-vif-unplugged:a874eeb0-33af-4e93-929c-569c031939d0 for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:56:37.279733 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-10f3c0f6-2e73-4c68-9aca-0d7acc43e674 req-5710b1dd-2ba6-4978-bc32-14d01b835db9 service nova] Creating event network-vif-plugged:cbc6a9b5-d543-4b1d-a522-41fc6d42bc9d for instance c952536b-2682-46ff-9623-9ca8e992eb96 on n-h1-854823-1 Aug 27 04:56:37.303361 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-10f3c0f6-2e73-4c68-9aca-0d7acc43e674 req-5710b1dd-2ba6-4978-bc32-14d01b835db9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.118413 Aug 27 04:56:37.311881 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2352/4652] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:37.596287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-086c9f71-0eb9-4a8b-821b-d06cbe8fea51 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:37.597955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-086c9f71-0eb9-4a8b-821b-d06cbe8fea51 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:37.610736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086c9f71-0eb9-4a8b-821b-d06cbe8fea51 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:37.613385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086c9f71-0eb9-4a8b-821b-d06cbe8fea51 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:37.614033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086c9f71-0eb9-4a8b-821b-d06cbe8fea51 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:37.617295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086c9f71-0eb9-4a8b-821b-d06cbe8fea51 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:37.620726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086c9f71-0eb9-4a8b-821b-d06cbe8fea51 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:37.621373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086c9f71-0eb9-4a8b-821b-d06cbe8fea51 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:37.668661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-50ffd19d-6cf2-495c-9292-2a71489bb9cd tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:37.700515 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-50ffd19d-6cf2-495c-9292-2a71489bb9cd tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1313 microversion: 2.1 time: 1.132310 Aug 27 04:56:37.702978 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2301/4653] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:36 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1313 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:37.716155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1d8e3113-f035-4c43-91ea-f1b2abc2f0f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:37.719109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1d8e3113-f035-4c43-91ea-f1b2abc2f0f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:37.747330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:37.754481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d8e3113-f035-4c43-91ea-f1b2abc2f0f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:37.762173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d8e3113-f035-4c43-91ea-f1b2abc2f0f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:37.762945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d8e3113-f035-4c43-91ea-f1b2abc2f0f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:37.768984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d8e3113-f035-4c43-91ea-f1b2abc2f0f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:37.769803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d8e3113-f035-4c43-91ea-f1b2abc2f0f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:37.772246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d8e3113-f035-4c43-91ea-f1b2abc2f0f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:38.381602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1d8e3113-f035-4c43-91ea-f1b2abc2f0f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:38.384088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:38.417034 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1d8e3113-f035-4c43-91ea-f1b2abc2f0f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 0.710721 Aug 27 04:56:38.418669 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2302/4654] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:37 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:38.501579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-086c9f71-0eb9-4a8b-821b-d06cbe8fea51 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:38.515790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-086c9f71-0eb9-4a8b-821b-d06cbe8fea51 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:38.526257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-086c9f71-0eb9-4a8b-821b-d06cbe8fea51 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:38.532985 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-086c9f71-0eb9-4a8b-821b-d06cbe8fea51 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 2592 microversion: 2.32 time: 0.939039 Aug 27 04:56:38.534077 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2353/4655] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:37 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 2592 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:56:38.723496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f46fd373-e9c5-42ad-b993-fbd816e06024 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:38.725099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f46fd373-e9c5-42ad-b993-fbd816e06024 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:38.740748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f46fd373-e9c5-42ad-b993-fbd816e06024 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:38.741610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f46fd373-e9c5-42ad-b993-fbd816e06024 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:38.744383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f46fd373-e9c5-42ad-b993-fbd816e06024 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:38.746023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f46fd373-e9c5-42ad-b993-fbd816e06024 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:38.746656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f46fd373-e9c5-42ad-b993-fbd816e06024 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:38.747921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f46fd373-e9c5-42ad-b993-fbd816e06024 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:39.444376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6882393f-aef4-46af-a0be-5a40fec54f95 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:39.445235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6882393f-aef4-46af-a0be-5a40fec54f95 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:39.460511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6882393f-aef4-46af-a0be-5a40fec54f95 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:39.463591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6882393f-aef4-46af-a0be-5a40fec54f95 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:39.467670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6882393f-aef4-46af-a0be-5a40fec54f95 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:39.469002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6882393f-aef4-46af-a0be-5a40fec54f95 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:39.471215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6882393f-aef4-46af-a0be-5a40fec54f95 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:39.472744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6882393f-aef4-46af-a0be-5a40fec54f95 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:39.502364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f46fd373-e9c5-42ad-b993-fbd816e06024 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:39.561209 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f46fd373-e9c5-42ad-b993-fbd816e06024 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1313 microversion: 2.1 time: 0.838691 Aug 27 04:56:39.567096 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2303/4656] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:38 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1313 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:39.609648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0b53a3e5-2fa2-4d58-8099-8cd3eb8c6839 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:39.617077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0b53a3e5-2fa2-4d58-8099-8cd3eb8c6839 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:39.658890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b53a3e5-2fa2-4d58-8099-8cd3eb8c6839 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:39.665874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b53a3e5-2fa2-4d58-8099-8cd3eb8c6839 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:39.670662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b53a3e5-2fa2-4d58-8099-8cd3eb8c6839 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:39.679105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b53a3e5-2fa2-4d58-8099-8cd3eb8c6839 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:39.684942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b53a3e5-2fa2-4d58-8099-8cd3eb8c6839 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:39.694736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b53a3e5-2fa2-4d58-8099-8cd3eb8c6839 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:40.059334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6882393f-aef4-46af-a0be-5a40fec54f95 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:40.073643 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6882393f-aef4-46af-a0be-5a40fec54f95 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 0.633197 Aug 27 04:56:40.075880 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2354/4657] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:39 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:40.085264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1073edf1-d1c7-4a66-894b-6d587e6a350f req-4064f20c-ffc5-4a12-b96d-68c5b3f65703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "name": "network-vif-deleted", "tag": "0da450d6-15cd-4605-89dd-19e1ab8d2cf8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:40.112678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1073edf1-d1c7-4a66-894b-6d587e6a350f req-4064f20c-ffc5-4a12-b96d-68c5b3f65703 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:40.120346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1073edf1-d1c7-4a66-894b-6d587e6a350f req-4064f20c-ffc5-4a12-b96d-68c5b3f65703 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:40.121308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1073edf1-d1c7-4a66-894b-6d587e6a350f req-4064f20c-ffc5-4a12-b96d-68c5b3f65703 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:40.162792 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1073edf1-d1c7-4a66-894b-6d587e6a350f req-4064f20c-ffc5-4a12-b96d-68c5b3f65703 service nova] Creating event network-vif-deleted:0da450d6-15cd-4605-89dd-19e1ab8d2cf8 for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:56:40.208648 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1073edf1-d1c7-4a66-894b-6d587e6a350f req-4064f20c-ffc5-4a12-b96d-68c5b3f65703 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128957 Aug 27 04:56:40.216335 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2355/4658] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:40.714424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a99ffe30-a5c0-4e09-a3ed-366f05cf4960 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-952157059", "availability_zone": "foo_zone"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:40.739379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-a99ffe30-a5c0-4e09-a3ed-366f05cf4960 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Generated uuid adeb2e29-b1c3-4010-b48b-3b258f8fe135 for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 04:56:40.852754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:40.894633 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a99ffe30-a5c0-4e09-a3ed-366f05cf4960 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.676635 Aug 27 04:56:40.901892 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2356/4659] 10.222.0.79 () {60 vars in 1164 bytes} [Sat Aug 27 04:56:40 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:40.903016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d07512b8-7627-4458-8c8f-8aebcc6306da tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:40.903765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d07512b8-7627-4458-8c8f-8aebcc6306da tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:40.966651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d07512b8-7627-4458-8c8f-8aebcc6306da tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:40.968278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d07512b8-7627-4458-8c8f-8aebcc6306da tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:40.970474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d07512b8-7627-4458-8c8f-8aebcc6306da tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:40.971362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d07512b8-7627-4458-8c8f-8aebcc6306da tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:40.974151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d07512b8-7627-4458-8c8f-8aebcc6306da tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:40.975069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d07512b8-7627-4458-8c8f-8aebcc6306da tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:41.091543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0b53a3e5-2fa2-4d58-8099-8cd3eb8c6839 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:41.125084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0b53a3e5-2fa2-4d58-8099-8cd3eb8c6839 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:41.138592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0b53a3e5-2fa2-4d58-8099-8cd3eb8c6839 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:41.142818 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0b53a3e5-2fa2-4d58-8099-8cd3eb8c6839 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 2545 microversion: 2.32 time: 1.571169 Aug 27 04:56:41.149477 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2304/4660] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:39 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 2545 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:41.171847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6eabe488-2161-4dea-b1b6-9d20396dedb4 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:41.339093 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6eabe488-2161-4dea-b1b6-9d20396dedb4 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.188038 Aug 27 04:56:41.341161 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2305/4661] 10.222.0.79 () {60 vars in 1194 bytes} [Sat Aug 27 04:56:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:41.376275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-51ad2e54-d1e9-45e5-b8a8-f9d9c7d13e20 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:41.378036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-51ad2e54-d1e9-45e5-b8a8-f9d9c7d13e20 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:41.477596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51ad2e54-d1e9-45e5-b8a8-f9d9c7d13e20 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:41.482810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51ad2e54-d1e9-45e5-b8a8-f9d9c7d13e20 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:41.496628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51ad2e54-d1e9-45e5-b8a8-f9d9c7d13e20 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:41.510667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51ad2e54-d1e9-45e5-b8a8-f9d9c7d13e20 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:41.511738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51ad2e54-d1e9-45e5-b8a8-f9d9c7d13e20 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:41.524860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51ad2e54-d1e9-45e5-b8a8-f9d9c7d13e20 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:41.556416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d07512b8-7627-4458-8c8f-8aebcc6306da tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:41.611330 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d07512b8-7627-4458-8c8f-8aebcc6306da tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1495 microversion: 2.1 time: 0.714291 Aug 27 04:56:41.617625 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2357/4662] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:40 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1495 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:41.637709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5219974-4a4f-4151-9d62-d54b8a3d1612 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:41.649088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5219974-4a4f-4151-9d62-d54b8a3d1612 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:41.666307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5219974-4a4f-4151-9d62-d54b8a3d1612 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:41.671578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5219974-4a4f-4151-9d62-d54b8a3d1612 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:41.676957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5219974-4a4f-4151-9d62-d54b8a3d1612 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:41.680360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5219974-4a4f-4151-9d62-d54b8a3d1612 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:41.685042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5219974-4a4f-4151-9d62-d54b8a3d1612 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:41.807859 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5219974-4a4f-4151-9d62-d54b8a3d1612 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.187054 Aug 27 04:56:41.809773 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2358/4663] 10.222.0.79 () {58 vars in 1176 bytes} [Sat Aug 27 04:56:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:41.830498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-10eb6b13-5812-4447-8781-00ecdd99d871 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:41.839091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-10eb6b13-5812-4447-8781-00ecdd99d871 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:41.863223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10eb6b13-5812-4447-8781-00ecdd99d871 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:41.866892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10eb6b13-5812-4447-8781-00ecdd99d871 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:41.869191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10eb6b13-5812-4447-8781-00ecdd99d871 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:41.873822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10eb6b13-5812-4447-8781-00ecdd99d871 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:41.876011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10eb6b13-5812-4447-8781-00ecdd99d871 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:41.876719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10eb6b13-5812-4447-8781-00ecdd99d871 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:41.971254 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-10eb6b13-5812-4447-8781-00ecdd99d871 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/ips" status: 200 len: 144 microversion: 2.1 time: 0.151399 Aug 27 04:56:41.972193 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2359/4664] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 04:56:41 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/ips => generated 144 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:41.994066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b38a3ea-18f4-47a0-991e-6ae8e66ed39a tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:42.014270 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b38a3ea-18f4-47a0-991e-6ae8e66ed39a tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.031406 Aug 27 04:56:42.015313 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2360/4665] 10.222.0.79 () {58 vars in 1143 bytes} [Sat Aug 27 04:56:41 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:42.029005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f84d3469-b450-42ac-b0ae-302a147a9aed tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854823-1"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:42.049261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f84d3469-b450-42ac-b0ae-302a147a9aed tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:42.050156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f84d3469-b450-42ac-b0ae-302a147a9aed tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:42.050843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f84d3469-b450-42ac-b0ae-302a147a9aed tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:42.116704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:42.205655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-51ad2e54-d1e9-45e5-b8a8-f9d9c7d13e20 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:42.231532 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-51ad2e54-d1e9-45e5-b8a8-f9d9c7d13e20 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 0.885766 Aug 27 04:56:42.233766 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2306/4666] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:41 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:42.240240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-80af6a1c-5f47-41db-9a9e-5dc6888da10f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:42.244191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-80af6a1c-5f47-41db-9a9e-5dc6888da10f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:42.274193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80af6a1c-5f47-41db-9a9e-5dc6888da10f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:42.276461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80af6a1c-5f47-41db-9a9e-5dc6888da10f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:42.278026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80af6a1c-5f47-41db-9a9e-5dc6888da10f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:42.282927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80af6a1c-5f47-41db-9a9e-5dc6888da10f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:42.283703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80af6a1c-5f47-41db-9a9e-5dc6888da10f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:42.284405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80af6a1c-5f47-41db-9a9e-5dc6888da10f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:42.695347 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f84d3469-b450-42ac-b0ae-302a147a9aed tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.668378 Aug 27 04:56:42.699242 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2361/4667] 10.222.0.79 () {60 vars in 1194 bytes} [Sat Aug 27 04:56:42 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:42.715601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-14a4ed9a-79e6-43e2-8594-d807314acce1 req-4b5959e5-6b42-46e8-8898-224de0b12467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "name": "network-vif-deleted", "tag": "be33a009-98cd-48e8-9d40-6cb18faec1d1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:42.768694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-80af6a1c-5f47-41db-9a9e-5dc6888da10f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:42.769567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-14a4ed9a-79e6-43e2-8594-d807314acce1 req-4b5959e5-6b42-46e8-8898-224de0b12467 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:42.770079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-14a4ed9a-79e6-43e2-8594-d807314acce1 req-4b5959e5-6b42-46e8-8898-224de0b12467 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:42.771260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-14a4ed9a-79e6-43e2-8594-d807314acce1 req-4b5959e5-6b42-46e8-8898-224de0b12467 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:42.801955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-80af6a1c-5f47-41db-9a9e-5dc6888da10f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:42.806863 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-14a4ed9a-79e6-43e2-8594-d807314acce1 req-4b5959e5-6b42-46e8-8898-224de0b12467 service nova] Creating event network-vif-deleted:be33a009-98cd-48e8-9d40-6cb18faec1d1 for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:56:42.813073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-80af6a1c-5f47-41db-9a9e-5dc6888da10f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:42.814361 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-80af6a1c-5f47-41db-9a9e-5dc6888da10f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 2212 microversion: 2.32 time: 0.579044 Aug 27 04:56:42.814935 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2307/4668] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:42 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 2212 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:42.837468 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-14a4ed9a-79e6-43e2-8594-d807314acce1 req-4b5959e5-6b42-46e8-8898-224de0b12467 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135150 Aug 27 04:56:42.838557 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2362/4669] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:42.852558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-626640e6-8e19-48b3-8419-9c49bd6b2620 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:42.880033 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-626640e6-8e19-48b3-8419-9c49bd6b2620 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.060470 Aug 27 04:56:42.881805 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2308/4670] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:56:42 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:42.909372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a174309c-7f87-408d-82f9-b36cd329c00a tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-299958424", "availability_zone": "foo_zone"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:43.239061 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a174309c-7f87-408d-82f9-b36cd329c00a tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.349000 Aug 27 04:56:43.240075 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2363/4671] 10.222.0.79 () {60 vars in 1173 bytes} [Sat Aug 27 04:56:42 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:43.272476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-03a346dc-dcc6-44a4-abd5-8e4290f90391 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:43.273704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-17a4e468-ff6c-4877-8b2e-f379b576b921 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:43.274460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-17a4e468-ff6c-4877-8b2e-f379b576b921 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:43.297858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a4e468-ff6c-4877-8b2e-f379b576b921 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:43.298442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a4e468-ff6c-4877-8b2e-f379b576b921 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:43.298787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a4e468-ff6c-4877-8b2e-f379b576b921 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:43.299531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a4e468-ff6c-4877-8b2e-f379b576b921 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:43.299972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a4e468-ff6c-4877-8b2e-f379b576b921 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:43.300396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a4e468-ff6c-4877-8b2e-f379b576b921 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:43.402942 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-03a346dc-dcc6-44a4-abd5-8e4290f90391 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.149186 Aug 27 04:56:43.407731 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2309/4672] 10.222.0.79 () {60 vars in 1194 bytes} [Sat Aug 27 04:56:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:43.439861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-37042dbe-f53d-41d0-bfbe-9fa74532cdb2 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:43.467018 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-37042dbe-f53d-41d0-bfbe-9fa74532cdb2 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.050939 Aug 27 04:56:43.477209 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2310/4673] 10.222.0.79 () {58 vars in 1152 bytes} [Sat Aug 27 04:56:43 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:43.491243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f2f6c4c7-3dc5-4051-bf4d-d70c464f9ae0 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854823-1"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:43.527504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2f6c4c7-3dc5-4051-bf4d-d70c464f9ae0 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:43.528866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2f6c4c7-3dc5-4051-bf4d-d70c464f9ae0 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:43.529907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2f6c4c7-3dc5-4051-bf4d-d70c464f9ae0 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:43.817021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-17a4e468-ff6c-4877-8b2e-f379b576b921 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:43.828797 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-17a4e468-ff6c-4877-8b2e-f379b576b921 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1515 microversion: 2.1 time: 0.558265 Aug 27 04:56:43.841972 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2364/4674] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:43 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1515 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:43.860010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de2de50c-23ce-4057-9bf5-14ded903532d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:43.860010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-de2de50c-23ce-4057-9bf5-14ded903532d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:43.862259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de2de50c-23ce-4057-9bf5-14ded903532d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:43.862997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de2de50c-23ce-4057-9bf5-14ded903532d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:43.863696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de2de50c-23ce-4057-9bf5-14ded903532d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:43.864713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de2de50c-23ce-4057-9bf5-14ded903532d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:43.865403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de2de50c-23ce-4057-9bf5-14ded903532d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:43.866051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de2de50c-23ce-4057-9bf5-14ded903532d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:44.041901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de2de50c-23ce-4057-9bf5-14ded903532d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:44.063316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de2de50c-23ce-4057-9bf5-14ded903532d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:44.071848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de2de50c-23ce-4057-9bf5-14ded903532d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:44.073908 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de2de50c-23ce-4057-9bf5-14ded903532d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1609 microversion: 2.32 time: 0.228383 Aug 27 04:56:44.074620 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2365/4675] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:43 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1609 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:44.110977 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f2f6c4c7-3dc5-4051-bf4d-d70c464f9ae0 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.632534 Aug 27 04:56:44.111609 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2311/4676] 10.222.0.79 () {60 vars in 1194 bytes} [Sat Aug 27 04:56:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:44.125253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-efd0de2e-61af-437c-aeb6-d7cd2b1fc3b1 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:44.165786 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-efd0de2e-61af-437c-aeb6-d7cd2b1fc3b1 tempest-TestAggregatesBasicOps-429234269 tempest-TestAggregatesBasicOps-429234269-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.046784 Aug 27 04:56:44.168149 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2366/4677] 10.222.0.79 () {58 vars in 1155 bytes} [Sat Aug 27 04:56:44 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 04:56:44.854218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ce1eed88-6293-4ad3-a156-d21ce4dc2833 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:44.855359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ce1eed88-6293-4ad3-a156-d21ce4dc2833 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:44.862918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e48ae0e9-44a2-438b-95c0-e6c1b0d86c62 req-8e4d8025-350d-4bc9-bb9c-0e586e2632c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a81b44d-9499-46a5-b0ba-367b61b33999", "name": "network-vif-deleted", "tag": "a874eeb0-33af-4e93-929c-569c031939d0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:44.874725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce1eed88-6293-4ad3-a156-d21ce4dc2833 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:44.875250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce1eed88-6293-4ad3-a156-d21ce4dc2833 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:44.875697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce1eed88-6293-4ad3-a156-d21ce4dc2833 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:44.876424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce1eed88-6293-4ad3-a156-d21ce4dc2833 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:44.877162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce1eed88-6293-4ad3-a156-d21ce4dc2833 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:44.877596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce1eed88-6293-4ad3-a156-d21ce4dc2833 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:44.899021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e48ae0e9-44a2-438b-95c0-e6c1b0d86c62 req-8e4d8025-350d-4bc9-bb9c-0e586e2632c6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:44.902821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e48ae0e9-44a2-438b-95c0-e6c1b0d86c62 req-8e4d8025-350d-4bc9-bb9c-0e586e2632c6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:44.904169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e48ae0e9-44a2-438b-95c0-e6c1b0d86c62 req-8e4d8025-350d-4bc9-bb9c-0e586e2632c6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:44.928403 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e48ae0e9-44a2-438b-95c0-e6c1b0d86c62 req-8e4d8025-350d-4bc9-bb9c-0e586e2632c6 service nova] Creating event network-vif-deleted:a874eeb0-33af-4e93-929c-569c031939d0 for instance 4a81b44d-9499-46a5-b0ba-367b61b33999 on n-h2-854823-1 Aug 27 04:56:44.938309 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e48ae0e9-44a2-438b-95c0-e6c1b0d86c62 req-8e4d8025-350d-4bc9-bb9c-0e586e2632c6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079646 Aug 27 04:56:44.945219 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2367/4678] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:45.105389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a3ecd6d-e07e-45df-8eb5-d9167c63c1db tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:45.107759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a3ecd6d-e07e-45df-8eb5-d9167c63c1db tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:45.121677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a3ecd6d-e07e-45df-8eb5-d9167c63c1db tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:45.123184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a3ecd6d-e07e-45df-8eb5-d9167c63c1db tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:45.124552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a3ecd6d-e07e-45df-8eb5-d9167c63c1db tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:45.125994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a3ecd6d-e07e-45df-8eb5-d9167c63c1db tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:45.127317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a3ecd6d-e07e-45df-8eb5-d9167c63c1db tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:45.128099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a3ecd6d-e07e-45df-8eb5-d9167c63c1db tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:45.338379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a3ecd6d-e07e-45df-8eb5-d9167c63c1db tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:45.350629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a3ecd6d-e07e-45df-8eb5-d9167c63c1db tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:45.358571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a3ecd6d-e07e-45df-8eb5-d9167c63c1db tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:45.359821 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a3ecd6d-e07e-45df-8eb5-d9167c63c1db tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.260889 Aug 27 04:56:45.377288 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2368/4679] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:45 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:56:46.136318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ce1eed88-6293-4ad3-a156-d21ce4dc2833 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:46.146062 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ce1eed88-6293-4ad3-a156-d21ce4dc2833 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 1.297290 Aug 27 04:56:46.146658 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2312/4680] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:44 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:46.383689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5aee555e-d836-453b-a487-0e578c8e291c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:46.384312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5aee555e-d836-453b-a487-0e578c8e291c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:46.397508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5aee555e-d836-453b-a487-0e578c8e291c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:46.398016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5aee555e-d836-453b-a487-0e578c8e291c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:46.398465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5aee555e-d836-453b-a487-0e578c8e291c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:46.399241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5aee555e-d836-453b-a487-0e578c8e291c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:46.399714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5aee555e-d836-453b-a487-0e578c8e291c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:46.400143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5aee555e-d836-453b-a487-0e578c8e291c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:46.843058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5aee555e-d836-453b-a487-0e578c8e291c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:46.861743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5aee555e-d836-453b-a487-0e578c8e291c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:46.863247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5aee555e-d836-453b-a487-0e578c8e291c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:46.867504 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5aee555e-d836-453b-a487-0e578c8e291c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.487654 Aug 27 04:56:46.881209 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2369/4681] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:46 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:47.172924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8f62d056-af14-447b-a659-4626a027657b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:47.173315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8f62d056-af14-447b-a659-4626a027657b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:47.199637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f62d056-af14-447b-a659-4626a027657b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:47.200161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f62d056-af14-447b-a659-4626a027657b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:47.200661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f62d056-af14-447b-a659-4626a027657b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:47.201362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f62d056-af14-447b-a659-4626a027657b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:47.201927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f62d056-af14-447b-a659-4626a027657b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:47.202431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f62d056-af14-447b-a659-4626a027657b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:47.519636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8f62d056-af14-447b-a659-4626a027657b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:47.534373 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8f62d056-af14-447b-a659-4626a027657b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 0.364725 Aug 27 04:56:47.537316 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2313/4682] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:47 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:47.730446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eefabedd-357b-473b-859c-ea82952e32d2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2392823-1c33-4f55-ab56-bcf92079846d"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:47.733303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eefabedd-357b-473b-859c-ea82952e32d2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:47.760882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eefabedd-357b-473b-859c-ea82952e32d2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:47.761395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eefabedd-357b-473b-859c-ea82952e32d2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:47.784873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eefabedd-357b-473b-859c-ea82952e32d2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:47.788324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eefabedd-357b-473b-859c-ea82952e32d2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:47.789870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eefabedd-357b-473b-859c-ea82952e32d2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:47.793151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eefabedd-357b-473b-859c-ea82952e32d2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:47.902820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9a18216a-e7e4-4607-a077-f56151783380 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:47.903664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9a18216a-e7e4-4607-a077-f56151783380 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:47.915463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a18216a-e7e4-4607-a077-f56151783380 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:47.919846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a18216a-e7e4-4607-a077-f56151783380 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:47.923399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a18216a-e7e4-4607-a077-f56151783380 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:47.924415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a18216a-e7e4-4607-a077-f56151783380 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:47.925119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a18216a-e7e4-4607-a077-f56151783380 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:47.925757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a18216a-e7e4-4607-a077-f56151783380 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:48.098181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9a18216a-e7e4-4607-a077-f56151783380 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:48.123597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9a18216a-e7e4-4607-a077-f56151783380 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:48.125287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9a18216a-e7e4-4607-a077-f56151783380 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:48.126542 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9a18216a-e7e4-4607-a077-f56151783380 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.234268 Aug 27 04:56:48.127378 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2314/4683] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:47 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:56:48.561383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-73f0056e-c65b-4c7a-9bd5-435e32df4a0a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:48.562178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-73f0056e-c65b-4c7a-9bd5-435e32df4a0a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:48.583406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73f0056e-c65b-4c7a-9bd5-435e32df4a0a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:48.584314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73f0056e-c65b-4c7a-9bd5-435e32df4a0a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:48.585029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73f0056e-c65b-4c7a-9bd5-435e32df4a0a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:48.586070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73f0056e-c65b-4c7a-9bd5-435e32df4a0a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:48.587076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73f0056e-c65b-4c7a-9bd5-435e32df4a0a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:48.587772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73f0056e-c65b-4c7a-9bd5-435e32df4a0a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:48.845720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-73f0056e-c65b-4c7a-9bd5-435e32df4a0a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:48.855980 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-73f0056e-c65b-4c7a-9bd5-435e32df4a0a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 0.298999 Aug 27 04:56:48.861650 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2315/4684] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:48 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:49.154863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5e317574-275d-48e5-b55a-e6574479db65 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:49.155719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5e317574-275d-48e5-b55a-e6574479db65 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:49.164896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e317574-275d-48e5-b55a-e6574479db65 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:49.171574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e317574-275d-48e5-b55a-e6574479db65 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:49.171842 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eefabedd-357b-473b-859c-ea82952e32d2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "POST /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.447839 Aug 27 04:56:49.177966 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2370/4685] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 04:56:47 2022] POST /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/os-volume_attachments => generated 194 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:49.178981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e317574-275d-48e5-b55a-e6574479db65 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:49.191107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e317574-275d-48e5-b55a-e6574479db65 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:49.192042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e317574-275d-48e5-b55a-e6574479db65 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:49.192763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e317574-275d-48e5-b55a-e6574479db65 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:49.334250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5e317574-275d-48e5-b55a-e6574479db65 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:49.355104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5e317574-275d-48e5-b55a-e6574479db65 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:49.359524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5e317574-275d-48e5-b55a-e6574479db65 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:49.366519 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5e317574-275d-48e5-b55a-e6574479db65 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.217232 Aug 27 04:56:49.367148 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2316/4686] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:49 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:49.482146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e805e94f-6936-470d-86f1-f5d1b950c959 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:49.484026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e805e94f-6936-470d-86f1-f5d1b950c959 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:49.509043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e805e94f-6936-470d-86f1-f5d1b950c959 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:49.509552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e805e94f-6936-470d-86f1-f5d1b950c959 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:49.509997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e805e94f-6936-470d-86f1-f5d1b950c959 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:49.510715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e805e94f-6936-470d-86f1-f5d1b950c959 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:49.511172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e805e94f-6936-470d-86f1-f5d1b950c959 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:49.511595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e805e94f-6936-470d-86f1-f5d1b950c959 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:49.557205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e805e94f-6936-470d-86f1-f5d1b950c959 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:56:49.744111 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e805e94f-6936-470d-86f1-f5d1b950c959 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 204 len: 0 microversion: 2.1 time: 0.266017 Aug 27 04:56:49.747947 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2371/4687] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:56:49 2022] DELETE /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:56:49.758632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-54935947-b2f2-4da5-b51a-f8521d801d5c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:49.759284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-54935947-b2f2-4da5-b51a-f8521d801d5c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:49.781624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54935947-b2f2-4da5-b51a-f8521d801d5c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:49.781624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54935947-b2f2-4da5-b51a-f8521d801d5c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:49.781624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54935947-b2f2-4da5-b51a-f8521d801d5c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:49.781624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54935947-b2f2-4da5-b51a-f8521d801d5c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:49.790411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54935947-b2f2-4da5-b51a-f8521d801d5c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:49.790935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-54935947-b2f2-4da5-b51a-f8521d801d5c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:49.886157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c82b285-05d0-496b-90fa-cfeb2efe502b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:49.886854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c82b285-05d0-496b-90fa-cfeb2efe502b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:49.901472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c82b285-05d0-496b-90fa-cfeb2efe502b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:49.901978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c82b285-05d0-496b-90fa-cfeb2efe502b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:49.902417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c82b285-05d0-496b-90fa-cfeb2efe502b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:49.903129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c82b285-05d0-496b-90fa-cfeb2efe502b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:49.903586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c82b285-05d0-496b-90fa-cfeb2efe502b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:49.904000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c82b285-05d0-496b-90fa-cfeb2efe502b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:50.215340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c82b285-05d0-496b-90fa-cfeb2efe502b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:50.223534 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c82b285-05d0-496b-90fa-cfeb2efe502b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 0.341656 Aug 27 04:56:50.243225 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2372/4688] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:49 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:50.329570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-54935947-b2f2-4da5-b51a-f8521d801d5c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:50.338280 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-54935947-b2f2-4da5-b51a-f8521d801d5c tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1501 microversion: 2.1 time: 0.588448 Aug 27 04:56:50.342875 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2317/4689] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:49 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1501 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:50.396324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29ab30bb-255d-4775-82db-d81f849fce96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:50.397350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29ab30bb-255d-4775-82db-d81f849fce96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:50.409751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29ab30bb-255d-4775-82db-d81f849fce96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:50.414202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29ab30bb-255d-4775-82db-d81f849fce96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:50.416832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29ab30bb-255d-4775-82db-d81f849fce96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:50.417930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29ab30bb-255d-4775-82db-d81f849fce96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:50.420019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29ab30bb-255d-4775-82db-d81f849fce96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:50.424105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29ab30bb-255d-4775-82db-d81f849fce96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:50.596047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29ab30bb-255d-4775-82db-d81f849fce96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:50.616121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29ab30bb-255d-4775-82db-d81f849fce96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:50.617864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29ab30bb-255d-4775-82db-d81f849fce96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:50.620372 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29ab30bb-255d-4775-82db-d81f849fce96 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.228640 Aug 27 04:56:50.626065 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2373/4690] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:50 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:51.248290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a4dccc7d-2d92-45c7-a96f-9cd9c53e9edf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:51.250048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a4dccc7d-2d92-45c7-a96f-9cd9c53e9edf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:51.268427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4dccc7d-2d92-45c7-a96f-9cd9c53e9edf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:51.269253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4dccc7d-2d92-45c7-a96f-9cd9c53e9edf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:51.269868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4dccc7d-2d92-45c7-a96f-9cd9c53e9edf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:51.270834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4dccc7d-2d92-45c7-a96f-9cd9c53e9edf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:51.271469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4dccc7d-2d92-45c7-a96f-9cd9c53e9edf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:51.272084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4dccc7d-2d92-45c7-a96f-9cd9c53e9edf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:51.363219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab36406b-236d-4386-8c2b-1055e72c7437 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:51.364425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab36406b-236d-4386-8c2b-1055e72c7437 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:51.386339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab36406b-236d-4386-8c2b-1055e72c7437 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:51.387142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab36406b-236d-4386-8c2b-1055e72c7437 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:51.387772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab36406b-236d-4386-8c2b-1055e72c7437 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:51.388722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab36406b-236d-4386-8c2b-1055e72c7437 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:51.389976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab36406b-236d-4386-8c2b-1055e72c7437 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:51.390790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab36406b-236d-4386-8c2b-1055e72c7437 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:51.643824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a4dccc7d-2d92-45c7-a96f-9cd9c53e9edf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:51.661422 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a4dccc7d-2d92-45c7-a96f-9cd9c53e9edf tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 0.418066 Aug 27 04:56:51.662613 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2318/4691] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:51 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:51.667761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-38d60484-4bb6-4394-88ce-152ce1a874da tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:51.668645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-38d60484-4bb6-4394-88ce-152ce1a874da tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:51.683930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab36406b-236d-4386-8c2b-1055e72c7437 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:51.693593 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab36406b-236d-4386-8c2b-1055e72c7437 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1501 microversion: 2.1 time: 0.334511 Aug 27 04:56:51.694196 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2374/4692] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:51 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1501 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:51.709656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38d60484-4bb6-4394-88ce-152ce1a874da tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:51.710342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38d60484-4bb6-4394-88ce-152ce1a874da tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:51.711098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38d60484-4bb6-4394-88ce-152ce1a874da tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:51.712269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38d60484-4bb6-4394-88ce-152ce1a874da tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:51.712763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38d60484-4bb6-4394-88ce-152ce1a874da tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:51.713209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38d60484-4bb6-4394-88ce-152ce1a874da tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:51.867918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-38d60484-4bb6-4394-88ce-152ce1a874da tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:51.891330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-38d60484-4bb6-4394-88ce-152ce1a874da tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:51.892731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-38d60484-4bb6-4394-88ce-152ce1a874da tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:51.893942 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-38d60484-4bb6-4394-88ce-152ce1a874da tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.230190 Aug 27 04:56:51.894515 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2319/4693] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:51 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:52.683769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56ae3dd5-99a7-412c-8ccc-f9115d1f26f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:52.684435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-56ae3dd5-99a7-412c-8ccc-f9115d1f26f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:52.694912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:52.697723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56ae3dd5-99a7-412c-8ccc-f9115d1f26f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:52.715096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1da3601f-08b3-4dce-88b5-fa14b05ef637 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:52.716494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1da3601f-08b3-4dce-88b5-fa14b05ef637 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:52.721745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56ae3dd5-99a7-412c-8ccc-f9115d1f26f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:52.723395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56ae3dd5-99a7-412c-8ccc-f9115d1f26f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:52.727083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1da3601f-08b3-4dce-88b5-fa14b05ef637 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:52.727756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56ae3dd5-99a7-412c-8ccc-f9115d1f26f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:52.728484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56ae3dd5-99a7-412c-8ccc-f9115d1f26f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:52.729186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56ae3dd5-99a7-412c-8ccc-f9115d1f26f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:52.730310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1da3601f-08b3-4dce-88b5-fa14b05ef637 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:52.733193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1da3601f-08b3-4dce-88b5-fa14b05ef637 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:52.734210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1da3601f-08b3-4dce-88b5-fa14b05ef637 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:52.734914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1da3601f-08b3-4dce-88b5-fa14b05ef637 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:52.738340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1da3601f-08b3-4dce-88b5-fa14b05ef637 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:52.933645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-56ae3dd5-99a7-412c-8ccc-f9115d1f26f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:52.943700 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-56ae3dd5-99a7-412c-8ccc-f9115d1f26f4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 0.264728 Aug 27 04:56:52.945104 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2375/4694] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:52 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:52.950762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-18e65448-6eff-45b4-ba32-a5fed0a4f0c8 req-3bf55aec-f004-4669-9c44-cd40a7f0fac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c952536b-2682-46ff-9623-9ca8e992eb96", "name": "network-vif-deleted", "tag": "cbc6a9b5-d543-4b1d-a522-41fc6d42bc9d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:56:52.961950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-18e65448-6eff-45b4-ba32-a5fed0a4f0c8 req-3bf55aec-f004-4669-9c44-cd40a7f0fac5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:52.962949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-18e65448-6eff-45b4-ba32-a5fed0a4f0c8 req-3bf55aec-f004-4669-9c44-cd40a7f0fac5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:52.963640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-18e65448-6eff-45b4-ba32-a5fed0a4f0c8 req-3bf55aec-f004-4669-9c44-cd40a7f0fac5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:52.987157 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-18e65448-6eff-45b4-ba32-a5fed0a4f0c8 req-3bf55aec-f004-4669-9c44-cd40a7f0fac5 service nova] Creating event network-vif-deleted:cbc6a9b5-d543-4b1d-a522-41fc6d42bc9d for instance c952536b-2682-46ff-9623-9ca8e992eb96 on n-h1-854823-1 Aug 27 04:56:53.000580 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-18e65448-6eff-45b4-ba32-a5fed0a4f0c8 req-3bf55aec-f004-4669-9c44-cd40a7f0fac5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052917 Aug 27 04:56:53.001209 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2376/4695] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:56:53.015993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba39acd2-d280-4fdd-83c8-edc16f90a18c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:53.017357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba39acd2-d280-4fdd-83c8-edc16f90a18c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:53.024959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba39acd2-d280-4fdd-83c8-edc16f90a18c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:53.026178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba39acd2-d280-4fdd-83c8-edc16f90a18c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:53.027173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba39acd2-d280-4fdd-83c8-edc16f90a18c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:53.028566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba39acd2-d280-4fdd-83c8-edc16f90a18c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:53.029203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba39acd2-d280-4fdd-83c8-edc16f90a18c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:53.030718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba39acd2-d280-4fdd-83c8-edc16f90a18c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:53.112275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1da3601f-08b3-4dce-88b5-fa14b05ef637 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052261afeb243018b05277cec626ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b952f425c6a244faadf7e8507a75f2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:53.125172 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1da3601f-08b3-4dce-88b5-fa14b05ef637 tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 200 len: 1459 microversion: 2.1 time: 0.413922 Aug 27 04:56:53.127426 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2320/4696] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:52 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 1459 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:56:53.144333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba39acd2-d280-4fdd-83c8-edc16f90a18c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:53.166176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba39acd2-d280-4fdd-83c8-edc16f90a18c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:53.167650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba39acd2-d280-4fdd-83c8-edc16f90a18c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:53.182879 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba39acd2-d280-4fdd-83c8-edc16f90a18c tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.165227 Aug 27 04:56:53.187382 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2377/4697] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:53 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:53.981345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-525eb28a-4e3e-4d0d-9449-194ab196ee7c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:53.983133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-525eb28a-4e3e-4d0d-9449-194ab196ee7c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:54.010675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-525eb28a-4e3e-4d0d-9449-194ab196ee7c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:54.014789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-525eb28a-4e3e-4d0d-9449-194ab196ee7c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:54.020122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-525eb28a-4e3e-4d0d-9449-194ab196ee7c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:54.027015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-525eb28a-4e3e-4d0d-9449-194ab196ee7c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:54.028906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-525eb28a-4e3e-4d0d-9449-194ab196ee7c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:54.029269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-525eb28a-4e3e-4d0d-9449-194ab196ee7c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:54.150317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba318376-6776-4952-bfb3-4f1aec8e38ef tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:54.151694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba318376-6776-4952-bfb3-4f1aec8e38ef tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] [instance: c952536b-2682-46ff-9623-9ca8e992eb96] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:54.160611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba318376-6776-4952-bfb3-4f1aec8e38ef tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:54.161464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba318376-6776-4952-bfb3-4f1aec8e38ef tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:54.162149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba318376-6776-4952-bfb3-4f1aec8e38ef tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:54.163105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba318376-6776-4952-bfb3-4f1aec8e38ef tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:54.164447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba318376-6776-4952-bfb3-4f1aec8e38ef tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:54.165163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba318376-6776-4952-bfb3-4f1aec8e38ef tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:54.183301 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ba318376-6776-4952-bfb3-4f1aec8e38ef tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] HTTP exception thrown: Instance c952536b-2682-46ff-9623-9ca8e992eb96 could not be found. Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba318376-6776-4952-bfb3-4f1aec8e38ef tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Request method failure captured: Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 HTTP/1.1 Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaPp8QmvRKhnAIMHlleop0pLZ1Xovl1GQ0dnwBWatftGQLC1wTXwz59dUhN9ClfvFynm9AENOo2plpH7RvgrXItlidXQeGIk3uSP3VMqM8f9r4WGV2vqzEqmrqzV85tUDRtIcdTFETXwOXDIDZ-Q8q4-ut8TN00KUXK5LI5IQZ2yVpc Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: b952f425c6a244faadf7e8507a75f2a5 Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesActionsTest-1424157951 Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b952f425c6a244faadf7e8507a75f2a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b952f425c6a244faadf7e8507a75f2a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b952f425c6a244faadf7e8507a75f2a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b952f425c6a244faadf7e8507a75f2a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesActionsTest-1424157951 Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: b952f425c6a244faadf7e8507a75f2a5 Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesActionsTest-1424157951 Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-VolumesActionsTest-1424157951-project Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a052261afeb243018b05277cec626ee8 Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesActionsTest-1424157951-project Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance c952536b-2682-46ff-9623-9ca8e992eb96 could not be found. Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'c952536b-2682-46ff-9623-9ca8e992eb96'} Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c952536b-2682-46ff-9623-9ca8e992eb96 could not be found. Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c952536b-2682-46ff-9623-9ca8e992eb96 could not be found. Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:56:54.185327 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:54.190740 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:56:54.190740 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:56:54.190740 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:56:54.190740 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:56:54.190740 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:56:54.190740 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c952536b-2682-46ff-9623-9ca8e992eb96 could not be found. Aug 27 04:56:54.190740 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:56:54.192922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba318376-6776-4952-bfb3-4f1aec8e38ef tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] Returning 404 to user: Instance c952536b-2682-46ff-9623-9ca8e992eb96 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:56:54.194183 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba318376-6776-4952-bfb3-4f1aec8e38ef tempest-VolumesActionsTest-1424157951 tempest-VolumesActionsTest-1424157951-project] 10.222.0.79 "GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96" status: 404 len: 111 microversion: 2.1 time: 0.049605 Aug 27 04:56:54.194935 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2378/4698] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:54 2022] GET /compute/v2.1/servers/c952536b-2682-46ff-9623-9ca8e992eb96 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:56:54.209922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f9e520c-004f-4dd1-9a5a-77756f08cc79 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:54.211618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f9e520c-004f-4dd1-9a5a-77756f08cc79 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:54.227017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9e520c-004f-4dd1-9a5a-77756f08cc79 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:54.227826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9e520c-004f-4dd1-9a5a-77756f08cc79 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:54.228434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9e520c-004f-4dd1-9a5a-77756f08cc79 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:54.231467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9e520c-004f-4dd1-9a5a-77756f08cc79 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:54.232118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9e520c-004f-4dd1-9a5a-77756f08cc79 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:54.233624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9e520c-004f-4dd1-9a5a-77756f08cc79 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:54.351249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f9e520c-004f-4dd1-9a5a-77756f08cc79 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:54.364895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f9e520c-004f-4dd1-9a5a-77756f08cc79 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:54.372152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f9e520c-004f-4dd1-9a5a-77756f08cc79 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:54.375355 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f9e520c-004f-4dd1-9a5a-77756f08cc79 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.171226 Aug 27 04:56:54.378128 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2379/4699] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:54 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:54.451037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-525eb28a-4e3e-4d0d-9449-194ab196ee7c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:54.474434 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-525eb28a-4e3e-4d0d-9449-194ab196ee7c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 0.496158 Aug 27 04:56:54.481530 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2321/4700] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:53 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:55.404884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3127f4a-2529-46e7-a297-551f179269b3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:55.406978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c3127f4a-2529-46e7-a297-551f179269b3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:55.433842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3127f4a-2529-46e7-a297-551f179269b3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:55.438131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3127f4a-2529-46e7-a297-551f179269b3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:55.439623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3127f4a-2529-46e7-a297-551f179269b3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:55.441854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3127f4a-2529-46e7-a297-551f179269b3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:55.442401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3127f4a-2529-46e7-a297-551f179269b3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:55.445319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3127f4a-2529-46e7-a297-551f179269b3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:55.511171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:55.512049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f54f4cbf-63e3-41e6-a3a0-21199ad03302 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:55.513450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f54f4cbf-63e3-41e6-a3a0-21199ad03302 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:55.524096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f54f4cbf-63e3-41e6-a3a0-21199ad03302 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:55.525053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f54f4cbf-63e3-41e6-a3a0-21199ad03302 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:55.525667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f54f4cbf-63e3-41e6-a3a0-21199ad03302 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:55.526931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f54f4cbf-63e3-41e6-a3a0-21199ad03302 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:55.527566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f54f4cbf-63e3-41e6-a3a0-21199ad03302 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:55.528162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f54f4cbf-63e3-41e6-a3a0-21199ad03302 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:55.613920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3127f4a-2529-46e7-a297-551f179269b3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:55.630695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3127f4a-2529-46e7-a297-551f179269b3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:55.632256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3127f4a-2529-46e7-a297-551f179269b3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:55.636259 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3127f4a-2529-46e7-a297-551f179269b3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.239336 Aug 27 04:56:55.637913 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2380/4701] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:55 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:55.864706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f54f4cbf-63e3-41e6-a3a0-21199ad03302 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:55.873850 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f54f4cbf-63e3-41e6-a3a0-21199ad03302 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1532 microversion: 2.1 time: 0.366441 Aug 27 04:56:55.875044 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2322/4702] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:55 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1532 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:56.661718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a27ea6d6-1cae-4d9f-bdc3-556d04511ec5 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:56.662354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a27ea6d6-1cae-4d9f-bdc3-556d04511ec5 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:56.689720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a27ea6d6-1cae-4d9f-bdc3-556d04511ec5 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:56.693704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a27ea6d6-1cae-4d9f-bdc3-556d04511ec5 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:56.694211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a27ea6d6-1cae-4d9f-bdc3-556d04511ec5 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:56.695150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a27ea6d6-1cae-4d9f-bdc3-556d04511ec5 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:56.695632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a27ea6d6-1cae-4d9f-bdc3-556d04511ec5 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:56.696062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a27ea6d6-1cae-4d9f-bdc3-556d04511ec5 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:56.835404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a27ea6d6-1cae-4d9f-bdc3-556d04511ec5 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:56.850125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a27ea6d6-1cae-4d9f-bdc3-556d04511ec5 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:56.852126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a27ea6d6-1cae-4d9f-bdc3-556d04511ec5 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:56.853702 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a27ea6d6-1cae-4d9f-bdc3-556d04511ec5 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.197709 Aug 27 04:56:56.854764 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2381/4703] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:56 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:56.898882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c2041af2-82e9-41d4-9127-8da62cdf476c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:56.901595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c2041af2-82e9-41d4-9127-8da62cdf476c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:56.918191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2041af2-82e9-41d4-9127-8da62cdf476c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:56.918732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2041af2-82e9-41d4-9127-8da62cdf476c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:56.919174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2041af2-82e9-41d4-9127-8da62cdf476c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:56.919898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2041af2-82e9-41d4-9127-8da62cdf476c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:56.920945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2041af2-82e9-41d4-9127-8da62cdf476c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:56.926034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2041af2-82e9-41d4-9127-8da62cdf476c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:57.428843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c2041af2-82e9-41d4-9127-8da62cdf476c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:57.431576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:57.443271 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c2041af2-82e9-41d4-9127-8da62cdf476c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.549126 Aug 27 04:56:57.448820 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2323/4704] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:56 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:57.877838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c7efaaf-d266-481c-a030-36dea8e4b1aa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:57.879011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4c7efaaf-d266-481c-a030-36dea8e4b1aa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:57.895638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c7efaaf-d266-481c-a030-36dea8e4b1aa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:57.897306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c7efaaf-d266-481c-a030-36dea8e4b1aa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:57.898244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c7efaaf-d266-481c-a030-36dea8e4b1aa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:57.900192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c7efaaf-d266-481c-a030-36dea8e4b1aa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:57.902111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c7efaaf-d266-481c-a030-36dea8e4b1aa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:57.903404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c7efaaf-d266-481c-a030-36dea8e4b1aa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:58.038853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c7efaaf-d266-481c-a030-36dea8e4b1aa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:58.051982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c7efaaf-d266-481c-a030-36dea8e4b1aa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:58.058905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c7efaaf-d266-481c-a030-36dea8e4b1aa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:58.060394 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c7efaaf-d266-481c-a030-36dea8e4b1aa tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.186717 Aug 27 04:56:58.061717 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2382/4705] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:57 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:58.471443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-de27498e-1719-4a35-9940-ec24d4c19d8d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:58.477567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-de27498e-1719-4a35-9940-ec24d4c19d8d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:58.490616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de27498e-1719-4a35-9940-ec24d4c19d8d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:58.491854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de27498e-1719-4a35-9940-ec24d4c19d8d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:58.492641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de27498e-1719-4a35-9940-ec24d4c19d8d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:58.493625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de27498e-1719-4a35-9940-ec24d4c19d8d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:58.496712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de27498e-1719-4a35-9940-ec24d4c19d8d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:58.497194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de27498e-1719-4a35-9940-ec24d4c19d8d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:58.756644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-de27498e-1719-4a35-9940-ec24d4c19d8d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:58.769968 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-de27498e-1719-4a35-9940-ec24d4c19d8d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.304736 Aug 27 04:56:58.771192 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2324/4706] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:58 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:56:59.086901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da4a548d-da07-41d2-ada1-d314ebaa521f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:59.087531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da4a548d-da07-41d2-ada1-d314ebaa521f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:59.104339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da4a548d-da07-41d2-ada1-d314ebaa521f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:59.104788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da4a548d-da07-41d2-ada1-d314ebaa521f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:59.105427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da4a548d-da07-41d2-ada1-d314ebaa521f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:59.106336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da4a548d-da07-41d2-ada1-d314ebaa521f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:59.106976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da4a548d-da07-41d2-ada1-d314ebaa521f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:59.108184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da4a548d-da07-41d2-ada1-d314ebaa521f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:59.275527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da4a548d-da07-41d2-ada1-d314ebaa521f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:59.287247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da4a548d-da07-41d2-ada1-d314ebaa521f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:59.294047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da4a548d-da07-41d2-ada1-d314ebaa521f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:56:59.296015 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da4a548d-da07-41d2-ada1-d314ebaa521f tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.213107 Aug 27 04:56:59.302108 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2383/4707] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:56:59 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:56:59.795131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a812aed-dac0-4539-90c4-790c3f9d8936 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:56:59.796771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a812aed-dac0-4539-90c4-790c3f9d8936 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:56:59.805810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a812aed-dac0-4539-90c4-790c3f9d8936 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:59.806800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a812aed-dac0-4539-90c4-790c3f9d8936 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:59.807895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a812aed-dac0-4539-90c4-790c3f9d8936 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:56:59.808921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a812aed-dac0-4539-90c4-790c3f9d8936 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:56:59.809638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a812aed-dac0-4539-90c4-790c3f9d8936 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:56:59.810352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a812aed-dac0-4539-90c4-790c3f9d8936 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:00.056380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5d00adf5-24ff-443a-9e40-9771fd2db5fb req-21940d13-2384-403e-9f1d-b0217462d068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228b4767-bbe2-41d0-a7d4-a6670e79043f", "name": "network-vif-plugged", "status": "completed", "tag": "1b95ce59-5e34-4673-9606-3f53d8d7b9d1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:00.080427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5d00adf5-24ff-443a-9e40-9771fd2db5fb req-21940d13-2384-403e-9f1d-b0217462d068 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:00.082849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5d00adf5-24ff-443a-9e40-9771fd2db5fb req-21940d13-2384-403e-9f1d-b0217462d068 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:00.084444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5d00adf5-24ff-443a-9e40-9771fd2db5fb req-21940d13-2384-403e-9f1d-b0217462d068 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:00.091608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6a812aed-dac0-4539-90c4-790c3f9d8936 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:00.104949 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a812aed-dac0-4539-90c4-790c3f9d8936 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.313587 Aug 27 04:57:00.105760 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2325/4708] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:56:59 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:00.132915 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5d00adf5-24ff-443a-9e40-9771fd2db5fb req-21940d13-2384-403e-9f1d-b0217462d068 service nova] Creating event network-vif-plugged:1b95ce59-5e34-4673-9606-3f53d8d7b9d1 for instance 228b4767-bbe2-41d0-a7d4-a6670e79043f on n-h2-854823-1 Aug 27 04:57:00.144402 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5d00adf5-24ff-443a-9e40-9771fd2db5fb req-21940d13-2384-403e-9f1d-b0217462d068 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090824 Aug 27 04:57:00.151172 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2384/4709] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:00.324181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1e7e601f-1997-442f-b108-822660d8c854 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:00.325120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1e7e601f-1997-442f-b108-822660d8c854 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:00.338443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e7e601f-1997-442f-b108-822660d8c854 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:00.339360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e7e601f-1997-442f-b108-822660d8c854 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:00.339996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e7e601f-1997-442f-b108-822660d8c854 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:00.340951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e7e601f-1997-442f-b108-822660d8c854 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:00.341615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e7e601f-1997-442f-b108-822660d8c854 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:00.342343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e7e601f-1997-442f-b108-822660d8c854 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:00.432732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e7e601f-1997-442f-b108-822660d8c854 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:00.458831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e7e601f-1997-442f-b108-822660d8c854 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:00.466615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e7e601f-1997-442f-b108-822660d8c854 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:00.471036 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1e7e601f-1997-442f-b108-822660d8c854 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.149882 Aug 27 04:57:00.507973 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2326/4710] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:00 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:01.132260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-632ff513-0ffa-4594-91ab-e817b667e621 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:01.133052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-632ff513-0ffa-4594-91ab-e817b667e621 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:01.146798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-632ff513-0ffa-4594-91ab-e817b667e621 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:01.150009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-632ff513-0ffa-4594-91ab-e817b667e621 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:01.150685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-632ff513-0ffa-4594-91ab-e817b667e621 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:01.151606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-632ff513-0ffa-4594-91ab-e817b667e621 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:01.155089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-632ff513-0ffa-4594-91ab-e817b667e621 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:01.155752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-632ff513-0ffa-4594-91ab-e817b667e621 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:01.516390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bddbc57c-fd39-4b59-9c27-f71b276d24ff tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:01.517775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bddbc57c-fd39-4b59-9c27-f71b276d24ff tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:01.538744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bddbc57c-fd39-4b59-9c27-f71b276d24ff tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:01.546725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bddbc57c-fd39-4b59-9c27-f71b276d24ff tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:01.547268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bddbc57c-fd39-4b59-9c27-f71b276d24ff tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:01.547946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bddbc57c-fd39-4b59-9c27-f71b276d24ff tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:01.548410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bddbc57c-fd39-4b59-9c27-f71b276d24ff tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:01.548866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bddbc57c-fd39-4b59-9c27-f71b276d24ff tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:01.649576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-632ff513-0ffa-4594-91ab-e817b667e621 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:01.649576 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-632ff513-0ffa-4594-91ab-e817b667e621 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.514572 Aug 27 04:57:01.671202 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2385/4711] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:01 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:01.779873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bddbc57c-fd39-4b59-9c27-f71b276d24ff tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:01.793295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bddbc57c-fd39-4b59-9c27-f71b276d24ff tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:01.796015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bddbc57c-fd39-4b59-9c27-f71b276d24ff tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:01.798309 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bddbc57c-fd39-4b59-9c27-f71b276d24ff tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.288844 Aug 27 04:57:01.809438 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2327/4712] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:01 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:57:02.665922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd8efb84-6d82-455a-b055-eb026e17fc23 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:02.666532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd8efb84-6d82-455a-b055-eb026e17fc23 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:02.685040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd8efb84-6d82-455a-b055-eb026e17fc23 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:02.685920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd8efb84-6d82-455a-b055-eb026e17fc23 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:02.686374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd8efb84-6d82-455a-b055-eb026e17fc23 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:02.691632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd8efb84-6d82-455a-b055-eb026e17fc23 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:02.692140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd8efb84-6d82-455a-b055-eb026e17fc23 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:02.693047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd8efb84-6d82-455a-b055-eb026e17fc23 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:02.836430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a7d32b39-1067-4393-b1d3-cd8a72ad0d26 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:02.837974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a7d32b39-1067-4393-b1d3-cd8a72ad0d26 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:02.856929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7d32b39-1067-4393-b1d3-cd8a72ad0d26 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:02.858524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7d32b39-1067-4393-b1d3-cd8a72ad0d26 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:02.859261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7d32b39-1067-4393-b1d3-cd8a72ad0d26 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:02.860237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7d32b39-1067-4393-b1d3-cd8a72ad0d26 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:02.861173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7d32b39-1067-4393-b1d3-cd8a72ad0d26 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:02.862641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7d32b39-1067-4393-b1d3-cd8a72ad0d26 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:03.011884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a7d32b39-1067-4393-b1d3-cd8a72ad0d26 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:03.021478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd8efb84-6d82-455a-b055-eb026e17fc23 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:03.044736 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd8efb84-6d82-455a-b055-eb026e17fc23 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.372517 Aug 27 04:57:03.046814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a7d32b39-1067-4393-b1d3-cd8a72ad0d26 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:03.047920 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2386/4713] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:02 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:03.058969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a7d32b39-1067-4393-b1d3-cd8a72ad0d26 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:03.060455 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a7d32b39-1067-4393-b1d3-cd8a72ad0d26 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.237332 Aug 27 04:57:03.065783 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2328/4714] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:02 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:04.074715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d2c00ee-6c85-4c77-ae2c-24a858a6ab3c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:04.076500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d2c00ee-6c85-4c77-ae2c-24a858a6ab3c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:04.091567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-37855c7d-d73e-4e8f-a88b-5ee446b6cd05 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:04.092743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-37855c7d-d73e-4e8f-a88b-5ee446b6cd05 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:04.114629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d2c00ee-6c85-4c77-ae2c-24a858a6ab3c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:04.115594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d2c00ee-6c85-4c77-ae2c-24a858a6ab3c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:04.116191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37855c7d-d73e-4e8f-a88b-5ee446b6cd05 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:04.117100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37855c7d-d73e-4e8f-a88b-5ee446b6cd05 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:04.117407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d2c00ee-6c85-4c77-ae2c-24a858a6ab3c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:04.117598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37855c7d-d73e-4e8f-a88b-5ee446b6cd05 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:04.118316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37855c7d-d73e-4e8f-a88b-5ee446b6cd05 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:04.118791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37855c7d-d73e-4e8f-a88b-5ee446b6cd05 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:04.119232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37855c7d-d73e-4e8f-a88b-5ee446b6cd05 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:04.120033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d2c00ee-6c85-4c77-ae2c-24a858a6ab3c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:04.123770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d2c00ee-6c85-4c77-ae2c-24a858a6ab3c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:04.124579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d2c00ee-6c85-4c77-ae2c-24a858a6ab3c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:04.372615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-37855c7d-d73e-4e8f-a88b-5ee446b6cd05 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:04.403394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-37855c7d-d73e-4e8f-a88b-5ee446b6cd05 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:04.414306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-37855c7d-d73e-4e8f-a88b-5ee446b6cd05 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:04.416356 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-37855c7d-d73e-4e8f-a88b-5ee446b6cd05 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.332466 Aug 27 04:57:04.417741 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2329/4715] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:04 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:57:04.440651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d2c00ee-6c85-4c77-ae2c-24a858a6ab3c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:04.460177 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d2c00ee-6c85-4c77-ae2c-24a858a6ab3c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.391152 Aug 27 04:57:04.461371 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2387/4716] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:04 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:05.442532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-57a038cb-7658-4d0f-af7b-b92bd7f92258 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:05.443136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-57a038cb-7658-4d0f-af7b-b92bd7f92258 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:05.454768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57a038cb-7658-4d0f-af7b-b92bd7f92258 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:05.455260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57a038cb-7658-4d0f-af7b-b92bd7f92258 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:05.462354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57a038cb-7658-4d0f-af7b-b92bd7f92258 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:05.463385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57a038cb-7658-4d0f-af7b-b92bd7f92258 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:05.464191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57a038cb-7658-4d0f-af7b-b92bd7f92258 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:05.464815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57a038cb-7658-4d0f-af7b-b92bd7f92258 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:05.482940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b23a3933-1997-4513-8e9f-f4773a36bb15 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:05.484251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b23a3933-1997-4513-8e9f-f4773a36bb15 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:05.513179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b23a3933-1997-4513-8e9f-f4773a36bb15 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:05.514400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b23a3933-1997-4513-8e9f-f4773a36bb15 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:05.515173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b23a3933-1997-4513-8e9f-f4773a36bb15 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:05.516180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b23a3933-1997-4513-8e9f-f4773a36bb15 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:05.516936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b23a3933-1997-4513-8e9f-f4773a36bb15 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:05.519588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b23a3933-1997-4513-8e9f-f4773a36bb15 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:05.606004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-57a038cb-7658-4d0f-af7b-b92bd7f92258 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:05.617649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-57a038cb-7658-4d0f-af7b-b92bd7f92258 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:05.621508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-57a038cb-7658-4d0f-af7b-b92bd7f92258 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:05.623772 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-57a038cb-7658-4d0f-af7b-b92bd7f92258 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.186034 Aug 27 04:57:05.625152 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2330/4717] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:05 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:05.820208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b23a3933-1997-4513-8e9f-f4773a36bb15 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:05.832110 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b23a3933-1997-4513-8e9f-f4773a36bb15 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.354312 Aug 27 04:57:05.834043 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2388/4718] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:05 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:06.650118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b5643a05-8efc-4b58-aab1-164ba6e35379 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:06.651351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b5643a05-8efc-4b58-aab1-164ba6e35379 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:06.671279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5643a05-8efc-4b58-aab1-164ba6e35379 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:06.675174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5643a05-8efc-4b58-aab1-164ba6e35379 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:06.677528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5643a05-8efc-4b58-aab1-164ba6e35379 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:06.682727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5643a05-8efc-4b58-aab1-164ba6e35379 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:06.683740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5643a05-8efc-4b58-aab1-164ba6e35379 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:06.691775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5643a05-8efc-4b58-aab1-164ba6e35379 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:06.858958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b480654d-b1e3-4e36-a9bd-1268cc82ebbc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:06.859591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b480654d-b1e3-4e36-a9bd-1268cc82ebbc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:06.879281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b480654d-b1e3-4e36-a9bd-1268cc82ebbc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:06.880587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b480654d-b1e3-4e36-a9bd-1268cc82ebbc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:06.888422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b480654d-b1e3-4e36-a9bd-1268cc82ebbc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:06.889356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b480654d-b1e3-4e36-a9bd-1268cc82ebbc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:06.890087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b480654d-b1e3-4e36-a9bd-1268cc82ebbc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:06.891618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b480654d-b1e3-4e36-a9bd-1268cc82ebbc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:06.900930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b5643a05-8efc-4b58-aab1-164ba6e35379 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:06.918302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b5643a05-8efc-4b58-aab1-164ba6e35379 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:06.925617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b5643a05-8efc-4b58-aab1-164ba6e35379 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:06.926993 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b5643a05-8efc-4b58-aab1-164ba6e35379 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.281851 Aug 27 04:57:06.927592 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2331/4719] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:06 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:07.223008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b480654d-b1e3-4e36-a9bd-1268cc82ebbc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:07.231174 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b480654d-b1e3-4e36-a9bd-1268cc82ebbc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.377348 Aug 27 04:57:07.237140 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2389/4720] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:06 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:07.970579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b14b924a-4f6d-4a93-9f43-73f3894396f3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:07.971191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b14b924a-4f6d-4a93-9f43-73f3894396f3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:07.999266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:08.021394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b14b924a-4f6d-4a93-9f43-73f3894396f3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:08.021394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b14b924a-4f6d-4a93-9f43-73f3894396f3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:08.021622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b14b924a-4f6d-4a93-9f43-73f3894396f3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:08.022472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b14b924a-4f6d-4a93-9f43-73f3894396f3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:08.030595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b14b924a-4f6d-4a93-9f43-73f3894396f3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:08.031027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b14b924a-4f6d-4a93-9f43-73f3894396f3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:08.197925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b14b924a-4f6d-4a93-9f43-73f3894396f3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:08.215998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b14b924a-4f6d-4a93-9f43-73f3894396f3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:08.222513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b14b924a-4f6d-4a93-9f43-73f3894396f3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:08.224432 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b14b924a-4f6d-4a93-9f43-73f3894396f3 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.277040 Aug 27 04:57:08.227686 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2332/4721] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:07 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:08.261823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56fe5486-d724-430a-a199-8c125eacf286 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:08.263335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-56fe5486-d724-430a-a199-8c125eacf286 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:08.306146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:08.312484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56fe5486-d724-430a-a199-8c125eacf286 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:08.314427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56fe5486-d724-430a-a199-8c125eacf286 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:08.318946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56fe5486-d724-430a-a199-8c125eacf286 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:08.320070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56fe5486-d724-430a-a199-8c125eacf286 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:08.321379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56fe5486-d724-430a-a199-8c125eacf286 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:08.324301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56fe5486-d724-430a-a199-8c125eacf286 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:08.655750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-56fe5486-d724-430a-a199-8c125eacf286 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:08.667526 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-56fe5486-d724-430a-a199-8c125eacf286 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.413822 Aug 27 04:57:08.668144 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2390/4722] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:08 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:09.254051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-80e19f16-2b97-478c-883e-8306c9cefe4d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:09.255290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-80e19f16-2b97-478c-883e-8306c9cefe4d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:09.271313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80e19f16-2b97-478c-883e-8306c9cefe4d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:09.271696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80e19f16-2b97-478c-883e-8306c9cefe4d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:09.280236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80e19f16-2b97-478c-883e-8306c9cefe4d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:09.281335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80e19f16-2b97-478c-883e-8306c9cefe4d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:09.281991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80e19f16-2b97-478c-883e-8306c9cefe4d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:09.282666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80e19f16-2b97-478c-883e-8306c9cefe4d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:09.386444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-80e19f16-2b97-478c-883e-8306c9cefe4d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:09.406152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-80e19f16-2b97-478c-883e-8306c9cefe4d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:09.408345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-80e19f16-2b97-478c-883e-8306c9cefe4d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:09.409913 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-80e19f16-2b97-478c-883e-8306c9cefe4d tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.161919 Aug 27 04:57:09.410978 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2333/4723] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:09 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:09.691126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20919658-ecd4-4a6c-8131-7d1ef9ed46dc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:09.691752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20919658-ecd4-4a6c-8131-7d1ef9ed46dc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:09.725887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20919658-ecd4-4a6c-8131-7d1ef9ed46dc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:09.726394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20919658-ecd4-4a6c-8131-7d1ef9ed46dc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:09.726840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20919658-ecd4-4a6c-8131-7d1ef9ed46dc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:09.727565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20919658-ecd4-4a6c-8131-7d1ef9ed46dc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:09.728034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20919658-ecd4-4a6c-8131-7d1ef9ed46dc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:09.749296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20919658-ecd4-4a6c-8131-7d1ef9ed46dc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:10.089453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-20919658-ecd4-4a6c-8131-7d1ef9ed46dc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:10.106523 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20919658-ecd4-4a6c-8131-7d1ef9ed46dc tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.420025 Aug 27 04:57:10.121307 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2391/4724] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:09 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:10.438666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3efe4b1a-23bc-41be-9b31-36b64fff92c4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:10.441804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3efe4b1a-23bc-41be-9b31-36b64fff92c4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:10.455149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3efe4b1a-23bc-41be-9b31-36b64fff92c4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:10.456493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3efe4b1a-23bc-41be-9b31-36b64fff92c4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:10.457801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3efe4b1a-23bc-41be-9b31-36b64fff92c4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:10.458892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3efe4b1a-23bc-41be-9b31-36b64fff92c4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:10.459634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3efe4b1a-23bc-41be-9b31-36b64fff92c4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:10.460590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3efe4b1a-23bc-41be-9b31-36b64fff92c4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:10.562485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3efe4b1a-23bc-41be-9b31-36b64fff92c4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:10.573988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3efe4b1a-23bc-41be-9b31-36b64fff92c4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:10.575439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3efe4b1a-23bc-41be-9b31-36b64fff92c4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:10.576705 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3efe4b1a-23bc-41be-9b31-36b64fff92c4 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.144933 Aug 27 04:57:10.578307 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2334/4725] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:10 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:11.130056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3da05aa4-f591-4899-b3c2-b4e3c4b1aeb6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:11.131314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3da05aa4-f591-4899-b3c2-b4e3c4b1aeb6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:11.140025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3da05aa4-f591-4899-b3c2-b4e3c4b1aeb6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:11.149310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3da05aa4-f591-4899-b3c2-b4e3c4b1aeb6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:11.150033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3da05aa4-f591-4899-b3c2-b4e3c4b1aeb6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:11.152434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3da05aa4-f591-4899-b3c2-b4e3c4b1aeb6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:11.161278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3da05aa4-f591-4899-b3c2-b4e3c4b1aeb6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:11.166112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3da05aa4-f591-4899-b3c2-b4e3c4b1aeb6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:11.599930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53a14895-7214-4da8-b9e5-89ac65631cc2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:11.601636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-53a14895-7214-4da8-b9e5-89ac65631cc2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:11.615578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a14895-7214-4da8-b9e5-89ac65631cc2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:11.625763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a14895-7214-4da8-b9e5-89ac65631cc2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:11.626545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a14895-7214-4da8-b9e5-89ac65631cc2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:11.630468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a14895-7214-4da8-b9e5-89ac65631cc2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:11.641633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a14895-7214-4da8-b9e5-89ac65631cc2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:11.642551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53a14895-7214-4da8-b9e5-89ac65631cc2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:11.878713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53a14895-7214-4da8-b9e5-89ac65631cc2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:11.888763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53a14895-7214-4da8-b9e5-89ac65631cc2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:11.910841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53a14895-7214-4da8-b9e5-89ac65631cc2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:11.915701 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-53a14895-7214-4da8-b9e5-89ac65631cc2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.316862 Aug 27 04:57:11.937857 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2335/4726] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:11 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:12.026192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3da05aa4-f591-4899-b3c2-b4e3c4b1aeb6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:12.035240 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3da05aa4-f591-4899-b3c2-b4e3c4b1aeb6 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.909221 Aug 27 04:57:12.035862 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2392/4727] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:11 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:12.941974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8cbe09c2-b419-4a89-a27c-4fb2caf7a3c2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:12.942571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8cbe09c2-b419-4a89-a27c-4fb2caf7a3c2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:12.954685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cbe09c2-b419-4a89-a27c-4fb2caf7a3c2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:12.955185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cbe09c2-b419-4a89-a27c-4fb2caf7a3c2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:12.955628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cbe09c2-b419-4a89-a27c-4fb2caf7a3c2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:12.957906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cbe09c2-b419-4a89-a27c-4fb2caf7a3c2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:12.958542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cbe09c2-b419-4a89-a27c-4fb2caf7a3c2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:12.958993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cbe09c2-b419-4a89-a27c-4fb2caf7a3c2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:13.062243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e0cd2727-4c56-43cf-bad0-e965eccdf0ea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:13.062834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e0cd2727-4c56-43cf-bad0-e965eccdf0ea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:13.073389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8cbe09c2-b419-4a89-a27c-4fb2caf7a3c2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:13.080784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0cd2727-4c56-43cf-bad0-e965eccdf0ea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:13.087302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8cbe09c2-b419-4a89-a27c-4fb2caf7a3c2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:13.088173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0cd2727-4c56-43cf-bad0-e965eccdf0ea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:13.088658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0cd2727-4c56-43cf-bad0-e965eccdf0ea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:13.089502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0cd2727-4c56-43cf-bad0-e965eccdf0ea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:13.089969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0cd2727-4c56-43cf-bad0-e965eccdf0ea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:13.090397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0cd2727-4c56-43cf-bad0-e965eccdf0ea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:13.090919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8cbe09c2-b419-4a89-a27c-4fb2caf7a3c2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:13.093692 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8cbe09c2-b419-4a89-a27c-4fb2caf7a3c2 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.156086 Aug 27 04:57:13.094923 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2336/4728] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:12 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:13.551986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e0cd2727-4c56-43cf-bad0-e965eccdf0ea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:13.564818 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e0cd2727-4c56-43cf-bad0-e965eccdf0ea tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.507149 Aug 27 04:57:13.583825 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2393/4729] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:13 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:14.123417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-74748e4d-0261-487c-be0d-d2d9237faab6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:14.124212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-74748e4d-0261-487c-be0d-d2d9237faab6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:14.142154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74748e4d-0261-487c-be0d-d2d9237faab6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:14.143081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74748e4d-0261-487c-be0d-d2d9237faab6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:14.145255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74748e4d-0261-487c-be0d-d2d9237faab6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:14.161376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74748e4d-0261-487c-be0d-d2d9237faab6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:14.162585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74748e4d-0261-487c-be0d-d2d9237faab6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:14.163377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74748e4d-0261-487c-be0d-d2d9237faab6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:14.386327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-74748e4d-0261-487c-be0d-d2d9237faab6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:14.431553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-74748e4d-0261-487c-be0d-d2d9237faab6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:14.433427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-74748e4d-0261-487c-be0d-d2d9237faab6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:14.445966 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-74748e4d-0261-487c-be0d-d2d9237faab6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.327449 Aug 27 04:57:14.453351 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2337/4730] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:14 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:14.592485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-528ab952-c9fc-453d-af0a-8ec720755e55 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:14.593192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-528ab952-c9fc-453d-af0a-8ec720755e55 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:14.605801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-528ab952-c9fc-453d-af0a-8ec720755e55 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:14.606310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-528ab952-c9fc-453d-af0a-8ec720755e55 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:14.606761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-528ab952-c9fc-453d-af0a-8ec720755e55 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:14.608056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-528ab952-c9fc-453d-af0a-8ec720755e55 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:14.608521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-528ab952-c9fc-453d-af0a-8ec720755e55 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:14.608986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-528ab952-c9fc-453d-af0a-8ec720755e55 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:15.145428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-528ab952-c9fc-453d-af0a-8ec720755e55 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:15.155256 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-528ab952-c9fc-453d-af0a-8ec720755e55 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.567616 Aug 27 04:57:15.158293 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2394/4731] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:14 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:15.489213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-87419b81-24fa-4ef0-a00b-6a45e8808db9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:15.490410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-87419b81-24fa-4ef0-a00b-6a45e8808db9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:15.505627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87419b81-24fa-4ef0-a00b-6a45e8808db9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:15.506539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87419b81-24fa-4ef0-a00b-6a45e8808db9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:15.507305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87419b81-24fa-4ef0-a00b-6a45e8808db9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:15.518448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87419b81-24fa-4ef0-a00b-6a45e8808db9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:15.522965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87419b81-24fa-4ef0-a00b-6a45e8808db9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:15.523580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87419b81-24fa-4ef0-a00b-6a45e8808db9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:15.689921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-87419b81-24fa-4ef0-a00b-6a45e8808db9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:15.706302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-87419b81-24fa-4ef0-a00b-6a45e8808db9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:15.711409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-87419b81-24fa-4ef0-a00b-6a45e8808db9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:15.713810 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-87419b81-24fa-4ef0-a00b-6a45e8808db9 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.241221 Aug 27 04:57:15.719614 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2338/4732] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:15 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:16.180570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f319de24-fa37-439b-aabf-e9d0b9c68af4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:16.181190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f319de24-fa37-439b-aabf-e9d0b9c68af4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:16.205137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f319de24-fa37-439b-aabf-e9d0b9c68af4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:16.205650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f319de24-fa37-439b-aabf-e9d0b9c68af4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:16.208088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f319de24-fa37-439b-aabf-e9d0b9c68af4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:16.212026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f319de24-fa37-439b-aabf-e9d0b9c68af4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:16.212761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f319de24-fa37-439b-aabf-e9d0b9c68af4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:16.213410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f319de24-fa37-439b-aabf-e9d0b9c68af4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:16.743958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2b234d53-e9e3-4869-bcbf-7f917a7e61ca tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:16.744570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2b234d53-e9e3-4869-bcbf-7f917a7e61ca tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:16.769104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b234d53-e9e3-4869-bcbf-7f917a7e61ca tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:16.774806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b234d53-e9e3-4869-bcbf-7f917a7e61ca tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:16.775677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b234d53-e9e3-4869-bcbf-7f917a7e61ca tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:16.781110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b234d53-e9e3-4869-bcbf-7f917a7e61ca tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:16.785178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b234d53-e9e3-4869-bcbf-7f917a7e61ca tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:16.786076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b234d53-e9e3-4869-bcbf-7f917a7e61ca tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:16.968627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2b234d53-e9e3-4869-bcbf-7f917a7e61ca tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:16.981389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2b234d53-e9e3-4869-bcbf-7f917a7e61ca tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:16.983726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2b234d53-e9e3-4869-bcbf-7f917a7e61ca tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:16.985156 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2b234d53-e9e3-4869-bcbf-7f917a7e61ca tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1605 microversion: 2.32 time: 0.246464 Aug 27 04:57:16.986272 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2339/4733] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:16 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1605 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:57:17.139969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f319de24-fa37-439b-aabf-e9d0b9c68af4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:17.148002 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f319de24-fa37-439b-aabf-e9d0b9c68af4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.973593 Aug 27 04:57:17.148638 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2395/4734] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:16 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:18.011756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:18.013855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:18.032635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:18.037260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:18.040268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:18.043170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:18.046347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:18.047065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:18.119463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:18.171229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0425dbb1-5b09-4885-8738-36c5a606c873 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:18.171995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0425dbb1-5b09-4885-8738-36c5a606c873 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:18.190527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0425dbb1-5b09-4885-8738-36c5a606c873 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:18.193474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0425dbb1-5b09-4885-8738-36c5a606c873 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:18.194698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0425dbb1-5b09-4885-8738-36c5a606c873 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:18.194874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0425dbb1-5b09-4885-8738-36c5a606c873 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:18.195301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0425dbb1-5b09-4885-8738-36c5a606c873 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:18.200689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0425dbb1-5b09-4885-8738-36c5a606c873 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:18.214721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:18.221975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:18.223924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:18.226105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lazy-loading 'fault' on Instance uuid 4a81b44d-9499-46a5-b0ba-367b61b33999 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:57:18.368478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:18.383565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:18.393775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5a9d453b9894b15b3ce0ed9613617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ab30a8d5fa4da892b06bc09b00d56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:18.402117 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b524b4a2-cf8d-40b6-b9c2-e6afb7f25934 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 200 len: 1610 microversion: 2.32 time: 0.396363 Aug 27 04:57:18.426215 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2340/4735] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:18 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 1610 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:57:18.933902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0425dbb1-5b09-4885-8738-36c5a606c873 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:18.948648 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0425dbb1-5b09-4885-8738-36c5a606c873 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.782604 Aug 27 04:57:18.953221 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2396/4736] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:18 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:19.437178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ff7db000-4426-4931-8a8b-a295bc4254d6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:19.441406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ff7db000-4426-4931-8a8b-a295bc4254d6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:19.469923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff7db000-4426-4931-8a8b-a295bc4254d6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:19.471093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff7db000-4426-4931-8a8b-a295bc4254d6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:19.472864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff7db000-4426-4931-8a8b-a295bc4254d6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:19.487217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff7db000-4426-4931-8a8b-a295bc4254d6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:19.488179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff7db000-4426-4931-8a8b-a295bc4254d6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:19.488667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff7db000-4426-4931-8a8b-a295bc4254d6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:19.576326 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-ff7db000-4426-4931-8a8b-a295bc4254d6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] HTTP exception thrown: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ff7db000-4426-4931-8a8b-a295bc4254d6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Request method failure captured: Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 HTTP/1.1 Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaKDD9u6K_ZhFNVk8nIKehamtLV3Xz1sV7x7i9vuapezDh8NxSwAE_Xhu_gcz5X3SdHiTbWmt6O-u1EEaX0d-x8ai08PME6AwpHP3LyExEtGWkWpjoYVIvk8Q-3OjDhvw6tmMcuYs2mB91g9WjZvbep4SmUYzAOA_WVGzi9U_8svspw Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 26ab30a8d5fa4da892b06bc09b00d56b Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TaggedBootDevicesTest-1308978328 Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26ab30a8d5fa4da892b06bc09b00d56b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_26ab30a8d5fa4da892b06bc09b00d56b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/26ab30a8d5fa4da892b06bc09b00d56b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26ab30a8d5fa4da892b06bc09b00d56b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TaggedBootDevicesTest-1308978328 Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 26ab30a8d5fa4da892b06bc09b00d56b Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1308978328 Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TaggedBootDevicesTest-1308978328-project Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: c5a9d453b9894b15b3ce0ed9613617b0 Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TaggedBootDevicesTest-1308978328-project Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '4a81b44d-9499-46a5-b0ba-367b61b33999'} Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:57:19.578533 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:19.584276 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:57:19.584276 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:19.584276 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:19.584276 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:19.584276 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:19.584276 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:19.584276 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:19.584276 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:57:19.585336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ff7db000-4426-4931-8a8b-a295bc4254d6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Returning 404 to user: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:19.586433 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ff7db000-4426-4931-8a8b-a295bc4254d6 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 404 len: 111 microversion: 2.32 time: 0.156752 Aug 27 04:57:19.589999 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2341/4737] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:19 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:57:19.601473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-174f15c2-ca84-4f31-b58b-9d614e0d0e02 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '.version_select at 0x7f1f218f3940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:19.676835 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-174f15c2-ca84-4f31-b58b-9d614e0d0e02 tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760453593" status: 204 len: 0 microversion: 2.32 time: 0.080957 Aug 27 04:57:19.691707 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2397/4738] 10.222.0.79 () {60 vars in 1262 bytes} [Sat Aug 27 04:57:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760453593 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:57:19.979092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ccafb959-b5d2-45ed-ad9b-968b2ae0efba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:19.979926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ccafb959-b5d2-45ed-ad9b-968b2ae0efba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:19.997819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccafb959-b5d2-45ed-ad9b-968b2ae0efba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:20.000286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccafb959-b5d2-45ed-ad9b-968b2ae0efba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:20.002634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccafb959-b5d2-45ed-ad9b-968b2ae0efba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:20.005099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccafb959-b5d2-45ed-ad9b-968b2ae0efba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:20.010461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccafb959-b5d2-45ed-ad9b-968b2ae0efba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:20.011001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccafb959-b5d2-45ed-ad9b-968b2ae0efba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:20.499406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ccafb959-b5d2-45ed-ad9b-968b2ae0efba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:20.518861 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ccafb959-b5d2-45ed-ad9b-968b2ae0efba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1527 microversion: 2.1 time: 0.544108 Aug 27 04:57:20.519479 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2342/4739] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:19 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1527 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:21.544440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f4d4682-0cc1-4788-88ce-0c646b2cf654 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:21.545218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f4d4682-0cc1-4788-88ce-0c646b2cf654 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:21.560943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f4d4682-0cc1-4788-88ce-0c646b2cf654 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:21.570415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f4d4682-0cc1-4788-88ce-0c646b2cf654 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:21.571935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f4d4682-0cc1-4788-88ce-0c646b2cf654 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:21.577507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f4d4682-0cc1-4788-88ce-0c646b2cf654 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:21.582000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f4d4682-0cc1-4788-88ce-0c646b2cf654 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:21.584775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f4d4682-0cc1-4788-88ce-0c646b2cf654 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:21.683134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:22.109127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f4d4682-0cc1-4788-88ce-0c646b2cf654 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:22.118985 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f4d4682-0cc1-4788-88ce-0c646b2cf654 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1509 microversion: 2.1 time: 0.580561 Aug 27 04:57:22.133359 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2398/4740] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:21 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1509 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:23.147576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7fd54e9b-5cb0-4f4f-afe6-e54643bdb6c4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:23.149218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7fd54e9b-5cb0-4f4f-afe6-e54643bdb6c4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:23.163478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fd54e9b-5cb0-4f4f-afe6-e54643bdb6c4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:23.163988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fd54e9b-5cb0-4f4f-afe6-e54643bdb6c4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:23.164433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fd54e9b-5cb0-4f4f-afe6-e54643bdb6c4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:23.165190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fd54e9b-5cb0-4f4f-afe6-e54643bdb6c4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:23.165683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fd54e9b-5cb0-4f4f-afe6-e54643bdb6c4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:23.176192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7fd54e9b-5cb0-4f4f-afe6-e54643bdb6c4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:23.716234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7fd54e9b-5cb0-4f4f-afe6-e54643bdb6c4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:23.728697 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7fd54e9b-5cb0-4f4f-afe6-e54643bdb6c4 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1509 microversion: 2.1 time: 0.582728 Aug 27 04:57:23.735143 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2343/4741] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:23 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1509 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:24.221545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3881c969-31df-4405-a30d-a848a17757c9 req-4b9d210b-94d6-47be-a1c1-8d4ed84cb2ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228b4767-bbe2-41d0-a7d4-a6670e79043f", "name": "network-vif-unplugged", "status": "completed", "tag": "1b95ce59-5e34-4673-9606-3f53d8d7b9d1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:24.307723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3881c969-31df-4405-a30d-a848a17757c9 req-4b9d210b-94d6-47be-a1c1-8d4ed84cb2ee service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:24.308216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3881c969-31df-4405-a30d-a848a17757c9 req-4b9d210b-94d6-47be-a1c1-8d4ed84cb2ee service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:24.316099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3881c969-31df-4405-a30d-a848a17757c9 req-4b9d210b-94d6-47be-a1c1-8d4ed84cb2ee service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:24.397660 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3881c969-31df-4405-a30d-a848a17757c9 req-4b9d210b-94d6-47be-a1c1-8d4ed84cb2ee service nova] Creating event network-vif-unplugged:1b95ce59-5e34-4673-9606-3f53d8d7b9d1 for instance 228b4767-bbe2-41d0-a7d4-a6670e79043f on n-h2-854823-1 Aug 27 04:57:24.428616 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3881c969-31df-4405-a30d-a848a17757c9 req-4b9d210b-94d6-47be-a1c1-8d4ed84cb2ee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.210869 Aug 27 04:57:24.434279 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2399/4742] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:24.758680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0bb54c72-20fa-40c6-9368-1f909bc5f752 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:24.759496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0bb54c72-20fa-40c6-9368-1f909bc5f752 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:24.791015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bb54c72-20fa-40c6-9368-1f909bc5f752 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:24.792117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bb54c72-20fa-40c6-9368-1f909bc5f752 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:24.812643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bb54c72-20fa-40c6-9368-1f909bc5f752 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:24.824356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bb54c72-20fa-40c6-9368-1f909bc5f752 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:24.838736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bb54c72-20fa-40c6-9368-1f909bc5f752 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:24.841415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bb54c72-20fa-40c6-9368-1f909bc5f752 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:25.536899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0bb54c72-20fa-40c6-9368-1f909bc5f752 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:25.554626 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0bb54c72-20fa-40c6-9368-1f909bc5f752 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1512 microversion: 2.1 time: 0.799785 Aug 27 04:57:25.584371 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2344/4743] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:24 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1512 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:25.609128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e89bb696-f21b-497b-af98-64b227cfa5ae tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:25.609834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e89bb696-f21b-497b-af98-64b227cfa5ae tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:25.624761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1979480769", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "77cdadc0-f358-49f3-a113-47b84e61cba9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b9321d5-af89-499e-b147-430b2ec333ca"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:25.628229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e89bb696-f21b-497b-af98-64b227cfa5ae tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:25.633571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e89bb696-f21b-497b-af98-64b227cfa5ae tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:25.634086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e89bb696-f21b-497b-af98-64b227cfa5ae tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:25.634839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e89bb696-f21b-497b-af98-64b227cfa5ae tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:25.635312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e89bb696-f21b-497b-af98-64b227cfa5ae tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:25.638070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e89bb696-f21b-497b-af98-64b227cfa5ae tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:25.767530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] validate_networks() for [('0b9321d5-af89-499e-b147-430b2ec333ca', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:57:26.079721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e89bb696-f21b-497b-af98-64b227cfa5ae tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:26.121174 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e89bb696-f21b-497b-af98-64b227cfa5ae tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1452 microversion: 2.1 time: 0.518755 Aug 27 04:57:26.126870 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2400/4744] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:25 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1452 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:26.214054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03607cb2-b73a-43c2-a9eb-1689115fafc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:26.214613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03607cb2-b73a-43c2-a9eb-1689115fafc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:26.233516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03607cb2-b73a-43c2-a9eb-1689115fafc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:26.234173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03607cb2-b73a-43c2-a9eb-1689115fafc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:26.234727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03607cb2-b73a-43c2-a9eb-1689115fafc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:26.235549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03607cb2-b73a-43c2-a9eb-1689115fafc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:26.236125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03607cb2-b73a-43c2-a9eb-1689115fafc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:26.236693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03607cb2-b73a-43c2-a9eb-1689115fafc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:26.287553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-03607cb2-b73a-43c2-a9eb-1689115fafc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lazy-loading 'flavor' on Instance uuid 228b4767-bbe2-41d0-a7d4-a6670e79043f {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:57:26.313345 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-03607cb2-b73a-43c2-a9eb-1689115fafc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Cannot 'shelve' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state shelved_offloaded Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03607cb2-b73a-43c2-a9eb-1689115fafc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action HTTP/1.1 Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 14 Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: {"shelve": {}} Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: exception: Cannot 'shelve' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state shelved_offloaded Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '228b4767-bbe2-41d0-a7d4-a6670e79043f', 'body': {'shelve': {}}} Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 228b4767-bbe2-41d0-a7d4-a6670e79043f in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:57:26.315844 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:57:26.320440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state shelved_offloaded Aug 27 04:57:26.320440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:57:26.320440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:26.320440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:57:26.320440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:26.320440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:26.320440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:26.320440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:26.320440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:26.320440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state shelved_offloaded Aug 27 04:57:26.320440 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:57:26.322374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03607cb2-b73a-43c2-a9eb-1689115fafc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 409 to user: Cannot 'shelve' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state shelved_offloaded {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:26.324332 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03607cb2-b73a-43c2-a9eb-1689115fafc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action" status: 409 len: 155 microversion: 2.1 time: 0.132123 Aug 27 04:57:26.329405 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2401/4745] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:57:26 2022] POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action => generated 155 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 04:57:26.346159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8397fc8-9290-4525-8a28-40ae2bf1a594 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:26.351407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a8397fc8-9290-4525-8a28-40ae2bf1a594 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:26.364157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8397fc8-9290-4525-8a28-40ae2bf1a594 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:26.367430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8397fc8-9290-4525-8a28-40ae2bf1a594 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:26.368067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8397fc8-9290-4525-8a28-40ae2bf1a594 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:26.369275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8397fc8-9290-4525-8a28-40ae2bf1a594 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:26.369949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8397fc8-9290-4525-8a28-40ae2bf1a594 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:26.370619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8397fc8-9290-4525-8a28-40ae2bf1a594 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:26.503670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a8397fc8-9290-4525-8a28-40ae2bf1a594 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128869) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 04:57:26.702647 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8397fc8-9290-4525-8a28-40ae2bf1a594 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action" status: 202 len: 0 microversion: 2.1 time: 0.364417 Aug 27 04:57:26.710285 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2402/4746] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:57:26 2022] POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:26.730151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5fdec85-25c4-4484-bf05-0ae30bc726a5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:26.751014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5fdec85-25c4-4484-bf05-0ae30bc726a5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:26.802869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5fdec85-25c4-4484-bf05-0ae30bc726a5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:26.806138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5fdec85-25c4-4484-bf05-0ae30bc726a5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:26.807124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5fdec85-25c4-4484-bf05-0ae30bc726a5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:26.812177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5fdec85-25c4-4484-bf05-0ae30bc726a5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:26.816585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5fdec85-25c4-4484-bf05-0ae30bc726a5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:26.817172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5fdec85-25c4-4484-bf05-0ae30bc726a5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:27.288924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f5fdec85-25c4-4484-bf05-0ae30bc726a5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:27.314571 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5fdec85-25c4-4484-bf05-0ae30bc726a5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1460 microversion: 2.1 time: 0.598613 Aug 27 04:57:27.317855 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2403/4747] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:26 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1460 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:27.452436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:57:27.453073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:57:27.454462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:57:27.454997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:57:27.457431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:57:27.522085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:27.529730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:27.537642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:27.547694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:27.548275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:27.557597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:27.699788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:57:27.762475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for user 8376c4e2cf814a8b8b1e2a8e404b0187 and project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:57:28.047386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:57:28.050055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77cdadc0-f358-49f3-a113-47b84e61cba9',volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:57:28.340558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2303a4f-a724-48ef-9a25-6cf2763bd39b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:28.342003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2303a4f-a724-48ef-9a25-6cf2763bd39b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:28.364314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2303a4f-a724-48ef-9a25-6cf2763bd39b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:28.364860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2303a4f-a724-48ef-9a25-6cf2763bd39b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:28.377209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2303a4f-a724-48ef-9a25-6cf2763bd39b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:28.378003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2303a4f-a724-48ef-9a25-6cf2763bd39b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:28.378491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2303a4f-a724-48ef-9a25-6cf2763bd39b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:28.378929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2303a4f-a724-48ef-9a25-6cf2763bd39b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:28.991282 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-47e1204b-5637-4c75-b6d3-61981fb002d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.373715 Aug 27 04:57:28.996504 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2345/4748] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:57:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:57:29.020993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-740ac395-6d58-45af-a425-28b18d083ab6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:29.054140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-740ac395-6d58-45af-a425-28b18d083ab6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:29.054652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-740ac395-6d58-45af-a425-28b18d083ab6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:29.055123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-740ac395-6d58-45af-a425-28b18d083ab6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:29.058176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b2303a4f-a724-48ef-9a25-6cf2763bd39b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:29.066850 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2303a4f-a724-48ef-9a25-6cf2763bd39b tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1460 microversion: 2.1 time: 0.731179 Aug 27 04:57:29.067458 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2404/4749] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:28 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1460 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:29.136784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e9395d9-3321-4ec7-ac81-c97a36d69aae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:29.137669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e9395d9-3321-4ec7-ac81-c97a36d69aae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:29.394039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e9395d9-3321-4ec7-ac81-c97a36d69aae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:29.402490 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e9395d9-3321-4ec7-ac81-c97a36d69aae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1057 microversion: 2.1 time: 0.293572 Aug 27 04:57:29.406148 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2405/4750] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:29 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1057 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:29.485530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-740ac395-6d58-45af-a425-28b18d083ab6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Going to try to stop instance {{(pid=128870) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 04:57:29.683569 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-740ac395-6d58-45af-a425-28b18d083ab6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "POST /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/action" status: 202 len: 0 microversion: 2.1 time: 0.684787 Aug 27 04:57:29.689342 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2346/4751] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:57:28 2022] POST /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:57:29.701213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42efeef8-258c-4d06-931c-5252a34a9532 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:29.702050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-42efeef8-258c-4d06-931c-5252a34a9532 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:29.732419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42efeef8-258c-4d06-931c-5252a34a9532 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:29.743640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42efeef8-258c-4d06-931c-5252a34a9532 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:29.748227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42efeef8-258c-4d06-931c-5252a34a9532 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:29.750944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42efeef8-258c-4d06-931c-5252a34a9532 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:29.751505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42efeef8-258c-4d06-931c-5252a34a9532 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:29.753665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42efeef8-258c-4d06-931c-5252a34a9532 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:30.094653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-444e1d6a-d99e-4b27-bf3a-0bf04ba437f7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:30.095299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-444e1d6a-d99e-4b27-bf3a-0bf04ba437f7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:30.113367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-444e1d6a-d99e-4b27-bf3a-0bf04ba437f7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:30.114328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-444e1d6a-d99e-4b27-bf3a-0bf04ba437f7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:30.114328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-444e1d6a-d99e-4b27-bf3a-0bf04ba437f7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:30.119289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-444e1d6a-d99e-4b27-bf3a-0bf04ba437f7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:30.121064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-444e1d6a-d99e-4b27-bf3a-0bf04ba437f7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:30.121754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-444e1d6a-d99e-4b27-bf3a-0bf04ba437f7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:30.152776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-42efeef8-258c-4d06-931c-5252a34a9532 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:30.171999 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42efeef8-258c-4d06-931c-5252a34a9532 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1720 microversion: 2.1 time: 0.477632 Aug 27 04:57:30.174405 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2406/4752] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:29 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1720 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:30.428612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0db0d84d-d42c-4dc0-87b9-dc2915bbbc94 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:30.429432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0db0d84d-d42c-4dc0-87b9-dc2915bbbc94 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:30.468118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0db0d84d-d42c-4dc0-87b9-dc2915bbbc94 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:30.471612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0db0d84d-d42c-4dc0-87b9-dc2915bbbc94 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:30.472074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0db0d84d-d42c-4dc0-87b9-dc2915bbbc94 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:30.496888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0db0d84d-d42c-4dc0-87b9-dc2915bbbc94 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:30.508672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0db0d84d-d42c-4dc0-87b9-dc2915bbbc94 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:30.513101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0db0d84d-d42c-4dc0-87b9-dc2915bbbc94 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:30.765881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0db0d84d-d42c-4dc0-87b9-dc2915bbbc94 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:30.777223 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0db0d84d-d42c-4dc0-87b9-dc2915bbbc94 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1107 microversion: 2.1 time: 0.354490 Aug 27 04:57:30.779836 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2407/4753] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:30 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1107 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:31.201709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9eb806e6-c43a-4382-81c1-4b5b06580784 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:31.202698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9eb806e6-c43a-4382-81c1-4b5b06580784 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:31.251123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eb806e6-c43a-4382-81c1-4b5b06580784 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:31.254171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eb806e6-c43a-4382-81c1-4b5b06580784 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:31.256719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eb806e6-c43a-4382-81c1-4b5b06580784 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:31.257820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eb806e6-c43a-4382-81c1-4b5b06580784 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:31.269211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eb806e6-c43a-4382-81c1-4b5b06580784 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:31.270815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eb806e6-c43a-4382-81c1-4b5b06580784 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:31.689914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-444e1d6a-d99e-4b27-bf3a-0bf04ba437f7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:31.699059 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-444e1d6a-d99e-4b27-bf3a-0bf04ba437f7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1460 microversion: 2.1 time: 1.609784 Aug 27 04:57:31.699658 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2347/4754] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:30 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1460 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:31.705990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9eb806e6-c43a-4382-81c1-4b5b06580784 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:31.720754 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9eb806e6-c43a-4382-81c1-4b5b06580784 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1720 microversion: 2.1 time: 0.527417 Aug 27 04:57:31.721683 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2408/4755] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:31 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1720 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:31.803382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-23cae7db-386b-4ce7-9752-42add2eb729e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:31.804225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-23cae7db-386b-4ce7-9752-42add2eb729e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:31.831182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23cae7db-386b-4ce7-9752-42add2eb729e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:31.831939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23cae7db-386b-4ce7-9752-42add2eb729e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:31.839006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23cae7db-386b-4ce7-9752-42add2eb729e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:31.843733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23cae7db-386b-4ce7-9752-42add2eb729e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:31.845717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23cae7db-386b-4ce7-9752-42add2eb729e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:31.846187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23cae7db-386b-4ce7-9752-42add2eb729e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:32.043981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-350da4be-b9ad-444a-9ec8-e7748f7649cd tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:32.044660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-350da4be-b9ad-444a-9ec8-e7748f7649cd tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:32.055114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-350da4be-b9ad-444a-9ec8-e7748f7649cd tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:32.055792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-350da4be-b9ad-444a-9ec8-e7748f7649cd tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:32.056309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-350da4be-b9ad-444a-9ec8-e7748f7649cd tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:32.057896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-350da4be-b9ad-444a-9ec8-e7748f7649cd tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:32.060924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-350da4be-b9ad-444a-9ec8-e7748f7649cd tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:32.061446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-350da4be-b9ad-444a-9ec8-e7748f7649cd tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:32.078330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-23cae7db-386b-4ce7-9752-42add2eb729e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:32.103568 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-23cae7db-386b-4ce7-9752-42add2eb729e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1155 microversion: 2.1 time: 0.298707 Aug 27 04:57:32.105235 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2348/4756] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:31 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1155 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:32.124137 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-350da4be-b9ad-444a-9ec8-e7748f7649cd tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] HTTP exception thrown: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-350da4be-b9ad-444a-9ec8-e7748f7649cd tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Request method failure captured: Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 HTTP/1.1 Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaKDD9u6K_ZhFNVk8nIKehamtLV3Xz1sV7x7i9vuapezDh8NxSwAE_Xhu_gcz5X3SdHiTbWmt6O-u1EEaX0d-x8ai08PME6AwpHP3LyExEtGWkWpjoYVIvk8Q-3OjDhvw6tmMcuYs2mB91g9WjZvbep4SmUYzAOA_WVGzi9U_8svspw Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 26ab30a8d5fa4da892b06bc09b00d56b Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TaggedBootDevicesTest-1308978328 Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26ab30a8d5fa4da892b06bc09b00d56b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_26ab30a8d5fa4da892b06bc09b00d56b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/26ab30a8d5fa4da892b06bc09b00d56b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26ab30a8d5fa4da892b06bc09b00d56b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TaggedBootDevicesTest-1308978328 Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 26ab30a8d5fa4da892b06bc09b00d56b Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1308978328 Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TaggedBootDevicesTest-1308978328-project Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: c5a9d453b9894b15b3ce0ed9613617b0 Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TaggedBootDevicesTest-1308978328-project Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '4a81b44d-9499-46a5-b0ba-367b61b33999'} Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:32.125863 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:32.129732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:32.129732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.129732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:32.129732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.129732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:32.129732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:32.129732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:32.129732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:32.129732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:32.129732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:32.129732 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.160423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-350da4be-b9ad-444a-9ec8-e7748f7649cd tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Returning 404 to user: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:32.169437 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-350da4be-b9ad-444a-9ec8-e7748f7649cd tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 404 len: 111 microversion: 2.32 time: 0.128790 Aug 27 04:57:32.170075 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2409/4757] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 04:57:32 2022] DELETE /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:57:32.180053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae7c4f0c-d608-49f2-aed1-efcae418f23a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:32.180781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ae7c4f0c-d608-49f2-aed1-efcae418f23a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] [instance: 4a81b44d-9499-46a5-b0ba-367b61b33999] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:32.195420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae7c4f0c-d608-49f2-aed1-efcae418f23a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:32.197057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae7c4f0c-d608-49f2-aed1-efcae418f23a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:32.198202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae7c4f0c-d608-49f2-aed1-efcae418f23a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:32.201288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae7c4f0c-d608-49f2-aed1-efcae418f23a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:32.205731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae7c4f0c-d608-49f2-aed1-efcae418f23a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:32.206355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae7c4f0c-d608-49f2-aed1-efcae418f23a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:32.241722 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-ae7c4f0c-d608-49f2-aed1-efcae418f23a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] HTTP exception thrown: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae7c4f0c-d608-49f2-aed1-efcae418f23a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Request method failure captured: Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 HTTP/1.1 Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaKDD9u6K_ZhFNVk8nIKehamtLV3Xz1sV7x7i9vuapezDh8NxSwAE_Xhu_gcz5X3SdHiTbWmt6O-u1EEaX0d-x8ai08PME6AwpHP3LyExEtGWkWpjoYVIvk8Q-3OjDhvw6tmMcuYs2mB91g9WjZvbep4SmUYzAOA_WVGzi9U_8svspw Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 26ab30a8d5fa4da892b06bc09b00d56b Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TaggedBootDevicesTest-1308978328 Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26ab30a8d5fa4da892b06bc09b00d56b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_26ab30a8d5fa4da892b06bc09b00d56b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/26ab30a8d5fa4da892b06bc09b00d56b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26ab30a8d5fa4da892b06bc09b00d56b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TaggedBootDevicesTest-1308978328 Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 26ab30a8d5fa4da892b06bc09b00d56b Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1308978328 Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TaggedBootDevicesTest-1308978328-project Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: c5a9d453b9894b15b3ce0ed9613617b0 Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TaggedBootDevicesTest-1308978328-project Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '4a81b44d-9499-46a5-b0ba-367b61b33999'} Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.247099 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:57:32.250247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.250247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:57:32.250247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:57:32.250247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:57:32.250247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:57:32.250247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:57:32.250247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. Aug 27 04:57:32.250247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:57:32.252884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae7c4f0c-d608-49f2-aed1-efcae418f23a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] Returning 404 to user: Instance 4a81b44d-9499-46a5-b0ba-367b61b33999 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:57:32.254708 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ae7c4f0c-d608-49f2-aed1-efcae418f23a tempest-TaggedBootDevicesTest-1308978328 tempest-TaggedBootDevicesTest-1308978328-project] 10.222.0.79 "GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999" status: 404 len: 111 microversion: 2.32 time: 0.079674 Aug 27 04:57:32.255781 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2349/4758] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:57:32 2022] GET /compute/v2.1/servers/4a81b44d-9499-46a5-b0ba-367b61b33999 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:57:32.729853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13aaf14a-0bcd-4467-801e-bbf4721a7c2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:32.730844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13aaf14a-0bcd-4467-801e-bbf4721a7c2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:32.744098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13aaf14a-0bcd-4467-801e-bbf4721a7c2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:32.746521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-989e7937-e6ba-447f-8bea-dfb199124f8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:32.747504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13aaf14a-0bcd-4467-801e-bbf4721a7c2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:32.747651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-989e7937-e6ba-447f-8bea-dfb199124f8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:32.751422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13aaf14a-0bcd-4467-801e-bbf4721a7c2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:32.753823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13aaf14a-0bcd-4467-801e-bbf4721a7c2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:32.757260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13aaf14a-0bcd-4467-801e-bbf4721a7c2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:32.758042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13aaf14a-0bcd-4467-801e-bbf4721a7c2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:32.764979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-989e7937-e6ba-447f-8bea-dfb199124f8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:32.765479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-989e7937-e6ba-447f-8bea-dfb199124f8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:32.765921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-989e7937-e6ba-447f-8bea-dfb199124f8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:32.766637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-989e7937-e6ba-447f-8bea-dfb199124f8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:32.767089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-989e7937-e6ba-447f-8bea-dfb199124f8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:32.786434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-989e7937-e6ba-447f-8bea-dfb199124f8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:33.064658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13aaf14a-0bcd-4467-801e-bbf4721a7c2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:33.076232 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13aaf14a-0bcd-4467-801e-bbf4721a7c2c tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.349204 Aug 27 04:57:33.077075 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2410/4759] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:32 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:33.128672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3ab64ed2-f7b3-4277-a4a8-14ba74ccf82a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:33.129598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3ab64ed2-f7b3-4277-a4a8-14ba74ccf82a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:33.140432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ab64ed2-f7b3-4277-a4a8-14ba74ccf82a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:33.142594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ab64ed2-f7b3-4277-a4a8-14ba74ccf82a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:33.143277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ab64ed2-f7b3-4277-a4a8-14ba74ccf82a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:33.145361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ab64ed2-f7b3-4277-a4a8-14ba74ccf82a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:33.146050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ab64ed2-f7b3-4277-a4a8-14ba74ccf82a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:33.153275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ab64ed2-f7b3-4277-a4a8-14ba74ccf82a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:33.302275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3ab64ed2-f7b3-4277-a4a8-14ba74ccf82a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:33.311415 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3ab64ed2-f7b3-4277-a4a8-14ba74ccf82a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1173 microversion: 2.1 time: 0.187232 Aug 27 04:57:33.314848 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2411/4760] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:33 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1173 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:33.736616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-989e7937-e6ba-447f-8bea-dfb199124f8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:33.745385 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-989e7937-e6ba-447f-8bea-dfb199124f8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1720 microversion: 2.1 time: 1.002642 Aug 27 04:57:33.750969 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2350/4761] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:32 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1720 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:34.098050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-423765b6-1955-4b07-ace1-eb2d1f906006 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:34.098663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-423765b6-1955-4b07-ace1-eb2d1f906006 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:34.116481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423765b6-1955-4b07-ace1-eb2d1f906006 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:34.117026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423765b6-1955-4b07-ace1-eb2d1f906006 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:34.117485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423765b6-1955-4b07-ace1-eb2d1f906006 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:34.118198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423765b6-1955-4b07-ace1-eb2d1f906006 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:34.118658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423765b6-1955-4b07-ace1-eb2d1f906006 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:34.119167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423765b6-1955-4b07-ace1-eb2d1f906006 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:34.338369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-072f89b5-a933-495f-b7ec-f4cb6bf9e96a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:34.339167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-072f89b5-a933-495f-b7ec-f4cb6bf9e96a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:34.365128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-072f89b5-a933-495f-b7ec-f4cb6bf9e96a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:34.365782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-072f89b5-a933-495f-b7ec-f4cb6bf9e96a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:34.366283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-072f89b5-a933-495f-b7ec-f4cb6bf9e96a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:34.367037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-072f89b5-a933-495f-b7ec-f4cb6bf9e96a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:34.380578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-072f89b5-a933-495f-b7ec-f4cb6bf9e96a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:34.380578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-072f89b5-a933-495f-b7ec-f4cb6bf9e96a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:34.658042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-423765b6-1955-4b07-ace1-eb2d1f906006 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:34.672209 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-423765b6-1955-4b07-ace1-eb2d1f906006 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.573092 Aug 27 04:57:34.677751 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2412/4762] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:34 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:34.778610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8bb9b86-4f81-4f3a-8051-ba4853949012 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:34.779266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8bb9b86-4f81-4f3a-8051-ba4853949012 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:34.793566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bb9b86-4f81-4f3a-8051-ba4853949012 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:34.794104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bb9b86-4f81-4f3a-8051-ba4853949012 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:34.800608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bb9b86-4f81-4f3a-8051-ba4853949012 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:34.801625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bb9b86-4f81-4f3a-8051-ba4853949012 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:34.802244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bb9b86-4f81-4f3a-8051-ba4853949012 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:34.805285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bb9b86-4f81-4f3a-8051-ba4853949012 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:34.834679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-072f89b5-a933-495f-b7ec-f4cb6bf9e96a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:34.856009 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-072f89b5-a933-495f-b7ec-f4cb6bf9e96a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1173 microversion: 2.1 time: 0.520736 Aug 27 04:57:34.860798 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2351/4763] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:34 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1173 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:35.394587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d8bb9b86-4f81-4f3a-8051-ba4853949012 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:35.410734 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8bb9b86-4f81-4f3a-8051-ba4853949012 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1720 microversion: 2.1 time: 0.638148 Aug 27 04:57:35.413950 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2413/4764] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:34 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1720 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:35.714286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-333eaae1-4878-4115-be54-d663f7e616d5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:35.715027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-333eaae1-4878-4115-be54-d663f7e616d5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:35.749879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-333eaae1-4878-4115-be54-d663f7e616d5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:35.757277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-333eaae1-4878-4115-be54-d663f7e616d5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:35.758859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-333eaae1-4878-4115-be54-d663f7e616d5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:35.761287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-333eaae1-4878-4115-be54-d663f7e616d5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:35.765389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-333eaae1-4878-4115-be54-d663f7e616d5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:35.768295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-333eaae1-4878-4115-be54-d663f7e616d5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:35.885351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea8e989a-1afe-4cfa-8448-62c5f87aba50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:35.886215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea8e989a-1afe-4cfa-8448-62c5f87aba50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:35.906921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea8e989a-1afe-4cfa-8448-62c5f87aba50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:35.914415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea8e989a-1afe-4cfa-8448-62c5f87aba50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:35.921989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea8e989a-1afe-4cfa-8448-62c5f87aba50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:35.929892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea8e989a-1afe-4cfa-8448-62c5f87aba50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:35.937943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea8e989a-1afe-4cfa-8448-62c5f87aba50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:35.938433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea8e989a-1afe-4cfa-8448-62c5f87aba50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:36.515687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ea8e989a-1afe-4cfa-8448-62c5f87aba50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:36.530562 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea8e989a-1afe-4cfa-8448-62c5f87aba50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1215 microversion: 2.1 time: 0.644657 Aug 27 04:57:36.533127 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2414/4765] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:35 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1215 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:36.547643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6a8f116-8a86-4a5d-ab9a-76a9d47c4778 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:36.563537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6a8f116-8a86-4a5d-ab9a-76a9d47c4778 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:36.602958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6a8f116-8a86-4a5d-ab9a-76a9d47c4778 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:36.606606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6a8f116-8a86-4a5d-ab9a-76a9d47c4778 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:36.607079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6a8f116-8a86-4a5d-ab9a-76a9d47c4778 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:36.607831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6a8f116-8a86-4a5d-ab9a-76a9d47c4778 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:36.608299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6a8f116-8a86-4a5d-ab9a-76a9d47c4778 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:36.608763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6a8f116-8a86-4a5d-ab9a-76a9d47c4778 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:36.697584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-333eaae1-4878-4115-be54-d663f7e616d5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:36.728616 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-333eaae1-4878-4115-be54-d663f7e616d5 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 1.022763 Aug 27 04:57:36.753198 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2352/4766] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:35 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:37.195247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a6a8f116-8a86-4a5d-ab9a-76a9d47c4778 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:37.223703 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6a8f116-8a86-4a5d-ab9a-76a9d47c4778 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1720 microversion: 2.1 time: 0.679967 Aug 27 04:57:37.228816 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2415/4767] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:36 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1720 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:37.565546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59f47af8-a3d2-4934-82a9-8f1d71da335c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:37.567751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-59f47af8-a3d2-4934-82a9-8f1d71da335c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:37.615794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59f47af8-a3d2-4934-82a9-8f1d71da335c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:37.616956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59f47af8-a3d2-4934-82a9-8f1d71da335c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:37.622909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59f47af8-a3d2-4934-82a9-8f1d71da335c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:37.625459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59f47af8-a3d2-4934-82a9-8f1d71da335c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:37.629966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59f47af8-a3d2-4934-82a9-8f1d71da335c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:37.634216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59f47af8-a3d2-4934-82a9-8f1d71da335c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:37.638581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:37.758395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8c9ade6-074a-498f-8db5-b4f9e8feec6d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:37.758930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8c9ade6-074a-498f-8db5-b4f9e8feec6d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:37.789798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8c9ade6-074a-498f-8db5-b4f9e8feec6d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:37.792326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8c9ade6-074a-498f-8db5-b4f9e8feec6d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:37.794908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8c9ade6-074a-498f-8db5-b4f9e8feec6d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:37.797545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8c9ade6-074a-498f-8db5-b4f9e8feec6d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:37.799295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8c9ade6-074a-498f-8db5-b4f9e8feec6d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:37.799441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:37.800400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8c9ade6-074a-498f-8db5-b4f9e8feec6d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:37.994043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:38.629659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8c9ade6-074a-498f-8db5-b4f9e8feec6d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:38.643260 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8c9ade6-074a-498f-8db5-b4f9e8feec6d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.888788 Aug 27 04:57:38.661110 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2416/4768] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:37 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:38.674253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-61392d24-6f5a-4504-a343-2bf7f2c7313e req-c36027c4-5f1e-4677-bf16-4c133fc071c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ed4facb-b782-4d67-8f23-b527744e747f", "tag": "a6feffab-3e0f-4541-85c9-fb49c8e1ddf8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:38.694494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:38.701165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-61392d24-6f5a-4504-a343-2bf7f2c7313e req-c36027c4-5f1e-4677-bf16-4c133fc071c9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:38.702138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-61392d24-6f5a-4504-a343-2bf7f2c7313e req-c36027c4-5f1e-4677-bf16-4c133fc071c9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:38.704989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-61392d24-6f5a-4504-a343-2bf7f2c7313e req-c36027c4-5f1e-4677-bf16-4c133fc071c9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:38.770694 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-61392d24-6f5a-4504-a343-2bf7f2c7313e req-c36027c4-5f1e-4677-bf16-4c133fc071c9 service nova] Creating event network-changed:a6feffab-3e0f-4541-85c9-fb49c8e1ddf8 for instance 8ed4facb-b782-4d67-8f23-b527744e747f on n-h2-854823-1 Aug 27 04:57:38.788664 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-61392d24-6f5a-4504-a343-2bf7f2c7313e req-c36027c4-5f1e-4677-bf16-4c133fc071c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123355 Aug 27 04:57:38.806750 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2417/4769] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:38.820233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be82ff48-f8b6-4031-8b3b-67097e0fc63f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:38.900118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-be82ff48-f8b6-4031-8b3b-67097e0fc63f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:38.929142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be82ff48-f8b6-4031-8b3b-67097e0fc63f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:38.931012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be82ff48-f8b6-4031-8b3b-67097e0fc63f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:38.933202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be82ff48-f8b6-4031-8b3b-67097e0fc63f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:38.934689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be82ff48-f8b6-4031-8b3b-67097e0fc63f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:38.935183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be82ff48-f8b6-4031-8b3b-67097e0fc63f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:38.940045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be82ff48-f8b6-4031-8b3b-67097e0fc63f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:39.034098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-59f47af8-a3d2-4934-82a9-8f1d71da335c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:39.043074 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-59f47af8-a3d2-4934-82a9-8f1d71da335c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1215 microversion: 2.1 time: 1.488109 Aug 27 04:57:39.061231 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2353/4770] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:37 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1215 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:39.398048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:39.623599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be82ff48-f8b6-4031-8b3b-67097e0fc63f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:39.647324 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be82ff48-f8b6-4031-8b3b-67097e0fc63f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1720 microversion: 2.1 time: 0.838515 Aug 27 04:57:39.650748 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2418/4771] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:38 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1720 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:39.682105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a6ce74fd-16b5-4e65-a12d-4c1966776f6f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:39.682954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a6ce74fd-16b5-4e65-a12d-4c1966776f6f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:39.697087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:39.699287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ce74fd-16b5-4e65-a12d-4c1966776f6f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:39.700447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ce74fd-16b5-4e65-a12d-4c1966776f6f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:39.703927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ce74fd-16b5-4e65-a12d-4c1966776f6f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:39.704995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ce74fd-16b5-4e65-a12d-4c1966776f6f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:39.705678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ce74fd-16b5-4e65-a12d-4c1966776f6f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:39.706313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ce74fd-16b5-4e65-a12d-4c1966776f6f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:40.071931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b97aad76-3632-474e-96d1-ef995b08c3eb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:40.073254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b97aad76-3632-474e-96d1-ef995b08c3eb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:40.089113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b97aad76-3632-474e-96d1-ef995b08c3eb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:40.093544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b97aad76-3632-474e-96d1-ef995b08c3eb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:40.094444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b97aad76-3632-474e-96d1-ef995b08c3eb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:40.100680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b97aad76-3632-474e-96d1-ef995b08c3eb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:40.101372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b97aad76-3632-474e-96d1-ef995b08c3eb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:40.102858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b97aad76-3632-474e-96d1-ef995b08c3eb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:40.429216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a6ce74fd-16b5-4e65-a12d-4c1966776f6f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:40.442139 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a6ce74fd-16b5-4e65-a12d-4c1966776f6f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.778049 Aug 27 04:57:40.458659 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2354/4772] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:39 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:40.476174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b97aad76-3632-474e-96d1-ef995b08c3eb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:40.499425 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b97aad76-3632-474e-96d1-ef995b08c3eb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1215 microversion: 2.1 time: 0.430156 Aug 27 04:57:40.500343 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2419/4773] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:40 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1215 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:40.678183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e1cdec0b-5e69-4317-ba44-fd116546f441 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:40.679615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e1cdec0b-5e69-4317-ba44-fd116546f441 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:40.692441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1cdec0b-5e69-4317-ba44-fd116546f441 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:40.694233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1cdec0b-5e69-4317-ba44-fd116546f441 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:40.696272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1cdec0b-5e69-4317-ba44-fd116546f441 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:40.697304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1cdec0b-5e69-4317-ba44-fd116546f441 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:40.699986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1cdec0b-5e69-4317-ba44-fd116546f441 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:40.700736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1cdec0b-5e69-4317-ba44-fd116546f441 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:41.473243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5dd209a-40fa-4b7a-b0a7-cfb5a07aeb5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:41.475096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d5dd209a-40fa-4b7a-b0a7-cfb5a07aeb5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:41.520213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5dd209a-40fa-4b7a-b0a7-cfb5a07aeb5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:41.533455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5dd209a-40fa-4b7a-b0a7-cfb5a07aeb5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:41.534067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5dd209a-40fa-4b7a-b0a7-cfb5a07aeb5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:41.535033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5dd209a-40fa-4b7a-b0a7-cfb5a07aeb5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:41.535597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5dd209a-40fa-4b7a-b0a7-cfb5a07aeb5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:41.536120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5dd209a-40fa-4b7a-b0a7-cfb5a07aeb5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:42.065737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d5dd209a-40fa-4b7a-b0a7-cfb5a07aeb5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:42.083257 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5dd209a-40fa-4b7a-b0a7-cfb5a07aeb5e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.613025 Aug 27 04:57:42.085841 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2420/4774] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:41 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:42.108893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6481f6f-0ca2-4984-b528-344c13a5c476 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:42.118938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e6481f6f-0ca2-4984-b528-344c13a5c476 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:42.165211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6481f6f-0ca2-4984-b528-344c13a5c476 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:42.172155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6481f6f-0ca2-4984-b528-344c13a5c476 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:42.174315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6481f6f-0ca2-4984-b528-344c13a5c476 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:42.175240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6481f6f-0ca2-4984-b528-344c13a5c476 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:42.179196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6481f6f-0ca2-4984-b528-344c13a5c476 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:42.179859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6481f6f-0ca2-4984-b528-344c13a5c476 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:42.242594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e1cdec0b-5e69-4317-ba44-fd116546f441 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:42.255264 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e1cdec0b-5e69-4317-ba44-fd116546f441 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1697 microversion: 2.1 time: 1.581675 Aug 27 04:57:42.256830 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2355/4775] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:40 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1697 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:42.290099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-40c11792-a0f7-4bd0-a5d7-495d62f498a5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:42.308866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c11792-a0f7-4bd0-a5d7-495d62f498a5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:42.310256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c11792-a0f7-4bd0-a5d7-495d62f498a5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:42.310844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c11792-a0f7-4bd0-a5d7-495d62f498a5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:42.421248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-40c11792-a0f7-4bd0-a5d7-495d62f498a5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Going to try to start instance {{(pid=128870) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 04:57:42.589440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e6481f6f-0ca2-4984-b528-344c13a5c476 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:42.605571 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6481f6f-0ca2-4984-b528-344c13a5c476 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1215 microversion: 2.1 time: 0.516353 Aug 27 04:57:42.616919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:42.630293 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2421/4776] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:42 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1215 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:42.674971 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-40c11792-a0f7-4bd0-a5d7-495d62f498a5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "POST /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/action" status: 202 len: 0 microversion: 2.1 time: 0.394964 Aug 27 04:57:42.675607 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2356/4777] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:57:42 2022] POST /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:57:42.686299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c7dd82d-5b3f-448e-ab7f-7baeaba9a3b8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:42.687122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c7dd82d-5b3f-448e-ab7f-7baeaba9a3b8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:42.704118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c7dd82d-5b3f-448e-ab7f-7baeaba9a3b8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:42.713517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c7dd82d-5b3f-448e-ab7f-7baeaba9a3b8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:42.723444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c7dd82d-5b3f-448e-ab7f-7baeaba9a3b8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:42.724123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c7dd82d-5b3f-448e-ab7f-7baeaba9a3b8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:42.726015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c7dd82d-5b3f-448e-ab7f-7baeaba9a3b8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:42.726493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c7dd82d-5b3f-448e-ab7f-7baeaba9a3b8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:43.110458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-565ecc7d-93f7-4473-bcf6-7dde081875c9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:43.111169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-565ecc7d-93f7-4473-bcf6-7dde081875c9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:43.134654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-565ecc7d-93f7-4473-bcf6-7dde081875c9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:43.135155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-565ecc7d-93f7-4473-bcf6-7dde081875c9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:43.135594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-565ecc7d-93f7-4473-bcf6-7dde081875c9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:43.146656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-565ecc7d-93f7-4473-bcf6-7dde081875c9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:43.147260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-565ecc7d-93f7-4473-bcf6-7dde081875c9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:43.155457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-565ecc7d-93f7-4473-bcf6-7dde081875c9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:43.305372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c7dd82d-5b3f-448e-ab7f-7baeaba9a3b8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:43.320327 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c7dd82d-5b3f-448e-ab7f-7baeaba9a3b8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1706 microversion: 2.1 time: 0.634892 Aug 27 04:57:43.341061 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2422/4778] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:42 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1706 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:43.651993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94db3e17-ba8c-4c05-9b15-c972d8aa0515 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:43.653840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94db3e17-ba8c-4c05-9b15-c972d8aa0515 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:43.669670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94db3e17-ba8c-4c05-9b15-c972d8aa0515 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:43.674179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-565ecc7d-93f7-4473-bcf6-7dde081875c9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:43.683596 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-565ecc7d-93f7-4473-bcf6-7dde081875c9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.579797 Aug 27 04:57:43.686484 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2357/4779] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:43 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:43.690797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94db3e17-ba8c-4c05-9b15-c972d8aa0515 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:43.690797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94db3e17-ba8c-4c05-9b15-c972d8aa0515 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:43.690797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94db3e17-ba8c-4c05-9b15-c972d8aa0515 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:43.690797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94db3e17-ba8c-4c05-9b15-c972d8aa0515 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:43.711192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94db3e17-ba8c-4c05-9b15-c972d8aa0515 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:44.215746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94db3e17-ba8c-4c05-9b15-c972d8aa0515 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:44.226083 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94db3e17-ba8c-4c05-9b15-c972d8aa0515 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1215 microversion: 2.1 time: 0.578127 Aug 27 04:57:44.231581 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2423/4780] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:43 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1215 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:44.354303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-efbbb0ff-66ec-46c9-a588-584bd809dc44 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:44.354303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-efbbb0ff-66ec-46c9-a588-584bd809dc44 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:44.379500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efbbb0ff-66ec-46c9-a588-584bd809dc44 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:44.382014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efbbb0ff-66ec-46c9-a588-584bd809dc44 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:44.384855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efbbb0ff-66ec-46c9-a588-584bd809dc44 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:44.388934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efbbb0ff-66ec-46c9-a588-584bd809dc44 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:44.389433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efbbb0ff-66ec-46c9-a588-584bd809dc44 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:44.389876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efbbb0ff-66ec-46c9-a588-584bd809dc44 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:44.727916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-93a3f407-b97a-4717-83ed-8ff56e2c4463 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:44.729150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-93a3f407-b97a-4717-83ed-8ff56e2c4463 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:44.773574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93a3f407-b97a-4717-83ed-8ff56e2c4463 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:44.774379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93a3f407-b97a-4717-83ed-8ff56e2c4463 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:44.775017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93a3f407-b97a-4717-83ed-8ff56e2c4463 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:44.778962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93a3f407-b97a-4717-83ed-8ff56e2c4463 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:44.789292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93a3f407-b97a-4717-83ed-8ff56e2c4463 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:44.797318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93a3f407-b97a-4717-83ed-8ff56e2c4463 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:45.034144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-efbbb0ff-66ec-46c9-a588-584bd809dc44 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:45.066490 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-efbbb0ff-66ec-46c9-a588-584bd809dc44 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1706 microversion: 2.1 time: 0.722675 Aug 27 04:57:45.067357 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2358/4781] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:44 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1706 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:45.259320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c6cddd9f-56e8-482b-ab02-b6e9f6b17911 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:45.260229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c6cddd9f-56e8-482b-ab02-b6e9f6b17911 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:45.280156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6cddd9f-56e8-482b-ab02-b6e9f6b17911 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:45.281808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6cddd9f-56e8-482b-ab02-b6e9f6b17911 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:45.282653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6cddd9f-56e8-482b-ab02-b6e9f6b17911 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:45.284426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6cddd9f-56e8-482b-ab02-b6e9f6b17911 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:45.289717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6cddd9f-56e8-482b-ab02-b6e9f6b17911 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:45.290019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6cddd9f-56e8-482b-ab02-b6e9f6b17911 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:45.394882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-93a3f407-b97a-4717-83ed-8ff56e2c4463 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:45.411579 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-93a3f407-b97a-4717-83ed-8ff56e2c4463 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.705057 Aug 27 04:57:45.439777 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2424/4782] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:44 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:45.962204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c6cddd9f-56e8-482b-ab02-b6e9f6b17911 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:45.972557 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c6cddd9f-56e8-482b-ab02-b6e9f6b17911 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1215 microversion: 2.1 time: 0.717028 Aug 27 04:57:45.975975 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2359/4783] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:45 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1215 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:46.092599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13674241-5698-470e-a83d-4acfb72ffa45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:46.093805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13674241-5698-470e-a83d-4acfb72ffa45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:46.122943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13674241-5698-470e-a83d-4acfb72ffa45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:46.123559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13674241-5698-470e-a83d-4acfb72ffa45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:46.123877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13674241-5698-470e-a83d-4acfb72ffa45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:46.134924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13674241-5698-470e-a83d-4acfb72ffa45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:46.135561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13674241-5698-470e-a83d-4acfb72ffa45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:46.136028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13674241-5698-470e-a83d-4acfb72ffa45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:46.435383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ac93bb10-8347-4263-a866-929282769cba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:46.436707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ac93bb10-8347-4263-a866-929282769cba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:46.463881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac93bb10-8347-4263-a866-929282769cba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:46.464947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac93bb10-8347-4263-a866-929282769cba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:46.467169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac93bb10-8347-4263-a866-929282769cba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:46.468816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac93bb10-8347-4263-a866-929282769cba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:46.473440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac93bb10-8347-4263-a866-929282769cba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:46.474219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac93bb10-8347-4263-a866-929282769cba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:46.638203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13674241-5698-470e-a83d-4acfb72ffa45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:46.651370 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13674241-5698-470e-a83d-4acfb72ffa45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1706 microversion: 2.1 time: 0.563633 Aug 27 04:57:46.664555 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2425/4784] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:46 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1706 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:46.834223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac93bb10-8347-4263-a866-929282769cba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:46.844028 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ac93bb10-8347-4263-a866-929282769cba tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.413712 Aug 27 04:57:46.845866 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2360/4785] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:46 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:47.003939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98f8ca49-a67d-4c10-88ab-8644469da3e9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:47.004944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98f8ca49-a67d-4c10-88ab-8644469da3e9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:47.016484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98f8ca49-a67d-4c10-88ab-8644469da3e9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:47.017685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98f8ca49-a67d-4c10-88ab-8644469da3e9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:47.018237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98f8ca49-a67d-4c10-88ab-8644469da3e9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:47.022773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98f8ca49-a67d-4c10-88ab-8644469da3e9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:47.023357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98f8ca49-a67d-4c10-88ab-8644469da3e9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:47.024044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98f8ca49-a67d-4c10-88ab-8644469da3e9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:47.447081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-98f8ca49-a67d-4c10-88ab-8644469da3e9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:47.459482 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98f8ca49-a67d-4c10-88ab-8644469da3e9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1215 microversion: 2.1 time: 0.464193 Aug 27 04:57:47.462697 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2426/4786] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:46 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1215 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:47.686799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2865f51e-523d-4ac0-9a71-d42be2c4ac8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:47.688508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2865f51e-523d-4ac0-9a71-d42be2c4ac8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:47.706378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2865f51e-523d-4ac0-9a71-d42be2c4ac8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:47.715480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2865f51e-523d-4ac0-9a71-d42be2c4ac8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:47.718243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2865f51e-523d-4ac0-9a71-d42be2c4ac8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:47.726987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2865f51e-523d-4ac0-9a71-d42be2c4ac8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:47.729467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2865f51e-523d-4ac0-9a71-d42be2c4ac8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:47.735523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2865f51e-523d-4ac0-9a71-d42be2c4ac8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:47.867041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e92469f0-b9bc-4a0c-99d0-bd9de2d2a21f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:47.868244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e92469f0-b9bc-4a0c-99d0-bd9de2d2a21f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:47.881169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e92469f0-b9bc-4a0c-99d0-bd9de2d2a21f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:47.888642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e92469f0-b9bc-4a0c-99d0-bd9de2d2a21f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:47.889434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e92469f0-b9bc-4a0c-99d0-bd9de2d2a21f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:47.891416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e92469f0-b9bc-4a0c-99d0-bd9de2d2a21f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:47.892132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e92469f0-b9bc-4a0c-99d0-bd9de2d2a21f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:47.896781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e92469f0-b9bc-4a0c-99d0-bd9de2d2a21f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:48.322917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2865f51e-523d-4ac0-9a71-d42be2c4ac8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:48.338812 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2865f51e-523d-4ac0-9a71-d42be2c4ac8d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1710 microversion: 2.1 time: 0.656587 Aug 27 04:57:48.343375 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2361/4787] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:47 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1710 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:48.373136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e92469f0-b9bc-4a0c-99d0-bd9de2d2a21f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:48.386669 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e92469f0-b9bc-4a0c-99d0-bd9de2d2a21f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.523856 Aug 27 04:57:48.400260 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2427/4788] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:47 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:48.486875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cc937331-a177-45ed-9552-1b867ecf7a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:48.487718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cc937331-a177-45ed-9552-1b867ecf7a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:48.509392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc937331-a177-45ed-9552-1b867ecf7a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:48.514154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc937331-a177-45ed-9552-1b867ecf7a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:48.514888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc937331-a177-45ed-9552-1b867ecf7a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:48.518088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc937331-a177-45ed-9552-1b867ecf7a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:48.519404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc937331-a177-45ed-9552-1b867ecf7a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:48.520374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc937331-a177-45ed-9552-1b867ecf7a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:48.972627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cc937331-a177-45ed-9552-1b867ecf7a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:48.982272 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cc937331-a177-45ed-9552-1b867ecf7a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1215 microversion: 2.1 time: 0.503135 Aug 27 04:57:48.988793 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2362/4789] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:48 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1215 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:49.424879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5a09a0c2-05ed-4c6b-953b-62fd708bd6f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:49.425530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5a09a0c2-05ed-4c6b-953b-62fd708bd6f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:49.437409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a09a0c2-05ed-4c6b-953b-62fd708bd6f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:49.438010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a09a0c2-05ed-4c6b-953b-62fd708bd6f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:49.438477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a09a0c2-05ed-4c6b-953b-62fd708bd6f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:49.439234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a09a0c2-05ed-4c6b-953b-62fd708bd6f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:49.439702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a09a0c2-05ed-4c6b-953b-62fd708bd6f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:49.462291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a09a0c2-05ed-4c6b-953b-62fd708bd6f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:49.776490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-495466d5-0b33-4750-9b4e-ec4247fcfe8c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'create', calling method: .version_select at 0x7f1f21a23310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1266101429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfOxAAyqoXQiFwIH1PD6fSXE4u7cqdNb9ecxyNroqEjBU5cv+Kmwjzd+9iRQ2YzJ8/WCRNdMVejzBUseaa3WAg47u4fmjtiUGFm4mK0RU8Nh0GBO3DCUL4N5KMF6+Jm/Q=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:57:49.887526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-495466d5-0b33-4750-9b4e-ec4247fcfe8c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:57:49.913584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5a09a0c2-05ed-4c6b-953b-62fd708bd6f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:49.922265 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5a09a0c2-05ed-4c6b-953b-62fd708bd6f3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.504375 Aug 27 04:57:49.922792 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2363/4790] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:49 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:49.925329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-495466d5-0b33-4750-9b4e-ec4247fcfe8c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for user e508461869c24fb3ad1641d830e2b22a and project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:57:50.004024 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-495466d5-0b33-4750-9b4e-ec4247fcfe8c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.763139 Aug 27 04:57:50.004579 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2428/4791] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:57:49 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:57:50.007211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-647a85d3-35fb-4e89-8b5c-7c578df68d11 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:50.008952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-647a85d3-35fb-4e89-8b5c-7c578df68d11 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:50.041015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-647a85d3-35fb-4e89-8b5c-7c578df68d11 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:50.043211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-647a85d3-35fb-4e89-8b5c-7c578df68d11 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:50.045630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-647a85d3-35fb-4e89-8b5c-7c578df68d11 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:50.049669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-647a85d3-35fb-4e89-8b5c-7c578df68d11 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:50.052486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-647a85d3-35fb-4e89-8b5c-7c578df68d11 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:50.054618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-647a85d3-35fb-4e89-8b5c-7c578df68d11 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:50.967364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a0590f1-3d34-4f91-acd1-f1742fa46d99 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:50.968712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5a0590f1-3d34-4f91-acd1-f1742fa46d99 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:51.031502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a0590f1-3d34-4f91-acd1-f1742fa46d99 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:51.032292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a0590f1-3d34-4f91-acd1-f1742fa46d99 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:51.049008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a0590f1-3d34-4f91-acd1-f1742fa46d99 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:51.051827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a0590f1-3d34-4f91-acd1-f1742fa46d99 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:51.056442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a0590f1-3d34-4f91-acd1-f1742fa46d99 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:51.061742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a0590f1-3d34-4f91-acd1-f1742fa46d99 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:51.277153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-647a85d3-35fb-4e89-8b5c-7c578df68d11 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:51.289991 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-647a85d3-35fb-4e89-8b5c-7c578df68d11 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1215 microversion: 2.1 time: 1.288359 Aug 27 04:57:51.305043 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2364/4792] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:49 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1215 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:51.790063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5a0590f1-3d34-4f91-acd1-f1742fa46d99 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:51.817989 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5a0590f1-3d34-4f91-acd1-f1742fa46d99 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.875401 Aug 27 04:57:51.830600 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2429/4793] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:50 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:52.320838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-890c9fcd-3595-4fb4-b0cb-cca6d52f515b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:52.321548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-890c9fcd-3595-4fb4-b0cb-cca6d52f515b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:52.351613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-890c9fcd-3595-4fb4-b0cb-cca6d52f515b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:52.352131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-890c9fcd-3595-4fb4-b0cb-cca6d52f515b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:52.352609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-890c9fcd-3595-4fb4-b0cb-cca6d52f515b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:52.379137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-890c9fcd-3595-4fb4-b0cb-cca6d52f515b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:52.380737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-890c9fcd-3595-4fb4-b0cb-cca6d52f515b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:52.388481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-890c9fcd-3595-4fb4-b0cb-cca6d52f515b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:52.845859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c715a6a0-61e4-468a-a75f-6c37c02f01dd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:52.847220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c715a6a0-61e4-468a-a75f-6c37c02f01dd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:52.865503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c715a6a0-61e4-468a-a75f-6c37c02f01dd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:52.866977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c715a6a0-61e4-468a-a75f-6c37c02f01dd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:52.869991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c715a6a0-61e4-468a-a75f-6c37c02f01dd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:52.874411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c715a6a0-61e4-468a-a75f-6c37c02f01dd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:52.875331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c715a6a0-61e4-468a-a75f-6c37c02f01dd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:52.879145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c715a6a0-61e4-468a-a75f-6c37c02f01dd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:53.249465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-890c9fcd-3595-4fb4-b0cb-cca6d52f515b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:53.258960 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-890c9fcd-3595-4fb4-b0cb-cca6d52f515b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1203 microversion: 2.1 time: 0.943595 Aug 27 04:57:53.260329 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2365/4794] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:52 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1203 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:53.906274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c715a6a0-61e4-468a-a75f-6c37c02f01dd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:53.917761 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c715a6a0-61e4-468a-a75f-6c37c02f01dd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 1.076095 Aug 27 04:57:53.922080 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2430/4795] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:52 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:57:54.284189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-05bcadd9-4121-4495-a380-8766100888ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:54.285903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-05bcadd9-4121-4495-a380-8766100888ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:54.311827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05bcadd9-4121-4495-a380-8766100888ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:54.315123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05bcadd9-4121-4495-a380-8766100888ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:54.330232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05bcadd9-4121-4495-a380-8766100888ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:54.332168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05bcadd9-4121-4495-a380-8766100888ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:54.337321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05bcadd9-4121-4495-a380-8766100888ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:54.339477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05bcadd9-4121-4495-a380-8766100888ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:54.951891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1fbfdb60-3f66-47bb-8ac3-0589315b1c41 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:54.952976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1fbfdb60-3f66-47bb-8ac3-0589315b1c41 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:54.975719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fbfdb60-3f66-47bb-8ac3-0589315b1c41 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:54.978805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fbfdb60-3f66-47bb-8ac3-0589315b1c41 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:54.981523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fbfdb60-3f66-47bb-8ac3-0589315b1c41 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:54.986537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fbfdb60-3f66-47bb-8ac3-0589315b1c41 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:54.989247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fbfdb60-3f66-47bb-8ac3-0589315b1c41 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:54.991211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fbfdb60-3f66-47bb-8ac3-0589315b1c41 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:55.191130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-05bcadd9-4121-4495-a380-8766100888ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:55.216934 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-05bcadd9-4121-4495-a380-8766100888ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1203 microversion: 2.1 time: 0.937706 Aug 27 04:57:55.230243 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2366/4796] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:54 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1203 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:55.691241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1fbfdb60-3f66-47bb-8ac3-0589315b1c41 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:55.709018 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1fbfdb60-3f66-47bb-8ac3-0589315b1c41 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.766767 Aug 27 04:57:55.709987 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2431/4797] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:54 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:56.238404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d62adb66-1e80-42e8-b9b5-992d4c3cd2d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:56.239235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d62adb66-1e80-42e8-b9b5-992d4c3cd2d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:56.257795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d62adb66-1e80-42e8-b9b5-992d4c3cd2d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:56.260319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d62adb66-1e80-42e8-b9b5-992d4c3cd2d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:56.260949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d62adb66-1e80-42e8-b9b5-992d4c3cd2d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:56.261847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d62adb66-1e80-42e8-b9b5-992d4c3cd2d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:56.263891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d62adb66-1e80-42e8-b9b5-992d4c3cd2d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:56.265705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d62adb66-1e80-42e8-b9b5-992d4c3cd2d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:56.455631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d62adb66-1e80-42e8-b9b5-992d4c3cd2d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:56.467079 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d62adb66-1e80-42e8-b9b5-992d4c3cd2d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1203 microversion: 2.1 time: 0.233023 Aug 27 04:57:56.467955 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2367/4798] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:56 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1203 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:56.735610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-275fac60-33aa-4748-b891-f1716ff54455 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:56.736932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-275fac60-33aa-4748-b891-f1716ff54455 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:56.752166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-275fac60-33aa-4748-b891-f1716ff54455 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:56.753495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-275fac60-33aa-4748-b891-f1716ff54455 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:56.754201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-275fac60-33aa-4748-b891-f1716ff54455 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:56.755156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-275fac60-33aa-4748-b891-f1716ff54455 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:56.763295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-275fac60-33aa-4748-b891-f1716ff54455 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:56.764995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-275fac60-33aa-4748-b891-f1716ff54455 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:57.235464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-275fac60-33aa-4748-b891-f1716ff54455 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:57.244676 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-275fac60-33aa-4748-b891-f1716ff54455 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.513260 Aug 27 04:57:57.245575 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2432/4799] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:56 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:57.490402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf046305-2272-4a59-a9b9-26cb81262e7c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:57.491100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bf046305-2272-4a59-a9b9-26cb81262e7c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:57.507765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf046305-2272-4a59-a9b9-26cb81262e7c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:57.508280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf046305-2272-4a59-a9b9-26cb81262e7c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:57.508995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf046305-2272-4a59-a9b9-26cb81262e7c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:57.509727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf046305-2272-4a59-a9b9-26cb81262e7c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:57.510191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf046305-2272-4a59-a9b9-26cb81262e7c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:57.510623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf046305-2272-4a59-a9b9-26cb81262e7c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:58.092022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bf046305-2272-4a59-a9b9-26cb81262e7c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:58.110208 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bf046305-2272-4a59-a9b9-26cb81262e7c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1203 microversion: 2.1 time: 0.614402 Aug 27 04:57:58.111320 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2368/4800] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:57 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1203 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:58.269056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c17a932-4735-4ff9-9ffe-73bcb8b6ce68 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:58.269677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c17a932-4735-4ff9-9ffe-73bcb8b6ce68 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:58.281263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c17a932-4735-4ff9-9ffe-73bcb8b6ce68 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:58.284919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c17a932-4735-4ff9-9ffe-73bcb8b6ce68 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:58.285592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c17a932-4735-4ff9-9ffe-73bcb8b6ce68 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:58.286532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c17a932-4735-4ff9-9ffe-73bcb8b6ce68 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:58.288391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c17a932-4735-4ff9-9ffe-73bcb8b6ce68 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:58.292396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c17a932-4735-4ff9-9ffe-73bcb8b6ce68 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:59.131701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-717d64be-36e2-4acb-af90-cbf51e5fb5f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:57:59.132321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-717d64be-36e2-4acb-af90-cbf51e5fb5f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:57:59.148783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-717d64be-36e2-4acb-af90-cbf51e5fb5f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:59.149606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-717d64be-36e2-4acb-af90-cbf51e5fb5f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:59.153144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-717d64be-36e2-4acb-af90-cbf51e5fb5f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:59.154399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-717d64be-36e2-4acb-af90-cbf51e5fb5f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:57:59.155061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-717d64be-36e2-4acb-af90-cbf51e5fb5f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:57:59.155691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-717d64be-36e2-4acb-af90-cbf51e5fb5f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:57:59.188437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c17a932-4735-4ff9-9ffe-73bcb8b6ce68 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:59.208018 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c17a932-4735-4ff9-9ffe-73bcb8b6ce68 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.938198 Aug 27 04:57:59.208692 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2433/4801] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:58 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:57:59.444486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-717d64be-36e2-4acb-af90-cbf51e5fb5f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:57:59.473781 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-717d64be-36e2-4acb-af90-cbf51e5fb5f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1203 microversion: 2.1 time: 0.346060 Aug 27 04:57:59.489934 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2369/4802] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:57:59 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1203 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:58:00.232867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f507584f-33e5-45e9-894e-2f39c72d9227 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:00.233404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f507584f-33e5-45e9-894e-2f39c72d9227 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:00.249787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:00.256840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f507584f-33e5-45e9-894e-2f39c72d9227 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:00.259420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f507584f-33e5-45e9-894e-2f39c72d9227 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:00.261502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f507584f-33e5-45e9-894e-2f39c72d9227 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:00.272256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f507584f-33e5-45e9-894e-2f39c72d9227 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:00.272848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f507584f-33e5-45e9-894e-2f39c72d9227 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:00.273302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f507584f-33e5-45e9-894e-2f39c72d9227 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:00.510889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cd644016-7bd7-4f45-89b0-e928f228600f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:00.516682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cd644016-7bd7-4f45-89b0-e928f228600f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:00.577892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd644016-7bd7-4f45-89b0-e928f228600f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:00.579757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd644016-7bd7-4f45-89b0-e928f228600f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:00.589509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd644016-7bd7-4f45-89b0-e928f228600f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:00.591012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd644016-7bd7-4f45-89b0-e928f228600f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:00.591514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd644016-7bd7-4f45-89b0-e928f228600f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:00.591963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd644016-7bd7-4f45-89b0-e928f228600f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:01.184421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f507584f-33e5-45e9-894e-2f39c72d9227 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:01.187878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:01.207896 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f507584f-33e5-45e9-894e-2f39c72d9227 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.981435 Aug 27 04:58:01.218800 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2434/4803] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:00 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:01.607522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cd644016-7bd7-4f45-89b0-e928f228600f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:01.621307 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cd644016-7bd7-4f45-89b0-e928f228600f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1203 microversion: 2.1 time: 1.110588 Aug 27 04:58:01.623227 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2370/4804] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:00 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1203 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:58:02.232642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1cca883-ab4a-4adb-829b-0e327be94651 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:02.233970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f1cca883-ab4a-4adb-829b-0e327be94651 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:02.248354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1cca883-ab4a-4adb-829b-0e327be94651 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:02.263807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1cca883-ab4a-4adb-829b-0e327be94651 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:02.265020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1cca883-ab4a-4adb-829b-0e327be94651 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:02.275171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1cca883-ab4a-4adb-829b-0e327be94651 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:02.276063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1cca883-ab4a-4adb-829b-0e327be94651 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:02.279220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1cca883-ab4a-4adb-829b-0e327be94651 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:02.644273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-70d9e0b5-1c30-4191-bffe-5be7ea5b3d18 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:02.645431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-70d9e0b5-1c30-4191-bffe-5be7ea5b3d18 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:02.686879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70d9e0b5-1c30-4191-bffe-5be7ea5b3d18 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:02.687390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70d9e0b5-1c30-4191-bffe-5be7ea5b3d18 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:02.687836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70d9e0b5-1c30-4191-bffe-5be7ea5b3d18 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:02.688580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70d9e0b5-1c30-4191-bffe-5be7ea5b3d18 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:02.689054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70d9e0b5-1c30-4191-bffe-5be7ea5b3d18 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:02.689489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70d9e0b5-1c30-4191-bffe-5be7ea5b3d18 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:02.778809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1cca883-ab4a-4adb-829b-0e327be94651 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:02.793781 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1cca883-ab4a-4adb-829b-0e327be94651 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.566021 Aug 27 04:58:02.795593 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2435/4805] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:02 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:03.769149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-70d9e0b5-1c30-4191-bffe-5be7ea5b3d18 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:03.779990 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-70d9e0b5-1c30-4191-bffe-5be7ea5b3d18 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1203 microversion: 2.1 time: 1.139966 Aug 27 04:58:03.780732 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2371/4806] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:02 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1203 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:58:03.826146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-926b2009-5b5d-45f1-92f5-4680bb531b50 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:03.826991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-926b2009-5b5d-45f1-92f5-4680bb531b50 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:03.851683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-926b2009-5b5d-45f1-92f5-4680bb531b50 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:03.852200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-926b2009-5b5d-45f1-92f5-4680bb531b50 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:03.860817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-926b2009-5b5d-45f1-92f5-4680bb531b50 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:03.864222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-926b2009-5b5d-45f1-92f5-4680bb531b50 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:03.865023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-926b2009-5b5d-45f1-92f5-4680bb531b50 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:03.868014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-926b2009-5b5d-45f1-92f5-4680bb531b50 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:04.717494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-926b2009-5b5d-45f1-92f5-4680bb531b50 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:04.720904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-3d0ff9bb-2cee-415c-a9c0-c52b6d11f107 req-f607fe03-ac4d-4183-8583-8670d45243c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228b4767-bbe2-41d0-a7d4-a6670e79043f", "name": "network-vif-plugged", "status": "completed", "tag": "1b95ce59-5e34-4673-9606-3f53d8d7b9d1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:04.732396 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-926b2009-5b5d-45f1-92f5-4680bb531b50 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.913868 Aug 27 04:58:04.733307 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2436/4807] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:03 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:04.746374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3d0ff9bb-2cee-415c-a9c0-c52b6d11f107 req-f607fe03-ac4d-4183-8583-8670d45243c1 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:04.747478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3d0ff9bb-2cee-415c-a9c0-c52b6d11f107 req-f607fe03-ac4d-4183-8583-8670d45243c1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:04.748282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3d0ff9bb-2cee-415c-a9c0-c52b6d11f107 req-f607fe03-ac4d-4183-8583-8670d45243c1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:04.789546 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-3d0ff9bb-2cee-415c-a9c0-c52b6d11f107 req-f607fe03-ac4d-4183-8583-8670d45243c1 service nova] Creating event network-vif-plugged:1b95ce59-5e34-4673-9606-3f53d8d7b9d1 for instance 228b4767-bbe2-41d0-a7d4-a6670e79043f on n-h2-854823-1 Aug 27 04:58:04.807437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8dce59e5-5493-4fdc-aca5-2868408ea510 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:04.808327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8dce59e5-5493-4fdc-aca5-2868408ea510 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:04.821109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dce59e5-5493-4fdc-aca5-2868408ea510 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:04.822030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dce59e5-5493-4fdc-aca5-2868408ea510 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:04.823112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dce59e5-5493-4fdc-aca5-2868408ea510 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:04.827319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dce59e5-5493-4fdc-aca5-2868408ea510 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:04.829513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dce59e5-5493-4fdc-aca5-2868408ea510 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:04.830185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dce59e5-5493-4fdc-aca5-2868408ea510 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:04.832432 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-3d0ff9bb-2cee-415c-a9c0-c52b6d11f107 req-f607fe03-ac4d-4183-8583-8670d45243c1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.716938 Aug 27 04:58:04.857278 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2372/4808] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:05.648486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8dce59e5-5493-4fdc-aca5-2868408ea510 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:05.661303 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8dce59e5-5493-4fdc-aca5-2868408ea510 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1203 microversion: 2.1 time: 0.863182 Aug 27 04:58:05.663553 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2437/4809] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:04 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1203 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:05.762626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a2397bdc-b6cb-449c-a4e5-355e4bc1336d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:05.765535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a2397bdc-b6cb-449c-a4e5-355e4bc1336d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:05.798023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2397bdc-b6cb-449c-a4e5-355e4bc1336d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:05.798656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2397bdc-b6cb-449c-a4e5-355e4bc1336d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:05.798990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2397bdc-b6cb-449c-a4e5-355e4bc1336d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:05.802625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2397bdc-b6cb-449c-a4e5-355e4bc1336d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:05.803255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2397bdc-b6cb-449c-a4e5-355e4bc1336d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:05.803716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2397bdc-b6cb-449c-a4e5-355e4bc1336d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:06.645362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a2397bdc-b6cb-449c-a4e5-355e4bc1336d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:06.658735 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a2397bdc-b6cb-449c-a4e5-355e4bc1336d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 0.906805 Aug 27 04:58:06.674764 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2373/4810] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:05 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:06.687038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d6e1adb-d0ae-4c5c-84f4-b5359d35a15b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:06.688286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d6e1adb-d0ae-4c5c-84f4-b5359d35a15b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:06.712460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d6e1adb-d0ae-4c5c-84f4-b5359d35a15b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:06.712961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d6e1adb-d0ae-4c5c-84f4-b5359d35a15b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:06.713418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d6e1adb-d0ae-4c5c-84f4-b5359d35a15b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:06.714177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d6e1adb-d0ae-4c5c-84f4-b5359d35a15b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:06.715219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d6e1adb-d0ae-4c5c-84f4-b5359d35a15b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:06.721684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d6e1adb-d0ae-4c5c-84f4-b5359d35a15b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:07.014282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-cc36dd86-9291-486f-9750-656658df077e req-873da4ad-3f2f-4b0c-84fc-f226cb796d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed4facb-b782-4d67-8f23-b527744e747f", "name": "network-vif-plugged", "status": "completed", "tag": "a6feffab-3e0f-4541-85c9-fb49c8e1ddf8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:07.039856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cc36dd86-9291-486f-9750-656658df077e req-873da4ad-3f2f-4b0c-84fc-f226cb796d56 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:07.040353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cc36dd86-9291-486f-9750-656658df077e req-873da4ad-3f2f-4b0c-84fc-f226cb796d56 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:07.046236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cc36dd86-9291-486f-9750-656658df077e req-873da4ad-3f2f-4b0c-84fc-f226cb796d56 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:07.049910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:07.083425 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-cc36dd86-9291-486f-9750-656658df077e req-873da4ad-3f2f-4b0c-84fc-f226cb796d56 service nova] Creating event network-vif-plugged:a6feffab-3e0f-4541-85c9-fb49c8e1ddf8 for instance 8ed4facb-b782-4d67-8f23-b527744e747f on n-h2-854823-1 Aug 27 04:58:07.094652 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-cc36dd86-9291-486f-9750-656658df077e req-873da4ad-3f2f-4b0c-84fc-f226cb796d56 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092425 Aug 27 04:58:07.097055 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2374/4811] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:07.687360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-40f11bf6-de92-42e5-89a3-293ffed058b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:07.688661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-40f11bf6-de92-42e5-89a3-293ffed058b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:07.719097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40f11bf6-de92-42e5-89a3-293ffed058b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:07.720736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40f11bf6-de92-42e5-89a3-293ffed058b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:07.721341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40f11bf6-de92-42e5-89a3-293ffed058b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:07.729392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40f11bf6-de92-42e5-89a3-293ffed058b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:07.729392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40f11bf6-de92-42e5-89a3-293ffed058b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:07.729392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40f11bf6-de92-42e5-89a3-293ffed058b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:08.330968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d6e1adb-d0ae-4c5c-84f4-b5359d35a15b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:08.343156 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d6e1adb-d0ae-4c5c-84f4-b5359d35a15b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1203 microversion: 2.1 time: 1.660074 Aug 27 04:58:08.349561 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2438/4812] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:06 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1203 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:09.348551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-40f11bf6-de92-42e5-89a3-293ffed058b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:09.367809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88176f18-f8ad-49fb-8f64-ed074e6e6a50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:09.368575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88176f18-f8ad-49fb-8f64-ed074e6e6a50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:09.369749 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-40f11bf6-de92-42e5-89a3-293ffed058b2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1518 microversion: 2.1 time: 1.679936 Aug 27 04:58:09.384905 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2375/4813] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:07 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1518 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:09.385233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:09.385233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88176f18-f8ad-49fb-8f64-ed074e6e6a50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:09.385233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88176f18-f8ad-49fb-8f64-ed074e6e6a50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:09.385233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88176f18-f8ad-49fb-8f64-ed074e6e6a50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:09.385233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88176f18-f8ad-49fb-8f64-ed074e6e6a50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:09.385233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88176f18-f8ad-49fb-8f64-ed074e6e6a50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:09.385233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88176f18-f8ad-49fb-8f64-ed074e6e6a50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:09.796242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88176f18-f8ad-49fb-8f64-ed074e6e6a50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:09.807436 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88176f18-f8ad-49fb-8f64-ed074e6e6a50 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1203 microversion: 2.1 time: 0.443638 Aug 27 04:58:09.822403 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2439/4814] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:09 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1203 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:10.391793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8dde37b7-140c-482f-b84f-59d866ec05b3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:10.392417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8dde37b7-140c-482f-b84f-59d866ec05b3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:10.410721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=44 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:10.419573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dde37b7-140c-482f-b84f-59d866ec05b3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:10.420068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dde37b7-140c-482f-b84f-59d866ec05b3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:10.420517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dde37b7-140c-482f-b84f-59d866ec05b3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:10.421305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dde37b7-140c-482f-b84f-59d866ec05b3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:10.421752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dde37b7-140c-482f-b84f-59d866ec05b3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:10.422183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dde37b7-140c-482f-b84f-59d866ec05b3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:10.562831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-674526406", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "22b2d05e-f54b-4e3f-a940-57ad10218e2f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1266101429", "security_groups": [{"name": "tempest-secgroup-smoke-770330431"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:10.821942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] validate_networks() for [('22b2d05e-f54b-4e3f-a940-57ad10218e2f', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:58:10.963517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8dde37b7-140c-482f-b84f-59d866ec05b3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:11.007612 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8dde37b7-140c-482f-b84f-59d866ec05b3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.601636 Aug 27 04:58:11.012893 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2376/4815] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:10 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:11.020480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9f5d5fcb-e9b2-4fbf-a843-5d00b7a7bb1d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:11.021383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9f5d5fcb-e9b2-4fbf-a843-5d00b7a7bb1d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:11.037996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f5d5fcb-e9b2-4fbf-a843-5d00b7a7bb1d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:11.038771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f5d5fcb-e9b2-4fbf-a843-5d00b7a7bb1d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:11.039361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f5d5fcb-e9b2-4fbf-a843-5d00b7a7bb1d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:11.041255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f5d5fcb-e9b2-4fbf-a843-5d00b7a7bb1d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:11.043589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f5d5fcb-e9b2-4fbf-a843-5d00b7a7bb1d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:11.044714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f5d5fcb-e9b2-4fbf-a843-5d00b7a7bb1d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:11.664334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:58:11.665313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:58:11.665947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:58:11.666515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:58:11.667082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:58:11.683584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:11.687212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:11.687852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:11.689940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:11.691651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:11.694169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:11.720483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:58:11.727446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for user e508461869c24fb3ad1641d830e2b22a and project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:58:11.744180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:58:11.747433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:58:11.803538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9f5d5fcb-e9b2-4fbf-a843-5d00b7a7bb1d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:11.815518 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9f5d5fcb-e9b2-4fbf-a843-5d00b7a7bb1d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1391 microversion: 2.1 time: 0.801105 Aug 27 04:58:11.817313 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2377/4816] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:11 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1391 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:11.865895 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f24d5725-bf43-4420-99cf-a4582d5a59ac tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.308288 Aug 27 04:58:11.866575 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2440/4817] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:58:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:58:11.872927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3313c717-7c89-410b-9955-49608f231cee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:11.877194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3313c717-7c89-410b-9955-49608f231cee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:11.882486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e6322ae-70af-42bb-9779-ab8ad9ccc999 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:11.883119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e6322ae-70af-42bb-9779-ab8ad9ccc999 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:11.896652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3313c717-7c89-410b-9955-49608f231cee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:11.900389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3313c717-7c89-410b-9955-49608f231cee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:11.903777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3313c717-7c89-410b-9955-49608f231cee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:11.905346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3313c717-7c89-410b-9955-49608f231cee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:11.906816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e6322ae-70af-42bb-9779-ab8ad9ccc999 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:11.907460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3313c717-7c89-410b-9955-49608f231cee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:11.908055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3313c717-7c89-410b-9955-49608f231cee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:11.908737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e6322ae-70af-42bb-9779-ab8ad9ccc999 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:11.912191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e6322ae-70af-42bb-9779-ab8ad9ccc999 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:11.913185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e6322ae-70af-42bb-9779-ab8ad9ccc999 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:11.915677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e6322ae-70af-42bb-9779-ab8ad9ccc999 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:11.917601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e6322ae-70af-42bb-9779-ab8ad9ccc999 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:12.357136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4e6322ae-70af-42bb-9779-ab8ad9ccc999 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:12.426907 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e6322ae-70af-42bb-9779-ab8ad9ccc999 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1391 microversion: 2.1 time: 0.535956 Aug 27 04:58:12.429001 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2441/4818] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:11 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1391 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:12.439469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aeed6fb6-ed02-490a-8d60-1e36375fb9a8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:12.442920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aeed6fb6-ed02-490a-8d60-1e36375fb9a8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:12.644026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3313c717-7c89-410b-9955-49608f231cee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:12.657862 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3313c717-7c89-410b-9955-49608f231cee tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.803928 Aug 27 04:58:12.659937 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2378/4819] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:11 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:12.665215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-053a8c4e-a7dd-4f35-9c6e-e34fce0e9181 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:12.666101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-053a8c4e-a7dd-4f35-9c6e-e34fce0e9181 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:12.672559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-053a8c4e-a7dd-4f35-9c6e-e34fce0e9181 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:12.678289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-053a8c4e-a7dd-4f35-9c6e-e34fce0e9181 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:12.679089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-053a8c4e-a7dd-4f35-9c6e-e34fce0e9181 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:12.680123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-053a8c4e-a7dd-4f35-9c6e-e34fce0e9181 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:12.682521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-053a8c4e-a7dd-4f35-9c6e-e34fce0e9181 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:12.687359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-053a8c4e-a7dd-4f35-9c6e-e34fce0e9181 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:12.945513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aeed6fb6-ed02-490a-8d60-1e36375fb9a8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:12.959139 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aeed6fb6-ed02-490a-8d60-1e36375fb9a8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1266 microversion: 2.1 time: 0.528984 Aug 27 04:58:12.963376 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2442/4820] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:12 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1266 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:12.977015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cf52c07-7fca-4493-b823-e7fb9cf19152 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:12.977726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2cf52c07-7fca-4493-b823-e7fb9cf19152 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:12.993920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf52c07-7fca-4493-b823-e7fb9cf19152 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:12.994435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf52c07-7fca-4493-b823-e7fb9cf19152 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:12.994883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf52c07-7fca-4493-b823-e7fb9cf19152 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:12.995671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf52c07-7fca-4493-b823-e7fb9cf19152 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:12.996136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf52c07-7fca-4493-b823-e7fb9cf19152 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:12.996580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf52c07-7fca-4493-b823-e7fb9cf19152 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:13.166127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-053a8c4e-a7dd-4f35-9c6e-e34fce0e9181 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:13.185506 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-053a8c4e-a7dd-4f35-9c6e-e34fce0e9181 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1391 microversion: 2.1 time: 0.524186 Aug 27 04:58:13.186352 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2379/4821] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:12 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1391 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:13.217426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cbfbe029-dcef-4068-8e0c-f9eab6fe79ae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:13.218198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cbfbe029-dcef-4068-8e0c-f9eab6fe79ae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:13.235393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbfbe029-dcef-4068-8e0c-f9eab6fe79ae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:13.236428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbfbe029-dcef-4068-8e0c-f9eab6fe79ae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:13.243384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbfbe029-dcef-4068-8e0c-f9eab6fe79ae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:13.261790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbfbe029-dcef-4068-8e0c-f9eab6fe79ae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:13.262557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbfbe029-dcef-4068-8e0c-f9eab6fe79ae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:13.263229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbfbe029-dcef-4068-8e0c-f9eab6fe79ae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:13.371416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cbfbe029-dcef-4068-8e0c-f9eab6fe79ae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:58:13.589019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2cf52c07-7fca-4493-b823-e7fb9cf19152 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:13.612768 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2cf52c07-7fca-4493-b823-e7fb9cf19152 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.644142 Aug 27 04:58:13.638447 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cbfbe029-dcef-4068-8e0c-f9eab6fe79ae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 204 len: 0 microversion: 2.1 time: 0.425241 Aug 27 04:58:13.638714 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2443/4822] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:12 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:13.647072 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2380/4823] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:58:13 2022] DELETE /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:58:13.674208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f554a3f7-a52d-41eb-b5ee-f46cc074d4a3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:13.682427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf50b098-1cc4-4b45-9a9a-a5d9d9ead37c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:13.685672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bf50b098-1cc4-4b45-9a9a-a5d9d9ead37c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:13.695591 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f554a3f7-a52d-41eb-b5ee-f46cc074d4a3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 5879a619-026f-4434-ada8-e542bc0e377b has no mapping to a cell. Aug 27 04:58:13.708049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf50b098-1cc4-4b45-9a9a-a5d9d9ead37c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:13.711485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf50b098-1cc4-4b45-9a9a-a5d9d9ead37c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:13.713381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf50b098-1cc4-4b45-9a9a-a5d9d9ead37c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f554a3f7-a52d-41eb-b5ee-f46cc074d4a3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/5879a619-026f-4434-ada8-e542bc0e377b/action HTTP/1.1 Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 15 Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: {"os-stop": {}} Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 5879a619-026f-4434-ada8-e542bc0e377b has no mapping to a cell. Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '5879a619-026f-4434-ada8-e542bc0e377b', 'body': {'os-stop': {}}} Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 5879a619-026f-4434-ada8-e542bc0e377b has no mapping to a cell. Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:58:13.716055 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5879a619-026f-4434-ada8-e542bc0e377b has no mapping to a cell. Aug 27 04:58:13.719374 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:13.719374 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:13.719374 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:13.719374 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:13.719374 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:13.719374 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:13.719374 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:58:13.719374 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:58:13.719374 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5879a619-026f-4434-ada8-e542bc0e377b has no mapping to a cell. Aug 27 04:58:13.719374 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:13.722209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f554a3f7-a52d-41eb-b5ee-f46cc074d4a3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 5879a619-026f-4434-ada8-e542bc0e377b has no mapping to a cell. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:13.723316 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f554a3f7-a52d-41eb-b5ee-f46cc074d4a3 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/5879a619-026f-4434-ada8-e542bc0e377b/action" status: 404 len: 117 microversion: 2.1 time: 0.082535 Aug 27 04:58:13.724135 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2444/4824] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:58:13 2022] POST /compute/v2.1/servers/5879a619-026f-4434-ada8-e542bc0e377b/action => generated 117 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:58:13.734642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf50b098-1cc4-4b45-9a9a-a5d9d9ead37c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:13.735608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf50b098-1cc4-4b45-9a9a-a5d9d9ead37c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:13.736287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf50b098-1cc4-4b45-9a9a-a5d9d9ead37c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:13.743645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7498027e-a93d-41c6-bb39-6d388145f981 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:13.759178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7498027e-a93d-41c6-bb39-6d388145f981 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:13.798730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7498027e-a93d-41c6-bb39-6d388145f981 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:13.799235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7498027e-a93d-41c6-bb39-6d388145f981 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:13.799679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7498027e-a93d-41c6-bb39-6d388145f981 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:13.800389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7498027e-a93d-41c6-bb39-6d388145f981 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:13.800875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7498027e-a93d-41c6-bb39-6d388145f981 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:13.801303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7498027e-a93d-41c6-bb39-6d388145f981 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:14.110424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bf50b098-1cc4-4b45-9a9a-a5d9d9ead37c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:14.124429 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bf50b098-1cc4-4b45-9a9a-a5d9d9ead37c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1397 microversion: 2.1 time: 0.472268 Aug 27 04:58:14.130076 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2381/4825] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:13 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1397 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:14.141509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bb345102-180c-4880-8f42-faf0c5302878 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:14.142986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bb345102-180c-4880-8f42-faf0c5302878 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:14.156973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb345102-180c-4880-8f42-faf0c5302878 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:14.157594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb345102-180c-4880-8f42-faf0c5302878 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:14.157912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb345102-180c-4880-8f42-faf0c5302878 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:14.159623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb345102-180c-4880-8f42-faf0c5302878 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:14.160104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb345102-180c-4880-8f42-faf0c5302878 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:14.160555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb345102-180c-4880-8f42-faf0c5302878 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:14.362334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bb345102-180c-4880-8f42-faf0c5302878 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:14.378380 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bb345102-180c-4880-8f42-faf0c5302878 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1318 microversion: 2.1 time: 0.245616 Aug 27 04:58:14.386692 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2382/4826] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:14 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:14.909897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d51a02ed-686a-4636-b2ee-e8bee98bc56c tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Action: 'create', calling method: .version_select at 0x7f1f21636310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-965891831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODzJvQtnyFIw4TnO1NYrwwqqYyF3LtXbvRbyr4QRqgxii+TKITf8U0mSmaT6FjkyvbuguK5obJ2ogkCdNjilNGw0FpAGYHk0kDY3SxGH3qjGf+FiJoz3a4Us3qdgF7Giw=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:14.951778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-d51a02ed-686a-4636-b2ee-e8bee98bc56c tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Getting quotas for project 85633ba41ad24104bbe326cae9b1cfdc. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:58:14.973302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-d51a02ed-686a-4636-b2ee-e8bee98bc56c tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Getting quotas for user 9a461972bdc04f17b181940db823dbe0 and project 85633ba41ad24104bbe326cae9b1cfdc. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:58:15.075124 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d51a02ed-686a-4636-b2ee-e8bee98bc56c tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.171796 Aug 27 04:58:15.076452 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2383/4827] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:58:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:15.152236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c8a71ac-b377-4056-8820-f30532427f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:15.153360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4c8a71ac-b377-4056-8820-f30532427f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:15.164887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c8a71ac-b377-4056-8820-f30532427f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:15.171972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c8a71ac-b377-4056-8820-f30532427f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:15.172727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c8a71ac-b377-4056-8820-f30532427f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:15.174675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c8a71ac-b377-4056-8820-f30532427f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:15.175376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c8a71ac-b377-4056-8820-f30532427f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:15.176040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c8a71ac-b377-4056-8820-f30532427f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:15.192481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7498027e-a93d-41c6-bb39-6d388145f981 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:15.206701 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7498027e-a93d-41c6-bb39-6d388145f981 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 1.476111 Aug 27 04:58:15.207805 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2445/4828] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:13 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:15.237344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa83bb6a-120f-4822-a840-2b6fec4c1f61 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:15.238728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fa83bb6a-120f-4822-a840-2b6fec4c1f61 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:15.263347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa83bb6a-120f-4822-a840-2b6fec4c1f61 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:15.264095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa83bb6a-120f-4822-a840-2b6fec4c1f61 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:15.264888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa83bb6a-120f-4822-a840-2b6fec4c1f61 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:15.265761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa83bb6a-120f-4822-a840-2b6fec4c1f61 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:15.266394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa83bb6a-120f-4822-a840-2b6fec4c1f61 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:15.270193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa83bb6a-120f-4822-a840-2b6fec4c1f61 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:16.199505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4c8a71ac-b377-4056-8820-f30532427f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:16.216663 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4c8a71ac-b377-4056-8820-f30532427f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1397 microversion: 2.1 time: 1.067006 Aug 27 04:58:16.234343 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2384/4829] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:15 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1397 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:58:16.260281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f0a5d2b1-040a-4be0-a235-cec31f4b2ac9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:16.262658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f0a5d2b1-040a-4be0-a235-cec31f4b2ac9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:16.289641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0a5d2b1-040a-4be0-a235-cec31f4b2ac9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:16.292997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0a5d2b1-040a-4be0-a235-cec31f4b2ac9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:16.293672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0a5d2b1-040a-4be0-a235-cec31f4b2ac9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:16.294642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0a5d2b1-040a-4be0-a235-cec31f4b2ac9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:16.295257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0a5d2b1-040a-4be0-a235-cec31f4b2ac9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:16.295848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0a5d2b1-040a-4be0-a235-cec31f4b2ac9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:16.530208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa83bb6a-120f-4822-a840-2b6fec4c1f61 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:16.543063 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa83bb6a-120f-4822-a840-2b6fec4c1f61 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 1.313137 Aug 27 04:58:16.544024 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2446/4830] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:15 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:16.578311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d02e066-c1a5-41ba-a1e3-9773d8e529cd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:16.579306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d02e066-c1a5-41ba-a1e3-9773d8e529cd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 4c2bc89d-cfc3-4c62-aee4-5eaa147fff5d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:16.588839 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7d02e066-c1a5-41ba-a1e3-9773d8e529cd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 4c2bc89d-cfc3-4c62-aee4-5eaa147fff5d could not be found. Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d02e066-c1a5-41ba-a1e3-9773d8e529cd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/4c2bc89d-cfc3-4c62-aee4-5eaa147fff5d/action HTTP/1.1 Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 15 Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: {"suspend": {}} Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 4c2bc89d-cfc3-4c62-aee4-5eaa147fff5d could not be found. Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '4c2bc89d-cfc3-4c62-aee4-5eaa147fff5d', 'body': {'suspend': {}}} Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2bc89d-cfc3-4c62-aee4-5eaa147fff5d could not be found. Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2bc89d-cfc3-4c62-aee4-5eaa147fff5d could not be found. Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:16.594048 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:16.598418 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:58:16.598418 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:58:16.598418 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2bc89d-cfc3-4c62-aee4-5eaa147fff5d could not be found. Aug 27 04:58:16.598418 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:16.601147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d02e066-c1a5-41ba-a1e3-9773d8e529cd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 4c2bc89d-cfc3-4c62-aee4-5eaa147fff5d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:16.605658 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d02e066-c1a5-41ba-a1e3-9773d8e529cd tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/4c2bc89d-cfc3-4c62-aee4-5eaa147fff5d/action" status: 404 len: 111 microversion: 2.1 time: 0.043742 Aug 27 04:58:16.610832 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2447/4831] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:58:16 2022] POST /compute/v2.1/servers/4c2bc89d-cfc3-4c62-aee4-5eaa147fff5d/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:58:16.625797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f0a5d2b1-040a-4be0-a235-cec31f4b2ac9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:16.650464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc34fff7-efcd-4ee0-af2d-117ef08300f8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:16.655281 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f0a5d2b1-040a-4be0-a235-cec31f4b2ac9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1324 microversion: 2.1 time: 0.416428 Aug 27 04:58:16.663567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc34fff7-efcd-4ee0-af2d-117ef08300f8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:16.663985 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2385/4832] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:16 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1324 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:16.675680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc34fff7-efcd-4ee0-af2d-117ef08300f8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:16.683918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc34fff7-efcd-4ee0-af2d-117ef08300f8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:16.684578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc34fff7-efcd-4ee0-af2d-117ef08300f8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:16.685409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc34fff7-efcd-4ee0-af2d-117ef08300f8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:16.686311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc34fff7-efcd-4ee0-af2d-117ef08300f8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:16.687064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc34fff7-efcd-4ee0-af2d-117ef08300f8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:17.111736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cc34fff7-efcd-4ee0-af2d-117ef08300f8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:17.122087 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc34fff7-efcd-4ee0-af2d-117ef08300f8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.505315 Aug 27 04:58:17.143144 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2448/4833] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:16 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:17.160911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9882e33d-206c-4517-a554-098f1b985693 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:17.162525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9882e33d-206c-4517-a554-098f1b985693 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:17.201812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9882e33d-206c-4517-a554-098f1b985693 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:17.202454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9882e33d-206c-4517-a554-098f1b985693 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:17.203693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9882e33d-206c-4517-a554-098f1b985693 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:17.218566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9882e33d-206c-4517-a554-098f1b985693 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:17.219311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9882e33d-206c-4517-a554-098f1b985693 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:17.221297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9882e33d-206c-4517-a554-098f1b985693 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:17.258310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be238afc-00d2-4c60-84f0-5c66b7f79709 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:17.258923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-be238afc-00d2-4c60-84f0-5c66b7f79709 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:17.277049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be238afc-00d2-4c60-84f0-5c66b7f79709 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:17.285789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be238afc-00d2-4c60-84f0-5c66b7f79709 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:17.288784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be238afc-00d2-4c60-84f0-5c66b7f79709 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:17.289733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be238afc-00d2-4c60-84f0-5c66b7f79709 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:17.290365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be238afc-00d2-4c60-84f0-5c66b7f79709 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:17.293360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be238afc-00d2-4c60-84f0-5c66b7f79709 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:17.879040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9882e33d-206c-4517-a554-098f1b985693 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:17.892255 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9882e33d-206c-4517-a554-098f1b985693 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.736251 Aug 27 04:58:17.892889 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2386/4834] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:17 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:17.912275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be238afc-00d2-4c60-84f0-5c66b7f79709 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:17.913274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-092dbca8-eeba-4db5-8642-f38ebda196a4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:17.913902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-092dbca8-eeba-4db5-8642-f38ebda196a4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:17.924054 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be238afc-00d2-4c60-84f0-5c66b7f79709 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1355 microversion: 2.1 time: 0.670078 Aug 27 04:58:17.925902 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2449/4835] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:17 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1355 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:58:17.936989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-744a6135-8999-4ce4-bdec-d80b34973341 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:17.937525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-744a6135-8999-4ce4-bdec-d80b34973341 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:17.947041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-092dbca8-eeba-4db5-8642-f38ebda196a4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:17.947536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-092dbca8-eeba-4db5-8642-f38ebda196a4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:17.947980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-092dbca8-eeba-4db5-8642-f38ebda196a4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:17.949245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-092dbca8-eeba-4db5-8642-f38ebda196a4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:17.949614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-744a6135-8999-4ce4-bdec-d80b34973341 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:17.949774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-092dbca8-eeba-4db5-8642-f38ebda196a4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:17.950121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-092dbca8-eeba-4db5-8642-f38ebda196a4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:17.953177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-744a6135-8999-4ce4-bdec-d80b34973341 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:17.967733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-744a6135-8999-4ce4-bdec-d80b34973341 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:17.968848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-744a6135-8999-4ce4-bdec-d80b34973341 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:17.969482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-744a6135-8999-4ce4-bdec-d80b34973341 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:17.970060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-744a6135-8999-4ce4-bdec-d80b34973341 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:18.036233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-744a6135-8999-4ce4-bdec-d80b34973341 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lazy-loading 'flavor' on Instance uuid 228b4767-bbe2-41d0-a7d4-a6670e79043f {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:58:18.356662 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-744a6135-8999-4ce4-bdec-d80b34973341 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action" status: 202 len: 0 microversion: 2.1 time: 0.429302 Aug 27 04:58:18.357796 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2450/4836] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:58:17 2022] POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:58:18.373853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7f51f1ac-9ef9-4193-9abd-e9278b4e06fb req-80140ae3-6e8b-4cc2-b2f0-5ed65c174bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed4facb-b782-4d67-8f23-b527744e747f", "name": "network-vif-deleted", "tag": "a6feffab-3e0f-4541-85c9-fb49c8e1ddf8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:18.431657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7f51f1ac-9ef9-4193-9abd-e9278b4e06fb req-80140ae3-6e8b-4cc2-b2f0-5ed65c174bd9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:18.432369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7f51f1ac-9ef9-4193-9abd-e9278b4e06fb req-80140ae3-6e8b-4cc2-b2f0-5ed65c174bd9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:18.433536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7f51f1ac-9ef9-4193-9abd-e9278b4e06fb req-80140ae3-6e8b-4cc2-b2f0-5ed65c174bd9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:18.457874 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7f51f1ac-9ef9-4193-9abd-e9278b4e06fb req-80140ae3-6e8b-4cc2-b2f0-5ed65c174bd9 service nova] Creating event network-vif-deleted:a6feffab-3e0f-4541-85c9-fb49c8e1ddf8 for instance 8ed4facb-b782-4d67-8f23-b527744e747f on n-h2-854823-1 Aug 27 04:58:18.464359 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7f51f1ac-9ef9-4193-9abd-e9278b4e06fb req-80140ae3-6e8b-4cc2-b2f0-5ed65c174bd9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104931 Aug 27 04:58:18.465919 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2451/4837] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:18.471419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aaabb791-436f-410e-add5-b6504114fe46 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:18.474279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aaabb791-436f-410e-add5-b6504114fe46 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:18.509145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-092dbca8-eeba-4db5-8642-f38ebda196a4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:18.515498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaabb791-436f-410e-add5-b6504114fe46 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:18.516018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaabb791-436f-410e-add5-b6504114fe46 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:18.516513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaabb791-436f-410e-add5-b6504114fe46 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:18.517263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaabb791-436f-410e-add5-b6504114fe46 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:18.517731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaabb791-436f-410e-add5-b6504114fe46 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:18.518164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaabb791-436f-410e-add5-b6504114fe46 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:18.525919 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-092dbca8-eeba-4db5-8642-f38ebda196a4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1391 microversion: 2.1 time: 0.617130 Aug 27 04:58:18.526863 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2387/4838] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:17 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1391 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:18.949919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0346a8ed-b17f-4c80-b41e-354fbc1ed63b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:18.950827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0346a8ed-b17f-4c80-b41e-354fbc1ed63b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:18.963664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0346a8ed-b17f-4c80-b41e-354fbc1ed63b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:18.972865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0346a8ed-b17f-4c80-b41e-354fbc1ed63b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:18.973765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0346a8ed-b17f-4c80-b41e-354fbc1ed63b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:18.974990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0346a8ed-b17f-4c80-b41e-354fbc1ed63b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:18.975600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0346a8ed-b17f-4c80-b41e-354fbc1ed63b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:18.976189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0346a8ed-b17f-4c80-b41e-354fbc1ed63b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:19.175712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0346a8ed-b17f-4c80-b41e-354fbc1ed63b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:19.188637 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0346a8ed-b17f-4c80-b41e-354fbc1ed63b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1188 microversion: 2.1 time: 0.243297 Aug 27 04:58:19.190781 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2388/4839] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:18 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1188 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:19.399158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aaabb791-436f-410e-add5-b6504114fe46 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:19.415305 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aaabb791-436f-410e-add5-b6504114fe46 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1513 microversion: 2.1 time: 0.945687 Aug 27 04:58:19.418185 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2452/4840] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:18 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1513 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:19.550953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5b396ee6-31ba-4935-a1a8-4917d7ca9e71 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:19.551890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5b396ee6-31ba-4935-a1a8-4917d7ca9e71 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:19.565451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b396ee6-31ba-4935-a1a8-4917d7ca9e71 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:19.566047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b396ee6-31ba-4935-a1a8-4917d7ca9e71 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:19.567155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b396ee6-31ba-4935-a1a8-4917d7ca9e71 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:19.568651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b396ee6-31ba-4935-a1a8-4917d7ca9e71 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:19.569191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b396ee6-31ba-4935-a1a8-4917d7ca9e71 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:19.572509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b396ee6-31ba-4935-a1a8-4917d7ca9e71 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:19.997807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5b396ee6-31ba-4935-a1a8-4917d7ca9e71 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:20.019005 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5b396ee6-31ba-4935-a1a8-4917d7ca9e71 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1391 microversion: 2.1 time: 0.473147 Aug 27 04:58:20.022009 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2389/4841] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:19 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1391 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:20.214738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e333160c-ffff-40a3-8692-b00914f74dc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:20.215459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e333160c-ffff-40a3-8692-b00914f74dc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:20.225147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e333160c-ffff-40a3-8692-b00914f74dc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:20.234391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e333160c-ffff-40a3-8692-b00914f74dc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:20.235119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e333160c-ffff-40a3-8692-b00914f74dc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:20.235870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e333160c-ffff-40a3-8692-b00914f74dc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:20.236330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e333160c-ffff-40a3-8692-b00914f74dc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:20.236783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e333160c-ffff-40a3-8692-b00914f74dc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:20.414305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e333160c-ffff-40a3-8692-b00914f74dc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:20.423819 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e333160c-ffff-40a3-8692-b00914f74dc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1188 microversion: 2.1 time: 0.213552 Aug 27 04:58:20.430235 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2453/4842] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:20 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1188 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:20.442890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b70e26ea-a24a-4f14-914d-d6ba39184136 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:20.443744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b70e26ea-a24a-4f14-914d-d6ba39184136 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:20.453999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b70e26ea-a24a-4f14-914d-d6ba39184136 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:20.455549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b70e26ea-a24a-4f14-914d-d6ba39184136 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:20.456712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b70e26ea-a24a-4f14-914d-d6ba39184136 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:20.458272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b70e26ea-a24a-4f14-914d-d6ba39184136 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:20.459021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b70e26ea-a24a-4f14-914d-d6ba39184136 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:20.460024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b70e26ea-a24a-4f14-914d-d6ba39184136 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:20.559221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1b143ed5-0e95-4ff6-ac64-dcea21cd08e9 req-97fbb6c0-6f8d-42b9-9b8b-7fb4e248d79f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79131199-61d1-48f7-a53c-614f1a17098e", "tag": "0862d8e7-87b9-4566-b5e9-f057655a8991"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:20.575950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1b143ed5-0e95-4ff6-ac64-dcea21cd08e9 req-97fbb6c0-6f8d-42b9-9b8b-7fb4e248d79f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:20.576495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1b143ed5-0e95-4ff6-ac64-dcea21cd08e9 req-97fbb6c0-6f8d-42b9-9b8b-7fb4e248d79f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:20.577114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1b143ed5-0e95-4ff6-ac64-dcea21cd08e9 req-97fbb6c0-6f8d-42b9-9b8b-7fb4e248d79f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:20.589526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:20.611543 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1b143ed5-0e95-4ff6-ac64-dcea21cd08e9 req-97fbb6c0-6f8d-42b9-9b8b-7fb4e248d79f service nova] Creating event network-changed:0862d8e7-87b9-4566-b5e9-f057655a8991 for instance 79131199-61d1-48f7-a53c-614f1a17098e on n-h1-854823-1 Aug 27 04:58:20.629267 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1b143ed5-0e95-4ff6-ac64-dcea21cd08e9 req-97fbb6c0-6f8d-42b9-9b8b-7fb4e248d79f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069551 Aug 27 04:58:20.631011 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2454/4843] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:21.005919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b70e26ea-a24a-4f14-914d-d6ba39184136 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:21.009805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:21.023579 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b70e26ea-a24a-4f14-914d-d6ba39184136 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1496 microversion: 2.1 time: 0.585771 Aug 27 04:58:21.046796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-308b9c94-8fc1-4d40-a2ed-5fca085f9245 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:21.047682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-308b9c94-8fc1-4d40-a2ed-5fca085f9245 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:21.051502 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2390/4844] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:20 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1496 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:21.062807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5510e998-398d-4b4a-94ab-6bf228475be8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:21.063223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-308b9c94-8fc1-4d40-a2ed-5fca085f9245 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:21.063959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-308b9c94-8fc1-4d40-a2ed-5fca085f9245 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:21.064594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-308b9c94-8fc1-4d40-a2ed-5fca085f9245 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:21.065342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5510e998-398d-4b4a-94ab-6bf228475be8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:21.081910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-308b9c94-8fc1-4d40-a2ed-5fca085f9245 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:21.082741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-308b9c94-8fc1-4d40-a2ed-5fca085f9245 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:21.083619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-308b9c94-8fc1-4d40-a2ed-5fca085f9245 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:21.095717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5510e998-398d-4b4a-94ab-6bf228475be8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:21.096218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5510e998-398d-4b4a-94ab-6bf228475be8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:21.102653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5510e998-398d-4b4a-94ab-6bf228475be8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:21.104435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5510e998-398d-4b4a-94ab-6bf228475be8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:21.105137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5510e998-398d-4b4a-94ab-6bf228475be8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:21.105720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5510e998-398d-4b4a-94ab-6bf228475be8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:21.164118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-5510e998-398d-4b4a-94ab-6bf228475be8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lazy-loading 'flavor' on Instance uuid 228b4767-bbe2-41d0-a7d4-a6670e79043f {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:58:21.179995 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-5510e998-398d-4b4a-94ab-6bf228475be8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Cannot 'suspend' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state suspended Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5510e998-398d-4b4a-94ab-6bf228475be8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action HTTP/1.1 Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 15 Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: {"suspend": {}} Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: exception: Cannot 'suspend' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state suspended Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '228b4767-bbe2-41d0-a7d4-a6670e79043f', 'body': {'suspend': {}}} Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 228b4767-bbe2-41d0-a7d4-a6670e79043f in vm_state suspended. Cannot suspend while the instance is in this state. Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 27 04:58:21.182095 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state suspended Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state suspended Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5510e998-398d-4b4a-94ab-6bf228475be8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 409 to user: Cannot 'suspend' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state suspended {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5510e998-398d-4b4a-94ab-6bf228475be8 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action" status: 409 len: 148 microversion: 2.1 time: 0.131418 Aug 27 04:58:21.190857 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2391/4845] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:58:21 2022] POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action => generated 148 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:58:21.194460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3fb73d76-c794-406b-a1a4-182c194ae9c2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:21.195205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3fb73d76-c794-406b-a1a4-182c194ae9c2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:21.203344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fb73d76-c794-406b-a1a4-182c194ae9c2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:21.204489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fb73d76-c794-406b-a1a4-182c194ae9c2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:21.205315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fb73d76-c794-406b-a1a4-182c194ae9c2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:21.206537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fb73d76-c794-406b-a1a4-182c194ae9c2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:21.207444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fb73d76-c794-406b-a1a4-182c194ae9c2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:21.208238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fb73d76-c794-406b-a1a4-182c194ae9c2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:21.300226 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3fb73d76-c794-406b-a1a4-182c194ae9c2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action" status: 202 len: 0 microversion: 2.1 time: 0.110364 Aug 27 04:58:21.304234 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2392/4846] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:58:21 2022] POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:58:21.310605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b852b310-7257-4c8c-b21a-f25b98b81340 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:21.311800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b852b310-7257-4c8c-b21a-f25b98b81340 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:21.321868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b852b310-7257-4c8c-b21a-f25b98b81340 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:21.322541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b852b310-7257-4c8c-b21a-f25b98b81340 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:21.323136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b852b310-7257-4c8c-b21a-f25b98b81340 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:21.324897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b852b310-7257-4c8c-b21a-f25b98b81340 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:21.325663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b852b310-7257-4c8c-b21a-f25b98b81340 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:21.326447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b852b310-7257-4c8c-b21a-f25b98b81340 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:21.613706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-308b9c94-8fc1-4d40-a2ed-5fca085f9245 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:21.623452 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-308b9c94-8fc1-4d40-a2ed-5fca085f9245 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1391 microversion: 2.1 time: 0.581811 Aug 27 04:58:21.624913 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2455/4847] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:21 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1391 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:21.630682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4d0fce1d-16cf-4c53-be37-039af989f9ee tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:21.631680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4d0fce1d-16cf-4c53-be37-039af989f9ee tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:21.638507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d0fce1d-16cf-4c53-be37-039af989f9ee tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:21.639319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d0fce1d-16cf-4c53-be37-039af989f9ee tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:21.639993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d0fce1d-16cf-4c53-be37-039af989f9ee tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:21.640978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d0fce1d-16cf-4c53-be37-039af989f9ee tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:21.641779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d0fce1d-16cf-4c53-be37-039af989f9ee tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:21.642442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d0fce1d-16cf-4c53-be37-039af989f9ee tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:21.662358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b852b310-7257-4c8c-b21a-f25b98b81340 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:21.674094 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b852b310-7257-4c8c-b21a-f25b98b81340 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1502 microversion: 2.1 time: 0.368502 Aug 27 04:58:21.674719 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2393/4848] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:21 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1502 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:21.709871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:21.803999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4d0fce1d-16cf-4c53-be37-039af989f9ee tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:21.826686 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4d0fce1d-16cf-4c53-be37-039af989f9ee tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1188 microversion: 2.1 time: 0.200340 Aug 27 04:58:21.843806 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2456/4849] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:21 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1188 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:22.046673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-802415248", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "cb41d500-a08d-4364-a96b-8febc61e2864"}], "key_name": "tempest-TestNetworkBasicOps-965891831", "security_groups": [{"name": "tempest-secgroup-smoke-158377924"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:22.332230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] validate_networks() for [('cb41d500-a08d-4364-a96b-8febc61e2864', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:58:22.647251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d8dbb1a-9427-4ac2-8d60-27c555398afb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:22.648400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3d8dbb1a-9427-4ac2-8d60-27c555398afb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:22.672822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d8dbb1a-9427-4ac2-8d60-27c555398afb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:22.673569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d8dbb1a-9427-4ac2-8d60-27c555398afb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:22.674235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d8dbb1a-9427-4ac2-8d60-27c555398afb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:22.675297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d8dbb1a-9427-4ac2-8d60-27c555398afb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:22.675954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d8dbb1a-9427-4ac2-8d60-27c555398afb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:22.677416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d8dbb1a-9427-4ac2-8d60-27c555398afb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:22.957521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d8dbb1a-9427-4ac2-8d60-27c555398afb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:22.962872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:22.974842 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d8dbb1a-9427-4ac2-8d60-27c555398afb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1391 microversion: 2.1 time: 0.332725 Aug 27 04:58:22.976140 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2457/4850] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:22 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1391 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:22.986243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42d83021-4afa-41fb-8005-46976bd6d435 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:22.988672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-42d83021-4afa-41fb-8005-46976bd6d435 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:22.996971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42d83021-4afa-41fb-8005-46976bd6d435 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:22.997919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42d83021-4afa-41fb-8005-46976bd6d435 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:22.998537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42d83021-4afa-41fb-8005-46976bd6d435 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:22.999600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42d83021-4afa-41fb-8005-46976bd6d435 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:23.000869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42d83021-4afa-41fb-8005-46976bd6d435 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:23.002057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42d83021-4afa-41fb-8005-46976bd6d435 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:23.072951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:58:23.076073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:58:23.077126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:58:23.077725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:58:23.078404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:58:23.092151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:23.092969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:23.093568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:23.094479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:23.096375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:23.097238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:23.127704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Getting quotas for project 85633ba41ad24104bbe326cae9b1cfdc. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:58:23.137756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Getting quotas for user 9a461972bdc04f17b181940db823dbe0 and project 85633ba41ad24104bbe326cae9b1cfdc. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:58:23.158471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:58:23.161452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:58:23.250233 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1ed2becd-a390-4afd-860f-33e3b7619275 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.206328 Aug 27 04:58:23.251253 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2394/4851] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:58:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:58:23.263292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-438d1a8f-304f-4a88-800e-c8a549f88ee6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:23.263919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-438d1a8f-304f-4a88-800e-c8a549f88ee6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:23.276764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-438d1a8f-304f-4a88-800e-c8a549f88ee6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:23.277370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-438d1a8f-304f-4a88-800e-c8a549f88ee6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:23.277877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-438d1a8f-304f-4a88-800e-c8a549f88ee6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:23.278740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-438d1a8f-304f-4a88-800e-c8a549f88ee6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:23.279321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-438d1a8f-304f-4a88-800e-c8a549f88ee6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:23.279821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-438d1a8f-304f-4a88-800e-c8a549f88ee6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:23.382037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-438d1a8f-304f-4a88-800e-c8a549f88ee6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:23.392101 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-438d1a8f-304f-4a88-800e-c8a549f88ee6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1188 microversion: 2.1 time: 0.137008 Aug 27 04:58:23.393421 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2395/4852] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:23 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1188 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:23.424841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-545030ff-2784-431b-b88a-639e9663d05a tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:23.427892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-545030ff-2784-431b-b88a-639e9663d05a tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:23.543900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-545030ff-2784-431b-b88a-639e9663d05a tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:23.553568 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-545030ff-2784-431b-b88a-639e9663d05a tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1247 microversion: 2.1 time: 0.157718 Aug 27 04:58:23.560127 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2396/4853] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:23 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1247 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:23.849471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-42d83021-4afa-41fb-8005-46976bd6d435 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:23.859557 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42d83021-4afa-41fb-8005-46976bd6d435 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1502 microversion: 2.1 time: 0.879941 Aug 27 04:58:23.862031 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2458/4854] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:22 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1502 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:24.001730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6bbfe888-5bd5-4487-a450-dc90776d04b9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:24.002746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6bbfe888-5bd5-4487-a450-dc90776d04b9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:24.016799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bbfe888-5bd5-4487-a450-dc90776d04b9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:24.019861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bbfe888-5bd5-4487-a450-dc90776d04b9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:24.020729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bbfe888-5bd5-4487-a450-dc90776d04b9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:24.022051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bbfe888-5bd5-4487-a450-dc90776d04b9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:24.023350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bbfe888-5bd5-4487-a450-dc90776d04b9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:24.024721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bbfe888-5bd5-4487-a450-dc90776d04b9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:24.418560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-deb5aedd-6c1b-4e20-8038-aa706b9afadc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:24.419878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-deb5aedd-6c1b-4e20-8038-aa706b9afadc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:24.433100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb5aedd-6c1b-4e20-8038-aa706b9afadc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:24.441058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb5aedd-6c1b-4e20-8038-aa706b9afadc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:24.441822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb5aedd-6c1b-4e20-8038-aa706b9afadc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:24.447922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb5aedd-6c1b-4e20-8038-aa706b9afadc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:24.449902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb5aedd-6c1b-4e20-8038-aa706b9afadc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:24.452277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb5aedd-6c1b-4e20-8038-aa706b9afadc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:24.761655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-deb5aedd-6c1b-4e20-8038-aa706b9afadc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:24.780586 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-deb5aedd-6c1b-4e20-8038-aa706b9afadc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1188 microversion: 2.1 time: 0.366479 Aug 27 04:58:24.790975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6bbfe888-5bd5-4487-a450-dc90776d04b9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:24.804399 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2459/4855] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:24 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1188 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:24.806131 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6bbfe888-5bd5-4487-a450-dc90776d04b9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1391 microversion: 2.1 time: 0.808390 Aug 27 04:58:24.809220 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2397/4856] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:23 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1391 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:24.812519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29f62a3c-ca0c-4a80-94de-99305d6d8789 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:24.813577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29f62a3c-ca0c-4a80-94de-99305d6d8789 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:24.821230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29f62a3c-ca0c-4a80-94de-99305d6d8789 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:24.822040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29f62a3c-ca0c-4a80-94de-99305d6d8789 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:24.822815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29f62a3c-ca0c-4a80-94de-99305d6d8789 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:24.824306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29f62a3c-ca0c-4a80-94de-99305d6d8789 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:24.825000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29f62a3c-ca0c-4a80-94de-99305d6d8789 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:24.826102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29f62a3c-ca0c-4a80-94de-99305d6d8789 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:24.882946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8185bbc7-7f75-4600-a106-9874b400c884 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:24.883931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8185bbc7-7f75-4600-a106-9874b400c884 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:24.898158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8185bbc7-7f75-4600-a106-9874b400c884 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:24.899107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8185bbc7-7f75-4600-a106-9874b400c884 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:24.900313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8185bbc7-7f75-4600-a106-9874b400c884 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:24.903729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8185bbc7-7f75-4600-a106-9874b400c884 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:24.904434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8185bbc7-7f75-4600-a106-9874b400c884 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:24.906039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8185bbc7-7f75-4600-a106-9874b400c884 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:24.965061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29f62a3c-ca0c-4a80-94de-99305d6d8789 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:24.974319 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29f62a3c-ca0c-4a80-94de-99305d6d8789 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1299 microversion: 2.1 time: 0.166649 Aug 27 04:58:24.980907 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2460/4857] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:24 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:25.295418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8185bbc7-7f75-4600-a106-9874b400c884 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:25.309952 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8185bbc7-7f75-4600-a106-9874b400c884 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.430449 Aug 27 04:58:25.310820 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2398/4858] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:24 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:25.340398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1646f2b0-2a9d-4645-8d56-9adccf4e33a0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:25.341090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1646f2b0-2a9d-4645-8d56-9adccf4e33a0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:25.347088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1646f2b0-2a9d-4645-8d56-9adccf4e33a0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:25.347764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1646f2b0-2a9d-4645-8d56-9adccf4e33a0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:25.348472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1646f2b0-2a9d-4645-8d56-9adccf4e33a0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:25.349698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1646f2b0-2a9d-4645-8d56-9adccf4e33a0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:25.350341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1646f2b0-2a9d-4645-8d56-9adccf4e33a0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:25.350961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1646f2b0-2a9d-4645-8d56-9adccf4e33a0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:25.547288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1646f2b0-2a9d-4645-8d56-9adccf4e33a0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:25.556233 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1646f2b0-2a9d-4645-8d56-9adccf4e33a0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.219655 Aug 27 04:58:25.559532 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2461/4859] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:25 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:25.585648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68d89e99-a023-4c78-9aea-64e0802770ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:25.586201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-68d89e99-a023-4c78-9aea-64e0802770ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 17ff5e99-0a27-48f5-9a54-31d53a714875] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:25.592756 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-68d89e99-a023-4c78-9aea-64e0802770ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 17ff5e99-0a27-48f5-9a54-31d53a714875 could not be found. Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68d89e99-a023-4c78-9aea-64e0802770ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/17ff5e99-0a27-48f5-9a54-31d53a714875/action HTTP/1.1 Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 15 Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: {"unpause": {}} Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 17ff5e99-0a27-48f5-9a54-31d53a714875 could not be found. Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '17ff5e99-0a27-48f5-9a54-31d53a714875', 'body': {'unpause': {}}} Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ff5e99-0a27-48f5-9a54-31d53a714875 could not be found. Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ff5e99-0a27-48f5-9a54-31d53a714875 could not be found. Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:25.594433 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:25.598276 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:58:25.598276 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:58:25.598276 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ff5e99-0a27-48f5-9a54-31d53a714875 could not be found. Aug 27 04:58:25.598276 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:25.600636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68d89e99-a023-4c78-9aea-64e0802770ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 17ff5e99-0a27-48f5-9a54-31d53a714875 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:25.601753 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-68d89e99-a023-4c78-9aea-64e0802770ed tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/17ff5e99-0a27-48f5-9a54-31d53a714875/action" status: 404 len: 111 microversion: 2.1 time: 0.020944 Aug 27 04:58:25.608299 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2399/4860] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:58:25 2022] POST /compute/v2.1/servers/17ff5e99-0a27-48f5-9a54-31d53a714875/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:58:25.612425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d9b42fbb-da05-4a37-89ab-a88d2dfd59f9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:25.613349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d9b42fbb-da05-4a37-89ab-a88d2dfd59f9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:25.624269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9b42fbb-da05-4a37-89ab-a88d2dfd59f9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:25.626950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9b42fbb-da05-4a37-89ab-a88d2dfd59f9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:25.627442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9b42fbb-da05-4a37-89ab-a88d2dfd59f9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:25.628185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9b42fbb-da05-4a37-89ab-a88d2dfd59f9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:25.631490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9b42fbb-da05-4a37-89ab-a88d2dfd59f9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:25.631941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9b42fbb-da05-4a37-89ab-a88d2dfd59f9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:25.806755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-541e34a2-5c6b-4171-8fc2-1c29a1cb540e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:25.808019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-541e34a2-5c6b-4171-8fc2-1c29a1cb540e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:25.834066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-541e34a2-5c6b-4171-8fc2-1c29a1cb540e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:25.843379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-541e34a2-5c6b-4171-8fc2-1c29a1cb540e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:25.845322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-541e34a2-5c6b-4171-8fc2-1c29a1cb540e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:25.846550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-541e34a2-5c6b-4171-8fc2-1c29a1cb540e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:25.851375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-541e34a2-5c6b-4171-8fc2-1c29a1cb540e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:25.855489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-541e34a2-5c6b-4171-8fc2-1c29a1cb540e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:25.985451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d9b42fbb-da05-4a37-89ab-a88d2dfd59f9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:26.005456 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d9b42fbb-da05-4a37-89ab-a88d2dfd59f9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.397765 Aug 27 04:58:26.019341 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2462/4861] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:25 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:26.032500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8c54b86-b2c1-4394-8a4e-c065e2e7399f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:26.034260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8c54b86-b2c1-4394-8a4e-c065e2e7399f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:26.045791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8c54b86-b2c1-4394-8a4e-c065e2e7399f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:26.046627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8c54b86-b2c1-4394-8a4e-c065e2e7399f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:26.047257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8c54b86-b2c1-4394-8a4e-c065e2e7399f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:26.048183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8c54b86-b2c1-4394-8a4e-c065e2e7399f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:26.049027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8c54b86-b2c1-4394-8a4e-c065e2e7399f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:26.049868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8c54b86-b2c1-4394-8a4e-c065e2e7399f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:26.140480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-541e34a2-5c6b-4171-8fc2-1c29a1cb540e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:26.153347 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-541e34a2-5c6b-4171-8fc2-1c29a1cb540e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 200 len: 1188 microversion: 2.1 time: 0.350494 Aug 27 04:58:26.158300 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2400/4862] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:25 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 1188 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:58:26.178761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-82224575-a953-4cf5-a829-3ff0e9d61229 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:26.187235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-82224575-a953-4cf5-a829-3ff0e9d61229 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:26.205062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82224575-a953-4cf5-a829-3ff0e9d61229 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:26.205662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82224575-a953-4cf5-a829-3ff0e9d61229 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:26.206238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82224575-a953-4cf5-a829-3ff0e9d61229 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:26.207021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82224575-a953-4cf5-a829-3ff0e9d61229 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:26.207478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82224575-a953-4cf5-a829-3ff0e9d61229 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:26.208056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82224575-a953-4cf5-a829-3ff0e9d61229 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:26.387780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-82224575-a953-4cf5-a829-3ff0e9d61229 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:26.411930 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-82224575-a953-4cf5-a829-3ff0e9d61229 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1305 microversion: 2.1 time: 0.243529 Aug 27 04:58:26.415036 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2401/4863] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:26 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1305 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:26.421454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c6795d5-c5b0-4abd-8c51-00bed93c30de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:26.422225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4c6795d5-c5b0-4abd-8c51-00bed93c30de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:26.422437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d8c54b86-b2c1-4394-8a4e-c065e2e7399f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:26.430271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c6795d5-c5b0-4abd-8c51-00bed93c30de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:26.431533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c6795d5-c5b0-4abd-8c51-00bed93c30de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:26.432077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c6795d5-c5b0-4abd-8c51-00bed93c30de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:26.433643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c6795d5-c5b0-4abd-8c51-00bed93c30de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:26.434385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c6795d5-c5b0-4abd-8c51-00bed93c30de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:26.435037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c6795d5-c5b0-4abd-8c51-00bed93c30de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:26.443434 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8c54b86-b2c1-4394-8a4e-c065e2e7399f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1391 microversion: 2.1 time: 0.422640 Aug 27 04:58:26.446552 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2463/4864] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:26 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1391 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:26.894849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4c6795d5-c5b0-4abd-8c51-00bed93c30de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:26.928290 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4c6795d5-c5b0-4abd-8c51-00bed93c30de tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.511893 Aug 27 04:58:26.930380 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2402/4865] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:26 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:26.963202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1666391d-c44f-42c3-b120-a461d678badb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:26.963202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1666391d-c44f-42c3-b120-a461d678badb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:27.006188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1666391d-c44f-42c3-b120-a461d678badb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:27.006859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1666391d-c44f-42c3-b120-a461d678badb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:27.007127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1666391d-c44f-42c3-b120-a461d678badb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:27.007857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1666391d-c44f-42c3-b120-a461d678badb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:27.008323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1666391d-c44f-42c3-b120-a461d678badb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:27.008778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1666391d-c44f-42c3-b120-a461d678badb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:27.079655 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1666391d-c44f-42c3-b120-a461d678badb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Cannot 'unpause' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1666391d-c44f-42c3-b120-a461d678badb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action HTTP/1.1 Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 15 Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: {"unpause": {}} Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: exception: Cannot 'unpause' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '228b4767-bbe2-41d0-a7d4-a6670e79043f', 'body': {'unpause': {}}} Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 228b4767-bbe2-41d0-a7d4-a6670e79043f in vm_state active. Cannot unpause while the instance is in this state. Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:27.089907 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:27.093735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:27.093735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:58:27.093735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:58:27.093735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:58:27.093735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:27.098931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1666391d-c44f-42c3-b120-a461d678badb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 409 to user: Cannot 'unpause' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:27.103580 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1666391d-c44f-42c3-b120-a461d678badb tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action" status: 409 len: 145 microversion: 2.1 time: 0.153602 Aug 27 04:58:27.106756 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2464/4866] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:58:26 2022] POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action => generated 145 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:58:27.128556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-257cd64e-ea18-4654-86bb-3cc4ddb0a86a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:27.130403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-257cd64e-ea18-4654-86bb-3cc4ddb0a86a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:27.140221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-257cd64e-ea18-4654-86bb-3cc4ddb0a86a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:27.141284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-257cd64e-ea18-4654-86bb-3cc4ddb0a86a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:27.141960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-257cd64e-ea18-4654-86bb-3cc4ddb0a86a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:27.142937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-257cd64e-ea18-4654-86bb-3cc4ddb0a86a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:27.146757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-257cd64e-ea18-4654-86bb-3cc4ddb0a86a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:27.148138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-257cd64e-ea18-4654-86bb-3cc4ddb0a86a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:27.191463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-631c00ae-f1ac-4881-9240-6f9b7f2aa1d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:27.192408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-631c00ae-f1ac-4881-9240-6f9b7f2aa1d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 8ed4facb-b782-4d67-8f23-b527744e747f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:27.212399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-631c00ae-f1ac-4881-9240-6f9b7f2aa1d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:27.213359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-631c00ae-f1ac-4881-9240-6f9b7f2aa1d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:27.222758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-631c00ae-f1ac-4881-9240-6f9b7f2aa1d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:27.226912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-631c00ae-f1ac-4881-9240-6f9b7f2aa1d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:27.229194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-631c00ae-f1ac-4881-9240-6f9b7f2aa1d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:27.231885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-631c00ae-f1ac-4881-9240-6f9b7f2aa1d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:27.309479 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-631c00ae-f1ac-4881-9240-6f9b7f2aa1d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance 8ed4facb-b782-4d67-8f23-b527744e747f could not be found. Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-631c00ae-f1ac-4881-9240-6f9b7f2aa1d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f HTTP/1.1 Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 8ed4facb-b782-4d67-8f23-b527744e747f could not be found. Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '8ed4facb-b782-4d67-8f23-b527744e747f'} Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ed4facb-b782-4d67-8f23-b527744e747f could not be found. Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ed4facb-b782-4d67-8f23-b527744e747f could not be found. Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:27.311085 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:27.314730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:27.314730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:27.314730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:27.314730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:58:27.314730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:58:27.314730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ed4facb-b782-4d67-8f23-b527744e747f could not be found. Aug 27 04:58:27.314730 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:27.314730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-631c00ae-f1ac-4881-9240-6f9b7f2aa1d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance 8ed4facb-b782-4d67-8f23-b527744e747f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:27.314730 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-631c00ae-f1ac-4881-9240-6f9b7f2aa1d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f" status: 404 len: 111 microversion: 2.1 time: 0.125539 Aug 27 04:58:27.317349 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2465/4867] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:27 2022] GET /compute/v2.1/servers/8ed4facb-b782-4d67-8f23-b527744e747f => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:58:27.447672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69d6ea34-c98b-4efc-a784-93c4aa6e074c tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:27.450716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69d6ea34-c98b-4efc-a784-93c4aa6e074c tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:27.470930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69d6ea34-c98b-4efc-a784-93c4aa6e074c tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:27.471499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69d6ea34-c98b-4efc-a784-93c4aa6e074c tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:27.471952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69d6ea34-c98b-4efc-a784-93c4aa6e074c tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:27.472773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69d6ea34-c98b-4efc-a784-93c4aa6e074c tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:27.473356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69d6ea34-c98b-4efc-a784-93c4aa6e074c tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:27.487125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69d6ea34-c98b-4efc-a784-93c4aa6e074c tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:27.750646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-257cd64e-ea18-4654-86bb-3cc4ddb0a86a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:27.761519 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-257cd64e-ea18-4654-86bb-3cc4ddb0a86a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.649564 Aug 27 04:58:27.766027 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2403/4868] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:27 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:27.774271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5aebd909-7618-406e-83bf-b6847ec08282 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:27.776969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5aebd909-7618-406e-83bf-b6847ec08282 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:27.805886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5aebd909-7618-406e-83bf-b6847ec08282 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:27.806319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5aebd909-7618-406e-83bf-b6847ec08282 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:27.806765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5aebd909-7618-406e-83bf-b6847ec08282 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:27.810473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5aebd909-7618-406e-83bf-b6847ec08282 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:27.811320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5aebd909-7618-406e-83bf-b6847ec08282 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:27.817800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5aebd909-7618-406e-83bf-b6847ec08282 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:27.962982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-69d6ea34-c98b-4efc-a784-93c4aa6e074c tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:27.973446 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69d6ea34-c98b-4efc-a784-93c4aa6e074c tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1372 microversion: 2.1 time: 0.536812 Aug 27 04:58:27.988595 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2466/4869] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:27 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1372 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:27.999963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b36fb6bc-0969-431b-ad75-35a15dcdd424 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:28.004256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b36fb6bc-0969-431b-ad75-35a15dcdd424 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:28.017516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b36fb6bc-0969-431b-ad75-35a15dcdd424 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:28.019065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b36fb6bc-0969-431b-ad75-35a15dcdd424 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:28.019726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b36fb6bc-0969-431b-ad75-35a15dcdd424 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:28.021024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b36fb6bc-0969-431b-ad75-35a15dcdd424 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:28.021714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b36fb6bc-0969-431b-ad75-35a15dcdd424 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:28.022943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b36fb6bc-0969-431b-ad75-35a15dcdd424 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:28.098510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5aebd909-7618-406e-83bf-b6847ec08282 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:28.115177 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5aebd909-7618-406e-83bf-b6847ec08282 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1391 microversion: 2.1 time: 0.347493 Aug 27 04:58:28.119273 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2404/4870] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:27 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1391 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:28.276425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b36fb6bc-0969-431b-ad75-35a15dcdd424 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:28.293835 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b36fb6bc-0969-431b-ad75-35a15dcdd424 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.303757 Aug 27 04:58:28.295070 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2467/4871] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:27 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:28.317477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b74d8a06-0840-4df9-8f9a-488ac65bba45 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:28.318573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b74d8a06-0840-4df9-8f9a-488ac65bba45 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: e9f2e481-ddd0-455f-9056-b4d86a58568f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:28.328363 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-b74d8a06-0840-4df9-8f9a-488ac65bba45 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance e9f2e481-ddd0-455f-9056-b4d86a58568f could not be found. Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b74d8a06-0840-4df9-8f9a-488ac65bba45 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/e9f2e481-ddd0-455f-9056-b4d86a58568f/action HTTP/1.1 Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 18 Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: {"unshelve": null} Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance e9f2e481-ddd0-455f-9056-b4d86a58568f could not be found. Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'e9f2e481-ddd0-455f-9056-b4d86a58568f', 'body': {'unshelve': None}} Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f2e481-ddd0-455f-9056-b4d86a58568f could not be found. Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f2e481-ddd0-455f-9056-b4d86a58568f could not be found. Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:28.331537 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:28.335305 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:28.335305 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:28.335305 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:28.335305 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:58:28.335305 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:58:28.335305 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f2e481-ddd0-455f-9056-b4d86a58568f could not be found. Aug 27 04:58:28.335305 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:28.335305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b74d8a06-0840-4df9-8f9a-488ac65bba45 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance e9f2e481-ddd0-455f-9056-b4d86a58568f could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:28.335305 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b74d8a06-0840-4df9-8f9a-488ac65bba45 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/e9f2e481-ddd0-455f-9056-b4d86a58568f/action" status: 404 len: 111 microversion: 2.1 time: 0.020043 Aug 27 04:58:28.343471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54e1a58e-2442-45f7-8605-59b842812007 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:28.344102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-54e1a58e-2442-45f7-8605-59b842812007 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:28.349697 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2405/4872] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:58:28 2022] POST /compute/v2.1/servers/e9f2e481-ddd0-455f-9056-b4d86a58568f/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:58:28.360165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54e1a58e-2442-45f7-8605-59b842812007 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:28.361540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54e1a58e-2442-45f7-8605-59b842812007 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:28.362997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54e1a58e-2442-45f7-8605-59b842812007 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:28.366051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54e1a58e-2442-45f7-8605-59b842812007 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:28.368805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54e1a58e-2442-45f7-8605-59b842812007 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:28.371169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54e1a58e-2442-45f7-8605-59b842812007 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:28.685316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-54e1a58e-2442-45f7-8605-59b842812007 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:28.698769 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-54e1a58e-2442-45f7-8605-59b842812007 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.359081 Aug 27 04:58:28.699440 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2468/4873] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:28 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:28.727751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-32f78d27-8ec3-4aa9-ba5e-da2679529485 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:28.728394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-32f78d27-8ec3-4aa9-ba5e-da2679529485 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:28.748818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b9e21156-d889-45d8-997f-ddb9836a7512 req-b0147e0b-f038-4b62-902c-5b2295cb4ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c8006a-b6ce-40d9-9136-6a08964d6544", "tag": "953af6d2-bfae-4d88-aac1-32046c271aa2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:28.754521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32f78d27-8ec3-4aa9-ba5e-da2679529485 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:28.755036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32f78d27-8ec3-4aa9-ba5e-da2679529485 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:28.755485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32f78d27-8ec3-4aa9-ba5e-da2679529485 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:28.756209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32f78d27-8ec3-4aa9-ba5e-da2679529485 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:28.756931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32f78d27-8ec3-4aa9-ba5e-da2679529485 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:28.757524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32f78d27-8ec3-4aa9-ba5e-da2679529485 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:28.772891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b9e21156-d889-45d8-997f-ddb9836a7512 req-b0147e0b-f038-4b62-902c-5b2295cb4ed0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:28.777297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b9e21156-d889-45d8-997f-ddb9836a7512 req-b0147e0b-f038-4b62-902c-5b2295cb4ed0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:28.777943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b9e21156-d889-45d8-997f-ddb9836a7512 req-b0147e0b-f038-4b62-902c-5b2295cb4ed0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:28.813838 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b9e21156-d889-45d8-997f-ddb9836a7512 req-b0147e0b-f038-4b62-902c-5b2295cb4ed0 service nova] Creating event network-changed:953af6d2-bfae-4d88-aac1-32046c271aa2 for instance f7c8006a-b6ce-40d9-9136-6a08964d6544 on n-h2-854823-1 Aug 27 04:58:28.822392 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b9e21156-d889-45d8-997f-ddb9836a7512 req-b0147e0b-f038-4b62-902c-5b2295cb4ed0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080270 Aug 27 04:58:28.823677 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2469/4874] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:28.832385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c0356a5a-764e-43e7-9b6b-d5ed5c6cde5a req-48b8a857-2db1-401b-88d0-7f479e2f156e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79131199-61d1-48f7-a53c-614f1a17098e", "name": "network-vif-plugged", "status": "completed", "tag": "0862d8e7-87b9-4566-b5e9-f057655a8991"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:28.843457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c0356a5a-764e-43e7-9b6b-d5ed5c6cde5a req-48b8a857-2db1-401b-88d0-7f479e2f156e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:28.845169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c0356a5a-764e-43e7-9b6b-d5ed5c6cde5a req-48b8a857-2db1-401b-88d0-7f479e2f156e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:28.845829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c0356a5a-764e-43e7-9b6b-d5ed5c6cde5a req-48b8a857-2db1-401b-88d0-7f479e2f156e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:28.859300 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c0356a5a-764e-43e7-9b6b-d5ed5c6cde5a req-48b8a857-2db1-401b-88d0-7f479e2f156e service nova] Creating event network-vif-plugged:0862d8e7-87b9-4566-b5e9-f057655a8991 for instance 79131199-61d1-48f7-a53c-614f1a17098e on n-h1-854823-1 Aug 27 04:58:28.867647 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c0356a5a-764e-43e7-9b6b-d5ed5c6cde5a req-48b8a857-2db1-401b-88d0-7f479e2f156e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041776 Aug 27 04:58:28.869163 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2470/4875] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:28.995521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a29583ec-6385-4779-a281-f9426f6fbf15 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:28.996688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a29583ec-6385-4779-a281-f9426f6fbf15 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:29.006121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a29583ec-6385-4779-a281-f9426f6fbf15 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:29.006861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a29583ec-6385-4779-a281-f9426f6fbf15 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:29.008242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a29583ec-6385-4779-a281-f9426f6fbf15 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:29.009433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a29583ec-6385-4779-a281-f9426f6fbf15 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:29.010060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a29583ec-6385-4779-a281-f9426f6fbf15 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:29.010680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a29583ec-6385-4779-a281-f9426f6fbf15 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:29.248366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a29583ec-6385-4779-a281-f9426f6fbf15 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:29.263281 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a29583ec-6385-4779-a281-f9426f6fbf15 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1372 microversion: 2.1 time: 0.272026 Aug 27 04:58:29.264812 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2471/4876] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:28 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1372 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:29.270767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-10fee5c5-17a3-451e-b85f-7521a5c78583 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:29.271668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-10fee5c5-17a3-451e-b85f-7521a5c78583 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:29.279686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10fee5c5-17a3-451e-b85f-7521a5c78583 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:29.281653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10fee5c5-17a3-451e-b85f-7521a5c78583 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:29.282344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10fee5c5-17a3-451e-b85f-7521a5c78583 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:29.283340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10fee5c5-17a3-451e-b85f-7521a5c78583 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:29.284619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10fee5c5-17a3-451e-b85f-7521a5c78583 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:29.285414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10fee5c5-17a3-451e-b85f-7521a5c78583 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:29.313739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-32f78d27-8ec3-4aa9-ba5e-da2679529485 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:29.341190 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-32f78d27-8ec3-4aa9-ba5e-da2679529485 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.617963 Aug 27 04:58:29.341718 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2406/4877] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:28 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:29.364602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-387f0b72-1fec-4601-a617-966f150a25f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:29.371621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-387f0b72-1fec-4601-a617-966f150a25f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:29.385210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-387f0b72-1fec-4601-a617-966f150a25f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:29.388040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-387f0b72-1fec-4601-a617-966f150a25f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:29.389049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-387f0b72-1fec-4601-a617-966f150a25f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:29.393599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-387f0b72-1fec-4601-a617-966f150a25f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:29.394955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-387f0b72-1fec-4601-a617-966f150a25f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:29.396281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-387f0b72-1fec-4601-a617-966f150a25f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:29.573291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-10fee5c5-17a3-451e-b85f-7521a5c78583 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:29.584795 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-10fee5c5-17a3-451e-b85f-7521a5c78583 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1391 microversion: 2.1 time: 0.318538 Aug 27 04:58:29.593893 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2472/4878] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:29 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1391 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:29.812234 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-387f0b72-1fec-4601-a617-966f150a25f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Cannot 'unshelve' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-387f0b72-1fec-4601-a617-966f150a25f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action HTTP/1.1 Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 18 Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: {"unshelve": null} Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: exception: Cannot 'unshelve' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '228b4767-bbe2-41d0-a7d4-a6670e79043f', 'body': {'unshelve': None}} Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 228b4767-bbe2-41d0-a7d4-a6670e79043f in vm_state active. Cannot unshelve while the instance is in this state. Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 04:58:29.815233 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 04:58:29.820243 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:58:29.820243 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:29.820243 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:29.820243 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:29.820243 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:29.820243 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:29.820243 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:29.820243 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:58:29.820243 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:58:29.820243 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active Aug 27 04:58:29.820243 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:29.820243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-387f0b72-1fec-4601-a617-966f150a25f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 409 to user: Cannot 'unshelve' instance 228b4767-bbe2-41d0-a7d4-a6670e79043f while it is in vm_state active {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:29.820243 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-387f0b72-1fec-4601-a617-966f150a25f2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action" status: 409 len: 146 microversion: 2.1 time: 0.458369 Aug 27 04:58:29.820243 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2407/4879] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:58:29 2022] POST /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f/action => generated 146 bytes in 459 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:58:29.827512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd8b4179-36eb-4e49-8177-c122da66e13f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:29.828142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd8b4179-36eb-4e49-8177-c122da66e13f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:29.836493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd8b4179-36eb-4e49-8177-c122da66e13f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:29.837436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd8b4179-36eb-4e49-8177-c122da66e13f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:29.838082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd8b4179-36eb-4e49-8177-c122da66e13f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:29.839286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd8b4179-36eb-4e49-8177-c122da66e13f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:29.840020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd8b4179-36eb-4e49-8177-c122da66e13f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:29.840841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd8b4179-36eb-4e49-8177-c122da66e13f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:30.057545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd8b4179-36eb-4e49-8177-c122da66e13f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:30.060711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:30.069113 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd8b4179-36eb-4e49-8177-c122da66e13f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.245691 Aug 27 04:58:30.096954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b8c8967e-c85f-4a05-8e88-247342f0bfc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:30.097826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b8c8967e-c85f-4a05-8e88-247342f0bfc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:30.100289 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2473/4880] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:29 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:30.108760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8c8967e-c85f-4a05-8e88-247342f0bfc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:30.109528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8c8967e-c85f-4a05-8e88-247342f0bfc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:30.110207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8c8967e-c85f-4a05-8e88-247342f0bfc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:30.111821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8c8967e-c85f-4a05-8e88-247342f0bfc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:30.112450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8c8967e-c85f-4a05-8e88-247342f0bfc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:30.113064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8c8967e-c85f-4a05-8e88-247342f0bfc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:30.289887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9807d1c2-f72d-4ff3-9f6a-bde92d20c9e0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:30.291280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9807d1c2-f72d-4ff3-9f6a-bde92d20c9e0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:30.298965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9807d1c2-f72d-4ff3-9f6a-bde92d20c9e0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:30.299695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9807d1c2-f72d-4ff3-9f6a-bde92d20c9e0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:30.300429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9807d1c2-f72d-4ff3-9f6a-bde92d20c9e0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:30.301865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9807d1c2-f72d-4ff3-9f6a-bde92d20c9e0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:30.302503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9807d1c2-f72d-4ff3-9f6a-bde92d20c9e0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:30.303362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9807d1c2-f72d-4ff3-9f6a-bde92d20c9e0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:30.435488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b8c8967e-c85f-4a05-8e88-247342f0bfc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:30.452128 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b8c8967e-c85f-4a05-8e88-247342f0bfc2 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.359397 Aug 27 04:58:30.473812 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2408/4881] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:30 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:30.490651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c1d27e24-f357-4fe5-a5b1-b44c7bd8b6b7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2033189285_updated"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:30.500291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c1d27e24-f357-4fe5-a5b1-b44c7bd8b6b7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 683ce579-31db-49fe-ae83-cd7677031ceb] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:30.512346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:30.516061 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-c1d27e24-f357-4fe5-a5b1-b44c7bd8b6b7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 683ce579-31db-49fe-ae83-cd7677031ceb could not be found. Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c1d27e24-f357-4fe5-a5b1-b44c7bd8b6b7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: request: PUT /compute/v2.1/servers/683ce579-31db-49fe-ae83-cd7677031ceb HTTP/1.1 Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 81 Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2033189285_updated"}} Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 683ce579-31db-49fe-ae83-cd7677031ceb could not be found. Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '683ce579-31db-49fe-ae83-cd7677031ceb', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2033189285_updated'}}} Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 683ce579-31db-49fe-ae83-cd7677031ceb could not be found. Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 27 04:58:30.517880 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 683ce579-31db-49fe-ae83-cd7677031ceb could not be found. Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 683ce579-31db-49fe-ae83-cd7677031ceb could not be found. Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c1d27e24-f357-4fe5-a5b1-b44c7bd8b6b7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 683ce579-31db-49fe-ae83-cd7677031ceb could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c1d27e24-f357-4fe5-a5b1-b44c7bd8b6b7 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "PUT /compute/v2.1/servers/683ce579-31db-49fe-ae83-cd7677031ceb" status: 404 len: 111 microversion: 2.1 time: 0.033937 Aug 27 04:58:30.523381 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2409/4882] 10.222.0.79 () {60 vars in 1256 bytes} [Sat Aug 27 04:58:30 2022] PUT /compute/v2.1/servers/683ce579-31db-49fe-ae83-cd7677031ceb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:58:30.533859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e72c83bd-b5b1-400d-ab84-a3ad6391d09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:30.534486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e72c83bd-b5b1-400d-ab84-a3ad6391d09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:30.563440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e72c83bd-b5b1-400d-ab84-a3ad6391d09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:30.564302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e72c83bd-b5b1-400d-ab84-a3ad6391d09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:30.564988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e72c83bd-b5b1-400d-ab84-a3ad6391d09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:30.565758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e72c83bd-b5b1-400d-ab84-a3ad6391d09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:30.566230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e72c83bd-b5b1-400d-ab84-a3ad6391d09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:30.566671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e72c83bd-b5b1-400d-ab84-a3ad6391d09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:30.586870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9807d1c2-f72d-4ff3-9f6a-bde92d20c9e0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:30.599997 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9807d1c2-f72d-4ff3-9f6a-bde92d20c9e0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1372 microversion: 2.1 time: 0.311855 Aug 27 04:58:30.614935 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2474/4883] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:30 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1372 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:58:30.621607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62c437fd-cb31-43b1-a07f-7daa449503ea tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:30.622460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-62c437fd-cb31-43b1-a07f-7daa449503ea tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:30.629459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62c437fd-cb31-43b1-a07f-7daa449503ea tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:30.630359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62c437fd-cb31-43b1-a07f-7daa449503ea tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:30.631491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62c437fd-cb31-43b1-a07f-7daa449503ea tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:30.632356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62c437fd-cb31-43b1-a07f-7daa449503ea tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:30.632975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62c437fd-cb31-43b1-a07f-7daa449503ea tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:30.633533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62c437fd-cb31-43b1-a07f-7daa449503ea tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:30.910918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-62c437fd-cb31-43b1-a07f-7daa449503ea tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:30.933613 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62c437fd-cb31-43b1-a07f-7daa449503ea tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1391 microversion: 2.1 time: 0.316968 Aug 27 04:58:30.935670 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2475/4884] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:30 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1391 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:31.187722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e72c83bd-b5b1-400d-ab84-a3ad6391d09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:31.201567 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e72c83bd-b5b1-400d-ab84-a3ad6391d09a tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.675552 Aug 27 04:58:31.202253 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2410/4885] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:30 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:31.227698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a264cfb-3843-4457-8ca9-0a3572ceb6e1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:31.230507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a264cfb-3843-4457-8ca9-0a3572ceb6e1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:31.250878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a264cfb-3843-4457-8ca9-0a3572ceb6e1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:31.251923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a264cfb-3843-4457-8ca9-0a3572ceb6e1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:31.254040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a264cfb-3843-4457-8ca9-0a3572ceb6e1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:31.259202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a264cfb-3843-4457-8ca9-0a3572ceb6e1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:31.259783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a264cfb-3843-4457-8ca9-0a3572ceb6e1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:31.263496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a264cfb-3843-4457-8ca9-0a3572ceb6e1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:31.589406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2a264cfb-3843-4457-8ca9-0a3572ceb6e1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:31.598870 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a264cfb-3843-4457-8ca9-0a3572ceb6e1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.376669 Aug 27 04:58:31.600052 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2476/4886] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:31 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:31.621478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf3cde6f-ab45-42ae-aa60-8821cdf1273f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:31.631257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26d98d3b-8e0b-4d01-873f-c464c3930ed8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:31.632262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26d98d3b-8e0b-4d01-873f-c464c3930ed8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf3cde6f-ab45-42ae-aa60-8821cdf1273f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: request: PUT /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f HTTP/1.1 Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 280 Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '228b4767-bbe2-41d0-a7d4-a6670e79043f', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:31.635273 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:58:31.639313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:31.643826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf3cde6f-ab45-42ae-aa60-8821cdf1273f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:31.647028 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bf3cde6f-ab45-42ae-aa60-8821cdf1273f tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "PUT /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 400 len: 619 microversion: 2.1 time: 0.029900 Aug 27 04:58:31.651829 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2411/4887] 10.222.0.79 () {60 vars in 1257 bytes} [Sat Aug 27 04:58:31 2022] PUT /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:58:31.656138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d98d3b-8e0b-4d01-873f-c464c3930ed8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:31.657842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d98d3b-8e0b-4d01-873f-c464c3930ed8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:31.658304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d98d3b-8e0b-4d01-873f-c464c3930ed8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:31.661496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d98d3b-8e0b-4d01-873f-c464c3930ed8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:31.662152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d98d3b-8e0b-4d01-873f-c464c3930ed8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:31.662613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d98d3b-8e0b-4d01-873f-c464c3930ed8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:31.667474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-79b8a9e0-0748-45b8-b690-467ea1a64b43 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:31.668579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-79b8a9e0-0748-45b8-b690-467ea1a64b43 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:31.688150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79b8a9e0-0748-45b8-b690-467ea1a64b43 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:31.688988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79b8a9e0-0748-45b8-b690-467ea1a64b43 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:31.689592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79b8a9e0-0748-45b8-b690-467ea1a64b43 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:31.694101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79b8a9e0-0748-45b8-b690-467ea1a64b43 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:31.694826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79b8a9e0-0748-45b8-b690-467ea1a64b43 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:31.695424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79b8a9e0-0748-45b8-b690-467ea1a64b43 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:31.736413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:31.905804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26d98d3b-8e0b-4d01-873f-c464c3930ed8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:31.917541 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26d98d3b-8e0b-4d01-873f-c464c3930ed8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1372 microversion: 2.1 time: 0.290842 Aug 27 04:58:31.918685 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2477/4888] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:31 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:31.959282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-17f21fb5-42e8-42bf-85b0-63da38619b44 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:31.960631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-17f21fb5-42e8-42bf-85b0-63da38619b44 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:31.968988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17f21fb5-42e8-42bf-85b0-63da38619b44 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:31.970543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17f21fb5-42e8-42bf-85b0-63da38619b44 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:31.971258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17f21fb5-42e8-42bf-85b0-63da38619b44 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:31.972165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17f21fb5-42e8-42bf-85b0-63da38619b44 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:31.972953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17f21fb5-42e8-42bf-85b0-63da38619b44 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:31.973942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17f21fb5-42e8-42bf-85b0-63da38619b44 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:32.326839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-17f21fb5-42e8-42bf-85b0-63da38619b44 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:32.339257 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-17f21fb5-42e8-42bf-85b0-63da38619b44 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1564 microversion: 2.1 time: 0.384859 Aug 27 04:58:32.344010 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2478/4889] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:31 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1564 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:58:32.370005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae94823c-dfcb-4305-94c2-93a9f98f4b5d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:32.371914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae94823c-dfcb-4305-94c2-93a9f98f4b5d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:32.386054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae94823c-dfcb-4305-94c2-93a9f98f4b5d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:32.389683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae94823c-dfcb-4305-94c2-93a9f98f4b5d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:32.392917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae94823c-dfcb-4305-94c2-93a9f98f4b5d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:32.396305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae94823c-dfcb-4305-94c2-93a9f98f4b5d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:32.402255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae94823c-dfcb-4305-94c2-93a9f98f4b5d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:32.402753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae94823c-dfcb-4305-94c2-93a9f98f4b5d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:32.523225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-79b8a9e0-0748-45b8-b690-467ea1a64b43 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:32.538510 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-79b8a9e0-0748-45b8-b690-467ea1a64b43 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.885101 Aug 27 04:58:32.539337 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2412/4890] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:31 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:32.566952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-38f8aff8-890f-4a45-b82b-80cea06c6ded tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:32.567735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-38f8aff8-890f-4a45-b82b-80cea06c6ded tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:32.578293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38f8aff8-890f-4a45-b82b-80cea06c6ded tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:32.581277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38f8aff8-890f-4a45-b82b-80cea06c6ded tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:32.581996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38f8aff8-890f-4a45-b82b-80cea06c6ded tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:32.583927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38f8aff8-890f-4a45-b82b-80cea06c6ded tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:32.586182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38f8aff8-890f-4a45-b82b-80cea06c6ded tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:32.587975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38f8aff8-890f-4a45-b82b-80cea06c6ded tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:32.870925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-38f8aff8-890f-4a45-b82b-80cea06c6ded tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:32.879966 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-38f8aff8-890f-4a45-b82b-80cea06c6ded tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.317923 Aug 27 04:58:32.880608 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2413/4891] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:32 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:32.909854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5210828-36f7-4483-8976-ec7a45a7d405 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5210828-36f7-4483-8976-ec7a45a7d405 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: request: PUT /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f HTTP/1.1 Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 24 Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: {"server": {"name": ""}} Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '228b4767-bbe2-41d0-a7d4-a6670e79043f', 'body': {'server': {'name': ''}}} Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi '' Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:58:32.914161 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:58:32.919479 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:32.919479 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:32.919479 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:32.919479 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:32.919479 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:32.919479 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:32.919479 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:58:32.919479 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:58:32.919479 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 04:58:32.919479 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:32.919479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5210828-36f7-4483-8976-ec7a45a7d405 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:32.921089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ae94823c-dfcb-4305-94c2-93a9f98f4b5d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:32.924389 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f5210828-36f7-4483-8976-ec7a45a7d405 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "PUT /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 400 len: 108 microversion: 2.1 time: 0.021881 Aug 27 04:58:32.930867 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae94823c-dfcb-4305-94c2-93a9f98f4b5d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1564 microversion: 2.1 time: 0.568121 Aug 27 04:58:32.937828 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2414/4893] 10.222.0.79 () {60 vars in 1256 bytes} [Sat Aug 27 04:58:32 2022] PUT /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 108 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:58:32.941245 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2479/4893] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:32 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1564 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:32.947646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bac505c0-544d-4ae2-8f16-53447ed1795f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:32.949403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bac505c0-544d-4ae2-8f16-53447ed1795f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:32.951106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0400c101-3e55-4085-92b2-982a351b0755 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:32.951730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0400c101-3e55-4085-92b2-982a351b0755 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:32.954331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:32.970875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0400c101-3e55-4085-92b2-982a351b0755 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:32.971391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0400c101-3e55-4085-92b2-982a351b0755 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:32.971838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0400c101-3e55-4085-92b2-982a351b0755 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:32.974163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0400c101-3e55-4085-92b2-982a351b0755 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:32.977129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0400c101-3e55-4085-92b2-982a351b0755 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:32.977787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0400c101-3e55-4085-92b2-982a351b0755 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:32.984449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bac505c0-544d-4ae2-8f16-53447ed1795f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:32.986117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bac505c0-544d-4ae2-8f16-53447ed1795f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:32.990430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bac505c0-544d-4ae2-8f16-53447ed1795f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:32.991206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bac505c0-544d-4ae2-8f16-53447ed1795f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:32.991690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bac505c0-544d-4ae2-8f16-53447ed1795f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:32.992130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bac505c0-544d-4ae2-8f16-53447ed1795f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:33.111433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:33.336813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bac505c0-544d-4ae2-8f16-53447ed1795f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:33.336813 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bac505c0-544d-4ae2-8f16-53447ed1795f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1372 microversion: 2.1 time: 0.392043 Aug 27 04:58:33.342385 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2415/4894] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:32 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1372 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:58:33.587543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0400c101-3e55-4085-92b2-982a351b0755 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:33.616879 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0400c101-3e55-4085-92b2-982a351b0755 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1505 microversion: 2.1 time: 0.669060 Aug 27 04:58:33.618181 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2480/4895] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:32 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1505 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:34.372782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd2a1390-76cf-4ffc-99fe-87e2f0c882db tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:34.374275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fd2a1390-76cf-4ffc-99fe-87e2f0c882db tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:34.389257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=12 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:34.422904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd2a1390-76cf-4ffc-99fe-87e2f0c882db tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:34.423743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd2a1390-76cf-4ffc-99fe-87e2f0c882db tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:34.426572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd2a1390-76cf-4ffc-99fe-87e2f0c882db tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:34.429268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd2a1390-76cf-4ffc-99fe-87e2f0c882db tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:34.432691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd2a1390-76cf-4ffc-99fe-87e2f0c882db tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:34.436028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd2a1390-76cf-4ffc-99fe-87e2f0c882db tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:35.013203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fd2a1390-76cf-4ffc-99fe-87e2f0c882db tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:35.029040 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fd2a1390-76cf-4ffc-99fe-87e2f0c882db tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1372 microversion: 2.1 time: 0.669113 Aug 27 04:58:35.030293 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2416/4896] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:34 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1372 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:36.055703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfddf604-08cc-48f1-8e06-3a6f1e648ca0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:36.058854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dfddf604-08cc-48f1-8e06-3a6f1e648ca0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:36.077740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfddf604-08cc-48f1-8e06-3a6f1e648ca0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:36.079581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfddf604-08cc-48f1-8e06-3a6f1e648ca0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:36.082652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfddf604-08cc-48f1-8e06-3a6f1e648ca0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:36.084353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfddf604-08cc-48f1-8e06-3a6f1e648ca0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:36.084910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfddf604-08cc-48f1-8e06-3a6f1e648ca0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:36.086691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfddf604-08cc-48f1-8e06-3a6f1e648ca0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:36.743691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e2a8c869-9aad-41da-ab7e-95ae080b92dd req-aedaedc9-3fdc-4ac8-aaec-95a81b8b67bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c8006a-b6ce-40d9-9136-6a08964d6544", "name": "network-vif-plugged", "status": "completed", "tag": "953af6d2-bfae-4d88-aac1-32046c271aa2"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:36.783383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e2a8c869-9aad-41da-ab7e-95ae080b92dd req-aedaedc9-3fdc-4ac8-aaec-95a81b8b67bb service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:36.783893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e2a8c869-9aad-41da-ab7e-95ae080b92dd req-aedaedc9-3fdc-4ac8-aaec-95a81b8b67bb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:36.786464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e2a8c869-9aad-41da-ab7e-95ae080b92dd req-aedaedc9-3fdc-4ac8-aaec-95a81b8b67bb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:36.821644 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e2a8c869-9aad-41da-ab7e-95ae080b92dd req-aedaedc9-3fdc-4ac8-aaec-95a81b8b67bb service nova] Creating event network-vif-plugged:953af6d2-bfae-4d88-aac1-32046c271aa2 for instance f7c8006a-b6ce-40d9-9136-6a08964d6544 on n-h2-854823-1 Aug 27 04:58:36.846801 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e2a8c869-9aad-41da-ab7e-95ae080b92dd req-aedaedc9-3fdc-4ac8-aaec-95a81b8b67bb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107169 Aug 27 04:58:36.854604 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2417/4897] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:36.878825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-374465394", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "de6b4f79-be49-4c7c-9581-299594ac4ceb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b9321d5-af89-499e-b147-430b2ec333ca"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:36.971348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dfddf604-08cc-48f1-8e06-3a6f1e648ca0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:36.986574 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dfddf604-08cc-48f1-8e06-3a6f1e648ca0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1372 microversion: 2.1 time: 0.938755 Aug 27 04:58:36.993836 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2481/4898] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:36 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1372 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:37.019842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] validate_networks() for [('0b9321d5-af89-499e-b147-430b2ec333ca', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:58:38.019594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d81332dd-eca3-48f2-a108-ee7051263499 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:38.019594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d81332dd-eca3-48f2-a108-ee7051263499 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:38.035352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d81332dd-eca3-48f2-a108-ee7051263499 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:38.037206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d81332dd-eca3-48f2-a108-ee7051263499 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:38.037866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d81332dd-eca3-48f2-a108-ee7051263499 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:38.038769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d81332dd-eca3-48f2-a108-ee7051263499 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:38.042985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d81332dd-eca3-48f2-a108-ee7051263499 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:38.043690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d81332dd-eca3-48f2-a108-ee7051263499 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:38.972493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d81332dd-eca3-48f2-a108-ee7051263499 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:38.979674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:58:38.980083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:58:38.980678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:58:38.981291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:58:38.982025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:58:38.987885 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d81332dd-eca3-48f2-a108-ee7051263499 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1372 microversion: 2.1 time: 0.973617 Aug 27 04:58:38.989710 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2482/4899] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:38 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1372 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:38.997261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:38.997939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:38.999783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:39.000909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:39.002619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:39.006074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:39.048044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:58:39.064695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for user 8376c4e2cf814a8b8b1e2a8e404b0187 and project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:58:39.128251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ad93f0e-8cf0-40bd-912d-4bc02b72da72 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:39.129869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6ad93f0e-8cf0-40bd-912d-4bc02b72da72 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:39.153086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad93f0e-8cf0-40bd-912d-4bc02b72da72 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:39.154114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad93f0e-8cf0-40bd-912d-4bc02b72da72 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:39.154734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad93f0e-8cf0-40bd-912d-4bc02b72da72 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:39.156220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad93f0e-8cf0-40bd-912d-4bc02b72da72 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:39.156921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad93f0e-8cf0-40bd-912d-4bc02b72da72 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:39.159531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad93f0e-8cf0-40bd-912d-4bc02b72da72 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:39.192075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:58:39.194386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de6b4f79-be49-4c7c-9581-299594ac4ceb',volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:58:39.483028 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8f28001e-18da-4d4b-be6d-4cf4637a4c2d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.613109 Aug 27 04:58:39.490269 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2418/4900] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:58:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:58:39.495142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-2b19b677-9035-4986-9b7e-2347d1d05b7f req-b5a6fec8-9f6e-4ec0-b7b2-3afce153b3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79131199-61d1-48f7-a53c-614f1a17098e", "tag": "0862d8e7-87b9-4566-b5e9-f057655a8991"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:39.522918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2b19b677-9035-4986-9b7e-2347d1d05b7f req-b5a6fec8-9f6e-4ec0-b7b2-3afce153b3fc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:39.526632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2b19b677-9035-4986-9b7e-2347d1d05b7f req-b5a6fec8-9f6e-4ec0-b7b2-3afce153b3fc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:39.527373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2b19b677-9035-4986-9b7e-2347d1d05b7f req-b5a6fec8-9f6e-4ec0-b7b2-3afce153b3fc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:39.555717 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-2b19b677-9035-4986-9b7e-2347d1d05b7f req-b5a6fec8-9f6e-4ec0-b7b2-3afce153b3fc service nova] Creating event network-changed:0862d8e7-87b9-4566-b5e9-f057655a8991 for instance 79131199-61d1-48f7-a53c-614f1a17098e on n-h1-854823-1 Aug 27 04:58:39.598781 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-2b19b677-9035-4986-9b7e-2347d1d05b7f req-b5a6fec8-9f6e-4ec0-b7b2-3afce153b3fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107404 Aug 27 04:58:39.602158 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2419/4901] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:39.620040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e1c9fbc6-8279-4520-9d8d-e6a887a9d48e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:39.633726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e1c9fbc6-8279-4520-9d8d-e6a887a9d48e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:39.885615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e1c9fbc6-8279-4520-9d8d-e6a887a9d48e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:39.903021 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e1c9fbc6-8279-4520-9d8d-e6a887a9d48e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1056 microversion: 2.1 time: 0.293483 Aug 27 04:58:39.925083 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2420/4902] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:39 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1056 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:39.951332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ad93f0e-8cf0-40bd-912d-4bc02b72da72 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:39.974508 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ad93f0e-8cf0-40bd-912d-4bc02b72da72 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1564 microversion: 2.1 time: 0.846955 Aug 27 04:58:39.977035 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2483/4903] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:39 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1564 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:40.011414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c45268bc-81c4-43a1-839b-9ff30b149aff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:40.012006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c45268bc-81c4-43a1-839b-9ff30b149aff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:40.047999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c45268bc-81c4-43a1-839b-9ff30b149aff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:40.052719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c45268bc-81c4-43a1-839b-9ff30b149aff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:40.053447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c45268bc-81c4-43a1-839b-9ff30b149aff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:40.054381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c45268bc-81c4-43a1-839b-9ff30b149aff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:40.056299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c45268bc-81c4-43a1-839b-9ff30b149aff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:40.058265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c45268bc-81c4-43a1-839b-9ff30b149aff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:40.606669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c45268bc-81c4-43a1-839b-9ff30b149aff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:40.624882 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c45268bc-81c4-43a1-839b-9ff30b149aff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1545 microversion: 2.1 time: 0.617198 Aug 27 04:58:40.625560 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2421/4904] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:40 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1545 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:40.650091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88a38feb-60d0-4d01-97b0-c86843f8b645 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:40.655050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88a38feb-60d0-4d01-97b0-c86843f8b645 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:40.683329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88a38feb-60d0-4d01-97b0-c86843f8b645 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:40.683877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88a38feb-60d0-4d01-97b0-c86843f8b645 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:40.684319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88a38feb-60d0-4d01-97b0-c86843f8b645 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:40.686899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88a38feb-60d0-4d01-97b0-c86843f8b645 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:40.689171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88a38feb-60d0-4d01-97b0-c86843f8b645 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:40.689816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88a38feb-60d0-4d01-97b0-c86843f8b645 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:40.933617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a8e1e819-cdfb-488f-b5b3-27939923be8e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:40.934451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a8e1e819-cdfb-488f-b5b3-27939923be8e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:40.953973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8e1e819-cdfb-488f-b5b3-27939923be8e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:40.954488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8e1e819-cdfb-488f-b5b3-27939923be8e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:40.958185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8e1e819-cdfb-488f-b5b3-27939923be8e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:40.960886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8e1e819-cdfb-488f-b5b3-27939923be8e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:40.961553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8e1e819-cdfb-488f-b5b3-27939923be8e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:40.964763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8e1e819-cdfb-488f-b5b3-27939923be8e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:41.268336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a8e1e819-cdfb-488f-b5b3-27939923be8e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:41.290799 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a8e1e819-cdfb-488f-b5b3-27939923be8e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1098 microversion: 2.1 time: 0.359993 Aug 27 04:58:41.292023 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2422/4905] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:40 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1098 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:41.432929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88a38feb-60d0-4d01-97b0-c86843f8b645 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:41.444579 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88a38feb-60d0-4d01-97b0-c86843f8b645 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1545 microversion: 2.1 time: 0.798292 Aug 27 04:58:41.445174 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2484/4906] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:40 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1545 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:42.318853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-700db349-e2ca-4c63-abf3-01b13eac618f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:42.320865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-700db349-e2ca-4c63-abf3-01b13eac618f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:42.331975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-700db349-e2ca-4c63-abf3-01b13eac618f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:42.335065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-700db349-e2ca-4c63-abf3-01b13eac618f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:42.337917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-700db349-e2ca-4c63-abf3-01b13eac618f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:42.339846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-700db349-e2ca-4c63-abf3-01b13eac618f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:42.340667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-700db349-e2ca-4c63-abf3-01b13eac618f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:42.342205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-700db349-e2ca-4c63-abf3-01b13eac618f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:42.629578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-700db349-e2ca-4c63-abf3-01b13eac618f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:42.654150 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-700db349-e2ca-4c63-abf3-01b13eac618f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1172 microversion: 2.1 time: 0.339955 Aug 27 04:58:42.670743 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2423/4907] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:42 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1172 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:43.688032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f4f638ce-e569-44a1-ae0d-1e0f321ae4bc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:43.689632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f4f638ce-e569-44a1-ae0d-1e0f321ae4bc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:43.702160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4f638ce-e569-44a1-ae0d-1e0f321ae4bc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:43.712028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4f638ce-e569-44a1-ae0d-1e0f321ae4bc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:43.713341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4f638ce-e569-44a1-ae0d-1e0f321ae4bc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:43.714887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4f638ce-e569-44a1-ae0d-1e0f321ae4bc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:43.716159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4f638ce-e569-44a1-ae0d-1e0f321ae4bc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:43.717405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4f638ce-e569-44a1-ae0d-1e0f321ae4bc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:44.674391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f4f638ce-e569-44a1-ae0d-1e0f321ae4bc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:44.717584 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f4f638ce-e569-44a1-ae0d-1e0f321ae4bc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1214 microversion: 2.1 time: 1.032994 Aug 27 04:58:44.722936 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2485/4908] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:43 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1214 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:45.246301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8a9ed643-5788-4cc2-9296-be9fddf5704a req-9f35ddb7-d47f-471b-9417-9accc8b45f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceb943b-a2fe-4445-9b5d-ac21543adf40", "tag": "e9cd9a99-7609-48ff-aae6-d3edb09edb0c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:45.261158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8a9ed643-5788-4cc2-9296-be9fddf5704a req-9f35ddb7-d47f-471b-9417-9accc8b45f39 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:45.261891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8a9ed643-5788-4cc2-9296-be9fddf5704a req-9f35ddb7-d47f-471b-9417-9accc8b45f39 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:45.262471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8a9ed643-5788-4cc2-9296-be9fddf5704a req-9f35ddb7-d47f-471b-9417-9accc8b45f39 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:45.287652 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8a9ed643-5788-4cc2-9296-be9fddf5704a req-9f35ddb7-d47f-471b-9417-9accc8b45f39 service nova] Creating event network-changed:e9cd9a99-7609-48ff-aae6-d3edb09edb0c for instance bceb943b-a2fe-4445-9b5d-ac21543adf40 on n-h2-854823-1 Aug 27 04:58:45.294019 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8a9ed643-5788-4cc2-9296-be9fddf5704a req-9f35ddb7-d47f-471b-9417-9accc8b45f39 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052295 Aug 27 04:58:45.296193 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2424/4909] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:45.444902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5026c8f7-7fcf-4bb9-b2ab-581a9898137d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:45.445427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5026c8f7-7fcf-4bb9-b2ab-581a9898137d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:45.473830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5026c8f7-7fcf-4bb9-b2ab-581a9898137d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:45.474339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5026c8f7-7fcf-4bb9-b2ab-581a9898137d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:45.474766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5026c8f7-7fcf-4bb9-b2ab-581a9898137d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:45.475487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5026c8f7-7fcf-4bb9-b2ab-581a9898137d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:45.475935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5026c8f7-7fcf-4bb9-b2ab-581a9898137d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:45.476358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5026c8f7-7fcf-4bb9-b2ab-581a9898137d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:45.572135 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-5026c8f7-7fcf-4bb9-b2ab-581a9898137d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5026c8f7-7fcf-4bb9-b2ab-581a9898137d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 HTTP/1.1 Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '71ce8444-1fbd-4b28-90bb-a5a472e04486'} Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:58:45.575361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:58:45.583356 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:58:45.583356 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:45.583356 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:45.583356 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:45.583356 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:45.583356 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:45.583356 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:45.583356 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:58:45.583356 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:58:45.583356 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:58:45.583356 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:45.583356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5026c8f7-7fcf-4bb9-b2ab-581a9898137d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:45.594765 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5026c8f7-7fcf-4bb9-b2ab-581a9898137d tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "DELETE /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 404 len: 111 microversion: 2.1 time: 0.153895 Aug 27 04:58:45.601758 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2486/4910] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:58:45 2022] DELETE /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:58:45.614658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e992db93-b3af-498e-aa66-b25c538c1465 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:45.618105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e992db93-b3af-498e-aa66-b25c538c1465 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 71ce8444-1fbd-4b28-90bb-a5a472e04486] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:45.685721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e992db93-b3af-498e-aa66-b25c538c1465 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:45.689186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e992db93-b3af-498e-aa66-b25c538c1465 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:45.690310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e992db93-b3af-498e-aa66-b25c538c1465 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:45.693915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e992db93-b3af-498e-aa66-b25c538c1465 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:45.701053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e992db93-b3af-498e-aa66-b25c538c1465 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:45.702268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e992db93-b3af-498e-aa66-b25c538c1465 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:45.740424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cdf0a558-48ee-4f8a-81a2-9878bfd2f256 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:45.741173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cdf0a558-48ee-4f8a-81a2-9878bfd2f256 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:45.763045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdf0a558-48ee-4f8a-81a2-9878bfd2f256 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:45.763543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdf0a558-48ee-4f8a-81a2-9878bfd2f256 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:45.763978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdf0a558-48ee-4f8a-81a2-9878bfd2f256 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:45.764727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdf0a558-48ee-4f8a-81a2-9878bfd2f256 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:45.773283 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-e992db93-b3af-498e-aa66-b25c538c1465 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e992db93-b3af-498e-aa66-b25c538c1465 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 HTTP/1.1 Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '71ce8444-1fbd-4b28-90bb-a5a472e04486'} Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:45.777494 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:45.785609 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:45.785609 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:45.785609 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:45.785609 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:58:45.785609 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:58:45.785609 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. Aug 27 04:58:45.785609 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 04:58:45.786661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdf0a558-48ee-4f8a-81a2-9878bfd2f256 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:45.786661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdf0a558-48ee-4f8a-81a2-9878bfd2f256 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:45.795227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e992db93-b3af-498e-aa66-b25c538c1465 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 71ce8444-1fbd-4b28-90bb-a5a472e04486 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:45.801371 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e992db93-b3af-498e-aa66-b25c538c1465 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486" status: 404 len: 111 microversion: 2.1 time: 0.195215 Aug 27 04:58:45.806500 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2425/4911] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:45 2022] GET /compute/v2.1/servers/71ce8444-1fbd-4b28-90bb-a5a472e04486 => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:58:45.836294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-033969d2-08e2-42f8-9b3d-69c381dfa2b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:45.844290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-033969d2-08e2-42f8-9b3d-69c381dfa2b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:45.875067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-033969d2-08e2-42f8-9b3d-69c381dfa2b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:45.879312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-033969d2-08e2-42f8-9b3d-69c381dfa2b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:45.885905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-033969d2-08e2-42f8-9b3d-69c381dfa2b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:45.894846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-033969d2-08e2-42f8-9b3d-69c381dfa2b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:45.897021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-033969d2-08e2-42f8-9b3d-69c381dfa2b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:45.899422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-033969d2-08e2-42f8-9b3d-69c381dfa2b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:46.021432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-033969d2-08e2-42f8-9b3d-69c381dfa2b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:58:46.273992 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-033969d2-08e2-42f8-9b3d-69c381dfa2b9 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "DELETE /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 204 len: 0 microversion: 2.1 time: 0.461807 Aug 27 04:58:46.279255 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2426/4912] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:58:45 2022] DELETE /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:58:46.294298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c92c979-d4d6-4f2e-afeb-177f2d70aff1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:46.295323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1c92c979-d4d6-4f2e-afeb-177f2d70aff1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:46.303872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c92c979-d4d6-4f2e-afeb-177f2d70aff1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:46.304656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c92c979-d4d6-4f2e-afeb-177f2d70aff1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:46.305281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c92c979-d4d6-4f2e-afeb-177f2d70aff1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:46.330873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c92c979-d4d6-4f2e-afeb-177f2d70aff1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:46.334856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c92c979-d4d6-4f2e-afeb-177f2d70aff1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:46.335608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c92c979-d4d6-4f2e-afeb-177f2d70aff1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:46.644889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cdf0a558-48ee-4f8a-81a2-9878bfd2f256 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:46.647881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1c92c979-d4d6-4f2e-afeb-177f2d70aff1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:46.658694 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1c92c979-d4d6-4f2e-afeb-177f2d70aff1 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 0.375034 Aug 27 04:58:46.660009 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2427/4913] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:46 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:46.667600 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cdf0a558-48ee-4f8a-81a2-9878bfd2f256 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1214 microversion: 2.1 time: 0.926480 Aug 27 04:58:46.668760 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2487/4914] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:45 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1214 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:47.700598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f734e58b-fd76-445c-ad5c-6d575de40a34 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:47.701903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdaecc58-d345-47ec-90ae-129ea9c134e0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:47.702501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f734e58b-fd76-445c-ad5c-6d575de40a34 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:47.703245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bdaecc58-d345-47ec-90ae-129ea9c134e0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:47.717105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdaecc58-d345-47ec-90ae-129ea9c134e0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:47.720276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdaecc58-d345-47ec-90ae-129ea9c134e0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:47.720936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdaecc58-d345-47ec-90ae-129ea9c134e0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:47.724740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdaecc58-d345-47ec-90ae-129ea9c134e0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:47.725584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdaecc58-d345-47ec-90ae-129ea9c134e0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:47.729322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdaecc58-d345-47ec-90ae-129ea9c134e0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:47.739897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f734e58b-fd76-445c-ad5c-6d575de40a34 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:47.742442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f734e58b-fd76-445c-ad5c-6d575de40a34 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:47.743713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f734e58b-fd76-445c-ad5c-6d575de40a34 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:47.747931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f734e58b-fd76-445c-ad5c-6d575de40a34 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:47.750605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f734e58b-fd76-445c-ad5c-6d575de40a34 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:47.769359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f734e58b-fd76-445c-ad5c-6d575de40a34 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:48.247637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdaecc58-d345-47ec-90ae-129ea9c134e0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:48.272889 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdaecc58-d345-47ec-90ae-129ea9c134e0 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 0.577189 Aug 27 04:58:48.277553 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2488/4915] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:47 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:48.845079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f734e58b-fd76-445c-ad5c-6d575de40a34 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:48.869949 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f734e58b-fd76-445c-ad5c-6d575de40a34 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1214 microversion: 2.1 time: 1.167066 Aug 27 04:58:48.870654 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2428/4916] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:47 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1214 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:49.228158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-86930933-a20f-4e30-a9a9-5886be40ee9f req-9dc83230-a5fd-4bdd-b7d1-78d33572aa67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c8006a-b6ce-40d9-9136-6a08964d6544", "tag": "953af6d2-bfae-4d88-aac1-32046c271aa2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:49.255722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-86930933-a20f-4e30-a9a9-5886be40ee9f req-9dc83230-a5fd-4bdd-b7d1-78d33572aa67 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:49.256220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-86930933-a20f-4e30-a9a9-5886be40ee9f req-9dc83230-a5fd-4bdd-b7d1-78d33572aa67 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:49.256689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-86930933-a20f-4e30-a9a9-5886be40ee9f req-9dc83230-a5fd-4bdd-b7d1-78d33572aa67 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:49.277007 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-86930933-a20f-4e30-a9a9-5886be40ee9f req-9dc83230-a5fd-4bdd-b7d1-78d33572aa67 service nova] Creating event network-changed:953af6d2-bfae-4d88-aac1-32046c271aa2 for instance f7c8006a-b6ce-40d9-9136-6a08964d6544 on n-h2-854823-1 Aug 27 04:58:49.284119 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-86930933-a20f-4e30-a9a9-5886be40ee9f req-9dc83230-a5fd-4bdd-b7d1-78d33572aa67 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.466263 Aug 27 04:58:49.288444 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2489/4917] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:49.298762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d111c1f2-768c-46f7-a0fc-3952d02acd80 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:49.299370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d111c1f2-768c-46f7-a0fc-3952d02acd80 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:49.307598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:49.326648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d111c1f2-768c-46f7-a0fc-3952d02acd80 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:49.327450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d111c1f2-768c-46f7-a0fc-3952d02acd80 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:49.341338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d111c1f2-768c-46f7-a0fc-3952d02acd80 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:49.343029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d111c1f2-768c-46f7-a0fc-3952d02acd80 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:49.343704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d111c1f2-768c-46f7-a0fc-3952d02acd80 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:49.344303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d111c1f2-768c-46f7-a0fc-3952d02acd80 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:49.892766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:49.900176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a61078ad-0341-410b-91d2-556a15ebc0f5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:49.902009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a61078ad-0341-410b-91d2-556a15ebc0f5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:49.924745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a61078ad-0341-410b-91d2-556a15ebc0f5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:49.925866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a61078ad-0341-410b-91d2-556a15ebc0f5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:49.926359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a61078ad-0341-410b-91d2-556a15ebc0f5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:49.930237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a61078ad-0341-410b-91d2-556a15ebc0f5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:49.931461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a61078ad-0341-410b-91d2-556a15ebc0f5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:49.934156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a61078ad-0341-410b-91d2-556a15ebc0f5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:50.123103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d111c1f2-768c-46f7-a0fc-3952d02acd80 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:50.144495 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d111c1f2-768c-46f7-a0fc-3952d02acd80 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1511 microversion: 2.1 time: 0.849275 Aug 27 04:58:50.157132 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2429/4918] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:49 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1511 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:50.674210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a61078ad-0341-410b-91d2-556a15ebc0f5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:50.713535 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a61078ad-0341-410b-91d2-556a15ebc0f5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1214 microversion: 2.1 time: 0.824430 Aug 27 04:58:50.717316 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2490/4919] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:49 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1214 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:51.028363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-3436aeaa-0a1c-485e-9365-5030313228a7 req-d102d90f-99bb-49a9-8bbe-73f2ecc2b519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228b4767-bbe2-41d0-a7d4-a6670e79043f", "name": "network-vif-deleted", "tag": "1b95ce59-5e34-4673-9606-3f53d8d7b9d1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:58:51.067626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3436aeaa-0a1c-485e-9365-5030313228a7 req-d102d90f-99bb-49a9-8bbe-73f2ecc2b519 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.069669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3436aeaa-0a1c-485e-9365-5030313228a7 req-d102d90f-99bb-49a9-8bbe-73f2ecc2b519 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.071000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3436aeaa-0a1c-485e-9365-5030313228a7 req-d102d90f-99bb-49a9-8bbe-73f2ecc2b519 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.164689 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-3436aeaa-0a1c-485e-9365-5030313228a7 req-d102d90f-99bb-49a9-8bbe-73f2ecc2b519 service nova] Creating event network-vif-deleted:1b95ce59-5e34-4673-9606-3f53d8d7b9d1 for instance 228b4767-bbe2-41d0-a7d4-a6670e79043f on n-h2-854823-1 Aug 27 04:58:51.166487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d822fcce-9413-49db-871a-d2a7d00f0510 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:51.167122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d822fcce-9413-49db-871a-d2a7d00f0510 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:51.180401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d822fcce-9413-49db-871a-d2a7d00f0510 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.183430 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-3436aeaa-0a1c-485e-9365-5030313228a7 req-d102d90f-99bb-49a9-8bbe-73f2ecc2b519 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.399400 Aug 27 04:58:51.184737 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2430/4920] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:58:51.187973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d822fcce-9413-49db-871a-d2a7d00f0510 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.195365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d822fcce-9413-49db-871a-d2a7d00f0510 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.196829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d822fcce-9413-49db-871a-d2a7d00f0510 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.197631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d822fcce-9413-49db-871a-d2a7d00f0510 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.198379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d822fcce-9413-49db-871a-d2a7d00f0510 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.330658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d822fcce-9413-49db-871a-d2a7d00f0510 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.331447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d822fcce-9413-49db-871a-d2a7d00f0510 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.332215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d822fcce-9413-49db-871a-d2a7d00f0510 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.332868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-d822fcce-9413-49db-871a-d2a7d00f0510 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lazy-loading 'fault' on Instance uuid 228b4767-bbe2-41d0-a7d4-a6670e79043f {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:58:51.339918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:51.405640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d822fcce-9413-49db-871a-d2a7d00f0510 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d403bc0f014a2b9c89e2edf2426ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0e87425d89463daa72c44543a13f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:51.415592 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d822fcce-9413-49db-871a-d2a7d00f0510 tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 200 len: 1306 microversion: 2.1 time: 0.254155 Aug 27 04:58:51.417773 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2491/4921] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:51 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 1306 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:51.740583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-09088f33-8c1f-43dc-bf9d-ba201852a3ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:51.741414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-09088f33-8c1f-43dc-bf9d-ba201852a3ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:51.767671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09088f33-8c1f-43dc-bf9d-ba201852a3ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.768203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09088f33-8c1f-43dc-bf9d-ba201852a3ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.768672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09088f33-8c1f-43dc-bf9d-ba201852a3ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:51.769416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09088f33-8c1f-43dc-bf9d-ba201852a3ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:51.786114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09088f33-8c1f-43dc-bf9d-ba201852a3ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:51.788225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09088f33-8c1f-43dc-bf9d-ba201852a3ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:52.198607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-09088f33-8c1f-43dc-bf9d-ba201852a3ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:52.210849 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-09088f33-8c1f-43dc-bf9d-ba201852a3ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1214 microversion: 2.1 time: 0.476620 Aug 27 04:58:52.211453 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2431/4922] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:51 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1214 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:52.443047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e603f4e-0c87-4d56-9478-c8954dbc3f8e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:52.443684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e603f4e-0c87-4d56-9478-c8954dbc3f8e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] [instance: 228b4767-bbe2-41d0-a7d4-a6670e79043f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:52.468509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e603f4e-0c87-4d56-9478-c8954dbc3f8e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:52.469046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e603f4e-0c87-4d56-9478-c8954dbc3f8e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:52.469501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e603f4e-0c87-4d56-9478-c8954dbc3f8e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:52.470232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e603f4e-0c87-4d56-9478-c8954dbc3f8e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:52.470698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e603f4e-0c87-4d56-9478-c8954dbc3f8e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:52.471133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e603f4e-0c87-4d56-9478-c8954dbc3f8e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:52.532828 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8e603f4e-0c87-4d56-9478-c8954dbc3f8e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] HTTP exception thrown: Instance 228b4767-bbe2-41d0-a7d4-a6670e79043f could not be found. Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e603f4e-0c87-4d56-9478-c8954dbc3f8e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Request method failure captured: Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f HTTP/1.1 Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaOayyx5Ab-4fY9zUKyVpAhXiOHMUTtLIthsVqX-c9MqN0jloiLAdGurgMnQqinEHAF8eFn-WyDRkKkKVcmsvzYnYSoPvKCbgwSNwe1BFtmuj2cOsQGbJn4r066SvsHEv4481opeqN0liommGAxHVNFx0OHEII7s47AQvg5iAb4jv1k Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db0e87425d89463daa72c44543a13f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db0e87425d89463daa72c44543a13f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db0e87425d89463daa72c44543a13f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db0e87425d89463daa72c44543a13f37 Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-76546494 Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1d403bc0f014a2b9c89e2edf2426ea3 Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-76546494-project Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 228b4767-bbe2-41d0-a7d4-a6670e79043f could not be found. Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '228b4767-bbe2-41d0-a7d4-a6670e79043f'} Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228b4767-bbe2-41d0-a7d4-a6670e79043f could not be found. Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228b4767-bbe2-41d0-a7d4-a6670e79043f could not be found. Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:58:52.534549 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:52.539282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:58:52.539282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:58:52.539282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:58:52.539282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:58:52.539282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:58:52.539282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228b4767-bbe2-41d0-a7d4-a6670e79043f could not be found. Aug 27 04:58:52.539282 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:58:52.539282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e603f4e-0c87-4d56-9478-c8954dbc3f8e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] Returning 404 to user: Instance 228b4767-bbe2-41d0-a7d4-a6670e79043f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:58:52.539282 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e603f4e-0c87-4d56-9478-c8954dbc3f8e tempest-ServersNegativeTestJSON-76546494 tempest-ServersNegativeTestJSON-76546494-project] 10.222.0.79 "GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f" status: 404 len: 111 microversion: 2.1 time: 0.096975 Aug 27 04:58:52.539282 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2492/4923] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:52 2022] GET /compute/v2.1/servers/228b4767-bbe2-41d0-a7d4-a6670e79043f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:58:53.234002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e0877c5c-bbc1-4b1a-a41b-193026067933 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:53.234699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e0877c5c-bbc1-4b1a-a41b-193026067933 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:53.266699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e0877c5c-bbc1-4b1a-a41b-193026067933 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:53.267093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e0877c5c-bbc1-4b1a-a41b-193026067933 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:53.267542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e0877c5c-bbc1-4b1a-a41b-193026067933 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:53.268268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e0877c5c-bbc1-4b1a-a41b-193026067933 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:53.268760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e0877c5c-bbc1-4b1a-a41b-193026067933 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:53.269488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e0877c5c-bbc1-4b1a-a41b-193026067933 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:53.646705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e0877c5c-bbc1-4b1a-a41b-193026067933 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:53.655682 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e0877c5c-bbc1-4b1a-a41b-193026067933 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1214 microversion: 2.1 time: 0.425565 Aug 27 04:58:53.656293 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2432/4924] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:53 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1214 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:54.682738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d8dd03c-53e0-4374-adc0-a5f8d86b4021 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:54.685239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d8dd03c-53e0-4374-adc0-a5f8d86b4021 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:54.696996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d8dd03c-53e0-4374-adc0-a5f8d86b4021 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:54.700818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d8dd03c-53e0-4374-adc0-a5f8d86b4021 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:54.702980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d8dd03c-53e0-4374-adc0-a5f8d86b4021 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:54.705108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d8dd03c-53e0-4374-adc0-a5f8d86b4021 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:54.706527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d8dd03c-53e0-4374-adc0-a5f8d86b4021 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:54.707312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d8dd03c-53e0-4374-adc0-a5f8d86b4021 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:55.333698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d8dd03c-53e0-4374-adc0-a5f8d86b4021 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:55.350572 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d8dd03c-53e0-4374-adc0-a5f8d86b4021 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1214 microversion: 2.1 time: 0.671109 Aug 27 04:58:55.353209 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2493/4925] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:54 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1214 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:55.498323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d3abf660-977d-4d2a-9cf3-2a0532955703 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:55.498864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d3abf660-977d-4d2a-9cf3-2a0532955703 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:55.515581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3abf660-977d-4d2a-9cf3-2a0532955703 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:55.519560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3abf660-977d-4d2a-9cf3-2a0532955703 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:55.520619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3abf660-977d-4d2a-9cf3-2a0532955703 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:55.523236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3abf660-977d-4d2a-9cf3-2a0532955703 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:55.524095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3abf660-977d-4d2a-9cf3-2a0532955703 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:55.524720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3abf660-977d-4d2a-9cf3-2a0532955703 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:55.589472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:55.762240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-d3abf660-977d-4d2a-9cf3-2a0532955703 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lazy-loading 'services' on Instance uuid 4c612c67-453a-48d4-8f78-97a00213ab46 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:58:56.039904 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d3abf660-977d-4d2a-9cf3-2a0532955703 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/os-volume_attachments/b2392823-1c33-4f55-ab56-bcf92079846d" status: 202 len: 0 microversion: 2.1 time: 0.553016 Aug 27 04:58:56.042191 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2433/4926] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 04:58:55 2022] DELETE /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/os-volume_attachments/b2392823-1c33-4f55-ab56-bcf92079846d => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:58:56.372668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26584447-0714-4918-adb4-dfbf65c35c0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:56.374143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26584447-0714-4918-adb4-dfbf65c35c0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:56.413642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26584447-0714-4918-adb4-dfbf65c35c0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:56.417126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26584447-0714-4918-adb4-dfbf65c35c0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:56.417757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26584447-0714-4918-adb4-dfbf65c35c0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:56.419996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26584447-0714-4918-adb4-dfbf65c35c0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:56.421448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26584447-0714-4918-adb4-dfbf65c35c0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:56.424958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26584447-0714-4918-adb4-dfbf65c35c0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:57.319291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26584447-0714-4918-adb4-dfbf65c35c0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:57.342980 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26584447-0714-4918-adb4-dfbf65c35c0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1214 microversion: 2.1 time: 0.970911 Aug 27 04:58:57.362362 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2494/4927] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:56 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1214 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:58:58.368210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f99f97ac-f76f-43d3-991d-de5789e5a5d0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:58:58.369709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f99f97ac-f76f-43d3-991d-de5789e5a5d0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:58:58.389983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f99f97ac-f76f-43d3-991d-de5789e5a5d0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:58.390847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f99f97ac-f76f-43d3-991d-de5789e5a5d0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:58.392968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f99f97ac-f76f-43d3-991d-de5789e5a5d0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:58.398177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f99f97ac-f76f-43d3-991d-de5789e5a5d0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:58:58.399029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f99f97ac-f76f-43d3-991d-de5789e5a5d0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:58:58.405775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f99f97ac-f76f-43d3-991d-de5789e5a5d0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:58:59.264365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f99f97ac-f76f-43d3-991d-de5789e5a5d0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:58:59.286208 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f99f97ac-f76f-43d3-991d-de5789e5a5d0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1214 microversion: 2.1 time: 0.918417 Aug 27 04:58:59.299181 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2434/4928] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:58:58 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1214 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:00.316589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6873460b-e821-47dd-9cf5-dac1feeedf9a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:00.324893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6873460b-e821-47dd-9cf5-dac1feeedf9a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:00.351938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6873460b-e821-47dd-9cf5-dac1feeedf9a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:00.352450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6873460b-e821-47dd-9cf5-dac1feeedf9a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:00.357790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6873460b-e821-47dd-9cf5-dac1feeedf9a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:00.358594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6873460b-e821-47dd-9cf5-dac1feeedf9a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:00.359093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6873460b-e821-47dd-9cf5-dac1feeedf9a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:00.359545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6873460b-e821-47dd-9cf5-dac1feeedf9a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:00.714517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6873460b-e821-47dd-9cf5-dac1feeedf9a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:00.725530 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6873460b-e821-47dd-9cf5-dac1feeedf9a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1202 microversion: 2.1 time: 0.412888 Aug 27 04:59:00.726632 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2495/4929] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:00 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:01.754289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-42f97ab1-8b95-4139-b678-c0249a8e21a6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:01.755530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-42f97ab1-8b95-4139-b678-c0249a8e21a6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:01.759096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:01.776637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42f97ab1-8b95-4139-b678-c0249a8e21a6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:01.777637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42f97ab1-8b95-4139-b678-c0249a8e21a6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:01.781426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42f97ab1-8b95-4139-b678-c0249a8e21a6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:01.782593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42f97ab1-8b95-4139-b678-c0249a8e21a6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:01.784441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42f97ab1-8b95-4139-b678-c0249a8e21a6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:01.785876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42f97ab1-8b95-4139-b678-c0249a8e21a6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:02.270236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-42f97ab1-8b95-4139-b678-c0249a8e21a6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:02.280406 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-42f97ab1-8b95-4139-b678-c0249a8e21a6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1202 microversion: 2.1 time: 0.531704 Aug 27 04:59:02.305802 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2435/4930] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:01 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1202 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:03.303661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-80d018da-8239-4c08-bc75-80293282e926 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:03.304289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-80d018da-8239-4c08-bc75-80293282e926 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:03.308904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=34 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:03.327060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80d018da-8239-4c08-bc75-80293282e926 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:03.330705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80d018da-8239-4c08-bc75-80293282e926 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:03.331366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80d018da-8239-4c08-bc75-80293282e926 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:03.333515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80d018da-8239-4c08-bc75-80293282e926 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:03.336923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80d018da-8239-4c08-bc75-80293282e926 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:03.337664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80d018da-8239-4c08-bc75-80293282e926 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:03.846077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80d018da-8239-4c08-bc75-80293282e926 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:03.851729 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-80d018da-8239-4c08-bc75-80293282e926 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1202 microversion: 2.1 time: 0.552024 Aug 27 04:59:03.854143 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2496/4931] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:03 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1202 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:04.873919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3da95f4f-10f1-411b-856e-f9aca81d7383 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:04.874552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3da95f4f-10f1-411b-856e-f9aca81d7383 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:04.894003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da95f4f-10f1-411b-856e-f9aca81d7383 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:04.894509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da95f4f-10f1-411b-856e-f9aca81d7383 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:04.894955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da95f4f-10f1-411b-856e-f9aca81d7383 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:04.895827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da95f4f-10f1-411b-856e-f9aca81d7383 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:04.896299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da95f4f-10f1-411b-856e-f9aca81d7383 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:04.896779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da95f4f-10f1-411b-856e-f9aca81d7383 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:05.450359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3da95f4f-10f1-411b-856e-f9aca81d7383 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:05.462322 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3da95f4f-10f1-411b-856e-f9aca81d7383 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1202 microversion: 2.1 time: 0.593236 Aug 27 04:59:05.464838 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2436/4932] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:04 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1202 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:06.485792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7cf8abfb-95e7-462f-badb-ea97d1f9c3d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:06.486432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7cf8abfb-95e7-462f-badb-ea97d1f9c3d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:06.496854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cf8abfb-95e7-462f-badb-ea97d1f9c3d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:06.497393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cf8abfb-95e7-462f-badb-ea97d1f9c3d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:06.497842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cf8abfb-95e7-462f-badb-ea97d1f9c3d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:06.498567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cf8abfb-95e7-462f-badb-ea97d1f9c3d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:06.499024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cf8abfb-95e7-462f-badb-ea97d1f9c3d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:06.499462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cf8abfb-95e7-462f-badb-ea97d1f9c3d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:06.804477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7cf8abfb-95e7-462f-badb-ea97d1f9c3d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:06.813570 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7cf8abfb-95e7-462f-badb-ea97d1f9c3d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1202 microversion: 2.1 time: 0.334040 Aug 27 04:59:06.820974 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2497/4933] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:06 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1202 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:07.637646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8929e2ea-00ce-40ad-9af1-f3977caf4b07 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:07.640193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8929e2ea-00ce-40ad-9af1-f3977caf4b07 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:07.659105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8929e2ea-00ce-40ad-9af1-f3977caf4b07 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:07.663542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8929e2ea-00ce-40ad-9af1-f3977caf4b07 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:07.664761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8929e2ea-00ce-40ad-9af1-f3977caf4b07 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:07.667082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8929e2ea-00ce-40ad-9af1-f3977caf4b07 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:07.667766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8929e2ea-00ce-40ad-9af1-f3977caf4b07 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:07.668717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8929e2ea-00ce-40ad-9af1-f3977caf4b07 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:07.804716 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8929e2ea-00ce-40ad-9af1-f3977caf4b07 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "POST /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544/action" status: 200 len: 24566 microversion: 2.1 time: 0.170392 Aug 27 04:59:07.810275 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2437/4934] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:59:07 2022] POST /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544/action => generated 24566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:59:07.844690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6146bcdd-93a0-4634-bc13-b96d4121009e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:07.846135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6146bcdd-93a0-4634-bc13-b96d4121009e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:07.861738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6146bcdd-93a0-4634-bc13-b96d4121009e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:07.866301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6146bcdd-93a0-4634-bc13-b96d4121009e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:07.871295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6146bcdd-93a0-4634-bc13-b96d4121009e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:07.874155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6146bcdd-93a0-4634-bc13-b96d4121009e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:07.875440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6146bcdd-93a0-4634-bc13-b96d4121009e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:07.877265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6146bcdd-93a0-4634-bc13-b96d4121009e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:08.330879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6146bcdd-93a0-4634-bc13-b96d4121009e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:08.352609 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6146bcdd-93a0-4634-bc13-b96d4121009e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1202 microversion: 2.1 time: 0.502446 Aug 27 04:59:08.352609 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2498/4935] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:07 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1202 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:09.050043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-abc6df0b-8a44-465b-abbc-2ab05cf9aa3d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:09.078136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abc6df0b-8a44-465b-abbc-2ab05cf9aa3d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:09.081266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abc6df0b-8a44-465b-abbc-2ab05cf9aa3d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:09.085508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abc6df0b-8a44-465b-abbc-2ab05cf9aa3d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:09.282717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-abc6df0b-8a44-465b-abbc-2ab05cf9aa3d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Going to try to stop instance {{(pid=128870) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 04:59:09.372278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98b9ccaf-97da-4c0c-acbf-cd51c2536828 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:09.372963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98b9ccaf-97da-4c0c-acbf-cd51c2536828 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:09.397900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98b9ccaf-97da-4c0c-acbf-cd51c2536828 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:09.399570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98b9ccaf-97da-4c0c-acbf-cd51c2536828 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:09.401817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98b9ccaf-97da-4c0c-acbf-cd51c2536828 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:09.404020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98b9ccaf-97da-4c0c-acbf-cd51c2536828 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:09.406324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98b9ccaf-97da-4c0c-acbf-cd51c2536828 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:09.407139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98b9ccaf-97da-4c0c-acbf-cd51c2536828 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:09.434400 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-abc6df0b-8a44-465b-abbc-2ab05cf9aa3d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "POST /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/action" status: 202 len: 0 microversion: 2.1 time: 0.391703 Aug 27 04:59:09.435798 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2438/4936] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:59:09 2022] POST /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:59:09.485320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68e2c3a1-4f09-47fe-bed3-669b89a6124e tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:09.486302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-68e2c3a1-4f09-47fe-bed3-669b89a6124e tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:09.558388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68e2c3a1-4f09-47fe-bed3-669b89a6124e tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:09.558904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68e2c3a1-4f09-47fe-bed3-669b89a6124e tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:09.559350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68e2c3a1-4f09-47fe-bed3-669b89a6124e tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:09.560071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68e2c3a1-4f09-47fe-bed3-669b89a6124e tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:09.560549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68e2c3a1-4f09-47fe-bed3-669b89a6124e tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:09.580337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68e2c3a1-4f09-47fe-bed3-669b89a6124e tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:09.959635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-98b9ccaf-97da-4c0c-acbf-cd51c2536828 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:09.971294 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98b9ccaf-97da-4c0c-acbf-cd51c2536828 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1202 microversion: 2.1 time: 0.609339 Aug 27 04:59:09.985490 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2499/4937] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:09 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1202 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:10.043608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-68e2c3a1-4f09-47fe-bed3-669b89a6124e tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:10.057880 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-68e2c3a1-4f09-47fe-bed3-669b89a6124e tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1674 microversion: 2.1 time: 0.608687 Aug 27 04:59:10.059503 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2439/4938] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:09 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1674 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:10.994490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa676d70-76b0-400a-96ac-5ee1ca20f080 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:10.998312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fa676d70-76b0-400a-96ac-5ee1ca20f080 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:11.032920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa676d70-76b0-400a-96ac-5ee1ca20f080 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:11.035094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa676d70-76b0-400a-96ac-5ee1ca20f080 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:11.036028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa676d70-76b0-400a-96ac-5ee1ca20f080 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:11.037603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa676d70-76b0-400a-96ac-5ee1ca20f080 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:11.041974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa676d70-76b0-400a-96ac-5ee1ca20f080 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:11.042677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa676d70-76b0-400a-96ac-5ee1ca20f080 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:11.086182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9a34278b-2f55-4cbc-8feb-8f3d01aae058 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:11.088417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9a34278b-2f55-4cbc-8feb-8f3d01aae058 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:11.124425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a34278b-2f55-4cbc-8feb-8f3d01aae058 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:11.124970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a34278b-2f55-4cbc-8feb-8f3d01aae058 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:11.125383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a34278b-2f55-4cbc-8feb-8f3d01aae058 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:11.126304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a34278b-2f55-4cbc-8feb-8f3d01aae058 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:11.137319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a34278b-2f55-4cbc-8feb-8f3d01aae058 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:11.137820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a34278b-2f55-4cbc-8feb-8f3d01aae058 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:11.437927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9a34278b-2f55-4cbc-8feb-8f3d01aae058 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:11.447518 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9a34278b-2f55-4cbc-8feb-8f3d01aae058 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1674 microversion: 2.1 time: 0.366310 Aug 27 04:59:11.448698 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2440/4939] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:11 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1674 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:11.614303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-0ff52aa1-7b13-4322-8cd1-b542ccd11488 req-3a920b72-7296-4838-9a9d-3ca8b194d071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceb943b-a2fe-4445-9b5d-ac21543adf40", "name": "network-vif-plugged", "status": "completed", "tag": "e9cd9a99-7609-48ff-aae6-d3edb09edb0c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:11.633189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0ff52aa1-7b13-4322-8cd1-b542ccd11488 req-3a920b72-7296-4838-9a9d-3ca8b194d071 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:11.634985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0ff52aa1-7b13-4322-8cd1-b542ccd11488 req-3a920b72-7296-4838-9a9d-3ca8b194d071 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:11.635446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0ff52aa1-7b13-4322-8cd1-b542ccd11488 req-3a920b72-7296-4838-9a9d-3ca8b194d071 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:11.641701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa676d70-76b0-400a-96ac-5ee1ca20f080 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:11.652098 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa676d70-76b0-400a-96ac-5ee1ca20f080 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1202 microversion: 2.1 time: 0.660833 Aug 27 04:59:11.655636 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2500/4940] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:10 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1202 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:11.671114 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-0ff52aa1-7b13-4322-8cd1-b542ccd11488 req-3a920b72-7296-4838-9a9d-3ca8b194d071 service nova] Creating event network-vif-plugged:e9cd9a99-7609-48ff-aae6-d3edb09edb0c for instance bceb943b-a2fe-4445-9b5d-ac21543adf40 on n-h2-854823-1 Aug 27 04:59:11.677527 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-0ff52aa1-7b13-4322-8cd1-b542ccd11488 req-3a920b72-7296-4838-9a9d-3ca8b194d071 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066943 Aug 27 04:59:11.678223 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2441/4941] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:59:12.471353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a305521-82d8-469d-a979-3be3eec87de6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:12.472688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a305521-82d8-469d-a979-3be3eec87de6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:12.504944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a305521-82d8-469d-a979-3be3eec87de6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:12.519940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a305521-82d8-469d-a979-3be3eec87de6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:12.521929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a305521-82d8-469d-a979-3be3eec87de6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:12.526977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a305521-82d8-469d-a979-3be3eec87de6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:12.532127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a305521-82d8-469d-a979-3be3eec87de6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:12.532785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a305521-82d8-469d-a979-3be3eec87de6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:12.700614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-56e4152e-bd57-481d-9926-d3c978665b02 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:12.701379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-56e4152e-bd57-481d-9926-d3c978665b02 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:12.721494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56e4152e-bd57-481d-9926-d3c978665b02 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:12.722009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56e4152e-bd57-481d-9926-d3c978665b02 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:12.729743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56e4152e-bd57-481d-9926-d3c978665b02 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:12.730542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56e4152e-bd57-481d-9926-d3c978665b02 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:12.735574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56e4152e-bd57-481d-9926-d3c978665b02 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:12.738814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56e4152e-bd57-481d-9926-d3c978665b02 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:13.189672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-56e4152e-bd57-481d-9926-d3c978665b02 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:13.204472 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-56e4152e-bd57-481d-9926-d3c978665b02 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1202 microversion: 2.1 time: 0.522359 Aug 27 04:59:13.205754 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2442/4942] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:12 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1202 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:13.357208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a305521-82d8-469d-a979-3be3eec87de6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:13.366718 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a305521-82d8-469d-a979-3be3eec87de6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1674 microversion: 2.1 time: 0.901059 Aug 27 04:59:13.371103 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2501/4943] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:12 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1674 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:14.228447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bb50f24d-2e6f-450e-8e0f-fa3a81e926b2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:14.228447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bb50f24d-2e6f-450e-8e0f-fa3a81e926b2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:14.252715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb50f24d-2e6f-450e-8e0f-fa3a81e926b2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:14.253243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb50f24d-2e6f-450e-8e0f-fa3a81e926b2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:14.253700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb50f24d-2e6f-450e-8e0f-fa3a81e926b2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:14.254430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb50f24d-2e6f-450e-8e0f-fa3a81e926b2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:14.277283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb50f24d-2e6f-450e-8e0f-fa3a81e926b2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:14.277757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb50f24d-2e6f-450e-8e0f-fa3a81e926b2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:14.398930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20a8324d-de4f-4e19-8fa8-ccea35db2694 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:14.400243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20a8324d-de4f-4e19-8fa8-ccea35db2694 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:14.421077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20a8324d-de4f-4e19-8fa8-ccea35db2694 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:14.421707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20a8324d-de4f-4e19-8fa8-ccea35db2694 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:14.422402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20a8324d-de4f-4e19-8fa8-ccea35db2694 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:14.426749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20a8324d-de4f-4e19-8fa8-ccea35db2694 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:14.428318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20a8324d-de4f-4e19-8fa8-ccea35db2694 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:14.432456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20a8324d-de4f-4e19-8fa8-ccea35db2694 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:14.635510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bb50f24d-2e6f-450e-8e0f-fa3a81e926b2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:14.659770 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bb50f24d-2e6f-450e-8e0f-fa3a81e926b2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1390 microversion: 2.1 time: 0.436405 Aug 27 04:59:14.662378 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2443/4944] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:14 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1390 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:14.690384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a3c34c79-3b69-4b91-857f-931662ebb9a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:14.691117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a3c34c79-3b69-4b91-857f-931662ebb9a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:14.713335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3c34c79-3b69-4b91-857f-931662ebb9a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:14.713842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3c34c79-3b69-4b91-857f-931662ebb9a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:14.714406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3c34c79-3b69-4b91-857f-931662ebb9a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:14.714990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3c34c79-3b69-4b91-857f-931662ebb9a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:14.720849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3c34c79-3b69-4b91-857f-931662ebb9a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:14.721354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3c34c79-3b69-4b91-857f-931662ebb9a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:14.846116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-20a8324d-de4f-4e19-8fa8-ccea35db2694 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:14.857884 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20a8324d-de4f-4e19-8fa8-ccea35db2694 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1674 microversion: 2.1 time: 0.462627 Aug 27 04:59:14.866250 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2502/4945] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:14 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1674 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:15.044939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a3c34c79-3b69-4b91-857f-931662ebb9a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:15.061545 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a3c34c79-3b69-4b91-857f-931662ebb9a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1390 microversion: 2.1 time: 0.381094 Aug 27 04:59:15.066111 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2444/4946] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:14 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1390 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:15.085926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3c6178f-e6e8-40f6-a2c5-f758aaf6be05 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:15.086472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3c6178f-e6e8-40f6-a2c5-f758aaf6be05 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:15.094384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3c6178f-e6e8-40f6-a2c5-f758aaf6be05 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:15.096428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3c6178f-e6e8-40f6-a2c5-f758aaf6be05 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:15.097416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3c6178f-e6e8-40f6-a2c5-f758aaf6be05 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:15.100556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3c6178f-e6e8-40f6-a2c5-f758aaf6be05 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:15.104158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3c6178f-e6e8-40f6-a2c5-f758aaf6be05 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:15.104887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3c6178f-e6e8-40f6-a2c5-f758aaf6be05 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:15.530781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3c6178f-e6e8-40f6-a2c5-f758aaf6be05 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:15.541880 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3c6178f-e6e8-40f6-a2c5-f758aaf6be05 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1390 microversion: 2.1 time: 0.460373 Aug 27 04:59:15.559547 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2503/4947] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:15 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1390 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:15.568878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b7a14c2a-c6a5-4c81-87b9-46706e411db3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:15.570184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b7a14c2a-c6a5-4c81-87b9-46706e411db3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:15.579567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7a14c2a-c6a5-4c81-87b9-46706e411db3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:15.580060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7a14c2a-c6a5-4c81-87b9-46706e411db3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:15.581066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7a14c2a-c6a5-4c81-87b9-46706e411db3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:15.582414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7a14c2a-c6a5-4c81-87b9-46706e411db3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:15.583041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7a14c2a-c6a5-4c81-87b9-46706e411db3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:15.583682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7a14c2a-c6a5-4c81-87b9-46706e411db3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:15.634664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b7a14c2a-c6a5-4c81-87b9-46706e411db3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:59:15.842205 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b7a14c2a-c6a5-4c81-87b9-46706e411db3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 204 len: 0 microversion: 2.1 time: 0.273924 Aug 27 04:59:15.844911 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2445/4948] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 04:59:15 2022] DELETE /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:59:15.866653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae0549bf-f743-440f-b077-d4c27900a4d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:15.870788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ae0549bf-f743-440f-b077-d4c27900a4d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:15.882143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0549bf-f743-440f-b077-d4c27900a4d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:15.883518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0549bf-f743-440f-b077-d4c27900a4d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:15.885073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0549bf-f743-440f-b077-d4c27900a4d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:15.886505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0549bf-f743-440f-b077-d4c27900a4d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:15.887621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0549bf-f743-440f-b077-d4c27900a4d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:15.888341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0549bf-f743-440f-b077-d4c27900a4d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:16.116327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc5de5bd-bc37-490f-b294-a4740481db24 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Action: 'create', calling method: .version_select at 0x7f1f20e61d30>, body: {"keypair": {"name": "tempest-keypair-240842740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGluglmT1uCh3nEHN+hazyVGnm2Zi6GXioA84zLH76rQ+t8K3FAbhAIyzIqFEVcAzi99QDcU2+PPpzN4KH93drfsOAZGBJ6+cmlDmbnDuUZl/FSYVeNYLAWNGdEb2Jn05g=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:16.166142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-dc5de5bd-bc37-490f-b294-a4740481db24 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Getting quotas for project 3d73cadd70ef45259dd85e6d59cbbab1. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:59:16.192266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-dc5de5bd-bc37-490f-b294-a4740481db24 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Getting quotas for user ec72122ff0b84c5fb558ca810ddd213d and project 3d73cadd70ef45259dd85e6d59cbbab1. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:59:16.247926 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc5de5bd-bc37-490f-b294-a4740481db24 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.450856 Aug 27 04:59:16.249249 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2504/4949] 10.222.0.79 () {62 vars in 1200 bytes} [Sat Aug 27 04:59:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 454 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 27 04:59:16.259481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ae0549bf-f743-440f-b077-d4c27900a4d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:16.262064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-121a1c28-526d-470c-93be-6b6a577bae45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:16.264471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-121a1c28-526d-470c-93be-6b6a577bae45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:16.273591 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ae0549bf-f743-440f-b077-d4c27900a4d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1396 microversion: 2.1 time: 0.425120 Aug 27 04:59:16.275193 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2446/4950] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:15 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1396 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:16.279943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-121a1c28-526d-470c-93be-6b6a577bae45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:16.280645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-121a1c28-526d-470c-93be-6b6a577bae45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:16.281215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-121a1c28-526d-470c-93be-6b6a577bae45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:16.282020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-121a1c28-526d-470c-93be-6b6a577bae45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:16.282587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-121a1c28-526d-470c-93be-6b6a577bae45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:16.283105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-121a1c28-526d-470c-93be-6b6a577bae45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:16.602555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-121a1c28-526d-470c-93be-6b6a577bae45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:16.617308 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-121a1c28-526d-470c-93be-6b6a577bae45 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1674 microversion: 2.1 time: 0.365540 Aug 27 04:59:16.620441 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2505/4951] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:16 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1674 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:16.735859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-edd3f394-d690-4538-881c-d37bdbcc8a8a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:16.745674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-edd3f394-d690-4538-881c-d37bdbcc8a8a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:16.764119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edd3f394-d690-4538-881c-d37bdbcc8a8a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:16.764856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edd3f394-d690-4538-881c-d37bdbcc8a8a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:16.765625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edd3f394-d690-4538-881c-d37bdbcc8a8a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:16.766680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edd3f394-d690-4538-881c-d37bdbcc8a8a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:16.767326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edd3f394-d690-4538-881c-d37bdbcc8a8a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:16.768799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edd3f394-d690-4538-881c-d37bdbcc8a8a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:16.867971 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-edd3f394-d690-4538-881c-d37bdbcc8a8a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e/action" status: 200 len: 24559 microversion: 2.1 time: 0.139324 Aug 27 04:59:16.870680 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2447/4952] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:59:16 2022] POST /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e/action => generated 24559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:59:17.297292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f104eb6e-9c63-4deb-906c-e516590382b7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:17.297923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f104eb6e-9c63-4deb-906c-e516590382b7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:17.308069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f104eb6e-9c63-4deb-906c-e516590382b7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:17.308596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f104eb6e-9c63-4deb-906c-e516590382b7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:17.309041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f104eb6e-9c63-4deb-906c-e516590382b7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:17.314511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f104eb6e-9c63-4deb-906c-e516590382b7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:17.314858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f104eb6e-9c63-4deb-906c-e516590382b7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:17.315593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f104eb6e-9c63-4deb-906c-e516590382b7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:17.630377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f104eb6e-9c63-4deb-906c-e516590382b7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:17.639300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d9164ddb-d39f-41d0-9547-277f38f066e2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:17.640264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d9164ddb-d39f-41d0-9547-277f38f066e2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:17.642662 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f104eb6e-9c63-4deb-906c-e516590382b7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1396 microversion: 2.1 time: 0.349843 Aug 27 04:59:17.648135 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2506/4953] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:17 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1396 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:17.662702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9164ddb-d39f-41d0-9547-277f38f066e2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:17.668310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9164ddb-d39f-41d0-9547-277f38f066e2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:17.669932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9164ddb-d39f-41d0-9547-277f38f066e2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:17.672629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9164ddb-d39f-41d0-9547-277f38f066e2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:17.673227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9164ddb-d39f-41d0-9547-277f38f066e2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:17.679755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d9164ddb-d39f-41d0-9547-277f38f066e2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:17.686546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:18.057858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d9164ddb-d39f-41d0-9547-277f38f066e2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:18.073933 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d9164ddb-d39f-41d0-9547-277f38f066e2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1674 microversion: 2.1 time: 0.438895 Aug 27 04:59:18.078822 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2448/4954] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:17 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1674 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:18.677426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a923bd0-9a8a-406e-90b2-85a9be4dda75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:18.679451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a923bd0-9a8a-406e-90b2-85a9be4dda75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:18.695740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a923bd0-9a8a-406e-90b2-85a9be4dda75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:18.696567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a923bd0-9a8a-406e-90b2-85a9be4dda75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:18.697166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a923bd0-9a8a-406e-90b2-85a9be4dda75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:18.698240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a923bd0-9a8a-406e-90b2-85a9be4dda75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:18.699413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a923bd0-9a8a-406e-90b2-85a9be4dda75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:18.700286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a923bd0-9a8a-406e-90b2-85a9be4dda75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:19.102476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53aff755-75ef-41bd-8082-189b1a37d011 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:19.103840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-53aff755-75ef-41bd-8082-189b1a37d011 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:19.118351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53aff755-75ef-41bd-8082-189b1a37d011 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:19.118859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53aff755-75ef-41bd-8082-189b1a37d011 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:19.119306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53aff755-75ef-41bd-8082-189b1a37d011 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:19.120098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53aff755-75ef-41bd-8082-189b1a37d011 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:19.120466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53aff755-75ef-41bd-8082-189b1a37d011 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:19.120927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53aff755-75ef-41bd-8082-189b1a37d011 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:19.235034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a923bd0-9a8a-406e-90b2-85a9be4dda75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:19.245499 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a923bd0-9a8a-406e-90b2-85a9be4dda75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1396 microversion: 2.1 time: 0.580054 Aug 27 04:59:19.262708 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2507/4955] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:18 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1396 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:19.336676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1264340960", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "abaf3479-bd4f-4f28-9f05-7c7e6c23c53c"}], "security_groups": [{"name": "tempest-securitygroup--413775666"}], "key_name": "tempest-keypair-240842740", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:19.444221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53aff755-75ef-41bd-8082-189b1a37d011 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:19.452612 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-53aff755-75ef-41bd-8082-189b1a37d011 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1674 microversion: 2.1 time: 0.355919 Aug 27 04:59:19.461975 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2449/4956] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:19 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1674 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:19.630499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-fcf837a9-dd6f-4984-bb02-02fc7a2881f4 req-762bb8f0-15a2-46be-8fd7-ac517ffcd986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceb943b-a2fe-4445-9b5d-ac21543adf40", "name": "network-vif-deleted", "tag": "e9cd9a99-7609-48ff-aae6-d3edb09edb0c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:19.654597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fcf837a9-dd6f-4984-bb02-02fc7a2881f4 req-762bb8f0-15a2-46be-8fd7-ac517ffcd986 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:19.664693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] validate_networks() for [('abaf3479-bd4f-4f28-9f05-7c7e6c23c53c', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:59:19.672408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fcf837a9-dd6f-4984-bb02-02fc7a2881f4 req-762bb8f0-15a2-46be-8fd7-ac517ffcd986 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:19.672985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fcf837a9-dd6f-4984-bb02-02fc7a2881f4 req-762bb8f0-15a2-46be-8fd7-ac517ffcd986 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:19.700829 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-fcf837a9-dd6f-4984-bb02-02fc7a2881f4 req-762bb8f0-15a2-46be-8fd7-ac517ffcd986 service nova] Creating event network-vif-deleted:e9cd9a99-7609-48ff-aae6-d3edb09edb0c for instance bceb943b-a2fe-4445-9b5d-ac21543adf40 on n-h2-854823-1 Aug 27 04:59:19.717989 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-fcf837a9-dd6f-4984-bb02-02fc7a2881f4 req-762bb8f0-15a2-46be-8fd7-ac517ffcd986 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091521 Aug 27 04:59:19.719221 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2450/4957] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:59:20.272431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4a0fe278-b153-4e69-8571-6137d4d90103 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:20.273232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4a0fe278-b153-4e69-8571-6137d4d90103 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:20.292774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0fe278-b153-4e69-8571-6137d4d90103 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:20.293281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0fe278-b153-4e69-8571-6137d4d90103 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:20.293730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0fe278-b153-4e69-8571-6137d4d90103 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:20.315564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0fe278-b153-4e69-8571-6137d4d90103 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:20.315997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0fe278-b153-4e69-8571-6137d4d90103 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:20.316440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0fe278-b153-4e69-8571-6137d4d90103 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:20.495594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4a0fe278-b153-4e69-8571-6137d4d90103 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:20.505292 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4a0fe278-b153-4e69-8571-6137d4d90103 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1187 microversion: 2.1 time: 0.237679 Aug 27 04:59:20.518340 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2451/4958] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:20 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1187 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:20.522330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6f8abfe1-917a-4c73-b67a-bcc740016ba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:20.523157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6f8abfe1-917a-4c73-b67a-bcc740016ba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:20.536757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f8abfe1-917a-4c73-b67a-bcc740016ba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:20.539548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f8abfe1-917a-4c73-b67a-bcc740016ba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:20.539996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f8abfe1-917a-4c73-b67a-bcc740016ba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:20.544633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f8abfe1-917a-4c73-b67a-bcc740016ba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:20.545221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f8abfe1-917a-4c73-b67a-bcc740016ba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:20.545892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f8abfe1-917a-4c73-b67a-bcc740016ba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:20.596180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:59:20.596951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:59:20.597450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:59:20.597977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:59:20.598508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:59:20.619082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:20.621045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:20.622463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:20.624713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:20.626313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:20.628026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:20.674792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Getting quotas for project 3d73cadd70ef45259dd85e6d59cbbab1. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:59:20.688249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Getting quotas for user ec72122ff0b84c5fb558ca810ddd213d and project 3d73cadd70ef45259dd85e6d59cbbab1. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:59:20.714343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:59:20.718486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:59:20.828880 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-91d5b44a-efeb-44d0-a1ae-2eaeceea9120 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.493757 Aug 27 04:59:20.835888 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2508/4959] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 04:59:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:59:20.851411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d387c23a-dab9-4ce6-bc46-b81e77b7672b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:20.852488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d387c23a-dab9-4ce6-bc46-b81e77b7672b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:20.905124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6f8abfe1-917a-4c73-b67a-bcc740016ba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:20.915188 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6f8abfe1-917a-4c73-b67a-bcc740016ba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1651 microversion: 2.1 time: 0.407518 Aug 27 04:59:20.925599 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2452/4960] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:20 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1651 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:20.941886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4cd2ac1-49f9-4959-af97-96f3f187c404 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:20.952206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4cd2ac1-49f9-4959-af97-96f3f187c404 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:20.953089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4cd2ac1-49f9-4959-af97-96f3f187c404 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:20.953801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4cd2ac1-49f9-4959-af97-96f3f187c404 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:21.006081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f4cd2ac1-49f9-4959-af97-96f3f187c404 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Going to try to start instance {{(pid=128870) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 04:59:21.100633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d387c23a-dab9-4ce6-bc46-b81e77b7672b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:21.107669 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f4cd2ac1-49f9-4959-af97-96f3f187c404 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "POST /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/action" status: 202 len: 0 microversion: 2.1 time: 0.171675 Aug 27 04:59:21.109826 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2453/4961] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 04:59:20 2022] POST /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:59:21.122349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-653a657b-6738-4f1b-819b-1f0e41dc9686 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:21.124344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-653a657b-6738-4f1b-819b-1f0e41dc9686 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:21.130817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d387c23a-dab9-4ce6-bc46-b81e77b7672b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:21.138534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d387c23a-dab9-4ce6-bc46-b81e77b7672b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:21.142214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-653a657b-6738-4f1b-819b-1f0e41dc9686 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:21.144424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-653a657b-6738-4f1b-819b-1f0e41dc9686 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:21.148609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-653a657b-6738-4f1b-819b-1f0e41dc9686 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:21.152869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-653a657b-6738-4f1b-819b-1f0e41dc9686 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:21.155281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-653a657b-6738-4f1b-819b-1f0e41dc9686 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:21.156805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-653a657b-6738-4f1b-819b-1f0e41dc9686 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:21.163777 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d387c23a-dab9-4ce6-bc46-b81e77b7672b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1281 microversion: 2.20 time: 0.320343 Aug 27 04:59:21.165592 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2509/4962] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:20 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1281 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:59:21.528040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12d68f39-a170-4f1b-9089-bdb79ee1adbd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:21.529480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12d68f39-a170-4f1b-9089-bdb79ee1adbd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:21.542219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12d68f39-a170-4f1b-9089-bdb79ee1adbd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:21.543004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12d68f39-a170-4f1b-9089-bdb79ee1adbd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:21.547250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12d68f39-a170-4f1b-9089-bdb79ee1adbd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:21.548864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12d68f39-a170-4f1b-9089-bdb79ee1adbd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:21.549843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12d68f39-a170-4f1b-9089-bdb79ee1adbd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:21.550463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12d68f39-a170-4f1b-9089-bdb79ee1adbd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:21.559181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=92 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:21.629913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-653a657b-6738-4f1b-819b-1f0e41dc9686 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:21.644409 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-653a657b-6738-4f1b-819b-1f0e41dc9686 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1660 microversion: 2.1 time: 0.530156 Aug 27 04:59:21.649400 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2454/4963] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:21 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1660 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:21.695986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-12d68f39-a170-4f1b-9089-bdb79ee1adbd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:21.727355 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12d68f39-a170-4f1b-9089-bdb79ee1adbd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1187 microversion: 2.1 time: 0.205028 Aug 27 04:59:21.728134 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2510/4964] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:21 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1187 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:22.193081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-801cd83a-ba0b-4930-859d-1282cccaee73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:22.194534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-801cd83a-ba0b-4930-859d-1282cccaee73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:22.214640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-801cd83a-ba0b-4930-859d-1282cccaee73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:22.220163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-801cd83a-ba0b-4930-859d-1282cccaee73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:22.221129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-801cd83a-ba0b-4930-859d-1282cccaee73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:22.222318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-801cd83a-ba0b-4930-859d-1282cccaee73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:22.224959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-801cd83a-ba0b-4930-859d-1282cccaee73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:22.248223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-801cd83a-ba0b-4930-859d-1282cccaee73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:22.492869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-801cd83a-ba0b-4930-859d-1282cccaee73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:22.505175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-801cd83a-ba0b-4930-859d-1282cccaee73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:22.520124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-801cd83a-ba0b-4930-859d-1282cccaee73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:22.522217 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-801cd83a-ba0b-4930-859d-1282cccaee73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1333 microversion: 2.20 time: 0.338081 Aug 27 04:59:22.523625 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2455/4965] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:22 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1333 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:22.679538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8cafa516-61d9-4454-b401-913e93d25168 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:22.681761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8cafa516-61d9-4454-b401-913e93d25168 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:22.693423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cafa516-61d9-4454-b401-913e93d25168 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:22.694456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cafa516-61d9-4454-b401-913e93d25168 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:22.695402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cafa516-61d9-4454-b401-913e93d25168 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:22.697411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cafa516-61d9-4454-b401-913e93d25168 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:22.698690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cafa516-61d9-4454-b401-913e93d25168 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:22.700406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cafa516-61d9-4454-b401-913e93d25168 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:22.755738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ab45db2d-cdad-49fe-b298-5ec022b88e36 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:22.756698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ab45db2d-cdad-49fe-b298-5ec022b88e36 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:22.765438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab45db2d-cdad-49fe-b298-5ec022b88e36 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:22.766616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab45db2d-cdad-49fe-b298-5ec022b88e36 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:22.767631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab45db2d-cdad-49fe-b298-5ec022b88e36 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:22.768779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab45db2d-cdad-49fe-b298-5ec022b88e36 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:22.769577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab45db2d-cdad-49fe-b298-5ec022b88e36 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:22.770482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab45db2d-cdad-49fe-b298-5ec022b88e36 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:22.970435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8cafa516-61d9-4454-b401-913e93d25168 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:22.993147 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8cafa516-61d9-4454-b401-913e93d25168 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1660 microversion: 2.1 time: 0.320796 Aug 27 04:59:23.011922 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2511/4966] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:22 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1660 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:23.053016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ab45db2d-cdad-49fe-b298-5ec022b88e36 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:23.078546 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ab45db2d-cdad-49fe-b298-5ec022b88e36 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1187 microversion: 2.1 time: 0.327319 Aug 27 04:59:23.079158 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2456/4967] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:22 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1187 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:23.560346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34c7f947-7647-41f4-a657-4fb5f5aead25 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:23.561047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34c7f947-7647-41f4-a657-4fb5f5aead25 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:23.583512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34c7f947-7647-41f4-a657-4fb5f5aead25 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:23.586226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34c7f947-7647-41f4-a657-4fb5f5aead25 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:23.587475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34c7f947-7647-41f4-a657-4fb5f5aead25 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:23.589824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34c7f947-7647-41f4-a657-4fb5f5aead25 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:23.590344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34c7f947-7647-41f4-a657-4fb5f5aead25 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:23.590790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34c7f947-7647-41f4-a657-4fb5f5aead25 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:23.737718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34c7f947-7647-41f4-a657-4fb5f5aead25 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:23.754083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34c7f947-7647-41f4-a657-4fb5f5aead25 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:23.755856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34c7f947-7647-41f4-a657-4fb5f5aead25 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:23.764640 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34c7f947-7647-41f4-a657-4fb5f5aead25 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1339 microversion: 2.20 time: 0.206492 Aug 27 04:59:23.765328 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2512/4968] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:23 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1339 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:24.103615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2b6c5200-585a-4021-a48c-a49800e62c48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:24.104791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2b6c5200-585a-4021-a48c-a49800e62c48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:24.113051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b6c5200-585a-4021-a48c-a49800e62c48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:24.121692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b6c5200-585a-4021-a48c-a49800e62c48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:24.122510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b6c5200-585a-4021-a48c-a49800e62c48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:24.123797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b6c5200-585a-4021-a48c-a49800e62c48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:24.124675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b6c5200-585a-4021-a48c-a49800e62c48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:24.125343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b6c5200-585a-4021-a48c-a49800e62c48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:24.231575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7f187055-71a6-4d6a-80ab-a1e9e933e5ab tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:24.232265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7f187055-71a6-4d6a-80ab-a1e9e933e5ab tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:24.244793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f187055-71a6-4d6a-80ab-a1e9e933e5ab tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:24.245246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f187055-71a6-4d6a-80ab-a1e9e933e5ab tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:24.249249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f187055-71a6-4d6a-80ab-a1e9e933e5ab tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:24.250381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f187055-71a6-4d6a-80ab-a1e9e933e5ab tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:24.250867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f187055-71a6-4d6a-80ab-a1e9e933e5ab tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:24.251616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f187055-71a6-4d6a-80ab-a1e9e933e5ab tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:24.326418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2b6c5200-585a-4021-a48c-a49800e62c48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:24.341946 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2b6c5200-585a-4021-a48c-a49800e62c48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1187 microversion: 2.1 time: 0.242358 Aug 27 04:59:24.343067 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2513/4969] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:24 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1187 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:24.791082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8fa9b74b-decf-433e-b08f-d284927d3586 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:24.791789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8fa9b74b-decf-433e-b08f-d284927d3586 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:24.803949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fa9b74b-decf-433e-b08f-d284927d3586 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:24.806100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fa9b74b-decf-433e-b08f-d284927d3586 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:24.807816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fa9b74b-decf-433e-b08f-d284927d3586 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:24.808790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fa9b74b-decf-433e-b08f-d284927d3586 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:24.809412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fa9b74b-decf-433e-b08f-d284927d3586 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:24.809955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fa9b74b-decf-433e-b08f-d284927d3586 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:25.012729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8fa9b74b-decf-433e-b08f-d284927d3586 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:25.026642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8fa9b74b-decf-433e-b08f-d284927d3586 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:25.028230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7f187055-71a6-4d6a-80ab-a1e9e933e5ab tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:25.028859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8fa9b74b-decf-433e-b08f-d284927d3586 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:25.030456 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8fa9b74b-decf-433e-b08f-d284927d3586 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1339 microversion: 2.20 time: 0.243641 Aug 27 04:59:25.034833 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2514/4970] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:24 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1339 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:59:25.041567 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7f187055-71a6-4d6a-80ab-a1e9e933e5ab tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1664 microversion: 2.1 time: 1.023350 Aug 27 04:59:25.057150 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2457/4971] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:24 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1664 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:25.363493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59171d3a-e6c8-408c-9be0-52ab56ecf753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:25.364125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59171d3a-e6c8-408c-9be0-52ab56ecf753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:25.379139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59171d3a-e6c8-408c-9be0-52ab56ecf753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:25.379650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59171d3a-e6c8-408c-9be0-52ab56ecf753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:25.380099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59171d3a-e6c8-408c-9be0-52ab56ecf753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:25.384797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59171d3a-e6c8-408c-9be0-52ab56ecf753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:25.390196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59171d3a-e6c8-408c-9be0-52ab56ecf753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:25.390863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59171d3a-e6c8-408c-9be0-52ab56ecf753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:25.533662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-59171d3a-e6c8-408c-9be0-52ab56ecf753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:25.545389 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59171d3a-e6c8-408c-9be0-52ab56ecf753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1187 microversion: 2.1 time: 0.185835 Aug 27 04:59:25.548905 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2515/4972] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:25 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1187 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:25.872994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a2aa70da-448a-4c2e-937d-defb78987553 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Action: 'create', calling method: .version_select at 0x7f1f214d5ee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1151096513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuCtvsT7oCdzAZK3ZphePdZfjP/K54vxazCJPF0EqJfHJneeCCB/dAIePhSggPMEbGy7EQjMY5i/xOkGOB69ijIcjByh7EGkTsWTLaAeaPsvdhDc7M0DAlsmjgF3WNqsg=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:25.912971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-a2aa70da-448a-4c2e-937d-defb78987553 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Getting quotas for project 85633ba41ad24104bbe326cae9b1cfdc. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:59:25.925231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-a2aa70da-448a-4c2e-937d-defb78987553 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Getting quotas for user 9a461972bdc04f17b181940db823dbe0 and project 85633ba41ad24104bbe326cae9b1cfdc. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:59:25.990467 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a2aa70da-448a-4c2e-937d-defb78987553 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.121427 Aug 27 04:59:25.992640 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2458/4973] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 04:59:25 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:26.062268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e70897a-a050-421e-85ea-57984679a546 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:26.062927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e70897a-a050-421e-85ea-57984679a546 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:26.080446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e70897a-a050-421e-85ea-57984679a546 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:26.081078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e70897a-a050-421e-85ea-57984679a546 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:26.081525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e70897a-a050-421e-85ea-57984679a546 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:26.082892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e70897a-a050-421e-85ea-57984679a546 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:26.083332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e70897a-a050-421e-85ea-57984679a546 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:26.083917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e70897a-a050-421e-85ea-57984679a546 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:26.494476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e70897a-a050-421e-85ea-57984679a546 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:26.523633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e70897a-a050-421e-85ea-57984679a546 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:26.528468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e70897a-a050-421e-85ea-57984679a546 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:26.529733 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e70897a-a050-421e-85ea-57984679a546 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1406 microversion: 2.20 time: 0.472036 Aug 27 04:59:26.533782 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2516/4974] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:26 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1406 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:26.569912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8ab217e4-0220-438e-af54-ffe9ca3c3b75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:26.573377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8ab217e4-0220-438e-af54-ffe9ca3c3b75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:26.582816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ab217e4-0220-438e-af54-ffe9ca3c3b75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:26.584472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ab217e4-0220-438e-af54-ffe9ca3c3b75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:26.585565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ab217e4-0220-438e-af54-ffe9ca3c3b75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:26.586090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ab217e4-0220-438e-af54-ffe9ca3c3b75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:26.587122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ab217e4-0220-438e-af54-ffe9ca3c3b75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:26.587853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ab217e4-0220-438e-af54-ffe9ca3c3b75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:26.743640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ab217e4-0220-438e-af54-ffe9ca3c3b75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:26.755226 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8ab217e4-0220-438e-af54-ffe9ca3c3b75 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1187 microversion: 2.1 time: 0.189760 Aug 27 04:59:26.769466 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2459/4975] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:26 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1187 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:26.883953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6353e2ec-950b-4a86-9160-8aecf8d958ee req-e318d500-c0fc-46ef-913b-f8c7d79368f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd1a40c-a36d-4253-9f1c-b5711b2ed52a", "tag": "620b69e1-40ab-4292-881f-6f2fff934397"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:26.907570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6353e2ec-950b-4a86-9160-8aecf8d958ee req-e318d500-c0fc-46ef-913b-f8c7d79368f2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:26.908813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6353e2ec-950b-4a86-9160-8aecf8d958ee req-e318d500-c0fc-46ef-913b-f8c7d79368f2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:26.909686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6353e2ec-950b-4a86-9160-8aecf8d958ee req-e318d500-c0fc-46ef-913b-f8c7d79368f2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:26.945170 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6353e2ec-950b-4a86-9160-8aecf8d958ee req-e318d500-c0fc-46ef-913b-f8c7d79368f2 service nova] Creating event network-changed:620b69e1-40ab-4292-881f-6f2fff934397 for instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a on n-h1-854823-1 Aug 27 04:59:26.956501 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6353e2ec-950b-4a86-9160-8aecf8d958ee req-e318d500-c0fc-46ef-913b-f8c7d79368f2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079972 Aug 27 04:59:26.959470 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2517/4976] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:27.559528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-04eb43b8-0ae5-4791-ab9e-6aaf1a0441b9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:27.560134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-04eb43b8-0ae5-4791-ab9e-6aaf1a0441b9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:27.570834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-04eb43b8-0ae5-4791-ab9e-6aaf1a0441b9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:27.576866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-04eb43b8-0ae5-4791-ab9e-6aaf1a0441b9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:27.577009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-04eb43b8-0ae5-4791-ab9e-6aaf1a0441b9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:27.577929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-04eb43b8-0ae5-4791-ab9e-6aaf1a0441b9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:27.578622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-04eb43b8-0ae5-4791-ab9e-6aaf1a0441b9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:27.579239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-04eb43b8-0ae5-4791-ab9e-6aaf1a0441b9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:27.781694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b16cd05-0dc1-4ef6-8b0e-5c611261ce69 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:27.782623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b16cd05-0dc1-4ef6-8b0e-5c611261ce69 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:27.799922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b16cd05-0dc1-4ef6-8b0e-5c611261ce69 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:27.800426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b16cd05-0dc1-4ef6-8b0e-5c611261ce69 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:27.800903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b16cd05-0dc1-4ef6-8b0e-5c611261ce69 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:27.801620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b16cd05-0dc1-4ef6-8b0e-5c611261ce69 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:27.802120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b16cd05-0dc1-4ef6-8b0e-5c611261ce69 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:27.802550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b16cd05-0dc1-4ef6-8b0e-5c611261ce69 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:27.904501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b16cd05-0dc1-4ef6-8b0e-5c611261ce69 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:27.918648 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b16cd05-0dc1-4ef6-8b0e-5c611261ce69 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1187 microversion: 2.1 time: 0.141733 Aug 27 04:59:27.919502 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2518/4977] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:27 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1187 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:27.951999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-04eb43b8-0ae5-4791-ab9e-6aaf1a0441b9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:27.969247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-04eb43b8-0ae5-4791-ab9e-6aaf1a0441b9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:27.973117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-04eb43b8-0ae5-4791-ab9e-6aaf1a0441b9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:27.978798 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-04eb43b8-0ae5-4791-ab9e-6aaf1a0441b9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1406 microversion: 2.20 time: 0.423135 Aug 27 04:59:27.989195 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2460/4978] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:27 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1406 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:28.945660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28cdf784-2015-481c-814b-2dfa3d1258d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:28.947669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-28cdf784-2015-481c-814b-2dfa3d1258d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:28.956293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28cdf784-2015-481c-814b-2dfa3d1258d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:28.962218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28cdf784-2015-481c-814b-2dfa3d1258d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:28.962954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28cdf784-2015-481c-814b-2dfa3d1258d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:28.963864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28cdf784-2015-481c-814b-2dfa3d1258d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:28.964469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28cdf784-2015-481c-814b-2dfa3d1258d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:28.965077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28cdf784-2015-481c-814b-2dfa3d1258d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:29.012704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d0e87980-c4a1-428b-9385-0b013dc2d0a6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:29.013921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d0e87980-c4a1-428b-9385-0b013dc2d0a6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:29.022836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0e87980-c4a1-428b-9385-0b013dc2d0a6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:29.026440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0e87980-c4a1-428b-9385-0b013dc2d0a6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:29.027392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0e87980-c4a1-428b-9385-0b013dc2d0a6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:29.029419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0e87980-c4a1-428b-9385-0b013dc2d0a6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:29.033134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0e87980-c4a1-428b-9385-0b013dc2d0a6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:29.033742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0e87980-c4a1-428b-9385-0b013dc2d0a6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:29.119687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-28cdf784-2015-481c-814b-2dfa3d1258d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:29.138142 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-28cdf784-2015-481c-814b-2dfa3d1258d4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1187 microversion: 2.1 time: 0.196265 Aug 27 04:59:29.140417 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2519/4979] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:28 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1187 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:29.147572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1373404457", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "b83fa82e-24c5-4695-af20-e5495079629e"}], "key_name": "tempest-TestNetworkBasicOps-1151096513", "security_groups": [{"name": "tempest-secgroup-smoke-1606652059"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:29.337494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d0e87980-c4a1-428b-9385-0b013dc2d0a6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:29.346520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d0e87980-c4a1-428b-9385-0b013dc2d0a6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:29.350610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d0e87980-c4a1-428b-9385-0b013dc2d0a6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:29.352619 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d0e87980-c4a1-428b-9385-0b013dc2d0a6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1406 microversion: 2.20 time: 0.343785 Aug 27 04:59:29.353768 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2461/4980] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:29 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1406 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:59:29.401829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] validate_networks() for [('b83fa82e-24c5-4695-af20-e5495079629e', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:59:30.160018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf0f3642-876c-4185-91b5-33c7127e639d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:30.160843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bf0f3642-876c-4185-91b5-33c7127e639d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:30.185207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0f3642-876c-4185-91b5-33c7127e639d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:30.185718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0f3642-876c-4185-91b5-33c7127e639d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:30.190736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0f3642-876c-4185-91b5-33c7127e639d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:30.191807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0f3642-876c-4185-91b5-33c7127e639d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:30.198651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0f3642-876c-4185-91b5-33c7127e639d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:30.203850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0f3642-876c-4185-91b5-33c7127e639d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:30.227060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:59:30.228138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:59:30.228817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:59:30.229921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:59:30.230508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:59:30.250179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:30.264119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:30.270639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:30.272802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:30.274103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:30.275209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:30.289253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0f3642-876c-4185-91b5-33c7127e639d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:30.289817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0f3642-876c-4185-91b5-33c7127e639d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:30.290249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0f3642-876c-4185-91b5-33c7127e639d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:30.290895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-bf0f3642-876c-4185-91b5-33c7127e639d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lazy-loading 'fault' on Instance uuid bceb943b-a2fe-4445-9b5d-ac21543adf40 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:59:30.322869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Getting quotas for project 85633ba41ad24104bbe326cae9b1cfdc. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:59:30.339235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Getting quotas for user 9a461972bdc04f17b181940db823dbe0 and project 85633ba41ad24104bbe326cae9b1cfdc. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:59:30.357416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bf0f3642-876c-4185-91b5-33c7127e639d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:30.372314 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bf0f3642-876c-4185-91b5-33c7127e639d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 200 len: 1192 microversion: 2.1 time: 0.216539 Aug 27 04:59:30.373798 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2462/4981] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:30 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 1192 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:59:30.379270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-32c33501-8246-4a9d-ba08-c2070e0d77ea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:30.380143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-32c33501-8246-4a9d-ba08-c2070e0d77ea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:30.387979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32c33501-8246-4a9d-ba08-c2070e0d77ea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:30.388822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32c33501-8246-4a9d-ba08-c2070e0d77ea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:30.389586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32c33501-8246-4a9d-ba08-c2070e0d77ea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:30.390587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32c33501-8246-4a9d-ba08-c2070e0d77ea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:30.392307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:59:30.395541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32c33501-8246-4a9d-ba08-c2070e0d77ea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:30.396190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32c33501-8246-4a9d-ba08-c2070e0d77ea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:30.399795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:59:30.529696 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a3cacba-da65-44c9-8701-5717107e49ff tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.376483 Aug 27 04:59:30.530716 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2520/4982] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 04:59:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:59:30.542616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd999fcd-7d81-4b00-aa69-1844c4b48d08 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:30.550423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd999fcd-7d81-4b00-aa69-1844c4b48d08 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:30.688945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bd999fcd-7d81-4b00-aa69-1844c4b48d08 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:30.698345 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd999fcd-7d81-4b00-aa69-1844c4b48d08 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1249 microversion: 2.1 time: 0.160105 Aug 27 04:59:30.704690 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2521/4983] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:30 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1249 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:30.710296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-32c33501-8246-4a9d-ba08-c2070e0d77ea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:30.724332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-32c33501-8246-4a9d-ba08-c2070e0d77ea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:30.734455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-32c33501-8246-4a9d-ba08-c2070e0d77ea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:30.736470 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-32c33501-8246-4a9d-ba08-c2070e0d77ea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1406 microversion: 2.20 time: 0.361296 Aug 27 04:59:30.738404 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2463/4984] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:30 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1406 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:31.399890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ddbc724-6dfe-4ace-a1c4-100d48167f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:31.400442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8ddbc724-6dfe-4ace-a1c4-100d48167f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: bceb943b-a2fe-4445-9b5d-ac21543adf40] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:31.412010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ddbc724-6dfe-4ace-a1c4-100d48167f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:31.412521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ddbc724-6dfe-4ace-a1c4-100d48167f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:31.425285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ddbc724-6dfe-4ace-a1c4-100d48167f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:31.426333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ddbc724-6dfe-4ace-a1c4-100d48167f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:31.426986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ddbc724-6dfe-4ace-a1c4-100d48167f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:31.427590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ddbc724-6dfe-4ace-a1c4-100d48167f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:31.443221 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8ddbc724-6dfe-4ace-a1c4-100d48167f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance bceb943b-a2fe-4445-9b5d-ac21543adf40 could not be found. Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ddbc724-6dfe-4ace-a1c4-100d48167f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 HTTP/1.1 Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance bceb943b-a2fe-4445-9b5d-ac21543adf40 could not be found. Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'bceb943b-a2fe-4445-9b5d-ac21543adf40'} Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bceb943b-a2fe-4445-9b5d-ac21543adf40 could not be found. Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bceb943b-a2fe-4445-9b5d-ac21543adf40 could not be found. Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:59:31.458615 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:59:31.463735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:59:31.463735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:59:31.463735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:59:31.463735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:59:31.463735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:59:31.463735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bceb943b-a2fe-4445-9b5d-ac21543adf40 could not be found. Aug 27 04:59:31.463735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 04:59:31.465789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ddbc724-6dfe-4ace-a1c4-100d48167f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance bceb943b-a2fe-4445-9b5d-ac21543adf40 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:59:31.466854 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8ddbc724-6dfe-4ace-a1c4-100d48167f0b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40" status: 404 len: 111 microversion: 2.1 time: 0.072796 Aug 27 04:59:31.471012 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2522/4985] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:31 2022] GET /compute/v2.1/servers/bceb943b-a2fe-4445-9b5d-ac21543adf40 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:59:31.730953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8fc83d42-f7d4-4972-b035-da073af3a4f4 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:31.732237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8fc83d42-f7d4-4972-b035-da073af3a4f4 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:31.749695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fc83d42-f7d4-4972-b035-da073af3a4f4 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:31.752874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fc83d42-f7d4-4972-b035-da073af3a4f4 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:31.754935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fc83d42-f7d4-4972-b035-da073af3a4f4 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:31.755934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fc83d42-f7d4-4972-b035-da073af3a4f4 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:31.772914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fc83d42-f7d4-4972-b035-da073af3a4f4 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:31.773735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8fc83d42-f7d4-4972-b035-da073af3a4f4 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:31.798440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dafdcb2d-baa5-4520-818e-b7b040bd9a63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:31.800245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dafdcb2d-baa5-4520-818e-b7b040bd9a63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:31.809989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:31.836599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dafdcb2d-baa5-4520-818e-b7b040bd9a63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:31.838048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dafdcb2d-baa5-4520-818e-b7b040bd9a63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:31.839017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dafdcb2d-baa5-4520-818e-b7b040bd9a63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:31.847267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dafdcb2d-baa5-4520-818e-b7b040bd9a63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:31.847925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dafdcb2d-baa5-4520-818e-b7b040bd9a63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:31.850303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dafdcb2d-baa5-4520-818e-b7b040bd9a63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:32.029852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8fc83d42-f7d4-4972-b035-da073af3a4f4 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:32.038015 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8fc83d42-f7d4-4972-b035-da073af3a4f4 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1253 microversion: 2.1 time: 0.311988 Aug 27 04:59:32.041684 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2464/4986] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:31 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1253 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:32.157239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dafdcb2d-baa5-4520-818e-b7b040bd9a63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:32.170280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dafdcb2d-baa5-4520-818e-b7b040bd9a63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:32.171806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dafdcb2d-baa5-4520-818e-b7b040bd9a63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:32.172995 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dafdcb2d-baa5-4520-818e-b7b040bd9a63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1406 microversion: 2.20 time: 0.383271 Aug 27 04:59:32.173962 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2523/4987] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:31 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:59:33.063734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1a742cf5-5437-40c3-af32-05e6c219c68f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:33.065320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1a742cf5-5437-40c3-af32-05e6c219c68f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:33.101202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:33.109850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-fdfb18a4-9dae-474d-9a8e-e80355c3eac0 req-f402a062-9054-4a08-a507-684fb4598464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd1a40c-a36d-4253-9f1c-b5711b2ed52a", "name": "network-vif-plugged", "status": "completed", "tag": "620b69e1-40ab-4292-881f-6f2fff934397"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:33.131114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a742cf5-5437-40c3-af32-05e6c219c68f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:33.132325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a742cf5-5437-40c3-af32-05e6c219c68f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:33.135224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a742cf5-5437-40c3-af32-05e6c219c68f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:33.138143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a742cf5-5437-40c3-af32-05e6c219c68f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:33.146089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a742cf5-5437-40c3-af32-05e6c219c68f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:33.148219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a742cf5-5437-40c3-af32-05e6c219c68f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:33.160000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fdfb18a4-9dae-474d-9a8e-e80355c3eac0 req-f402a062-9054-4a08-a507-684fb4598464 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:33.162653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fdfb18a4-9dae-474d-9a8e-e80355c3eac0 req-f402a062-9054-4a08-a507-684fb4598464 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:33.166817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fdfb18a4-9dae-474d-9a8e-e80355c3eac0 req-f402a062-9054-4a08-a507-684fb4598464 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:33.220972 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-fdfb18a4-9dae-474d-9a8e-e80355c3eac0 req-f402a062-9054-4a08-a507-684fb4598464 service nova] Creating event network-vif-plugged:620b69e1-40ab-4292-881f-6f2fff934397 for instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a on n-h1-854823-1 Aug 27 04:59:33.233420 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-fdfb18a4-9dae-474d-9a8e-e80355c3eac0 req-f402a062-9054-4a08-a507-684fb4598464 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128386 Aug 27 04:59:33.234294 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2524/4988] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:59:33.251834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a42169bc-49c3-4acb-b049-36ef4f66948f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:33.252982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a42169bc-49c3-4acb-b049-36ef4f66948f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:33.269321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:33.273621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a42169bc-49c3-4acb-b049-36ef4f66948f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:33.275040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a42169bc-49c3-4acb-b049-36ef4f66948f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:33.276111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a42169bc-49c3-4acb-b049-36ef4f66948f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:33.277160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a42169bc-49c3-4acb-b049-36ef4f66948f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:33.277954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a42169bc-49c3-4acb-b049-36ef4f66948f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:33.278539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a42169bc-49c3-4acb-b049-36ef4f66948f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:33.470063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1a742cf5-5437-40c3-af32-05e6c219c68f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:33.489742 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1a742cf5-5437-40c3-af32-05e6c219c68f tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1319 microversion: 2.1 time: 0.432390 Aug 27 04:59:33.494982 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2465/4989] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:33 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:33.586214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a42169bc-49c3-4acb-b049-36ef4f66948f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:33.603621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a42169bc-49c3-4acb-b049-36ef4f66948f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:33.612274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a42169bc-49c3-4acb-b049-36ef4f66948f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:33.616446 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a42169bc-49c3-4acb-b049-36ef4f66948f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1406 microversion: 2.20 time: 0.374858 Aug 27 04:59:33.626989 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2525/4990] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:33 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1406 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:34.521977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e2c46347-92a8-42b4-b285-c7290e02e187 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:34.524603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e2c46347-92a8-42b4-b285-c7290e02e187 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:34.557074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2c46347-92a8-42b4-b285-c7290e02e187 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:34.564175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2c46347-92a8-42b4-b285-c7290e02e187 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:34.568773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2c46347-92a8-42b4-b285-c7290e02e187 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:34.577613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2c46347-92a8-42b4-b285-c7290e02e187 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:34.580166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2c46347-92a8-42b4-b285-c7290e02e187 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:34.583004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2c46347-92a8-42b4-b285-c7290e02e187 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:34.646108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a4c28e0-c8f3-4796-9b08-00608f5b6cac tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:34.647282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a4c28e0-c8f3-4796-9b08-00608f5b6cac tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:34.663926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a4c28e0-c8f3-4796-9b08-00608f5b6cac tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:34.671518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a4c28e0-c8f3-4796-9b08-00608f5b6cac tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:34.672339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a4c28e0-c8f3-4796-9b08-00608f5b6cac tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:34.673319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a4c28e0-c8f3-4796-9b08-00608f5b6cac tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:34.681575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a4c28e0-c8f3-4796-9b08-00608f5b6cac tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:34.682416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a4c28e0-c8f3-4796-9b08-00608f5b6cac tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:34.862452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e2c46347-92a8-42b4-b285-c7290e02e187 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:34.874880 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e2c46347-92a8-42b4-b285-c7290e02e187 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1375 microversion: 2.1 time: 0.357824 Aug 27 04:59:34.876924 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2466/4991] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:34 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1375 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:35.080818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a4c28e0-c8f3-4796-9b08-00608f5b6cac tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:35.091788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a4c28e0-c8f3-4796-9b08-00608f5b6cac tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:35.099938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a4c28e0-c8f3-4796-9b08-00608f5b6cac tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:35.107219 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a4c28e0-c8f3-4796-9b08-00608f5b6cac tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1406 microversion: 2.20 time: 0.465141 Aug 27 04:59:35.107784 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2526/4992] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:34 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:59:35.896937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e343a8eb-35e2-4175-8cd7-891f886b0ff2 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:35.897716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e343a8eb-35e2-4175-8cd7-891f886b0ff2 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:35.911757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e343a8eb-35e2-4175-8cd7-891f886b0ff2 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:35.912576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e343a8eb-35e2-4175-8cd7-891f886b0ff2 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:35.913096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e343a8eb-35e2-4175-8cd7-891f886b0ff2 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:35.918222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e343a8eb-35e2-4175-8cd7-891f886b0ff2 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:35.918884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e343a8eb-35e2-4175-8cd7-891f886b0ff2 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:35.919413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e343a8eb-35e2-4175-8cd7-891f886b0ff2 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:35.985075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:36.092551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e5efe9cb-2ea0-4213-ad26-b48b076f2287 req-0db4f571-cb8b-495b-bc63-ae7b74cfd29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3266305f-b5d8-4d6c-8741-03c1d4cc0175", "tag": "6a33d8c9-22d8-4dc7-a58e-a1e57fef11e5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:36.117402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e5efe9cb-2ea0-4213-ad26-b48b076f2287 req-0db4f571-cb8b-495b-bc63-ae7b74cfd29e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:36.117999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e5efe9cb-2ea0-4213-ad26-b48b076f2287 req-0db4f571-cb8b-495b-bc63-ae7b74cfd29e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:36.118484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e5efe9cb-2ea0-4213-ad26-b48b076f2287 req-0db4f571-cb8b-495b-bc63-ae7b74cfd29e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:36.169229 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e5efe9cb-2ea0-4213-ad26-b48b076f2287 req-0db4f571-cb8b-495b-bc63-ae7b74cfd29e service nova] Creating event network-changed:6a33d8c9-22d8-4dc7-a58e-a1e57fef11e5 for instance 3266305f-b5d8-4d6c-8741-03c1d4cc0175 on n-h2-854823-1 Aug 27 04:59:36.190567 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e5efe9cb-2ea0-4213-ad26-b48b076f2287 req-0db4f571-cb8b-495b-bc63-ae7b74cfd29e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101632 Aug 27 04:59:36.194966 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2527/4993] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:36.241650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f61fccf5-8c3c-4469-ac44-50c8c1c2cf66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:36.242852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f61fccf5-8c3c-4469-ac44-50c8c1c2cf66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:36.263897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f61fccf5-8c3c-4469-ac44-50c8c1c2cf66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:36.264444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f61fccf5-8c3c-4469-ac44-50c8c1c2cf66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:36.264927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f61fccf5-8c3c-4469-ac44-50c8c1c2cf66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:36.265714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f61fccf5-8c3c-4469-ac44-50c8c1c2cf66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:36.266187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f61fccf5-8c3c-4469-ac44-50c8c1c2cf66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:36.266668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e343a8eb-35e2-4175-8cd7-891f886b0ff2 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:36.268936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f61fccf5-8c3c-4469-ac44-50c8c1c2cf66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:36.286029 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e343a8eb-35e2-4175-8cd7-891f886b0ff2 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1375 microversion: 2.1 time: 0.393275 Aug 27 04:59:36.289901 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2467/4994] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:35 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1375 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:36.672702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f61fccf5-8c3c-4469-ac44-50c8c1c2cf66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:36.683777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f61fccf5-8c3c-4469-ac44-50c8c1c2cf66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:36.689828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f61fccf5-8c3c-4469-ac44-50c8c1c2cf66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:36.691884 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f61fccf5-8c3c-4469-ac44-50c8c1c2cf66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1597 microversion: 2.20 time: 0.491198 Aug 27 04:59:36.715261 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2528/4995] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:36 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1597 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:59:36.726006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2127f26a-6f6a-4c66-8e59-57c75026c96d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:36.726738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2127f26a-6f6a-4c66-8e59-57c75026c96d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:36.744205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2127f26a-6f6a-4c66-8e59-57c75026c96d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:36.752815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2127f26a-6f6a-4c66-8e59-57c75026c96d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:36.753429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2127f26a-6f6a-4c66-8e59-57c75026c96d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:36.754306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2127f26a-6f6a-4c66-8e59-57c75026c96d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:36.755507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2127f26a-6f6a-4c66-8e59-57c75026c96d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:36.758473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2127f26a-6f6a-4c66-8e59-57c75026c96d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:36.968693 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2127f26a-6f6a-4c66-8e59-57c75026c96d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.246176 Aug 27 04:59:36.978223 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2468/4996] 10.222.0.79 () {60 vars in 1316 bytes} [Sat Aug 27 04:59:36 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-interface => generated 284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:59:37.312379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0eb7224f-9a64-455d-aae3-d966d2c56cdb tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:37.313954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0eb7224f-9a64-455d-aae3-d966d2c56cdb tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:37.336457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0eb7224f-9a64-455d-aae3-d966d2c56cdb tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:37.339491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0eb7224f-9a64-455d-aae3-d966d2c56cdb tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:37.350007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0eb7224f-9a64-455d-aae3-d966d2c56cdb tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:37.354545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0eb7224f-9a64-455d-aae3-d966d2c56cdb tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:37.355802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0eb7224f-9a64-455d-aae3-d966d2c56cdb tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:37.356423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0eb7224f-9a64-455d-aae3-d966d2c56cdb tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:37.645489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0eb7224f-9a64-455d-aae3-d966d2c56cdb tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:37.658505 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0eb7224f-9a64-455d-aae3-d966d2c56cdb tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1375 microversion: 2.1 time: 0.350295 Aug 27 04:59:37.663386 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2529/4997] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:37 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1375 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:38.694170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c945d942-5cee-4948-9b5f-e55c3e264181 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:38.695255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c945d942-5cee-4948-9b5f-e55c3e264181 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:38.730278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c945d942-5cee-4948-9b5f-e55c3e264181 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:38.731173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c945d942-5cee-4948-9b5f-e55c3e264181 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:38.731952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c945d942-5cee-4948-9b5f-e55c3e264181 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:38.733202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c945d942-5cee-4948-9b5f-e55c3e264181 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:38.734030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c945d942-5cee-4948-9b5f-e55c3e264181 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:38.734812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c945d942-5cee-4948-9b5f-e55c3e264181 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:39.030506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-af48e798-740a-4a33-afe8-ac23f9190014 req-514ab6ec-5b6d-4737-ab31-3ab58b5e7f81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd1a40c-a36d-4253-9f1c-b5711b2ed52a", "tag": "620b69e1-40ab-4292-881f-6f2fff934397"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:39.095976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-af48e798-740a-4a33-afe8-ac23f9190014 req-514ab6ec-5b6d-4737-ab31-3ab58b5e7f81 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:39.096988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-af48e798-740a-4a33-afe8-ac23f9190014 req-514ab6ec-5b6d-4737-ab31-3ab58b5e7f81 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:39.097695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-af48e798-740a-4a33-afe8-ac23f9190014 req-514ab6ec-5b6d-4737-ab31-3ab58b5e7f81 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:39.152596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c945d942-5cee-4948-9b5f-e55c3e264181 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:39.153330 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-af48e798-740a-4a33-afe8-ac23f9190014 req-514ab6ec-5b6d-4737-ab31-3ab58b5e7f81 service nova] Creating event network-changed:620b69e1-40ab-4292-881f-6f2fff934397 for instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a on n-h1-854823-1 Aug 27 04:59:39.162559 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c945d942-5cee-4948-9b5f-e55c3e264181 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1375 microversion: 2.1 time: 0.478058 Aug 27 04:59:39.163752 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2469/4998] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:38 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1375 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:39.192805 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-af48e798-740a-4a33-afe8-ac23f9190014 req-514ab6ec-5b6d-4737-ab31-3ab58b5e7f81 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168769 Aug 27 04:59:39.198012 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2530/4999] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:40.200746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-78790c2b-4de2-4a92-8d5d-31c5f18ecae3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:40.202184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-78790c2b-4de2-4a92-8d5d-31c5f18ecae3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:40.219520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78790c2b-4de2-4a92-8d5d-31c5f18ecae3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:40.222890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78790c2b-4de2-4a92-8d5d-31c5f18ecae3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:40.226715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78790c2b-4de2-4a92-8d5d-31c5f18ecae3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:40.228353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78790c2b-4de2-4a92-8d5d-31c5f18ecae3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:40.229057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78790c2b-4de2-4a92-8d5d-31c5f18ecae3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:40.233017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78790c2b-4de2-4a92-8d5d-31c5f18ecae3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:41.426243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-78790c2b-4de2-4a92-8d5d-31c5f18ecae3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:41.442706 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-78790c2b-4de2-4a92-8d5d-31c5f18ecae3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1375 microversion: 2.1 time: 1.246572 Aug 27 04:59:41.451833 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2470/5000] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:40 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1375 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:42.472604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:42.473812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=20 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:42.479306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0abcce61-e045-4aac-b4cc-fc3142f34f3b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:42.480026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0abcce61-e045-4aac-b4cc-fc3142f34f3b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:42.505514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0abcce61-e045-4aac-b4cc-fc3142f34f3b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.506101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0abcce61-e045-4aac-b4cc-fc3142f34f3b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.506449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0abcce61-e045-4aac-b4cc-fc3142f34f3b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.507149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0abcce61-e045-4aac-b4cc-fc3142f34f3b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:42.507592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0abcce61-e045-4aac-b4cc-fc3142f34f3b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:42.508047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0abcce61-e045-4aac-b4cc-fc3142f34f3b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:42.865211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0abcce61-e045-4aac-b4cc-fc3142f34f3b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:42.876442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:42.890614 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0abcce61-e045-4aac-b4cc-fc3142f34f3b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1375 microversion: 2.1 time: 0.417323 Aug 27 04:59:42.910957 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2531/5001] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:42 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1375 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:43.911704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-482879f6-e2f9-4e18-b5a3-978fa6a6e769 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:43.913402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-482879f6-e2f9-4e18-b5a3-978fa6a6e769 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:43.922973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-482879f6-e2f9-4e18-b5a3-978fa6a6e769 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:43.923470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-482879f6-e2f9-4e18-b5a3-978fa6a6e769 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:43.923987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-482879f6-e2f9-4e18-b5a3-978fa6a6e769 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:43.925561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-482879f6-e2f9-4e18-b5a3-978fa6a6e769 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:43.926249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-482879f6-e2f9-4e18-b5a3-978fa6a6e769 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:43.926678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-482879f6-e2f9-4e18-b5a3-978fa6a6e769 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:44.122025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-482879f6-e2f9-4e18-b5a3-978fa6a6e769 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:44.136249 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-482879f6-e2f9-4e18-b5a3-978fa6a6e769 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1375 microversion: 2.1 time: 0.228471 Aug 27 04:59:44.137758 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2471/5002] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:43 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1375 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:45.058743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dbfa5927-620e-4e6a-b03d-2275899f7f13 req-1f21cbcd-3cf8-46da-be7d-1952f13c2f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3266305f-b5d8-4d6c-8741-03c1d4cc0175", "name": "network-vif-plugged", "status": "completed", "tag": "6a33d8c9-22d8-4dc7-a58e-a1e57fef11e5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:45.091120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dbfa5927-620e-4e6a-b03d-2275899f7f13 req-1f21cbcd-3cf8-46da-be7d-1952f13c2f53 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:45.091859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dbfa5927-620e-4e6a-b03d-2275899f7f13 req-1f21cbcd-3cf8-46da-be7d-1952f13c2f53 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:45.094044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dbfa5927-620e-4e6a-b03d-2275899f7f13 req-1f21cbcd-3cf8-46da-be7d-1952f13c2f53 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:45.118669 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dbfa5927-620e-4e6a-b03d-2275899f7f13 req-1f21cbcd-3cf8-46da-be7d-1952f13c2f53 service nova] Creating event network-vif-plugged:6a33d8c9-22d8-4dc7-a58e-a1e57fef11e5 for instance 3266305f-b5d8-4d6c-8741-03c1d4cc0175 on n-h2-854823-1 Aug 27 04:59:45.135635 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dbfa5927-620e-4e6a-b03d-2275899f7f13 req-1f21cbcd-3cf8-46da-be7d-1952f13c2f53 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081212 Aug 27 04:59:45.136265 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2532/5003] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 04:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:59:45.157661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ad7316a-5fd7-47e9-b019-210016474045 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:45.158293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1ad7316a-5fd7-47e9-b019-210016474045 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:45.170766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ad7316a-5fd7-47e9-b019-210016474045 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:45.170766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ad7316a-5fd7-47e9-b019-210016474045 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:45.170766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ad7316a-5fd7-47e9-b019-210016474045 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:45.170766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ad7316a-5fd7-47e9-b019-210016474045 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:45.170766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ad7316a-5fd7-47e9-b019-210016474045 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:45.170766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ad7316a-5fd7-47e9-b019-210016474045 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:45.446358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1ad7316a-5fd7-47e9-b019-210016474045 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:45.457777 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1ad7316a-5fd7-47e9-b019-210016474045 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1375 microversion: 2.1 time: 0.303915 Aug 27 04:59:45.465810 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2472/5004] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:45 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1375 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:46.483695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dab9fa90-6d33-47b2-9a37-835e55930e34 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:46.486805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dab9fa90-6d33-47b2-9a37-835e55930e34 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:46.494407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dab9fa90-6d33-47b2-9a37-835e55930e34 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:46.495116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dab9fa90-6d33-47b2-9a37-835e55930e34 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:46.495895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dab9fa90-6d33-47b2-9a37-835e55930e34 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:46.498222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dab9fa90-6d33-47b2-9a37-835e55930e34 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:46.498856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dab9fa90-6d33-47b2-9a37-835e55930e34 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:46.499447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dab9fa90-6d33-47b2-9a37-835e55930e34 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:46.844728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dab9fa90-6d33-47b2-9a37-835e55930e34 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:46.854682 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dab9fa90-6d33-47b2-9a37-835e55930e34 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1375 microversion: 2.1 time: 0.377778 Aug 27 04:59:46.870749 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2533/5005] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:46 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1375 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:47.882246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-40564aad-d01e-46d9-ac68-f0cc88ed81d6 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:47.884286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-40564aad-d01e-46d9-ac68-f0cc88ed81d6 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:47.902640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40564aad-d01e-46d9-ac68-f0cc88ed81d6 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:47.904749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40564aad-d01e-46d9-ac68-f0cc88ed81d6 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:47.905618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40564aad-d01e-46d9-ac68-f0cc88ed81d6 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:47.910762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40564aad-d01e-46d9-ac68-f0cc88ed81d6 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:47.912278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40564aad-d01e-46d9-ac68-f0cc88ed81d6 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:47.913351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40564aad-d01e-46d9-ac68-f0cc88ed81d6 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:48.306107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-40564aad-d01e-46d9-ac68-f0cc88ed81d6 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:48.315956 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-40564aad-d01e-46d9-ac68-f0cc88ed81d6 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1548 microversion: 2.1 time: 0.441205 Aug 27 04:59:48.336772 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2473/5006] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:47 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1548 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:48.343297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-663d1523-a5d9-4030-b215-3937445e5000 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:48.343920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-663d1523-a5d9-4030-b215-3937445e5000 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:48.357312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-663d1523-a5d9-4030-b215-3937445e5000 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:48.357824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-663d1523-a5d9-4030-b215-3937445e5000 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:48.358273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-663d1523-a5d9-4030-b215-3937445e5000 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:48.358992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-663d1523-a5d9-4030-b215-3937445e5000 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:48.359454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-663d1523-a5d9-4030-b215-3937445e5000 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:48.369175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-663d1523-a5d9-4030-b215-3937445e5000 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:49.009319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-663d1523-a5d9-4030-b215-3937445e5000 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:49.018738 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-663d1523-a5d9-4030-b215-3937445e5000 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1548 microversion: 2.1 time: 0.678616 Aug 27 04:59:49.033819 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2534/5007] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 04:59:48 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1548 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:59:50.654235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f8d5cda9-9ccb-4d2b-824d-f63b7576805b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Action: 'create', calling method: .version_select at 0x7f1f20f71160>, body: {"keypair": {"name": "tempest-keypair-259684562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn5MlB7Z4M/VXCB7iB1AilHdqkNtwDWRKR0dG9ASBoVoI6y/6g5LOx2CzjXM9W/LDa430hMmR6tWEwBVxkS3qCULcDxC7CHSVXXjxtBF7zonAfbX1hP+5ufCpO/bKB3nA=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:50.701605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-f8d5cda9-9ccb-4d2b-824d-f63b7576805b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Getting quotas for project 7a51afac6daf4c628cbd076b7aad9ee7. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:59:50.727954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-f8d5cda9-9ccb-4d2b-824d-f63b7576805b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Getting quotas for user 809234c837b04efca610afdf479c4f86 and project 7a51afac6daf4c628cbd076b7aad9ee7. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:59:50.784389 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f8d5cda9-9ccb-4d2b-824d-f63b7576805b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.134233 Aug 27 04:59:50.785510 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2474/5008] 10.222.0.79 () {62 vars in 1200 bytes} [Sat Aug 27 04:59:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 04:59:53.765407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1437302783", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6f05c74b-5794-4e8e-b73f-e252088fd71c"}, {"port": "fbb40aad-f6d0-4f6b-8334-5b18e9abb354", "tag": "port-1"}, {"port": "adaea27e-c6f4-4ae6-8f05-708c4fc87dfb", "tag": "port-2"}, {"uuid": "e525caac-e3b2-4ee8-98aa-fde04c7af037", "tag": "net-1"}, {"uuid": "e525caac-e3b2-4ee8-98aa-fde04c7af037"}, {"uuid": "4ac4a87a-24c0-4e25-8414-dd224b0c3139", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "4ac4a87a-24c0-4e25-8414-dd224b0c3139", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2568faa4-aea7-4f67-90c7-c69422bba740", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c06d72a5-cae5-447d-8996-c3a01ea0bdb7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "1826e4e5-60ee-454d-b8df-84742c0eedc5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--818044382"}], "key_name": "tempest-keypair-259684562", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:59:54.164626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] validate_networks() for [('6f05c74b-5794-4e8e-b73f-e252088fd71c', None, None, None, None, None), (None, None, 'fbb40aad-f6d0-4f6b-8334-5b18e9abb354', None, None, None), (None, None, 'adaea27e-c6f4-4ae6-8f05-708c4fc87dfb', None, None, None), ('e525caac-e3b2-4ee8-98aa-fde04c7af037', None, None, None, None, None), ('e525caac-e3b2-4ee8-98aa-fde04c7af037', None, None, None, None, None), ('4ac4a87a-24c0-4e25-8414-dd224b0c3139', '10.2.2.100', None, None, None, None), ('4ac4a87a-24c0-4e25-8414-dd224b0c3139', '10.2.2.200', None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:59:58.020363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:59:58.022636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:59:58.023687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:59:58.024105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:59:58.024765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:59:58.052573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:58.053441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:58.054091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:58.055849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:59:58.056494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:59:58.057126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:59:58.107750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Getting quotas for project 7a51afac6daf4c628cbd076b7aad9ee7. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:59:58.130919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Getting quotas for user 809234c837b04efca610afdf479c4f86 and project 7a51afac6daf4c628cbd076b7aad9ee7. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:59:58.511409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:59:58.515085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2568faa4-aea7-4f67-90c7-c69422bba740',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c06d72a5-cae5-447d-8996-c3a01ea0bdb7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1826e4e5-60ee-454d-b8df-84742c0eedc5',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:59:59.004352 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5f0f92d-7ff4-4b91-9d27-a45f9b3fbff0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 5.240589 Aug 27 04:59:59.011998 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2535/5009] 10.222.0.79 () {62 vars in 1189 bytes} [Sat Aug 27 04:59:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 5252 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 04:59:59.014241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=51 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:59.022137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-549fe1d6-1a83-450a-abd3-020acab7f6ea tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:59:59.023078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-549fe1d6-1a83-450a-abd3-020acab7f6ea tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:59:59.112670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-549fe1d6-1a83-450a-abd3-020acab7f6ea tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:59.143355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-549fe1d6-1a83-450a-abd3-020acab7f6ea tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:59.147310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-549fe1d6-1a83-450a-abd3-020acab7f6ea tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:59:59.151745 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-549fe1d6-1a83-450a-abd3-020acab7f6ea tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1285 microversion: 2.42 time: 0.139218 Aug 27 04:59:59.152347 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2475/5010] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 04:59:59 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:00.188894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2bae77ad-e2b8-43a8-a5f2-253da823c292 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:00.190111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2bae77ad-e2b8-43a8-a5f2-253da823c292 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:00.356102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2bae77ad-e2b8-43a8-a5f2-253da823c292 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:00.373658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2bae77ad-e2b8-43a8-a5f2-253da823c292 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:00.377317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2bae77ad-e2b8-43a8-a5f2-253da823c292 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:00.379111 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2bae77ad-e2b8-43a8-a5f2-253da823c292 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1285 microversion: 2.42 time: 0.204744 Aug 27 05:00:00.380102 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2536/5011] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:00 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:01.407060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-22dc2246-9983-446a-b707-19c331ac34ee tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:01.407844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-22dc2246-9983-446a-b707-19c331ac34ee tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:01.421164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22dc2246-9983-446a-b707-19c331ac34ee tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:01.421663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22dc2246-9983-446a-b707-19c331ac34ee tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:01.422104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22dc2246-9983-446a-b707-19c331ac34ee tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:01.424083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22dc2246-9983-446a-b707-19c331ac34ee tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:01.425513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22dc2246-9983-446a-b707-19c331ac34ee tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:01.426760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22dc2246-9983-446a-b707-19c331ac34ee tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:01.571299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-22dc2246-9983-446a-b707-19c331ac34ee tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:01.584756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-22dc2246-9983-446a-b707-19c331ac34ee tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:01.588618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-22dc2246-9983-446a-b707-19c331ac34ee tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:01.592000 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-22dc2246-9983-446a-b707-19c331ac34ee tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1583 microversion: 2.42 time: 0.189303 Aug 27 05:00:01.593521 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2476/5012] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:01 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1583 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:02.622116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a8a27e8-bacc-4975-84ff-6b2ba45c1e47 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:02.622743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a8a27e8-bacc-4975-84ff-6b2ba45c1e47 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:02.626418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:02.645737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8a27e8-bacc-4975-84ff-6b2ba45c1e47 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:02.646220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8a27e8-bacc-4975-84ff-6b2ba45c1e47 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:02.646659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8a27e8-bacc-4975-84ff-6b2ba45c1e47 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:02.647371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8a27e8-bacc-4975-84ff-6b2ba45c1e47 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:02.648354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8a27e8-bacc-4975-84ff-6b2ba45c1e47 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:02.648815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8a27e8-bacc-4975-84ff-6b2ba45c1e47 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:03.138251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a8a27e8-bacc-4975-84ff-6b2ba45c1e47 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:03.151430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a8a27e8-bacc-4975-84ff-6b2ba45c1e47 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:03.158095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a8a27e8-bacc-4975-84ff-6b2ba45c1e47 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:03.160464 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a8a27e8-bacc-4975-84ff-6b2ba45c1e47 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1593 microversion: 2.42 time: 0.541686 Aug 27 05:00:03.163053 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2537/5013] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:02 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1593 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:04.187611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fcb2b1b5-52f3-4d40-9737-4d6912a84aad tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:04.188236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fcb2b1b5-52f3-4d40-9737-4d6912a84aad tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:04.191375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:04.201786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb2b1b5-52f3-4d40-9737-4d6912a84aad tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:04.202303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb2b1b5-52f3-4d40-9737-4d6912a84aad tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:04.202755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb2b1b5-52f3-4d40-9737-4d6912a84aad tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:04.203476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb2b1b5-52f3-4d40-9737-4d6912a84aad tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:04.203939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb2b1b5-52f3-4d40-9737-4d6912a84aad tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:04.204376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fcb2b1b5-52f3-4d40-9737-4d6912a84aad tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:04.581453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fcb2b1b5-52f3-4d40-9737-4d6912a84aad tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:04.603635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fcb2b1b5-52f3-4d40-9737-4d6912a84aad tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:04.605493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fcb2b1b5-52f3-4d40-9737-4d6912a84aad tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:04.606922 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fcb2b1b5-52f3-4d40-9737-4d6912a84aad tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1706 microversion: 2.42 time: 0.423440 Aug 27 05:00:04.617883 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2477/5014] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:04 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1706 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:05.114465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba3a9348-ee9b-40aa-b07d-c95ab9a67006 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:05.115629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba3a9348-ee9b-40aa-b07d-c95ab9a67006 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:05.133914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba3a9348-ee9b-40aa-b07d-c95ab9a67006 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:05.134389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba3a9348-ee9b-40aa-b07d-c95ab9a67006 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:05.134937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba3a9348-ee9b-40aa-b07d-c95ab9a67006 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:05.135670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba3a9348-ee9b-40aa-b07d-c95ab9a67006 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:05.136131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba3a9348-ee9b-40aa-b07d-c95ab9a67006 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:05.136578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba3a9348-ee9b-40aa-b07d-c95ab9a67006 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:05.643662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb7d6c92-733d-460f-8bfc-7d06723573fe tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:05.644940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eb7d6c92-733d-460f-8bfc-7d06723573fe tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:05.657810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7d6c92-733d-460f-8bfc-7d06723573fe tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:05.662986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7d6c92-733d-460f-8bfc-7d06723573fe tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:05.665894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7d6c92-733d-460f-8bfc-7d06723573fe tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:05.666836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7d6c92-733d-460f-8bfc-7d06723573fe tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:05.673012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7d6c92-733d-460f-8bfc-7d06723573fe tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:05.673478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7d6c92-733d-460f-8bfc-7d06723573fe tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:05.997105 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba3a9348-ee9b-40aa-b07d-c95ab9a67006 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1834 microversion: 2.1 time: 0.886131 Aug 27 05:00:05.998708 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2538/5015] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:05 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1834 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:06.026044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c102605-88d5-483e-974b-865ffac207fb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:06.033304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c102605-88d5-483e-974b-865ffac207fb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:06.046151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c102605-88d5-483e-974b-865ffac207fb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:06.046664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c102605-88d5-483e-974b-865ffac207fb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:06.052658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c102605-88d5-483e-974b-865ffac207fb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:06.053654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c102605-88d5-483e-974b-865ffac207fb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:06.054195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c102605-88d5-483e-974b-865ffac207fb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:06.054642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c102605-88d5-483e-974b-865ffac207fb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:06.232261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb7d6c92-733d-460f-8bfc-7d06723573fe tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:06.246220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb7d6c92-733d-460f-8bfc-7d06723573fe tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:06.248172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb7d6c92-733d-460f-8bfc-7d06723573fe tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:06.252248 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb7d6c92-733d-460f-8bfc-7d06723573fe tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1752 microversion: 2.42 time: 0.612797 Aug 27 05:00:06.254856 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2478/5016] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:05 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1752 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:06.651772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c102605-88d5-483e-974b-865ffac207fb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:06.667417 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c102605-88d5-483e-974b-865ffac207fb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1683 microversion: 2.1 time: 0.645864 Aug 27 05:00:06.670696 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2539/5017] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:06 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1683 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:06.826620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2d49ee5e-846c-466d-a650-89b8a6c62e9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:06.830265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2d49ee5e-846c-466d-a650-89b8a6c62e9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:06.847648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d49ee5e-846c-466d-a650-89b8a6c62e9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:06.848978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d49ee5e-846c-466d-a650-89b8a6c62e9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:06.849589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d49ee5e-846c-466d-a650-89b8a6c62e9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:06.853528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d49ee5e-846c-466d-a650-89b8a6c62e9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:06.854325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d49ee5e-846c-466d-a650-89b8a6c62e9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:06.854967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d49ee5e-846c-466d-a650-89b8a6c62e9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:06.949665 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2d49ee5e-846c-466d-a650-89b8a6c62e9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e/action" status: 200 len: 32627 microversion: 2.1 time: 0.128894 Aug 27 05:00:06.958588 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2479/5018] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:00:06 2022] POST /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e/action => generated 32627 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:00:07.183620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8bfae5a5-119c-415d-aa8a-2b9c7b67e514 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:07.184083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8bfae5a5-119c-415d-aa8a-2b9c7b67e514 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:07.206147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfae5a5-119c-415d-aa8a-2b9c7b67e514 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.206643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfae5a5-119c-415d-aa8a-2b9c7b67e514 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.207082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfae5a5-119c-415d-aa8a-2b9c7b67e514 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.207801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfae5a5-119c-415d-aa8a-2b9c7b67e514 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.208252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfae5a5-119c-415d-aa8a-2b9c7b67e514 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.208703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfae5a5-119c-415d-aa8a-2b9c7b67e514 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.278020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7d22c96f-58ca-4dd9-896e-fd1140cdae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:07.278719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7d22c96f-58ca-4dd9-896e-fd1140cdae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:07.301245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d22c96f-58ca-4dd9-896e-fd1140cdae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.301749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d22c96f-58ca-4dd9-896e-fd1140cdae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.302192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d22c96f-58ca-4dd9-896e-fd1140cdae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.302906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d22c96f-58ca-4dd9-896e-fd1140cdae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.303362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d22c96f-58ca-4dd9-896e-fd1140cdae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.303787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d22c96f-58ca-4dd9-896e-fd1140cdae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.372022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8bfae5a5-119c-415d-aa8a-2b9c7b67e514 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1d0bee9b3c074da39665365d6c5a4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1649548b654371a5fc4f04ee9c1763', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:07.373008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8bfae5a5-119c-415d-aa8a-2b9c7b67e514 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] flavor_id is None. Assuming migration. {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 05:00:07.373628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8bfae5a5-119c-415d-aa8a-2b9c7b67e514 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:00:07.619076 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8bfae5a5-119c-415d-aa8a-2b9c7b67e514 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e/action" status: 202 len: 0 microversion: 2.1 time: 0.440048 Aug 27 05:00:07.620401 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2540/5019] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:00:07 2022] POST /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:00:07.634757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-41fbcbbb-336e-4e72-8ae2-076b76cbf6f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:07.635282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41fbcbbb-336e-4e72-8ae2-076b76cbf6f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:07.657736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41fbcbbb-336e-4e72-8ae2-076b76cbf6f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.658959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41fbcbbb-336e-4e72-8ae2-076b76cbf6f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.659581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41fbcbbb-336e-4e72-8ae2-076b76cbf6f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.661024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41fbcbbb-336e-4e72-8ae2-076b76cbf6f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:07.663936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41fbcbbb-336e-4e72-8ae2-076b76cbf6f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:07.664705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41fbcbbb-336e-4e72-8ae2-076b76cbf6f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:07.703566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7d22c96f-58ca-4dd9-896e-fd1140cdae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:07.718129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7d22c96f-58ca-4dd9-896e-fd1140cdae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:07.721335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7d22c96f-58ca-4dd9-896e-fd1140cdae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:07.725621 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7d22c96f-58ca-4dd9-896e-fd1140cdae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1752 microversion: 2.42 time: 0.451785 Aug 27 05:00:07.732560 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2480/5020] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:07 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1752 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:08.067928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:08.190702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-41fbcbbb-336e-4e72-8ae2-076b76cbf6f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:08.214924 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-41fbcbbb-336e-4e72-8ae2-076b76cbf6f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1692 microversion: 2.1 time: 0.589131 Aug 27 05:00:08.215550 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2541/5021] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:07 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1692 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:08.751733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-899361d6-f489-4e1f-b61d-9b89dc5ba028 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:08.752352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-899361d6-f489-4e1f-b61d-9b89dc5ba028 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:08.771348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-899361d6-f489-4e1f-b61d-9b89dc5ba028 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:08.771841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-899361d6-f489-4e1f-b61d-9b89dc5ba028 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:08.772277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-899361d6-f489-4e1f-b61d-9b89dc5ba028 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:08.773540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-899361d6-f489-4e1f-b61d-9b89dc5ba028 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:08.773995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-899361d6-f489-4e1f-b61d-9b89dc5ba028 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:08.774424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-899361d6-f489-4e1f-b61d-9b89dc5ba028 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:09.047652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-899361d6-f489-4e1f-b61d-9b89dc5ba028 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:09.057780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-899361d6-f489-4e1f-b61d-9b89dc5ba028 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:09.059221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-899361d6-f489-4e1f-b61d-9b89dc5ba028 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:09.062085 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-899361d6-f489-4e1f-b61d-9b89dc5ba028 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1798 microversion: 2.42 time: 0.314701 Aug 27 05:00:09.078797 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2481/5022] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:08 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1798 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:09.242434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0cb2376-45af-41db-b01e-5e4db394e3ee tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:09.243179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a0cb2376-45af-41db-b01e-5e4db394e3ee tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:09.256800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0cb2376-45af-41db-b01e-5e4db394e3ee tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:09.260118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0cb2376-45af-41db-b01e-5e4db394e3ee tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:09.260793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0cb2376-45af-41db-b01e-5e4db394e3ee tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:09.261619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0cb2376-45af-41db-b01e-5e4db394e3ee tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:09.263389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0cb2376-45af-41db-b01e-5e4db394e3ee tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:09.264779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0cb2376-45af-41db-b01e-5e4db394e3ee tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:10.086463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53d33216-ce1d-447d-8ba1-125c6d546273 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:10.087080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-53d33216-ce1d-447d-8ba1-125c6d546273 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:10.090191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:10.115566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53d33216-ce1d-447d-8ba1-125c6d546273 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:10.116071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53d33216-ce1d-447d-8ba1-125c6d546273 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:10.118637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53d33216-ce1d-447d-8ba1-125c6d546273 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:10.119395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53d33216-ce1d-447d-8ba1-125c6d546273 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:10.119866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53d33216-ce1d-447d-8ba1-125c6d546273 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:10.120302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53d33216-ce1d-447d-8ba1-125c6d546273 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:10.289528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a0cb2376-45af-41db-b01e-5e4db394e3ee tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:10.305782 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0cb2376-45af-41db-b01e-5e4db394e3ee tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1692 microversion: 2.1 time: 1.068037 Aug 27 05:00:10.308193 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2542/5023] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:09 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1692 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:10.731261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53d33216-ce1d-447d-8ba1-125c6d546273 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:10.746888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53d33216-ce1d-447d-8ba1-125c6d546273 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:10.750251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53d33216-ce1d-447d-8ba1-125c6d546273 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:10.754201 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-53d33216-ce1d-447d-8ba1-125c6d546273 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1844 microversion: 2.42 time: 0.672235 Aug 27 05:00:10.756279 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2482/5024] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:10 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1844 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:11.332447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a5dcedd-1ddb-4372-bc94-e885a61339e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:11.337207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a5dcedd-1ddb-4372-bc94-e885a61339e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:11.351598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:11.354663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a5dcedd-1ddb-4372-bc94-e885a61339e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:11.355167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a5dcedd-1ddb-4372-bc94-e885a61339e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:11.355611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a5dcedd-1ddb-4372-bc94-e885a61339e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:11.356347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a5dcedd-1ddb-4372-bc94-e885a61339e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:11.356847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a5dcedd-1ddb-4372-bc94-e885a61339e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:11.357351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a5dcedd-1ddb-4372-bc94-e885a61339e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:11.743740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2a5dcedd-1ddb-4372-bc94-e885a61339e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:11.762254 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a5dcedd-1ddb-4372-bc94-e885a61339e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1692 microversion: 2.1 time: 0.429023 Aug 27 05:00:11.766969 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2543/5025] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:11 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1692 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:11.784372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-44efe6c9-fa94-40d1-bb4e-673cb2edc342 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:11.785114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-44efe6c9-fa94-40d1-bb4e-673cb2edc342 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:11.798716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44efe6c9-fa94-40d1-bb4e-673cb2edc342 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:11.801117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44efe6c9-fa94-40d1-bb4e-673cb2edc342 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:11.804267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44efe6c9-fa94-40d1-bb4e-673cb2edc342 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:11.805299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44efe6c9-fa94-40d1-bb4e-673cb2edc342 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:11.809137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44efe6c9-fa94-40d1-bb4e-673cb2edc342 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:11.809684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44efe6c9-fa94-40d1-bb4e-673cb2edc342 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:12.190958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-67c40626-81ec-4cc1-b464-231c13733899 req-41b6a156-dce3-48ad-8421-4a9a26a0ac0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "tag": "8d4f958b-79cd-4a09-9322-87a1b16589ee"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:12.214152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-67c40626-81ec-4cc1-b464-231c13733899 req-41b6a156-dce3-48ad-8421-4a9a26a0ac0f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:12.215165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-67c40626-81ec-4cc1-b464-231c13733899 req-41b6a156-dce3-48ad-8421-4a9a26a0ac0f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:12.216838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-67c40626-81ec-4cc1-b464-231c13733899 req-41b6a156-dce3-48ad-8421-4a9a26a0ac0f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:12.238535 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-67c40626-81ec-4cc1-b464-231c13733899 req-41b6a156-dce3-48ad-8421-4a9a26a0ac0f service nova] Creating event network-changed:8d4f958b-79cd-4a09-9322-87a1b16589ee for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:00:12.252817 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-67c40626-81ec-4cc1-b464-231c13733899 req-41b6a156-dce3-48ad-8421-4a9a26a0ac0f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069326 Aug 27 05:00:12.254037 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2544/5026] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:12.373001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-44efe6c9-fa94-40d1-bb4e-673cb2edc342 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:12.394587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-44efe6c9-fa94-40d1-bb4e-673cb2edc342 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:12.401354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-44efe6c9-fa94-40d1-bb4e-673cb2edc342 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:12.405729 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-44efe6c9-fa94-40d1-bb4e-673cb2edc342 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1844 microversion: 2.42 time: 0.625820 Aug 27 05:00:12.419208 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2483/5027] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:11 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1844 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:12.793206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5450fea3-c816-4c3d-b8aa-10c02de2ea2a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:12.794731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5450fea3-c816-4c3d-b8aa-10c02de2ea2a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:12.826104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5450fea3-c816-4c3d-b8aa-10c02de2ea2a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:12.831230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5450fea3-c816-4c3d-b8aa-10c02de2ea2a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:12.832126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5450fea3-c816-4c3d-b8aa-10c02de2ea2a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:12.833087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5450fea3-c816-4c3d-b8aa-10c02de2ea2a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:12.836180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5450fea3-c816-4c3d-b8aa-10c02de2ea2a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:12.840985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5450fea3-c816-4c3d-b8aa-10c02de2ea2a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:13.368963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5450fea3-c816-4c3d-b8aa-10c02de2ea2a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:13.386404 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5450fea3-c816-4c3d-b8aa-10c02de2ea2a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1697 microversion: 2.1 time: 0.591696 Aug 27 05:00:13.388090 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2545/5028] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:12 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1697 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:13.441153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-08b4da15-59a7-4a4c-b84d-6c75685ba314 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:13.442618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-08b4da15-59a7-4a4c-b84d-6c75685ba314 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:13.461893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08b4da15-59a7-4a4c-b84d-6c75685ba314 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:13.485760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08b4da15-59a7-4a4c-b84d-6c75685ba314 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:13.489136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08b4da15-59a7-4a4c-b84d-6c75685ba314 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:13.490155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08b4da15-59a7-4a4c-b84d-6c75685ba314 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:13.495179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08b4da15-59a7-4a4c-b84d-6c75685ba314 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:13.497517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08b4da15-59a7-4a4c-b84d-6c75685ba314 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:13.764688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-08b4da15-59a7-4a4c-b84d-6c75685ba314 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:13.778647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-08b4da15-59a7-4a4c-b84d-6c75685ba314 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:13.780933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-08b4da15-59a7-4a4c-b84d-6c75685ba314 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:13.782749 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-08b4da15-59a7-4a4c-b84d-6c75685ba314 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1865 microversion: 2.42 time: 0.345845 Aug 27 05:00:13.783831 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2484/5029] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:13 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1865 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:14.296386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-545f9aeb-6af1-4de2-a12a-48fbc4161bcf req-a894ff05-0a97-4ce7-8e9b-631afa7261c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "tag": "fbb40aad-f6d0-4f6b-8334-5b18e9abb354"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:14.312129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-545f9aeb-6af1-4de2-a12a-48fbc4161bcf req-a894ff05-0a97-4ce7-8e9b-631afa7261c7 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:14.315082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-545f9aeb-6af1-4de2-a12a-48fbc4161bcf req-a894ff05-0a97-4ce7-8e9b-631afa7261c7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:14.318060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-545f9aeb-6af1-4de2-a12a-48fbc4161bcf req-a894ff05-0a97-4ce7-8e9b-631afa7261c7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:14.341337 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-545f9aeb-6af1-4de2-a12a-48fbc4161bcf req-a894ff05-0a97-4ce7-8e9b-631afa7261c7 service nova] Creating event network-changed:fbb40aad-f6d0-4f6b-8334-5b18e9abb354 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:00:14.352325 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-545f9aeb-6af1-4de2-a12a-48fbc4161bcf req-a894ff05-0a97-4ce7-8e9b-631afa7261c7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059720 Aug 27 05:00:14.353014 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2546/5030] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:14.410500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4a0026c1-5d08-4bb9-a846-042b40f101b0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:14.411256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4a0026c1-5d08-4bb9-a846-042b40f101b0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:14.423591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0026c1-5d08-4bb9-a846-042b40f101b0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:14.424103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0026c1-5d08-4bb9-a846-042b40f101b0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:14.424564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0026c1-5d08-4bb9-a846-042b40f101b0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:14.425366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0026c1-5d08-4bb9-a846-042b40f101b0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:14.425760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0026c1-5d08-4bb9-a846-042b40f101b0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:14.426159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0026c1-5d08-4bb9-a846-042b40f101b0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:14.809380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50a0a1f4-6c9d-479e-8116-6fdad47c7df8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:14.810356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50a0a1f4-6c9d-479e-8116-6fdad47c7df8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:14.820546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4a0026c1-5d08-4bb9-a846-042b40f101b0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:14.832013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a0a1f4-6c9d-479e-8116-6fdad47c7df8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:14.832505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a0a1f4-6c9d-479e-8116-6fdad47c7df8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:14.832974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a0a1f4-6c9d-479e-8116-6fdad47c7df8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:14.833703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a0a1f4-6c9d-479e-8116-6fdad47c7df8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:14.834249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a0a1f4-6c9d-479e-8116-6fdad47c7df8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:14.834572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a0a1f4-6c9d-479e-8116-6fdad47c7df8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:14.834761 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4a0026c1-5d08-4bb9-a846-042b40f101b0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1697 microversion: 2.1 time: 0.427819 Aug 27 05:00:14.835564 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2485/5031] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:14 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1697 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:15.273530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50a0a1f4-6c9d-479e-8116-6fdad47c7df8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:15.275855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:15.299504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50a0a1f4-6c9d-479e-8116-6fdad47c7df8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:15.301078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50a0a1f4-6c9d-479e-8116-6fdad47c7df8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:15.309656 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50a0a1f4-6c9d-479e-8116-6fdad47c7df8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1886 microversion: 2.42 time: 0.498848 Aug 27 05:00:15.313675 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2547/5032] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:14 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1886 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:15.858135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c9e59d43-f709-4ffe-9d3f-3821428c36fe tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:15.859562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c9e59d43-f709-4ffe-9d3f-3821428c36fe tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:15.877145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9e59d43-f709-4ffe-9d3f-3821428c36fe tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:15.877935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9e59d43-f709-4ffe-9d3f-3821428c36fe tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:15.878387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9e59d43-f709-4ffe-9d3f-3821428c36fe tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:15.879137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9e59d43-f709-4ffe-9d3f-3821428c36fe tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:15.879870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9e59d43-f709-4ffe-9d3f-3821428c36fe tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:15.886223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9e59d43-f709-4ffe-9d3f-3821428c36fe tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:16.311266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c9e59d43-f709-4ffe-9d3f-3821428c36fe tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:16.327363 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c9e59d43-f709-4ffe-9d3f-3821428c36fe tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1697 microversion: 2.1 time: 0.466755 Aug 27 05:00:16.331963 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2486/5033] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:15 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1697 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:16.333293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88323945-8993-4d6a-a2fd-e2f1cf82d080 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:16.334426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88323945-8993-4d6a-a2fd-e2f1cf82d080 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:16.346098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88323945-8993-4d6a-a2fd-e2f1cf82d080 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:16.348791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88323945-8993-4d6a-a2fd-e2f1cf82d080 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:16.351434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88323945-8993-4d6a-a2fd-e2f1cf82d080 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:16.354277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88323945-8993-4d6a-a2fd-e2f1cf82d080 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:16.356142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88323945-8993-4d6a-a2fd-e2f1cf82d080 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:16.359340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88323945-8993-4d6a-a2fd-e2f1cf82d080 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:16.393199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-b2f5e63e-eda6-4eda-8718-613c6632c750 req-0bf0a5f0-d472-4d00-9306-ce9d74c3f9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "tag": "adaea27e-c6f4-4ae6-8f05-708c4fc87dfb"}, {"name": "network-changed", "server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "tag": "c1f12ba8-4229-4c6b-8a69-f4b909bb0337"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:16.417053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b2f5e63e-eda6-4eda-8718-613c6632c750 req-0bf0a5f0-d472-4d00-9306-ce9d74c3f9e3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:16.417545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b2f5e63e-eda6-4eda-8718-613c6632c750 req-0bf0a5f0-d472-4d00-9306-ce9d74c3f9e3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:16.418075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b2f5e63e-eda6-4eda-8718-613c6632c750 req-0bf0a5f0-d472-4d00-9306-ce9d74c3f9e3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:16.437147 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b2f5e63e-eda6-4eda-8718-613c6632c750 req-0bf0a5f0-d472-4d00-9306-ce9d74c3f9e3 service nova] Creating event network-changed:adaea27e-c6f4-4ae6-8f05-708c4fc87dfb for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:00:16.440376 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b2f5e63e-eda6-4eda-8718-613c6632c750 req-0bf0a5f0-d472-4d00-9306-ce9d74c3f9e3 service nova] Creating event network-changed:c1f12ba8-4229-4c6b-8a69-f4b909bb0337 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:00:16.454665 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-b2f5e63e-eda6-4eda-8718-613c6632c750 req-0bf0a5f0-d472-4d00-9306-ce9d74c3f9e3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062775 Aug 27 05:00:16.458704 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2487/5034] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:16.739326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88323945-8993-4d6a-a2fd-e2f1cf82d080 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:16.755320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88323945-8993-4d6a-a2fd-e2f1cf82d080 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:16.757452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88323945-8993-4d6a-a2fd-e2f1cf82d080 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:16.758662 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88323945-8993-4d6a-a2fd-e2f1cf82d080 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1886 microversion: 2.42 time: 0.435398 Aug 27 05:00:16.765734 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2548/5035] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:16 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1886 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:17.355702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-af0f518e-6e4a-45c9-984d-9df4fd9e024a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:17.357156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-af0f518e-6e4a-45c9-984d-9df4fd9e024a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:17.378421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af0f518e-6e4a-45c9-984d-9df4fd9e024a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:17.379458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af0f518e-6e4a-45c9-984d-9df4fd9e024a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:17.380132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af0f518e-6e4a-45c9-984d-9df4fd9e024a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:17.382654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af0f518e-6e4a-45c9-984d-9df4fd9e024a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:17.383329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af0f518e-6e4a-45c9-984d-9df4fd9e024a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:17.384311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-af0f518e-6e4a-45c9-984d-9df4fd9e024a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:17.802675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e5b1ceec-2fb1-4b3c-81ac-f50b805b6f78 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:17.803322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e5b1ceec-2fb1-4b3c-81ac-f50b805b6f78 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:17.827923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5b1ceec-2fb1-4b3c-81ac-f50b805b6f78 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:17.828740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5b1ceec-2fb1-4b3c-81ac-f50b805b6f78 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:17.832960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5b1ceec-2fb1-4b3c-81ac-f50b805b6f78 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:17.833936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5b1ceec-2fb1-4b3c-81ac-f50b805b6f78 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:17.837117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5b1ceec-2fb1-4b3c-81ac-f50b805b6f78 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:17.838151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5b1ceec-2fb1-4b3c-81ac-f50b805b6f78 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:18.016237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-af0f518e-6e4a-45c9-984d-9df4fd9e024a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:18.039656 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-af0f518e-6e4a-45c9-984d-9df4fd9e024a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1697 microversion: 2.1 time: 0.691693 Aug 27 05:00:18.053117 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2488/5036] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:17 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1697 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:18.493968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-aed4c127-f12d-4616-afb2-afe31e48c62e req-12b88b84-a1a8-43e8-8a75-6ac22a533d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "tag": "3a3619e3-dc35-4c97-b3a7-cdae4e3af733"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:18.521068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-aed4c127-f12d-4616-afb2-afe31e48c62e req-12b88b84-a1a8-43e8-8a75-6ac22a533d95 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:18.524387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-aed4c127-f12d-4616-afb2-afe31e48c62e req-12b88b84-a1a8-43e8-8a75-6ac22a533d95 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:18.525091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-aed4c127-f12d-4616-afb2-afe31e48c62e req-12b88b84-a1a8-43e8-8a75-6ac22a533d95 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:18.560852 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-aed4c127-f12d-4616-afb2-afe31e48c62e req-12b88b84-a1a8-43e8-8a75-6ac22a533d95 service nova] Creating event network-changed:3a3619e3-dc35-4c97-b3a7-cdae4e3af733 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:00:18.568947 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-aed4c127-f12d-4616-afb2-afe31e48c62e req-12b88b84-a1a8-43e8-8a75-6ac22a533d95 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082582 Aug 27 05:00:18.569951 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2489/5037] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:00:18.575438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e5b1ceec-2fb1-4b3c-81ac-f50b805b6f78 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:18.608420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e5b1ceec-2fb1-4b3c-81ac-f50b805b6f78 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:18.611503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e5b1ceec-2fb1-4b3c-81ac-f50b805b6f78 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:18.615617 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e5b1ceec-2fb1-4b3c-81ac-f50b805b6f78 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1886 microversion: 2.42 time: 0.820878 Aug 27 05:00:18.618309 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2549/5038] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:17 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1886 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:19.071723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-383e8b9a-52ae-4fc0-bf83-a19bfff5f27c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:19.072429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-383e8b9a-52ae-4fc0-bf83-a19bfff5f27c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:19.082738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-383e8b9a-52ae-4fc0-bf83-a19bfff5f27c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:19.085799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-383e8b9a-52ae-4fc0-bf83-a19bfff5f27c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:19.089140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-383e8b9a-52ae-4fc0-bf83-a19bfff5f27c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:19.090140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-383e8b9a-52ae-4fc0-bf83-a19bfff5f27c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:19.094710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-383e8b9a-52ae-4fc0-bf83-a19bfff5f27c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:19.097699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-383e8b9a-52ae-4fc0-bf83-a19bfff5f27c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:19.199991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1305296407", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f417a3fc-b0d5-4294-bf92-3059dc0d1453", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "0b9321d5-af89-499e-b147-430b2ec333ca"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:19.441310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] validate_networks() for [('0b9321d5-af89-499e-b147-430b2ec333ca', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:00:19.711961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-383e8b9a-52ae-4fc0-bf83-a19bfff5f27c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:19.729819 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-383e8b9a-52ae-4fc0-bf83-a19bfff5f27c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1697 microversion: 2.1 time: 0.662626 Aug 27 05:00:19.732323 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2490/5039] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:19 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1697 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:19.752105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2947bca7-ea6a-43cc-85d3-98e5e8ac5d70 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:19.755983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2947bca7-ea6a-43cc-85d3-98e5e8ac5d70 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:19.770088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2947bca7-ea6a-43cc-85d3-98e5e8ac5d70 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:19.771693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2947bca7-ea6a-43cc-85d3-98e5e8ac5d70 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:19.774447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2947bca7-ea6a-43cc-85d3-98e5e8ac5d70 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:19.781834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2947bca7-ea6a-43cc-85d3-98e5e8ac5d70 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:19.785433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2947bca7-ea6a-43cc-85d3-98e5e8ac5d70 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:19.786225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2947bca7-ea6a-43cc-85d3-98e5e8ac5d70 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:20.382829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2947bca7-ea6a-43cc-85d3-98e5e8ac5d70 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:20.422969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2947bca7-ea6a-43cc-85d3-98e5e8ac5d70 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:20.426787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2947bca7-ea6a-43cc-85d3-98e5e8ac5d70 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:20.439047 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2947bca7-ea6a-43cc-85d3-98e5e8ac5d70 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1886 microversion: 2.42 time: 0.705206 Aug 27 05:00:20.439657 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2491/5040] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:19 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1886 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:20.686201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-76bc34d6-e2d3-43ff-9c18-a26fbc388877 req-97a4e10f-ce20-4b6e-a797-905acd59af25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "tag": "2f5d037f-12fc-48e0-a08b-bc7ed1c9a197"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:20.707980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-76bc34d6-e2d3-43ff-9c18-a26fbc388877 req-97a4e10f-ce20-4b6e-a797-905acd59af25 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:20.708462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-76bc34d6-e2d3-43ff-9c18-a26fbc388877 req-97a4e10f-ce20-4b6e-a797-905acd59af25 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:20.708915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-76bc34d6-e2d3-43ff-9c18-a26fbc388877 req-97a4e10f-ce20-4b6e-a797-905acd59af25 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:20.730567 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-76bc34d6-e2d3-43ff-9c18-a26fbc388877 req-97a4e10f-ce20-4b6e-a797-905acd59af25 service nova] Creating event network-changed:2f5d037f-12fc-48e0-a08b-bc7ed1c9a197 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:00:20.739427 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-76bc34d6-e2d3-43ff-9c18-a26fbc388877 req-97a4e10f-ce20-4b6e-a797-905acd59af25 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057489 Aug 27 05:00:20.740050 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2492/5041] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:00:20.758153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e7fbdead-55b5-41b4-9286-38de0fac2d92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:20.759586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e7fbdead-55b5-41b4-9286-38de0fac2d92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:20.767614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7fbdead-55b5-41b4-9286-38de0fac2d92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:20.768284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7fbdead-55b5-41b4-9286-38de0fac2d92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:20.769322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7fbdead-55b5-41b4-9286-38de0fac2d92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:20.770196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7fbdead-55b5-41b4-9286-38de0fac2d92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:20.770810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7fbdead-55b5-41b4-9286-38de0fac2d92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:20.771412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7fbdead-55b5-41b4-9286-38de0fac2d92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:21.083825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:00:21.084380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:00:21.085144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:00:21.085673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:00:21.086195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:00:21.109985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:21.114171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:21.123430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:21.126681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:21.128012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:21.130931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:21.201341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:00:21.233117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for user 8376c4e2cf814a8b8b1e2a8e404b0187 and project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:00:21.278410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e7fbdead-55b5-41b4-9286-38de0fac2d92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:21.287608 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e7fbdead-55b5-41b4-9286-38de0fac2d92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1697 microversion: 2.1 time: 0.535171 Aug 27 05:00:21.289500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:00:21.291116 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2493/5042] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:20 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1697 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:21.293767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f417a3fc-b0d5-4294-bf92-3059dc0d1453',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:00:21.375671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9b355667-08a2-4d26-b4dd-d10cbe85d241 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:21.376429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9b355667-08a2-4d26-b4dd-d10cbe85d241 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:21.405155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b355667-08a2-4d26-b4dd-d10cbe85d241 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:21.407096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b355667-08a2-4d26-b4dd-d10cbe85d241 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:21.408270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b355667-08a2-4d26-b4dd-d10cbe85d241 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:21.411013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b355667-08a2-4d26-b4dd-d10cbe85d241 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:21.411699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b355667-08a2-4d26-b4dd-d10cbe85d241 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:21.414208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b355667-08a2-4d26-b4dd-d10cbe85d241 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:21.441135 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3556de2f-47e2-4a18-8038-8bd113df6cf8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.245729 Aug 27 05:00:21.442410 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2550/5043] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:00:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:00:21.458579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88b08104-3b80-467c-85d1-c4bc5ad055f3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:21.462069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88b08104-3b80-467c-85d1-c4bc5ad055f3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:21.530715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9b355667-08a2-4d26-b4dd-d10cbe85d241 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:00:21.534053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:21.661108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88b08104-3b80-467c-85d1-c4bc5ad055f3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:21.673165 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88b08104-3b80-467c-85d1-c4bc5ad055f3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1057 microversion: 2.1 time: 0.222908 Aug 27 05:00:21.674480 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2551/5044] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:21 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1057 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:21.680133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f1c480f-30dc-4a70-97db-084d16671b14 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:21.680986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f1c480f-30dc-4a70-97db-084d16671b14 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:21.687766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f1c480f-30dc-4a70-97db-084d16671b14 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:21.688603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f1c480f-30dc-4a70-97db-084d16671b14 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:21.689251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f1c480f-30dc-4a70-97db-084d16671b14 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:21.690165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f1c480f-30dc-4a70-97db-084d16671b14 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:21.690843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f1c480f-30dc-4a70-97db-084d16671b14 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:21.691435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f1c480f-30dc-4a70-97db-084d16671b14 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:21.764058 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9b355667-08a2-4d26-b4dd-d10cbe85d241 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 204 len: 0 microversion: 2.1 time: 0.395589 Aug 27 05:00:21.766610 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2494/5045] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:00:21 2022] DELETE /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:00:21.782655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-24eb60cf-e724-4022-9dbf-b971c55639bd tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:21.785819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-24eb60cf-e724-4022-9dbf-b971c55639bd tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:21.801906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24eb60cf-e724-4022-9dbf-b971c55639bd tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:21.802424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24eb60cf-e724-4022-9dbf-b971c55639bd tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:21.802863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24eb60cf-e724-4022-9dbf-b971c55639bd tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:21.805332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24eb60cf-e724-4022-9dbf-b971c55639bd tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:21.805800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24eb60cf-e724-4022-9dbf-b971c55639bd tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:21.806232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24eb60cf-e724-4022-9dbf-b971c55639bd tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:22.027279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-24eb60cf-e724-4022-9dbf-b971c55639bd tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:22.035747 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-24eb60cf-e724-4022-9dbf-b971c55639bd tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1554 microversion: 2.1 time: 0.264873 Aug 27 05:00:22.036353 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2495/5046] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:21 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1554 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:22.102116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f1c480f-30dc-4a70-97db-084d16671b14 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:22.123726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f1c480f-30dc-4a70-97db-084d16671b14 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:22.126042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f1c480f-30dc-4a70-97db-084d16671b14 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:22.128462 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f1c480f-30dc-4a70-97db-084d16671b14 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1886 microversion: 2.42 time: 0.452218 Aug 27 05:00:22.145141 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2552/5047] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:21 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1886 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:22.312175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3fd51f98-5b0b-4aec-9c0e-8b43e9830980 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:22.313162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3fd51f98-5b0b-4aec-9c0e-8b43e9830980 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:22.325303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fd51f98-5b0b-4aec-9c0e-8b43e9830980 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:22.325967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fd51f98-5b0b-4aec-9c0e-8b43e9830980 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:22.326731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fd51f98-5b0b-4aec-9c0e-8b43e9830980 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:22.327744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fd51f98-5b0b-4aec-9c0e-8b43e9830980 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:22.329370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fd51f98-5b0b-4aec-9c0e-8b43e9830980 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:22.329884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3fd51f98-5b0b-4aec-9c0e-8b43e9830980 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:22.543239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3fd51f98-5b0b-4aec-9c0e-8b43e9830980 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:22.555057 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3fd51f98-5b0b-4aec-9c0e-8b43e9830980 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1697 microversion: 2.1 time: 0.247525 Aug 27 05:00:22.556270 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2496/5048] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:22 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1697 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:22.697816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-767626b9-8ff2-466b-8e77-1b21a427088f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:22.698814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-767626b9-8ff2-466b-8e77-1b21a427088f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:22.705958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767626b9-8ff2-466b-8e77-1b21a427088f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:22.706690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767626b9-8ff2-466b-8e77-1b21a427088f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:22.707283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767626b9-8ff2-466b-8e77-1b21a427088f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:22.708192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767626b9-8ff2-466b-8e77-1b21a427088f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:22.708943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767626b9-8ff2-466b-8e77-1b21a427088f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:22.709523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767626b9-8ff2-466b-8e77-1b21a427088f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:22.760256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-808b6699-991a-4721-9ca9-22251a8776f3 req-ce650cb3-947c-477e-90bb-58ad5b6dad77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "tag": "d47b1431-6e76-424f-a633-fedf675e1d79"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:22.771243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-808b6699-991a-4721-9ca9-22251a8776f3 req-ce650cb3-947c-477e-90bb-58ad5b6dad77 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:22.772799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-808b6699-991a-4721-9ca9-22251a8776f3 req-ce650cb3-947c-477e-90bb-58ad5b6dad77 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:22.773714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-808b6699-991a-4721-9ca9-22251a8776f3 req-ce650cb3-947c-477e-90bb-58ad5b6dad77 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:22.788977 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-808b6699-991a-4721-9ca9-22251a8776f3 req-ce650cb3-947c-477e-90bb-58ad5b6dad77 service nova] Creating event network-changed:d47b1431-6e76-424f-a633-fedf675e1d79 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:00:22.794909 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-808b6699-991a-4721-9ca9-22251a8776f3 req-ce650cb3-947c-477e-90bb-58ad5b6dad77 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038914 Aug 27 05:00:22.796023 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2497/5049] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:22.825941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-767626b9-8ff2-466b-8e77-1b21a427088f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:22.836890 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-767626b9-8ff2-466b-8e77-1b21a427088f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1109 microversion: 2.1 time: 0.146351 Aug 27 05:00:22.837522 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2553/5050] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:22 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1109 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:23.060407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0dcdd930-df4c-4805-9006-de1f633efd79 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:23.061844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0dcdd930-df4c-4805-9006-de1f633efd79 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:23.075559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0dcdd930-df4c-4805-9006-de1f633efd79 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:23.076689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0dcdd930-df4c-4805-9006-de1f633efd79 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:23.077332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0dcdd930-df4c-4805-9006-de1f633efd79 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:23.079069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0dcdd930-df4c-4805-9006-de1f633efd79 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:23.079872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0dcdd930-df4c-4805-9006-de1f633efd79 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:23.080502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0dcdd930-df4c-4805-9006-de1f633efd79 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:23.161807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-972c139b-ddaa-49ad-9925-8413ded9f330 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:23.163985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-972c139b-ddaa-49ad-9925-8413ded9f330 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:23.175256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-972c139b-ddaa-49ad-9925-8413ded9f330 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:23.177710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-972c139b-ddaa-49ad-9925-8413ded9f330 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:23.180020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-972c139b-ddaa-49ad-9925-8413ded9f330 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:23.181779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-972c139b-ddaa-49ad-9925-8413ded9f330 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:23.183408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-972c139b-ddaa-49ad-9925-8413ded9f330 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:23.184965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-972c139b-ddaa-49ad-9925-8413ded9f330 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:23.463832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0dcdd930-df4c-4805-9006-de1f633efd79 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:23.472919 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0dcdd930-df4c-4805-9006-de1f633efd79 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1554 microversion: 2.1 time: 0.418103 Aug 27 05:00:23.474442 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2498/5051] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:23 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1554 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:23.579038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e6832ec9-6453-4a7e-898d-079a76be6833 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:23.579666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e6832ec9-6453-4a7e-898d-079a76be6833 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:23.588130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6832ec9-6453-4a7e-898d-079a76be6833 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:23.592798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6832ec9-6453-4a7e-898d-079a76be6833 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:23.593513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6832ec9-6453-4a7e-898d-079a76be6833 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:23.594797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6832ec9-6453-4a7e-898d-079a76be6833 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:23.596234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6832ec9-6453-4a7e-898d-079a76be6833 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:23.597191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6832ec9-6453-4a7e-898d-079a76be6833 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:24.252412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e6832ec9-6453-4a7e-898d-079a76be6833 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:24.267313 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e6832ec9-6453-4a7e-898d-079a76be6833 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1697 microversion: 2.1 time: 0.693570 Aug 27 05:00:24.281736 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2499/5052] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:23 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1697 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:24.299552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1cf175fe-3beb-4ec0-8277-d05fc02a6927 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:24.304672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1cf175fe-3beb-4ec0-8277-d05fc02a6927 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:24.345287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cf175fe-3beb-4ec0-8277-d05fc02a6927 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:24.350776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cf175fe-3beb-4ec0-8277-d05fc02a6927 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:24.358360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cf175fe-3beb-4ec0-8277-d05fc02a6927 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:24.363739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cf175fe-3beb-4ec0-8277-d05fc02a6927 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:24.364620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cf175fe-3beb-4ec0-8277-d05fc02a6927 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:24.365270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cf175fe-3beb-4ec0-8277-d05fc02a6927 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:24.553745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-972c139b-ddaa-49ad-9925-8413ded9f330 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:24.565271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-972c139b-ddaa-49ad-9925-8413ded9f330 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:24.567141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-972c139b-ddaa-49ad-9925-8413ded9f330 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:24.570727 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-972c139b-ddaa-49ad-9925-8413ded9f330 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1886 microversion: 2.42 time: 1.421690 Aug 27 05:00:24.586576 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2554/5053] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:23 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1886 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:24.594527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82b4c6cc-5f46-4664-86c0-8c6dcbcdb954 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:24.595405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-82b4c6cc-5f46-4664-86c0-8c6dcbcdb954 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:24.603949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82b4c6cc-5f46-4664-86c0-8c6dcbcdb954 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:24.604923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82b4c6cc-5f46-4664-86c0-8c6dcbcdb954 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:24.605603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82b4c6cc-5f46-4664-86c0-8c6dcbcdb954 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:24.613865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82b4c6cc-5f46-4664-86c0-8c6dcbcdb954 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:24.614731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82b4c6cc-5f46-4664-86c0-8c6dcbcdb954 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:24.617265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82b4c6cc-5f46-4664-86c0-8c6dcbcdb954 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:24.709355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-82b4c6cc-5f46-4664-86c0-8c6dcbcdb954 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:24.719656 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-82b4c6cc-5f46-4664-86c0-8c6dcbcdb954 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 200 len: 1486 microversion: 2.1 time: 0.131649 Aug 27 05:00:24.724760 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2555/5054] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:24 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 1486 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:24.792405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1cf175fe-3beb-4ec0-8277-d05fc02a6927 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:24.800475 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1cf175fe-3beb-4ec0-8277-d05fc02a6927 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1127 microversion: 2.1 time: 0.517099 Aug 27 05:00:24.801101 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2500/5055] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:24 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1127 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:24.842146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e23c2335-6f2a-4ea8-8591-5f96a728f9de req-725e7b11-45e2-46fa-8ee1-5c223804c1bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3266305f-b5d8-4d6c-8741-03c1d4cc0175", "name": "network-vif-deleted", "tag": "6a33d8c9-22d8-4dc7-a58e-a1e57fef11e5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:24.859936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e23c2335-6f2a-4ea8-8591-5f96a728f9de req-725e7b11-45e2-46fa-8ee1-5c223804c1bc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:24.860865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e23c2335-6f2a-4ea8-8591-5f96a728f9de req-725e7b11-45e2-46fa-8ee1-5c223804c1bc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:24.861589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e23c2335-6f2a-4ea8-8591-5f96a728f9de req-725e7b11-45e2-46fa-8ee1-5c223804c1bc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:24.878856 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e23c2335-6f2a-4ea8-8591-5f96a728f9de req-725e7b11-45e2-46fa-8ee1-5c223804c1bc service nova] Creating event network-vif-deleted:6a33d8c9-22d8-4dc7-a58e-a1e57fef11e5 for instance 3266305f-b5d8-4d6c-8741-03c1d4cc0175 on n-h2-854823-1 Aug 27 05:00:24.890525 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e23c2335-6f2a-4ea8-8591-5f96a728f9de req-725e7b11-45e2-46fa-8ee1-5c223804c1bc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052271 Aug 27 05:00:24.896890 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2556/5056] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:25.301751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a51fd401-86ca-4a2e-bd92-687e7fadf42e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:25.302984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a51fd401-86ca-4a2e-bd92-687e7fadf42e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:25.317343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a51fd401-86ca-4a2e-bd92-687e7fadf42e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:25.318209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a51fd401-86ca-4a2e-bd92-687e7fadf42e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:25.318932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a51fd401-86ca-4a2e-bd92-687e7fadf42e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:25.321129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a51fd401-86ca-4a2e-bd92-687e7fadf42e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:25.327796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a51fd401-86ca-4a2e-bd92-687e7fadf42e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:25.328500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a51fd401-86ca-4a2e-bd92-687e7fadf42e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:25.616695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6eebf7d-6a43-4274-9547-b877df29558a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:25.618259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6eebf7d-6a43-4274-9547-b877df29558a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:25.659465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6eebf7d-6a43-4274-9547-b877df29558a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:25.661426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6eebf7d-6a43-4274-9547-b877df29558a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:25.669503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6eebf7d-6a43-4274-9547-b877df29558a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:25.673128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6eebf7d-6a43-4274-9547-b877df29558a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:25.677151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6eebf7d-6a43-4274-9547-b877df29558a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:25.677819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6eebf7d-6a43-4274-9547-b877df29558a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:26.159070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f6eebf7d-6a43-4274-9547-b877df29558a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:26.173991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f6eebf7d-6a43-4274-9547-b877df29558a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:26.190115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f6eebf7d-6a43-4274-9547-b877df29558a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:26.191989 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6eebf7d-6a43-4274-9547-b877df29558a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1886 microversion: 2.42 time: 0.595951 Aug 27 05:00:26.192831 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2557/5057] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:25 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1886 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:26.210904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9240c071-e13a-47dc-b6b4-a1c20174ea74 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:26.212035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9240c071-e13a-47dc-b6b4-a1c20174ea74 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 3266305f-b5d8-4d6c-8741-03c1d4cc0175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:26.226804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9240c071-e13a-47dc-b6b4-a1c20174ea74 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:26.228198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a51fd401-86ca-4a2e-bd92-687e7fadf42e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:26.228799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9240c071-e13a-47dc-b6b4-a1c20174ea74 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:26.229786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9240c071-e13a-47dc-b6b4-a1c20174ea74 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:26.233826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9240c071-e13a-47dc-b6b4-a1c20174ea74 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:26.234342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9240c071-e13a-47dc-b6b4-a1c20174ea74 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:26.243951 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a51fd401-86ca-4a2e-bd92-687e7fadf42e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1697 microversion: 2.1 time: 0.946176 Aug 27 05:00:26.244445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9240c071-e13a-47dc-b6b4-a1c20174ea74 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:26.257879 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2501/5058] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:25 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1697 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:26.261228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7172fba1-3215-439d-a245-aa30533e1106 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:26.262670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7172fba1-3215-439d-a245-aa30533e1106 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:26.272389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7172fba1-3215-439d-a245-aa30533e1106 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:26.272912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7172fba1-3215-439d-a245-aa30533e1106 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:26.273357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7172fba1-3215-439d-a245-aa30533e1106 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:26.274224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7172fba1-3215-439d-a245-aa30533e1106 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:26.274524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7172fba1-3215-439d-a245-aa30533e1106 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:26.274947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7172fba1-3215-439d-a245-aa30533e1106 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:26.294766 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9240c071-e13a-47dc-b6b4-a1c20174ea74 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] HTTP exception thrown: Instance 3266305f-b5d8-4d6c-8741-03c1d4cc0175 could not be found. Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9240c071-e13a-47dc-b6b4-a1c20174ea74 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Request method failure captured: Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 HTTP/1.1 Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaRM811Cx00m9jBTaHXe0XCWofY4WpsKYZc8Y3tH-Cux9k1apGsuVmCc7AXjzDFvxmuBqv1wXnyU10Y54VL9C7EUSbQ0UeedSn36RYRi2CgG4nqfpfouZFGiY-PcdEUKUfUM0mqv4gO_cyQju9ojG0KU9qc-XPQFc7LlN9iCLhw4oC8 Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 85633ba41ad24104bbe326cae9b1cfdc Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestNetworkBasicOps-265431408 Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/85633ba41ad24104bbe326cae9b1cfdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_85633ba41ad24104bbe326cae9b1cfdc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/85633ba41ad24104bbe326cae9b1cfdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/85633ba41ad24104bbe326cae9b1cfdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestNetworkBasicOps-265431408 Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 85633ba41ad24104bbe326cae9b1cfdc Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestNetworkBasicOps-265431408 Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestNetworkBasicOps-265431408-project Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 9a461972bdc04f17b181940db823dbe0 Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestNetworkBasicOps-265431408-project Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 3266305f-b5d8-4d6c-8741-03c1d4cc0175 could not be found. Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '3266305f-b5d8-4d6c-8741-03c1d4cc0175'} Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3266305f-b5d8-4d6c-8741-03c1d4cc0175 could not be found. Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3266305f-b5d8-4d6c-8741-03c1d4cc0175 could not be found. Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:26.297640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:00:26.302324 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:26.302324 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:26.302324 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:26.302324 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:00:26.302324 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:00:26.302324 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3266305f-b5d8-4d6c-8741-03c1d4cc0175 could not be found. Aug 27 05:00:26.302324 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:00:26.307454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9240c071-e13a-47dc-b6b4-a1c20174ea74 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Returning 404 to user: Instance 3266305f-b5d8-4d6c-8741-03c1d4cc0175 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:00:26.308867 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9240c071-e13a-47dc-b6b4-a1c20174ea74 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175" status: 404 len: 111 microversion: 2.1 time: 0.113927 Aug 27 05:00:26.311086 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2558/5059] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:26 2022] GET /compute/v2.1/servers/3266305f-b5d8-4d6c-8741-03c1d4cc0175 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:00:26.763593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dca9a535-df45-42ff-b956-6b4aae97e9e7 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '.version_select at 0x7f1f20e58160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:26.840496 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dca9a535-df45-42ff-b956-6b4aae97e9e7 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1151096513" status: 202 len: 0 microversion: 2.1 time: 0.081311 Aug 27 05:00:26.841128 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2559/5060] 10.222.0.79 () {58 vars in 1257 bytes} [Sat Aug 27 05:00:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1151096513 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:00:27.222913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e7f8830-5f4a-4c52-b13e-fb930779c6aa tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:27.223864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e7f8830-5f4a-4c52-b13e-fb930779c6aa tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:27.238841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e7f8830-5f4a-4c52-b13e-fb930779c6aa tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:27.241670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e7f8830-5f4a-4c52-b13e-fb930779c6aa tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:27.244211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e7f8830-5f4a-4c52-b13e-fb930779c6aa tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:27.245353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e7f8830-5f4a-4c52-b13e-fb930779c6aa tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:27.248943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e7f8830-5f4a-4c52-b13e-fb930779c6aa tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:27.249586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e7f8830-5f4a-4c52-b13e-fb930779c6aa tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:27.537602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7172fba1-3215-439d-a245-aa30533e1106 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:27.550937 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7172fba1-3215-439d-a245-aa30533e1106 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 1.304986 Aug 27 05:00:27.564713 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2502/5061] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:26 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:27.574896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-748e91d2-0a34-4b6c-bc45-c79bbda53714 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:27.578758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-748e91d2-0a34-4b6c-bc45-c79bbda53714 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:27.595347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748e91d2-0a34-4b6c-bc45-c79bbda53714 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:27.596077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748e91d2-0a34-4b6c-bc45-c79bbda53714 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:27.597111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748e91d2-0a34-4b6c-bc45-c79bbda53714 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:27.603732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748e91d2-0a34-4b6c-bc45-c79bbda53714 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:27.604428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748e91d2-0a34-4b6c-bc45-c79bbda53714 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:27.605155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748e91d2-0a34-4b6c-bc45-c79bbda53714 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:27.913215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e7f8830-5f4a-4c52-b13e-fb930779c6aa tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:27.937738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e7f8830-5f4a-4c52-b13e-fb930779c6aa tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:27.945162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e7f8830-5f4a-4c52-b13e-fb930779c6aa tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:27.947423 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e7f8830-5f4a-4c52-b13e-fb930779c6aa tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1886 microversion: 2.42 time: 0.728083 Aug 27 05:00:27.952499 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2560/5062] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:27 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1886 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:28.570988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-748e91d2-0a34-4b6c-bc45-c79bbda53714 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:28.572922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9dd2ef9a-28cd-4b9c-9b62-5a535240038c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:28.573768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9dd2ef9a-28cd-4b9c-9b62-5a535240038c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:28.580606 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-748e91d2-0a34-4b6c-bc45-c79bbda53714 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1697 microversion: 2.1 time: 1.014441 Aug 27 05:00:28.593092 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2503/5063] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:27 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1697 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:28.602082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dd2ef9a-28cd-4b9c-9b62-5a535240038c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:28.602942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dd2ef9a-28cd-4b9c-9b62-5a535240038c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:28.606284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dd2ef9a-28cd-4b9c-9b62-5a535240038c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:28.608704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dd2ef9a-28cd-4b9c-9b62-5a535240038c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:28.610830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dd2ef9a-28cd-4b9c-9b62-5a535240038c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:28.611511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dd2ef9a-28cd-4b9c-9b62-5a535240038c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:28.979455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5a4a4727-ad78-4fb9-8c9f-371552b53b9e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:28.980463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5a4a4727-ad78-4fb9-8c9f-371552b53b9e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:28.992365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a4a4727-ad78-4fb9-8c9f-371552b53b9e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:28.997003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a4a4727-ad78-4fb9-8c9f-371552b53b9e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:28.997718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a4a4727-ad78-4fb9-8c9f-371552b53b9e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:28.998708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a4a4727-ad78-4fb9-8c9f-371552b53b9e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:28.999533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a4a4727-ad78-4fb9-8c9f-371552b53b9e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:29.000428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a4a4727-ad78-4fb9-8c9f-371552b53b9e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:29.321016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9dd2ef9a-28cd-4b9c-9b62-5a535240038c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:29.338391 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9dd2ef9a-28cd-4b9c-9b62-5a535240038c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.766349 Aug 27 05:00:29.339430 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2561/5064] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:28 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:29.607432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5961f56-5ae0-4697-9368-cd4229b2c355 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:29.608322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5961f56-5ae0-4697-9368-cd4229b2c355 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:29.624605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5961f56-5ae0-4697-9368-cd4229b2c355 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:29.628897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5961f56-5ae0-4697-9368-cd4229b2c355 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:29.629682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5961f56-5ae0-4697-9368-cd4229b2c355 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:29.633593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5961f56-5ae0-4697-9368-cd4229b2c355 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:29.635751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5961f56-5ae0-4697-9368-cd4229b2c355 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:29.639185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5961f56-5ae0-4697-9368-cd4229b2c355 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:30.307620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5a4a4727-ad78-4fb9-8c9f-371552b53b9e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:30.325556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5a4a4727-ad78-4fb9-8c9f-371552b53b9e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:30.327769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5a4a4727-ad78-4fb9-8c9f-371552b53b9e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:30.331576 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5a4a4727-ad78-4fb9-8c9f-371552b53b9e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1886 microversion: 2.42 time: 1.358177 Aug 27 05:00:30.338241 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2504/5065] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:28 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1886 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:30.367981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e5c6ef98-81e2-4538-8ae7-4bb3b012e550 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:30.368901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e5c6ef98-81e2-4538-8ae7-4bb3b012e550 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:30.383343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5c6ef98-81e2-4538-8ae7-4bb3b012e550 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:30.387363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5c6ef98-81e2-4538-8ae7-4bb3b012e550 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:30.389937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5c6ef98-81e2-4538-8ae7-4bb3b012e550 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:30.393512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5c6ef98-81e2-4538-8ae7-4bb3b012e550 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:30.394242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5c6ef98-81e2-4538-8ae7-4bb3b012e550 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:30.397707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5c6ef98-81e2-4538-8ae7-4bb3b012e550 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:30.714805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c5961f56-5ae0-4697-9368-cd4229b2c355 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:30.737701 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5961f56-5ae0-4697-9368-cd4229b2c355 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1696 microversion: 2.1 time: 1.134797 Aug 27 05:00:30.760896 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2562/5066] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:29 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1696 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:31.063495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e5c6ef98-81e2-4538-8ae7-4bb3b012e550 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:31.102404 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e5c6ef98-81e2-4538-8ae7-4bb3b012e550 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.727957 Aug 27 05:00:31.106441 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2505/5067] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:30 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:31.197360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d55bb36a-281d-4dab-b57d-a1123b06afe0 req-39a8e721-16bc-4f4e-9ed2-1e88f2f2d274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c61deb16-51e0-4d32-b077-0f1808a1f525", "tag": "cc200f87-b6f5-486b-914d-1b4a92915b90"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:31.241066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:31.260229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d55bb36a-281d-4dab-b57d-a1123b06afe0 req-39a8e721-16bc-4f4e-9ed2-1e88f2f2d274 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:31.277051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d55bb36a-281d-4dab-b57d-a1123b06afe0 req-39a8e721-16bc-4f4e-9ed2-1e88f2f2d274 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:31.280572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d55bb36a-281d-4dab-b57d-a1123b06afe0 req-39a8e721-16bc-4f4e-9ed2-1e88f2f2d274 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:31.309085 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d55bb36a-281d-4dab-b57d-a1123b06afe0 req-39a8e721-16bc-4f4e-9ed2-1e88f2f2d274 service nova] Creating event network-changed:cc200f87-b6f5-486b-914d-1b4a92915b90 for instance c61deb16-51e0-4d32-b077-0f1808a1f525 on n-h1-854823-1 Aug 27 05:00:31.324662 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d55bb36a-281d-4dab-b57d-a1123b06afe0 req-39a8e721-16bc-4f4e-9ed2-1e88f2f2d274 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131036 Aug 27 05:00:31.325590 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2563/5068] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:31.385924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8920e546-9b42-4663-9d4a-12ca848e9305 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:31.386959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8920e546-9b42-4663-9d4a-12ca848e9305 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:31.414382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8920e546-9b42-4663-9d4a-12ca848e9305 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:31.415850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8920e546-9b42-4663-9d4a-12ca848e9305 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:31.417155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8920e546-9b42-4663-9d4a-12ca848e9305 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:31.419428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8920e546-9b42-4663-9d4a-12ca848e9305 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:31.420108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8920e546-9b42-4663-9d4a-12ca848e9305 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:31.422348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8920e546-9b42-4663-9d4a-12ca848e9305 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:31.763132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:31.768932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62aeeb1b-23d4-4066-9c6b-42fee4ba58f4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:31.769953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-62aeeb1b-23d4-4066-9c6b-42fee4ba58f4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:31.785623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62aeeb1b-23d4-4066-9c6b-42fee4ba58f4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:31.786130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62aeeb1b-23d4-4066-9c6b-42fee4ba58f4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:31.786565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62aeeb1b-23d4-4066-9c6b-42fee4ba58f4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:31.801142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62aeeb1b-23d4-4066-9c6b-42fee4ba58f4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:31.801560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62aeeb1b-23d4-4066-9c6b-42fee4ba58f4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:31.802012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62aeeb1b-23d4-4066-9c6b-42fee4ba58f4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:32.347328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8920e546-9b42-4663-9d4a-12ca848e9305 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:32.367014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8920e546-9b42-4663-9d4a-12ca848e9305 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:32.372334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8920e546-9b42-4663-9d4a-12ca848e9305 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:32.374508 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8920e546-9b42-4663-9d4a-12ca848e9305 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1886 microversion: 2.42 time: 0.994494 Aug 27 05:00:32.380145 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2506/5069] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:31 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1886 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:32.388206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a9158a3d-4297-473c-bfc4-1b49c7587a9c req-9f4c9dab-d16b-4a11-867a-45b227da2647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79131199-61d1-48f7-a53c-614f1a17098e", "name": "network-vif-unplugged", "status": "completed", "tag": "0862d8e7-87b9-4566-b5e9-f057655a8991"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:32.423360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a9158a3d-4297-473c-bfc4-1b49c7587a9c req-9f4c9dab-d16b-4a11-867a-45b227da2647 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:32.424460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a9158a3d-4297-473c-bfc4-1b49c7587a9c req-9f4c9dab-d16b-4a11-867a-45b227da2647 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:32.424875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a9158a3d-4297-473c-bfc4-1b49c7587a9c req-9f4c9dab-d16b-4a11-867a-45b227da2647 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:32.456085 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a9158a3d-4297-473c-bfc4-1b49c7587a9c req-9f4c9dab-d16b-4a11-867a-45b227da2647 service nova] Creating event network-vif-unplugged:0862d8e7-87b9-4566-b5e9-f057655a8991 for instance 79131199-61d1-48f7-a53c-614f1a17098e on n-h2-854823-1 Aug 27 05:00:32.488649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-a9158a3d-4297-473c-bfc4-1b49c7587a9c req-9f4c9dab-d16b-4a11-867a-45b227da2647 service nova] Instance 79131199-61d1-48f7-a53c-614f1a17098e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:00:32.525629 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a9158a3d-4297-473c-bfc4-1b49c7587a9c req-9f4c9dab-d16b-4a11-867a-45b227da2647 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126609 Aug 27 05:00:32.531677 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2507/5070] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:32.552743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8226050d-4951-4156-93c7-281587821309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:32.563937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8226050d-4951-4156-93c7-281587821309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:32.580719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8226050d-4951-4156-93c7-281587821309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:32.581041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8226050d-4951-4156-93c7-281587821309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:32.581488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8226050d-4951-4156-93c7-281587821309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:32.582202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8226050d-4951-4156-93c7-281587821309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:32.582665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8226050d-4951-4156-93c7-281587821309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:32.583096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8226050d-4951-4156-93c7-281587821309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:33.188467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8226050d-4951-4156-93c7-281587821309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:33.216516 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8226050d-4951-4156-93c7-281587821309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.676049 Aug 27 05:00:33.224938 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2508/5071] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:32 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:33.264240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-648526fe-c24c-4551-b2f4-75b248272c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:33.269208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-648526fe-c24c-4551-b2f4-75b248272c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:33.281148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-648526fe-c24c-4551-b2f4-75b248272c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:33.283006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-648526fe-c24c-4551-b2f4-75b248272c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:33.284948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-648526fe-c24c-4551-b2f4-75b248272c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:33.286173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-648526fe-c24c-4551-b2f4-75b248272c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:33.287038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-648526fe-c24c-4551-b2f4-75b248272c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:33.288006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-648526fe-c24c-4551-b2f4-75b248272c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:33.438303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-62aeeb1b-23d4-4066-9c6b-42fee4ba58f4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:33.442432 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-648526fe-c24c-4551-b2f4-75b248272c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.195053 Aug 27 05:00:33.455634 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2509/5072] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:00:33 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46/os-volume_attachments => generated 25 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:00:33.482367 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62aeeb1b-23d4-4066-9c6b-42fee4ba58f4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1696 microversion: 2.1 time: 1.714464 Aug 27 05:00:33.483851 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2564/5073] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:31 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1696 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:33.489975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4d09d67f-2de5-43f5-9db3-1cfa86a4c692 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:33.491142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4d09d67f-2de5-43f5-9db3-1cfa86a4c692 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:33.524814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d09d67f-2de5-43f5-9db3-1cfa86a4c692 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:33.525924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d09d67f-2de5-43f5-9db3-1cfa86a4c692 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:33.537269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d09d67f-2de5-43f5-9db3-1cfa86a4c692 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:33.538979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d09d67f-2de5-43f5-9db3-1cfa86a4c692 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:33.539673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d09d67f-2de5-43f5-9db3-1cfa86a4c692 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:33.540325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d09d67f-2de5-43f5-9db3-1cfa86a4c692 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:33.606591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b8005e8-613d-44fc-83d7-ca0293a05eca tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:33.609879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b8005e8-613d-44fc-83d7-ca0293a05eca tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:33.613848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:33.620822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b8005e8-613d-44fc-83d7-ca0293a05eca tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:33.622070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b8005e8-613d-44fc-83d7-ca0293a05eca tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:33.622688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b8005e8-613d-44fc-83d7-ca0293a05eca tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:33.623573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b8005e8-613d-44fc-83d7-ca0293a05eca tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:33.624197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b8005e8-613d-44fc-83d7-ca0293a05eca tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:33.625566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b8005e8-613d-44fc-83d7-ca0293a05eca tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:33.709104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b8005e8-613d-44fc-83d7-ca0293a05eca tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:00:34.104894 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b8005e8-613d-44fc-83d7-ca0293a05eca tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 204 len: 0 microversion: 2.1 time: 0.503329 Aug 27 05:00:34.116478 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2565/5074] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:00:33 2022] DELETE /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:00:34.140187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a3a63aad-f6e0-4335-88f5-400e2ea98fff tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:34.147961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a3a63aad-f6e0-4335-88f5-400e2ea98fff tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:34.176893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3a63aad-f6e0-4335-88f5-400e2ea98fff tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:34.177747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3a63aad-f6e0-4335-88f5-400e2ea98fff tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:34.178778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3a63aad-f6e0-4335-88f5-400e2ea98fff tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:34.179782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3a63aad-f6e0-4335-88f5-400e2ea98fff tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:34.180261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3a63aad-f6e0-4335-88f5-400e2ea98fff tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:34.180825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3a63aad-f6e0-4335-88f5-400e2ea98fff tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:34.693449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4d09d67f-2de5-43f5-9db3-1cfa86a4c692 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:34.697351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:34.717824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4d09d67f-2de5-43f5-9db3-1cfa86a4c692 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:34.727807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4d09d67f-2de5-43f5-9db3-1cfa86a4c692 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:34.742183 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4d09d67f-2de5-43f5-9db3-1cfa86a4c692 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1886 microversion: 2.42 time: 1.274978 Aug 27 05:00:34.743753 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2510/5075] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:33 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1886 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:34.761710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fc5d99b0-4d96-47b3-bd42-6b762bd08c52 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:34.762879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fc5d99b0-4d96-47b3-bd42-6b762bd08c52 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:34.808554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:34.817858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc5d99b0-4d96-47b3-bd42-6b762bd08c52 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:34.822454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc5d99b0-4d96-47b3-bd42-6b762bd08c52 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:34.835729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc5d99b0-4d96-47b3-bd42-6b762bd08c52 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:34.837630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc5d99b0-4d96-47b3-bd42-6b762bd08c52 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:34.840685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc5d99b0-4d96-47b3-bd42-6b762bd08c52 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:34.841626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc5d99b0-4d96-47b3-bd42-6b762bd08c52 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:34.869771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a3a63aad-f6e0-4335-88f5-400e2ea98fff tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:34.883306 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a3a63aad-f6e0-4335-88f5-400e2ea98fff tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1670 microversion: 2.1 time: 0.760854 Aug 27 05:00:34.883908 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2566/5076] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:34 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1670 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:34.907276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81085bd7-f042-400e-a045-e6c046275c53 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:34.916222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-81085bd7-f042-400e-a045-e6c046275c53 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:34.943035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81085bd7-f042-400e-a045-e6c046275c53 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:34.943572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81085bd7-f042-400e-a045-e6c046275c53 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:34.946819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81085bd7-f042-400e-a045-e6c046275c53 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:34.947781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81085bd7-f042-400e-a045-e6c046275c53 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:34.951112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81085bd7-f042-400e-a045-e6c046275c53 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:34.954133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81085bd7-f042-400e-a045-e6c046275c53 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:35.052916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:35.423798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fc5d99b0-4d96-47b3-bd42-6b762bd08c52 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:35.456084 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fc5d99b0-4d96-47b3-bd42-6b762bd08c52 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.697135 Aug 27 05:00:35.468567 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2511/5077] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:34 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:35.476746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d12e24f7-9a17-4abb-8e29-0aa0a367891d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:35.480004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d12e24f7-9a17-4abb-8e29-0aa0a367891d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:35.509899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d12e24f7-9a17-4abb-8e29-0aa0a367891d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:35.512047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d12e24f7-9a17-4abb-8e29-0aa0a367891d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:35.516007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d12e24f7-9a17-4abb-8e29-0aa0a367891d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:35.517334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d12e24f7-9a17-4abb-8e29-0aa0a367891d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:35.518041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d12e24f7-9a17-4abb-8e29-0aa0a367891d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:35.519026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d12e24f7-9a17-4abb-8e29-0aa0a367891d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:35.628111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d12e24f7-9a17-4abb-8e29-0aa0a367891d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:00:35.892692 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d12e24f7-9a17-4abb-8e29-0aa0a367891d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 204 len: 0 microversion: 2.1 time: 0.433047 Aug 27 05:00:35.896452 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2512/5078] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:00:35 2022] DELETE /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:00:35.935342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-2a3d46ca-8538-4184-84ef-5f92396a89cf req-7c8935b6-63b0-4cf6-a139-433af589e0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c8006a-b6ce-40d9-9136-6a08964d6544", "tag": "953af6d2-bfae-4d88-aac1-32046c271aa2"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:35.986347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2a3d46ca-8538-4184-84ef-5f92396a89cf req-7c8935b6-63b0-4cf6-a139-433af589e0a5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:35.987663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2a3d46ca-8538-4184-84ef-5f92396a89cf req-7c8935b6-63b0-4cf6-a139-433af589e0a5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:35.988444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2a3d46ca-8538-4184-84ef-5f92396a89cf req-7c8935b6-63b0-4cf6-a139-433af589e0a5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.020895 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-2a3d46ca-8538-4184-84ef-5f92396a89cf req-7c8935b6-63b0-4cf6-a139-433af589e0a5 service nova] Creating event network-changed:953af6d2-bfae-4d88-aac1-32046c271aa2 for instance f7c8006a-b6ce-40d9-9136-6a08964d6544 on n-h2-854823-1 Aug 27 05:00:36.026891 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-2a3d46ca-8538-4184-84ef-5f92396a89cf req-7c8935b6-63b0-4cf6-a139-433af589e0a5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132305 Aug 27 05:00:36.028442 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2513/5079] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:36.036800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-911be0a0-7271-4f55-8b27-6b228ba3bf37 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:36.038892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-911be0a0-7271-4f55-8b27-6b228ba3bf37 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:36.047089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-911be0a0-7271-4f55-8b27-6b228ba3bf37 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:36.047886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-911be0a0-7271-4f55-8b27-6b228ba3bf37 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:36.048699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-911be0a0-7271-4f55-8b27-6b228ba3bf37 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.049347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-81085bd7-f042-400e-a045-e6c046275c53 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:36.051223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-911be0a0-7271-4f55-8b27-6b228ba3bf37 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:36.052376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-911be0a0-7271-4f55-8b27-6b228ba3bf37 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:36.053947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-911be0a0-7271-4f55-8b27-6b228ba3bf37 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.071859 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-81085bd7-f042-400e-a045-e6c046275c53 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1696 microversion: 2.1 time: 1.178570 Aug 27 05:00:36.071859 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2567/5080] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:34 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1696 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:36.077975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc403239-962b-4ac1-a538-a5a04b0429e8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:36.078593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fc403239-962b-4ac1-a538-a5a04b0429e8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:36.137697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc403239-962b-4ac1-a538-a5a04b0429e8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:36.141391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc403239-962b-4ac1-a538-a5a04b0429e8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:36.142074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc403239-962b-4ac1-a538-a5a04b0429e8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.144288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc403239-962b-4ac1-a538-a5a04b0429e8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:36.144968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc403239-962b-4ac1-a538-a5a04b0429e8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:36.149806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc403239-962b-4ac1-a538-a5a04b0429e8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.541895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fc403239-962b-4ac1-a538-a5a04b0429e8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:36.554757 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc403239-962b-4ac1-a538-a5a04b0429e8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1670 microversion: 2.1 time: 0.481956 Aug 27 05:00:36.557469 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2568/5081] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:36 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1670 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:36.566391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-93502d3e-dc06-4640-8ed1-cd3cb63eb352 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:36.569854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-93502d3e-dc06-4640-8ed1-cd3cb63eb352 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:36.586448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93502d3e-dc06-4640-8ed1-cd3cb63eb352 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:36.587358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93502d3e-dc06-4640-8ed1-cd3cb63eb352 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:36.588043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93502d3e-dc06-4640-8ed1-cd3cb63eb352 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.589064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93502d3e-dc06-4640-8ed1-cd3cb63eb352 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:36.589748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93502d3e-dc06-4640-8ed1-cd3cb63eb352 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:36.590399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93502d3e-dc06-4640-8ed1-cd3cb63eb352 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.612552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-911be0a0-7271-4f55-8b27-6b228ba3bf37 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:36.626839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-911be0a0-7271-4f55-8b27-6b228ba3bf37 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:36.628305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-911be0a0-7271-4f55-8b27-6b228ba3bf37 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:36.629524 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-911be0a0-7271-4f55-8b27-6b228ba3bf37 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.599034 Aug 27 05:00:36.639432 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2514/5082] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:36 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:36.658389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a5537c61-1e14-404e-8665-0cb9968c65e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:36.663985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a5537c61-1e14-404e-8665-0cb9968c65e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:36.677730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5537c61-1e14-404e-8665-0cb9968c65e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:36.678557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5537c61-1e14-404e-8665-0cb9968c65e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:36.681297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5537c61-1e14-404e-8665-0cb9968c65e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:36.682297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5537c61-1e14-404e-8665-0cb9968c65e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:36.682784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5537c61-1e14-404e-8665-0cb9968c65e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:36.689539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5537c61-1e14-404e-8665-0cb9968c65e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:37.020820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a5537c61-1e14-404e-8665-0cb9968c65e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:37.034864 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a5537c61-1e14-404e-8665-0cb9968c65e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.383394 Aug 27 05:00:37.036722 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2515/5083] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:36 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:37.114459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-84b02dfe-31a3-4a07-b522-a807d36de5c4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:37.115269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-84b02dfe-31a3-4a07-b522-a807d36de5c4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:37.128816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84b02dfe-31a3-4a07-b522-a807d36de5c4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:37.129392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84b02dfe-31a3-4a07-b522-a807d36de5c4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:37.130163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84b02dfe-31a3-4a07-b522-a807d36de5c4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:37.130585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84b02dfe-31a3-4a07-b522-a807d36de5c4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:37.131051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84b02dfe-31a3-4a07-b522-a807d36de5c4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:37.133170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84b02dfe-31a3-4a07-b522-a807d36de5c4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:37.358801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-93502d3e-dc06-4640-8ed1-cd3cb63eb352 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:37.381974 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-93502d3e-dc06-4640-8ed1-cd3cb63eb352 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1670 microversion: 2.1 time: 0.820487 Aug 27 05:00:37.381974 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2569/5084] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:36 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1670 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:37.583876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e503be0a-eb39-4fc3-8e48-982962b9f3ec tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:37.585624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e503be0a-eb39-4fc3-8e48-982962b9f3ec tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:37.596445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e503be0a-eb39-4fc3-8e48-982962b9f3ec tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:37.599992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e503be0a-eb39-4fc3-8e48-982962b9f3ec tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:37.600858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e503be0a-eb39-4fc3-8e48-982962b9f3ec tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:37.601886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e503be0a-eb39-4fc3-8e48-982962b9f3ec tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:37.602590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e503be0a-eb39-4fc3-8e48-982962b9f3ec tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:37.605439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e503be0a-eb39-4fc3-8e48-982962b9f3ec tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:37.634148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-84b02dfe-31a3-4a07-b522-a807d36de5c4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:37.690456 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-84b02dfe-31a3-4a07-b522-a807d36de5c4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1696 microversion: 2.1 time: 0.581351 Aug 27 05:00:37.722503 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2516/5085] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:37 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1696 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:37.760495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-97945eb0-d62b-43a7-b18a-3ea8ec75a500 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:37.761524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-97945eb0-d62b-43a7-b18a-3ea8ec75a500 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:37.770422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97945eb0-d62b-43a7-b18a-3ea8ec75a500 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:37.771523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97945eb0-d62b-43a7-b18a-3ea8ec75a500 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:37.772233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97945eb0-d62b-43a7-b18a-3ea8ec75a500 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:37.773685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97945eb0-d62b-43a7-b18a-3ea8ec75a500 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:37.774165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97945eb0-d62b-43a7-b18a-3ea8ec75a500 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:37.774587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97945eb0-d62b-43a7-b18a-3ea8ec75a500 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:38.005030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e503be0a-eb39-4fc3-8e48-982962b9f3ec tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:38.021716 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e503be0a-eb39-4fc3-8e48-982962b9f3ec tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1670 microversion: 2.1 time: 0.442575 Aug 27 05:00:38.039369 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2570/5086] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:37 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1670 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:38.065573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14d9866b-cd23-46c7-9011-e57e321f9eb6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:38.069044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14d9866b-cd23-46c7-9011-e57e321f9eb6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:38.085757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14d9866b-cd23-46c7-9011-e57e321f9eb6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:38.087340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14d9866b-cd23-46c7-9011-e57e321f9eb6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:38.089940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14d9866b-cd23-46c7-9011-e57e321f9eb6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:38.091004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14d9866b-cd23-46c7-9011-e57e321f9eb6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:38.092283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14d9866b-cd23-46c7-9011-e57e321f9eb6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:38.093064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14d9866b-cd23-46c7-9011-e57e321f9eb6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:38.646348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14d9866b-cd23-46c7-9011-e57e321f9eb6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:38.658478 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14d9866b-cd23-46c7-9011-e57e321f9eb6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.605995 Aug 27 05:00:38.659308 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2571/5087] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:38 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:38.668118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-97945eb0-d62b-43a7-b18a-3ea8ec75a500 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:38.670754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-77542a99-f3e3-464b-8b06-0b443545af03 req-2f2af15c-fc9b-4938-95ad-fffc5b3a68e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79131199-61d1-48f7-a53c-614f1a17098e", "tag": "0862d8e7-87b9-4566-b5e9-f057655a8991"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:38.685538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-97945eb0-d62b-43a7-b18a-3ea8ec75a500 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:38.689603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-97945eb0-d62b-43a7-b18a-3ea8ec75a500 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:38.694433 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-97945eb0-d62b-43a7-b18a-3ea8ec75a500 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.957553 Aug 27 05:00:38.698121 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2517/5088] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:37 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:38.699709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77542a99-f3e3-464b-8b06-0b443545af03 req-2f2af15c-fc9b-4938-95ad-fffc5b3a68e5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:38.705298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b9402207-daba-4dc0-8757-f19a7b5bd509 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:38.708184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77542a99-f3e3-464b-8b06-0b443545af03 req-2f2af15c-fc9b-4938-95ad-fffc5b3a68e5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:38.709042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77542a99-f3e3-464b-8b06-0b443545af03 req-2f2af15c-fc9b-4938-95ad-fffc5b3a68e5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:38.718526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b9402207-daba-4dc0-8757-f19a7b5bd509 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:38.731179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9402207-daba-4dc0-8757-f19a7b5bd509 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:38.742488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9402207-daba-4dc0-8757-f19a7b5bd509 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:38.743171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9402207-daba-4dc0-8757-f19a7b5bd509 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:38.747203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9402207-daba-4dc0-8757-f19a7b5bd509 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:38.747915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9402207-daba-4dc0-8757-f19a7b5bd509 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:38.748674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9402207-daba-4dc0-8757-f19a7b5bd509 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:38.753842 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-77542a99-f3e3-464b-8b06-0b443545af03 req-2f2af15c-fc9b-4938-95ad-fffc5b3a68e5 service nova] Creating event network-changed:0862d8e7-87b9-4566-b5e9-f057655a8991 for instance 79131199-61d1-48f7-a53c-614f1a17098e on n-h2-854823-1 Aug 27 05:00:38.762057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-77542a99-f3e3-464b-8b06-0b443545af03 req-2f2af15c-fc9b-4938-95ad-fffc5b3a68e5 service nova] Instance 79131199-61d1-48f7-a53c-614f1a17098e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:00:38.806242 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-77542a99-f3e3-464b-8b06-0b443545af03 req-2f2af15c-fc9b-4938-95ad-fffc5b3a68e5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145427 Aug 27 05:00:38.811916 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2572/5089] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:38.823776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db646e92-9902-479b-8228-305bc6de915a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:38.824474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db646e92-9902-479b-8228-305bc6de915a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:38.853096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db646e92-9902-479b-8228-305bc6de915a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:38.853890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db646e92-9902-479b-8228-305bc6de915a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:38.854499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db646e92-9902-479b-8228-305bc6de915a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:38.857745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db646e92-9902-479b-8228-305bc6de915a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:38.858389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db646e92-9902-479b-8228-305bc6de915a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:38.859013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db646e92-9902-479b-8228-305bc6de915a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:39.103537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b9402207-daba-4dc0-8757-f19a7b5bd509 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:39.120984 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b9402207-daba-4dc0-8757-f19a7b5bd509 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1603 microversion: 2.1 time: 0.419239 Aug 27 05:00:39.121831 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2518/5090] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:38 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1603 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:39.128353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d3c757d7-1632-49be-a1cc-ebd27a03e564 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:39.147142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d3c757d7-1632-49be-a1cc-ebd27a03e564 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:39.165967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3c757d7-1632-49be-a1cc-ebd27a03e564 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:39.166739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3c757d7-1632-49be-a1cc-ebd27a03e564 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:39.167339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3c757d7-1632-49be-a1cc-ebd27a03e564 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:39.171420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3c757d7-1632-49be-a1cc-ebd27a03e564 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:39.172153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3c757d7-1632-49be-a1cc-ebd27a03e564 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:39.174378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3c757d7-1632-49be-a1cc-ebd27a03e564 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:39.777746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db646e92-9902-479b-8228-305bc6de915a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:39.801048 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db646e92-9902-479b-8228-305bc6de915a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1696 microversion: 2.1 time: 0.978254 Aug 27 05:00:39.816880 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2573/5091] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:38 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1696 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:39.822233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cd96ec27-15ac-498b-bb49-3dc8b2ba9d8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:39.823010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cd96ec27-15ac-498b-bb49-3dc8b2ba9d8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:39.838538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd96ec27-15ac-498b-bb49-3dc8b2ba9d8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:39.839344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd96ec27-15ac-498b-bb49-3dc8b2ba9d8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:39.841637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd96ec27-15ac-498b-bb49-3dc8b2ba9d8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:39.842600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd96ec27-15ac-498b-bb49-3dc8b2ba9d8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:39.843942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd96ec27-15ac-498b-bb49-3dc8b2ba9d8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:39.844454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd96ec27-15ac-498b-bb49-3dc8b2ba9d8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:39.852102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d3c757d7-1632-49be-a1cc-ebd27a03e564 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:39.865975 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d3c757d7-1632-49be-a1cc-ebd27a03e564 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1670 microversion: 2.1 time: 0.742237 Aug 27 05:00:39.870768 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2519/5092] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:39 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1670 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:39.885179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-35f73f48-0ca2-4711-ba2e-6e30ca5cb57f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:39.886024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-35f73f48-0ca2-4711-ba2e-6e30ca5cb57f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:39.909735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35f73f48-0ca2-4711-ba2e-6e30ca5cb57f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:39.910796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35f73f48-0ca2-4711-ba2e-6e30ca5cb57f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:39.911511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35f73f48-0ca2-4711-ba2e-6e30ca5cb57f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:39.913115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35f73f48-0ca2-4711-ba2e-6e30ca5cb57f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:39.913809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35f73f48-0ca2-4711-ba2e-6e30ca5cb57f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:39.914986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35f73f48-0ca2-4711-ba2e-6e30ca5cb57f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:40.217779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cd96ec27-15ac-498b-bb49-3dc8b2ba9d8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:40.229357 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cd96ec27-15ac-498b-bb49-3dc8b2ba9d8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.410861 Aug 27 05:00:40.230245 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2574/5093] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:39 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:40.251456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a2a3428-27b3-4664-a6f0-fb01af263c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:40.252089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a2a3428-27b3-4664-a6f0-fb01af263c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:40.259145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a2a3428-27b3-4664-a6f0-fb01af263c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:40.259659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a2a3428-27b3-4664-a6f0-fb01af263c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:40.260100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a2a3428-27b3-4664-a6f0-fb01af263c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:40.261094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a2a3428-27b3-4664-a6f0-fb01af263c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:40.261723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a2a3428-27b3-4664-a6f0-fb01af263c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:40.263928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a2a3428-27b3-4664-a6f0-fb01af263c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:40.426350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a2a3428-27b3-4664-a6f0-fb01af263c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:40.440331 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a2a3428-27b3-4664-a6f0-fb01af263c09 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1603 microversion: 2.1 time: 0.195956 Aug 27 05:00:40.441744 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2575/5094] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:40 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1603 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:40.470888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-35f73f48-0ca2-4711-ba2e-6e30ca5cb57f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:40.486097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-35f73f48-0ca2-4711-ba2e-6e30ca5cb57f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:40.490276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-35f73f48-0ca2-4711-ba2e-6e30ca5cb57f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:40.494481 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-35f73f48-0ca2-4711-ba2e-6e30ca5cb57f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.618285 Aug 27 05:00:40.498720 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2520/5095] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:39 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:40.824767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6e1c708-d4cd-4b01-b0b6-dc170b89d797 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:40.825552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6e1c708-d4cd-4b01-b0b6-dc170b89d797 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:40.851511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-eac9bbcb-3564-471f-be1e-6797397b3173 req-71bd1dd9-98b4-4dc4-a511-688f21ee9ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c612c67-453a-48d4-8f78-97a00213ab46", "name": "network-vif-deleted", "tag": "97b740d0-8a58-4ce5-9a2e-87124b4851c6"}, {"server_uuid": "f7c8006a-b6ce-40d9-9136-6a08964d6544", "name": "network-vif-deleted", "tag": "953af6d2-bfae-4d88-aac1-32046c271aa2"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:40.857790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6e1c708-d4cd-4b01-b0b6-dc170b89d797 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:40.861281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6e1c708-d4cd-4b01-b0b6-dc170b89d797 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:40.863267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6e1c708-d4cd-4b01-b0b6-dc170b89d797 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:40.869512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6e1c708-d4cd-4b01-b0b6-dc170b89d797 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:40.873973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6e1c708-d4cd-4b01-b0b6-dc170b89d797 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:40.876801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6e1c708-d4cd-4b01-b0b6-dc170b89d797 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:40.907649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-eac9bbcb-3564-471f-be1e-6797397b3173 req-71bd1dd9-98b4-4dc4-a511-688f21ee9ad7 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:40.908148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-eac9bbcb-3564-471f-be1e-6797397b3173 req-71bd1dd9-98b4-4dc4-a511-688f21ee9ad7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:40.920867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-eac9bbcb-3564-471f-be1e-6797397b3173 req-71bd1dd9-98b4-4dc4-a511-688f21ee9ad7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:40.971566 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-eac9bbcb-3564-471f-be1e-6797397b3173 req-71bd1dd9-98b4-4dc4-a511-688f21ee9ad7 service nova] Creating event network-vif-deleted:97b740d0-8a58-4ce5-9a2e-87124b4851c6 for instance 4c612c67-453a-48d4-8f78-97a00213ab46 on n-h1-854823-1 Aug 27 05:00:40.980681 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-eac9bbcb-3564-471f-be1e-6797397b3173 req-71bd1dd9-98b4-4dc4-a511-688f21ee9ad7 service nova] Creating event network-vif-deleted:953af6d2-bfae-4d88-aac1-32046c271aa2 for instance f7c8006a-b6ce-40d9-9136-6a08964d6544 on n-h2-854823-1 Aug 27 05:00:41.006828 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-eac9bbcb-3564-471f-be1e-6797397b3173 req-71bd1dd9-98b4-4dc4-a511-688f21ee9ad7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.159754 Aug 27 05:00:41.007449 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2521/5096] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:00:41.020309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e4d9d784-6b08-4db1-a7b4-ecf2ffeefae8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:41.026459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e4d9d784-6b08-4db1-a7b4-ecf2ffeefae8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:41.044904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4d9d784-6b08-4db1-a7b4-ecf2ffeefae8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.045713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4d9d784-6b08-4db1-a7b4-ecf2ffeefae8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.046570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4d9d784-6b08-4db1-a7b4-ecf2ffeefae8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:41.048219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4d9d784-6b08-4db1-a7b4-ecf2ffeefae8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.054113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4d9d784-6b08-4db1-a7b4-ecf2ffeefae8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.054791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4d9d784-6b08-4db1-a7b4-ecf2ffeefae8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:41.236729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e4d9d784-6b08-4db1-a7b4-ecf2ffeefae8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:41.241090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f6e1c708-d4cd-4b01-b0b6-dc170b89d797 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:41.254319 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6e1c708-d4cd-4b01-b0b6-dc170b89d797 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1694 microversion: 2.1 time: 0.433578 Aug 27 05:00:41.255136 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e4d9d784-6b08-4db1-a7b4-ecf2ffeefae8 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 200 len: 1332 microversion: 2.1 time: 0.243298 Aug 27 05:00:41.255773 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2522/5097] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:41 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 1332 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:41.273307 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2576/5098] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:40 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1694 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:41.278430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5f94d641-4640-45cf-ba54-31f633d358d9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:41.283920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5f94d641-4640-45cf-ba54-31f633d358d9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:41.306873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f94d641-4640-45cf-ba54-31f633d358d9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.307429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f94d641-4640-45cf-ba54-31f633d358d9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.307802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f94d641-4640-45cf-ba54-31f633d358d9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:41.308697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f94d641-4640-45cf-ba54-31f633d358d9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.316450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f94d641-4640-45cf-ba54-31f633d358d9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.321047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5f94d641-4640-45cf-ba54-31f633d358d9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:41.464185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bafa7a61-913b-496f-b65d-617f03e2eba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:41.464887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bafa7a61-913b-496f-b65d-617f03e2eba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:41.486379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafa7a61-913b-496f-b65d-617f03e2eba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.486909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafa7a61-913b-496f-b65d-617f03e2eba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.487369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafa7a61-913b-496f-b65d-617f03e2eba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:41.490829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafa7a61-913b-496f-b65d-617f03e2eba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.491351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafa7a61-913b-496f-b65d-617f03e2eba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.491800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafa7a61-913b-496f-b65d-617f03e2eba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:41.594968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafa7a61-913b-496f-b65d-617f03e2eba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.595478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafa7a61-913b-496f-b65d-617f03e2eba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.595936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafa7a61-913b-496f-b65d-617f03e2eba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:41.597958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-bafa7a61-913b-496f-b65d-617f03e2eba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lazy-loading 'fault' on Instance uuid 4c612c67-453a-48d4-8f78-97a00213ab46 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:00:41.696798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bafa7a61-913b-496f-b65d-617f03e2eba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:41.716014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5f94d641-4640-45cf-ba54-31f633d358d9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:41.716829 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bafa7a61-913b-496f-b65d-617f03e2eba6 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 200 len: 1326 microversion: 2.1 time: 0.254831 Aug 27 05:00:41.717755 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2577/5099] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:41 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 1326 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:41.731678 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5f94d641-4640-45cf-ba54-31f633d358d9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.472657 Aug 27 05:00:41.735293 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2523/5100] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:41 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:41.748766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b7ae980c-4cd9-48be-8619-8f201463f4e9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:41.749678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b7ae980c-4cd9-48be-8619-8f201463f4e9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:41.771971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7ae980c-4cd9-48be-8619-8f201463f4e9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.772850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7ae980c-4cd9-48be-8619-8f201463f4e9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.775927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7ae980c-4cd9-48be-8619-8f201463f4e9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:41.779963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7ae980c-4cd9-48be-8619-8f201463f4e9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:41.781246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7ae980c-4cd9-48be-8619-8f201463f4e9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:41.782597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7ae980c-4cd9-48be-8619-8f201463f4e9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.235193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b7ae980c-4cd9-48be-8619-8f201463f4e9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:42.248830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b7ae980c-4cd9-48be-8619-8f201463f4e9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:42.251235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b7ae980c-4cd9-48be-8619-8f201463f4e9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:42.252435 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b7ae980c-4cd9-48be-8619-8f201463f4e9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.517485 Aug 27 05:00:42.260152 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2578/5101] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:41 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:42.283269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3192d0dd-36a4-4ef9-a9ac-a5bf325da356 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:42.283905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3192d0dd-36a4-4ef9-a9ac-a5bf325da356 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:42.285295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-45be2cc6-21a4-43e7-81cc-c48b726b8049 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:42.286307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-45be2cc6-21a4-43e7-81cc-c48b726b8049 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: f7c8006a-b6ce-40d9-9136-6a08964d6544] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:42.298033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3192d0dd-36a4-4ef9-a9ac-a5bf325da356 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.298595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3192d0dd-36a4-4ef9-a9ac-a5bf325da356 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.299047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3192d0dd-36a4-4ef9-a9ac-a5bf325da356 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.299838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3192d0dd-36a4-4ef9-a9ac-a5bf325da356 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.303991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45be2cc6-21a4-43e7-81cc-c48b726b8049 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.305167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45be2cc6-21a4-43e7-81cc-c48b726b8049 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.305626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45be2cc6-21a4-43e7-81cc-c48b726b8049 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.306405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3192d0dd-36a4-4ef9-a9ac-a5bf325da356 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.307231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45be2cc6-21a4-43e7-81cc-c48b726b8049 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.307898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3192d0dd-36a4-4ef9-a9ac-a5bf325da356 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.315899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45be2cc6-21a4-43e7-81cc-c48b726b8049 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.316972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45be2cc6-21a4-43e7-81cc-c48b726b8049 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.357919 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-45be2cc6-21a4-43e7-81cc-c48b726b8049 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] HTTP exception thrown: Instance f7c8006a-b6ce-40d9-9136-6a08964d6544 could not be found. Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-45be2cc6-21a4-43e7-81cc-c48b726b8049 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Request method failure captured: Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 HTTP/1.1 Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaRM811Cx00m9jBTaHXe0XCWofY4WpsKYZc8Y3tH-Cux9k1apGsuVmCc7AXjzDFvxmuBqv1wXnyU10Y54VL9C7EUSbQ0UeedSn36RYRi2CgG4nqfpfouZFGiY-PcdEUKUfUM0mqv4gO_cyQju9ojG0KU9qc-XPQFc7LlN9iCLhw4oC8 Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 85633ba41ad24104bbe326cae9b1cfdc Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestNetworkBasicOps-265431408 Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/85633ba41ad24104bbe326cae9b1cfdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_85633ba41ad24104bbe326cae9b1cfdc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/85633ba41ad24104bbe326cae9b1cfdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/85633ba41ad24104bbe326cae9b1cfdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestNetworkBasicOps-265431408 Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 85633ba41ad24104bbe326cae9b1cfdc Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestNetworkBasicOps-265431408 Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestNetworkBasicOps-265431408-project Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 9a461972bdc04f17b181940db823dbe0 Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestNetworkBasicOps-265431408-project Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance f7c8006a-b6ce-40d9-9136-6a08964d6544 could not be found. Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'f7c8006a-b6ce-40d9-9136-6a08964d6544'} Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7c8006a-b6ce-40d9-9136-6a08964d6544 could not be found. Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7c8006a-b6ce-40d9-9136-6a08964d6544 could not be found. Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:42.360415 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:00:42.366672 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:42.366672 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:42.366672 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:42.366672 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:00:42.366672 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:00:42.366672 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7c8006a-b6ce-40d9-9136-6a08964d6544 could not be found. Aug 27 05:00:42.366672 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:00:42.371288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-45be2cc6-21a4-43e7-81cc-c48b726b8049 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Returning 404 to user: Instance f7c8006a-b6ce-40d9-9136-6a08964d6544 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:00:42.374692 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-45be2cc6-21a4-43e7-81cc-c48b726b8049 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544" status: 404 len: 111 microversion: 2.1 time: 0.099824 Aug 27 05:00:42.379548 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2524/5102] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:42 2022] GET /compute/v2.1/servers/f7c8006a-b6ce-40d9-9136-6a08964d6544 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:00:42.680409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c869ab99-3670-4d6a-bcfd-f99d6be7c389 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '.version_select at 0x7f1f212280d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:42.731172 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c869ab99-3670-4d6a-bcfd-f99d6be7c389 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-965891831" status: 202 len: 0 microversion: 2.1 time: 0.054234 Aug 27 05:00:42.749740 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2525/5103] 10.222.0.79 () {58 vars in 1254 bytes} [Sat Aug 27 05:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-965891831 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:00:42.764489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ecb47745-3095-489b-bb36-4de41a89252a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:42.765139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ecb47745-3095-489b-bb36-4de41a89252a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:42.787681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ecb47745-3095-489b-bb36-4de41a89252a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.788492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ecb47745-3095-489b-bb36-4de41a89252a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.789443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ecb47745-3095-489b-bb36-4de41a89252a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.790682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ecb47745-3095-489b-bb36-4de41a89252a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.791356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ecb47745-3095-489b-bb36-4de41a89252a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.792009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ecb47745-3095-489b-bb36-4de41a89252a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.815193 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-ecb47745-3095-489b-bb36-4de41a89252a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] HTTP exception thrown: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ecb47745-3095-489b-bb36-4de41a89252a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Request method failure captured: Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 HTTP/1.1 Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaN-uPj_TT7bawmb_-0n_q5UkdPqLbwkNGOfvsDFK-lMqPINg7GTogRN347xfUzG_vvyLxAPEi3FUYcoMxvblviBFizYeVGUWq61kqlXqaz_cTQCc74ctB4SXhbxCWaYA-Iv_jF2VP6y2lj8rp_RfPu-I0Uwam9gRUJgI8neAYsQGgw Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8fe84461cde7445dbf0d1a98df3aeb15 Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8fe84461cde7445dbf0d1a98df3aeb15 Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AttachVolumeTestJSON-799482090-project Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 18c5a89d81c64bdaad17d7005434f01f Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AttachVolumeTestJSON-799482090-project Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '4c612c67-453a-48d4-8f78-97a00213ab46'} Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:00:42.817129 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:00:42.823458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:00:42.823458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:00:42.823458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:00:42.823458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:00:42.823458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:00:42.823458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:00:42.823458 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:00:42.826534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ecb47745-3095-489b-bb36-4de41a89252a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Returning 404 to user: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:00:42.827648 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ecb47745-3095-489b-bb36-4de41a89252a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 404 len: 111 microversion: 2.1 time: 0.076697 Aug 27 05:00:42.828843 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2526/5104] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:42 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:00:42.840211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e25f5af-a8eb-4d9b-93e4-c4830142903a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:42.840493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3192d0dd-36a4-4ef9-a9ac-a5bf325da356 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:42.843043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3e25f5af-a8eb-4d9b-93e4-c4830142903a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:42.851587 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3192d0dd-36a4-4ef9-a9ac-a5bf325da356 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1691 microversion: 2.1 time: 0.572371 Aug 27 05:00:42.852436 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2579/5105] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:42 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1691 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:42.872042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf947e90-ab4f-4c4b-816f-22ba18a4a1cb tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '.version_select at 0x7f1f20e63280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:42.872599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e25f5af-a8eb-4d9b-93e4-c4830142903a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.873108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e25f5af-a8eb-4d9b-93e4-c4830142903a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.873551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e25f5af-a8eb-4d9b-93e4-c4830142903a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.881985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e25f5af-a8eb-4d9b-93e4-c4830142903a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.882634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e25f5af-a8eb-4d9b-93e4-c4830142903a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.887326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e25f5af-a8eb-4d9b-93e4-c4830142903a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.920333 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf947e90-ab4f-4c4b-816f-22ba18a4a1cb tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-252219775" status: 202 len: 0 microversion: 2.1 time: 0.059648 Aug 27 05:00:42.920922 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2580/5106] 10.222.0.79 () {58 vars in 1218 bytes} [Sat Aug 27 05:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-252219775 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:00:42.949660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df6e7ccf-8da3-4c6c-ac12-cf18c203e559 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:42.950224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-df6e7ccf-8da3-4c6c-ac12-cf18c203e559 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:42.970964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df6e7ccf-8da3-4c6c-ac12-cf18c203e559 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.971475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df6e7ccf-8da3-4c6c-ac12-cf18c203e559 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.971919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df6e7ccf-8da3-4c6c-ac12-cf18c203e559 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:42.972673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df6e7ccf-8da3-4c6c-ac12-cf18c203e559 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:42.973132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df6e7ccf-8da3-4c6c-ac12-cf18c203e559 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:42.973561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df6e7ccf-8da3-4c6c-ac12-cf18c203e559 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:43.143630 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-df6e7ccf-8da3-4c6c-ac12-cf18c203e559 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e/action" status: 204 len: 0 microversion: 2.1 time: 0.221307 Aug 27 05:00:43.145848 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2581/5107] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:00:42 2022] POST /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e/action => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:00:43.183706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a4a36b4b-7d5a-4ff4-9ef1-471a5433f2f5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:43.186108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a4a36b4b-7d5a-4ff4-9ef1-471a5433f2f5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:43.221418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4a36b4b-7d5a-4ff4-9ef1-471a5433f2f5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:43.224495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4a36b4b-7d5a-4ff4-9ef1-471a5433f2f5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:43.227639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4a36b4b-7d5a-4ff4-9ef1-471a5433f2f5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:43.230526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4a36b4b-7d5a-4ff4-9ef1-471a5433f2f5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:43.231756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4a36b4b-7d5a-4ff4-9ef1-471a5433f2f5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:43.232759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4a36b4b-7d5a-4ff4-9ef1-471a5433f2f5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:43.440481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3e25f5af-a8eb-4d9b-93e4-c4830142903a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:43.454705 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3e25f5af-a8eb-4d9b-93e4-c4830142903a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.622512 Aug 27 05:00:43.455680 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2527/5108] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:42 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:43.467528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-359f665a-7409-4d47-a11a-5ff71c7380ab tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:43.468147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-359f665a-7409-4d47-a11a-5ff71c7380ab tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:43.487704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-359f665a-7409-4d47-a11a-5ff71c7380ab tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:43.493157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-359f665a-7409-4d47-a11a-5ff71c7380ab tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:43.493797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-359f665a-7409-4d47-a11a-5ff71c7380ab tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:43.494711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-359f665a-7409-4d47-a11a-5ff71c7380ab tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:43.496336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-359f665a-7409-4d47-a11a-5ff71c7380ab tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:43.496986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-359f665a-7409-4d47-a11a-5ff71c7380ab tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:43.871099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a4a36b4b-7d5a-4ff4-9ef1-471a5433f2f5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:43.884288 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a4a36b4b-7d5a-4ff4-9ef1-471a5433f2f5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1691 microversion: 2.1 time: 0.725184 Aug 27 05:00:43.885276 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2582/5109] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:43 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1691 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:44.137834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-359f665a-7409-4d47-a11a-5ff71c7380ab tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:44.149922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-359f665a-7409-4d47-a11a-5ff71c7380ab tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:44.151386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-359f665a-7409-4d47-a11a-5ff71c7380ab tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:44.159119 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-359f665a-7409-4d47-a11a-5ff71c7380ab tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.689806 Aug 27 05:00:44.178507 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2528/5110] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:43 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:44.284285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8496bea8-dd41-4545-be21-21eb998cca47 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Action: 'create', calling method: .version_select at 0x7f1f20dec0d0>, body: {"keypair": {"name": "tempest-keypair-663252782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFQrbh3NdFZttZ3RbHFTrcnMDZZco7yZYBFuEJSKxBzOoBlYpON1FFfWIif9h7/fbAfe9ewwPHnmjpCdTQe7t+XG4uzREoo48H9WQWTBXiUX7zq48wGA2MZXfvxFBEYGw=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:44.305122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8496bea8-dd41-4545-be21-21eb998cca47 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Getting quotas for project 8fe84461cde7445dbf0d1a98df3aeb15. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:00:44.312390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8496bea8-dd41-4545-be21-21eb998cca47 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Getting quotas for user 18c5a89d81c64bdaad17d7005434f01f and project 8fe84461cde7445dbf0d1a98df3aeb15. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:00:44.339965 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8496bea8-dd41-4545-be21-21eb998cca47 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060695 Aug 27 05:00:44.348467 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2583/5111] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:00:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:44.476763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0462a667-344f-49cc-91bc-208dd7270d79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:44.477382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0462a667-344f-49cc-91bc-208dd7270d79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:44.488261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0462a667-344f-49cc-91bc-208dd7270d79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:44.491600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0462a667-344f-49cc-91bc-208dd7270d79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:44.492455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0462a667-344f-49cc-91bc-208dd7270d79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:44.493490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0462a667-344f-49cc-91bc-208dd7270d79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:44.494333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0462a667-344f-49cc-91bc-208dd7270d79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:44.511722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0462a667-344f-49cc-91bc-208dd7270d79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:44.560949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:44.863293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0462a667-344f-49cc-91bc-208dd7270d79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:44.875111 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0462a667-344f-49cc-91bc-208dd7270d79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.402387 Aug 27 05:00:44.880145 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2529/5112] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:44 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:44.911016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e789f3d-a31c-4a48-bee8-b9d5320fac8e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:44.912910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e789f3d-a31c-4a48-bee8-b9d5320fac8e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:44.935462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e789f3d-a31c-4a48-bee8-b9d5320fac8e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:44.936461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e789f3d-a31c-4a48-bee8-b9d5320fac8e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:44.939009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e789f3d-a31c-4a48-bee8-b9d5320fac8e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:44.940269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e789f3d-a31c-4a48-bee8-b9d5320fac8e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:44.941010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e789f3d-a31c-4a48-bee8-b9d5320fac8e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:44.941738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e789f3d-a31c-4a48-bee8-b9d5320fac8e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:45.184243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c8d51c8-a1e1-4245-8bbf-375b707cae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:45.185139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4c8d51c8-a1e1-4245-8bbf-375b707cae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:45.193989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c8d51c8-a1e1-4245-8bbf-375b707cae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:45.201666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c8d51c8-a1e1-4245-8bbf-375b707cae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:45.202793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c8d51c8-a1e1-4245-8bbf-375b707cae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:45.203718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c8d51c8-a1e1-4245-8bbf-375b707cae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:45.204346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c8d51c8-a1e1-4245-8bbf-375b707cae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:45.204975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c8d51c8-a1e1-4245-8bbf-375b707cae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:45.673184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4c8d51c8-a1e1-4245-8bbf-375b707cae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:45.683487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4c8d51c8-a1e1-4245-8bbf-375b707cae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:45.684958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4c8d51c8-a1e1-4245-8bbf-375b707cae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:45.686128 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4c8d51c8-a1e1-4245-8bbf-375b707cae53 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.505841 Aug 27 05:00:45.690238 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2530/5113] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:45 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:45.696415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ecdbc072-9fff-4d43-a83e-df64d83a78ec req-1f0cb2cc-7e36-4c0f-b392-6d71868a854e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79131199-61d1-48f7-a53c-614f1a17098e", "name": "network-vif-plugged", "status": "completed", "tag": "0862d8e7-87b9-4566-b5e9-f057655a8991"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:45.724039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ecdbc072-9fff-4d43-a83e-df64d83a78ec req-1f0cb2cc-7e36-4c0f-b392-6d71868a854e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:45.725081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ecdbc072-9fff-4d43-a83e-df64d83a78ec req-1f0cb2cc-7e36-4c0f-b392-6d71868a854e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:45.725519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ecdbc072-9fff-4d43-a83e-df64d83a78ec req-1f0cb2cc-7e36-4c0f-b392-6d71868a854e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:45.757071 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ecdbc072-9fff-4d43-a83e-df64d83a78ec req-1f0cb2cc-7e36-4c0f-b392-6d71868a854e service nova] Creating event network-vif-plugged:0862d8e7-87b9-4566-b5e9-f057655a8991 for instance 79131199-61d1-48f7-a53c-614f1a17098e on n-h2-854823-1 Aug 27 05:00:45.784889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-ecdbc072-9fff-4d43-a83e-df64d83a78ec req-1f0cb2cc-7e36-4c0f-b392-6d71868a854e service nova] Instance 79131199-61d1-48f7-a53c-614f1a17098e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:00:45.808776 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ecdbc072-9fff-4d43-a83e-df64d83a78ec req-1f0cb2cc-7e36-4c0f-b392-6d71868a854e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117153 Aug 27 05:00:45.812092 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2531/5114] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:45.906265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-524d82ed-57e2-4288-97d1-e1b17dea8fdd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:45.907009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-524d82ed-57e2-4288-97d1-e1b17dea8fdd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:45.916219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-524d82ed-57e2-4288-97d1-e1b17dea8fdd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:45.918346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-524d82ed-57e2-4288-97d1-e1b17dea8fdd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:45.918803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-524d82ed-57e2-4288-97d1-e1b17dea8fdd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:45.919523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-524d82ed-57e2-4288-97d1-e1b17dea8fdd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:45.919990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-524d82ed-57e2-4288-97d1-e1b17dea8fdd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:45.920424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-524d82ed-57e2-4288-97d1-e1b17dea8fdd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:45.954532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1e789f3d-a31c-4a48-bee8-b9d5320fac8e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:45.975407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:46.025277 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e789f3d-a31c-4a48-bee8-b9d5320fac8e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1691 microversion: 2.1 time: 1.112838 Aug 27 05:00:46.025963 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2584/5115] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:44 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1691 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:46.429213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-524d82ed-57e2-4288-97d1-e1b17dea8fdd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:46.454429 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-524d82ed-57e2-4288-97d1-e1b17dea8fdd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.545261 Aug 27 05:00:46.455381 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2532/5116] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:45 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:46.717084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b23aa29-cfbe-4e62-b9db-9dddf8251f5a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:46.717717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b23aa29-cfbe-4e62-b9db-9dddf8251f5a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:46.740725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b23aa29-cfbe-4e62-b9db-9dddf8251f5a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:46.744672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b23aa29-cfbe-4e62-b9db-9dddf8251f5a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:46.746402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b23aa29-cfbe-4e62-b9db-9dddf8251f5a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:46.749610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b23aa29-cfbe-4e62-b9db-9dddf8251f5a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:46.752430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b23aa29-cfbe-4e62-b9db-9dddf8251f5a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:46.753157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b23aa29-cfbe-4e62-b9db-9dddf8251f5a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:47.053189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0aba2717-611d-4148-bd57-29e5c9ea0757 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:47.053623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0aba2717-611d-4148-bd57-29e5c9ea0757 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:47.078258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0aba2717-611d-4148-bd57-29e5c9ea0757 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:47.079056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0aba2717-611d-4148-bd57-29e5c9ea0757 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:47.079922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0aba2717-611d-4148-bd57-29e5c9ea0757 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:47.081007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0aba2717-611d-4148-bd57-29e5c9ea0757 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:47.081832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0aba2717-611d-4148-bd57-29e5c9ea0757 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:47.082434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0aba2717-611d-4148-bd57-29e5c9ea0757 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:47.180144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b23aa29-cfbe-4e62-b9db-9dddf8251f5a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:47.209275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b23aa29-cfbe-4e62-b9db-9dddf8251f5a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:47.217176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b23aa29-cfbe-4e62-b9db-9dddf8251f5a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:47.233435 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b23aa29-cfbe-4e62-b9db-9dddf8251f5a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.516600 Aug 27 05:00:47.246840 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2585/5117] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:46 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:47.408605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0aba2717-611d-4148-bd57-29e5c9ea0757 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:47.420157 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0aba2717-611d-4148-bd57-29e5c9ea0757 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1683 microversion: 2.1 time: 0.374030 Aug 27 05:00:47.420801 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2533/5118] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:47 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1683 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:47.498312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1afe5fcd-b8e8-42c2-b494-6fbd62bf0c8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:47.499201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1afe5fcd-b8e8-42c2-b494-6fbd62bf0c8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:47.524776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1afe5fcd-b8e8-42c2-b494-6fbd62bf0c8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:47.525404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1afe5fcd-b8e8-42c2-b494-6fbd62bf0c8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:47.528622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1afe5fcd-b8e8-42c2-b494-6fbd62bf0c8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:47.529804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1afe5fcd-b8e8-42c2-b494-6fbd62bf0c8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:47.530483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1afe5fcd-b8e8-42c2-b494-6fbd62bf0c8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:47.531151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1afe5fcd-b8e8-42c2-b494-6fbd62bf0c8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:47.586849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-291208815", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db72d00a-dd07-4f92-8b87-ad6efb8c8c8c"}], "security_groups": [{"name": "tempest-securitygroup--166997883"}], "key_name": "tempest-keypair-663252782", "user_data": "}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:47.743306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] validate_networks() for [('db72d00a-dd07-4f92-8b87-ad6efb8c8c8c', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:00:47.866850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1afe5fcd-b8e8-42c2-b494-6fbd62bf0c8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:47.882547 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1afe5fcd-b8e8-42c2-b494-6fbd62bf0c8a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.394273 Aug 27 05:00:47.883164 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2586/5119] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:47 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:48.267325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66b77d95-9bf7-4f19-8053-3063d8906066 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:48.268731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66b77d95-9bf7-4f19-8053-3063d8906066 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:48.277298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66b77d95-9bf7-4f19-8053-3063d8906066 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:48.278121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66b77d95-9bf7-4f19-8053-3063d8906066 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:48.278736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66b77d95-9bf7-4f19-8053-3063d8906066 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:48.279731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66b77d95-9bf7-4f19-8053-3063d8906066 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:48.280452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66b77d95-9bf7-4f19-8053-3063d8906066 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:48.281300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66b77d95-9bf7-4f19-8053-3063d8906066 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:48.556206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66b77d95-9bf7-4f19-8053-3063d8906066 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:48.566721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66b77d95-9bf7-4f19-8053-3063d8906066 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:48.567716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66b77d95-9bf7-4f19-8053-3063d8906066 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:48.577721 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66b77d95-9bf7-4f19-8053-3063d8906066 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.321791 Aug 27 05:00:48.582543 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2587/5120] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:48 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:00:48.842125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:00:48.844602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:00:48.845522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:00:48.846182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:00:48.846996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:00:48.857614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:48.858240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:48.858723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:48.859535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:48.860105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:48.860746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:48.883117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Getting quotas for project 8fe84461cde7445dbf0d1a98df3aeb15. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:00:48.889598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Getting quotas for user 18c5a89d81c64bdaad17d7005434f01f and project 8fe84461cde7445dbf0d1a98df3aeb15. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:00:48.907233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5917043b-1f6d-48c7-a96c-e5b6658d1922 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:48.908190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5917043b-1f6d-48c7-a96c-e5b6658d1922 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:48.909706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:00:48.912573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:00:48.915415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5917043b-1f6d-48c7-a96c-e5b6658d1922 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:48.915923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5917043b-1f6d-48c7-a96c-e5b6658d1922 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:48.916362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5917043b-1f6d-48c7-a96c-e5b6658d1922 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:48.921600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5917043b-1f6d-48c7-a96c-e5b6658d1922 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:48.922497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5917043b-1f6d-48c7-a96c-e5b6658d1922 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:48.923117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5917043b-1f6d-48c7-a96c-e5b6658d1922 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:48.985579 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b85eb6d7-91e4-4239-b6b3-c7671c3c7273 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.403493 Aug 27 05:00:48.986829 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2534/5121] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:00:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:00:49.001557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7e6720f-29bd-45cc-8382-713cc571e040 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:49.003440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c7e6720f-29bd-45cc-8382-713cc571e040 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:49.101147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c7e6720f-29bd-45cc-8382-713cc571e040 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:49.109489 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7e6720f-29bd-45cc-8382-713cc571e040 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1236 microversion: 2.1 time: 0.114392 Aug 27 05:00:49.111478 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2535/5122] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:48 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1236 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:49.172686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5917043b-1f6d-48c7-a96c-e5b6658d1922 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:49.192300 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5917043b-1f6d-48c7-a96c-e5b6658d1922 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.287668 Aug 27 05:00:49.206017 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2588/5123] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:48 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:49.602127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1e728c02-5f70-4301-a2ae-b8fe94f8cea1 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:49.603048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1e728c02-5f70-4301-a2ae-b8fe94f8cea1 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:49.638495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e728c02-5f70-4301-a2ae-b8fe94f8cea1 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:49.639418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e728c02-5f70-4301-a2ae-b8fe94f8cea1 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:49.640992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e728c02-5f70-4301-a2ae-b8fe94f8cea1 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:49.655464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e728c02-5f70-4301-a2ae-b8fe94f8cea1 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:49.655464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e728c02-5f70-4301-a2ae-b8fe94f8cea1 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:49.655464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e728c02-5f70-4301-a2ae-b8fe94f8cea1 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:50.067561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e728c02-5f70-4301-a2ae-b8fe94f8cea1 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:50.087484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e728c02-5f70-4301-a2ae-b8fe94f8cea1 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:50.092327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e728c02-5f70-4301-a2ae-b8fe94f8cea1 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:50.119357 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1e728c02-5f70-4301-a2ae-b8fe94f8cea1 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.496704 Aug 27 05:00:50.119357 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2536/5124] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:49 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:50.132872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6b04581-1083-42f0-8531-6957bf1547c2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:50.134033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e6b04581-1083-42f0-8531-6957bf1547c2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:50.146533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b04581-1083-42f0-8531-6957bf1547c2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:50.149654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b04581-1083-42f0-8531-6957bf1547c2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:50.152979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b04581-1083-42f0-8531-6957bf1547c2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:50.154443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b04581-1083-42f0-8531-6957bf1547c2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:50.158197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b04581-1083-42f0-8531-6957bf1547c2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:50.158538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b04581-1083-42f0-8531-6957bf1547c2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:50.216723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-71c22a6e-7cb1-42ea-8c14-499ed1607cc0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:50.217727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-71c22a6e-7cb1-42ea-8c14-499ed1607cc0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:50.227051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71c22a6e-7cb1-42ea-8c14-499ed1607cc0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:50.227877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71c22a6e-7cb1-42ea-8c14-499ed1607cc0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:50.228553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71c22a6e-7cb1-42ea-8c14-499ed1607cc0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:50.229516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71c22a6e-7cb1-42ea-8c14-499ed1607cc0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:50.230211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71c22a6e-7cb1-42ea-8c14-499ed1607cc0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:50.230938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71c22a6e-7cb1-42ea-8c14-499ed1607cc0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:50.264615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e6b04581-1083-42f0-8531-6957bf1547c2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:50.275635 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6b04581-1083-42f0-8531-6957bf1547c2 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1288 microversion: 2.1 time: 0.145248 Aug 27 05:00:50.277207 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2589/5125] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:50 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1288 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:50.571775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-71c22a6e-7cb1-42ea-8c14-499ed1607cc0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:50.588706 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-71c22a6e-7cb1-42ea-8c14-499ed1607cc0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.375217 Aug 27 05:00:50.589331 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2537/5126] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:50 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:51.146365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25f5066f-fc8f-4cd1-990b-ddac261c9348 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:51.146989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25f5066f-fc8f-4cd1-990b-ddac261c9348 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:51.160771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25f5066f-fc8f-4cd1-990b-ddac261c9348 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:51.162726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25f5066f-fc8f-4cd1-990b-ddac261c9348 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:51.163500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25f5066f-fc8f-4cd1-990b-ddac261c9348 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:51.166501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25f5066f-fc8f-4cd1-990b-ddac261c9348 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:51.167157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25f5066f-fc8f-4cd1-990b-ddac261c9348 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:51.167753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25f5066f-fc8f-4cd1-990b-ddac261c9348 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:51.301652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-70108cda-0bd7-4b6b-8edc-aba2bc342ba8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:51.303628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-70108cda-0bd7-4b6b-8edc-aba2bc342ba8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:51.323268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70108cda-0bd7-4b6b-8edc-aba2bc342ba8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:51.324681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70108cda-0bd7-4b6b-8edc-aba2bc342ba8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:51.327615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70108cda-0bd7-4b6b-8edc-aba2bc342ba8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:51.331764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70108cda-0bd7-4b6b-8edc-aba2bc342ba8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:51.332445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70108cda-0bd7-4b6b-8edc-aba2bc342ba8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:51.336351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70108cda-0bd7-4b6b-8edc-aba2bc342ba8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:51.465689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-70108cda-0bd7-4b6b-8edc-aba2bc342ba8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:51.494704 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-70108cda-0bd7-4b6b-8edc-aba2bc342ba8 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1294 microversion: 2.1 time: 0.198565 Aug 27 05:00:51.495319 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2538/5127] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:51 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1294 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:51.610214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4a2f80f4-6deb-460d-8b6d-b18caa02cb26 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:51.611111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4a2f80f4-6deb-460d-8b6d-b18caa02cb26 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:51.619923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a2f80f4-6deb-460d-8b6d-b18caa02cb26 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:51.621132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a2f80f4-6deb-460d-8b6d-b18caa02cb26 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:51.622430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a2f80f4-6deb-460d-8b6d-b18caa02cb26 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:51.626860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a2f80f4-6deb-460d-8b6d-b18caa02cb26 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:51.627839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a2f80f4-6deb-460d-8b6d-b18caa02cb26 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:51.628886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a2f80f4-6deb-460d-8b6d-b18caa02cb26 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:51.781385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25f5066f-fc8f-4cd1-990b-ddac261c9348 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:51.809713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25f5066f-fc8f-4cd1-990b-ddac261c9348 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:51.812617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25f5066f-fc8f-4cd1-990b-ddac261c9348 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:51.822866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4a2f80f4-6deb-460d-8b6d-b18caa02cb26 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:51.825285 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25f5066f-fc8f-4cd1-990b-ddac261c9348 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.672382 Aug 27 05:00:51.825974 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2590/5128] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:51 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:51.833067 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4a2f80f4-6deb-460d-8b6d-b18caa02cb26 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.226376 Aug 27 05:00:51.838311 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2539/5129] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:51 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:52.520926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b115adc4-a2c5-4a61-9011-2d836b20d6d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:52.522266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b115adc4-a2c5-4a61-9011-2d836b20d6d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:52.542162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b115adc4-a2c5-4a61-9011-2d836b20d6d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:52.545938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b115adc4-a2c5-4a61-9011-2d836b20d6d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:52.547284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b115adc4-a2c5-4a61-9011-2d836b20d6d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:52.553484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b115adc4-a2c5-4a61-9011-2d836b20d6d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:52.555025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b115adc4-a2c5-4a61-9011-2d836b20d6d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:52.557179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b115adc4-a2c5-4a61-9011-2d836b20d6d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:52.759399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b115adc4-a2c5-4a61-9011-2d836b20d6d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:52.807168 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b115adc4-a2c5-4a61-9011-2d836b20d6d9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1294 microversion: 2.1 time: 0.272675 Aug 27 05:00:52.810909 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2591/5130] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:52 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1294 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:52.848752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b62fba9d-2c1e-405e-a659-0371996ac1a0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:52.857630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e207920d-1b46-40af-ad33-4787f37f1cbb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:52.858542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e207920d-1b46-40af-ad33-4787f37f1cbb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:52.860474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b62fba9d-2c1e-405e-a659-0371996ac1a0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:52.887219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e207920d-1b46-40af-ad33-4787f37f1cbb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:52.887741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b62fba9d-2c1e-405e-a659-0371996ac1a0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:52.887870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e207920d-1b46-40af-ad33-4787f37f1cbb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:52.888249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e207920d-1b46-40af-ad33-4787f37f1cbb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:52.889025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b62fba9d-2c1e-405e-a659-0371996ac1a0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:52.889582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b62fba9d-2c1e-405e-a659-0371996ac1a0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:52.890055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e207920d-1b46-40af-ad33-4787f37f1cbb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:52.890894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e207920d-1b46-40af-ad33-4787f37f1cbb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:52.891089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b62fba9d-2c1e-405e-a659-0371996ac1a0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:52.891405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e207920d-1b46-40af-ad33-4787f37f1cbb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:52.891887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b62fba9d-2c1e-405e-a659-0371996ac1a0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:52.892461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b62fba9d-2c1e-405e-a659-0371996ac1a0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:53.266650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b62fba9d-2c1e-405e-a659-0371996ac1a0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:53.284832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b62fba9d-2c1e-405e-a659-0371996ac1a0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:53.287111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b62fba9d-2c1e-405e-a659-0371996ac1a0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:53.288689 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b62fba9d-2c1e-405e-a659-0371996ac1a0 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.444577 Aug 27 05:00:53.289814 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2540/5131] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:52 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:53.678440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e207920d-1b46-40af-ad33-4787f37f1cbb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:53.695999 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e207920d-1b46-40af-ad33-4787f37f1cbb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.843541 Aug 27 05:00:53.697417 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2592/5132] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:52 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:53.830133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bec84123-33bc-4203-88cd-86249630a506 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:53.830954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bec84123-33bc-4203-88cd-86249630a506 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:53.843790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bec84123-33bc-4203-88cd-86249630a506 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:53.845266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bec84123-33bc-4203-88cd-86249630a506 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:53.845720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bec84123-33bc-4203-88cd-86249630a506 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:53.846445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bec84123-33bc-4203-88cd-86249630a506 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:53.846900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bec84123-33bc-4203-88cd-86249630a506 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:53.847331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bec84123-33bc-4203-88cd-86249630a506 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:54.275105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bec84123-33bc-4203-88cd-86249630a506 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:54.294429 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bec84123-33bc-4203-88cd-86249630a506 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1361 microversion: 2.1 time: 0.468470 Aug 27 05:00:54.295307 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2541/5133] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:53 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1361 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:54.313569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e5a39d3-a0c5-4c9f-bbce-c83b362c9969 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:54.314190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e5a39d3-a0c5-4c9f-bbce-c83b362c9969 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:54.325800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:54.328610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e5a39d3-a0c5-4c9f-bbce-c83b362c9969 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:54.330278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e5a39d3-a0c5-4c9f-bbce-c83b362c9969 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:54.330960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e5a39d3-a0c5-4c9f-bbce-c83b362c9969 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:54.336077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e5a39d3-a0c5-4c9f-bbce-c83b362c9969 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:54.336877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e5a39d3-a0c5-4c9f-bbce-c83b362c9969 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:54.337451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e5a39d3-a0c5-4c9f-bbce-c83b362c9969 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:54.728745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-17c8d0b6-bf27-434b-916b-fe4237d34641 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:54.729569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-17c8d0b6-bf27-434b-916b-fe4237d34641 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:54.737960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17c8d0b6-bf27-434b-916b-fe4237d34641 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:54.738892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17c8d0b6-bf27-434b-916b-fe4237d34641 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:54.739505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17c8d0b6-bf27-434b-916b-fe4237d34641 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:54.740513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17c8d0b6-bf27-434b-916b-fe4237d34641 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:54.741283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17c8d0b6-bf27-434b-916b-fe4237d34641 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:54.741882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17c8d0b6-bf27-434b-916b-fe4237d34641 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:54.752599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e5a39d3-a0c5-4c9f-bbce-c83b362c9969 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:54.771881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e5a39d3-a0c5-4c9f-bbce-c83b362c9969 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:54.773656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e5a39d3-a0c5-4c9f-bbce-c83b362c9969 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:54.782266 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e5a39d3-a0c5-4c9f-bbce-c83b362c9969 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.472652 Aug 27 05:00:54.796563 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2593/5134] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:54 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:55.007037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-17c8d0b6-bf27-434b-916b-fe4237d34641 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:55.020377 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-17c8d0b6-bf27-434b-916b-fe4237d34641 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1169 microversion: 2.1 time: 0.301165 Aug 27 05:00:55.021176 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2542/5135] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:54 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1169 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:55.322437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f9f4d8e-e168-4cce-a205-761ae7580a2d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:55.323233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f9f4d8e-e168-4cce-a205-761ae7580a2d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:55.337212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9f4d8e-e168-4cce-a205-761ae7580a2d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:55.339736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9f4d8e-e168-4cce-a205-761ae7580a2d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:55.340220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9f4d8e-e168-4cce-a205-761ae7580a2d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:55.341027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9f4d8e-e168-4cce-a205-761ae7580a2d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:55.341504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9f4d8e-e168-4cce-a205-761ae7580a2d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:55.341943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9f4d8e-e168-4cce-a205-761ae7580a2d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:55.724596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-3e28503c-830a-4192-bb1d-d7fd20b4115d req-5af30dcb-4eb3-4877-8283-dcb6c5a22e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3ca3f0-178f-48ad-a92d-81f2285abf64", "tag": "fbc1d9ef-c67e-4481-bf0a-b2732263a4fd"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:55.744076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3e28503c-830a-4192-bb1d-d7fd20b4115d req-5af30dcb-4eb3-4877-8283-dcb6c5a22e7e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:55.745465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3e28503c-830a-4192-bb1d-d7fd20b4115d req-5af30dcb-4eb3-4877-8283-dcb6c5a22e7e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:55.748455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3e28503c-830a-4192-bb1d-d7fd20b4115d req-5af30dcb-4eb3-4877-8283-dcb6c5a22e7e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:55.784970 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-3e28503c-830a-4192-bb1d-d7fd20b4115d req-5af30dcb-4eb3-4877-8283-dcb6c5a22e7e service nova] Creating event network-changed:fbc1d9ef-c67e-4481-bf0a-b2732263a4fd for instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 on n-h2-854823-1 Aug 27 05:00:55.799335 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-3e28503c-830a-4192-bb1d-d7fd20b4115d req-5af30dcb-4eb3-4877-8283-dcb6c5a22e7e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078517 Aug 27 05:00:55.800435 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2543/5136] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:00:55.807873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f9f4d8e-e168-4cce-a205-761ae7580a2d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:55.821556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53914060-dbdf-4feb-a393-c1f37f0885a9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:55.822471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-53914060-dbdf-4feb-a393-c1f37f0885a9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:55.829558 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f9f4d8e-e168-4cce-a205-761ae7580a2d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1361 microversion: 2.1 time: 0.512827 Aug 27 05:00:55.835766 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2594/5137] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:55 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1361 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:00:55.842688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53914060-dbdf-4feb-a393-c1f37f0885a9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:55.848810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53914060-dbdf-4feb-a393-c1f37f0885a9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:55.850310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53914060-dbdf-4feb-a393-c1f37f0885a9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:55.851388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53914060-dbdf-4feb-a393-c1f37f0885a9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:55.852101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53914060-dbdf-4feb-a393-c1f37f0885a9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:55.852801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53914060-dbdf-4feb-a393-c1f37f0885a9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:56.048061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-938826be-2310-4fe8-baa6-5a8a8a8b1c21 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:56.049049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-938826be-2310-4fe8-baa6-5a8a8a8b1c21 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:56.064234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-938826be-2310-4fe8-baa6-5a8a8a8b1c21 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:56.064906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-938826be-2310-4fe8-baa6-5a8a8a8b1c21 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:56.065485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-938826be-2310-4fe8-baa6-5a8a8a8b1c21 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:56.066336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-938826be-2310-4fe8-baa6-5a8a8a8b1c21 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:56.073524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-938826be-2310-4fe8-baa6-5a8a8a8b1c21 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:56.074115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-938826be-2310-4fe8-baa6-5a8a8a8b1c21 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:56.882815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53914060-dbdf-4feb-a393-c1f37f0885a9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:56.900260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53914060-dbdf-4feb-a393-c1f37f0885a9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:56.910857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53914060-dbdf-4feb-a393-c1f37f0885a9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:56.916463 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-53914060-dbdf-4feb-a393-c1f37f0885a9 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 1.106090 Aug 27 05:00:56.917348 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2544/5138] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:55 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:56.952305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-83c7929d-3ef9-4344-bc28-f09a70c10925 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:56.955520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-83c7929d-3ef9-4344-bc28-f09a70c10925 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:56.969140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83c7929d-3ef9-4344-bc28-f09a70c10925 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:56.969908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83c7929d-3ef9-4344-bc28-f09a70c10925 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:56.970544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83c7929d-3ef9-4344-bc28-f09a70c10925 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:56.971497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83c7929d-3ef9-4344-bc28-f09a70c10925 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:56.972127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83c7929d-3ef9-4344-bc28-f09a70c10925 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:56.972760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83c7929d-3ef9-4344-bc28-f09a70c10925 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:57.456423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-938826be-2310-4fe8-baa6-5a8a8a8b1c21 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:57.469286 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-938826be-2310-4fe8-baa6-5a8a8a8b1c21 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1203 microversion: 2.1 time: 1.426410 Aug 27 05:00:57.484965 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2595/5139] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:56 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1203 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:57.881319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-83c7929d-3ef9-4344-bc28-f09a70c10925 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:57.890799 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-83c7929d-3ef9-4344-bc28-f09a70c10925 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1361 microversion: 2.1 time: 0.970872 Aug 27 05:00:57.893152 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2545/5140] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:56 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1361 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:57.942730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7bc4a4b9-a05e-416a-8ad7-dbda67e9e62f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:57.944720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7bc4a4b9-a05e-416a-8ad7-dbda67e9e62f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:57.957696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc4a4b9-a05e-416a-8ad7-dbda67e9e62f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:57.958507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc4a4b9-a05e-416a-8ad7-dbda67e9e62f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:57.959827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc4a4b9-a05e-416a-8ad7-dbda67e9e62f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:57.962430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc4a4b9-a05e-416a-8ad7-dbda67e9e62f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:57.964619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc4a4b9-a05e-416a-8ad7-dbda67e9e62f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:57.966132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bc4a4b9-a05e-416a-8ad7-dbda67e9e62f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:58.264302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7bc4a4b9-a05e-416a-8ad7-dbda67e9e62f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:58.277805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7bc4a4b9-a05e-416a-8ad7-dbda67e9e62f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:58.279742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7bc4a4b9-a05e-416a-8ad7-dbda67e9e62f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:58.281329 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7bc4a4b9-a05e-416a-8ad7-dbda67e9e62f tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.342742 Aug 27 05:00:58.299381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-211182809", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "0da6eff2-1f4c-4a7b-b7b5-c56e9bd5fc5e"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:00:58.301873 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2596/5141] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:57 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:00:58.362070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] validate_networks() for [('0da6eff2-1f4c-4a7b-b7b5-c56e9bd5fc5e', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:00:58.493583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb9e0bb2-0cfb-4c0d-9d0c-14426b24eb77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:58.494220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cb9e0bb2-0cfb-4c0d-9d0c-14426b24eb77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:58.507000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb9e0bb2-0cfb-4c0d-9d0c-14426b24eb77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:58.523847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb9e0bb2-0cfb-4c0d-9d0c-14426b24eb77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:58.525476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb9e0bb2-0cfb-4c0d-9d0c-14426b24eb77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:58.527821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb9e0bb2-0cfb-4c0d-9d0c-14426b24eb77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:58.528335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb9e0bb2-0cfb-4c0d-9d0c-14426b24eb77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:58.528824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb9e0bb2-0cfb-4c0d-9d0c-14426b24eb77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:58.870812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:58.888164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cb9e0bb2-0cfb-4c0d-9d0c-14426b24eb77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:58.897488 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cb9e0bb2-0cfb-4c0d-9d0c-14426b24eb77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1203 microversion: 2.1 time: 0.409525 Aug 27 05:00:58.898504 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2597/5142] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:58 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1203 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:58.918050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-086d9c0a-02e4-4224-b60d-e045284c9303 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:58.918917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-086d9c0a-02e4-4224-b60d-e045284c9303 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:58.933717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086d9c0a-02e4-4224-b60d-e045284c9303 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:58.934469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086d9c0a-02e4-4224-b60d-e045284c9303 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:58.935105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086d9c0a-02e4-4224-b60d-e045284c9303 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:58.935990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086d9c0a-02e4-4224-b60d-e045284c9303 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:58.936668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086d9c0a-02e4-4224-b60d-e045284c9303 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:58.937285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-086d9c0a-02e4-4224-b60d-e045284c9303 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:59.107846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:59.277812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-086d9c0a-02e4-4224-b60d-e045284c9303 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:00:59.301781 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-086d9c0a-02e4-4224-b60d-e045284c9303 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1361 microversion: 2.1 time: 0.387206 Aug 27 05:00:59.302983 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2598/5143] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:00:58 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1361 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:00:59.307902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54310e61-b192-4d2c-95ed-e040b1dccebc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:00:59.308798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-54310e61-b192-4d2c-95ed-e040b1dccebc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:00:59.326372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54310e61-b192-4d2c-95ed-e040b1dccebc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:59.327113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54310e61-b192-4d2c-95ed-e040b1dccebc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:59.327721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54310e61-b192-4d2c-95ed-e040b1dccebc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:00:59.328656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54310e61-b192-4d2c-95ed-e040b1dccebc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:00:59.329300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54310e61-b192-4d2c-95ed-e040b1dccebc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:00:59.329918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54310e61-b192-4d2c-95ed-e040b1dccebc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:00.034731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:01:00.035156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:01:00.035627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:01:00.036874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:01:00.037599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:01:00.053529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:00.058370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:00.059071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:00.064254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:00.065129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:00.065737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:00.099490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:00.119282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Getting quotas for project 96da74018b7846f79741bf8f15b22ae9. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:01:00.135988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-54310e61-b192-4d2c-95ed-e040b1dccebc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:00.141890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Getting quotas for user d5b1048ffa264ff4abdf91994f0d66a1 and project 96da74018b7846f79741bf8f15b22ae9. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:01:00.148897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-54310e61-b192-4d2c-95ed-e040b1dccebc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:00.154142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-54310e61-b192-4d2c-95ed-e040b1dccebc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:00.159573 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-54310e61-b192-4d2c-95ed-e040b1dccebc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.855382 Aug 27 05:01:00.165150 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2599/5144] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:00:59 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:00.170336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd91b971-e0fa-4b2d-9f84-c1f8b7b35199 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:00.171911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd91b971-e0fa-4b2d-9f84-c1f8b7b35199 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:00.178532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd91b971-e0fa-4b2d-9f84-c1f8b7b35199 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:00.179198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd91b971-e0fa-4b2d-9f84-c1f8b7b35199 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:00.196336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd91b971-e0fa-4b2d-9f84-c1f8b7b35199 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:00.199595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd91b971-e0fa-4b2d-9f84-c1f8b7b35199 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:00.200631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:01:00.203424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:01:00.204320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd91b971-e0fa-4b2d-9f84-c1f8b7b35199 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:00.204964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd91b971-e0fa-4b2d-9f84-c1f8b7b35199 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:00.281228 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ba9c00fc-690e-46bb-9c8b-c9935f02f10d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.992574 Aug 27 05:01:00.282490 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2546/5145] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:00:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:01:00.293872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5bb1ff11-569e-4c01-9123-9611843e62d1 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:00.294757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5bb1ff11-569e-4c01-9123-9611843e62d1 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:00.422566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5bb1ff11-569e-4c01-9123-9611843e62d1 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:00.432450 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5bb1ff11-569e-4c01-9123-9611843e62d1 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1218 microversion: 2.1 time: 0.142571 Aug 27 05:01:00.443420 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2547/5146] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:00 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:00.450256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6379e265-a4c8-4757-a4d4-341a109a8344 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:00.450567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6379e265-a4c8-4757-a4d4-341a109a8344 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:00.476297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6379e265-a4c8-4757-a4d4-341a109a8344 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:00.478356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6379e265-a4c8-4757-a4d4-341a109a8344 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:00.487825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6379e265-a4c8-4757-a4d4-341a109a8344 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:00.488636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6379e265-a4c8-4757-a4d4-341a109a8344 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:00.489123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6379e265-a4c8-4757-a4d4-341a109a8344 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:00.497891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6379e265-a4c8-4757-a4d4-341a109a8344 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:00.583720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bd91b971-e0fa-4b2d-9f84-c1f8b7b35199 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:00.596274 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd91b971-e0fa-4b2d-9f84-c1f8b7b35199 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1203 microversion: 2.1 time: 0.429757 Aug 27 05:01:00.616634 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2600/5147] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:00 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1203 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:01.007215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6379e265-a4c8-4757-a4d4-341a109a8344 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:01.019720 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6379e265-a4c8-4757-a4d4-341a109a8344 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1361 microversion: 2.1 time: 0.575021 Aug 27 05:01:01.024421 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2548/5148] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:00 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1361 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:01.189110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d537bc75-8b3f-4419-a219-74827595fca8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:01.190313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d537bc75-8b3f-4419-a219-74827595fca8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:01.199191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d537bc75-8b3f-4419-a219-74827595fca8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:01.200070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d537bc75-8b3f-4419-a219-74827595fca8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:01.200744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d537bc75-8b3f-4419-a219-74827595fca8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.201802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d537bc75-8b3f-4419-a219-74827595fca8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:01.202488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d537bc75-8b3f-4419-a219-74827595fca8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:01.203319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d537bc75-8b3f-4419-a219-74827595fca8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.228561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:01.447185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d537bc75-8b3f-4419-a219-74827595fca8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:01.455377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5f6d8ce-3af8-44f8-b39f-7d2f8145baa3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:01.456755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f5f6d8ce-3af8-44f8-b39f-7d2f8145baa3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:01.464313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5f6d8ce-3af8-44f8-b39f-7d2f8145baa3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:01.465145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5f6d8ce-3af8-44f8-b39f-7d2f8145baa3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:01.465791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5f6d8ce-3af8-44f8-b39f-7d2f8145baa3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.466814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5f6d8ce-3af8-44f8-b39f-7d2f8145baa3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:01.467549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5f6d8ce-3af8-44f8-b39f-7d2f8145baa3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:01.468198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5f6d8ce-3af8-44f8-b39f-7d2f8145baa3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.469950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d537bc75-8b3f-4419-a219-74827595fca8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:01.471871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d537bc75-8b3f-4419-a219-74827595fca8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:01.473093 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d537bc75-8b3f-4419-a219-74827595fca8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.289140 Aug 27 05:01:01.474870 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2601/5149] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:01 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:01.577860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f5f6d8ce-3af8-44f8-b39f-7d2f8145baa3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:01.596249 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f5f6d8ce-3af8-44f8-b39f-7d2f8145baa3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1214 microversion: 2.1 time: 0.144775 Aug 27 05:01:01.596887 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2549/5150] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:01 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:01.619923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-098a810b-60b4-4dc7-bc86-127e18cf2cad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:01.620662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-098a810b-60b4-4dc7-bc86-127e18cf2cad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:01.630918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-098a810b-60b4-4dc7-bc86-127e18cf2cad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:01.631942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-098a810b-60b4-4dc7-bc86-127e18cf2cad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:01.632462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-098a810b-60b4-4dc7-bc86-127e18cf2cad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.634639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-098a810b-60b4-4dc7-bc86-127e18cf2cad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:01.635195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-098a810b-60b4-4dc7-bc86-127e18cf2cad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:01.635711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-098a810b-60b4-4dc7-bc86-127e18cf2cad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.841381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-098a810b-60b4-4dc7-bc86-127e18cf2cad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:01.850487 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-098a810b-60b4-4dc7-bc86-127e18cf2cad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1203 microversion: 2.1 time: 0.234648 Aug 27 05:01:01.851105 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2602/5151] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:01 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1203 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:01.919259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8c7028a1-1f69-4f09-b401-b9e08a2ff9e5 req-45b69683-a321-4e1f-9857-a9492d704dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-plugged", "status": "completed", "tag": "fbb40aad-f6d0-4f6b-8334-5b18e9abb354"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:01.938871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8c7028a1-1f69-4f09-b401-b9e08a2ff9e5 req-45b69683-a321-4e1f-9857-a9492d704dea service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:01.940866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8c7028a1-1f69-4f09-b401-b9e08a2ff9e5 req-45b69683-a321-4e1f-9857-a9492d704dea service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:01.945630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8c7028a1-1f69-4f09-b401-b9e08a2ff9e5 req-45b69683-a321-4e1f-9857-a9492d704dea service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:01.975628 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8c7028a1-1f69-4f09-b401-b9e08a2ff9e5 req-45b69683-a321-4e1f-9857-a9492d704dea service nova] Creating event network-vif-plugged:fbb40aad-f6d0-4f6b-8334-5b18e9abb354 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:01:01.982561 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8c7028a1-1f69-4f09-b401-b9e08a2ff9e5 req-45b69683-a321-4e1f-9857-a9492d704dea service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067369 Aug 27 05:01:01.984883 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2550/5152] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:02.043388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27f38c94-af73-4217-a019-18d306ae53ef tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:02.043937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-27f38c94-af73-4217-a019-18d306ae53ef tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:02.056782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27f38c94-af73-4217-a019-18d306ae53ef tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.057667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27f38c94-af73-4217-a019-18d306ae53ef tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.058288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27f38c94-af73-4217-a019-18d306ae53ef tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:02.059255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27f38c94-af73-4217-a019-18d306ae53ef tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.060252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27f38c94-af73-4217-a019-18d306ae53ef tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.061244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27f38c94-af73-4217-a019-18d306ae53ef tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:02.243642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-27f38c94-af73-4217-a019-18d306ae53ef tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:02.254857 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-27f38c94-af73-4217-a019-18d306ae53ef tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1361 microversion: 2.1 time: 0.215399 Aug 27 05:01:02.256548 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2603/5153] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:02 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:02.499427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7aa1b931-fe11-4a16-88bd-945f5391486c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:02.505122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7aa1b931-fe11-4a16-88bd-945f5391486c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:02.524795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aa1b931-fe11-4a16-88bd-945f5391486c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.531073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aa1b931-fe11-4a16-88bd-945f5391486c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.531761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aa1b931-fe11-4a16-88bd-945f5391486c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:02.532743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aa1b931-fe11-4a16-88bd-945f5391486c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.533374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aa1b931-fe11-4a16-88bd-945f5391486c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.534000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aa1b931-fe11-4a16-88bd-945f5391486c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:02.547616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:02.618928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4cdb65e-1479-4157-9b52-e8d5b1b67f75 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:02.619679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4cdb65e-1479-4157-9b52-e8d5b1b67f75 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:02.640194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cdb65e-1479-4157-9b52-e8d5b1b67f75 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.640861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cdb65e-1479-4157-9b52-e8d5b1b67f75 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.641319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cdb65e-1479-4157-9b52-e8d5b1b67f75 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:02.642085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cdb65e-1479-4157-9b52-e8d5b1b67f75 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.645874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cdb65e-1479-4157-9b52-e8d5b1b67f75 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.647237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cdb65e-1479-4157-9b52-e8d5b1b67f75 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:02.806103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4cdb65e-1479-4157-9b52-e8d5b1b67f75 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:02.838504 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4cdb65e-1479-4157-9b52-e8d5b1b67f75 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1270 microversion: 2.1 time: 0.224345 Aug 27 05:01:02.853516 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2604/5154] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:02 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1270 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:02.874007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ced65276-7974-4e2d-a94d-e3df04921714 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:02.875198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ced65276-7974-4e2d-a94d-e3df04921714 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:02.877994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:02.886867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced65276-7974-4e2d-a94d-e3df04921714 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.887786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced65276-7974-4e2d-a94d-e3df04921714 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.888669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced65276-7974-4e2d-a94d-e3df04921714 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:02.889661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced65276-7974-4e2d-a94d-e3df04921714 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:02.890475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced65276-7974-4e2d-a94d-e3df04921714 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:02.891369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ced65276-7974-4e2d-a94d-e3df04921714 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:03.165610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ced65276-7974-4e2d-a94d-e3df04921714 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:03.178122 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ced65276-7974-4e2d-a94d-e3df04921714 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1203 microversion: 2.1 time: 0.308470 Aug 27 05:01:03.194922 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2605/5155] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:02 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1203 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:03.284044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f26981ee-fa7a-4d8f-8ec6-50f761b7885d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:03.285294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f26981ee-fa7a-4d8f-8ec6-50f761b7885d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:03.308023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26981ee-fa7a-4d8f-8ec6-50f761b7885d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:03.308963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26981ee-fa7a-4d8f-8ec6-50f761b7885d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:03.309427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26981ee-fa7a-4d8f-8ec6-50f761b7885d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:03.312988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26981ee-fa7a-4d8f-8ec6-50f761b7885d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:03.313883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26981ee-fa7a-4d8f-8ec6-50f761b7885d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:03.316899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26981ee-fa7a-4d8f-8ec6-50f761b7885d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:03.471814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7aa1b931-fe11-4a16-88bd-945f5391486c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:03.489109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7aa1b931-fe11-4a16-88bd-945f5391486c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:03.495949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7aa1b931-fe11-4a16-88bd-945f5391486c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:03.497532 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7aa1b931-fe11-4a16-88bd-945f5391486c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 1.003436 Aug 27 05:01:03.498341 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2551/5156] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:02 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:03.575032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f26981ee-fa7a-4d8f-8ec6-50f761b7885d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:03.593737 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f26981ee-fa7a-4d8f-8ec6-50f761b7885d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1361 microversion: 2.1 time: 0.317626 Aug 27 05:01:03.598427 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2606/5157] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:03 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1361 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:03.872060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7c6b4d9c-42f9-434e-bf98-4892614d8b8f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:03.875197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7c6b4d9c-42f9-434e-bf98-4892614d8b8f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:03.915509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c6b4d9c-42f9-434e-bf98-4892614d8b8f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:03.917291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c6b4d9c-42f9-434e-bf98-4892614d8b8f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:03.921882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c6b4d9c-42f9-434e-bf98-4892614d8b8f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:03.923000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c6b4d9c-42f9-434e-bf98-4892614d8b8f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:03.925476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c6b4d9c-42f9-434e-bf98-4892614d8b8f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:03.928617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c6b4d9c-42f9-434e-bf98-4892614d8b8f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:04.014744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-24fef31c-2686-4fcb-ba66-2e215688ec43 req-0a4514d0-0ed6-4862-9142-adca5d6d9102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-plugged", "status": "completed", "tag": "2f5d037f-12fc-48e0-a08b-bc7ed1c9a197"}, {"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-plugged", "status": "completed", "tag": "c1f12ba8-4229-4c6b-8a69-f4b909bb0337"}, {"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-plugged", "status": "completed", "tag": "d47b1431-6e76-424f-a633-fedf675e1d79"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:04.052990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-24fef31c-2686-4fcb-ba66-2e215688ec43 req-0a4514d0-0ed6-4862-9142-adca5d6d9102 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:04.062653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-24fef31c-2686-4fcb-ba66-2e215688ec43 req-0a4514d0-0ed6-4862-9142-adca5d6d9102 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:04.063441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-24fef31c-2686-4fcb-ba66-2e215688ec43 req-0a4514d0-0ed6-4862-9142-adca5d6d9102 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:04.115872 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-24fef31c-2686-4fcb-ba66-2e215688ec43 req-0a4514d0-0ed6-4862-9142-adca5d6d9102 service nova] Creating event network-vif-plugged:2f5d037f-12fc-48e0-a08b-bc7ed1c9a197 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:01:04.116386 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-24fef31c-2686-4fcb-ba66-2e215688ec43 req-0a4514d0-0ed6-4862-9142-adca5d6d9102 service nova] Creating event network-vif-plugged:c1f12ba8-4229-4c6b-8a69-f4b909bb0337 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:01:04.116924 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-24fef31c-2686-4fcb-ba66-2e215688ec43 req-0a4514d0-0ed6-4862-9142-adca5d6d9102 service nova] Creating event network-vif-plugged:d47b1431-6e76-424f-a633-fedf675e1d79 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:01:04.131483 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-24fef31c-2686-4fcb-ba66-2e215688ec43 req-0a4514d0-0ed6-4862-9142-adca5d6d9102 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.121918 Aug 27 05:01:04.135318 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2607/5158] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:04.201424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bb4d03c-15fd-4616-9e5d-a95123f51671 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:04.202325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0bb4d03c-15fd-4616-9e5d-a95123f51671 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:04.205837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7c6b4d9c-42f9-434e-bf98-4892614d8b8f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:04.218584 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7c6b4d9c-42f9-434e-bf98-4892614d8b8f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1276 microversion: 2.1 time: 0.361053 Aug 27 05:01:04.220029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb4d03c-15fd-4616-9e5d-a95123f51671 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:04.220562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb4d03c-15fd-4616-9e5d-a95123f51671 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:04.221055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb4d03c-15fd-4616-9e5d-a95123f51671 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:04.221870 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2552/5159] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:03 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1276 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:04.222078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb4d03c-15fd-4616-9e5d-a95123f51671 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:04.222545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb4d03c-15fd-4616-9e5d-a95123f51671 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:04.222974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb4d03c-15fd-4616-9e5d-a95123f51671 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:04.528701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1256467c-7693-4142-9bec-be0b5260d722 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:04.529769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1256467c-7693-4142-9bec-be0b5260d722 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:04.564175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1256467c-7693-4142-9bec-be0b5260d722 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:04.571898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1256467c-7693-4142-9bec-be0b5260d722 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:04.576661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1256467c-7693-4142-9bec-be0b5260d722 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:04.578481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1256467c-7693-4142-9bec-be0b5260d722 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:04.581480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1256467c-7693-4142-9bec-be0b5260d722 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:04.583976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1256467c-7693-4142-9bec-be0b5260d722 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:05.065435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1256467c-7693-4142-9bec-be0b5260d722 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:05.096196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1256467c-7693-4142-9bec-be0b5260d722 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:05.096894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1256467c-7693-4142-9bec-be0b5260d722 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:05.101308 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1256467c-7693-4142-9bec-be0b5260d722 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.575997 Aug 27 05:01:05.103851 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2553/5160] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:04 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:05.123959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-86ee8a53-4d90-492c-9884-431010996805 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:05.125010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-86ee8a53-4d90-492c-9884-431010996805 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:05.126539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0bb4d03c-15fd-4616-9e5d-a95123f51671 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:05.136357 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0bb4d03c-15fd-4616-9e5d-a95123f51671 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1203 microversion: 2.1 time: 0.940344 Aug 27 05:01:05.137742 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2608/5161] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:04 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1203 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:05.138614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86ee8a53-4d90-492c-9884-431010996805 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:05.139477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86ee8a53-4d90-492c-9884-431010996805 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:05.139926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86ee8a53-4d90-492c-9884-431010996805 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:05.141282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86ee8a53-4d90-492c-9884-431010996805 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:05.141756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86ee8a53-4d90-492c-9884-431010996805 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:05.142184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86ee8a53-4d90-492c-9884-431010996805 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:05.144556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7cd51883-cf98-4759-91ef-6c8d19f8e96b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Action: 'create', calling method: .version_select at 0x7f1f218ecee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1522682117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0r4bNfsFtXxYTF3/Yon7AVgRCV4Z1Q021T9Y9DZL1RZ+u26nBD71oBcGoNAmD8udEKlps7Ka7bWJb6V//oazyRhYvQ4N/jvNZf6RuGE7F14i8uJtbM7E/xYHgLcJBw/g=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:05.165420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7cd51883-cf98-4759-91ef-6c8d19f8e96b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Getting quotas for project 85633ba41ad24104bbe326cae9b1cfdc. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:01:05.171656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7cd51883-cf98-4759-91ef-6c8d19f8e96b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Getting quotas for user 9a461972bdc04f17b181940db823dbe0 and project 85633ba41ad24104bbe326cae9b1cfdc. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:01:05.222413 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7cd51883-cf98-4759-91ef-6c8d19f8e96b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.082282 Aug 27 05:01:05.223235 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2609/5162] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:01:05 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:05.242705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-064f837f-7a05-4e96-a62a-3eab816e4ace tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:05.252853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-064f837f-7a05-4e96-a62a-3eab816e4ace tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:05.272849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-064f837f-7a05-4e96-a62a-3eab816e4ace tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:05.278862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-064f837f-7a05-4e96-a62a-3eab816e4ace tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:05.281532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-064f837f-7a05-4e96-a62a-3eab816e4ace tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:05.285218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-064f837f-7a05-4e96-a62a-3eab816e4ace tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:05.291523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-064f837f-7a05-4e96-a62a-3eab816e4ace tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:05.294973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-064f837f-7a05-4e96-a62a-3eab816e4ace tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:05.776650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-064f837f-7a05-4e96-a62a-3eab816e4ace tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:05.790483 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-064f837f-7a05-4e96-a62a-3eab816e4ace tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1318 microversion: 2.1 time: 0.552143 Aug 27 05:01:05.804428 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2610/5163] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:05 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:06.013349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-86ee8a53-4d90-492c-9884-431010996805 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:06.026335 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-86ee8a53-4d90-492c-9884-431010996805 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1361 microversion: 2.1 time: 0.917351 Aug 27 05:01:06.044850 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2554/5164] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:05 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1361 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:06.126788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-07d02c47-1e79-4944-9732-c9f498882967 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:06.127407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-07d02c47-1e79-4944-9732-c9f498882967 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:06.141041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d02c47-1e79-4944-9732-c9f498882967 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:06.142632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d02c47-1e79-4944-9732-c9f498882967 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:06.143098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d02c47-1e79-4944-9732-c9f498882967 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:06.145394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d02c47-1e79-4944-9732-c9f498882967 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:06.148998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d02c47-1e79-4944-9732-c9f498882967 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:06.149666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d02c47-1e79-4944-9732-c9f498882967 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:06.160960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9219d2b2-401d-4f92-93b8-2204708da24d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:06.162202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9219d2b2-401d-4f92-93b8-2204708da24d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:06.174881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9219d2b2-401d-4f92-93b8-2204708da24d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:06.175666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9219d2b2-401d-4f92-93b8-2204708da24d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:06.185175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9219d2b2-401d-4f92-93b8-2204708da24d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:06.191446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9219d2b2-401d-4f92-93b8-2204708da24d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:06.197016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9219d2b2-401d-4f92-93b8-2204708da24d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:06.198306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9219d2b2-401d-4f92-93b8-2204708da24d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:06.731358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9219d2b2-401d-4f92-93b8-2204708da24d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:06.741190 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9219d2b2-401d-4f92-93b8-2204708da24d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1203 microversion: 2.1 time: 0.584377 Aug 27 05:01:06.761874 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2555/5165] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:06 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1203 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:06.777741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-04ebb1cb-8f22-4cb0-ab42-3c65390d05ac req-7748516d-d005-4585-9a27-2ed90aabdfd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-plugged", "status": "completed", "tag": "8d4f958b-79cd-4a09-9322-87a1b16589ee"}, {"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-plugged", "status": "completed", "tag": "3a3619e3-dc35-4c97-b3a7-cdae4e3af733"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:06.782520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-07d02c47-1e79-4944-9732-c9f498882967 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:06.804309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-07d02c47-1e79-4944-9732-c9f498882967 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:06.814243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-07d02c47-1e79-4944-9732-c9f498882967 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:06.815871 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-07d02c47-1e79-4944-9732-c9f498882967 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.693527 Aug 27 05:01:06.821261 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2611/5166] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:06 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:06.827773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-04ebb1cb-8f22-4cb0-ab42-3c65390d05ac req-7748516d-d005-4585-9a27-2ed90aabdfd0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:06.828520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-04ebb1cb-8f22-4cb0-ab42-3c65390d05ac req-7748516d-d005-4585-9a27-2ed90aabdfd0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:06.831645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-04ebb1cb-8f22-4cb0-ab42-3c65390d05ac req-7748516d-d005-4585-9a27-2ed90aabdfd0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:06.837800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2802eb91-1ab5-47cc-8944-622fb8c143ff req-4360768f-a0d8-4b5b-b48b-af8bd8dba06c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f03f20-94d9-43e9-b017-6e850da180b4", "tag": "a0dee1a3-649f-441e-bf2f-f1754f49e03d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:06.871583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2802eb91-1ab5-47cc-8944-622fb8c143ff req-4360768f-a0d8-4b5b-b48b-af8bd8dba06c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:06.872816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2802eb91-1ab5-47cc-8944-622fb8c143ff req-4360768f-a0d8-4b5b-b48b-af8bd8dba06c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:06.873842 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-04ebb1cb-8f22-4cb0-ab42-3c65390d05ac req-7748516d-d005-4585-9a27-2ed90aabdfd0 service nova] Creating event network-vif-plugged:8d4f958b-79cd-4a09-9322-87a1b16589ee for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:01:06.876058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2802eb91-1ab5-47cc-8944-622fb8c143ff req-4360768f-a0d8-4b5b-b48b-af8bd8dba06c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:06.876704 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-04ebb1cb-8f22-4cb0-ab42-3c65390d05ac req-7748516d-d005-4585-9a27-2ed90aabdfd0 service nova] Creating event network-vif-plugged:3a3619e3-dc35-4c97-b3a7-cdae4e3af733 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:01:06.900651 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-04ebb1cb-8f22-4cb0-ab42-3c65390d05ac req-7748516d-d005-4585-9a27-2ed90aabdfd0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.134117 Aug 27 05:01:06.903279 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2556/5167] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:06.909137 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2802eb91-1ab5-47cc-8944-622fb8c143ff req-4360768f-a0d8-4b5b-b48b-af8bd8dba06c service nova] Creating event network-changed:a0dee1a3-649f-441e-bf2f-f1754f49e03d for instance 41f03f20-94d9-43e9-b017-6e850da180b4 on n-h1-854823-1 Aug 27 05:01:06.921672 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2802eb91-1ab5-47cc-8944-622fb8c143ff req-4360768f-a0d8-4b5b-b48b-af8bd8dba06c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098496 Aug 27 05:01:06.921984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53e3a1f1-69a2-4cc7-99cc-3b3005da8062 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:06.926084 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2612/5168] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:06.928699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-53e3a1f1-69a2-4cc7-99cc-3b3005da8062 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:06.954742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53e3a1f1-69a2-4cc7-99cc-3b3005da8062 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:06.955344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53e3a1f1-69a2-4cc7-99cc-3b3005da8062 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:06.955819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53e3a1f1-69a2-4cc7-99cc-3b3005da8062 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:06.956680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53e3a1f1-69a2-4cc7-99cc-3b3005da8062 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:06.957036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53e3a1f1-69a2-4cc7-99cc-3b3005da8062 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:06.957462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53e3a1f1-69a2-4cc7-99cc-3b3005da8062 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:07.053733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5f660c0-0e5d-47ab-a0fa-8421afdb0e54 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:07.054679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d5f660c0-0e5d-47ab-a0fa-8421afdb0e54 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:07.075800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5f660c0-0e5d-47ab-a0fa-8421afdb0e54 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:07.076370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5f660c0-0e5d-47ab-a0fa-8421afdb0e54 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:07.079902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5f660c0-0e5d-47ab-a0fa-8421afdb0e54 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:07.084813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5f660c0-0e5d-47ab-a0fa-8421afdb0e54 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:07.085401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5f660c0-0e5d-47ab-a0fa-8421afdb0e54 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:07.088776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5f660c0-0e5d-47ab-a0fa-8421afdb0e54 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:07.434985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d5f660c0-0e5d-47ab-a0fa-8421afdb0e54 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:07.452274 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5f660c0-0e5d-47ab-a0fa-8421afdb0e54 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1361 microversion: 2.1 time: 0.403930 Aug 27 05:01:07.464408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-53e3a1f1-69a2-4cc7-99cc-3b3005da8062 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:07.471852 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2613/5169] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:07 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1361 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:07.475412 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-53e3a1f1-69a2-4cc7-99cc-3b3005da8062 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1318 microversion: 2.1 time: 0.570433 Aug 27 05:01:07.476638 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2557/5170] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:06 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:07.573180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26484663-69cf-411a-9830-937bc05f6e76 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:07.573743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26484663-69cf-411a-9830-937bc05f6e76 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:07.582192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26484663-69cf-411a-9830-937bc05f6e76 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:07.583744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26484663-69cf-411a-9830-937bc05f6e76 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:07.584416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26484663-69cf-411a-9830-937bc05f6e76 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:07.585382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26484663-69cf-411a-9830-937bc05f6e76 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:07.585945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26484663-69cf-411a-9830-937bc05f6e76 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:07.586607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26484663-69cf-411a-9830-937bc05f6e76 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:07.616369 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26484663-69cf-411a-9830-937bc05f6e76 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/ips" status: 200 len: 151 microversion: 2.20 time: 0.052269 Aug 27 05:01:07.617334 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2614/5171] 10.222.0.79 () {60 vars in 1289 bytes} [Sat Aug 27 05:01:07 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 05:01:07.766123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8eef54d2-ac6a-4ed2-bf47-3aaa6ce51a37 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:07.766775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8eef54d2-ac6a-4ed2-bf47-3aaa6ce51a37 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:07.773317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8eef54d2-ac6a-4ed2-bf47-3aaa6ce51a37 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:07.774172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8eef54d2-ac6a-4ed2-bf47-3aaa6ce51a37 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:07.774773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8eef54d2-ac6a-4ed2-bf47-3aaa6ce51a37 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:07.775656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8eef54d2-ac6a-4ed2-bf47-3aaa6ce51a37 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:07.776271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8eef54d2-ac6a-4ed2-bf47-3aaa6ce51a37 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:07.776885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8eef54d2-ac6a-4ed2-bf47-3aaa6ce51a37 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:07.849222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d33b562-158a-4670-a7b2-3dfacf02d760 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:07.850104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3d33b562-158a-4670-a7b2-3dfacf02d760 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:07.861792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d33b562-158a-4670-a7b2-3dfacf02d760 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:07.862294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d33b562-158a-4670-a7b2-3dfacf02d760 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:07.864736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d33b562-158a-4670-a7b2-3dfacf02d760 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:07.864736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d33b562-158a-4670-a7b2-3dfacf02d760 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:07.864736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d33b562-158a-4670-a7b2-3dfacf02d760 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:07.865215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d33b562-158a-4670-a7b2-3dfacf02d760 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:08.011392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8eef54d2-ac6a-4ed2-bf47-3aaa6ce51a37 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:08.021877 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8eef54d2-ac6a-4ed2-bf47-3aaa6ce51a37 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1203 microversion: 2.1 time: 0.259649 Aug 27 05:01:08.022477 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2558/5172] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:07 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1203 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:08.187037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1148526124", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "daacd0b4-68ba-4fc6-a2eb-5fe934cca455"}], "key_name": "tempest-TestNetworkBasicOps-1522682117", "security_groups": [{"name": "tempest-secgroup-smoke-835621618"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:08.207356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d33b562-158a-4670-a7b2-3dfacf02d760 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:08.241145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d33b562-158a-4670-a7b2-3dfacf02d760 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:08.242890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d33b562-158a-4670-a7b2-3dfacf02d760 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:08.244226 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d33b562-158a-4670-a7b2-3dfacf02d760 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.399328 Aug 27 05:01:08.244903 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2615/5173] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:07 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:08.331230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] validate_networks() for [('daacd0b4-68ba-4fc6-a2eb-5fe934cca455', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:01:08.480091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-482dd5b3-84dd-4df5-bdca-0a7357897aa5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:08.481869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-482dd5b3-84dd-4df5-bdca-0a7357897aa5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:08.489173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-482dd5b3-84dd-4df5-bdca-0a7357897aa5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:08.489677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-482dd5b3-84dd-4df5-bdca-0a7357897aa5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:08.490120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-482dd5b3-84dd-4df5-bdca-0a7357897aa5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:08.490836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-482dd5b3-84dd-4df5-bdca-0a7357897aa5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:08.491603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-482dd5b3-84dd-4df5-bdca-0a7357897aa5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:08.492720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-482dd5b3-84dd-4df5-bdca-0a7357897aa5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:08.764848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:01:08.765332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:01:08.765736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:01:08.766149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:01:08.766563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:01:08.781504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:08.785935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:08.786969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:08.788517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:08.792694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:08.793355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:08.836225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Getting quotas for project 85633ba41ad24104bbe326cae9b1cfdc. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:01:08.845445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Getting quotas for user 9a461972bdc04f17b181940db823dbe0 and project 85633ba41ad24104bbe326cae9b1cfdc. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:01:08.883958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:01:08.889660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:01:09.005747 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fd4abc96-19cc-4ba0-b2dc-4689a0821060 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.822449 Aug 27 05:01:09.012912 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2559/5174] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:01:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:01:09.017378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6c238f04-df21-4616-8321-a6c9487f84f9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:09.023108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6c238f04-df21-4616-8321-a6c9487f84f9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:09.038366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c238f04-df21-4616-8321-a6c9487f84f9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:09.038874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c238f04-df21-4616-8321-a6c9487f84f9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:09.042267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c238f04-df21-4616-8321-a6c9487f84f9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:09.043384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c238f04-df21-4616-8321-a6c9487f84f9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:09.043867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c238f04-df21-4616-8321-a6c9487f84f9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:09.044307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c238f04-df21-4616-8321-a6c9487f84f9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:09.091556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-482dd5b3-84dd-4df5-bdca-0a7357897aa5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.101583 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-482dd5b3-84dd-4df5-bdca-0a7357897aa5 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1361 microversion: 2.1 time: 0.625400 Aug 27 05:01:09.109101 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2616/5175] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:08 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1361 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:09.119551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e87db604-f31e-4798-a81b-06cd1bca6dc3 req-2c43cdf3-dede-49ab-bbff-858887945c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-plugged", "status": "completed", "tag": "adaea27e-c6f4-4ae6-8f05-708c4fc87dfb"}, {"server_uuid": "dc3ca3f0-178f-48ad-a92d-81f2285abf64", "name": "network-vif-plugged", "status": "completed", "tag": "fbc1d9ef-c67e-4481-bf0a-b2732263a4fd"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:09.146064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e87db604-f31e-4798-a81b-06cd1bca6dc3 req-2c43cdf3-dede-49ab-bbff-858887945c0e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:09.146564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e87db604-f31e-4798-a81b-06cd1bca6dc3 req-2c43cdf3-dede-49ab-bbff-858887945c0e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:09.147005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e87db604-f31e-4798-a81b-06cd1bca6dc3 req-2c43cdf3-dede-49ab-bbff-858887945c0e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:09.186849 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e87db604-f31e-4798-a81b-06cd1bca6dc3 req-2c43cdf3-dede-49ab-bbff-858887945c0e service nova] Creating event network-vif-plugged:adaea27e-c6f4-4ae6-8f05-708c4fc87dfb for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:01:09.187584 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e87db604-f31e-4798-a81b-06cd1bca6dc3 req-2c43cdf3-dede-49ab-bbff-858887945c0e service nova] Creating event network-vif-plugged:fbc1d9ef-c67e-4481-bf0a-b2732263a4fd for instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 on n-h2-854823-1 Aug 27 05:01:09.205337 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e87db604-f31e-4798-a81b-06cd1bca6dc3 req-2c43cdf3-dede-49ab-bbff-858887945c0e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089951 Aug 27 05:01:09.206785 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2617/5176] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:09.227282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-736baae9-2d7a-4836-b40e-4dc3350797ad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:09.228009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-736baae9-2d7a-4836-b40e-4dc3350797ad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:09.332157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6c238f04-df21-4616-8321-a6c9487f84f9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.349844 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6c238f04-df21-4616-8321-a6c9487f84f9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1318 microversion: 2.1 time: 0.337221 Aug 27 05:01:09.361176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-736baae9-2d7a-4836-b40e-4dc3350797ad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.366110 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2560/5177] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:09 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:09.369808 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-736baae9-2d7a-4836-b40e-4dc3350797ad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1249 microversion: 2.1 time: 0.155215 Aug 27 05:01:09.371995 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2618/5178] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:09 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1249 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:09.383796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b467315-bea8-4fe5-b12b-8c79c53a8a0d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:09.385235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b467315-bea8-4fe5-b12b-8c79c53a8a0d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:09.386135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8ff2cef0-3605-4490-97af-3148520795fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:09.387205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8ff2cef0-3605-4490-97af-3148520795fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:09.401312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ff2cef0-3605-4490-97af-3148520795fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:09.401982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ff2cef0-3605-4490-97af-3148520795fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:09.402613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ff2cef0-3605-4490-97af-3148520795fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:09.403559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ff2cef0-3605-4490-97af-3148520795fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:09.405018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ff2cef0-3605-4490-97af-3148520795fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:09.406360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ff2cef0-3605-4490-97af-3148520795fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:09.406517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b467315-bea8-4fe5-b12b-8c79c53a8a0d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:09.407065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b467315-bea8-4fe5-b12b-8c79c53a8a0d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:09.407709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b467315-bea8-4fe5-b12b-8c79c53a8a0d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:09.410244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b467315-bea8-4fe5-b12b-8c79c53a8a0d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:09.411099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b467315-bea8-4fe5-b12b-8c79c53a8a0d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:09.415164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b467315-bea8-4fe5-b12b-8c79c53a8a0d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:09.727301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ff2cef0-3605-4490-97af-3148520795fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.740308 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8ff2cef0-3605-4490-97af-3148520795fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1203 microversion: 2.1 time: 0.370126 Aug 27 05:01:09.742040 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2561/5179] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:09 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1203 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:09.744016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b467315-bea8-4fe5-b12b-8c79c53a8a0d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.756212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b467315-bea8-4fe5-b12b-8c79c53a8a0d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.757805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b467315-bea8-4fe5-b12b-8c79c53a8a0d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:09.759836 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b467315-bea8-4fe5-b12b-8c79c53a8a0d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.385360 Aug 27 05:01:09.761212 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2619/5180] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:09 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:10.123662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7cd046f9-48b7-44e1-bcac-697773982172 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:10.124185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7cd046f9-48b7-44e1-bcac-697773982172 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:10.133748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cd046f9-48b7-44e1-bcac-697773982172 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.134354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cd046f9-48b7-44e1-bcac-697773982172 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.134799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cd046f9-48b7-44e1-bcac-697773982172 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.135498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cd046f9-48b7-44e1-bcac-697773982172 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.135952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cd046f9-48b7-44e1-bcac-697773982172 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.136377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7cd046f9-48b7-44e1-bcac-697773982172 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.371525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff8000e9-0e69-4ac9-b682-15a68f2281c5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:10.372702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ff8000e9-0e69-4ac9-b682-15a68f2281c5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:10.384408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff8000e9-0e69-4ac9-b682-15a68f2281c5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.385375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff8000e9-0e69-4ac9-b682-15a68f2281c5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.385993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff8000e9-0e69-4ac9-b682-15a68f2281c5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.387609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff8000e9-0e69-4ac9-b682-15a68f2281c5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.389212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff8000e9-0e69-4ac9-b682-15a68f2281c5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.391230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff8000e9-0e69-4ac9-b682-15a68f2281c5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.434705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7cd046f9-48b7-44e1-bcac-697773982172 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:10.443810 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7cd046f9-48b7-44e1-bcac-697773982172 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1361 microversion: 2.1 time: 0.324007 Aug 27 05:01:10.450909 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2562/5181] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:10 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1361 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:10.464351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6af203be-0e83-4a7c-9b94-263809f30f5b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:10.465124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6af203be-0e83-4a7c-9b94-263809f30f5b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:10.488896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6af203be-0e83-4a7c-9b94-263809f30f5b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.495108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6af203be-0e83-4a7c-9b94-263809f30f5b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.495826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6af203be-0e83-4a7c-9b94-263809f30f5b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.497079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6af203be-0e83-4a7c-9b94-263809f30f5b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.498061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6af203be-0e83-4a7c-9b94-263809f30f5b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.500309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6af203be-0e83-4a7c-9b94-263809f30f5b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.610051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ff8000e9-0e69-4ac9-b682-15a68f2281c5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:10.622396 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff8000e9-0e69-4ac9-b682-15a68f2281c5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1318 microversion: 2.1 time: 0.253499 Aug 27 05:01:10.624583 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2620/5182] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:10 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:10.660319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6af203be-0e83-4a7c-9b94-263809f30f5b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:10.669002 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6af203be-0e83-4a7c-9b94-263809f30f5b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1253 microversion: 2.1 time: 0.216634 Aug 27 05:01:10.669594 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2563/5183] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:10 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1253 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:10.763002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-930938e8-8904-4442-87bd-93890c0e1d7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:10.763926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-930938e8-8904-4442-87bd-93890c0e1d7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:10.771426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-930938e8-8904-4442-87bd-93890c0e1d7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.772083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-930938e8-8904-4442-87bd-93890c0e1d7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.772660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-930938e8-8904-4442-87bd-93890c0e1d7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.773634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-930938e8-8904-4442-87bd-93890c0e1d7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.774940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-930938e8-8904-4442-87bd-93890c0e1d7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.775492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-930938e8-8904-4442-87bd-93890c0e1d7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.789486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-851ba701-8d6e-4a40-9b1b-bc7cf0f8121e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:10.790363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-851ba701-8d6e-4a40-9b1b-bc7cf0f8121e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:10.797764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-851ba701-8d6e-4a40-9b1b-bc7cf0f8121e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.798659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-851ba701-8d6e-4a40-9b1b-bc7cf0f8121e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.799373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-851ba701-8d6e-4a40-9b1b-bc7cf0f8121e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.800096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-851ba701-8d6e-4a40-9b1b-bc7cf0f8121e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:10.800581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-851ba701-8d6e-4a40-9b1b-bc7cf0f8121e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:10.801098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-851ba701-8d6e-4a40-9b1b-bc7cf0f8121e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:10.972191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-930938e8-8904-4442-87bd-93890c0e1d7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:10.982552 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-930938e8-8904-4442-87bd-93890c0e1d7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1203 microversion: 2.1 time: 0.223314 Aug 27 05:01:11.000300 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2621/5184] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:10 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1203 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:11.006025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f40470dd-7add-4149-a35e-28f8b18e4c01 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:11.016557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f40470dd-7add-4149-a35e-28f8b18e4c01 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:11.027259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f40470dd-7add-4149-a35e-28f8b18e4c01 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.032518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f40470dd-7add-4149-a35e-28f8b18e4c01 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.033228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f40470dd-7add-4149-a35e-28f8b18e4c01 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.034131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f40470dd-7add-4149-a35e-28f8b18e4c01 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.034758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f40470dd-7add-4149-a35e-28f8b18e4c01 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.035345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f40470dd-7add-4149-a35e-28f8b18e4c01 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.052266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-851ba701-8d6e-4a40-9b1b-bc7cf0f8121e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:11.066593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:11.066979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-851ba701-8d6e-4a40-9b1b-bc7cf0f8121e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:11.069939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-851ba701-8d6e-4a40-9b1b-bc7cf0f8121e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:11.071638 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-851ba701-8d6e-4a40-9b1b-bc7cf0f8121e tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1874 microversion: 2.42 time: 0.287590 Aug 27 05:01:11.075131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-f40470dd-7add-4149-a35e-28f8b18e4c01 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lazy-loading 'flavor' on Instance uuid 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:01:11.079011 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2564/5185] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:10 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1874 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:11.263094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8108fd18-8212-4f53-aebe-71fbba4b6e3d req-e83ae686-360b-415a-9d68-3e44c789a246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61deb16-51e0-4d32-b077-0f1808a1f525", "name": "network-vif-plugged", "status": "completed", "tag": "cc200f87-b6f5-486b-914d-1b4a92915b90"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:11.283743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8108fd18-8212-4f53-aebe-71fbba4b6e3d req-e83ae686-360b-415a-9d68-3e44c789a246 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.288132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8108fd18-8212-4f53-aebe-71fbba4b6e3d req-e83ae686-360b-415a-9d68-3e44c789a246 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.288661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8108fd18-8212-4f53-aebe-71fbba4b6e3d req-e83ae686-360b-415a-9d68-3e44c789a246 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.329307 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8108fd18-8212-4f53-aebe-71fbba4b6e3d req-e83ae686-360b-415a-9d68-3e44c789a246 service nova] Creating event network-vif-plugged:cc200f87-b6f5-486b-914d-1b4a92915b90 for instance c61deb16-51e0-4d32-b077-0f1808a1f525 on n-h1-854823-1 Aug 27 05:01:11.342631 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8108fd18-8212-4f53-aebe-71fbba4b6e3d req-e83ae686-360b-415a-9d68-3e44c789a246 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083464 Aug 27 05:01:11.343861 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2565/5186] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:11.374935 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f40470dd-7add-4149-a35e-28f8b18e4c01 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "POST /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/action" status: 202 len: 0 microversion: 2.20 time: 0.372629 Aug 27 05:01:11.376154 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2622/5187] 10.222.0.79 () {62 vars in 1319 bytes} [Sat Aug 27 05:01:11 2022] POST /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:01:11.387392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-02b0331d-a3db-4ddf-8f7f-369d974b2214 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:11.388108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-02b0331d-a3db-4ddf-8f7f-369d974b2214 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:11.394894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02b0331d-a3db-4ddf-8f7f-369d974b2214 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.396583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02b0331d-a3db-4ddf-8f7f-369d974b2214 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.397459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02b0331d-a3db-4ddf-8f7f-369d974b2214 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.399128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02b0331d-a3db-4ddf-8f7f-369d974b2214 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.400049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02b0331d-a3db-4ddf-8f7f-369d974b2214 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.401123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02b0331d-a3db-4ddf-8f7f-369d974b2214 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.477080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a92e1869-defe-43d6-a4e4-44fbe0e955c1 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:11.478185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a92e1869-defe-43d6-a4e4-44fbe0e955c1 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:11.504180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a92e1869-defe-43d6-a4e4-44fbe0e955c1 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.506716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a92e1869-defe-43d6-a4e4-44fbe0e955c1 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.508254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a92e1869-defe-43d6-a4e4-44fbe0e955c1 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.510241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a92e1869-defe-43d6-a4e4-44fbe0e955c1 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.511201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a92e1869-defe-43d6-a4e4-44fbe0e955c1 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.511834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a92e1869-defe-43d6-a4e4-44fbe0e955c1 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.685973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-02b0331d-a3db-4ddf-8f7f-369d974b2214 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:11.694634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a92e1869-defe-43d6-a4e4-44fbe0e955c1 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:11.696178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-02b0331d-a3db-4ddf-8f7f-369d974b2214 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:11.697678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-02b0331d-a3db-4ddf-8f7f-369d974b2214 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:11.698879 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-02b0331d-a3db-4ddf-8f7f-369d974b2214 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.316636 Aug 27 05:01:11.699450 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2566/5188] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:11 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:11.704497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-092b1072-9428-4ced-af7c-936d57c08971 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:11.706776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-092b1072-9428-4ced-af7c-936d57c08971 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:11.713387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-092b1072-9428-4ced-af7c-936d57c08971 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.713880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-092b1072-9428-4ced-af7c-936d57c08971 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.714317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-092b1072-9428-4ced-af7c-936d57c08971 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.715021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-092b1072-9428-4ced-af7c-936d57c08971 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.715477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-092b1072-9428-4ced-af7c-936d57c08971 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.716191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-092b1072-9428-4ced-af7c-936d57c08971 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.716381 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a92e1869-defe-43d6-a4e4-44fbe0e955c1 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1546 microversion: 2.1 time: 0.253210 Aug 27 05:01:11.717204 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2623/5189] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:11 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1546 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:11.722606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0761e4f-12a6-446e-bffd-84ff34340506 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:11.723341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a0761e4f-12a6-446e-bffd-84ff34340506 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:11.730494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0761e4f-12a6-446e-bffd-84ff34340506 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.731213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0761e4f-12a6-446e-bffd-84ff34340506 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.731656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0761e4f-12a6-446e-bffd-84ff34340506 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.732558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0761e4f-12a6-446e-bffd-84ff34340506 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.733182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0761e4f-12a6-446e-bffd-84ff34340506 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.733789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0761e4f-12a6-446e-bffd-84ff34340506 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.871161 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-092b1072-9428-4ced-af7c-936d57c08971 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e/action" status: 200 len: 24571 microversion: 2.1 time: 0.170171 Aug 27 05:01:11.873037 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2567/5190] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:01:11 2022] POST /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e/action => generated 24571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:01:11.893562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2ae56e88-6c3f-4814-9df9-35940781609b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:11.894423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2ae56e88-6c3f-4814-9df9-35940781609b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:11.894936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a0761e4f-12a6-446e-bffd-84ff34340506 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:11.904498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ae56e88-6c3f-4814-9df9-35940781609b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.905177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ae56e88-6c3f-4814-9df9-35940781609b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.905721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ae56e88-6c3f-4814-9df9-35940781609b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.906586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ae56e88-6c3f-4814-9df9-35940781609b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.907151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ae56e88-6c3f-4814-9df9-35940781609b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.907683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ae56e88-6c3f-4814-9df9-35940781609b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.914305 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0761e4f-12a6-446e-bffd-84ff34340506 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1318 microversion: 2.1 time: 0.196140 Aug 27 05:01:11.916376 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2624/5191] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:11 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:11.923902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b46d3985-1857-4b89-9c28-707a8d1cd638 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:11.924424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b46d3985-1857-4b89-9c28-707a8d1cd638 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:11.948246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b46d3985-1857-4b89-9c28-707a8d1cd638 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.948810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b46d3985-1857-4b89-9c28-707a8d1cd638 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.949265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b46d3985-1857-4b89-9c28-707a8d1cd638 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.950675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b46d3985-1857-4b89-9c28-707a8d1cd638 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:11.951153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b46d3985-1857-4b89-9c28-707a8d1cd638 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:11.953292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b46d3985-1857-4b89-9c28-707a8d1cd638 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:11.993718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2ae56e88-6c3f-4814-9df9-35940781609b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:12.005228 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2ae56e88-6c3f-4814-9df9-35940781609b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1301 microversion: 2.1 time: 0.119280 Aug 27 05:01:12.005962 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2568/5192] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:11 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1301 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:12.036895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0a3fd84b-8c9a-4ccc-ad53-c5885b013f0a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:12.046498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0a3fd84b-8c9a-4ccc-ad53-c5885b013f0a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:12.058265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a3fd84b-8c9a-4ccc-ad53-c5885b013f0a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:12.059418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a3fd84b-8c9a-4ccc-ad53-c5885b013f0a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:12.059962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a3fd84b-8c9a-4ccc-ad53-c5885b013f0a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:12.060808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a3fd84b-8c9a-4ccc-ad53-c5885b013f0a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:12.061541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a3fd84b-8c9a-4ccc-ad53-c5885b013f0a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:12.062072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a3fd84b-8c9a-4ccc-ad53-c5885b013f0a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:12.110356 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b46d3985-1857-4b89-9c28-707a8d1cd638 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.192623 Aug 27 05:01:12.117674 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2625/5193] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 05:01:11 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-interface => generated 284 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:12.121045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7a6866a-3c19-429b-ba07-553b07b7a0a6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:12.121681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7a6866a-3c19-429b-ba07-553b07b7a0a6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:12.129225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a6866a-3c19-429b-ba07-553b07b7a0a6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:12.131738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a6866a-3c19-429b-ba07-553b07b7a0a6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:12.132732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a6866a-3c19-429b-ba07-553b07b7a0a6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:12.133571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a6866a-3c19-429b-ba07-553b07b7a0a6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:12.133940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a6866a-3c19-429b-ba07-553b07b7a0a6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:12.134375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a6866a-3c19-429b-ba07-553b07b7a0a6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:12.449025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7a6866a-3c19-429b-ba07-553b07b7a0a6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:12.462134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7a6866a-3c19-429b-ba07-553b07b7a0a6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:12.464246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7a6866a-3c19-429b-ba07-553b07b7a0a6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:12.465692 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7a6866a-3c19-429b-ba07-553b07b7a0a6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 2829 microversion: 2.42 time: 0.352829 Aug 27 05:01:12.466669 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2626/5194] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:12 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 2829 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:12.491722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e30c39d4-44c8-47cc-97f9-bde485570467 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:12.492240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e30c39d4-44c8-47cc-97f9-bde485570467 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:12.500047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30c39d4-44c8-47cc-97f9-bde485570467 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:12.501469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30c39d4-44c8-47cc-97f9-bde485570467 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:12.501933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30c39d4-44c8-47cc-97f9-bde485570467 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:12.502723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30c39d4-44c8-47cc-97f9-bde485570467 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:12.503191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30c39d4-44c8-47cc-97f9-bde485570467 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:12.503626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30c39d4-44c8-47cc-97f9-bde485570467 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:12.652160 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e30c39d4-44c8-47cc-97f9-bde485570467 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.165066 Aug 27 05:01:12.653221 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2627/5195] 10.222.0.79 () {60 vars in 1316 bytes} [Sat Aug 27 05:01:12 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64/os-interface => generated 1830 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:12.725151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f144369-6df6-4ea5-9272-2f32b6d12a66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:12.725786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f144369-6df6-4ea5-9272-2f32b6d12a66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:12.741958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f144369-6df6-4ea5-9272-2f32b6d12a66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:12.742463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f144369-6df6-4ea5-9272-2f32b6d12a66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:12.742906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f144369-6df6-4ea5-9272-2f32b6d12a66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:12.743629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f144369-6df6-4ea5-9272-2f32b6d12a66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:12.744096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f144369-6df6-4ea5-9272-2f32b6d12a66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:12.744523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f144369-6df6-4ea5-9272-2f32b6d12a66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:12.882878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0a3fd84b-8c9a-4ccc-ad53-c5885b013f0a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:12.891010 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0a3fd84b-8c9a-4ccc-ad53-c5885b013f0a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1203 microversion: 2.1 time: 0.871167 Aug 27 05:01:12.891686 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2569/5196] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:12 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1203 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:12.936895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0dd05286-3328-45ed-8b5a-2d41670df1df tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:12.937704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0dd05286-3328-45ed-8b5a-2d41670df1df tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:12.943958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0dd05286-3328-45ed-8b5a-2d41670df1df tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:12.944611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0dd05286-3328-45ed-8b5a-2d41670df1df tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:12.945147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0dd05286-3328-45ed-8b5a-2d41670df1df tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:12.947092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0dd05286-3328-45ed-8b5a-2d41670df1df tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:12.947705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0dd05286-3328-45ed-8b5a-2d41670df1df tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:12.948230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0dd05286-3328-45ed-8b5a-2d41670df1df tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:12.954496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:13.026169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f144369-6df6-4ea5-9272-2f32b6d12a66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:13.039902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f144369-6df6-4ea5-9272-2f32b6d12a66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:13.042402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f144369-6df6-4ea5-9272-2f32b6d12a66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:13.046197 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f144369-6df6-4ea5-9272-2f32b6d12a66 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.327074 Aug 27 05:01:13.050030 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2628/5197] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:12 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:13.055711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81d5f857-b052-43e6-a25c-f41c34ac4dc0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:13.056560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-81d5f857-b052-43e6-a25c-f41c34ac4dc0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:13.082245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d5f857-b052-43e6-a25c-f41c34ac4dc0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:13.083084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d5f857-b052-43e6-a25c-f41c34ac4dc0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:13.083735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d5f857-b052-43e6-a25c-f41c34ac4dc0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:13.084670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d5f857-b052-43e6-a25c-f41c34ac4dc0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:13.085334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d5f857-b052-43e6-a25c-f41c34ac4dc0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:13.085808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d5f857-b052-43e6-a25c-f41c34ac4dc0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:13.213554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-81d5f857-b052-43e6-a25c-f41c34ac4dc0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:13.224267 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-81d5f857-b052-43e6-a25c-f41c34ac4dc0 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1307 microversion: 2.1 time: 0.172715 Aug 27 05:01:13.225662 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2629/5198] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:13 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:13.426589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-05b0f3b8-c01d-42a6-bee5-d25f38472e79 req-53f31c18-6711-466c-90c5-1e38a3efd526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f03f20-94d9-43e9-b017-6e850da180b4", "name": "network-vif-plugged", "status": "completed", "tag": "a0dee1a3-649f-441e-bf2f-f1754f49e03d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:13.440059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-05b0f3b8-c01d-42a6-bee5-d25f38472e79 req-53f31c18-6711-466c-90c5-1e38a3efd526 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:13.448267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-05b0f3b8-c01d-42a6-bee5-d25f38472e79 req-53f31c18-6711-466c-90c5-1e38a3efd526 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:13.450182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-05b0f3b8-c01d-42a6-bee5-d25f38472e79 req-53f31c18-6711-466c-90c5-1e38a3efd526 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:13.492841 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-05b0f3b8-c01d-42a6-bee5-d25f38472e79 req-53f31c18-6711-466c-90c5-1e38a3efd526 service nova] Creating event network-vif-plugged:a0dee1a3-649f-441e-bf2f-f1754f49e03d for instance 41f03f20-94d9-43e9-b017-6e850da180b4 on n-h1-854823-1 Aug 27 05:01:13.509823 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-05b0f3b8-c01d-42a6-bee5-d25f38472e79 req-53f31c18-6711-466c-90c5-1e38a3efd526 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090814 Aug 27 05:01:13.510724 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2630/5199] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:01:13.878805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0dd05286-3328-45ed-8b5a-2d41670df1df tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:13.887817 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0dd05286-3328-45ed-8b5a-2d41670df1df tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1318 microversion: 2.1 time: 0.955041 Aug 27 05:01:13.898402 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2570/5200] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:12 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1318 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:13.913334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a030a847-425c-48ab-b91a-ae2da709d1ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:13.914531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a030a847-425c-48ab-b91a-ae2da709d1ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:13.921349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a030a847-425c-48ab-b91a-ae2da709d1ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:13.922296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a030a847-425c-48ab-b91a-ae2da709d1ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:13.922894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a030a847-425c-48ab-b91a-ae2da709d1ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:13.923783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a030a847-425c-48ab-b91a-ae2da709d1ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:13.924675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a030a847-425c-48ab-b91a-ae2da709d1ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:13.925289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a030a847-425c-48ab-b91a-ae2da709d1ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.078733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6224eb8c-dd2c-474d-881e-f1346acb260b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:14.079620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6224eb8c-dd2c-474d-881e-f1346acb260b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:14.092159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6224eb8c-dd2c-474d-881e-f1346acb260b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.093103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6224eb8c-dd2c-474d-881e-f1346acb260b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.094811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6224eb8c-dd2c-474d-881e-f1346acb260b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.095716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6224eb8c-dd2c-474d-881e-f1346acb260b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.097129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6224eb8c-dd2c-474d-881e-f1346acb260b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.098025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6224eb8c-dd2c-474d-881e-f1346acb260b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.141014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a030a847-425c-48ab-b91a-ae2da709d1ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:14.150831 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a030a847-425c-48ab-b91a-ae2da709d1ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1391 microversion: 2.1 time: 0.243175 Aug 27 05:01:14.151435 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2631/5201] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:13 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1391 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:14.176302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab7c6718-ab68-42af-8f46-7c3afe5aad4e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:14.177246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab7c6718-ab68-42af-8f46-7c3afe5aad4e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:14.183669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab7c6718-ab68-42af-8f46-7c3afe5aad4e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.184416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab7c6718-ab68-42af-8f46-7c3afe5aad4e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.185042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab7c6718-ab68-42af-8f46-7c3afe5aad4e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.186080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab7c6718-ab68-42af-8f46-7c3afe5aad4e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.186716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab7c6718-ab68-42af-8f46-7c3afe5aad4e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.187312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab7c6718-ab68-42af-8f46-7c3afe5aad4e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.393688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6224eb8c-dd2c-474d-881e-f1346acb260b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:14.408798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6224eb8c-dd2c-474d-881e-f1346acb260b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:14.410237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6224eb8c-dd2c-474d-881e-f1346acb260b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:14.411471 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6224eb8c-dd2c-474d-881e-f1346acb260b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.338379 Aug 27 05:01:14.421264 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2571/5202] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:14 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:14.426297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2502e135-9ece-4284-9f6d-78f97beaea26 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:14.427432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2502e135-9ece-4284-9f6d-78f97beaea26 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:14.449411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab7c6718-ab68-42af-8f46-7c3afe5aad4e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:14.453921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2502e135-9ece-4284-9f6d-78f97beaea26 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.455569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2502e135-9ece-4284-9f6d-78f97beaea26 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.457370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2502e135-9ece-4284-9f6d-78f97beaea26 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.458151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2502e135-9ece-4284-9f6d-78f97beaea26 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.459767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2502e135-9ece-4284-9f6d-78f97beaea26 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.461012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2502e135-9ece-4284-9f6d-78f97beaea26 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.464406 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab7c6718-ab68-42af-8f46-7c3afe5aad4e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1391 microversion: 2.1 time: 0.291857 Aug 27 05:01:14.465786 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2632/5203] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:14 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1391 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:14.473247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7437e312-a978-4f50-9d1a-4cb89f08947e req-047e17e3-51f9-4c5a-8af5-c56cb678ecdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "tag": "8d4f958b-79cd-4a09-9322-87a1b16589ee"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:14.484209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7437e312-a978-4f50-9d1a-4cb89f08947e req-047e17e3-51f9-4c5a-8af5-c56cb678ecdd service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.485174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7437e312-a978-4f50-9d1a-4cb89f08947e req-047e17e3-51f9-4c5a-8af5-c56cb678ecdd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.485790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7437e312-a978-4f50-9d1a-4cb89f08947e req-047e17e3-51f9-4c5a-8af5-c56cb678ecdd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.504490 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7437e312-a978-4f50-9d1a-4cb89f08947e req-047e17e3-51f9-4c5a-8af5-c56cb678ecdd service nova] Creating event network-changed:8d4f958b-79cd-4a09-9322-87a1b16589ee for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:01:14.513110 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7437e312-a978-4f50-9d1a-4cb89f08947e req-047e17e3-51f9-4c5a-8af5-c56cb678ecdd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043874 Aug 27 05:01:14.513706 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2633/5204] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:14.529676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-205ab251-77b8-451b-9c19-57ba5fede698 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:14.530739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-205ab251-77b8-451b-9c19-57ba5fede698 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:14.538447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-205ab251-77b8-451b-9c19-57ba5fede698 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.539170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-205ab251-77b8-451b-9c19-57ba5fede698 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.539924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-205ab251-77b8-451b-9c19-57ba5fede698 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.540871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-205ab251-77b8-451b-9c19-57ba5fede698 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.542079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-205ab251-77b8-451b-9c19-57ba5fede698 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.544618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-205ab251-77b8-451b-9c19-57ba5fede698 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.625768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2502e135-9ece-4284-9f6d-78f97beaea26 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:14.636032 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2502e135-9ece-4284-9f6d-78f97beaea26 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1307 microversion: 2.1 time: 0.213544 Aug 27 05:01:14.654263 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2572/5205] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:14 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:14.702779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ed90b6ca-624f-4336-972f-945a6a6f1feb req-c602248d-ff5c-4ceb-8317-673585e1ec6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3ca3f0-178f-48ad-a92d-81f2285abf64", "tag": "fbc1d9ef-c67e-4481-bf0a-b2732263a4fd"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:14.718223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ed90b6ca-624f-4336-972f-945a6a6f1feb req-c602248d-ff5c-4ceb-8317-673585e1ec6e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.718707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ed90b6ca-624f-4336-972f-945a6a6f1feb req-c602248d-ff5c-4ceb-8317-673585e1ec6e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.719134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ed90b6ca-624f-4336-972f-945a6a6f1feb req-c602248d-ff5c-4ceb-8317-673585e1ec6e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.778167 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ed90b6ca-624f-4336-972f-945a6a6f1feb req-c602248d-ff5c-4ceb-8317-673585e1ec6e service nova] Creating event network-changed:fbc1d9ef-c67e-4481-bf0a-b2732263a4fd for instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 on n-h2-854823-1 Aug 27 05:01:14.787573 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ed90b6ca-624f-4336-972f-945a6a6f1feb req-c602248d-ff5c-4ceb-8317-673585e1ec6e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088344 Aug 27 05:01:14.793056 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2573/5206] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:01:14.910263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b4e3337a-d069-490f-8172-4cfd8c68a028 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:14.913743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b4e3337a-d069-490f-8172-4cfd8c68a028 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:14.927555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4e3337a-d069-490f-8172-4cfd8c68a028 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.933023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4e3337a-d069-490f-8172-4cfd8c68a028 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.935455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4e3337a-d069-490f-8172-4cfd8c68a028 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:14.937684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4e3337a-d069-490f-8172-4cfd8c68a028 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:14.941054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4e3337a-d069-490f-8172-4cfd8c68a028 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:14.941807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4e3337a-d069-490f-8172-4cfd8c68a028 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:15.025614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-205ab251-77b8-451b-9c19-57ba5fede698 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:15.037591 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-205ab251-77b8-451b-9c19-57ba5fede698 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1391 microversion: 2.1 time: 0.515272 Aug 27 05:01:15.042595 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2634/5207] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:14 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1391 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:15.212512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8754178-30df-420b-a3e4-3f2db3245f6a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:15.213301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b8754178-30df-420b-a3e4-3f2db3245f6a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:15.224663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8754178-30df-420b-a3e4-3f2db3245f6a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:15.225173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8754178-30df-420b-a3e4-3f2db3245f6a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:15.228317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8754178-30df-420b-a3e4-3f2db3245f6a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:15.231667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8754178-30df-420b-a3e4-3f2db3245f6a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:15.232695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8754178-30df-420b-a3e4-3f2db3245f6a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:15.236201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8754178-30df-420b-a3e4-3f2db3245f6a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:15.315317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b8754178-30df-420b-a3e4-3f2db3245f6a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:01:15.330868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b4e3337a-d069-490f-8172-4cfd8c68a028 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:15.342897 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b4e3337a-d069-490f-8172-4cfd8c68a028 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1318 microversion: 2.1 time: 0.437362 Aug 27 05:01:15.345791 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2574/5208] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:14 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:15.439214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-745879bc-a7b0-41f0-b9d6-7f8a9e54f9a0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:15.439825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-745879bc-a7b0-41f0-b9d6-7f8a9e54f9a0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:15.452955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-745879bc-a7b0-41f0-b9d6-7f8a9e54f9a0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:15.456900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-745879bc-a7b0-41f0-b9d6-7f8a9e54f9a0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:15.458169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-745879bc-a7b0-41f0-b9d6-7f8a9e54f9a0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:15.459207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-745879bc-a7b0-41f0-b9d6-7f8a9e54f9a0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:15.459870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-745879bc-a7b0-41f0-b9d6-7f8a9e54f9a0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:15.460695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-745879bc-a7b0-41f0-b9d6-7f8a9e54f9a0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:15.517189 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b8754178-30df-420b-a3e4-3f2db3245f6a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 204 len: 0 microversion: 2.1 time: 0.310528 Aug 27 05:01:15.517960 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2635/5209] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:01:15 2022] DELETE /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:01:15.531878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2c53d24-5e13-4424-8f14-9b508ef62f4a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:15.534817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2c53d24-5e13-4424-8f14-9b508ef62f4a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:15.549371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2c53d24-5e13-4424-8f14-9b508ef62f4a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:15.553331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2c53d24-5e13-4424-8f14-9b508ef62f4a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:15.554082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2c53d24-5e13-4424-8f14-9b508ef62f4a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:15.555075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2c53d24-5e13-4424-8f14-9b508ef62f4a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:15.558118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2c53d24-5e13-4424-8f14-9b508ef62f4a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:15.558801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2c53d24-5e13-4424-8f14-9b508ef62f4a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:15.978140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-745879bc-a7b0-41f0-b9d6-7f8a9e54f9a0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:15.987812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-745879bc-a7b0-41f0-b9d6-7f8a9e54f9a0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:15.993965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-745879bc-a7b0-41f0-b9d6-7f8a9e54f9a0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:15.995220 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-745879bc-a7b0-41f0-b9d6-7f8a9e54f9a0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.560757 Aug 27 05:01:16.003648 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2575/5210] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:15 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:16.009222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-85832270-2f45-4861-83ae-4e67b9003e25 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:16.024247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-85832270-2f45-4861-83ae-4e67b9003e25 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:16.045159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85832270-2f45-4861-83ae-4e67b9003e25 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:16.045750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85832270-2f45-4861-83ae-4e67b9003e25 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:16.046099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85832270-2f45-4861-83ae-4e67b9003e25 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:16.046816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85832270-2f45-4861-83ae-4e67b9003e25 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:16.047268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85832270-2f45-4861-83ae-4e67b9003e25 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:16.047689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85832270-2f45-4861-83ae-4e67b9003e25 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:16.156786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b2c53d24-5e13-4424-8f14-9b508ef62f4a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:16.169487 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2c53d24-5e13-4424-8f14-9b508ef62f4a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1397 microversion: 2.1 time: 0.644557 Aug 27 05:01:16.194452 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2636/5211] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:15 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1397 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:16.364997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1aec2e57-fbbe-41dd-a58e-15c7ac0521ea tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:16.365687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1aec2e57-fbbe-41dd-a58e-15c7ac0521ea tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:16.383443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1aec2e57-fbbe-41dd-a58e-15c7ac0521ea tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:16.384152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1aec2e57-fbbe-41dd-a58e-15c7ac0521ea tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:16.384635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1aec2e57-fbbe-41dd-a58e-15c7ac0521ea tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:16.385711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1aec2e57-fbbe-41dd-a58e-15c7ac0521ea tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:16.386255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1aec2e57-fbbe-41dd-a58e-15c7ac0521ea tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:16.389082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1aec2e57-fbbe-41dd-a58e-15c7ac0521ea tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:16.426359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-85832270-2f45-4861-83ae-4e67b9003e25 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:16.431864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:16.439803 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-85832270-2f45-4861-83ae-4e67b9003e25 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1374 microversion: 2.1 time: 0.434945 Aug 27 05:01:16.443253 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2576/5212] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:16 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1374 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:16.815458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ec152c03-41dd-4c5b-a248-4cb5aa7dfe49 req-48c8838d-72c8-4bc5-8509-ef828e838d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0391d663-2bf9-4363-922e-338c94829bf5", "tag": "6eb2d37f-1d73-4f5b-aa9b-d1f28643976e"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:16.854958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ec152c03-41dd-4c5b-a248-4cb5aa7dfe49 req-48c8838d-72c8-4bc5-8509-ef828e838d1a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:16.857641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ec152c03-41dd-4c5b-a248-4cb5aa7dfe49 req-48c8838d-72c8-4bc5-8509-ef828e838d1a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:16.861723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ec152c03-41dd-4c5b-a248-4cb5aa7dfe49 req-48c8838d-72c8-4bc5-8509-ef828e838d1a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:16.896335 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ec152c03-41dd-4c5b-a248-4cb5aa7dfe49 req-48c8838d-72c8-4bc5-8509-ef828e838d1a service nova] Creating event network-changed:6eb2d37f-1d73-4f5b-aa9b-d1f28643976e for instance 0391d663-2bf9-4363-922e-338c94829bf5 on n-h2-854823-1 Aug 27 05:01:16.910513 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ec152c03-41dd-4c5b-a248-4cb5aa7dfe49 req-48c8838d-72c8-4bc5-8509-ef828e838d1a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099588 Aug 27 05:01:16.912234 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2577/5213] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:01:17.011709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1aec2e57-fbbe-41dd-a58e-15c7ac0521ea tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:17.021547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bedc759e-8f12-4725-98de-6cfd39bd7933 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:17.023044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bedc759e-8f12-4725-98de-6cfd39bd7933 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:17.028354 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1aec2e57-fbbe-41dd-a58e-15c7ac0521ea tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1507 microversion: 2.1 time: 0.668076 Aug 27 05:01:17.029245 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2637/5214] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:16 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1507 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:17.039889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bedc759e-8f12-4725-98de-6cfd39bd7933 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:17.043182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bedc759e-8f12-4725-98de-6cfd39bd7933 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:17.043803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bedc759e-8f12-4725-98de-6cfd39bd7933 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:17.044561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bedc759e-8f12-4725-98de-6cfd39bd7933 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:17.045035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bedc759e-8f12-4725-98de-6cfd39bd7933 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:17.045546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bedc759e-8f12-4725-98de-6cfd39bd7933 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:17.191113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c64ba053-c5bb-4df9-879f-a9674040b154 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:17.191740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c64ba053-c5bb-4df9-879f-a9674040b154 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:17.199900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64ba053-c5bb-4df9-879f-a9674040b154 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:17.200404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64ba053-c5bb-4df9-879f-a9674040b154 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:17.200893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64ba053-c5bb-4df9-879f-a9674040b154 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:17.201716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64ba053-c5bb-4df9-879f-a9674040b154 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:17.202228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64ba053-c5bb-4df9-879f-a9674040b154 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:17.202730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64ba053-c5bb-4df9-879f-a9674040b154 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:17.442181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c64ba053-c5bb-4df9-879f-a9674040b154 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:17.446885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bedc759e-8f12-4725-98de-6cfd39bd7933 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:17.452112 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c64ba053-c5bb-4df9-879f-a9674040b154 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1397 microversion: 2.1 time: 0.264451 Aug 27 05:01:17.455425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bedc759e-8f12-4725-98de-6cfd39bd7933 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:17.457199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bedc759e-8f12-4725-98de-6cfd39bd7933 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:17.459152 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bedc759e-8f12-4725-98de-6cfd39bd7933 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.443505 Aug 27 05:01:17.472585 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2638/5215] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:17 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1397 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:17.473869 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2578/5216] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:17 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:17.474103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43a2e8bb-3408-4303-a3be-bbcd26ecbc84 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:17.476611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43a2e8bb-3408-4303-a3be-bbcd26ecbc84 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:17.482681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43a2e8bb-3408-4303-a3be-bbcd26ecbc84 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:17.483221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43a2e8bb-3408-4303-a3be-bbcd26ecbc84 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:17.483643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43a2e8bb-3408-4303-a3be-bbcd26ecbc84 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:17.484647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43a2e8bb-3408-4303-a3be-bbcd26ecbc84 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:17.485256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43a2e8bb-3408-4303-a3be-bbcd26ecbc84 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:17.487195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43a2e8bb-3408-4303-a3be-bbcd26ecbc84 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:17.650921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-43a2e8bb-3408-4303-a3be-bbcd26ecbc84 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:17.662362 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43a2e8bb-3408-4303-a3be-bbcd26ecbc84 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1374 microversion: 2.1 time: 0.195212 Aug 27 05:01:17.664736 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2639/5217] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:17 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:18.479042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-44c466bd-c19e-45d8-af98-5c5da2e432c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:18.479652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-44c466bd-c19e-45d8-af98-5c5da2e432c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:18.484422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5fe0b0b6-4deb-47e8-b18d-5e490094f3cf tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:18.485106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5fe0b0b6-4deb-47e8-b18d-5e490094f3cf tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:18.503328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fe0b0b6-4deb-47e8-b18d-5e490094f3cf tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:18.504885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44c466bd-c19e-45d8-af98-5c5da2e432c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:18.505487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fe0b0b6-4deb-47e8-b18d-5e490094f3cf tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:18.506021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fe0b0b6-4deb-47e8-b18d-5e490094f3cf tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:18.509463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44c466bd-c19e-45d8-af98-5c5da2e432c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:18.509789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fe0b0b6-4deb-47e8-b18d-5e490094f3cf tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:18.510356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fe0b0b6-4deb-47e8-b18d-5e490094f3cf tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:18.510872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44c466bd-c19e-45d8-af98-5c5da2e432c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:18.511803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44c466bd-c19e-45d8-af98-5c5da2e432c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:18.512465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fe0b0b6-4deb-47e8-b18d-5e490094f3cf tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:18.518646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44c466bd-c19e-45d8-af98-5c5da2e432c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:18.522356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44c466bd-c19e-45d8-af98-5c5da2e432c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:18.664816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-44c466bd-c19e-45d8-af98-5c5da2e432c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:18.675197 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-44c466bd-c19e-45d8-af98-5c5da2e432c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1188 microversion: 2.1 time: 0.202341 Aug 27 05:01:18.692866 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2579/5218] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:18 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1188 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:18.698148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-515d5a7b-1627-41d2-a0f8-688d9d501299 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:18.698777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-515d5a7b-1627-41d2-a0f8-688d9d501299 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:18.717141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-515d5a7b-1627-41d2-a0f8-688d9d501299 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:18.717647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-515d5a7b-1627-41d2-a0f8-688d9d501299 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:18.718093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-515d5a7b-1627-41d2-a0f8-688d9d501299 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:18.718818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-515d5a7b-1627-41d2-a0f8-688d9d501299 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:18.719282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-515d5a7b-1627-41d2-a0f8-688d9d501299 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:18.719715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-515d5a7b-1627-41d2-a0f8-688d9d501299 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:18.812848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:18.830414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5fe0b0b6-4deb-47e8-b18d-5e490094f3cf tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:18.844606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5fe0b0b6-4deb-47e8-b18d-5e490094f3cf tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:18.846144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5fe0b0b6-4deb-47e8-b18d-5e490094f3cf tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:18.847364 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5fe0b0b6-4deb-47e8-b18d-5e490094f3cf tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.367102 Aug 27 05:01:18.847947 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2640/5219] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:18 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:18.861519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=14 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:18.977296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a0d63a1f-5063-4c0c-be7e-e4ad7d3bee1d req-3b159f17-f549-4aee-aca8-c79891178efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61deb16-51e0-4d32-b077-0f1808a1f525", "name": "network-vif-deleted", "tag": "cc200f87-b6f5-486b-914d-1b4a92915b90"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:18.997747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a0d63a1f-5063-4c0c-be7e-e4ad7d3bee1d req-3b159f17-f549-4aee-aca8-c79891178efb service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:18.999438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a0d63a1f-5063-4c0c-be7e-e4ad7d3bee1d req-3b159f17-f549-4aee-aca8-c79891178efb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:19.001162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a0d63a1f-5063-4c0c-be7e-e4ad7d3bee1d req-3b159f17-f549-4aee-aca8-c79891178efb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:19.026156 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a0d63a1f-5063-4c0c-be7e-e4ad7d3bee1d req-3b159f17-f549-4aee-aca8-c79891178efb service nova] Creating event network-vif-deleted:cc200f87-b6f5-486b-914d-1b4a92915b90 for instance c61deb16-51e0-4d32-b077-0f1808a1f525 on n-h1-854823-1 Aug 27 05:01:19.044298 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a0d63a1f-5063-4c0c-be7e-e4ad7d3bee1d req-3b159f17-f549-4aee-aca8-c79891178efb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067247 Aug 27 05:01:19.049241 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2641/5220] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:01:19.118007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-515d5a7b-1627-41d2-a0f8-688d9d501299 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:19.131014 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-515d5a7b-1627-41d2-a0f8-688d9d501299 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1374 microversion: 2.1 time: 0.436024 Aug 27 05:01:19.134873 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2580/5221] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:18 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1374 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:19.698027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-254b3f70-2055-4061-8f71-f2cfb3da29d6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:19.699425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-254b3f70-2055-4061-8f71-f2cfb3da29d6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:19.705464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:19.710149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-254b3f70-2055-4061-8f71-f2cfb3da29d6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:19.711154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-254b3f70-2055-4061-8f71-f2cfb3da29d6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:19.711862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-254b3f70-2055-4061-8f71-f2cfb3da29d6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:19.712859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-254b3f70-2055-4061-8f71-f2cfb3da29d6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:19.715760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-254b3f70-2055-4061-8f71-f2cfb3da29d6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:19.716659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-254b3f70-2055-4061-8f71-f2cfb3da29d6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:19.818894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-254b3f70-2055-4061-8f71-f2cfb3da29d6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:19.827881 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-254b3f70-2055-4061-8f71-f2cfb3da29d6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1188 microversion: 2.1 time: 0.134133 Aug 27 05:01:19.828631 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2642/5222] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:19 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1188 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:19.873367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c9f4849c-c0ee-4409-bf03-d35382886627 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:19.875800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c9f4849c-c0ee-4409-bf03-d35382886627 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:19.885824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f4849c-c0ee-4409-bf03-d35382886627 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:19.886515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f4849c-c0ee-4409-bf03-d35382886627 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:19.887208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f4849c-c0ee-4409-bf03-d35382886627 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:19.888085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f4849c-c0ee-4409-bf03-d35382886627 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:19.888783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f4849c-c0ee-4409-bf03-d35382886627 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:19.889414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f4849c-c0ee-4409-bf03-d35382886627 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:20.159167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6f91785-5499-478f-b6e0-ecab3bf5ca7d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:20.162968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6f91785-5499-478f-b6e0-ecab3bf5ca7d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:20.177259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6f91785-5499-478f-b6e0-ecab3bf5ca7d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:20.178072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6f91785-5499-478f-b6e0-ecab3bf5ca7d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:20.178680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6f91785-5499-478f-b6e0-ecab3bf5ca7d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:20.179552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6f91785-5499-478f-b6e0-ecab3bf5ca7d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:20.180162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6f91785-5499-478f-b6e0-ecab3bf5ca7d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:20.184000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6f91785-5499-478f-b6e0-ecab3bf5ca7d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:20.437443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f6f91785-5499-478f-b6e0-ecab3bf5ca7d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:20.452885 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6f91785-5499-478f-b6e0-ecab3bf5ca7d tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1374 microversion: 2.1 time: 0.300601 Aug 27 05:01:20.465541 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2643/5223] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:20 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1374 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:20.523642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c9f4849c-c0ee-4409-bf03-d35382886627 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:20.533651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c9f4849c-c0ee-4409-bf03-d35382886627 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:20.536399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c9f4849c-c0ee-4409-bf03-d35382886627 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:20.538329 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c9f4849c-c0ee-4409-bf03-d35382886627 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.670888 Aug 27 05:01:20.538934 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2581/5224] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:19 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:20.849891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7449f6a7-bc81-445a-a51b-b3a4b9969636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:20.850524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7449f6a7-bc81-445a-a51b-b3a4b9969636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:20.857910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7449f6a7-bc81-445a-a51b-b3a4b9969636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:20.858761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7449f6a7-bc81-445a-a51b-b3a4b9969636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:20.859394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7449f6a7-bc81-445a-a51b-b3a4b9969636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:20.860320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7449f6a7-bc81-445a-a51b-b3a4b9969636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:20.861035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7449f6a7-bc81-445a-a51b-b3a4b9969636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:20.861934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7449f6a7-bc81-445a-a51b-b3a4b9969636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:20.932875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7449f6a7-bc81-445a-a51b-b3a4b9969636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:20.941637 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7449f6a7-bc81-445a-a51b-b3a4b9969636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1188 microversion: 2.1 time: 0.096190 Aug 27 05:01:20.942814 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2644/5225] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:20 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:21.484904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b4ce08a2-021c-4c01-b975-7ef7e45ed9aa tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:21.484904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b4ce08a2-021c-4c01-b975-7ef7e45ed9aa tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:21.484904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:21.485884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4ce08a2-021c-4c01-b975-7ef7e45ed9aa tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:21.486457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4ce08a2-021c-4c01-b975-7ef7e45ed9aa tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:21.486907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4ce08a2-021c-4c01-b975-7ef7e45ed9aa tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:21.487620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4ce08a2-021c-4c01-b975-7ef7e45ed9aa tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:21.488069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4ce08a2-021c-4c01-b975-7ef7e45ed9aa tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:21.488770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4ce08a2-021c-4c01-b975-7ef7e45ed9aa tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:21.562222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd97a9bd-237e-49e9-a6bb-6db4efbd2744 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:21.562829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd97a9bd-237e-49e9-a6bb-6db4efbd2744 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:21.575586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd97a9bd-237e-49e9-a6bb-6db4efbd2744 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:21.576602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd97a9bd-237e-49e9-a6bb-6db4efbd2744 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:21.577071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd97a9bd-237e-49e9-a6bb-6db4efbd2744 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:21.577893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd97a9bd-237e-49e9-a6bb-6db4efbd2744 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:21.579249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd97a9bd-237e-49e9-a6bb-6db4efbd2744 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:21.579886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd97a9bd-237e-49e9-a6bb-6db4efbd2744 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:21.689140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b4ce08a2-021c-4c01-b975-7ef7e45ed9aa tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:21.701732 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b4ce08a2-021c-4c01-b975-7ef7e45ed9aa tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1374 microversion: 2.1 time: 0.228781 Aug 27 05:01:21.702868 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2582/5226] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:21 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1374 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:21.834374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bd97a9bd-237e-49e9-a6bb-6db4efbd2744 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:21.845611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bd97a9bd-237e-49e9-a6bb-6db4efbd2744 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:21.848575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bd97a9bd-237e-49e9-a6bb-6db4efbd2744 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:21.850175 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd97a9bd-237e-49e9-a6bb-6db4efbd2744 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.291657 Aug 27 05:01:21.851476 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2645/5227] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:21 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:21.964002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0458e5bc-0eaf-4596-a888-e6b19e74cacf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:21.964736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0458e5bc-0eaf-4596-a888-e6b19e74cacf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:21.979832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0458e5bc-0eaf-4596-a888-e6b19e74cacf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:21.980336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0458e5bc-0eaf-4596-a888-e6b19e74cacf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:21.980812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0458e5bc-0eaf-4596-a888-e6b19e74cacf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:21.981527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0458e5bc-0eaf-4596-a888-e6b19e74cacf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:21.981989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0458e5bc-0eaf-4596-a888-e6b19e74cacf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:21.982419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0458e5bc-0eaf-4596-a888-e6b19e74cacf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:22.013669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b02c680b-3aae-4164-8993-0b1fe195be65 req-36dfa354-68f1-48f0-b9a5-2fa3dfbf005b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0391d663-2bf9-4363-922e-338c94829bf5", "name": "network-vif-plugged", "status": "completed", "tag": "6eb2d37f-1d73-4f5b-aa9b-d1f28643976e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:22.029854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:22.032225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b02c680b-3aae-4164-8993-0b1fe195be65 req-36dfa354-68f1-48f0-b9a5-2fa3dfbf005b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:22.034938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b02c680b-3aae-4164-8993-0b1fe195be65 req-36dfa354-68f1-48f0-b9a5-2fa3dfbf005b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:22.036695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b02c680b-3aae-4164-8993-0b1fe195be65 req-36dfa354-68f1-48f0-b9a5-2fa3dfbf005b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:22.070058 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b02c680b-3aae-4164-8993-0b1fe195be65 req-36dfa354-68f1-48f0-b9a5-2fa3dfbf005b service nova] Creating event network-vif-plugged:6eb2d37f-1d73-4f5b-aa9b-d1f28643976e for instance 0391d663-2bf9-4363-922e-338c94829bf5 on n-h2-854823-1 Aug 27 05:01:22.085710 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b02c680b-3aae-4164-8993-0b1fe195be65 req-36dfa354-68f1-48f0-b9a5-2fa3dfbf005b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078711 Aug 27 05:01:22.088490 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2646/5228] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:22.140274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0458e5bc-0eaf-4596-a888-e6b19e74cacf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:22.163384 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0458e5bc-0eaf-4596-a888-e6b19e74cacf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1188 microversion: 2.1 time: 0.203751 Aug 27 05:01:22.163998 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2583/5229] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:21 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1188 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:22.728895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d40ea5f1-a372-4054-b77b-871cf6aab96a tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:22.730061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d40ea5f1-a372-4054-b77b-871cf6aab96a tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:22.740690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d40ea5f1-a372-4054-b77b-871cf6aab96a tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:22.741537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d40ea5f1-a372-4054-b77b-871cf6aab96a tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:22.742191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d40ea5f1-a372-4054-b77b-871cf6aab96a tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:22.743955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d40ea5f1-a372-4054-b77b-871cf6aab96a tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:22.744685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d40ea5f1-a372-4054-b77b-871cf6aab96a tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:22.745361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d40ea5f1-a372-4054-b77b-871cf6aab96a tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:22.813988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a7bc9adc-b197-462e-974e-2873b422f2ff tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:22.814603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a7bc9adc-b197-462e-974e-2873b422f2ff tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:22.828059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7bc9adc-b197-462e-974e-2873b422f2ff tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:22.828845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7bc9adc-b197-462e-974e-2873b422f2ff tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:22.829456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7bc9adc-b197-462e-974e-2873b422f2ff tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:22.830367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7bc9adc-b197-462e-974e-2873b422f2ff tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:22.830990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7bc9adc-b197-462e-974e-2873b422f2ff tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:22.831704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7bc9adc-b197-462e-974e-2873b422f2ff tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:22.980366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d40ea5f1-a372-4054-b77b-871cf6aab96a tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:22.993455 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d40ea5f1-a372-4054-b77b-871cf6aab96a tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1374 microversion: 2.1 time: 0.269424 Aug 27 05:01:22.994962 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2647/5230] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:22 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1374 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:22.999927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8afaa2a-b9b2-4395-a1a4-6e9b556f00b6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:23.001322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8afaa2a-b9b2-4395-a1a4-6e9b556f00b6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:23.008044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8afaa2a-b9b2-4395-a1a4-6e9b556f00b6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:23.008879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8afaa2a-b9b2-4395-a1a4-6e9b556f00b6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:23.009871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8afaa2a-b9b2-4395-a1a4-6e9b556f00b6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:23.011163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8afaa2a-b9b2-4395-a1a4-6e9b556f00b6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:23.012032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8afaa2a-b9b2-4395-a1a4-6e9b556f00b6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:23.012687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8afaa2a-b9b2-4395-a1a4-6e9b556f00b6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:23.086694 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a7bc9adc-b197-462e-974e-2873b422f2ff tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1834 microversion: 2.1 time: 0.276805 Aug 27 05:01:23.109844 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2584/5231] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:22 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1834 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:01:23.184836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-585f2dfa-8ea6-4d87-b829-284e7266115f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:23.185525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-585f2dfa-8ea6-4d87-b829-284e7266115f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:23.210016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-585f2dfa-8ea6-4d87-b829-284e7266115f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:23.211007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-585f2dfa-8ea6-4d87-b829-284e7266115f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:23.211390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8afaa2a-b9b2-4395-a1a4-6e9b556f00b6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:23.211530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-585f2dfa-8ea6-4d87-b829-284e7266115f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:23.212216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-585f2dfa-8ea6-4d87-b829-284e7266115f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:23.212773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-585f2dfa-8ea6-4d87-b829-284e7266115f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:23.213232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-585f2dfa-8ea6-4d87-b829-284e7266115f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:23.221894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8afaa2a-b9b2-4395-a1a4-6e9b556f00b6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:23.225894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8afaa2a-b9b2-4395-a1a4-6e9b556f00b6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:23.227093 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8afaa2a-b9b2-4395-a1a4-6e9b556f00b6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.230967 Aug 27 05:01:23.227669 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2648/5232] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:22 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:23.327266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-585f2dfa-8ea6-4d87-b829-284e7266115f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:23.337765 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-585f2dfa-8ea6-4d87-b829-284e7266115f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 200 len: 1188 microversion: 2.1 time: 0.157984 Aug 27 05:01:23.338359 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2585/5233] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:23 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 1188 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:24.016511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5af9a9c-6eba-4983-bcc2-a71a17bac285 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:24.017331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5af9a9c-6eba-4983-bcc2-a71a17bac285 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:24.024459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5af9a9c-6eba-4983-bcc2-a71a17bac285 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.025402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5af9a9c-6eba-4983-bcc2-a71a17bac285 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.026284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5af9a9c-6eba-4983-bcc2-a71a17bac285 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.027298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5af9a9c-6eba-4983-bcc2-a71a17bac285 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.027867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5af9a9c-6eba-4983-bcc2-a71a17bac285 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.028397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5af9a9c-6eba-4983-bcc2-a71a17bac285 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.199616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f5af9a9c-6eba-4983-bcc2-a71a17bac285 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:24.210511 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5af9a9c-6eba-4983-bcc2-a71a17bac285 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1546 microversion: 2.1 time: 0.198868 Aug 27 05:01:24.211778 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2649/5234] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:24 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1546 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:24.237250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-be9068aa-d3e1-46c1-8a32-36fe497944f3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:24.237848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-be9068aa-d3e1-46c1-8a32-36fe497944f3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:24.244703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be9068aa-d3e1-46c1-8a32-36fe497944f3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.245824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be9068aa-d3e1-46c1-8a32-36fe497944f3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.246486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be9068aa-d3e1-46c1-8a32-36fe497944f3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.247644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be9068aa-d3e1-46c1-8a32-36fe497944f3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.248519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be9068aa-d3e1-46c1-8a32-36fe497944f3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.254779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a9f0810b-14d3-47b3-b67a-7c8a0deb7fc6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:24.255841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a9f0810b-14d3-47b3-b67a-7c8a0deb7fc6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:24.260679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be9068aa-d3e1-46c1-8a32-36fe497944f3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.266618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f0810b-14d3-47b3-b67a-7c8a0deb7fc6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.268095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f0810b-14d3-47b3-b67a-7c8a0deb7fc6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.268801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f0810b-14d3-47b3-b67a-7c8a0deb7fc6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.271591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f0810b-14d3-47b3-b67a-7c8a0deb7fc6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.272173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f0810b-14d3-47b3-b67a-7c8a0deb7fc6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.273227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f0810b-14d3-47b3-b67a-7c8a0deb7fc6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.475327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a9f0810b-14d3-47b3-b67a-7c8a0deb7fc6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:24.488672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a9f0810b-14d3-47b3-b67a-7c8a0deb7fc6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:24.491288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a9f0810b-14d3-47b3-b67a-7c8a0deb7fc6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:24.492917 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a9f0810b-14d3-47b3-b67a-7c8a0deb7fc6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.242979 Aug 27 05:01:24.504462 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2650/5235] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:24 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:24.530964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8f23f7c-a66d-4ca2-a610-8b450a2d0246 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:24.532082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8f23f7c-a66d-4ca2-a610-8b450a2d0246 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:24.549813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8f23f7c-a66d-4ca2-a610-8b450a2d0246 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.550703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8f23f7c-a66d-4ca2-a610-8b450a2d0246 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.551589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8f23f7c-a66d-4ca2-a610-8b450a2d0246 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.552440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8f23f7c-a66d-4ca2-a610-8b450a2d0246 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.555112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8f23f7c-a66d-4ca2-a610-8b450a2d0246 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.557825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8f23f7c-a66d-4ca2-a610-8b450a2d0246 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.590152 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f8f23f7c-a66d-4ca2-a610-8b450a2d0246 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8f23f7c-a66d-4ca2-a610-8b450a2d0246 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 HTTP/1.1 Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'c61deb16-51e0-4d32-b077-0f1808a1f525'} Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:24.593231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:24.598158 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:24.598158 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:24.598158 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:24.598158 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:24.598158 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:24.598158 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:24.598158 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:24.600918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8f23f7c-a66d-4ca2-a610-8b450a2d0246 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:24.602032 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8f23f7c-a66d-4ca2-a610-8b450a2d0246 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 404 len: 111 microversion: 2.1 time: 0.102522 Aug 27 05:01:24.603346 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2651/5236] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:24 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:01:24.627299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-475ce6c8-921e-47e0-8a33-3f776d44775b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:24.627893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-475ce6c8-921e-47e0-8a33-3f776d44775b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:24.640424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-475ce6c8-921e-47e0-8a33-3f776d44775b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.640920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-475ce6c8-921e-47e0-8a33-3f776d44775b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.643354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-475ce6c8-921e-47e0-8a33-3f776d44775b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.644193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-475ce6c8-921e-47e0-8a33-3f776d44775b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.646552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-475ce6c8-921e-47e0-8a33-3f776d44775b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.647184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-475ce6c8-921e-47e0-8a33-3f776d44775b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.682593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-be9068aa-d3e1-46c1-8a32-36fe497944f3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:24.696125 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-be9068aa-d3e1-46c1-8a32-36fe497944f3 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1546 microversion: 2.1 time: 0.464669 Aug 27 05:01:24.698004 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2586/5237] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:24 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1546 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:24.709658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a03a2b76-a42b-48dd-9b35-51b8034fa42c req-2291cbe2-7c24-46ad-b331-45f72c67f705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79131199-61d1-48f7-a53c-614f1a17098e", "tag": "0862d8e7-87b9-4566-b5e9-f057655a8991"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:24.712142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-475ce6c8-921e-47e0-8a33-3f776d44775b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:01:24.741916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a03a2b76-a42b-48dd-9b35-51b8034fa42c req-2291cbe2-7c24-46ad-b331-45f72c67f705 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.742725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a03a2b76-a42b-48dd-9b35-51b8034fa42c req-2291cbe2-7c24-46ad-b331-45f72c67f705 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.743333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a03a2b76-a42b-48dd-9b35-51b8034fa42c req-2291cbe2-7c24-46ad-b331-45f72c67f705 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.761918 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a03a2b76-a42b-48dd-9b35-51b8034fa42c req-2291cbe2-7c24-46ad-b331-45f72c67f705 service nova] Creating event network-changed:0862d8e7-87b9-4566-b5e9-f057655a8991 for instance 79131199-61d1-48f7-a53c-614f1a17098e on n-h2-854823-1 Aug 27 05:01:24.768348 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a03a2b76-a42b-48dd-9b35-51b8034fa42c req-2291cbe2-7c24-46ad-b331-45f72c67f705 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068735 Aug 27 05:01:24.769729 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2587/5238] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:24.912569 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-475ce6c8-921e-47e0-8a33-3f776d44775b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "DELETE /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 204 len: 0 microversion: 2.1 time: 0.288862 Aug 27 05:01:24.919371 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2652/5239] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:01:24 2022] DELETE /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:01:24.927309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8d4f62e1-77aa-40c7-8db0-be599dd57e5f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:24.928022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8d4f62e1-77aa-40c7-8db0-be599dd57e5f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:24.945840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d4f62e1-77aa-40c7-8db0-be599dd57e5f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.946347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d4f62e1-77aa-40c7-8db0-be599dd57e5f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.946801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d4f62e1-77aa-40c7-8db0-be599dd57e5f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:24.948761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d4f62e1-77aa-40c7-8db0-be599dd57e5f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:24.952831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d4f62e1-77aa-40c7-8db0-be599dd57e5f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:24.953291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d4f62e1-77aa-40c7-8db0-be599dd57e5f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:25.523346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa4c8854-8c54-4f45-8c9e-a7cb0df21f6c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:25.525814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fa4c8854-8c54-4f45-8c9e-a7cb0df21f6c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:25.542120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8d4f62e1-77aa-40c7-8db0-be599dd57e5f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:25.546260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa4c8854-8c54-4f45-8c9e-a7cb0df21f6c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:25.546918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa4c8854-8c54-4f45-8c9e-a7cb0df21f6c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:25.547831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa4c8854-8c54-4f45-8c9e-a7cb0df21f6c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:25.548791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa4c8854-8c54-4f45-8c9e-a7cb0df21f6c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:25.550266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:25.550672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa4c8854-8c54-4f45-8c9e-a7cb0df21f6c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:25.551248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa4c8854-8c54-4f45-8c9e-a7cb0df21f6c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:25.559330 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8d4f62e1-77aa-40c7-8db0-be599dd57e5f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1689 microversion: 2.1 time: 0.636670 Aug 27 05:01:25.561053 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2588/5240] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:24 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1689 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:25.949381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa4c8854-8c54-4f45-8c9e-a7cb0df21f6c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:25.966453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa4c8854-8c54-4f45-8c9e-a7cb0df21f6c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:25.973663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa4c8854-8c54-4f45-8c9e-a7cb0df21f6c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:25.977757 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa4c8854-8c54-4f45-8c9e-a7cb0df21f6c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.457235 Aug 27 05:01:25.978998 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2653/5241] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:25 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:26.581660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-62f36d73-1664-45b7-9aa6-4bfcca8be71f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:26.582371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-62f36d73-1664-45b7-9aa6-4bfcca8be71f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:26.600752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62f36d73-1664-45b7-9aa6-4bfcca8be71f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:26.601277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62f36d73-1664-45b7-9aa6-4bfcca8be71f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:26.601726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62f36d73-1664-45b7-9aa6-4bfcca8be71f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:26.602448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62f36d73-1664-45b7-9aa6-4bfcca8be71f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:26.608119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62f36d73-1664-45b7-9aa6-4bfcca8be71f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:26.609077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62f36d73-1664-45b7-9aa6-4bfcca8be71f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:27.016156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5bdc6c65-8dd8-492d-80ed-aeab53e25274 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:27.016728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5bdc6c65-8dd8-492d-80ed-aeab53e25274 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:27.042518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bdc6c65-8dd8-492d-80ed-aeab53e25274 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:27.043381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bdc6c65-8dd8-492d-80ed-aeab53e25274 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:27.045678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bdc6c65-8dd8-492d-80ed-aeab53e25274 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:27.047112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bdc6c65-8dd8-492d-80ed-aeab53e25274 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:27.049324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bdc6c65-8dd8-492d-80ed-aeab53e25274 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:27.053387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bdc6c65-8dd8-492d-80ed-aeab53e25274 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:27.121469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:27.344875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-62f36d73-1664-45b7-9aa6-4bfcca8be71f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:27.383553 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-62f36d73-1664-45b7-9aa6-4bfcca8be71f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1689 microversion: 2.1 time: 0.805797 Aug 27 05:01:27.384506 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2589/5242] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:26 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1689 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:27.729863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5bdc6c65-8dd8-492d-80ed-aeab53e25274 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:27.747160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5bdc6c65-8dd8-492d-80ed-aeab53e25274 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:27.750819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5bdc6c65-8dd8-492d-80ed-aeab53e25274 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:27.752804 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5bdc6c65-8dd8-492d-80ed-aeab53e25274 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.742354 Aug 27 05:01:27.754519 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2654/5243] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:27 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:28.064861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ab338b09-1bba-43f1-aecf-ec68d07f8a89 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:28.065877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ab338b09-1bba-43f1-aecf-ec68d07f8a89 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:28.075217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab338b09-1bba-43f1-aecf-ec68d07f8a89 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:28.076061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab338b09-1bba-43f1-aecf-ec68d07f8a89 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:28.076907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab338b09-1bba-43f1-aecf-ec68d07f8a89 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:28.077715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab338b09-1bba-43f1-aecf-ec68d07f8a89 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:28.078837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab338b09-1bba-43f1-aecf-ec68d07f8a89 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:28.079440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab338b09-1bba-43f1-aecf-ec68d07f8a89 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:28.104897 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-ab338b09-1bba-43f1-aecf-ec68d07f8a89 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ab338b09-1bba-43f1-aecf-ec68d07f8a89 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 HTTP/1.1 Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'c61deb16-51e0-4d32-b077-0f1808a1f525'} Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:28.106959 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:28.111435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:28.111435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:01:28.111435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:28.111435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:01:28.111435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:28.111435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:28.111435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:28.111435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:28.111435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:28.111435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:28.111435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:01:28.114199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ab338b09-1bba-43f1-aecf-ec68d07f8a89 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:28.115480 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ab338b09-1bba-43f1-aecf-ec68d07f8a89 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 404 len: 111 microversion: 2.1 time: 0.054797 Aug 27 05:01:28.116666 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2590/5244] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:01:28 2022] DELETE /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:01:28.124787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d509b8dc-78ea-4e90-92d0-86388638184c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:28.125676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d509b8dc-78ea-4e90-92d0-86388638184c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: c61deb16-51e0-4d32-b077-0f1808a1f525] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:28.139234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d509b8dc-78ea-4e90-92d0-86388638184c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:28.139735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d509b8dc-78ea-4e90-92d0-86388638184c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:28.140352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d509b8dc-78ea-4e90-92d0-86388638184c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:28.144568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d509b8dc-78ea-4e90-92d0-86388638184c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:28.145063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d509b8dc-78ea-4e90-92d0-86388638184c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:28.145588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d509b8dc-78ea-4e90-92d0-86388638184c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:28.165023 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d509b8dc-78ea-4e90-92d0-86388638184c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d509b8dc-78ea-4e90-92d0-86388638184c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 HTTP/1.1 Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'c61deb16-51e0-4d32-b077-0f1808a1f525'} Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:28.166760 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:28.170640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:28.170640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:28.170640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:28.170640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:28.170640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:28.170640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. Aug 27 05:01:28.170640 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:28.170640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d509b8dc-78ea-4e90-92d0-86388638184c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance c61deb16-51e0-4d32-b077-0f1808a1f525 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:28.170640 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d509b8dc-78ea-4e90-92d0-86388638184c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525" status: 404 len: 111 microversion: 2.1 time: 0.047731 Aug 27 05:01:28.170640 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2655/5245] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:28 2022] GET /compute/v2.1/servers/c61deb16-51e0-4d32-b077-0f1808a1f525 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:01:28.399100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-aeba3f36-f3ef-4096-9948-2128f43401a8 req-25e1b429-feea-4393-84f6-c868b71a9efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79131199-61d1-48f7-a53c-614f1a17098e", "name": "network-vif-deleted", "tag": "0862d8e7-87b9-4566-b5e9-f057655a8991"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:28.410109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d41b8ea-3c6a-4b8a-8e16-daed5b73b4a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:28.411703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d41b8ea-3c6a-4b8a-8e16-daed5b73b4a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:28.416386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-aeba3f36-f3ef-4096-9948-2128f43401a8 req-25e1b429-feea-4393-84f6-c868b71a9efd service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:28.420652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-aeba3f36-f3ef-4096-9948-2128f43401a8 req-25e1b429-feea-4393-84f6-c868b71a9efd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:28.421410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-aeba3f36-f3ef-4096-9948-2128f43401a8 req-25e1b429-feea-4393-84f6-c868b71a9efd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:28.425625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d41b8ea-3c6a-4b8a-8e16-daed5b73b4a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:28.426906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d41b8ea-3c6a-4b8a-8e16-daed5b73b4a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:28.427797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d41b8ea-3c6a-4b8a-8e16-daed5b73b4a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:28.428810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d41b8ea-3c6a-4b8a-8e16-daed5b73b4a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:28.429620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d41b8ea-3c6a-4b8a-8e16-daed5b73b4a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:28.430216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d41b8ea-3c6a-4b8a-8e16-daed5b73b4a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:28.451907 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-aeba3f36-f3ef-4096-9948-2128f43401a8 req-25e1b429-feea-4393-84f6-c868b71a9efd service nova] Creating event network-vif-deleted:0862d8e7-87b9-4566-b5e9-f057655a8991 for instance 79131199-61d1-48f7-a53c-614f1a17098e on n-h2-854823-1 Aug 27 05:01:28.463839 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-aeba3f36-f3ef-4096-9948-2128f43401a8 req-25e1b429-feea-4393-84f6-c868b71a9efd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068972 Aug 27 05:01:28.467707 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2591/5246] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:28.631930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d41b8ea-3c6a-4b8a-8e16-daed5b73b4a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:28.664874 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d41b8ea-3c6a-4b8a-8e16-daed5b73b4a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 200 len: 1503 microversion: 2.1 time: 0.258747 Aug 27 05:01:28.667116 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2656/5247] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:28 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 1503 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:28.789217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9dc1fa42-dea1-435e-bb18-3fd1a2b682fa tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:28.789568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9dc1fa42-dea1-435e-bb18-3fd1a2b682fa tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:28.815228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dc1fa42-dea1-435e-bb18-3fd1a2b682fa tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:28.817610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dc1fa42-dea1-435e-bb18-3fd1a2b682fa tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:28.820067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dc1fa42-dea1-435e-bb18-3fd1a2b682fa tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:28.821789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dc1fa42-dea1-435e-bb18-3fd1a2b682fa tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:28.835432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dc1fa42-dea1-435e-bb18-3fd1a2b682fa tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:28.838695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9dc1fa42-dea1-435e-bb18-3fd1a2b682fa tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:29.043666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9dc1fa42-dea1-435e-bb18-3fd1a2b682fa tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:29.056831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9dc1fa42-dea1-435e-bb18-3fd1a2b682fa tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:29.060389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9dc1fa42-dea1-435e-bb18-3fd1a2b682fa tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:29.062541 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9dc1fa42-dea1-435e-bb18-3fd1a2b682fa tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1743 microversion: 2.20 time: 0.286774 Aug 27 05:01:29.063925 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2592/5248] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:28 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1743 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:29.691284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fec8a0d9-1c5b-4bff-ba2e-d69ce1b9bef7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:29.692499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fec8a0d9-1c5b-4bff-ba2e-d69ce1b9bef7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: 79131199-61d1-48f7-a53c-614f1a17098e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:29.703076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fec8a0d9-1c5b-4bff-ba2e-d69ce1b9bef7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:29.705917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fec8a0d9-1c5b-4bff-ba2e-d69ce1b9bef7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:29.709708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fec8a0d9-1c5b-4bff-ba2e-d69ce1b9bef7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:29.710624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fec8a0d9-1c5b-4bff-ba2e-d69ce1b9bef7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:29.711457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fec8a0d9-1c5b-4bff-ba2e-d69ce1b9bef7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:29.712748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fec8a0d9-1c5b-4bff-ba2e-d69ce1b9bef7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:29.754023 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-fec8a0d9-1c5b-4bff-ba2e-d69ce1b9bef7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] HTTP exception thrown: Instance 79131199-61d1-48f7-a53c-614f1a17098e could not be found. Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fec8a0d9-1c5b-4bff-ba2e-d69ce1b9bef7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Request method failure captured: Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e HTTP/1.1 Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaRLmGBWEgwXQ5YrU3e-W09M-LG1_uBsJAS_ya1U9ZYATItKtu2g488KSFy-iTE2V_v7BoakUfBk6IbcG40wQ3Zjfp3X3qOXFXfrymr-WhwLzX-o71ez1rD8Ed7CjlUefvAzorMpVDawtgICzWr1EdH9eXF9QcoonuA5HE1Rfgy_-qk Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 7c34a6245d5c46f6babc0b7775512d84 Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-511432365 Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestNetworkAdvancedServerOps-511432365 Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 7c34a6245d5c46f6babc0b7775512d84 Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-511432365 Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestNetworkAdvancedServerOps-511432365-project Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: e508461869c24fb3ad1641d830e2b22a Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestNetworkAdvancedServerOps-511432365-project Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 79131199-61d1-48f7-a53c-614f1a17098e could not be found. Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '79131199-61d1-48f7-a53c-614f1a17098e'} Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79131199-61d1-48f7-a53c-614f1a17098e could not be found. Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79131199-61d1-48f7-a53c-614f1a17098e could not be found. Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:29.764354 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:01:29.768903 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:29.768903 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:01:29.768903 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:01:29.768903 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:01:29.768903 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:01:29.768903 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:01:29.768903 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79131199-61d1-48f7-a53c-614f1a17098e could not be found. Aug 27 05:01:29.768903 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:01:29.771126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fec8a0d9-1c5b-4bff-ba2e-d69ce1b9bef7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Returning 404 to user: Instance 79131199-61d1-48f7-a53c-614f1a17098e could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:01:29.772457 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fec8a0d9-1c5b-4bff-ba2e-d69ce1b9bef7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e" status: 404 len: 111 microversion: 2.1 time: 0.087738 Aug 27 05:01:29.773694 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2657/5249] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:29 2022] GET /compute/v2.1/servers/79131199-61d1-48f7-a53c-614f1a17098e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:01:30.089613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6acf3615-bdcb-45e6-8709-e73a152d66cd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:30.090236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6acf3615-bdcb-45e6-8709-e73a152d66cd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:30.114059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6acf3615-bdcb-45e6-8709-e73a152d66cd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:30.114692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6acf3615-bdcb-45e6-8709-e73a152d66cd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:30.115201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6acf3615-bdcb-45e6-8709-e73a152d66cd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:30.115998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6acf3615-bdcb-45e6-8709-e73a152d66cd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:30.116597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6acf3615-bdcb-45e6-8709-e73a152d66cd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:30.117679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6acf3615-bdcb-45e6-8709-e73a152d66cd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:30.601473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0930feb2-4dc0-4ee8-b71f-801440367a48 req-e210e1d7-07c8-40de-8df6-1afe7966d5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0391d663-2bf9-4363-922e-338c94829bf5", "tag": "6eb2d37f-1d73-4f5b-aa9b-d1f28643976e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:30.629830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0930feb2-4dc0-4ee8-b71f-801440367a48 req-e210e1d7-07c8-40de-8df6-1afe7966d5c3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:30.632334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0930feb2-4dc0-4ee8-b71f-801440367a48 req-e210e1d7-07c8-40de-8df6-1afe7966d5c3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:30.634122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0930feb2-4dc0-4ee8-b71f-801440367a48 req-e210e1d7-07c8-40de-8df6-1afe7966d5c3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:30.679459 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0930feb2-4dc0-4ee8-b71f-801440367a48 req-e210e1d7-07c8-40de-8df6-1afe7966d5c3 service nova] Creating event network-changed:6eb2d37f-1d73-4f5b-aa9b-d1f28643976e for instance 0391d663-2bf9-4363-922e-338c94829bf5 on n-h2-854823-1 Aug 27 05:01:30.679786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6acf3615-bdcb-45e6-8709-e73a152d66cd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:30.692264 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0930feb2-4dc0-4ee8-b71f-801440367a48 req-e210e1d7-07c8-40de-8df6-1afe7966d5c3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093014 Aug 27 05:01:30.693261 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2658/5250] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:30.702178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6acf3615-bdcb-45e6-8709-e73a152d66cd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:30.704427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6acf3615-bdcb-45e6-8709-e73a152d66cd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:30.707957 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6acf3615-bdcb-45e6-8709-e73a152d66cd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1743 microversion: 2.20 time: 0.621807 Aug 27 05:01:30.714062 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2593/5251] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:30 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1743 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:31.467899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ee1db1f4-549d-4362-9dd7-6321e249f6b5 req-d1ed3e10-d5df-405d-bc9a-660edb145421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd1a40c-a36d-4253-9f1c-b5711b2ed52a", "name": "network-vif-plugged", "status": "completed", "tag": "620b69e1-40ab-4292-881f-6f2fff934397"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:31.494297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ee1db1f4-549d-4362-9dd7-6321e249f6b5 req-d1ed3e10-d5df-405d-bc9a-660edb145421 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:31.495111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ee1db1f4-549d-4362-9dd7-6321e249f6b5 req-d1ed3e10-d5df-405d-bc9a-660edb145421 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:31.495778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ee1db1f4-549d-4362-9dd7-6321e249f6b5 req-d1ed3e10-d5df-405d-bc9a-660edb145421 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:31.526405 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ee1db1f4-549d-4362-9dd7-6321e249f6b5 req-d1ed3e10-d5df-405d-bc9a-660edb145421 service nova] Creating event network-vif-plugged:620b69e1-40ab-4292-881f-6f2fff934397 for instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a on n-h1-854823-1 Aug 27 05:01:31.535809 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ee1db1f4-549d-4362-9dd7-6321e249f6b5 req-d1ed3e10-d5df-405d-bc9a-660edb145421 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073535 Aug 27 05:01:31.537029 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2659/5252] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:31.741702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2114f573-c59b-4b86-8f9d-87bcbdcd0ee7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:31.742330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2114f573-c59b-4b86-8f9d-87bcbdcd0ee7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:31.749791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2114f573-c59b-4b86-8f9d-87bcbdcd0ee7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:31.750770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2114f573-c59b-4b86-8f9d-87bcbdcd0ee7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:31.751211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2114f573-c59b-4b86-8f9d-87bcbdcd0ee7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:31.752111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2114f573-c59b-4b86-8f9d-87bcbdcd0ee7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:31.753033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2114f573-c59b-4b86-8f9d-87bcbdcd0ee7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:31.753634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2114f573-c59b-4b86-8f9d-87bcbdcd0ee7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:32.099897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2114f573-c59b-4b86-8f9d-87bcbdcd0ee7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:32.116726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2114f573-c59b-4b86-8f9d-87bcbdcd0ee7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:32.121667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2114f573-c59b-4b86-8f9d-87bcbdcd0ee7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:32.124483 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2114f573-c59b-4b86-8f9d-87bcbdcd0ee7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1743 microversion: 2.20 time: 0.386256 Aug 27 05:01:32.137536 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2594/5253] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:31 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1743 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:33.153230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4550f9a1-f6ce-45f2-9c60-3b5494ae4f12 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:33.154754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4550f9a1-f6ce-45f2-9c60-3b5494ae4f12 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:33.165094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4550f9a1-f6ce-45f2-9c60-3b5494ae4f12 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:33.165795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4550f9a1-f6ce-45f2-9c60-3b5494ae4f12 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:33.166402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4550f9a1-f6ce-45f2-9c60-3b5494ae4f12 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:33.167320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4550f9a1-f6ce-45f2-9c60-3b5494ae4f12 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:33.167950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4550f9a1-f6ce-45f2-9c60-3b5494ae4f12 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:33.168574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4550f9a1-f6ce-45f2-9c60-3b5494ae4f12 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:33.436980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4550f9a1-f6ce-45f2-9c60-3b5494ae4f12 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:33.456890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4550f9a1-f6ce-45f2-9c60-3b5494ae4f12 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:33.466214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4550f9a1-f6ce-45f2-9c60-3b5494ae4f12 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:33.471069 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4550f9a1-f6ce-45f2-9c60-3b5494ae4f12 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1743 microversion: 2.20 time: 0.321988 Aug 27 05:01:33.473494 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2660/5254] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:33 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1743 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:34.499361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef1e627a-a82f-48a4-b03b-5c219e21ef7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:34.503269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ef1e627a-a82f-48a4-b03b-5c219e21ef7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:34.526634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef1e627a-a82f-48a4-b03b-5c219e21ef7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:34.527449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef1e627a-a82f-48a4-b03b-5c219e21ef7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:34.528468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef1e627a-a82f-48a4-b03b-5c219e21ef7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:34.531737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef1e627a-a82f-48a4-b03b-5c219e21ef7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:34.532735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef1e627a-a82f-48a4-b03b-5c219e21ef7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:34.533345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef1e627a-a82f-48a4-b03b-5c219e21ef7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:35.119616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef1e627a-a82f-48a4-b03b-5c219e21ef7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:35.135471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef1e627a-a82f-48a4-b03b-5c219e21ef7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:35.137572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef1e627a-a82f-48a4-b03b-5c219e21ef7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:35.141871 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ef1e627a-a82f-48a4-b03b-5c219e21ef7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.647389 Aug 27 05:01:35.146130 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2595/5255] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:34 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:36.183289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e25d7ed1-fed4-4849-a1c1-54afeefe38ec tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:36.184609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e25d7ed1-fed4-4849-a1c1-54afeefe38ec tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:36.200445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e25d7ed1-fed4-4849-a1c1-54afeefe38ec tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:36.203056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e25d7ed1-fed4-4849-a1c1-54afeefe38ec tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:36.203501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e25d7ed1-fed4-4849-a1c1-54afeefe38ec tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:36.211071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e25d7ed1-fed4-4849-a1c1-54afeefe38ec tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:36.212735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e25d7ed1-fed4-4849-a1c1-54afeefe38ec tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:36.213517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e25d7ed1-fed4-4849-a1c1-54afeefe38ec tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:36.659156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e25d7ed1-fed4-4849-a1c1-54afeefe38ec tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:36.675768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e25d7ed1-fed4-4849-a1c1-54afeefe38ec tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:36.680830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e25d7ed1-fed4-4849-a1c1-54afeefe38ec tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:36.683737 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e25d7ed1-fed4-4849-a1c1-54afeefe38ec tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.505192 Aug 27 05:01:36.698763 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2661/5256] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:36 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:37.422943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0f2f10fe-e3f2-4a2d-91f9-25798c7f9208 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '.version_select at 0x7f1f209f48b0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:37.470347 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0f2f10fe-e3f2-4a2d-91f9-25798c7f9208 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1266101429" status: 202 len: 0 microversion: 2.1 time: 0.052705 Aug 27 05:01:37.491128 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2596/5257] 10.222.0.79 () {58 vars in 1284 bytes} [Sat Aug 27 05:01:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1266101429 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:01:37.519731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5594ba3-bd7d-40d4-8e5e-6473068a742d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'create', calling method: .version_select at 0x7f1f219a64c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1653418233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbZfFgcRwabOsfRCXvKzceuov04MgaWwZwALdfcvKH6Y3FsJoo5kZwkckR30gsVhcDL88Rxf9fBMrZL8h2yQ5zQhtVhHrBTbcZulgXss7rCykkScO2yHY9UoXcVxYpRWA=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:37.578821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b5594ba3-bd7d-40d4-8e5e-6473068a742d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:01:37.597125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b5594ba3-bd7d-40d4-8e5e-6473068a742d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for user e508461869c24fb3ad1641d830e2b22a and project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:01:37.651996 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5594ba3-bd7d-40d4-8e5e-6473068a742d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.136330 Aug 27 05:01:37.653419 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2662/5258] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:01:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:37.710502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-be83e35a-e688-4124-82df-011138e879f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:37.711576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-be83e35a-e688-4124-82df-011138e879f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:37.739736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be83e35a-e688-4124-82df-011138e879f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:37.741517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be83e35a-e688-4124-82df-011138e879f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:37.741988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be83e35a-e688-4124-82df-011138e879f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:37.742750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be83e35a-e688-4124-82df-011138e879f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:37.743223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be83e35a-e688-4124-82df-011138e879f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:37.749966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be83e35a-e688-4124-82df-011138e879f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:38.085053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-be83e35a-e688-4124-82df-011138e879f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:38.105754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-be83e35a-e688-4124-82df-011138e879f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:38.107334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-be83e35a-e688-4124-82df-011138e879f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:38.132202 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-be83e35a-e688-4124-82df-011138e879f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.404639 Aug 27 05:01:38.133212 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2597/5259] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:37 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:39.170558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d326b251-2b0f-4637-86e6-1e5b1c074dff tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:39.172132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d326b251-2b0f-4637-86e6-1e5b1c074dff tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:39.186547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d326b251-2b0f-4637-86e6-1e5b1c074dff tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:39.187347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d326b251-2b0f-4637-86e6-1e5b1c074dff tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:39.187962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d326b251-2b0f-4637-86e6-1e5b1c074dff tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:39.188889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d326b251-2b0f-4637-86e6-1e5b1c074dff tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:39.189504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d326b251-2b0f-4637-86e6-1e5b1c074dff tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:39.190134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d326b251-2b0f-4637-86e6-1e5b1c074dff tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:39.453404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d326b251-2b0f-4637-86e6-1e5b1c074dff tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:39.467025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d326b251-2b0f-4637-86e6-1e5b1c074dff tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:39.470213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d326b251-2b0f-4637-86e6-1e5b1c074dff tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:39.471785 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d326b251-2b0f-4637-86e6-1e5b1c074dff tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.309600 Aug 27 05:01:39.473627 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2663/5260] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:39 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:40.495285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4315c7d5-ab65-4fc1-84ad-543c11b298c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:40.496490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4315c7d5-ab65-4fc1-84ad-543c11b298c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:40.511059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4315c7d5-ab65-4fc1-84ad-543c11b298c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:40.512592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4315c7d5-ab65-4fc1-84ad-543c11b298c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:40.513623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4315c7d5-ab65-4fc1-84ad-543c11b298c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:40.515036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4315c7d5-ab65-4fc1-84ad-543c11b298c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:40.517998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4315c7d5-ab65-4fc1-84ad-543c11b298c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:40.518622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4315c7d5-ab65-4fc1-84ad-543c11b298c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:40.819477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4315c7d5-ab65-4fc1-84ad-543c11b298c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:40.833065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4315c7d5-ab65-4fc1-84ad-543c11b298c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:40.842446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4315c7d5-ab65-4fc1-84ad-543c11b298c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:40.843914 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4315c7d5-ab65-4fc1-84ad-543c11b298c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.352633 Aug 27 05:01:40.844690 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2598/5261] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:40 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:41.874533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3b67594-4a61-4c9c-a474-d6ed994bad8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:41.877771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c3b67594-4a61-4c9c-a474-d6ed994bad8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:41.886983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b67594-4a61-4c9c-a474-d6ed994bad8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:41.887567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b67594-4a61-4c9c-a474-d6ed994bad8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:41.888077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b67594-4a61-4c9c-a474-d6ed994bad8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:41.893727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b67594-4a61-4c9c-a474-d6ed994bad8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:41.896104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b67594-4a61-4c9c-a474-d6ed994bad8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:41.898835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b67594-4a61-4c9c-a474-d6ed994bad8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:42.188736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3b67594-4a61-4c9c-a474-d6ed994bad8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:42.206587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3b67594-4a61-4c9c-a474-d6ed994bad8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:42.212037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3b67594-4a61-4c9c-a474-d6ed994bad8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:42.213590 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3b67594-4a61-4c9c-a474-d6ed994bad8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.344187 Aug 27 05:01:42.216400 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2664/5262] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:41 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:43.248599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3000b04a-f521-47c1-ab62-381697738620 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:43.249211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3000b04a-f521-47c1-ab62-381697738620 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:43.264735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3000b04a-f521-47c1-ab62-381697738620 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:43.267393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3000b04a-f521-47c1-ab62-381697738620 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:43.267844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3000b04a-f521-47c1-ab62-381697738620 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:43.268594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3000b04a-f521-47c1-ab62-381697738620 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:43.269055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3000b04a-f521-47c1-ab62-381697738620 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:43.270021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3000b04a-f521-47c1-ab62-381697738620 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:43.507808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3000b04a-f521-47c1-ab62-381697738620 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:43.535936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3000b04a-f521-47c1-ab62-381697738620 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:43.542137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3000b04a-f521-47c1-ab62-381697738620 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:43.545441 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3000b04a-f521-47c1-ab62-381697738620 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.306509 Aug 27 05:01:43.549106 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2599/5263] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:43 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:44.577472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8071c1f-4215-45e4-8dba-a659373f95e5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:44.579278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8071c1f-4215-45e4-8dba-a659373f95e5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:44.612117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8071c1f-4215-45e4-8dba-a659373f95e5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:44.614480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8071c1f-4215-45e4-8dba-a659373f95e5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:44.616556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8071c1f-4215-45e4-8dba-a659373f95e5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:44.617515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8071c1f-4215-45e4-8dba-a659373f95e5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:44.617995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8071c1f-4215-45e4-8dba-a659373f95e5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:44.629098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8071c1f-4215-45e4-8dba-a659373f95e5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:45.104764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8071c1f-4215-45e4-8dba-a659373f95e5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:45.122985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8071c1f-4215-45e4-8dba-a659373f95e5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:45.131754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8071c1f-4215-45e4-8dba-a659373f95e5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:45.134826 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8071c1f-4215-45e4-8dba-a659373f95e5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.563002 Aug 27 05:01:45.158248 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2665/5264] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:44 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:46.164891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8f776a52-0b53-4fa9-a496-20de0572e6c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:46.165541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8f776a52-0b53-4fa9-a496-20de0572e6c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:46.176096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f776a52-0b53-4fa9-a496-20de0572e6c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:46.176523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f776a52-0b53-4fa9-a496-20de0572e6c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:46.185128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f776a52-0b53-4fa9-a496-20de0572e6c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:46.186982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f776a52-0b53-4fa9-a496-20de0572e6c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:46.190844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f776a52-0b53-4fa9-a496-20de0572e6c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:46.195389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8f776a52-0b53-4fa9-a496-20de0572e6c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:46.602045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8f776a52-0b53-4fa9-a496-20de0572e6c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:46.626874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8f776a52-0b53-4fa9-a496-20de0572e6c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:46.632730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8f776a52-0b53-4fa9-a496-20de0572e6c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:46.634668 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8f776a52-0b53-4fa9-a496-20de0572e6c8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.474955 Aug 27 05:01:46.636804 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2600/5265] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:46 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:47.662694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3a44c4d-b60d-4c09-8867-047572eac8f6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:47.664326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c3a44c4d-b60d-4c09-8867-047572eac8f6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:47.671060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:47.677211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3a44c4d-b60d-4c09-8867-047572eac8f6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:47.679916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3a44c4d-b60d-4c09-8867-047572eac8f6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:47.686763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3a44c4d-b60d-4c09-8867-047572eac8f6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:47.688009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3a44c4d-b60d-4c09-8867-047572eac8f6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:47.688777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3a44c4d-b60d-4c09-8867-047572eac8f6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:47.689464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3a44c4d-b60d-4c09-8867-047572eac8f6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:48.510818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3a44c4d-b60d-4c09-8867-047572eac8f6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:48.530495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3a44c4d-b60d-4c09-8867-047572eac8f6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:48.547590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3a44c4d-b60d-4c09-8867-047572eac8f6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:48.551999 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3a44c4d-b60d-4c09-8867-047572eac8f6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.892088 Aug 27 05:01:48.554531 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2666/5266] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:47 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:49.580756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dc4d0313-29ae-4b16-92f1-078cf786be11 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:49.583019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dc4d0313-29ae-4b16-92f1-078cf786be11 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:49.598849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc4d0313-29ae-4b16-92f1-078cf786be11 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:49.599532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc4d0313-29ae-4b16-92f1-078cf786be11 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:49.600338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc4d0313-29ae-4b16-92f1-078cf786be11 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:49.601254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc4d0313-29ae-4b16-92f1-078cf786be11 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:49.601873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc4d0313-29ae-4b16-92f1-078cf786be11 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:49.602454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc4d0313-29ae-4b16-92f1-078cf786be11 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:49.795212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1135445946", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "421c7ba1-5780-4d34-a6ae-29674e2ce27b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1653418233", "security_groups": [{"name": "tempest-secgroup-smoke-1543485469"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:49.885903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dc4d0313-29ae-4b16-92f1-078cf786be11 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:49.901157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dc4d0313-29ae-4b16-92f1-078cf786be11 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:49.903013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dc4d0313-29ae-4b16-92f1-078cf786be11 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:49.904940 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dc4d0313-29ae-4b16-92f1-078cf786be11 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.328577 Aug 27 05:01:49.906823 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2601/5267] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:49 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:50.936414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-933d3baf-cd70-446d-aa40-9e86d6c72bb6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:50.937153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-933d3baf-cd70-446d-aa40-9e86d6c72bb6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:50.953054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-933d3baf-cd70-446d-aa40-9e86d6c72bb6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:50.956190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-933d3baf-cd70-446d-aa40-9e86d6c72bb6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:50.962915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-933d3baf-cd70-446d-aa40-9e86d6c72bb6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:50.964038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-933d3baf-cd70-446d-aa40-9e86d6c72bb6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:50.964787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-933d3baf-cd70-446d-aa40-9e86d6c72bb6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:50.965464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-933d3baf-cd70-446d-aa40-9e86d6c72bb6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:51.383452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-933d3baf-cd70-446d-aa40-9e86d6c72bb6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:51.397366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-933d3baf-cd70-446d-aa40-9e86d6c72bb6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:51.400840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-933d3baf-cd70-446d-aa40-9e86d6c72bb6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:51.405062 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-933d3baf-cd70-446d-aa40-9e86d6c72bb6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.470514 Aug 27 05:01:51.406498 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2602/5268] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:50 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:52.433208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0c31d873-50e9-449f-83d7-0be3df4d7968 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:52.433976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0c31d873-50e9-449f-83d7-0be3df4d7968 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:52.448923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:52.464425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c31d873-50e9-449f-83d7-0be3df4d7968 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:52.469301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c31d873-50e9-449f-83d7-0be3df4d7968 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:52.472080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c31d873-50e9-449f-83d7-0be3df4d7968 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:52.473828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c31d873-50e9-449f-83d7-0be3df4d7968 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:52.476346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c31d873-50e9-449f-83d7-0be3df4d7968 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:52.478122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c31d873-50e9-449f-83d7-0be3df4d7968 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:53.399226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0c31d873-50e9-449f-83d7-0be3df4d7968 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:53.408260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0c31d873-50e9-449f-83d7-0be3df4d7968 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:53.414176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0c31d873-50e9-449f-83d7-0be3df4d7968 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:53.416260 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0c31d873-50e9-449f-83d7-0be3df4d7968 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.986685 Aug 27 05:01:53.420403 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2603/5269] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:52 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:53.725130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0cff9e6b-2ae6-4563-8182-82f025ff9484 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Action: 'create', calling method: .version_select at 0x7f1f20f714c0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1414090982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdZxfcgHlXN4RB2+74GoUqjYFb7RWO84hklQLi7lFu6ozMZK1ZY25bQtXXJOhbCGvpMryINqx/sKI7R1Xhn9ffe5SsLSMFWQ1UgNllluPSy0va5hh1kQtTFG/6UOFVOiQ=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:53.749405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-0cff9e6b-2ae6-4563-8182-82f025ff9484 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Getting quotas for project 5cb264664558452095a2d83e8950dbeb. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:01:53.757068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-0cff9e6b-2ae6-4563-8182-82f025ff9484 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Getting quotas for user 277ff8e295684cd18d8c9dd5130dde1d and project 5cb264664558452095a2d83e8950dbeb. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:01:53.805285 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0cff9e6b-2ae6-4563-8182-82f025ff9484 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.383364 Aug 27 05:01:53.811428 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2604/5270] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:01:53 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:54.454797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1398d1ce-8f4d-464f-8d3f-e5ec44269345 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:54.461552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1398d1ce-8f4d-464f-8d3f-e5ec44269345 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:54.476579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1398d1ce-8f4d-464f-8d3f-e5ec44269345 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:54.477708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1398d1ce-8f4d-464f-8d3f-e5ec44269345 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:54.479439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1398d1ce-8f4d-464f-8d3f-e5ec44269345 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:54.480409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1398d1ce-8f4d-464f-8d3f-e5ec44269345 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:54.481065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1398d1ce-8f4d-464f-8d3f-e5ec44269345 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:54.481888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1398d1ce-8f4d-464f-8d3f-e5ec44269345 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:55.086884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1398d1ce-8f4d-464f-8d3f-e5ec44269345 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:55.105297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1398d1ce-8f4d-464f-8d3f-e5ec44269345 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:55.111468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1398d1ce-8f4d-464f-8d3f-e5ec44269345 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:55.114519 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1398d1ce-8f4d-464f-8d3f-e5ec44269345 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.674089 Aug 27 05:01:55.116690 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2605/5271] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:54 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:55.135347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0a065117-be9f-41ab-b953-b7662ab65d43 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:01:55.153340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0a065117-be9f-41ab-b953-b7662ab65d43 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:55.171827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a065117-be9f-41ab-b953-b7662ab65d43 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:55.173589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a065117-be9f-41ab-b953-b7662ab65d43 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:55.176426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a065117-be9f-41ab-b953-b7662ab65d43 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:55.177308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a065117-be9f-41ab-b953-b7662ab65d43 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:55.177945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a065117-be9f-41ab-b953-b7662ab65d43 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:55.178572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a065117-be9f-41ab-b953-b7662ab65d43 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:55.274751 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0a065117-be9f-41ab-b953-b7662ab65d43 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "POST /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5/action" status: 200 len: 24560 microversion: 2.1 time: 0.154504 Aug 27 05:01:55.275417 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2606/5272] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:01:55 2022] POST /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5/action => generated 24560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:01:56.146117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ac30f89f-e70f-4b4f-9034-a836fb2a73c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:56.146783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ac30f89f-e70f-4b4f-9034-a836fb2a73c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:56.181147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac30f89f-e70f-4b4f-9034-a836fb2a73c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:56.181961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac30f89f-e70f-4b4f-9034-a836fb2a73c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:56.182579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac30f89f-e70f-4b4f-9034-a836fb2a73c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:56.183505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac30f89f-e70f-4b4f-9034-a836fb2a73c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:56.183971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac30f89f-e70f-4b4f-9034-a836fb2a73c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:56.184399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac30f89f-e70f-4b4f-9034-a836fb2a73c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:56.301387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] validate_networks() for [('421c7ba1-5780-4d34-a6ae-29674e2ce27b', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:01:56.471038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac30f89f-e70f-4b4f-9034-a836fb2a73c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:56.498991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac30f89f-e70f-4b4f-9034-a836fb2a73c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:56.504025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac30f89f-e70f-4b4f-9034-a836fb2a73c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:56.518227 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ac30f89f-e70f-4b4f-9034-a836fb2a73c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1738 microversion: 2.20 time: 0.366093 Aug 27 05:01:56.532437 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2607/5273] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:56 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1738 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:01:56.616566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:56.916445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:01:56.917275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:01:56.918036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:01:56.918671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:01:56.919343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:01:56.933489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:56.934267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:56.934985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:56.936070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:56.936798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:56.937527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:56.965661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:01:56.974026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for user e508461869c24fb3ad1641d830e2b22a and project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:01:56.997943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:01:57.005020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:01:57.090651 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9306375-0ee7-4a5c-830e-4cef91c8f677 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 7.299456 Aug 27 05:01:57.094541 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2667/5274] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:01:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 7304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:01:57.113087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd3d3e6e-7ca0-4d84-937c-b6e02ac7f9b8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:57.114784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fd3d3e6e-7ca0-4d84-937c-b6e02ac7f9b8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:57.240640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fd3d3e6e-7ca0-4d84-937c-b6e02ac7f9b8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:57.252103 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fd3d3e6e-7ca0-4d84-937c-b6e02ac7f9b8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1267 microversion: 2.1 time: 0.149764 Aug 27 05:01:57.253653 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2608/5275] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:57 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:57.549211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a4334bb8-6567-4919-861e-9117a5e13e80 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:57.551076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a4334bb8-6567-4919-861e-9117a5e13e80 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:57.560150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4334bb8-6567-4919-861e-9117a5e13e80 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:57.561034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4334bb8-6567-4919-861e-9117a5e13e80 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:57.561769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4334bb8-6567-4919-861e-9117a5e13e80 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:57.562665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4334bb8-6567-4919-861e-9117a5e13e80 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:57.563284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4334bb8-6567-4919-861e-9117a5e13e80 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:57.564306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4334bb8-6567-4919-861e-9117a5e13e80 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:57.568501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=55 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:57.816476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a4334bb8-6567-4919-861e-9117a5e13e80 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:57.829528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a4334bb8-6567-4919-861e-9117a5e13e80 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:57.831973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a4334bb8-6567-4919-861e-9117a5e13e80 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:57.833272 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a4334bb8-6567-4919-861e-9117a5e13e80 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1720 microversion: 2.20 time: 0.290568 Aug 27 05:01:57.836990 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2668/5276] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:57 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1720 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:57.919817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ffc556f5-dd70-42a5-82d1-edf9cc3afae9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:57.920324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ffc556f5-dd70-42a5-82d1-edf9cc3afae9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:57.931296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc556f5-dd70-42a5-82d1-edf9cc3afae9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:57.931798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc556f5-dd70-42a5-82d1-edf9cc3afae9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:57.932231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc556f5-dd70-42a5-82d1-edf9cc3afae9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:57.933565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc556f5-dd70-42a5-82d1-edf9cc3afae9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:57.934028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc556f5-dd70-42a5-82d1-edf9cc3afae9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:57.939502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ffc556f5-dd70-42a5-82d1-edf9cc3afae9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:57.949973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=93 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:58.015307 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ffc556f5-dd70-42a5-82d1-edf9cc3afae9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/ips" status: 200 len: 144 microversion: 2.1 time: 0.100100 Aug 27 05:01:58.025520 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2609/5277] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 05:01:57 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/ips => generated 144 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:01:58.279857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f5fc32d-090f-4f4e-aff5-3f6a27c8ef35 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:58.280935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f5fc32d-090f-4f4e-aff5-3f6a27c8ef35 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:58.295948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f5fc32d-090f-4f4e-aff5-3f6a27c8ef35 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:58.299120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f5fc32d-090f-4f4e-aff5-3f6a27c8ef35 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:58.299638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f5fc32d-090f-4f4e-aff5-3f6a27c8ef35 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:58.301605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f5fc32d-090f-4f4e-aff5-3f6a27c8ef35 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:58.305904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f5fc32d-090f-4f4e-aff5-3f6a27c8ef35 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:58.306694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f5fc32d-090f-4f4e-aff5-3f6a27c8ef35 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:58.507828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f5fc32d-090f-4f4e-aff5-3f6a27c8ef35 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:58.523652 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f5fc32d-090f-4f4e-aff5-3f6a27c8ef35 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1263 microversion: 2.1 time: 0.246843 Aug 27 05:01:58.525331 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2669/5278] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:58 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1263 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:01:58.866460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-52a8e824-bf33-4694-9ea2-266f395ad559 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:58.868031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-52a8e824-bf33-4694-9ea2-266f395ad559 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:58.882297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52a8e824-bf33-4694-9ea2-266f395ad559 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:58.886630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52a8e824-bf33-4694-9ea2-266f395ad559 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:58.887442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52a8e824-bf33-4694-9ea2-266f395ad559 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:58.888587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52a8e824-bf33-4694-9ea2-266f395ad559 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:58.889220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52a8e824-bf33-4694-9ea2-266f395ad559 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:58.889845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52a8e824-bf33-4694-9ea2-266f395ad559 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:59.209812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-52a8e824-bf33-4694-9ea2-266f395ad559 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:59.224434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-52a8e824-bf33-4694-9ea2-266f395ad559 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:59.233522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-52a8e824-bf33-4694-9ea2-266f395ad559 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:59.241170 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-52a8e824-bf33-4694-9ea2-266f395ad559 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1720 microversion: 2.20 time: 0.379168 Aug 27 05:01:59.244097 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2610/5279] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:01:58 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1720 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:01:59.547618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33ad0b69-a05d-4661-8d8e-937e4f40a17d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:01:59.548231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33ad0b69-a05d-4661-8d8e-937e4f40a17d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:01:59.566896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33ad0b69-a05d-4661-8d8e-937e4f40a17d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:59.567679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33ad0b69-a05d-4661-8d8e-937e4f40a17d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:59.569620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33ad0b69-a05d-4661-8d8e-937e4f40a17d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:59.580385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33ad0b69-a05d-4661-8d8e-937e4f40a17d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:01:59.581152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33ad0b69-a05d-4661-8d8e-937e4f40a17d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:01:59.581615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33ad0b69-a05d-4661-8d8e-937e4f40a17d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:01:59.870907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33ad0b69-a05d-4661-8d8e-937e4f40a17d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:01:59.880129 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33ad0b69-a05d-4661-8d8e-937e4f40a17d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1263 microversion: 2.1 time: 0.336512 Aug 27 05:01:59.891747 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2670/5280] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:01:59 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1263 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:00.270218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1e65e736-d95d-44d6-aedd-91291c7e1de5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:00.272094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1e65e736-d95d-44d6-aedd-91291c7e1de5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:00.293057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e65e736-d95d-44d6-aedd-91291c7e1de5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:00.294838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e65e736-d95d-44d6-aedd-91291c7e1de5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:00.295291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e65e736-d95d-44d6-aedd-91291c7e1de5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:00.298384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e65e736-d95d-44d6-aedd-91291c7e1de5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:00.299133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e65e736-d95d-44d6-aedd-91291c7e1de5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:00.302163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e65e736-d95d-44d6-aedd-91291c7e1de5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:00.689037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e65e736-d95d-44d6-aedd-91291c7e1de5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:00.708784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e65e736-d95d-44d6-aedd-91291c7e1de5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:00.724927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e65e736-d95d-44d6-aedd-91291c7e1de5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:00.735215 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1e65e736-d95d-44d6-aedd-91291c7e1de5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1723 microversion: 2.20 time: 0.469496 Aug 27 05:02:00.739245 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2611/5281] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:00 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1723 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:00.781360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf3b965c-51f1-4726-97e5-7322c2b5d210 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73cab2e3-cf4f-44a5-8e76-0b9d6255bee6"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:00.784998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf3b965c-51f1-4726-97e5-7322c2b5d210 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:00.814451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3b965c-51f1-4726-97e5-7322c2b5d210 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:00.820964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3b965c-51f1-4726-97e5-7322c2b5d210 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:00.822056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3b965c-51f1-4726-97e5-7322c2b5d210 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:00.823102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3b965c-51f1-4726-97e5-7322c2b5d210 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:00.823797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3b965c-51f1-4726-97e5-7322c2b5d210 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:00.830083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3b965c-51f1-4726-97e5-7322c2b5d210 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:00.916175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5fca2bc1-692e-4771-bc83-f45f29e0bf32 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:00.924032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5fca2bc1-692e-4771-bc83-f45f29e0bf32 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:00.972465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fca2bc1-692e-4771-bc83-f45f29e0bf32 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:00.973694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fca2bc1-692e-4771-bc83-f45f29e0bf32 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:00.979132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fca2bc1-692e-4771-bc83-f45f29e0bf32 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:00.980817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fca2bc1-692e-4771-bc83-f45f29e0bf32 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:00.989992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fca2bc1-692e-4771-bc83-f45f29e0bf32 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:00.991102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fca2bc1-692e-4771-bc83-f45f29e0bf32 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:01.276444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5fca2bc1-692e-4771-bc83-f45f29e0bf32 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:01.288886 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5fca2bc1-692e-4771-bc83-f45f29e0bf32 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1327 microversion: 2.1 time: 0.377310 Aug 27 05:02:01.298825 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2612/5282] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:00 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1327 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:01.776025 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf3b965c-51f1-4726-97e5-7322c2b5d210 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "POST /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.999726 Aug 27 05:02:01.782898 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2671/5283] 10.222.0.79 () {62 vars in 1364 bytes} [Sat Aug 27 05:02:00 2022] POST /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments => generated 188 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:02:02.014955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-7d50ab49-cd38-4ded-80e9-072a83faa685 req-a440bf06-e369-4e91-bffb-5bfd41b90d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd1a40c-a36d-4253-9f1c-b5711b2ed52a", "name": "network-vif-unplugged", "status": "completed", "tag": "620b69e1-40ab-4292-881f-6f2fff934397"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:02.020784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-130ae8ca-7550-4103-8ca9-fe0ed65cb73b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:02.022992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-130ae8ca-7550-4103-8ca9-fe0ed65cb73b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:02.063665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7d50ab49-cd38-4ded-80e9-072a83faa685 req-a440bf06-e369-4e91-bffb-5bfd41b90d62 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:02.064260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-130ae8ca-7550-4103-8ca9-fe0ed65cb73b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:02.065142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7d50ab49-cd38-4ded-80e9-072a83faa685 req-a440bf06-e369-4e91-bffb-5bfd41b90d62 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:02.067135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-130ae8ca-7550-4103-8ca9-fe0ed65cb73b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:02.067722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-130ae8ca-7550-4103-8ca9-fe0ed65cb73b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:02.068360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7d50ab49-cd38-4ded-80e9-072a83faa685 req-a440bf06-e369-4e91-bffb-5bfd41b90d62 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:02.069344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-130ae8ca-7550-4103-8ca9-fe0ed65cb73b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:02.071419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-130ae8ca-7550-4103-8ca9-fe0ed65cb73b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:02.072696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-130ae8ca-7550-4103-8ca9-fe0ed65cb73b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:02.105466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.compute.server_external_events [req-7d50ab49-cd38-4ded-80e9-072a83faa685 req-a440bf06-e369-4e91-bffb-5bfd41b90d62 service nova] Unable to find a host for instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a. Dropping event network-vif-unplugged {{(pid=128870) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 05:02:02.106626 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-7d50ab49-cd38-4ded-80e9-072a83faa685 req-a440bf06-e369-4e91-bffb-5bfd41b90d62 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.109396 Aug 27 05:02:02.109665 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2613/5284] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 113 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 05:02:02.144239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-130ae8ca-7550-4103-8ca9-fe0ed65cb73b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128869) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 05:02:02.177910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2d748b45-a53e-4f59-a983-c040492a22ee tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8d52961-8c3e-4f76-b2cd-a09d0452c50d"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:02.181698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2d748b45-a53e-4f59-a983-c040492a22ee tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:02.204894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d748b45-a53e-4f59-a983-c040492a22ee tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:02.210981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d748b45-a53e-4f59-a983-c040492a22ee tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:02.213779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d748b45-a53e-4f59-a983-c040492a22ee tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:02.216010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d748b45-a53e-4f59-a983-c040492a22ee tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:02.217482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d748b45-a53e-4f59-a983-c040492a22ee tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:02.219200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d748b45-a53e-4f59-a983-c040492a22ee tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:02.357598 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-130ae8ca-7550-4103-8ca9-fe0ed65cb73b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "POST /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/action" status: 202 len: 0 microversion: 2.20 time: 0.357210 Aug 27 05:02:02.358258 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2672/5285] 10.222.0.79 () {62 vars in 1319 bytes} [Sat Aug 27 05:02:01 2022] POST /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:02:02.368434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-785ed606-dc24-4c50-948b-a1eb6045bd3f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:02.376094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-785ed606-dc24-4c50-948b-a1eb6045bd3f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:02.383651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785ed606-dc24-4c50-948b-a1eb6045bd3f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:02.384428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785ed606-dc24-4c50-948b-a1eb6045bd3f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:02.387028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785ed606-dc24-4c50-948b-a1eb6045bd3f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:02.388174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785ed606-dc24-4c50-948b-a1eb6045bd3f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:02.393208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785ed606-dc24-4c50-948b-a1eb6045bd3f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:02.393744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785ed606-dc24-4c50-948b-a1eb6045bd3f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:02.722729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-785ed606-dc24-4c50-948b-a1eb6045bd3f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:02.734736 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-785ed606-dc24-4c50-948b-a1eb6045bd3f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1325 microversion: 2.1 time: 0.375109 Aug 27 05:02:02.762165 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2673/5286] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:02 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1325 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:02.762165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-44f77fc6-cf94-4b69-a062-62079cf54871 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:02.762165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-44f77fc6-cf94-4b69-a062-62079cf54871 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:02.794048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44f77fc6-cf94-4b69-a062-62079cf54871 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:02.794623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44f77fc6-cf94-4b69-a062-62079cf54871 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:02.795015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44f77fc6-cf94-4b69-a062-62079cf54871 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:02.795835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44f77fc6-cf94-4b69-a062-62079cf54871 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:02.796241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44f77fc6-cf94-4b69-a062-62079cf54871 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:02.800379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44f77fc6-cf94-4b69-a062-62079cf54871 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:02.987895 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2d748b45-a53e-4f59-a983-c040492a22ee tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "POST /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812389 Aug 27 05:02:02.996803 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2614/5287] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:02:02 2022] POST /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments => generated 194 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:03.514948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-44f77fc6-cf94-4b69-a062-62079cf54871 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:03.524683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-44f77fc6-cf94-4b69-a062-62079cf54871 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:03.526133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-44f77fc6-cf94-4b69-a062-62079cf54871 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:03.527321 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-44f77fc6-cf94-4b69-a062-62079cf54871 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1749 microversion: 2.20 time: 0.774752 Aug 27 05:02:03.527907 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2674/5288] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:02 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1749 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:03.802505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ed50a5cb-e1b6-4bca-90b4-f475a8756e58 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:03.804245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ed50a5cb-e1b6-4bca-90b4-f475a8756e58 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:03.839258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed50a5cb-e1b6-4bca-90b4-f475a8756e58 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:03.839394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed50a5cb-e1b6-4bca-90b4-f475a8756e58 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:03.840348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed50a5cb-e1b6-4bca-90b4-f475a8756e58 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:03.840963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed50a5cb-e1b6-4bca-90b4-f475a8756e58 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:03.841511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed50a5cb-e1b6-4bca-90b4-f475a8756e58 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:03.842681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed50a5cb-e1b6-4bca-90b4-f475a8756e58 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:04.160813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed50a5cb-e1b6-4bca-90b4-f475a8756e58 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:04.176223 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ed50a5cb-e1b6-4bca-90b4-f475a8756e58 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1393 microversion: 2.1 time: 0.403848 Aug 27 05:02:04.177191 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2615/5289] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:03 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1393 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:04.555414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-571b8634-af6f-4c30-80f6-cbbab851cd54 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:04.556797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-571b8634-af6f-4c30-80f6-cbbab851cd54 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:04.576616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-571b8634-af6f-4c30-80f6-cbbab851cd54 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:04.580765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-571b8634-af6f-4c30-80f6-cbbab851cd54 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:04.581666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-571b8634-af6f-4c30-80f6-cbbab851cd54 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:04.583805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-571b8634-af6f-4c30-80f6-cbbab851cd54 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:04.588146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-571b8634-af6f-4c30-80f6-cbbab851cd54 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:04.591364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-571b8634-af6f-4c30-80f6-cbbab851cd54 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:05.202442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3009bd1f-d0b7-4aea-83d0-821daacad3c7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:05.203838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3009bd1f-d0b7-4aea-83d0-821daacad3c7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:05.225996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3009bd1f-d0b7-4aea-83d0-821daacad3c7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:05.226960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3009bd1f-d0b7-4aea-83d0-821daacad3c7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:05.227633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3009bd1f-d0b7-4aea-83d0-821daacad3c7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:05.230400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3009bd1f-d0b7-4aea-83d0-821daacad3c7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:05.231590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3009bd1f-d0b7-4aea-83d0-821daacad3c7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:05.233109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3009bd1f-d0b7-4aea-83d0-821daacad3c7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:05.295520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-571b8634-af6f-4c30-80f6-cbbab851cd54 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:05.312002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-571b8634-af6f-4c30-80f6-cbbab851cd54 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:05.314108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-571b8634-af6f-4c30-80f6-cbbab851cd54 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:05.321543 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-571b8634-af6f-4c30-80f6-cbbab851cd54 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1751 microversion: 2.20 time: 0.770130 Aug 27 05:02:05.322838 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2675/5290] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:04 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1751 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:05.535420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3009bd1f-d0b7-4aea-83d0-821daacad3c7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:05.547291 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3009bd1f-d0b7-4aea-83d0-821daacad3c7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1393 microversion: 2.1 time: 0.348325 Aug 27 05:02:05.559562 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2616/5291] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:05 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1393 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:06.351663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1c857fd4-2119-4a07-b656-cd662f337033 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:06.352287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1c857fd4-2119-4a07-b656-cd662f337033 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:06.371930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d68b5072-a36a-469b-907c-9409b829a89b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:06.375509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d68b5072-a36a-469b-907c-9409b829a89b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:06.379220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c857fd4-2119-4a07-b656-cd662f337033 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:06.379966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c857fd4-2119-4a07-b656-cd662f337033 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:06.381293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c857fd4-2119-4a07-b656-cd662f337033 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:06.382608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c857fd4-2119-4a07-b656-cd662f337033 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:06.383245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c857fd4-2119-4a07-b656-cd662f337033 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:06.383840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c857fd4-2119-4a07-b656-cd662f337033 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:06.393027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d68b5072-a36a-469b-907c-9409b829a89b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:06.395224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d68b5072-a36a-469b-907c-9409b829a89b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:06.395809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d68b5072-a36a-469b-907c-9409b829a89b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:06.397863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d68b5072-a36a-469b-907c-9409b829a89b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:06.398473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d68b5072-a36a-469b-907c-9409b829a89b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:06.401001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d68b5072-a36a-469b-907c-9409b829a89b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:06.488587 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d68b5072-a36a-469b-907c-9409b829a89b tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "POST /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5/action" status: 200 len: 32626 microversion: 2.1 time: 0.119607 Aug 27 05:02:06.489508 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2617/5292] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:02:06 2022] POST /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5/action => generated 32626 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:02:06.587482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-96edb67f-7259-485e-9760-7de155c4e28d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:06.588200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-96edb67f-7259-485e-9760-7de155c4e28d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:06.610742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96edb67f-7259-485e-9760-7de155c4e28d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:06.620025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96edb67f-7259-485e-9760-7de155c4e28d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:06.620964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96edb67f-7259-485e-9760-7de155c4e28d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:06.622213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96edb67f-7259-485e-9760-7de155c4e28d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:06.624337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96edb67f-7259-485e-9760-7de155c4e28d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:06.625860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96edb67f-7259-485e-9760-7de155c4e28d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:06.811085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c857fd4-2119-4a07-b656-cd662f337033 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:06.828902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c857fd4-2119-4a07-b656-cd662f337033 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:06.834281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c857fd4-2119-4a07-b656-cd662f337033 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:06.837210 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1c857fd4-2119-4a07-b656-cd662f337033 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1751 microversion: 2.20 time: 0.489508 Aug 27 05:02:06.843212 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2676/5293] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:06 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1751 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:07.016325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-96edb67f-7259-485e-9760-7de155c4e28d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:07.028944 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-96edb67f-7259-485e-9760-7de155c4e28d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1393 microversion: 2.1 time: 0.446067 Aug 27 05:02:07.050923 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2618/5294] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:06 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1393 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:07.140469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c9c81284-acbe-48b6-aa80-f66c15bd43d3 req-5ac07990-a192-4d41-af69-3717f247beef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c", "tag": "1c0cd31d-1134-43c3-8033-7756a472aa85"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:07.158302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:07.163210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:07.169118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9c81284-acbe-48b6-aa80-f66c15bd43d3 req-5ac07990-a192-4d41-af69-3717f247beef service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:07.169668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9c81284-acbe-48b6-aa80-f66c15bd43d3 req-5ac07990-a192-4d41-af69-3717f247beef service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:07.170107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9c81284-acbe-48b6-aa80-f66c15bd43d3 req-5ac07990-a192-4d41-af69-3717f247beef service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:07.214637 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c9c81284-acbe-48b6-aa80-f66c15bd43d3 req-5ac07990-a192-4d41-af69-3717f247beef service nova] Creating event network-changed:1c0cd31d-1134-43c3-8033-7756a472aa85 for instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c on n-h1-854823-1 Aug 27 05:02:07.229996 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c9c81284-acbe-48b6-aa80-f66c15bd43d3 req-5ac07990-a192-4d41-af69-3717f247beef service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094514 Aug 27 05:02:07.233312 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2677/5295] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:07.867419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a9a67eac-86c7-4edb-8254-566712950dce tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:07.868340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a9a67eac-86c7-4edb-8254-566712950dce tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:07.871241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:07.890043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9a67eac-86c7-4edb-8254-566712950dce tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:07.890563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9a67eac-86c7-4edb-8254-566712950dce tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:07.891001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9a67eac-86c7-4edb-8254-566712950dce tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:07.891743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9a67eac-86c7-4edb-8254-566712950dce tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:07.892203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9a67eac-86c7-4edb-8254-566712950dce tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:07.896718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9a67eac-86c7-4edb-8254-566712950dce tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:08.053198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d6f3fe6-5c88-42bb-86f2-7c91c07c1152 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:08.054567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d6f3fe6-5c88-42bb-86f2-7c91c07c1152 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:08.071773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6f3fe6-5c88-42bb-86f2-7c91c07c1152 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:08.074454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6f3fe6-5c88-42bb-86f2-7c91c07c1152 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:08.075102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6f3fe6-5c88-42bb-86f2-7c91c07c1152 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:08.076398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6f3fe6-5c88-42bb-86f2-7c91c07c1152 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:08.078961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6f3fe6-5c88-42bb-86f2-7c91c07c1152 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:08.082103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6f3fe6-5c88-42bb-86f2-7c91c07c1152 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:08.397283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d6f3fe6-5c88-42bb-86f2-7c91c07c1152 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:08.409619 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d6f3fe6-5c88-42bb-86f2-7c91c07c1152 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1393 microversion: 2.1 time: 0.361212 Aug 27 05:02:08.410234 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2678/5296] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:08 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1393 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:08.689832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a9a67eac-86c7-4edb-8254-566712950dce tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:08.707455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a9a67eac-86c7-4edb-8254-566712950dce tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:08.709002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a9a67eac-86c7-4edb-8254-566712950dce tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:08.710228 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a9a67eac-86c7-4edb-8254-566712950dce tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1751 microversion: 2.20 time: 0.849600 Aug 27 05:02:08.716779 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2619/5297] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:07 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1751 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:08.929152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0a2665b-8be0-43ec-9a9e-9e31fd5be799 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:08.930133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0a2665b-8be0-43ec-9a9e-9e31fd5be799 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:08.941956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a2665b-8be0-43ec-9a9e-9e31fd5be799 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:08.943916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a2665b-8be0-43ec-9a9e-9e31fd5be799 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:08.944639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a2665b-8be0-43ec-9a9e-9e31fd5be799 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:08.946148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a2665b-8be0-43ec-9a9e-9e31fd5be799 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:08.947695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a2665b-8be0-43ec-9a9e-9e31fd5be799 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:08.948340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a2665b-8be0-43ec-9a9e-9e31fd5be799 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:08.951255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a30b30d9-70cf-4b37-a20d-4005e745c7ed req-dd5fbfe0-5bb6-40df-bd23-e028f6725a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0391d663-2bf9-4363-922e-338c94829bf5", "tag": "6eb2d37f-1d73-4f5b-aa9b-d1f28643976e"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:08.974053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a30b30d9-70cf-4b37-a20d-4005e745c7ed req-dd5fbfe0-5bb6-40df-bd23-e028f6725a69 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:08.974907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a30b30d9-70cf-4b37-a20d-4005e745c7ed req-dd5fbfe0-5bb6-40df-bd23-e028f6725a69 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:08.975694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a30b30d9-70cf-4b37-a20d-4005e745c7ed req-dd5fbfe0-5bb6-40df-bd23-e028f6725a69 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:09.013180 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a30b30d9-70cf-4b37-a20d-4005e745c7ed req-dd5fbfe0-5bb6-40df-bd23-e028f6725a69 service nova] Creating event network-changed:6eb2d37f-1d73-4f5b-aa9b-d1f28643976e for instance 0391d663-2bf9-4363-922e-338c94829bf5 on n-h2-854823-1 Aug 27 05:02:09.016155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0a2665b-8be0-43ec-9a9e-9e31fd5be799 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:02:09.026806 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a30b30d9-70cf-4b37-a20d-4005e745c7ed req-dd5fbfe0-5bb6-40df-bd23-e028f6725a69 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078642 Aug 27 05:02:09.029095 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2620/5298] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:09.256802 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0a2665b-8be0-43ec-9a9e-9e31fd5be799 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 204 len: 0 microversion: 2.1 time: 0.331472 Aug 27 05:02:09.257880 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2679/5299] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:02:08 2022] DELETE /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:02:09.269545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e851ecc-39d1-4ff7-a68e-91cd976f2a47 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:09.270533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3e851ecc-39d1-4ff7-a68e-91cd976f2a47 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:09.286014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e851ecc-39d1-4ff7-a68e-91cd976f2a47 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:09.288446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e851ecc-39d1-4ff7-a68e-91cd976f2a47 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:09.289250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e851ecc-39d1-4ff7-a68e-91cd976f2a47 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:09.290576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e851ecc-39d1-4ff7-a68e-91cd976f2a47 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:09.295070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e851ecc-39d1-4ff7-a68e-91cd976f2a47 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:09.295563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e851ecc-39d1-4ff7-a68e-91cd976f2a47 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:09.442500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3ff8311-d241-4c4b-b218-2a08fe99e57e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:09.442500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3ff8311-d241-4c4b-b218-2a08fe99e57e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:09.458023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3ff8311-d241-4c4b-b218-2a08fe99e57e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:09.461622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3ff8311-d241-4c4b-b218-2a08fe99e57e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:09.462420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3ff8311-d241-4c4b-b218-2a08fe99e57e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:09.465563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3ff8311-d241-4c4b-b218-2a08fe99e57e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:09.466289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3ff8311-d241-4c4b-b218-2a08fe99e57e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:09.470135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3ff8311-d241-4c4b-b218-2a08fe99e57e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:09.485785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:09.530799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3e851ecc-39d1-4ff7-a68e-91cd976f2a47 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:09.541379 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3e851ecc-39d1-4ff7-a68e-91cd976f2a47 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1671 microversion: 2.1 time: 0.278644 Aug 27 05:02:09.542426 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2621/5300] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:09 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1671 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:09.548270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-522704998-access_point-432009428", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "a148202d-687b-42e2-b03a-a8c41c0c719e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1414090982", "security_groups": [{"name": "tempest-secgroup_access--1064892722"}, {"name": "tempest-secgroup_general--1539936423"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:09.777920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3ff8311-d241-4c4b-b218-2a08fe99e57e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:09.791189 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3ff8311-d241-4c4b-b218-2a08fe99e57e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1393 microversion: 2.1 time: 0.357557 Aug 27 05:02:09.793154 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2680/5301] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:09 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1393 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:09.803180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e2cb1f15-fcfb-43d9-aa3a-b6b50646089d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:09.804047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e2cb1f15-fcfb-43d9-aa3a-b6b50646089d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:09.828653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2cb1f15-fcfb-43d9-aa3a-b6b50646089d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:09.829526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2cb1f15-fcfb-43d9-aa3a-b6b50646089d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:09.830127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2cb1f15-fcfb-43d9-aa3a-b6b50646089d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:09.831796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2cb1f15-fcfb-43d9-aa3a-b6b50646089d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:09.832631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2cb1f15-fcfb-43d9-aa3a-b6b50646089d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:09.833230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2cb1f15-fcfb-43d9-aa3a-b6b50646089d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:09.843760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] validate_networks() for [('a148202d-687b-42e2-b03a-a8c41c0c719e', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:02:10.112811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e2cb1f15-fcfb-43d9-aa3a-b6b50646089d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:10.142329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e2cb1f15-fcfb-43d9-aa3a-b6b50646089d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:10.147419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e2cb1f15-fcfb-43d9-aa3a-b6b50646089d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:10.150712 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e2cb1f15-fcfb-43d9-aa3a-b6b50646089d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1751 microversion: 2.20 time: 0.356148 Aug 27 05:02:10.164955 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2681/5302] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:09 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1751 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:10.365180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:02:10.365854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:02:10.383948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:02:10.385070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:02:10.390376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:02:10.423618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:10.424124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:10.425211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:10.425964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:10.426438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:10.426864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:10.496971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Getting quotas for project 5cb264664558452095a2d83e8950dbeb. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:02:10.515088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Getting quotas for user 277ff8e295684cd18d8c9dd5130dde1d and project 5cb264664558452095a2d83e8950dbeb. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:02:10.557828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:02:10.560767 n-d-854823-1 devstack@n-api.service[128870]: WARNING nova.utils [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-522704998-access_point-432009428 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-522704998-acc Aug 27 05:02:10.561773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:02:10.565670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-323d0f25-7e67-435a-8525-5e242c349579 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:10.566403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-323d0f25-7e67-435a-8525-5e242c349579 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:10.574952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-323d0f25-7e67-435a-8525-5e242c349579 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:10.575719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-323d0f25-7e67-435a-8525-5e242c349579 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:10.576343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-323d0f25-7e67-435a-8525-5e242c349579 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:10.577293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-323d0f25-7e67-435a-8525-5e242c349579 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:10.577756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-323d0f25-7e67-435a-8525-5e242c349579 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:10.578324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-323d0f25-7e67-435a-8525-5e242c349579 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:10.712562 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1d7f8843-b372-47b7-91d2-f4f05531bd3d tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.168226 Aug 27 05:02:10.716768 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2622/5303] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:02:09 2022] POST /compute/v2.1/servers => generated 458 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:02:10.728376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c3188820-1be3-42c6-9d9c-e28b5bdfe3be tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:10.731928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c3188820-1be3-42c6-9d9c-e28b5bdfe3be tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:10.744038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3188820-1be3-42c6-9d9c-e28b5bdfe3be tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:10.745023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3188820-1be3-42c6-9d9c-e28b5bdfe3be tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:10.745690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3188820-1be3-42c6-9d9c-e28b5bdfe3be tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:10.747110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3188820-1be3-42c6-9d9c-e28b5bdfe3be tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:10.747914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3188820-1be3-42c6-9d9c-e28b5bdfe3be tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:10.748682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3188820-1be3-42c6-9d9c-e28b5bdfe3be tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:12.283747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-323d0f25-7e67-435a-8525-5e242c349579 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:12.289313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c3188820-1be3-42c6-9d9c-e28b5bdfe3be tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:12.306089 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-323d0f25-7e67-435a-8525-5e242c349579 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1671 microversion: 2.1 time: 1.746500 Aug 27 05:02:12.307535 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2682/5304] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:10 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1671 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:12.310138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c3188820-1be3-42c6-9d9c-e28b5bdfe3be tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:12.317961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f839be57-7c44-4dde-9ebb-1d4f91f2de4c tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:12.321846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c3188820-1be3-42c6-9d9c-e28b5bdfe3be tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:12.323703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f839be57-7c44-4dde-9ebb-1d4f91f2de4c tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:12.326280 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c3188820-1be3-42c6-9d9c-e28b5bdfe3be tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 2947 microversion: 2.42 time: 1.604485 Aug 27 05:02:12.327921 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2623/5305] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:10 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 2947 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:12.341488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f839be57-7c44-4dde-9ebb-1d4f91f2de4c tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:12.342383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f839be57-7c44-4dde-9ebb-1d4f91f2de4c tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:12.343041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f839be57-7c44-4dde-9ebb-1d4f91f2de4c tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:12.345289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e135e81f-ebb7-4b54-ab10-c64cb3f2c271 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:12.345943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e135e81f-ebb7-4b54-ab10-c64cb3f2c271 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:12.347314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f839be57-7c44-4dde-9ebb-1d4f91f2de4c tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:12.348120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f839be57-7c44-4dde-9ebb-1d4f91f2de4c tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:12.349177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f839be57-7c44-4dde-9ebb-1d4f91f2de4c tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:12.364018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e135e81f-ebb7-4b54-ab10-c64cb3f2c271 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:12.365417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e135e81f-ebb7-4b54-ab10-c64cb3f2c271 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:12.366547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e135e81f-ebb7-4b54-ab10-c64cb3f2c271 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:12.373176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e135e81f-ebb7-4b54-ab10-c64cb3f2c271 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:12.374360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e135e81f-ebb7-4b54-ab10-c64cb3f2c271 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:12.374827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e135e81f-ebb7-4b54-ab10-c64cb3f2c271 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:12.835627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e135e81f-ebb7-4b54-ab10-c64cb3f2c271 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:12.848041 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e135e81f-ebb7-4b54-ab10-c64cb3f2c271 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1393 microversion: 2.1 time: 0.511243 Aug 27 05:02:12.851952 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2624/5306] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:12 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1393 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:12.863482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-97cc29c8-39b9-4706-af7f-3295730e79d7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:12.865203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-97cc29c8-39b9-4706-af7f-3295730e79d7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:12.880105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97cc29c8-39b9-4706-af7f-3295730e79d7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:12.881667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97cc29c8-39b9-4706-af7f-3295730e79d7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:12.882561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97cc29c8-39b9-4706-af7f-3295730e79d7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:12.884814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97cc29c8-39b9-4706-af7f-3295730e79d7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:12.885536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97cc29c8-39b9-4706-af7f-3295730e79d7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:12.886196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97cc29c8-39b9-4706-af7f-3295730e79d7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:13.123712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-97cc29c8-39b9-4706-af7f-3295730e79d7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:13.135096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-97cc29c8-39b9-4706-af7f-3295730e79d7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:13.136711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-97cc29c8-39b9-4706-af7f-3295730e79d7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:13.138705 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-97cc29c8-39b9-4706-af7f-3295730e79d7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1751 microversion: 2.20 time: 0.284875 Aug 27 05:02:13.139623 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2625/5307] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:12 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1751 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:13.164658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31945599-c8d5-4490-9fd4-1001ef3d4263 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:13.165774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-31945599-c8d5-4490-9fd4-1001ef3d4263 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:13.174929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31945599-c8d5-4490-9fd4-1001ef3d4263 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:13.176338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31945599-c8d5-4490-9fd4-1001ef3d4263 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:13.177070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31945599-c8d5-4490-9fd4-1001ef3d4263 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:13.178102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31945599-c8d5-4490-9fd4-1001ef3d4263 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:13.178988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31945599-c8d5-4490-9fd4-1001ef3d4263 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:13.179695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31945599-c8d5-4490-9fd4-1001ef3d4263 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:13.254581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f839be57-7c44-4dde-9ebb-1d4f91f2de4c tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:13.274811 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f839be57-7c44-4dde-9ebb-1d4f91f2de4c tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 200 len: 1345 microversion: 2.1 time: 0.965901 Aug 27 05:02:13.275422 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2683/5308] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:12 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 1345 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:13.334032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52c21e33-0e8d-4dd3-aac7-6282885c65ca tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:13.336276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-52c21e33-0e8d-4dd3-aac7-6282885c65ca tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:13.351750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c21e33-0e8d-4dd3-aac7-6282885c65ca tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:13.353605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c21e33-0e8d-4dd3-aac7-6282885c65ca tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:13.356728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c21e33-0e8d-4dd3-aac7-6282885c65ca tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:13.362668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c21e33-0e8d-4dd3-aac7-6282885c65ca tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:13.364417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c21e33-0e8d-4dd3-aac7-6282885c65ca tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:13.365098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c21e33-0e8d-4dd3-aac7-6282885c65ca tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:13.489314 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-31945599-c8d5-4490-9fd4-1001ef3d4263 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.335596 Aug 27 05:02:13.491549 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2626/5309] 10.222.0.79 () {60 vars in 1316 bytes} [Sat Aug 27 05:02:13 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64/os-interface => generated 1830 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:13.871747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-fd264428-57b1-46ba-8c47-24f6be94313e req-ea344ed8-9947-46e2-a20b-42b6c3ebcce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0391d663-2bf9-4363-922e-338c94829bf5", "name": "network-vif-deleted", "tag": "6eb2d37f-1d73-4f5b-aa9b-d1f28643976e"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:13.885425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52c21e33-0e8d-4dd3-aac7-6282885c65ca tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a461972bdc04f17b181940db823dbe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85633ba41ad24104bbe326cae9b1cfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:13.895963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fd264428-57b1-46ba-8c47-24f6be94313e req-ea344ed8-9947-46e2-a20b-42b6c3ebcce9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:13.896482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fd264428-57b1-46ba-8c47-24f6be94313e req-ea344ed8-9947-46e2-a20b-42b6c3ebcce9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:13.897183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fd264428-57b1-46ba-8c47-24f6be94313e req-ea344ed8-9947-46e2-a20b-42b6c3ebcce9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:13.898721 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52c21e33-0e8d-4dd3-aac7-6282885c65ca tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 200 len: 1552 microversion: 2.1 time: 0.572829 Aug 27 05:02:13.903370 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2684/5310] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:13 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 1552 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:13.911757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4ef169c-7fc6-4350-bdeb-d9eec7d4463c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:13.912399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e4ef169c-7fc6-4350-bdeb-d9eec7d4463c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:13.918754 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-fd264428-57b1-46ba-8c47-24f6be94313e req-ea344ed8-9947-46e2-a20b-42b6c3ebcce9 service nova] Creating event network-vif-deleted:6eb2d37f-1d73-4f5b-aa9b-d1f28643976e for instance 0391d663-2bf9-4363-922e-338c94829bf5 on n-h2-854823-1 Aug 27 05:02:13.928381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4ef169c-7fc6-4350-bdeb-d9eec7d4463c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:13.928922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4ef169c-7fc6-4350-bdeb-d9eec7d4463c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:13.929366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4ef169c-7fc6-4350-bdeb-d9eec7d4463c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:13.930130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4ef169c-7fc6-4350-bdeb-d9eec7d4463c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:13.930578 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-fd264428-57b1-46ba-8c47-24f6be94313e req-ea344ed8-9947-46e2-a20b-42b6c3ebcce9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061594 Aug 27 05:02:13.930698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4ef169c-7fc6-4350-bdeb-d9eec7d4463c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:13.931129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4ef169c-7fc6-4350-bdeb-d9eec7d4463c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:13.944386 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2627/5311] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:14.171113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bb0061e2-86f4-4665-8bf7-7334cd78b91c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:14.171879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bb0061e2-86f4-4665-8bf7-7334cd78b91c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:14.181871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb0061e2-86f4-4665-8bf7-7334cd78b91c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:14.182325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb0061e2-86f4-4665-8bf7-7334cd78b91c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:14.182763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb0061e2-86f4-4665-8bf7-7334cd78b91c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:14.183487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb0061e2-86f4-4665-8bf7-7334cd78b91c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:14.183953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb0061e2-86f4-4665-8bf7-7334cd78b91c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:14.191536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb0061e2-86f4-4665-8bf7-7334cd78b91c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:14.194816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:14.494209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bb0061e2-86f4-4665-8bf7-7334cd78b91c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:14.523818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bb0061e2-86f4-4665-8bf7-7334cd78b91c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:14.526484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bb0061e2-86f4-4665-8bf7-7334cd78b91c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:14.529578 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bb0061e2-86f4-4665-8bf7-7334cd78b91c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1751 microversion: 2.20 time: 0.363106 Aug 27 05:02:14.542936 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2628/5312] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:14 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1751 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:02:14.557533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-03de8701-3168-4e5b-a3b8-69531de04236 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:14.558236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-03de8701-3168-4e5b-a3b8-69531de04236 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:14.565826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03de8701-3168-4e5b-a3b8-69531de04236 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:14.566241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03de8701-3168-4e5b-a3b8-69531de04236 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:14.566689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03de8701-3168-4e5b-a3b8-69531de04236 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:14.567554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03de8701-3168-4e5b-a3b8-69531de04236 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:14.568011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03de8701-3168-4e5b-a3b8-69531de04236 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:14.568448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03de8701-3168-4e5b-a3b8-69531de04236 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:14.572628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e4ef169c-7fc6-4350-bdeb-d9eec7d4463c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:14.583121 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e4ef169c-7fc6-4350-bdeb-d9eec7d4463c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1393 microversion: 2.1 time: 0.678153 Aug 27 05:02:14.584026 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2685/5313] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:13 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1393 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:14.665866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-03de8701-3168-4e5b-a3b8-69531de04236 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:14.683045 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-03de8701-3168-4e5b-a3b8-69531de04236 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 200 len: 1351 microversion: 2.1 time: 0.138551 Aug 27 05:02:14.683667 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2629/5314] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:14 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 1351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:14.932686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d1af7e5-0c92-4cf9-83a2-734c8b62ccad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:14.933843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d1af7e5-0c92-4cf9-83a2-734c8b62ccad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] [instance: 0391d663-2bf9-4363-922e-338c94829bf5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:14.948428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d1af7e5-0c92-4cf9-83a2-734c8b62ccad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:14.949018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d1af7e5-0c92-4cf9-83a2-734c8b62ccad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:14.949637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d1af7e5-0c92-4cf9-83a2-734c8b62ccad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:14.952785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d1af7e5-0c92-4cf9-83a2-734c8b62ccad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:14.953465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d1af7e5-0c92-4cf9-83a2-734c8b62ccad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:14.955011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d1af7e5-0c92-4cf9-83a2-734c8b62ccad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:14.989147 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9d1af7e5-0c92-4cf9-83a2-734c8b62ccad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] HTTP exception thrown: Instance 0391d663-2bf9-4363-922e-338c94829bf5 could not be found. Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d1af7e5-0c92-4cf9-83a2-734c8b62ccad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Request method failure captured: Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 HTTP/1.1 Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaRM811Cx00m9jBTaHXe0XCWofY4WpsKYZc8Y3tH-Cux9k1apGsuVmCc7AXjzDFvxmuBqv1wXnyU10Y54VL9C7EUSbQ0UeedSn36RYRi2CgG4nqfpfouZFGiY-PcdEUKUfUM0mqv4gO_cyQju9ojG0KU9qc-XPQFc7LlN9iCLhw4oC8 Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 85633ba41ad24104bbe326cae9b1cfdc Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestNetworkBasicOps-265431408 Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/85633ba41ad24104bbe326cae9b1cfdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_85633ba41ad24104bbe326cae9b1cfdc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/85633ba41ad24104bbe326cae9b1cfdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/85633ba41ad24104bbe326cae9b1cfdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestNetworkBasicOps-265431408 Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 85633ba41ad24104bbe326cae9b1cfdc Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestNetworkBasicOps-265431408 Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestNetworkBasicOps-265431408-project Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 9a461972bdc04f17b181940db823dbe0 Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestNetworkBasicOps-265431408-project Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 0391d663-2bf9-4363-922e-338c94829bf5 could not be found. Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '0391d663-2bf9-4363-922e-338c94829bf5'} Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0391d663-2bf9-4363-922e-338c94829bf5 could not be found. Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0391d663-2bf9-4363-922e-338c94829bf5 could not be found. Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:02:14.998766 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:02:15.006348 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:02:15.006348 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:02:15.006348 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:02:15.006348 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:02:15.006348 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:02:15.006348 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0391d663-2bf9-4363-922e-338c94829bf5 could not be found. Aug 27 05:02:15.006348 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:02:15.006348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d1af7e5-0c92-4cf9-83a2-734c8b62ccad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Returning 404 to user: Instance 0391d663-2bf9-4363-922e-338c94829bf5 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:02:15.006348 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d1af7e5-0c92-4cf9-83a2-734c8b62ccad tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5" status: 404 len: 111 microversion: 2.1 time: 0.074731 Aug 27 05:02:15.006348 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2686/5315] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:14 2022] GET /compute/v2.1/servers/0391d663-2bf9-4363-922e-338c94829bf5 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:02:15.398246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a14774c-d543-467c-986c-c24c8443b053 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] Calling method '.version_select at 0x7f1f2097e280>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:15.446028 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a14774c-d543-467c-986c-c24c8443b053 tempest-TestNetworkBasicOps-265431408 tempest-TestNetworkBasicOps-265431408-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1522682117" status: 202 len: 0 microversion: 2.1 time: 0.052987 Aug 27 05:02:15.447232 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2630/5316] 10.222.0.79 () {58 vars in 1257 bytes} [Sat Aug 27 05:02:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1522682117 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:02:15.557858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f21701b-fa38-43aa-be8b-df0a894eb7b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:15.558921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f21701b-fa38-43aa-be8b-df0a894eb7b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:15.571724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f21701b-fa38-43aa-be8b-df0a894eb7b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:15.575138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f21701b-fa38-43aa-be8b-df0a894eb7b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:15.578964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f21701b-fa38-43aa-be8b-df0a894eb7b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:15.580030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f21701b-fa38-43aa-be8b-df0a894eb7b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:15.581327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f21701b-fa38-43aa-be8b-df0a894eb7b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:15.583547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f21701b-fa38-43aa-be8b-df0a894eb7b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:15.605754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6d219fa9-24c4-4013-86c5-1d855e45602c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:15.607236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6d219fa9-24c4-4013-86c5-1d855e45602c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:15.626259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d219fa9-24c4-4013-86c5-1d855e45602c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:15.627068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d219fa9-24c4-4013-86c5-1d855e45602c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:15.633160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d219fa9-24c4-4013-86c5-1d855e45602c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:15.633991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d219fa9-24c4-4013-86c5-1d855e45602c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:15.638638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d219fa9-24c4-4013-86c5-1d855e45602c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:15.644125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d219fa9-24c4-4013-86c5-1d855e45602c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:15.979455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f21701b-fa38-43aa-be8b-df0a894eb7b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:15.996209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f21701b-fa38-43aa-be8b-df0a894eb7b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:16.003302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f21701b-fa38-43aa-be8b-df0a894eb7b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:16.003849 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f21701b-fa38-43aa-be8b-df0a894eb7b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1751 microversion: 2.20 time: 0.449457 Aug 27 05:02:16.030501 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2687/5317] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:15 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1751 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:16.038256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f2607d1-a269-4523-95f6-9d284d009d05 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:16.041229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f2607d1-a269-4523-95f6-9d284d009d05 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:16.048890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f2607d1-a269-4523-95f6-9d284d009d05 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:16.051248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f2607d1-a269-4523-95f6-9d284d009d05 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:16.052523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f2607d1-a269-4523-95f6-9d284d009d05 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:16.053529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f2607d1-a269-4523-95f6-9d284d009d05 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:16.054166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f2607d1-a269-4523-95f6-9d284d009d05 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:16.054756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f2607d1-a269-4523-95f6-9d284d009d05 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:16.130472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6d219fa9-24c4-4013-86c5-1d855e45602c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:16.144701 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6d219fa9-24c4-4013-86c5-1d855e45602c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1393 microversion: 2.1 time: 0.537534 Aug 27 05:02:16.146455 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2631/5318] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:15 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1393 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:16.151839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-f1ff69f3-6a9b-42fc-b6f2-6d22366b1b1b req-40f48bce-a141-4391-9099-7e42c1dcf01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c", "name": "network-vif-plugged", "status": "completed", "tag": "1c0cd31d-1134-43c3-8033-7756a472aa85"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:16.170837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f1ff69f3-6a9b-42fc-b6f2-6d22366b1b1b req-40f48bce-a141-4391-9099-7e42c1dcf01c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:16.172679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f1ff69f3-6a9b-42fc-b6f2-6d22366b1b1b req-40f48bce-a141-4391-9099-7e42c1dcf01c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:16.173360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f1ff69f3-6a9b-42fc-b6f2-6d22366b1b1b req-40f48bce-a141-4391-9099-7e42c1dcf01c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:16.194325 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f1ff69f3-6a9b-42fc-b6f2-6d22366b1b1b req-40f48bce-a141-4391-9099-7e42c1dcf01c service nova] Creating event network-vif-plugged:1c0cd31d-1134-43c3-8033-7756a472aa85 for instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c on n-h1-854823-1 Aug 27 05:02:16.211478 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-f1ff69f3-6a9b-42fc-b6f2-6d22366b1b1b req-40f48bce-a141-4391-9099-7e42c1dcf01c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063421 Aug 27 05:02:16.212470 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2632/5319] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:16.333354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-fe6a2f81-af38-4da9-8073-1b9e262529b1 req-3c962506-9f62-4e64-8c1a-1bbb510d329c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63fd1673-2a84-4740-9748-f9d2d180a067", "tag": "479d2ba7-3e50-4a5f-bd9e-c5e2872feff5"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:16.355620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fe6a2f81-af38-4da9-8073-1b9e262529b1 req-3c962506-9f62-4e64-8c1a-1bbb510d329c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:16.356116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fe6a2f81-af38-4da9-8073-1b9e262529b1 req-3c962506-9f62-4e64-8c1a-1bbb510d329c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:16.356584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fe6a2f81-af38-4da9-8073-1b9e262529b1 req-3c962506-9f62-4e64-8c1a-1bbb510d329c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:16.383169 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-fe6a2f81-af38-4da9-8073-1b9e262529b1 req-3c962506-9f62-4e64-8c1a-1bbb510d329c service nova] Creating event network-changed:479d2ba7-3e50-4a5f-bd9e-c5e2872feff5 for instance 63fd1673-2a84-4740-9748-f9d2d180a067 on n-h2-854823-1 Aug 27 05:02:16.391073 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-fe6a2f81-af38-4da9-8073-1b9e262529b1 req-3c962506-9f62-4e64-8c1a-1bbb510d329c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061720 Aug 27 05:02:16.392242 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2633/5320] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:02:16.447860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f2607d1-a269-4523-95f6-9d284d009d05 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:16.456238 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f2607d1-a269-4523-95f6-9d284d009d05 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 200 len: 1471 microversion: 2.1 time: 0.424286 Aug 27 05:02:16.470522 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2688/5321] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:16 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 1471 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:17.046404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6397f468-480b-4150-94e9-6de9e5eee50a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:17.047737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6397f468-480b-4150-94e9-6de9e5eee50a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:17.056067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6397f468-480b-4150-94e9-6de9e5eee50a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:17.056588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6397f468-480b-4150-94e9-6de9e5eee50a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:17.057017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6397f468-480b-4150-94e9-6de9e5eee50a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:17.057722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6397f468-480b-4150-94e9-6de9e5eee50a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:17.058223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6397f468-480b-4150-94e9-6de9e5eee50a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:17.059215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6397f468-480b-4150-94e9-6de9e5eee50a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:17.162008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-567b43ea-3073-49fa-8817-6c8aa9c58d09 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:17.163398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-567b43ea-3073-49fa-8817-6c8aa9c58d09 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:17.171667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-567b43ea-3073-49fa-8817-6c8aa9c58d09 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:17.172325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-567b43ea-3073-49fa-8817-6c8aa9c58d09 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:17.172809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-567b43ea-3073-49fa-8817-6c8aa9c58d09 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:17.173589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-567b43ea-3073-49fa-8817-6c8aa9c58d09 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:17.175075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-567b43ea-3073-49fa-8817-6c8aa9c58d09 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:17.175520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-567b43ea-3073-49fa-8817-6c8aa9c58d09 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:17.316453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6397f468-480b-4150-94e9-6de9e5eee50a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:17.327505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6397f468-480b-4150-94e9-6de9e5eee50a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:17.329501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6397f468-480b-4150-94e9-6de9e5eee50a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:17.331287 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6397f468-480b-4150-94e9-6de9e5eee50a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1751 microversion: 2.20 time: 0.291309 Aug 27 05:02:17.336497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-567b43ea-3073-49fa-8817-6c8aa9c58d09 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:17.337518 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2634/5322] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:17 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1751 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:17.349191 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-567b43ea-3073-49fa-8817-6c8aa9c58d09 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1393 microversion: 2.1 time: 0.191656 Aug 27 05:02:17.349787 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2689/5323] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:17 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1393 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:17.454786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a88d790b-2d47-4a5b-ae10-4ec5b18dbae3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "122c190c-4b42-4ea2-91a1-728a99320025", "device": "/dev/sdb"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:17.457758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a88d790b-2d47-4a5b-ae10-4ec5b18dbae3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:17.464678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a88d790b-2d47-4a5b-ae10-4ec5b18dbae3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:17.465491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a88d790b-2d47-4a5b-ae10-4ec5b18dbae3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:17.466266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a88d790b-2d47-4a5b-ae10-4ec5b18dbae3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:17.467381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a88d790b-2d47-4a5b-ae10-4ec5b18dbae3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:17.468002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a88d790b-2d47-4a5b-ae10-4ec5b18dbae3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:17.468709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a88d790b-2d47-4a5b-ae10-4ec5b18dbae3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:17.477309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86fe4f5d-82ef-4b20-867a-1a3d5f48e250 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:17.477941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86fe4f5d-82ef-4b20-867a-1a3d5f48e250 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:17.494996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86fe4f5d-82ef-4b20-867a-1a3d5f48e250 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:17.495510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86fe4f5d-82ef-4b20-867a-1a3d5f48e250 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:17.495962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86fe4f5d-82ef-4b20-867a-1a3d5f48e250 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:17.496811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86fe4f5d-82ef-4b20-867a-1a3d5f48e250 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:17.498012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86fe4f5d-82ef-4b20-867a-1a3d5f48e250 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:17.498473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86fe4f5d-82ef-4b20-867a-1a3d5f48e250 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:17.825217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86fe4f5d-82ef-4b20-867a-1a3d5f48e250 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:17.834983 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86fe4f5d-82ef-4b20-867a-1a3d5f48e250 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 200 len: 1471 microversion: 2.1 time: 0.361544 Aug 27 05:02:17.848601 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2690/5324] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:17 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 1471 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:17.853903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1223291150", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9ea3026b-2b75-40a0-9167-c3d3e66b7f7b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "0b9321d5-af89-499e-b147-430b2ec333ca"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:17.936948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] validate_networks() for [('0b9321d5-af89-499e-b147-430b2ec333ca', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:02:18.121959 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a88d790b-2d47-4a5b-ae10-4ec5b18dbae3 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "POST /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.670762 Aug 27 05:02:18.142948 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2635/5325] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:02:17 2022] POST /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:18.357009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-01ccdb1e-1897-420a-bef4-c0e02b48e55b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:18.358012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-01ccdb1e-1897-420a-bef4-c0e02b48e55b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:18.370049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01ccdb1e-1897-420a-bef4-c0e02b48e55b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:18.370844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01ccdb1e-1897-420a-bef4-c0e02b48e55b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:18.371650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01ccdb1e-1897-420a-bef4-c0e02b48e55b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:18.372912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01ccdb1e-1897-420a-bef4-c0e02b48e55b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:18.373535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01ccdb1e-1897-420a-bef4-c0e02b48e55b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:18.374143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-01ccdb1e-1897-420a-bef4-c0e02b48e55b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:18.455520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:02:18.455901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:02:18.456145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:02:18.456571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:02:18.456990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:02:18.467714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:18.468355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:18.468934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:18.469754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:18.470469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:18.471144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:18.514918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:02:18.521892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for user 8376c4e2cf814a8b8b1e2a8e404b0187 and project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:02:18.834787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-01ccdb1e-1897-420a-bef4-c0e02b48e55b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:18.843829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-01ccdb1e-1897-420a-bef4-c0e02b48e55b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:18.845523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-01ccdb1e-1897-420a-bef4-c0e02b48e55b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:18.846952 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-01ccdb1e-1897-420a-bef4-c0e02b48e55b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1751 microversion: 2.20 time: 0.495312 Aug 27 05:02:18.847684 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2636/5326] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:18 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1751 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:02:18.854097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4ba67090-2203-4e7d-9254-e253b5595205 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:18.854902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4ba67090-2203-4e7d-9254-e253b5595205 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:18.866374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ba67090-2203-4e7d-9254-e253b5595205 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:18.866866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ba67090-2203-4e7d-9254-e253b5595205 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:18.867296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ba67090-2203-4e7d-9254-e253b5595205 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:18.868006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ba67090-2203-4e7d-9254-e253b5595205 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:18.868438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ba67090-2203-4e7d-9254-e253b5595205 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:18.881117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ba67090-2203-4e7d-9254-e253b5595205 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:19.063021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4ba67090-2203-4e7d-9254-e253b5595205 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:19.074576 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4ba67090-2203-4e7d-9254-e253b5595205 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1565 microversion: 2.1 time: 0.223488 Aug 27 05:02:19.077266 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2637/5327] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:18 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1565 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:19.085770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9f2ec4ce-ddd0-41dd-9304-26c082e81d2a tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:19.088700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9f2ec4ce-ddd0-41dd-9304-26c082e81d2a tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:19.113783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:19.117309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f2ec4ce-ddd0-41dd-9304-26c082e81d2a tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:19.118803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f2ec4ce-ddd0-41dd-9304-26c082e81d2a tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:19.119513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f2ec4ce-ddd0-41dd-9304-26c082e81d2a tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:19.123650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f2ec4ce-ddd0-41dd-9304-26c082e81d2a tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:19.125500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f2ec4ce-ddd0-41dd-9304-26c082e81d2a tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:19.126701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9f2ec4ce-ddd0-41dd-9304-26c082e81d2a tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:19.469538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9f2ec4ce-ddd0-41dd-9304-26c082e81d2a tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:19.480062 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9f2ec4ce-ddd0-41dd-9304-26c082e81d2a tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 200 len: 1471 microversion: 2.1 time: 0.401458 Aug 27 05:02:19.481471 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2638/5328] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:19 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 1471 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:19.488203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-523076e4-f075-4193-a2c1-23882561e02a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:19.489277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-523076e4-f075-4193-a2c1-23882561e02a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:19.496085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-523076e4-f075-4193-a2c1-23882561e02a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:19.497050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-523076e4-f075-4193-a2c1-23882561e02a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:19.497891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-523076e4-f075-4193-a2c1-23882561e02a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:19.498839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-523076e4-f075-4193-a2c1-23882561e02a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:19.499685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-523076e4-f075-4193-a2c1-23882561e02a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:19.500642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-523076e4-f075-4193-a2c1-23882561e02a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:19.711694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-523076e4-f075-4193-a2c1-23882561e02a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:19.724227 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-523076e4-f075-4193-a2c1-23882561e02a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1565 microversion: 2.1 time: 0.241418 Aug 27 05:02:19.726326 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2639/5329] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:19 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1565 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:19.870819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc1e01da-a8c3-4c4c-94f1-d5f428814c5d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:19.872021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bc1e01da-a8c3-4c4c-94f1-d5f428814c5d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:19.883244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc1e01da-a8c3-4c4c-94f1-d5f428814c5d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:19.885547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc1e01da-a8c3-4c4c-94f1-d5f428814c5d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:19.887208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc1e01da-a8c3-4c4c-94f1-d5f428814c5d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:19.889083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc1e01da-a8c3-4c4c-94f1-d5f428814c5d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:19.892475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc1e01da-a8c3-4c4c-94f1-d5f428814c5d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:19.893462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc1e01da-a8c3-4c4c-94f1-d5f428814c5d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:20.004493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:02:20.006689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ea3026b-2b75-40a0-9167-c3d3e66b7f7b',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:02:20.380419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bc1e01da-a8c3-4c4c-94f1-d5f428814c5d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:20.390186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bc1e01da-a8c3-4c4c-94f1-d5f428814c5d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:20.400726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bc1e01da-a8c3-4c4c-94f1-d5f428814c5d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:20.402001 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bc1e01da-a8c3-4c4c-94f1-d5f428814c5d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1751 microversion: 2.20 time: 0.535949 Aug 27 05:02:20.402581 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2640/5330] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:19 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1751 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:02:20.506232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2643a311-1a2c-4bb8-abc4-8114bc100b02 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:20.507114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2643a311-1a2c-4bb8-abc4-8114bc100b02 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:20.509342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:20.522397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2643a311-1a2c-4bb8-abc4-8114bc100b02 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:20.529463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2643a311-1a2c-4bb8-abc4-8114bc100b02 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:20.530762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2643a311-1a2c-4bb8-abc4-8114bc100b02 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:20.531859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2643a311-1a2c-4bb8-abc4-8114bc100b02 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:20.532492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2643a311-1a2c-4bb8-abc4-8114bc100b02 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:20.533114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2643a311-1a2c-4bb8-abc4-8114bc100b02 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:20.567534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:20.582069 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76055760-05c3-4bff-b034-abd37357305c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.731936 Aug 27 05:02:20.586520 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2691/5331] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:02:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:02:20.620067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe62f9ea-a1d8-42b4-bc43-cdd985542663 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:20.634164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe62f9ea-a1d8-42b4-bc43-cdd985542663 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:20.834917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe62f9ea-a1d8-42b4-bc43-cdd985542663 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:20.849607 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe62f9ea-a1d8-42b4-bc43-cdd985542663 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1071 microversion: 2.1 time: 0.258466 Aug 27 05:02:20.853455 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2692/5332] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:20 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1071 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:21.215052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2643a311-1a2c-4bb8-abc4-8114bc100b02 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:21.236273 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2643a311-1a2c-4bb8-abc4-8114bc100b02 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 200 len: 1471 microversion: 2.1 time: 0.733917 Aug 27 05:02:21.253728 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2641/5333] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:20 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 1471 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:21.425924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4bf0b7a7-a622-4411-8a8a-86be259b9f30 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:21.426725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4bf0b7a7-a622-4411-8a8a-86be259b9f30 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:21.435922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bf0b7a7-a622-4411-8a8a-86be259b9f30 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:21.441492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bf0b7a7-a622-4411-8a8a-86be259b9f30 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:21.442095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bf0b7a7-a622-4411-8a8a-86be259b9f30 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:21.447528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bf0b7a7-a622-4411-8a8a-86be259b9f30 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:21.448088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bf0b7a7-a622-4411-8a8a-86be259b9f30 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:21.448568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bf0b7a7-a622-4411-8a8a-86be259b9f30 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:21.890830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4bf0b7a7-a622-4411-8a8a-86be259b9f30 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:21.907268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4bf0b7a7-a622-4411-8a8a-86be259b9f30 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:21.914919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4bf0b7a7-a622-4411-8a8a-86be259b9f30 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:21.928122 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4bf0b7a7-a622-4411-8a8a-86be259b9f30 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.500005 Aug 27 05:02:21.929085 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2693/5334] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:21 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:22.013593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-970cd476-9b49-49d2-bd56-65f6e85b4ff2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:22.014828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-970cd476-9b49-49d2-bd56-65f6e85b4ff2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:22.031434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-970cd476-9b49-49d2-bd56-65f6e85b4ff2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:22.032665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-970cd476-9b49-49d2-bd56-65f6e85b4ff2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:22.033267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-970cd476-9b49-49d2-bd56-65f6e85b4ff2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:22.036041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-970cd476-9b49-49d2-bd56-65f6e85b4ff2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:22.036700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-970cd476-9b49-49d2-bd56-65f6e85b4ff2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:22.037315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-970cd476-9b49-49d2-bd56-65f6e85b4ff2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:22.228585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-970cd476-9b49-49d2-bd56-65f6e85b4ff2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:22.244863 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-970cd476-9b49-49d2-bd56-65f6e85b4ff2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1169 microversion: 2.1 time: 0.372238 Aug 27 05:02:22.262016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8604796c-d8a2-4b5b-a05e-0cc0da473600 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:22.262479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8604796c-d8a2-4b5b-a05e-0cc0da473600 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:22.270951 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2642/5335] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:21 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1169 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:22.274951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8604796c-d8a2-4b5b-a05e-0cc0da473600 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:22.276011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8604796c-d8a2-4b5b-a05e-0cc0da473600 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:22.276466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8604796c-d8a2-4b5b-a05e-0cc0da473600 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:22.277454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8604796c-d8a2-4b5b-a05e-0cc0da473600 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:22.277920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8604796c-d8a2-4b5b-a05e-0cc0da473600 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:22.278359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8604796c-d8a2-4b5b-a05e-0cc0da473600 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:22.779395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8604796c-d8a2-4b5b-a05e-0cc0da473600 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:22.797803 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8604796c-d8a2-4b5b-a05e-0cc0da473600 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 200 len: 1471 microversion: 2.1 time: 0.542350 Aug 27 05:02:22.801632 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2694/5336] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:22 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 1471 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:22.953405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-37d91e09-b3d0-4b33-9109-c727432b9a00 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:22.954097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-37d91e09-b3d0-4b33-9109-c727432b9a00 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:22.970377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37d91e09-b3d0-4b33-9109-c727432b9a00 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:22.971913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37d91e09-b3d0-4b33-9109-c727432b9a00 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:22.973460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37d91e09-b3d0-4b33-9109-c727432b9a00 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:22.973876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37d91e09-b3d0-4b33-9109-c727432b9a00 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:22.974347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37d91e09-b3d0-4b33-9109-c727432b9a00 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:22.974808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37d91e09-b3d0-4b33-9109-c727432b9a00 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:23.009241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ff9efd0b-26a5-4bda-bc20-92b3dad34951 req-dfba50ba-f5f2-4b0f-905e-815225c3776d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63fd1673-2a84-4740-9748-f9d2d180a067", "name": "network-vif-plugged", "status": "completed", "tag": "479d2ba7-3e50-4a5f-bd9e-c5e2872feff5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:23.045554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ff9efd0b-26a5-4bda-bc20-92b3dad34951 req-dfba50ba-f5f2-4b0f-905e-815225c3776d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:23.048757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ff9efd0b-26a5-4bda-bc20-92b3dad34951 req-dfba50ba-f5f2-4b0f-905e-815225c3776d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:23.050959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ff9efd0b-26a5-4bda-bc20-92b3dad34951 req-dfba50ba-f5f2-4b0f-905e-815225c3776d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:23.096761 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ff9efd0b-26a5-4bda-bc20-92b3dad34951 req-dfba50ba-f5f2-4b0f-905e-815225c3776d service nova] Creating event network-vif-plugged:479d2ba7-3e50-4a5f-bd9e-c5e2872feff5 for instance 63fd1673-2a84-4740-9748-f9d2d180a067 on n-h2-854823-1 Aug 27 05:02:23.113039 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ff9efd0b-26a5-4bda-bc20-92b3dad34951 req-dfba50ba-f5f2-4b0f-905e-815225c3776d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106210 Aug 27 05:02:23.115555 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2695/5337] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:23.273824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ef3e0fa-5418-4e49-af22-25f3459eb2ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:23.275255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6ef3e0fa-5418-4e49-af22-25f3459eb2ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:23.281314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:23.291112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ef3e0fa-5418-4e49-af22-25f3459eb2ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:23.300003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ef3e0fa-5418-4e49-af22-25f3459eb2ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:23.301035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ef3e0fa-5418-4e49-af22-25f3459eb2ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:23.301918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ef3e0fa-5418-4e49-af22-25f3459eb2ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:23.302278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ef3e0fa-5418-4e49-af22-25f3459eb2ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:23.302705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ef3e0fa-5418-4e49-af22-25f3459eb2ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:23.467440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ef3e0fa-5418-4e49-af22-25f3459eb2ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:23.478537 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ef3e0fa-5418-4e49-af22-25f3459eb2ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1187 microversion: 2.1 time: 0.210401 Aug 27 05:02:23.479199 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2696/5338] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:23 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1187 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:23.823749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-41734ccb-d9ea-49e4-91c0-b9f7aa6dbd91 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:23.826275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41734ccb-d9ea-49e4-91c0-b9f7aa6dbd91 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:23.844670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41734ccb-d9ea-49e4-91c0-b9f7aa6dbd91 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:23.852793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41734ccb-d9ea-49e4-91c0-b9f7aa6dbd91 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:23.858903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41734ccb-d9ea-49e4-91c0-b9f7aa6dbd91 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:23.865247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41734ccb-d9ea-49e4-91c0-b9f7aa6dbd91 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:23.866176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41734ccb-d9ea-49e4-91c0-b9f7aa6dbd91 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:23.868453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41734ccb-d9ea-49e4-91c0-b9f7aa6dbd91 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:24.010300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-37d91e09-b3d0-4b33-9109-c727432b9a00 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:24.025156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-37d91e09-b3d0-4b33-9109-c727432b9a00 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:24.026743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-37d91e09-b3d0-4b33-9109-c727432b9a00 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:24.036664 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-37d91e09-b3d0-4b33-9109-c727432b9a00 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 1.080816 Aug 27 05:02:24.037755 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2643/5339] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:22 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:24.257112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-41734ccb-d9ea-49e4-91c0-b9f7aa6dbd91 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:24.266913 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-41734ccb-d9ea-49e4-91c0-b9f7aa6dbd91 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 200 len: 1471 microversion: 2.1 time: 0.448290 Aug 27 05:02:24.280709 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2697/5340] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:23 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 1471 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:24.495511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1f7bc6a8-5d7f-4910-bf3a-960858a710f8 req-e2a53c9b-ffaa-426c-bfa5-6fac69babbb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd1a40c-a36d-4253-9f1c-b5711b2ed52a", "tag": "620b69e1-40ab-4292-881f-6f2fff934397"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:24.505866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b6485eac-d286-4193-95bf-370a80ab533a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:24.506489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b6485eac-d286-4193-95bf-370a80ab533a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:24.536244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1f7bc6a8-5d7f-4910-bf3a-960858a710f8 req-e2a53c9b-ffaa-426c-bfa5-6fac69babbb6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:24.536769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1f7bc6a8-5d7f-4910-bf3a-960858a710f8 req-e2a53c9b-ffaa-426c-bfa5-6fac69babbb6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:24.537205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1f7bc6a8-5d7f-4910-bf3a-960858a710f8 req-e2a53c9b-ffaa-426c-bfa5-6fac69babbb6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:24.537869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6485eac-d286-4193-95bf-370a80ab533a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:24.538641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6485eac-d286-4193-95bf-370a80ab533a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:24.539250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6485eac-d286-4193-95bf-370a80ab533a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:24.540199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6485eac-d286-4193-95bf-370a80ab533a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:24.540889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6485eac-d286-4193-95bf-370a80ab533a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:24.541483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6485eac-d286-4193-95bf-370a80ab533a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:24.566642 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1f7bc6a8-5d7f-4910-bf3a-960858a710f8 req-e2a53c9b-ffaa-426c-bfa5-6fac69babbb6 service nova] Creating event network-changed:620b69e1-40ab-4292-881f-6f2fff934397 for instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a on n-h2-854823-1 Aug 27 05:02:24.572906 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1f7bc6a8-5d7f-4910-bf3a-960858a710f8 req-e2a53c9b-ffaa-426c-bfa5-6fac69babbb6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080575 Aug 27 05:02:24.574480 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2644/5341] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:24.641092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8e2ecfa2-f8af-4551-ba3b-f173da5e67ec tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:24.641896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8e2ecfa2-f8af-4551-ba3b-f173da5e67ec tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:24.650473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e2ecfa2-f8af-4551-ba3b-f173da5e67ec tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:24.651085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e2ecfa2-f8af-4551-ba3b-f173da5e67ec tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:24.651617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e2ecfa2-f8af-4551-ba3b-f173da5e67ec tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:24.652467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e2ecfa2-f8af-4551-ba3b-f173da5e67ec tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:24.653191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e2ecfa2-f8af-4551-ba3b-f173da5e67ec tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:24.654216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e2ecfa2-f8af-4551-ba3b-f173da5e67ec tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:24.896800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b6485eac-d286-4193-95bf-370a80ab533a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:24.905859 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b6485eac-d286-4193-95bf-370a80ab533a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1229 microversion: 2.1 time: 0.404310 Aug 27 05:02:24.916454 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2698/5342] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:24 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1229 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:25.064049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99684553-9fcf-4f88-9657-bddeeaee078f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:25.065408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99684553-9fcf-4f88-9657-bddeeaee078f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:25.075781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99684553-9fcf-4f88-9657-bddeeaee078f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:25.076735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99684553-9fcf-4f88-9657-bddeeaee078f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:25.077536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99684553-9fcf-4f88-9657-bddeeaee078f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:25.079380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99684553-9fcf-4f88-9657-bddeeaee078f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:25.080076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99684553-9fcf-4f88-9657-bddeeaee078f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:25.082888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99684553-9fcf-4f88-9657-bddeeaee078f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:25.099479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8e2ecfa2-f8af-4551-ba3b-f173da5e67ec tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:25.116650 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8e2ecfa2-f8af-4551-ba3b-f173da5e67ec tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1565 microversion: 2.1 time: 0.478499 Aug 27 05:02:25.119873 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2645/5343] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:24 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1565 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:25.294714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7ad9cb0c-6125-4343-8b1f-c666adb18bf2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:25.295341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7ad9cb0c-6125-4343-8b1f-c666adb18bf2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:25.311039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ad9cb0c-6125-4343-8b1f-c666adb18bf2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:25.311632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ad9cb0c-6125-4343-8b1f-c666adb18bf2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:25.312015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ad9cb0c-6125-4343-8b1f-c666adb18bf2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:25.318601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ad9cb0c-6125-4343-8b1f-c666adb18bf2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:25.319206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ad9cb0c-6125-4343-8b1f-c666adb18bf2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:25.319963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ad9cb0c-6125-4343-8b1f-c666adb18bf2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:25.372667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:25.482793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99684553-9fcf-4f88-9657-bddeeaee078f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:25.486345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:25.501009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99684553-9fcf-4f88-9657-bddeeaee078f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:25.508507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99684553-9fcf-4f88-9657-bddeeaee078f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:25.513628 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99684553-9fcf-4f88-9657-bddeeaee078f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.453490 Aug 27 05:02:25.516175 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2699/5344] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:25 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:02:25.692069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ebcaecef-e8e2-4c03-a9dc-1f48f95c4e41 req-48bf7aa4-b109-4775-9d40-7f31760d112a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38", "tag": "fafeac18-7f47-48f7-9544-4ab5fee53c4c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:25.726227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ebcaecef-e8e2-4c03-a9dc-1f48f95c4e41 req-48bf7aa4-b109-4775-9d40-7f31760d112a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:25.729230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ebcaecef-e8e2-4c03-a9dc-1f48f95c4e41 req-48bf7aa4-b109-4775-9d40-7f31760d112a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:25.732003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ebcaecef-e8e2-4c03-a9dc-1f48f95c4e41 req-48bf7aa4-b109-4775-9d40-7f31760d112a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:25.785339 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ebcaecef-e8e2-4c03-a9dc-1f48f95c4e41 req-48bf7aa4-b109-4775-9d40-7f31760d112a service nova] Creating event network-changed:fafeac18-7f47-48f7-9544-4ab5fee53c4c for instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 on n-h1-854823-1 Aug 27 05:02:25.797570 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ebcaecef-e8e2-4c03-a9dc-1f48f95c4e41 req-48bf7aa4-b109-4775-9d40-7f31760d112a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109942 Aug 27 05:02:25.803618 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2700/5345] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:02:25.881487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7ad9cb0c-6125-4343-8b1f-c666adb18bf2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:25.904898 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7ad9cb0c-6125-4343-8b1f-c666adb18bf2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 200 len: 1642 microversion: 2.1 time: 0.605284 Aug 27 05:02:25.909276 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2646/5346] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:25 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 1642 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:25.932409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f39a68db-3f59-42f8-9b47-820d1cf082c1 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:25.936464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f39a68db-3f59-42f8-9b47-820d1cf082c1 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:25.942906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bd6355d6-19c5-4e36-8a89-bb4d9af2e35c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:25.944969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bd6355d6-19c5-4e36-8a89-bb4d9af2e35c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:25.954509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f39a68db-3f59-42f8-9b47-820d1cf082c1 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:25.957907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f39a68db-3f59-42f8-9b47-820d1cf082c1 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:25.958829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f39a68db-3f59-42f8-9b47-820d1cf082c1 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:25.962280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f39a68db-3f59-42f8-9b47-820d1cf082c1 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:25.963119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f39a68db-3f59-42f8-9b47-820d1cf082c1 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:25.965459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f39a68db-3f59-42f8-9b47-820d1cf082c1 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:25.978509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd6355d6-19c5-4e36-8a89-bb4d9af2e35c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:25.982753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd6355d6-19c5-4e36-8a89-bb4d9af2e35c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:25.984848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd6355d6-19c5-4e36-8a89-bb4d9af2e35c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:25.988182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd6355d6-19c5-4e36-8a89-bb4d9af2e35c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:25.990133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd6355d6-19c5-4e36-8a89-bb4d9af2e35c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:25.992364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd6355d6-19c5-4e36-8a89-bb4d9af2e35c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:26.378221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f39a68db-3f59-42f8-9b47-820d1cf082c1 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:26.390154 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f39a68db-3f59-42f8-9b47-820d1cf082c1 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 200 len: 1642 microversion: 2.1 time: 0.462708 Aug 27 05:02:26.391508 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2701/5347] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:25 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 1642 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:26.422197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2251f771-0eed-4a40-9051-17e90ca76806 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:26.422829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2251f771-0eed-4a40-9051-17e90ca76806 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:26.436806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2251f771-0eed-4a40-9051-17e90ca76806 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:26.437142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2251f771-0eed-4a40-9051-17e90ca76806 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:26.442225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2251f771-0eed-4a40-9051-17e90ca76806 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:26.443940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2251f771-0eed-4a40-9051-17e90ca76806 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:26.445226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2251f771-0eed-4a40-9051-17e90ca76806 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:26.446432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2251f771-0eed-4a40-9051-17e90ca76806 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:26.492509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bd6355d6-19c5-4e36-8a89-bb4d9af2e35c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:26.507068 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bd6355d6-19c5-4e36-8a89-bb4d9af2e35c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1229 microversion: 2.1 time: 0.571737 Aug 27 05:02:26.508273 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2647/5348] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:25 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1229 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:26.551054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3ae5fccd-5633-4a88-a2e8-47019fc51ede tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:26.551830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3ae5fccd-5633-4a88-a2e8-47019fc51ede tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:26.561705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ae5fccd-5633-4a88-a2e8-47019fc51ede tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:26.562210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ae5fccd-5633-4a88-a2e8-47019fc51ede tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:26.562965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ae5fccd-5633-4a88-a2e8-47019fc51ede tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:26.563903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ae5fccd-5633-4a88-a2e8-47019fc51ede tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:26.564402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ae5fccd-5633-4a88-a2e8-47019fc51ede tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:26.565680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ae5fccd-5633-4a88-a2e8-47019fc51ede tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:26.998087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3ae5fccd-5633-4a88-a2e8-47019fc51ede tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:27.009640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3ae5fccd-5633-4a88-a2e8-47019fc51ede tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:27.029528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3ae5fccd-5633-4a88-a2e8-47019fc51ede tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:27.034316 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3ae5fccd-5633-4a88-a2e8-47019fc51ede tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.486423 Aug 27 05:02:27.035190 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2648/5349] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:26 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:27.053298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-6923f2e9-a2bd-4bc2-b5fa-e6238d03f50f req-34e92594-781a-4b5f-b423-540981acbbfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c", "tag": "1c0cd31d-1134-43c3-8033-7756a472aa85"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:27.080314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6923f2e9-a2bd-4bc2-b5fa-e6238d03f50f req-34e92594-781a-4b5f-b423-540981acbbfe service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:27.092059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6923f2e9-a2bd-4bc2-b5fa-e6238d03f50f req-34e92594-781a-4b5f-b423-540981acbbfe service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:27.092800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6923f2e9-a2bd-4bc2-b5fa-e6238d03f50f req-34e92594-781a-4b5f-b423-540981acbbfe service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:27.124444 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-6923f2e9-a2bd-4bc2-b5fa-e6238d03f50f req-34e92594-781a-4b5f-b423-540981acbbfe service nova] Creating event network-changed:1c0cd31d-1134-43c3-8033-7756a472aa85 for instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c on n-h1-854823-1 Aug 27 05:02:27.150252 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-6923f2e9-a2bd-4bc2-b5fa-e6238d03f50f req-34e92594-781a-4b5f-b423-540981acbbfe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113476 Aug 27 05:02:27.151133 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2649/5350] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:27.320746 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2251f771-0eed-4a40-9051-17e90ca76806 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 200 len: 1793 microversion: 2.1 time: 0.908788 Aug 27 05:02:27.327277 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2702/5351] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:26 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 1793 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:27.531642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-23542a56-46f4-4861-b7a1-04fbbbf69bab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:27.541625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-23542a56-46f4-4861-b7a1-04fbbbf69bab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:27.554119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23542a56-46f4-4861-b7a1-04fbbbf69bab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:27.561262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23542a56-46f4-4861-b7a1-04fbbbf69bab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:27.562004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23542a56-46f4-4861-b7a1-04fbbbf69bab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:27.568248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23542a56-46f4-4861-b7a1-04fbbbf69bab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:27.569142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23542a56-46f4-4861-b7a1-04fbbbf69bab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:27.569864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-23542a56-46f4-4861-b7a1-04fbbbf69bab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:27.957290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-23542a56-46f4-4861-b7a1-04fbbbf69bab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:27.975195 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-23542a56-46f4-4861-b7a1-04fbbbf69bab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1229 microversion: 2.1 time: 0.447652 Aug 27 05:02:27.982541 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2650/5352] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:27 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1229 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:28.062559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c6ecbef9-8f0b-459a-bb4a-47c1829686da tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:28.063179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c6ecbef9-8f0b-459a-bb4a-47c1829686da tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:28.084647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ecbef9-8f0b-459a-bb4a-47c1829686da tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:28.085472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ecbef9-8f0b-459a-bb4a-47c1829686da tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:28.086118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ecbef9-8f0b-459a-bb4a-47c1829686da tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:28.087117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ecbef9-8f0b-459a-bb4a-47c1829686da tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:28.087926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ecbef9-8f0b-459a-bb4a-47c1829686da tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:28.088594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ecbef9-8f0b-459a-bb4a-47c1829686da tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:28.475651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c6ecbef9-8f0b-459a-bb4a-47c1829686da tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:28.505585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:28.510910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c6ecbef9-8f0b-459a-bb4a-47c1829686da tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:28.513065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c6ecbef9-8f0b-459a-bb4a-47c1829686da tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:28.514542 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c6ecbef9-8f0b-459a-bb4a-47c1829686da tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.456496 Aug 27 05:02:28.529271 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2703/5353] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:28 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:28.694749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f6612c2b-dfc7-4890-8512-273f52743a16 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:28.698233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f6612c2b-dfc7-4890-8512-273f52743a16 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:28.710662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6612c2b-dfc7-4890-8512-273f52743a16 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:28.721841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6612c2b-dfc7-4890-8512-273f52743a16 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:28.724131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6612c2b-dfc7-4890-8512-273f52743a16 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:28.724555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6612c2b-dfc7-4890-8512-273f52743a16 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:28.725040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6612c2b-dfc7-4890-8512-273f52743a16 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:28.725532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6612c2b-dfc7-4890-8512-273f52743a16 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:28.767280 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f6612c2b-dfc7-4890-8512-273f52743a16 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081456 Aug 27 05:02:28.768918 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2651/5354] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:02:28 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:28.780997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ebb6b48-3028-4403-ae70-c84a546e5ba0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:28.781541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8ebb6b48-3028-4403-ae70-c84a546e5ba0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:28.803880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b48-3028-4403-ae70-c84a546e5ba0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:28.804803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b48-3028-4403-ae70-c84a546e5ba0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:28.805955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b48-3028-4403-ae70-c84a546e5ba0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:28.807074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b48-3028-4403-ae70-c84a546e5ba0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:28.807788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b48-3028-4403-ae70-c84a546e5ba0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:28.808543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b48-3028-4403-ae70-c84a546e5ba0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:28.861589 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8ebb6b48-3028-4403-ae70-c84a546e5ba0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments/c8d52961-8c3e-4f76-b2cd-a09d0452c50d" status: 200 len: 194 microversion: 2.1 time: 0.084076 Aug 27 05:02:28.863104 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2704/5355] 10.222.0.79 () {58 vars in 1413 bytes} [Sat Aug 27 05:02:28 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments/c8d52961-8c3e-4f76-b2cd-a09d0452c50d => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:29.006447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fb491550-68c8-4eb9-8dc5-5dc8605e1ab6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:29.007058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fb491550-68c8-4eb9-8dc5-5dc8605e1ab6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:29.022410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb491550-68c8-4eb9-8dc5-5dc8605e1ab6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:29.022913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb491550-68c8-4eb9-8dc5-5dc8605e1ab6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:29.023353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb491550-68c8-4eb9-8dc5-5dc8605e1ab6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:29.024062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb491550-68c8-4eb9-8dc5-5dc8605e1ab6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:29.024516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb491550-68c8-4eb9-8dc5-5dc8605e1ab6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:29.024961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb491550-68c8-4eb9-8dc5-5dc8605e1ab6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:29.316754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fb491550-68c8-4eb9-8dc5-5dc8605e1ab6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:29.330370 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fb491550-68c8-4eb9-8dc5-5dc8605e1ab6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1229 microversion: 2.1 time: 0.327507 Aug 27 05:02:29.360973 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2652/5356] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:29 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1229 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:29.539566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92cde040-fbee-4d79-8dd3-c7f566e707b7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:29.540248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92cde040-fbee-4d79-8dd3-c7f566e707b7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:29.554173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92cde040-fbee-4d79-8dd3-c7f566e707b7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:29.561384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92cde040-fbee-4d79-8dd3-c7f566e707b7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:29.562532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92cde040-fbee-4d79-8dd3-c7f566e707b7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:29.563494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92cde040-fbee-4d79-8dd3-c7f566e707b7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:29.564498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92cde040-fbee-4d79-8dd3-c7f566e707b7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:29.565742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92cde040-fbee-4d79-8dd3-c7f566e707b7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:30.082166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92cde040-fbee-4d79-8dd3-c7f566e707b7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:30.100755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92cde040-fbee-4d79-8dd3-c7f566e707b7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:30.108435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92cde040-fbee-4d79-8dd3-c7f566e707b7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:30.110923 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92cde040-fbee-4d79-8dd3-c7f566e707b7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.575199 Aug 27 05:02:30.114265 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2705/5357] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:29 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:30.373150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-417ac49a-2a40-4a1a-ac07-f78a7fca3c40 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:30.373813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-417ac49a-2a40-4a1a-ac07-f78a7fca3c40 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:30.385156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-417ac49a-2a40-4a1a-ac07-f78a7fca3c40 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:30.385654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-417ac49a-2a40-4a1a-ac07-f78a7fca3c40 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:30.386099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-417ac49a-2a40-4a1a-ac07-f78a7fca3c40 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:30.387029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-417ac49a-2a40-4a1a-ac07-f78a7fca3c40 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:30.391064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-417ac49a-2a40-4a1a-ac07-f78a7fca3c40 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:30.391734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-417ac49a-2a40-4a1a-ac07-f78a7fca3c40 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:30.721398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-417ac49a-2a40-4a1a-ac07-f78a7fca3c40 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:30.729799 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-417ac49a-2a40-4a1a-ac07-f78a7fca3c40 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1229 microversion: 2.1 time: 0.360636 Aug 27 05:02:30.730416 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2653/5358] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:30 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1229 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:31.142366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14c3b9de-39d8-4778-b36b-39d438cf1363 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:31.144263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14c3b9de-39d8-4778-b36b-39d438cf1363 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:31.156493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:31.168830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c3b9de-39d8-4778-b36b-39d438cf1363 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:31.169764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c3b9de-39d8-4778-b36b-39d438cf1363 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:31.170579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c3b9de-39d8-4778-b36b-39d438cf1363 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:31.171526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c3b9de-39d8-4778-b36b-39d438cf1363 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:31.172290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c3b9de-39d8-4778-b36b-39d438cf1363 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:31.173059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c3b9de-39d8-4778-b36b-39d438cf1363 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:31.397863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-de279e68-0c6a-415f-b14d-51ed0d749a8f req-3cc85ae8-33d8-4f4a-adf8-b65ba63f4ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63fd1673-2a84-4740-9748-f9d2d180a067", "tag": "479d2ba7-3e50-4a5f-bd9e-c5e2872feff5"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:31.424448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-de279e68-0c6a-415f-b14d-51ed0d749a8f req-3cc85ae8-33d8-4f4a-adf8-b65ba63f4ab7 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:31.424983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-de279e68-0c6a-415f-b14d-51ed0d749a8f req-3cc85ae8-33d8-4f4a-adf8-b65ba63f4ab7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:31.425420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-de279e68-0c6a-415f-b14d-51ed0d749a8f req-3cc85ae8-33d8-4f4a-adf8-b65ba63f4ab7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:31.445797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14c3b9de-39d8-4778-b36b-39d438cf1363 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:31.461310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14c3b9de-39d8-4778-b36b-39d438cf1363 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:31.463036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14c3b9de-39d8-4778-b36b-39d438cf1363 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:31.466998 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14c3b9de-39d8-4778-b36b-39d438cf1363 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.328953 Aug 27 05:02:31.467593 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-de279e68-0c6a-415f-b14d-51ed0d749a8f req-3cc85ae8-33d8-4f4a-adf8-b65ba63f4ab7 service nova] Creating event network-changed:479d2ba7-3e50-4a5f-bd9e-c5e2872feff5 for instance 63fd1673-2a84-4740-9748-f9d2d180a067 on n-h2-854823-1 Aug 27 05:02:31.467737 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2706/5359] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:31 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:31.488622 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-de279e68-0c6a-415f-b14d-51ed0d749a8f req-3cc85ae8-33d8-4f4a-adf8-b65ba63f4ab7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094857 Aug 27 05:02:31.492479 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2654/5360] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:31.735141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7625d3a7-d497-4b13-acc2-ef4b5f9dc09d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67eeaee9-283b-41f6-8070-6c76699d36d2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:31.738447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7625d3a7-d497-4b13-acc2-ef4b5f9dc09d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:31.761807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1587413e-c32d-4883-a10e-e3fcd0724d0c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:31.762926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1587413e-c32d-4883-a10e-e3fcd0724d0c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:31.768711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7625d3a7-d497-4b13-acc2-ef4b5f9dc09d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:31.769314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7625d3a7-d497-4b13-acc2-ef4b5f9dc09d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:31.769837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7625d3a7-d497-4b13-acc2-ef4b5f9dc09d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:31.771760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7625d3a7-d497-4b13-acc2-ef4b5f9dc09d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:31.772247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7625d3a7-d497-4b13-acc2-ef4b5f9dc09d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:31.772742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7625d3a7-d497-4b13-acc2-ef4b5f9dc09d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:31.776800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1587413e-c32d-4883-a10e-e3fcd0724d0c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:31.778674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1587413e-c32d-4883-a10e-e3fcd0724d0c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:31.779137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1587413e-c32d-4883-a10e-e3fcd0724d0c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:31.779875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1587413e-c32d-4883-a10e-e3fcd0724d0c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:31.780434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1587413e-c32d-4883-a10e-e3fcd0724d0c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:31.780914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1587413e-c32d-4883-a10e-e3fcd0724d0c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:32.442668 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7625d3a7-d497-4b13-acc2-ef4b5f9dc09d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "POST /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.711708 Aug 27 05:02:32.450506 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2707/5361] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:02:31 2022] POST /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:32.494966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86e28b90-16ff-49d4-9531-d6af2c82fb63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:32.495819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86e28b90-16ff-49d4-9531-d6af2c82fb63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:32.511060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86e28b90-16ff-49d4-9531-d6af2c82fb63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:32.511642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86e28b90-16ff-49d4-9531-d6af2c82fb63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:32.512083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86e28b90-16ff-49d4-9531-d6af2c82fb63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:32.522714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86e28b90-16ff-49d4-9531-d6af2c82fb63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:32.524303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86e28b90-16ff-49d4-9531-d6af2c82fb63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:32.525085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86e28b90-16ff-49d4-9531-d6af2c82fb63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:32.876441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86e28b90-16ff-49d4-9531-d6af2c82fb63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:32.896695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86e28b90-16ff-49d4-9531-d6af2c82fb63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:32.898692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86e28b90-16ff-49d4-9531-d6af2c82fb63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:32.900084 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86e28b90-16ff-49d4-9531-d6af2c82fb63 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.411776 Aug 27 05:02:32.912565 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2708/5362] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:32 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:02:33.029247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1587413e-c32d-4883-a10e-e3fcd0724d0c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:33.042988 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1587413e-c32d-4883-a10e-e3fcd0724d0c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1229 microversion: 2.1 time: 1.285841 Aug 27 05:02:33.044184 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2655/5363] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:31 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1229 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:33.927992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73b459c4-ecbf-4909-9748-82f29be29fb4 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:33.928727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73b459c4-ecbf-4909-9748-82f29be29fb4 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:33.952152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b459c4-ecbf-4909-9748-82f29be29fb4 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:33.952698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b459c4-ecbf-4909-9748-82f29be29fb4 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:33.953153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b459c4-ecbf-4909-9748-82f29be29fb4 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:33.953903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b459c4-ecbf-4909-9748-82f29be29fb4 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:33.954371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b459c4-ecbf-4909-9748-82f29be29fb4 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:33.956494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b459c4-ecbf-4909-9748-82f29be29fb4 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:34.073697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-da1e3ca9-6d1f-4032-bf5f-2c2137fb9636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:34.074434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-da1e3ca9-6d1f-4032-bf5f-2c2137fb9636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:34.090462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da1e3ca9-6d1f-4032-bf5f-2c2137fb9636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:34.090888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da1e3ca9-6d1f-4032-bf5f-2c2137fb9636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:34.098472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da1e3ca9-6d1f-4032-bf5f-2c2137fb9636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:34.099613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da1e3ca9-6d1f-4032-bf5f-2c2137fb9636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:34.102403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da1e3ca9-6d1f-4032-bf5f-2c2137fb9636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:34.103061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da1e3ca9-6d1f-4032-bf5f-2c2137fb9636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:34.218462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-73b459c4-ecbf-4909-9748-82f29be29fb4 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:34.246777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-73b459c4-ecbf-4909-9748-82f29be29fb4 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:34.249441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-73b459c4-ecbf-4909-9748-82f29be29fb4 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:34.250965 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-73b459c4-ecbf-4909-9748-82f29be29fb4 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.327523 Aug 27 05:02:34.251949 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2709/5364] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:33 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:34.506323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-da1e3ca9-6d1f-4032-bf5f-2c2137fb9636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:34.521662 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-da1e3ca9-6d1f-4032-bf5f-2c2137fb9636 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1229 microversion: 2.1 time: 0.455787 Aug 27 05:02:34.522709 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2656/5365] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:34 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1229 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:35.277936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fce437ba-1d17-4fda-bc6b-3f835b7a035e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:35.278551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fce437ba-1d17-4fda-bc6b-3f835b7a035e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:35.287769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fce437ba-1d17-4fda-bc6b-3f835b7a035e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:35.288607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fce437ba-1d17-4fda-bc6b-3f835b7a035e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:35.289318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fce437ba-1d17-4fda-bc6b-3f835b7a035e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:35.290196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fce437ba-1d17-4fda-bc6b-3f835b7a035e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:35.291116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fce437ba-1d17-4fda-bc6b-3f835b7a035e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:35.291711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fce437ba-1d17-4fda-bc6b-3f835b7a035e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:35.541918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fce437ba-1d17-4fda-bc6b-3f835b7a035e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:35.549284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a05af7a6-0153-4302-96cf-2fc2b5305bd9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:35.550250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a05af7a6-0153-4302-96cf-2fc2b5305bd9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:35.563042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a05af7a6-0153-4302-96cf-2fc2b5305bd9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:35.564310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fce437ba-1d17-4fda-bc6b-3f835b7a035e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:35.564492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a05af7a6-0153-4302-96cf-2fc2b5305bd9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:35.565371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a05af7a6-0153-4302-96cf-2fc2b5305bd9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:35.566158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fce437ba-1d17-4fda-bc6b-3f835b7a035e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:35.566723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a05af7a6-0153-4302-96cf-2fc2b5305bd9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:35.567687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a05af7a6-0153-4302-96cf-2fc2b5305bd9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:35.567913 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fce437ba-1d17-4fda-bc6b-3f835b7a035e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.293894 Aug 27 05:02:35.568990 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2710/5366] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:35 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:35.569650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a05af7a6-0153-4302-96cf-2fc2b5305bd9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:35.807372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a05af7a6-0153-4302-96cf-2fc2b5305bd9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:35.825366 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a05af7a6-0153-4302-96cf-2fc2b5305bd9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1229 microversion: 2.1 time: 0.281873 Aug 27 05:02:35.827189 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2657/5367] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:35 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1229 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:36.593358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6eb8acfd-6c0b-492e-9ee4-3c382f7dfd8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:36.593968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6eb8acfd-6c0b-492e-9ee4-3c382f7dfd8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:36.601049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eb8acfd-6c0b-492e-9ee4-3c382f7dfd8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:36.601544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eb8acfd-6c0b-492e-9ee4-3c382f7dfd8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:36.601979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eb8acfd-6c0b-492e-9ee4-3c382f7dfd8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:36.602680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eb8acfd-6c0b-492e-9ee4-3c382f7dfd8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:36.603131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eb8acfd-6c0b-492e-9ee4-3c382f7dfd8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:36.603553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eb8acfd-6c0b-492e-9ee4-3c382f7dfd8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:36.744996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6eb8acfd-6c0b-492e-9ee4-3c382f7dfd8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:36.755225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6eb8acfd-6c0b-492e-9ee4-3c382f7dfd8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:36.756868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6eb8acfd-6c0b-492e-9ee4-3c382f7dfd8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:36.758352 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6eb8acfd-6c0b-492e-9ee4-3c382f7dfd8a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.168884 Aug 27 05:02:36.759037 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2711/5368] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:36 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:36.850635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8141fb94-6ec3-4273-8fd0-5d2ad14c4823 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:36.851267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8141fb94-6ec3-4273-8fd0-5d2ad14c4823 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:36.858845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8141fb94-6ec3-4273-8fd0-5d2ad14c4823 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:36.859344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8141fb94-6ec3-4273-8fd0-5d2ad14c4823 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:36.859982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8141fb94-6ec3-4273-8fd0-5d2ad14c4823 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:36.860747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8141fb94-6ec3-4273-8fd0-5d2ad14c4823 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:36.861967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8141fb94-6ec3-4273-8fd0-5d2ad14c4823 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:36.862403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8141fb94-6ec3-4273-8fd0-5d2ad14c4823 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:37.024277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8141fb94-6ec3-4273-8fd0-5d2ad14c4823 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:37.033869 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8141fb94-6ec3-4273-8fd0-5d2ad14c4823 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1217 microversion: 2.1 time: 0.186661 Aug 27 05:02:37.037817 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2658/5369] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:36 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:37.782504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ca98b2c-85c2-4d4d-aade-c5514ad4fd7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:37.783315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ca98b2c-85c2-4d4d-aade-c5514ad4fd7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:37.791954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca98b2c-85c2-4d4d-aade-c5514ad4fd7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:37.792779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca98b2c-85c2-4d4d-aade-c5514ad4fd7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:37.793340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca98b2c-85c2-4d4d-aade-c5514ad4fd7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:37.794170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca98b2c-85c2-4d4d-aade-c5514ad4fd7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:37.794859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca98b2c-85c2-4d4d-aade-c5514ad4fd7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:37.795492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca98b2c-85c2-4d4d-aade-c5514ad4fd7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:37.931315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ca98b2c-85c2-4d4d-aade-c5514ad4fd7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:37.947317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ca98b2c-85c2-4d4d-aade-c5514ad4fd7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:37.948925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ca98b2c-85c2-4d4d-aade-c5514ad4fd7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:37.950255 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ca98b2c-85c2-4d4d-aade-c5514ad4fd7d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.172303 Aug 27 05:02:37.950901 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2712/5370] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:37 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:38.058037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f731bc9-8fe8-4f63-93e5-b98872037551 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:38.058813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4f731bc9-8fe8-4f63-93e5-b98872037551 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:38.066197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f731bc9-8fe8-4f63-93e5-b98872037551 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:38.066692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f731bc9-8fe8-4f63-93e5-b98872037551 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:38.067127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f731bc9-8fe8-4f63-93e5-b98872037551 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:38.067828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f731bc9-8fe8-4f63-93e5-b98872037551 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:38.068433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f731bc9-8fe8-4f63-93e5-b98872037551 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:38.068893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f731bc9-8fe8-4f63-93e5-b98872037551 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:38.216158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4f731bc9-8fe8-4f63-93e5-b98872037551 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:38.245668 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4f731bc9-8fe8-4f63-93e5-b98872037551 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1217 microversion: 2.1 time: 0.191373 Aug 27 05:02:38.259171 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2659/5371] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:38 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1217 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:38.979409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83cb4c15-c495-4feb-82fd-4606c8c818e7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:38.980149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-83cb4c15-c495-4feb-82fd-4606c8c818e7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:38.987530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83cb4c15-c495-4feb-82fd-4606c8c818e7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:38.988104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83cb4c15-c495-4feb-82fd-4606c8c818e7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:38.988657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83cb4c15-c495-4feb-82fd-4606c8c818e7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:38.989574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83cb4c15-c495-4feb-82fd-4606c8c818e7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:38.990276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83cb4c15-c495-4feb-82fd-4606c8c818e7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:38.990857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83cb4c15-c495-4feb-82fd-4606c8c818e7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:39.134729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83cb4c15-c495-4feb-82fd-4606c8c818e7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:39.143641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83cb4c15-c495-4feb-82fd-4606c8c818e7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:39.145146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83cb4c15-c495-4feb-82fd-4606c8c818e7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:39.146339 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83cb4c15-c495-4feb-82fd-4606c8c818e7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.171018 Aug 27 05:02:39.146915 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2713/5372] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:38 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:39.279548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7290af96-d520-4be1-a0ae-ad0abfa58bc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:39.280299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7290af96-d520-4be1-a0ae-ad0abfa58bc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:39.288664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7290af96-d520-4be1-a0ae-ad0abfa58bc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:39.289286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7290af96-d520-4be1-a0ae-ad0abfa58bc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:39.289870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7290af96-d520-4be1-a0ae-ad0abfa58bc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:39.290763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7290af96-d520-4be1-a0ae-ad0abfa58bc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:39.291330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7290af96-d520-4be1-a0ae-ad0abfa58bc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:39.291864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7290af96-d520-4be1-a0ae-ad0abfa58bc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:39.444237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7290af96-d520-4be1-a0ae-ad0abfa58bc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:39.453115 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7290af96-d520-4be1-a0ae-ad0abfa58bc3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1217 microversion: 2.1 time: 0.177698 Aug 27 05:02:39.453709 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2660/5373] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:39 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:40.170981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d6729dc-3a5f-40dc-b388-ddbcc17dab60 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:40.171526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1d6729dc-3a5f-40dc-b388-ddbcc17dab60 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:40.178473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d6729dc-3a5f-40dc-b388-ddbcc17dab60 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:40.178964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d6729dc-3a5f-40dc-b388-ddbcc17dab60 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:40.179405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d6729dc-3a5f-40dc-b388-ddbcc17dab60 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:40.180107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d6729dc-3a5f-40dc-b388-ddbcc17dab60 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:40.180594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d6729dc-3a5f-40dc-b388-ddbcc17dab60 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:40.181028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d6729dc-3a5f-40dc-b388-ddbcc17dab60 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:40.318422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1d6729dc-3a5f-40dc-b388-ddbcc17dab60 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:40.327404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1d6729dc-3a5f-40dc-b388-ddbcc17dab60 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:40.328797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1d6729dc-3a5f-40dc-b388-ddbcc17dab60 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:40.330728 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d6729dc-3a5f-40dc-b388-ddbcc17dab60 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.163074 Aug 27 05:02:40.331311 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2714/5374] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:40 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:40.474355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-563df7e5-6908-4304-93ec-b6d32959d85c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:40.475104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-563df7e5-6908-4304-93ec-b6d32959d85c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:40.484578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-563df7e5-6908-4304-93ec-b6d32959d85c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:40.484913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-563df7e5-6908-4304-93ec-b6d32959d85c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:40.485351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-563df7e5-6908-4304-93ec-b6d32959d85c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:40.486096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-563df7e5-6908-4304-93ec-b6d32959d85c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:40.486705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-563df7e5-6908-4304-93ec-b6d32959d85c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:40.487143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-563df7e5-6908-4304-93ec-b6d32959d85c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:40.626386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-563df7e5-6908-4304-93ec-b6d32959d85c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:40.634937 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-563df7e5-6908-4304-93ec-b6d32959d85c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1217 microversion: 2.1 time: 0.164935 Aug 27 05:02:40.635530 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2661/5375] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:40 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:41.372873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9b842bba-7951-4219-8d30-2f2aefa7961a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:41.373985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9b842bba-7951-4219-8d30-2f2aefa7961a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:41.397876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b842bba-7951-4219-8d30-2f2aefa7961a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:41.399688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b842bba-7951-4219-8d30-2f2aefa7961a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:41.400227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b842bba-7951-4219-8d30-2f2aefa7961a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:41.402133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b842bba-7951-4219-8d30-2f2aefa7961a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:41.404637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b842bba-7951-4219-8d30-2f2aefa7961a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:41.406353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b842bba-7951-4219-8d30-2f2aefa7961a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:41.559434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b842bba-7951-4219-8d30-2f2aefa7961a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:41.561871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:41.570461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b842bba-7951-4219-8d30-2f2aefa7961a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:41.571939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b842bba-7951-4219-8d30-2f2aefa7961a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:41.573211 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9b842bba-7951-4219-8d30-2f2aefa7961a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.217961 Aug 27 05:02:41.573789 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2715/5376] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:41 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:41.656179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a2d98f28-e8a4-4e97-841a-16de32f69210 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:41.656770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a2d98f28-e8a4-4e97-841a-16de32f69210 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:41.664269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d98f28-e8a4-4e97-841a-16de32f69210 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:41.664790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d98f28-e8a4-4e97-841a-16de32f69210 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:41.665227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d98f28-e8a4-4e97-841a-16de32f69210 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:41.665921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d98f28-e8a4-4e97-841a-16de32f69210 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:41.666373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d98f28-e8a4-4e97-841a-16de32f69210 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:41.666794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d98f28-e8a4-4e97-841a-16de32f69210 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:41.859420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a2d98f28-e8a4-4e97-841a-16de32f69210 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:41.872628 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a2d98f28-e8a4-4e97-841a-16de32f69210 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1217 microversion: 2.1 time: 0.216974 Aug 27 05:02:41.873522 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2662/5377] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:41 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1217 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:42.598941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35ad2401-a27c-46c8-a0db-8405315fa923 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:42.599618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35ad2401-a27c-46c8-a0db-8405315fa923 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:42.609414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35ad2401-a27c-46c8-a0db-8405315fa923 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:42.609911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35ad2401-a27c-46c8-a0db-8405315fa923 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:42.610624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35ad2401-a27c-46c8-a0db-8405315fa923 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:42.611990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35ad2401-a27c-46c8-a0db-8405315fa923 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:42.612399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35ad2401-a27c-46c8-a0db-8405315fa923 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:42.612873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35ad2401-a27c-46c8-a0db-8405315fa923 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:42.759026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35ad2401-a27c-46c8-a0db-8405315fa923 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:42.768117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35ad2401-a27c-46c8-a0db-8405315fa923 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:42.769734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35ad2401-a27c-46c8-a0db-8405315fa923 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:42.770933 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35ad2401-a27c-46c8-a0db-8405315fa923 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.177253 Aug 27 05:02:42.771513 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2716/5378] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:42 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:42.897947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d165d839-b222-4eda-8081-9a338064f765 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:42.898475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d165d839-b222-4eda-8081-9a338064f765 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:42.907765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d165d839-b222-4eda-8081-9a338064f765 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:42.908924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d165d839-b222-4eda-8081-9a338064f765 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:42.909356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d165d839-b222-4eda-8081-9a338064f765 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:42.910074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d165d839-b222-4eda-8081-9a338064f765 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:42.910569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d165d839-b222-4eda-8081-9a338064f765 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:42.911119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d165d839-b222-4eda-8081-9a338064f765 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:43.047525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d165d839-b222-4eda-8081-9a338064f765 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:43.055451 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d165d839-b222-4eda-8081-9a338064f765 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1217 microversion: 2.1 time: 0.161445 Aug 27 05:02:43.056039 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2663/5379] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:42 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:43.796851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc4b7574-af74-4f1f-9e3b-96343d4b531a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:43.797471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc4b7574-af74-4f1f-9e3b-96343d4b531a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:43.804409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc4b7574-af74-4f1f-9e3b-96343d4b531a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:43.804938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc4b7574-af74-4f1f-9e3b-96343d4b531a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:43.805374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc4b7574-af74-4f1f-9e3b-96343d4b531a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:43.806064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc4b7574-af74-4f1f-9e3b-96343d4b531a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:43.806519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc4b7574-af74-4f1f-9e3b-96343d4b531a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:43.806940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc4b7574-af74-4f1f-9e3b-96343d4b531a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:43.950725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cc4b7574-af74-4f1f-9e3b-96343d4b531a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:43.960126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cc4b7574-af74-4f1f-9e3b-96343d4b531a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:43.961612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cc4b7574-af74-4f1f-9e3b-96343d4b531a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:43.962914 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc4b7574-af74-4f1f-9e3b-96343d4b531a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.171488 Aug 27 05:02:43.963495 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2717/5380] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:43 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:44.077144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e1169477-7350-48a2-a788-84f1d49b91e0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:44.078036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e1169477-7350-48a2-a788-84f1d49b91e0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:44.085748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1169477-7350-48a2-a788-84f1d49b91e0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:44.086234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1169477-7350-48a2-a788-84f1d49b91e0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:44.086669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1169477-7350-48a2-a788-84f1d49b91e0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:44.087357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1169477-7350-48a2-a788-84f1d49b91e0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:44.087810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1169477-7350-48a2-a788-84f1d49b91e0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:44.088233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1169477-7350-48a2-a788-84f1d49b91e0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:44.102875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:44.222178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e1169477-7350-48a2-a788-84f1d49b91e0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:44.229896 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e1169477-7350-48a2-a788-84f1d49b91e0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1217 microversion: 2.1 time: 0.157197 Aug 27 05:02:44.230466 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2664/5381] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:44 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:44.990858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f882064-dae2-4196-9e9d-f44024a72971 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:44.991468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f882064-dae2-4196-9e9d-f44024a72971 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:44.998705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f882064-dae2-4196-9e9d-f44024a72971 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:44.999194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f882064-dae2-4196-9e9d-f44024a72971 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:44.999631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f882064-dae2-4196-9e9d-f44024a72971 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:45.000605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f882064-dae2-4196-9e9d-f44024a72971 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:45.001059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f882064-dae2-4196-9e9d-f44024a72971 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:45.001481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f882064-dae2-4196-9e9d-f44024a72971 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:45.151966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f882064-dae2-4196-9e9d-f44024a72971 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:45.160791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f882064-dae2-4196-9e9d-f44024a72971 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:45.162621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f882064-dae2-4196-9e9d-f44024a72971 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:45.163802 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f882064-dae2-4196-9e9d-f44024a72971 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.177127 Aug 27 05:02:45.171253 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2718/5382] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:44 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:45.251258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-939f1c65-5831-4afd-b9ae-1213f32b1c15 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:45.251809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-939f1c65-5831-4afd-b9ae-1213f32b1c15 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:45.258920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-939f1c65-5831-4afd-b9ae-1213f32b1c15 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:45.259396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-939f1c65-5831-4afd-b9ae-1213f32b1c15 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:45.259895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-939f1c65-5831-4afd-b9ae-1213f32b1c15 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:45.260716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-939f1c65-5831-4afd-b9ae-1213f32b1c15 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:45.261283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-939f1c65-5831-4afd-b9ae-1213f32b1c15 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:45.261630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-939f1c65-5831-4afd-b9ae-1213f32b1c15 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:45.405915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-939f1c65-5831-4afd-b9ae-1213f32b1c15 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:45.419973 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-939f1c65-5831-4afd-b9ae-1213f32b1c15 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1217 microversion: 2.1 time: 0.172861 Aug 27 05:02:45.420823 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2665/5383] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:45 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:46.190723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-552f5935-5bce-4a43-b367-e3b3aca44b02 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:46.191527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-552f5935-5bce-4a43-b367-e3b3aca44b02 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:46.199398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-552f5935-5bce-4a43-b367-e3b3aca44b02 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:46.199398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-552f5935-5bce-4a43-b367-e3b3aca44b02 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:46.199877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-552f5935-5bce-4a43-b367-e3b3aca44b02 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:46.200690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-552f5935-5bce-4a43-b367-e3b3aca44b02 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:46.201241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-552f5935-5bce-4a43-b367-e3b3aca44b02 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:46.201857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-552f5935-5bce-4a43-b367-e3b3aca44b02 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:46.248421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-221248ac-3e62-4d67-b15c-23ad84b5f8d3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:46.250897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-221248ac-3e62-4d67-b15c-23ad84b5f8d3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:46.258074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-221248ac-3e62-4d67-b15c-23ad84b5f8d3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:46.258750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-221248ac-3e62-4d67-b15c-23ad84b5f8d3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:46.259122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-221248ac-3e62-4d67-b15c-23ad84b5f8d3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:46.259897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-221248ac-3e62-4d67-b15c-23ad84b5f8d3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:46.260391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-221248ac-3e62-4d67-b15c-23ad84b5f8d3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:46.261275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-221248ac-3e62-4d67-b15c-23ad84b5f8d3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:46.293560 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-221248ac-3e62-4d67-b15c-23ad84b5f8d3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049152 Aug 27 05:02:46.294227 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2666/5384] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:02:46 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:02:46.343707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-552f5935-5bce-4a43-b367-e3b3aca44b02 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:46.352894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-552f5935-5bce-4a43-b367-e3b3aca44b02 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:46.354338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-552f5935-5bce-4a43-b367-e3b3aca44b02 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:46.355836 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-552f5935-5bce-4a43-b367-e3b3aca44b02 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.170461 Aug 27 05:02:46.356407 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2719/5385] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:46 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:46.439847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f1fe1a0c-b6a4-46e5-b086-f0ab50b6fc38 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:46.440340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f1fe1a0c-b6a4-46e5-b086-f0ab50b6fc38 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:46.441325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f688cf0a-72f7-41cb-b30c-af631c8af207 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:46.442050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f688cf0a-72f7-41cb-b30c-af631c8af207 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:46.446742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1fe1a0c-b6a4-46e5-b086-f0ab50b6fc38 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:46.447242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1fe1a0c-b6a4-46e5-b086-f0ab50b6fc38 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:46.447686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1fe1a0c-b6a4-46e5-b086-f0ab50b6fc38 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:46.448044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f688cf0a-72f7-41cb-b30c-af631c8af207 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:46.448496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1fe1a0c-b6a4-46e5-b086-f0ab50b6fc38 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:46.448626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f688cf0a-72f7-41cb-b30c-af631c8af207 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:46.448982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1fe1a0c-b6a4-46e5-b086-f0ab50b6fc38 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:46.449088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f688cf0a-72f7-41cb-b30c-af631c8af207 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:46.449411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f1fe1a0c-b6a4-46e5-b086-f0ab50b6fc38 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:46.449695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f688cf0a-72f7-41cb-b30c-af631c8af207 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:46.450163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f688cf0a-72f7-41cb-b30c-af631c8af207 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:46.450595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f688cf0a-72f7-41cb-b30c-af631c8af207 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:46.479594 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f1fe1a0c-b6a4-46e5-b086-f0ab50b6fc38 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments/c8d52961-8c3e-4f76-b2cd-a09d0452c50d" status: 200 len: 194 microversion: 2.1 time: 0.043834 Aug 27 05:02:46.480631 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2667/5386] 10.222.0.79 () {58 vars in 1413 bytes} [Sat Aug 27 05:02:46 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments/c8d52961-8c3e-4f76-b2cd-a09d0452c50d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:02:46.491375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dea457f0-a1e1-418a-af17-2a6af6e66c10 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:46.492129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dea457f0-a1e1-418a-af17-2a6af6e66c10 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:46.498580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea457f0-a1e1-418a-af17-2a6af6e66c10 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:46.499208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea457f0-a1e1-418a-af17-2a6af6e66c10 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:46.499702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea457f0-a1e1-418a-af17-2a6af6e66c10 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:46.500735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea457f0-a1e1-418a-af17-2a6af6e66c10 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:46.501190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea457f0-a1e1-418a-af17-2a6af6e66c10 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:46.501616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea457f0-a1e1-418a-af17-2a6af6e66c10 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:46.589574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f688cf0a-72f7-41cb-b30c-af631c8af207 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:46.589874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-dea457f0-a1e1-418a-af17-2a6af6e66c10 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lazy-loading 'services' on Instance uuid dc3ca3f0-178f-48ad-a92d-81f2285abf64 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:02:46.598122 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f688cf0a-72f7-41cb-b30c-af631c8af207 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1217 microversion: 2.1 time: 0.160771 Aug 27 05:02:46.598721 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2720/5387] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:46 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:46.663648 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dea457f0-a1e1-418a-af17-2a6af6e66c10 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "DELETE /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments/c8d52961-8c3e-4f76-b2cd-a09d0452c50d" status: 202 len: 0 microversion: 2.1 time: 0.175580 Aug 27 05:02:46.664408 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2668/5388] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:02:46 2022] DELETE /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments/c8d52961-8c3e-4f76-b2cd-a09d0452c50d => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:02:46.845118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7512f8d3-51a9-4ca9-a6e9-7b2c8e164dd1 req-61c5715a-53e0-453d-a20a-18204132c902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd1a40c-a36d-4253-9f1c-b5711b2ed52a", "name": "network-vif-plugged", "status": "completed", "tag": "620b69e1-40ab-4292-881f-6f2fff934397"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:46.856492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7512f8d3-51a9-4ca9-a6e9-7b2c8e164dd1 req-61c5715a-53e0-453d-a20a-18204132c902 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:46.857035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7512f8d3-51a9-4ca9-a6e9-7b2c8e164dd1 req-61c5715a-53e0-453d-a20a-18204132c902 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:46.857458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7512f8d3-51a9-4ca9-a6e9-7b2c8e164dd1 req-61c5715a-53e0-453d-a20a-18204132c902 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:46.873174 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7512f8d3-51a9-4ca9-a6e9-7b2c8e164dd1 req-61c5715a-53e0-453d-a20a-18204132c902 service nova] Creating event network-vif-plugged:620b69e1-40ab-4292-881f-6f2fff934397 for instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a on n-h2-854823-1 Aug 27 05:02:46.878610 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7512f8d3-51a9-4ca9-a6e9-7b2c8e164dd1 req-61c5715a-53e0-453d-a20a-18204132c902 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037277 Aug 27 05:02:46.879726 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2721/5389] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:02:47.380914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8aa4882b-39d3-404d-88a2-b37409495e73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:47.381628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8aa4882b-39d3-404d-88a2-b37409495e73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:47.389410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa4882b-39d3-404d-88a2-b37409495e73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:47.389905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa4882b-39d3-404d-88a2-b37409495e73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:47.390345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa4882b-39d3-404d-88a2-b37409495e73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:47.391048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa4882b-39d3-404d-88a2-b37409495e73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:47.391508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa4882b-39d3-404d-88a2-b37409495e73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:47.391963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa4882b-39d3-404d-88a2-b37409495e73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:47.563985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8aa4882b-39d3-404d-88a2-b37409495e73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:47.574842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8aa4882b-39d3-404d-88a2-b37409495e73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:47.576556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8aa4882b-39d3-404d-88a2-b37409495e73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:47.578047 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8aa4882b-39d3-404d-88a2-b37409495e73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.202147 Aug 27 05:02:47.578793 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2669/5390] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:47 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:47.620729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09f47318-3aed-413f-8b7f-959f33905e3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:47.621433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-09f47318-3aed-413f-8b7f-959f33905e3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:47.633894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09f47318-3aed-413f-8b7f-959f33905e3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:47.635358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09f47318-3aed-413f-8b7f-959f33905e3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:47.637116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09f47318-3aed-413f-8b7f-959f33905e3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:47.639243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09f47318-3aed-413f-8b7f-959f33905e3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:47.639938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09f47318-3aed-413f-8b7f-959f33905e3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:47.641167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09f47318-3aed-413f-8b7f-959f33905e3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:47.815515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09f47318-3aed-413f-8b7f-959f33905e3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:47.824517 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09f47318-3aed-413f-8b7f-959f33905e3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1217 microversion: 2.1 time: 0.208873 Aug 27 05:02:47.825205 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2722/5391] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:47 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1217 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:48.603779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6f6d4e16-9335-4f4b-b31b-6f5585197159 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:48.604481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6f6d4e16-9335-4f4b-b31b-6f5585197159 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:48.614307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6d4e16-9335-4f4b-b31b-6f5585197159 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:48.614852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6d4e16-9335-4f4b-b31b-6f5585197159 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:48.615299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6d4e16-9335-4f4b-b31b-6f5585197159 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:48.616015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6d4e16-9335-4f4b-b31b-6f5585197159 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:48.617287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6d4e16-9335-4f4b-b31b-6f5585197159 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:48.617737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6d4e16-9335-4f4b-b31b-6f5585197159 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:48.768567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6f6d4e16-9335-4f4b-b31b-6f5585197159 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:48.779292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6f6d4e16-9335-4f4b-b31b-6f5585197159 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:48.780902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6f6d4e16-9335-4f4b-b31b-6f5585197159 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:48.782100 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6f6d4e16-9335-4f4b-b31b-6f5585197159 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1807 microversion: 2.20 time: 0.184134 Aug 27 05:02:48.782670 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2670/5392] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:48 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:48.850812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-278f9fe3-5b1d-4cfd-a2d6-082a390bc5b3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:48.853619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-278f9fe3-5b1d-4cfd-a2d6-082a390bc5b3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:48.871735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-278f9fe3-5b1d-4cfd-a2d6-082a390bc5b3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:48.872309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-278f9fe3-5b1d-4cfd-a2d6-082a390bc5b3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:48.872779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-278f9fe3-5b1d-4cfd-a2d6-082a390bc5b3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:48.873524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-278f9fe3-5b1d-4cfd-a2d6-082a390bc5b3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:48.873993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-278f9fe3-5b1d-4cfd-a2d6-082a390bc5b3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:48.874428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-278f9fe3-5b1d-4cfd-a2d6-082a390bc5b3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:48.900900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-70169b95-5609-4b49-b8f8-98a8d5eb17e2 req-340ea9b4-f09b-4468-9999-306ddfb8b5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38", "name": "network-vif-plugged", "status": "completed", "tag": "fafeac18-7f47-48f7-9544-4ab5fee53c4c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:48.916792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-70169b95-5609-4b49-b8f8-98a8d5eb17e2 req-340ea9b4-f09b-4468-9999-306ddfb8b5f3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:48.917141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-70169b95-5609-4b49-b8f8-98a8d5eb17e2 req-340ea9b4-f09b-4468-9999-306ddfb8b5f3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:48.917765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-70169b95-5609-4b49-b8f8-98a8d5eb17e2 req-340ea9b4-f09b-4468-9999-306ddfb8b5f3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:48.934711 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-70169b95-5609-4b49-b8f8-98a8d5eb17e2 req-340ea9b4-f09b-4468-9999-306ddfb8b5f3 service nova] Creating event network-vif-plugged:fafeac18-7f47-48f7-9544-4ab5fee53c4c for instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 on n-h1-854823-1 Aug 27 05:02:48.943378 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-70169b95-5609-4b49-b8f8-98a8d5eb17e2 req-340ea9b4-f09b-4468-9999-306ddfb8b5f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046082 Aug 27 05:02:48.944475 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2671/5393] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:02:48.974606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f0c22394-c316-4b8c-9353-50905fd6c332 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:48.980244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f0c22394-c316-4b8c-9353-50905fd6c332 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:48.991075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c22394-c316-4b8c-9353-50905fd6c332 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:48.991661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c22394-c316-4b8c-9353-50905fd6c332 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:48.992408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c22394-c316-4b8c-9353-50905fd6c332 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:48.993366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c22394-c316-4b8c-9353-50905fd6c332 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:48.994128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c22394-c316-4b8c-9353-50905fd6c332 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:48.994752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0c22394-c316-4b8c-9353-50905fd6c332 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:49.096170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-278f9fe3-5b1d-4cfd-a2d6-082a390bc5b3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:49.108512 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-278f9fe3-5b1d-4cfd-a2d6-082a390bc5b3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1217 microversion: 2.1 time: 0.265941 Aug 27 05:02:49.112317 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2723/5394] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:48 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1217 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:49.143359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-f0c22394-c316-4b8c-9353-50905fd6c332 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lazy-loading 'services' on Instance uuid 41f03f20-94d9-43e9-b017-6e850da180b4 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:02:49.239880 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f0c22394-c316-4b8c-9353-50905fd6c332 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "DELETE /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4/os-volume_attachments/122c190c-4b42-4ea2-91a1-728a99320025" status: 202 len: 0 microversion: 2.1 time: 0.272929 Aug 27 05:02:49.245162 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2672/5395] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:02:48 2022] DELETE /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4/os-volume_attachments/122c190c-4b42-4ea2-91a1-728a99320025 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:02:49.805465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36828ffb-aa74-4ec0-af2c-a10e1bf7d616 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:49.805986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36828ffb-aa74-4ec0-af2c-a10e1bf7d616 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:49.812284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36828ffb-aa74-4ec0-af2c-a10e1bf7d616 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:49.812805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36828ffb-aa74-4ec0-af2c-a10e1bf7d616 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:49.813246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36828ffb-aa74-4ec0-af2c-a10e1bf7d616 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:49.813967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36828ffb-aa74-4ec0-af2c-a10e1bf7d616 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:49.814422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36828ffb-aa74-4ec0-af2c-a10e1bf7d616 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:49.814848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36828ffb-aa74-4ec0-af2c-a10e1bf7d616 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:49.972425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36828ffb-aa74-4ec0-af2c-a10e1bf7d616 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:49.981975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36828ffb-aa74-4ec0-af2c-a10e1bf7d616 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:49.983755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36828ffb-aa74-4ec0-af2c-a10e1bf7d616 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:49.985364 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36828ffb-aa74-4ec0-af2c-a10e1bf7d616 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1794 microversion: 2.20 time: 0.183797 Aug 27 05:02:49.986081 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2724/5396] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:02:49 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1794 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:02:50.137000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dafa4fad-d5bc-4ae9-96f6-e74dd56e858e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:50.137520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dafa4fad-d5bc-4ae9-96f6-e74dd56e858e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:50.140012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=70 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:50.148191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dafa4fad-d5bc-4ae9-96f6-e74dd56e858e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:50.148938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dafa4fad-d5bc-4ae9-96f6-e74dd56e858e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:50.149774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dafa4fad-d5bc-4ae9-96f6-e74dd56e858e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:50.150685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dafa4fad-d5bc-4ae9-96f6-e74dd56e858e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:50.151366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dafa4fad-d5bc-4ae9-96f6-e74dd56e858e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:50.152142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dafa4fad-d5bc-4ae9-96f6-e74dd56e858e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:50.288268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dafa4fad-d5bc-4ae9-96f6-e74dd56e858e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:50.295999 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dafa4fad-d5bc-4ae9-96f6-e74dd56e858e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1217 microversion: 2.1 time: 0.165905 Aug 27 05:02:50.296583 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2673/5397] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:50 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:51.318597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05f21e2a-9ba3-4378-abbe-d411408f9346 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:51.320266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05f21e2a-9ba3-4378-abbe-d411408f9346 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:51.331566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05f21e2a-9ba3-4378-abbe-d411408f9346 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.332421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05f21e2a-9ba3-4378-abbe-d411408f9346 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.333186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05f21e2a-9ba3-4378-abbe-d411408f9346 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:51.334310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05f21e2a-9ba3-4378-abbe-d411408f9346 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.335083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05f21e2a-9ba3-4378-abbe-d411408f9346 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.335677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05f21e2a-9ba3-4378-abbe-d411408f9346 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:51.495804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05f21e2a-9ba3-4378-abbe-d411408f9346 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:51.505418 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05f21e2a-9ba3-4378-abbe-d411408f9346 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1404 microversion: 2.1 time: 0.192052 Aug 27 05:02:51.506576 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2725/5398] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:51 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1404 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:51.529173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-907eff18-0463-4f03-b691-f07a775d0819 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:51.529794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-907eff18-0463-4f03-b691-f07a775d0819 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:51.537345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-907eff18-0463-4f03-b691-f07a775d0819 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.538253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-907eff18-0463-4f03-b691-f07a775d0819 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.538253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-907eff18-0463-4f03-b691-f07a775d0819 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:51.539593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-907eff18-0463-4f03-b691-f07a775d0819 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.540291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-907eff18-0463-4f03-b691-f07a775d0819 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.540821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-907eff18-0463-4f03-b691-f07a775d0819 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:51.684477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-907eff18-0463-4f03-b691-f07a775d0819 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:51.693514 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-907eff18-0463-4f03-b691-f07a775d0819 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1404 microversion: 2.1 time: 0.170377 Aug 27 05:02:51.694352 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2674/5399] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:51 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1404 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:51.714534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ccbc41eb-db9a-4134-a8e0-80c5c30dd837 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1950515330"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:51.717055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ccbc41eb-db9a-4134-a8e0-80c5c30dd837 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:51.724069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccbc41eb-db9a-4134-a8e0-80c5c30dd837 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.724866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccbc41eb-db9a-4134-a8e0-80c5c30dd837 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.725314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccbc41eb-db9a-4134-a8e0-80c5c30dd837 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:51.726040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccbc41eb-db9a-4134-a8e0-80c5c30dd837 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.726674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccbc41eb-db9a-4134-a8e0-80c5c30dd837 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.727113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccbc41eb-db9a-4134-a8e0-80c5c30dd837 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:51.894837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a5d65de4-a098-431f-96e5-509ceec6912b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:51.895391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a5d65de4-a098-431f-96e5-509ceec6912b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:51.904081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5d65de4-a098-431f-96e5-509ceec6912b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.905003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5d65de4-a098-431f-96e5-509ceec6912b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.905495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5d65de4-a098-431f-96e5-509ceec6912b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:51.906219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5d65de4-a098-431f-96e5-509ceec6912b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.906679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5d65de4-a098-431f-96e5-509ceec6912b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.907104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5d65de4-a098-431f-96e5-509ceec6912b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:51.970737 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a5d65de4-a098-431f-96e5-509ceec6912b tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments/67eeaee9-283b-41f6-8070-6c76699d36d2" status: 200 len: 194 microversion: 2.1 time: 0.079975 Aug 27 05:02:51.976770 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2675/5400] 10.222.0.79 () {58 vars in 1413 bytes} [Sat Aug 27 05:02:51 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments/67eeaee9-283b-41f6-8070-6c76699d36d2 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:02:51.981994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-555858b7-ce0d-4f81-8b18-f8e9e64a146a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:51.982702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-555858b7-ce0d-4f81-8b18-f8e9e64a146a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:51.989325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-555858b7-ce0d-4f81-8b18-f8e9e64a146a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.989833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-555858b7-ce0d-4f81-8b18-f8e9e64a146a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.990283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-555858b7-ce0d-4f81-8b18-f8e9e64a146a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:51.991007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-555858b7-ce0d-4f81-8b18-f8e9e64a146a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:51.991473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-555858b7-ce0d-4f81-8b18-f8e9e64a146a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:51.991904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-555858b7-ce0d-4f81-8b18-f8e9e64a146a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:52.024168 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.compute.api [None req-ccbc41eb-db9a-4134-a8e0-80c5c30dd837 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Attempting to quiesce instance before volume snapshot. Aug 27 05:02:52.081962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-555858b7-ce0d-4f81-8b18-f8e9e64a146a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lazy-loading 'services' on Instance uuid dc3ca3f0-178f-48ad-a92d-81f2285abf64 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:02:52.097981 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.compute.api [None req-ccbc41eb-db9a-4134-a8e0-80c5c30dd837 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 27 05:02:52.181755 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-555858b7-ce0d-4f81-8b18-f8e9e64a146a tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "DELETE /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments/67eeaee9-283b-41f6-8070-6c76699d36d2" status: 202 len: 0 microversion: 2.1 time: 0.203214 Aug 27 05:02:52.182795 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2676/5401] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:02:51 2022] DELETE /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments/67eeaee9-283b-41f6-8070-6c76699d36d2 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:02:52.221223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ccbc41eb-db9a-4134-a8e0-80c5c30dd837 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Creating snapshot from volume 9ea3026b-2b75-40a0-9167-c3d3e66b7f7b. {{(pid=128869) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 27 05:02:52.971190 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ccbc41eb-db9a-4134-a8e0-80c5c30dd837 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "POST /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38/action" status: 202 len: 0 microversion: 2.1 time: 1.260432 Aug 27 05:02:52.977541 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2726/5402] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:02:51 2022] POST /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38/action => generated 0 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 05:02:56.314958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-276777961", "imageRef": "62a06793-bea7-4b0b-b653-a950703946d7", "flavorRef": "452", "networks": [{"uuid": "0b9321d5-af89-499e-b147-430b2ec333ca"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:56.324503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e49b71b8-50e6-4a38-8bcb-7b1f26e93805 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:56.325715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e49b71b8-50e6-4a38-8bcb-7b1f26e93805 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:56.327714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=61 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:56.335430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e49b71b8-50e6-4a38-8bcb-7b1f26e93805 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:56.336253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e49b71b8-50e6-4a38-8bcb-7b1f26e93805 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:56.337000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e49b71b8-50e6-4a38-8bcb-7b1f26e93805 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:56.337952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e49b71b8-50e6-4a38-8bcb-7b1f26e93805 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:56.338659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e49b71b8-50e6-4a38-8bcb-7b1f26e93805 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:56.339321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e49b71b8-50e6-4a38-8bcb-7b1f26e93805 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:56.369239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e49b71b8-50e6-4a38-8bcb-7b1f26e93805 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:02:56.378332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] validate_networks() for [('0b9321d5-af89-499e-b147-430b2ec333ca', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:02:56.461161 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e49b71b8-50e6-4a38-8bcb-7b1f26e93805 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "DELETE /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 204 len: 0 microversion: 2.1 time: 0.141242 Aug 27 05:02:56.462279 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2727/5403] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:02:56 2022] DELETE /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:02:56.471120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c935a338-f483-4fcf-93cc-81c8db6b431d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:56.471998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c935a338-f483-4fcf-93cc-81c8db6b431d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:56.479331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c935a338-f483-4fcf-93cc-81c8db6b431d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:56.480001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c935a338-f483-4fcf-93cc-81c8db6b431d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:56.480626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c935a338-f483-4fcf-93cc-81c8db6b431d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:56.481618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c935a338-f483-4fcf-93cc-81c8db6b431d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:56.482202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c935a338-f483-4fcf-93cc-81c8db6b431d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:56.482748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c935a338-f483-4fcf-93cc-81c8db6b431d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:56.622558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c935a338-f483-4fcf-93cc-81c8db6b431d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:56.631814 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c935a338-f483-4fcf-93cc-81c8db6b431d tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1513 microversion: 2.1 time: 0.165132 Aug 27 05:02:56.632338 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2728/5404] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:56 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:56.783843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:02:56.784261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:02:56.784792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:02:56.785321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:02:56.785763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:02:56.794774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:56.795285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:56.795714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:56.796439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:56.796915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:56.797339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:56.814836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:02:56.820066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for user 8376c4e2cf814a8b8b1e2a8e404b0187 and project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:02:56.832982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:02:56.835637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='6d27cc08-dc1d-4a67-813d-77da8e9f0063',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:02:56.914428 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8dc90a1a-ff24-491e-ad6d-e304ee368474 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604527 Aug 27 05:02:56.921427 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2677/5405] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:02:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:02:56.927230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0507d9f8-e1f0-4e2d-b9bc-05e63d5ddfec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:56.928226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0507d9f8-e1f0-4e2d-b9bc-05e63d5ddfec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:56.989769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0507d9f8-e1f0-4e2d-b9bc-05e63d5ddfec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:56.998257 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0507d9f8-e1f0-4e2d-b9bc-05e63d5ddfec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1229 microversion: 2.1 time: 0.075343 Aug 27 05:02:57.000583 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2729/5406] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:56 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1229 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:57.654045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-872a56ae-f692-4bb4-a9b0-633167510807 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:57.654624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-872a56ae-f692-4bb4-a9b0-633167510807 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:57.663422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-872a56ae-f692-4bb4-a9b0-633167510807 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:57.663914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-872a56ae-f692-4bb4-a9b0-633167510807 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:57.664347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-872a56ae-f692-4bb4-a9b0-633167510807 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:57.665080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-872a56ae-f692-4bb4-a9b0-633167510807 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:57.665541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-872a56ae-f692-4bb4-a9b0-633167510807 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:57.665967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-872a56ae-f692-4bb4-a9b0-633167510807 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:57.811938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-872a56ae-f692-4bb4-a9b0-633167510807 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:57.820854 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-872a56ae-f692-4bb4-a9b0-633167510807 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1513 microversion: 2.1 time: 0.170823 Aug 27 05:02:57.821451 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2678/5407] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:57 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:58.021369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3500d353-378a-4982-9efe-913e7050287c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:58.022138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3500d353-378a-4982-9efe-913e7050287c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:58.029824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3500d353-378a-4982-9efe-913e7050287c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:58.030414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3500d353-378a-4982-9efe-913e7050287c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:58.030874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3500d353-378a-4982-9efe-913e7050287c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:58.031603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3500d353-378a-4982-9efe-913e7050287c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:58.032080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3500d353-378a-4982-9efe-913e7050287c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:58.032551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3500d353-378a-4982-9efe-913e7050287c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:58.037082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:58.102200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3500d353-378a-4982-9efe-913e7050287c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:58.112899 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3500d353-378a-4982-9efe-913e7050287c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1281 microversion: 2.1 time: 0.095314 Aug 27 05:02:58.114347 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2730/5408] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:58 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1281 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:58.843652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31b95d41-ef2f-4617-8126-105b06b07e3c tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:58.844596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-31b95d41-ef2f-4617-8126-105b06b07e3c tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:58.852351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31b95d41-ef2f-4617-8126-105b06b07e3c tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:58.853759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31b95d41-ef2f-4617-8126-105b06b07e3c tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:58.854821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31b95d41-ef2f-4617-8126-105b06b07e3c tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:58.855881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31b95d41-ef2f-4617-8126-105b06b07e3c tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:58.856630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31b95d41-ef2f-4617-8126-105b06b07e3c tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:58.857360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31b95d41-ef2f-4617-8126-105b06b07e3c tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:59.135875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f587c49-06e4-449d-a787-709ed8a24753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:02:59.136651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3f587c49-06e4-449d-a787-709ed8a24753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:02:59.139782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-31b95d41-ef2f-4617-8126-105b06b07e3c tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:59.149494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f587c49-06e4-449d-a787-709ed8a24753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:59.153195 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-31b95d41-ef2f-4617-8126-105b06b07e3c tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1513 microversion: 2.1 time: 0.312537 Aug 27 05:02:59.154002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f587c49-06e4-449d-a787-709ed8a24753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:59.154575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f587c49-06e4-449d-a787-709ed8a24753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:59.155452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f587c49-06e4-449d-a787-709ed8a24753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:59.156149 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2679/5409] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:58 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1513 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:02:59.170332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f587c49-06e4-449d-a787-709ed8a24753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:59.171374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f587c49-06e4-449d-a787-709ed8a24753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:59.470009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f587c49-06e4-449d-a787-709ed8a24753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:02:59.481070 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f587c49-06e4-449d-a787-709ed8a24753 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.349618 Aug 27 05:02:59.497522 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2731/5410] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:02:59 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:02:59.582346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-27ba63e5-bd57-46e1-92a8-223d3154f0cf req-35d14bf2-220f-410f-92a2-618d3426f7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f03f20-94d9-43e9-b017-6e850da180b4", "name": "network-vif-deleted", "tag": "a0dee1a3-649f-441e-bf2f-f1754f49e03d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:02:59.595838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-27ba63e5-bd57-46e1-92a8-223d3154f0cf req-35d14bf2-220f-410f-92a2-618d3426f7e8 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:02:59.598717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-27ba63e5-bd57-46e1-92a8-223d3154f0cf req-35d14bf2-220f-410f-92a2-618d3426f7e8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:02:59.599527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-27ba63e5-bd57-46e1-92a8-223d3154f0cf req-35d14bf2-220f-410f-92a2-618d3426f7e8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:02:59.633642 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-27ba63e5-bd57-46e1-92a8-223d3154f0cf req-35d14bf2-220f-410f-92a2-618d3426f7e8 service nova] Creating event network-vif-deleted:a0dee1a3-649f-441e-bf2f-f1754f49e03d for instance 41f03f20-94d9-43e9-b017-6e850da180b4 on n-h1-854823-1 Aug 27 05:02:59.643819 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-27ba63e5-bd57-46e1-92a8-223d3154f0cf req-35d14bf2-220f-410f-92a2-618d3426f7e8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065801 Aug 27 05:02:59.645252 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2680/5411] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:00.179165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f1d593d-3c34-4326-9326-4ccc50d99772 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:00.179812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f1d593d-3c34-4326-9326-4ccc50d99772 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:00.193486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f1d593d-3c34-4326-9326-4ccc50d99772 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:00.194239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f1d593d-3c34-4326-9326-4ccc50d99772 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:00.195248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f1d593d-3c34-4326-9326-4ccc50d99772 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:00.196918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f1d593d-3c34-4326-9326-4ccc50d99772 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:00.197557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f1d593d-3c34-4326-9326-4ccc50d99772 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:00.198303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f1d593d-3c34-4326-9326-4ccc50d99772 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:00.257717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f1d593d-3c34-4326-9326-4ccc50d99772 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:00.258446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f1d593d-3c34-4326-9326-4ccc50d99772 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:00.259066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f1d593d-3c34-4326-9326-4ccc50d99772 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:00.259770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-4f1d593d-3c34-4326-9326-4ccc50d99772 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lazy-loading 'fault' on Instance uuid 41f03f20-94d9-43e9-b017-6e850da180b4 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:03:00.314422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f1d593d-3c34-4326-9326-4ccc50d99772 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:00.326085 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f1d593d-3c34-4326-9326-4ccc50d99772 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 200 len: 1308 microversion: 2.1 time: 0.152555 Aug 27 05:03:00.327080 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2732/5412] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:00 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 1308 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:00.504817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-20004e83-659b-405e-b48a-f3cf1257f81d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:00.507005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-20004e83-659b-405e-b48a-f3cf1257f81d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:00.518352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20004e83-659b-405e-b48a-f3cf1257f81d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:00.519120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20004e83-659b-405e-b48a-f3cf1257f81d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:00.519717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20004e83-659b-405e-b48a-f3cf1257f81d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:00.520663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20004e83-659b-405e-b48a-f3cf1257f81d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:00.521304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20004e83-659b-405e-b48a-f3cf1257f81d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:00.521913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20004e83-659b-405e-b48a-f3cf1257f81d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:00.526953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:00.718271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-20004e83-659b-405e-b48a-f3cf1257f81d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:00.726960 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-20004e83-659b-405e-b48a-f3cf1257f81d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.228028 Aug 27 05:03:00.727589 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2681/5413] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:00 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:01.355670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0084de3-a465-4f9e-b0b8-b5d311c8422a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:01.356297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a0084de3-a465-4f9e-b0b8-b5d311c8422a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: 41f03f20-94d9-43e9-b017-6e850da180b4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:01.364542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0084de3-a465-4f9e-b0b8-b5d311c8422a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:01.365178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0084de3-a465-4f9e-b0b8-b5d311c8422a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:01.365628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0084de3-a465-4f9e-b0b8-b5d311c8422a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:01.366339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0084de3-a465-4f9e-b0b8-b5d311c8422a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:01.366805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0084de3-a465-4f9e-b0b8-b5d311c8422a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:01.367237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0084de3-a465-4f9e-b0b8-b5d311c8422a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:01.384013 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a0084de3-a465-4f9e-b0b8-b5d311c8422a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] HTTP exception thrown: Instance 41f03f20-94d9-43e9-b017-6e850da180b4 could not be found. Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0084de3-a465-4f9e-b0b8-b5d311c8422a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Request method failure captured: Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 HTTP/1.1 Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaSkQdWmuDdjr-XV46C0CsVlteLi8W8qZ2QYwYaAuw9Z6qj-qD18m93IWxV36EJWgjherngsddyASXWkbEIobsORLHzWPNkPWMcMOGNdOIv-_w_LDkZWSpUwTqisafReMTMCUgMIQ1f0Fz2tzATT04qmb8Dwt8XLio-lf0DxNHiSy6s Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 96da74018b7846f79741bf8f15b22ae9 Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1005291699 Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/96da74018b7846f79741bf8f15b22ae9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_96da74018b7846f79741bf8f15b22ae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/96da74018b7846f79741bf8f15b22ae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/96da74018b7846f79741bf8f15b22ae9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesSnapshotTestJSON-1005291699 Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 96da74018b7846f79741bf8f15b22ae9 Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1005291699 Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-VolumesSnapshotTestJSON-1005291699-project Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: d5b1048ffa264ff4abdf91994f0d66a1 Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesSnapshotTestJSON-1005291699-project Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 41f03f20-94d9-43e9-b017-6e850da180b4 could not be found. Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '41f03f20-94d9-43e9-b017-6e850da180b4'} Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f03f20-94d9-43e9-b017-6e850da180b4 could not be found. Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f03f20-94d9-43e9-b017-6e850da180b4 could not be found. Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:01.385739 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:01.390638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:01.390638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:01.390638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:01.390638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:01.390638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:01.390638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f03f20-94d9-43e9-b017-6e850da180b4 could not be found. Aug 27 05:03:01.390638 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:01.390638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0084de3-a465-4f9e-b0b8-b5d311c8422a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Returning 404 to user: Instance 41f03f20-94d9-43e9-b017-6e850da180b4 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:01.390638 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0084de3-a465-4f9e-b0b8-b5d311c8422a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4" status: 404 len: 111 microversion: 2.1 time: 0.035638 Aug 27 05:03:01.391302 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2733/5414] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:01 2022] GET /compute/v2.1/servers/41f03f20-94d9-43e9-b017-6e850da180b4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:01.748117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-18da885c-8340-4ae8-9dc7-22248c5de5c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:01.749551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-18da885c-8340-4ae8-9dc7-22248c5de5c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:01.757162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18da885c-8340-4ae8-9dc7-22248c5de5c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:01.757872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18da885c-8340-4ae8-9dc7-22248c5de5c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:01.758307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18da885c-8340-4ae8-9dc7-22248c5de5c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:01.758996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18da885c-8340-4ae8-9dc7-22248c5de5c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:01.759797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18da885c-8340-4ae8-9dc7-22248c5de5c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:01.760476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-18da885c-8340-4ae8-9dc7-22248c5de5c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:01.789404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5b0fb7e8-e79d-46ca-a12a-1fb3c9faa212 req-f4cb7f9f-51eb-4ff1-a086-aa20e6e6e637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a1d6417-52c8-4ede-864c-c1afc2733a46", "tag": "d01488bd-73f7-429f-aad4-d9efbdec2c24"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:01.800984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5b0fb7e8-e79d-46ca-a12a-1fb3c9faa212 req-f4cb7f9f-51eb-4ff1-a086-aa20e6e6e637 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:01.801812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5b0fb7e8-e79d-46ca-a12a-1fb3c9faa212 req-f4cb7f9f-51eb-4ff1-a086-aa20e6e6e637 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:01.802454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5b0fb7e8-e79d-46ca-a12a-1fb3c9faa212 req-f4cb7f9f-51eb-4ff1-a086-aa20e6e6e637 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:01.820374 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5b0fb7e8-e79d-46ca-a12a-1fb3c9faa212 req-f4cb7f9f-51eb-4ff1-a086-aa20e6e6e637 service nova] Creating event network-changed:d01488bd-73f7-429f-aad4-d9efbdec2c24 for instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 on n-h2-854823-1 Aug 27 05:03:01.826747 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5b0fb7e8-e79d-46ca-a12a-1fb3c9faa212 req-f4cb7f9f-51eb-4ff1-a086-aa20e6e6e637 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042073 Aug 27 05:03:01.828180 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2734/5415] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:03:02.026890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d9a7b565-bac5-48e6-9d8e-ac098d4eed29 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:02.030263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d9a7b565-bac5-48e6-9d8e-ac098d4eed29 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:02.037276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9a7b565-bac5-48e6-9d8e-ac098d4eed29 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:02.038205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9a7b565-bac5-48e6-9d8e-ac098d4eed29 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:02.039462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9a7b565-bac5-48e6-9d8e-ac098d4eed29 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:02.040393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9a7b565-bac5-48e6-9d8e-ac098d4eed29 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:02.041099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9a7b565-bac5-48e6-9d8e-ac098d4eed29 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:02.041907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9a7b565-bac5-48e6-9d8e-ac098d4eed29 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:02.060096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-18da885c-8340-4ae8-9dc7-22248c5de5c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:02.073816 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-18da885c-8340-4ae8-9dc7-22248c5de5c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.329603 Aug 27 05:03:02.074416 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2682/5416] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:01 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:02.099517 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d9a7b565-bac5-48e6-9d8e-ac098d4eed29 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077536 Aug 27 05:03:02.100752 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2735/5417] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:03:02 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:03:02.259839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60074dce-7989-4608-9a69-bebee40ad3a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:02.264449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60074dce-7989-4608-9a69-bebee40ad3a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:02.279481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60074dce-7989-4608-9a69-bebee40ad3a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:02.291232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60074dce-7989-4608-9a69-bebee40ad3a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:02.292390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60074dce-7989-4608-9a69-bebee40ad3a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:02.293645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60074dce-7989-4608-9a69-bebee40ad3a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:02.294251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60074dce-7989-4608-9a69-bebee40ad3a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:02.294948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60074dce-7989-4608-9a69-bebee40ad3a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:02.333400 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60074dce-7989-4608-9a69-bebee40ad3a3 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078187 Aug 27 05:03:02.337028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c1c7c4be-e340-4e45-ac8a-e8bfb5303924 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:02.340562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c1c7c4be-e340-4e45-ac8a-e8bfb5303924 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:02.340794 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2736/5418] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:03:02 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:03:02.352923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1c7c4be-e340-4e45-ac8a-e8bfb5303924 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:02.353465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1c7c4be-e340-4e45-ac8a-e8bfb5303924 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:02.354039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1c7c4be-e340-4e45-ac8a-e8bfb5303924 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:02.356356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1c7c4be-e340-4e45-ac8a-e8bfb5303924 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:02.358032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1c7c4be-e340-4e45-ac8a-e8bfb5303924 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:02.358533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c1c7c4be-e340-4e45-ac8a-e8bfb5303924 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:02.430983 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c1c7c4be-e340-4e45-ac8a-e8bfb5303924 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c/action" status: 200 len: 24567 microversion: 2.1 time: 0.355163 Aug 27 05:03:02.431444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b4a29a3c-9d55-4711-adb8-727ae54ab409 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:02.431916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b4a29a3c-9d55-4711-adb8-727ae54ab409 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:02.435505 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2683/5419] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:03:02 2022] POST /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c/action => generated 24567 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:03:02.440613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4a29a3c-9d55-4711-adb8-727ae54ab409 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:02.441658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4a29a3c-9d55-4711-adb8-727ae54ab409 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:02.443626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4a29a3c-9d55-4711-adb8-727ae54ab409 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:02.445756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4a29a3c-9d55-4711-adb8-727ae54ab409 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:02.446305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4a29a3c-9d55-4711-adb8-727ae54ab409 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:02.446749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4a29a3c-9d55-4711-adb8-727ae54ab409 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:02.500723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b4a29a3c-9d55-4711-adb8-727ae54ab409 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:03:02.654773 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b4a29a3c-9d55-4711-adb8-727ae54ab409 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "DELETE /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 204 len: 0 microversion: 2.1 time: 0.228362 Aug 27 05:03:02.655975 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2737/5420] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:03:02 2022] DELETE /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:03:02.672196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-913cc69d-56bb-4847-a500-c2a9aa48db23 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:02.675255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-913cc69d-56bb-4847-a500-c2a9aa48db23 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:02.684517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-913cc69d-56bb-4847-a500-c2a9aa48db23 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:02.685157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-913cc69d-56bb-4847-a500-c2a9aa48db23 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:02.688077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-913cc69d-56bb-4847-a500-c2a9aa48db23 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:02.688077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-913cc69d-56bb-4847-a500-c2a9aa48db23 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:02.688077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-913cc69d-56bb-4847-a500-c2a9aa48db23 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:02.688077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-913cc69d-56bb-4847-a500-c2a9aa48db23 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:02.909082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-913cc69d-56bb-4847-a500-c2a9aa48db23 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:02.918380 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-913cc69d-56bb-4847-a500-c2a9aa48db23 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1670 microversion: 2.1 time: 0.256940 Aug 27 05:03:02.919319 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2684/5421] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:02 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1670 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:03.101727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ebb38c45-0a50-4081-ac8a-971e16417992 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:03.102879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ebb38c45-0a50-4081-ac8a-971e16417992 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:03.110634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebb38c45-0a50-4081-ac8a-971e16417992 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:03.111358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebb38c45-0a50-4081-ac8a-971e16417992 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:03.112146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebb38c45-0a50-4081-ac8a-971e16417992 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:03.113432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebb38c45-0a50-4081-ac8a-971e16417992 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:03.114311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebb38c45-0a50-4081-ac8a-971e16417992 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:03.115005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebb38c45-0a50-4081-ac8a-971e16417992 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:03.362268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ebb38c45-0a50-4081-ac8a-971e16417992 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:03.374195 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ebb38c45-0a50-4081-ac8a-971e16417992 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.278436 Aug 27 05:03:03.377866 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2738/5422] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:03 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:03.947329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6d9d9b15-417b-4091-804e-5cbe6e3fb0ba tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:03.947950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6d9d9b15-417b-4091-804e-5cbe6e3fb0ba tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:03.955353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d9d9b15-417b-4091-804e-5cbe6e3fb0ba tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:03.955930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d9d9b15-417b-4091-804e-5cbe6e3fb0ba tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:03.956352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d9d9b15-417b-4091-804e-5cbe6e3fb0ba tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:03.957110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d9d9b15-417b-4091-804e-5cbe6e3fb0ba tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:03.957754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d9d9b15-417b-4091-804e-5cbe6e3fb0ba tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:03.958191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d9d9b15-417b-4091-804e-5cbe6e3fb0ba tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:04.184373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6d9d9b15-417b-4091-804e-5cbe6e3fb0ba tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:04.197309 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6d9d9b15-417b-4091-804e-5cbe6e3fb0ba tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1670 microversion: 2.1 time: 0.255100 Aug 27 05:03:04.198237 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2685/5423] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:03 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1670 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:04.401285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-645a8864-a990-4efc-ad99-c34e060b6a1f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:04.401933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-645a8864-a990-4efc-ad99-c34e060b6a1f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:04.413048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645a8864-a990-4efc-ad99-c34e060b6a1f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:04.413555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645a8864-a990-4efc-ad99-c34e060b6a1f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:04.414013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645a8864-a990-4efc-ad99-c34e060b6a1f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:04.415304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645a8864-a990-4efc-ad99-c34e060b6a1f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:04.416948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645a8864-a990-4efc-ad99-c34e060b6a1f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:04.416948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645a8864-a990-4efc-ad99-c34e060b6a1f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:04.655977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-645a8864-a990-4efc-ad99-c34e060b6a1f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:04.671635 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-645a8864-a990-4efc-ad99-c34e060b6a1f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.274501 Aug 27 05:03:04.672506 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2739/5424] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:04 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:05.231531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0cad18b-f1b8-4869-bf5d-84bfe346a0bf tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:05.232974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c0cad18b-f1b8-4869-bf5d-84bfe346a0bf tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:05.247085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0cad18b-f1b8-4869-bf5d-84bfe346a0bf tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:05.248699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0cad18b-f1b8-4869-bf5d-84bfe346a0bf tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:05.249491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0cad18b-f1b8-4869-bf5d-84bfe346a0bf tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:05.251099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0cad18b-f1b8-4869-bf5d-84bfe346a0bf tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:05.252697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0cad18b-f1b8-4869-bf5d-84bfe346a0bf tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:05.253538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0cad18b-f1b8-4869-bf5d-84bfe346a0bf tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:05.702039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-072cdc76-2b18-471b-a4d5-a3afeeed71be tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:05.702594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-072cdc76-2b18-471b-a4d5-a3afeeed71be tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:05.717583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-072cdc76-2b18-471b-a4d5-a3afeeed71be tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:05.720555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-072cdc76-2b18-471b-a4d5-a3afeeed71be tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:05.722852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-072cdc76-2b18-471b-a4d5-a3afeeed71be tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:05.727829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-072cdc76-2b18-471b-a4d5-a3afeeed71be tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:05.732557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-072cdc76-2b18-471b-a4d5-a3afeeed71be tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:05.735165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-072cdc76-2b18-471b-a4d5-a3afeeed71be tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:06.018730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-072cdc76-2b18-471b-a4d5-a3afeeed71be tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:06.030125 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-072cdc76-2b18-471b-a4d5-a3afeeed71be tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.332043 Aug 27 05:03:06.031652 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2740/5425] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:05 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:06.036035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c0cad18b-f1b8-4869-bf5d-84bfe346a0bf tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:06.046181 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c0cad18b-f1b8-4869-bf5d-84bfe346a0bf tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1670 microversion: 2.1 time: 0.821698 Aug 27 05:03:06.059750 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2686/5426] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:05 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1670 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:06.324125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-870110a9-8fd5-4042-bd4e-957c79f7cb8f req-43653f4e-1595-446d-8104-b3acf0ddc6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3ca3f0-178f-48ad-a92d-81f2285abf64", "name": "network-vif-deleted", "tag": "fbc1d9ef-c67e-4481-bf0a-b2732263a4fd"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:06.343731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-870110a9-8fd5-4042-bd4e-957c79f7cb8f req-43653f4e-1595-446d-8104-b3acf0ddc6f4 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:06.345167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-870110a9-8fd5-4042-bd4e-957c79f7cb8f req-43653f4e-1595-446d-8104-b3acf0ddc6f4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:06.346252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-870110a9-8fd5-4042-bd4e-957c79f7cb8f req-43653f4e-1595-446d-8104-b3acf0ddc6f4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:06.382665 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-870110a9-8fd5-4042-bd4e-957c79f7cb8f req-43653f4e-1595-446d-8104-b3acf0ddc6f4 service nova] Creating event network-vif-deleted:fbc1d9ef-c67e-4481-bf0a-b2732263a4fd for instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 on n-h2-854823-1 Aug 27 05:03:06.391166 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-870110a9-8fd5-4042-bd4e-957c79f7cb8f req-43653f4e-1595-446d-8104-b3acf0ddc6f4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083393 Aug 27 05:03:06.392038 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2741/5427] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:03:07.062900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e57c1f04-8760-4dc8-a349-7f260f99fdb4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:07.070200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6816343b-1523-4872-b50e-1f68b5d9abb0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:07.071563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6816343b-1523-4872-b50e-1f68b5d9abb0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:07.072285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e57c1f04-8760-4dc8-a349-7f260f99fdb4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:07.077957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:07.079978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:07.081344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:07.093040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6816343b-1523-4872-b50e-1f68b5d9abb0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:07.095955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6816343b-1523-4872-b50e-1f68b5d9abb0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:07.097112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6816343b-1523-4872-b50e-1f68b5d9abb0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:07.098361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e57c1f04-8760-4dc8-a349-7f260f99fdb4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:07.099410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6816343b-1523-4872-b50e-1f68b5d9abb0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:07.100181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e57c1f04-8760-4dc8-a349-7f260f99fdb4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:07.101041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6816343b-1523-4872-b50e-1f68b5d9abb0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:07.101767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e57c1f04-8760-4dc8-a349-7f260f99fdb4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:07.102471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6816343b-1523-4872-b50e-1f68b5d9abb0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:07.103450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e57c1f04-8760-4dc8-a349-7f260f99fdb4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:07.106371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e57c1f04-8760-4dc8-a349-7f260f99fdb4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:07.107213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e57c1f04-8760-4dc8-a349-7f260f99fdb4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:07.181787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6816343b-1523-4872-b50e-1f68b5d9abb0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:07.182238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6816343b-1523-4872-b50e-1f68b5d9abb0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:07.185040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6816343b-1523-4872-b50e-1f68b5d9abb0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:07.185040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-6816343b-1523-4872-b50e-1f68b5d9abb0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lazy-loading 'fault' on Instance uuid dc3ca3f0-178f-48ad-a92d-81f2285abf64 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:03:07.237158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6816343b-1523-4872-b50e-1f68b5d9abb0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18c5a89d81c64bdaad17d7005434f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe84461cde7445dbf0d1a98df3aeb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:07.248360 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6816343b-1523-4872-b50e-1f68b5d9abb0 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 200 len: 1326 microversion: 2.1 time: 0.182201 Aug 27 05:03:07.265043 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2742/5428] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:07 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 1326 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:07.379183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e57c1f04-8760-4dc8-a349-7f260f99fdb4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:07.387721 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e57c1f04-8760-4dc8-a349-7f260f99fdb4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.329803 Aug 27 05:03:07.392233 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2687/5429] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:07 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:08.272468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84b99eae-ae5a-4878-ac90-d5cf1b42ab1d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:08.273910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-84b99eae-ae5a-4878-ac90-d5cf1b42ab1d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:08.283372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84b99eae-ae5a-4878-ac90-d5cf1b42ab1d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:08.284155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84b99eae-ae5a-4878-ac90-d5cf1b42ab1d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:08.284890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84b99eae-ae5a-4878-ac90-d5cf1b42ab1d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:08.285716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84b99eae-ae5a-4878-ac90-d5cf1b42ab1d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:08.286429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84b99eae-ae5a-4878-ac90-d5cf1b42ab1d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:08.287092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84b99eae-ae5a-4878-ac90-d5cf1b42ab1d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:08.302311 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-84b99eae-ae5a-4878-ac90-d5cf1b42ab1d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] HTTP exception thrown: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84b99eae-ae5a-4878-ac90-d5cf1b42ab1d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Request method failure captured: Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 HTTP/1.1 Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaN-uPj_TT7bawmb_-0n_q5UkdPqLbwkNGOfvsDFK-lMqPINg7GTogRN347xfUzG_vvyLxAPEi3FUYcoMxvblviBFizYeVGUWq61kqlXqaz_cTQCc74ctB4SXhbxCWaYA-Iv_jF2VP6y2lj8rp_RfPu-I0Uwam9gRUJgI8neAYsQGgw Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8fe84461cde7445dbf0d1a98df3aeb15 Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8fe84461cde7445dbf0d1a98df3aeb15 Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeTestJSON-799482090-project Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 18c5a89d81c64bdaad17d7005434f01f Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeTestJSON-799482090-project Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'dc3ca3f0-178f-48ad-a92d-81f2285abf64'} Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:08.304380 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:08.308655 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:08.308655 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:08.308655 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:08.308655 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:08.308655 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:08.308655 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:08.308655 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:08.311113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84b99eae-ae5a-4878-ac90-d5cf1b42ab1d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Returning 404 to user: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:08.312408 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-84b99eae-ae5a-4878-ac90-d5cf1b42ab1d tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 404 len: 111 microversion: 2.1 time: 0.043767 Aug 27 05:03:08.316895 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2743/5430] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:08 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:08.327346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4d81dff8-d068-4a4f-8ecc-23c9f66fa1b9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '.version_select at 0x7f1f2116c8b0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:08.364594 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4d81dff8-d068-4a4f-8ecc-23c9f66fa1b9 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-663252782" status: 202 len: 0 microversion: 2.1 time: 0.046604 Aug 27 05:03:08.365218 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2688/5431] 10.222.0.79 () {58 vars in 1218 bytes} [Sat Aug 27 05:03:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-663252782 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:03:08.424045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e70d833-afce-4f6d-8ec1-1fa1857cc101 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:08.427125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e70d833-afce-4f6d-8ec1-1fa1857cc101 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:08.456871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e70d833-afce-4f6d-8ec1-1fa1857cc101 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:08.461293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e70d833-afce-4f6d-8ec1-1fa1857cc101 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:08.462169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e70d833-afce-4f6d-8ec1-1fa1857cc101 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:08.462701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e70d833-afce-4f6d-8ec1-1fa1857cc101 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:08.463160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e70d833-afce-4f6d-8ec1-1fa1857cc101 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:08.467438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e70d833-afce-4f6d-8ec1-1fa1857cc101 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:08.662008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-125825359", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "0da6eff2-1f4c-4a7b-b7b5-c56e9bd5fc5e"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:08.747356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4e70d833-afce-4f6d-8ec1-1fa1857cc101 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:08.762625 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e70d833-afce-4f6d-8ec1-1fa1857cc101 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.346673 Aug 27 05:03:08.764456 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2744/5432] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:08 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:08.790253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] validate_networks() for [('0da6eff2-1f4c-4a7b-b7b5-c56e9bd5fc5e', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:03:09.453190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:03:09.453843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:03:09.454229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:03:09.454648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:03:09.455194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:03:09.464270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:09.464830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:09.465404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:09.466246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:09.466704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:09.467165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:09.491170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Getting quotas for project 96da74018b7846f79741bf8f15b22ae9. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:03:09.497110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Getting quotas for user d5b1048ffa264ff4abdf91994f0d66a1 and project 96da74018b7846f79741bf8f15b22ae9. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:03:09.526079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:03:09.528855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:03:09.586875 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-517bd7bc-dbc4-42d8-8680-6cbdf8102650 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928828 Aug 27 05:03:09.587547 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2689/5433] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:03:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:03:09.603123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59c7f7b9-4c17-40c6-be16-4cd6b4d56b57 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:09.603821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59c7f7b9-4c17-40c6-be16-4cd6b4d56b57 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:09.717429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-59c7f7b9-4c17-40c6-be16-4cd6b4d56b57 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:09.726424 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59c7f7b9-4c17-40c6-be16-4cd6b4d56b57 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 200 len: 1218 microversion: 2.1 time: 0.130764 Aug 27 05:03:09.728718 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2745/5434] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:09 2022] GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:09.790378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dffeadc3-e8e5-4b6b-b4a8-a0392a3b4646 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:09.791177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dffeadc3-e8e5-4b6b-b4a8-a0392a3b4646 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:09.800580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dffeadc3-e8e5-4b6b-b4a8-a0392a3b4646 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:09.801141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dffeadc3-e8e5-4b6b-b4a8-a0392a3b4646 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:09.801588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dffeadc3-e8e5-4b6b-b4a8-a0392a3b4646 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:09.802303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dffeadc3-e8e5-4b6b-b4a8-a0392a3b4646 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:09.802764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dffeadc3-e8e5-4b6b-b4a8-a0392a3b4646 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:09.803188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dffeadc3-e8e5-4b6b-b4a8-a0392a3b4646 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:09.975484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dffeadc3-e8e5-4b6b-b4a8-a0392a3b4646 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:09.984602 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dffeadc3-e8e5-4b6b-b4a8-a0392a3b4646 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.198979 Aug 27 05:03:09.985804 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2690/5435] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:09 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:10.754186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22da2a87-bd33-4866-8a2d-643f02ece4e7 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:10.757605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22da2a87-bd33-4866-8a2d-643f02ece4e7 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:10.783220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22da2a87-bd33-4866-8a2d-643f02ece4e7 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:10.784199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22da2a87-bd33-4866-8a2d-643f02ece4e7 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:10.784962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22da2a87-bd33-4866-8a2d-643f02ece4e7 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:10.785812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22da2a87-bd33-4866-8a2d-643f02ece4e7 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:10.786298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22da2a87-bd33-4866-8a2d-643f02ece4e7 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:10.786741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22da2a87-bd33-4866-8a2d-643f02ece4e7 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:11.009786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-50be35e1-d702-4aba-8a71-5fe60236d711 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:11.010612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-50be35e1-d702-4aba-8a71-5fe60236d711 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:11.032999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50be35e1-d702-4aba-8a71-5fe60236d711 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:11.033766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50be35e1-d702-4aba-8a71-5fe60236d711 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:11.034424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50be35e1-d702-4aba-8a71-5fe60236d711 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:11.035437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50be35e1-d702-4aba-8a71-5fe60236d711 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:11.036221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50be35e1-d702-4aba-8a71-5fe60236d711 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:11.036960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50be35e1-d702-4aba-8a71-5fe60236d711 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:11.119387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22da2a87-bd33-4866-8a2d-643f02ece4e7 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:11.140241 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22da2a87-bd33-4866-8a2d-643f02ece4e7 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 200 len: 1270 microversion: 2.1 time: 0.393729 Aug 27 05:03:11.146281 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2746/5436] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:10 2022] GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 1270 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:11.316924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-50be35e1-d702-4aba-8a71-5fe60236d711 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:11.339516 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-50be35e1-d702-4aba-8a71-5fe60236d711 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.331368 Aug 27 05:03:11.339957 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2691/5437] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:11 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:12.167850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6b4108b-df94-47a9-8a51-640baf10d7da tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:12.168323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e6b4108b-df94-47a9-8a51-640baf10d7da tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:12.189562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b4108b-df94-47a9-8a51-640baf10d7da tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:12.189562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b4108b-df94-47a9-8a51-640baf10d7da tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:12.189562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b4108b-df94-47a9-8a51-640baf10d7da tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:12.189562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b4108b-df94-47a9-8a51-640baf10d7da tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:12.189562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b4108b-df94-47a9-8a51-640baf10d7da tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:12.189562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6b4108b-df94-47a9-8a51-640baf10d7da tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:12.363015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-60bee60a-6fd8-414e-b110-fc65a8d95ae8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:12.364279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-60bee60a-6fd8-414e-b110-fc65a8d95ae8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:12.381070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60bee60a-6fd8-414e-b110-fc65a8d95ae8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:12.383941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60bee60a-6fd8-414e-b110-fc65a8d95ae8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:12.384885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60bee60a-6fd8-414e-b110-fc65a8d95ae8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:12.386609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60bee60a-6fd8-414e-b110-fc65a8d95ae8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:12.388936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60bee60a-6fd8-414e-b110-fc65a8d95ae8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:12.390533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60bee60a-6fd8-414e-b110-fc65a8d95ae8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:12.557947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e6b4108b-df94-47a9-8a51-640baf10d7da tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:12.569775 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6b4108b-df94-47a9-8a51-640baf10d7da tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 200 len: 1318 microversion: 2.1 time: 0.405952 Aug 27 05:03:12.570440 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2747/5438] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:12 2022] GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:12.990029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-60bee60a-6fd8-414e-b110-fc65a8d95ae8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:13.010912 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-60bee60a-6fd8-414e-b110-fc65a8d95ae8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.653954 Aug 27 05:03:13.016044 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2692/5439] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:12 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:13.243053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-aa45ba1c-d8ab-4976-bbe3-6b6c6735c62f req-b3c69b44-2c08-4d30-915f-2061f9079483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d523dbe1-c9f5-4c99-bbe6-36b3f458be7a", "tag": "e6fe9c87-1bef-4dd9-b9d3-d67d5a6e39a1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:13.275736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-aa45ba1c-d8ab-4976-bbe3-6b6c6735c62f req-b3c69b44-2c08-4d30-915f-2061f9079483 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:13.276384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-aa45ba1c-d8ab-4976-bbe3-6b6c6735c62f req-b3c69b44-2c08-4d30-915f-2061f9079483 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:13.277066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-aa45ba1c-d8ab-4976-bbe3-6b6c6735c62f req-b3c69b44-2c08-4d30-915f-2061f9079483 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:13.281628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:13.289796 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-aa45ba1c-d8ab-4976-bbe3-6b6c6735c62f req-b3c69b44-2c08-4d30-915f-2061f9079483 service nova] Creating event network-changed:e6fe9c87-1bef-4dd9-b9d3-d67d5a6e39a1 for instance d523dbe1-c9f5-4c99-bbe6-36b3f458be7a on n-h1-854823-1 Aug 27 05:03:13.296563 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-aa45ba1c-d8ab-4976-bbe3-6b6c6735c62f req-b3c69b44-2c08-4d30-915f-2061f9079483 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056981 Aug 27 05:03:13.302255 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2748/5440] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:03:13.594760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-61b8f255-1a27-4df2-8052-b220741683a8 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:13.601757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-61b8f255-1a27-4df2-8052-b220741683a8 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:13.615473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61b8f255-1a27-4df2-8052-b220741683a8 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:13.615960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61b8f255-1a27-4df2-8052-b220741683a8 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:13.616454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61b8f255-1a27-4df2-8052-b220741683a8 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:13.619974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61b8f255-1a27-4df2-8052-b220741683a8 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:13.620710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61b8f255-1a27-4df2-8052-b220741683a8 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:13.621446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61b8f255-1a27-4df2-8052-b220741683a8 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:14.033077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-61b8f255-1a27-4df2-8052-b220741683a8 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:14.039070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5306bd4f-824a-457e-b346-4304b4001635 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:14.039902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5306bd4f-824a-457e-b346-4304b4001635 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:14.058277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5306bd4f-824a-457e-b346-4304b4001635 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:14.058816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5306bd4f-824a-457e-b346-4304b4001635 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:14.059303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5306bd4f-824a-457e-b346-4304b4001635 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:14.060482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5306bd4f-824a-457e-b346-4304b4001635 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:14.060743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5306bd4f-824a-457e-b346-4304b4001635 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:14.061026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5306bd4f-824a-457e-b346-4304b4001635 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:14.069615 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-61b8f255-1a27-4df2-8052-b220741683a8 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 200 len: 1318 microversion: 2.1 time: 0.481164 Aug 27 05:03:14.074867 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2693/5441] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:13 2022] GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:14.594037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5306bd4f-824a-457e-b346-4304b4001635 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:14.612345 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5306bd4f-824a-457e-b346-4304b4001635 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.577915 Aug 27 05:03:14.614604 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2749/5442] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:14 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:15.102483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a0f3e0a6-2a6e-488f-bfb9-53538f46c10f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:15.104151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a0f3e0a6-2a6e-488f-bfb9-53538f46c10f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:15.121481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0f3e0a6-2a6e-488f-bfb9-53538f46c10f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:15.124573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0f3e0a6-2a6e-488f-bfb9-53538f46c10f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:15.126151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0f3e0a6-2a6e-488f-bfb9-53538f46c10f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:15.130538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0f3e0a6-2a6e-488f-bfb9-53538f46c10f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:15.131363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0f3e0a6-2a6e-488f-bfb9-53538f46c10f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:15.132928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a0f3e0a6-2a6e-488f-bfb9-53538f46c10f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:15.498562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a0f3e0a6-2a6e-488f-bfb9-53538f46c10f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:15.521094 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a0f3e0a6-2a6e-488f-bfb9-53538f46c10f tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 200 len: 1318 microversion: 2.1 time: 0.424348 Aug 27 05:03:15.528476 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2694/5443] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:15 2022] GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:15.648156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6988cc75-60bf-4bdd-83ae-210c188f4ad3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:15.652053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6988cc75-60bf-4bdd-83ae-210c188f4ad3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:15.663692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6988cc75-60bf-4bdd-83ae-210c188f4ad3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:15.664213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6988cc75-60bf-4bdd-83ae-210c188f4ad3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:15.664719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6988cc75-60bf-4bdd-83ae-210c188f4ad3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:15.665449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6988cc75-60bf-4bdd-83ae-210c188f4ad3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:15.666000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6988cc75-60bf-4bdd-83ae-210c188f4ad3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:15.673079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6988cc75-60bf-4bdd-83ae-210c188f4ad3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:15.953418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6988cc75-60bf-4bdd-83ae-210c188f4ad3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:15.965293 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6988cc75-60bf-4bdd-83ae-210c188f4ad3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.330342 Aug 27 05:03:15.979422 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2750/5444] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:15 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:16.548290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98139af0-3de5-415b-b67c-d0437d84a715 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:16.549184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98139af0-3de5-415b-b67c-d0437d84a715 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:16.562622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98139af0-3de5-415b-b67c-d0437d84a715 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:16.570562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98139af0-3de5-415b-b67c-d0437d84a715 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:16.571269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98139af0-3de5-415b-b67c-d0437d84a715 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:16.573950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98139af0-3de5-415b-b67c-d0437d84a715 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:16.574723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98139af0-3de5-415b-b67c-d0437d84a715 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:16.576332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98139af0-3de5-415b-b67c-d0437d84a715 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:16.766025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-68914375", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "3acee1ac-4b05-4962-93bd-71cbc1d62b3f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1414090982", "security_groups": []}, "os:scheduler_hints": {"different_host": ["63fd1673-2a84-4740-9748-f9d2d180a067"]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:16.896369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-98139af0-3de5-415b-b67c-d0437d84a715 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:16.901576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] validate_networks() for [('3acee1ac-4b05-4962-93bd-71cbc1d62b3f', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:03:16.929926 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-98139af0-3de5-415b-b67c-d0437d84a715 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 200 len: 1318 microversion: 2.1 time: 0.384061 Aug 27 05:03:16.932949 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2695/5445] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:16 2022] GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:16.991117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-312c588d-f9f0-4c6a-ac77-afee65e0ac0e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:16.991847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-312c588d-f9f0-4c6a-ac77-afee65e0ac0e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:17.012412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-312c588d-f9f0-4c6a-ac77-afee65e0ac0e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:17.013337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-312c588d-f9f0-4c6a-ac77-afee65e0ac0e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:17.014435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-312c588d-f9f0-4c6a-ac77-afee65e0ac0e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:17.023484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-312c588d-f9f0-4c6a-ac77-afee65e0ac0e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:17.023601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-312c588d-f9f0-4c6a-ac77-afee65e0ac0e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:17.024954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-312c588d-f9f0-4c6a-ac77-afee65e0ac0e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:17.419879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-312c588d-f9f0-4c6a-ac77-afee65e0ac0e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:17.435553 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-312c588d-f9f0-4c6a-ac77-afee65e0ac0e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.449232 Aug 27 05:03:17.437402 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2696/5446] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:16 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:17.960140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a2f45ef6-5180-4850-8fda-ea02e4b2e891 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:17.961688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a2f45ef6-5180-4850-8fda-ea02e4b2e891 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:17.978114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2f45ef6-5180-4850-8fda-ea02e4b2e891 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:17.981514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2f45ef6-5180-4850-8fda-ea02e4b2e891 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:17.983638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2f45ef6-5180-4850-8fda-ea02e4b2e891 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:17.989493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2f45ef6-5180-4850-8fda-ea02e4b2e891 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:17.990583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2f45ef6-5180-4850-8fda-ea02e4b2e891 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:17.993209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2f45ef6-5180-4850-8fda-ea02e4b2e891 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:18.210075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:03:18.210572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:03:18.211103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:03:18.211610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:03:18.212117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:03:18.232845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:18.234138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:18.235239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:18.236483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:18.238578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:18.240478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:18.284898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Getting quotas for project 5cb264664558452095a2d83e8950dbeb. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:03:18.289476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a2f45ef6-5180-4850-8fda-ea02e4b2e891 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:18.291876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Getting quotas for user 277ff8e295684cd18d8c9dd5130dde1d and project 5cb264664558452095a2d83e8950dbeb. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:03:18.306412 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a2f45ef6-5180-4850-8fda-ea02e4b2e891 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 200 len: 1318 microversion: 2.1 time: 0.351658 Aug 27 05:03:18.308819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:03:18.311683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:03:18.326015 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2697/5447] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:17 2022] GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:18.374558 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a9ba797-f725-4793-83f3-c9c20614342e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.613781 Aug 27 05:03:18.382449 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2751/5448] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:03:16 2022] POST /compute/v2.1/servers => generated 361 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:03:18.388217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-084923b3-d60e-47d5-9a31-ba5b102591a4 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:18.388925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-084923b3-d60e-47d5-9a31-ba5b102591a4 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:18.463149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-084923b3-d60e-47d5-9a31-ba5b102591a4 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:18.467352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c6db22e-4710-45f3-a8e4-6369b5c63de4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:18.467993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c6db22e-4710-45f3-a8e4-6369b5c63de4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:18.475002 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-084923b3-d60e-47d5-9a31-ba5b102591a4 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1240 microversion: 2.1 time: 0.090786 Aug 27 05:03:18.475606 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2698/5449] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:18 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:18.481106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6db22e-4710-45f3-a8e4-6369b5c63de4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:18.481106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6db22e-4710-45f3-a8e4-6369b5c63de4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:18.481106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6db22e-4710-45f3-a8e4-6369b5c63de4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:18.481669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6db22e-4710-45f3-a8e4-6369b5c63de4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:18.483932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6db22e-4710-45f3-a8e4-6369b5c63de4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:18.485266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6db22e-4710-45f3-a8e4-6369b5c63de4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:18.848465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8c6db22e-4710-45f3-a8e4-6369b5c63de4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:18.859982 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8c6db22e-4710-45f3-a8e4-6369b5c63de4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.402272 Aug 27 05:03:18.861377 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2752/5450] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:18 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:19.354237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7c097fc9-a3f7-4a4b-a25f-a0f1a329d6e4 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:19.355696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7c097fc9-a3f7-4a4b-a25f-a0f1a329d6e4 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:19.386929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c097fc9-a3f7-4a4b-a25f-a0f1a329d6e4 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:19.387801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c097fc9-a3f7-4a4b-a25f-a0f1a329d6e4 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:19.388584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c097fc9-a3f7-4a4b-a25f-a0f1a329d6e4 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:19.389622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c097fc9-a3f7-4a4b-a25f-a0f1a329d6e4 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:19.390367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c097fc9-a3f7-4a4b-a25f-a0f1a329d6e4 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:19.391634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c097fc9-a3f7-4a4b-a25f-a0f1a329d6e4 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:19.489414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:19.503618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-690977e6-2a58-4123-af00-02b5d88949af tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:19.504393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-690977e6-2a58-4123-af00-02b5d88949af tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:19.516494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-690977e6-2a58-4123-af00-02b5d88949af tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:19.525724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-690977e6-2a58-4123-af00-02b5d88949af tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:19.526243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-690977e6-2a58-4123-af00-02b5d88949af tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:19.527123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-690977e6-2a58-4123-af00-02b5d88949af tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:19.527792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-690977e6-2a58-4123-af00-02b5d88949af tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:19.528390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-690977e6-2a58-4123-af00-02b5d88949af tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:19.729083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-690977e6-2a58-4123-af00-02b5d88949af tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:19.752931 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-690977e6-2a58-4123-af00-02b5d88949af tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1292 microversion: 2.1 time: 0.250347 Aug 27 05:03:19.767439 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2753/5451] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:19 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1292 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:19.812218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7c097fc9-a3f7-4a4b-a25f-a0f1a329d6e4 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:19.825315 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7c097fc9-a3f7-4a4b-a25f-a0f1a329d6e4 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 200 len: 1318 microversion: 2.1 time: 0.488135 Aug 27 05:03:19.826680 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2699/5452] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:19 2022] GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:19.886802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14980de4-a03a-4ac3-96d3-f073047f63ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:19.887937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14980de4-a03a-4ac3-96d3-f073047f63ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:19.902885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14980de4-a03a-4ac3-96d3-f073047f63ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:19.904033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14980de4-a03a-4ac3-96d3-f073047f63ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:19.904886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14980de4-a03a-4ac3-96d3-f073047f63ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:19.905895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14980de4-a03a-4ac3-96d3-f073047f63ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:19.906616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14980de4-a03a-4ac3-96d3-f073047f63ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:19.907478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14980de4-a03a-4ac3-96d3-f073047f63ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:20.157307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-dec7daf0-34dd-496b-a582-5c23e64dd972 req-b8172d85-afaa-4287-9c34-46acc6fb0333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d523dbe1-c9f5-4c99-bbe6-36b3f458be7a", "name": "network-vif-plugged", "status": "completed", "tag": "e6fe9c87-1bef-4dd9-b9d3-d67d5a6e39a1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:20.171807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:20.176730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14980de4-a03a-4ac3-96d3-f073047f63ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:20.186658 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14980de4-a03a-4ac3-96d3-f073047f63ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.307701 Aug 27 05:03:20.188022 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2754/5453] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:19 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:20.199113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-dec7daf0-34dd-496b-a582-5c23e64dd972 req-b8172d85-afaa-4287-9c34-46acc6fb0333 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:20.204749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-dec7daf0-34dd-496b-a582-5c23e64dd972 req-b8172d85-afaa-4287-9c34-46acc6fb0333 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:20.206592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-dec7daf0-34dd-496b-a582-5c23e64dd972 req-b8172d85-afaa-4287-9c34-46acc6fb0333 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:20.244231 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-dec7daf0-34dd-496b-a582-5c23e64dd972 req-b8172d85-afaa-4287-9c34-46acc6fb0333 service nova] Creating event network-vif-plugged:e6fe9c87-1bef-4dd9-b9d3-d67d5a6e39a1 for instance d523dbe1-c9f5-4c99-bbe6-36b3f458be7a on n-h1-854823-1 Aug 27 05:03:20.256995 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-dec7daf0-34dd-496b-a582-5c23e64dd972 req-b8172d85-afaa-4287-9c34-46acc6fb0333 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.287862 Aug 27 05:03:20.258366 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2700/5454] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:20.778936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-170b4922-8e4f-4193-8b0d-9a9ab2971827 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:20.779436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-170b4922-8e4f-4193-8b0d-9a9ab2971827 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:20.789490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170b4922-8e4f-4193-8b0d-9a9ab2971827 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:20.790303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170b4922-8e4f-4193-8b0d-9a9ab2971827 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:20.791278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170b4922-8e4f-4193-8b0d-9a9ab2971827 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:20.792173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170b4922-8e4f-4193-8b0d-9a9ab2971827 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:20.792845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170b4922-8e4f-4193-8b0d-9a9ab2971827 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:20.793600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170b4922-8e4f-4193-8b0d-9a9ab2971827 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:20.848219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b0f68b65-1102-4bd5-a5ea-22982d8f9bf5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:20.848958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b0f68b65-1102-4bd5-a5ea-22982d8f9bf5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:20.871739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0f68b65-1102-4bd5-a5ea-22982d8f9bf5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:20.873428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0f68b65-1102-4bd5-a5ea-22982d8f9bf5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:20.874128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0f68b65-1102-4bd5-a5ea-22982d8f9bf5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:20.877038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0f68b65-1102-4bd5-a5ea-22982d8f9bf5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:20.877770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0f68b65-1102-4bd5-a5ea-22982d8f9bf5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:20.878389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0f68b65-1102-4bd5-a5ea-22982d8f9bf5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:20.917349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:20.934271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-170b4922-8e4f-4193-8b0d-9a9ab2971827 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:20.955760 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-170b4922-8e4f-4193-8b0d-9a9ab2971827 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1298 microversion: 2.1 time: 0.181144 Aug 27 05:03:20.956360 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2755/5455] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:20 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1298 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:21.127749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b0f68b65-1102-4bd5-a5ea-22982d8f9bf5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:21.143490 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b0f68b65-1102-4bd5-a5ea-22982d8f9bf5 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 200 len: 1318 microversion: 2.1 time: 0.299511 Aug 27 05:03:21.145550 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2701/5456] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:20 2022] GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:21.210080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-925daa19-6e11-49a3-a136-9daf1415b854 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:21.210971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-925daa19-6e11-49a3-a136-9daf1415b854 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:21.222354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-925daa19-6e11-49a3-a136-9daf1415b854 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:21.223143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-925daa19-6e11-49a3-a136-9daf1415b854 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:21.223769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-925daa19-6e11-49a3-a136-9daf1415b854 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:21.225866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-925daa19-6e11-49a3-a136-9daf1415b854 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:21.229237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-925daa19-6e11-49a3-a136-9daf1415b854 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:21.229911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-925daa19-6e11-49a3-a136-9daf1415b854 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:21.444452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-925daa19-6e11-49a3-a136-9daf1415b854 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:21.456253 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-925daa19-6e11-49a3-a136-9daf1415b854 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1341 microversion: 2.1 time: 0.249862 Aug 27 05:03:21.457592 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2756/5457] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:21 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1341 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:21.977149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-73823529-eb14-41c7-a422-ef0dade3c3e2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:21.977955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-73823529-eb14-41c7-a422-ef0dade3c3e2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:21.985280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73823529-eb14-41c7-a422-ef0dade3c3e2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:21.986086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73823529-eb14-41c7-a422-ef0dade3c3e2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:21.987342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73823529-eb14-41c7-a422-ef0dade3c3e2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:21.988394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73823529-eb14-41c7-a422-ef0dade3c3e2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:21.988981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73823529-eb14-41c7-a422-ef0dade3c3e2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:21.989479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73823529-eb14-41c7-a422-ef0dade3c3e2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.111890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5247462-9740-46eb-be20-a6cfb7602b2f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:22.112588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5247462-9740-46eb-be20-a6cfb7602b2f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:22.121314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5247462-9740-46eb-be20-a6cfb7602b2f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.123740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5247462-9740-46eb-be20-a6cfb7602b2f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.124449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5247462-9740-46eb-be20-a6cfb7602b2f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.125764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5247462-9740-46eb-be20-a6cfb7602b2f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.126492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5247462-9740-46eb-be20-a6cfb7602b2f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.127152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5247462-9740-46eb-be20-a6cfb7602b2f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.151181 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f5247462-9740-46eb-be20-a6cfb7602b2f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] HTTP exception thrown: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5247462-9740-46eb-be20-a6cfb7602b2f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Request method failure captured: Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 HTTP/1.1 Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaN-uPj_TT7bawmb_-0n_q5UkdPqLbwkNGOfvsDFK-lMqPINg7GTogRN347xfUzG_vvyLxAPEi3FUYcoMxvblviBFizYeVGUWq61kqlXqaz_cTQCc74ctB4SXhbxCWaYA-Iv_jF2VP6y2lj8rp_RfPu-I0Uwam9gRUJgI8neAYsQGgw Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8fe84461cde7445dbf0d1a98df3aeb15 Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8fe84461cde7445dbf0d1a98df3aeb15 Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeTestJSON-799482090-project Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 18c5a89d81c64bdaad17d7005434f01f Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeTestJSON-799482090-project Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'dc3ca3f0-178f-48ad-a92d-81f2285abf64'} Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:22.153785 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:22.159399 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:22.159399 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:22.159399 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:22.159399 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:22.159399 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:22.159399 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:22.159399 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:22.159399 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:22.159399 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:22.159399 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:22.159399 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:22.166158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5247462-9740-46eb-be20-a6cfb7602b2f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Returning 404 to user: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:22.167060 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5247462-9740-46eb-be20-a6cfb7602b2f tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "DELETE /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 404 len: 111 microversion: 2.1 time: 0.067213 Aug 27 05:03:22.167649 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2757/5458] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:03:22 2022] DELETE /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:03:22.169053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-73823529-eb14-41c7-a422-ef0dade3c3e2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:22.180915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cf1a7ae-2858-4a98-ad21-fe895fb74aac tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:22.181571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2cf1a7ae-2858-4a98-ad21-fe895fb74aac tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:22.185245 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-73823529-eb14-41c7-a422-ef0dade3c3e2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1298 microversion: 2.1 time: 0.210303 Aug 27 05:03:22.192286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf1a7ae-2858-4a98-ad21-fe895fb74aac tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.195833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf1a7ae-2858-4a98-ad21-fe895fb74aac tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.196463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf1a7ae-2858-4a98-ad21-fe895fb74aac tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.199293 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2702/5459] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:21 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1298 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:22.199440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf1a7ae-2858-4a98-ad21-fe895fb74aac tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.199835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf1a7ae-2858-4a98-ad21-fe895fb74aac tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.200446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf1a7ae-2858-4a98-ad21-fe895fb74aac tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.209315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-92aae925-7d04-4e45-a690-b9c621b0eb0c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:22.210164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-92aae925-7d04-4e45-a690-b9c621b0eb0c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: dc3ca3f0-178f-48ad-a92d-81f2285abf64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:22.220004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92aae925-7d04-4e45-a690-b9c621b0eb0c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.220631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92aae925-7d04-4e45-a690-b9c621b0eb0c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.221299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92aae925-7d04-4e45-a690-b9c621b0eb0c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.222827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92aae925-7d04-4e45-a690-b9c621b0eb0c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.223524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92aae925-7d04-4e45-a690-b9c621b0eb0c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.224583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92aae925-7d04-4e45-a690-b9c621b0eb0c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.241237 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-92aae925-7d04-4e45-a690-b9c621b0eb0c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] HTTP exception thrown: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-92aae925-7d04-4e45-a690-b9c621b0eb0c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Request method failure captured: Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 HTTP/1.1 Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaN-uPj_TT7bawmb_-0n_q5UkdPqLbwkNGOfvsDFK-lMqPINg7GTogRN347xfUzG_vvyLxAPEi3FUYcoMxvblviBFizYeVGUWq61kqlXqaz_cTQCc74ctB4SXhbxCWaYA-Iv_jF2VP6y2lj8rp_RfPu-I0Uwam9gRUJgI8neAYsQGgw Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8fe84461cde7445dbf0d1a98df3aeb15 Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8fe84461cde7445dbf0d1a98df3aeb15 Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AttachVolumeTestJSON-799482090-project Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 18c5a89d81c64bdaad17d7005434f01f Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AttachVolumeTestJSON-799482090-project Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'dc3ca3f0-178f-48ad-a92d-81f2285abf64'} Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:22.242811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:22.248617 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:22.248617 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:22.248617 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:22.248617 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:22.248617 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:22.248617 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. Aug 27 05:03:22.248617 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:22.248617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-92aae925-7d04-4e45-a690-b9c621b0eb0c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Returning 404 to user: Instance dc3ca3f0-178f-48ad-a92d-81f2285abf64 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:22.248617 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-92aae925-7d04-4e45-a690-b9c621b0eb0c tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64" status: 404 len: 111 microversion: 2.1 time: 0.041182 Aug 27 05:03:22.248617 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2703/5460] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:22 2022] GET /compute/v2.1/servers/dc3ca3f0-178f-48ad-a92d-81f2285abf64 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:22.478442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2cf1a7ae-2858-4a98-ad21-fe895fb74aac tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:22.479175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d58fd0de-3896-4d55-914e-e771bcf6d5ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:22.479992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d58fd0de-3896-4d55-914e-e771bcf6d5ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:22.491218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d58fd0de-3896-4d55-914e-e771bcf6d5ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.492933 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2cf1a7ae-2858-4a98-ad21-fe895fb74aac tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 200 len: 1508 microversion: 2.1 time: 0.324106 Aug 27 05:03:22.515790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d58fd0de-3896-4d55-914e-e771bcf6d5ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.533915 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2758/5461] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:22 2022] GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 1508 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:22.534473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d58fd0de-3896-4d55-914e-e771bcf6d5ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.541144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27d51f7e-bb89-4e37-a078-50ab18194d41 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c5fa0d9-c302-48fe-abc9-233c51ecfe11", "device": "/dev/sdb"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:22.541887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d58fd0de-3896-4d55-914e-e771bcf6d5ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.546067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d58fd0de-3896-4d55-914e-e771bcf6d5ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.546530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d58fd0de-3896-4d55-914e-e771bcf6d5ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.556029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-27d51f7e-bb89-4e37-a078-50ab18194d41 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:22.566028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:22.582895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27d51f7e-bb89-4e37-a078-50ab18194d41 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.583458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27d51f7e-bb89-4e37-a078-50ab18194d41 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.584068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27d51f7e-bb89-4e37-a078-50ab18194d41 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.584860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27d51f7e-bb89-4e37-a078-50ab18194d41 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:22.585336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27d51f7e-bb89-4e37-a078-50ab18194d41 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:22.585782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27d51f7e-bb89-4e37-a078-50ab18194d41 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:22.832965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d58fd0de-3896-4d55-914e-e771bcf6d5ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:22.840852 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d58fd0de-3896-4d55-914e-e771bcf6d5ec tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1375 microversion: 2.1 time: 0.365833 Aug 27 05:03:22.845251 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2704/5462] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:22 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1375 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:22.953823 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-27d51f7e-bb89-4e37-a078-50ab18194d41 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "POST /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.415836 Aug 27 05:03:22.959742 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2759/5463] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:03:22 2022] POST /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a/os-volume_attachments => generated 194 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:23.210574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-61441770-95b1-4169-8c6f-ac52f0921829 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:23.211207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-61441770-95b1-4169-8c6f-ac52f0921829 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:23.227999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61441770-95b1-4169-8c6f-ac52f0921829 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:23.229267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61441770-95b1-4169-8c6f-ac52f0921829 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:23.230897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61441770-95b1-4169-8c6f-ac52f0921829 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:23.233745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61441770-95b1-4169-8c6f-ac52f0921829 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:23.237284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61441770-95b1-4169-8c6f-ac52f0921829 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:23.239084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61441770-95b1-4169-8c6f-ac52f0921829 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:23.415624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-61441770-95b1-4169-8c6f-ac52f0921829 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:23.426338 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-61441770-95b1-4169-8c6f-ac52f0921829 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1298 microversion: 2.1 time: 0.220402 Aug 27 05:03:23.453072 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2705/5464] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:23 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1298 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:23.527671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-aadef934-e2dc-4873-8a80-6e2cd8920ffc req-5db9dafa-1fed-47e2-9e21-b2561895b21b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48", "tag": "1b509e6d-1a48-41cc-854b-3cb32f6ccb15"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:23.552968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-aadef934-e2dc-4873-8a80-6e2cd8920ffc req-5db9dafa-1fed-47e2-9e21-b2561895b21b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:23.553924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-aadef934-e2dc-4873-8a80-6e2cd8920ffc req-5db9dafa-1fed-47e2-9e21-b2561895b21b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:23.554782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-aadef934-e2dc-4873-8a80-6e2cd8920ffc req-5db9dafa-1fed-47e2-9e21-b2561895b21b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:23.579868 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-aadef934-e2dc-4873-8a80-6e2cd8920ffc req-5db9dafa-1fed-47e2-9e21-b2561895b21b service nova] Creating event network-changed:1b509e6d-1a48-41cc-854b-3cb32f6ccb15 for instance 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 on n-h1-854823-1 Aug 27 05:03:23.586099 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-aadef934-e2dc-4873-8a80-6e2cd8920ffc req-5db9dafa-1fed-47e2-9e21-b2561895b21b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077724 Aug 27 05:03:23.587116 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2760/5465] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:23.863730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d2558329-78ff-405d-b385-d46a0c8c5e56 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:23.864555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d2558329-78ff-405d-b385-d46a0c8c5e56 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:23.872022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2558329-78ff-405d-b385-d46a0c8c5e56 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:23.872519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2558329-78ff-405d-b385-d46a0c8c5e56 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:23.873174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2558329-78ff-405d-b385-d46a0c8c5e56 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:23.874253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2558329-78ff-405d-b385-d46a0c8c5e56 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:23.875029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2558329-78ff-405d-b385-d46a0c8c5e56 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:23.876124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d2558329-78ff-405d-b385-d46a0c8c5e56 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:24.103120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d2558329-78ff-405d-b385-d46a0c8c5e56 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:24.123687 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d2558329-78ff-405d-b385-d46a0c8c5e56 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1375 microversion: 2.1 time: 0.265015 Aug 27 05:03:24.161908 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2706/5466] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:23 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1375 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:24.465048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-325b9b54-c4bf-4be4-be37-704c320d42e8 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:24.466316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-325b9b54-c4bf-4be4-be37-704c320d42e8 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:24.475702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-325b9b54-c4bf-4be4-be37-704c320d42e8 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:24.477154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-325b9b54-c4bf-4be4-be37-704c320d42e8 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:24.477154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-325b9b54-c4bf-4be4-be37-704c320d42e8 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:24.477760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-325b9b54-c4bf-4be4-be37-704c320d42e8 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:24.478713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-325b9b54-c4bf-4be4-be37-704c320d42e8 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:24.479929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-325b9b54-c4bf-4be4-be37-704c320d42e8 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:24.605320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-325b9b54-c4bf-4be4-be37-704c320d42e8 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:24.629895 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-325b9b54-c4bf-4be4-be37-704c320d42e8 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1298 microversion: 2.1 time: 0.172414 Aug 27 05:03:24.630858 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2761/5467] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:24 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1298 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:25.163548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b69ef184-3fd9-487e-9aff-5ce811b70876 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:25.164094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b69ef184-3fd9-487e-9aff-5ce811b70876 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:25.171844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b69ef184-3fd9-487e-9aff-5ce811b70876 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:25.172914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b69ef184-3fd9-487e-9aff-5ce811b70876 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:25.173347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b69ef184-3fd9-487e-9aff-5ce811b70876 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:25.174217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b69ef184-3fd9-487e-9aff-5ce811b70876 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:25.174690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b69ef184-3fd9-487e-9aff-5ce811b70876 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:25.175123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b69ef184-3fd9-487e-9aff-5ce811b70876 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:25.342385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b69ef184-3fd9-487e-9aff-5ce811b70876 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:25.363702 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b69ef184-3fd9-487e-9aff-5ce811b70876 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1375 microversion: 2.1 time: 0.203988 Aug 27 05:03:25.364899 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2707/5468] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:25 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1375 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:25.652970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b6d77460-d702-442f-81fd-9837eca4c45b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:25.654365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b6d77460-d702-442f-81fd-9837eca4c45b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:25.664150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6d77460-d702-442f-81fd-9837eca4c45b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:25.665031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6d77460-d702-442f-81fd-9837eca4c45b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:25.665826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6d77460-d702-442f-81fd-9837eca4c45b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:25.666973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6d77460-d702-442f-81fd-9837eca4c45b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:25.667501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6d77460-d702-442f-81fd-9837eca4c45b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:25.668133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6d77460-d702-442f-81fd-9837eca4c45b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:25.775158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b6d77460-d702-442f-81fd-9837eca4c45b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:25.784936 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b6d77460-d702-442f-81fd-9837eca4c45b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1298 microversion: 2.1 time: 0.137134 Aug 27 05:03:25.785977 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2762/5469] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:25 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1298 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:26.387178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e264fe3-39fa-41b1-9c77-9161f279b08d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:26.388087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e264fe3-39fa-41b1-9c77-9161f279b08d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:26.397764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e264fe3-39fa-41b1-9c77-9161f279b08d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:26.398360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e264fe3-39fa-41b1-9c77-9161f279b08d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:26.399069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e264fe3-39fa-41b1-9c77-9161f279b08d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:26.399966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e264fe3-39fa-41b1-9c77-9161f279b08d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:26.400736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e264fe3-39fa-41b1-9c77-9161f279b08d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:26.401178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e264fe3-39fa-41b1-9c77-9161f279b08d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:26.552749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9e264fe3-39fa-41b1-9c77-9161f279b08d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:26.567373 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e264fe3-39fa-41b1-9c77-9161f279b08d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1375 microversion: 2.1 time: 0.184803 Aug 27 05:03:26.567965 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2708/5470] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:26 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:26.749292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-506192a6-83eb-4775-b37d-8a403e530bf4 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:26.751519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-506192a6-83eb-4775-b37d-8a403e530bf4 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:26.760796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-506192a6-83eb-4775-b37d-8a403e530bf4 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:26.761619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-506192a6-83eb-4775-b37d-8a403e530bf4 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:26.762415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-506192a6-83eb-4775-b37d-8a403e530bf4 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:26.763397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-506192a6-83eb-4775-b37d-8a403e530bf4 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:26.764267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-506192a6-83eb-4775-b37d-8a403e530bf4 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:26.764846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-506192a6-83eb-4775-b37d-8a403e530bf4 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:26.782207 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-506192a6-83eb-4775-b37d-8a403e530bf4 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] HTTP exception thrown: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-506192a6-83eb-4775-b37d-8a403e530bf4 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Request method failure captured: Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 HTTP/1.1 Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaN-uPj_TT7bawmb_-0n_q5UkdPqLbwkNGOfvsDFK-lMqPINg7GTogRN347xfUzG_vvyLxAPEi3FUYcoMxvblviBFizYeVGUWq61kqlXqaz_cTQCc74ctB4SXhbxCWaYA-Iv_jF2VP6y2lj8rp_RfPu-I0Uwam9gRUJgI8neAYsQGgw Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 8fe84461cde7445dbf0d1a98df3aeb15 Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 8fe84461cde7445dbf0d1a98df3aeb15 Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeTestJSON-799482090-project Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 18c5a89d81c64bdaad17d7005434f01f Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeTestJSON-799482090-project Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '4c612c67-453a-48d4-8f78-97a00213ab46'} Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:26.784816 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:26.790757 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:03:26.790757 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.790757 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:26.790757 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.790757 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:26.790757 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:26.790757 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:26.790757 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:26.790757 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:26.790757 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:03:26.790757 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.790757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-506192a6-83eb-4775-b37d-8a403e530bf4 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Returning 404 to user: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:26.790757 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-506192a6-83eb-4775-b37d-8a403e530bf4 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 404 len: 111 microversion: 2.1 time: 0.045273 Aug 27 05:03:26.795722 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2763/5471] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:03:26 2022] DELETE /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:26.801215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f2369d86-9a1c-46d0-b330-521ce89a0d22 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:26.801890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f2369d86-9a1c-46d0-b330-521ce89a0d22 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] [instance: 4c612c67-453a-48d4-8f78-97a00213ab46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:26.809324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5695f60-1d9f-412a-ab7a-fe4cea844d2e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:26.810511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d5695f60-1d9f-412a-ab7a-fe4cea844d2e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:26.813213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2369d86-9a1c-46d0-b330-521ce89a0d22 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:26.813941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2369d86-9a1c-46d0-b330-521ce89a0d22 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:26.814726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2369d86-9a1c-46d0-b330-521ce89a0d22 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:26.815736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2369d86-9a1c-46d0-b330-521ce89a0d22 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:26.816682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2369d86-9a1c-46d0-b330-521ce89a0d22 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:26.817284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2369d86-9a1c-46d0-b330-521ce89a0d22 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:26.820642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5695f60-1d9f-412a-ab7a-fe4cea844d2e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:26.821323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5695f60-1d9f-412a-ab7a-fe4cea844d2e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:26.822011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5695f60-1d9f-412a-ab7a-fe4cea844d2e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:26.823465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5695f60-1d9f-412a-ab7a-fe4cea844d2e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:26.824431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5695f60-1d9f-412a-ab7a-fe4cea844d2e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:26.834016 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-f2369d86-9a1c-46d0-b330-521ce89a0d22 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] HTTP exception thrown: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f2369d86-9a1c-46d0-b330-521ce89a0d22 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Request method failure captured: Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 HTTP/1.1 Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaN-uPj_TT7bawmb_-0n_q5UkdPqLbwkNGOfvsDFK-lMqPINg7GTogRN347xfUzG_vvyLxAPEi3FUYcoMxvblviBFizYeVGUWq61kqlXqaz_cTQCc74ctB4SXhbxCWaYA-Iv_jF2VP6y2lj8rp_RfPu-I0Uwam9gRUJgI8neAYsQGgw Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 8fe84461cde7445dbf0d1a98df3aeb15 Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fe84461cde7445dbf0d1a98df3aeb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 8fe84461cde7445dbf0d1a98df3aeb15 Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-799482090 Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AttachVolumeTestJSON-799482090-project Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 18c5a89d81c64bdaad17d7005434f01f Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AttachVolumeTestJSON-799482090-project Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '4c612c67-453a-48d4-8f78-97a00213ab46'} Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:26.835861 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.840675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:26.840675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:26.840675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:26.840675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:26.840675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:26.840675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. Aug 27 05:03:26.840675 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:26.841805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5695f60-1d9f-412a-ab7a-fe4cea844d2e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:26.842226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f2369d86-9a1c-46d0-b330-521ce89a0d22 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] Returning 404 to user: Instance 4c612c67-453a-48d4-8f78-97a00213ab46 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:26.843245 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f2369d86-9a1c-46d0-b330-521ce89a0d22 tempest-AttachVolumeTestJSON-799482090 tempest-AttachVolumeTestJSON-799482090-project] 10.222.0.79 "GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46" status: 404 len: 111 microversion: 2.1 time: 0.047035 Aug 27 05:03:26.849251 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2709/5472] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:26 2022] GET /compute/v2.1/servers/4c612c67-453a-48d4-8f78-97a00213ab46 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:26.981505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d5695f60-1d9f-412a-ab7a-fe4cea844d2e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:26.995905 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5695f60-1d9f-412a-ab7a-fe4cea844d2e tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1298 microversion: 2.1 time: 0.191834 Aug 27 05:03:27.001024 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2764/5473] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:26 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1298 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:27.590186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-589e666f-51b8-4bf5-a32d-85a443126116 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:27.590861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-589e666f-51b8-4bf5-a32d-85a443126116 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:27.598636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-589e666f-51b8-4bf5-a32d-85a443126116 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:27.599501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-589e666f-51b8-4bf5-a32d-85a443126116 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:27.600208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-589e666f-51b8-4bf5-a32d-85a443126116 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:27.601199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-589e666f-51b8-4bf5-a32d-85a443126116 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:27.601809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-589e666f-51b8-4bf5-a32d-85a443126116 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:27.603082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-589e666f-51b8-4bf5-a32d-85a443126116 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:27.817435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-589e666f-51b8-4bf5-a32d-85a443126116 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:27.827400 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-589e666f-51b8-4bf5-a32d-85a443126116 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1375 microversion: 2.1 time: 0.241675 Aug 27 05:03:27.829308 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2710/5474] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:27 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1375 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:28.024439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c81aeb99-1600-4340-b58a-a645e0afc198 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:28.026260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c81aeb99-1600-4340-b58a-a645e0afc198 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:28.037887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81aeb99-1600-4340-b58a-a645e0afc198 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:28.038574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81aeb99-1600-4340-b58a-a645e0afc198 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:28.039201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81aeb99-1600-4340-b58a-a645e0afc198 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:28.040258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81aeb99-1600-4340-b58a-a645e0afc198 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:28.041065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81aeb99-1600-4340-b58a-a645e0afc198 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:28.041649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81aeb99-1600-4340-b58a-a645e0afc198 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:28.158604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c81aeb99-1600-4340-b58a-a645e0afc198 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:28.169308 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c81aeb99-1600-4340-b58a-a645e0afc198 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1298 microversion: 2.1 time: 0.150030 Aug 27 05:03:28.170910 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2765/5475] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:28 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1298 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:28.857508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dea22ac6-d077-40ce-b2a3-c2c2af772db7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:28.858231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dea22ac6-d077-40ce-b2a3-c2c2af772db7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:28.861315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:28.868698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea22ac6-d077-40ce-b2a3-c2c2af772db7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:28.869674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea22ac6-d077-40ce-b2a3-c2c2af772db7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:28.870089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea22ac6-d077-40ce-b2a3-c2c2af772db7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:28.870846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea22ac6-d077-40ce-b2a3-c2c2af772db7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:28.871617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea22ac6-d077-40ce-b2a3-c2c2af772db7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:28.872067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea22ac6-d077-40ce-b2a3-c2c2af772db7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:29.035345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dea22ac6-d077-40ce-b2a3-c2c2af772db7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:29.048572 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dea22ac6-d077-40ce-b2a3-c2c2af772db7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1375 microversion: 2.1 time: 0.201468 Aug 27 05:03:29.061606 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2711/5476] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:28 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1375 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:29.192126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e5f6ed4-4eab-4ee9-beaf-76bb1393f27f tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:29.192832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e5f6ed4-4eab-4ee9-beaf-76bb1393f27f tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:29.194831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:29.196413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:29.204881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e5f6ed4-4eab-4ee9-beaf-76bb1393f27f tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:29.205725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e5f6ed4-4eab-4ee9-beaf-76bb1393f27f tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:29.206211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e5f6ed4-4eab-4ee9-beaf-76bb1393f27f tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:29.206967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e5f6ed4-4eab-4ee9-beaf-76bb1393f27f tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:29.207434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e5f6ed4-4eab-4ee9-beaf-76bb1393f27f tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:29.208090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e5f6ed4-4eab-4ee9-beaf-76bb1393f27f tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:29.302059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5391fc08-9b0e-49bb-b430-45f53346626c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:29.302565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5391fc08-9b0e-49bb-b430-45f53346626c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:29.307161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e5f6ed4-4eab-4ee9-beaf-76bb1393f27f tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:29.309868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5391fc08-9b0e-49bb-b430-45f53346626c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:29.310620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5391fc08-9b0e-49bb-b430-45f53346626c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:29.311435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5391fc08-9b0e-49bb-b430-45f53346626c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:29.312785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5391fc08-9b0e-49bb-b430-45f53346626c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:29.313846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5391fc08-9b0e-49bb-b430-45f53346626c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:29.314587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5391fc08-9b0e-49bb-b430-45f53346626c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:29.322650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:29.326143 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e5f6ed4-4eab-4ee9-beaf-76bb1393f27f tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1298 microversion: 2.1 time: 0.138600 Aug 27 05:03:29.340409 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2766/5477] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:29 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1298 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:29.357883 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5391fc08-9b0e-49bb-b430-45f53346626c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments/73cab2e3-cf4f-44a5-8e76-0b9d6255bee6" status: 200 len: 194 microversion: 2.20 time: 0.059764 Aug 27 05:03:29.364930 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2712/5478] 10.222.0.79 () {60 vars in 1454 bytes} [Sat Aug 27 05:03:29 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments/73cab2e3-cf4f-44a5-8e76-0b9d6255bee6 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 05:03:29.452056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af443cad-a54a-4408-93e4-e28b8b7bc901 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:29.455474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af443cad-a54a-4408-93e4-e28b8b7bc901 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:29.466803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af443cad-a54a-4408-93e4-e28b8b7bc901 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:29.468364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af443cad-a54a-4408-93e4-e28b8b7bc901 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:29.469665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af443cad-a54a-4408-93e4-e28b8b7bc901 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:29.470756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af443cad-a54a-4408-93e4-e28b8b7bc901 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:29.471485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af443cad-a54a-4408-93e4-e28b8b7bc901 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:29.473331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af443cad-a54a-4408-93e4-e28b8b7bc901 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:29.582958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-af443cad-a54a-4408-93e4-e28b8b7bc901 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lazy-loading 'services' on Instance uuid 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:03:29.707754 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af443cad-a54a-4408-93e4-e28b8b7bc901 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments/73cab2e3-cf4f-44a5-8e76-0b9d6255bee6" status: 202 len: 0 microversion: 2.20 time: 0.261488 Aug 27 05:03:29.711011 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2767/5479] 10.222.0.79 () {60 vars in 1457 bytes} [Sat Aug 27 05:03:29 2022] DELETE /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments/73cab2e3-cf4f-44a5-8e76-0b9d6255bee6 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:03:29.721854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-45ce1632-a82f-44af-aa3a-e06218bfa690 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:29.725894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-45ce1632-a82f-44af-aa3a-e06218bfa690 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:29.735018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45ce1632-a82f-44af-aa3a-e06218bfa690 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:29.735873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45ce1632-a82f-44af-aa3a-e06218bfa690 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:29.736672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45ce1632-a82f-44af-aa3a-e06218bfa690 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:29.737924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45ce1632-a82f-44af-aa3a-e06218bfa690 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:29.738727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45ce1632-a82f-44af-aa3a-e06218bfa690 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:29.739625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45ce1632-a82f-44af-aa3a-e06218bfa690 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:29.785801 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-45ce1632-a82f-44af-aa3a-e06218bfa690 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069947 Aug 27 05:03:29.786395 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2713/5480] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 05:03:29 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:03:29.902568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-121638f5-c396-486c-a782-dbb5bea0cfd1 req-e6a02866-c997-4a20-9519-7a7b42084111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48", "name": "network-vif-plugged", "status": "completed", "tag": "1b509e6d-1a48-41cc-854b-3cb32f6ccb15"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:29.920090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-121638f5-c396-486c-a782-dbb5bea0cfd1 req-e6a02866-c997-4a20-9519-7a7b42084111 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:29.920714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-121638f5-c396-486c-a782-dbb5bea0cfd1 req-e6a02866-c997-4a20-9519-7a7b42084111 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:29.921254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-121638f5-c396-486c-a782-dbb5bea0cfd1 req-e6a02866-c997-4a20-9519-7a7b42084111 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:29.935136 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-121638f5-c396-486c-a782-dbb5bea0cfd1 req-e6a02866-c997-4a20-9519-7a7b42084111 service nova] Creating event network-vif-plugged:1b509e6d-1a48-41cc-854b-3cb32f6ccb15 for instance 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 on n-h1-854823-1 Aug 27 05:03:29.940613 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-121638f5-c396-486c-a782-dbb5bea0cfd1 req-e6a02866-c997-4a20-9519-7a7b42084111 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044409 Aug 27 05:03:29.941591 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2768/5481] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:30.072522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1745a188-d77c-4283-8620-3105505c3637 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:30.073246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1745a188-d77c-4283-8620-3105505c3637 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:30.080838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1745a188-d77c-4283-8620-3105505c3637 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:30.081923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1745a188-d77c-4283-8620-3105505c3637 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:30.082630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1745a188-d77c-4283-8620-3105505c3637 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:30.083130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1745a188-d77c-4283-8620-3105505c3637 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:30.083596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1745a188-d77c-4283-8620-3105505c3637 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:30.084010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1745a188-d77c-4283-8620-3105505c3637 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:30.317859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1745a188-d77c-4283-8620-3105505c3637 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:30.327730 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1745a188-d77c-4283-8620-3105505c3637 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1375 microversion: 2.1 time: 0.259132 Aug 27 05:03:30.328689 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2714/5482] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:30 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1375 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:30.349584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2198776d-69aa-4622-a9b0-c02706b2bd03 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:30.350892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2198776d-69aa-4622-a9b0-c02706b2bd03 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:30.358236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2198776d-69aa-4622-a9b0-c02706b2bd03 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:30.358744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2198776d-69aa-4622-a9b0-c02706b2bd03 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:30.359191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2198776d-69aa-4622-a9b0-c02706b2bd03 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:30.360448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2198776d-69aa-4622-a9b0-c02706b2bd03 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:30.360938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2198776d-69aa-4622-a9b0-c02706b2bd03 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:30.361373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2198776d-69aa-4622-a9b0-c02706b2bd03 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:30.524240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2198776d-69aa-4622-a9b0-c02706b2bd03 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:30.532678 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2198776d-69aa-4622-a9b0-c02706b2bd03 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1298 microversion: 2.1 time: 0.188186 Aug 27 05:03:30.535829 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2769/5483] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:30 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1298 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:30.799998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5fb5799a-29ac-484d-9f80-4ff16a327a23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:30.802251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5fb5799a-29ac-484d-9f80-4ff16a327a23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:30.822017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fb5799a-29ac-484d-9f80-4ff16a327a23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:30.822532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fb5799a-29ac-484d-9f80-4ff16a327a23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:30.822968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fb5799a-29ac-484d-9f80-4ff16a327a23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:30.823689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fb5799a-29ac-484d-9f80-4ff16a327a23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:30.824144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fb5799a-29ac-484d-9f80-4ff16a327a23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:30.824593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5fb5799a-29ac-484d-9f80-4ff16a327a23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:30.889412 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5fb5799a-29ac-484d-9f80-4ff16a327a23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092692 Aug 27 05:03:30.894488 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2715/5484] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 05:03:30 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:03:31.351094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ece9deb-3b84-4b55-b823-dfd77c332a7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:31.353278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ece9deb-3b84-4b55-b823-dfd77c332a7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:31.365901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ece9deb-3b84-4b55-b823-dfd77c332a7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:31.366428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ece9deb-3b84-4b55-b823-dfd77c332a7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:31.366880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ece9deb-3b84-4b55-b823-dfd77c332a7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:31.367949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ece9deb-3b84-4b55-b823-dfd77c332a7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:31.368439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ece9deb-3b84-4b55-b823-dfd77c332a7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:31.368988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ece9deb-3b84-4b55-b823-dfd77c332a7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:31.553201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ece9deb-3b84-4b55-b823-dfd77c332a7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:31.556301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-720e1a89-a879-4aed-9420-07aa6972c6fd tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:31.557553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-720e1a89-a879-4aed-9420-07aa6972c6fd tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:31.562582 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ece9deb-3b84-4b55-b823-dfd77c332a7b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1375 microversion: 2.1 time: 0.216203 Aug 27 05:03:31.563265 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2770/5485] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:31 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1375 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:31.567887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-720e1a89-a879-4aed-9420-07aa6972c6fd tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:31.568758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-720e1a89-a879-4aed-9420-07aa6972c6fd tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:31.569501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-720e1a89-a879-4aed-9420-07aa6972c6fd tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:31.570480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-720e1a89-a879-4aed-9420-07aa6972c6fd tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:31.571100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-720e1a89-a879-4aed-9420-07aa6972c6fd tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:31.571686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-720e1a89-a879-4aed-9420-07aa6972c6fd tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:31.684453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-720e1a89-a879-4aed-9420-07aa6972c6fd tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:31.692953 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-720e1a89-a879-4aed-9420-07aa6972c6fd tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1298 microversion: 2.1 time: 0.142125 Aug 27 05:03:31.693669 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2716/5486] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:31 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1298 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:31.909382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1c346f5-a9e8-4a47-ab92-a026cdfdf504 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:31.913482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1c346f5-a9e8-4a47-ab92-a026cdfdf504 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:31.922921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1c346f5-a9e8-4a47-ab92-a026cdfdf504 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:31.923790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1c346f5-a9e8-4a47-ab92-a026cdfdf504 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:31.924706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1c346f5-a9e8-4a47-ab92-a026cdfdf504 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:31.925693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1c346f5-a9e8-4a47-ab92-a026cdfdf504 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:31.926473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1c346f5-a9e8-4a47-ab92-a026cdfdf504 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:31.927498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1c346f5-a9e8-4a47-ab92-a026cdfdf504 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:31.971822 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1c346f5-a9e8-4a47-ab92-a026cdfdf504 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068905 Aug 27 05:03:31.973066 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2771/5487] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 05:03:31 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:03:32.583710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-86afbc53-fb5d-4835-bb57-9c911e11e86b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:32.584157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-86afbc53-fb5d-4835-bb57-9c911e11e86b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:32.591791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86afbc53-fb5d-4835-bb57-9c911e11e86b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:32.592281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86afbc53-fb5d-4835-bb57-9c911e11e86b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:32.592762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86afbc53-fb5d-4835-bb57-9c911e11e86b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:32.593463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86afbc53-fb5d-4835-bb57-9c911e11e86b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:32.593960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86afbc53-fb5d-4835-bb57-9c911e11e86b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:32.594391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86afbc53-fb5d-4835-bb57-9c911e11e86b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:32.716125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a9f51350-b43f-40a4-a181-22f8f5c57500 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:32.718931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a9f51350-b43f-40a4-a181-22f8f5c57500 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:32.730488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f51350-b43f-40a4-a181-22f8f5c57500 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:32.731242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f51350-b43f-40a4-a181-22f8f5c57500 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:32.732156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f51350-b43f-40a4-a181-22f8f5c57500 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:32.733247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f51350-b43f-40a4-a181-22f8f5c57500 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:32.733921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f51350-b43f-40a4-a181-22f8f5c57500 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:32.737561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f51350-b43f-40a4-a181-22f8f5c57500 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:32.756683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-86afbc53-fb5d-4835-bb57-9c911e11e86b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:32.767754 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-86afbc53-fb5d-4835-bb57-9c911e11e86b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1375 microversion: 2.1 time: 0.186174 Aug 27 05:03:32.769154 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2717/5488] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:32 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1375 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:32.851150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a9f51350-b43f-40a4-a181-22f8f5c57500 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:32.862342 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a9f51350-b43f-40a4-a181-22f8f5c57500 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1470 microversion: 2.1 time: 0.151516 Aug 27 05:03:32.864109 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2772/5489] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:32 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:32.886237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb1bfc72-e966-4ea2-aebc-f2a5e654c5fa tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:32.886237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eb1bfc72-e966-4ea2-aebc-f2a5e654c5fa tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:32.891114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb1bfc72-e966-4ea2-aebc-f2a5e654c5fa tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:32.891707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb1bfc72-e966-4ea2-aebc-f2a5e654c5fa tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:32.892241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb1bfc72-e966-4ea2-aebc-f2a5e654c5fa tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:32.893324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb1bfc72-e966-4ea2-aebc-f2a5e654c5fa tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:32.893882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb1bfc72-e966-4ea2-aebc-f2a5e654c5fa tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:32.894402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb1bfc72-e966-4ea2-aebc-f2a5e654c5fa tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:32.993753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-61ebcaf8-d642-4316-9fe5-34239a2e5de6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:33.012590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-61ebcaf8-d642-4316-9fe5-34239a2e5de6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:33.020705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61ebcaf8-d642-4316-9fe5-34239a2e5de6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.021941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61ebcaf8-d642-4316-9fe5-34239a2e5de6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.022582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61ebcaf8-d642-4316-9fe5-34239a2e5de6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.026926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb1bfc72-e966-4ea2-aebc-f2a5e654c5fa tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:33.031879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61ebcaf8-d642-4316-9fe5-34239a2e5de6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.032776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61ebcaf8-d642-4316-9fe5-34239a2e5de6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.036047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61ebcaf8-d642-4316-9fe5-34239a2e5de6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.039873 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb1bfc72-e966-4ea2-aebc-f2a5e654c5fa tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1470 microversion: 2.1 time: 0.158877 Aug 27 05:03:33.040490 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2718/5490] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:32 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:33.065920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b03e2697-0a53-4556-9263-f474fe1fdbe6 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:33.069190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b03e2697-0a53-4556-9263-f474fe1fdbe6 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:33.084593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b03e2697-0a53-4556-9263-f474fe1fdbe6 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.085346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b03e2697-0a53-4556-9263-f474fe1fdbe6 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.086485 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-61ebcaf8-d642-4316-9fe5-34239a2e5de6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105712 Aug 27 05:03:33.087674 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2773/5491] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 05:03:32 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:03:33.089114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b03e2697-0a53-4556-9263-f474fe1fdbe6 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.090049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b03e2697-0a53-4556-9263-f474fe1fdbe6 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.090833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b03e2697-0a53-4556-9263-f474fe1fdbe6 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.091452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b03e2697-0a53-4556-9263-f474fe1fdbe6 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.112265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:33.161541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b512be03-f0e1-4c96-b5da-3e8512008042 req-90945e9c-f51b-4eb5-b6e7-1d28fcff6aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a1d6417-52c8-4ede-864c-c1afc2733a46", "name": "network-vif-plugged", "status": "completed", "tag": "d01488bd-73f7-429f-aad4-d9efbdec2c24"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:33.182457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b512be03-f0e1-4c96-b5da-3e8512008042 req-90945e9c-f51b-4eb5-b6e7-1d28fcff6aa2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.182457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b512be03-f0e1-4c96-b5da-3e8512008042 req-90945e9c-f51b-4eb5-b6e7-1d28fcff6aa2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.182704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b512be03-f0e1-4c96-b5da-3e8512008042 req-90945e9c-f51b-4eb5-b6e7-1d28fcff6aa2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.205776 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b03e2697-0a53-4556-9263-f474fe1fdbe6 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1621 microversion: 2.1 time: 0.148005 Aug 27 05:03:33.206355 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2719/5492] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:33 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1621 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:33.220936 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b512be03-f0e1-4c96-b5da-3e8512008042 req-90945e9c-f51b-4eb5-b6e7-1d28fcff6aa2 service nova] Creating event network-vif-plugged:d01488bd-73f7-429f-aad4-d9efbdec2c24 for instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 on n-h2-854823-1 Aug 27 05:03:33.225227 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b512be03-f0e1-4c96-b5da-3e8512008042 req-90945e9c-f51b-4eb5-b6e7-1d28fcff6aa2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067100 Aug 27 05:03:33.226102 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2774/5493] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:03:33.229381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4334b191-d55b-4017-9126-7d04f5d04f58 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:33.230229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4334b191-d55b-4017-9126-7d04f5d04f58 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:33.247765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4334b191-d55b-4017-9126-7d04f5d04f58 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.248257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4334b191-d55b-4017-9126-7d04f5d04f58 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.248719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4334b191-d55b-4017-9126-7d04f5d04f58 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.249892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4334b191-d55b-4017-9126-7d04f5d04f58 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.250617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4334b191-d55b-4017-9126-7d04f5d04f58 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.251048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4334b191-d55b-4017-9126-7d04f5d04f58 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.507765 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4334b191-d55b-4017-9126-7d04f5d04f58 tempest-TestSecurityGroupsBasicOps-843273973 tempest-TestSecurityGroupsBasicOps-843273973-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 200 len: 1912 microversion: 2.1 time: 0.282720 Aug 27 05:03:33.514174 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2720/5494] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:33 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 1912 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:33.582624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4bede139-a189-4233-bca6-9b26d5da2051 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:33.583469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4bede139-a189-4233-bca6-9b26d5da2051 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:33.591364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bede139-a189-4233-bca6-9b26d5da2051 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.591950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bede139-a189-4233-bca6-9b26d5da2051 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.592480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bede139-a189-4233-bca6-9b26d5da2051 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.593445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bede139-a189-4233-bca6-9b26d5da2051 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.594624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bede139-a189-4233-bca6-9b26d5da2051 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.595248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bede139-a189-4233-bca6-9b26d5da2051 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.626119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4bede139-a189-4233-bca6-9b26d5da2051 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:03:33.717683 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4bede139-a189-4233-bca6-9b26d5da2051 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "DELETE /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 204 len: 0 microversion: 2.1 time: 0.139067 Aug 27 05:03:33.719142 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2775/5495] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:03:33 2022] DELETE /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:03:33.728123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8ca18926-0185-4100-9b38-40ac2a16a981 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:33.728123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8ca18926-0185-4100-9b38-40ac2a16a981 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:33.737166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ca18926-0185-4100-9b38-40ac2a16a981 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.737748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ca18926-0185-4100-9b38-40ac2a16a981 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.738270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ca18926-0185-4100-9b38-40ac2a16a981 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.739040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ca18926-0185-4100-9b38-40ac2a16a981 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.739557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ca18926-0185-4100-9b38-40ac2a16a981 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.740072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ca18926-0185-4100-9b38-40ac2a16a981 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.792790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b665e44b-3861-43d1-908f-dc6e53e81258 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:33.793537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b665e44b-3861-43d1-908f-dc6e53e81258 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:33.800269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b665e44b-3861-43d1-908f-dc6e53e81258 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.801053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b665e44b-3861-43d1-908f-dc6e53e81258 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.801695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b665e44b-3861-43d1-908f-dc6e53e81258 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.802943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b665e44b-3861-43d1-908f-dc6e53e81258 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:33.803625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b665e44b-3861-43d1-908f-dc6e53e81258 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:33.804046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b665e44b-3861-43d1-908f-dc6e53e81258 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:33.842516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ca18926-0185-4100-9b38-40ac2a16a981 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:33.851421 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8ca18926-0185-4100-9b38-40ac2a16a981 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1476 microversion: 2.1 time: 0.127952 Aug 27 05:03:33.852612 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2721/5496] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:33 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1476 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:33.981607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b665e44b-3861-43d1-908f-dc6e53e81258 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:33.993177 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b665e44b-3861-43d1-908f-dc6e53e81258 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1375 microversion: 2.1 time: 0.205946 Aug 27 05:03:33.993905 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2776/5497] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:33 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1375 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:34.101633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9defd1e9-355c-49b9-af69-aad805780349 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:34.104261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9defd1e9-355c-49b9-af69-aad805780349 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:34.112509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9defd1e9-355c-49b9-af69-aad805780349 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:34.113099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9defd1e9-355c-49b9-af69-aad805780349 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:34.113611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9defd1e9-355c-49b9-af69-aad805780349 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:34.114382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9defd1e9-355c-49b9-af69-aad805780349 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:34.114905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9defd1e9-355c-49b9-af69-aad805780349 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:34.115420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9defd1e9-355c-49b9-af69-aad805780349 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:34.152679 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9defd1e9-355c-49b9-af69-aad805780349 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056340 Aug 27 05:03:34.153611 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2722/5498] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 05:03:34 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 05:03:34.873745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe169a77-4b4b-4fec-b169-e092a9c43838 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:34.876727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe169a77-4b4b-4fec-b169-e092a9c43838 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:34.884861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe169a77-4b4b-4fec-b169-e092a9c43838 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:34.885846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe169a77-4b4b-4fec-b169-e092a9c43838 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:34.886630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe169a77-4b4b-4fec-b169-e092a9c43838 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:34.887668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe169a77-4b4b-4fec-b169-e092a9c43838 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:34.888742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe169a77-4b4b-4fec-b169-e092a9c43838 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:34.889242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe169a77-4b4b-4fec-b169-e092a9c43838 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:35.001148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe169a77-4b4b-4fec-b169-e092a9c43838 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:35.010631 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe169a77-4b4b-4fec-b169-e092a9c43838 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1476 microversion: 2.1 time: 0.140992 Aug 27 05:03:35.011349 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2777/5499] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:34 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1476 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:35.015247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-434857d9-a678-4386-8978-c310f84ade91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:35.016677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-434857d9-a678-4386-8978-c310f84ade91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:35.023759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-434857d9-a678-4386-8978-c310f84ade91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:35.024515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-434857d9-a678-4386-8978-c310f84ade91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:35.025201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-434857d9-a678-4386-8978-c310f84ade91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:35.026109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-434857d9-a678-4386-8978-c310f84ade91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:35.026595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-434857d9-a678-4386-8978-c310f84ade91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:35.027186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-434857d9-a678-4386-8978-c310f84ade91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:35.166295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1fc49b0f-4142-4fe2-b9f6-91ef3e862040 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:35.168908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1fc49b0f-4142-4fe2-b9f6-91ef3e862040 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:35.178370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fc49b0f-4142-4fe2-b9f6-91ef3e862040 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:35.179258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fc49b0f-4142-4fe2-b9f6-91ef3e862040 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:35.180003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fc49b0f-4142-4fe2-b9f6-91ef3e862040 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:35.181166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fc49b0f-4142-4fe2-b9f6-91ef3e862040 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:35.182139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fc49b0f-4142-4fe2-b9f6-91ef3e862040 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:35.182813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fc49b0f-4142-4fe2-b9f6-91ef3e862040 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:35.215064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-434857d9-a678-4386-8978-c310f84ade91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:35.225840 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-434857d9-a678-4386-8978-c310f84ade91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1563 microversion: 2.1 time: 0.214144 Aug 27 05:03:35.232576 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2723/5500] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:35 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1563 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:35.245038 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1fc49b0f-4142-4fe2-b9f6-91ef3e862040 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082693 Aug 27 05:03:35.247042 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2778/5501] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 05:03:35 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:03:35.248649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1505ce2d-94bf-43ca-9577-3258934e90ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:35.249526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1505ce2d-94bf-43ca-9577-3258934e90ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:35.258025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1505ce2d-94bf-43ca-9577-3258934e90ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:35.259361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1505ce2d-94bf-43ca-9577-3258934e90ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:35.259810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1505ce2d-94bf-43ca-9577-3258934e90ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:35.260552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1505ce2d-94bf-43ca-9577-3258934e90ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:35.261025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1505ce2d-94bf-43ca-9577-3258934e90ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:35.262214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1505ce2d-94bf-43ca-9577-3258934e90ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:35.426253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1505ce2d-94bf-43ca-9577-3258934e90ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:35.434232 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1505ce2d-94bf-43ca-9577-3258934e90ff tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1563 microversion: 2.1 time: 0.190162 Aug 27 05:03:35.434815 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2724/5502] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:35 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1563 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:35.526177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ff3740b-7381-4e12-89dd-36853a8d53c5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:35.526692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ff3740b-7381-4e12-89dd-36853a8d53c5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:35.533764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ff3740b-7381-4e12-89dd-36853a8d53c5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:35.534272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ff3740b-7381-4e12-89dd-36853a8d53c5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:35.534748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ff3740b-7381-4e12-89dd-36853a8d53c5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:35.535444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ff3740b-7381-4e12-89dd-36853a8d53c5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:35.536113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ff3740b-7381-4e12-89dd-36853a8d53c5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:35.536595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ff3740b-7381-4e12-89dd-36853a8d53c5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:35.563599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ff3740b-7381-4e12-89dd-36853a8d53c5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:03:35.660756 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ff3740b-7381-4e12-89dd-36853a8d53c5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 204 len: 0 microversion: 2.1 time: 0.136787 Aug 27 05:03:35.661494 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2779/5503] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:03:35 2022] DELETE /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:03:35.670754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c6b6ef1f-aaee-41ac-9dd6-3085abcf07ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:35.672063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c6b6ef1f-aaee-41ac-9dd6-3085abcf07ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:35.678529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6b6ef1f-aaee-41ac-9dd6-3085abcf07ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:35.679025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6b6ef1f-aaee-41ac-9dd6-3085abcf07ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:35.679467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6b6ef1f-aaee-41ac-9dd6-3085abcf07ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:35.680169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6b6ef1f-aaee-41ac-9dd6-3085abcf07ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:35.680672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6b6ef1f-aaee-41ac-9dd6-3085abcf07ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:35.681198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6b6ef1f-aaee-41ac-9dd6-3085abcf07ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:35.840355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c6b6ef1f-aaee-41ac-9dd6-3085abcf07ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:35.849088 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c6b6ef1f-aaee-41ac-9dd6-3085abcf07ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1569 microversion: 2.1 time: 0.182745 Aug 27 05:03:35.849877 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2725/5504] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:35 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:36.032658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff0d1252-ee11-467c-a607-0de82eba7b80 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:36.033381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ff0d1252-ee11-467c-a607-0de82eba7b80 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:36.041201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff0d1252-ee11-467c-a607-0de82eba7b80 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:36.041700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff0d1252-ee11-467c-a607-0de82eba7b80 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:36.042208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff0d1252-ee11-467c-a607-0de82eba7b80 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:36.043024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff0d1252-ee11-467c-a607-0de82eba7b80 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:36.043717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff0d1252-ee11-467c-a607-0de82eba7b80 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:36.044157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff0d1252-ee11-467c-a607-0de82eba7b80 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:36.144062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ff0d1252-ee11-467c-a607-0de82eba7b80 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:36.147843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:36.153257 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff0d1252-ee11-467c-a607-0de82eba7b80 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1476 microversion: 2.1 time: 0.125540 Aug 27 05:03:36.154026 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2780/5505] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:36 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1476 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:36.258965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9118d489-0782-40e1-ba92-7221d63aa733 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:36.261820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9118d489-0782-40e1-ba92-7221d63aa733 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:36.268986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9118d489-0782-40e1-ba92-7221d63aa733 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:36.269477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9118d489-0782-40e1-ba92-7221d63aa733 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:36.270004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9118d489-0782-40e1-ba92-7221d63aa733 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:36.270588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9118d489-0782-40e1-ba92-7221d63aa733 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:36.271034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9118d489-0782-40e1-ba92-7221d63aa733 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:36.271463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9118d489-0782-40e1-ba92-7221d63aa733 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:36.308136 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9118d489-0782-40e1-ba92-7221d63aa733 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053292 Aug 27 05:03:36.315694 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2726/5506] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 05:03:36 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:36.413849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8ced5d1-1e29-432b-9cbe-662e52f365bb tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:36.414531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8ced5d1-1e29-432b-9cbe-662e52f365bb tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:36.423671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8ced5d1-1e29-432b-9cbe-662e52f365bb tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:36.424626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8ced5d1-1e29-432b-9cbe-662e52f365bb tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:36.425303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8ced5d1-1e29-432b-9cbe-662e52f365bb tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:36.426287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8ced5d1-1e29-432b-9cbe-662e52f365bb tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:36.427008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8ced5d1-1e29-432b-9cbe-662e52f365bb tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:36.427695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8ced5d1-1e29-432b-9cbe-662e52f365bb tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:36.464639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8ced5d1-1e29-432b-9cbe-662e52f365bb tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:03:36.558454 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8ced5d1-1e29-432b-9cbe-662e52f365bb tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 204 len: 0 microversion: 2.20 time: 0.151133 Aug 27 05:03:36.563475 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2781/5507] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 05:03:36 2022] DELETE /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:03:36.569073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f48c53c-9f56-43a0-94a1-5bb127968208 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:36.569816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4f48c53c-9f56-43a0-94a1-5bb127968208 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:36.578482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f48c53c-9f56-43a0-94a1-5bb127968208 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:36.579132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f48c53c-9f56-43a0-94a1-5bb127968208 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:36.579899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f48c53c-9f56-43a0-94a1-5bb127968208 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:36.580817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f48c53c-9f56-43a0-94a1-5bb127968208 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:36.581280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f48c53c-9f56-43a0-94a1-5bb127968208 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:36.581708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f48c53c-9f56-43a0-94a1-5bb127968208 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:36.832499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4f48c53c-9f56-43a0-94a1-5bb127968208 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:36.844459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4f48c53c-9f56-43a0-94a1-5bb127968208 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:36.846917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4f48c53c-9f56-43a0-94a1-5bb127968208 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:36.848272 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4f48c53c-9f56-43a0-94a1-5bb127968208 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.283555 Aug 27 05:03:36.849525 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2727/5508] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:36 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:03:36.885415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79356dac-333b-423c-a086-e06440f882c0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:36.886902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-79356dac-333b-423c-a086-e06440f882c0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:36.916430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79356dac-333b-423c-a086-e06440f882c0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:36.917381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79356dac-333b-423c-a086-e06440f882c0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:36.918119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79356dac-333b-423c-a086-e06440f882c0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:36.919184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79356dac-333b-423c-a086-e06440f882c0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:36.919675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79356dac-333b-423c-a086-e06440f882c0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:36.920234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79356dac-333b-423c-a086-e06440f882c0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:37.089071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-efe20f66-a0f3-4ff8-b329-02c98294b3eb req-2a3b5253-5bcd-4582-85ac-c99748de3e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48", "name": "network-vif-deleted", "tag": "1b509e6d-1a48-41cc-854b-3cb32f6ccb15"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:37.126220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-efe20f66-a0f3-4ff8-b329-02c98294b3eb req-2a3b5253-5bcd-4582-85ac-c99748de3e71 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:37.128120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-efe20f66-a0f3-4ff8-b329-02c98294b3eb req-2a3b5253-5bcd-4582-85ac-c99748de3e71 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:37.128802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-efe20f66-a0f3-4ff8-b329-02c98294b3eb req-2a3b5253-5bcd-4582-85ac-c99748de3e71 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:37.148366 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-efe20f66-a0f3-4ff8-b329-02c98294b3eb req-2a3b5253-5bcd-4582-85ac-c99748de3e71 service nova] Creating event network-vif-deleted:1b509e6d-1a48-41cc-854b-3cb32f6ccb15 for instance 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 on n-h1-854823-1 Aug 27 05:03:37.155321 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-efe20f66-a0f3-4ff8-b329-02c98294b3eb req-2a3b5253-5bcd-4582-85ac-c99748de3e71 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072397 Aug 27 05:03:37.164118 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2728/5509] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:37.165288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-79356dac-333b-423c-a086-e06440f882c0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:37.176507 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-79356dac-333b-423c-a086-e06440f882c0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1569 microversion: 2.1 time: 0.301841 Aug 27 05:03:37.178017 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2782/5510] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:36 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1569 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:37.184767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-60dfdc92-25d0-4fac-afcd-81dbb3609158 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:37.184767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-60dfdc92-25d0-4fac-afcd-81dbb3609158 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:37.191600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60dfdc92-25d0-4fac-afcd-81dbb3609158 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:37.197701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60dfdc92-25d0-4fac-afcd-81dbb3609158 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:37.198274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60dfdc92-25d0-4fac-afcd-81dbb3609158 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:37.199106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60dfdc92-25d0-4fac-afcd-81dbb3609158 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:37.199647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60dfdc92-25d0-4fac-afcd-81dbb3609158 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:37.200150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60dfdc92-25d0-4fac-afcd-81dbb3609158 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:37.360062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-60dfdc92-25d0-4fac-afcd-81dbb3609158 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:37.376386 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-60dfdc92-25d0-4fac-afcd-81dbb3609158 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 200 len: 1325 microversion: 2.1 time: 0.205455 Aug 27 05:03:37.390131 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2729/5511] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:37 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 1325 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:37.885088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c5e0b0d-e665-409a-b413-86fa3234006b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:37.886302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4c5e0b0d-e665-409a-b413-86fa3234006b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:37.892943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5e0b0d-e665-409a-b413-86fa3234006b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:37.893854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5e0b0d-e665-409a-b413-86fa3234006b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:37.894559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5e0b0d-e665-409a-b413-86fa3234006b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:37.895514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5e0b0d-e665-409a-b413-86fa3234006b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:37.896209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5e0b0d-e665-409a-b413-86fa3234006b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:37.897206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5e0b0d-e665-409a-b413-86fa3234006b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:38.116675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c5e0b0d-e665-409a-b413-86fa3234006b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:38.126148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c5e0b0d-e665-409a-b413-86fa3234006b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:38.127613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c5e0b0d-e665-409a-b413-86fa3234006b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:38.128820 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c5e0b0d-e665-409a-b413-86fa3234006b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.247623 Aug 27 05:03:38.129480 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2783/5512] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:37 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:03:38.199277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d90e420a-7182-4e23-a5d8-565cfb9b5fdb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:38.199902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d90e420a-7182-4e23-a5d8-565cfb9b5fdb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:38.206548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d90e420a-7182-4e23-a5d8-565cfb9b5fdb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:38.206972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d90e420a-7182-4e23-a5d8-565cfb9b5fdb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:38.207414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d90e420a-7182-4e23-a5d8-565cfb9b5fdb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:38.208114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d90e420a-7182-4e23-a5d8-565cfb9b5fdb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:38.208594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d90e420a-7182-4e23-a5d8-565cfb9b5fdb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:38.209024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d90e420a-7182-4e23-a5d8-565cfb9b5fdb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:38.393982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d90e420a-7182-4e23-a5d8-565cfb9b5fdb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:38.405620 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d90e420a-7182-4e23-a5d8-565cfb9b5fdb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1569 microversion: 2.1 time: 0.210179 Aug 27 05:03:38.407466 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2730/5513] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:38 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:38.411874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4dd08b2-9e27-41b5-ad99-654e7da3c8cb tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:38.416215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4dd08b2-9e27-41b5-ad99-654e7da3c8cb tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:38.425939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4dd08b2-9e27-41b5-ad99-654e7da3c8cb tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:38.426576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4dd08b2-9e27-41b5-ad99-654e7da3c8cb tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:38.426895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4dd08b2-9e27-41b5-ad99-654e7da3c8cb tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:38.427624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4dd08b2-9e27-41b5-ad99-654e7da3c8cb tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:38.428186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4dd08b2-9e27-41b5-ad99-654e7da3c8cb tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:38.428560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4dd08b2-9e27-41b5-ad99-654e7da3c8cb tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:38.452160 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d4dd08b2-9e27-41b5-ad99-654e7da3c8cb tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] HTTP exception thrown: Instance 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 could not be found. Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4dd08b2-9e27-41b5-ad99-654e7da3c8cb tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Request method failure captured: Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 HTTP/1.1 Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaU-gr0l4Ujty6nybKAak0VSHGJ2lRQSRuqS_QHNEJOICO8ebpnuL9z2ZVLwrlWRiq355ZTOhtsrmTRTthB3JxZsAvqyjqL-a7TgM_zt8YHzrNYUFVGEViOKmDjmb-uXvHYmtEyBKnYkV1bcU-6JDFsivo53jifFyy3kkljLUOgT87M Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 5cb264664558452095a2d83e8950dbeb Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-522704998 Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cb264664558452095a2d83e8950dbeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cb264664558452095a2d83e8950dbeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cb264664558452095a2d83e8950dbeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cb264664558452095a2d83e8950dbeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestSecurityGroupsBasicOps-522704998 Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 5cb264664558452095a2d83e8950dbeb Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-522704998 Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestSecurityGroupsBasicOps-522704998-project Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 277ff8e295684cd18d8c9dd5130dde1d Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestSecurityGroupsBasicOps-522704998-project Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 could not be found. Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48'} Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 could not be found. Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 could not be found. Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:38.455200 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:38.461786 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:38.461786 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:38.461786 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:38.461786 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:38.461786 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:38.461786 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 could not be found. Aug 27 05:03:38.461786 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:38.461786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4dd08b2-9e27-41b5-ad99-654e7da3c8cb tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Returning 404 to user: Instance 17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:38.461786 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4dd08b2-9e27-41b5-ad99-654e7da3c8cb tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48" status: 404 len: 111 microversion: 2.1 time: 0.058298 Aug 27 05:03:38.461786 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2784/5514] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:38 2022] GET /compute/v2.1/servers/17cd0a49-f3ee-4fa8-8eff-ddbc1b696f48 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:39.158592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ed1b4045-efbc-4395-bd90-dc9c48aec30d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:39.161857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ed1b4045-efbc-4395-bd90-dc9c48aec30d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:39.184026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed1b4045-efbc-4395-bd90-dc9c48aec30d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:39.191354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed1b4045-efbc-4395-bd90-dc9c48aec30d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:39.192147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed1b4045-efbc-4395-bd90-dc9c48aec30d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:39.193620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed1b4045-efbc-4395-bd90-dc9c48aec30d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:39.194468 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed1b4045-efbc-4395-bd90-dc9c48aec30d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:39.196433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed1b4045-efbc-4395-bd90-dc9c48aec30d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:39.436950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2d59687-de20-4094-9a78-f1d8d4156a3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:39.438354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2d59687-de20-4094-9a78-f1d8d4156a3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:39.449460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2d59687-de20-4094-9a78-f1d8d4156a3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:39.451902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2d59687-de20-4094-9a78-f1d8d4156a3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:39.452506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2d59687-de20-4094-9a78-f1d8d4156a3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:39.453691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2d59687-de20-4094-9a78-f1d8d4156a3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:39.454177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2d59687-de20-4094-9a78-f1d8d4156a3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:39.454801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2d59687-de20-4094-9a78-f1d8d4156a3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:39.555449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed1b4045-efbc-4395-bd90-dc9c48aec30d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:39.566336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed1b4045-efbc-4395-bd90-dc9c48aec30d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:39.568236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed1b4045-efbc-4395-bd90-dc9c48aec30d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:39.570536 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ed1b4045-efbc-4395-bd90-dc9c48aec30d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1722 microversion: 2.20 time: 0.417119 Aug 27 05:03:39.571371 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2731/5515] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:39 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1722 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:03:39.778303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c2d59687-de20-4094-9a78-f1d8d4156a3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:39.821747 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2d59687-de20-4094-9a78-f1d8d4156a3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1569 microversion: 2.1 time: 0.393736 Aug 27 05:03:39.823052 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2785/5516] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:39 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1569 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:40.076910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d85ad9dc-34b3-4023-bbe7-72cf64cf70a3 req-a64e135c-d195-4f3e-bedc-ed570ed0a897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a1d6417-52c8-4ede-864c-c1afc2733a46", "name": "network-vif-deleted", "tag": "d01488bd-73f7-429f-aad4-d9efbdec2c24"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:40.110767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d85ad9dc-34b3-4023-bbe7-72cf64cf70a3 req-a64e135c-d195-4f3e-bedc-ed570ed0a897 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:40.111655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d85ad9dc-34b3-4023-bbe7-72cf64cf70a3 req-a64e135c-d195-4f3e-bedc-ed570ed0a897 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:40.112259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d85ad9dc-34b3-4023-bbe7-72cf64cf70a3 req-a64e135c-d195-4f3e-bedc-ed570ed0a897 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:40.181936 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d85ad9dc-34b3-4023-bbe7-72cf64cf70a3 req-a64e135c-d195-4f3e-bedc-ed570ed0a897 service nova] Creating event network-vif-deleted:d01488bd-73f7-429f-aad4-d9efbdec2c24 for instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 on n-h2-854823-1 Aug 27 05:03:40.205619 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d85ad9dc-34b3-4023-bbe7-72cf64cf70a3 req-a64e135c-d195-4f3e-bedc-ed570ed0a897 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135437 Aug 27 05:03:40.211126 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2732/5517] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:40.242446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c49ca9c6-d61d-4bb4-9127-66588513224c req-5158deb9-1bfb-401f-8700-45765e459b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd1a40c-a36d-4253-9f1c-b5711b2ed52a", "name": "network-vif-deleted", "tag": "620b69e1-40ab-4292-881f-6f2fff934397"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:40.277000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c49ca9c6-d61d-4bb4-9127-66588513224c req-5158deb9-1bfb-401f-8700-45765e459b8a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:40.278107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c49ca9c6-d61d-4bb4-9127-66588513224c req-5158deb9-1bfb-401f-8700-45765e459b8a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:40.278742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c49ca9c6-d61d-4bb4-9127-66588513224c req-5158deb9-1bfb-401f-8700-45765e459b8a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:40.301883 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c49ca9c6-d61d-4bb4-9127-66588513224c req-5158deb9-1bfb-401f-8700-45765e459b8a service nova] Creating event network-vif-deleted:620b69e1-40ab-4292-881f-6f2fff934397 for instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a on n-h2-854823-1 Aug 27 05:03:40.310341 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c49ca9c6-d61d-4bb4-9127-66588513224c req-5158deb9-1bfb-401f-8700-45765e459b8a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072984 Aug 27 05:03:40.311485 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2786/5518] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:40.596853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:40.598955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:40.613246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:40.616082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:40.616800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:40.619199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:40.620662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:40.622870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:40.715766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:40.716274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:40.716893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:40.719268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lazy-loading 'fault' on Instance uuid 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:03:40.811319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:40.825721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:40.827242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:40.833170 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a050b74c-4a20-4573-9661-8a0f8e102794 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 200 len: 1371 microversion: 2.20 time: 0.240322 Aug 27 05:03:40.834577 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2733/5519] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:40 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:03:40.858144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03578dbc-a683-491b-9d2a-8bf0a07c28ba tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:40.859720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03578dbc-a683-491b-9d2a-8bf0a07c28ba tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:40.875553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03578dbc-a683-491b-9d2a-8bf0a07c28ba tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:40.876924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03578dbc-a683-491b-9d2a-8bf0a07c28ba tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:40.877396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03578dbc-a683-491b-9d2a-8bf0a07c28ba tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:40.878136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03578dbc-a683-491b-9d2a-8bf0a07c28ba tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:40.878614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03578dbc-a683-491b-9d2a-8bf0a07c28ba tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:40.879052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03578dbc-a683-491b-9d2a-8bf0a07c28ba tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:41.040084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-03578dbc-a683-491b-9d2a-8bf0a07c28ba tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:41.061871 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03578dbc-a683-491b-9d2a-8bf0a07c28ba tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1360 microversion: 2.1 time: 0.202556 Aug 27 05:03:41.077773 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2787/5520] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:40 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1360 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:41.861903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-62ecd5fc-d5d4-4800-b3c5-687df464a26c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:41.863442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-62ecd5fc-d5d4-4800-b3c5-687df464a26c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:41.879975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62ecd5fc-d5d4-4800-b3c5-687df464a26c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:41.883103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62ecd5fc-d5d4-4800-b3c5-687df464a26c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:41.891497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62ecd5fc-d5d4-4800-b3c5-687df464a26c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:41.902151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62ecd5fc-d5d4-4800-b3c5-687df464a26c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:41.918441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62ecd5fc-d5d4-4800-b3c5-687df464a26c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:41.922651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62ecd5fc-d5d4-4800-b3c5-687df464a26c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:41.956799 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-62ecd5fc-d5d4-4800-b3c5-687df464a26c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] HTTP exception thrown: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-62ecd5fc-d5d4-4800-b3c5-687df464a26c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Request method failure captured: Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a HTTP/1.1 Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaSjtKQ8CNr8ijhBpDj-EldUtAutdZu4lRoyWRJSbKIHJXnKqqOeGbCBFdWOZKopjq1IGLgQGFQNqz8sSUAQqx808Z7T-yWEwNxol6tWR3RDabS8xz0sm8_TchXJn0LJbdFaeJmZmmQTvO4payBl1yD5Yqrlhi3JSiB63gvuJdHxdCM Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 3d73cadd70ef45259dd85e6d59cbbab1 Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 3d73cadd70ef45259dd85e6d59cbbab1 Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AttachVolumeShelveTestJSON-1256848898-project Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: ec72122ff0b84c5fb558ca810ddd213d Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1256848898-project Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '4fd1a40c-a36d-4253-9f1c-b5711b2ed52a'} Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:41.959611 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:41.966312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:41.966312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:41.966312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:41.966312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:41.966312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:41.966312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:41.966312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:03:41.966312 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:03:41.970598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-62ecd5fc-d5d4-4800-b3c5-687df464a26c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Returning 404 to user: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:41.971690 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-62ecd5fc-d5d4-4800-b3c5-687df464a26c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 404 len: 111 microversion: 2.20 time: 0.115079 Aug 27 05:03:41.972792 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2734/5521] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:41 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:03:41.981631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63006b53-1f47-4549-9f18-6d534e38754d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '.version_select at 0x7f1f20495e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:42.014666 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63006b53-1f47-4549-9f18-6d534e38754d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-240842740" status: 204 len: 0 microversion: 2.20 time: 0.037320 Aug 27 05:03:42.020030 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2788/5522] 10.222.0.79 () {60 vars in 1259 bytes} [Sat Aug 27 05:03:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-240842740 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:03:42.091161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a451ce22-a5b5-41d3-8648-fc1b79e4d5e4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:42.096750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a451ce22-a5b5-41d3-8648-fc1b79e4d5e4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:42.127061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a451ce22-a5b5-41d3-8648-fc1b79e4d5e4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:42.127654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a451ce22-a5b5-41d3-8648-fc1b79e4d5e4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:42.131142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a451ce22-a5b5-41d3-8648-fc1b79e4d5e4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:42.135746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a451ce22-a5b5-41d3-8648-fc1b79e4d5e4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:42.137646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a451ce22-a5b5-41d3-8648-fc1b79e4d5e4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:42.138153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a451ce22-a5b5-41d3-8648-fc1b79e4d5e4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:42.365302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a451ce22-a5b5-41d3-8648-fc1b79e4d5e4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:42.378322 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a451ce22-a5b5-41d3-8648-fc1b79e4d5e4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1360 microversion: 2.1 time: 0.294937 Aug 27 05:03:42.381023 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2735/5523] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:42 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1360 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:43.404200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c3ed660-f714-42ae-bf0f-1a94082d6fe5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:43.405592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c3ed660-f714-42ae-bf0f-1a94082d6fe5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:43.413900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c3ed660-f714-42ae-bf0f-1a94082d6fe5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:43.415194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c3ed660-f714-42ae-bf0f-1a94082d6fe5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:43.415853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c3ed660-f714-42ae-bf0f-1a94082d6fe5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:43.416862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c3ed660-f714-42ae-bf0f-1a94082d6fe5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:43.417547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c3ed660-f714-42ae-bf0f-1a94082d6fe5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:43.418191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c3ed660-f714-42ae-bf0f-1a94082d6fe5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:43.512886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c3ed660-f714-42ae-bf0f-1a94082d6fe5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:43.530279 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c3ed660-f714-42ae-bf0f-1a94082d6fe5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1360 microversion: 2.1 time: 0.126323 Aug 27 05:03:43.537012 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2789/5524] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:43 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1360 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:43.751455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5360f5ab-360f-4a9f-aa70-e709ef53f4c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Action: 'create', calling method: .version_select at 0x7f1f20974670>, body: {"keypair": {"name": "tempest-keypair-134333275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK38p1H/qD/PLoHSYgYMxMkiJH8FPo2qBAzDiFaFnMlkMj0KpQA7/zhrtJYMnzYNw4M4qNebG4/TsBU31mcM85qa/nlVuUBSKtswiFUlFHlcrfkDuHDPLEQmMCUd7lTSgQ=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:43.775301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-5360f5ab-360f-4a9f-aa70-e709ef53f4c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Getting quotas for project 3d73cadd70ef45259dd85e6d59cbbab1. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:03:43.784051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-5360f5ab-360f-4a9f-aa70-e709ef53f4c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Getting quotas for user ec72122ff0b84c5fb558ca810ddd213d and project 3d73cadd70ef45259dd85e6d59cbbab1. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:03:43.838318 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5360f5ab-360f-4a9f-aa70-e709ef53f4c1 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.094414 Aug 27 05:03:43.840734 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2736/5525] 10.222.0.79 () {62 vars in 1200 bytes} [Sat Aug 27 05:03:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 05:03:44.551321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8085c0f0-c04e-4dcd-9686-0b7fbaf79d63 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:44.551994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8085c0f0-c04e-4dcd-9686-0b7fbaf79d63 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:44.567992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8085c0f0-c04e-4dcd-9686-0b7fbaf79d63 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:44.568512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8085c0f0-c04e-4dcd-9686-0b7fbaf79d63 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:44.572013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8085c0f0-c04e-4dcd-9686-0b7fbaf79d63 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:44.573219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8085c0f0-c04e-4dcd-9686-0b7fbaf79d63 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:44.576003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8085c0f0-c04e-4dcd-9686-0b7fbaf79d63 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:44.577127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8085c0f0-c04e-4dcd-9686-0b7fbaf79d63 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:44.981787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8085c0f0-c04e-4dcd-9686-0b7fbaf79d63 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:44.990818 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8085c0f0-c04e-4dcd-9686-0b7fbaf79d63 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1360 microversion: 2.1 time: 0.443439 Aug 27 05:03:44.999837 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2790/5526] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:44 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1360 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:46.012997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bffbf74a-678b-4a2a-b01c-f485f0a39fa3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:46.013753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bffbf74a-678b-4a2a-b01c-f485f0a39fa3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:46.039527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bffbf74a-678b-4a2a-b01c-f485f0a39fa3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:46.041309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bffbf74a-678b-4a2a-b01c-f485f0a39fa3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:46.042098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bffbf74a-678b-4a2a-b01c-f485f0a39fa3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:46.045030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bffbf74a-678b-4a2a-b01c-f485f0a39fa3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:46.045712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bffbf74a-678b-4a2a-b01c-f485f0a39fa3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:46.046396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bffbf74a-678b-4a2a-b01c-f485f0a39fa3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:46.193808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bffbf74a-678b-4a2a-b01c-f485f0a39fa3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:46.207425 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bffbf74a-678b-4a2a-b01c-f485f0a39fa3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1360 microversion: 2.1 time: 0.199464 Aug 27 05:03:46.208874 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2737/5527] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:46 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1360 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:46.255107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1834558863", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "abaf3479-bd4f-4f28-9f05-7c7e6c23c53c"}], "security_groups": [{"name": "tempest-securitygroup--1432871134"}], "key_name": "tempest-keypair-134333275", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:46.561701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] validate_networks() for [('abaf3479-bd4f-4f28-9f05-7c7e6c23c53c', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:03:47.214848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7acaae89-59b8-4d3c-87d8-d7d868e1eef2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:47.215440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7acaae89-59b8-4d3c-87d8-d7d868e1eef2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:47.229307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7acaae89-59b8-4d3c-87d8-d7d868e1eef2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:47.231502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7acaae89-59b8-4d3c-87d8-d7d868e1eef2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:47.232028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7acaae89-59b8-4d3c-87d8-d7d868e1eef2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:47.233248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7acaae89-59b8-4d3c-87d8-d7d868e1eef2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:47.234918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7acaae89-59b8-4d3c-87d8-d7d868e1eef2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:47.235547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7acaae89-59b8-4d3c-87d8-d7d868e1eef2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:47.272574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7acaae89-59b8-4d3c-87d8-d7d868e1eef2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:03:47.279572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:47.332573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:03:47.333127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:03:47.333597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:03:47.334272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:03:47.334781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:03:47.348833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:47.349483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:47.356752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:47.358614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:47.361028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:47.362033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:47.396820 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7acaae89-59b8-4d3c-87d8-d7d868e1eef2 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "DELETE /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 204 len: 0 microversion: 2.1 time: 0.186374 Aug 27 05:03:47.398177 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2738/5528] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:03:47 2022] DELETE /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:03:47.410239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Getting quotas for project 3d73cadd70ef45259dd85e6d59cbbab1. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:03:47.413092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e9d9a8c8-2688-4be0-a36c-de99bc6294ea tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:47.413816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e9d9a8c8-2688-4be0-a36c-de99bc6294ea tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:47.417283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Getting quotas for user ec72122ff0b84c5fb558ca810ddd213d and project 3d73cadd70ef45259dd85e6d59cbbab1. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:03:47.420581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9d9a8c8-2688-4be0-a36c-de99bc6294ea tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:47.421835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9d9a8c8-2688-4be0-a36c-de99bc6294ea tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:47.422461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9d9a8c8-2688-4be0-a36c-de99bc6294ea tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:47.423443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9d9a8c8-2688-4be0-a36c-de99bc6294ea tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:47.424085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9d9a8c8-2688-4be0-a36c-de99bc6294ea tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:47.424705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9d9a8c8-2688-4be0-a36c-de99bc6294ea tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:47.435608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:03:47.438989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:03:47.489377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:47.502789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e9d9a8c8-2688-4be0-a36c-de99bc6294ea tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:47.514185 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e9d9a8c8-2688-4be0-a36c-de99bc6294ea tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1360 microversion: 2.1 time: 0.114761 Aug 27 05:03:47.514785 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2739/5529] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:47 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1360 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:47.526896 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d82684a7-f818-4879-bc68-a1b9b5e8e8b3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.277118 Aug 27 05:03:47.528224 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2791/5530] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 05:03:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 05:03:47.530768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-30d7828d-ce84-4eaf-9cfb-50b4da944da7 req-80b93733-0a1d-4416-aaa5-8969593ed97b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63fd1673-2a84-4740-9748-f9d2d180a067", "tag": "479d2ba7-3e50-4a5f-bd9e-c5e2872feff5"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:47.533284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f9e9e6f-d0e8-4eee-904e-88312db4b3e3 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:47.534592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f9e9e6f-d0e8-4eee-904e-88312db4b3e3 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:47.548783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9e9e6f-d0e8-4eee-904e-88312db4b3e3 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:47.549538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9e9e6f-d0e8-4eee-904e-88312db4b3e3 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:47.551938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9e9e6f-d0e8-4eee-904e-88312db4b3e3 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:47.552899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9e9e6f-d0e8-4eee-904e-88312db4b3e3 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:47.555015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-30d7828d-ce84-4eaf-9cfb-50b4da944da7 req-80b93733-0a1d-4416-aaa5-8969593ed97b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:47.555501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-30d7828d-ce84-4eaf-9cfb-50b4da944da7 req-80b93733-0a1d-4416-aaa5-8969593ed97b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:47.556195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-30d7828d-ce84-4eaf-9cfb-50b4da944da7 req-80b93733-0a1d-4416-aaa5-8969593ed97b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:47.557687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9e9e6f-d0e8-4eee-904e-88312db4b3e3 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:47.558196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f9e9e6f-d0e8-4eee-904e-88312db4b3e3 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:47.590468 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-30d7828d-ce84-4eaf-9cfb-50b4da944da7 req-80b93733-0a1d-4416-aaa5-8969593ed97b service nova] Creating event network-changed:479d2ba7-3e50-4a5f-bd9e-c5e2872feff5 for instance 63fd1673-2a84-4740-9748-f9d2d180a067 on n-h2-854823-1 Aug 27 05:03:47.603181 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-30d7828d-ce84-4eaf-9cfb-50b4da944da7 req-80b93733-0a1d-4416-aaa5-8969593ed97b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078506 Aug 27 05:03:47.604043 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2740/5531] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:47.614322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6b024029-2b73-45f5-83ac-fe6e8cb2b662 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:47.618544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6b024029-2b73-45f5-83ac-fe6e8cb2b662 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:47.631785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:47.769498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6b024029-2b73-45f5-83ac-fe6e8cb2b662 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:47.777184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6b024029-2b73-45f5-83ac-fe6e8cb2b662 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:47.783481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6b024029-2b73-45f5-83ac-fe6e8cb2b662 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:47.786723 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6b024029-2b73-45f5-83ac-fe6e8cb2b662 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1281 microversion: 2.20 time: 0.180878 Aug 27 05:03:47.787325 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2741/5532] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:47 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1281 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:03:47.872628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f9e9e6f-d0e8-4eee-904e-88312db4b3e3 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:47.884279 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f9e9e6f-d0e8-4eee-904e-88312db4b3e3 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 200 len: 1767 microversion: 2.1 time: 0.353545 Aug 27 05:03:47.887313 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2792/5533] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:47 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 1767 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:48.538098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dc28fc72-b9b4-402c-9aff-bfb4aef02738 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:48.541082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dc28fc72-b9b4-402c-9aff-bfb4aef02738 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:48.552514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc28fc72-b9b4-402c-9aff-bfb4aef02738 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:48.553030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc28fc72-b9b4-402c-9aff-bfb4aef02738 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:48.553701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc28fc72-b9b4-402c-9aff-bfb4aef02738 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:48.573889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc28fc72-b9b4-402c-9aff-bfb4aef02738 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:48.574514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc28fc72-b9b4-402c-9aff-bfb4aef02738 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:48.576928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc28fc72-b9b4-402c-9aff-bfb4aef02738 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:48.747253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dc28fc72-b9b4-402c-9aff-bfb4aef02738 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:48.762696 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dc28fc72-b9b4-402c-9aff-bfb4aef02738 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 200 len: 1360 microversion: 2.1 time: 0.230439 Aug 27 05:03:48.777521 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2742/5534] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:48 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 1360 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:48.822849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5a3ceda-4e02-4360-a091-f4cd5a984b34 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:48.824612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d5a3ceda-4e02-4360-a091-f4cd5a984b34 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:48.839781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5a3ceda-4e02-4360-a091-f4cd5a984b34 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:48.840920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5a3ceda-4e02-4360-a091-f4cd5a984b34 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:48.841501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5a3ceda-4e02-4360-a091-f4cd5a984b34 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:48.842466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5a3ceda-4e02-4360-a091-f4cd5a984b34 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:48.856720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5a3ceda-4e02-4360-a091-f4cd5a984b34 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:48.870123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5a3ceda-4e02-4360-a091-f4cd5a984b34 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:48.913268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fdf387e4-b568-43a8-8958-cd9337959d1b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:48.914134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fdf387e4-b568-43a8-8958-cd9337959d1b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:48.923239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdf387e4-b568-43a8-8958-cd9337959d1b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:48.925964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdf387e4-b568-43a8-8958-cd9337959d1b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:48.929517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdf387e4-b568-43a8-8958-cd9337959d1b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:48.931704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdf387e4-b568-43a8-8958-cd9337959d1b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:48.933087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdf387e4-b568-43a8-8958-cd9337959d1b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:48.935850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdf387e4-b568-43a8-8958-cd9337959d1b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:49.127158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d5a3ceda-4e02-4360-a091-f4cd5a984b34 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:49.142474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d5a3ceda-4e02-4360-a091-f4cd5a984b34 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:49.146602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d5a3ceda-4e02-4360-a091-f4cd5a984b34 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:49.148132 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5a3ceda-4e02-4360-a091-f4cd5a984b34 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1333 microversion: 2.20 time: 0.330435 Aug 27 05:03:49.152004 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2793/5535] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:48 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1333 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:03:49.813894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-917ca1c7-4f56-45f2-b619-96987e11efe0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:49.814713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-917ca1c7-4f56-45f2-b619-96987e11efe0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:49.833766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-917ca1c7-4f56-45f2-b619-96987e11efe0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:49.840003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-917ca1c7-4f56-45f2-b619-96987e11efe0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:49.840727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-917ca1c7-4f56-45f2-b619-96987e11efe0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:49.842261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-917ca1c7-4f56-45f2-b619-96987e11efe0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:49.842854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-917ca1c7-4f56-45f2-b619-96987e11efe0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:49.846056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-917ca1c7-4f56-45f2-b619-96987e11efe0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:49.908734 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-917ca1c7-4f56-45f2-b619-96987e11efe0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-917ca1c7-4f56-45f2-b619-96987e11efe0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 HTTP/1.1 Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '5a1d6417-52c8-4ede-864c-c1afc2733a46'} Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:49.911260 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:49.915647 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:49.915647 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:49.915647 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:49.915647 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:49.915647 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:49.915647 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:03:49.915647 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:49.920493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-917ca1c7-4f56-45f2-b619-96987e11efe0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:49.923051 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-917ca1c7-4f56-45f2-b619-96987e11efe0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 404 len: 111 microversion: 2.1 time: 0.122309 Aug 27 05:03:49.929974 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2794/5536] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:49 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:50.429445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fdf387e4-b568-43a8-8958-cd9337959d1b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277ff8e295684cd18d8c9dd5130dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb264664558452095a2d83e8950dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:50.442026 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fdf387e4-b568-43a8-8958-cd9337959d1b tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 200 len: 1767 microversion: 2.1 time: 1.532957 Aug 27 05:03:50.443021 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2743/5537] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:48 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 1767 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:50.456749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f914b9b1-34eb-498b-af76-0f1a6ad9a864 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:50.457780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f914b9b1-34eb-498b-af76-0f1a6ad9a864 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:50.469188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f914b9b1-34eb-498b-af76-0f1a6ad9a864 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:50.471144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f914b9b1-34eb-498b-af76-0f1a6ad9a864 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:50.473156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f914b9b1-34eb-498b-af76-0f1a6ad9a864 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:50.473990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f914b9b1-34eb-498b-af76-0f1a6ad9a864 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:50.480710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f914b9b1-34eb-498b-af76-0f1a6ad9a864 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:50.480710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f914b9b1-34eb-498b-af76-0f1a6ad9a864 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:50.480920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-691b9267-40d9-4166-9f0a-66f2f15fb9cb req-ea913bb7-67c3-44a1-9021-f0561ded5ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63fd1673-2a84-4740-9748-f9d2d180a067", "name": "network-vif-deleted", "tag": "479d2ba7-3e50-4a5f-bd9e-c5e2872feff5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:50.497615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-691b9267-40d9-4166-9f0a-66f2f15fb9cb req-ea913bb7-67c3-44a1-9021-f0561ded5ced service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:50.498061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-691b9267-40d9-4166-9f0a-66f2f15fb9cb req-ea913bb7-67c3-44a1-9021-f0561ded5ced service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:50.498501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-691b9267-40d9-4166-9f0a-66f2f15fb9cb req-ea913bb7-67c3-44a1-9021-f0561ded5ced service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:50.534990 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-691b9267-40d9-4166-9f0a-66f2f15fb9cb req-ea913bb7-67c3-44a1-9021-f0561ded5ced service nova] Creating event network-vif-deleted:479d2ba7-3e50-4a5f-bd9e-c5e2872feff5 for instance 63fd1673-2a84-4740-9748-f9d2d180a067 on n-h2-854823-1 Aug 27 05:03:50.547220 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-691b9267-40d9-4166-9f0a-66f2f15fb9cb req-ea913bb7-67c3-44a1-9021-f0561ded5ced service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.389097 Aug 27 05:03:50.551887 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2795/5538] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:03:50.638715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f914b9b1-34eb-498b-af76-0f1a6ad9a864 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:50.659128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f914b9b1-34eb-498b-af76-0f1a6ad9a864 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:50.661758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f914b9b1-34eb-498b-af76-0f1a6ad9a864 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:50.663352 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f914b9b1-34eb-498b-af76-0f1a6ad9a864 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1339 microversion: 2.20 time: 0.219066 Aug 27 05:03:50.664134 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2744/5539] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:50 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1339 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:03:50.899900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f789daa5-e7f7-4d0f-ac77-3d3aca395e9d tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:50.901730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f789daa5-e7f7-4d0f-ac77-3d3aca395e9d tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:50.911871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f789daa5-e7f7-4d0f-ac77-3d3aca395e9d tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:50.912833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f789daa5-e7f7-4d0f-ac77-3d3aca395e9d tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:50.913563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f789daa5-e7f7-4d0f-ac77-3d3aca395e9d tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:50.915856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f789daa5-e7f7-4d0f-ac77-3d3aca395e9d tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:50.916618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f789daa5-e7f7-4d0f-ac77-3d3aca395e9d tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:50.917516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f789daa5-e7f7-4d0f-ac77-3d3aca395e9d tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:51.254833 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f789daa5-e7f7-4d0f-ac77-3d3aca395e9d tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1834 microversion: 2.1 time: 0.551244 Aug 27 05:03:51.264585 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2796/5540] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:50 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1834 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:51.276512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2f107511-6fca-4b33-8af1-e69aa6af6850 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:51.277711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2f107511-6fca-4b33-8af1-e69aa6af6850 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:51.286027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f107511-6fca-4b33-8af1-e69aa6af6850 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:51.286749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f107511-6fca-4b33-8af1-e69aa6af6850 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:51.287410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f107511-6fca-4b33-8af1-e69aa6af6850 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:51.288332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f107511-6fca-4b33-8af1-e69aa6af6850 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:51.288988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f107511-6fca-4b33-8af1-e69aa6af6850 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:51.289546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f107511-6fca-4b33-8af1-e69aa6af6850 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:51.467209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e87d8088-3850-44a6-8be9-e9edba9331de tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:51.468298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e87d8088-3850-44a6-8be9-e9edba9331de tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] [instance: 63fd1673-2a84-4740-9748-f9d2d180a067] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:51.485222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e87d8088-3850-44a6-8be9-e9edba9331de tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:51.488432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e87d8088-3850-44a6-8be9-e9edba9331de tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:51.490187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e87d8088-3850-44a6-8be9-e9edba9331de tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:51.491152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e87d8088-3850-44a6-8be9-e9edba9331de tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:51.493245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e87d8088-3850-44a6-8be9-e9edba9331de tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:51.503734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e87d8088-3850-44a6-8be9-e9edba9331de tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:51.573060 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e87d8088-3850-44a6-8be9-e9edba9331de tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] HTTP exception thrown: Instance 63fd1673-2a84-4740-9748-f9d2d180a067 could not be found. Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e87d8088-3850-44a6-8be9-e9edba9331de tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Request method failure captured: Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 HTTP/1.1 Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaU-gr0l4Ujty6nybKAak0VSHGJ2lRQSRuqS_QHNEJOICO8ebpnuL9z2ZVLwrlWRiq355ZTOhtsrmTRTthB3JxZsAvqyjqL-a7TgM_zt8YHzrNYUFVGEViOKmDjmb-uXvHYmtEyBKnYkV1bcU-6JDFsivo53jifFyy3kkljLUOgT87M Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 5cb264664558452095a2d83e8950dbeb Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-522704998 Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cb264664558452095a2d83e8950dbeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cb264664558452095a2d83e8950dbeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cb264664558452095a2d83e8950dbeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cb264664558452095a2d83e8950dbeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestSecurityGroupsBasicOps-522704998 Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 5cb264664558452095a2d83e8950dbeb Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-522704998 Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestSecurityGroupsBasicOps-522704998-project Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 277ff8e295684cd18d8c9dd5130dde1d Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestSecurityGroupsBasicOps-522704998-project Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 63fd1673-2a84-4740-9748-f9d2d180a067 could not be found. Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '63fd1673-2a84-4740-9748-f9d2d180a067'} Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63fd1673-2a84-4740-9748-f9d2d180a067 could not be found. Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63fd1673-2a84-4740-9748-f9d2d180a067 could not be found. Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:03:51.583402 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:51.589117 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:03:51.589117 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:03:51.589117 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:03:51.589117 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:03:51.589117 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:03:51.589117 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63fd1673-2a84-4740-9748-f9d2d180a067 could not be found. Aug 27 05:03:51.589117 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:03:51.592398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e87d8088-3850-44a6-8be9-e9edba9331de tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Returning 404 to user: Instance 63fd1673-2a84-4740-9748-f9d2d180a067 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:03:51.596892 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e87d8088-3850-44a6-8be9-e9edba9331de tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067" status: 404 len: 111 microversion: 2.1 time: 0.131449 Aug 27 05:03:51.597588 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2797/5541] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:51 2022] GET /compute/v2.1/servers/63fd1673-2a84-4740-9748-f9d2d180a067 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:51.646793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2f107511-6fca-4b33-8af1-e69aa6af6850 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:51.667764 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2f107511-6fca-4b33-8af1-e69aa6af6850 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1683 microversion: 2.1 time: 0.395355 Aug 27 05:03:51.670905 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2745/5542] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:51 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1683 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:51.697813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d962612b-b9c0-4704-8990-94af603642f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:51.698593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d962612b-b9c0-4704-8990-94af603642f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:51.709744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d962612b-b9c0-4704-8990-94af603642f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:51.710270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d962612b-b9c0-4704-8990-94af603642f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:51.710730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d962612b-b9c0-4704-8990-94af603642f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:51.711478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d962612b-b9c0-4704-8990-94af603642f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:51.712030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d962612b-b9c0-4704-8990-94af603642f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:51.722387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d962612b-b9c0-4704-8990-94af603642f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:52.032977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c532248d-5432-4d32-9778-1bac84ef31cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:52.036055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c532248d-5432-4d32-9778-1bac84ef31cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:52.064571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c532248d-5432-4d32-9778-1bac84ef31cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:52.066609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c532248d-5432-4d32-9778-1bac84ef31cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:52.067867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c532248d-5432-4d32-9778-1bac84ef31cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:52.076789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c532248d-5432-4d32-9778-1bac84ef31cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:52.077390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c532248d-5432-4d32-9778-1bac84ef31cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:52.077847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c532248d-5432-4d32-9778-1bac84ef31cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:52.172792 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c532248d-5432-4d32-9778-1bac84ef31cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c/action" status: 200 len: 32636 microversion: 2.1 time: 0.152597 Aug 27 05:03:52.173602 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2746/5543] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:03:52 2022] POST /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c/action => generated 32636 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 05:03:52.327425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4ab88522-d456-4ab2-a93e-709c9c5cab11 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:52.327744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4ab88522-d456-4ab2-a93e-709c9c5cab11 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:52.340937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ab88522-d456-4ab2-a93e-709c9c5cab11 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:52.343517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ab88522-d456-4ab2-a93e-709c9c5cab11 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:52.345132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ab88522-d456-4ab2-a93e-709c9c5cab11 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:52.345884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ab88522-d456-4ab2-a93e-709c9c5cab11 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:52.348115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ab88522-d456-4ab2-a93e-709c9c5cab11 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:52.348576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4ab88522-d456-4ab2-a93e-709c9c5cab11 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:52.456323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d962612b-b9c0-4704-8990-94af603642f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:52.468877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d962612b-b9c0-4704-8990-94af603642f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:52.478001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d962612b-b9c0-4704-8990-94af603642f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:52.483018 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d962612b-b9c0-4704-8990-94af603642f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1407 microversion: 2.20 time: 0.789864 Aug 27 05:03:52.505500 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2798/5544] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:51 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1407 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:03:52.728083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4ab88522-d456-4ab2-a93e-709c9c5cab11 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1d0bee9b3c074da39665365d6c5a4416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1649548b654371a5fc4f04ee9c1763', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:52.728895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4ab88522-d456-4ab2-a93e-709c9c5cab11 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] flavor_id is None. Assuming migration. {{(pid=128870) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 05:03:52.729342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4ab88522-d456-4ab2-a93e-709c9c5cab11 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128870) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:03:53.286599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-880b969a-7101-47f8-b89a-b6fc180d2ba8 req-321f23bc-0411-4cfb-97f9-c2f151758a7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf34f382-9b01-4519-ba5f-78471ee22e32", "tag": "7a1ec75a-2f7a-416e-b884-5870283eafe6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:03:53.296839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-880b969a-7101-47f8-b89a-b6fc180d2ba8 req-321f23bc-0411-4cfb-97f9-c2f151758a7c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:53.297340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-880b969a-7101-47f8-b89a-b6fc180d2ba8 req-321f23bc-0411-4cfb-97f9-c2f151758a7c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:53.297787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-880b969a-7101-47f8-b89a-b6fc180d2ba8 req-321f23bc-0411-4cfb-97f9-c2f151758a7c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:53.333068 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-880b969a-7101-47f8-b89a-b6fc180d2ba8 req-321f23bc-0411-4cfb-97f9-c2f151758a7c service nova] Creating event network-changed:7a1ec75a-2f7a-416e-b884-5870283eafe6 for instance bf34f382-9b01-4519-ba5f-78471ee22e32 on n-h1-854823-1 Aug 27 05:03:53.347052 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-880b969a-7101-47f8-b89a-b6fc180d2ba8 req-321f23bc-0411-4cfb-97f9-c2f151758a7c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.291819 Aug 27 05:03:53.348193 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2799/5545] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:03:53.514810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-582ed2b8-29bd-47bd-865b-47ae3a4463f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:53.516485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-582ed2b8-29bd-47bd-865b-47ae3a4463f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:53.530120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-582ed2b8-29bd-47bd-865b-47ae3a4463f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:53.531502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-582ed2b8-29bd-47bd-865b-47ae3a4463f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:53.533670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-582ed2b8-29bd-47bd-865b-47ae3a4463f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:53.534700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-582ed2b8-29bd-47bd-865b-47ae3a4463f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:53.536571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-582ed2b8-29bd-47bd-865b-47ae3a4463f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:53.538007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-582ed2b8-29bd-47bd-865b-47ae3a4463f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:53.572187 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4ab88522-d456-4ab2-a93e-709c9c5cab11 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c/action" status: 202 len: 0 microversion: 2.1 time: 1.248981 Aug 27 05:03:53.574755 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2747/5546] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:03:52 2022] POST /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c/action => generated 0 bytes in 1254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:03:53.593578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6f164742-f79c-4711-8d46-ff2dc4c4148f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:53.618138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6f164742-f79c-4711-8d46-ff2dc4c4148f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:53.633738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f164742-f79c-4711-8d46-ff2dc4c4148f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:53.634250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f164742-f79c-4711-8d46-ff2dc4c4148f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:53.634692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f164742-f79c-4711-8d46-ff2dc4c4148f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:53.639260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f164742-f79c-4711-8d46-ff2dc4c4148f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:53.639851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f164742-f79c-4711-8d46-ff2dc4c4148f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:53.648353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f164742-f79c-4711-8d46-ff2dc4c4148f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:54.010339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6f164742-f79c-4711-8d46-ff2dc4c4148f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:54.034800 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6f164742-f79c-4711-8d46-ff2dc4c4148f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1692 microversion: 2.1 time: 0.448372 Aug 27 05:03:54.037531 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2748/5547] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:53 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1692 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:54.247119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-582ed2b8-29bd-47bd-865b-47ae3a4463f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:54.278389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-582ed2b8-29bd-47bd-865b-47ae3a4463f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:54.306201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-582ed2b8-29bd-47bd-865b-47ae3a4463f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:54.307863 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-582ed2b8-29bd-47bd-865b-47ae3a4463f5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1407 microversion: 2.20 time: 0.798194 Aug 27 05:03:54.308572 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2800/5548] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:53 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1407 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:03:54.325852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bfe30e3d-8d02-4b82-b684-3e56843e6416 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:54.327830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bfe30e3d-8d02-4b82-b684-3e56843e6416 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:54.338695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe30e3d-8d02-4b82-b684-3e56843e6416 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:54.340018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe30e3d-8d02-4b82-b684-3e56843e6416 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:54.340963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe30e3d-8d02-4b82-b684-3e56843e6416 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:54.341849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe30e3d-8d02-4b82-b684-3e56843e6416 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:54.342542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe30e3d-8d02-4b82-b684-3e56843e6416 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:54.343837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe30e3d-8d02-4b82-b684-3e56843e6416 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:54.529113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-bfe30e3d-8d02-4b82-b684-3e56843e6416 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lazy-loading 'services' on Instance uuid d523dbe1-c9f5-4c99-bbe6-36b3f458be7a {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:03:54.725647 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bfe30e3d-8d02-4b82-b684-3e56843e6416 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a/os-volume_attachments/3c5fa0d9-c302-48fe-abc9-233c51ecfe11" status: 202 len: 0 microversion: 2.1 time: 0.403755 Aug 27 05:03:54.727243 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2749/5549] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:03:54 2022] DELETE /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a/os-volume_attachments/3c5fa0d9-c302-48fe-abc9-233c51ecfe11 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:03:55.058467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b482ac7a-73ea-4191-91fc-3bb62f229ef9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:55.059091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b482ac7a-73ea-4191-91fc-3bb62f229ef9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:55.074062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b482ac7a-73ea-4191-91fc-3bb62f229ef9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:55.079289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b482ac7a-73ea-4191-91fc-3bb62f229ef9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:55.080157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b482ac7a-73ea-4191-91fc-3bb62f229ef9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:55.080995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b482ac7a-73ea-4191-91fc-3bb62f229ef9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:55.084295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b482ac7a-73ea-4191-91fc-3bb62f229ef9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:55.084803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b482ac7a-73ea-4191-91fc-3bb62f229ef9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:55.146122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:55.334634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-abee72cf-49b9-413c-935d-12271de0d7a5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:55.335356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-abee72cf-49b9-413c-935d-12271de0d7a5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:55.360164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abee72cf-49b9-413c-935d-12271de0d7a5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:55.362670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abee72cf-49b9-413c-935d-12271de0d7a5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:55.365544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abee72cf-49b9-413c-935d-12271de0d7a5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:55.366534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abee72cf-49b9-413c-935d-12271de0d7a5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:55.371068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abee72cf-49b9-413c-935d-12271de0d7a5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:55.372661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abee72cf-49b9-413c-935d-12271de0d7a5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:55.656360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-abee72cf-49b9-413c-935d-12271de0d7a5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:55.667792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-abee72cf-49b9-413c-935d-12271de0d7a5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:55.673858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-abee72cf-49b9-413c-935d-12271de0d7a5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:55.675099 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-abee72cf-49b9-413c-935d-12271de0d7a5 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1407 microversion: 2.20 time: 0.346984 Aug 27 05:03:55.675678 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2750/5550] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:55 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:03:56.056648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b482ac7a-73ea-4191-91fc-3bb62f229ef9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:56.070706 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b482ac7a-73ea-4191-91fc-3bb62f229ef9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1692 microversion: 2.1 time: 1.011809 Aug 27 05:03:56.072972 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2801/5551] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:55 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1692 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:56.700801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b0445e5f-31a7-4d60-bf6e-a39fc1a06e23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:56.702812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b0445e5f-31a7-4d60-bf6e-a39fc1a06e23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:56.720053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0445e5f-31a7-4d60-bf6e-a39fc1a06e23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:56.722159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0445e5f-31a7-4d60-bf6e-a39fc1a06e23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:56.722678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0445e5f-31a7-4d60-bf6e-a39fc1a06e23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:56.725260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0445e5f-31a7-4d60-bf6e-a39fc1a06e23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:56.725962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0445e5f-31a7-4d60-bf6e-a39fc1a06e23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:56.727391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b0445e5f-31a7-4d60-bf6e-a39fc1a06e23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:56.749331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73d497c6-fa6c-4e2c-bc02-59b0e31954b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:56.751451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73d497c6-fa6c-4e2c-bc02-59b0e31954b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:56.760371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73d497c6-fa6c-4e2c-bc02-59b0e31954b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:56.765756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73d497c6-fa6c-4e2c-bc02-59b0e31954b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:56.766617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73d497c6-fa6c-4e2c-bc02-59b0e31954b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:56.767538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73d497c6-fa6c-4e2c-bc02-59b0e31954b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:56.768175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73d497c6-fa6c-4e2c-bc02-59b0e31954b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:56.769445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73d497c6-fa6c-4e2c-bc02-59b0e31954b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:56.847994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73d497c6-fa6c-4e2c-bc02-59b0e31954b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:03:56.977598 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-73d497c6-fa6c-4e2c-bc02-59b0e31954b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 204 len: 0 microversion: 2.1 time: 0.233551 Aug 27 05:03:56.980458 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2802/5552] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:03:56 2022] DELETE /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:03:56.992924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18b8f0a0-0a87-465f-96a2-8340e9b32c3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:56.993887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18b8f0a0-0a87-465f-96a2-8340e9b32c3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:57.001506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18b8f0a0-0a87-465f-96a2-8340e9b32c3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:57.002744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18b8f0a0-0a87-465f-96a2-8340e9b32c3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:57.003398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18b8f0a0-0a87-465f-96a2-8340e9b32c3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:57.005194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18b8f0a0-0a87-465f-96a2-8340e9b32c3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:57.006298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18b8f0a0-0a87-465f-96a2-8340e9b32c3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:57.007002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18b8f0a0-0a87-465f-96a2-8340e9b32c3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:57.166338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b0445e5f-31a7-4d60-bf6e-a39fc1a06e23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:57.184122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b0445e5f-31a7-4d60-bf6e-a39fc1a06e23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:57.185836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b0445e5f-31a7-4d60-bf6e-a39fc1a06e23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:57.187014 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b0445e5f-31a7-4d60-bf6e-a39fc1a06e23 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1407 microversion: 2.20 time: 0.492002 Aug 27 05:03:57.187888 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2751/5553] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:56 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:03:57.215733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-10167dfb-ecba-4728-92f2-3da1f5a966e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:57.216375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-10167dfb-ecba-4728-92f2-3da1f5a966e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:57.227693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10167dfb-ecba-4728-92f2-3da1f5a966e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:57.228206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10167dfb-ecba-4728-92f2-3da1f5a966e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:57.228686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10167dfb-ecba-4728-92f2-3da1f5a966e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:57.229412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10167dfb-ecba-4728-92f2-3da1f5a966e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:57.234143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10167dfb-ecba-4728-92f2-3da1f5a966e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:57.234606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10167dfb-ecba-4728-92f2-3da1f5a966e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:57.245568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18b8f0a0-0a87-465f-96a2-8340e9b32c3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:57.255670 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18b8f0a0-0a87-465f-96a2-8340e9b32c3a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1410 microversion: 2.1 time: 0.271292 Aug 27 05:03:57.269771 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2803/5554] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:56 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1410 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:03:57.490271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10167dfb-ecba-4728-92f2-3da1f5a966e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:57.505576 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-10167dfb-ecba-4728-92f2-3da1f5a966e6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1692 microversion: 2.1 time: 0.315859 Aug 27 05:03:57.506594 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2752/5555] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:57 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1692 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:58.213481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d887d33e-7be0-4abf-8ab7-c7cba392e61a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:58.214323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d887d33e-7be0-4abf-8ab7-c7cba392e61a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:58.216366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:58.217546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:58.225562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d887d33e-7be0-4abf-8ab7-c7cba392e61a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:58.226307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d887d33e-7be0-4abf-8ab7-c7cba392e61a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:58.226930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d887d33e-7be0-4abf-8ab7-c7cba392e61a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:58.227771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d887d33e-7be0-4abf-8ab7-c7cba392e61a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:58.228234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d887d33e-7be0-4abf-8ab7-c7cba392e61a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:58.228701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d887d33e-7be0-4abf-8ab7-c7cba392e61a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:58.279172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99cc6ddb-ce95-4dc6-ba37-3e8c45b3697e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:58.280170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-99cc6ddb-ce95-4dc6-ba37-3e8c45b3697e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:58.287932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:58.306392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99cc6ddb-ce95-4dc6-ba37-3e8c45b3697e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:58.306952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99cc6ddb-ce95-4dc6-ba37-3e8c45b3697e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:58.307406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99cc6ddb-ce95-4dc6-ba37-3e8c45b3697e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:58.308234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99cc6ddb-ce95-4dc6-ba37-3e8c45b3697e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:58.308859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99cc6ddb-ce95-4dc6-ba37-3e8c45b3697e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:58.309449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99cc6ddb-ce95-4dc6-ba37-3e8c45b3697e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:58.328581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:58.499975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-99cc6ddb-ce95-4dc6-ba37-3e8c45b3697e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:58.537672 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-99cc6ddb-ce95-4dc6-ba37-3e8c45b3697e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1410 microversion: 2.1 time: 0.263659 Aug 27 05:03:58.541879 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2753/5556] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:58 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1410 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:58.552291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4274191e-2c33-4c2c-b5d2-cc08f22cd306 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:58.553188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4274191e-2c33-4c2c-b5d2-cc08f22cd306 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:58.563902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4274191e-2c33-4c2c-b5d2-cc08f22cd306 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:58.564415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4274191e-2c33-4c2c-b5d2-cc08f22cd306 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:58.564891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4274191e-2c33-4c2c-b5d2-cc08f22cd306 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:58.566655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4274191e-2c33-4c2c-b5d2-cc08f22cd306 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:58.567150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4274191e-2c33-4c2c-b5d2-cc08f22cd306 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:58.567591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4274191e-2c33-4c2c-b5d2-cc08f22cd306 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:58.578239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d887d33e-7be0-4abf-8ab7-c7cba392e61a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:58.590849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d887d33e-7be0-4abf-8ab7-c7cba392e61a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:58.600810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d887d33e-7be0-4abf-8ab7-c7cba392e61a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:58.602470 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d887d33e-7be0-4abf-8ab7-c7cba392e61a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1407 microversion: 2.20 time: 0.393741 Aug 27 05:03:58.603600 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2804/5557] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:58 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:03:58.654097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8fc02723-0b6e-4cc2-a14b-13521cfe8341 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] Calling method '.version_select at 0x7f1f20442280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:58.721761 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8fc02723-0b6e-4cc2-a14b-13521cfe8341 tempest-TestSecurityGroupsBasicOps-522704998 tempest-TestSecurityGroupsBasicOps-522704998-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1414090982" status: 202 len: 0 microversion: 2.1 time: 0.071810 Aug 27 05:03:58.722715 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2805/5558] 10.222.0.79 () {58 vars in 1278 bytes} [Sat Aug 27 05:03:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1414090982 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:03:58.950560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4274191e-2c33-4c2c-b5d2-cc08f22cd306 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:58.962277 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4274191e-2c33-4c2c-b5d2-cc08f22cd306 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1692 microversion: 2.1 time: 0.419245 Aug 27 05:03:58.963301 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2754/5559] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:58 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1692 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:03:59.565256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-533d923c-8287-4a0d-946f-2604f44fafe4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:59.566603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-533d923c-8287-4a0d-946f-2604f44fafe4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:59.580264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-533d923c-8287-4a0d-946f-2604f44fafe4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:59.583025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-533d923c-8287-4a0d-946f-2604f44fafe4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:59.583802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-533d923c-8287-4a0d-946f-2604f44fafe4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:59.584909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-533d923c-8287-4a0d-946f-2604f44fafe4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:59.587970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-533d923c-8287-4a0d-946f-2604f44fafe4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:59.589218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-533d923c-8287-4a0d-946f-2604f44fafe4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:59.631911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7b90e91c-97fb-4928-8806-55b630f24b6a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:03:59.633573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7b90e91c-97fb-4928-8806-55b630f24b6a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:03:59.643707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b90e91c-97fb-4928-8806-55b630f24b6a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:59.644106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b90e91c-97fb-4928-8806-55b630f24b6a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:59.644590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b90e91c-97fb-4928-8806-55b630f24b6a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:59.645980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b90e91c-97fb-4928-8806-55b630f24b6a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:03:59.647440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b90e91c-97fb-4928-8806-55b630f24b6a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:03:59.648067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b90e91c-97fb-4928-8806-55b630f24b6a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:03:59.971109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-533d923c-8287-4a0d-946f-2604f44fafe4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:03:59.985445 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-533d923c-8287-4a0d-946f-2604f44fafe4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1410 microversion: 2.1 time: 0.427299 Aug 27 05:04:00.012624 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2806/5560] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:03:59 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1410 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:00.017789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-532df40d-98c5-4748-ba86-bc8224afe600 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:00.019237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-532df40d-98c5-4748-ba86-bc8224afe600 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:00.032951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-532df40d-98c5-4748-ba86-bc8224afe600 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:00.035843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-532df40d-98c5-4748-ba86-bc8224afe600 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:00.037871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-532df40d-98c5-4748-ba86-bc8224afe600 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:00.038635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-532df40d-98c5-4748-ba86-bc8224afe600 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:00.042045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-532df40d-98c5-4748-ba86-bc8224afe600 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:00.042749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-532df40d-98c5-4748-ba86-bc8224afe600 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:00.430993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b90e91c-97fb-4928-8806-55b630f24b6a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:00.443940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b90e91c-97fb-4928-8806-55b630f24b6a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:00.447266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b90e91c-97fb-4928-8806-55b630f24b6a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:00.452725 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7b90e91c-97fb-4928-8806-55b630f24b6a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1407 microversion: 2.20 time: 0.825087 Aug 27 05:04:00.454023 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2755/5561] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:03:59 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1407 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:04:00.534373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-46e31247-ff3e-4235-9169-c0f9c298dee8 req-486afe21-19ba-49f1-8083-80b9e26cb1ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf34f382-9b01-4519-ba5f-78471ee22e32", "name": "network-vif-plugged", "status": "completed", "tag": "7a1ec75a-2f7a-416e-b884-5870283eafe6"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:00.553245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-46e31247-ff3e-4235-9169-c0f9c298dee8 req-486afe21-19ba-49f1-8083-80b9e26cb1ce service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:00.554456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-46e31247-ff3e-4235-9169-c0f9c298dee8 req-486afe21-19ba-49f1-8083-80b9e26cb1ce service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:00.557257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-46e31247-ff3e-4235-9169-c0f9c298dee8 req-486afe21-19ba-49f1-8083-80b9e26cb1ce service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:00.582521 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-46e31247-ff3e-4235-9169-c0f9c298dee8 req-486afe21-19ba-49f1-8083-80b9e26cb1ce service nova] Creating event network-vif-plugged:7a1ec75a-2f7a-416e-b884-5870283eafe6 for instance bf34f382-9b01-4519-ba5f-78471ee22e32 on n-h1-854823-1 Aug 27 05:04:00.592385 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-46e31247-ff3e-4235-9169-c0f9c298dee8 req-486afe21-19ba-49f1-8083-80b9e26cb1ce service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061631 Aug 27 05:04:00.600212 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2756/5562] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:04:00.742346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-532df40d-98c5-4748-ba86-bc8224afe600 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:00.757654 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-532df40d-98c5-4748-ba86-bc8224afe600 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1692 microversion: 2.1 time: 0.742706 Aug 27 05:04:00.775859 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2807/5563] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:00 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1692 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:00.962381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-b8b4f2f9-af53-44cf-a638-b9aac5656c14 req-367a3b88-a716-4fd7-b08e-4c81fde62281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38", "name": "network-vif-deleted", "tag": "fafeac18-7f47-48f7-9544-4ab5fee53c4c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:00.973965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b8b4f2f9-af53-44cf-a638-b9aac5656c14 req-367a3b88-a716-4fd7-b08e-4c81fde62281 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:00.974789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b8b4f2f9-af53-44cf-a638-b9aac5656c14 req-367a3b88-a716-4fd7-b08e-4c81fde62281 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:00.975587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b8b4f2f9-af53-44cf-a638-b9aac5656c14 req-367a3b88-a716-4fd7-b08e-4c81fde62281 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:00.991209 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b8b4f2f9-af53-44cf-a638-b9aac5656c14 req-367a3b88-a716-4fd7-b08e-4c81fde62281 service nova] Creating event network-vif-deleted:fafeac18-7f47-48f7-9544-4ab5fee53c4c for instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 on n-h1-854823-1 Aug 27 05:04:00.997106 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-b8b4f2f9-af53-44cf-a638-b9aac5656c14 req-367a3b88-a716-4fd7-b08e-4c81fde62281 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041302 Aug 27 05:04:00.998133 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2757/5564] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:01.008122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc6072b3-cbe7-4311-bb44-6ff8abc5a8ac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:01.009114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bc6072b3-cbe7-4311-bb44-6ff8abc5a8ac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:01.017600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc6072b3-cbe7-4311-bb44-6ff8abc5a8ac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:01.018832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc6072b3-cbe7-4311-bb44-6ff8abc5a8ac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:01.021088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc6072b3-cbe7-4311-bb44-6ff8abc5a8ac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:01.022815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc6072b3-cbe7-4311-bb44-6ff8abc5a8ac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:01.023413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc6072b3-cbe7-4311-bb44-6ff8abc5a8ac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:01.024372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc6072b3-cbe7-4311-bb44-6ff8abc5a8ac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:01.096098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bc6072b3-cbe7-4311-bb44-6ff8abc5a8ac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:01.131945 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc6072b3-cbe7-4311-bb44-6ff8abc5a8ac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1368 microversion: 2.1 time: 0.126373 Aug 27 05:04:01.134522 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2808/5565] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:01 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1368 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:01.480049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2a10a19f-286e-451b-a4fb-9649c7a7714f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:01.480754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2a10a19f-286e-451b-a4fb-9649c7a7714f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:01.490906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a10a19f-286e-451b-a4fb-9649c7a7714f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:01.493791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a10a19f-286e-451b-a4fb-9649c7a7714f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:01.494248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a10a19f-286e-451b-a4fb-9649c7a7714f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:01.497080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a10a19f-286e-451b-a4fb-9649c7a7714f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:01.499762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a10a19f-286e-451b-a4fb-9649c7a7714f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:01.500287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a10a19f-286e-451b-a4fb-9649c7a7714f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:01.662804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a10a19f-286e-451b-a4fb-9649c7a7714f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:01.678391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a10a19f-286e-451b-a4fb-9649c7a7714f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:01.680842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a10a19f-286e-451b-a4fb-9649c7a7714f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:01.683022 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2a10a19f-286e-451b-a4fb-9649c7a7714f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1407 microversion: 2.20 time: 0.207765 Aug 27 05:04:01.684323 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2758/5566] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:01 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:01.780283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eea8446c-ffd4-4575-ba36-3a1ecfae0946 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:01.781826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eea8446c-ffd4-4575-ba36-3a1ecfae0946 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:01.792810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea8446c-ffd4-4575-ba36-3a1ecfae0946 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:01.793326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea8446c-ffd4-4575-ba36-3a1ecfae0946 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:01.793774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea8446c-ffd4-4575-ba36-3a1ecfae0946 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:01.794749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea8446c-ffd4-4575-ba36-3a1ecfae0946 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:01.795342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea8446c-ffd4-4575-ba36-3a1ecfae0946 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:01.796616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea8446c-ffd4-4575-ba36-3a1ecfae0946 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:02.104672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eea8446c-ffd4-4575-ba36-3a1ecfae0946 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:02.119186 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eea8446c-ffd4-4575-ba36-3a1ecfae0946 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1697 microversion: 2.1 time: 0.343658 Aug 27 05:04:02.124207 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2809/5567] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:01 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1697 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:02.158263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c6a0fb5c-ca00-4bfa-a50c-b19d8e9c2429 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:02.159527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c6a0fb5c-ca00-4bfa-a50c-b19d8e9c2429 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:02.175270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6a0fb5c-ca00-4bfa-a50c-b19d8e9c2429 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:02.183482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6a0fb5c-ca00-4bfa-a50c-b19d8e9c2429 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:02.184221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6a0fb5c-ca00-4bfa-a50c-b19d8e9c2429 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:02.185194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6a0fb5c-ca00-4bfa-a50c-b19d8e9c2429 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:02.185856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6a0fb5c-ca00-4bfa-a50c-b19d8e9c2429 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:02.186552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6a0fb5c-ca00-4bfa-a50c-b19d8e9c2429 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:02.322789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c6a0fb5c-ca00-4bfa-a50c-b19d8e9c2429 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:02.334170 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c6a0fb5c-ca00-4bfa-a50c-b19d8e9c2429 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1202 microversion: 2.1 time: 0.180303 Aug 27 05:04:02.336710 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2759/5568] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:02 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1202 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:02.709976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac686227-8ae3-400b-901a-fe07b2fc6248 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:02.710717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac686227-8ae3-400b-901a-fe07b2fc6248 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:02.718217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac686227-8ae3-400b-901a-fe07b2fc6248 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:02.720638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac686227-8ae3-400b-901a-fe07b2fc6248 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:02.721486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac686227-8ae3-400b-901a-fe07b2fc6248 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:02.722504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac686227-8ae3-400b-901a-fe07b2fc6248 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:02.725037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac686227-8ae3-400b-901a-fe07b2fc6248 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:02.725577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac686227-8ae3-400b-901a-fe07b2fc6248 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:02.886712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac686227-8ae3-400b-901a-fe07b2fc6248 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:02.901699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac686227-8ae3-400b-901a-fe07b2fc6248 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:02.904823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac686227-8ae3-400b-901a-fe07b2fc6248 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:02.907342 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac686227-8ae3-400b-901a-fe07b2fc6248 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1599 microversion: 2.20 time: 0.203030 Aug 27 05:04:02.916995 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2810/5569] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:02 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:02.941673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-924d8b64-0a4f-4717-9895-8dd9b99efeea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:02.942413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-924d8b64-0a4f-4717-9895-8dd9b99efeea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:02.948848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-924d8b64-0a4f-4717-9895-8dd9b99efeea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:02.949446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-924d8b64-0a4f-4717-9895-8dd9b99efeea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:02.949879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-924d8b64-0a4f-4717-9895-8dd9b99efeea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:02.950624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-924d8b64-0a4f-4717-9895-8dd9b99efeea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:02.951075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-924d8b64-0a4f-4717-9895-8dd9b99efeea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:02.951494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-924d8b64-0a4f-4717-9895-8dd9b99efeea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:03.040368 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-924d8b64-0a4f-4717-9895-8dd9b99efeea tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102743 Aug 27 05:04:03.041533 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2760/5570] 10.222.0.79 () {60 vars in 1316 bytes} [Sat Aug 27 05:04:02 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:04:03.159326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37f30b98-124b-4b1a-860d-0ae7fce589c2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:03.160363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37f30b98-124b-4b1a-860d-0ae7fce589c2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:03.167221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f30b98-124b-4b1a-860d-0ae7fce589c2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:03.168384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f30b98-124b-4b1a-860d-0ae7fce589c2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:03.168961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f30b98-124b-4b1a-860d-0ae7fce589c2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:03.169929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f30b98-124b-4b1a-860d-0ae7fce589c2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:03.171316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f30b98-124b-4b1a-860d-0ae7fce589c2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:03.171858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f30b98-124b-4b1a-860d-0ae7fce589c2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:03.348250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-37f30b98-124b-4b1a-860d-0ae7fce589c2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:03.361408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-deb57ee1-9de1-4003-a07f-a6bfdbb751ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:03.363531 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37f30b98-124b-4b1a-860d-0ae7fce589c2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1697 microversion: 2.1 time: 0.207718 Aug 27 05:04:03.364782 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2811/5571] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:03 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1697 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:03.372699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-deb57ee1-9de1-4003-a07f-a6bfdbb751ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:03.391672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-deb57ee1-9de1-4003-a07f-a6bfdbb751ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:03.392786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-deb57ee1-9de1-4003-a07f-a6bfdbb751ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:03.393778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-deb57ee1-9de1-4003-a07f-a6bfdbb751ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:03.395385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-deb57ee1-9de1-4003-a07f-a6bfdbb751ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:03.396295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-deb57ee1-9de1-4003-a07f-a6bfdbb751ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:03.397020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-deb57ee1-9de1-4003-a07f-a6bfdbb751ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:03.719109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-deb57ee1-9de1-4003-a07f-a6bfdbb751ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:03.728900 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-deb57ee1-9de1-4003-a07f-a6bfdbb751ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1202 microversion: 2.1 time: 0.375946 Aug 27 05:04:03.729949 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2761/5572] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:03 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1202 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:04.390220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94be3fa0-23c6-452a-ba3e-0ca82fe5029e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:04.391086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94be3fa0-23c6-452a-ba3e-0ca82fe5029e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:04.399441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94be3fa0-23c6-452a-ba3e-0ca82fe5029e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:04.400114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94be3fa0-23c6-452a-ba3e-0ca82fe5029e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:04.400919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94be3fa0-23c6-452a-ba3e-0ca82fe5029e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:04.401716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94be3fa0-23c6-452a-ba3e-0ca82fe5029e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:04.402317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94be3fa0-23c6-452a-ba3e-0ca82fe5029e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:04.402899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94be3fa0-23c6-452a-ba3e-0ca82fe5029e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:04.503511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-c1e6aec8-e551-4890-98eb-d81298e4264a req-238ee754-6334-4317-ad8f-0a4403e7a59f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf34f382-9b01-4519-ba5f-78471ee22e32", "tag": "7a1ec75a-2f7a-416e-b884-5870283eafe6"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:04.525352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c1e6aec8-e551-4890-98eb-d81298e4264a req-238ee754-6334-4317-ad8f-0a4403e7a59f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:04.526188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c1e6aec8-e551-4890-98eb-d81298e4264a req-238ee754-6334-4317-ad8f-0a4403e7a59f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:04.526843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c1e6aec8-e551-4890-98eb-d81298e4264a req-238ee754-6334-4317-ad8f-0a4403e7a59f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:04.540627 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-c1e6aec8-e551-4890-98eb-d81298e4264a req-238ee754-6334-4317-ad8f-0a4403e7a59f service nova] Creating event network-changed:7a1ec75a-2f7a-416e-b884-5870283eafe6 for instance bf34f382-9b01-4519-ba5f-78471ee22e32 on n-h1-854823-1 Aug 27 05:04:04.546812 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-c1e6aec8-e551-4890-98eb-d81298e4264a req-238ee754-6334-4317-ad8f-0a4403e7a59f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048302 Aug 27 05:04:04.551566 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2762/5573] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:04.694147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94be3fa0-23c6-452a-ba3e-0ca82fe5029e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:04.705590 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94be3fa0-23c6-452a-ba3e-0ca82fe5029e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1697 microversion: 2.1 time: 0.317863 Aug 27 05:04:04.720250 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2812/5574] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:04 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1697 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:04.753419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3b80cfc0-1031-4dd6-ac51-1b16969c91d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:04.754125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3b80cfc0-1031-4dd6-ac51-1b16969c91d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:04.769061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b80cfc0-1031-4dd6-ac51-1b16969c91d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:04.771774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b80cfc0-1031-4dd6-ac51-1b16969c91d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:04.772317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b80cfc0-1031-4dd6-ac51-1b16969c91d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:04.773161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b80cfc0-1031-4dd6-ac51-1b16969c91d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:04.777305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b80cfc0-1031-4dd6-ac51-1b16969c91d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:04.780815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3b80cfc0-1031-4dd6-ac51-1b16969c91d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:04.910807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3b80cfc0-1031-4dd6-ac51-1b16969c91d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:04.928643 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3b80cfc0-1031-4dd6-ac51-1b16969c91d7 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1202 microversion: 2.1 time: 0.175430 Aug 27 05:04:04.929812 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2763/5575] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:04 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1202 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:05.134666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-00361a44-796e-438f-9edc-57a4aac475d9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:05.135199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-00361a44-796e-438f-9edc-57a4aac475d9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:05.146680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00361a44-796e-438f-9edc-57a4aac475d9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:05.149852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00361a44-796e-438f-9edc-57a4aac475d9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:05.154167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00361a44-796e-438f-9edc-57a4aac475d9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:05.156799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00361a44-796e-438f-9edc-57a4aac475d9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:05.157660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00361a44-796e-438f-9edc-57a4aac475d9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:05.158862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00361a44-796e-438f-9edc-57a4aac475d9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:05.195572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-00361a44-796e-438f-9edc-57a4aac475d9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:04:05.352642 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-00361a44-796e-438f-9edc-57a4aac475d9 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 204 len: 0 microversion: 2.1 time: 0.222043 Aug 27 05:04:05.353583 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2813/5576] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:04:05 2022] DELETE /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:04:05.364593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6df3fd84-5f40-4fec-ad91-f99b26450983 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:05.365609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6df3fd84-5f40-4fec-ad91-f99b26450983 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:05.376642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6df3fd84-5f40-4fec-ad91-f99b26450983 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:05.377283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6df3fd84-5f40-4fec-ad91-f99b26450983 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:05.378151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6df3fd84-5f40-4fec-ad91-f99b26450983 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:05.378922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6df3fd84-5f40-4fec-ad91-f99b26450983 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:05.379686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6df3fd84-5f40-4fec-ad91-f99b26450983 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:05.380357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6df3fd84-5f40-4fec-ad91-f99b26450983 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:05.593103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6df3fd84-5f40-4fec-ad91-f99b26450983 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:05.609846 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6df3fd84-5f40-4fec-ad91-f99b26450983 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 200 len: 1514 microversion: 2.1 time: 0.251927 Aug 27 05:04:05.623946 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2764/5577] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:05 2022] GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 1514 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:05.728013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1d5a8c7-80da-478f-a4e1-e11f8531da6b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:05.729588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1d5a8c7-80da-478f-a4e1-e11f8531da6b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:05.736691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d5a8c7-80da-478f-a4e1-e11f8531da6b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:05.737390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d5a8c7-80da-478f-a4e1-e11f8531da6b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:05.738039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d5a8c7-80da-478f-a4e1-e11f8531da6b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:05.739211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d5a8c7-80da-478f-a4e1-e11f8531da6b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:05.739852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d5a8c7-80da-478f-a4e1-e11f8531da6b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:05.740486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d5a8c7-80da-478f-a4e1-e11f8531da6b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:05.950056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b2a97dc7-bc40-4742-b29b-4b97e13dd8ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:05.951294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b2a97dc7-bc40-4742-b29b-4b97e13dd8ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:05.956876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1d5a8c7-80da-478f-a4e1-e11f8531da6b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:05.960093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2a97dc7-bc40-4742-b29b-4b97e13dd8ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:05.963884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2a97dc7-bc40-4742-b29b-4b97e13dd8ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:05.965655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2a97dc7-bc40-4742-b29b-4b97e13dd8ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:05.966584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2a97dc7-bc40-4742-b29b-4b97e13dd8ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:05.968030 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1d5a8c7-80da-478f-a4e1-e11f8531da6b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1697 microversion: 2.1 time: 0.243337 Aug 27 05:04:05.969176 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2814/5578] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:05 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1697 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:05.973205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2a97dc7-bc40-4742-b29b-4b97e13dd8ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:05.973667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2a97dc7-bc40-4742-b29b-4b97e13dd8ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:06.047534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b2a97dc7-bc40-4742-b29b-4b97e13dd8ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:06.055971 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b2a97dc7-bc40-4742-b29b-4b97e13dd8ab tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1202 microversion: 2.1 time: 0.109729 Aug 27 05:04:06.057716 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2765/5579] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:05 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1202 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:06.631209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-390751a6-e4a1-46c1-a23c-020ffb59ad10 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:06.631834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-390751a6-e4a1-46c1-a23c-020ffb59ad10 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:06.638073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-390751a6-e4a1-46c1-a23c-020ffb59ad10 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:06.638588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-390751a6-e4a1-46c1-a23c-020ffb59ad10 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:06.639044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-390751a6-e4a1-46c1-a23c-020ffb59ad10 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:06.640288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-390751a6-e4a1-46c1-a23c-020ffb59ad10 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:06.640953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-390751a6-e4a1-46c1-a23c-020ffb59ad10 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:06.641555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-390751a6-e4a1-46c1-a23c-020ffb59ad10 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:06.875970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-390751a6-e4a1-46c1-a23c-020ffb59ad10 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:06.879557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:06.884257 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-390751a6-e4a1-46c1-a23c-020ffb59ad10 tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 200 len: 1514 microversion: 2.1 time: 0.257037 Aug 27 05:04:06.884880 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2815/5580] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:06 2022] GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:06.990067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3c9f0050-a2c0-4267-9c3c-47c043fa8a05 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:06.990784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3c9f0050-a2c0-4267-9c3c-47c043fa8a05 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:07.001942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c9f0050-a2c0-4267-9c3c-47c043fa8a05 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:07.002877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c9f0050-a2c0-4267-9c3c-47c043fa8a05 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:07.003925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c9f0050-a2c0-4267-9c3c-47c043fa8a05 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:07.005634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c9f0050-a2c0-4267-9c3c-47c043fa8a05 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:07.006848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c9f0050-a2c0-4267-9c3c-47c043fa8a05 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:07.008111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c9f0050-a2c0-4267-9c3c-47c043fa8a05 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:07.080599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79c57fe8-df62-4ab5-a612-4c3514041259 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:07.082032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-79c57fe8-df62-4ab5-a612-4c3514041259 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:07.093788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79c57fe8-df62-4ab5-a612-4c3514041259 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:07.094397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79c57fe8-df62-4ab5-a612-4c3514041259 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:07.095388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79c57fe8-df62-4ab5-a612-4c3514041259 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:07.096645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79c57fe8-df62-4ab5-a612-4c3514041259 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:07.097202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79c57fe8-df62-4ab5-a612-4c3514041259 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:07.098317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79c57fe8-df62-4ab5-a612-4c3514041259 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:07.180342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-79c57fe8-df62-4ab5-a612-4c3514041259 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:07.187301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3c9f0050-a2c0-4267-9c3c-47c043fa8a05 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:07.191126 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-79c57fe8-df62-4ab5-a612-4c3514041259 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1202 microversion: 2.1 time: 0.116156 Aug 27 05:04:07.204778 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2816/5581] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:07 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1202 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:07.204880 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3c9f0050-a2c0-4267-9c3c-47c043fa8a05 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1697 microversion: 2.1 time: 0.211927 Aug 27 05:04:07.204880 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2766/5582] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:06 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1697 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:08.021262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f953deeb-9119-4700-9c99-7cf81d366bab tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:08.024238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f953deeb-9119-4700-9c99-7cf81d366bab tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:08.036689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f953deeb-9119-4700-9c99-7cf81d366bab tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:08.038124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f953deeb-9119-4700-9c99-7cf81d366bab tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:08.039068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f953deeb-9119-4700-9c99-7cf81d366bab tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:08.040085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f953deeb-9119-4700-9c99-7cf81d366bab tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:08.040932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f953deeb-9119-4700-9c99-7cf81d366bab tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:08.045167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f953deeb-9119-4700-9c99-7cf81d366bab tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:08.226331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6d19be3d-d9e2-4540-b6ab-55971261aa06 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:08.229301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6d19be3d-d9e2-4540-b6ab-55971261aa06 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:08.247213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d19be3d-d9e2-4540-b6ab-55971261aa06 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:08.247979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d19be3d-d9e2-4540-b6ab-55971261aa06 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:08.249971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d19be3d-d9e2-4540-b6ab-55971261aa06 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:08.251977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d19be3d-d9e2-4540-b6ab-55971261aa06 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:08.252423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d19be3d-d9e2-4540-b6ab-55971261aa06 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:08.253035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d19be3d-d9e2-4540-b6ab-55971261aa06 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:08.322284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f953deeb-9119-4700-9c99-7cf81d366bab tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b1048ffa264ff4abdf91994f0d66a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96da74018b7846f79741bf8f15b22ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:08.336851 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f953deeb-9119-4700-9c99-7cf81d366bab tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 200 len: 1514 microversion: 2.1 time: 0.322888 Aug 27 05:04:08.337458 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2817/5583] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:08 2022] GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 1514 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:08.351466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d32a03e2-3ae3-40c6-b69e-ca2b5e0fe6be tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:08.351466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d32a03e2-3ae3-40c6-b69e-ca2b5e0fe6be tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:08.372259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d32a03e2-3ae3-40c6-b69e-ca2b5e0fe6be tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:08.373069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d32a03e2-3ae3-40c6-b69e-ca2b5e0fe6be tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:08.377247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d32a03e2-3ae3-40c6-b69e-ca2b5e0fe6be tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:08.377247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d32a03e2-3ae3-40c6-b69e-ca2b5e0fe6be tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:08.377247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d32a03e2-3ae3-40c6-b69e-ca2b5e0fe6be tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:08.380280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d32a03e2-3ae3-40c6-b69e-ca2b5e0fe6be tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:08.388416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6d19be3d-d9e2-4540-b6ab-55971261aa06 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:08.405106 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6d19be3d-d9e2-4540-b6ab-55971261aa06 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1202 microversion: 2.1 time: 0.194841 Aug 27 05:04:08.406125 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2767/5584] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:08 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1202 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:08.412259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-c3e83821-6849-4f09-b961-86c1751907f3 req-2b7bd2cf-5652-4372-ace7-554dad63f807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d523dbe1-c9f5-4c99-bbe6-36b3f458be7a", "name": "network-vif-deleted", "tag": "e6fe9c87-1bef-4dd9-b9d3-d67d5a6e39a1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:08.426879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c3e83821-6849-4f09-b961-86c1751907f3 req-2b7bd2cf-5652-4372-ace7-554dad63f807 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:08.427475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c3e83821-6849-4f09-b961-86c1751907f3 req-2b7bd2cf-5652-4372-ace7-554dad63f807 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:08.427969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c3e83821-6849-4f09-b961-86c1751907f3 req-2b7bd2cf-5652-4372-ace7-554dad63f807 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:08.450152 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-c3e83821-6849-4f09-b961-86c1751907f3 req-2b7bd2cf-5652-4372-ace7-554dad63f807 service nova] Creating event network-vif-deleted:e6fe9c87-1bef-4dd9-b9d3-d67d5a6e39a1 for instance d523dbe1-c9f5-4c99-bbe6-36b3f458be7a on n-h1-854823-1 Aug 27 05:04:08.459094 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-c3e83821-6849-4f09-b961-86c1751907f3 req-2b7bd2cf-5652-4372-ace7-554dad63f807 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050246 Aug 27 05:04:08.460152 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2768/5585] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:08.568503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d32a03e2-3ae3-40c6-b69e-ca2b5e0fe6be tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:08.579613 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d32a03e2-3ae3-40c6-b69e-ca2b5e0fe6be tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1697 microversion: 2.1 time: 0.235630 Aug 27 05:04:08.581148 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2818/5586] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:08 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1697 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:09.362374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ed3a9c7-e913-48c4-b3d5-d037f142c46a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:09.363709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1ed3a9c7-e913-48c4-b3d5-d037f142c46a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] [instance: d523dbe1-c9f5-4c99-bbe6-36b3f458be7a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:09.374216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ed3a9c7-e913-48c4-b3d5-d037f142c46a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:09.375722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ed3a9c7-e913-48c4-b3d5-d037f142c46a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:09.376600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ed3a9c7-e913-48c4-b3d5-d037f142c46a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:09.377540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ed3a9c7-e913-48c4-b3d5-d037f142c46a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:09.378209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ed3a9c7-e913-48c4-b3d5-d037f142c46a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:09.378862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ed3a9c7-e913-48c4-b3d5-d037f142c46a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:09.393847 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-1ed3a9c7-e913-48c4-b3d5-d037f142c46a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] HTTP exception thrown: Instance d523dbe1-c9f5-4c99-bbe6-36b3f458be7a could not be found. Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ed3a9c7-e913-48c4-b3d5-d037f142c46a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Request method failure captured: Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a HTTP/1.1 Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaSkQdWmuDdjr-XV46C0CsVlteLi8W8qZ2QYwYaAuw9Z6qj-qD18m93IWxV36EJWgjherngsddyASXWkbEIobsORLHzWPNkPWMcMOGNdOIv-_w_LDkZWSpUwTqisafReMTMCUgMIQ1f0Fz2tzATT04qmb8Dwt8XLio-lf0DxNHiSy6s Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 96da74018b7846f79741bf8f15b22ae9 Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1005291699 Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/96da74018b7846f79741bf8f15b22ae9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_96da74018b7846f79741bf8f15b22ae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/96da74018b7846f79741bf8f15b22ae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/96da74018b7846f79741bf8f15b22ae9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-VolumesSnapshotTestJSON-1005291699 Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 96da74018b7846f79741bf8f15b22ae9 Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1005291699 Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-VolumesSnapshotTestJSON-1005291699-project Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: d5b1048ffa264ff4abdf91994f0d66a1 Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-VolumesSnapshotTestJSON-1005291699-project Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance d523dbe1-c9f5-4c99-bbe6-36b3f458be7a could not be found. Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'd523dbe1-c9f5-4c99-bbe6-36b3f458be7a'} Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d523dbe1-c9f5-4c99-bbe6-36b3f458be7a could not be found. Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d523dbe1-c9f5-4c99-bbe6-36b3f458be7a could not be found. Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:09.396561 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:09.400733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:09.400733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:09.400733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:09.400733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:09.400733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:09.400733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d523dbe1-c9f5-4c99-bbe6-36b3f458be7a could not be found. Aug 27 05:04:09.400733 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:09.402838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ed3a9c7-e913-48c4-b3d5-d037f142c46a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] Returning 404 to user: Instance d523dbe1-c9f5-4c99-bbe6-36b3f458be7a could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:09.404014 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1ed3a9c7-e913-48c4-b3d5-d037f142c46a tempest-VolumesSnapshotTestJSON-1005291699 tempest-VolumesSnapshotTestJSON-1005291699-project] 10.222.0.79 "GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a" status: 404 len: 111 microversion: 2.1 time: 0.047250 Aug 27 05:04:09.404930 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2769/5587] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:09 2022] GET /compute/v2.1/servers/d523dbe1-c9f5-4c99-bbe6-36b3f458be7a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:04:09.428364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98f1b801-fc41-4451-bfe6-61c591bd1507 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:09.439477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98f1b801-fc41-4451-bfe6-61c591bd1507 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:09.463586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98f1b801-fc41-4451-bfe6-61c591bd1507 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:09.466786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98f1b801-fc41-4451-bfe6-61c591bd1507 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:09.467545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98f1b801-fc41-4451-bfe6-61c591bd1507 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:09.468545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98f1b801-fc41-4451-bfe6-61c591bd1507 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:09.471535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98f1b801-fc41-4451-bfe6-61c591bd1507 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:09.471992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98f1b801-fc41-4451-bfe6-61c591bd1507 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:09.608683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3cc7dc04-637e-451c-9da6-4009f2beab64 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:09.611854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3cc7dc04-637e-451c-9da6-4009f2beab64 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:09.616438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-98f1b801-fc41-4451-bfe6-61c591bd1507 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:09.627397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cc7dc04-637e-451c-9da6-4009f2beab64 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:09.627895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cc7dc04-637e-451c-9da6-4009f2beab64 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:09.631720 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98f1b801-fc41-4451-bfe6-61c591bd1507 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1202 microversion: 2.1 time: 0.207407 Aug 27 05:04:09.645349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cc7dc04-637e-451c-9da6-4009f2beab64 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:09.645349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cc7dc04-637e-451c-9da6-4009f2beab64 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:09.645349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cc7dc04-637e-451c-9da6-4009f2beab64 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:09.645349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cc7dc04-637e-451c-9da6-4009f2beab64 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:09.645743 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2819/5588] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:09 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1202 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:09.964097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3cc7dc04-637e-451c-9da6-4009f2beab64 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:09.973129 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3cc7dc04-637e-451c-9da6-4009f2beab64 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1697 microversion: 2.1 time: 0.374951 Aug 27 05:04:09.977410 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2770/5589] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:09 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1697 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:10.659388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-060c36f4-4aac-462e-a171-1782f5debf91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:10.660045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-060c36f4-4aac-462e-a171-1782f5debf91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:10.674328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-060c36f4-4aac-462e-a171-1782f5debf91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:10.678228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-060c36f4-4aac-462e-a171-1782f5debf91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:10.678448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-060c36f4-4aac-462e-a171-1782f5debf91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:10.680118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-060c36f4-4aac-462e-a171-1782f5debf91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:10.682280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-060c36f4-4aac-462e-a171-1782f5debf91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:10.683623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-060c36f4-4aac-462e-a171-1782f5debf91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:10.769398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-060c36f4-4aac-462e-a171-1782f5debf91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:10.774597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-060c36f4-4aac-462e-a171-1782f5debf91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:10.775427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-060c36f4-4aac-462e-a171-1782f5debf91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:10.776127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-060c36f4-4aac-462e-a171-1782f5debf91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lazy-loading 'fault' on Instance uuid a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:04:10.845118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-060c36f4-4aac-462e-a171-1782f5debf91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:10.856503 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-060c36f4-4aac-462e-a171-1782f5debf91 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 200 len: 1161 microversion: 2.1 time: 0.203241 Aug 27 05:04:10.857320 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2820/5590] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:10 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 1161 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:10.997917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8db09a48-dd94-4e39-b222-99aff4f8375b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:10.998754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8db09a48-dd94-4e39-b222-99aff4f8375b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:11.029255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8db09a48-dd94-4e39-b222-99aff4f8375b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:11.031238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8db09a48-dd94-4e39-b222-99aff4f8375b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:11.032118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8db09a48-dd94-4e39-b222-99aff4f8375b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:11.033574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8db09a48-dd94-4e39-b222-99aff4f8375b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:11.034376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8db09a48-dd94-4e39-b222-99aff4f8375b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:11.035178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8db09a48-dd94-4e39-b222-99aff4f8375b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:11.448464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8db09a48-dd94-4e39-b222-99aff4f8375b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:11.458009 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8db09a48-dd94-4e39-b222-99aff4f8375b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1697 microversion: 2.1 time: 0.466662 Aug 27 05:04:11.459167 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2771/5591] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:10 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1697 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:11.880040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcd443d2-97d4-43d9-a720-47ed39b315ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:11.880776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fcd443d2-97d4-43d9-a720-47ed39b315ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:11.893531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcd443d2-97d4-43d9-a720-47ed39b315ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:11.896802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcd443d2-97d4-43d9-a720-47ed39b315ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:11.896802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcd443d2-97d4-43d9-a720-47ed39b315ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:11.896802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcd443d2-97d4-43d9-a720-47ed39b315ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:11.896802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcd443d2-97d4-43d9-a720-47ed39b315ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:11.905212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcd443d2-97d4-43d9-a720-47ed39b315ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:11.931214 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-fcd443d2-97d4-43d9-a720-47ed39b315ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcd443d2-97d4-43d9-a720-47ed39b315ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 HTTP/1.1 Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38'} Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:11.935001 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:11.941728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:11.941728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:11.941728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:11.941728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:11.941728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:11.941728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:11.941728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:11.941728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcd443d2-97d4-43d9-a720-47ed39b315ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:11.941728 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fcd443d2-97d4-43d9-a720-47ed39b315ef tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 404 len: 111 microversion: 2.1 time: 0.063399 Aug 27 05:04:11.955692 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2821/5592] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:11 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:04:12.491908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a3c8dc0b-55cc-42d6-8fde-50ca508fd338 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:12.493816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a3c8dc0b-55cc-42d6-8fde-50ca508fd338 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:12.503503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3c8dc0b-55cc-42d6-8fde-50ca508fd338 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:12.504257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3c8dc0b-55cc-42d6-8fde-50ca508fd338 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:12.504960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3c8dc0b-55cc-42d6-8fde-50ca508fd338 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:12.505965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3c8dc0b-55cc-42d6-8fde-50ca508fd338 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:12.506958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3c8dc0b-55cc-42d6-8fde-50ca508fd338 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:12.507685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3c8dc0b-55cc-42d6-8fde-50ca508fd338 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:12.843265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a3c8dc0b-55cc-42d6-8fde-50ca508fd338 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:12.858527 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a3c8dc0b-55cc-42d6-8fde-50ca508fd338 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1697 microversion: 2.1 time: 0.381638 Aug 27 05:04:12.868560 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2772/5593] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:12 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1697 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:13.884929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1210dd23-1a41-488b-8d3f-1e95ba8d586a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:13.889527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1210dd23-1a41-488b-8d3f-1e95ba8d586a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:13.897907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1210dd23-1a41-488b-8d3f-1e95ba8d586a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:13.898712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1210dd23-1a41-488b-8d3f-1e95ba8d586a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:13.899135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1210dd23-1a41-488b-8d3f-1e95ba8d586a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:13.899856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1210dd23-1a41-488b-8d3f-1e95ba8d586a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:13.900325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1210dd23-1a41-488b-8d3f-1e95ba8d586a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:13.900822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1210dd23-1a41-488b-8d3f-1e95ba8d586a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:14.158782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-abe3f592-6e80-448d-a787-6026039ae74e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:14.159386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-abe3f592-6e80-448d-a787-6026039ae74e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:14.167262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abe3f592-6e80-448d-a787-6026039ae74e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:14.167774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abe3f592-6e80-448d-a787-6026039ae74e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:14.168423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abe3f592-6e80-448d-a787-6026039ae74e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:14.169362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abe3f592-6e80-448d-a787-6026039ae74e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:14.170078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abe3f592-6e80-448d-a787-6026039ae74e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:14.170733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abe3f592-6e80-448d-a787-6026039ae74e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:14.195361 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-abe3f592-6e80-448d-a787-6026039ae74e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-abe3f592-6e80-448d-a787-6026039ae74e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 HTTP/1.1 Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '5a1d6417-52c8-4ede-864c-c1afc2733a46'} Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:04:14.197176 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:04:14.202762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:04:14.202762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:14.202762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:14.202762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:14.202762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:14.202762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:14.202762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:14.202762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:14.202762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:14.202762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:04:14.202762 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:14.202762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-abe3f592-6e80-448d-a787-6026039ae74e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:14.213275 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-abe3f592-6e80-448d-a787-6026039ae74e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 404 len: 111 microversion: 2.1 time: 0.047786 Aug 27 05:04:14.218135 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2773/5594] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:04:14 2022] DELETE /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:04:14.224398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5bf368a0-c8fd-4a9b-84fe-2ea183f09f5c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:14.226615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5bf368a0-c8fd-4a9b-84fe-2ea183f09f5c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 5a1d6417-52c8-4ede-864c-c1afc2733a46] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:14.247274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bf368a0-c8fd-4a9b-84fe-2ea183f09f5c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:14.253578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bf368a0-c8fd-4a9b-84fe-2ea183f09f5c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:14.254663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bf368a0-c8fd-4a9b-84fe-2ea183f09f5c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:14.255653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bf368a0-c8fd-4a9b-84fe-2ea183f09f5c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:14.256333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bf368a0-c8fd-4a9b-84fe-2ea183f09f5c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:14.256979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bf368a0-c8fd-4a9b-84fe-2ea183f09f5c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:14.277664 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-5bf368a0-c8fd-4a9b-84fe-2ea183f09f5c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5bf368a0-c8fd-4a9b-84fe-2ea183f09f5c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 HTTP/1.1 Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '5a1d6417-52c8-4ede-864c-c1afc2733a46'} Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:14.280634 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:14.285313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:14.285313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:14.285313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:14.285313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:14.285313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:14.285313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. Aug 27 05:04:14.285313 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:14.285856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5bf368a0-c8fd-4a9b-84fe-2ea183f09f5c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance 5a1d6417-52c8-4ede-864c-c1afc2733a46 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:14.287275 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5bf368a0-c8fd-4a9b-84fe-2ea183f09f5c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46" status: 404 len: 111 microversion: 2.1 time: 0.066750 Aug 27 05:04:14.287275 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2774/5595] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:14 2022] GET /compute/v2.1/servers/5a1d6417-52c8-4ede-864c-c1afc2733a46 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:04:14.316711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1210dd23-1a41-488b-8d3f-1e95ba8d586a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:14.325864 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1210dd23-1a41-488b-8d3f-1e95ba8d586a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1697 microversion: 2.1 time: 0.444543 Aug 27 05:04:14.326081 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2822/5596] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:13 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1697 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:15.210177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-56150c9f-d97d-4541-9031-fcebec318ed9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:15.211418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-56150c9f-d97d-4541-9031-fcebec318ed9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:15.225364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56150c9f-d97d-4541-9031-fcebec318ed9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:15.225893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56150c9f-d97d-4541-9031-fcebec318ed9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:15.228177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56150c9f-d97d-4541-9031-fcebec318ed9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:15.236688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56150c9f-d97d-4541-9031-fcebec318ed9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:15.237241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56150c9f-d97d-4541-9031-fcebec318ed9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:15.237724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56150c9f-d97d-4541-9031-fcebec318ed9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:15.253561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:15.265939 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-56150c9f-d97d-4541-9031-fcebec318ed9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-56150c9f-d97d-4541-9031-fcebec318ed9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 HTTP/1.1 Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38'} Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:04:15.268661 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:04:15.273348 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:15.273348 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:15.273348 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:15.273348 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:15.273348 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:15.273348 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:15.273348 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:15.273348 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:15.273348 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:15.273348 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:15.273348 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:15.273348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-56150c9f-d97d-4541-9031-fcebec318ed9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:15.273348 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-56150c9f-d97d-4541-9031-fcebec318ed9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 404 len: 111 microversion: 2.1 time: 0.065739 Aug 27 05:04:15.273348 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2775/5597] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:04:15 2022] DELETE /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:04:15.279939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76d96e76-0760-4d84-a6a3-177b8090770c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:15.280675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76d96e76-0760-4d84-a6a3-177b8090770c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:15.290594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d96e76-0760-4d84-a6a3-177b8090770c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:15.291458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d96e76-0760-4d84-a6a3-177b8090770c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:15.292336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d96e76-0760-4d84-a6a3-177b8090770c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:15.293918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d96e76-0760-4d84-a6a3-177b8090770c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:15.294797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d96e76-0760-4d84-a6a3-177b8090770c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:15.296147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d96e76-0760-4d84-a6a3-177b8090770c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:15.315177 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-76d96e76-0760-4d84-a6a3-177b8090770c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76d96e76-0760-4d84-a6a3-177b8090770c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 HTTP/1.1 Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38'} Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:15.318060 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:15.322332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:15.322332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:15.322332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:15.322332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:15.322332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:15.322332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. Aug 27 05:04:15.322332 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:15.324095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76d96e76-0760-4d84-a6a3-177b8090770c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:15.325242 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76d96e76-0760-4d84-a6a3-177b8090770c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38" status: 404 len: 111 microversion: 2.1 time: 0.050029 Aug 27 05:04:15.330266 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2823/5598] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:15 2022] GET /compute/v2.1/servers/a2d73442-cfbb-4ee7-8bf9-7790ad7b6a38 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:04:15.354040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-faee5a5e-afb7-4fd0-9a48-4de5fb10f465 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:15.354865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-faee5a5e-afb7-4fd0-9a48-4de5fb10f465 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:15.363439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-faee5a5e-afb7-4fd0-9a48-4de5fb10f465 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:15.364066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-faee5a5e-afb7-4fd0-9a48-4de5fb10f465 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:15.364685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-faee5a5e-afb7-4fd0-9a48-4de5fb10f465 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:15.365516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-faee5a5e-afb7-4fd0-9a48-4de5fb10f465 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:15.366046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-faee5a5e-afb7-4fd0-9a48-4de5fb10f465 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:15.366593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-faee5a5e-afb7-4fd0-9a48-4de5fb10f465 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:15.446284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba397cee-64e9-4831-b509-939a55fa7cf5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Action: 'create', calling method: .version_select at 0x7f1f204ae0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1893726088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkdKkRrjqAA4zowXx7R1/uOXn0rtQF2+C6GPIecsxzQ+LVfyGQBQ4eaP2Yne9EwiuTPSPMJ7lEeVcxj44M24s0NPP2vuRPyuLkST+WAQM1I52OUcWxmid9lJO6cg9QN1Q=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:15.465249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ba397cee-64e9-4831-b509-939a55fa7cf5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:15.472914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ba397cee-64e9-4831-b509-939a55fa7cf5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for user 8376c4e2cf814a8b8b1e2a8e404b0187 and project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:15.521633 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba397cee-64e9-4831-b509-939a55fa7cf5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.081637 Aug 27 05:04:15.522976 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2824/5599] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:04:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:15.608182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-faee5a5e-afb7-4fd0-9a48-4de5fb10f465 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:15.618179 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-faee5a5e-afb7-4fd0-9a48-4de5fb10f465 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1697 microversion: 2.1 time: 0.270658 Aug 27 05:04:15.622433 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2776/5600] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:15 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1697 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:16.642942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bfc722bb-b3e0-4b47-ad6e-d06c2f70e858 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:16.644352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bfc722bb-b3e0-4b47-ad6e-d06c2f70e858 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:16.652922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfc722bb-b3e0-4b47-ad6e-d06c2f70e858 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:16.653493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfc722bb-b3e0-4b47-ad6e-d06c2f70e858 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:16.653931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfc722bb-b3e0-4b47-ad6e-d06c2f70e858 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:16.655408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfc722bb-b3e0-4b47-ad6e-d06c2f70e858 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:16.655799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfc722bb-b3e0-4b47-ad6e-d06c2f70e858 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:16.657203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfc722bb-b3e0-4b47-ad6e-d06c2f70e858 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:16.860375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bfc722bb-b3e0-4b47-ad6e-d06c2f70e858 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:16.881651 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bfc722bb-b3e0-4b47-ad6e-d06c2f70e858 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1697 microversion: 2.1 time: 0.243189 Aug 27 05:04:16.887960 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2825/5601] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:16 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1697 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:17.909643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f64aeba3-2e1a-44df-94ac-0778d7b80370 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:17.910899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f64aeba3-2e1a-44df-94ac-0778d7b80370 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:17.914200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=76 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:17.927507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f64aeba3-2e1a-44df-94ac-0778d7b80370 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:17.929020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f64aeba3-2e1a-44df-94ac-0778d7b80370 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:17.931230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f64aeba3-2e1a-44df-94ac-0778d7b80370 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:17.933714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f64aeba3-2e1a-44df-94ac-0778d7b80370 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:17.937576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f64aeba3-2e1a-44df-94ac-0778d7b80370 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:17.939492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f64aeba3-2e1a-44df-94ac-0778d7b80370 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:18.192096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f64aeba3-2e1a-44df-94ac-0778d7b80370 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:18.202618 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f64aeba3-2e1a-44df-94ac-0778d7b80370 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1697 microversion: 2.1 time: 0.297046 Aug 27 05:04:18.216355 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2777/5602] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:17 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1697 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:18.338089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1808f53d-d097-4abf-acf1-c62a1063d4d6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:18.338649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1808f53d-d097-4abf-acf1-c62a1063d4d6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:18.349580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:18.351455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1808f53d-d097-4abf-acf1-c62a1063d4d6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:18.352288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1808f53d-d097-4abf-acf1-c62a1063d4d6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:18.357218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1808f53d-d097-4abf-acf1-c62a1063d4d6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:18.359673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1808f53d-d097-4abf-acf1-c62a1063d4d6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:18.363474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1808f53d-d097-4abf-acf1-c62a1063d4d6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:18.363894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1808f53d-d097-4abf-acf1-c62a1063d4d6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:18.448855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1808f53d-d097-4abf-acf1-c62a1063d4d6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:04:18.577871 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1808f53d-d097-4abf-acf1-c62a1063d4d6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 204 len: 0 microversion: 2.42 time: 0.622776 Aug 27 05:04:18.587537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef4144e6-c545-4cdb-bd96-3d3ae3596349 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:18.588483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ef4144e6-c545-4cdb-bd96-3d3ae3596349 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:18.596881 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2826/5603] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 05:04:17 2022] DELETE /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 05:04:18.599473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef4144e6-c545-4cdb-bd96-3d3ae3596349 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:18.600211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef4144e6-c545-4cdb-bd96-3d3ae3596349 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:18.600980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef4144e6-c545-4cdb-bd96-3d3ae3596349 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:18.602008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef4144e6-c545-4cdb-bd96-3d3ae3596349 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:18.606057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef4144e6-c545-4cdb-bd96-3d3ae3596349 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:18.606511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef4144e6-c545-4cdb-bd96-3d3ae3596349 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:18.856946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef4144e6-c545-4cdb-bd96-3d3ae3596349 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:18.870889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef4144e6-c545-4cdb-bd96-3d3ae3596349 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:18.872739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef4144e6-c545-4cdb-bd96-3d3ae3596349 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:18.874757 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ef4144e6-c545-4cdb-bd96-3d3ae3596349 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 2953 microversion: 2.42 time: 0.291065 Aug 27 05:04:18.876333 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2778/5604] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:18 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 2953 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:19.225521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-173c8406-2817-4ce0-aabd-b11b227c7430 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:19.226434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-173c8406-2817-4ce0-aabd-b11b227c7430 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:19.245465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173c8406-2817-4ce0-aabd-b11b227c7430 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:19.245983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173c8406-2817-4ce0-aabd-b11b227c7430 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:19.246562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173c8406-2817-4ce0-aabd-b11b227c7430 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:19.247306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173c8406-2817-4ce0-aabd-b11b227c7430 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:19.247773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173c8406-2817-4ce0-aabd-b11b227c7430 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:19.248346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-173c8406-2817-4ce0-aabd-b11b227c7430 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:19.469733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-173c8406-2817-4ce0-aabd-b11b227c7430 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:19.486446 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-173c8406-2817-4ce0-aabd-b11b227c7430 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1696 microversion: 2.1 time: 0.265713 Aug 27 05:04:19.501685 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2827/5605] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:19 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1696 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:19.901958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d301e9b3-2d58-43c9-bece-3b31ef6276ae tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:19.903165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d301e9b3-2d58-43c9-bece-3b31ef6276ae tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:19.909903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d301e9b3-2d58-43c9-bece-3b31ef6276ae tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:19.910787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d301e9b3-2d58-43c9-bece-3b31ef6276ae tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:19.911377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d301e9b3-2d58-43c9-bece-3b31ef6276ae tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:19.912223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d301e9b3-2d58-43c9-bece-3b31ef6276ae tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:19.912880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d301e9b3-2d58-43c9-bece-3b31ef6276ae tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:19.913465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d301e9b3-2d58-43c9-bece-3b31ef6276ae tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:20.235774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d301e9b3-2d58-43c9-bece-3b31ef6276ae tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:20.246588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d301e9b3-2d58-43c9-bece-3b31ef6276ae tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:20.249035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d301e9b3-2d58-43c9-bece-3b31ef6276ae tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:20.250923 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d301e9b3-2d58-43c9-bece-3b31ef6276ae tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 2953 microversion: 2.42 time: 0.354566 Aug 27 05:04:20.251699 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2779/5606] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:19 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 2953 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:20.514266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6cce2e85-6989-4203-af2f-5f1cb8a8e5e1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:20.514994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6cce2e85-6989-4203-af2f-5f1cb8a8e5e1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:20.524625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cce2e85-6989-4203-af2f-5f1cb8a8e5e1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:20.525142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cce2e85-6989-4203-af2f-5f1cb8a8e5e1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:20.525786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cce2e85-6989-4203-af2f-5f1cb8a8e5e1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:20.526731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cce2e85-6989-4203-af2f-5f1cb8a8e5e1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:20.527213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cce2e85-6989-4203-af2f-5f1cb8a8e5e1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:20.530683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cce2e85-6989-4203-af2f-5f1cb8a8e5e1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:21.034978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6cce2e85-6989-4203-af2f-5f1cb8a8e5e1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:21.044183 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6cce2e85-6989-4203-af2f-5f1cb8a8e5e1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1696 microversion: 2.1 time: 0.535224 Aug 27 05:04:21.045211 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2828/5607] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:20 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1696 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:21.284798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6bcf591a-a74c-4bb8-b123-52bb78008ea3 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:21.287119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6bcf591a-a74c-4bb8-b123-52bb78008ea3 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:21.297759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bcf591a-a74c-4bb8-b123-52bb78008ea3 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:21.298676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bcf591a-a74c-4bb8-b123-52bb78008ea3 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:21.300258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bcf591a-a74c-4bb8-b123-52bb78008ea3 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:21.301355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bcf591a-a74c-4bb8-b123-52bb78008ea3 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:21.302107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bcf591a-a74c-4bb8-b123-52bb78008ea3 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:21.302710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6bcf591a-a74c-4bb8-b123-52bb78008ea3 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:22.065864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b53c5b5-b06f-429f-adcb-d74cd0daaccf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:22.066497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b53c5b5-b06f-429f-adcb-d74cd0daaccf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:22.076047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b53c5b5-b06f-429f-adcb-d74cd0daaccf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:22.082401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b53c5b5-b06f-429f-adcb-d74cd0daaccf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:22.083165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b53c5b5-b06f-429f-adcb-d74cd0daaccf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:22.084254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b53c5b5-b06f-429f-adcb-d74cd0daaccf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:22.084784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b53c5b5-b06f-429f-adcb-d74cd0daaccf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:22.085242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b53c5b5-b06f-429f-adcb-d74cd0daaccf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:22.179179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6bcf591a-a74c-4bb8-b123-52bb78008ea3 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:22.193764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6bcf591a-a74c-4bb8-b123-52bb78008ea3 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:22.197956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6bcf591a-a74c-4bb8-b123-52bb78008ea3 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:22.203671 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6bcf591a-a74c-4bb8-b123-52bb78008ea3 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 2953 microversion: 2.42 time: 0.925295 Aug 27 05:04:22.205895 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2780/5608] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:21 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 2953 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:22.248393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-334320d5-97ea-4772-aee3-39e1eac8eef1 req-7b21ffa2-c27c-4fab-a0ed-92d23f25d4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c", "name": "network-vif-unplugged", "status": "completed", "tag": "1c0cd31d-1134-43c3-8033-7756a472aa85"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:22.273369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-334320d5-97ea-4772-aee3-39e1eac8eef1 req-7b21ffa2-c27c-4fab-a0ed-92d23f25d4b0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:22.274173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-334320d5-97ea-4772-aee3-39e1eac8eef1 req-7b21ffa2-c27c-4fab-a0ed-92d23f25d4b0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:22.275303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-334320d5-97ea-4772-aee3-39e1eac8eef1 req-7b21ffa2-c27c-4fab-a0ed-92d23f25d4b0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:22.313888 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-334320d5-97ea-4772-aee3-39e1eac8eef1 req-7b21ffa2-c27c-4fab-a0ed-92d23f25d4b0 service nova] Creating event network-vif-unplugged:1c0cd31d-1134-43c3-8033-7756a472aa85 for instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c on n-h2-854823-1 Aug 27 05:04:22.360372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-334320d5-97ea-4772-aee3-39e1eac8eef1 req-7b21ffa2-c27c-4fab-a0ed-92d23f25d4b0 service nova] Instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:04:22.383376 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-334320d5-97ea-4772-aee3-39e1eac8eef1 req-7b21ffa2-c27c-4fab-a0ed-92d23f25d4b0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137952 Aug 27 05:04:22.384509 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2781/5609] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:04:22.412266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b53c5b5-b06f-429f-adcb-d74cd0daaccf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:22.429558 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b53c5b5-b06f-429f-adcb-d74cd0daaccf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1696 microversion: 2.1 time: 0.366818 Aug 27 05:04:22.431596 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2829/5610] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:22 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1696 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:23.236470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-29a2e9e2-0319-4aea-b17d-03447e7069fb tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:23.237298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-29a2e9e2-0319-4aea-b17d-03447e7069fb tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:23.270156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29a2e9e2-0319-4aea-b17d-03447e7069fb tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:23.271691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29a2e9e2-0319-4aea-b17d-03447e7069fb tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:23.272451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29a2e9e2-0319-4aea-b17d-03447e7069fb tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:23.276146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29a2e9e2-0319-4aea-b17d-03447e7069fb tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:23.277802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29a2e9e2-0319-4aea-b17d-03447e7069fb tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:23.280510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29a2e9e2-0319-4aea-b17d-03447e7069fb tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:23.453829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8efb7524-1dff-4202-8c07-bb1423b62fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:23.455433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8efb7524-1dff-4202-8c07-bb1423b62fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:23.468557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8efb7524-1dff-4202-8c07-bb1423b62fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:23.470212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8efb7524-1dff-4202-8c07-bb1423b62fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:23.471540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8efb7524-1dff-4202-8c07-bb1423b62fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:23.473324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8efb7524-1dff-4202-8c07-bb1423b62fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:23.475628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8efb7524-1dff-4202-8c07-bb1423b62fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:23.477576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8efb7524-1dff-4202-8c07-bb1423b62fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:23.611532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-29a2e9e2-0319-4aea-b17d-03447e7069fb tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:23.631100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-29a2e9e2-0319-4aea-b17d-03447e7069fb tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:23.637186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-29a2e9e2-0319-4aea-b17d-03447e7069fb tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:23.638944 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-29a2e9e2-0319-4aea-b17d-03447e7069fb tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 2932 microversion: 2.42 time: 0.411968 Aug 27 05:04:23.643742 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2782/5611] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:23 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 2932 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:23.854622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8efb7524-1dff-4202-8c07-bb1423b62fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:23.864607 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8efb7524-1dff-4202-8c07-bb1423b62fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1696 microversion: 2.1 time: 0.415749 Aug 27 05:04:23.865506 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2830/5612] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:23 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1696 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:24.404967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-bacfd58b-2e22-4d3f-9051-5a4a4ca8e2bb req-afb79a9f-7fa8-4241-a21c-1ce75d004747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c", "tag": "1c0cd31d-1134-43c3-8033-7756a472aa85"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:24.421537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bacfd58b-2e22-4d3f-9051-5a4a4ca8e2bb req-afb79a9f-7fa8-4241-a21c-1ce75d004747 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:24.422331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bacfd58b-2e22-4d3f-9051-5a4a4ca8e2bb req-afb79a9f-7fa8-4241-a21c-1ce75d004747 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:24.423136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bacfd58b-2e22-4d3f-9051-5a4a4ca8e2bb req-afb79a9f-7fa8-4241-a21c-1ce75d004747 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:24.443030 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-bacfd58b-2e22-4d3f-9051-5a4a4ca8e2bb req-afb79a9f-7fa8-4241-a21c-1ce75d004747 service nova] Creating event network-changed:1c0cd31d-1134-43c3-8033-7756a472aa85 for instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c on n-h2-854823-1 Aug 27 05:04:24.456282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-bacfd58b-2e22-4d3f-9051-5a4a4ca8e2bb req-afb79a9f-7fa8-4241-a21c-1ce75d004747 service nova] Instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:04:24.472408 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-bacfd58b-2e22-4d3f-9051-5a4a4ca8e2bb req-afb79a9f-7fa8-4241-a21c-1ce75d004747 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071976 Aug 27 05:04:24.476840 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2783/5613] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:04:24.673054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88746168-ee9c-40ea-a9e4-8330b24b2b4b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:24.674238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88746168-ee9c-40ea-a9e4-8330b24b2b4b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:24.683202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88746168-ee9c-40ea-a9e4-8330b24b2b4b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:24.683927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88746168-ee9c-40ea-a9e4-8330b24b2b4b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:24.684170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88746168-ee9c-40ea-a9e4-8330b24b2b4b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:24.684934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88746168-ee9c-40ea-a9e4-8330b24b2b4b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:24.686788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88746168-ee9c-40ea-a9e4-8330b24b2b4b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:24.687524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88746168-ee9c-40ea-a9e4-8330b24b2b4b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:24.889017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c6f0c6ac-8327-4328-b86f-3396580cb2e8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:24.890472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c6f0c6ac-8327-4328-b86f-3396580cb2e8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:24.898200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6f0c6ac-8327-4328-b86f-3396580cb2e8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:24.899319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6f0c6ac-8327-4328-b86f-3396580cb2e8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:24.900023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6f0c6ac-8327-4328-b86f-3396580cb2e8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:24.900863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6f0c6ac-8327-4328-b86f-3396580cb2e8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:24.901559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6f0c6ac-8327-4328-b86f-3396580cb2e8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:24.902207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6f0c6ac-8327-4328-b86f-3396580cb2e8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:25.178078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88746168-ee9c-40ea-a9e4-8330b24b2b4b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:25.198538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88746168-ee9c-40ea-a9e4-8330b24b2b4b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:25.204284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88746168-ee9c-40ea-a9e4-8330b24b2b4b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:25.205692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c6f0c6ac-8327-4328-b86f-3396580cb2e8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:25.208348 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88746168-ee9c-40ea-a9e4-8330b24b2b4b tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 2911 microversion: 2.42 time: 0.538478 Aug 27 05:04:25.209178 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2831/5614] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:24 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 2911 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:25.219675 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c6f0c6ac-8327-4328-b86f-3396580cb2e8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1694 microversion: 2.1 time: 0.335254 Aug 27 05:04:25.235789 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2784/5615] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:24 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1694 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:25.340805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-85721466-950b-48af-a57e-6edc35b832aa req-ea1c05d5-5193-4863-b36f-182bf12e2fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-unplugged", "status": "completed", "tag": "2f5d037f-12fc-48e0-a08b-bc7ed1c9a197"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:25.358922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-85721466-950b-48af-a57e-6edc35b832aa req-ea1c05d5-5193-4863-b36f-182bf12e2fda service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:25.360645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-85721466-950b-48af-a57e-6edc35b832aa req-ea1c05d5-5193-4863-b36f-182bf12e2fda service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:25.363363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-85721466-950b-48af-a57e-6edc35b832aa req-ea1c05d5-5193-4863-b36f-182bf12e2fda service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:25.389174 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-85721466-950b-48af-a57e-6edc35b832aa req-ea1c05d5-5193-4863-b36f-182bf12e2fda service nova] Creating event network-vif-unplugged:2f5d037f-12fc-48e0-a08b-bc7ed1c9a197 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:04:25.402029 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-85721466-950b-48af-a57e-6edc35b832aa req-ea1c05d5-5193-4863-b36f-182bf12e2fda service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065228 Aug 27 05:04:25.402863 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2832/5616] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:25.421631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-5f79391d-6b74-4390-b743-b699138f7cfe req-d5081d04-3b9d-4704-9940-74a0bdff5ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-deleted", "tag": "3a3619e3-dc35-4c97-b3a7-cdae4e3af733"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:25.436560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5f79391d-6b74-4390-b743-b699138f7cfe req-d5081d04-3b9d-4704-9940-74a0bdff5ac8 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:25.437335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5f79391d-6b74-4390-b743-b699138f7cfe req-d5081d04-3b9d-4704-9940-74a0bdff5ac8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:25.438125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5f79391d-6b74-4390-b743-b699138f7cfe req-d5081d04-3b9d-4704-9940-74a0bdff5ac8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:25.477953 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-5f79391d-6b74-4390-b743-b699138f7cfe req-d5081d04-3b9d-4704-9940-74a0bdff5ac8 service nova] Creating event network-vif-deleted:3a3619e3-dc35-4c97-b3a7-cdae4e3af733 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:04:25.493579 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-5f79391d-6b74-4390-b743-b699138f7cfe req-d5081d04-3b9d-4704-9940-74a0bdff5ac8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078653 Aug 27 05:04:25.498799 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2785/5617] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:04:26.239701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01587cb4-4b7d-4611-8229-452813dc3784 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:26.241001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01587cb4-4b7d-4611-8229-452813dc3784 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:26.244702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1b988bc4-5e86-40cd-8693-0b80762d3fc9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:26.246096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1b988bc4-5e86-40cd-8693-0b80762d3fc9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:26.253359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:26.254485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b988bc4-5e86-40cd-8693-0b80762d3fc9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:26.255340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b988bc4-5e86-40cd-8693-0b80762d3fc9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:26.256078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b988bc4-5e86-40cd-8693-0b80762d3fc9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:26.257058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b988bc4-5e86-40cd-8693-0b80762d3fc9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:26.257713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b988bc4-5e86-40cd-8693-0b80762d3fc9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:26.258337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b988bc4-5e86-40cd-8693-0b80762d3fc9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:26.264892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01587cb4-4b7d-4611-8229-452813dc3784 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:26.268852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01587cb4-4b7d-4611-8229-452813dc3784 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:26.269511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01587cb4-4b7d-4611-8229-452813dc3784 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:26.271555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01587cb4-4b7d-4611-8229-452813dc3784 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:26.273598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01587cb4-4b7d-4611-8229-452813dc3784 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:26.278075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01587cb4-4b7d-4611-8229-452813dc3784 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:26.350255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:26.626457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1b988bc4-5e86-40cd-8693-0b80762d3fc9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:26.638193 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1b988bc4-5e86-40cd-8693-0b80762d3fc9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1691 microversion: 2.1 time: 0.397664 Aug 27 05:04:26.639939 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2786/5618] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:26 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1691 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:26.662667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-41166007-079d-4a19-95f3-33a1ada05105 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:26.663512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-41166007-079d-4a19-95f3-33a1ada05105 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:26.673250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41166007-079d-4a19-95f3-33a1ada05105 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:26.673760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41166007-079d-4a19-95f3-33a1ada05105 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:26.674236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41166007-079d-4a19-95f3-33a1ada05105 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:26.674985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41166007-079d-4a19-95f3-33a1ada05105 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:26.679969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41166007-079d-4a19-95f3-33a1ada05105 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:26.680750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41166007-079d-4a19-95f3-33a1ada05105 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:27.261423 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-41166007-079d-4a19-95f3-33a1ada05105 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c/action" status: 202 len: 0 microversion: 2.1 time: 0.602691 Aug 27 05:04:27.265607 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2787/5619] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:04:26 2022] POST /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:04:27.280247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5b654391-a5e5-484c-ae38-a941e46ac9d5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:27.281095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5b654391-a5e5-484c-ae38-a941e46ac9d5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:27.318169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b654391-a5e5-484c-ae38-a941e46ac9d5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:27.318895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b654391-a5e5-484c-ae38-a941e46ac9d5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:27.319624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b654391-a5e5-484c-ae38-a941e46ac9d5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:27.320578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b654391-a5e5-484c-ae38-a941e46ac9d5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:27.321211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b654391-a5e5-484c-ae38-a941e46ac9d5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:27.321814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b654391-a5e5-484c-ae38-a941e46ac9d5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:27.448219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01587cb4-4b7d-4611-8229-452813dc3784 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:27.469866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01587cb4-4b7d-4611-8229-452813dc3784 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:27.485423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01587cb4-4b7d-4611-8229-452813dc3784 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:27.487551 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01587cb4-4b7d-4611-8229-452813dc3784 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 2753 microversion: 2.42 time: 1.253179 Aug 27 05:04:27.491191 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2833/5620] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:26 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 2753 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:27.579272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-334d57c9-205b-4ec2-932c-685f18d6bba9 req-ffc8a5fd-7c1d-45f1-996c-60f1f8617f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-unplugged", "status": "completed", "tag": "c1f12ba8-4229-4c6b-8a69-f4b909bb0337"}, {"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-unplugged", "status": "completed", "tag": "d47b1431-6e76-424f-a633-fedf675e1d79"}, {"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-unplugged", "status": "completed", "tag": "8d4f958b-79cd-4a09-9322-87a1b16589ee"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:27.596750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-334d57c9-205b-4ec2-932c-685f18d6bba9 req-ffc8a5fd-7c1d-45f1-996c-60f1f8617f8e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:27.597559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-334d57c9-205b-4ec2-932c-685f18d6bba9 req-ffc8a5fd-7c1d-45f1-996c-60f1f8617f8e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:27.598215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-334d57c9-205b-4ec2-932c-685f18d6bba9 req-ffc8a5fd-7c1d-45f1-996c-60f1f8617f8e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:27.626566 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-334d57c9-205b-4ec2-932c-685f18d6bba9 req-ffc8a5fd-7c1d-45f1-996c-60f1f8617f8e service nova] Creating event network-vif-unplugged:c1f12ba8-4229-4c6b-8a69-f4b909bb0337 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:04:27.629264 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-334d57c9-205b-4ec2-932c-685f18d6bba9 req-ffc8a5fd-7c1d-45f1-996c-60f1f8617f8e service nova] Creating event network-vif-unplugged:d47b1431-6e76-424f-a633-fedf675e1d79 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:04:27.630107 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-334d57c9-205b-4ec2-932c-685f18d6bba9 req-ffc8a5fd-7c1d-45f1-996c-60f1f8617f8e service nova] Creating event network-vif-unplugged:8d4f958b-79cd-4a09-9322-87a1b16589ee for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:04:27.665663 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-334d57c9-205b-4ec2-932c-685f18d6bba9 req-ffc8a5fd-7c1d-45f1-996c-60f1f8617f8e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.086582 Aug 27 05:04:27.666367 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2834/5621] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:27.935780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5b654391-a5e5-484c-ae38-a941e46ac9d5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:27.951722 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5b654391-a5e5-484c-ae38-a941e46ac9d5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1690 microversion: 2.1 time: 0.683825 Aug 27 05:04:27.952660 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2788/5622] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:27 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1690 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:27.953945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ef2762ae-48ed-4962-92d8-2f36b5643530 req-795949fd-2f73-412c-90e2-4d0cc94c4eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-deleted", "tag": "8d4f958b-79cd-4a09-9322-87a1b16589ee"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:27.976280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ef2762ae-48ed-4962-92d8-2f36b5643530 req-795949fd-2f73-412c-90e2-4d0cc94c4eb2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:27.977089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ef2762ae-48ed-4962-92d8-2f36b5643530 req-795949fd-2f73-412c-90e2-4d0cc94c4eb2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:27.977981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ef2762ae-48ed-4962-92d8-2f36b5643530 req-795949fd-2f73-412c-90e2-4d0cc94c4eb2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:27.994423 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ef2762ae-48ed-4962-92d8-2f36b5643530 req-795949fd-2f73-412c-90e2-4d0cc94c4eb2 service nova] Creating event network-vif-deleted:8d4f958b-79cd-4a09-9322-87a1b16589ee for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:04:28.004060 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ef2762ae-48ed-4962-92d8-2f36b5643530 req-795949fd-2f73-412c-90e2-4d0cc94c4eb2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056699 Aug 27 05:04:28.005923 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2835/5623] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:28.519672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-65cfa3c8-fea3-49fb-8489-18de0083635a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:28.520220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-65cfa3c8-fea3-49fb-8489-18de0083635a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:28.541238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65cfa3c8-fea3-49fb-8489-18de0083635a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:28.541748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65cfa3c8-fea3-49fb-8489-18de0083635a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:28.542190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65cfa3c8-fea3-49fb-8489-18de0083635a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:28.550434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65cfa3c8-fea3-49fb-8489-18de0083635a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:28.556021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65cfa3c8-fea3-49fb-8489-18de0083635a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:28.558444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65cfa3c8-fea3-49fb-8489-18de0083635a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:28.974610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b2073a3-edb2-49ff-839a-ffa1eb6b0193 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:28.976434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b2073a3-edb2-49ff-839a-ffa1eb6b0193 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:28.993099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b2073a3-edb2-49ff-839a-ffa1eb6b0193 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:28.996582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b2073a3-edb2-49ff-839a-ffa1eb6b0193 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:28.997698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b2073a3-edb2-49ff-839a-ffa1eb6b0193 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:28.998687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b2073a3-edb2-49ff-839a-ffa1eb6b0193 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:29.001041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b2073a3-edb2-49ff-839a-ffa1eb6b0193 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:29.002360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b2073a3-edb2-49ff-839a-ffa1eb6b0193 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:29.464786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b2073a3-edb2-49ff-839a-ffa1eb6b0193 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:29.476689 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b2073a3-edb2-49ff-839a-ffa1eb6b0193 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1690 microversion: 2.1 time: 0.506938 Aug 27 05:04:29.482836 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2836/5624] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:28 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1690 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:29.683336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-76637668-9129-4917-9f8e-4da36c68cdaf req-14acb3d4-7978-4c3c-a449-56a76b7277c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c", "name": "network-vif-plugged", "status": "completed", "tag": "1c0cd31d-1134-43c3-8033-7756a472aa85"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:29.703456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-76637668-9129-4917-9f8e-4da36c68cdaf req-14acb3d4-7978-4c3c-a449-56a76b7277c1 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:29.703958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-76637668-9129-4917-9f8e-4da36c68cdaf req-14acb3d4-7978-4c3c-a449-56a76b7277c1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:29.704405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-76637668-9129-4917-9f8e-4da36c68cdaf req-14acb3d4-7978-4c3c-a449-56a76b7277c1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:29.739795 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-76637668-9129-4917-9f8e-4da36c68cdaf req-14acb3d4-7978-4c3c-a449-56a76b7277c1 service nova] Creating event network-vif-plugged:1c0cd31d-1134-43c3-8033-7756a472aa85 for instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c on n-h2-854823-1 Aug 27 05:04:29.760370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-76637668-9129-4917-9f8e-4da36c68cdaf req-14acb3d4-7978-4c3c-a449-56a76b7277c1 service nova] Instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:04:29.787097 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-76637668-9129-4917-9f8e-4da36c68cdaf req-14acb3d4-7978-4c3c-a449-56a76b7277c1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106533 Aug 27 05:04:29.787097 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2837/5625] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:04:29.831879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-65cfa3c8-fea3-49fb-8489-18de0083635a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:29.842241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-65cfa3c8-fea3-49fb-8489-18de0083635a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:29.865521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-65cfa3c8-fea3-49fb-8489-18de0083635a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:29.867107 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-65cfa3c8-fea3-49fb-8489-18de0083635a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 2370 microversion: 2.42 time: 1.351928 Aug 27 05:04:29.867755 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2789/5626] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:28 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 2370 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:30.062022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8290e282-11cb-4a09-b205-81e02c33bb23 req-990728c6-5917-45f1-a5f1-ca8c514273db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-deleted", "tag": "d47b1431-6e76-424f-a633-fedf675e1d79"}, {"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-deleted", "tag": "2f5d037f-12fc-48e0-a08b-bc7ed1c9a197"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:30.098152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8290e282-11cb-4a09-b205-81e02c33bb23 req-990728c6-5917-45f1-a5f1-ca8c514273db service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:30.098667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8290e282-11cb-4a09-b205-81e02c33bb23 req-990728c6-5917-45f1-a5f1-ca8c514273db service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:30.099124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8290e282-11cb-4a09-b205-81e02c33bb23 req-990728c6-5917-45f1-a5f1-ca8c514273db service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:30.127638 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8290e282-11cb-4a09-b205-81e02c33bb23 req-990728c6-5917-45f1-a5f1-ca8c514273db service nova] Creating event network-vif-deleted:d47b1431-6e76-424f-a633-fedf675e1d79 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:04:30.128708 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8290e282-11cb-4a09-b205-81e02c33bb23 req-990728c6-5917-45f1-a5f1-ca8c514273db service nova] Creating event network-vif-deleted:2f5d037f-12fc-48e0-a08b-bc7ed1c9a197 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:04:30.135484 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8290e282-11cb-4a09-b205-81e02c33bb23 req-990728c6-5917-45f1-a5f1-ca8c514273db service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080370 Aug 27 05:04:30.137628 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2838/5627] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:30.505464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e70249a-b4d2-4656-b2b2-03de88a2d55b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:30.513237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4e70249a-b4d2-4656-b2b2-03de88a2d55b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:30.535107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e70249a-b4d2-4656-b2b2-03de88a2d55b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:30.536047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e70249a-b4d2-4656-b2b2-03de88a2d55b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:30.536721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e70249a-b4d2-4656-b2b2-03de88a2d55b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:30.537914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e70249a-b4d2-4656-b2b2-03de88a2d55b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:30.538539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e70249a-b4d2-4656-b2b2-03de88a2d55b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:30.539156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e70249a-b4d2-4656-b2b2-03de88a2d55b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:30.801606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4e70249a-b4d2-4656-b2b2-03de88a2d55b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:30.814603 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4e70249a-b4d2-4656-b2b2-03de88a2d55b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1690 microversion: 2.1 time: 0.311765 Aug 27 05:04:30.828751 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2790/5628] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:30 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1690 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:30.896166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84dad5a0-eda0-4764-a762-2543b37f551c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:30.896908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-84dad5a0-eda0-4764-a762-2543b37f551c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:30.907099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84dad5a0-eda0-4764-a762-2543b37f551c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:30.909450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84dad5a0-eda0-4764-a762-2543b37f551c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:30.910074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84dad5a0-eda0-4764-a762-2543b37f551c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:30.918371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84dad5a0-eda0-4764-a762-2543b37f551c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:30.919135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84dad5a0-eda0-4764-a762-2543b37f551c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:30.920284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84dad5a0-eda0-4764-a762-2543b37f551c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:31.051874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84dad5a0-eda0-4764-a762-2543b37f551c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:31.080657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84dad5a0-eda0-4764-a762-2543b37f551c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:31.083005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84dad5a0-eda0-4764-a762-2543b37f551c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:31.089688 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-84dad5a0-eda0-4764-a762-2543b37f551c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 2257 microversion: 2.42 time: 0.192555 Aug 27 05:04:31.090647 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2839/5629] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:30 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 2257 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:31.843785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8438ca24-6655-4bc0-809b-5deb856e405c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:31.845065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8438ca24-6655-4bc0-809b-5deb856e405c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:31.853957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8438ca24-6655-4bc0-809b-5deb856e405c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:31.854760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8438ca24-6655-4bc0-809b-5deb856e405c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:31.855406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8438ca24-6655-4bc0-809b-5deb856e405c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:31.856628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8438ca24-6655-4bc0-809b-5deb856e405c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:31.857922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8438ca24-6655-4bc0-809b-5deb856e405c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:31.859007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8438ca24-6655-4bc0-809b-5deb856e405c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:32.031730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8438ca24-6655-4bc0-809b-5deb856e405c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:32.035533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:32.044855 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8438ca24-6655-4bc0-809b-5deb856e405c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1690 microversion: 2.1 time: 0.205390 Aug 27 05:04:32.046675 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2791/5630] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:31 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1690 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:32.117060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b001fb5-8f38-4e97-9e02-ce5cc73fd1dc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:32.118318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b001fb5-8f38-4e97-9e02-ce5cc73fd1dc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:32.133185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b001fb5-8f38-4e97-9e02-ce5cc73fd1dc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:32.133983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b001fb5-8f38-4e97-9e02-ce5cc73fd1dc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:32.134879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b001fb5-8f38-4e97-9e02-ce5cc73fd1dc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:32.140857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b001fb5-8f38-4e97-9e02-ce5cc73fd1dc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:32.141459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b001fb5-8f38-4e97-9e02-ce5cc73fd1dc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:32.141927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b001fb5-8f38-4e97-9e02-ce5cc73fd1dc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:32.278522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b001fb5-8f38-4e97-9e02-ce5cc73fd1dc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:32.310948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b001fb5-8f38-4e97-9e02-ce5cc73fd1dc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:32.317385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-b26789b2-b173-460f-a3ab-d9793dd4e2fc req-0f7cffca-3f7c-4e8f-bab6-76b11b799ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a473312c-429d-4aab-89d5-013329683a64", "name": "network-vif-deleted", "tag": "c1f12ba8-4229-4c6b-8a69-f4b909bb0337"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:32.319351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b001fb5-8f38-4e97-9e02-ce5cc73fd1dc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:32.323567 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b001fb5-8f38-4e97-9e02-ce5cc73fd1dc tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1986 microversion: 2.42 time: 0.210997 Aug 27 05:04:32.337957 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2840/5631] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:32 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1986 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:32.338850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b26789b2-b173-460f-a3ab-d9793dd4e2fc req-0f7cffca-3f7c-4e8f-bab6-76b11b799ee2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:32.339349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b26789b2-b173-460f-a3ab-d9793dd4e2fc req-0f7cffca-3f7c-4e8f-bab6-76b11b799ee2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:32.340685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b26789b2-b173-460f-a3ab-d9793dd4e2fc req-0f7cffca-3f7c-4e8f-bab6-76b11b799ee2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:32.372161 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b26789b2-b173-460f-a3ab-d9793dd4e2fc req-0f7cffca-3f7c-4e8f-bab6-76b11b799ee2 service nova] Creating event network-vif-deleted:c1f12ba8-4229-4c6b-8a69-f4b909bb0337 for instance a473312c-429d-4aab-89d5-013329683a64 on n-h2-854823-1 Aug 27 05:04:32.387119 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-b26789b2-b173-460f-a3ab-d9793dd4e2fc req-0f7cffca-3f7c-4e8f-bab6-76b11b799ee2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074016 Aug 27 05:04:32.408464 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2792/5632] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:33.067886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-21fe6901-0643-490c-b5d7-eee5866f2f92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:33.068548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-21fe6901-0643-490c-b5d7-eee5866f2f92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:33.079078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21fe6901-0643-490c-b5d7-eee5866f2f92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:33.079605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21fe6901-0643-490c-b5d7-eee5866f2f92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:33.080081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21fe6901-0643-490c-b5d7-eee5866f2f92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:33.080845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21fe6901-0643-490c-b5d7-eee5866f2f92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:33.081325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21fe6901-0643-490c-b5d7-eee5866f2f92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:33.081774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21fe6901-0643-490c-b5d7-eee5866f2f92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:33.359362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-21fe6901-0643-490c-b5d7-eee5866f2f92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:33.362339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fabe8792-7c8c-4b2e-b846-2c913d65ae38 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:33.364798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fabe8792-7c8c-4b2e-b846-2c913d65ae38 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:33.367958 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-21fe6901-0643-490c-b5d7-eee5866f2f92 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1690 microversion: 2.1 time: 0.304003 Aug 27 05:04:33.386059 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2841/5633] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:33 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1690 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:33.386319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabe8792-7c8c-4b2e-b846-2c913d65ae38 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:33.387698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabe8792-7c8c-4b2e-b846-2c913d65ae38 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:33.389531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabe8792-7c8c-4b2e-b846-2c913d65ae38 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:33.392896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabe8792-7c8c-4b2e-b846-2c913d65ae38 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:33.393559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabe8792-7c8c-4b2e-b846-2c913d65ae38 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:33.396505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabe8792-7c8c-4b2e-b846-2c913d65ae38 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:33.600317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fabe8792-7c8c-4b2e-b846-2c913d65ae38 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:33.613129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fabe8792-7c8c-4b2e-b846-2c913d65ae38 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:33.614601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fabe8792-7c8c-4b2e-b846-2c913d65ae38 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:33.615850 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fabe8792-7c8c-4b2e-b846-2c913d65ae38 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1872 microversion: 2.42 time: 0.265512 Aug 27 05:04:33.616421 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2793/5634] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:33 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1872 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:34.401903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6aeb3ceb-d08b-4155-9e54-9129ac9de227 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:34.405599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6aeb3ceb-d08b-4155-9e54-9129ac9de227 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:34.438350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ad5316b6-1719-4cb6-8397-0ab4758594d2 req-a6fcf3d0-4dcb-4c12-bfb4-6c2519f1a6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c", "name": "network-vif-unplugged", "status": "completed", "tag": "1c0cd31d-1134-43c3-8033-7756a472aa85"}, {"name": "network-changed", "server_uuid": "c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c", "tag": "1c0cd31d-1134-43c3-8033-7756a472aa85"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:34.441063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6aeb3ceb-d08b-4155-9e54-9129ac9de227 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:34.457905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ad5316b6-1719-4cb6-8397-0ab4758594d2 req-a6fcf3d0-4dcb-4c12-bfb4-6c2519f1a6d0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:34.463191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6aeb3ceb-d08b-4155-9e54-9129ac9de227 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:34.463891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ad5316b6-1719-4cb6-8397-0ab4758594d2 req-a6fcf3d0-4dcb-4c12-bfb4-6c2519f1a6d0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:34.464550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ad5316b6-1719-4cb6-8397-0ab4758594d2 req-a6fcf3d0-4dcb-4c12-bfb4-6c2519f1a6d0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:34.466374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6aeb3ceb-d08b-4155-9e54-9129ac9de227 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:34.472342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6aeb3ceb-d08b-4155-9e54-9129ac9de227 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:34.473481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6aeb3ceb-d08b-4155-9e54-9129ac9de227 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:34.477484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6aeb3ceb-d08b-4155-9e54-9129ac9de227 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:34.496502 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ad5316b6-1719-4cb6-8397-0ab4758594d2 req-a6fcf3d0-4dcb-4c12-bfb4-6c2519f1a6d0 service nova] Creating event network-vif-unplugged:1c0cd31d-1134-43c3-8033-7756a472aa85 for instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c on n-h1-854823-1 Aug 27 05:04:34.497058 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ad5316b6-1719-4cb6-8397-0ab4758594d2 req-a6fcf3d0-4dcb-4c12-bfb4-6c2519f1a6d0 service nova] Creating event network-changed:1c0cd31d-1134-43c3-8033-7756a472aa85 for instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c on n-h1-854823-1 Aug 27 05:04:34.517549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-ad5316b6-1719-4cb6-8397-0ab4758594d2 req-a6fcf3d0-4dcb-4c12-bfb4-6c2519f1a6d0 service nova] Instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:04:34.545276 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ad5316b6-1719-4cb6-8397-0ab4758594d2 req-a6fcf3d0-4dcb-4c12-bfb4-6c2519f1a6d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.110960 Aug 27 05:04:34.548915 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2794/5635] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:04:34.649150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b4119a61-f115-4143-bf78-e94836e819c4 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:34.650161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b4119a61-f115-4143-bf78-e94836e819c4 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:34.673301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4119a61-f115-4143-bf78-e94836e819c4 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:34.674377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4119a61-f115-4143-bf78-e94836e819c4 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:34.675501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4119a61-f115-4143-bf78-e94836e819c4 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:34.676599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4119a61-f115-4143-bf78-e94836e819c4 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:34.677370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4119a61-f115-4143-bf78-e94836e819c4 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:34.677977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b4119a61-f115-4143-bf78-e94836e819c4 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:34.933857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b4119a61-f115-4143-bf78-e94836e819c4 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:34.980333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b4119a61-f115-4143-bf78-e94836e819c4 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:34.988066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b4119a61-f115-4143-bf78-e94836e819c4 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:34.989731 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b4119a61-f115-4143-bf78-e94836e819c4 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1872 microversion: 2.42 time: 0.345690 Aug 27 05:04:34.992699 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2795/5636] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:34 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1872 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:35.752768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6aeb3ceb-d08b-4155-9e54-9129ac9de227 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:35.768522 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6aeb3ceb-d08b-4155-9e54-9129ac9de227 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1690 microversion: 2.1 time: 1.378143 Aug 27 05:04:35.770792 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2842/5637] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:34 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1690 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:36.016479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1acdd7c8-2511-47cf-8aed-42e9d92c8c56 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:36.017392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1acdd7c8-2511-47cf-8aed-42e9d92c8c56 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:36.032735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1acdd7c8-2511-47cf-8aed-42e9d92c8c56 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:36.034248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1acdd7c8-2511-47cf-8aed-42e9d92c8c56 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:36.034934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1acdd7c8-2511-47cf-8aed-42e9d92c8c56 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:36.040179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1acdd7c8-2511-47cf-8aed-42e9d92c8c56 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:36.040741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1acdd7c8-2511-47cf-8aed-42e9d92c8c56 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:36.041283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1acdd7c8-2511-47cf-8aed-42e9d92c8c56 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:36.133910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1acdd7c8-2511-47cf-8aed-42e9d92c8c56 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:36.144866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1acdd7c8-2511-47cf-8aed-42e9d92c8c56 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:36.147248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1acdd7c8-2511-47cf-8aed-42e9d92c8c56 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:36.148790 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1acdd7c8-2511-47cf-8aed-42e9d92c8c56 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1872 microversion: 2.42 time: 0.137714 Aug 27 05:04:36.149640 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2796/5638] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:36 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1872 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:36.791023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-401a9d6e-dbe5-43f5-b9a1-78e7b914fc60 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:36.792441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-401a9d6e-dbe5-43f5-b9a1-78e7b914fc60 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:36.808713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-401a9d6e-dbe5-43f5-b9a1-78e7b914fc60 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:36.809457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-401a9d6e-dbe5-43f5-b9a1-78e7b914fc60 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:36.810638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-401a9d6e-dbe5-43f5-b9a1-78e7b914fc60 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:36.815296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-401a9d6e-dbe5-43f5-b9a1-78e7b914fc60 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:36.816152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-401a9d6e-dbe5-43f5-b9a1-78e7b914fc60 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:36.816888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-401a9d6e-dbe5-43f5-b9a1-78e7b914fc60 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:37.109322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-401a9d6e-dbe5-43f5-b9a1-78e7b914fc60 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:37.119731 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-401a9d6e-dbe5-43f5-b9a1-78e7b914fc60 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1690 microversion: 2.1 time: 0.333024 Aug 27 05:04:37.121202 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2843/5639] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:36 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1690 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:37.174972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aca62809-295e-4da4-930b-eb3f8f989628 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:37.175739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aca62809-295e-4da4-930b-eb3f8f989628 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:37.186108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aca62809-295e-4da4-930b-eb3f8f989628 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:37.186709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aca62809-295e-4da4-930b-eb3f8f989628 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:37.187276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aca62809-295e-4da4-930b-eb3f8f989628 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:37.188100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aca62809-295e-4da4-930b-eb3f8f989628 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:37.188852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aca62809-295e-4da4-930b-eb3f8f989628 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:37.189403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aca62809-295e-4da4-930b-eb3f8f989628 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:37.287503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aca62809-295e-4da4-930b-eb3f8f989628 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:37.314111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aca62809-295e-4da4-930b-eb3f8f989628 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:37.325466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aca62809-295e-4da4-930b-eb3f8f989628 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:37.327335 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aca62809-295e-4da4-930b-eb3f8f989628 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1872 microversion: 2.42 time: 0.157794 Aug 27 05:04:37.328238 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2797/5640] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:37 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1872 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:38.142529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d3832e1-7237-4189-90e6-f0ba7b9b7f21 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:38.143165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d3832e1-7237-4189-90e6-f0ba7b9b7f21 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:38.154616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d3832e1-7237-4189-90e6-f0ba7b9b7f21 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:38.155555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d3832e1-7237-4189-90e6-f0ba7b9b7f21 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:38.156194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d3832e1-7237-4189-90e6-f0ba7b9b7f21 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:38.157247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d3832e1-7237-4189-90e6-f0ba7b9b7f21 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:38.157899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d3832e1-7237-4189-90e6-f0ba7b9b7f21 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:38.158892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d3832e1-7237-4189-90e6-f0ba7b9b7f21 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:38.351162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4d597a97-6737-4b35-b785-04c1226e82d7 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:38.352382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4d597a97-6737-4b35-b785-04c1226e82d7 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:38.366349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d597a97-6737-4b35-b785-04c1226e82d7 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:38.373607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d597a97-6737-4b35-b785-04c1226e82d7 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:38.384640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d597a97-6737-4b35-b785-04c1226e82d7 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:38.387074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d597a97-6737-4b35-b785-04c1226e82d7 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:38.387805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d597a97-6737-4b35-b785-04c1226e82d7 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:38.393167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d597a97-6737-4b35-b785-04c1226e82d7 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:38.509924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d3832e1-7237-4189-90e6-f0ba7b9b7f21 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:38.510802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4d597a97-6737-4b35-b785-04c1226e82d7 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:38.529736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4d597a97-6737-4b35-b785-04c1226e82d7 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:38.530001 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d3832e1-7237-4189-90e6-f0ba7b9b7f21 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1690 microversion: 2.1 time: 0.391892 Aug 27 05:04:38.532233 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2844/5641] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:38 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1690 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:38.536651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4d597a97-6737-4b35-b785-04c1226e82d7 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:38.537947 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4d597a97-6737-4b35-b785-04c1226e82d7 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1872 microversion: 2.42 time: 0.190751 Aug 27 05:04:38.553270 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2798/5642] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:38 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1872 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:39.565733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b375455f-666c-42db-aede-840729939f6d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:39.573688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a54e4f08-e882-49ca-a4ec-c49476e66857 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:39.576993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a54e4f08-e882-49ca-a4ec-c49476e66857 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:39.578260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b375455f-666c-42db-aede-840729939f6d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:39.620444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a54e4f08-e882-49ca-a4ec-c49476e66857 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:39.620986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b375455f-666c-42db-aede-840729939f6d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:39.621775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b375455f-666c-42db-aede-840729939f6d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:39.623003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a54e4f08-e882-49ca-a4ec-c49476e66857 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:39.623639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b375455f-666c-42db-aede-840729939f6d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:39.626824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a54e4f08-e882-49ca-a4ec-c49476e66857 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:39.628565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b375455f-666c-42db-aede-840729939f6d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:39.629247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b375455f-666c-42db-aede-840729939f6d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:39.629774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a54e4f08-e882-49ca-a4ec-c49476e66857 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:39.630379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b375455f-666c-42db-aede-840729939f6d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:39.631055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a54e4f08-e882-49ca-a4ec-c49476e66857 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:39.636608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a54e4f08-e882-49ca-a4ec-c49476e66857 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:39.784789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b375455f-666c-42db-aede-840729939f6d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:39.803668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b375455f-666c-42db-aede-840729939f6d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:39.805917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b375455f-666c-42db-aede-840729939f6d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:39.809340 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b375455f-666c-42db-aede-840729939f6d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1872 microversion: 2.42 time: 0.250296 Aug 27 05:04:39.812230 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2799/5643] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:39 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1872 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:40.367811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a54e4f08-e882-49ca-a4ec-c49476e66857 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:40.393475 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a54e4f08-e882-49ca-a4ec-c49476e66857 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1683 microversion: 2.1 time: 0.845231 Aug 27 05:04:40.395331 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2845/5644] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:39 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1683 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:40.839285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-602d2f62-729e-4cf5-91a1-c7d860965824 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:40.839790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-602d2f62-729e-4cf5-91a1-c7d860965824 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:40.852825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-602d2f62-729e-4cf5-91a1-c7d860965824 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:40.854157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-602d2f62-729e-4cf5-91a1-c7d860965824 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:40.859277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-602d2f62-729e-4cf5-91a1-c7d860965824 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:40.860329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-602d2f62-729e-4cf5-91a1-c7d860965824 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:40.861028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-602d2f62-729e-4cf5-91a1-c7d860965824 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:40.861681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-602d2f62-729e-4cf5-91a1-c7d860965824 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:41.048939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-602d2f62-729e-4cf5-91a1-c7d860965824 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:41.064033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-602d2f62-729e-4cf5-91a1-c7d860965824 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:41.069521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-602d2f62-729e-4cf5-91a1-c7d860965824 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:41.073581 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-602d2f62-729e-4cf5-91a1-c7d860965824 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1872 microversion: 2.42 time: 0.239127 Aug 27 05:04:41.076674 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2800/5645] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:40 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1872 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:42.099668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c47fd241-a42b-4905-8e19-84d5cec84daf tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:42.101492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c47fd241-a42b-4905-8e19-84d5cec84daf tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:42.118827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c47fd241-a42b-4905-8e19-84d5cec84daf tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:42.121976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c47fd241-a42b-4905-8e19-84d5cec84daf tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:42.122505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c47fd241-a42b-4905-8e19-84d5cec84daf tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:42.123274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c47fd241-a42b-4905-8e19-84d5cec84daf tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:42.123760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c47fd241-a42b-4905-8e19-84d5cec84daf tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:42.124658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c47fd241-a42b-4905-8e19-84d5cec84daf tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:42.329660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c47fd241-a42b-4905-8e19-84d5cec84daf tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:42.353789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c47fd241-a42b-4905-8e19-84d5cec84daf tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:42.357762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c47fd241-a42b-4905-8e19-84d5cec84daf tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:42.361577 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c47fd241-a42b-4905-8e19-84d5cec84daf tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1872 microversion: 2.42 time: 0.263739 Aug 27 05:04:42.365113 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2846/5646] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:42 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1872 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:04:42.386703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-cfee842d-b3e8-4599-8b06-2ce81272c52b req-d3bdcaf3-5820-45a1-8d43-a55d024deb6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c", "name": "network-vif-plugged", "status": "completed", "tag": "1c0cd31d-1134-43c3-8033-7756a472aa85"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:42.407574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cfee842d-b3e8-4599-8b06-2ce81272c52b req-d3bdcaf3-5820-45a1-8d43-a55d024deb6b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:42.411377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cfee842d-b3e8-4599-8b06-2ce81272c52b req-d3bdcaf3-5820-45a1-8d43-a55d024deb6b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:42.411851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cfee842d-b3e8-4599-8b06-2ce81272c52b req-d3bdcaf3-5820-45a1-8d43-a55d024deb6b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:42.435915 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-cfee842d-b3e8-4599-8b06-2ce81272c52b req-d3bdcaf3-5820-45a1-8d43-a55d024deb6b service nova] Creating event network-vif-plugged:1c0cd31d-1134-43c3-8033-7756a472aa85 for instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c on n-h1-854823-1 Aug 27 05:04:42.458386 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-cfee842d-b3e8-4599-8b06-2ce81272c52b req-d3bdcaf3-5820-45a1-8d43-a55d024deb6b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075722 Aug 27 05:04:42.459340 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2801/5647] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:43.396057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-785f2f4b-4d88-4ad6-a058-578e24be62d8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:43.396646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-785f2f4b-4d88-4ad6-a058-578e24be62d8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:43.414730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785f2f4b-4d88-4ad6-a058-578e24be62d8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:43.416258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785f2f4b-4d88-4ad6-a058-578e24be62d8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:43.417053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785f2f4b-4d88-4ad6-a058-578e24be62d8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:43.417842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785f2f4b-4d88-4ad6-a058-578e24be62d8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:43.418334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785f2f4b-4d88-4ad6-a058-578e24be62d8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:43.419365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-785f2f4b-4d88-4ad6-a058-578e24be62d8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:43.540604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-785f2f4b-4d88-4ad6-a058-578e24be62d8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:43.562254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-785f2f4b-4d88-4ad6-a058-578e24be62d8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:43.564098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-785f2f4b-4d88-4ad6-a058-578e24be62d8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:43.565371 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-785f2f4b-4d88-4ad6-a058-578e24be62d8 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1872 microversion: 2.42 time: 0.174196 Aug 27 05:04:43.577700 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2847/5648] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:43 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1872 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:44.604248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a4dffbbc-64fd-4b74-af13-f73815dfa529 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:44.605600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a4dffbbc-64fd-4b74-af13-f73815dfa529 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:44.621543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4dffbbc-64fd-4b74-af13-f73815dfa529 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:44.622994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4dffbbc-64fd-4b74-af13-f73815dfa529 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:44.623730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4dffbbc-64fd-4b74-af13-f73815dfa529 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:44.625443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4dffbbc-64fd-4b74-af13-f73815dfa529 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:44.626001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4dffbbc-64fd-4b74-af13-f73815dfa529 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:44.626694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4dffbbc-64fd-4b74-af13-f73815dfa529 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:44.718410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a4dffbbc-64fd-4b74-af13-f73815dfa529 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:44.732273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a4dffbbc-64fd-4b74-af13-f73815dfa529 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:44.734448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a4dffbbc-64fd-4b74-af13-f73815dfa529 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:44.735978 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a4dffbbc-64fd-4b74-af13-f73815dfa529 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1872 microversion: 2.42 time: 0.137896 Aug 27 05:04:44.737351 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2802/5649] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:44 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1872 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:45.360599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2079503182", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1893726088", "security_groups": [{"name": "tempest-secgroup-smoke-933956386"}], "block_device_mapping_v2": [{"uuid": "0268c68b-cd52-4ccf-a8a6-907a0ebfe5f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b9321d5-af89-499e-b147-430b2ec333ca"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:45.571019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] validate_networks() for [('0b9321d5-af89-499e-b147-430b2ec333ca', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:04:45.765590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7d6f5190-7fac-472c-adb2-2d802359b0d5 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:45.766261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7d6f5190-7fac-472c-adb2-2d802359b0d5 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:45.777538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d6f5190-7fac-472c-adb2-2d802359b0d5 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:45.778342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d6f5190-7fac-472c-adb2-2d802359b0d5 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:45.779708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d6f5190-7fac-472c-adb2-2d802359b0d5 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:45.780650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d6f5190-7fac-472c-adb2-2d802359b0d5 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:45.781275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d6f5190-7fac-472c-adb2-2d802359b0d5 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:45.781925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7d6f5190-7fac-472c-adb2-2d802359b0d5 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:45.889836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7d6f5190-7fac-472c-adb2-2d802359b0d5 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:45.900222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7d6f5190-7fac-472c-adb2-2d802359b0d5 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:45.901973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7d6f5190-7fac-472c-adb2-2d802359b0d5 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:45.904113 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7d6f5190-7fac-472c-adb2-2d802359b0d5 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1872 microversion: 2.42 time: 0.142442 Aug 27 05:04:45.918148 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2803/5650] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:45 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1872 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:04:46.170240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:04:46.170929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:04:46.171596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:04:46.172337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:04:46.173051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:04:46.184230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:46.184811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:46.185412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:46.186336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:46.186973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:46.187689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:46.212442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:04:46.219240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for user 8376c4e2cf814a8b8b1e2a8e404b0187 and project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:04:46.310639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:04:46.313142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0268c68b-cd52-4ccf-a8a6-907a0ebfe5f7',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:04:46.510271 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba0264ee-a576-4137-a2b9-6e43f5b3a40d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.152167 Aug 27 05:04:46.512050 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2848/5651] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:04:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:04:46.523906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4df3dd9b-e775-4a62-95cd-0537798640cf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:46.524369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4df3dd9b-e775-4a62-95cd-0537798640cf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:46.666784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4df3dd9b-e775-4a62-95cd-0537798640cf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:46.675653 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4df3dd9b-e775-4a62-95cd-0537798640cf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1095 microversion: 2.1 time: 0.155394 Aug 27 05:04:46.677575 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2804/5652] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:46 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1095 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:46.933992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf3e9762-45fe-4a1b-a45f-205eebabcc7c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:46.934406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf3e9762-45fe-4a1b-a45f-205eebabcc7c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:46.946801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3e9762-45fe-4a1b-a45f-205eebabcc7c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:46.947579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3e9762-45fe-4a1b-a45f-205eebabcc7c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:46.948071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3e9762-45fe-4a1b-a45f-205eebabcc7c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:46.948826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3e9762-45fe-4a1b-a45f-205eebabcc7c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:46.949313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3e9762-45fe-4a1b-a45f-205eebabcc7c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:46.949764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf3e9762-45fe-4a1b-a45f-205eebabcc7c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:47.067004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bf3e9762-45fe-4a1b-a45f-205eebabcc7c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:47.077859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bf3e9762-45fe-4a1b-a45f-205eebabcc7c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:47.083617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bf3e9762-45fe-4a1b-a45f-205eebabcc7c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:47.085614 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf3e9762-45fe-4a1b-a45f-205eebabcc7c tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1872 microversion: 2.42 time: 0.155818 Aug 27 05:04:47.089145 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2849/5653] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:46 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1872 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:47.700312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e0d0404-29d9-4a5d-b745-d82ba095b198 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:47.701028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e0d0404-29d9-4a5d-b745-d82ba095b198 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:47.709009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e0d0404-29d9-4a5d-b745-d82ba095b198 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:47.709510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e0d0404-29d9-4a5d-b745-d82ba095b198 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:47.709951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e0d0404-29d9-4a5d-b745-d82ba095b198 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:47.710659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e0d0404-29d9-4a5d-b745-d82ba095b198 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:47.711118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e0d0404-29d9-4a5d-b745-d82ba095b198 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:47.711546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e0d0404-29d9-4a5d-b745-d82ba095b198 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:47.801920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9e0d0404-29d9-4a5d-b745-d82ba095b198 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:47.821511 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e0d0404-29d9-4a5d-b745-d82ba095b198 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1193 microversion: 2.1 time: 0.126287 Aug 27 05:04:47.822738 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2805/5654] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:47 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1193 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:48.112488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0a0b9ab-c67d-46b5-b2d9-b012966d499a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:48.113319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0a0b9ab-c67d-46b5-b2d9-b012966d499a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:48.123714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a0b9ab-c67d-46b5-b2d9-b012966d499a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:48.137404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a0b9ab-c67d-46b5-b2d9-b012966d499a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:48.138852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a0b9ab-c67d-46b5-b2d9-b012966d499a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:48.139871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a0b9ab-c67d-46b5-b2d9-b012966d499a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:48.140603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a0b9ab-c67d-46b5-b2d9-b012966d499a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:48.141269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a0b9ab-c67d-46b5-b2d9-b012966d499a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:48.292904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0a0b9ab-c67d-46b5-b2d9-b012966d499a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:48.339538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0a0b9ab-c67d-46b5-b2d9-b012966d499a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:48.342157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0a0b9ab-c67d-46b5-b2d9-b012966d499a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:48.344087 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0a0b9ab-c67d-46b5-b2d9-b012966d499a tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1872 microversion: 2.42 time: 0.236590 Aug 27 05:04:48.344828 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2850/5655] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:48 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1872 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:48.849708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6534e639-d558-4b2e-a709-8099fe68a1ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:48.850533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6534e639-d558-4b2e-a709-8099fe68a1ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:48.856063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=64 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:48.869642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6534e639-d558-4b2e-a709-8099fe68a1ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:48.875466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6534e639-d558-4b2e-a709-8099fe68a1ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:48.875940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6534e639-d558-4b2e-a709-8099fe68a1ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:48.876941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6534e639-d558-4b2e-a709-8099fe68a1ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:48.877427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6534e639-d558-4b2e-a709-8099fe68a1ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:48.877857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6534e639-d558-4b2e-a709-8099fe68a1ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:49.106029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6534e639-d558-4b2e-a709-8099fe68a1ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:49.116752 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6534e639-d558-4b2e-a709-8099fe68a1ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1211 microversion: 2.1 time: 0.274059 Aug 27 05:04:49.119630 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2806/5656] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:48 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1211 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:49.371556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:49.372118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:49.382777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:49.384287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:49.387121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:49.387609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:49.391242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:49.391751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:49.392203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:49.478846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:49.479609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:49.480235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:49.481422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lazy-loading 'fault' on Instance uuid a473312c-429d-4aab-89d5-013329683a64 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:04:49.596497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:49.612246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:49.615483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '809234c837b04efca610afdf479c4f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a51afac6daf4c628cbd076b7aad9ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:49.620039 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c21e323-9b83-47dc-9c5e-7eb650e33aec tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 200 len: 1877 microversion: 2.42 time: 0.254336 Aug 27 05:04:49.625937 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2851/5657] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:49 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 1877 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:04:50.144170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0fbb2bc8-ce14-40c5-a57d-0e6a2f69b794 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:50.144820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0fbb2bc8-ce14-40c5-a57d-0e6a2f69b794 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:50.159263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fbb2bc8-ce14-40c5-a57d-0e6a2f69b794 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:50.159830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fbb2bc8-ce14-40c5-a57d-0e6a2f69b794 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:50.160296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fbb2bc8-ce14-40c5-a57d-0e6a2f69b794 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:50.161128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fbb2bc8-ce14-40c5-a57d-0e6a2f69b794 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:50.161580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fbb2bc8-ce14-40c5-a57d-0e6a2f69b794 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:50.162180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fbb2bc8-ce14-40c5-a57d-0e6a2f69b794 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:50.323495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0fbb2bc8-ce14-40c5-a57d-0e6a2f69b794 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:50.332237 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0fbb2bc8-ce14-40c5-a57d-0e6a2f69b794 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1278 microversion: 2.1 time: 0.192059 Aug 27 05:04:50.346266 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2807/5658] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:50 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:50.651665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c626c1ce-e4b8-4836-bdf8-78a26dbe6d30 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:50.654209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c626c1ce-e4b8-4836-bdf8-78a26dbe6d30 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:50.667872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c626c1ce-e4b8-4836-bdf8-78a26dbe6d30 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:50.669237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c626c1ce-e4b8-4836-bdf8-78a26dbe6d30 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:50.669960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c626c1ce-e4b8-4836-bdf8-78a26dbe6d30 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:50.671058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c626c1ce-e4b8-4836-bdf8-78a26dbe6d30 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:50.672345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c626c1ce-e4b8-4836-bdf8-78a26dbe6d30 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:50.673275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c626c1ce-e4b8-4836-bdf8-78a26dbe6d30 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:50.692824 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c626c1ce-e4b8-4836-bdf8-78a26dbe6d30 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] HTTP exception thrown: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c626c1ce-e4b8-4836-bdf8-78a26dbe6d30 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Request method failure captured: Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 HTTP/1.1 Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaSH2iag4lLpt7eY0oI2CX4vMkBcCkEh_9_LLgek9RWGvt-QTsHKgvtYBDmSBWti8f8wmRKYHQMz2lYBgxWZWUzOUHqBzoWDbJIDMPoEg4I1WT5GFZKGK3r1t8iAHkr6FW-o08_BgkfgvabSvDWp2TOfWkJQlcWkv9XToQKddy2wflQ Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 7a51afac6daf4c628cbd076b7aad9ee7 Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1074440844 Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7a51afac6daf4c628cbd076b7aad9ee7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7a51afac6daf4c628cbd076b7aad9ee7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7a51afac6daf4c628cbd076b7aad9ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7a51afac6daf4c628cbd076b7aad9ee7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1074440844 Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 7a51afac6daf4c628cbd076b7aad9ee7 Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1074440844 Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TaggedBootDevicesTest_v242-1074440844-project Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 809234c837b04efca610afdf479c4f86 Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1074440844-project Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'a473312c-429d-4aab-89d5-013329683a64'} Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:50.695028 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:50.701493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:50.701493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:50.701493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:50.701493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:50.701493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:50.701493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:50.701493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:50.701493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:04:50.702999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c626c1ce-e4b8-4836-bdf8-78a26dbe6d30 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Returning 404 to user: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:50.704085 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c626c1ce-e4b8-4836-bdf8-78a26dbe6d30 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 404 len: 111 microversion: 2.42 time: 0.058962 Aug 27 05:04:50.704917 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2852/5659] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:50 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:04:50.713952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fcb0b3ba-6fe1-48ce-b69c-e1c30c3345e6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '.version_select at 0x7f1f20f3dd30>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:50.735944 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fcb0b3ba-6fe1-48ce-b69c-e1c30c3345e6 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-259684562" status: 204 len: 0 microversion: 2.42 time: 0.026126 Aug 27 05:04:50.736967 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2808/5660] 10.222.0.79 () {60 vars in 1259 bytes} [Sat Aug 27 05:04:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-259684562 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:04:51.286888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4d32eb35-a5b7-40e2-86ae-1b9724758d96 req-499c216e-c6c8-4ab6-b985-629770dad8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a094869-315b-493d-ad12-b727bfae7d9e", "tag": "5c5d6f80-5b1c-4d96-bd9a-6f0981657a28"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:04:51.324713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4d32eb35-a5b7-40e2-86ae-1b9724758d96 req-499c216e-c6c8-4ab6-b985-629770dad8d7 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:51.327000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4d32eb35-a5b7-40e2-86ae-1b9724758d96 req-499c216e-c6c8-4ab6-b985-629770dad8d7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:51.327629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4d32eb35-a5b7-40e2-86ae-1b9724758d96 req-499c216e-c6c8-4ab6-b985-629770dad8d7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:51.355456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8a0730b4-eabd-4344-945d-719992c3f520 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:51.355853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8a0730b4-eabd-4344-945d-719992c3f520 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:51.361475 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4d32eb35-a5b7-40e2-86ae-1b9724758d96 req-499c216e-c6c8-4ab6-b985-629770dad8d7 service nova] Creating event network-changed:5c5d6f80-5b1c-4d96-bd9a-6f0981657a28 for instance 7a094869-315b-493d-ad12-b727bfae7d9e on n-h2-854823-1 Aug 27 05:04:51.372853 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4d32eb35-a5b7-40e2-86ae-1b9724758d96 req-499c216e-c6c8-4ab6-b985-629770dad8d7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088893 Aug 27 05:04:51.374351 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2853/5661] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:04:51.379092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a0730b4-eabd-4344-945d-719992c3f520 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:51.381052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a0730b4-eabd-4344-945d-719992c3f520 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:51.382572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a0730b4-eabd-4344-945d-719992c3f520 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:51.389592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a0730b4-eabd-4344-945d-719992c3f520 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:51.390436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a0730b4-eabd-4344-945d-719992c3f520 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:51.391121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a0730b4-eabd-4344-945d-719992c3f520 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:51.854783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8a0730b4-eabd-4344-945d-719992c3f520 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:51.863727 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8a0730b4-eabd-4344-945d-719992c3f520 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1278 microversion: 2.1 time: 0.514081 Aug 27 05:04:51.872066 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2809/5662] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:51 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1278 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:04:52.892954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f305d7e7-3ab4-428c-83ce-f221598c754e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:52.894275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f305d7e7-3ab4-428c-83ce-f221598c754e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:52.901555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f305d7e7-3ab4-428c-83ce-f221598c754e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:52.902424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f305d7e7-3ab4-428c-83ce-f221598c754e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:52.903143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f305d7e7-3ab4-428c-83ce-f221598c754e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:52.904109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f305d7e7-3ab4-428c-83ce-f221598c754e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:52.904885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f305d7e7-3ab4-428c-83ce-f221598c754e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:52.905560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f305d7e7-3ab4-428c-83ce-f221598c754e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:52.911007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:53.553182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f305d7e7-3ab4-428c-83ce-f221598c754e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:53.567295 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f305d7e7-3ab4-428c-83ce-f221598c754e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1278 microversion: 2.1 time: 0.679461 Aug 27 05:04:53.567898 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2854/5663] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:52 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1278 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:54.593955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-40c8301a-022b-482b-bfe5-0d4eae425cda tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:54.594596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-40c8301a-022b-482b-bfe5-0d4eae425cda tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:54.621606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c8301a-022b-482b-bfe5-0d4eae425cda tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:54.622652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c8301a-022b-482b-bfe5-0d4eae425cda tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:54.623089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c8301a-022b-482b-bfe5-0d4eae425cda tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:54.623988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c8301a-022b-482b-bfe5-0d4eae425cda tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:54.624754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c8301a-022b-482b-bfe5-0d4eae425cda tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:54.625187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c8301a-022b-482b-bfe5-0d4eae425cda tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:55.070650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-40c8301a-022b-482b-bfe5-0d4eae425cda tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:55.099853 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-40c8301a-022b-482b-bfe5-0d4eae425cda tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1278 microversion: 2.1 time: 0.513542 Aug 27 05:04:55.100819 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2810/5664] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:54 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1278 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:56.125672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ddaac5f-1a70-4c78-81ee-5f9e1c26441d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:56.126878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ddaac5f-1a70-4c78-81ee-5f9e1c26441d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:56.134792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ddaac5f-1a70-4c78-81ee-5f9e1c26441d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.135612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ddaac5f-1a70-4c78-81ee-5f9e1c26441d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.136237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ddaac5f-1a70-4c78-81ee-5f9e1c26441d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.137194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ddaac5f-1a70-4c78-81ee-5f9e1c26441d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.137871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ddaac5f-1a70-4c78-81ee-5f9e1c26441d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.138481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ddaac5f-1a70-4c78-81ee-5f9e1c26441d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.200478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:56.228748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:56.626441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-050f2a15-8692-4d2d-87aa-3f548ff93869 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:56.627202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-050f2a15-8692-4d2d-87aa-3f548ff93869 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:56.642561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-050f2a15-8692-4d2d-87aa-3f548ff93869 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.645208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-050f2a15-8692-4d2d-87aa-3f548ff93869 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.645835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-050f2a15-8692-4d2d-87aa-3f548ff93869 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.647850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-050f2a15-8692-4d2d-87aa-3f548ff93869 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.649131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-050f2a15-8692-4d2d-87aa-3f548ff93869 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.649756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-050f2a15-8692-4d2d-87aa-3f548ff93869 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.674843 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-050f2a15-8692-4d2d-87aa-3f548ff93869 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] HTTP exception thrown: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-050f2a15-8692-4d2d-87aa-3f548ff93869 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Request method failure captured: Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 HTTP/1.1 Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaSH2iag4lLpt7eY0oI2CX4vMkBcCkEh_9_LLgek9RWGvt-QTsHKgvtYBDmSBWti8f8wmRKYHQMz2lYBgxWZWUzOUHqBzoWDbJIDMPoEg4I1WT5GFZKGK3r1t8iAHkr6FW-o08_BgkfgvabSvDWp2TOfWkJQlcWkv9XToQKddy2wflQ Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 7a51afac6daf4c628cbd076b7aad9ee7 Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1074440844 Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7a51afac6daf4c628cbd076b7aad9ee7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7a51afac6daf4c628cbd076b7aad9ee7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7a51afac6daf4c628cbd076b7aad9ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7a51afac6daf4c628cbd076b7aad9ee7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1074440844 Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 7a51afac6daf4c628cbd076b7aad9ee7 Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1074440844 Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TaggedBootDevicesTest_v242-1074440844-project Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 809234c837b04efca610afdf479c4f86 Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1074440844-project Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'a473312c-429d-4aab-89d5-013329683a64'} Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:04:56.676818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:04:56.681866 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:56.681866 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:56.681866 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:56.681866 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:56.681866 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:56.681866 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:56.681866 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:56.681866 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:56.681866 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:56.681866 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:56.681866 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:56.684393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-050f2a15-8692-4d2d-87aa-3f548ff93869 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Returning 404 to user: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:56.685712 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-050f2a15-8692-4d2d-87aa-3f548ff93869 tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 404 len: 111 microversion: 2.42 time: 0.065677 Aug 27 05:04:56.689747 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2811/5665] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 05:04:56 2022] DELETE /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 05:04:56.691628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:56.698519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c765d3f2-7211-43ea-b618-02a3897b439d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:56.699369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c765d3f2-7211-43ea-b618-02a3897b439d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] [instance: a473312c-429d-4aab-89d5-013329683a64] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:56.708871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ddaac5f-1a70-4c78-81ee-5f9e1c26441d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:56.721029 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ddaac5f-1a70-4c78-81ee-5f9e1c26441d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1266 microversion: 2.1 time: 0.600538 Aug 27 05:04:56.723828 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2855/5666] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:56 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1266 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:56.726334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c765d3f2-7211-43ea-b618-02a3897b439d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.727041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c765d3f2-7211-43ea-b618-02a3897b439d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.727631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c765d3f2-7211-43ea-b618-02a3897b439d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.728571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c765d3f2-7211-43ea-b618-02a3897b439d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:56.729319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c765d3f2-7211-43ea-b618-02a3897b439d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:56.729887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c765d3f2-7211-43ea-b618-02a3897b439d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:56.751984 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-c765d3f2-7211-43ea-b618-02a3897b439d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] HTTP exception thrown: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c765d3f2-7211-43ea-b618-02a3897b439d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Request method failure captured: Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 HTTP/1.1 Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaSH2iag4lLpt7eY0oI2CX4vMkBcCkEh_9_LLgek9RWGvt-QTsHKgvtYBDmSBWti8f8wmRKYHQMz2lYBgxWZWUzOUHqBzoWDbJIDMPoEg4I1WT5GFZKGK3r1t8iAHkr6FW-o08_BgkfgvabSvDWp2TOfWkJQlcWkv9XToQKddy2wflQ Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 7a51afac6daf4c628cbd076b7aad9ee7 Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1074440844 Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7a51afac6daf4c628cbd076b7aad9ee7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7a51afac6daf4c628cbd076b7aad9ee7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7a51afac6daf4c628cbd076b7aad9ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7a51afac6daf4c628cbd076b7aad9ee7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1074440844 Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 7a51afac6daf4c628cbd076b7aad9ee7 Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1074440844 Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TaggedBootDevicesTest_v242-1074440844-project Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 809234c837b04efca610afdf479c4f86 Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1074440844-project Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'a473312c-429d-4aab-89d5-013329683a64'} Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:56.754979 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:04:56.759818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:56.759818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:04:56.759818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:04:56.759818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:04:56.759818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:04:56.759818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:04:56.759818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. Aug 27 05:04:56.759818 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:04:56.762212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c765d3f2-7211-43ea-b618-02a3897b439d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] Returning 404 to user: Instance a473312c-429d-4aab-89d5-013329683a64 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:04:56.764349 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c765d3f2-7211-43ea-b618-02a3897b439d tempest-TaggedBootDevicesTest_v242-1074440844 tempest-TaggedBootDevicesTest_v242-1074440844-project] 10.222.0.79 "GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64" status: 404 len: 111 microversion: 2.42 time: 0.073395 Aug 27 05:04:56.770262 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2812/5667] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:04:56 2022] GET /compute/v2.1/servers/a473312c-429d-4aab-89d5-013329683a64 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:04:57.743753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce4d2903-07c2-47d2-9edd-15d5da09bab3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:57.745743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce4d2903-07c2-47d2-9edd-15d5da09bab3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:57.754053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce4d2903-07c2-47d2-9edd-15d5da09bab3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:57.754928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce4d2903-07c2-47d2-9edd-15d5da09bab3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:57.755765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce4d2903-07c2-47d2-9edd-15d5da09bab3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:57.756723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce4d2903-07c2-47d2-9edd-15d5da09bab3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:57.757450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce4d2903-07c2-47d2-9edd-15d5da09bab3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:57.758112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce4d2903-07c2-47d2-9edd-15d5da09bab3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:58.015348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce4d2903-07c2-47d2-9edd-15d5da09bab3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:58.024488 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce4d2903-07c2-47d2-9edd-15d5da09bab3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1266 microversion: 2.1 time: 0.284710 Aug 27 05:04:58.025662 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2856/5668] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:57 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:04:59.048956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f58ef94b-0362-46dc-acd3-35713f1284e1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:04:59.050214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f58ef94b-0362-46dc-acd3-35713f1284e1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:04:59.061652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f58ef94b-0362-46dc-acd3-35713f1284e1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:59.067994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f58ef94b-0362-46dc-acd3-35713f1284e1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:59.068768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f58ef94b-0362-46dc-acd3-35713f1284e1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:59.069713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f58ef94b-0362-46dc-acd3-35713f1284e1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:04:59.071540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f58ef94b-0362-46dc-acd3-35713f1284e1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:04:59.072172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f58ef94b-0362-46dc-acd3-35713f1284e1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:04:59.105139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:59.264513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f58ef94b-0362-46dc-acd3-35713f1284e1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:04:59.278476 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f58ef94b-0362-46dc-acd3-35713f1284e1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1266 microversion: 2.1 time: 0.232739 Aug 27 05:04:59.282395 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2813/5669] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:04:59 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:00.303042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d61a881-1f2c-4367-a763-a9d8396da6e2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:00.303604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d61a881-1f2c-4367-a763-a9d8396da6e2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:00.311793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d61a881-1f2c-4367-a763-a9d8396da6e2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.312322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d61a881-1f2c-4367-a763-a9d8396da6e2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.312989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d61a881-1f2c-4367-a763-a9d8396da6e2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.313763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d61a881-1f2c-4367-a763-a9d8396da6e2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:00.314249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d61a881-1f2c-4367-a763-a9d8396da6e2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:00.314731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d61a881-1f2c-4367-a763-a9d8396da6e2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:00.607003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d61a881-1f2c-4367-a763-a9d8396da6e2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:00.619177 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d61a881-1f2c-4367-a763-a9d8396da6e2 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1266 microversion: 2.1 time: 0.318747 Aug 27 05:05:00.636665 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2857/5670] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:00 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:01.640793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d163c0e8-da8a-4f3f-b206-7b8fa1f09a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:01.641988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d163c0e8-da8a-4f3f-b206-7b8fa1f09a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:01.649773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d163c0e8-da8a-4f3f-b206-7b8fa1f09a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:01.650583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d163c0e8-da8a-4f3f-b206-7b8fa1f09a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:01.651261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d163c0e8-da8a-4f3f-b206-7b8fa1f09a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:01.652184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d163c0e8-da8a-4f3f-b206-7b8fa1f09a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:01.653476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d163c0e8-da8a-4f3f-b206-7b8fa1f09a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:01.654130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d163c0e8-da8a-4f3f-b206-7b8fa1f09a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:01.883344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d163c0e8-da8a-4f3f-b206-7b8fa1f09a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:01.896427 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d163c0e8-da8a-4f3f-b206-7b8fa1f09a60 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1266 microversion: 2.1 time: 0.259463 Aug 27 05:05:01.898680 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2814/5671] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:01 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:02.922369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-953fdd53-e202-4d3a-aaff-e6690a8d10c9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:02.923888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-953fdd53-e202-4d3a-aaff-e6690a8d10c9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:02.933961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-953fdd53-e202-4d3a-aaff-e6690a8d10c9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:02.934825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-953fdd53-e202-4d3a-aaff-e6690a8d10c9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:02.935622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-953fdd53-e202-4d3a-aaff-e6690a8d10c9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:02.936616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-953fdd53-e202-4d3a-aaff-e6690a8d10c9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:02.937289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-953fdd53-e202-4d3a-aaff-e6690a8d10c9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:02.938147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-953fdd53-e202-4d3a-aaff-e6690a8d10c9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:03.406454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-953fdd53-e202-4d3a-aaff-e6690a8d10c9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:03.414881 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-953fdd53-e202-4d3a-aaff-e6690a8d10c9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1266 microversion: 2.1 time: 0.500541 Aug 27 05:05:03.429084 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2858/5672] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:02 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1266 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:04.438237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-02d0b860-88c9-4746-8347-cf3b5d299bcf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:04.438951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-02d0b860-88c9-4746-8347-cf3b5d299bcf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:04.449054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02d0b860-88c9-4746-8347-cf3b5d299bcf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:04.451604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02d0b860-88c9-4746-8347-cf3b5d299bcf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:04.452394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02d0b860-88c9-4746-8347-cf3b5d299bcf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:04.453821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02d0b860-88c9-4746-8347-cf3b5d299bcf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:04.454466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02d0b860-88c9-4746-8347-cf3b5d299bcf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:04.455070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02d0b860-88c9-4746-8347-cf3b5d299bcf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:04.658498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-02d0b860-88c9-4746-8347-cf3b5d299bcf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:04.668222 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-02d0b860-88c9-4746-8347-cf3b5d299bcf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1266 microversion: 2.1 time: 0.235496 Aug 27 05:05:04.669995 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2815/5673] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:04 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:05.692042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcdf3ffa-06e2-48d3-b08a-a72bae4fc019 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:05.692780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fcdf3ffa-06e2-48d3-b08a-a72bae4fc019 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:05.700184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcdf3ffa-06e2-48d3-b08a-a72bae4fc019 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.700719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcdf3ffa-06e2-48d3-b08a-a72bae4fc019 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.701173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcdf3ffa-06e2-48d3-b08a-a72bae4fc019 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:05.701894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcdf3ffa-06e2-48d3-b08a-a72bae4fc019 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:05.702367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcdf3ffa-06e2-48d3-b08a-a72bae4fc019 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:05.702813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcdf3ffa-06e2-48d3-b08a-a72bae4fc019 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:06.038853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fcdf3ffa-06e2-48d3-b08a-a72bae4fc019 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:06.048224 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fcdf3ffa-06e2-48d3-b08a-a72bae4fc019 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1266 microversion: 2.1 time: 0.359993 Aug 27 05:05:06.048858 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2859/5674] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:05 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:06.291271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-64d8df1b-83a5-4053-bb3c-cbc0c0d357f4 req-ce042ee9-e456-45cc-8f50-6857e4045e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a094869-315b-493d-ad12-b727bfae7d9e", "name": "network-vif-plugged", "status": "completed", "tag": "5c5d6f80-5b1c-4d96-bd9a-6f0981657a28"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:06.308812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-64d8df1b-83a5-4053-bb3c-cbc0c0d357f4 req-ce042ee9-e456-45cc-8f50-6857e4045e09 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:06.313148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-64d8df1b-83a5-4053-bb3c-cbc0c0d357f4 req-ce042ee9-e456-45cc-8f50-6857e4045e09 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:06.313791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-64d8df1b-83a5-4053-bb3c-cbc0c0d357f4 req-ce042ee9-e456-45cc-8f50-6857e4045e09 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:06.338607 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-64d8df1b-83a5-4053-bb3c-cbc0c0d357f4 req-ce042ee9-e456-45cc-8f50-6857e4045e09 service nova] Creating event network-vif-plugged:5c5d6f80-5b1c-4d96-bd9a-6f0981657a28 for instance 7a094869-315b-493d-ad12-b727bfae7d9e on n-h2-854823-1 Aug 27 05:05:06.352038 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-64d8df1b-83a5-4053-bb3c-cbc0c0d357f4 req-ce042ee9-e456-45cc-8f50-6857e4045e09 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064658 Aug 27 05:05:06.353268 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2816/5675] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:07.072454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-414f0f2f-5a61-4149-8553-861a87d42ad0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:07.073128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-414f0f2f-5a61-4149-8553-861a87d42ad0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:07.087029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-414f0f2f-5a61-4149-8553-861a87d42ad0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:07.089527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-414f0f2f-5a61-4149-8553-861a87d42ad0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:07.090047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-414f0f2f-5a61-4149-8553-861a87d42ad0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:07.090860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-414f0f2f-5a61-4149-8553-861a87d42ad0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:07.097064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-414f0f2f-5a61-4149-8553-861a87d42ad0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:07.098002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-414f0f2f-5a61-4149-8553-861a87d42ad0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:07.351880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-414f0f2f-5a61-4149-8553-861a87d42ad0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:07.360744 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-414f0f2f-5a61-4149-8553-861a87d42ad0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1266 microversion: 2.1 time: 0.292682 Aug 27 05:05:07.375997 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2860/5676] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:07 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:08.386717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-46e274e0-4f51-4ee8-80be-8f943ade75a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:08.387132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-46e274e0-4f51-4ee8-80be-8f943ade75a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:08.405677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46e274e0-4f51-4ee8-80be-8f943ade75a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.406177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46e274e0-4f51-4ee8-80be-8f943ade75a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.406616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46e274e0-4f51-4ee8-80be-8f943ade75a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:08.410967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46e274e0-4f51-4ee8-80be-8f943ade75a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.411937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46e274e0-4f51-4ee8-80be-8f943ade75a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.426217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46e274e0-4f51-4ee8-80be-8f943ade75a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:08.723926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-46e274e0-4f51-4ee8-80be-8f943ade75a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:08.740311 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-46e274e0-4f51-4ee8-80be-8f943ade75a0 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1453 microversion: 2.1 time: 0.360418 Aug 27 05:05:08.753183 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2817/5677] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:08 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1453 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:08.780848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d81d8aa2-1b50-4329-bfd5-aefca31398b8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:08.782383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d81d8aa2-1b50-4329-bfd5-aefca31398b8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:08.791539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d81d8aa2-1b50-4329-bfd5-aefca31398b8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.793772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d81d8aa2-1b50-4329-bfd5-aefca31398b8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.794490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d81d8aa2-1b50-4329-bfd5-aefca31398b8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:08.795489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d81d8aa2-1b50-4329-bfd5-aefca31398b8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:08.796185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d81d8aa2-1b50-4329-bfd5-aefca31398b8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:08.796872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d81d8aa2-1b50-4329-bfd5-aefca31398b8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:09.200628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d81d8aa2-1b50-4329-bfd5-aefca31398b8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:09.211738 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d81d8aa2-1b50-4329-bfd5-aefca31398b8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1453 microversion: 2.1 time: 0.436023 Aug 27 05:05:09.217434 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2861/5678] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:08 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1453 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:11.970440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-4114314b-6fbb-485f-9b97-92a38b04286f req-89fb312d-99d1-49bd-851e-523fdee5c813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a094869-315b-493d-ad12-b727bfae7d9e", "tag": "5c5d6f80-5b1c-4d96-bd9a-6f0981657a28"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:11.988741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4114314b-6fbb-485f-9b97-92a38b04286f req-89fb312d-99d1-49bd-851e-523fdee5c813 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:11.993646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4114314b-6fbb-485f-9b97-92a38b04286f req-89fb312d-99d1-49bd-851e-523fdee5c813 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:11.994195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4114314b-6fbb-485f-9b97-92a38b04286f req-89fb312d-99d1-49bd-851e-523fdee5c813 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:12.024768 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-4114314b-6fbb-485f-9b97-92a38b04286f req-89fb312d-99d1-49bd-851e-523fdee5c813 service nova] Creating event network-changed:5c5d6f80-5b1c-4d96-bd9a-6f0981657a28 for instance 7a094869-315b-493d-ad12-b727bfae7d9e on n-h2-854823-1 Aug 27 05:05:12.030587 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-4114314b-6fbb-485f-9b97-92a38b04286f req-89fb312d-99d1-49bd-851e-523fdee5c813 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065177 Aug 27 05:05:12.031690 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2818/5679] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:21.018622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8c1f8af-1fd3-499d-b8d7-4cb4ef3f209c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:21.021638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a8c1f8af-1fd3-499d-b8d7-4cb4ef3f209c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:21.050088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=23 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:21.054419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=46 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:21.057361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c1f8af-1fd3-499d-b8d7-4cb4ef3f209c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:21.062752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c1f8af-1fd3-499d-b8d7-4cb4ef3f209c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:21.063610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c1f8af-1fd3-499d-b8d7-4cb4ef3f209c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:21.064581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c1f8af-1fd3-499d-b8d7-4cb4ef3f209c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:21.065247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c1f8af-1fd3-499d-b8d7-4cb4ef3f209c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:21.067555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c1f8af-1fd3-499d-b8d7-4cb4ef3f209c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:21.207426 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8c1f8af-1fd3-499d-b8d7-4cb4ef3f209c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c/action" status: 200 len: 63153 microversion: 2.1 time: 0.194274 Aug 27 05:05:21.219505 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2862/5680] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:05:21 2022] POST /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c/action => generated 63153 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:05:31.555575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:31.557339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=24 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:31.925871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dd2b8ea5-5b27-490f-999f-5608803d7964 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:31.926471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dd2b8ea5-5b27-490f-999f-5608803d7964 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:31.942989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd2b8ea5-5b27-490f-999f-5608803d7964 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:31.943486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd2b8ea5-5b27-490f-999f-5608803d7964 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:31.943972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd2b8ea5-5b27-490f-999f-5608803d7964 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:31.944677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd2b8ea5-5b27-490f-999f-5608803d7964 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:31.945137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd2b8ea5-5b27-490f-999f-5608803d7964 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:31.945565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd2b8ea5-5b27-490f-999f-5608803d7964 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:31.995085 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dd2b8ea5-5b27-490f-999f-5608803d7964 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32/ips" status: 200 len: 152 microversion: 2.20 time: 0.445247 Aug 27 05:05:31.995637 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2819/5681] 10.222.0.79 () {60 vars in 1289 bytes} [Sat Aug 27 05:05:31 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32/ips => generated 152 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 05:05:33.442529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:33.443291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:33.733834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff3b747e-a08b-4d8d-b684-daf4c7b86ba8 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Action: 'create', calling method: .version_select at 0x7f1f21a0b430>, body: {"keypair": {"name": "tempest-TestServerBasicOps-2091912062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZKdMq4B4jaQb7tUz5Hjh8X43zvFQULb5Vo5oOZ613CNY3LD+CHJTu8VD1st0TFeECiKtrgX3Z/kKcv0z/mbbkmh3zN2XWz7h+lgSqatVQuy0oQ8/NYew+A9YiJXuOd4Q=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:33.768082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ff3b747e-a08b-4d8d-b684-daf4c7b86ba8 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Getting quotas for project d024d1b3e6bb4d5d9e6b6a38d346eed8. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:05:33.783381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ff3b747e-a08b-4d8d-b684-daf4c7b86ba8 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Getting quotas for user a1ef6237278a408799a22a5d83d8e7c3 and project d024d1b3e6bb4d5d9e6b6a38d346eed8. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:05:33.841510 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff3b747e-a08b-4d8d-b684-daf4c7b86ba8 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.405982 Aug 27 05:05:33.847305 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2863/5682] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:05:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:34.118638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-136315815", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "e3ee2d2a-c655-49b1-b3b3-15ea91610881"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:34.251273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] validate_networks() for [('e3ee2d2a-c655-49b1-b3b3-15ea91610881', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:05:35.278850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-114a4334-78d4-4b48-8728-c8c2718ee5c6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:35.279635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-114a4334-78d4-4b48-8728-c8c2718ee5c6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:35.298623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-114a4334-78d4-4b48-8728-c8c2718ee5c6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:35.298623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-114a4334-78d4-4b48-8728-c8c2718ee5c6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:35.298623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-114a4334-78d4-4b48-8728-c8c2718ee5c6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:35.305602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-114a4334-78d4-4b48-8728-c8c2718ee5c6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:35.306401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-114a4334-78d4-4b48-8728-c8c2718ee5c6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:35.307029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-114a4334-78d4-4b48-8728-c8c2718ee5c6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:35.383077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-114a4334-78d4-4b48-8728-c8c2718ee5c6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lazy-loading 'flavor' on Instance uuid bf34f382-9b01-4519-ba5f-78471ee22e32 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:05:35.585588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:05:35.586053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:05:35.586639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:05:35.587081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:05:35.587799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:05:35.601919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:35.602673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:35.604026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:35.606274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:35.608158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:35.609601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:35.636691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Getting quotas for project 9237f42aa1504c8eaaee4e443e4f03a6. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:05:35.643615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Getting quotas for user 1cb5adea3b6a4fd489254b022c86d288 and project 9237f42aa1504c8eaaee4e443e4f03a6. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:05:35.663495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:05:35.666726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:05:35.727636 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-114a4334-78d4-4b48-8728-c8c2718ee5c6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "POST /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32/action" status: 202 len: 0 microversion: 2.20 time: 0.454995 Aug 27 05:05:35.736021 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2864/5683] 10.222.0.79 () {62 vars in 1319 bytes} [Sat Aug 27 05:05:35 2022] POST /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:05:35.740237 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-53c9ee1e-affd-42aa-9f70-b35433d1f37d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.762417 Aug 27 05:05:35.742137 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2820/5684] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:05:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:05:35.744430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-02335247-ea9a-459b-97ab-4482869de74f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:35.745254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-02335247-ea9a-459b-97ab-4482869de74f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:35.755781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1a05abe5-8184-4abc-870c-d7d8ad61c083 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:35.756439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1a05abe5-8184-4abc-870c-d7d8ad61c083 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:35.763860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02335247-ea9a-459b-97ab-4482869de74f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:35.764366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02335247-ea9a-459b-97ab-4482869de74f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:35.764862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02335247-ea9a-459b-97ab-4482869de74f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:35.765734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02335247-ea9a-459b-97ab-4482869de74f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:35.766222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02335247-ea9a-459b-97ab-4482869de74f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:35.767525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02335247-ea9a-459b-97ab-4482869de74f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:35.946197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1a05abe5-8184-4abc-870c-d7d8ad61c083 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:35.956137 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1a05abe5-8184-4abc-870c-d7d8ad61c083 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1216 microversion: 2.1 time: 0.204305 Aug 27 05:05:35.959226 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2821/5685] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:35 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1216 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:36.027418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-02335247-ea9a-459b-97ab-4482869de74f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:36.038726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-02335247-ea9a-459b-97ab-4482869de74f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:36.040117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-02335247-ea9a-459b-97ab-4482869de74f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:36.041384 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-02335247-ea9a-459b-97ab-4482869de74f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.305322 Aug 27 05:05:36.048782 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2865/5686] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:35 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:36.855488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1345766303", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-2091912062", "security_groups": [{"name": "tempest-secgroup-smoke-727976332"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "3b49cf67-b244-4b14-a67a-bbcc94e8cec0"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:36.983585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9752a785-ad38-4107-82e9-6583d010af75 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:36.986172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9752a785-ad38-4107-82e9-6583d010af75 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:36.995318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9752a785-ad38-4107-82e9-6583d010af75 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:36.995844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9752a785-ad38-4107-82e9-6583d010af75 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:36.996963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9752a785-ad38-4107-82e9-6583d010af75 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:36.997949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9752a785-ad38-4107-82e9-6583d010af75 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:36.998629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9752a785-ad38-4107-82e9-6583d010af75 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:36.999607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9752a785-ad38-4107-82e9-6583d010af75 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:37.078158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] validate_networks() for [('3b49cf67-b244-4b14-a67a-bbcc94e8cec0', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:05:37.089727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9752a785-ad38-4107-82e9-6583d010af75 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:37.109931 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9752a785-ad38-4107-82e9-6583d010af75 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1220 microversion: 2.1 time: 0.133206 Aug 27 05:05:37.122913 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2866/5687] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:36 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1220 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:37.129532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c23a4011-8a20-40d5-a988-dd0ba79293af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:37.130330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c23a4011-8a20-40d5-a988-dd0ba79293af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:37.137626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c23a4011-8a20-40d5-a988-dd0ba79293af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:37.138274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c23a4011-8a20-40d5-a988-dd0ba79293af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:37.138724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c23a4011-8a20-40d5-a988-dd0ba79293af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:37.139747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c23a4011-8a20-40d5-a988-dd0ba79293af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:37.140370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c23a4011-8a20-40d5-a988-dd0ba79293af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:37.141027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c23a4011-8a20-40d5-a988-dd0ba79293af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:37.337701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c23a4011-8a20-40d5-a988-dd0ba79293af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:37.346868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c23a4011-8a20-40d5-a988-dd0ba79293af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:37.348810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c23a4011-8a20-40d5-a988-dd0ba79293af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:37.350962 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c23a4011-8a20-40d5-a988-dd0ba79293af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.225271 Aug 27 05:05:37.351201 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2867/5688] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:37 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:37.999314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Getting quotas for project d024d1b3e6bb4d5d9e6b6a38d346eed8. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:05:38.013061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Getting quotas for user a1ef6237278a408799a22a5d83d8e7c3 and project d024d1b3e6bb4d5d9e6b6a38d346eed8. Resources: dict_keys(['metadata_items']) {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:05:38.036037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:05:38.036479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:05:38.037221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:05:38.037824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:05:38.038434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:05:38.066941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:38.067884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:38.068573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:38.069451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:38.070134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:38.070769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:38.100940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Getting quotas for project d024d1b3e6bb4d5d9e6b6a38d346eed8. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:05:38.110412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Getting quotas for user a1ef6237278a408799a22a5d83d8e7c3 and project d024d1b3e6bb4d5d9e6b6a38d346eed8. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:05:38.130447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:05:38.133498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:05:38.151984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-647e92a6-20bd-4ae6-8b7e-d07cc0029026 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:38.153856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-647e92a6-20bd-4ae6-8b7e-d07cc0029026 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:38.170237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-647e92a6-20bd-4ae6-8b7e-d07cc0029026 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:38.177763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-647e92a6-20bd-4ae6-8b7e-d07cc0029026 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:38.179753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-647e92a6-20bd-4ae6-8b7e-d07cc0029026 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:38.181980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-647e92a6-20bd-4ae6-8b7e-d07cc0029026 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:38.182571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-647e92a6-20bd-4ae6-8b7e-d07cc0029026 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:38.184828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-647e92a6-20bd-4ae6-8b7e-d07cc0029026 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:38.218034 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b6103eb5-ea26-4463-9f64-3b061f96c868 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.367059 Aug 27 05:05:38.224081 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2822/5689] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:05:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:05:38.240307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eae82d6c-5664-46fd-b2ae-958c2498aa72 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:38.243544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eae82d6c-5664-46fd-b2ae-958c2498aa72 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:38.349816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-647e92a6-20bd-4ae6-8b7e-d07cc0029026 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:38.375111 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-647e92a6-20bd-4ae6-8b7e-d07cc0029026 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1274 microversion: 2.1 time: 0.231096 Aug 27 05:05:38.378163 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2868/5690] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:38 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:38.393073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b0f59a8d-e976-4841-997d-0c04b2c0f462 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:38.397568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b0f59a8d-e976-4841-997d-0c04b2c0f462 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:38.418879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0f59a8d-e976-4841-997d-0c04b2c0f462 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:38.424713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0f59a8d-e976-4841-997d-0c04b2c0f462 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:38.426900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0f59a8d-e976-4841-997d-0c04b2c0f462 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:38.428060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0f59a8d-e976-4841-997d-0c04b2c0f462 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:38.432024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0f59a8d-e976-4841-997d-0c04b2c0f462 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:38.433719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0f59a8d-e976-4841-997d-0c04b2c0f462 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:38.624229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eae82d6c-5664-46fd-b2ae-958c2498aa72 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:38.638922 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eae82d6c-5664-46fd-b2ae-958c2498aa72 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1303 microversion: 2.1 time: 0.405530 Aug 27 05:05:38.639554 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2823/5691] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:38 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1303 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:38.840865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0f59a8d-e976-4841-997d-0c04b2c0f462 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:38.859994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0f59a8d-e976-4841-997d-0c04b2c0f462 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:38.862641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0f59a8d-e976-4841-997d-0c04b2c0f462 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:38.872674 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b0f59a8d-e976-4841-997d-0c04b2c0f462 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.490260 Aug 27 05:05:38.877875 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2869/5692] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:38 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:39.400247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b18dc037-216e-4ccd-902f-9fedfc7e4f52 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:39.402130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b18dc037-216e-4ccd-902f-9fedfc7e4f52 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:39.411657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b18dc037-216e-4ccd-902f-9fedfc7e4f52 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:39.412796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b18dc037-216e-4ccd-902f-9fedfc7e4f52 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:39.413591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b18dc037-216e-4ccd-902f-9fedfc7e4f52 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:39.414568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b18dc037-216e-4ccd-902f-9fedfc7e4f52 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:39.415351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b18dc037-216e-4ccd-902f-9fedfc7e4f52 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:39.416029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b18dc037-216e-4ccd-902f-9fedfc7e4f52 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:39.660824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-17cc20ca-5845-42aa-a165-15b0c0fd615d tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:39.661559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-17cc20ca-5845-42aa-a165-15b0c0fd615d tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:39.675591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17cc20ca-5845-42aa-a165-15b0c0fd615d tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:39.677957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17cc20ca-5845-42aa-a165-15b0c0fd615d tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:39.678619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17cc20ca-5845-42aa-a165-15b0c0fd615d tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:39.680974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17cc20ca-5845-42aa-a165-15b0c0fd615d tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:39.681704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17cc20ca-5845-42aa-a165-15b0c0fd615d tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:39.685373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17cc20ca-5845-42aa-a165-15b0c0fd615d tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:39.707909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b18dc037-216e-4ccd-902f-9fedfc7e4f52 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:39.727971 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b18dc037-216e-4ccd-902f-9fedfc7e4f52 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1316 microversion: 2.1 time: 0.331430 Aug 27 05:05:39.729174 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2824/5693] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:39 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:39.813964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-17cc20ca-5845-42aa-a165-15b0c0fd615d tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:39.837278 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-17cc20ca-5845-42aa-a165-15b0c0fd615d tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1355 microversion: 2.1 time: 0.180732 Aug 27 05:05:39.845888 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2870/5694] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:39 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1355 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:39.908577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-73b74e96-e1c3-41f0-b792-a9c29d4459fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:39.910225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-73b74e96-e1c3-41f0-b792-a9c29d4459fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:39.924864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73b74e96-e1c3-41f0-b792-a9c29d4459fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:39.925758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73b74e96-e1c3-41f0-b792-a9c29d4459fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:39.929417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73b74e96-e1c3-41f0-b792-a9c29d4459fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:39.931172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73b74e96-e1c3-41f0-b792-a9c29d4459fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:39.931675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73b74e96-e1c3-41f0-b792-a9c29d4459fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:39.933781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73b74e96-e1c3-41f0-b792-a9c29d4459fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:40.293859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-73b74e96-e1c3-41f0-b792-a9c29d4459fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:40.302980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-73b74e96-e1c3-41f0-b792-a9c29d4459fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:40.318432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-73b74e96-e1c3-41f0-b792-a9c29d4459fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:40.319263 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-73b74e96-e1c3-41f0-b792-a9c29d4459fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.416150 Aug 27 05:05:40.336982 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2825/5695] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:39 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:40.536269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-07c067b5-bb46-46d7-b6f0-2020851a429e req-ba870b3c-df5b-4fdc-995d-1721b60082a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba63d69-1a05-41ec-9620-e772743da5ae", "tag": "bca03d46-1865-45c9-897b-833934521260"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:40.549608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-07c067b5-bb46-46d7-b6f0-2020851a429e req-ba870b3c-df5b-4fdc-995d-1721b60082a0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:40.550500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-07c067b5-bb46-46d7-b6f0-2020851a429e req-ba870b3c-df5b-4fdc-995d-1721b60082a0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:40.551220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-07c067b5-bb46-46d7-b6f0-2020851a429e req-ba870b3c-df5b-4fdc-995d-1721b60082a0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:40.568420 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-07c067b5-bb46-46d7-b6f0-2020851a429e req-ba870b3c-df5b-4fdc-995d-1721b60082a0 service nova] Creating event network-changed:bca03d46-1865-45c9-897b-833934521260 for instance cba63d69-1a05-41ec-9620-e772743da5ae on n-h1-854823-1 Aug 27 05:05:40.592700 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-07c067b5-bb46-46d7-b6f0-2020851a429e req-ba870b3c-df5b-4fdc-995d-1721b60082a0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060758 Aug 27 05:05:40.593995 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2871/5696] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:40.757267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-27e47477-a1c6-4f95-ad08-af2320ca1d4f tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:40.758437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-27e47477-a1c6-4f95-ad08-af2320ca1d4f tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:40.770489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27e47477-a1c6-4f95-ad08-af2320ca1d4f tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:40.772429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27e47477-a1c6-4f95-ad08-af2320ca1d4f tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:40.772937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27e47477-a1c6-4f95-ad08-af2320ca1d4f tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:40.773693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27e47477-a1c6-4f95-ad08-af2320ca1d4f tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:40.774161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27e47477-a1c6-4f95-ad08-af2320ca1d4f tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:40.777903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27e47477-a1c6-4f95-ad08-af2320ca1d4f tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:40.869096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac4485d3-fde2-43f7-9c74-f676a9d855e7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:40.870014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac4485d3-fde2-43f7-9c74-f676a9d855e7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:40.883845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac4485d3-fde2-43f7-9c74-f676a9d855e7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:40.886616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac4485d3-fde2-43f7-9c74-f676a9d855e7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:40.888919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac4485d3-fde2-43f7-9c74-f676a9d855e7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:40.893679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac4485d3-fde2-43f7-9c74-f676a9d855e7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:40.894522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac4485d3-fde2-43f7-9c74-f676a9d855e7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:40.895193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac4485d3-fde2-43f7-9c74-f676a9d855e7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:41.493639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac4485d3-fde2-43f7-9c74-f676a9d855e7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:41.504076 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac4485d3-fde2-43f7-9c74-f676a9d855e7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1361 microversion: 2.1 time: 0.640277 Aug 27 05:05:41.505510 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2872/5697] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:40 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1361 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:41.517231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-27e47477-a1c6-4f95-ad08-af2320ca1d4f tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:41.521935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4b88960-f5ea-499c-9da0-378012ee6f78 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:41.522983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e4b88960-f5ea-499c-9da0-378012ee6f78 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:41.530306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4b88960-f5ea-499c-9da0-378012ee6f78 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:41.531193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4b88960-f5ea-499c-9da0-378012ee6f78 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:41.531927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4b88960-f5ea-499c-9da0-378012ee6f78 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:41.532699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4b88960-f5ea-499c-9da0-378012ee6f78 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:41.533119 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-27e47477-a1c6-4f95-ad08-af2320ca1d4f tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1316 microversion: 2.1 time: 0.780862 Aug 27 05:05:41.533568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4b88960-f5ea-499c-9da0-378012ee6f78 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:41.534313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4b88960-f5ea-499c-9da0-378012ee6f78 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:41.534547 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2826/5698] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:40 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1316 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:41.839151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e4b88960-f5ea-499c-9da0-378012ee6f78 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:41.861353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e4b88960-f5ea-499c-9da0-378012ee6f78 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:41.868954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e4b88960-f5ea-499c-9da0-378012ee6f78 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:41.871929 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e4b88960-f5ea-499c-9da0-378012ee6f78 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.364549 Aug 27 05:05:41.874312 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2873/5699] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:41 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:42.529282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ed4e20c3-6fc1-4bdf-be83-bd0a233f621f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:42.530495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ed4e20c3-6fc1-4bdf-be83-bd0a233f621f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:42.555776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff3a6fe9-99ec-4359-8987-d79ba4f54cba tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:42.556418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ff3a6fe9-99ec-4359-8987-d79ba4f54cba tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:42.570490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed4e20c3-6fc1-4bdf-be83-bd0a233f621f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:42.570911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed4e20c3-6fc1-4bdf-be83-bd0a233f621f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:42.571418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed4e20c3-6fc1-4bdf-be83-bd0a233f621f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:42.578932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff3a6fe9-99ec-4359-8987-d79ba4f54cba tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:42.581318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed4e20c3-6fc1-4bdf-be83-bd0a233f621f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:42.585370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff3a6fe9-99ec-4359-8987-d79ba4f54cba tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:42.586279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed4e20c3-6fc1-4bdf-be83-bd0a233f621f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:42.586939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed4e20c3-6fc1-4bdf-be83-bd0a233f621f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:42.587596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff3a6fe9-99ec-4359-8987-d79ba4f54cba tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:42.593545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff3a6fe9-99ec-4359-8987-d79ba4f54cba tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:42.594441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff3a6fe9-99ec-4359-8987-d79ba4f54cba tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:42.597135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff3a6fe9-99ec-4359-8987-d79ba4f54cba tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:42.819446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed4e20c3-6fc1-4bdf-be83-bd0a233f621f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:42.829585 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ed4e20c3-6fc1-4bdf-be83-bd0a233f621f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1428 microversion: 2.1 time: 0.307486 Aug 27 05:05:42.833219 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2827/5700] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:42 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1428 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:42.904951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e03aee4d-0568-4ffa-8df4-8bf9e968c797 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:42.904951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e03aee4d-0568-4ffa-8df4-8bf9e968c797 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:42.913861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e03aee4d-0568-4ffa-8df4-8bf9e968c797 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:42.914813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e03aee4d-0568-4ffa-8df4-8bf9e968c797 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:42.915306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e03aee4d-0568-4ffa-8df4-8bf9e968c797 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:42.916043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e03aee4d-0568-4ffa-8df4-8bf9e968c797 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:42.917689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e03aee4d-0568-4ffa-8df4-8bf9e968c797 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:42.918551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e03aee4d-0568-4ffa-8df4-8bf9e968c797 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:43.067607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e03aee4d-0568-4ffa-8df4-8bf9e968c797 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:43.077721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e03aee4d-0568-4ffa-8df4-8bf9e968c797 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:43.079319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e03aee4d-0568-4ffa-8df4-8bf9e968c797 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:43.080669 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e03aee4d-0568-4ffa-8df4-8bf9e968c797 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.181794 Aug 27 05:05:43.081276 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2828/5701] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:42 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:05:43.125298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ff3a6fe9-99ec-4359-8987-d79ba4f54cba tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:43.136490 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff3a6fe9-99ec-4359-8987-d79ba4f54cba tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1316 microversion: 2.1 time: 0.584315 Aug 27 05:05:43.143130 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2874/5702] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:42 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1316 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:43.507456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8105fdaf-3c1d-48d2-b56b-a35e71dd3d58 req-dfc28728-58ca-48ec-be0b-433ea0555610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82956fdf-e10f-4f30-835f-9c025da46479", "tag": "000cfb7d-f84b-4f34-afa8-cf1e87bb3337"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:43.518180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8105fdaf-3c1d-48d2-b56b-a35e71dd3d58 req-dfc28728-58ca-48ec-be0b-433ea0555610 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:43.518695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8105fdaf-3c1d-48d2-b56b-a35e71dd3d58 req-dfc28728-58ca-48ec-be0b-433ea0555610 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:43.519377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8105fdaf-3c1d-48d2-b56b-a35e71dd3d58 req-dfc28728-58ca-48ec-be0b-433ea0555610 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:43.532205 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8105fdaf-3c1d-48d2-b56b-a35e71dd3d58 req-dfc28728-58ca-48ec-be0b-433ea0555610 service nova] Creating event network-changed:000cfb7d-f84b-4f34-afa8-cf1e87bb3337 for instance 82956fdf-e10f-4f30-835f-9c025da46479 on n-h2-854823-1 Aug 27 05:05:43.537701 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8105fdaf-3c1d-48d2-b56b-a35e71dd3d58 req-dfc28728-58ca-48ec-be0b-433ea0555610 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033847 Aug 27 05:05:43.538619 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2829/5703] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:43.850358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:43.855611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9864231c-80df-4984-8dbe-56b1d819b3c6 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:43.856445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9864231c-80df-4984-8dbe-56b1d819b3c6 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:43.862733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9864231c-80df-4984-8dbe-56b1d819b3c6 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:43.863314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9864231c-80df-4984-8dbe-56b1d819b3c6 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:43.863839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9864231c-80df-4984-8dbe-56b1d819b3c6 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:43.864823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9864231c-80df-4984-8dbe-56b1d819b3c6 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:43.865500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9864231c-80df-4984-8dbe-56b1d819b3c6 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:43.865935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9864231c-80df-4984-8dbe-56b1d819b3c6 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:44.112238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a7600300-868e-49bb-a3a8-d478601cdca7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:44.113261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a7600300-868e-49bb-a3a8-d478601cdca7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:44.120876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9864231c-80df-4984-8dbe-56b1d819b3c6 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:44.132106 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9864231c-80df-4984-8dbe-56b1d819b3c6 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1428 microversion: 2.1 time: 0.283433 Aug 27 05:05:44.137391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7600300-868e-49bb-a3a8-d478601cdca7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:44.138278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7600300-868e-49bb-a3a8-d478601cdca7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:44.139059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7600300-868e-49bb-a3a8-d478601cdca7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:44.140118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7600300-868e-49bb-a3a8-d478601cdca7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:44.140613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7600300-868e-49bb-a3a8-d478601cdca7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:44.141550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7600300-868e-49bb-a3a8-d478601cdca7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:44.146658 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2875/5704] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:43 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1428 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:44.158114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0cf7e70e-9f87-4fa2-b83c-3a9641a4a7a9 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:44.158756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0cf7e70e-9f87-4fa2-b83c-3a9641a4a7a9 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:44.165776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cf7e70e-9f87-4fa2-b83c-3a9641a4a7a9 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:44.166290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cf7e70e-9f87-4fa2-b83c-3a9641a4a7a9 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:44.166747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cf7e70e-9f87-4fa2-b83c-3a9641a4a7a9 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:44.167904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cf7e70e-9f87-4fa2-b83c-3a9641a4a7a9 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:44.168451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cf7e70e-9f87-4fa2-b83c-3a9641a4a7a9 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:44.168933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cf7e70e-9f87-4fa2-b83c-3a9641a4a7a9 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:44.316042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0cf7e70e-9f87-4fa2-b83c-3a9641a4a7a9 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:44.326161 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0cf7e70e-9f87-4fa2-b83c-3a9641a4a7a9 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1316 microversion: 2.1 time: 0.171850 Aug 27 05:05:44.326846 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2876/5705] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:44 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:44.328715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a7600300-868e-49bb-a3a8-d478601cdca7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:44.337645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a7600300-868e-49bb-a3a8-d478601cdca7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:44.339235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a7600300-868e-49bb-a3a8-d478601cdca7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:44.340485 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a7600300-868e-49bb-a3a8-d478601cdca7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.238884 Aug 27 05:05:44.341159 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2830/5706] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:44 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:05:45.154233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22b20338-782c-4140-b891-56f4e478dd28 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:45.154989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22b20338-782c-4140-b891-56f4e478dd28 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:45.167693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22b20338-782c-4140-b891-56f4e478dd28 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:45.168284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22b20338-782c-4140-b891-56f4e478dd28 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:45.168803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22b20338-782c-4140-b891-56f4e478dd28 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:45.169564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22b20338-782c-4140-b891-56f4e478dd28 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:45.170050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22b20338-782c-4140-b891-56f4e478dd28 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:45.171611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22b20338-782c-4140-b891-56f4e478dd28 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:45.349745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e5fff690-c091-4377-950e-41bed223f8ca tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:45.352052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e5fff690-c091-4377-950e-41bed223f8ca tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:45.361834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5fff690-c091-4377-950e-41bed223f8ca tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:45.362590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5fff690-c091-4377-950e-41bed223f8ca tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:45.363026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5fff690-c091-4377-950e-41bed223f8ca tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:45.363828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5fff690-c091-4377-950e-41bed223f8ca tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:45.364463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5fff690-c091-4377-950e-41bed223f8ca tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:45.365070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5fff690-c091-4377-950e-41bed223f8ca tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:45.506420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22b20338-782c-4140-b891-56f4e478dd28 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:45.521167 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22b20338-782c-4140-b891-56f4e478dd28 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1428 microversion: 2.1 time: 0.371189 Aug 27 05:05:45.522366 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2877/5707] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:45 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1428 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:45.528353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a91c98d-aede-465d-9a00-7660c05ba606 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:45.529194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a91c98d-aede-465d-9a00-7660c05ba606 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:45.536761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a91c98d-aede-465d-9a00-7660c05ba606 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:45.537539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a91c98d-aede-465d-9a00-7660c05ba606 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:45.538297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a91c98d-aede-465d-9a00-7660c05ba606 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:45.539052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a91c98d-aede-465d-9a00-7660c05ba606 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:45.539530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a91c98d-aede-465d-9a00-7660c05ba606 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:45.539968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a91c98d-aede-465d-9a00-7660c05ba606 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:45.549759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e5fff690-c091-4377-950e-41bed223f8ca tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:45.559899 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e5fff690-c091-4377-950e-41bed223f8ca tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1316 microversion: 2.1 time: 0.214161 Aug 27 05:05:45.573190 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2831/5708] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:45 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:45.870485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a91c98d-aede-465d-9a00-7660c05ba606 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:45.879441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a91c98d-aede-465d-9a00-7660c05ba606 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:45.880998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a91c98d-aede-465d-9a00-7660c05ba606 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:45.882218 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a91c98d-aede-465d-9a00-7660c05ba606 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.358669 Aug 27 05:05:45.888660 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2878/5709] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:45 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:46.545312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a87b84bd-c8bb-450b-9170-75cf423dc8d5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:46.545925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a87b84bd-c8bb-450b-9170-75cf423dc8d5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:46.553262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a87b84bd-c8bb-450b-9170-75cf423dc8d5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:46.553953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a87b84bd-c8bb-450b-9170-75cf423dc8d5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:46.554574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a87b84bd-c8bb-450b-9170-75cf423dc8d5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:46.555551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a87b84bd-c8bb-450b-9170-75cf423dc8d5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:46.556172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a87b84bd-c8bb-450b-9170-75cf423dc8d5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:46.557311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a87b84bd-c8bb-450b-9170-75cf423dc8d5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:46.584356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3ad265dd-6548-42df-9446-3a552e15cc23 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:46.585890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3ad265dd-6548-42df-9446-3a552e15cc23 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:46.598090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ad265dd-6548-42df-9446-3a552e15cc23 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:46.598938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ad265dd-6548-42df-9446-3a552e15cc23 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:46.599557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ad265dd-6548-42df-9446-3a552e15cc23 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:46.601182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ad265dd-6548-42df-9446-3a552e15cc23 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:46.601897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ad265dd-6548-42df-9446-3a552e15cc23 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:46.602514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ad265dd-6548-42df-9446-3a552e15cc23 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:46.609761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:46.756257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3ad265dd-6548-42df-9446-3a552e15cc23 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:46.765772 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3ad265dd-6548-42df-9446-3a552e15cc23 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1316 microversion: 2.1 time: 0.186534 Aug 27 05:05:46.766040 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2879/5710] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:46 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:46.771985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a87b84bd-c8bb-450b-9170-75cf423dc8d5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:46.780698 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a87b84bd-c8bb-450b-9170-75cf423dc8d5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1428 microversion: 2.1 time: 0.240059 Aug 27 05:05:46.781398 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2832/5711] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:46 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1428 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:46.908523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7395fb8e-cbef-47e3-a401-476589ca8714 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:46.909629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7395fb8e-cbef-47e3-a401-476589ca8714 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:46.918161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7395fb8e-cbef-47e3-a401-476589ca8714 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:46.919202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7395fb8e-cbef-47e3-a401-476589ca8714 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:46.920136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7395fb8e-cbef-47e3-a401-476589ca8714 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:46.921206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7395fb8e-cbef-47e3-a401-476589ca8714 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:46.922747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7395fb8e-cbef-47e3-a401-476589ca8714 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:46.923409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7395fb8e-cbef-47e3-a401-476589ca8714 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:47.079130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7395fb8e-cbef-47e3-a401-476589ca8714 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:47.088619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7395fb8e-cbef-47e3-a401-476589ca8714 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:47.090135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7395fb8e-cbef-47e3-a401-476589ca8714 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:47.091373 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7395fb8e-cbef-47e3-a401-476589ca8714 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.188713 Aug 27 05:05:47.092279 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2880/5712] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:46 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:47.787628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a7e4a1f2-bb16-4d20-b619-2e7865624b83 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:47.789335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a7e4a1f2-bb16-4d20-b619-2e7865624b83 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:47.797496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7e4a1f2-bb16-4d20-b619-2e7865624b83 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:47.798348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7e4a1f2-bb16-4d20-b619-2e7865624b83 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:47.799070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7e4a1f2-bb16-4d20-b619-2e7865624b83 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:47.799866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7e4a1f2-bb16-4d20-b619-2e7865624b83 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:47.800444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7e4a1f2-bb16-4d20-b619-2e7865624b83 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:47.801202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7e4a1f2-bb16-4d20-b619-2e7865624b83 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:47.803962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-680807ec-8abb-4086-8af9-aac99d90a41f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:47.804693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-680807ec-8abb-4086-8af9-aac99d90a41f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:47.814304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-680807ec-8abb-4086-8af9-aac99d90a41f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:47.815146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-680807ec-8abb-4086-8af9-aac99d90a41f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:47.815862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-680807ec-8abb-4086-8af9-aac99d90a41f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:47.822154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-680807ec-8abb-4086-8af9-aac99d90a41f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:47.824432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-680807ec-8abb-4086-8af9-aac99d90a41f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:47.824941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-680807ec-8abb-4086-8af9-aac99d90a41f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:47.973953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-680807ec-8abb-4086-8af9-aac99d90a41f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:47.982725 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-680807ec-8abb-4086-8af9-aac99d90a41f tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1428 microversion: 2.1 time: 0.183243 Aug 27 05:05:47.983596 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2881/5713] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:47 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1428 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:48.030166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a7e4a1f2-bb16-4d20-b619-2e7865624b83 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:48.039806 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a7e4a1f2-bb16-4d20-b619-2e7865624b83 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1316 microversion: 2.1 time: 0.256014 Aug 27 05:05:48.040811 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2833/5714] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:47 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:48.118170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de869b90-2f71-43a1-a2cd-4f5efa5d75af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:48.118802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-de869b90-2f71-43a1-a2cd-4f5efa5d75af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:48.126308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de869b90-2f71-43a1-a2cd-4f5efa5d75af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:48.126937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de869b90-2f71-43a1-a2cd-4f5efa5d75af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:48.127576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de869b90-2f71-43a1-a2cd-4f5efa5d75af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:48.128288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de869b90-2f71-43a1-a2cd-4f5efa5d75af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:48.129219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de869b90-2f71-43a1-a2cd-4f5efa5d75af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:48.129667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de869b90-2f71-43a1-a2cd-4f5efa5d75af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:48.264747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de869b90-2f71-43a1-a2cd-4f5efa5d75af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:48.278472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de869b90-2f71-43a1-a2cd-4f5efa5d75af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:48.281551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de869b90-2f71-43a1-a2cd-4f5efa5d75af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:48.283934 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de869b90-2f71-43a1-a2cd-4f5efa5d75af tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.170862 Aug 27 05:05:48.285806 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2882/5715] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:48 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:48.434126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-be9c4051-9d80-4477-b535-9bf771e16c6c req-1c30f2db-83fb-4e8e-bbb5-b52b020b8743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba63d69-1a05-41ec-9620-e772743da5ae", "name": "network-vif-plugged", "status": "completed", "tag": "bca03d46-1865-45c9-897b-833934521260"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:48.453573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:48.459498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-be9c4051-9d80-4477-b535-9bf771e16c6c req-1c30f2db-83fb-4e8e-bbb5-b52b020b8743 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:48.460005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-be9c4051-9d80-4477-b535-9bf771e16c6c req-1c30f2db-83fb-4e8e-bbb5-b52b020b8743 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:48.461134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-be9c4051-9d80-4477-b535-9bf771e16c6c req-1c30f2db-83fb-4e8e-bbb5-b52b020b8743 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:48.478149 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-be9c4051-9d80-4477-b535-9bf771e16c6c req-1c30f2db-83fb-4e8e-bbb5-b52b020b8743 service nova] Creating event network-vif-plugged:bca03d46-1865-45c9-897b-833934521260 for instance cba63d69-1a05-41ec-9620-e772743da5ae on n-h1-854823-1 Aug 27 05:05:48.484369 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-be9c4051-9d80-4477-b535-9bf771e16c6c req-1c30f2db-83fb-4e8e-bbb5-b52b020b8743 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056073 Aug 27 05:05:48.485570 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2834/5716] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:49.007311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ab4d728-2dc1-4bb1-b003-40e68aab3da5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:49.008073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ab4d728-2dc1-4bb1-b003-40e68aab3da5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:49.015529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ab4d728-2dc1-4bb1-b003-40e68aab3da5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:49.016057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ab4d728-2dc1-4bb1-b003-40e68aab3da5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:49.016565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ab4d728-2dc1-4bb1-b003-40e68aab3da5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:49.017307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ab4d728-2dc1-4bb1-b003-40e68aab3da5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:49.017809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ab4d728-2dc1-4bb1-b003-40e68aab3da5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:49.018254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ab4d728-2dc1-4bb1-b003-40e68aab3da5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:49.072133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4b38ad8-8ab7-4e19-a789-d5cdf209f986 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:49.083753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f4b38ad8-8ab7-4e19-a789-d5cdf209f986 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:49.085931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=20 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:49.092999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4b38ad8-8ab7-4e19-a789-d5cdf209f986 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:49.093699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4b38ad8-8ab7-4e19-a789-d5cdf209f986 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:49.094958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4b38ad8-8ab7-4e19-a789-d5cdf209f986 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:49.095696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4b38ad8-8ab7-4e19-a789-d5cdf209f986 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:49.096153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4b38ad8-8ab7-4e19-a789-d5cdf209f986 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:49.096605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4b38ad8-8ab7-4e19-a789-d5cdf209f986 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:49.179530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ab4d728-2dc1-4bb1-b003-40e68aab3da5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:49.190056 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ab4d728-2dc1-4bb1-b003-40e68aab3da5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1428 microversion: 2.1 time: 0.187264 Aug 27 05:05:49.190673 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2883/5717] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:49 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1428 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:49.308250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ad2ddbe8-8042-4e7d-bf41-ed97bd926a1b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:49.309569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ad2ddbe8-8042-4e7d-bf41-ed97bd926a1b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:49.315671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad2ddbe8-8042-4e7d-bf41-ed97bd926a1b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:49.316245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad2ddbe8-8042-4e7d-bf41-ed97bd926a1b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:49.316762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad2ddbe8-8042-4e7d-bf41-ed97bd926a1b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:49.317540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad2ddbe8-8042-4e7d-bf41-ed97bd926a1b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:49.318120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad2ddbe8-8042-4e7d-bf41-ed97bd926a1b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:49.318568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad2ddbe8-8042-4e7d-bf41-ed97bd926a1b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:49.456272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ad2ddbe8-8042-4e7d-bf41-ed97bd926a1b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:49.465648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ad2ddbe8-8042-4e7d-bf41-ed97bd926a1b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:49.467108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ad2ddbe8-8042-4e7d-bf41-ed97bd926a1b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:49.468401 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ad2ddbe8-8042-4e7d-bf41-ed97bd926a1b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.164932 Aug 27 05:05:49.469013 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2884/5718] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:49 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:05:49.488301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f4b38ad8-8ab7-4e19-a789-d5cdf209f986 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:49.497191 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f4b38ad8-8ab7-4e19-a789-d5cdf209f986 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1316 microversion: 2.1 time: 0.429568 Aug 27 05:05:49.497787 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2835/5719] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:49 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:50.212542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f6d4a64-a57c-43f7-b2d9-08ae3bc5d442 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:50.213146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f6d4a64-a57c-43f7-b2d9-08ae3bc5d442 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:50.220963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a64-a57c-43f7-b2d9-08ae3bc5d442 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:50.221721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a64-a57c-43f7-b2d9-08ae3bc5d442 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:50.222171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a64-a57c-43f7-b2d9-08ae3bc5d442 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:50.222917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a64-a57c-43f7-b2d9-08ae3bc5d442 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:50.223579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a64-a57c-43f7-b2d9-08ae3bc5d442 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:50.224017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a64-a57c-43f7-b2d9-08ae3bc5d442 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:50.387736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f6d4a64-a57c-43f7-b2d9-08ae3bc5d442 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:50.396173 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f6d4a64-a57c-43f7-b2d9-08ae3bc5d442 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1428 microversion: 2.1 time: 0.188854 Aug 27 05:05:50.396799 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2885/5720] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:50 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1428 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:50.496359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1a63fb65-0229-4f8d-97f4-45a70efe9ce7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:50.497010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1a63fb65-0229-4f8d-97f4-45a70efe9ce7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:50.504402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a63fb65-0229-4f8d-97f4-45a70efe9ce7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:50.504772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dce81cea-77f7-4af9-a3e0-4bcdc281e294 req-47b13552-b1a4-48c6-9fbb-5a49731302c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82956fdf-e10f-4f30-835f-9c025da46479", "name": "network-vif-plugged", "status": "completed", "tag": "000cfb7d-f84b-4f34-afa8-cf1e87bb3337"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:50.505413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a63fb65-0229-4f8d-97f4-45a70efe9ce7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:50.505857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a63fb65-0229-4f8d-97f4-45a70efe9ce7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:50.506563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a63fb65-0229-4f8d-97f4-45a70efe9ce7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:50.507169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a63fb65-0229-4f8d-97f4-45a70efe9ce7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:50.507596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a63fb65-0229-4f8d-97f4-45a70efe9ce7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:50.521656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dce81cea-77f7-4af9-a3e0-4bcdc281e294 req-47b13552-b1a4-48c6-9fbb-5a49731302c9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:50.522210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dce81cea-77f7-4af9-a3e0-4bcdc281e294 req-47b13552-b1a4-48c6-9fbb-5a49731302c9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:50.522666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dce81cea-77f7-4af9-a3e0-4bcdc281e294 req-47b13552-b1a4-48c6-9fbb-5a49731302c9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:50.534674 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dce81cea-77f7-4af9-a3e0-4bcdc281e294 req-47b13552-b1a4-48c6-9fbb-5a49731302c9 service nova] Creating event network-vif-plugged:000cfb7d-f84b-4f34-afa8-cf1e87bb3337 for instance 82956fdf-e10f-4f30-835f-9c025da46479 on n-h2-854823-1 Aug 27 05:05:50.539962 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dce81cea-77f7-4af9-a3e0-4bcdc281e294 req-47b13552-b1a4-48c6-9fbb-5a49731302c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038928 Aug 27 05:05:50.540758 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2886/5721] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:50.546534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0fe1a192-8cc4-4198-9599-b68a8b6118ef tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:50.547261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0fe1a192-8cc4-4198-9599-b68a8b6118ef tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:50.555552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fe1a192-8cc4-4198-9599-b68a8b6118ef tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:50.556067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fe1a192-8cc4-4198-9599-b68a8b6118ef tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:50.556520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fe1a192-8cc4-4198-9599-b68a8b6118ef tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:50.557274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fe1a192-8cc4-4198-9599-b68a8b6118ef tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:50.558300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fe1a192-8cc4-4198-9599-b68a8b6118ef tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:50.558977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fe1a192-8cc4-4198-9599-b68a8b6118ef tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:50.742827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1a63fb65-0229-4f8d-97f4-45a70efe9ce7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:50.753536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1a63fb65-0229-4f8d-97f4-45a70efe9ce7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:50.756123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1a63fb65-0229-4f8d-97f4-45a70efe9ce7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:50.757909 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1a63fb65-0229-4f8d-97f4-45a70efe9ce7 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.266323 Aug 27 05:05:50.772451 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2836/5722] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:50 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:50.786864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0fe1a192-8cc4-4198-9599-b68a8b6118ef tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:50.796502 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0fe1a192-8cc4-4198-9599-b68a8b6118ef tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1505 microversion: 2.1 time: 0.254640 Aug 27 05:05:50.797361 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2887/5723] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:50 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:50.819083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b1bf733f-766b-46ae-a6c5-374214ce3100 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:50.819669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b1bf733f-766b-46ae-a6c5-374214ce3100 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:50.826536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1bf733f-766b-46ae-a6c5-374214ce3100 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:50.827640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1bf733f-766b-46ae-a6c5-374214ce3100 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:50.828271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1bf733f-766b-46ae-a6c5-374214ce3100 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:50.830483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1bf733f-766b-46ae-a6c5-374214ce3100 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:50.830483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1bf733f-766b-46ae-a6c5-374214ce3100 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:50.830483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1bf733f-766b-46ae-a6c5-374214ce3100 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:50.865565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b1bf733f-766b-46ae-a6c5-374214ce3100 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:50.866569 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b1bf733f-766b-46ae-a6c5-374214ce3100 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae/os-instance-actions/req-53c9ee1e-affd-42aa-9f70-b35433d1f37d" status: 200 len: 313 microversion: 2.1 time: 0.052242 Aug 27 05:05:50.867169 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2837/5724] 10.222.0.79 () {58 vars in 1419 bytes} [Sat Aug 27 05:05:50 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae/os-instance-actions/req-53c9ee1e-affd-42aa-9f70-b35433d1f37d => generated 313 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:50.881402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-004b670d-4f76-48cb-89e6-a52ee86c21fe tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:50.884687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-004b670d-4f76-48cb-89e6-a52ee86c21fe tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:50.890873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-004b670d-4f76-48cb-89e6-a52ee86c21fe tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:50.891371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-004b670d-4f76-48cb-89e6-a52ee86c21fe tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:50.892060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-004b670d-4f76-48cb-89e6-a52ee86c21fe tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:50.893059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-004b670d-4f76-48cb-89e6-a52ee86c21fe tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:50.893705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-004b670d-4f76-48cb-89e6-a52ee86c21fe tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:50.894317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-004b670d-4f76-48cb-89e6-a52ee86c21fe tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:50.993991 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-004b670d-4f76-48cb-89e6-a52ee86c21fe tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "POST /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae/action" status: 202 len: 0 microversion: 2.1 time: 0.116816 Aug 27 05:05:50.995114 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2888/5725] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:05:50 2022] POST /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:05:51.003178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-25a5976e-7001-49d5-bd88-d12bcc660ffd tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:51.003804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-25a5976e-7001-49d5-bd88-d12bcc660ffd tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:51.011123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25a5976e-7001-49d5-bd88-d12bcc660ffd tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:51.011620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25a5976e-7001-49d5-bd88-d12bcc660ffd tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:51.012053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25a5976e-7001-49d5-bd88-d12bcc660ffd tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:51.012782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25a5976e-7001-49d5-bd88-d12bcc660ffd tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:51.013532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25a5976e-7001-49d5-bd88-d12bcc660ffd tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:51.014013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25a5976e-7001-49d5-bd88-d12bcc660ffd tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:51.259772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-25a5976e-7001-49d5-bd88-d12bcc660ffd tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:51.276253 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-25a5976e-7001-49d5-bd88-d12bcc660ffd tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1507 microversion: 2.1 time: 0.277035 Aug 27 05:05:51.278709 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2838/5726] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:50 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1507 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:51.419341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f82c8686-527c-4123-a374-c1f85e086b46 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:51.420687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f82c8686-527c-4123-a374-c1f85e086b46 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:51.426995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f82c8686-527c-4123-a374-c1f85e086b46 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:51.427547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f82c8686-527c-4123-a374-c1f85e086b46 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:51.427996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f82c8686-527c-4123-a374-c1f85e086b46 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:51.428763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f82c8686-527c-4123-a374-c1f85e086b46 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:51.429240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f82c8686-527c-4123-a374-c1f85e086b46 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:51.429888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f82c8686-527c-4123-a374-c1f85e086b46 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:51.473080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cc27771c-24b4-4faf-a699-7143b7fa4958 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:51.474045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cc27771c-24b4-4faf-a699-7143b7fa4958 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:51.496670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc27771c-24b4-4faf-a699-7143b7fa4958 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:51.498023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc27771c-24b4-4faf-a699-7143b7fa4958 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:51.499062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc27771c-24b4-4faf-a699-7143b7fa4958 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:51.500111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc27771c-24b4-4faf-a699-7143b7fa4958 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:51.500882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc27771c-24b4-4faf-a699-7143b7fa4958 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:51.501528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cc27771c-24b4-4faf-a699-7143b7fa4958 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:51.668585 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cc27771c-24b4-4faf-a699-7143b7fa4958 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1834 microversion: 2.1 time: 0.199347 Aug 27 05:05:51.669946 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2839/5727] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:51 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1834 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:51.731772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f82c8686-527c-4123-a374-c1f85e086b46 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:51.748231 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f82c8686-527c-4123-a374-c1f85e086b46 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1428 microversion: 2.1 time: 0.334575 Aug 27 05:05:51.750844 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2889/5728] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:51 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1428 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:51.782657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9749ee74-68ef-4816-b5a1-7742fb5a9425 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:51.783549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9749ee74-68ef-4816-b5a1-7742fb5a9425 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:51.791027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9749ee74-68ef-4816-b5a1-7742fb5a9425 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:51.792799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9749ee74-68ef-4816-b5a1-7742fb5a9425 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:51.793485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9749ee74-68ef-4816-b5a1-7742fb5a9425 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:51.794780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9749ee74-68ef-4816-b5a1-7742fb5a9425 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:51.795657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9749ee74-68ef-4816-b5a1-7742fb5a9425 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:51.796326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9749ee74-68ef-4816-b5a1-7742fb5a9425 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:51.822791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:52.215382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9749ee74-68ef-4816-b5a1-7742fb5a9425 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:52.227035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9749ee74-68ef-4816-b5a1-7742fb5a9425 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:52.229045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9749ee74-68ef-4816-b5a1-7742fb5a9425 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:52.231561 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9749ee74-68ef-4816-b5a1-7742fb5a9425 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.452981 Aug 27 05:05:52.248095 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2840/5729] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:51 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:52.299793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bcf263a4-7a31-4d95-a5bc-ad7fdab763b1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:52.300350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bcf263a4-7a31-4d95-a5bc-ad7fdab763b1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:52.308513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcf263a4-7a31-4d95-a5bc-ad7fdab763b1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:52.310166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcf263a4-7a31-4d95-a5bc-ad7fdab763b1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:52.310633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcf263a4-7a31-4d95-a5bc-ad7fdab763b1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:52.311380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcf263a4-7a31-4d95-a5bc-ad7fdab763b1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:52.311855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcf263a4-7a31-4d95-a5bc-ad7fdab763b1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:52.312305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcf263a4-7a31-4d95-a5bc-ad7fdab763b1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:52.580766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bcf263a4-7a31-4d95-a5bc-ad7fdab763b1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:52.590340 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bcf263a4-7a31-4d95-a5bc-ad7fdab763b1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1507 microversion: 2.1 time: 0.294664 Aug 27 05:05:52.591142 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2890/5730] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:52 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1507 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:52.773262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f2e6eda5-7ca5-4a44-b47c-7d3326886ea4 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:52.774767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f2e6eda5-7ca5-4a44-b47c-7d3326886ea4 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:52.785327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2e6eda5-7ca5-4a44-b47c-7d3326886ea4 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:52.786228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2e6eda5-7ca5-4a44-b47c-7d3326886ea4 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:52.787016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2e6eda5-7ca5-4a44-b47c-7d3326886ea4 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:52.790393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2e6eda5-7ca5-4a44-b47c-7d3326886ea4 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:52.791199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2e6eda5-7ca5-4a44-b47c-7d3326886ea4 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:52.792748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2e6eda5-7ca5-4a44-b47c-7d3326886ea4 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:52.845565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d037c52-4568-4661-8553-3ebc6ad1bfc5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:52.846570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d037c52-4568-4661-8553-3ebc6ad1bfc5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:52.859535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d037c52-4568-4661-8553-3ebc6ad1bfc5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:52.860430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d037c52-4568-4661-8553-3ebc6ad1bfc5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:52.862528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d037c52-4568-4661-8553-3ebc6ad1bfc5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:52.863579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d037c52-4568-4661-8553-3ebc6ad1bfc5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:52.864250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d037c52-4568-4661-8553-3ebc6ad1bfc5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:52.864900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d037c52-4568-4661-8553-3ebc6ad1bfc5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:52.916268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d037c52-4568-4661-8553-3ebc6ad1bfc5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:05:53.030937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f2e6eda5-7ca5-4a44-b47c-7d3326886ea4 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:53.046816 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f2e6eda5-7ca5-4a44-b47c-7d3326886ea4 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1608 microversion: 2.1 time: 0.279987 Aug 27 05:05:53.047418 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2841/5731] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:52 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1608 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:53.062124 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d037c52-4568-4661-8553-3ebc6ad1bfc5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 204 len: 0 microversion: 2.1 time: 0.219461 Aug 27 05:05:53.063632 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2891/5732] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:05:52 2022] DELETE /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:05:53.072966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-08d47d27-a569-4790-8bf6-2c12da14ac1b req-e60c7030-9a5f-419d-b92c-0b69c54dcbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c", "tag": "1c0cd31d-1134-43c3-8033-7756a472aa85"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:53.083952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e5883fa7-2f2d-4c67-9d97-d8bde7e5e9cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:53.085111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e5883fa7-2f2d-4c67-9d97-d8bde7e5e9cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:53.094481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5883fa7-2f2d-4c67-9d97-d8bde7e5e9cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.095385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5883fa7-2f2d-4c67-9d97-d8bde7e5e9cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.096398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5883fa7-2f2d-4c67-9d97-d8bde7e5e9cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.097538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5883fa7-2f2d-4c67-9d97-d8bde7e5e9cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.098483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5883fa7-2f2d-4c67-9d97-d8bde7e5e9cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.099329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5883fa7-2f2d-4c67-9d97-d8bde7e5e9cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.100193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-08d47d27-a569-4790-8bf6-2c12da14ac1b req-e60c7030-9a5f-419d-b92c-0b69c54dcbe1 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.101159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-08d47d27-a569-4790-8bf6-2c12da14ac1b req-e60c7030-9a5f-419d-b92c-0b69c54dcbe1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.102353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-08d47d27-a569-4790-8bf6-2c12da14ac1b req-e60c7030-9a5f-419d-b92c-0b69c54dcbe1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.120308 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-08d47d27-a569-4790-8bf6-2c12da14ac1b req-e60c7030-9a5f-419d-b92c-0b69c54dcbe1 service nova] Creating event network-changed:1c0cd31d-1134-43c3-8033-7756a472aa85 for instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c on n-h1-854823-1 Aug 27 05:05:53.127801 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-08d47d27-a569-4790-8bf6-2c12da14ac1b req-e60c7030-9a5f-419d-b92c-0b69c54dcbe1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074263 Aug 27 05:05:53.128415 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2842/5733] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:53.135455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5d3f1b1d-8c11-4fc0-8f9f-3fac2bff2637 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:53.136502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5d3f1b1d-8c11-4fc0-8f9f-3fac2bff2637 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:53.145191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d3f1b1d-8c11-4fc0-8f9f-3fac2bff2637 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.146096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d3f1b1d-8c11-4fc0-8f9f-3fac2bff2637 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.146908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d3f1b1d-8c11-4fc0-8f9f-3fac2bff2637 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.147646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d3f1b1d-8c11-4fc0-8f9f-3fac2bff2637 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.148449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d3f1b1d-8c11-4fc0-8f9f-3fac2bff2637 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.148571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d3f1b1d-8c11-4fc0-8f9f-3fac2bff2637 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.330470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5d3f1b1d-8c11-4fc0-8f9f-3fac2bff2637 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:53.340917 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5d3f1b1d-8c11-4fc0-8f9f-3fac2bff2637 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1608 microversion: 2.1 time: 0.210953 Aug 27 05:05:53.341642 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2843/5734] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:53 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1608 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:53.349440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-490a9688-fc33-4cfc-9cac-eb9b3d2abe53 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:53.350596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-490a9688-fc33-4cfc-9cac-eb9b3d2abe53 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:53.359579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-490a9688-fc33-4cfc-9cac-eb9b3d2abe53 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.360148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-490a9688-fc33-4cfc-9cac-eb9b3d2abe53 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.360860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-490a9688-fc33-4cfc-9cac-eb9b3d2abe53 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.361652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-490a9688-fc33-4cfc-9cac-eb9b3d2abe53 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.362138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-490a9688-fc33-4cfc-9cac-eb9b3d2abe53 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.362747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-490a9688-fc33-4cfc-9cac-eb9b3d2abe53 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.380996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e5883fa7-2f2d-4c67-9d97-d8bde7e5e9cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:53.392700 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e5883fa7-2f2d-4c67-9d97-d8bde7e5e9cf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1689 microversion: 2.1 time: 0.316017 Aug 27 05:05:53.407792 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2892/5735] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:53 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1689 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:53.415777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3729dd6-47dc-4b7d-8cda-32e59b467cd5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:53.418038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b3729dd6-47dc-4b7d-8cda-32e59b467cd5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:53.429741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3729dd6-47dc-4b7d-8cda-32e59b467cd5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.430277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3729dd6-47dc-4b7d-8cda-32e59b467cd5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.433481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3729dd6-47dc-4b7d-8cda-32e59b467cd5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.434217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3729dd6-47dc-4b7d-8cda-32e59b467cd5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.434734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3729dd6-47dc-4b7d-8cda-32e59b467cd5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.435169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3729dd6-47dc-4b7d-8cda-32e59b467cd5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.533556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-490a9688-fc33-4cfc-9cac-eb9b3d2abe53 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:53.544887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-490a9688-fc33-4cfc-9cac-eb9b3d2abe53 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:53.546506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-490a9688-fc33-4cfc-9cac-eb9b3d2abe53 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:53.547862 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-490a9688-fc33-4cfc-9cac-eb9b3d2abe53 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1745 microversion: 2.20 time: 0.205026 Aug 27 05:05:53.552628 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2844/5736] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:53 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1745 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:53.613643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b8eea189-8f2c-40b0-821d-5e8a48c0408e tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:53.614627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b8eea189-8f2c-40b0-821d-5e8a48c0408e tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:53.622085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8eea189-8f2c-40b0-821d-5e8a48c0408e tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.623019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8eea189-8f2c-40b0-821d-5e8a48c0408e tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.623019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8eea189-8f2c-40b0-821d-5e8a48c0408e tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.624087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8eea189-8f2c-40b0-821d-5e8a48c0408e tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.624576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8eea189-8f2c-40b0-821d-5e8a48c0408e tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.625094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8eea189-8f2c-40b0-821d-5e8a48c0408e tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.673252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b3729dd6-47dc-4b7d-8cda-32e59b467cd5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:53.677544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:53.684666 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3729dd6-47dc-4b7d-8cda-32e59b467cd5 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1608 microversion: 2.1 time: 0.275357 Aug 27 05:05:53.685509 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2893/5737] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:53 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1608 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:53.810375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b8eea189-8f2c-40b0-821d-5e8a48c0408e tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:53.821194 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b8eea189-8f2c-40b0-821d-5e8a48c0408e tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1505 microversion: 2.1 time: 0.213614 Aug 27 05:05:53.822286 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2845/5738] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:53 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:53.846064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69ee16e5-ba78-43b7-ac1a-ef990cbd642d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '.version_select at 0x7f1f2055d280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:53.846652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69ee16e5-ba78-43b7-ac1a-ef990cbd642d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:53.858794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69ee16e5-ba78-43b7-ac1a-ef990cbd642d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.859359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69ee16e5-ba78-43b7-ac1a-ef990cbd642d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.859828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69ee16e5-ba78-43b7-ac1a-ef990cbd642d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.860634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69ee16e5-ba78-43b7-ac1a-ef990cbd642d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.861388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69ee16e5-ba78-43b7-ac1a-ef990cbd642d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.861791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69ee16e5-ba78-43b7-ac1a-ef990cbd642d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.896296 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69ee16e5-ba78-43b7-ac1a-ef990cbd642d tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.054404 Aug 27 05:05:53.904885 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2894/5739] 10.222.0.79 () {58 vars in 1296 bytes} [Sat Aug 27 05:05:53 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae/os-instance-actions => generated 611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:53.909837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-56cb8211-3f43-4d2e-8258-d0ca090a020a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:53.910447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-56cb8211-3f43-4d2e-8258-d0ca090a020a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:53.917600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56cb8211-3f43-4d2e-8258-d0ca090a020a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.918105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56cb8211-3f43-4d2e-8258-d0ca090a020a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.918522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56cb8211-3f43-4d2e-8258-d0ca090a020a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.919225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56cb8211-3f43-4d2e-8258-d0ca090a020a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:53.919680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56cb8211-3f43-4d2e-8258-d0ca090a020a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:53.922758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56cb8211-3f43-4d2e-8258-d0ca090a020a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:53.960409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-56cb8211-3f43-4d2e-8258-d0ca090a020a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:05:54.065751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:54.091119 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-56cb8211-3f43-4d2e-8258-d0ca090a020a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 204 len: 0 microversion: 2.1 time: 0.185259 Aug 27 05:05:54.096362 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2846/5740] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:05:53 2022] DELETE /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:05:54.101051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3bc8a334-9e10-40e1-90b7-f630493cbe3a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:54.101709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3bc8a334-9e10-40e1-90b7-f630493cbe3a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:54.112904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bc8a334-9e10-40e1-90b7-f630493cbe3a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:54.113676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bc8a334-9e10-40e1-90b7-f630493cbe3a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:54.114324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bc8a334-9e10-40e1-90b7-f630493cbe3a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:54.115256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bc8a334-9e10-40e1-90b7-f630493cbe3a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:54.115908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bc8a334-9e10-40e1-90b7-f630493cbe3a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:54.116557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bc8a334-9e10-40e1-90b7-f630493cbe3a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:54.415924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e35c35dc-265d-48cb-a207-711a8093c2e7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:54.416190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e35c35dc-265d-48cb-a207-711a8093c2e7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:54.424612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e35c35dc-265d-48cb-a207-711a8093c2e7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:54.425121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e35c35dc-265d-48cb-a207-711a8093c2e7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:54.426159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e35c35dc-265d-48cb-a207-711a8093c2e7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:54.426321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e35c35dc-265d-48cb-a207-711a8093c2e7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:54.426793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e35c35dc-265d-48cb-a207-711a8093c2e7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:54.427227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e35c35dc-265d-48cb-a207-711a8093c2e7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:54.439910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3bc8a334-9e10-40e1-90b7-f630493cbe3a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:54.454429 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3bc8a334-9e10-40e1-90b7-f630493cbe3a tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1511 microversion: 2.1 time: 0.357452 Aug 27 05:05:54.460922 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2895/5741] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:54 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:54.577152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d59a9706-cd11-4215-9a9e-6150b5f4d29a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:54.578044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d59a9706-cd11-4215-9a9e-6150b5f4d29a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:54.585856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d59a9706-cd11-4215-9a9e-6150b5f4d29a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:54.586504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d59a9706-cd11-4215-9a9e-6150b5f4d29a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:54.587146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d59a9706-cd11-4215-9a9e-6150b5f4d29a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:54.588034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d59a9706-cd11-4215-9a9e-6150b5f4d29a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:54.588741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d59a9706-cd11-4215-9a9e-6150b5f4d29a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:54.589338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d59a9706-cd11-4215-9a9e-6150b5f4d29a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:54.711807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e35c35dc-265d-48cb-a207-711a8093c2e7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:54.721603 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e35c35dc-265d-48cb-a207-711a8093c2e7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1689 microversion: 2.1 time: 0.311088 Aug 27 05:05:54.722345 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2847/5742] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:54 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1689 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:54.809464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d59a9706-cd11-4215-9a9e-6150b5f4d29a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:54.820313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d59a9706-cd11-4215-9a9e-6150b5f4d29a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:54.822811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d59a9706-cd11-4215-9a9e-6150b5f4d29a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:54.830617 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d59a9706-cd11-4215-9a9e-6150b5f4d29a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1745 microversion: 2.20 time: 0.253638 Aug 27 05:05:54.831410 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2896/5743] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:54 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1745 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:05:55.485313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7b086a51-6a13-4cef-9d2b-3e595d74f459 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:55.486073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7b086a51-6a13-4cef-9d2b-3e595d74f459 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:55.493566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b086a51-6a13-4cef-9d2b-3e595d74f459 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:55.494346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b086a51-6a13-4cef-9d2b-3e595d74f459 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:55.494860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b086a51-6a13-4cef-9d2b-3e595d74f459 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:55.495900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b086a51-6a13-4cef-9d2b-3e595d74f459 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:55.496574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b086a51-6a13-4cef-9d2b-3e595d74f459 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:55.497013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b086a51-6a13-4cef-9d2b-3e595d74f459 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:55.743423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d250fa18-d84d-48fe-8114-68c0ce36d667 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:55.744341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d250fa18-d84d-48fe-8114-68c0ce36d667 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:55.752070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d250fa18-d84d-48fe-8114-68c0ce36d667 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:55.752605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d250fa18-d84d-48fe-8114-68c0ce36d667 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:55.753061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d250fa18-d84d-48fe-8114-68c0ce36d667 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:55.753780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d250fa18-d84d-48fe-8114-68c0ce36d667 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:55.754492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d250fa18-d84d-48fe-8114-68c0ce36d667 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:55.754931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d250fa18-d84d-48fe-8114-68c0ce36d667 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:55.838696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b086a51-6a13-4cef-9d2b-3e595d74f459 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:55.846696 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7b086a51-6a13-4cef-9d2b-3e595d74f459 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1511 microversion: 2.1 time: 0.372520 Aug 27 05:05:55.847287 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2848/5744] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:55 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:55.853010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a7464e2d-90c7-413b-98a8-1a3ae2440339 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:55.853609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a7464e2d-90c7-413b-98a8-1a3ae2440339 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:55.859619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7464e2d-90c7-413b-98a8-1a3ae2440339 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:55.860103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7464e2d-90c7-413b-98a8-1a3ae2440339 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:55.860639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7464e2d-90c7-413b-98a8-1a3ae2440339 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:55.861247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7464e2d-90c7-413b-98a8-1a3ae2440339 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:55.861699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7464e2d-90c7-413b-98a8-1a3ae2440339 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:55.862120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7464e2d-90c7-413b-98a8-1a3ae2440339 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:56.128359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d250fa18-d84d-48fe-8114-68c0ce36d667 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:56.143781 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d250fa18-d84d-48fe-8114-68c0ce36d667 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1689 microversion: 2.1 time: 0.403682 Aug 27 05:05:56.145505 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2897/5745] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:55 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1689 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:56.233467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a7464e2d-90c7-413b-98a8-1a3ae2440339 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:56.244722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a7464e2d-90c7-413b-98a8-1a3ae2440339 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:56.246828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a7464e2d-90c7-413b-98a8-1a3ae2440339 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:56.248105 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a7464e2d-90c7-413b-98a8-1a3ae2440339 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1745 microversion: 2.20 time: 0.399014 Aug 27 05:05:56.256757 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2849/5746] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:55 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1745 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:56.630037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5ca03cb0-867b-478c-947d-1b19704e1f36 req-52b8d8bc-5193-4c91-bb75-5d46b82cf9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf34f382-9b01-4519-ba5f-78471ee22e32", "name": "network-vif-plugged", "status": "completed", "tag": "7a1ec75a-2f7a-416e-b884-5870283eafe6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:56.653143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5ca03cb0-867b-478c-947d-1b19704e1f36 req-52b8d8bc-5193-4c91-bb75-5d46b82cf9de service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:56.654167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5ca03cb0-867b-478c-947d-1b19704e1f36 req-52b8d8bc-5193-4c91-bb75-5d46b82cf9de service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:56.655255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5ca03cb0-867b-478c-947d-1b19704e1f36 req-52b8d8bc-5193-4c91-bb75-5d46b82cf9de service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:56.675873 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5ca03cb0-867b-478c-947d-1b19704e1f36 req-52b8d8bc-5193-4c91-bb75-5d46b82cf9de service nova] Creating event network-vif-plugged:7a1ec75a-2f7a-416e-b884-5870283eafe6 for instance bf34f382-9b01-4519-ba5f-78471ee22e32 on n-h1-854823-1 Aug 27 05:05:56.681747 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5ca03cb0-867b-478c-947d-1b19704e1f36 req-52b8d8bc-5193-4c91-bb75-5d46b82cf9de service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069293 Aug 27 05:05:56.683206 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2898/5747] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:56.810424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-f3075d9a-457a-4af2-991f-7584435d65cd req-8bad35fd-b124-4791-b801-0ec4f95390a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82956fdf-e10f-4f30-835f-9c025da46479", "tag": "000cfb7d-f84b-4f34-afa8-cf1e87bb3337"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:56.834994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f3075d9a-457a-4af2-991f-7584435d65cd req-8bad35fd-b124-4791-b801-0ec4f95390a3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:56.835853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f3075d9a-457a-4af2-991f-7584435d65cd req-8bad35fd-b124-4791-b801-0ec4f95390a3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:56.836470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f3075d9a-457a-4af2-991f-7584435d65cd req-8bad35fd-b124-4791-b801-0ec4f95390a3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:56.862686 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f3075d9a-457a-4af2-991f-7584435d65cd req-8bad35fd-b124-4791-b801-0ec4f95390a3 service nova] Creating event network-changed:000cfb7d-f84b-4f34-afa8-cf1e87bb3337 for instance 82956fdf-e10f-4f30-835f-9c025da46479 on n-h2-854823-1 Aug 27 05:05:56.872061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52ef0a8c-a208-4e5c-ad9c-a621fa2b66f1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:56.872920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-52ef0a8c-a208-4e5c-ad9c-a621fa2b66f1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:56.874958 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-f3075d9a-457a-4af2-991f-7584435d65cd req-8bad35fd-b124-4791-b801-0ec4f95390a3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069402 Aug 27 05:05:56.876245 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2850/5748] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:56.892340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52ef0a8c-a208-4e5c-ad9c-a621fa2b66f1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:56.894705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52ef0a8c-a208-4e5c-ad9c-a621fa2b66f1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:56.895741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52ef0a8c-a208-4e5c-ad9c-a621fa2b66f1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:56.899513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52ef0a8c-a208-4e5c-ad9c-a621fa2b66f1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:56.900106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52ef0a8c-a208-4e5c-ad9c-a621fa2b66f1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:56.902444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52ef0a8c-a208-4e5c-ad9c-a621fa2b66f1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:57.171505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-da7cf413-9e14-4283-8010-e7bb9066e8cb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:57.172221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-da7cf413-9e14-4283-8010-e7bb9066e8cb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:57.184198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da7cf413-9e14-4283-8010-e7bb9066e8cb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:57.190339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da7cf413-9e14-4283-8010-e7bb9066e8cb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:57.190795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da7cf413-9e14-4283-8010-e7bb9066e8cb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:57.191739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da7cf413-9e14-4283-8010-e7bb9066e8cb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:57.192198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da7cf413-9e14-4283-8010-e7bb9066e8cb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:57.192652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da7cf413-9e14-4283-8010-e7bb9066e8cb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:57.273478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da7cf413-9e14-4283-8010-e7bb9066e8cb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:57.274657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da7cf413-9e14-4283-8010-e7bb9066e8cb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:57.276660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da7cf413-9e14-4283-8010-e7bb9066e8cb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:57.277438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-da7cf413-9e14-4283-8010-e7bb9066e8cb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lazy-loading 'fault' on Instance uuid c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:05:57.305094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52ef0a8c-a208-4e5c-ad9c-a621fa2b66f1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:57.317153 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52ef0a8c-a208-4e5c-ad9c-a621fa2b66f1 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1511 microversion: 2.1 time: 0.452668 Aug 27 05:05:57.322686 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2899/5749] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:56 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1511 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:57.328417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ebffd893-78e0-4761-9a4f-fb15e01a4c51 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:57.329390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ebffd893-78e0-4761-9a4f-fb15e01a4c51 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:57.337310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebffd893-78e0-4761-9a4f-fb15e01a4c51 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:57.338087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebffd893-78e0-4761-9a4f-fb15e01a4c51 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:57.339436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebffd893-78e0-4761-9a4f-fb15e01a4c51 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:57.340818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebffd893-78e0-4761-9a4f-fb15e01a4c51 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:57.341490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebffd893-78e0-4761-9a4f-fb15e01a4c51 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:57.342292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebffd893-78e0-4761-9a4f-fb15e01a4c51 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:57.397049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-da7cf413-9e14-4283-8010-e7bb9066e8cb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:57.405248 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-da7cf413-9e14-4283-8010-e7bb9066e8cb tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 200 len: 1357 microversion: 2.1 time: 0.242946 Aug 27 05:05:57.422842 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2851/5750] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:57 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:05:57.674804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ebffd893-78e0-4761-9a4f-fb15e01a4c51 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:57.687023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ebffd893-78e0-4761-9a4f-fb15e01a4c51 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:57.689707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ebffd893-78e0-4761-9a4f-fb15e01a4c51 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:57.691570 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ebffd893-78e0-4761-9a4f-fb15e01a4c51 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1745 microversion: 2.20 time: 0.366976 Aug 27 05:05:57.692844 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2900/5751] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:57 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1745 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:57.912424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-affce227-7d1a-427f-bdcf-e48f5d050248 req-98ed3823-824e-4817-bc59-f54545856b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba63d69-1a05-41ec-9620-e772743da5ae", "name": "network-vif-deleted", "tag": "bca03d46-1865-45c9-897b-833934521260"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:57.958767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-affce227-7d1a-427f-bdcf-e48f5d050248 req-98ed3823-824e-4817-bc59-f54545856b52 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:57.960126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-affce227-7d1a-427f-bdcf-e48f5d050248 req-98ed3823-824e-4817-bc59-f54545856b52 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:57.961330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-affce227-7d1a-427f-bdcf-e48f5d050248 req-98ed3823-824e-4817-bc59-f54545856b52 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:57.995504 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-affce227-7d1a-427f-bdcf-e48f5d050248 req-98ed3823-824e-4817-bc59-f54545856b52 service nova] Creating event network-vif-deleted:bca03d46-1865-45c9-897b-833934521260 for instance cba63d69-1a05-41ec-9620-e772743da5ae on n-h1-854823-1 Aug 27 05:05:58.006703 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-affce227-7d1a-427f-bdcf-e48f5d050248 req-98ed3823-824e-4817-bc59-f54545856b52 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114411 Aug 27 05:05:58.011975 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2852/5752] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:58.343871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a830fe96-4bba-4129-b189-5ad96a1f87eb tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:58.344892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a830fe96-4bba-4129-b189-5ad96a1f87eb tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:58.351918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a830fe96-4bba-4129-b189-5ad96a1f87eb tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:58.352652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a830fe96-4bba-4129-b189-5ad96a1f87eb tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:58.353317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a830fe96-4bba-4129-b189-5ad96a1f87eb tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:58.354613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a830fe96-4bba-4129-b189-5ad96a1f87eb tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:58.355105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a830fe96-4bba-4129-b189-5ad96a1f87eb tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:58.355552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a830fe96-4bba-4129-b189-5ad96a1f87eb tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:58.389867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a830fe96-4bba-4129-b189-5ad96a1f87eb tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:58.390378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a830fe96-4bba-4129-b189-5ad96a1f87eb tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:58.390832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a830fe96-4bba-4129-b189-5ad96a1f87eb tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:58.391303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-a830fe96-4bba-4129-b189-5ad96a1f87eb tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lazy-loading 'fault' on Instance uuid cba63d69-1a05-41ec-9620-e772743da5ae {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:05:58.432904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b9cab9b5-4798-4f83-bd56-513a3d6a36f0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:58.433613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b9cab9b5-4798-4f83-bd56-513a3d6a36f0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:58.439395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a830fe96-4bba-4129-b189-5ad96a1f87eb tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb5adea3b6a4fd489254b022c86d288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237f42aa1504c8eaaee4e443e4f03a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:58.443876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9cab9b5-4798-4f83-bd56-513a3d6a36f0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:58.444796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9cab9b5-4798-4f83-bd56-513a3d6a36f0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:58.445457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9cab9b5-4798-4f83-bd56-513a3d6a36f0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:58.446383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9cab9b5-4798-4f83-bd56-513a3d6a36f0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:58.447440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9cab9b5-4798-4f83-bd56-513a3d6a36f0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:58.448707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9cab9b5-4798-4f83-bd56-513a3d6a36f0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:58.449931 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a830fe96-4bba-4129-b189-5ad96a1f87eb tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 200 len: 1306 microversion: 2.1 time: 0.110029 Aug 27 05:05:58.452758 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2901/5753] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:58 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 1306 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:05:58.478383 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-b9cab9b5-4798-4f83-bd56-513a3d6a36f0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] HTTP exception thrown: Instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c could not be found. Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b9cab9b5-4798-4f83-bd56-513a3d6a36f0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Request method failure captured: Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c HTTP/1.1 Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaRLmGBWEgwXQ5YrU3e-W09M-LG1_uBsJAS_ya1U9ZYATItKtu2g488KSFy-iTE2V_v7BoakUfBk6IbcG40wQ3Zjfp3X3qOXFXfrymr-WhwLzX-o71ez1rD8Ed7CjlUefvAzorMpVDawtgICzWr1EdH9eXF9QcoonuA5HE1Rfgy_-qk Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 7c34a6245d5c46f6babc0b7775512d84 Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-511432365 Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestNetworkAdvancedServerOps-511432365 Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 7c34a6245d5c46f6babc0b7775512d84 Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-511432365 Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestNetworkAdvancedServerOps-511432365-project Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: e508461869c24fb3ad1641d830e2b22a Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestNetworkAdvancedServerOps-511432365-project Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c could not be found. Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c'} Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c could not be found. Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c could not be found. Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:05:58.481799 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:05:58.486655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:05:58.486655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:58.486655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:05:58.486655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:05:58.486655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:05:58.486655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:05:58.486655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c could not be found. Aug 27 05:05:58.486655 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:05:58.488833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b9cab9b5-4798-4f83-bd56-513a3d6a36f0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Returning 404 to user: Instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:05:58.489810 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b9cab9b5-4798-4f83-bd56-513a3d6a36f0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c" status: 404 len: 111 microversion: 2.1 time: 0.061505 Aug 27 05:05:58.490757 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2853/5754] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:58 2022] GET /compute/v2.1/servers/c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:05:58.716058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-890f3449-645e-4706-8cf1-d75511bcd92c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:58.716807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-890f3449-645e-4706-8cf1-d75511bcd92c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:58.722934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890f3449-645e-4706-8cf1-d75511bcd92c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:58.723449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890f3449-645e-4706-8cf1-d75511bcd92c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:58.723923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890f3449-645e-4706-8cf1-d75511bcd92c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:58.724669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890f3449-645e-4706-8cf1-d75511bcd92c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:58.725151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890f3449-645e-4706-8cf1-d75511bcd92c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:58.725601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890f3449-645e-4706-8cf1-d75511bcd92c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:58.937165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-890f3449-645e-4706-8cf1-d75511bcd92c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:58.946400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-47b93bea-ae93-4f38-98b8-56e47d3ef38b req-c94a16de-ef0f-4dcf-9605-47c264675c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c", "name": "network-vif-deleted", "tag": "1c0cd31d-1134-43c3-8033-7756a472aa85"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:05:58.960481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-890f3449-645e-4706-8cf1-d75511bcd92c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:58.961899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-890f3449-645e-4706-8cf1-d75511bcd92c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:05:58.963105 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-890f3449-645e-4706-8cf1-d75511bcd92c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1745 microversion: 2.20 time: 0.252067 Aug 27 05:05:58.968027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-47b93bea-ae93-4f38-98b8-56e47d3ef38b req-c94a16de-ef0f-4dcf-9605-47c264675c1f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:58.968796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-47b93bea-ae93-4f38-98b8-56e47d3ef38b req-c94a16de-ef0f-4dcf-9605-47c264675c1f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:58.969392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-47b93bea-ae93-4f38-98b8-56e47d3ef38b req-c94a16de-ef0f-4dcf-9605-47c264675c1f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:58.969882 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2902/5755] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:58 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1745 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:05:58.995487 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-47b93bea-ae93-4f38-98b8-56e47d3ef38b req-c94a16de-ef0f-4dcf-9605-47c264675c1f service nova] Creating event network-vif-deleted:1c0cd31d-1134-43c3-8033-7756a472aa85 for instance c0fdc6b5-2c3f-45e1-bc17-575a1c2e153c on n-h1-854823-1 Aug 27 05:05:59.002345 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-47b93bea-ae93-4f38-98b8-56e47d3ef38b req-c94a16de-ef0f-4dcf-9605-47c264675c1f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059102 Aug 27 05:05:59.003553 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2854/5756] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:05:59.471231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfacff93-13fd-43a9-b927-720fe503d523 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:59.472594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dfacff93-13fd-43a9-b927-720fe503d523 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] [instance: cba63d69-1a05-41ec-9620-e772743da5ae] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:05:59.479470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:59.481194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfacff93-13fd-43a9-b927-720fe503d523 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:59.481887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfacff93-13fd-43a9-b927-720fe503d523 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:59.482500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfacff93-13fd-43a9-b927-720fe503d523 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:59.483418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfacff93-13fd-43a9-b927-720fe503d523 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:05:59.484064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfacff93-13fd-43a9-b927-720fe503d523 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:05:59.484717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfacff93-13fd-43a9-b927-720fe503d523 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:05:59.506214 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-dfacff93-13fd-43a9-b927-720fe503d523 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] HTTP exception thrown: Instance cba63d69-1a05-41ec-9620-e772743da5ae could not be found. Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfacff93-13fd-43a9-b927-720fe503d523 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Request method failure captured: Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae HTTP/1.1 Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaYdwQ6LUr9Z96Mofa2TFaDw94mrvdgFQFZpBj8MAOvdDIhJrAR0iCtZSK8SDi5c-JK1pDxhaMY5ki7lEoXH9MeEES6CCVBHW_DMzpCvJcCUnqdCBie2CuD7KehlPJLHBMr3XyjNsmDaOmCsygA_WEz1zZoIlDcDiaVYc7YOdCQOS64 Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 9237f42aa1504c8eaaee4e443e4f03a6 Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-InstanceActionsTestJSON-1015774819 Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9237f42aa1504c8eaaee4e443e4f03a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9237f42aa1504c8eaaee4e443e4f03a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9237f42aa1504c8eaaee4e443e4f03a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9237f42aa1504c8eaaee4e443e4f03a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-InstanceActionsTestJSON-1015774819 Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 9237f42aa1504c8eaaee4e443e4f03a6 Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1015774819 Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-InstanceActionsTestJSON-1015774819-project Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 1cb5adea3b6a4fd489254b022c86d288 Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-InstanceActionsTestJSON-1015774819-project Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance cba63d69-1a05-41ec-9620-e772743da5ae could not be found. Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'cba63d69-1a05-41ec-9620-e772743da5ae'} Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba63d69-1a05-41ec-9620-e772743da5ae could not be found. Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba63d69-1a05-41ec-9620-e772743da5ae could not be found. Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:05:59.507929 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:05:59.513155 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:05:59.513155 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:05:59.513155 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:05:59.513155 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:05:59.513155 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:05:59.513155 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba63d69-1a05-41ec-9620-e772743da5ae could not be found. Aug 27 05:05:59.513155 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:05:59.514601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfacff93-13fd-43a9-b927-720fe503d523 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] Returning 404 to user: Instance cba63d69-1a05-41ec-9620-e772743da5ae could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:05:59.515699 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dfacff93-13fd-43a9-b927-720fe503d523 tempest-InstanceActionsTestJSON-1015774819 tempest-InstanceActionsTestJSON-1015774819-project] 10.222.0.79 "GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae" status: 404 len: 111 microversion: 2.1 time: 0.048446 Aug 27 05:05:59.516887 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2903/5757] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:05:59 2022] GET /compute/v2.1/servers/cba63d69-1a05-41ec-9620-e772743da5ae => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:05:59.989453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3421a7d6-e52c-4654-abce-55908f9a348c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:05:59.990869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3421a7d6-e52c-4654-abce-55908f9a348c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:00.000543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3421a7d6-e52c-4654-abce-55908f9a348c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:00.001459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3421a7d6-e52c-4654-abce-55908f9a348c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:00.002176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3421a7d6-e52c-4654-abce-55908f9a348c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:00.003140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3421a7d6-e52c-4654-abce-55908f9a348c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:00.003824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3421a7d6-e52c-4654-abce-55908f9a348c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:00.004486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3421a7d6-e52c-4654-abce-55908f9a348c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:00.917147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3421a7d6-e52c-4654-abce-55908f9a348c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:00.926422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3421a7d6-e52c-4654-abce-55908f9a348c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:00.931517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3421a7d6-e52c-4654-abce-55908f9a348c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:00.939118 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3421a7d6-e52c-4654-abce-55908f9a348c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1740 microversion: 2.20 time: 0.956224 Aug 27 05:06:00.940216 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2855/5758] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:05:59 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1740 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:01.972172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-283aa80c-b92c-4a98-9cb5-5c958b5f6c0f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:01.979570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-283aa80c-b92c-4a98-9cb5-5c958b5f6c0f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:02.002377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-283aa80c-b92c-4a98-9cb5-5c958b5f6c0f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:02.017568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-283aa80c-b92c-4a98-9cb5-5c958b5f6c0f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:02.018356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-283aa80c-b92c-4a98-9cb5-5c958b5f6c0f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:02.019315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-283aa80c-b92c-4a98-9cb5-5c958b5f6c0f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:02.019998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-283aa80c-b92c-4a98-9cb5-5c958b5f6c0f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:02.020649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-283aa80c-b92c-4a98-9cb5-5c958b5f6c0f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:02.808055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-283aa80c-b92c-4a98-9cb5-5c958b5f6c0f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:02.837438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-283aa80c-b92c-4a98-9cb5-5c958b5f6c0f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:02.846992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-283aa80c-b92c-4a98-9cb5-5c958b5f6c0f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:02.853712 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-283aa80c-b92c-4a98-9cb5-5c958b5f6c0f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1740 microversion: 2.20 time: 0.889503 Aug 27 05:06:02.876993 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2904/5759] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:01 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1740 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:03.925392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-25996e82-8bec-48bd-b2e0-5c04e5ade1ee tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:03.926562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-25996e82-8bec-48bd-b2e0-5c04e5ade1ee tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:03.936617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25996e82-8bec-48bd-b2e0-5c04e5ade1ee tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:03.939758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25996e82-8bec-48bd-b2e0-5c04e5ade1ee tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:03.940436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25996e82-8bec-48bd-b2e0-5c04e5ade1ee tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:03.941710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25996e82-8bec-48bd-b2e0-5c04e5ade1ee tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:03.942338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25996e82-8bec-48bd-b2e0-5c04e5ade1ee tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:03.943521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25996e82-8bec-48bd-b2e0-5c04e5ade1ee tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:04.735867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-25996e82-8bec-48bd-b2e0-5c04e5ade1ee tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:04.792711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-25996e82-8bec-48bd-b2e0-5c04e5ade1ee tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:04.806188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-25996e82-8bec-48bd-b2e0-5c04e5ade1ee tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:04.808820 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-25996e82-8bec-48bd-b2e0-5c04e5ade1ee tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1740 microversion: 2.20 time: 0.889144 Aug 27 05:06:04.838109 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2856/5760] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:03 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1740 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:05.865817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c9617f13-f525-4d36-9555-71140a6f4698 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:05.867221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c9617f13-f525-4d36-9555-71140a6f4698 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:05.919264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9617f13-f525-4d36-9555-71140a6f4698 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:05.920169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9617f13-f525-4d36-9555-71140a6f4698 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:05.933055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9617f13-f525-4d36-9555-71140a6f4698 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:05.934388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9617f13-f525-4d36-9555-71140a6f4698 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:05.935553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9617f13-f525-4d36-9555-71140a6f4698 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:05.936582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9617f13-f525-4d36-9555-71140a6f4698 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:06.321191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c9617f13-f525-4d36-9555-71140a6f4698 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:06.331132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c9617f13-f525-4d36-9555-71140a6f4698 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:06.336400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c9617f13-f525-4d36-9555-71140a6f4698 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:06.341971 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c9617f13-f525-4d36-9555-71140a6f4698 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1740 microversion: 2.20 time: 0.483585 Aug 27 05:06:06.344667 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2905/5761] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:05 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1740 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:07.371707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f454eb12-1e94-47ab-9ba6-baf05d04200d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:07.373004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f454eb12-1e94-47ab-9ba6-baf05d04200d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:07.386689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f454eb12-1e94-47ab-9ba6-baf05d04200d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:07.397259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f454eb12-1e94-47ab-9ba6-baf05d04200d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:07.398002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f454eb12-1e94-47ab-9ba6-baf05d04200d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:07.398875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f454eb12-1e94-47ab-9ba6-baf05d04200d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:07.399460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f454eb12-1e94-47ab-9ba6-baf05d04200d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:07.400003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f454eb12-1e94-47ab-9ba6-baf05d04200d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:07.689467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f454eb12-1e94-47ab-9ba6-baf05d04200d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:07.726148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f454eb12-1e94-47ab-9ba6-baf05d04200d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:07.760662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f454eb12-1e94-47ab-9ba6-baf05d04200d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:07.776871 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f454eb12-1e94-47ab-9ba6-baf05d04200d tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1740 microversion: 2.20 time: 0.402223 Aug 27 05:06:07.780843 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2857/5762] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:07 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:08.032749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5484bb32-bd36-4a5a-ae32-1071ee6decc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '.version_select at 0x7f1f20e63280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:08.079169 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5484bb32-bd36-4a5a-ae32-1071ee6decc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1653418233" status: 202 len: 0 microversion: 2.1 time: 0.052216 Aug 27 05:06:08.082214 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2906/5763] 10.222.0.79 () {58 vars in 1284 bytes} [Sat Aug 27 05:06:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1653418233 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:06:08.132109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-593f9dbb-ffe8-438a-9cbb-dceb5d6c7c62 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'create', calling method: .version_select at 0x7f1f20f73b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-483116555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaarylclrIABozH7Fb1mvvcuAAC2/exk4MtwrFVbHnX2mFlfWr19wYgYclGP9NO8pNIf4Q8FMLrhOTy+SyfzrmXkdEmMrVom+gOE5+Xx1MQSKx2dT2jL0JztehN4mpW6A=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:08.180317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-593f9dbb-ffe8-438a-9cbb-dceb5d6c7c62 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:06:08.190585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-593f9dbb-ffe8-438a-9cbb-dceb5d6c7c62 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for user e508461869c24fb3ad1641d830e2b22a and project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:06:08.304347 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-593f9dbb-ffe8-438a-9cbb-dceb5d6c7c62 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.181959 Aug 27 05:06:08.324329 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2858/5764] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:06:08 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:08.806244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ffe729bd-be97-4f33-8053-32656c40740e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:08.807185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ffe729bd-be97-4f33-8053-32656c40740e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:08.814619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffe729bd-be97-4f33-8053-32656c40740e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:08.815124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffe729bd-be97-4f33-8053-32656c40740e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:08.815856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffe729bd-be97-4f33-8053-32656c40740e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:08.817339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffe729bd-be97-4f33-8053-32656c40740e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:08.818217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffe729bd-be97-4f33-8053-32656c40740e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:08.818847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffe729bd-be97-4f33-8053-32656c40740e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:09.484403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ffe729bd-be97-4f33-8053-32656c40740e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:09.498173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ffe729bd-be97-4f33-8053-32656c40740e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:09.501437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ffe729bd-be97-4f33-8053-32656c40740e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:09.503468 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ffe729bd-be97-4f33-8053-32656c40740e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1740 microversion: 2.20 time: 0.700959 Aug 27 05:06:09.505377 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2907/5765] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:08 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1740 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:10.533766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c869f037-7d6e-4662-8298-cba4bb075738 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:10.535213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c869f037-7d6e-4662-8298-cba4bb075738 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:10.566649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c869f037-7d6e-4662-8298-cba4bb075738 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:10.567523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c869f037-7d6e-4662-8298-cba4bb075738 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:10.573783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c869f037-7d6e-4662-8298-cba4bb075738 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:10.577497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c869f037-7d6e-4662-8298-cba4bb075738 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:10.577999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c869f037-7d6e-4662-8298-cba4bb075738 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:10.580441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c869f037-7d6e-4662-8298-cba4bb075738 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:10.628381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:11.085734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c869f037-7d6e-4662-8298-cba4bb075738 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:11.101691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c869f037-7d6e-4662-8298-cba4bb075738 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:11.103171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c869f037-7d6e-4662-8298-cba4bb075738 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:11.105201 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c869f037-7d6e-4662-8298-cba4bb075738 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1740 microversion: 2.20 time: 0.575515 Aug 27 05:06:11.126563 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2859/5766] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:10 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1740 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:12.140143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-585eda20-7e76-4f15-973c-2f4198fe4c95 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:12.141935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-585eda20-7e76-4f15-973c-2f4198fe4c95 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:12.158606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-585eda20-7e76-4f15-973c-2f4198fe4c95 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:12.162353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-585eda20-7e76-4f15-973c-2f4198fe4c95 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:12.166560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-585eda20-7e76-4f15-973c-2f4198fe4c95 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:12.167629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-585eda20-7e76-4f15-973c-2f4198fe4c95 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:12.169047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-585eda20-7e76-4f15-973c-2f4198fe4c95 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:12.169751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-585eda20-7e76-4f15-973c-2f4198fe4c95 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:12.561033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-585eda20-7e76-4f15-973c-2f4198fe4c95 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:12.571578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-585eda20-7e76-4f15-973c-2f4198fe4c95 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:12.581398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-585eda20-7e76-4f15-973c-2f4198fe4c95 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:12.596662 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-585eda20-7e76-4f15-973c-2f4198fe4c95 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1740 microversion: 2.20 time: 0.468873 Aug 27 05:06:12.607598 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2908/5767] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:12 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1740 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:13.623925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6819a478-dc72-43dd-bf8c-4e18f67974dc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:13.624773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6819a478-dc72-43dd-bf8c-4e18f67974dc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:13.639633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6819a478-dc72-43dd-bf8c-4e18f67974dc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:13.645261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6819a478-dc72-43dd-bf8c-4e18f67974dc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:13.646095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6819a478-dc72-43dd-bf8c-4e18f67974dc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:13.647043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6819a478-dc72-43dd-bf8c-4e18f67974dc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:13.647682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6819a478-dc72-43dd-bf8c-4e18f67974dc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:13.648264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6819a478-dc72-43dd-bf8c-4e18f67974dc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:14.520385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6819a478-dc72-43dd-bf8c-4e18f67974dc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:14.560565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6819a478-dc72-43dd-bf8c-4e18f67974dc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:14.571315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6819a478-dc72-43dd-bf8c-4e18f67974dc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:14.581649 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6819a478-dc72-43dd-bf8c-4e18f67974dc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1740 microversion: 2.20 time: 0.962598 Aug 27 05:06:14.592564 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2860/5768] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:13 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1740 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:15.615934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0660aef9-29cc-4e9d-abda-5a0228ff3168 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:15.617238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0660aef9-29cc-4e9d-abda-5a0228ff3168 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:15.625792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0660aef9-29cc-4e9d-abda-5a0228ff3168 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:15.626667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0660aef9-29cc-4e9d-abda-5a0228ff3168 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:15.627295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0660aef9-29cc-4e9d-abda-5a0228ff3168 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:15.628485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0660aef9-29cc-4e9d-abda-5a0228ff3168 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:15.629227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0660aef9-29cc-4e9d-abda-5a0228ff3168 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:15.629997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0660aef9-29cc-4e9d-abda-5a0228ff3168 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:15.958417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0660aef9-29cc-4e9d-abda-5a0228ff3168 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:15.973324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0660aef9-29cc-4e9d-abda-5a0228ff3168 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:15.976106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0660aef9-29cc-4e9d-abda-5a0228ff3168 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:15.978495 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0660aef9-29cc-4e9d-abda-5a0228ff3168 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1740 microversion: 2.20 time: 0.369219 Aug 27 05:06:16.002881 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2909/5769] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:15 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1740 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:17.005463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1d58dbda-9899-4d16-99a1-a06dd35e05fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:17.006711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1d58dbda-9899-4d16-99a1-a06dd35e05fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:17.019097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d58dbda-9899-4d16-99a1-a06dd35e05fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:17.020918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d58dbda-9899-4d16-99a1-a06dd35e05fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:17.022087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d58dbda-9899-4d16-99a1-a06dd35e05fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:17.024462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d58dbda-9899-4d16-99a1-a06dd35e05fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:17.025823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d58dbda-9899-4d16-99a1-a06dd35e05fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:17.027935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1d58dbda-9899-4d16-99a1-a06dd35e05fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:17.595211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1d58dbda-9899-4d16-99a1-a06dd35e05fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:17.627641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1d58dbda-9899-4d16-99a1-a06dd35e05fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:17.637995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1d58dbda-9899-4d16-99a1-a06dd35e05fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:17.644067 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1d58dbda-9899-4d16-99a1-a06dd35e05fc tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1740 microversion: 2.20 time: 0.642910 Aug 27 05:06:17.649700 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2861/5770] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:16 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1740 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:06:18.677874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76a1babb-de82-4348-a39e-d66566cb3223 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:18.678516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76a1babb-de82-4348-a39e-d66566cb3223 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:18.694386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a1babb-de82-4348-a39e-d66566cb3223 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:18.696783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a1babb-de82-4348-a39e-d66566cb3223 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:18.699044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a1babb-de82-4348-a39e-d66566cb3223 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:18.702589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a1babb-de82-4348-a39e-d66566cb3223 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:18.703077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a1babb-de82-4348-a39e-d66566cb3223 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:18.709052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a1babb-de82-4348-a39e-d66566cb3223 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:19.008857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-76a1babb-de82-4348-a39e-d66566cb3223 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:19.018567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-76a1babb-de82-4348-a39e-d66566cb3223 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:19.022848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-76a1babb-de82-4348-a39e-d66566cb3223 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:19.025248 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76a1babb-de82-4348-a39e-d66566cb3223 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1740 microversion: 2.20 time: 0.351722 Aug 27 05:06:19.037707 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2910/5771] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:18 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1740 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:20.052563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-415e167c-7ff9-4be3-8c02-8646b4850687 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:20.053204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-415e167c-7ff9-4be3-8c02-8646b4850687 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:20.062467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:20.081199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-415e167c-7ff9-4be3-8c02-8646b4850687 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:20.081964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-415e167c-7ff9-4be3-8c02-8646b4850687 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:20.082702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-415e167c-7ff9-4be3-8c02-8646b4850687 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:20.083680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-415e167c-7ff9-4be3-8c02-8646b4850687 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:20.084437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-415e167c-7ff9-4be3-8c02-8646b4850687 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:20.085101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-415e167c-7ff9-4be3-8c02-8646b4850687 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:20.343706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-415e167c-7ff9-4be3-8c02-8646b4850687 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:20.360408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-415e167c-7ff9-4be3-8c02-8646b4850687 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:20.361936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-415e167c-7ff9-4be3-8c02-8646b4850687 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:20.363189 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-415e167c-7ff9-4be3-8c02-8646b4850687 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1722 microversion: 2.20 time: 0.315968 Aug 27 05:06:20.363840 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2862/5772] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:20 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:20.543750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-282432169", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "dce8fbb3-a247-4208-a3af-2a99a3a58f9b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:20.635058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] validate_networks() for [('dce8fbb3-a247-4208-a3af-2a99a3a58f9b', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:06:21.390052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-248be62b-a3ed-4e53-b409-09a44a0e2aa9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:21.390834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-248be62b-a3ed-4e53-b409-09a44a0e2aa9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:21.401327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-248be62b-a3ed-4e53-b409-09a44a0e2aa9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:21.402112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-248be62b-a3ed-4e53-b409-09a44a0e2aa9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:21.402813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-248be62b-a3ed-4e53-b409-09a44a0e2aa9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:21.404091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-248be62b-a3ed-4e53-b409-09a44a0e2aa9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:21.405136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-248be62b-a3ed-4e53-b409-09a44a0e2aa9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:21.405880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-248be62b-a3ed-4e53-b409-09a44a0e2aa9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:21.608137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-248be62b-a3ed-4e53-b409-09a44a0e2aa9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:21.622192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-248be62b-a3ed-4e53-b409-09a44a0e2aa9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:21.624384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-248be62b-a3ed-4e53-b409-09a44a0e2aa9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:21.625938 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-248be62b-a3ed-4e53-b409-09a44a0e2aa9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1722 microversion: 2.20 time: 0.240104 Aug 27 05:06:21.627142 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2863/5773] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:21 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:22.450906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:06:22.451408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:06:22.451824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:06:22.452436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:06:22.453082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:06:22.465530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:22.466279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:22.467567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:22.468509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:22.471676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:22.471991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:22.506927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Getting quotas for project 7d8b8e262d854d4580541782ec6c2921. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:06:22.518576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Getting quotas for user ea381bd85ad64d32bfcc340d2d8261c7 and project 7d8b8e262d854d4580541782ec6c2921. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:06:22.549219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:06:22.560662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:06:22.642031 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47a6ad11-1bdd-45a1-be6e-7cb24845082d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.345560 Aug 27 05:06:22.643278 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2911/5774] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:06:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:06:22.651780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ad56447d-6bd9-4c12-99ba-9fb34c67009a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:22.653020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ad56447d-6bd9-4c12-99ba-9fb34c67009a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:22.661794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-acc35590-fbff-49f5-8ca2-692bbb8543ba tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:22.662973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-acc35590-fbff-49f5-8ca2-692bbb8543ba tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:22.666807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad56447d-6bd9-4c12-99ba-9fb34c67009a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:22.670767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad56447d-6bd9-4c12-99ba-9fb34c67009a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:22.671227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad56447d-6bd9-4c12-99ba-9fb34c67009a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:22.671975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad56447d-6bd9-4c12-99ba-9fb34c67009a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:22.672438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad56447d-6bd9-4c12-99ba-9fb34c67009a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:22.672899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad56447d-6bd9-4c12-99ba-9fb34c67009a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:22.825650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-acc35590-fbff-49f5-8ca2-692bbb8543ba tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:22.836749 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-acc35590-fbff-49f5-8ca2-692bbb8543ba tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1224 microversion: 2.1 time: 0.185305 Aug 27 05:06:22.850117 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2912/5775] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:22 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1224 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:23.142397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1595850784", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "064f76ce-a409-4ee7-be7a-4362bb082d5d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-483116555", "security_groups": [{"name": "tempest-secgroup-smoke-936281964"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:23.201104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ad56447d-6bd9-4c12-99ba-9fb34c67009a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:23.217153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ad56447d-6bd9-4c12-99ba-9fb34c67009a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:23.218845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ad56447d-6bd9-4c12-99ba-9fb34c67009a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:23.221113 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ad56447d-6bd9-4c12-99ba-9fb34c67009a tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1722 microversion: 2.20 time: 0.574579 Aug 27 05:06:23.224223 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2864/5776] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:22 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1722 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:23.301661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] validate_networks() for [('064f76ce-a409-4ee7-be7a-4362bb082d5d', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:06:23.799196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:06:23.800704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:06:23.801406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:06:23.802026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:06:23.802635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:06:23.816084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:23.816937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:23.817651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:23.818615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:23.819282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:23.819932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:23.840146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:06:23.846107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for user e508461869c24fb3ad1641d830e2b22a and project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:06:23.857780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc41dea8-7aa3-47f9-b61a-2c37e56a5393 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:23.858906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bc41dea8-7aa3-47f9-b61a-2c37e56a5393 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:23.869163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc41dea8-7aa3-47f9-b61a-2c37e56a5393 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:23.869672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc41dea8-7aa3-47f9-b61a-2c37e56a5393 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:23.870127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc41dea8-7aa3-47f9-b61a-2c37e56a5393 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:23.870884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc41dea8-7aa3-47f9-b61a-2c37e56a5393 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:23.871339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc41dea8-7aa3-47f9-b61a-2c37e56a5393 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:23.875461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc41dea8-7aa3-47f9-b61a-2c37e56a5393 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:23.883329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:06:23.885967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:06:23.977709 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b932206f-9298-4d90-9a79-3e83e5d28728 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.841463 Aug 27 05:06:23.984688 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2913/5777] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:06:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:06:24.001435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49c007fe-cc4f-4c79-8d8b-684a66eab2cd tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:24.002344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-49c007fe-cc4f-4c79-8d8b-684a66eab2cd tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:24.088417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bc41dea8-7aa3-47f9-b61a-2c37e56a5393 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:24.110386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49c007fe-cc4f-4c79-8d8b-684a66eab2cd tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:24.114922 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bc41dea8-7aa3-47f9-b61a-2c37e56a5393 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1228 microversion: 2.1 time: 0.247675 Aug 27 05:06:24.118629 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2865/5778] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:23 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1228 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:24.120790 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49c007fe-cc4f-4c79-8d8b-684a66eab2cd tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1266 microversion: 2.1 time: 0.125217 Aug 27 05:06:24.124922 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2914/5779] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:23 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:24.248887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-062b1a22-429f-434a-8a47-8216515cbbf3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:24.250465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-062b1a22-429f-434a-8a47-8216515cbbf3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:24.258553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:24.265592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-062b1a22-429f-434a-8a47-8216515cbbf3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:24.275960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-062b1a22-429f-434a-8a47-8216515cbbf3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:24.283205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-062b1a22-429f-434a-8a47-8216515cbbf3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:24.284651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-062b1a22-429f-434a-8a47-8216515cbbf3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:24.288133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-062b1a22-429f-434a-8a47-8216515cbbf3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:24.292808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-062b1a22-429f-434a-8a47-8216515cbbf3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:24.709039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-062b1a22-429f-434a-8a47-8216515cbbf3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:24.719976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-062b1a22-429f-434a-8a47-8216515cbbf3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:24.726985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-062b1a22-429f-434a-8a47-8216515cbbf3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:24.731995 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-062b1a22-429f-434a-8a47-8216515cbbf3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1725 microversion: 2.20 time: 0.488230 Aug 27 05:06:24.733465 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2866/5780] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:24 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1725 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:24.760014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30295041-f420-42f4-910c-53449be6f28e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1b2cb84-cc2b-4b44-aa7e-07721d7922fa"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:24.762995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-30295041-f420-42f4-910c-53449be6f28e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:24.780641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30295041-f420-42f4-910c-53449be6f28e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:24.781547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30295041-f420-42f4-910c-53449be6f28e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:24.782214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30295041-f420-42f4-910c-53449be6f28e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:24.784554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30295041-f420-42f4-910c-53449be6f28e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:24.786620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30295041-f420-42f4-910c-53449be6f28e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:24.788653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30295041-f420-42f4-910c-53449be6f28e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:24.848679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:24.960982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-216d2a66-47b8-448b-85ea-53507cb457b8 req-cfcdd6d0-0210-4e67-9eb6-ba42ac10168d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf34f382-9b01-4519-ba5f-78471ee22e32", "name": "network-vif-unplugged", "status": "completed", "tag": "7a1ec75a-2f7a-416e-b884-5870283eafe6"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:24.995097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-216d2a66-47b8-448b-85ea-53507cb457b8 req-cfcdd6d0-0210-4e67-9eb6-ba42ac10168d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:24.996104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-216d2a66-47b8-448b-85ea-53507cb457b8 req-cfcdd6d0-0210-4e67-9eb6-ba42ac10168d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:24.996966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-216d2a66-47b8-448b-85ea-53507cb457b8 req-cfcdd6d0-0210-4e67-9eb6-ba42ac10168d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:25.012920 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-216d2a66-47b8-448b-85ea-53507cb457b8 req-cfcdd6d0-0210-4e67-9eb6-ba42ac10168d service nova] Creating event network-vif-unplugged:7a1ec75a-2f7a-416e-b884-5870283eafe6 for instance bf34f382-9b01-4519-ba5f-78471ee22e32 on n-h1-854823-1 Aug 27 05:06:25.021515 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-216d2a66-47b8-448b-85ea-53507cb457b8 req-cfcdd6d0-0210-4e67-9eb6-ba42ac10168d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066065 Aug 27 05:06:25.023181 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2867/5781] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:06:25.146308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f3ce9388-b626-4b7c-a894-8085a8c94f20 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:25.148008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f3ce9388-b626-4b7c-a894-8085a8c94f20 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:25.168890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3ce9388-b626-4b7c-a894-8085a8c94f20 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:25.169717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3ce9388-b626-4b7c-a894-8085a8c94f20 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:25.170280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3ce9388-b626-4b7c-a894-8085a8c94f20 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:25.171288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3ce9388-b626-4b7c-a894-8085a8c94f20 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:25.171954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3ce9388-b626-4b7c-a894-8085a8c94f20 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:25.172603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f3ce9388-b626-4b7c-a894-8085a8c94f20 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:25.437940 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-30295041-f420-42f4-910c-53449be6f28e tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "POST /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.683668 Aug 27 05:06:25.440476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f3ce9388-b626-4b7c-a894-8085a8c94f20 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:25.445255 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2915/5782] 10.222.0.79 () {62 vars in 1364 bytes} [Sat Aug 27 05:06:24 2022] POST /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32/os-volume_attachments => generated 188 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:06:25.451966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df64027a-af68-489e-a904-6a8f4ad58fd7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:25.454723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-df64027a-af68-489e-a904-6a8f4ad58fd7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:25.467623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df64027a-af68-489e-a904-6a8f4ad58fd7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:25.468339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df64027a-af68-489e-a904-6a8f4ad58fd7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:25.469826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df64027a-af68-489e-a904-6a8f4ad58fd7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:25.470800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df64027a-af68-489e-a904-6a8f4ad58fd7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:25.472350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df64027a-af68-489e-a904-6a8f4ad58fd7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:25.472808 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f3ce9388-b626-4b7c-a894-8085a8c94f20 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1294 microversion: 2.1 time: 0.335848 Aug 27 05:06:25.473343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df64027a-af68-489e-a904-6a8f4ad58fd7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:25.473491 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2868/5783] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:25 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1294 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:25.641362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-df64027a-af68-489e-a904-6a8f4ad58fd7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:25.646638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ec6aa9a2-d1f4-40a0-839b-e8074c281136 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:25.647154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ec6aa9a2-d1f4-40a0-839b-e8074c281136 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:25.658974 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-df64027a-af68-489e-a904-6a8f4ad58fd7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1262 microversion: 2.1 time: 0.212194 Aug 27 05:06:25.660032 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2916/5784] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:25 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1262 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:25.672179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec6aa9a2-d1f4-40a0-839b-e8074c281136 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:25.673051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec6aa9a2-d1f4-40a0-839b-e8074c281136 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:25.673691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec6aa9a2-d1f4-40a0-839b-e8074c281136 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:25.674818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec6aa9a2-d1f4-40a0-839b-e8074c281136 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:25.675483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec6aa9a2-d1f4-40a0-839b-e8074c281136 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:25.676311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ec6aa9a2-d1f4-40a0-839b-e8074c281136 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:25.981975 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ec6aa9a2-d1f4-40a0-839b-e8074c281136 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32/os-volume_attachments/c1b2cb84-cc2b-4b44-aa7e-07721d7922fa" status: 202 len: 0 microversion: 2.20 time: 0.342517 Aug 27 05:06:25.985973 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2869/5785] 10.222.0.79 () {60 vars in 1457 bytes} [Sat Aug 27 05:06:25 2022] DELETE /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32/os-volume_attachments/c1b2cb84-cc2b-4b44-aa7e-07721d7922fa => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:06:26.126384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6e7029b-339b-442f-8fd6-eb6a86cddba3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:26.127554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6e7029b-339b-442f-8fd6-eb6a86cddba3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:26.144010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6e7029b-339b-442f-8fd6-eb6a86cddba3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:26.144414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6e7029b-339b-442f-8fd6-eb6a86cddba3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:26.154128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6e7029b-339b-442f-8fd6-eb6a86cddba3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:26.160682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6e7029b-339b-442f-8fd6-eb6a86cddba3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:26.161395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6e7029b-339b-442f-8fd6-eb6a86cddba3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:26.161966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6e7029b-339b-442f-8fd6-eb6a86cddba3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:26.243654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6e7029b-339b-442f-8fd6-eb6a86cddba3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128869) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 05:06:26.379965 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6e7029b-339b-442f-8fd6-eb6a86cddba3 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "POST /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32/action" status: 202 len: 0 microversion: 2.20 time: 0.258147 Aug 27 05:06:26.388890 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2917/5786] 10.222.0.79 () {62 vars in 1319 bytes} [Sat Aug 27 05:06:26 2022] POST /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:06:26.392283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d897f891-cb21-4f44-84e1-1f739fb82fdd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:26.393145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d897f891-cb21-4f44-84e1-1f739fb82fdd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:26.416061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d897f891-cb21-4f44-84e1-1f739fb82fdd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:26.418023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d897f891-cb21-4f44-84e1-1f739fb82fdd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:26.420948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d897f891-cb21-4f44-84e1-1f739fb82fdd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:26.424840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d897f891-cb21-4f44-84e1-1f739fb82fdd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:26.426569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d897f891-cb21-4f44-84e1-1f739fb82fdd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:26.427697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d897f891-cb21-4f44-84e1-1f739fb82fdd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:26.495521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34a94337-2ef9-423e-b164-071c3d3eb9fd tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:26.497008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34a94337-2ef9-423e-b164-071c3d3eb9fd tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:26.527432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a94337-2ef9-423e-b164-071c3d3eb9fd tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:26.528347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a94337-2ef9-423e-b164-071c3d3eb9fd tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:26.528854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a94337-2ef9-423e-b164-071c3d3eb9fd tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:26.541475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a94337-2ef9-423e-b164-071c3d3eb9fd tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:26.542364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a94337-2ef9-423e-b164-071c3d3eb9fd tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:26.545079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a94337-2ef9-423e-b164-071c3d3eb9fd tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:27.034729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d897f891-cb21-4f44-84e1-1f739fb82fdd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:27.055738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d897f891-cb21-4f44-84e1-1f739fb82fdd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:27.057982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d897f891-cb21-4f44-84e1-1f739fb82fdd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:27.060887 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d897f891-cb21-4f44-84e1-1f739fb82fdd tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1673 microversion: 2.20 time: 0.672214 Aug 27 05:06:27.061633 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2870/5787] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:26 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1673 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:06:27.076318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-394401e5-80a4-4059-905f-3f39118f860c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:27.078041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-394401e5-80a4-4059-905f-3f39118f860c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:27.089493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394401e5-80a4-4059-905f-3f39118f860c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:27.090409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394401e5-80a4-4059-905f-3f39118f860c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:27.091188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394401e5-80a4-4059-905f-3f39118f860c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:27.092180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394401e5-80a4-4059-905f-3f39118f860c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:27.093132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394401e5-80a4-4059-905f-3f39118f860c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:27.099402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-394401e5-80a4-4059-905f-3f39118f860c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:27.206407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-394401e5-80a4-4059-905f-3f39118f860c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:27.219697 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-394401e5-80a4-4059-905f-3f39118f860c tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1324 microversion: 2.1 time: 0.156041 Aug 27 05:06:27.220641 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2871/5788] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:27 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1324 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:27.375629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34a94337-2ef9-423e-b164-071c3d3eb9fd tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:27.389972 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34a94337-2ef9-423e-b164-071c3d3eb9fd tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1324 microversion: 2.1 time: 0.898871 Aug 27 05:06:27.391239 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2918/5789] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:26 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1324 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:28.093083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ff614960-d7c2-4682-b18d-a3d76c9f1b7b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:28.094297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ff614960-d7c2-4682-b18d-a3d76c9f1b7b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:28.125439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff614960-d7c2-4682-b18d-a3d76c9f1b7b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:28.126104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff614960-d7c2-4682-b18d-a3d76c9f1b7b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:28.126567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff614960-d7c2-4682-b18d-a3d76c9f1b7b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:28.127326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff614960-d7c2-4682-b18d-a3d76c9f1b7b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:28.134715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff614960-d7c2-4682-b18d-a3d76c9f1b7b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:28.135340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff614960-d7c2-4682-b18d-a3d76c9f1b7b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:28.229945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a4d6586e-d512-4c4f-bd42-710c1eaa90dd req-00f28ab6-5a57-4597-9250-e30888535c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c163756-2a5e-4c6e-85ef-396959f03bb8", "tag": "52dfb670-cc5a-497c-9a62-41f774ae4ed5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:28.256290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a4d6586e-d512-4c4f-bd42-710c1eaa90dd req-00f28ab6-5a57-4597-9250-e30888535c84 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:28.257317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a4d6586e-d512-4c4f-bd42-710c1eaa90dd req-00f28ab6-5a57-4597-9250-e30888535c84 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:28.257947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a4d6586e-d512-4c4f-bd42-710c1eaa90dd req-00f28ab6-5a57-4597-9250-e30888535c84 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:28.271656 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a4d6586e-d512-4c4f-bd42-710c1eaa90dd req-00f28ab6-5a57-4597-9250-e30888535c84 service nova] Creating event network-changed:52dfb670-cc5a-497c-9a62-41f774ae4ed5 for instance 3c163756-2a5e-4c6e-85ef-396959f03bb8 on n-h1-854823-1 Aug 27 05:06:28.278095 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a4d6586e-d512-4c4f-bd42-710c1eaa90dd req-00f28ab6-5a57-4597-9250-e30888535c84 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051999 Aug 27 05:06:28.279299 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2919/5790] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:06:28.286597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ea4c1f7-d779-4d97-891a-4beaae0151f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:28.288257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ea4c1f7-d779-4d97-891a-4beaae0151f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:28.297615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ea4c1f7-d779-4d97-891a-4beaae0151f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:28.298477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ea4c1f7-d779-4d97-891a-4beaae0151f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:28.299115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ea4c1f7-d779-4d97-891a-4beaae0151f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:28.300458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ea4c1f7-d779-4d97-891a-4beaae0151f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:28.301143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ea4c1f7-d779-4d97-891a-4beaae0151f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:28.303124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ea4c1f7-d779-4d97-891a-4beaae0151f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:28.435946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ff614960-d7c2-4682-b18d-a3d76c9f1b7b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:28.451790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ff614960-d7c2-4682-b18d-a3d76c9f1b7b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:28.455423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ff614960-d7c2-4682-b18d-a3d76c9f1b7b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:28.456970 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ff614960-d7c2-4682-b18d-a3d76c9f1b7b tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1731 microversion: 2.20 time: 0.372140 Aug 27 05:06:28.457575 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2872/5791] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:28 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1731 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:28.469032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5edf92cd-28af-4e61-8254-c94496f0859d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:28.469032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5edf92cd-28af-4e61-8254-c94496f0859d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:28.475497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5edf92cd-28af-4e61-8254-c94496f0859d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:28.476245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5edf92cd-28af-4e61-8254-c94496f0859d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:28.476906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5edf92cd-28af-4e61-8254-c94496f0859d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:28.478285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5edf92cd-28af-4e61-8254-c94496f0859d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:28.478933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5edf92cd-28af-4e61-8254-c94496f0859d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:28.479545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5edf92cd-28af-4e61-8254-c94496f0859d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:28.609348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ea4c1f7-d779-4d97-891a-4beaae0151f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:28.619450 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ea4c1f7-d779-4d97-891a-4beaae0151f3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1391 microversion: 2.1 time: 0.338641 Aug 27 05:06:28.620658 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2920/5792] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:28 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1391 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:28.856961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5edf92cd-28af-4e61-8254-c94496f0859d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:28.867183 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5edf92cd-28af-4e61-8254-c94496f0859d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1324 microversion: 2.1 time: 0.405655 Aug 27 05:06:28.867879 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2873/5793] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:28 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1324 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:29.175710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6a3f9e04-cd87-4e8a-a83b-53ed57d00892 req-64d19fe3-5999-4f4b-bbf2-b551e8886a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4332394-4519-4c1d-b5bd-22c1de38fd6e", "tag": "d7595bd6-4531-40ab-b41d-fcc3e753c0cd"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:29.189998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6a3f9e04-cd87-4e8a-a83b-53ed57d00892 req-64d19fe3-5999-4f4b-bbf2-b551e8886a4a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.190538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6a3f9e04-cd87-4e8a-a83b-53ed57d00892 req-64d19fe3-5999-4f4b-bbf2-b551e8886a4a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.191061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6a3f9e04-cd87-4e8a-a83b-53ed57d00892 req-64d19fe3-5999-4f4b-bbf2-b551e8886a4a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.203364 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6a3f9e04-cd87-4e8a-a83b-53ed57d00892 req-64d19fe3-5999-4f4b-bbf2-b551e8886a4a service nova] Creating event network-changed:d7595bd6-4531-40ab-b41d-fcc3e753c0cd for instance b4332394-4519-4c1d-b5bd-22c1de38fd6e on n-h1-854823-1 Aug 27 05:06:29.208272 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6a3f9e04-cd87-4e8a-a83b-53ed57d00892 req-64d19fe3-5999-4f4b-bbf2-b551e8886a4a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036255 Aug 27 05:06:29.208929 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2921/5794] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:29.487593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-74a6fb31-b668-4462-a867-61a19e7d0420 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:29.488209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-74a6fb31-b668-4462-a867-61a19e7d0420 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:29.495126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74a6fb31-b668-4462-a867-61a19e7d0420 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.495621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74a6fb31-b668-4462-a867-61a19e7d0420 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.496114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74a6fb31-b668-4462-a867-61a19e7d0420 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.496860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74a6fb31-b668-4462-a867-61a19e7d0420 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.497320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74a6fb31-b668-4462-a867-61a19e7d0420 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.497748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74a6fb31-b668-4462-a867-61a19e7d0420 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.520875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:29.646012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8fa6605a-749c-469d-9051-9d20471aef54 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:29.646012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8fa6605a-749c-469d-9051-9d20471aef54 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:29.652779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fa6605a-749c-469d-9051-9d20471aef54 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.653295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fa6605a-749c-469d-9051-9d20471aef54 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.654110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fa6605a-749c-469d-9051-9d20471aef54 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.654898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fa6605a-749c-469d-9051-9d20471aef54 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:29.655344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fa6605a-749c-469d-9051-9d20471aef54 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:29.655781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fa6605a-749c-469d-9051-9d20471aef54 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:29.977656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8fa6605a-749c-469d-9051-9d20471aef54 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:29.986912 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8fa6605a-749c-469d-9051-9d20471aef54 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1391 microversion: 2.1 time: 0.348535 Aug 27 05:06:29.987519 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2922/5795] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:29 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1391 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:29.993311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-321c48a9-385b-4be1-9b8a-68e684401a4f tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:29.994817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-321c48a9-385b-4be1-9b8a-68e684401a4f tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:30.001964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321c48a9-385b-4be1-9b8a-68e684401a4f tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:30.002730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321c48a9-385b-4be1-9b8a-68e684401a4f tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:30.003188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321c48a9-385b-4be1-9b8a-68e684401a4f tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:30.003929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321c48a9-385b-4be1-9b8a-68e684401a4f tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:30.004418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321c48a9-385b-4be1-9b8a-68e684401a4f tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:30.004901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321c48a9-385b-4be1-9b8a-68e684401a4f tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:30.117812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-74a6fb31-b668-4462-a867-61a19e7d0420 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:30.141375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-74a6fb31-b668-4462-a867-61a19e7d0420 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:30.142934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-74a6fb31-b668-4462-a867-61a19e7d0420 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:30.144481 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-74a6fb31-b668-4462-a867-61a19e7d0420 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1731 microversion: 2.20 time: 0.663221 Aug 27 05:06:30.145182 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2874/5796] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:29 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1731 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:30.251221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-321c48a9-385b-4be1-9b8a-68e684401a4f tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:30.260286 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-321c48a9-385b-4be1-9b8a-68e684401a4f tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1324 microversion: 2.1 time: 0.271476 Aug 27 05:06:30.260996 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2923/5797] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:29 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1324 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:30.325461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-53d2addc-5239-444c-8238-d57464342e0b req-ca394d0a-610d-4d32-a31d-355987a69672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf34f382-9b01-4519-ba5f-78471ee22e32", "tag": "7a1ec75a-2f7a-416e-b884-5870283eafe6"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:30.338624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-53d2addc-5239-444c-8238-d57464342e0b req-ca394d0a-610d-4d32-a31d-355987a69672 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:30.339230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-53d2addc-5239-444c-8238-d57464342e0b req-ca394d0a-610d-4d32-a31d-355987a69672 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:30.339764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-53d2addc-5239-444c-8238-d57464342e0b req-ca394d0a-610d-4d32-a31d-355987a69672 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:30.352252 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-53d2addc-5239-444c-8238-d57464342e0b req-ca394d0a-610d-4d32-a31d-355987a69672 service nova] Creating event network-changed:7a1ec75a-2f7a-416e-b884-5870283eafe6 for instance bf34f382-9b01-4519-ba5f-78471ee22e32 on n-h2-854823-1 Aug 27 05:06:30.358477 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-53d2addc-5239-444c-8238-d57464342e0b req-ca394d0a-610d-4d32-a31d-355987a69672 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039230 Aug 27 05:06:30.359101 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2875/5798] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:31.011215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a201677-5f2a-4897-aa3d-a1200e6c0ff9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:31.012564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a201677-5f2a-4897-aa3d-a1200e6c0ff9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:31.020721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a201677-5f2a-4897-aa3d-a1200e6c0ff9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:31.021633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a201677-5f2a-4897-aa3d-a1200e6c0ff9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:31.022561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a201677-5f2a-4897-aa3d-a1200e6c0ff9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:31.023725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a201677-5f2a-4897-aa3d-a1200e6c0ff9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:31.024447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a201677-5f2a-4897-aa3d-a1200e6c0ff9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:31.026239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a201677-5f2a-4897-aa3d-a1200e6c0ff9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:31.172218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-769bd337-3c33-4b18-960a-3ec476789a06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:31.173115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-769bd337-3c33-4b18-960a-3ec476789a06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:31.192843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-769bd337-3c33-4b18-960a-3ec476789a06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:31.193690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-769bd337-3c33-4b18-960a-3ec476789a06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:31.194204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-769bd337-3c33-4b18-960a-3ec476789a06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:31.194969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-769bd337-3c33-4b18-960a-3ec476789a06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:31.195430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-769bd337-3c33-4b18-960a-3ec476789a06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:31.195932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-769bd337-3c33-4b18-960a-3ec476789a06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:31.347671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a201677-5f2a-4897-aa3d-a1200e6c0ff9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:31.359831 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a201677-5f2a-4897-aa3d-a1200e6c0ff9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1391 microversion: 2.1 time: 0.352991 Aug 27 05:06:31.360423 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2924/5799] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:31 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1391 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:31.381761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-470a8c02-59b3-4612-9de8-a0e77410ddb8 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:31.382894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-470a8c02-59b3-4612-9de8-a0e77410ddb8 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:31.404683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470a8c02-59b3-4612-9de8-a0e77410ddb8 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:31.411937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470a8c02-59b3-4612-9de8-a0e77410ddb8 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:31.415542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470a8c02-59b3-4612-9de8-a0e77410ddb8 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:31.416594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470a8c02-59b3-4612-9de8-a0e77410ddb8 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:31.419508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470a8c02-59b3-4612-9de8-a0e77410ddb8 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:31.420134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470a8c02-59b3-4612-9de8-a0e77410ddb8 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:31.870672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-769bd337-3c33-4b18-960a-3ec476789a06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:31.890752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-769bd337-3c33-4b18-960a-3ec476789a06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:31.892832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-769bd337-3c33-4b18-960a-3ec476789a06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:31.898360 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-769bd337-3c33-4b18-960a-3ec476789a06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1731 microversion: 2.20 time: 0.734651 Aug 27 05:06:31.899804 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2876/5800] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:31 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1731 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:06:31.969765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-470a8c02-59b3-4612-9de8-a0e77410ddb8 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:31.983044 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-470a8c02-59b3-4612-9de8-a0e77410ddb8 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1324 microversion: 2.1 time: 0.619059 Aug 27 05:06:31.983662 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2925/5801] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:31 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1324 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:32.407596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a77c0d16-0702-4449-af10-b88db596221e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:32.409179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a77c0d16-0702-4449-af10-b88db596221e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:32.424589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a77c0d16-0702-4449-af10-b88db596221e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:32.425230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a77c0d16-0702-4449-af10-b88db596221e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:32.425744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a77c0d16-0702-4449-af10-b88db596221e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:32.426488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a77c0d16-0702-4449-af10-b88db596221e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:32.426958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a77c0d16-0702-4449-af10-b88db596221e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:32.431903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a77c0d16-0702-4449-af10-b88db596221e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:32.833760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a77c0d16-0702-4449-af10-b88db596221e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:32.853993 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a77c0d16-0702-4449-af10-b88db596221e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1391 microversion: 2.1 time: 0.450179 Aug 27 05:06:32.859199 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2877/5802] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:32 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1391 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:32.945582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a21fa1c3-c1f1-4d1b-af4e-b0d0b9682af2 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:32.948150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a21fa1c3-c1f1-4d1b-af4e-b0d0b9682af2 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:32.964276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:32.967218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a21fa1c3-c1f1-4d1b-af4e-b0d0b9682af2 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:32.967956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a21fa1c3-c1f1-4d1b-af4e-b0d0b9682af2 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:32.969169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a21fa1c3-c1f1-4d1b-af4e-b0d0b9682af2 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:32.970481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a21fa1c3-c1f1-4d1b-af4e-b0d0b9682af2 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:32.971413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a21fa1c3-c1f1-4d1b-af4e-b0d0b9682af2 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:32.973833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a21fa1c3-c1f1-4d1b-af4e-b0d0b9682af2 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:33.011441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-375dd7b1-42da-4677-bb8c-026aaf7e75b4 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:33.012364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-375dd7b1-42da-4677-bb8c-026aaf7e75b4 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:33.027000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-375dd7b1-42da-4677-bb8c-026aaf7e75b4 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:33.041106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-375dd7b1-42da-4677-bb8c-026aaf7e75b4 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:33.041701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-375dd7b1-42da-4677-bb8c-026aaf7e75b4 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:33.042563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-375dd7b1-42da-4677-bb8c-026aaf7e75b4 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:33.043139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-375dd7b1-42da-4677-bb8c-026aaf7e75b4 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:33.043701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-375dd7b1-42da-4677-bb8c-026aaf7e75b4 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:33.375472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a21fa1c3-c1f1-4d1b-af4e-b0d0b9682af2 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:33.387287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a21fa1c3-c1f1-4d1b-af4e-b0d0b9682af2 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:33.402514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a21fa1c3-c1f1-4d1b-af4e-b0d0b9682af2 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:33.410771 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a21fa1c3-c1f1-4d1b-af4e-b0d0b9682af2 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1731 microversion: 2.20 time: 0.489004 Aug 27 05:06:33.417069 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2926/5803] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:32 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1731 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:33.424867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-375dd7b1-42da-4677-bb8c-026aaf7e75b4 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:33.439258 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-375dd7b1-42da-4677-bb8c-026aaf7e75b4 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1324 microversion: 2.1 time: 0.433419 Aug 27 05:06:33.449368 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2878/5804] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:33 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1324 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:33.883379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7a927f4-eafc-494f-9d0d-3d91652c0b4b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:33.884455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7a927f4-eafc-494f-9d0d-3d91652c0b4b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:33.892986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:33.898127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a927f4-eafc-494f-9d0d-3d91652c0b4b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:33.898995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a927f4-eafc-494f-9d0d-3d91652c0b4b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:33.899548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a927f4-eafc-494f-9d0d-3d91652c0b4b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:33.900307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a927f4-eafc-494f-9d0d-3d91652c0b4b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:33.900836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a927f4-eafc-494f-9d0d-3d91652c0b4b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:33.901381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7a927f4-eafc-494f-9d0d-3d91652c0b4b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:34.115790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=16 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:34.438291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cd035b46-8800-40db-bfd9-463e6b11fbef tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:34.439095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cd035b46-8800-40db-bfd9-463e6b11fbef tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:34.452814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd035b46-8800-40db-bfd9-463e6b11fbef tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:34.453314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd035b46-8800-40db-bfd9-463e6b11fbef tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:34.462861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd035b46-8800-40db-bfd9-463e6b11fbef tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:34.463975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd035b46-8800-40db-bfd9-463e6b11fbef tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:34.465747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd035b46-8800-40db-bfd9-463e6b11fbef tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:34.466403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd035b46-8800-40db-bfd9-463e6b11fbef tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:34.769812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7a927f4-eafc-494f-9d0d-3d91652c0b4b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:34.782638 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7a927f4-eafc-494f-9d0d-3d91652c0b4b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1391 microversion: 2.1 time: 0.904762 Aug 27 05:06:34.783246 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2927/5805] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:33 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1391 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:34.791369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef30cf99-1cc6-40b6-ac4a-a90ed92e3ec5 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:34.792313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef30cf99-1cc6-40b6-ac4a-a90ed92e3ec5 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:34.799111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef30cf99-1cc6-40b6-ac4a-a90ed92e3ec5 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:34.800329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef30cf99-1cc6-40b6-ac4a-a90ed92e3ec5 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:34.801094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef30cf99-1cc6-40b6-ac4a-a90ed92e3ec5 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:34.819369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cd035b46-8800-40db-bfd9-463e6b11fbef tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:34.822817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef30cf99-1cc6-40b6-ac4a-a90ed92e3ec5 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:34.823564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef30cf99-1cc6-40b6-ac4a-a90ed92e3ec5 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:34.824192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef30cf99-1cc6-40b6-ac4a-a90ed92e3ec5 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:34.842536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cd035b46-8800-40db-bfd9-463e6b11fbef tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:34.844640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cd035b46-8800-40db-bfd9-463e6b11fbef tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:34.848785 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cd035b46-8800-40db-bfd9-463e6b11fbef tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1731 microversion: 2.20 time: 0.414596 Aug 27 05:06:34.855542 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2879/5806] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:34 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1731 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:35.244996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef30cf99-1cc6-40b6-ac4a-a90ed92e3ec5 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:35.300263 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef30cf99-1cc6-40b6-ac4a-a90ed92e3ec5 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1324 microversion: 2.1 time: 0.514664 Aug 27 05:06:35.315571 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2928/5807] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:34 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1324 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:35.811467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9a8f57e0-2138-451b-b5dc-a0eede4c5102 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:35.812794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9a8f57e0-2138-451b-b5dc-a0eede4c5102 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:35.831220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a8f57e0-2138-451b-b5dc-a0eede4c5102 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:35.832281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a8f57e0-2138-451b-b5dc-a0eede4c5102 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:35.834343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a8f57e0-2138-451b-b5dc-a0eede4c5102 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:35.836991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a8f57e0-2138-451b-b5dc-a0eede4c5102 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:35.838309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a8f57e0-2138-451b-b5dc-a0eede4c5102 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:35.840108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9a8f57e0-2138-451b-b5dc-a0eede4c5102 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:35.883577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e028c8a7-94a4-4873-b014-13a8a87aff73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:35.884359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e028c8a7-94a4-4873-b014-13a8a87aff73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:35.902395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e028c8a7-94a4-4873-b014-13a8a87aff73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:35.904711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e028c8a7-94a4-4873-b014-13a8a87aff73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:35.905206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e028c8a7-94a4-4873-b014-13a8a87aff73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:35.905985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e028c8a7-94a4-4873-b014-13a8a87aff73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:35.906534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e028c8a7-94a4-4873-b014-13a8a87aff73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:35.906989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e028c8a7-94a4-4873-b014-13a8a87aff73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:35.962735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:36.208238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9a8f57e0-2138-451b-b5dc-a0eede4c5102 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:36.221575 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9a8f57e0-2138-451b-b5dc-a0eede4c5102 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1391 microversion: 2.1 time: 0.414752 Aug 27 05:06:36.226070 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2880/5808] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:35 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1391 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:36.231841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d0a1e9f2-8fc8-4e6e-a100-5db035146886 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:36.235845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d0a1e9f2-8fc8-4e6e-a100-5db035146886 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:36.243728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0a1e9f2-8fc8-4e6e-a100-5db035146886 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:36.244502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0a1e9f2-8fc8-4e6e-a100-5db035146886 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:36.246206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0a1e9f2-8fc8-4e6e-a100-5db035146886 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:36.247549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0a1e9f2-8fc8-4e6e-a100-5db035146886 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:36.248367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0a1e9f2-8fc8-4e6e-a100-5db035146886 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:36.249282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0a1e9f2-8fc8-4e6e-a100-5db035146886 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:36.271276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e028c8a7-94a4-4873-b014-13a8a87aff73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:36.283019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e028c8a7-94a4-4873-b014-13a8a87aff73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:36.287406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e028c8a7-94a4-4873-b014-13a8a87aff73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:36.295127 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e028c8a7-94a4-4873-b014-13a8a87aff73 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1731 microversion: 2.20 time: 0.414684 Aug 27 05:06:36.296252 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2929/5809] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:35 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1731 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:06:36.298646 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d0a1e9f2-8fc8-4e6e-a100-5db035146886 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.070940 Aug 27 05:06:36.299500 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2881/5810] 10.222.0.79 () {58 vars in 1293 bytes} [Sat Aug 27 05:06:36 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479/os-server-password => generated 116 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:36.342801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-951d8e28-1f46-4699-b9b6-80e724c58f1b tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:36.343355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-951d8e28-1f46-4699-b9b6-80e724c58f1b tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:36.359847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951d8e28-1f46-4699-b9b6-80e724c58f1b tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:36.360716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951d8e28-1f46-4699-b9b6-80e724c58f1b tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:36.361609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951d8e28-1f46-4699-b9b6-80e724c58f1b tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:36.364160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951d8e28-1f46-4699-b9b6-80e724c58f1b tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:36.367219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951d8e28-1f46-4699-b9b6-80e724c58f1b tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:36.369443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951d8e28-1f46-4699-b9b6-80e724c58f1b tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:36.793091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-951d8e28-1f46-4699-b9b6-80e724c58f1b tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:36.809605 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-951d8e28-1f46-4699-b9b6-80e724c58f1b tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1324 microversion: 2.1 time: 0.470688 Aug 27 05:06:36.815626 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2930/5811] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:36 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1324 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:37.144478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-b84f24ab-47ee-4c63-8a85-7ec231aee0db req-97781a87-0176-48cf-9165-54389f3749ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c163756-2a5e-4c6e-85ef-396959f03bb8", "name": "network-vif-plugged", "status": "completed", "tag": "52dfb670-cc5a-497c-9a62-41f774ae4ed5"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:37.188346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b84f24ab-47ee-4c63-8a85-7ec231aee0db req-97781a87-0176-48cf-9165-54389f3749ee service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:37.190752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b84f24ab-47ee-4c63-8a85-7ec231aee0db req-97781a87-0176-48cf-9165-54389f3749ee service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:37.191287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b84f24ab-47ee-4c63-8a85-7ec231aee0db req-97781a87-0176-48cf-9165-54389f3749ee service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:37.223206 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b84f24ab-47ee-4c63-8a85-7ec231aee0db req-97781a87-0176-48cf-9165-54389f3749ee service nova] Creating event network-vif-plugged:52dfb670-cc5a-497c-9a62-41f774ae4ed5 for instance 3c163756-2a5e-4c6e-85ef-396959f03bb8 on n-h1-854823-1 Aug 27 05:06:37.233822 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-b84f24ab-47ee-4c63-8a85-7ec231aee0db req-97781a87-0176-48cf-9165-54389f3749ee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094449 Aug 27 05:06:37.238347 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2882/5812] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:37.245697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dce4bd85-69f0-4dd3-97fc-05b4dedf9cd5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:37.246485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dce4bd85-69f0-4dd3-97fc-05b4dedf9cd5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:37.274202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dce4bd85-69f0-4dd3-97fc-05b4dedf9cd5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:37.274937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dce4bd85-69f0-4dd3-97fc-05b4dedf9cd5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:37.280277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dce4bd85-69f0-4dd3-97fc-05b4dedf9cd5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:37.280707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dce4bd85-69f0-4dd3-97fc-05b4dedf9cd5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:37.281253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dce4bd85-69f0-4dd3-97fc-05b4dedf9cd5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:37.281738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dce4bd85-69f0-4dd3-97fc-05b4dedf9cd5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:37.323719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-110defd5-c769-4e3c-a4b0-66e37d121a75 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:37.324503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-110defd5-c769-4e3c-a4b0-66e37d121a75 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:37.342333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-110defd5-c769-4e3c-a4b0-66e37d121a75 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:37.342842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-110defd5-c769-4e3c-a4b0-66e37d121a75 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:37.343286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-110defd5-c769-4e3c-a4b0-66e37d121a75 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:37.344105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-110defd5-c769-4e3c-a4b0-66e37d121a75 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:37.344601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-110defd5-c769-4e3c-a4b0-66e37d121a75 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:37.345139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-110defd5-c769-4e3c-a4b0-66e37d121a75 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:37.663864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dce4bd85-69f0-4dd3-97fc-05b4dedf9cd5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:37.674001 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dce4bd85-69f0-4dd3-97fc-05b4dedf9cd5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1391 microversion: 2.1 time: 0.434551 Aug 27 05:06:37.689629 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2931/5813] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:37 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1391 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:37.697728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-110defd5-c769-4e3c-a4b0-66e37d121a75 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:37.715925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-110defd5-c769-4e3c-a4b0-66e37d121a75 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:37.717433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-110defd5-c769-4e3c-a4b0-66e37d121a75 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:37.718656 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-110defd5-c769-4e3c-a4b0-66e37d121a75 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1731 microversion: 2.20 time: 0.400432 Aug 27 05:06:37.733047 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2883/5814] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:37 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1731 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:37.856073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cfdcbaab-dda1-4d63-a554-de7185520f2e tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:37.858055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cfdcbaab-dda1-4d63-a554-de7185520f2e tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:37.883146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfdcbaab-dda1-4d63-a554-de7185520f2e tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:37.888749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfdcbaab-dda1-4d63-a554-de7185520f2e tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:37.890902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfdcbaab-dda1-4d63-a554-de7185520f2e tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:37.898499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfdcbaab-dda1-4d63-a554-de7185520f2e tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:37.901223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfdcbaab-dda1-4d63-a554-de7185520f2e tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:37.902034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfdcbaab-dda1-4d63-a554-de7185520f2e tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:38.113085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cfdcbaab-dda1-4d63-a554-de7185520f2e tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:38.164336 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cfdcbaab-dda1-4d63-a554-de7185520f2e tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1324 microversion: 2.1 time: 0.328068 Aug 27 05:06:38.164336 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2932/5815] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:37 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1324 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:38.702523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-64ad93ec-be05-4d60-b7b9-188d0a6b4720 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:38.705211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-64ad93ec-be05-4d60-b7b9-188d0a6b4720 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:38.719040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64ad93ec-be05-4d60-b7b9-188d0a6b4720 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:38.720021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64ad93ec-be05-4d60-b7b9-188d0a6b4720 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:38.722465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64ad93ec-be05-4d60-b7b9-188d0a6b4720 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:38.724165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64ad93ec-be05-4d60-b7b9-188d0a6b4720 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:38.725614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64ad93ec-be05-4d60-b7b9-188d0a6b4720 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:38.727140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64ad93ec-be05-4d60-b7b9-188d0a6b4720 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:38.747814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db396ae7-1726-4a0f-9fea-b3a320a90cd6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:38.748724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db396ae7-1726-4a0f-9fea-b3a320a90cd6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:38.767649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db396ae7-1726-4a0f-9fea-b3a320a90cd6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:38.770487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db396ae7-1726-4a0f-9fea-b3a320a90cd6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:38.775231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db396ae7-1726-4a0f-9fea-b3a320a90cd6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:38.777312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db396ae7-1726-4a0f-9fea-b3a320a90cd6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:38.781182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db396ae7-1726-4a0f-9fea-b3a320a90cd6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:38.783336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db396ae7-1726-4a0f-9fea-b3a320a90cd6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:38.916450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-64ad93ec-be05-4d60-b7b9-188d0a6b4720 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:38.926362 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-64ad93ec-be05-4d60-b7b9-188d0a6b4720 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1391 microversion: 2.1 time: 0.231997 Aug 27 05:06:38.944089 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2884/5816] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:38 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1391 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:39.085765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db396ae7-1726-4a0f-9fea-b3a320a90cd6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:39.123007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db396ae7-1726-4a0f-9fea-b3a320a90cd6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:39.130712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db396ae7-1726-4a0f-9fea-b3a320a90cd6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:39.137683 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db396ae7-1726-4a0f-9fea-b3a320a90cd6 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1731 microversion: 2.20 time: 0.395373 Aug 27 05:06:39.138832 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2933/5817] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:38 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1731 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:39.222412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5051dfd2-afda-42a9-be64-05539fca166d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:39.224414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5051dfd2-afda-42a9-be64-05539fca166d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:39.235738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5051dfd2-afda-42a9-be64-05539fca166d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:39.239141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5051dfd2-afda-42a9-be64-05539fca166d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:39.240252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5051dfd2-afda-42a9-be64-05539fca166d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:39.245100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5051dfd2-afda-42a9-be64-05539fca166d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:39.245650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5051dfd2-afda-42a9-be64-05539fca166d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:39.246082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5051dfd2-afda-42a9-be64-05539fca166d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:39.543209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5051dfd2-afda-42a9-be64-05539fca166d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:39.565336 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5051dfd2-afda-42a9-be64-05539fca166d tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1520 microversion: 2.1 time: 0.347702 Aug 27 05:06:39.585534 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2885/5818] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:39 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1520 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:39.600389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d983edc-9eb6-4284-a258-4b2abceb5eda tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:39.607727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3d983edc-9eb6-4284-a258-4b2abceb5eda tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:39.625617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d983edc-9eb6-4284-a258-4b2abceb5eda tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:39.626076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d983edc-9eb6-4284-a258-4b2abceb5eda tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:39.626533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d983edc-9eb6-4284-a258-4b2abceb5eda tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:39.627278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d983edc-9eb6-4284-a258-4b2abceb5eda tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:39.627793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d983edc-9eb6-4284-a258-4b2abceb5eda tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:39.628241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d983edc-9eb6-4284-a258-4b2abceb5eda tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:39.700258 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3d983edc-9eb6-4284-a258-4b2abceb5eda tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] HTTP exception thrown: Action 999 not found Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d983edc-9eb6-4284-a258-4b2abceb5eda tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Request method failure captured: Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8/os-instance-actions/999 HTTP/1.1 Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaZM4n82YNZTdpyU8r4WGiX1ooHOGOBrgdLGzctjkb5iriUuTb-y_uY2QQm6FD-iPc6nblx_G5O55rlJXOL9sacBF_FN6VBKK7-ZutaM2BHgvOuWeAmCrtxqbX3F_O0hqGV80jtj_F3N4BDOwmpfAuAW_fBcoqKKo2VCZzp_xJN_0Vo Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 7d8b8e262d854d4580541782ec6c2921 Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1300727 Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7d8b8e262d854d4580541782ec6c2921"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7d8b8e262d854d4580541782ec6c2921"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7d8b8e262d854d4580541782ec6c2921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7d8b8e262d854d4580541782ec6c2921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1300727 Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 7d8b8e262d854d4580541782ec6c2921 Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1300727 Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-InstanceActionsNegativeTestJSON-1300727-project Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: ea381bd85ad64d32bfcc340d2d8261c7 Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1300727-project Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: exception: Action 999 not found Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'server_id': '3c163756-2a5e-4c6e-85ef-396959f03bb8', 'id': '999'} Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 27 05:06:39.716453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:06:39.725184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d983edc-9eb6-4284-a258-4b2abceb5eda tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Returning 404 to user: Action 999 not found {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:06:39.731100 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d983edc-9eb6-4284-a258-4b2abceb5eda tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.135103 Aug 27 05:06:39.735178 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2934/5819] 10.222.0.79 () {58 vars in 1308 bytes} [Sat Aug 27 05:06:39 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8/os-instance-actions/999 => generated 66 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:06:39.746884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-266cdd5d-9f00-45b2-b5e0-335b2be68b25 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '.version_select at 0x7f1f2123d820>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:39.748649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-266cdd5d-9f00-45b2-b5e0-335b2be68b25 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 6911e524-6b25-4482-a035-b9771ba5be0f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:39.759277 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-266cdd5d-9f00-45b2-b5e0-335b2be68b25 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] HTTP exception thrown: Instance 6911e524-6b25-4482-a035-b9771ba5be0f could not be found. Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-266cdd5d-9f00-45b2-b5e0-335b2be68b25 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Request method failure captured: Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/6911e524-6b25-4482-a035-b9771ba5be0f/os-instance-actions HTTP/1.1 Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaZM4n82YNZTdpyU8r4WGiX1ooHOGOBrgdLGzctjkb5iriUuTb-y_uY2QQm6FD-iPc6nblx_G5O55rlJXOL9sacBF_FN6VBKK7-ZutaM2BHgvOuWeAmCrtxqbX3F_O0hqGV80jtj_F3N4BDOwmpfAuAW_fBcoqKKo2VCZzp_xJN_0Vo Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 7d8b8e262d854d4580541782ec6c2921 Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1300727 Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7d8b8e262d854d4580541782ec6c2921"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7d8b8e262d854d4580541782ec6c2921"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7d8b8e262d854d4580541782ec6c2921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7d8b8e262d854d4580541782ec6c2921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1300727 Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 7d8b8e262d854d4580541782ec6c2921 Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1300727 Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-InstanceActionsNegativeTestJSON-1300727-project Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: ea381bd85ad64d32bfcc340d2d8261c7 Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1300727-project Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 6911e524-6b25-4482-a035-b9771ba5be0f could not be found. Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'server_id': '6911e524-6b25-4482-a035-b9771ba5be0f'} Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6911e524-6b25-4482-a035-b9771ba5be0f could not be found. Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:06:39.764089 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:06:39.771453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6911e524-6b25-4482-a035-b9771ba5be0f could not be found. Aug 27 05:06:39.771453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:06:39.771453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:39.771453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:06:39.771453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:39.771453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:39.771453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:39.771453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:06:39.771453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:06:39.771453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6911e524-6b25-4482-a035-b9771ba5be0f could not be found. Aug 27 05:06:39.771453 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:06:39.773370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-266cdd5d-9f00-45b2-b5e0-335b2be68b25 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Returning 404 to user: Instance 6911e524-6b25-4482-a035-b9771ba5be0f could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:06:39.774756 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-266cdd5d-9f00-45b2-b5e0-335b2be68b25 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/6911e524-6b25-4482-a035-b9771ba5be0f/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.032261 Aug 27 05:06:39.780708 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2886/5820] 10.222.0.79 () {58 vars in 1296 bytes} [Sat Aug 27 05:06:39 2022] GET /compute/v2.1/servers/6911e524-6b25-4482-a035-b9771ba5be0f/os-instance-actions => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:06:39.785620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cdf0a8d8-e013-4a75-b38e-01ba8140fc82 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:39.786201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cdf0a8d8-e013-4a75-b38e-01ba8140fc82 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:39.801369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdf0a8d8-e013-4a75-b38e-01ba8140fc82 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:39.802040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdf0a8d8-e013-4a75-b38e-01ba8140fc82 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:39.802500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdf0a8d8-e013-4a75-b38e-01ba8140fc82 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:39.803397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdf0a8d8-e013-4a75-b38e-01ba8140fc82 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:39.804137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdf0a8d8-e013-4a75-b38e-01ba8140fc82 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:39.805134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdf0a8d8-e013-4a75-b38e-01ba8140fc82 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:39.843246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cdf0a8d8-e013-4a75-b38e-01ba8140fc82 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:06:39.943671 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cdf0a8d8-e013-4a75-b38e-01ba8140fc82 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 204 len: 0 microversion: 2.1 time: 0.162058 Aug 27 05:06:39.944364 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2935/5821] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:06:39 2022] DELETE /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:06:39.954227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-90c25e23-18f1-46a8-b4f9-40094bcac154 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:39.955085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-90c25e23-18f1-46a8-b4f9-40094bcac154 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:39.955267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-04a9a4cd-5a4a-4d0f-af43-d71b5b413d91 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:39.955845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-04a9a4cd-5a4a-4d0f-af43-d71b5b413d91 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:39.963304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90c25e23-18f1-46a8-b4f9-40094bcac154 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:39.964239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90c25e23-18f1-46a8-b4f9-40094bcac154 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:39.964239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90c25e23-18f1-46a8-b4f9-40094bcac154 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:39.965006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04a9a4cd-5a4a-4d0f-af43-d71b5b413d91 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:39.965214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90c25e23-18f1-46a8-b4f9-40094bcac154 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:39.965467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90c25e23-18f1-46a8-b4f9-40094bcac154 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:39.965886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04a9a4cd-5a4a-4d0f-af43-d71b5b413d91 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:39.966038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90c25e23-18f1-46a8-b4f9-40094bcac154 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:39.966357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04a9a4cd-5a4a-4d0f-af43-d71b5b413d91 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:39.967118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04a9a4cd-5a4a-4d0f-af43-d71b5b413d91 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:39.968725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04a9a4cd-5a4a-4d0f-af43-d71b5b413d91 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:39.969178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04a9a4cd-5a4a-4d0f-af43-d71b5b413d91 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:40.112088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-04a9a4cd-5a4a-4d0f-af43-d71b5b413d91 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:40.120294 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-04a9a4cd-5a4a-4d0f-af43-d71b5b413d91 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1526 microversion: 2.1 time: 0.169645 Aug 27 05:06:40.133056 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2936/5822] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:39 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1526 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:40.164416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-053288e6-d089-445b-8e7f-b2c1db7803f9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:40.165637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-053288e6-d089-445b-8e7f-b2c1db7803f9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:40.171732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053288e6-d089-445b-8e7f-b2c1db7803f9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:40.172242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053288e6-d089-445b-8e7f-b2c1db7803f9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:40.172728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053288e6-d089-445b-8e7f-b2c1db7803f9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:40.173452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053288e6-d089-445b-8e7f-b2c1db7803f9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:40.173921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053288e6-d089-445b-8e7f-b2c1db7803f9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:40.174369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053288e6-d089-445b-8e7f-b2c1db7803f9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:40.208123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-90c25e23-18f1-46a8-b4f9-40094bcac154 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:40.219248 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-90c25e23-18f1-46a8-b4f9-40094bcac154 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1391 microversion: 2.1 time: 0.268793 Aug 27 05:06:40.219847 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2887/5823] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:39 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1391 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:40.317776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-053288e6-d089-445b-8e7f-b2c1db7803f9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:40.327033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-053288e6-d089-445b-8e7f-b2c1db7803f9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:40.328087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-053288e6-d089-445b-8e7f-b2c1db7803f9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:40.329319 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-053288e6-d089-445b-8e7f-b2c1db7803f9 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1731 microversion: 2.20 time: 0.169258 Aug 27 05:06:40.330063 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2937/5824] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:40 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:06:40.865507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a2fa6bc1-0965-4299-b8db-f9649e72f7b0 req-583c0233-3b86-4fe0-be26-b445a895ad76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4332394-4519-4c1d-b5bd-22c1de38fd6e", "name": "network-vif-plugged", "status": "completed", "tag": "d7595bd6-4531-40ab-b41d-fcc3e753c0cd"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:40.877412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a2fa6bc1-0965-4299-b8db-f9649e72f7b0 req-583c0233-3b86-4fe0-be26-b445a895ad76 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:40.878015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a2fa6bc1-0965-4299-b8db-f9649e72f7b0 req-583c0233-3b86-4fe0-be26-b445a895ad76 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:40.878552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a2fa6bc1-0965-4299-b8db-f9649e72f7b0 req-583c0233-3b86-4fe0-be26-b445a895ad76 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:40.890776 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a2fa6bc1-0965-4299-b8db-f9649e72f7b0 req-583c0233-3b86-4fe0-be26-b445a895ad76 service nova] Creating event network-vif-plugged:d7595bd6-4531-40ab-b41d-fcc3e753c0cd for instance b4332394-4519-4c1d-b5bd-22c1de38fd6e on n-h1-854823-1 Aug 27 05:06:40.895956 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a2fa6bc1-0965-4299-b8db-f9649e72f7b0 req-583c0233-3b86-4fe0-be26-b445a895ad76 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034333 Aug 27 05:06:40.896810 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2888/5825] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:06:41.141531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8bfd4de4-830f-4046-adc6-3663a5283312 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:41.142411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8bfd4de4-830f-4046-adc6-3663a5283312 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:41.152345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfd4de4-830f-4046-adc6-3663a5283312 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:41.153227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfd4de4-830f-4046-adc6-3663a5283312 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:41.153676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfd4de4-830f-4046-adc6-3663a5283312 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:41.154411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfd4de4-830f-4046-adc6-3663a5283312 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:41.154892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfd4de4-830f-4046-adc6-3663a5283312 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:41.155338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfd4de4-830f-4046-adc6-3663a5283312 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:41.240730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-641bed56-26e0-4c02-8540-77007e4e0452 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:41.241356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-641bed56-26e0-4c02-8540-77007e4e0452 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:41.262880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-641bed56-26e0-4c02-8540-77007e4e0452 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:41.262880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-641bed56-26e0-4c02-8540-77007e4e0452 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:41.263809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-641bed56-26e0-4c02-8540-77007e4e0452 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:41.264873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-641bed56-26e0-4c02-8540-77007e4e0452 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:41.265612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-641bed56-26e0-4c02-8540-77007e4e0452 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:41.266229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-641bed56-26e0-4c02-8540-77007e4e0452 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:41.313881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8bfd4de4-830f-4046-adc6-3663a5283312 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:41.322545 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8bfd4de4-830f-4046-adc6-3663a5283312 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1526 microversion: 2.1 time: 0.185734 Aug 27 05:06:41.323220 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2938/5826] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:41 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1526 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:41.353850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b692dff-2cdc-4538-a006-44a7b3b84f08 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:41.354606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b692dff-2cdc-4538-a006-44a7b3b84f08 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:41.360690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b692dff-2cdc-4538-a006-44a7b3b84f08 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:41.361196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b692dff-2cdc-4538-a006-44a7b3b84f08 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:41.361761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b692dff-2cdc-4538-a006-44a7b3b84f08 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:41.362485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b692dff-2cdc-4538-a006-44a7b3b84f08 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:41.362953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b692dff-2cdc-4538-a006-44a7b3b84f08 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:41.363391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b692dff-2cdc-4538-a006-44a7b3b84f08 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:41.504416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8b692dff-2cdc-4538-a006-44a7b3b84f08 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:41.517352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8b692dff-2cdc-4538-a006-44a7b3b84f08 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:41.518843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8b692dff-2cdc-4538-a006-44a7b3b84f08 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:41.520063 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b692dff-2cdc-4538-a006-44a7b3b84f08 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1731 microversion: 2.20 time: 0.171199 Aug 27 05:06:41.520657 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2939/5827] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:41 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:06:41.534130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-641bed56-26e0-4c02-8540-77007e4e0452 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:41.542614 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-641bed56-26e0-4c02-8540-77007e4e0452 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1391 microversion: 2.1 time: 0.306190 Aug 27 05:06:41.543200 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2889/5828] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:41 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1391 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:42.343432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95da43e7-17e0-4b0d-ad1d-112cc4bb1c72 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:42.344092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95da43e7-17e0-4b0d-ad1d-112cc4bb1c72 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:42.351510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95da43e7-17e0-4b0d-ad1d-112cc4bb1c72 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:42.352282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95da43e7-17e0-4b0d-ad1d-112cc4bb1c72 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:42.352942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95da43e7-17e0-4b0d-ad1d-112cc4bb1c72 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:42.353860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95da43e7-17e0-4b0d-ad1d-112cc4bb1c72 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:42.354504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95da43e7-17e0-4b0d-ad1d-112cc4bb1c72 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:42.355126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95da43e7-17e0-4b0d-ad1d-112cc4bb1c72 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:42.501336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95da43e7-17e0-4b0d-ad1d-112cc4bb1c72 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:42.510966 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95da43e7-17e0-4b0d-ad1d-112cc4bb1c72 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1526 microversion: 2.1 time: 0.171485 Aug 27 05:06:42.511915 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2940/5829] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:42 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1526 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:42.543382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1517265f-5f0f-4d43-b797-970c99f4669f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:42.544665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1517265f-5f0f-4d43-b797-970c99f4669f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:42.551618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1517265f-5f0f-4d43-b797-970c99f4669f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:42.552106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1517265f-5f0f-4d43-b797-970c99f4669f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:42.552760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1517265f-5f0f-4d43-b797-970c99f4669f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:42.553682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1517265f-5f0f-4d43-b797-970c99f4669f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:42.554313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1517265f-5f0f-4d43-b797-970c99f4669f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:42.554909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1517265f-5f0f-4d43-b797-970c99f4669f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:42.565258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7188bdca-445b-4166-8152-383628f343b3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:42.566151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7188bdca-445b-4166-8152-383628f343b3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:42.573546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7188bdca-445b-4166-8152-383628f343b3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:42.574340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7188bdca-445b-4166-8152-383628f343b3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:42.575386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7188bdca-445b-4166-8152-383628f343b3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:42.576325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7188bdca-445b-4166-8152-383628f343b3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:42.577013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7188bdca-445b-4166-8152-383628f343b3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:42.578509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7188bdca-445b-4166-8152-383628f343b3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:42.720390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7188bdca-445b-4166-8152-383628f343b3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:42.729912 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7188bdca-445b-4166-8152-383628f343b3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1391 microversion: 2.1 time: 0.169261 Aug 27 05:06:42.730553 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2941/5830] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:42 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:06:42.910965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1517265f-5f0f-4d43-b797-970c99f4669f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:42.922385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1517265f-5f0f-4d43-b797-970c99f4669f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:42.924165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1517265f-5f0f-4d43-b797-970c99f4669f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:42.925396 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1517265f-5f0f-4d43-b797-970c99f4669f tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1731 microversion: 2.20 time: 0.385992 Aug 27 05:06:42.925966 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2890/5831] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:42 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1731 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:06:43.540761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eab4dafe-04e9-47ab-b994-a10acbecfa35 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:43.543835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eab4dafe-04e9-47ab-b994-a10acbecfa35 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:43.566615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-44eeed4f-a659-4043-8190-dd244959c4fb req-c1ecfa9d-476b-4db2-869f-94f440ba463e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c163756-2a5e-4c6e-85ef-396959f03bb8", "name": "network-vif-deleted", "tag": "52dfb670-cc5a-497c-9a62-41f774ae4ed5"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:43.577304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eab4dafe-04e9-47ab-b994-a10acbecfa35 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:43.578050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eab4dafe-04e9-47ab-b994-a10acbecfa35 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:43.581569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eab4dafe-04e9-47ab-b994-a10acbecfa35 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:43.585770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eab4dafe-04e9-47ab-b994-a10acbecfa35 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:43.586301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eab4dafe-04e9-47ab-b994-a10acbecfa35 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:43.587323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eab4dafe-04e9-47ab-b994-a10acbecfa35 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:43.595790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-44eeed4f-a659-4043-8190-dd244959c4fb req-c1ecfa9d-476b-4db2-869f-94f440ba463e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:43.596976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-44eeed4f-a659-4043-8190-dd244959c4fb req-c1ecfa9d-476b-4db2-869f-94f440ba463e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:43.597635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-44eeed4f-a659-4043-8190-dd244959c4fb req-c1ecfa9d-476b-4db2-869f-94f440ba463e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:43.628041 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-44eeed4f-a659-4043-8190-dd244959c4fb req-c1ecfa9d-476b-4db2-869f-94f440ba463e service nova] Creating event network-vif-deleted:52dfb670-cc5a-497c-9a62-41f774ae4ed5 for instance 3c163756-2a5e-4c6e-85ef-396959f03bb8 on n-h1-854823-1 Aug 27 05:06:43.645014 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-44eeed4f-a659-4043-8190-dd244959c4fb req-c1ecfa9d-476b-4db2-869f-94f440ba463e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090891 Aug 27 05:06:43.646543 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2891/5832] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:06:43.701653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eab4dafe-04e9-47ab-b994-a10acbecfa35 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea381bd85ad64d32bfcc340d2d8261c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b8e262d854d4580541782ec6c2921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:43.714190 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eab4dafe-04e9-47ab-b994-a10acbecfa35 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 200 len: 1309 microversion: 2.1 time: 0.185238 Aug 27 05:06:43.714800 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2942/5833] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:43 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 1309 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:43.752186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f872f75c-559d-4370-9c01-ea20aa0301a5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:43.753149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f872f75c-559d-4370-9c01-ea20aa0301a5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:43.760219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f872f75c-559d-4370-9c01-ea20aa0301a5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:43.760979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f872f75c-559d-4370-9c01-ea20aa0301a5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:43.761609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f872f75c-559d-4370-9c01-ea20aa0301a5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:43.762488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f872f75c-559d-4370-9c01-ea20aa0301a5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:43.763104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f872f75c-559d-4370-9c01-ea20aa0301a5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:43.763706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f872f75c-559d-4370-9c01-ea20aa0301a5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:43.935819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f872f75c-559d-4370-9c01-ea20aa0301a5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:43.947717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-63078af9-07ea-4b26-b3ce-c43eb0ee03d3 req-d19569a5-db7e-4a24-8dfa-78814d684acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf34f382-9b01-4519-ba5f-78471ee22e32", "name": "network-vif-plugged", "status": "completed", "tag": "7a1ec75a-2f7a-416e-b884-5870283eafe6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:43.948656 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f872f75c-559d-4370-9c01-ea20aa0301a5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1563 microversion: 2.1 time: 0.200546 Aug 27 05:06:43.949885 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2892/5834] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:43 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1563 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:43.955579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0344366b-318e-43e3-a18e-5ae336b87778 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:43.956324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0344366b-318e-43e3-a18e-5ae336b87778 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:43.960908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-63078af9-07ea-4b26-b3ce-c43eb0ee03d3 req-d19569a5-db7e-4a24-8dfa-78814d684acb service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:43.961409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-63078af9-07ea-4b26-b3ce-c43eb0ee03d3 req-d19569a5-db7e-4a24-8dfa-78814d684acb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:43.961892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-63078af9-07ea-4b26-b3ce-c43eb0ee03d3 req-d19569a5-db7e-4a24-8dfa-78814d684acb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:43.963936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0344366b-318e-43e3-a18e-5ae336b87778 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:43.965340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0344366b-318e-43e3-a18e-5ae336b87778 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:43.966025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0344366b-318e-43e3-a18e-5ae336b87778 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:43.967142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0344366b-318e-43e3-a18e-5ae336b87778 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:43.967820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0344366b-318e-43e3-a18e-5ae336b87778 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:43.968557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0344366b-318e-43e3-a18e-5ae336b87778 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:43.977290 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-63078af9-07ea-4b26-b3ce-c43eb0ee03d3 req-d19569a5-db7e-4a24-8dfa-78814d684acb service nova] Creating event network-vif-plugged:7a1ec75a-2f7a-416e-b884-5870283eafe6 for instance bf34f382-9b01-4519-ba5f-78471ee22e32 on n-h2-854823-1 Aug 27 05:06:43.982872 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-63078af9-07ea-4b26-b3ce-c43eb0ee03d3 req-d19569a5-db7e-4a24-8dfa-78814d684acb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040679 Aug 27 05:06:43.984033 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2943/5835] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:06:43.989619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82815759-6ece-4e04-8562-6c7e025e08d2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:43.990674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-82815759-6ece-4e04-8562-6c7e025e08d2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:44.019105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82815759-6ece-4e04-8562-6c7e025e08d2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:44.019896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82815759-6ece-4e04-8562-6c7e025e08d2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:44.020698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82815759-6ece-4e04-8562-6c7e025e08d2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:44.021612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82815759-6ece-4e04-8562-6c7e025e08d2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:44.022264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82815759-6ece-4e04-8562-6c7e025e08d2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:44.022938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82815759-6ece-4e04-8562-6c7e025e08d2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:44.171565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0344366b-318e-43e3-a18e-5ae336b87778 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:44.183663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0344366b-318e-43e3-a18e-5ae336b87778 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:44.185165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0344366b-318e-43e3-a18e-5ae336b87778 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:44.186388 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0344366b-318e-43e3-a18e-5ae336b87778 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1731 microversion: 2.20 time: 0.234997 Aug 27 05:06:44.187368 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2893/5836] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:43 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:44.347867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-82815759-6ece-4e04-8562-6c7e025e08d2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:44.356864 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-82815759-6ece-4e04-8562-6c7e025e08d2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1563 microversion: 2.1 time: 0.371342 Aug 27 05:06:44.357668 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2944/5837] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:43 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1563 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:44.735306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8ecb129-b920-4a45-a0b2-6ca48b0fa1d3 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:44.735886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d8ecb129-b920-4a45-a0b2-6ca48b0fa1d3 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] [instance: 3c163756-2a5e-4c6e-85ef-396959f03bb8] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:44.742798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8ecb129-b920-4a45-a0b2-6ca48b0fa1d3 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:44.743251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8ecb129-b920-4a45-a0b2-6ca48b0fa1d3 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:44.743700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8ecb129-b920-4a45-a0b2-6ca48b0fa1d3 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:44.744402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8ecb129-b920-4a45-a0b2-6ca48b0fa1d3 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:44.745084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8ecb129-b920-4a45-a0b2-6ca48b0fa1d3 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:44.745523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8ecb129-b920-4a45-a0b2-6ca48b0fa1d3 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:44.760021 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-d8ecb129-b920-4a45-a0b2-6ca48b0fa1d3 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] HTTP exception thrown: Instance 3c163756-2a5e-4c6e-85ef-396959f03bb8 could not be found. Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8ecb129-b920-4a45-a0b2-6ca48b0fa1d3 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Request method failure captured: Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 HTTP/1.1 Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaZM4n82YNZTdpyU8r4WGiX1ooHOGOBrgdLGzctjkb5iriUuTb-y_uY2QQm6FD-iPc6nblx_G5O55rlJXOL9sacBF_FN6VBKK7-ZutaM2BHgvOuWeAmCrtxqbX3F_O0hqGV80jtj_F3N4BDOwmpfAuAW_fBcoqKKo2VCZzp_xJN_0Vo Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 7d8b8e262d854d4580541782ec6c2921 Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1300727 Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7d8b8e262d854d4580541782ec6c2921"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7d8b8e262d854d4580541782ec6c2921"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7d8b8e262d854d4580541782ec6c2921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7d8b8e262d854d4580541782ec6c2921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1300727 Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 7d8b8e262d854d4580541782ec6c2921 Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1300727 Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-InstanceActionsNegativeTestJSON-1300727-project Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: ea381bd85ad64d32bfcc340d2d8261c7 Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1300727-project Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 3c163756-2a5e-4c6e-85ef-396959f03bb8 could not be found. Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '3c163756-2a5e-4c6e-85ef-396959f03bb8'} Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c163756-2a5e-4c6e-85ef-396959f03bb8 could not be found. Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c163756-2a5e-4c6e-85ef-396959f03bb8 could not be found. Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:06:44.761732 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:06:44.766772 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:06:44.766772 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:06:44.766772 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:06:44.766772 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:06:44.766772 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:06:44.766772 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:06:44.766772 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c163756-2a5e-4c6e-85ef-396959f03bb8 could not be found. Aug 27 05:06:44.766772 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:06:44.766772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8ecb129-b920-4a45-a0b2-6ca48b0fa1d3 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] Returning 404 to user: Instance 3c163756-2a5e-4c6e-85ef-396959f03bb8 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:06:44.766772 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d8ecb129-b920-4a45-a0b2-6ca48b0fa1d3 tempest-InstanceActionsNegativeTestJSON-1300727 tempest-InstanceActionsNegativeTestJSON-1300727-project] 10.222.0.79 "GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8" status: 404 len: 111 microversion: 2.1 time: 0.031871 Aug 27 05:06:44.766772 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2894/5838] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:44 2022] GET /compute/v2.1/servers/3c163756-2a5e-4c6e-85ef-396959f03bb8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:06:45.212878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb9c0a8d-7d21-43a5-aba6-dc7f8fe3c190 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:45.214085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cb9c0a8d-7d21-43a5-aba6-dc7f8fe3c190 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:45.222629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb9c0a8d-7d21-43a5-aba6-dc7f8fe3c190 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:45.223162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb9c0a8d-7d21-43a5-aba6-dc7f8fe3c190 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:45.223890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb9c0a8d-7d21-43a5-aba6-dc7f8fe3c190 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:45.224700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb9c0a8d-7d21-43a5-aba6-dc7f8fe3c190 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:45.225181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb9c0a8d-7d21-43a5-aba6-dc7f8fe3c190 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:45.225630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb9c0a8d-7d21-43a5-aba6-dc7f8fe3c190 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:45.230727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:45.906144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cb9c0a8d-7d21-43a5-aba6-dc7f8fe3c190 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:45.915383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cb9c0a8d-7d21-43a5-aba6-dc7f8fe3c190 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:45.917532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cb9c0a8d-7d21-43a5-aba6-dc7f8fe3c190 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:45.919164 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cb9c0a8d-7d21-43a5-aba6-dc7f8fe3c190 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1731 microversion: 2.20 time: 0.712374 Aug 27 05:06:45.928610 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2945/5839] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:45 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1731 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:06:46.945301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-55ef5e79-b700-407e-be62-00a1025df6c0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:46.946863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-55ef5e79-b700-407e-be62-00a1025df6c0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:46.953770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55ef5e79-b700-407e-be62-00a1025df6c0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:46.954201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55ef5e79-b700-407e-be62-00a1025df6c0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:46.954627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55ef5e79-b700-407e-be62-00a1025df6c0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:46.955645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55ef5e79-b700-407e-be62-00a1025df6c0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:46.958911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55ef5e79-b700-407e-be62-00a1025df6c0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:46.959401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-55ef5e79-b700-407e-be62-00a1025df6c0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:47.205218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-55ef5e79-b700-407e-be62-00a1025df6c0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:47.207991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:47.222849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-55ef5e79-b700-407e-be62-00a1025df6c0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:47.225325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-55ef5e79-b700-407e-be62-00a1025df6c0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:47.228366 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-55ef5e79-b700-407e-be62-00a1025df6c0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1718 microversion: 2.20 time: 0.286976 Aug 27 05:06:47.248775 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2895/5840] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:06:46 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1718 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:06:48.003488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7fecbf31-cac4-4491-bbb0-563952abe09f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:48.004118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7fecbf31-cac4-4491-bbb0-563952abe09f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:48.018626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fecbf31-cac4-4491-bbb0-563952abe09f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:48.019141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fecbf31-cac4-4491-bbb0-563952abe09f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:48.019596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fecbf31-cac4-4491-bbb0-563952abe09f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:48.020326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fecbf31-cac4-4491-bbb0-563952abe09f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:48.020829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fecbf31-cac4-4491-bbb0-563952abe09f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:48.021270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fecbf31-cac4-4491-bbb0-563952abe09f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:48.065551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a9c4be27-63f3-45b3-b6c5-d7125ba1f972 req-4a3504d7-6812-42e6-97cb-2a96d6701466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4332394-4519-4c1d-b5bd-22c1de38fd6e", "tag": "d7595bd6-4531-40ab-b41d-fcc3e753c0cd"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:48.090652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a9c4be27-63f3-45b3-b6c5-d7125ba1f972 req-4a3504d7-6812-42e6-97cb-2a96d6701466 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:48.091137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a9c4be27-63f3-45b3-b6c5-d7125ba1f972 req-4a3504d7-6812-42e6-97cb-2a96d6701466 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:48.091565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a9c4be27-63f3-45b3-b6c5-d7125ba1f972 req-4a3504d7-6812-42e6-97cb-2a96d6701466 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:48.111493 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a9c4be27-63f3-45b3-b6c5-d7125ba1f972 req-4a3504d7-6812-42e6-97cb-2a96d6701466 service nova] Creating event network-changed:d7595bd6-4531-40ab-b41d-fcc3e753c0cd for instance b4332394-4519-4c1d-b5bd-22c1de38fd6e on n-h1-854823-1 Aug 27 05:06:48.137615 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a9c4be27-63f3-45b3-b6c5-d7125ba1f972 req-4a3504d7-6812-42e6-97cb-2a96d6701466 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075684 Aug 27 05:06:48.139894 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2896/5841] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:06:48.919449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7fecbf31-cac4-4491-bbb0-563952abe09f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:48.932203 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7fecbf31-cac4-4491-bbb0-563952abe09f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1563 microversion: 2.1 time: 0.932457 Aug 27 05:06:48.940854 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2946/5842] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:47 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1563 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:56.061772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-60e80111-5bdd-49dd-80f0-2b107739a7eb tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'create', calling method: .version_select at 0x7f1f21485d30>, body: {"keypair": {"name": "tempest-keypair-2140678373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNv9JZo4/EbkiJCDfAlEuRMeIURSSixjrbe2z4evN9JK0Gtz75QcZ3qqGMWZkR/7mq7+3fWdIBPb5GrN8vLhEyjdu/WfZbxFrgiwey4khUcMLEoIuxluegxY8gcimz1yPw=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:56.069155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=62 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:56.103916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-60e80111-5bdd-49dd-80f0-2b107739a7eb tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Getting quotas for project 631787d4099e4245be9291f39ff6b2bd. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:06:56.110660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-60e80111-5bdd-49dd-80f0-2b107739a7eb tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Getting quotas for user c77d065776e448f08f0a1d6fde1aff3c and project 631787d4099e4245be9291f39ff6b2bd. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:06:56.145545 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-60e80111-5bdd-49dd-80f0-2b107739a7eb tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.235090 Aug 27 05:06:56.146175 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2897/5843] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:06:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:06:57.766847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-693008809", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b8ed832-ef0e-4e8a-a972-17542970b368"}], "security_groups": [{"name": "tempest-securitygroup--609744612"}], "key_name": "tempest-keypair-2140678373", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:06:57.891847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] validate_networks() for [('3b8ed832-ef0e-4e8a-a972-17542970b368', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:06:58.404128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:06:58.405031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:06:58.405601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:06:58.406051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:06:58.406719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:06:58.419877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:58.420697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:58.421521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:58.422480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:58.423119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:58.423751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:58.447536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Getting quotas for project 631787d4099e4245be9291f39ff6b2bd. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:06:58.471096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Getting quotas for user c77d065776e448f08f0a1d6fde1aff3c and project 631787d4099e4245be9291f39ff6b2bd. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:06:58.486807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:06:58.490387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:06:58.602936 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db7e6f92-285a-4a36-912b-844ac95a0ad8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.840851 Aug 27 05:06:58.610344 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2947/5844] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:06:57 2022] POST /compute/v2.1/servers => generated 408 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:06:58.613053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:58.618044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-16e4c0d2-4a68-4040-8f1b-5f26725164a2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:58.619413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-16e4c0d2-4a68-4040-8f1b-5f26725164a2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:58.865512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-16e4c0d2-4a68-4040-8f1b-5f26725164a2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:06:58.880238 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-16e4c0d2-4a68-4040-8f1b-5f26725164a2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1238 microversion: 2.1 time: 0.268922 Aug 27 05:06:58.892036 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2898/5845] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:58 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1238 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:06:59.904143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50abf7d3-a2fd-4464-98b1-22dd8242e3c8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:06:59.905307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50abf7d3-a2fd-4464-98b1-22dd8242e3c8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:06:59.916438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50abf7d3-a2fd-4464-98b1-22dd8242e3c8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:59.917003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50abf7d3-a2fd-4464-98b1-22dd8242e3c8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:59.917476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50abf7d3-a2fd-4464-98b1-22dd8242e3c8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:06:59.918218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50abf7d3-a2fd-4464-98b1-22dd8242e3c8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:06:59.918701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50abf7d3-a2fd-4464-98b1-22dd8242e3c8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:06:59.919169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50abf7d3-a2fd-4464-98b1-22dd8242e3c8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:00.121128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50abf7d3-a2fd-4464-98b1-22dd8242e3c8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:00.141374 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50abf7d3-a2fd-4464-98b1-22dd8242e3c8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1290 microversion: 2.1 time: 0.241754 Aug 27 05:07:00.142687 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2948/5846] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:06:59 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1290 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:01.164197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8d4d9933-cc60-449f-8252-eaefe755ea84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:01.164883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8d4d9933-cc60-449f-8252-eaefe755ea84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:01.173611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d4d9933-cc60-449f-8252-eaefe755ea84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:01.174523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d4d9933-cc60-449f-8252-eaefe755ea84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:01.175373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d4d9933-cc60-449f-8252-eaefe755ea84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:01.176607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d4d9933-cc60-449f-8252-eaefe755ea84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:01.177271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d4d9933-cc60-449f-8252-eaefe755ea84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:01.178742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d4d9933-cc60-449f-8252-eaefe755ea84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:01.466939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8d4d9933-cc60-449f-8252-eaefe755ea84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:01.477986 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8d4d9933-cc60-449f-8252-eaefe755ea84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1363 microversion: 2.1 time: 0.318846 Aug 27 05:07:01.481114 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2899/5847] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:01 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:01.818508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0655822c-af91-42f6-b83b-3833a6b2e474 req-e3547e01-abf4-4ae9-a3db-abf420407417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f54d929-acc6-47f3-96a7-708032ccd9d9", "tag": "060a48ca-cf07-4257-8892-27d740101396"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:01.830852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0655822c-af91-42f6-b83b-3833a6b2e474 req-e3547e01-abf4-4ae9-a3db-abf420407417 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:01.831868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0655822c-af91-42f6-b83b-3833a6b2e474 req-e3547e01-abf4-4ae9-a3db-abf420407417 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:01.832557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0655822c-af91-42f6-b83b-3833a6b2e474 req-e3547e01-abf4-4ae9-a3db-abf420407417 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:01.854759 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0655822c-af91-42f6-b83b-3833a6b2e474 req-e3547e01-abf4-4ae9-a3db-abf420407417 service nova] Creating event network-changed:060a48ca-cf07-4257-8892-27d740101396 for instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 on n-h2-854823-1 Aug 27 05:07:01.861270 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0655822c-af91-42f6-b83b-3833a6b2e474 req-e3547e01-abf4-4ae9-a3db-abf420407417 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048394 Aug 27 05:07:01.862645 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2949/5848] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:02.500276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bafd5021-0b1c-4575-b51a-f6e11fd16677 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:02.500931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bafd5021-0b1c-4575-b51a-f6e11fd16677 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:02.509173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bafd5021-0b1c-4575-b51a-f6e11fd16677 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:02.509957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bafd5021-0b1c-4575-b51a-f6e11fd16677 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:02.510588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bafd5021-0b1c-4575-b51a-f6e11fd16677 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:02.511457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bafd5021-0b1c-4575-b51a-f6e11fd16677 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:02.512080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bafd5021-0b1c-4575-b51a-f6e11fd16677 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:02.512702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bafd5021-0b1c-4575-b51a-f6e11fd16677 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:02.660118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bafd5021-0b1c-4575-b51a-f6e11fd16677 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:02.668066 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bafd5021-0b1c-4575-b51a-f6e11fd16677 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1363 microversion: 2.1 time: 0.172117 Aug 27 05:07:02.668664 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2900/5849] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:02 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:03.691207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-236cd711-b9e3-45d8-afcd-cfbcf08ae453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:03.692157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-236cd711-b9e3-45d8-afcd-cfbcf08ae453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:03.694717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:03.701532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-236cd711-b9e3-45d8-afcd-cfbcf08ae453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:03.702337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-236cd711-b9e3-45d8-afcd-cfbcf08ae453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:03.703027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-236cd711-b9e3-45d8-afcd-cfbcf08ae453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:03.704115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-236cd711-b9e3-45d8-afcd-cfbcf08ae453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:03.704958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-236cd711-b9e3-45d8-afcd-cfbcf08ae453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:03.707071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-236cd711-b9e3-45d8-afcd-cfbcf08ae453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:04.009566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-236cd711-b9e3-45d8-afcd-cfbcf08ae453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:04.018747 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-236cd711-b9e3-45d8-afcd-cfbcf08ae453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1363 microversion: 2.1 time: 0.332924 Aug 27 05:07:04.035110 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2950/5850] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:03 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:05.043648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2a30be4f-8ffe-4f54-9eb3-7f750785f171 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:05.045145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2a30be4f-8ffe-4f54-9eb3-7f750785f171 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:05.052715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a30be4f-8ffe-4f54-9eb3-7f750785f171 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:05.053213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a30be4f-8ffe-4f54-9eb3-7f750785f171 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:05.053656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a30be4f-8ffe-4f54-9eb3-7f750785f171 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:05.054378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a30be4f-8ffe-4f54-9eb3-7f750785f171 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:05.055618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a30be4f-8ffe-4f54-9eb3-7f750785f171 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:05.056256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a30be4f-8ffe-4f54-9eb3-7f750785f171 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:05.211929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a30be4f-8ffe-4f54-9eb3-7f750785f171 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:05.220042 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2a30be4f-8ffe-4f54-9eb3-7f750785f171 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1363 microversion: 2.1 time: 0.180290 Aug 27 05:07:05.220673 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2901/5851] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:05 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:06.072067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b3754ee0-ea0a-451e-94d6-0adb9d5671a3 req-8e40d62d-51f6-41d8-9e9e-a8e0609adb88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f54d929-acc6-47f3-96a7-708032ccd9d9", "name": "network-vif-plugged", "status": "completed", "tag": "060a48ca-cf07-4257-8892-27d740101396"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:06.086686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b3754ee0-ea0a-451e-94d6-0adb9d5671a3 req-8e40d62d-51f6-41d8-9e9e-a8e0609adb88 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:06.087184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b3754ee0-ea0a-451e-94d6-0adb9d5671a3 req-8e40d62d-51f6-41d8-9e9e-a8e0609adb88 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:06.087658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b3754ee0-ea0a-451e-94d6-0adb9d5671a3 req-8e40d62d-51f6-41d8-9e9e-a8e0609adb88 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:06.101298 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b3754ee0-ea0a-451e-94d6-0adb9d5671a3 req-8e40d62d-51f6-41d8-9e9e-a8e0609adb88 service nova] Creating event network-vif-plugged:060a48ca-cf07-4257-8892-27d740101396 for instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 on n-h2-854823-1 Aug 27 05:07:06.107871 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b3754ee0-ea0a-451e-94d6-0adb9d5671a3 req-8e40d62d-51f6-41d8-9e9e-a8e0609adb88 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039526 Aug 27 05:07:06.108706 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2951/5852] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:06.243849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fccb38a1-ccf8-4c3a-ba36-a1abfdfad681 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:06.244506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fccb38a1-ccf8-4c3a-ba36-a1abfdfad681 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:06.252232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fccb38a1-ccf8-4c3a-ba36-a1abfdfad681 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:06.252778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fccb38a1-ccf8-4c3a-ba36-a1abfdfad681 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:06.253223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fccb38a1-ccf8-4c3a-ba36-a1abfdfad681 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:06.254102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fccb38a1-ccf8-4c3a-ba36-a1abfdfad681 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:06.254445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fccb38a1-ccf8-4c3a-ba36-a1abfdfad681 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:06.254876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fccb38a1-ccf8-4c3a-ba36-a1abfdfad681 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:06.396828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fccb38a1-ccf8-4c3a-ba36-a1abfdfad681 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:06.406489 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fccb38a1-ccf8-4c3a-ba36-a1abfdfad681 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1363 microversion: 2.1 time: 0.167198 Aug 27 05:07:06.407114 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2902/5853] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:06 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:07.431604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a2295ec-09ac-49c1-b9ec-f0dcc87fbb3d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:07.432667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a2295ec-09ac-49c1-b9ec-f0dcc87fbb3d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:07.444865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a2295ec-09ac-49c1-b9ec-f0dcc87fbb3d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:07.445796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a2295ec-09ac-49c1-b9ec-f0dcc87fbb3d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:07.446710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a2295ec-09ac-49c1-b9ec-f0dcc87fbb3d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:07.447533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a2295ec-09ac-49c1-b9ec-f0dcc87fbb3d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:07.448209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a2295ec-09ac-49c1-b9ec-f0dcc87fbb3d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:07.448911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a2295ec-09ac-49c1-b9ec-f0dcc87fbb3d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:07.713804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a2295ec-09ac-49c1-b9ec-f0dcc87fbb3d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:07.722422 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a2295ec-09ac-49c1-b9ec-f0dcc87fbb3d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1363 microversion: 2.1 time: 0.298636 Aug 27 05:07:07.723375 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2952/5854] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:07 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:08.746037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-24584c92-8e09-4328-b616-0649c882f19a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:08.746556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-24584c92-8e09-4328-b616-0649c882f19a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:08.753525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24584c92-8e09-4328-b616-0649c882f19a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:08.754024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24584c92-8e09-4328-b616-0649c882f19a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:08.754465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24584c92-8e09-4328-b616-0649c882f19a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:08.755179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24584c92-8e09-4328-b616-0649c882f19a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:08.755643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24584c92-8e09-4328-b616-0649c882f19a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:08.756410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24584c92-8e09-4328-b616-0649c882f19a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:08.870269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:09.018868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-24584c92-8e09-4328-b616-0649c882f19a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:09.027086 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-24584c92-8e09-4328-b616-0649c882f19a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1549 microversion: 2.1 time: 0.286477 Aug 27 05:07:09.027837 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2903/5855] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:08 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1549 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:09.048393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-385fb25b-4c40-47fd-a72b-1a3a4fb019d0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:09.048975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-385fb25b-4c40-47fd-a72b-1a3a4fb019d0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:09.050984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:09.052480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:09.058932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-385fb25b-4c40-47fd-a72b-1a3a4fb019d0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:09.059446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-385fb25b-4c40-47fd-a72b-1a3a4fb019d0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:09.059898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-385fb25b-4c40-47fd-a72b-1a3a4fb019d0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:09.060650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-385fb25b-4c40-47fd-a72b-1a3a4fb019d0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:09.061120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-385fb25b-4c40-47fd-a72b-1a3a4fb019d0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:09.061562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-385fb25b-4c40-47fd-a72b-1a3a4fb019d0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:09.164214 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-385fb25b-4c40-47fd-a72b-1a3a4fb019d0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119314 Aug 27 05:07:09.165042 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2953/5856] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 05:07:09 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:10.700275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-923ed6f9-0d10-48ef-8827-c41dff756e67 req-9fe6e9e1-837f-488d-96a9-96f40ed91c79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f54d929-acc6-47f3-96a7-708032ccd9d9", "tag": "060a48ca-cf07-4257-8892-27d740101396"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:10.713489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-923ed6f9-0d10-48ef-8827-c41dff756e67 req-9fe6e9e1-837f-488d-96a9-96f40ed91c79 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:10.714254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-923ed6f9-0d10-48ef-8827-c41dff756e67 req-9fe6e9e1-837f-488d-96a9-96f40ed91c79 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:10.714865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-923ed6f9-0d10-48ef-8827-c41dff756e67 req-9fe6e9e1-837f-488d-96a9-96f40ed91c79 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:10.727733 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-923ed6f9-0d10-48ef-8827-c41dff756e67 req-9fe6e9e1-837f-488d-96a9-96f40ed91c79 service nova] Creating event network-changed:060a48ca-cf07-4257-8892-27d740101396 for instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 on n-h2-854823-1 Aug 27 05:07:10.733001 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-923ed6f9-0d10-48ef-8827-c41dff756e67 req-9fe6e9e1-837f-488d-96a9-96f40ed91c79 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036421 Aug 27 05:07:10.734208 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2904/5857] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:07:17.632169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-51630749-fbf6-4145-9d7c-d2380754240f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:17.632878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-51630749-fbf6-4145-9d7c-d2380754240f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:17.639465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51630749-fbf6-4145-9d7c-d2380754240f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:17.640050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51630749-fbf6-4145-9d7c-d2380754240f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:17.640611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51630749-fbf6-4145-9d7c-d2380754240f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:17.641414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51630749-fbf6-4145-9d7c-d2380754240f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:17.641961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51630749-fbf6-4145-9d7c-d2380754240f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:17.642519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51630749-fbf6-4145-9d7c-d2380754240f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:17.647489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=40 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:17.672206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-51630749-fbf6-4145-9d7c-d2380754240f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:07:17.776718 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-51630749-fbf6-4145-9d7c-d2380754240f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 204 len: 0 microversion: 2.1 time: 0.149209 Aug 27 05:07:17.777676 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2954/5858] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:07:17 2022] DELETE /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:07:17.789644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-49843bc3-5f8a-4b04-aede-9188aec78803 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:17.790965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-49843bc3-5f8a-4b04-aede-9188aec78803 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:17.797332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49843bc3-5f8a-4b04-aede-9188aec78803 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:17.798693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49843bc3-5f8a-4b04-aede-9188aec78803 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:17.799134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49843bc3-5f8a-4b04-aede-9188aec78803 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:17.799839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49843bc3-5f8a-4b04-aede-9188aec78803 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:17.800296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49843bc3-5f8a-4b04-aede-9188aec78803 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:17.800763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49843bc3-5f8a-4b04-aede-9188aec78803 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:18.001441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-49843bc3-5f8a-4b04-aede-9188aec78803 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:18.010288 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-49843bc3-5f8a-4b04-aede-9188aec78803 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1577 microversion: 2.1 time: 0.226884 Aug 27 05:07:18.011025 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2905/5859] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:17 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1577 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:19.033739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6535fb71-379b-453f-a78c-05ba5df980d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:19.034535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6535fb71-379b-453f-a78c-05ba5df980d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:19.042137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6535fb71-379b-453f-a78c-05ba5df980d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:19.042646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6535fb71-379b-453f-a78c-05ba5df980d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:19.043103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6535fb71-379b-453f-a78c-05ba5df980d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:19.043834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6535fb71-379b-453f-a78c-05ba5df980d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:19.044306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6535fb71-379b-453f-a78c-05ba5df980d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:19.044781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6535fb71-379b-453f-a78c-05ba5df980d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:19.582571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6535fb71-379b-453f-a78c-05ba5df980d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:19.591867 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6535fb71-379b-453f-a78c-05ba5df980d3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1577 microversion: 2.1 time: 0.563056 Aug 27 05:07:19.606490 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2955/5860] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:19 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1577 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:20.612831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5a8183d5-0cd2-4779-9aae-1e742e2678b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:20.613464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5a8183d5-0cd2-4779-9aae-1e742e2678b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:20.622682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a8183d5-0cd2-4779-9aae-1e742e2678b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:20.623541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a8183d5-0cd2-4779-9aae-1e742e2678b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:20.623995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a8183d5-0cd2-4779-9aae-1e742e2678b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:20.624742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a8183d5-0cd2-4779-9aae-1e742e2678b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:20.625513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a8183d5-0cd2-4779-9aae-1e742e2678b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:20.626173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a8183d5-0cd2-4779-9aae-1e742e2678b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:20.699857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5a8183d5-0cd2-4779-9aae-1e742e2678b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:20.709706 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5a8183d5-0cd2-4779-9aae-1e742e2678b5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1510 microversion: 2.1 time: 0.100777 Aug 27 05:07:20.710921 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2906/5861] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:20 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1510 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:20.955949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-82424640-d891-4aff-a95c-425a6bc460ef req-badf7a12-d0e4-4fed-ace5-e24903687fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a094869-315b-493d-ad12-b727bfae7d9e", "name": "network-vif-deleted", "tag": "5c5d6f80-5b1c-4d96-bd9a-6f0981657a28"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:20.972820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-82424640-d891-4aff-a95c-425a6bc460ef req-badf7a12-d0e4-4fed-ace5-e24903687fbf service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:20.976802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-82424640-d891-4aff-a95c-425a6bc460ef req-badf7a12-d0e4-4fed-ace5-e24903687fbf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:20.979824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-82424640-d891-4aff-a95c-425a6bc460ef req-badf7a12-d0e4-4fed-ace5-e24903687fbf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.015603 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-82424640-d891-4aff-a95c-425a6bc460ef req-badf7a12-d0e4-4fed-ace5-e24903687fbf service nova] Creating event network-vif-deleted:5c5d6f80-5b1c-4d96-bd9a-6f0981657a28 for instance 7a094869-315b-493d-ad12-b727bfae7d9e on n-h2-854823-1 Aug 27 05:07:21.029406 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-82424640-d891-4aff-a95c-425a6bc460ef req-badf7a12-d0e4-4fed-ace5-e24903687fbf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077751 Aug 27 05:07:21.030940 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2956/5862] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:21.072598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fdfe96e8-ff88-4c5a-aa32-3d243d578912 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:21.075522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fdfe96e8-ff88-4c5a-aa32-3d243d578912 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:21.088402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdfe96e8-ff88-4c5a-aa32-3d243d578912 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.089754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdfe96e8-ff88-4c5a-aa32-3d243d578912 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.091552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdfe96e8-ff88-4c5a-aa32-3d243d578912 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.093358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdfe96e8-ff88-4c5a-aa32-3d243d578912 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.093942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdfe96e8-ff88-4c5a-aa32-3d243d578912 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.095761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdfe96e8-ff88-4c5a-aa32-3d243d578912 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.160824 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fdfe96e8-ff88-4c5a-aa32-3d243d578912 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.092611 Aug 27 05:07:21.161517 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2907/5863] 10.222.0.79 () {60 vars in 1343 bytes} [Sat Aug 27 05:07:21 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:21.267303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f272f39e-38db-42f7-8b17-6ea2308791b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:21.268145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f272f39e-38db-42f7-8b17-6ea2308791b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:21.280937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f272f39e-38db-42f7-8b17-6ea2308791b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.281575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f272f39e-38db-42f7-8b17-6ea2308791b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.284198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f272f39e-38db-42f7-8b17-6ea2308791b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.285065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f272f39e-38db-42f7-8b17-6ea2308791b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.286561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f272f39e-38db-42f7-8b17-6ea2308791b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.287224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f272f39e-38db-42f7-8b17-6ea2308791b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.343450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f272f39e-38db-42f7-8b17-6ea2308791b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:07:21.557378 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f272f39e-38db-42f7-8b17-6ea2308791b0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 204 len: 0 microversion: 2.20 time: 0.283540 Aug 27 05:07:21.561787 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2957/5864] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 05:07:21 2022] DELETE /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:07:21.568852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f6a4ad31-bc09-4b5c-a3c2-76a05baccaa8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:21.569683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f6a4ad31-bc09-4b5c-a3c2-76a05baccaa8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:21.581798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6a4ad31-bc09-4b5c-a3c2-76a05baccaa8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.584467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6a4ad31-bc09-4b5c-a3c2-76a05baccaa8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.585075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6a4ad31-bc09-4b5c-a3c2-76a05baccaa8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.590063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6a4ad31-bc09-4b5c-a3c2-76a05baccaa8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.590576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6a4ad31-bc09-4b5c-a3c2-76a05baccaa8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.593040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f6a4ad31-bc09-4b5c-a3c2-76a05baccaa8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.732856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99a83385-b667-4ad6-a1e8-89d4716205cb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:21.734084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99a83385-b667-4ad6-a1e8-89d4716205cb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:21.747932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99a83385-b667-4ad6-a1e8-89d4716205cb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.749107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99a83385-b667-4ad6-a1e8-89d4716205cb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.749630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99a83385-b667-4ad6-a1e8-89d4716205cb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.756379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99a83385-b667-4ad6-a1e8-89d4716205cb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:21.757155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99a83385-b667-4ad6-a1e8-89d4716205cb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:21.757837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99a83385-b667-4ad6-a1e8-89d4716205cb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:21.850205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f6a4ad31-bc09-4b5c-a3c2-76a05baccaa8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:21.861155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f6a4ad31-bc09-4b5c-a3c2-76a05baccaa8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:21.869011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f6a4ad31-bc09-4b5c-a3c2-76a05baccaa8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:21.875583 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f6a4ad31-bc09-4b5c-a3c2-76a05baccaa8 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.311517 Aug 27 05:07:21.876235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99a83385-b667-4ad6-a1e8-89d4716205cb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:21.876955 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2908/5865] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:21 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:21.900128 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99a83385-b667-4ad6-a1e8-89d4716205cb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1226 microversion: 2.1 time: 0.171782 Aug 27 05:07:21.900857 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2958/5866] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:21 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1226 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:22.899697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-089bb496-2400-4f16-8986-3f8225b547fe tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:22.900400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-089bb496-2400-4f16-8986-3f8225b547fe tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:22.908353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-089bb496-2400-4f16-8986-3f8225b547fe tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:22.908888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-089bb496-2400-4f16-8986-3f8225b547fe tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:22.909320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-089bb496-2400-4f16-8986-3f8225b547fe tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:22.910022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-089bb496-2400-4f16-8986-3f8225b547fe tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:22.910482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-089bb496-2400-4f16-8986-3f8225b547fe tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:22.910894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-089bb496-2400-4f16-8986-3f8225b547fe tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:23.091989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-089bb496-2400-4f16-8986-3f8225b547fe tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:23.107260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-089bb496-2400-4f16-8986-3f8225b547fe tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:23.108844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-089bb496-2400-4f16-8986-3f8225b547fe tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:23.110042 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-089bb496-2400-4f16-8986-3f8225b547fe tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1724 microversion: 2.20 time: 0.214640 Aug 27 05:07:23.111387 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2909/5867] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:22 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:23.131814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5730d396-db9c-4e67-bee5-4dfd71070bfc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:23.132715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5730d396-db9c-4e67-bee5-4dfd71070bfc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:23.149674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5730d396-db9c-4e67-bee5-4dfd71070bfc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:23.150193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5730d396-db9c-4e67-bee5-4dfd71070bfc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:23.150670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5730d396-db9c-4e67-bee5-4dfd71070bfc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:23.151402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5730d396-db9c-4e67-bee5-4dfd71070bfc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:23.151875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5730d396-db9c-4e67-bee5-4dfd71070bfc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:23.152422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5730d396-db9c-4e67-bee5-4dfd71070bfc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:23.254894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5730d396-db9c-4e67-bee5-4dfd71070bfc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:23.265637 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5730d396-db9c-4e67-bee5-4dfd71070bfc tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1226 microversion: 2.1 time: 0.340650 Aug 27 05:07:23.266824 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2959/5868] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:22 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1226 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:24.114176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1c206a4e-0517-4b25-9b12-8a6515708e0f req-126b7e1d-bc68-4b60-be24-35cba465f15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf34f382-9b01-4519-ba5f-78471ee22e32", "name": "network-vif-deleted", "tag": "7a1ec75a-2f7a-416e-b884-5870283eafe6"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:24.135705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a461a18-49d7-4141-a1a4-e21df930d652 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:24.137023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a461a18-49d7-4141-a1a4-e21df930d652 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:24.156467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1c206a4e-0517-4b25-9b12-8a6515708e0f req-126b7e1d-bc68-4b60-be24-35cba465f15f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:24.161424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1c206a4e-0517-4b25-9b12-8a6515708e0f req-126b7e1d-bc68-4b60-be24-35cba465f15f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:24.162246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1c206a4e-0517-4b25-9b12-8a6515708e0f req-126b7e1d-bc68-4b60-be24-35cba465f15f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:24.162651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a461a18-49d7-4141-a1a4-e21df930d652 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:24.171472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a461a18-49d7-4141-a1a4-e21df930d652 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:24.173399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a461a18-49d7-4141-a1a4-e21df930d652 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:24.174438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a461a18-49d7-4141-a1a4-e21df930d652 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:24.186952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a461a18-49d7-4141-a1a4-e21df930d652 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:24.187628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a461a18-49d7-4141-a1a4-e21df930d652 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:24.192770 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1c206a4e-0517-4b25-9b12-8a6515708e0f req-126b7e1d-bc68-4b60-be24-35cba465f15f service nova] Creating event network-vif-deleted:7a1ec75a-2f7a-416e-b884-5870283eafe6 for instance bf34f382-9b01-4519-ba5f-78471ee22e32 on n-h2-854823-1 Aug 27 05:07:24.222491 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1c206a4e-0517-4b25-9b12-8a6515708e0f req-126b7e1d-bc68-4b60-be24-35cba465f15f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115744 Aug 27 05:07:24.224984 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2910/5869] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:24.294866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a5e0ecf7-1ab8-4bca-a54f-e3fb9408899d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:24.297300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a5e0ecf7-1ab8-4bca-a54f-e3fb9408899d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:24.326335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5e0ecf7-1ab8-4bca-a54f-e3fb9408899d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:24.330714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5e0ecf7-1ab8-4bca-a54f-e3fb9408899d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:24.332095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5e0ecf7-1ab8-4bca-a54f-e3fb9408899d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:24.334836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5e0ecf7-1ab8-4bca-a54f-e3fb9408899d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:24.337111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5e0ecf7-1ab8-4bca-a54f-e3fb9408899d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:24.338239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5e0ecf7-1ab8-4bca-a54f-e3fb9408899d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:24.450677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a461a18-49d7-4141-a1a4-e21df930d652 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:24.467414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a461a18-49d7-4141-a1a4-e21df930d652 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:24.469365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a461a18-49d7-4141-a1a4-e21df930d652 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec72122ff0b84c5fb558ca810ddd213d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d73cadd70ef45259dd85e6d59cbbab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:24.471569 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a461a18-49d7-4141-a1a4-e21df930d652 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 200 len: 1366 microversion: 2.20 time: 0.339831 Aug 27 05:07:24.472743 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2960/5870] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:24 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:07:24.507666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a5e0ecf7-1ab8-4bca-a54f-e3fb9408899d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:24.518218 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a5e0ecf7-1ab8-4bca-a54f-e3fb9408899d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1226 microversion: 2.1 time: 0.233379 Aug 27 05:07:24.519185 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2911/5871] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:24 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1226 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:25.502053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ad18cba-7676-4958-a339-774b850e1068 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:25.502950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ad18cba-7676-4958-a339-774b850e1068 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:25.528988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad18cba-7676-4958-a339-774b850e1068 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:25.530328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad18cba-7676-4958-a339-774b850e1068 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:25.531034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad18cba-7676-4958-a339-774b850e1068 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:25.532200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad18cba-7676-4958-a339-774b850e1068 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:25.532984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad18cba-7676-4958-a339-774b850e1068 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:25.534479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad18cba-7676-4958-a339-774b850e1068 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:25.545572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2bac15df-8df3-41f3-9798-bd0b5b526408 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:25.546241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2bac15df-8df3-41f3-9798-bd0b5b526408 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:25.558099 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7ad18cba-7676-4958-a339-774b850e1068 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] HTTP exception thrown: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ad18cba-7676-4958-a339-774b850e1068 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Request method failure captured: Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 HTTP/1.1 Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaSjtKQ8CNr8ijhBpDj-EldUtAutdZu4lRoyWRJSbKIHJXnKqqOeGbCBFdWOZKopjq1IGLgQGFQNqz8sSUAQqx808Z7T-yWEwNxol6tWR3RDabS8xz0sm8_TchXJn0LJbdFaeJmZmmQTvO4payBl1yD5Yqrlhi3JSiB63gvuJdHxdCM Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 3d73cadd70ef45259dd85e6d59cbbab1 Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 3d73cadd70ef45259dd85e6d59cbbab1 Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeShelveTestJSON-1256848898-project Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: ec72122ff0b84c5fb558ca810ddd213d Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1256848898-project Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'bf34f382-9b01-4519-ba5f-78471ee22e32'} Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:25.560860 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:25.566938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:25.566938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:25.566938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:25.566938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:25.566938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:25.566938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:25.566938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:25.566938 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:25.567626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bac15df-8df3-41f3-9798-bd0b5b526408 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:25.567626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bac15df-8df3-41f3-9798-bd0b5b526408 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:25.567626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bac15df-8df3-41f3-9798-bd0b5b526408 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:25.567626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bac15df-8df3-41f3-9798-bd0b5b526408 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:25.567626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bac15df-8df3-41f3-9798-bd0b5b526408 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:25.569865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ad18cba-7676-4958-a339-774b850e1068 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Returning 404 to user: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:25.570005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bac15df-8df3-41f3-9798-bd0b5b526408 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:25.570120 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ad18cba-7676-4958-a339-774b850e1068 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 404 len: 111 microversion: 2.20 time: 0.071429 Aug 27 05:07:25.570120 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2961/5872] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:25 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:07:25.577790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba97580c-6853-4f81-81fc-2c3e685ee0d0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '.version_select at 0x7f1f20dec280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:25.623380 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba97580c-6853-4f81-81fc-2c3e685ee0d0 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-134333275" status: 204 len: 0 microversion: 2.20 time: 0.049386 Aug 27 05:07:25.624477 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2962/5873] 10.222.0.79 () {60 vars in 1259 bytes} [Sat Aug 27 05:07:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-134333275 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:07:25.750313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2bac15df-8df3-41f3-9798-bd0b5b526408 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:25.765152 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2bac15df-8df3-41f3-9798-bd0b5b526408 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1226 microversion: 2.1 time: 0.218648 Aug 27 05:07:25.766278 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2912/5874] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:25 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1226 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:26.788048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90915868-f4e3-4ce0-a4da-c57528c7610f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:26.789532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90915868-f4e3-4ce0-a4da-c57528c7610f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:26.798915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90915868-f4e3-4ce0-a4da-c57528c7610f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:26.799933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90915868-f4e3-4ce0-a4da-c57528c7610f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:26.800675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90915868-f4e3-4ce0-a4da-c57528c7610f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:26.801653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90915868-f4e3-4ce0-a4da-c57528c7610f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:26.802387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90915868-f4e3-4ce0-a4da-c57528c7610f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:26.803092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90915868-f4e3-4ce0-a4da-c57528c7610f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:26.838969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90915868-f4e3-4ce0-a4da-c57528c7610f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:26.839609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90915868-f4e3-4ce0-a4da-c57528c7610f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:26.840168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90915868-f4e3-4ce0-a4da-c57528c7610f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:26.841168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-90915868-f4e3-4ce0-a4da-c57528c7610f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lazy-loading 'fault' on Instance uuid 7a094869-315b-493d-ad12-b727bfae7d9e {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:07:26.898594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-90915868-f4e3-4ce0-a4da-c57528c7610f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:26.909485 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90915868-f4e3-4ce0-a4da-c57528c7610f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 200 len: 1231 microversion: 2.1 time: 0.123926 Aug 27 05:07:26.927350 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2963/5875] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:26 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 1231 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:27.935064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-485aed12-0561-4b0f-97d5-b8588d99d16d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:27.936099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-485aed12-0561-4b0f-97d5-b8588d99d16d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:27.939763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:27.947459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-485aed12-0561-4b0f-97d5-b8588d99d16d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:27.948072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-485aed12-0561-4b0f-97d5-b8588d99d16d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:27.948623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-485aed12-0561-4b0f-97d5-b8588d99d16d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:27.949383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-485aed12-0561-4b0f-97d5-b8588d99d16d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:27.949917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-485aed12-0561-4b0f-97d5-b8588d99d16d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:27.950601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-485aed12-0561-4b0f-97d5-b8588d99d16d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:27.968108 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-485aed12-0561-4b0f-97d5-b8588d99d16d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-485aed12-0561-4b0f-97d5-b8588d99d16d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e HTTP/1.1 Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '7a094869-315b-493d-ad12-b727bfae7d9e'} Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:27.970070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:07:27.975525 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:27.975525 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:27.975525 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:27.975525 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:27.975525 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:27.975525 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:07:27.975525 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:07:27.977285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-485aed12-0561-4b0f-97d5-b8588d99d16d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:27.978346 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-485aed12-0561-4b0f-97d5-b8588d99d16d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 404 len: 111 microversion: 2.1 time: 0.047877 Aug 27 05:07:27.978948 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2913/5876] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:27 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:07:28.047395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-619783946", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1893726088", "security_groups": [{"name": "tempest-secgroup-smoke-933956386"}], "block_device_mapping_v2": [{"uuid": "0268c68b-cd52-4ccf-a8a6-907a0ebfe5f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b9321d5-af89-499e-b147-430b2ec333ca"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:28.281197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] validate_networks() for [('0b9321d5-af89-499e-b147-430b2ec333ca', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:07:29.067816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:07:29.070031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:07:29.071132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:07:29.071913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:07:29.072620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:07:29.086959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:29.088000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:29.090091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:29.097027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:29.098817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:29.099933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:29.128851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:07:29.135530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for user 8376c4e2cf814a8b8b1e2a8e404b0187 and project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:07:29.229204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:07:29.231536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0268c68b-cd52-4ccf-a8a6-907a0ebfe5f7',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:07:29.394340 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8f143cc-d44c-4098-a0c2-adaf5fde0d5f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.353134 Aug 27 05:07:29.395372 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2964/5877] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:07:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:07:29.409124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-73fce261-587e-4d4e-8eee-682fc5c32bdf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:29.410285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-73fce261-587e-4d4e-8eee-682fc5c32bdf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:29.439107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f49fafd-caf2-4f47-a691-beeb33917b61 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:29.439833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f49fafd-caf2-4f47-a691-beeb33917b61 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:29.450973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f49fafd-caf2-4f47-a691-beeb33917b61 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:29.455843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f49fafd-caf2-4f47-a691-beeb33917b61 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:29.456368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f49fafd-caf2-4f47-a691-beeb33917b61 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:29.457894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f49fafd-caf2-4f47-a691-beeb33917b61 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:29.458458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f49fafd-caf2-4f47-a691-beeb33917b61 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:29.459537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f49fafd-caf2-4f47-a691-beeb33917b61 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:29.511065 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8f49fafd-caf2-4f47-a691-beeb33917b61 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] HTTP exception thrown: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f49fafd-caf2-4f47-a691-beeb33917b61 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Request method failure captured: Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 HTTP/1.1 Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaSjtKQ8CNr8ijhBpDj-EldUtAutdZu4lRoyWRJSbKIHJXnKqqOeGbCBFdWOZKopjq1IGLgQGFQNqz8sSUAQqx808Z7T-yWEwNxol6tWR3RDabS8xz0sm8_TchXJn0LJbdFaeJmZmmQTvO4payBl1yD5Yqrlhi3JSiB63gvuJdHxdCM Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 3d73cadd70ef45259dd85e6d59cbbab1 Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 3d73cadd70ef45259dd85e6d59cbbab1 Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeShelveTestJSON-1256848898-project Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: ec72122ff0b84c5fb558ca810ddd213d Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1256848898-project Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'bf34f382-9b01-4519-ba5f-78471ee22e32'} Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:07:29.514735 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:29.519969 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:29.519969 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:29.519969 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:29.519969 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:29.519969 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:29.519969 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:29.519969 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:29.519969 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:29.519969 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:29.519969 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:29.519969 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:29.519969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f49fafd-caf2-4f47-a691-beeb33917b61 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Returning 404 to user: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:29.522488 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f49fafd-caf2-4f47-a691-beeb33917b61 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 404 len: 111 microversion: 2.20 time: 0.087816 Aug 27 05:07:29.523493 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2965/5878] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 05:07:29 2022] DELETE /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 05:07:29.531744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94ee9b38-0226-45c8-92d1-67246a90784c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:29.532387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94ee9b38-0226-45c8-92d1-67246a90784c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: bf34f382-9b01-4519-ba5f-78471ee22e32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:29.541724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94ee9b38-0226-45c8-92d1-67246a90784c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:29.542561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94ee9b38-0226-45c8-92d1-67246a90784c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:29.543293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94ee9b38-0226-45c8-92d1-67246a90784c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:29.544743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94ee9b38-0226-45c8-92d1-67246a90784c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:29.545504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94ee9b38-0226-45c8-92d1-67246a90784c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:29.546297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94ee9b38-0226-45c8-92d1-67246a90784c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:29.559211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-73fce261-587e-4d4e-8eee-682fc5c32bdf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:29.570191 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-73fce261-587e-4d4e-8eee-682fc5c32bdf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1094 microversion: 2.1 time: 0.166240 Aug 27 05:07:29.572272 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-94ee9b38-0226-45c8-92d1-67246a90784c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] HTTP exception thrown: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:29.572571 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2914/5879] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:29 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1094 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94ee9b38-0226-45c8-92d1-67246a90784c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Request method failure captured: Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 HTTP/1.1 Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaSjtKQ8CNr8ijhBpDj-EldUtAutdZu4lRoyWRJSbKIHJXnKqqOeGbCBFdWOZKopjq1IGLgQGFQNqz8sSUAQqx808Z7T-yWEwNxol6tWR3RDabS8xz0sm8_TchXJn0LJbdFaeJmZmmQTvO4payBl1yD5Yqrlhi3JSiB63gvuJdHxdCM Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 3d73cadd70ef45259dd85e6d59cbbab1 Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 3d73cadd70ef45259dd85e6d59cbbab1 Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeShelveTestJSON-1256848898-project Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: ec72122ff0b84c5fb558ca810ddd213d Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1256848898-project Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'bf34f382-9b01-4519-ba5f-78471ee22e32'} Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:29.574361 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:29.579063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:29.579063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:29.579063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:29.579063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:29.579063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:29.579063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:29.579063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. Aug 27 05:07:29.579063 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:29.579063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94ee9b38-0226-45c8-92d1-67246a90784c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Returning 404 to user: Instance bf34f382-9b01-4519-ba5f-78471ee22e32 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:29.579063 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94ee9b38-0226-45c8-92d1-67246a90784c tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32" status: 404 len: 111 microversion: 2.20 time: 0.048482 Aug 27 05:07:29.590797 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2966/5880] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:29 2022] GET /compute/v2.1/servers/bf34f382-9b01-4519-ba5f-78471ee22e32 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 05:07:30.337960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-07c53e94-3e0e-459f-aed8-3af6a21737c1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:30.340362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-07c53e94-3e0e-459f-aed8-3af6a21737c1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:30.351297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c53e94-3e0e-459f-aed8-3af6a21737c1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:30.352148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c53e94-3e0e-459f-aed8-3af6a21737c1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:30.353402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c53e94-3e0e-459f-aed8-3af6a21737c1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:30.354767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c53e94-3e0e-459f-aed8-3af6a21737c1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:30.355405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c53e94-3e0e-459f-aed8-3af6a21737c1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:30.356241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07c53e94-3e0e-459f-aed8-3af6a21737c1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:30.391681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=79 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:30.591418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5843ef4b-d2f4-44dd-b906-bc0a6736bc3b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:30.592097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5843ef4b-d2f4-44dd-b906-bc0a6736bc3b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:30.606669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5843ef4b-d2f4-44dd-b906-bc0a6736bc3b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:30.607114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5843ef4b-d2f4-44dd-b906-bc0a6736bc3b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:30.607578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5843ef4b-d2f4-44dd-b906-bc0a6736bc3b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:30.608328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5843ef4b-d2f4-44dd-b906-bc0a6736bc3b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:30.608840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5843ef4b-d2f4-44dd-b906-bc0a6736bc3b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:30.609291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5843ef4b-d2f4-44dd-b906-bc0a6736bc3b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:30.648430 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-07c53e94-3e0e-459f-aed8-3af6a21737c1 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e/action" status: 200 len: 24556 microversion: 2.1 time: 0.314232 Aug 27 05:07:30.649326 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2915/5881] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:07:30 2022] POST /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e/action => generated 24556 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:07:30.730583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5843ef4b-d2f4-44dd-b906-bc0a6736bc3b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:30.743318 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5843ef4b-d2f4-44dd-b906-bc0a6736bc3b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1192 microversion: 2.1 time: 0.155791 Aug 27 05:07:30.743942 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2967/5882] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:30 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1192 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:31.771105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f50e1293-592c-4c04-93e1-ee378d21477a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:31.777184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f50e1293-592c-4c04-93e1-ee378d21477a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:31.801055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f50e1293-592c-4c04-93e1-ee378d21477a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.810995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f50e1293-592c-4c04-93e1-ee378d21477a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.812276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f50e1293-592c-4c04-93e1-ee378d21477a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:31.813249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f50e1293-592c-4c04-93e1-ee378d21477a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:31.813920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f50e1293-592c-4c04-93e1-ee378d21477a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:31.814557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f50e1293-592c-4c04-93e1-ee378d21477a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:32.029751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f50e1293-592c-4c04-93e1-ee378d21477a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:32.042260 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f50e1293-592c-4c04-93e1-ee378d21477a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1210 microversion: 2.1 time: 0.280052 Aug 27 05:07:32.058522 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2916/5883] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:31 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1210 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:33.066844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d02e8580-a16b-4f56-bfec-0186f7b7962f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:33.067472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d02e8580-a16b-4f56-bfec-0186f7b7962f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:33.086652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d02e8580-a16b-4f56-bfec-0186f7b7962f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:33.088239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d02e8580-a16b-4f56-bfec-0186f7b7962f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:33.088239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d02e8580-a16b-4f56-bfec-0186f7b7962f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:33.091477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d02e8580-a16b-4f56-bfec-0186f7b7962f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:33.092215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d02e8580-a16b-4f56-bfec-0186f7b7962f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:33.093436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d02e8580-a16b-4f56-bfec-0186f7b7962f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:33.389110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d02e8580-a16b-4f56-bfec-0186f7b7962f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:33.405209 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d02e8580-a16b-4f56-bfec-0186f7b7962f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1277 microversion: 2.1 time: 0.340616 Aug 27 05:07:33.407047 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2968/5884] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:33 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1277 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:33.512404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-19a310ad-dcb4-42cb-9e4a-272c7574a583 req-6034014f-85cd-4ac0-9c4e-cff28c2ba66e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1de3f97-c882-44a1-bb4e-89e450bdb01e", "tag": "66099720-3a60-4878-a03f-475ad084c6d4"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:33.541001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-19a310ad-dcb4-42cb-9e4a-272c7574a583 req-6034014f-85cd-4ac0-9c4e-cff28c2ba66e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:33.542612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-19a310ad-dcb4-42cb-9e4a-272c7574a583 req-6034014f-85cd-4ac0-9c4e-cff28c2ba66e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:33.543498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-19a310ad-dcb4-42cb-9e4a-272c7574a583 req-6034014f-85cd-4ac0-9c4e-cff28c2ba66e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:33.581251 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-19a310ad-dcb4-42cb-9e4a-272c7574a583 req-6034014f-85cd-4ac0-9c4e-cff28c2ba66e service nova] Creating event network-changed:66099720-3a60-4878-a03f-475ad084c6d4 for instance d1de3f97-c882-44a1-bb4e-89e450bdb01e on n-h1-854823-1 Aug 27 05:07:33.591345 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-19a310ad-dcb4-42cb-9e4a-272c7574a583 req-6034014f-85cd-4ac0-9c4e-cff28c2ba66e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084525 Aug 27 05:07:33.598746 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2917/5885] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:34.130733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75d0f582-35e1-4231-bb3d-1676fb436f06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:34.131305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75d0f582-35e1-4231-bb3d-1676fb436f06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:34.135578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:34.141809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d0f582-35e1-4231-bb3d-1676fb436f06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:34.149936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d0f582-35e1-4231-bb3d-1676fb436f06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:34.153113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d0f582-35e1-4231-bb3d-1676fb436f06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:34.153935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d0f582-35e1-4231-bb3d-1676fb436f06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:34.154436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d0f582-35e1-4231-bb3d-1676fb436f06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:34.162087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d0f582-35e1-4231-bb3d-1676fb436f06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:34.181874 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-75d0f582-35e1-4231-bb3d-1676fb436f06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] HTTP exception thrown: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75d0f582-35e1-4231-bb3d-1676fb436f06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Request method failure captured: Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a HTTP/1.1 Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaSjtKQ8CNr8ijhBpDj-EldUtAutdZu4lRoyWRJSbKIHJXnKqqOeGbCBFdWOZKopjq1IGLgQGFQNqz8sSUAQqx808Z7T-yWEwNxol6tWR3RDabS8xz0sm8_TchXJn0LJbdFaeJmZmmQTvO4payBl1yD5Yqrlhi3JSiB63gvuJdHxdCM Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 3d73cadd70ef45259dd85e6d59cbbab1 Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 3d73cadd70ef45259dd85e6d59cbbab1 Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeShelveTestJSON-1256848898-project Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: ec72122ff0b84c5fb558ca810ddd213d Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1256848898-project Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '4fd1a40c-a36d-4253-9f1c-b5711b2ed52a'} Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:07:34.184721 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:34.190575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:07:34.190575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:34.190575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:34.190575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:34.190575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:34.190575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:34.190575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:34.190575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:34.190575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:34.190575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:07:34.190575 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:07:34.190575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75d0f582-35e1-4231-bb3d-1676fb436f06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Returning 404 to user: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:34.190575 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75d0f582-35e1-4231-bb3d-1676fb436f06 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 404 len: 111 microversion: 2.20 time: 0.068027 Aug 27 05:07:34.190575 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2969/5886] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 05:07:34 2022] DELETE /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:07:34.196134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fdca049c-6e0f-4273-9908-ded976d8a779 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:34.196972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fdca049c-6e0f-4273-9908-ded976d8a779 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] [instance: 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:34.204613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdca049c-6e0f-4273-9908-ded976d8a779 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:34.205101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdca049c-6e0f-4273-9908-ded976d8a779 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:34.206777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdca049c-6e0f-4273-9908-ded976d8a779 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:34.207823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdca049c-6e0f-4273-9908-ded976d8a779 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:34.210700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdca049c-6e0f-4273-9908-ded976d8a779 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:34.211249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fdca049c-6e0f-4273-9908-ded976d8a779 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:34.242442 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-fdca049c-6e0f-4273-9908-ded976d8a779 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] HTTP exception thrown: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fdca049c-6e0f-4273-9908-ded976d8a779 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Request method failure captured: Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a HTTP/1.1 Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaSjtKQ8CNr8ijhBpDj-EldUtAutdZu4lRoyWRJSbKIHJXnKqqOeGbCBFdWOZKopjq1IGLgQGFQNqz8sSUAQqx808Z7T-yWEwNxol6tWR3RDabS8xz0sm8_TchXJn0LJbdFaeJmZmmQTvO4payBl1yD5Yqrlhi3JSiB63gvuJdHxdCM Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 3d73cadd70ef45259dd85e6d59cbbab1 Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3d73cadd70ef45259dd85e6d59cbbab1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 3d73cadd70ef45259dd85e6d59cbbab1 Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1256848898 Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AttachVolumeShelveTestJSON-1256848898-project Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: ec72122ff0b84c5fb558ca810ddd213d Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1256848898-project Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '4fd1a40c-a36d-4253-9f1c-b5711b2ed52a'} Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:07:34.244179 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:07:34.249015 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:07:34.249015 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:07:34.249015 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:07:34.249015 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:07:34.249015 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:07:34.249015 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:07:34.249015 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. Aug 27 05:07:34.249015 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:07:34.249015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fdca049c-6e0f-4273-9908-ded976d8a779 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] Returning 404 to user: Instance 4fd1a40c-a36d-4253-9f1c-b5711b2ed52a could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:07:34.250052 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fdca049c-6e0f-4273-9908-ded976d8a779 tempest-AttachVolumeShelveTestJSON-1256848898 tempest-AttachVolumeShelveTestJSON-1256848898-project] 10.222.0.79 "GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a" status: 404 len: 111 microversion: 2.20 time: 0.057005 Aug 27 05:07:34.254302 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2918/5887] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:07:34 2022] GET /compute/v2.1/servers/4fd1a40c-a36d-4253-9f1c-b5711b2ed52a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:07:34.427811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a513ea0e-5b7f-407e-8989-e96224e44a88 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:34.428480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a513ea0e-5b7f-407e-8989-e96224e44a88 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:34.458715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a513ea0e-5b7f-407e-8989-e96224e44a88 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:34.459242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a513ea0e-5b7f-407e-8989-e96224e44a88 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:34.459833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a513ea0e-5b7f-407e-8989-e96224e44a88 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:34.465983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a513ea0e-5b7f-407e-8989-e96224e44a88 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:34.473544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a513ea0e-5b7f-407e-8989-e96224e44a88 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:34.473879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a513ea0e-5b7f-407e-8989-e96224e44a88 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:35.312586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a513ea0e-5b7f-407e-8989-e96224e44a88 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:35.331992 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a513ea0e-5b7f-407e-8989-e96224e44a88 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1277 microversion: 2.1 time: 0.910510 Aug 27 05:07:35.336379 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2970/5888] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:34 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1277 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:36.356296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e923ed6-5dfe-451e-850b-41d35b3c89ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:36.357187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3e923ed6-5dfe-451e-850b-41d35b3c89ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:36.371003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e923ed6-5dfe-451e-850b-41d35b3c89ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:36.374129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e923ed6-5dfe-451e-850b-41d35b3c89ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:36.374721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e923ed6-5dfe-451e-850b-41d35b3c89ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:36.377831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e923ed6-5dfe-451e-850b-41d35b3c89ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:36.378915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e923ed6-5dfe-451e-850b-41d35b3c89ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:36.379459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e923ed6-5dfe-451e-850b-41d35b3c89ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:36.635365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3e923ed6-5dfe-451e-850b-41d35b3c89ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:36.649523 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3e923ed6-5dfe-451e-850b-41d35b3c89ad tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1277 microversion: 2.1 time: 0.295784 Aug 27 05:07:36.664595 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2919/5889] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:36 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1277 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:37.671466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c015a7a3-88f2-46ea-b01d-d024ddbb2441 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:37.672364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c015a7a3-88f2-46ea-b01d-d024ddbb2441 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:37.681601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c015a7a3-88f2-46ea-b01d-d024ddbb2441 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:37.682523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c015a7a3-88f2-46ea-b01d-d024ddbb2441 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:37.683149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c015a7a3-88f2-46ea-b01d-d024ddbb2441 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:37.684085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c015a7a3-88f2-46ea-b01d-d024ddbb2441 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:37.684611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c015a7a3-88f2-46ea-b01d-d024ddbb2441 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:37.685247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c015a7a3-88f2-46ea-b01d-d024ddbb2441 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:38.026812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c015a7a3-88f2-46ea-b01d-d024ddbb2441 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:38.040511 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c015a7a3-88f2-46ea-b01d-d024ddbb2441 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1277 microversion: 2.1 time: 0.372924 Aug 27 05:07:38.053823 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2971/5890] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:37 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1277 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:39.066399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c6a32be6-276d-400e-9fc3-0a2f9a758dd8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:39.067015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c6a32be6-276d-400e-9fc3-0a2f9a758dd8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:39.077406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6a32be6-276d-400e-9fc3-0a2f9a758dd8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:39.078553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6a32be6-276d-400e-9fc3-0a2f9a758dd8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:39.079520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6a32be6-276d-400e-9fc3-0a2f9a758dd8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:39.080732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6a32be6-276d-400e-9fc3-0a2f9a758dd8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:39.081534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6a32be6-276d-400e-9fc3-0a2f9a758dd8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:39.082134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6a32be6-276d-400e-9fc3-0a2f9a758dd8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:39.371052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c6a32be6-276d-400e-9fc3-0a2f9a758dd8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:39.383706 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c6a32be6-276d-400e-9fc3-0a2f9a758dd8 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1265 microversion: 2.1 time: 0.320896 Aug 27 05:07:39.384962 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2920/5891] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:39 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:40.405779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f82705f-c24e-4b6a-ad91-21d7a6902baf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:40.406667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f82705f-c24e-4b6a-ad91-21d7a6902baf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:40.409473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:40.410429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:40.416257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f82705f-c24e-4b6a-ad91-21d7a6902baf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:40.417083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f82705f-c24e-4b6a-ad91-21d7a6902baf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:40.417746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f82705f-c24e-4b6a-ad91-21d7a6902baf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:40.418690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f82705f-c24e-4b6a-ad91-21d7a6902baf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:40.419350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f82705f-c24e-4b6a-ad91-21d7a6902baf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:40.419973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f82705f-c24e-4b6a-ad91-21d7a6902baf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:40.446773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:40.600963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f82705f-c24e-4b6a-ad91-21d7a6902baf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:40.611568 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f82705f-c24e-4b6a-ad91-21d7a6902baf tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1265 microversion: 2.1 time: 0.209976 Aug 27 05:07:40.626969 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2972/5892] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:40 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:41.635511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1a1b346f-da4d-45d5-ab2d-c0e57cbfe0f9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:41.636220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1a1b346f-da4d-45d5-ab2d-c0e57cbfe0f9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:41.638364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:41.650682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a1b346f-da4d-45d5-ab2d-c0e57cbfe0f9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:41.653593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a1b346f-da4d-45d5-ab2d-c0e57cbfe0f9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:41.654283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a1b346f-da4d-45d5-ab2d-c0e57cbfe0f9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:41.655370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a1b346f-da4d-45d5-ab2d-c0e57cbfe0f9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:41.657804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a1b346f-da4d-45d5-ab2d-c0e57cbfe0f9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:41.659063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a1b346f-da4d-45d5-ab2d-c0e57cbfe0f9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:41.899777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1a1b346f-da4d-45d5-ab2d-c0e57cbfe0f9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:41.913835 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1a1b346f-da4d-45d5-ab2d-c0e57cbfe0f9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1265 microversion: 2.1 time: 0.279049 Aug 27 05:07:41.926763 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2921/5893] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:41 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:42.935071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c05516e-27ef-41f4-9485-aceb21bcfad9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:42.935611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c05516e-27ef-41f4-9485-aceb21bcfad9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:42.949283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c05516e-27ef-41f4-9485-aceb21bcfad9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:42.949805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c05516e-27ef-41f4-9485-aceb21bcfad9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:42.953822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c05516e-27ef-41f4-9485-aceb21bcfad9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:42.955987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c05516e-27ef-41f4-9485-aceb21bcfad9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:42.956506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c05516e-27ef-41f4-9485-aceb21bcfad9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:42.956999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c05516e-27ef-41f4-9485-aceb21bcfad9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:43.403077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c05516e-27ef-41f4-9485-aceb21bcfad9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:43.419944 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c05516e-27ef-41f4-9485-aceb21bcfad9 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1265 microversion: 2.1 time: 0.488805 Aug 27 05:07:43.420820 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2973/5894] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:42 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1265 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:44.442063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef6b0712-40b8-4845-9856-af6165ebeeac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:44.442686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ef6b0712-40b8-4845-9856-af6165ebeeac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:44.457652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef6b0712-40b8-4845-9856-af6165ebeeac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:44.458509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef6b0712-40b8-4845-9856-af6165ebeeac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:44.460737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef6b0712-40b8-4845-9856-af6165ebeeac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:44.461880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef6b0712-40b8-4845-9856-af6165ebeeac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:44.462980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef6b0712-40b8-4845-9856-af6165ebeeac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:44.463643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef6b0712-40b8-4845-9856-af6165ebeeac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:44.839608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef6b0712-40b8-4845-9856-af6165ebeeac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:44.869958 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ef6b0712-40b8-4845-9856-af6165ebeeac tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1265 microversion: 2.1 time: 0.414812 Aug 27 05:07:44.884381 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2922/5895] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:44 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1265 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:45.893166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d3d7fe1-4c95-4af3-933b-fbac00cf38e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:45.893862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d3d7fe1-4c95-4af3-933b-fbac00cf38e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:45.904406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d3d7fe1-4c95-4af3-933b-fbac00cf38e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:45.904955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d3d7fe1-4c95-4af3-933b-fbac00cf38e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:45.905413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d3d7fe1-4c95-4af3-933b-fbac00cf38e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:45.906142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d3d7fe1-4c95-4af3-933b-fbac00cf38e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:45.908582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d3d7fe1-4c95-4af3-933b-fbac00cf38e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:45.909772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d3d7fe1-4c95-4af3-933b-fbac00cf38e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:46.195518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d3d7fe1-4c95-4af3-933b-fbac00cf38e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:46.204201 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d3d7fe1-4c95-4af3-933b-fbac00cf38e3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1265 microversion: 2.1 time: 0.316716 Aug 27 05:07:46.208813 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2974/5896] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:45 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:46.788461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-45c5b680-c8d8-499f-9266-c936e4585197 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Action: 'create', calling method: .version_select at 0x7f1f21572e50>, body: {"keypair": {"name": "tempest-keypair-717512700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/Mb2Y7MKNbLeXJtttsoLMaX9JWwIiBI40Vn8bq4s/nCRqx8ioQMcXxacMTntaIRBfJQLKBhb9azJoizHzf+PPhS0JNncPjvWGBHgnHCm+TESN2Gbf3GRx6x1Hmuq8MYA=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:46.802415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a66999b4-97fa-4823-8e13-325b718bf6ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:46.803589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a66999b4-97fa-4823-8e13-325b718bf6ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:46.813474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a66999b4-97fa-4823-8e13-325b718bf6ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:46.813992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a66999b4-97fa-4823-8e13-325b718bf6ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:46.814576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a66999b4-97fa-4823-8e13-325b718bf6ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:46.815503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a66999b4-97fa-4823-8e13-325b718bf6ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:46.820889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a66999b4-97fa-4823-8e13-325b718bf6ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:46.823098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a66999b4-97fa-4823-8e13-325b718bf6ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:46.835474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-45c5b680-c8d8-499f-9266-c936e4585197 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:07:46.843254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-45c5b680-c8d8-499f-9266-c936e4585197 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for user dc1b938c06bd432496e8ae8b24965678 and project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:07:46.895583 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-45c5b680-c8d8-499f-9266-c936e4585197 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.305313 Aug 27 05:07:46.900991 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2923/5897] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:07:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:47.073447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a66999b4-97fa-4823-8e13-325b718bf6ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:47.090676 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a66999b4-97fa-4823-8e13-325b718bf6ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.292788 Aug 27 05:07:47.091864 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2975/5898] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:46 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:47.113690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb67793f-aa79-4466-ae51-8c9204db826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:47.118105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eb67793f-aa79-4466-ae51-8c9204db826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:47.125680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb67793f-aa79-4466-ae51-8c9204db826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:47.126444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb67793f-aa79-4466-ae51-8c9204db826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:47.127093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb67793f-aa79-4466-ae51-8c9204db826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:47.128212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb67793f-aa79-4466-ae51-8c9204db826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:47.128882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb67793f-aa79-4466-ae51-8c9204db826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:47.129510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb67793f-aa79-4466-ae51-8c9204db826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:47.235662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83f46f5b-6219-4954-95c0-21c7ea3543fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:47.236716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-83f46f5b-6219-4954-95c0-21c7ea3543fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:47.245446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83f46f5b-6219-4954-95c0-21c7ea3543fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:47.246496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83f46f5b-6219-4954-95c0-21c7ea3543fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:47.247476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83f46f5b-6219-4954-95c0-21c7ea3543fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:47.248997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83f46f5b-6219-4954-95c0-21c7ea3543fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:47.250158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83f46f5b-6219-4954-95c0-21c7ea3543fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:47.250864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83f46f5b-6219-4954-95c0-21c7ea3543fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:47.445637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb67793f-aa79-4466-ae51-8c9204db826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:47.450559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83f46f5b-6219-4954-95c0-21c7ea3543fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:47.463403 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83f46f5b-6219-4954-95c0-21c7ea3543fe tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1265 microversion: 2.1 time: 0.232437 Aug 27 05:07:47.465057 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2976/5899] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:47 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:47.469368 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb67793f-aa79-4466-ae51-8c9204db826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.360218 Aug 27 05:07:47.470758 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2924/5900] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:47 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:47.503321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c0dc0ded-0870-4c82-a3dc-521dc985d978 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:47.504449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c0dc0ded-0870-4c82-a3dc-521dc985d978 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:47.513102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0dc0ded-0870-4c82-a3dc-521dc985d978 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:47.516404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0dc0ded-0870-4c82-a3dc-521dc985d978 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:47.517173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0dc0ded-0870-4c82-a3dc-521dc985d978 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:47.518998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0dc0ded-0870-4c82-a3dc-521dc985d978 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:47.519941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0dc0ded-0870-4c82-a3dc-521dc985d978 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:47.520629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0dc0ded-0870-4c82-a3dc-521dc985d978 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:47.714945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c0dc0ded-0870-4c82-a3dc-521dc985d978 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:47.733366 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c0dc0ded-0870-4c82-a3dc-521dc985d978 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.235351 Aug 27 05:07:47.734510 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2977/5901] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:47 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:47.760112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c095ead-490e-4345-ba4d-45fa5e8048e8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-492083724"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:47.762759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4c095ead-490e-4345-ba4d-45fa5e8048e8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:47.770341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c095ead-490e-4345-ba4d-45fa5e8048e8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:47.771137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c095ead-490e-4345-ba4d-45fa5e8048e8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:47.771579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c095ead-490e-4345-ba4d-45fa5e8048e8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:47.773042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c095ead-490e-4345-ba4d-45fa5e8048e8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:47.773505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c095ead-490e-4345-ba4d-45fa5e8048e8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:47.773937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c095ead-490e-4345-ba4d-45fa5e8048e8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:48.218775 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4c095ead-490e-4345-ba4d-45fa5e8048e8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.464417 Aug 27 05:07:48.219793 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2925/5902] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:07:47 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 05:07:48.486658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e308d0b5-98ae-4a28-bf8b-712ec26487c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:48.488160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e308d0b5-98ae-4a28-bf8b-712ec26487c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:48.511226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e308d0b5-98ae-4a28-bf8b-712ec26487c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:48.517714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e308d0b5-98ae-4a28-bf8b-712ec26487c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:48.518714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e308d0b5-98ae-4a28-bf8b-712ec26487c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:48.520473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e308d0b5-98ae-4a28-bf8b-712ec26487c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:48.528825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e308d0b5-98ae-4a28-bf8b-712ec26487c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:48.530027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e308d0b5-98ae-4a28-bf8b-712ec26487c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:48.973665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e308d0b5-98ae-4a28-bf8b-712ec26487c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:48.988560 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e308d0b5-98ae-4a28-bf8b-712ec26487c6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1265 microversion: 2.1 time: 0.507083 Aug 27 05:07:48.989498 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2978/5903] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:48 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1265 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:49.451948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-206251017", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d0ae2b2-26fa-4f3d-bb3c-eb9fbaada560"}], "security_groups": [{"name": "tempest-securitygroup--1934685603"}], "key_name": "tempest-keypair-717512700", "user_data": "}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:49.642560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] validate_networks() for [('1d0ae2b2-26fa-4f3d-bb3c-eb9fbaada560', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:07:49.698534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-98bfe80c-8e3d-4d7a-a8fd-5b5adbe1d0fb req-ec6e21cf-1cbe-4654-858a-96af02234190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1de3f97-c882-44a1-bb4e-89e450bdb01e", "name": "network-vif-plugged", "status": "completed", "tag": "66099720-3a60-4878-a03f-475ad084c6d4"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:49.713894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-98bfe80c-8e3d-4d7a-a8fd-5b5adbe1d0fb req-ec6e21cf-1cbe-4654-858a-96af02234190 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:49.715701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-98bfe80c-8e3d-4d7a-a8fd-5b5adbe1d0fb req-ec6e21cf-1cbe-4654-858a-96af02234190 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:49.716367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-98bfe80c-8e3d-4d7a-a8fd-5b5adbe1d0fb req-ec6e21cf-1cbe-4654-858a-96af02234190 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:49.735564 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-98bfe80c-8e3d-4d7a-a8fd-5b5adbe1d0fb req-ec6e21cf-1cbe-4654-858a-96af02234190 service nova] Creating event network-vif-plugged:66099720-3a60-4878-a03f-475ad084c6d4 for instance d1de3f97-c882-44a1-bb4e-89e450bdb01e on n-h1-854823-1 Aug 27 05:07:49.754049 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-98bfe80c-8e3d-4d7a-a8fd-5b5adbe1d0fb req-ec6e21cf-1cbe-4654-858a-96af02234190 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061051 Aug 27 05:07:49.755165 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2979/5904] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:07:50.012546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f4a4a79f-6d59-4d39-8808-cd7267c6a643 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:50.013590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f4a4a79f-6d59-4d39-8808-cd7267c6a643 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:50.027888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4a4a79f-6d59-4d39-8808-cd7267c6a643 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:50.028406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4a4a79f-6d59-4d39-8808-cd7267c6a643 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:50.028994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4a4a79f-6d59-4d39-8808-cd7267c6a643 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:50.029739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4a4a79f-6d59-4d39-8808-cd7267c6a643 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:50.030221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4a4a79f-6d59-4d39-8808-cd7267c6a643 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:50.030731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4a4a79f-6d59-4d39-8808-cd7267c6a643 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:50.323931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f4a4a79f-6d59-4d39-8808-cd7267c6a643 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:50.346054 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f4a4a79f-6d59-4d39-8808-cd7267c6a643 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1265 microversion: 2.1 time: 0.338010 Aug 27 05:07:50.361466 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2980/5905] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:50 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:50.883358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:07:50.883888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:07:50.890033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:07:50.891013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:07:50.891663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:07:50.908996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:50.909887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:50.911153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:50.913725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:50.915812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:50.917082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:50.952758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:07:50.962450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for user dc1b938c06bd432496e8ae8b24965678 and project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:07:50.982752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:07:50.986856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:07:51.089511 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7da9e00d-1adf-4754-8899-2552e1f79bca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.642169 Aug 27 05:07:51.092243 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2926/5906] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:07:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:07:51.103304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-939ffcdf-5645-4b55-8cde-df7c5240a8ff tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:51.103935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-939ffcdf-5645-4b55-8cde-df7c5240a8ff tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:51.256304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-939ffcdf-5645-4b55-8cde-df7c5240a8ff tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:51.268959 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-939ffcdf-5645-4b55-8cde-df7c5240a8ff tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1240 microversion: 2.1 time: 0.169227 Aug 27 05:07:51.272713 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2981/5907] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:51 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1240 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:51.370278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0ede6b44-84ef-4e86-880e-aa7061bcaf77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:51.371176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0ede6b44-84ef-4e86-880e-aa7061bcaf77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:51.390329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ede6b44-84ef-4e86-880e-aa7061bcaf77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:51.393618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ede6b44-84ef-4e86-880e-aa7061bcaf77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:51.395245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ede6b44-84ef-4e86-880e-aa7061bcaf77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:51.398054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ede6b44-84ef-4e86-880e-aa7061bcaf77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:51.399995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ede6b44-84ef-4e86-880e-aa7061bcaf77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:51.401217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ede6b44-84ef-4e86-880e-aa7061bcaf77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:51.734112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0ede6b44-84ef-4e86-880e-aa7061bcaf77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:51.743927 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0ede6b44-84ef-4e86-880e-aa7061bcaf77 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1265 microversion: 2.1 time: 0.378044 Aug 27 05:07:51.751690 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2927/5908] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:51 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1265 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:52.291453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e2075bdc-f753-4542-90bc-98c7298f854e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:52.292089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e2075bdc-f753-4542-90bc-98c7298f854e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:52.325761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2075bdc-f753-4542-90bc-98c7298f854e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.326318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2075bdc-f753-4542-90bc-98c7298f854e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.326809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2075bdc-f753-4542-90bc-98c7298f854e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.327556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2075bdc-f753-4542-90bc-98c7298f854e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.328041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2075bdc-f753-4542-90bc-98c7298f854e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.328487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2075bdc-f753-4542-90bc-98c7298f854e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.537686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e2075bdc-f753-4542-90bc-98c7298f854e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:52.547626 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e2075bdc-f753-4542-90bc-98c7298f854e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1244 microversion: 2.1 time: 0.260654 Aug 27 05:07:52.548230 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2982/5909] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:52 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1244 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:52.698413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-dd88e651-97b9-4203-92ba-c3dcf1bb78b8 req-dd9e174c-5c52-4265-8ea3-8cac7d63ab15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f54d929-acc6-47f3-96a7-708032ccd9d9", "name": "network-vif-plugged", "status": "completed", "tag": "060a48ca-cf07-4257-8892-27d740101396"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:52.743973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-dd88e651-97b9-4203-92ba-c3dcf1bb78b8 req-dd9e174c-5c52-4265-8ea3-8cac7d63ab15 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.749057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-dd88e651-97b9-4203-92ba-c3dcf1bb78b8 req-dd9e174c-5c52-4265-8ea3-8cac7d63ab15 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.749605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-dd88e651-97b9-4203-92ba-c3dcf1bb78b8 req-dd9e174c-5c52-4265-8ea3-8cac7d63ab15 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.767081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9b1a959a-276e-44e5-a632-384baad9c721 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:52.768263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9b1a959a-276e-44e5-a632-384baad9c721 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:52.778036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b1a959a-276e-44e5-a632-384baad9c721 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.778892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b1a959a-276e-44e5-a632-384baad9c721 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.779603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b1a959a-276e-44e5-a632-384baad9c721 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.781532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b1a959a-276e-44e5-a632-384baad9c721 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:52.782491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b1a959a-276e-44e5-a632-384baad9c721 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:52.783188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b1a959a-276e-44e5-a632-384baad9c721 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:52.817625 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-dd88e651-97b9-4203-92ba-c3dcf1bb78b8 req-dd9e174c-5c52-4265-8ea3-8cac7d63ab15 service nova] Creating event network-vif-plugged:060a48ca-cf07-4257-8892-27d740101396 for instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 on n-h2-854823-1 Aug 27 05:07:52.831773 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-dd88e651-97b9-4203-92ba-c3dcf1bb78b8 req-dd9e174c-5c52-4265-8ea3-8cac7d63ab15 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137905 Aug 27 05:07:52.833103 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2928/5910] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:53.083347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b1a959a-276e-44e5-a632-384baad9c721 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:53.097471 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9b1a959a-276e-44e5-a632-384baad9c721 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1452 microversion: 2.1 time: 0.334537 Aug 27 05:07:53.098486 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2983/5911] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:52 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1452 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:07:53.130758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5b20c20d-6745-4f9b-95a2-47e88e320f79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:53.131594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5b20c20d-6745-4f9b-95a2-47e88e320f79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:53.149756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b20c20d-6745-4f9b-95a2-47e88e320f79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:53.153125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b20c20d-6745-4f9b-95a2-47e88e320f79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:53.153571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b20c20d-6745-4f9b-95a2-47e88e320f79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:53.157644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b20c20d-6745-4f9b-95a2-47e88e320f79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:53.158440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b20c20d-6745-4f9b-95a2-47e88e320f79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:53.160433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b20c20d-6745-4f9b-95a2-47e88e320f79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:53.545209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5b20c20d-6745-4f9b-95a2-47e88e320f79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:53.556070 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5b20c20d-6745-4f9b-95a2-47e88e320f79 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1452 microversion: 2.1 time: 0.432109 Aug 27 05:07:53.578008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-098638d1-3c93-4308-b593-240dd2169dd1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:53.580499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-098638d1-3c93-4308-b593-240dd2169dd1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:53.594349 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2929/5912] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:53 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1452 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:53.596938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-098638d1-3c93-4308-b593-240dd2169dd1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:53.597652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-098638d1-3c93-4308-b593-240dd2169dd1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:53.598339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-098638d1-3c93-4308-b593-240dd2169dd1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:53.599237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-098638d1-3c93-4308-b593-240dd2169dd1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:53.600016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-098638d1-3c93-4308-b593-240dd2169dd1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:53.600661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-098638d1-3c93-4308-b593-240dd2169dd1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:53.758640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-098638d1-3c93-4308-b593-240dd2169dd1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:53.784805 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-098638d1-3c93-4308-b593-240dd2169dd1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1298 microversion: 2.1 time: 0.203362 Aug 27 05:07:53.785481 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2984/5913] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:53 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1298 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:54.807351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0b32cd3a-1711-4dde-857d-fff67643e06f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:54.808144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0b32cd3a-1711-4dde-857d-fff67643e06f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:54.820355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b32cd3a-1711-4dde-857d-fff67643e06f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:54.824337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b32cd3a-1711-4dde-857d-fff67643e06f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:54.824912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b32cd3a-1711-4dde-857d-fff67643e06f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:54.825738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b32cd3a-1711-4dde-857d-fff67643e06f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:54.826281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b32cd3a-1711-4dde-857d-fff67643e06f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:54.826789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b32cd3a-1711-4dde-857d-fff67643e06f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:55.244712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0b32cd3a-1711-4dde-857d-fff67643e06f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:55.258052 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0b32cd3a-1711-4dde-857d-fff67643e06f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1366 microversion: 2.1 time: 0.455415 Aug 27 05:07:55.261076 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2930/5914] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:54 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1366 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:56.279336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2312f62-5609-4207-8e97-a3d7d27cc122 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:56.279965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2312f62-5609-4207-8e97-a3d7d27cc122 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:56.293211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2312f62-5609-4207-8e97-a3d7d27cc122 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:56.293938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2312f62-5609-4207-8e97-a3d7d27cc122 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:56.294254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2312f62-5609-4207-8e97-a3d7d27cc122 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:56.294975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2312f62-5609-4207-8e97-a3d7d27cc122 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:56.295705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2312f62-5609-4207-8e97-a3d7d27cc122 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:56.301395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2312f62-5609-4207-8e97-a3d7d27cc122 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:56.563745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2312f62-5609-4207-8e97-a3d7d27cc122 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:56.575745 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2312f62-5609-4207-8e97-a3d7d27cc122 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1366 microversion: 2.1 time: 0.300230 Aug 27 05:07:56.576679 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2985/5915] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:56 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:57.200561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-85978561-7513-425c-9a5f-146edf151c5a req-6a3a8881-97a9-4539-ae53-84b17fc930cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1fdabdb-6353-46ce-9239-bc41ad53212e", "tag": "c9df8fc7-dcb3-4177-af25-45f0708c8a3b"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:57.225447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-85978561-7513-425c-9a5f-146edf151c5a req-6a3a8881-97a9-4539-ae53-84b17fc930cc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:57.229094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-85978561-7513-425c-9a5f-146edf151c5a req-6a3a8881-97a9-4539-ae53-84b17fc930cc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:57.231842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-85978561-7513-425c-9a5f-146edf151c5a req-6a3a8881-97a9-4539-ae53-84b17fc930cc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:57.253837 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-85978561-7513-425c-9a5f-146edf151c5a req-6a3a8881-97a9-4539-ae53-84b17fc930cc service nova] Creating event network-changed:c9df8fc7-dcb3-4177-af25-45f0708c8a3b for instance d1fdabdb-6353-46ce-9239-bc41ad53212e on n-h1-854823-1 Aug 27 05:07:57.260379 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-85978561-7513-425c-9a5f-146edf151c5a req-6a3a8881-97a9-4539-ae53-84b17fc930cc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065024 Aug 27 05:07:57.261415 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2931/5916] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:07:57.602187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd3d72ab-6cef-486e-a569-b91465aa741e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:57.604136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd3d72ab-6cef-486e-a569-b91465aa741e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:57.618216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd3d72ab-6cef-486e-a569-b91465aa741e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:57.620168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd3d72ab-6cef-486e-a569-b91465aa741e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:57.620934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd3d72ab-6cef-486e-a569-b91465aa741e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:57.621903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd3d72ab-6cef-486e-a569-b91465aa741e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:57.622596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd3d72ab-6cef-486e-a569-b91465aa741e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:57.623614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd3d72ab-6cef-486e-a569-b91465aa741e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:57.860314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bd3d72ab-6cef-486e-a569-b91465aa741e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:57.869547 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd3d72ab-6cef-486e-a569-b91465aa741e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1366 microversion: 2.1 time: 0.274375 Aug 27 05:07:57.886756 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2986/5917] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:57 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:58.899127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-80a408e4-eed9-44e5-86a9-35d9576691fc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:07:58.899947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-80a408e4-eed9-44e5-86a9-35d9576691fc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:07:58.906888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:58.918111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80a408e4-eed9-44e5-86a9-35d9576691fc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:58.918740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80a408e4-eed9-44e5-86a9-35d9576691fc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:58.919169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80a408e4-eed9-44e5-86a9-35d9576691fc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:58.923147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80a408e4-eed9-44e5-86a9-35d9576691fc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:58.925891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80a408e4-eed9-44e5-86a9-35d9576691fc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:58.928691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-80a408e4-eed9-44e5-86a9-35d9576691fc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:59.097108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-80a408e4-eed9-44e5-86a9-35d9576691fc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:07:59.107195 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-80a408e4-eed9-44e5-86a9-35d9576691fc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1366 microversion: 2.1 time: 0.217116 Aug 27 05:07:59.121538 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2932/5918] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:07:58 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:07:59.321088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-93b2edfc-6c00-4623-b0c8-ef88a0c87435 req-0622f3fb-9511-4ae3-be94-434d2e8065a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1de3f97-c882-44a1-bb4e-89e450bdb01e", "tag": "66099720-3a60-4878-a03f-475ad084c6d4"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:07:59.348052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-93b2edfc-6c00-4623-b0c8-ef88a0c87435 req-0622f3fb-9511-4ae3-be94-434d2e8065a2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:07:59.349008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-93b2edfc-6c00-4623-b0c8-ef88a0c87435 req-0622f3fb-9511-4ae3-be94-434d2e8065a2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:07:59.350551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-93b2edfc-6c00-4623-b0c8-ef88a0c87435 req-0622f3fb-9511-4ae3-be94-434d2e8065a2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:07:59.367998 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-93b2edfc-6c00-4623-b0c8-ef88a0c87435 req-0622f3fb-9511-4ae3-be94-434d2e8065a2 service nova] Creating event network-changed:66099720-3a60-4878-a03f-475ad084c6d4 for instance d1de3f97-c882-44a1-bb4e-89e450bdb01e on n-h1-854823-1 Aug 27 05:07:59.375898 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-93b2edfc-6c00-4623-b0c8-ef88a0c87435 req-0622f3fb-9511-4ae3-be94-434d2e8065a2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059235 Aug 27 05:07:59.377478 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2987/5919] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:08:00.131039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ac65fc40-867b-406a-9bad-40120ca60ed4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:00.132300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ac65fc40-867b-406a-9bad-40120ca60ed4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:00.139963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac65fc40-867b-406a-9bad-40120ca60ed4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:00.141175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac65fc40-867b-406a-9bad-40120ca60ed4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:00.141907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac65fc40-867b-406a-9bad-40120ca60ed4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:00.142819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac65fc40-867b-406a-9bad-40120ca60ed4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:00.143496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac65fc40-867b-406a-9bad-40120ca60ed4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:00.144740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac65fc40-867b-406a-9bad-40120ca60ed4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:00.315331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac65fc40-867b-406a-9bad-40120ca60ed4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:00.324434 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ac65fc40-867b-406a-9bad-40120ca60ed4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1366 microversion: 2.1 time: 0.198474 Aug 27 05:08:00.325887 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2933/5920] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:00 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:01.347550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a34bbf8-45f7-46bf-8c04-938f63c93c96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:01.349118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a34bbf8-45f7-46bf-8c04-938f63c93c96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:01.355652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:01.363517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a34bbf8-45f7-46bf-8c04-938f63c93c96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:01.364487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a34bbf8-45f7-46bf-8c04-938f63c93c96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:01.365280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a34bbf8-45f7-46bf-8c04-938f63c93c96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:01.366977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a34bbf8-45f7-46bf-8c04-938f63c93c96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:01.367691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a34bbf8-45f7-46bf-8c04-938f63c93c96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:01.371565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a34bbf8-45f7-46bf-8c04-938f63c93c96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:01.543907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a34bbf8-45f7-46bf-8c04-938f63c93c96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:01.554574 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a34bbf8-45f7-46bf-8c04-938f63c93c96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1366 microversion: 2.1 time: 0.212818 Aug 27 05:08:01.555534 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2988/5921] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:01 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:02.578767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:02.579822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=10 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:02.585683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-10d75b4b-4062-4dcd-93e0-2fbc11f54338 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:02.588967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-10d75b4b-4062-4dcd-93e0-2fbc11f54338 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:02.600685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10d75b4b-4062-4dcd-93e0-2fbc11f54338 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:02.604711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10d75b4b-4062-4dcd-93e0-2fbc11f54338 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:02.605458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10d75b4b-4062-4dcd-93e0-2fbc11f54338 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:02.606403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10d75b4b-4062-4dcd-93e0-2fbc11f54338 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:02.606926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10d75b4b-4062-4dcd-93e0-2fbc11f54338 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:02.609781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10d75b4b-4062-4dcd-93e0-2fbc11f54338 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:02.624651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:02.967010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10d75b4b-4062-4dcd-93e0-2fbc11f54338 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:02.981498 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-10d75b4b-4062-4dcd-93e0-2fbc11f54338 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1366 microversion: 2.1 time: 0.403334 Aug 27 05:08:02.984455 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2934/5922] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:02 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1366 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:04.008659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bb68321-63e9-42fe-bfa5-958a4372d547 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:04.009929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0bb68321-63e9-42fe-bfa5-958a4372d547 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:04.017995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb68321-63e9-42fe-bfa5-958a4372d547 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:04.018514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb68321-63e9-42fe-bfa5-958a4372d547 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:04.018969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb68321-63e9-42fe-bfa5-958a4372d547 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:04.019711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb68321-63e9-42fe-bfa5-958a4372d547 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:04.020191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb68321-63e9-42fe-bfa5-958a4372d547 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:04.020662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb68321-63e9-42fe-bfa5-958a4372d547 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:04.277923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0bb68321-63e9-42fe-bfa5-958a4372d547 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:04.292347 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0bb68321-63e9-42fe-bfa5-958a4372d547 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1366 microversion: 2.1 time: 0.288607 Aug 27 05:08:04.294236 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2989/5923] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:04 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:05.325431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c30c321b-f16f-4eac-94a0-9010725c372d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:05.328901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c30c321b-f16f-4eac-94a0-9010725c372d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:05.337988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c30c321b-f16f-4eac-94a0-9010725c372d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:05.338852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c30c321b-f16f-4eac-94a0-9010725c372d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:05.339324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c30c321b-f16f-4eac-94a0-9010725c372d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:05.340410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c30c321b-f16f-4eac-94a0-9010725c372d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:05.341129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c30c321b-f16f-4eac-94a0-9010725c372d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:05.341638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c30c321b-f16f-4eac-94a0-9010725c372d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:05.536452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c30c321b-f16f-4eac-94a0-9010725c372d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:05.548339 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c30c321b-f16f-4eac-94a0-9010725c372d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1366 microversion: 2.1 time: 0.236296 Aug 27 05:08:05.554318 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2935/5924] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:05 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:05.920420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-42370283-a25d-4a0c-824c-565c3fcf67b6 req-33f3999b-5999-417a-9257-b46ec1ba3be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fdabdb-6353-46ce-9239-bc41ad53212e", "name": "network-vif-plugged", "status": "completed", "tag": "c9df8fc7-dcb3-4177-af25-45f0708c8a3b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:05.932874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=44 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:05.935491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42370283-a25d-4a0c-824c-565c3fcf67b6 req-33f3999b-5999-417a-9257-b46ec1ba3be3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:05.936135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42370283-a25d-4a0c-824c-565c3fcf67b6 req-33f3999b-5999-417a-9257-b46ec1ba3be3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:05.937052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42370283-a25d-4a0c-824c-565c3fcf67b6 req-33f3999b-5999-417a-9257-b46ec1ba3be3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:05.953332 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-42370283-a25d-4a0c-824c-565c3fcf67b6 req-33f3999b-5999-417a-9257-b46ec1ba3be3 service nova] Creating event network-vif-plugged:c9df8fc7-dcb3-4177-af25-45f0708c8a3b for instance d1fdabdb-6353-46ce-9239-bc41ad53212e on n-h1-854823-1 Aug 27 05:08:05.959821 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-42370283-a25d-4a0c-824c-565c3fcf67b6 req-33f3999b-5999-417a-9257-b46ec1ba3be3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042397 Aug 27 05:08:05.960950 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2990/5925] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:06.570331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-94428f21-867e-427f-a857-d20ca121e7d0 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:06.571019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-94428f21-867e-427f-a857-d20ca121e7d0 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:06.577870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94428f21-867e-427f-a857-d20ca121e7d0 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:06.578357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94428f21-867e-427f-a857-d20ca121e7d0 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:06.578801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94428f21-867e-427f-a857-d20ca121e7d0 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:06.579509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94428f21-867e-427f-a857-d20ca121e7d0 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:06.579958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94428f21-867e-427f-a857-d20ca121e7d0 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:06.580411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94428f21-867e-427f-a857-d20ca121e7d0 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:06.723762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-94428f21-867e-427f-a857-d20ca121e7d0 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:06.731608 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-94428f21-867e-427f-a857-d20ca121e7d0 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1366 microversion: 2.1 time: 0.165216 Aug 27 05:08:06.732181 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2936/5926] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:06 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:07.007391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-16b56c17-4ec4-408f-ac5c-5a0c2799b4c0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:07.008139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-16b56c17-4ec4-408f-ac5c-5a0c2799b4c0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:07.014783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16b56c17-4ec4-408f-ac5c-5a0c2799b4c0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.015458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16b56c17-4ec4-408f-ac5c-5a0c2799b4c0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.015987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16b56c17-4ec4-408f-ac5c-5a0c2799b4c0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.016885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16b56c17-4ec4-408f-ac5c-5a0c2799b4c0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.017818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16b56c17-4ec4-408f-ac5c-5a0c2799b4c0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.018298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16b56c17-4ec4-408f-ac5c-5a0c2799b4c0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.152832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-16b56c17-4ec4-408f-ac5c-5a0c2799b4c0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:07.155199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:07.162422 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-16b56c17-4ec4-408f-ac5c-5a0c2799b4c0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.162308 Aug 27 05:08:07.163014 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2991/5927] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:06 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:07.182770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4861d0a4-7987-4807-8666-24417ca7fd9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1873229437"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:07.185235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4861d0a4-7987-4807-8666-24417ca7fd9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:07.191383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4861d0a4-7987-4807-8666-24417ca7fd9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.191877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4861d0a4-7987-4807-8666-24417ca7fd9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.192324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4861d0a4-7987-4807-8666-24417ca7fd9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.193651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4861d0a4-7987-4807-8666-24417ca7fd9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.194131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4861d0a4-7987-4807-8666-24417ca7fd9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.194545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4861d0a4-7987-4807-8666-24417ca7fd9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.377413 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4861d0a4-7987-4807-8666-24417ca7fd9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.198382 Aug 27 05:08:07.378030 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2937/5928] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:08:07 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 05:08:07.752837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-288c0e39-0b4d-47a0-9271-2f0796f780ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:07.753519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-288c0e39-0b4d-47a0-9271-2f0796f780ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:07.761246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-288c0e39-0b4d-47a0-9271-2f0796f780ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.761757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-288c0e39-0b4d-47a0-9271-2f0796f780ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.762211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-288c0e39-0b4d-47a0-9271-2f0796f780ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.763051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-288c0e39-0b4d-47a0-9271-2f0796f780ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.763697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-288c0e39-0b4d-47a0-9271-2f0796f780ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.764084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-288c0e39-0b4d-47a0-9271-2f0796f780ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.901107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-288c0e39-0b4d-47a0-9271-2f0796f780ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:07.908970 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-288c0e39-0b4d-47a0-9271-2f0796f780ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1556 microversion: 2.1 time: 0.160150 Aug 27 05:08:07.909549 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2992/5929] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:07 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:07.931510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-557d65fa-58f4-40e1-a612-b550d9522505 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:07.932100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-557d65fa-58f4-40e1-a612-b550d9522505 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:07.939485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-557d65fa-58f4-40e1-a612-b550d9522505 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.939989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-557d65fa-58f4-40e1-a612-b550d9522505 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.940432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-557d65fa-58f4-40e1-a612-b550d9522505 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:07.941204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-557d65fa-58f4-40e1-a612-b550d9522505 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:07.941663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-557d65fa-58f4-40e1-a612-b550d9522505 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:07.942091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-557d65fa-58f4-40e1-a612-b550d9522505 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:08.029815 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-557d65fa-58f4-40e1-a612-b550d9522505 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103182 Aug 27 05:08:08.030545 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2938/5930] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 05:08:07 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:09.011469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d3508d00-178d-4780-9f4a-61ebc27dfa34 req-6db2d9dc-31e2-4a93-b66d-35170aac20f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1fdabdb-6353-46ce-9239-bc41ad53212e", "tag": "c9df8fc7-dcb3-4177-af25-45f0708c8a3b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:09.022948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d3508d00-178d-4780-9f4a-61ebc27dfa34 req-6db2d9dc-31e2-4a93-b66d-35170aac20f3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:09.023735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d3508d00-178d-4780-9f4a-61ebc27dfa34 req-6db2d9dc-31e2-4a93-b66d-35170aac20f3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:09.024259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d3508d00-178d-4780-9f4a-61ebc27dfa34 req-6db2d9dc-31e2-4a93-b66d-35170aac20f3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:09.038493 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d3508d00-178d-4780-9f4a-61ebc27dfa34 req-6db2d9dc-31e2-4a93-b66d-35170aac20f3 service nova] Creating event network-changed:c9df8fc7-dcb3-4177-af25-45f0708c8a3b for instance d1fdabdb-6353-46ce-9239-bc41ad53212e on n-h1-854823-1 Aug 27 05:08:09.043649 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d3508d00-178d-4780-9f4a-61ebc27dfa34 req-6db2d9dc-31e2-4a93-b66d-35170aac20f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036111 Aug 27 05:08:09.044699 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2993/5931] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:08:10.576514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-6ab62483-bbf5-4dd6-8f10-cb80baf81ed0 req-990c42d8-c739-47df-b3c2-bf0b07468f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f54d929-acc6-47f3-96a7-708032ccd9d9", "name": "network-vif-unplugged", "status": "completed", "tag": "060a48ca-cf07-4257-8892-27d740101396"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:10.590069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6ab62483-bbf5-4dd6-8f10-cb80baf81ed0 req-990c42d8-c739-47df-b3c2-bf0b07468f48 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:10.591391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6ab62483-bbf5-4dd6-8f10-cb80baf81ed0 req-990c42d8-c739-47df-b3c2-bf0b07468f48 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:10.592079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6ab62483-bbf5-4dd6-8f10-cb80baf81ed0 req-990c42d8-c739-47df-b3c2-bf0b07468f48 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:10.605939 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-6ab62483-bbf5-4dd6-8f10-cb80baf81ed0 req-990c42d8-c739-47df-b3c2-bf0b07468f48 service nova] Creating event network-vif-unplugged:060a48ca-cf07-4257-8892-27d740101396 for instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 on n-h2-854823-1 Aug 27 05:08:10.612544 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-6ab62483-bbf5-4dd6-8f10-cb80baf81ed0 req-990c42d8-c739-47df-b3c2-bf0b07468f48 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039638 Aug 27 05:08:10.613845 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2939/5932] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:12.654926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dd434407-26f1-44d8-ba1d-945b41aff997 req-a15d0bb0-3374-4934-8c34-5d2a166811b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f54d929-acc6-47f3-96a7-708032ccd9d9", "name": "network-vif-plugged", "status": "completed", "tag": "060a48ca-cf07-4257-8892-27d740101396"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:12.690728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dd434407-26f1-44d8-ba1d-945b41aff997 req-a15d0bb0-3374-4934-8c34-5d2a166811b2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:12.691146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dd434407-26f1-44d8-ba1d-945b41aff997 req-a15d0bb0-3374-4934-8c34-5d2a166811b2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:12.692239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dd434407-26f1-44d8-ba1d-945b41aff997 req-a15d0bb0-3374-4934-8c34-5d2a166811b2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:12.705413 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dd434407-26f1-44d8-ba1d-945b41aff997 req-a15d0bb0-3374-4934-8c34-5d2a166811b2 service nova] Creating event network-vif-plugged:060a48ca-cf07-4257-8892-27d740101396 for instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 on n-h2-854823-1 Aug 27 05:08:12.713957 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dd434407-26f1-44d8-ba1d-945b41aff997 req-a15d0bb0-3374-4934-8c34-5d2a166811b2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070210 Aug 27 05:08:12.714847 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2994/5933] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:19.572936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-db84b3a0-f1a1-4ca6-a132-1fa2ea876ed4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:19.574093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-db84b3a0-f1a1-4ca6-a132-1fa2ea876ed4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:19.581298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db84b3a0-f1a1-4ca6-a132-1fa2ea876ed4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:19.582012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db84b3a0-f1a1-4ca6-a132-1fa2ea876ed4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:19.582653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db84b3a0-f1a1-4ca6-a132-1fa2ea876ed4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:19.584788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db84b3a0-f1a1-4ca6-a132-1fa2ea876ed4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:19.585568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db84b3a0-f1a1-4ca6-a132-1fa2ea876ed4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:19.586237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db84b3a0-f1a1-4ca6-a132-1fa2ea876ed4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:19.784144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-db84b3a0-f1a1-4ca6-a132-1fa2ea876ed4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:19.794414 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-db84b3a0-f1a1-4ca6-a132-1fa2ea876ed4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1681 microversion: 2.1 time: 0.568323 Aug 27 05:08:19.796082 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2940/5934] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:19 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1681 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:19.941835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c3e0606-7f21-48bb-8837-beba245db163 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:19.944835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c3e0606-7f21-48bb-8837-beba245db163 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:19.955016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3e0606-7f21-48bb-8837-beba245db163 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:19.955748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3e0606-7f21-48bb-8837-beba245db163 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:19.956411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3e0606-7f21-48bb-8837-beba245db163 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:19.957377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3e0606-7f21-48bb-8837-beba245db163 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:19.958539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3e0606-7f21-48bb-8837-beba245db163 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:19.959174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3e0606-7f21-48bb-8837-beba245db163 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:20.017080 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c3e0606-7f21-48bb-8837-beba245db163 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e/action" status: 200 len: 32628 microversion: 2.1 time: 0.080335 Aug 27 05:08:20.018889 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2995/5935] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:08:19 2022] POST /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e/action => generated 32628 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:08:20.240130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-de8994a2-6c4b-4b5c-9113-4f104fd57188 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:20.241017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-de8994a2-6c4b-4b5c-9113-4f104fd57188 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:20.254304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de8994a2-6c4b-4b5c-9113-4f104fd57188 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:20.255965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de8994a2-6c4b-4b5c-9113-4f104fd57188 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:20.256607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de8994a2-6c4b-4b5c-9113-4f104fd57188 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:20.257822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de8994a2-6c4b-4b5c-9113-4f104fd57188 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:20.260783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de8994a2-6c4b-4b5c-9113-4f104fd57188 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:20.261498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-de8994a2-6c4b-4b5c-9113-4f104fd57188 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:20.441632 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-de8994a2-6c4b-4b5c-9113-4f104fd57188 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1832 microversion: 2.1 time: 0.209081 Aug 27 05:08:20.442989 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2941/5936] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:20 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1832 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:20.475776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2f8e835-8510-490d-9b50-362624d979d7 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:20.484620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2f8e835-8510-490d-9b50-362624d979d7 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:20.493824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2f8e835-8510-490d-9b50-362624d979d7 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:20.494331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2f8e835-8510-490d-9b50-362624d979d7 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:20.494880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2f8e835-8510-490d-9b50-362624d979d7 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:20.496102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2f8e835-8510-490d-9b50-362624d979d7 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:20.496897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2f8e835-8510-490d-9b50-362624d979d7 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:20.497553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2f8e835-8510-490d-9b50-362624d979d7 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:20.548517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-b2f8e835-8510-490d-9b50-362624d979d7 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lazy-loading 'flavor' on Instance uuid b4332394-4519-4c1d-b5bd-22c1de38fd6e {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:08:20.564620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2f8e835-8510-490d-9b50-362624d979d7 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Going to try to live migrate instance to another host {{(pid=128869) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 05:08:21.987235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e5441a69-d7b5-44ee-8fd1-0e7689b098c6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:21.987787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e5441a69-d7b5-44ee-8fd1-0e7689b098c6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:21.996896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5441a69-d7b5-44ee-8fd1-0e7689b098c6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:21.998336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5441a69-d7b5-44ee-8fd1-0e7689b098c6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:21.998847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5441a69-d7b5-44ee-8fd1-0e7689b098c6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.000062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5441a69-d7b5-44ee-8fd1-0e7689b098c6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:22.000756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5441a69-d7b5-44ee-8fd1-0e7689b098c6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:22.001189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5441a69-d7b5-44ee-8fd1-0e7689b098c6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.301581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e5441a69-d7b5-44ee-8fd1-0e7689b098c6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:22.312151 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e5441a69-d7b5-44ee-8fd1-0e7689b098c6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.329527 Aug 27 05:08:22.313489 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2942/5937] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:21 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:22.335821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0f3a5e16-8712-4094-8a1c-f692f1dc60dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-358744156"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:22.338525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0f3a5e16-8712-4094-8a1c-f692f1dc60dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:22.345567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f3a5e16-8712-4094-8a1c-f692f1dc60dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:22.346571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f3a5e16-8712-4094-8a1c-f692f1dc60dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:22.350955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f3a5e16-8712-4094-8a1c-f692f1dc60dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.354405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f3a5e16-8712-4094-8a1c-f692f1dc60dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:22.355175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f3a5e16-8712-4094-8a1c-f692f1dc60dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:22.357397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f3a5e16-8712-4094-8a1c-f692f1dc60dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.542842 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2f8e835-8510-490d-9b50-362624d979d7 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e/action" status: 202 len: 0 microversion: 2.1 time: 2.072526 Aug 27 05:08:22.545243 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2996/5938] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:08:20 2022] POST /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e/action => generated 0 bytes in 2076 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:08:22.558540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d9057e6c-9008-4a2c-8da6-dd11554ce99f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:22.559728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d9057e6c-9008-4a2c-8da6-dd11554ce99f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:22.586952 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0f3a5e16-8712-4094-8a1c-f692f1dc60dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.254138 Aug 27 05:08:22.587632 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2943/5939] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:08:22 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Aug 27 05:08:22.590433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9057e6c-9008-4a2c-8da6-dd11554ce99f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:22.591294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9057e6c-9008-4a2c-8da6-dd11554ce99f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:22.598096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-968818a5-130e-49cb-be36-37e56491142e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:22.598326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9057e6c-9008-4a2c-8da6-dd11554ce99f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.599822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-968818a5-130e-49cb-be36-37e56491142e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:22.602951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9057e6c-9008-4a2c-8da6-dd11554ce99f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:22.606335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9057e6c-9008-4a2c-8da6-dd11554ce99f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:22.607147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-968818a5-130e-49cb-be36-37e56491142e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:22.608139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-968818a5-130e-49cb-be36-37e56491142e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:22.608521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-968818a5-130e-49cb-be36-37e56491142e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.609501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-968818a5-130e-49cb-be36-37e56491142e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:22.609844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9057e6c-9008-4a2c-8da6-dd11554ce99f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.609982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-968818a5-130e-49cb-be36-37e56491142e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:22.610251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-968818a5-130e-49cb-be36-37e56491142e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:22.994557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d9057e6c-9008-4a2c-8da6-dd11554ce99f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:23.007643 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d9057e6c-9008-4a2c-8da6-dd11554ce99f tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1691 microversion: 2.1 time: 0.456932 Aug 27 05:08:23.008175 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2997/5940] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:22 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1691 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:23.046649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-968818a5-130e-49cb-be36-37e56491142e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:23.056400 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-968818a5-130e-49cb-be36-37e56491142e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.463480 Aug 27 05:08:23.057118 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2944/5941] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:22 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:24.030991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3df7513d-054a-496c-87bc-f36e65ec9d10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:24.033779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3df7513d-054a-496c-87bc-f36e65ec9d10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:24.042683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3df7513d-054a-496c-87bc-f36e65ec9d10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:24.043206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3df7513d-054a-496c-87bc-f36e65ec9d10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:24.043852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3df7513d-054a-496c-87bc-f36e65ec9d10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:24.046224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3df7513d-054a-496c-87bc-f36e65ec9d10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:24.047382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3df7513d-054a-496c-87bc-f36e65ec9d10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:24.047833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3df7513d-054a-496c-87bc-f36e65ec9d10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:24.079390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-037150e3-65db-42eb-8a77-230772133e78 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:24.081896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-037150e3-65db-42eb-8a77-230772133e78 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:24.090890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-037150e3-65db-42eb-8a77-230772133e78 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:24.091381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-037150e3-65db-42eb-8a77-230772133e78 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:24.091816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-037150e3-65db-42eb-8a77-230772133e78 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:24.092803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-037150e3-65db-42eb-8a77-230772133e78 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:24.093473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-037150e3-65db-42eb-8a77-230772133e78 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:24.094213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-037150e3-65db-42eb-8a77-230772133e78 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:24.244185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-037150e3-65db-42eb-8a77-230772133e78 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:24.252782 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-037150e3-65db-42eb-8a77-230772133e78 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1686 microversion: 2.1 time: 0.177538 Aug 27 05:08:24.253366 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2945/5942] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:24 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:24.318404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3df7513d-054a-496c-87bc-f36e65ec9d10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:24.328609 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3df7513d-054a-496c-87bc-f36e65ec9d10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1691 microversion: 2.1 time: 0.302239 Aug 27 05:08:24.329807 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2998/5943] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:24 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1691 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:24.464716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-16590843-a3a7-49e5-9958-f40569602197 req-ba5da12b-2f37-4759-bb60-9e387f75f635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4332394-4519-4c1d-b5bd-22c1de38fd6e", "name": "network-vif-unplugged", "status": "completed", "tag": "d7595bd6-4531-40ab-b41d-fcc3e753c0cd"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:24.475647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-16590843-a3a7-49e5-9958-f40569602197 req-ba5da12b-2f37-4759-bb60-9e387f75f635 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:24.476584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-16590843-a3a7-49e5-9958-f40569602197 req-ba5da12b-2f37-4759-bb60-9e387f75f635 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:24.477217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-16590843-a3a7-49e5-9958-f40569602197 req-ba5da12b-2f37-4759-bb60-9e387f75f635 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:24.494280 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-16590843-a3a7-49e5-9958-f40569602197 req-ba5da12b-2f37-4759-bb60-9e387f75f635 service nova] Creating event network-vif-unplugged:d7595bd6-4531-40ab-b41d-fcc3e753c0cd for instance b4332394-4519-4c1d-b5bd-22c1de38fd6e on n-h1-854823-1 Aug 27 05:08:24.499638 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-16590843-a3a7-49e5-9958-f40569602197 req-ba5da12b-2f37-4759-bb60-9e387f75f635 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038714 Aug 27 05:08:24.500785 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2946/5944] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:24.817752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a14db1b2-47b6-4718-8230-99fa888e00aa req-49b4383c-009a-448e-905f-d70a515103e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f54d929-acc6-47f3-96a7-708032ccd9d9", "name": "network-vif-unplugged", "status": "completed", "tag": "060a48ca-cf07-4257-8892-27d740101396"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:24.827858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a14db1b2-47b6-4718-8230-99fa888e00aa req-49b4383c-009a-448e-905f-d70a515103e6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:24.828483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a14db1b2-47b6-4718-8230-99fa888e00aa req-49b4383c-009a-448e-905f-d70a515103e6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:24.829060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a14db1b2-47b6-4718-8230-99fa888e00aa req-49b4383c-009a-448e-905f-d70a515103e6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:24.851968 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a14db1b2-47b6-4718-8230-99fa888e00aa req-49b4383c-009a-448e-905f-d70a515103e6 service nova] Creating event network-vif-unplugged:060a48ca-cf07-4257-8892-27d740101396 for instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 on n-h2-854823-1 Aug 27 05:08:24.857453 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a14db1b2-47b6-4718-8230-99fa888e00aa req-49b4383c-009a-448e-905f-d70a515103e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.305454 Aug 27 05:08:24.858130 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2999/5945] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:08:25.286653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a1c8ab85-b3b4-4353-8837-03af540420ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:25.287817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a1c8ab85-b3b4-4353-8837-03af540420ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:25.296033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1c8ab85-b3b4-4353-8837-03af540420ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:25.296660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1c8ab85-b3b4-4353-8837-03af540420ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:25.297391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1c8ab85-b3b4-4353-8837-03af540420ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:25.298310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1c8ab85-b3b4-4353-8837-03af540420ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:25.298855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1c8ab85-b3b4-4353-8837-03af540420ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:25.299749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1c8ab85-b3b4-4353-8837-03af540420ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:25.355868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-887ee612-31ae-4590-b873-cf5b4b9950a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:25.356684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-887ee612-31ae-4590-b873-cf5b4b9950a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:25.364619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-887ee612-31ae-4590-b873-cf5b4b9950a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:25.365084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-887ee612-31ae-4590-b873-cf5b4b9950a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:25.365787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-887ee612-31ae-4590-b873-cf5b4b9950a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:25.367237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-887ee612-31ae-4590-b873-cf5b4b9950a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:25.367899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-887ee612-31ae-4590-b873-cf5b4b9950a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:25.368350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-887ee612-31ae-4590-b873-cf5b4b9950a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:25.472998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a1c8ab85-b3b4-4353-8837-03af540420ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:25.481867 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a1c8ab85-b3b4-4353-8837-03af540420ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1686 microversion: 2.1 time: 0.209302 Aug 27 05:08:25.483883 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2947/5946] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:25 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1686 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:25.552213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-887ee612-31ae-4590-b873-cf5b4b9950a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:25.561207 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-887ee612-31ae-4590-b873-cf5b4b9950a2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1691 microversion: 2.1 time: 0.213239 Aug 27 05:08:25.561808 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3000/5947] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:25 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1691 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:26.509717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f2f1b386-1204-4e48-a0c2-b2f289c566ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:26.511037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f2f1b386-1204-4e48-a0c2-b2f289c566ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:26.518375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2f1b386-1204-4e48-a0c2-b2f289c566ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:26.519112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2f1b386-1204-4e48-a0c2-b2f289c566ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:26.520079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2f1b386-1204-4e48-a0c2-b2f289c566ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:26.521078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2f1b386-1204-4e48-a0c2-b2f289c566ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:26.521915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2f1b386-1204-4e48-a0c2-b2f289c566ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:26.522565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2f1b386-1204-4e48-a0c2-b2f289c566ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:26.529556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-24b231d6-184c-468e-a5a2-3594fde46f9f req-771cb62f-e4df-46de-ac76-043a03603fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4332394-4519-4c1d-b5bd-22c1de38fd6e", "tag": "d7595bd6-4531-40ab-b41d-fcc3e753c0cd"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:26.545501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-24b231d6-184c-468e-a5a2-3594fde46f9f req-771cb62f-e4df-46de-ac76-043a03603fd7 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:26.546003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-24b231d6-184c-468e-a5a2-3594fde46f9f req-771cb62f-e4df-46de-ac76-043a03603fd7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:26.546571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-24b231d6-184c-468e-a5a2-3594fde46f9f req-771cb62f-e4df-46de-ac76-043a03603fd7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:26.563638 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-24b231d6-184c-468e-a5a2-3594fde46f9f req-771cb62f-e4df-46de-ac76-043a03603fd7 service nova] Creating event network-changed:d7595bd6-4531-40ab-b41d-fcc3e753c0cd for instance b4332394-4519-4c1d-b5bd-22c1de38fd6e on n-h1-854823-1 Aug 27 05:08:26.573818 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-24b231d6-184c-468e-a5a2-3594fde46f9f req-771cb62f-e4df-46de-ac76-043a03603fd7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048587 Aug 27 05:08:26.575136 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3001/5948] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:26.588491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a54b73ed-e978-4806-821c-9d69753a5e52 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:26.591738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a54b73ed-e978-4806-821c-9d69753a5e52 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:26.612590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a54b73ed-e978-4806-821c-9d69753a5e52 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:26.614560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a54b73ed-e978-4806-821c-9d69753a5e52 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:26.617209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a54b73ed-e978-4806-821c-9d69753a5e52 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:26.618223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a54b73ed-e978-4806-821c-9d69753a5e52 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:26.618710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a54b73ed-e978-4806-821c-9d69753a5e52 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:26.619160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a54b73ed-e978-4806-821c-9d69753a5e52 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:26.707216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f2f1b386-1204-4e48-a0c2-b2f289c566ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:26.717635 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f2f1b386-1204-4e48-a0c2-b2f289c566ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1681 microversion: 2.1 time: 0.212505 Aug 27 05:08:26.718686 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2948/5949] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:26 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:26.874877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-bbdd742c-1571-4b51-993c-2123654408e3 req-e68e60a7-daa3-40d0-aa7b-e334b2f719bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f54d929-acc6-47f3-96a7-708032ccd9d9", "name": "network-vif-plugged", "status": "completed", "tag": "060a48ca-cf07-4257-8892-27d740101396"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:26.886470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bbdd742c-1571-4b51-993c-2123654408e3 req-e68e60a7-daa3-40d0-aa7b-e334b2f719bb service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:26.887047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bbdd742c-1571-4b51-993c-2123654408e3 req-e68e60a7-daa3-40d0-aa7b-e334b2f719bb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:26.887535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bbdd742c-1571-4b51-993c-2123654408e3 req-e68e60a7-daa3-40d0-aa7b-e334b2f719bb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:26.901243 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-bbdd742c-1571-4b51-993c-2123654408e3 req-e68e60a7-daa3-40d0-aa7b-e334b2f719bb service nova] Creating event network-vif-plugged:060a48ca-cf07-4257-8892-27d740101396 for instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 on n-h2-854823-1 Aug 27 05:08:26.907033 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-bbdd742c-1571-4b51-993c-2123654408e3 req-e68e60a7-daa3-40d0-aa7b-e334b2f719bb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036812 Aug 27 05:08:26.907879 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2949/5950] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:08:26.997458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a54b73ed-e978-4806-821c-9d69753a5e52 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:27.007274 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a54b73ed-e978-4806-821c-9d69753a5e52 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1691 microversion: 2.1 time: 0.427745 Aug 27 05:08:27.023055 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3002/5951] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:26 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1691 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:27.744367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-82028341-2756-47dc-b32f-10f4f1c05ca4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:27.745800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-82028341-2756-47dc-b32f-10f4f1c05ca4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:27.753928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82028341-2756-47dc-b32f-10f4f1c05ca4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:27.755409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82028341-2756-47dc-b32f-10f4f1c05ca4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:27.755913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82028341-2756-47dc-b32f-10f4f1c05ca4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:27.756915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82028341-2756-47dc-b32f-10f4f1c05ca4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:27.757573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82028341-2756-47dc-b32f-10f4f1c05ca4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:27.758218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82028341-2756-47dc-b32f-10f4f1c05ca4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:27.776958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:27.943625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-82028341-2756-47dc-b32f-10f4f1c05ca4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:27.981749 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-82028341-2756-47dc-b32f-10f4f1c05ca4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1681 microversion: 2.1 time: 0.243029 Aug 27 05:08:27.982383 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2950/5952] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:27 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:28.030822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f46d14eb-dfad-47fe-a82c-6792113053d0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:28.031485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f46d14eb-dfad-47fe-a82c-6792113053d0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:28.040700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f46d14eb-dfad-47fe-a82c-6792113053d0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:28.041485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f46d14eb-dfad-47fe-a82c-6792113053d0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:28.042158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f46d14eb-dfad-47fe-a82c-6792113053d0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:28.043082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f46d14eb-dfad-47fe-a82c-6792113053d0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:28.043748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f46d14eb-dfad-47fe-a82c-6792113053d0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:28.044378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f46d14eb-dfad-47fe-a82c-6792113053d0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:28.226555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f46d14eb-dfad-47fe-a82c-6792113053d0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:28.236455 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f46d14eb-dfad-47fe-a82c-6792113053d0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1691 microversion: 2.1 time: 0.210683 Aug 27 05:08:28.240844 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3003/5953] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:28 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1691 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:29.005209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8bf810c8-5b34-41b5-b1c6-85c66c69a3bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:29.006859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8bf810c8-5b34-41b5-b1c6-85c66c69a3bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:29.013622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=38 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:29.015859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bf810c8-5b34-41b5-b1c6-85c66c69a3bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:29.016647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bf810c8-5b34-41b5-b1c6-85c66c69a3bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:29.017334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bf810c8-5b34-41b5-b1c6-85c66c69a3bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:29.018336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bf810c8-5b34-41b5-b1c6-85c66c69a3bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:29.018857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bf810c8-5b34-41b5-b1c6-85c66c69a3bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:29.019474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bf810c8-5b34-41b5-b1c6-85c66c69a3bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:29.191081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8bf810c8-5b34-41b5-b1c6-85c66c69a3bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:29.202368 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8bf810c8-5b34-41b5-b1c6-85c66c69a3bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1681 microversion: 2.1 time: 0.201859 Aug 27 05:08:29.203519 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2951/5954] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:28 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1681 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:29.262529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-967b69d4-b906-4283-91e8-675f021065ed tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:29.263788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-967b69d4-b906-4283-91e8-675f021065ed tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:29.278073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-967b69d4-b906-4283-91e8-675f021065ed tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:29.279075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-967b69d4-b906-4283-91e8-675f021065ed tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:29.280098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-967b69d4-b906-4283-91e8-675f021065ed tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:29.281146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-967b69d4-b906-4283-91e8-675f021065ed tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:29.281800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-967b69d4-b906-4283-91e8-675f021065ed tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:29.282419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-967b69d4-b906-4283-91e8-675f021065ed tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:29.490405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-967b69d4-b906-4283-91e8-675f021065ed tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:29.499191 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-967b69d4-b906-4283-91e8-675f021065ed tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1691 microversion: 2.1 time: 0.241075 Aug 27 05:08:29.499795 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3004/5955] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:29 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1691 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:30.224349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2c158092-52bc-45b8-81c7-b0e545804ce8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:30.225717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2c158092-52bc-45b8-81c7-b0e545804ce8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:30.236853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c158092-52bc-45b8-81c7-b0e545804ce8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:30.237799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c158092-52bc-45b8-81c7-b0e545804ce8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:30.239634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c158092-52bc-45b8-81c7-b0e545804ce8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:30.240614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c158092-52bc-45b8-81c7-b0e545804ce8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:30.241374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c158092-52bc-45b8-81c7-b0e545804ce8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:30.242023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2c158092-52bc-45b8-81c7-b0e545804ce8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:30.408277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2c158092-52bc-45b8-81c7-b0e545804ce8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:30.418676 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2c158092-52bc-45b8-81c7-b0e545804ce8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1681 microversion: 2.1 time: 0.198709 Aug 27 05:08:30.419649 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2952/5956] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:30 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:30.521147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-777bbae7-3348-4bfa-bc1f-d6a46fce4ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:30.522557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-777bbae7-3348-4bfa-bc1f-d6a46fce4ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:30.535915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777bbae7-3348-4bfa-bc1f-d6a46fce4ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:30.536634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777bbae7-3348-4bfa-bc1f-d6a46fce4ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:30.537707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777bbae7-3348-4bfa-bc1f-d6a46fce4ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:30.540500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777bbae7-3348-4bfa-bc1f-d6a46fce4ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:30.541311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777bbae7-3348-4bfa-bc1f-d6a46fce4ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:30.543486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777bbae7-3348-4bfa-bc1f-d6a46fce4ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:30.964098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-777bbae7-3348-4bfa-bc1f-d6a46fce4ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:30.976299 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-777bbae7-3348-4bfa-bc1f-d6a46fce4ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1691 microversion: 2.1 time: 0.458228 Aug 27 05:08:30.978079 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3005/5957] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:30 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1691 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:31.444519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ee020951-4f97-4066-96d0-7e95d9a2c98e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:31.445667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ee020951-4f97-4066-96d0-7e95d9a2c98e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:31.454954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee020951-4f97-4066-96d0-7e95d9a2c98e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:31.456018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee020951-4f97-4066-96d0-7e95d9a2c98e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:31.456691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee020951-4f97-4066-96d0-7e95d9a2c98e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:31.458519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee020951-4f97-4066-96d0-7e95d9a2c98e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:31.458988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee020951-4f97-4066-96d0-7e95d9a2c98e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:31.459450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee020951-4f97-4066-96d0-7e95d9a2c98e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:31.629050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ee020951-4f97-4066-96d0-7e95d9a2c98e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:31.643505 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ee020951-4f97-4066-96d0-7e95d9a2c98e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1681 microversion: 2.1 time: 0.203154 Aug 27 05:08:31.656427 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2953/5958] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:31 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:32.003493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae132e73-8706-4a7b-97a5-82e5f8b90ced tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:32.004273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae132e73-8706-4a7b-97a5-82e5f8b90ced tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:32.016789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae132e73-8706-4a7b-97a5-82e5f8b90ced tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:32.029524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae132e73-8706-4a7b-97a5-82e5f8b90ced tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:32.030338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae132e73-8706-4a7b-97a5-82e5f8b90ced tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:32.031342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae132e73-8706-4a7b-97a5-82e5f8b90ced tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:32.032110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae132e73-8706-4a7b-97a5-82e5f8b90ced tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:32.033336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae132e73-8706-4a7b-97a5-82e5f8b90ced tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:32.300907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ae132e73-8706-4a7b-97a5-82e5f8b90ced tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:32.314015 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae132e73-8706-4a7b-97a5-82e5f8b90ced tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1691 microversion: 2.1 time: 0.315276 Aug 27 05:08:32.315115 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3006/5959] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:31 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1691 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:32.668031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-00cfcaef-b959-4dc6-8267-706659f1b544 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:32.668700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-00cfcaef-b959-4dc6-8267-706659f1b544 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:32.677956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00cfcaef-b959-4dc6-8267-706659f1b544 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:32.678827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00cfcaef-b959-4dc6-8267-706659f1b544 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:32.679609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00cfcaef-b959-4dc6-8267-706659f1b544 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:32.680512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00cfcaef-b959-4dc6-8267-706659f1b544 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:32.681171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00cfcaef-b959-4dc6-8267-706659f1b544 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:32.681792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00cfcaef-b959-4dc6-8267-706659f1b544 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:32.887287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-00cfcaef-b959-4dc6-8267-706659f1b544 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:32.899291 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-00cfcaef-b959-4dc6-8267-706659f1b544 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1681 microversion: 2.1 time: 0.234838 Aug 27 05:08:32.899896 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2954/5960] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:32 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:33.344182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e37dde6-3c6e-419f-acce-71aed762e96a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:33.344997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e37dde6-3c6e-419f-acce-71aed762e96a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:33.362982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e37dde6-3c6e-419f-acce-71aed762e96a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:33.363499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e37dde6-3c6e-419f-acce-71aed762e96a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:33.364490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e37dde6-3c6e-419f-acce-71aed762e96a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:33.365254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e37dde6-3c6e-419f-acce-71aed762e96a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:33.365728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e37dde6-3c6e-419f-acce-71aed762e96a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:33.366169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e37dde6-3c6e-419f-acce-71aed762e96a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:33.619463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e37dde6-3c6e-419f-acce-71aed762e96a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:33.628324 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e37dde6-3c6e-419f-acce-71aed762e96a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1681 microversion: 2.1 time: 0.288674 Aug 27 05:08:33.629028 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3007/5961] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:33 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1681 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:33.651277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1408f55a-b82c-442d-bf6d-3bee82887935 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:33.651805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1408f55a-b82c-442d-bf6d-3bee82887935 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:33.658394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1408f55a-b82c-442d-bf6d-3bee82887935 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:33.658894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1408f55a-b82c-442d-bf6d-3bee82887935 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:33.659384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1408f55a-b82c-442d-bf6d-3bee82887935 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:33.660460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1408f55a-b82c-442d-bf6d-3bee82887935 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:33.660590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1408f55a-b82c-442d-bf6d-3bee82887935 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:33.661646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1408f55a-b82c-442d-bf6d-3bee82887935 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:33.854390 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1408f55a-b82c-442d-bf6d-3bee82887935 tempest-TestNetworkAdvancedServerOps-1458170239 tempest-TestNetworkAdvancedServerOps-1458170239-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1832 microversion: 2.1 time: 0.207460 Aug 27 05:08:33.869350 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2955/5962] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:33 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1832 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:33.879336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03cd3061-57e3-41a1-afd9-07ce9c0bc27e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:33.880421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03cd3061-57e3-41a1-afd9-07ce9c0bc27e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:33.888359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03cd3061-57e3-41a1-afd9-07ce9c0bc27e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:33.890219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03cd3061-57e3-41a1-afd9-07ce9c0bc27e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:33.890919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03cd3061-57e3-41a1-afd9-07ce9c0bc27e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:33.892731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03cd3061-57e3-41a1-afd9-07ce9c0bc27e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:33.894004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03cd3061-57e3-41a1-afd9-07ce9c0bc27e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:33.894556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03cd3061-57e3-41a1-afd9-07ce9c0bc27e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:33.921202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d43351fb-286b-4201-b442-52e92b788f65 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:33.922291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d43351fb-286b-4201-b442-52e92b788f65 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:33.933503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d43351fb-286b-4201-b442-52e92b788f65 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:33.934316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d43351fb-286b-4201-b442-52e92b788f65 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:33.935563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d43351fb-286b-4201-b442-52e92b788f65 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:33.937667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d43351fb-286b-4201-b442-52e92b788f65 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:33.939302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d43351fb-286b-4201-b442-52e92b788f65 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:33.941453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d43351fb-286b-4201-b442-52e92b788f65 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:34.095366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-03cd3061-57e3-41a1-afd9-07ce9c0bc27e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:34.107321 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03cd3061-57e3-41a1-afd9-07ce9c0bc27e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1681 microversion: 2.1 time: 0.230755 Aug 27 05:08:34.108125 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3008/5963] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:33 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1681 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:34.193541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d43351fb-286b-4201-b442-52e92b788f65 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:34.203474 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d43351fb-286b-4201-b442-52e92b788f65 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1681 microversion: 2.1 time: 0.286114 Aug 27 05:08:34.216698 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2956/5964] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:33 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1681 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:35.227401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ece7c5c-af60-4f44-9aa8-8872bdec1cf7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:35.228116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ece7c5c-af60-4f44-9aa8-8872bdec1cf7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:35.236172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ece7c5c-af60-4f44-9aa8-8872bdec1cf7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:35.237007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ece7c5c-af60-4f44-9aa8-8872bdec1cf7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:35.237697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ece7c5c-af60-4f44-9aa8-8872bdec1cf7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:35.238600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ece7c5c-af60-4f44-9aa8-8872bdec1cf7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:35.239417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ece7c5c-af60-4f44-9aa8-8872bdec1cf7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:35.240032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ece7c5c-af60-4f44-9aa8-8872bdec1cf7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:35.422530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ece7c5c-af60-4f44-9aa8-8872bdec1cf7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:35.424983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:35.433793 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ece7c5c-af60-4f44-9aa8-8872bdec1cf7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1681 microversion: 2.1 time: 0.210243 Aug 27 05:08:35.434487 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3009/5965] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:35 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:36.265036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4aa39f17-ec23-4c03-bc82-560d01968ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:36.268407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4aa39f17-ec23-4c03-bc82-560d01968ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:36.286131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4aa39f17-ec23-4c03-bc82-560d01968ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:36.286783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4aa39f17-ec23-4c03-bc82-560d01968ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:36.287778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4aa39f17-ec23-4c03-bc82-560d01968ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:36.288638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4aa39f17-ec23-4c03-bc82-560d01968ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:36.289192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4aa39f17-ec23-4c03-bc82-560d01968ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:36.289852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4aa39f17-ec23-4c03-bc82-560d01968ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:36.353193 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4aa39f17-ec23-4c03-bc82-560d01968ce9 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e/action" status: 200 len: 38591 microversion: 2.1 time: 0.091815 Aug 27 05:08:36.361099 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2957/5966] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:08:36 2022] POST /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e/action => generated 38591 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:08:36.458274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4aa3b187-2ee4-472d-86a8-a474e50c45ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:36.458965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4aa3b187-2ee4-472d-86a8-a474e50c45ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:36.462850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=42 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:36.470099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aa3b187-2ee4-472d-86a8-a474e50c45ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:36.470654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aa3b187-2ee4-472d-86a8-a474e50c45ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:36.471392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aa3b187-2ee4-472d-86a8-a474e50c45ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:36.472142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aa3b187-2ee4-472d-86a8-a474e50c45ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:36.472650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aa3b187-2ee4-472d-86a8-a474e50c45ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:36.473157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aa3b187-2ee4-472d-86a8-a474e50c45ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:36.661136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4aa3b187-2ee4-472d-86a8-a474e50c45ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:36.670217 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4aa3b187-2ee4-472d-86a8-a474e50c45ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1681 microversion: 2.1 time: 0.217192 Aug 27 05:08:36.670986 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3010/5967] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:36 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1681 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:37.693582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b2b39813-8dc2-42a8-8ebe-b0b6d48778b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:37.695047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b2b39813-8dc2-42a8-8ebe-b0b6d48778b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:37.704203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2b39813-8dc2-42a8-8ebe-b0b6d48778b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:37.704891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2b39813-8dc2-42a8-8ebe-b0b6d48778b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:37.705478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2b39813-8dc2-42a8-8ebe-b0b6d48778b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:37.706182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2b39813-8dc2-42a8-8ebe-b0b6d48778b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:37.709758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2b39813-8dc2-42a8-8ebe-b0b6d48778b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:37.710410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b2b39813-8dc2-42a8-8ebe-b0b6d48778b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:37.999618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b2b39813-8dc2-42a8-8ebe-b0b6d48778b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:38.009583 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b2b39813-8dc2-42a8-8ebe-b0b6d48778b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1681 microversion: 2.1 time: 0.321205 Aug 27 05:08:38.010445 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2958/5968] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:37 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1681 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:38.080981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8742067c-2c2c-4e7d-b788-a3eda0dc80e3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:38.081507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8742067c-2c2c-4e7d-b788-a3eda0dc80e3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:38.090838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8742067c-2c2c-4e7d-b788-a3eda0dc80e3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:38.092648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8742067c-2c2c-4e7d-b788-a3eda0dc80e3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:38.093547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8742067c-2c2c-4e7d-b788-a3eda0dc80e3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:38.094557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8742067c-2c2c-4e7d-b788-a3eda0dc80e3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:38.095140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8742067c-2c2c-4e7d-b788-a3eda0dc80e3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:38.098806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8742067c-2c2c-4e7d-b788-a3eda0dc80e3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:38.113961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8b7383d0-db9d-4d19-a117-88289c4afc4f req-91ff8f39-fed9-43b6-af9e-d62367c1e02b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4332394-4519-4c1d-b5bd-22c1de38fd6e", "tag": "d7595bd6-4531-40ab-b41d-fcc3e753c0cd"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:38.159942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8b7383d0-db9d-4d19-a117-88289c4afc4f req-91ff8f39-fed9-43b6-af9e-d62367c1e02b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:38.160780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8b7383d0-db9d-4d19-a117-88289c4afc4f req-91ff8f39-fed9-43b6-af9e-d62367c1e02b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:38.161181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8742067c-2c2c-4e7d-b788-a3eda0dc80e3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:08:38.162739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8b7383d0-db9d-4d19-a117-88289c4afc4f req-91ff8f39-fed9-43b6-af9e-d62367c1e02b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:38.195491 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8b7383d0-db9d-4d19-a117-88289c4afc4f req-91ff8f39-fed9-43b6-af9e-d62367c1e02b service nova] Creating event network-changed:d7595bd6-4531-40ab-b41d-fcc3e753c0cd for instance b4332394-4519-4c1d-b5bd-22c1de38fd6e on n-h2-854823-1 Aug 27 05:08:38.206860 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8b7383d0-db9d-4d19-a117-88289c4afc4f req-91ff8f39-fed9-43b6-af9e-d62367c1e02b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104327 Aug 27 05:08:38.222651 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2959/5969] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:08:38.280566 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8742067c-2c2c-4e7d-b788-a3eda0dc80e3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 204 len: 0 microversion: 2.1 time: 0.204434 Aug 27 05:08:38.282656 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3011/5970] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:08:38 2022] DELETE /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:08:38.292668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-13829551-d849-4607-a5d3-478a4ca5fdaa tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:38.293368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-13829551-d849-4607-a5d3-478a4ca5fdaa tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:38.306017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13829551-d849-4607-a5d3-478a4ca5fdaa tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:38.306527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13829551-d849-4607-a5d3-478a4ca5fdaa tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:38.308224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13829551-d849-4607-a5d3-478a4ca5fdaa tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:38.311938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13829551-d849-4607-a5d3-478a4ca5fdaa tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:38.313993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13829551-d849-4607-a5d3-478a4ca5fdaa tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:38.314447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13829551-d849-4607-a5d3-478a4ca5fdaa tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:38.561175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-13829551-d849-4607-a5d3-478a4ca5fdaa tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:38.571938 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-13829551-d849-4607-a5d3-478a4ca5fdaa tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1687 microversion: 2.1 time: 0.284335 Aug 27 05:08:38.572708 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2960/5971] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:38 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1687 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:39.033221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13254fdf-c1bf-41db-b7ff-ca1cedf6f5e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:39.034041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13254fdf-c1bf-41db-b7ff-ca1cedf6f5e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:39.059013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13254fdf-c1bf-41db-b7ff-ca1cedf6f5e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:39.059725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13254fdf-c1bf-41db-b7ff-ca1cedf6f5e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:39.060393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13254fdf-c1bf-41db-b7ff-ca1cedf6f5e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:39.061625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13254fdf-c1bf-41db-b7ff-ca1cedf6f5e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:39.062261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13254fdf-c1bf-41db-b7ff-ca1cedf6f5e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:39.062904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13254fdf-c1bf-41db-b7ff-ca1cedf6f5e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:39.491569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13254fdf-c1bf-41db-b7ff-ca1cedf6f5e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:39.514684 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13254fdf-c1bf-41db-b7ff-ca1cedf6f5e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.486742 Aug 27 05:08:39.518004 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3012/5972] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:39 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:39.607154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a6ab6db0-9f2f-418c-bf2e-a994d1a2c520 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:39.607784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a6ab6db0-9f2f-418c-bf2e-a994d1a2c520 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:39.621300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ab6db0-9f2f-418c-bf2e-a994d1a2c520 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:39.621691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ab6db0-9f2f-418c-bf2e-a994d1a2c520 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:39.627183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ab6db0-9f2f-418c-bf2e-a994d1a2c520 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:39.628025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ab6db0-9f2f-418c-bf2e-a994d1a2c520 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:39.628511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ab6db0-9f2f-418c-bf2e-a994d1a2c520 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:39.629172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ab6db0-9f2f-418c-bf2e-a994d1a2c520 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:39.735861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a6ab6db0-9f2f-418c-bf2e-a994d1a2c520 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:39.754115 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a6ab6db0-9f2f-418c-bf2e-a994d1a2c520 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 200 len: 1502 microversion: 2.1 time: 0.151120 Aug 27 05:08:39.754825 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2961/5973] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:39 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:40.229871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7a623afa-4da4-423f-91fa-28b4c705fe94 req-8c61a1e7-8a9b-4ee6-a7cc-6b8e7545311d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4332394-4519-4c1d-b5bd-22c1de38fd6e", "name": "network-vif-deleted", "tag": "d7595bd6-4531-40ab-b41d-fcc3e753c0cd"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:40.246323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7a623afa-4da4-423f-91fa-28b4c705fe94 req-8c61a1e7-8a9b-4ee6-a7cc-6b8e7545311d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:40.247269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7a623afa-4da4-423f-91fa-28b4c705fe94 req-8c61a1e7-8a9b-4ee6-a7cc-6b8e7545311d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:40.248569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7a623afa-4da4-423f-91fa-28b4c705fe94 req-8c61a1e7-8a9b-4ee6-a7cc-6b8e7545311d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:40.268627 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7a623afa-4da4-423f-91fa-28b4c705fe94 req-8c61a1e7-8a9b-4ee6-a7cc-6b8e7545311d service nova] Creating event network-vif-deleted:d7595bd6-4531-40ab-b41d-fcc3e753c0cd for instance b4332394-4519-4c1d-b5bd-22c1de38fd6e on n-h2-854823-1 Aug 27 05:08:40.276432 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7a623afa-4da4-423f-91fa-28b4c705fe94 req-8c61a1e7-8a9b-4ee6-a7cc-6b8e7545311d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055081 Aug 27 05:08:40.277294 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3013/5974] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:08:40.639201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e75ead43-b43d-47aa-9d5c-770dfd0a4769 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:40.639907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e75ead43-b43d-47aa-9d5c-770dfd0a4769 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:40.648028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e75ead43-b43d-47aa-9d5c-770dfd0a4769 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:40.648471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e75ead43-b43d-47aa-9d5c-770dfd0a4769 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:40.648929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e75ead43-b43d-47aa-9d5c-770dfd0a4769 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:40.649631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e75ead43-b43d-47aa-9d5c-770dfd0a4769 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:40.650144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e75ead43-b43d-47aa-9d5c-770dfd0a4769 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:40.650585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e75ead43-b43d-47aa-9d5c-770dfd0a4769 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:40.777203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4672aee3-85bd-4219-b65e-dbd394058598 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:40.779168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4672aee3-85bd-4219-b65e-dbd394058598 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: b4332394-4519-4c1d-b5bd-22c1de38fd6e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:40.787063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4672aee3-85bd-4219-b65e-dbd394058598 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:40.787659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4672aee3-85bd-4219-b65e-dbd394058598 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:40.788194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4672aee3-85bd-4219-b65e-dbd394058598 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:40.788959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4672aee3-85bd-4219-b65e-dbd394058598 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:40.789780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4672aee3-85bd-4219-b65e-dbd394058598 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:40.790290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4672aee3-85bd-4219-b65e-dbd394058598 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:40.799062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e75ead43-b43d-47aa-9d5c-770dfd0a4769 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:40.811986 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4672aee3-85bd-4219-b65e-dbd394058598 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] HTTP exception thrown: Instance b4332394-4519-4c1d-b5bd-22c1de38fd6e could not be found. Aug 27 05:08:40.813216 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e75ead43-b43d-47aa-9d5c-770dfd0a4769 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.177565 Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4672aee3-85bd-4219-b65e-dbd394058598 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Request method failure captured: Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e HTTP/1.1 Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaRLmGBWEgwXQ5YrU3e-W09M-LG1_uBsJAS_ya1U9ZYATItKtu2g488KSFy-iTE2V_v7BoakUfBk6IbcG40wQ3Zjfp3X3qOXFXfrymr-WhwLzX-o71ez1rD8Ed7CjlUefvAzorMpVDawtgICzWr1EdH9eXF9QcoonuA5HE1Rfgy_-qk Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 7c34a6245d5c46f6babc0b7775512d84 Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-511432365 Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestNetworkAdvancedServerOps-511432365 Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 7c34a6245d5c46f6babc0b7775512d84 Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-511432365 Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestNetworkAdvancedServerOps-511432365-project Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: e508461869c24fb3ad1641d830e2b22a Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestNetworkAdvancedServerOps-511432365-project Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance b4332394-4519-4c1d-b5bd-22c1de38fd6e could not be found. Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'b4332394-4519-4c1d-b5bd-22c1de38fd6e'} Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4332394-4519-4c1d-b5bd-22c1de38fd6e could not be found. Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4332394-4519-4c1d-b5bd-22c1de38fd6e could not be found. Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:08:40.813842 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:08:40.819417 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:08:40.819417 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:08:40.819417 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:08:40.819417 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:08:40.819417 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:08:40.819417 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:08:40.819417 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4332394-4519-4c1d-b5bd-22c1de38fd6e could not be found. Aug 27 05:08:40.819417 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:08:40.819417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4672aee3-85bd-4219-b65e-dbd394058598 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Returning 404 to user: Instance b4332394-4519-4c1d-b5bd-22c1de38fd6e could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:08:40.819417 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4672aee3-85bd-4219-b65e-dbd394058598 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e" status: 404 len: 111 microversion: 2.1 time: 0.042952 Aug 27 05:08:40.819417 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3014/5975] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:40 2022] GET /compute/v2.1/servers/b4332394-4519-4c1d-b5bd-22c1de38fd6e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:08:40.821693 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2962/5976] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:40 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:42.253617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c7af1fb-9ccd-4513-b221-1bbe081d1b9f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:42.254829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7c7af1fb-9ccd-4513-b221-1bbe081d1b9f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:42.261539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c7af1fb-9ccd-4513-b221-1bbe081d1b9f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:42.262149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c7af1fb-9ccd-4513-b221-1bbe081d1b9f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:42.262849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c7af1fb-9ccd-4513-b221-1bbe081d1b9f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:42.264105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c7af1fb-9ccd-4513-b221-1bbe081d1b9f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:42.264575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c7af1fb-9ccd-4513-b221-1bbe081d1b9f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:42.265259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c7af1fb-9ccd-4513-b221-1bbe081d1b9f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:42.571609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-b954daab-db04-49fe-a033-14d1882db76e req-14d3e7f3-345f-4c4f-b952-f69bd9756fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f54d929-acc6-47f3-96a7-708032ccd9d9", "name": "network-vif-unplugged", "status": "completed", "tag": "060a48ca-cf07-4257-8892-27d740101396"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:42.583684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b954daab-db04-49fe-a033-14d1882db76e req-14d3e7f3-345f-4c4f-b952-f69bd9756fd9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:42.584615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b954daab-db04-49fe-a033-14d1882db76e req-14d3e7f3-345f-4c4f-b952-f69bd9756fd9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:42.585475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b954daab-db04-49fe-a033-14d1882db76e req-14d3e7f3-345f-4c4f-b952-f69bd9756fd9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:42.601015 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b954daab-db04-49fe-a033-14d1882db76e req-14d3e7f3-345f-4c4f-b952-f69bd9756fd9 service nova] Creating event network-vif-unplugged:060a48ca-cf07-4257-8892-27d740101396 for instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 on n-h2-854823-1 Aug 27 05:08:42.609999 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-b954daab-db04-49fe-a033-14d1882db76e req-14d3e7f3-345f-4c4f-b952-f69bd9756fd9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042402 Aug 27 05:08:42.611216 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2963/5977] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:08:42.662533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7c7af1fb-9ccd-4513-b221-1bbe081d1b9f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:42.674755 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7c7af1fb-9ccd-4513-b221-1bbe081d1b9f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.426822 Aug 27 05:08:42.675887 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3015/5978] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:42 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:42.697827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-51d51b56-5070-4c19-b2bb-8ed2259f542c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:42.698907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-51d51b56-5070-4c19-b2bb-8ed2259f542c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:42.707966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51d51b56-5070-4c19-b2bb-8ed2259f542c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:42.709703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51d51b56-5070-4c19-b2bb-8ed2259f542c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:42.710390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51d51b56-5070-4c19-b2bb-8ed2259f542c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:42.711485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51d51b56-5070-4c19-b2bb-8ed2259f542c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:42.713111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51d51b56-5070-4c19-b2bb-8ed2259f542c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:42.713670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51d51b56-5070-4c19-b2bb-8ed2259f542c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:42.885342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-51d51b56-5070-4c19-b2bb-8ed2259f542c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:42.894679 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-51d51b56-5070-4c19-b2bb-8ed2259f542c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.202155 Aug 27 05:08:42.896972 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2964/5979] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:42 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:42.917517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c93a1ec-376a-498e-b83b-08ab907a2f14 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:42.918529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c93a1ec-376a-498e-b83b-08ab907a2f14 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:42.929559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c93a1ec-376a-498e-b83b-08ab907a2f14 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:42.930425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c93a1ec-376a-498e-b83b-08ab907a2f14 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:42.931188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c93a1ec-376a-498e-b83b-08ab907a2f14 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:42.932777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c93a1ec-376a-498e-b83b-08ab907a2f14 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:42.933521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c93a1ec-376a-498e-b83b-08ab907a2f14 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:42.934301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c93a1ec-376a-498e-b83b-08ab907a2f14 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:43.193207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5c93a1ec-376a-498e-b83b-08ab907a2f14 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:43.205254 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c93a1ec-376a-498e-b83b-08ab907a2f14 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.292347 Aug 27 05:08:43.206365 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3016/5980] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:42 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:43.230311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d3fd4e31-fc2c-41d2-99fe-1f0eb0353eb6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:43.233285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d3fd4e31-fc2c-41d2-99fe-1f0eb0353eb6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:43.240476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3fd4e31-fc2c-41d2-99fe-1f0eb0353eb6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:43.241472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3fd4e31-fc2c-41d2-99fe-1f0eb0353eb6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:43.242309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3fd4e31-fc2c-41d2-99fe-1f0eb0353eb6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:43.243356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3fd4e31-fc2c-41d2-99fe-1f0eb0353eb6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:43.244567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3fd4e31-fc2c-41d2-99fe-1f0eb0353eb6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:43.245182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3fd4e31-fc2c-41d2-99fe-1f0eb0353eb6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:43.406007 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d3fd4e31-fc2c-41d2-99fe-1f0eb0353eb6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.181139 Aug 27 05:08:43.406937 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2965/5981] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:08:43 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:08:43.421447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-923e2d97-c5ac-43bc-8b98-c759a513c709 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:43.425703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-923e2d97-c5ac-43bc-8b98-c759a513c709 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:43.459493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-923e2d97-c5ac-43bc-8b98-c759a513c709 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:43.463868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-923e2d97-c5ac-43bc-8b98-c759a513c709 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:43.464638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-923e2d97-c5ac-43bc-8b98-c759a513c709 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:43.466000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-923e2d97-c5ac-43bc-8b98-c759a513c709 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:43.466800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-923e2d97-c5ac-43bc-8b98-c759a513c709 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:43.467443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-923e2d97-c5ac-43bc-8b98-c759a513c709 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:43.786408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-923e2d97-c5ac-43bc-8b98-c759a513c709 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:43.803207 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-923e2d97-c5ac-43bc-8b98-c759a513c709 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1670 microversion: 2.1 time: 0.390028 Aug 27 05:08:43.803846 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3017/5982] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:43 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1670 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:44.828052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-45775eb2-d7f4-45ba-9823-cd7472b93da3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:44.829497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-45775eb2-d7f4-45ba-9823-cd7472b93da3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:44.844366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45775eb2-d7f4-45ba-9823-cd7472b93da3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:44.859094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45775eb2-d7f4-45ba-9823-cd7472b93da3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:44.859781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45775eb2-d7f4-45ba-9823-cd7472b93da3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:44.860634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45775eb2-d7f4-45ba-9823-cd7472b93da3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:44.861140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45775eb2-d7f4-45ba-9823-cd7472b93da3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:44.861852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-45775eb2-d7f4-45ba-9823-cd7472b93da3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.017907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-45775eb2-d7f4-45ba-9823-cd7472b93da3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:45.026629 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-45775eb2-d7f4-45ba-9823-cd7472b93da3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.203040 Aug 27 05:08:45.027208 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2966/5983] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:44 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:45.051061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8bbe2db4-5633-4395-ac29-e5942eba41b5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:45.053656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8bbe2db4-5633-4395-ac29-e5942eba41b5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:45.061930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bbe2db4-5633-4395-ac29-e5942eba41b5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.063004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bbe2db4-5633-4395-ac29-e5942eba41b5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.063473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bbe2db4-5633-4395-ac29-e5942eba41b5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.064194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bbe2db4-5633-4395-ac29-e5942eba41b5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.065085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bbe2db4-5633-4395-ac29-e5942eba41b5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.065530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bbe2db4-5633-4395-ac29-e5942eba41b5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.088305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-78b3d2d7-6068-4871-a59d-261edc02c205 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '.version_select at 0x7f1f25d21ee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:45.115258 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-78b3d2d7-6068-4871-a59d-261edc02c205 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-483116555" status: 202 len: 0 microversion: 2.1 time: 0.031385 Aug 27 05:08:45.116714 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2967/5984] 10.222.0.79 () {58 vars in 1281 bytes} [Sat Aug 27 05:08:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-483116555 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:08:45.136056 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8bbe2db4-5633-4395-ac29-e5942eba41b5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 200 len: 143 microversion: 2.1 time: 0.088792 Aug 27 05:08:45.137498 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3018/5985] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:08:45 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 143 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:45.156569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e2ad97f5-a8f2-4c24-a1ff-4d6b97cd1bad tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'create', calling method: .version_select at 0x7f1f22031af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1106153915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5UAkIe5T0ag6Il1DnJW4seNvqwmRvZ2xg6DOwkarAP5adgCVYHgKi4TsPvpHVyWIRgq14hkVUQFaF31PbuUMKzGjq41BnUhhBvKbzik3VRqw+A34Mu+yc33w61nh6oxQ=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:45.158613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bda9fa49-0778-44a3-9de5-73ab08e94d7a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:45.159738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bda9fa49-0778-44a3-9de5-73ab08e94d7a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:45.174290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bda9fa49-0778-44a3-9de5-73ab08e94d7a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.174823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bda9fa49-0778-44a3-9de5-73ab08e94d7a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.175474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bda9fa49-0778-44a3-9de5-73ab08e94d7a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.176941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bda9fa49-0778-44a3-9de5-73ab08e94d7a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.177638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bda9fa49-0778-44a3-9de5-73ab08e94d7a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.178097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bda9fa49-0778-44a3-9de5-73ab08e94d7a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.185724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-e2ad97f5-a8f2-4c24-a1ff-4d6b97cd1bad tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:08:45.193688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-e2ad97f5-a8f2-4c24-a1ff-4d6b97cd1bad tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for user e508461869c24fb3ad1641d830e2b22a and project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:08:45.233977 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e2ad97f5-a8f2-4c24-a1ff-4d6b97cd1bad tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.087296 Aug 27 05:08:45.234975 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2968/5986] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:08:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:45.385339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bda9fa49-0778-44a3-9de5-73ab08e94d7a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:45.395903 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bda9fa49-0778-44a3-9de5-73ab08e94d7a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.247892 Aug 27 05:08:45.396629 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3019/5987] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:45 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:45.417459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b29d4e29-4074-461e-971e-ba5abbc21e53 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:45.418379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b29d4e29-4074-461e-971e-ba5abbc21e53 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:45.424978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b29d4e29-4074-461e-971e-ba5abbc21e53 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.425470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b29d4e29-4074-461e-971e-ba5abbc21e53 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.426897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b29d4e29-4074-461e-971e-ba5abbc21e53 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.427133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b29d4e29-4074-461e-971e-ba5abbc21e53 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.427608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b29d4e29-4074-461e-971e-ba5abbc21e53 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.428014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b29d4e29-4074-461e-971e-ba5abbc21e53 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.584881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b29d4e29-4074-461e-971e-ba5abbc21e53 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:45.588003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:45.598826 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b29d4e29-4074-461e-971e-ba5abbc21e53 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.184472 Aug 27 05:08:45.600176 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2969/5988] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:45 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:45.620374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f175959b-fa84-45df-9d09-88c7440708cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:45.621066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f175959b-fa84-45df-9d09-88c7440708cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:45.629124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f175959b-fa84-45df-9d09-88c7440708cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.629960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f175959b-fa84-45df-9d09-88c7440708cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.630790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f175959b-fa84-45df-9d09-88c7440708cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.631764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f175959b-fa84-45df-9d09-88c7440708cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.632416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f175959b-fa84-45df-9d09-88c7440708cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.633256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f175959b-fa84-45df-9d09-88c7440708cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.807297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f175959b-fa84-45df-9d09-88c7440708cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:45.809420 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f175959b-fa84-45df-9d09-88c7440708cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.193188 Aug 27 05:08:45.824879 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3020/5989] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:45 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:45.831217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a1f287bf-bff0-44b3-9e41-72e3c2bf721f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:45.832254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a1f287bf-bff0-44b3-9e41-72e3c2bf721f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:45.839737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1f287bf-bff0-44b3-9e41-72e3c2bf721f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.840376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1f287bf-bff0-44b3-9e41-72e3c2bf721f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.840863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1f287bf-bff0-44b3-9e41-72e3c2bf721f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:45.841863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1f287bf-bff0-44b3-9e41-72e3c2bf721f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:45.842344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1f287bf-bff0-44b3-9e41-72e3c2bf721f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:45.842770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a1f287bf-bff0-44b3-9e41-72e3c2bf721f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:46.022365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a1f287bf-bff0-44b3-9e41-72e3c2bf721f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:46.031267 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a1f287bf-bff0-44b3-9e41-72e3c2bf721f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.205113 Aug 27 05:08:46.032149 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2970/5990] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:45 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:46.167914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-973019255", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "3b8ed832-ef0e-4e8a-a972-17542970b368"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:46.236031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] validate_networks() for [('3b8ed832-ef0e-4e8a-a972-17542970b368', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:08:46.692543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:08:46.693005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:08:46.693972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:08:46.694409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:08:46.694851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:08:46.705729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:46.706242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:46.708055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:46.708880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:46.709761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:46.710275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:46.734145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Getting quotas for project 631787d4099e4245be9291f39ff6b2bd. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:08:46.743032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Getting quotas for user c77d065776e448f08f0a1d6fde1aff3c and project 631787d4099e4245be9291f39ff6b2bd. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:08:46.761199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:08:46.763887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:08:46.824575 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-530055f5-9dbc-4222-bc8c-7d4747522b0a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660542 Aug 27 05:08:46.831765 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3021/5991] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:08:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:08:46.838576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31b233e6-99ac-4518-89d2-f124cb40c731 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:46.839242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-31b233e6-99ac-4518-89d2-f124cb40c731 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:46.936607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-31b233e6-99ac-4518-89d2-f124cb40c731 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:46.945260 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-31b233e6-99ac-4518-89d2-f124cb40c731 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1214 microversion: 2.1 time: 0.112375 Aug 27 05:08:46.949118 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2971/5992] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:46 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:47.987527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05a66b1f-c73e-48d8-be6f-e7ade262524c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:47.990352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05a66b1f-c73e-48d8-be6f-e7ade262524c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:48.005042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a66b1f-c73e-48d8-be6f-e7ade262524c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:48.005952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a66b1f-c73e-48d8-be6f-e7ade262524c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:48.006581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a66b1f-c73e-48d8-be6f-e7ade262524c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:48.007530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a66b1f-c73e-48d8-be6f-e7ade262524c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:48.008191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a66b1f-c73e-48d8-be6f-e7ade262524c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:48.009213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a66b1f-c73e-48d8-be6f-e7ade262524c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:48.136956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05a66b1f-c73e-48d8-be6f-e7ade262524c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:48.148680 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05a66b1f-c73e-48d8-be6f-e7ade262524c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1266 microversion: 2.1 time: 0.185019 Aug 27 05:08:48.167342 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3022/5993] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:47 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:49.185859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6b51fc47-b1d9-415a-af58-e04453df57ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:49.188950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6b51fc47-b1d9-415a-af58-e04453df57ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:49.208505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b51fc47-b1d9-415a-af58-e04453df57ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:49.209766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b51fc47-b1d9-415a-af58-e04453df57ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:49.210407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b51fc47-b1d9-415a-af58-e04453df57ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:49.211393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b51fc47-b1d9-415a-af58-e04453df57ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:49.213110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b51fc47-b1d9-415a-af58-e04453df57ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:49.215474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b51fc47-b1d9-415a-af58-e04453df57ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:49.812573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6b51fc47-b1d9-415a-af58-e04453df57ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:49.827442 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6b51fc47-b1d9-415a-af58-e04453df57ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1314 microversion: 2.1 time: 0.652781 Aug 27 05:08:49.828337 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2972/5994] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:49 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1314 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:50.454526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c95612fd-183c-4d48-9197-9db9642327cc req-6feb0d87-4878-4444-b0a0-3ca3248ca0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9d82ec7-fd33-4c19-a1fa-7c315638e864", "tag": "d994e15f-12a7-4d03-8d1f-a78bdfb5f9f3"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:50.465700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c95612fd-183c-4d48-9197-9db9642327cc req-6feb0d87-4878-4444-b0a0-3ca3248ca0e4 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:50.466412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c95612fd-183c-4d48-9197-9db9642327cc req-6feb0d87-4878-4444-b0a0-3ca3248ca0e4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:50.466992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c95612fd-183c-4d48-9197-9db9642327cc req-6feb0d87-4878-4444-b0a0-3ca3248ca0e4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:50.507877 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c95612fd-183c-4d48-9197-9db9642327cc req-6feb0d87-4878-4444-b0a0-3ca3248ca0e4 service nova] Creating event network-changed:d994e15f-12a7-4d03-8d1f-a78bdfb5f9f3 for instance f9d82ec7-fd33-4c19-a1fa-7c315638e864 on n-h1-854823-1 Aug 27 05:08:50.512341 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c95612fd-183c-4d48-9197-9db9642327cc req-6feb0d87-4878-4444-b0a0-3ca3248ca0e4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256354 Aug 27 05:08:50.514393 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3023/5995] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:50.865601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fadefa53-b71d-4d55-83a4-150257828f05 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:50.866384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fadefa53-b71d-4d55-83a4-150257828f05 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:50.881955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fadefa53-b71d-4d55-83a4-150257828f05 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:50.883215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fadefa53-b71d-4d55-83a4-150257828f05 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:50.883829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fadefa53-b71d-4d55-83a4-150257828f05 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:50.884656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fadefa53-b71d-4d55-83a4-150257828f05 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:50.885820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fadefa53-b71d-4d55-83a4-150257828f05 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:50.890998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fadefa53-b71d-4d55-83a4-150257828f05 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:51.475446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fadefa53-b71d-4d55-83a4-150257828f05 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:51.486732 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fadefa53-b71d-4d55-83a4-150257828f05 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1314 microversion: 2.1 time: 0.640042 Aug 27 05:08:51.490640 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2973/5996] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:50 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:52.513836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d207c87-7cd4-493f-ad78-921d73fe29e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:52.514582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d207c87-7cd4-493f-ad78-921d73fe29e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:52.538675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d207c87-7cd4-493f-ad78-921d73fe29e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:52.539233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d207c87-7cd4-493f-ad78-921d73fe29e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:52.539679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d207c87-7cd4-493f-ad78-921d73fe29e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:52.547451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d207c87-7cd4-493f-ad78-921d73fe29e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:52.548253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d207c87-7cd4-493f-ad78-921d73fe29e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:52.548766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d207c87-7cd4-493f-ad78-921d73fe29e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:52.773109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d207c87-7cd4-493f-ad78-921d73fe29e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:52.800489 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d207c87-7cd4-493f-ad78-921d73fe29e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1314 microversion: 2.1 time: 0.294579 Aug 27 05:08:52.806079 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3024/5997] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:52 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:53.767625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-52519144", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "911523f4-9150-4315-a349-92e412e3cfb6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1106153915", "security_groups": [{"name": "tempest-secgroup-smoke-475152574"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:53.830901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea2d3ec7-508b-4e15-b755-de6907cbcc9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:53.832315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea2d3ec7-508b-4e15-b755-de6907cbcc9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:53.849850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea2d3ec7-508b-4e15-b755-de6907cbcc9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:53.850683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea2d3ec7-508b-4e15-b755-de6907cbcc9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:53.852658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea2d3ec7-508b-4e15-b755-de6907cbcc9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:53.853573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea2d3ec7-508b-4e15-b755-de6907cbcc9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:53.863649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea2d3ec7-508b-4e15-b755-de6907cbcc9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:53.864366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea2d3ec7-508b-4e15-b755-de6907cbcc9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:53.927469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] validate_networks() for [('911523f4-9150-4315-a349-92e412e3cfb6', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:08:54.143640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ea2d3ec7-508b-4e15-b755-de6907cbcc9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:54.159261 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea2d3ec7-508b-4e15-b755-de6907cbcc9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1314 microversion: 2.1 time: 0.334033 Aug 27 05:08:54.167454 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3025/5998] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:53 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:54.588435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:08:54.588916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:08:54.589592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:08:54.590021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:08:54.590440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:08:54.603764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:54.604570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:54.605167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:54.606058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:54.606667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:54.607275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:54.632242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:08:54.638106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Getting quotas for user e508461869c24fb3ad1641d830e2b22a and project 7c34a6245d5c46f6babc0b7775512d84. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:08:54.655235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:08:54.659606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:08:54.724981 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7b71c433-dc72-4c66-ac78-a9413e970782 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.961420 Aug 27 05:08:54.732952 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2974/5999] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:08:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:08:54.743791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6cd2410c-2538-409e-bf8d-4225cc91c4b8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:54.745037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6cd2410c-2538-409e-bf8d-4225cc91c4b8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:54.813005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6cd2410c-2538-409e-bf8d-4225cc91c4b8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:54.823015 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6cd2410c-2538-409e-bf8d-4225cc91c4b8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1265 microversion: 2.1 time: 0.089929 Aug 27 05:08:54.837471 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3026/6000] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:54 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:08:55.182975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ce75c4bb-70af-458c-895f-28f57a554a84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:55.183418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ce75c4bb-70af-458c-895f-28f57a554a84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:55.197330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce75c4bb-70af-458c-895f-28f57a554a84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:55.197850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce75c4bb-70af-458c-895f-28f57a554a84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:55.198300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce75c4bb-70af-458c-895f-28f57a554a84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:55.199192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce75c4bb-70af-458c-895f-28f57a554a84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:55.209444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce75c4bb-70af-458c-895f-28f57a554a84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:55.209745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ce75c4bb-70af-458c-895f-28f57a554a84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:55.386516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ce75c4bb-70af-458c-895f-28f57a554a84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:55.396880 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ce75c4bb-70af-458c-895f-28f57a554a84 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1314 microversion: 2.1 time: 0.217745 Aug 27 05:08:55.397935 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2975/6001] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:55 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:55.845456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e60c79e-a198-4be1-bbce-a942764ee8f7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:55.846530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e60c79e-a198-4be1-bbce-a942764ee8f7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:55.855071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e60c79e-a198-4be1-bbce-a942764ee8f7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:55.855578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e60c79e-a198-4be1-bbce-a942764ee8f7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:55.856034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e60c79e-a198-4be1-bbce-a942764ee8f7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:55.856871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e60c79e-a198-4be1-bbce-a942764ee8f7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:55.857484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e60c79e-a198-4be1-bbce-a942764ee8f7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:55.857807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e60c79e-a198-4be1-bbce-a942764ee8f7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:55.923033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0e60c79e-a198-4be1-bbce-a942764ee8f7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:55.931372 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e60c79e-a198-4be1-bbce-a942764ee8f7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1317 microversion: 2.1 time: 0.090553 Aug 27 05:08:55.932273 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3027/6002] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:55 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1317 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:56.419767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7b841a2b-ce29-4991-8828-b31fd9e392f3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:56.421406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7b841a2b-ce29-4991-8828-b31fd9e392f3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:56.435773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b841a2b-ce29-4991-8828-b31fd9e392f3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:56.440190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b841a2b-ce29-4991-8828-b31fd9e392f3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:56.440861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b841a2b-ce29-4991-8828-b31fd9e392f3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:56.442854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b841a2b-ce29-4991-8828-b31fd9e392f3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:56.443464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b841a2b-ce29-4991-8828-b31fd9e392f3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:56.444195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b841a2b-ce29-4991-8828-b31fd9e392f3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:56.742543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b841a2b-ce29-4991-8828-b31fd9e392f3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:56.758225 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7b841a2b-ce29-4991-8828-b31fd9e392f3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1314 microversion: 2.1 time: 0.342672 Aug 27 05:08:56.758856 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2976/6003] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:56 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:56.952869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db02d480-6ab5-4a91-bcb8-9aeabbe9c574 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:56.954210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db02d480-6ab5-4a91-bcb8-9aeabbe9c574 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:56.960163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:56.964045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db02d480-6ab5-4a91-bcb8-9aeabbe9c574 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:56.964737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db02d480-6ab5-4a91-bcb8-9aeabbe9c574 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:56.967115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db02d480-6ab5-4a91-bcb8-9aeabbe9c574 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:56.967910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db02d480-6ab5-4a91-bcb8-9aeabbe9c574 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:56.968431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db02d480-6ab5-4a91-bcb8-9aeabbe9c574 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:56.968916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db02d480-6ab5-4a91-bcb8-9aeabbe9c574 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:57.048301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db02d480-6ab5-4a91-bcb8-9aeabbe9c574 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:57.051788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:57.065322 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db02d480-6ab5-4a91-bcb8-9aeabbe9c574 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1323 microversion: 2.1 time: 0.116759 Aug 27 05:08:57.066503 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3028/6004] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:56 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1323 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:57.780191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b3d18561-70bd-4559-8e71-e74dbdeda234 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:57.781007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b3d18561-70bd-4559-8e71-e74dbdeda234 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:57.788121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3d18561-70bd-4559-8e71-e74dbdeda234 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:57.788859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3d18561-70bd-4559-8e71-e74dbdeda234 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:57.789391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3d18561-70bd-4559-8e71-e74dbdeda234 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:57.790184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3d18561-70bd-4559-8e71-e74dbdeda234 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:57.790837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3d18561-70bd-4559-8e71-e74dbdeda234 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:57.791337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b3d18561-70bd-4559-8e71-e74dbdeda234 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:58.087965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-baddbc23-008a-4035-8c05-41e9d92ebffc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:58.088727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-baddbc23-008a-4035-8c05-41e9d92ebffc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:58.106085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-baddbc23-008a-4035-8c05-41e9d92ebffc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:58.106640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-baddbc23-008a-4035-8c05-41e9d92ebffc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:58.107611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-baddbc23-008a-4035-8c05-41e9d92ebffc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:58.108366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-baddbc23-008a-4035-8c05-41e9d92ebffc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:58.108908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-baddbc23-008a-4035-8c05-41e9d92ebffc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:58.109972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-baddbc23-008a-4035-8c05-41e9d92ebffc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:58.297651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-baddbc23-008a-4035-8c05-41e9d92ebffc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:58.326124 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-baddbc23-008a-4035-8c05-41e9d92ebffc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1390 microversion: 2.1 time: 0.232805 Aug 27 05:08:58.339678 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3029/6005] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:58 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1390 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:58.340267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b3d18561-70bd-4559-8e71-e74dbdeda234 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:58.343661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5d164bd4-a439-4e34-be76-6d435af3f9c7 req-1135e4bc-19bd-4a74-a78b-62643bfa1e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d82ec7-fd33-4c19-a1fa-7c315638e864", "name": "network-vif-plugged", "status": "completed", "tag": "d994e15f-12a7-4d03-8d1f-a78bdfb5f9f3"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:58.348922 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b3d18561-70bd-4559-8e71-e74dbdeda234 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1314 microversion: 2.1 time: 0.573482 Aug 27 05:08:58.355694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5d164bd4-a439-4e34-be76-6d435af3f9c7 req-1135e4bc-19bd-4a74-a78b-62643bfa1e92 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:58.356670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5d164bd4-a439-4e34-be76-6d435af3f9c7 req-1135e4bc-19bd-4a74-a78b-62643bfa1e92 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:58.357398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5d164bd4-a439-4e34-be76-6d435af3f9c7 req-1135e4bc-19bd-4a74-a78b-62643bfa1e92 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:58.361224 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2977/6006] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:57 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:58.372094 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5d164bd4-a439-4e34-be76-6d435af3f9c7 req-1135e4bc-19bd-4a74-a78b-62643bfa1e92 service nova] Creating event network-vif-plugged:d994e15f-12a7-4d03-8d1f-a78bdfb5f9f3 for instance f9d82ec7-fd33-4c19-a1fa-7c315638e864 on n-h1-854823-1 Aug 27 05:08:58.377364 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5d164bd4-a439-4e34-be76-6d435af3f9c7 req-1135e4bc-19bd-4a74-a78b-62643bfa1e92 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046366 Aug 27 05:08:58.378150 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3030/6007] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:58.627336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d1281313-9d2a-4c56-b873-742692dcefb3 req-7de2cf8e-a5c8-4117-bc2d-d2aec6124036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa772619-856a-4d48-981c-e4f2cdd39e29", "tag": "2be38a72-a68a-4e59-9f92-1a716c927f84"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:08:58.637472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d1281313-9d2a-4c56-b873-742692dcefb3 req-7de2cf8e-a5c8-4117-bc2d-d2aec6124036 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:58.638169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d1281313-9d2a-4c56-b873-742692dcefb3 req-7de2cf8e-a5c8-4117-bc2d-d2aec6124036 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:58.638742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d1281313-9d2a-4c56-b873-742692dcefb3 req-7de2cf8e-a5c8-4117-bc2d-d2aec6124036 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:58.650761 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d1281313-9d2a-4c56-b873-742692dcefb3 req-7de2cf8e-a5c8-4117-bc2d-d2aec6124036 service nova] Creating event network-changed:2be38a72-a68a-4e59-9f92-1a716c927f84 for instance aa772619-856a-4d48-981c-e4f2cdd39e29 on n-h2-854823-1 Aug 27 05:08:58.655555 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d1281313-9d2a-4c56-b873-742692dcefb3 req-7de2cf8e-a5c8-4117-bc2d-d2aec6124036 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154354 Aug 27 05:08:58.656300 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2978/6008] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:08:59.351227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94f65ef1-101b-42ca-8e9e-7b32068a9133 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:59.351966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94f65ef1-101b-42ca-8e9e-7b32068a9133 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:59.373644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94f65ef1-101b-42ca-8e9e-7b32068a9133 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:59.374166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94f65ef1-101b-42ca-8e9e-7b32068a9133 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:59.374633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94f65ef1-101b-42ca-8e9e-7b32068a9133 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:59.375539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-31a8395c-5ab6-4af1-b1ae-75998066c32d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:08:59.375981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94f65ef1-101b-42ca-8e9e-7b32068a9133 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:59.376052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94f65ef1-101b-42ca-8e9e-7b32068a9133 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:59.376366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-31a8395c-5ab6-4af1-b1ae-75998066c32d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:08:59.376467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94f65ef1-101b-42ca-8e9e-7b32068a9133 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:59.379185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:59.385738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31a8395c-5ab6-4af1-b1ae-75998066c32d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:59.386338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31a8395c-5ab6-4af1-b1ae-75998066c32d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:59.386851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31a8395c-5ab6-4af1-b1ae-75998066c32d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:59.387643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31a8395c-5ab6-4af1-b1ae-75998066c32d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:08:59.388171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31a8395c-5ab6-4af1-b1ae-75998066c32d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:08:59.388731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-31a8395c-5ab6-4af1-b1ae-75998066c32d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:08:59.536061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94f65ef1-101b-42ca-8e9e-7b32068a9133 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:59.544349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-31a8395c-5ab6-4af1-b1ae-75998066c32d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:08:59.553755 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-31a8395c-5ab6-4af1-b1ae-75998066c32d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1314 microversion: 2.1 time: 0.185999 Aug 27 05:08:59.554571 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2979/6009] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:59 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:08:59.560978 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94f65ef1-101b-42ca-8e9e-7b32068a9133 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1390 microversion: 2.1 time: 0.214646 Aug 27 05:08:59.561577 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3031/6010] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:08:59 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1390 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:00.575239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a7c25224-f69c-4257-843c-6407d97edacf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:00.576028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a7c25224-f69c-4257-843c-6407d97edacf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:00.583116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbc46de0-8a6f-4b4d-ad19-434bcdef0da5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:00.583647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bbc46de0-8a6f-4b4d-ad19-434bcdef0da5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:00.594917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7c25224-f69c-4257-843c-6407d97edacf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:00.596403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbc46de0-8a6f-4b4d-ad19-434bcdef0da5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:00.598297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbc46de0-8a6f-4b4d-ad19-434bcdef0da5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:00.598750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbc46de0-8a6f-4b4d-ad19-434bcdef0da5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:00.599484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbc46de0-8a6f-4b4d-ad19-434bcdef0da5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:00.602017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7c25224-f69c-4257-843c-6407d97edacf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:00.602577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7c25224-f69c-4257-843c-6407d97edacf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:00.603295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7c25224-f69c-4257-843c-6407d97edacf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:00.603750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7c25224-f69c-4257-843c-6407d97edacf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:00.604172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7c25224-f69c-4257-843c-6407d97edacf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:00.605141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbc46de0-8a6f-4b4d-ad19-434bcdef0da5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:00.605610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbc46de0-8a6f-4b4d-ad19-434bcdef0da5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:00.765035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bbc46de0-8a6f-4b4d-ad19-434bcdef0da5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:00.774469 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bbc46de0-8a6f-4b4d-ad19-434bcdef0da5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1390 microversion: 2.1 time: 0.194916 Aug 27 05:09:00.775433 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3032/6011] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:00 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1390 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:00.796511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a7c25224-f69c-4257-843c-6407d97edacf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:00.806665 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a7c25224-f69c-4257-843c-6407d97edacf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1500 microversion: 2.1 time: 0.235176 Aug 27 05:09:00.807256 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2980/6012] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:00 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1500 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:00.829349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20d00abb-3b17-4b03-b3e6-1b7e5078df40 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:00.835471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d00abb-3b17-4b03-b3e6-1b7e5078df40 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:00.835914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d00abb-3b17-4b03-b3e6-1b7e5078df40 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:00.836362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d00abb-3b17-4b03-b3e6-1b7e5078df40 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:00.859971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20d00abb-3b17-4b03-b3e6-1b7e5078df40 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Going to try to stop instance {{(pid=128869) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:09:00.902582 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20d00abb-3b17-4b03-b3e6-1b7e5078df40 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864/action" status: 202 len: 0 microversion: 2.1 time: 0.078468 Aug 27 05:09:00.906941 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3033/6013] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:00 2022] POST /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:09:00.913099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-00a679ea-2054-4835-a1b3-c1190048043f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:00.913738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-00a679ea-2054-4835-a1b3-c1190048043f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:00.921184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00a679ea-2054-4835-a1b3-c1190048043f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:00.921714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00a679ea-2054-4835-a1b3-c1190048043f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:00.922149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00a679ea-2054-4835-a1b3-c1190048043f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:00.922937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00a679ea-2054-4835-a1b3-c1190048043f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:00.923413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00a679ea-2054-4835-a1b3-c1190048043f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:00.923949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00a679ea-2054-4835-a1b3-c1190048043f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:01.080679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-00a679ea-2054-4835-a1b3-c1190048043f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:01.091979 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-00a679ea-2054-4835-a1b3-c1190048043f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.183815 Aug 27 05:09:01.093025 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2981/6014] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:00 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:01.801645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0f912b2-fe7c-42b6-8ecc-eaeaf1e9b0f6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:01.802734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a0f912b2-fe7c-42b6-8ecc-eaeaf1e9b0f6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:01.810328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0f912b2-fe7c-42b6-8ecc-eaeaf1e9b0f6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:01.810845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0f912b2-fe7c-42b6-8ecc-eaeaf1e9b0f6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:01.811307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0f912b2-fe7c-42b6-8ecc-eaeaf1e9b0f6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:01.812067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0f912b2-fe7c-42b6-8ecc-eaeaf1e9b0f6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:01.812607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0f912b2-fe7c-42b6-8ecc-eaeaf1e9b0f6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:01.813019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0f912b2-fe7c-42b6-8ecc-eaeaf1e9b0f6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:01.947276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a0f912b2-fe7c-42b6-8ecc-eaeaf1e9b0f6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:01.955575 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0f912b2-fe7c-42b6-8ecc-eaeaf1e9b0f6 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1390 microversion: 2.1 time: 0.159662 Aug 27 05:09:01.956444 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3034/6015] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:01 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:02.113847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-08c0f093-37d7-4cbf-b1b6-e1549197dd87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:02.114408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-08c0f093-37d7-4cbf-b1b6-e1549197dd87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:02.121491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c0f093-37d7-4cbf-b1b6-e1549197dd87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.122142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c0f093-37d7-4cbf-b1b6-e1549197dd87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.122791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c0f093-37d7-4cbf-b1b6-e1549197dd87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.123488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c0f093-37d7-4cbf-b1b6-e1549197dd87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.123948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c0f093-37d7-4cbf-b1b6-e1549197dd87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.124374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08c0f093-37d7-4cbf-b1b6-e1549197dd87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.262996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-08c0f093-37d7-4cbf-b1b6-e1549197dd87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:02.271556 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-08c0f093-37d7-4cbf-b1b6-e1549197dd87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.161626 Aug 27 05:09:02.272141 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2982/6016] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:02 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:02.674179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6a3bd040-7d19-4c40-a728-c49dca607205 req-d3430959-ea4b-49ab-9571-d1c5b538c72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa772619-856a-4d48-981c-e4f2cdd39e29", "name": "network-vif-plugged", "status": "completed", "tag": "2be38a72-a68a-4e59-9f92-1a716c927f84"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:02.685817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6a3bd040-7d19-4c40-a728-c49dca607205 req-d3430959-ea4b-49ab-9571-d1c5b538c72a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.686324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6a3bd040-7d19-4c40-a728-c49dca607205 req-d3430959-ea4b-49ab-9571-d1c5b538c72a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.687351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6a3bd040-7d19-4c40-a728-c49dca607205 req-d3430959-ea4b-49ab-9571-d1c5b538c72a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.699731 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6a3bd040-7d19-4c40-a728-c49dca607205 req-d3430959-ea4b-49ab-9571-d1c5b538c72a service nova] Creating event network-vif-plugged:2be38a72-a68a-4e59-9f92-1a716c927f84 for instance aa772619-856a-4d48-981c-e4f2cdd39e29 on n-h2-854823-1 Aug 27 05:09:02.704755 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6a3bd040-7d19-4c40-a728-c49dca607205 req-d3430959-ea4b-49ab-9571-d1c5b538c72a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034347 Aug 27 05:09:02.706273 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3035/6017] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:02.976675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f0fe3b03-9f06-4cef-936e-70f25cab9e8b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:02.977299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f0fe3b03-9f06-4cef-936e-70f25cab9e8b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:02.983382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0fe3b03-9f06-4cef-936e-70f25cab9e8b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.983896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0fe3b03-9f06-4cef-936e-70f25cab9e8b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.984338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0fe3b03-9f06-4cef-936e-70f25cab9e8b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:02.985065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0fe3b03-9f06-4cef-936e-70f25cab9e8b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:02.985528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0fe3b03-9f06-4cef-936e-70f25cab9e8b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:02.985960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0fe3b03-9f06-4cef-936e-70f25cab9e8b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:03.132781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f0fe3b03-9f06-4cef-936e-70f25cab9e8b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:03.140564 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f0fe3b03-9f06-4cef-936e-70f25cab9e8b tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1390 microversion: 2.1 time: 0.167898 Aug 27 05:09:03.141134 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2983/6018] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:02 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:03.293239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99e6b0e0-64b9-4f5e-80b4-f47504757b4d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:03.294064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99e6b0e0-64b9-4f5e-80b4-f47504757b4d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:03.302395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99e6b0e0-64b9-4f5e-80b4-f47504757b4d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:03.302997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99e6b0e0-64b9-4f5e-80b4-f47504757b4d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:03.303509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99e6b0e0-64b9-4f5e-80b4-f47504757b4d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:03.304343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99e6b0e0-64b9-4f5e-80b4-f47504757b4d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:03.304899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99e6b0e0-64b9-4f5e-80b4-f47504757b4d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:03.305438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99e6b0e0-64b9-4f5e-80b4-f47504757b4d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:03.498584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99e6b0e0-64b9-4f5e-80b4-f47504757b4d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:03.507201 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99e6b0e0-64b9-4f5e-80b4-f47504757b4d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.218344 Aug 27 05:09:03.507795 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3036/6019] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:03 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:04.161538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5a37c03a-43cf-4b2b-8131-534c62cee9c0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:04.162219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5a37c03a-43cf-4b2b-8131-534c62cee9c0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:04.169362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a37c03a-43cf-4b2b-8131-534c62cee9c0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:04.169866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a37c03a-43cf-4b2b-8131-534c62cee9c0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:04.170312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a37c03a-43cf-4b2b-8131-534c62cee9c0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:04.171025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a37c03a-43cf-4b2b-8131-534c62cee9c0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:04.171660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a37c03a-43cf-4b2b-8131-534c62cee9c0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:04.172093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a37c03a-43cf-4b2b-8131-534c62cee9c0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:04.320992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5a37c03a-43cf-4b2b-8131-534c62cee9c0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:04.330693 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5a37c03a-43cf-4b2b-8131-534c62cee9c0 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1390 microversion: 2.1 time: 0.173063 Aug 27 05:09:04.331280 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2984/6020] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:04 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:04.528615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-459359b1-0bb2-4e0e-a297-cc8b166b9ae0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:04.529242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-459359b1-0bb2-4e0e-a297-cc8b166b9ae0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:04.535751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-459359b1-0bb2-4e0e-a297-cc8b166b9ae0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:04.536248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-459359b1-0bb2-4e0e-a297-cc8b166b9ae0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:04.536723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-459359b1-0bb2-4e0e-a297-cc8b166b9ae0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:04.537427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-459359b1-0bb2-4e0e-a297-cc8b166b9ae0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:04.537893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-459359b1-0bb2-4e0e-a297-cc8b166b9ae0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:04.538326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-459359b1-0bb2-4e0e-a297-cc8b166b9ae0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:04.670320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-459359b1-0bb2-4e0e-a297-cc8b166b9ae0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:04.678535 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-459359b1-0bb2-4e0e-a297-cc8b166b9ae0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.154026 Aug 27 05:09:04.679317 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3037/6021] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:04 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:05.352093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6688d961-be63-4485-bd6c-c6a8c3e1ccb4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:05.352746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6688d961-be63-4485-bd6c-c6a8c3e1ccb4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:05.354645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:05.355320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=12 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:05.363546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6688d961-be63-4485-bd6c-c6a8c3e1ccb4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:05.363983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6688d961-be63-4485-bd6c-c6a8c3e1ccb4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:05.364427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6688d961-be63-4485-bd6c-c6a8c3e1ccb4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:05.365163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6688d961-be63-4485-bd6c-c6a8c3e1ccb4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:05.365628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6688d961-be63-4485-bd6c-c6a8c3e1ccb4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:05.366061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6688d961-be63-4485-bd6c-c6a8c3e1ccb4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:05.504900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6688d961-be63-4485-bd6c-c6a8c3e1ccb4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:05.513179 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6688d961-be63-4485-bd6c-c6a8c3e1ccb4 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1561 microversion: 2.1 time: 0.165003 Aug 27 05:09:05.513969 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2985/6022] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:05 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:05.538710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd708b11-4198-442b-a45e-41d5a1352647 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:05.541218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd708b11-4198-442b-a45e-41d5a1352647 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:05.544646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:05.549333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd708b11-4198-442b-a45e-41d5a1352647 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:05.550093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd708b11-4198-442b-a45e-41d5a1352647 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:05.551519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd708b11-4198-442b-a45e-41d5a1352647 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:05.551519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd708b11-4198-442b-a45e-41d5a1352647 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:05.551839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd708b11-4198-442b-a45e-41d5a1352647 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:05.552276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd708b11-4198-442b-a45e-41d5a1352647 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:05.693045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd708b11-4198-442b-a45e-41d5a1352647 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:05.699257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a6e17be2-5a76-4a6f-87f1-0a1a645654f8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:05.700287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a6e17be2-5a76-4a6f-87f1-0a1a645654f8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:05.701317 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd708b11-4198-442b-a45e-41d5a1352647 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1561 microversion: 2.1 time: 0.167461 Aug 27 05:09:05.701902 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3038/6023] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:05 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:05.707399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6e17be2-5a76-4a6f-87f1-0a1a645654f8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:05.707968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6e17be2-5a76-4a6f-87f1-0a1a645654f8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:05.708479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6e17be2-5a76-4a6f-87f1-0a1a645654f8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:05.709277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6e17be2-5a76-4a6f-87f1-0a1a645654f8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:05.709849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6e17be2-5a76-4a6f-87f1-0a1a645654f8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:05.710346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6e17be2-5a76-4a6f-87f1-0a1a645654f8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:05.895177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a6e17be2-5a76-4a6f-87f1-0a1a645654f8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:05.904643 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a6e17be2-5a76-4a6f-87f1-0a1a645654f8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.209148 Aug 27 05:09:05.918124 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2986/6024] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:05 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:06.926801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-791c13e9-2a3a-42c7-b976-d887363fe3e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:06.928029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-791c13e9-2a3a-42c7-b976-d887363fe3e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:06.931978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:06.935596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791c13e9-2a3a-42c7-b976-d887363fe3e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:06.935943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791c13e9-2a3a-42c7-b976-d887363fe3e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:06.936656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791c13e9-2a3a-42c7-b976-d887363fe3e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:06.937521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791c13e9-2a3a-42c7-b976-d887363fe3e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:06.937994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791c13e9-2a3a-42c7-b976-d887363fe3e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:06.938429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791c13e9-2a3a-42c7-b976-d887363fe3e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:07.163094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-791c13e9-2a3a-42c7-b976-d887363fe3e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:07.172031 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-791c13e9-2a3a-42c7-b976-d887363fe3e6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.249558 Aug 27 05:09:07.172811 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3039/6025] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:06 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:07.874949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0ecc3682-ec1d-4d48-92cd-663f7705bcad req-5fdf02ea-dbc1-46d6-86e4-3ae63676bc54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa772619-856a-4d48-981c-e4f2cdd39e29", "tag": "2be38a72-a68a-4e59-9f92-1a716c927f84"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:07.875761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ccbe086a-c12f-46db-b5b1-24b239f0d628 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:07.883755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ccbe086a-c12f-46db-b5b1-24b239f0d628 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:07.887493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0ecc3682-ec1d-4d48-92cd-663f7705bcad req-5fdf02ea-dbc1-46d6-86e4-3ae63676bc54 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:07.888165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0ecc3682-ec1d-4d48-92cd-663f7705bcad req-5fdf02ea-dbc1-46d6-86e4-3ae63676bc54 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:07.888974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0ecc3682-ec1d-4d48-92cd-663f7705bcad req-5fdf02ea-dbc1-46d6-86e4-3ae63676bc54 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:07.891191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccbe086a-c12f-46db-b5b1-24b239f0d628 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:07.891989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccbe086a-c12f-46db-b5b1-24b239f0d628 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:07.892615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccbe086a-c12f-46db-b5b1-24b239f0d628 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:07.894749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccbe086a-c12f-46db-b5b1-24b239f0d628 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:07.895142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccbe086a-c12f-46db-b5b1-24b239f0d628 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:07.895781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ccbe086a-c12f-46db-b5b1-24b239f0d628 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:07.903283 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0ecc3682-ec1d-4d48-92cd-663f7705bcad req-5fdf02ea-dbc1-46d6-86e4-3ae63676bc54 service nova] Creating event network-changed:2be38a72-a68a-4e59-9f92-1a716c927f84 for instance aa772619-856a-4d48-981c-e4f2cdd39e29 on n-h2-854823-1 Aug 27 05:09:07.910051 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0ecc3682-ec1d-4d48-92cd-663f7705bcad req-5fdf02ea-dbc1-46d6-86e4-3ae63676bc54 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041805 Aug 27 05:09:07.910784 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3040/6026] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:08.087565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ccbe086a-c12f-46db-b5b1-24b239f0d628 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:08.102164 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ccbe086a-c12f-46db-b5b1-24b239f0d628 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1561 microversion: 2.1 time: 0.236765 Aug 27 05:09:08.119921 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2987/6027] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:07 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1561 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:08.198559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95e4d7e6-bc5c-484d-8d1a-0d0479a3751d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:08.199779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95e4d7e6-bc5c-484d-8d1a-0d0479a3751d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:08.214117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95e4d7e6-bc5c-484d-8d1a-0d0479a3751d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:08.214657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95e4d7e6-bc5c-484d-8d1a-0d0479a3751d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:08.215124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95e4d7e6-bc5c-484d-8d1a-0d0479a3751d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:08.216459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95e4d7e6-bc5c-484d-8d1a-0d0479a3751d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:08.216459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95e4d7e6-bc5c-484d-8d1a-0d0479a3751d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:08.217046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95e4d7e6-bc5c-484d-8d1a-0d0479a3751d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:08.432996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95e4d7e6-bc5c-484d-8d1a-0d0479a3751d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:08.442483 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95e4d7e6-bc5c-484d-8d1a-0d0479a3751d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.253147 Aug 27 05:09:08.443089 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3041/6028] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:08 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:09.465318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d44673f1-413f-41bc-bbbe-0cdf99c5b270 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:09.466094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d44673f1-413f-41bc-bbbe-0cdf99c5b270 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:09.473982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d44673f1-413f-41bc-bbbe-0cdf99c5b270 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:09.474473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d44673f1-413f-41bc-bbbe-0cdf99c5b270 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:09.474908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d44673f1-413f-41bc-bbbe-0cdf99c5b270 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:09.475616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d44673f1-413f-41bc-bbbe-0cdf99c5b270 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:09.476074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d44673f1-413f-41bc-bbbe-0cdf99c5b270 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:09.476504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d44673f1-413f-41bc-bbbe-0cdf99c5b270 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:09.622820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d44673f1-413f-41bc-bbbe-0cdf99c5b270 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:09.625100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:09.632496 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d44673f1-413f-41bc-bbbe-0cdf99c5b270 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.171238 Aug 27 05:09:09.633324 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2988/6029] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:09 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:10.653667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bfdd8265-33a9-4c23-b52a-73e791322523 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:10.654302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bfdd8265-33a9-4c23-b52a-73e791322523 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:10.661843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfdd8265-33a9-4c23-b52a-73e791322523 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:10.662356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfdd8265-33a9-4c23-b52a-73e791322523 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:10.662815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfdd8265-33a9-4c23-b52a-73e791322523 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:10.663542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfdd8265-33a9-4c23-b52a-73e791322523 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:10.664024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfdd8265-33a9-4c23-b52a-73e791322523 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:10.664470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfdd8265-33a9-4c23-b52a-73e791322523 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:10.804643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bfdd8265-33a9-4c23-b52a-73e791322523 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:10.812773 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bfdd8265-33a9-4c23-b52a-73e791322523 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.163027 Aug 27 05:09:10.813367 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3042/6030] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:10 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:11.834728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-105732e7-b755-45be-ae53-287af436f460 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:11.835351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-105732e7-b755-45be-ae53-287af436f460 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:11.842670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-105732e7-b755-45be-ae53-287af436f460 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:11.843155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-105732e7-b755-45be-ae53-287af436f460 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:11.843601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-105732e7-b755-45be-ae53-287af436f460 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:11.844303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-105732e7-b755-45be-ae53-287af436f460 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:11.844806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-105732e7-b755-45be-ae53-287af436f460 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:11.845237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-105732e7-b755-45be-ae53-287af436f460 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:11.982576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-105732e7-b755-45be-ae53-287af436f460 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:11.992028 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-105732e7-b755-45be-ae53-287af436f460 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.161720 Aug 27 05:09:11.993211 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2989/6031] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:11 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:13.017065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aff9e4c2-70ae-4b7f-ba03-49eff38f5ebd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:13.017840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aff9e4c2-70ae-4b7f-ba03-49eff38f5ebd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:13.031684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aff9e4c2-70ae-4b7f-ba03-49eff38f5ebd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:13.032207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aff9e4c2-70ae-4b7f-ba03-49eff38f5ebd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:13.032700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aff9e4c2-70ae-4b7f-ba03-49eff38f5ebd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:13.033652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aff9e4c2-70ae-4b7f-ba03-49eff38f5ebd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:13.034962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aff9e4c2-70ae-4b7f-ba03-49eff38f5ebd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:13.035569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aff9e4c2-70ae-4b7f-ba03-49eff38f5ebd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:13.189082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aff9e4c2-70ae-4b7f-ba03-49eff38f5ebd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:13.204506 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aff9e4c2-70ae-4b7f-ba03-49eff38f5ebd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.192681 Aug 27 05:09:13.206559 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3043/6032] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:13 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:14.227642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c69cc439-78cd-4c97-b7e2-5807e6187fea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:14.228872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c69cc439-78cd-4c97-b7e2-5807e6187fea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:14.236509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c69cc439-78cd-4c97-b7e2-5807e6187fea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:14.237161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c69cc439-78cd-4c97-b7e2-5807e6187fea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:14.237639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c69cc439-78cd-4c97-b7e2-5807e6187fea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:14.238351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c69cc439-78cd-4c97-b7e2-5807e6187fea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:14.238832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c69cc439-78cd-4c97-b7e2-5807e6187fea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:14.239431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c69cc439-78cd-4c97-b7e2-5807e6187fea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:14.403907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c69cc439-78cd-4c97-b7e2-5807e6187fea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:14.412815 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c69cc439-78cd-4c97-b7e2-5807e6187fea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.189631 Aug 27 05:09:14.413718 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2990/6033] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:14 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:15.435252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-139fcfb2-a2c2-4ee8-ab81-1d0de1b47017 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:15.435876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-139fcfb2-a2c2-4ee8-ab81-1d0de1b47017 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:15.443539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-139fcfb2-a2c2-4ee8-ab81-1d0de1b47017 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:15.444040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-139fcfb2-a2c2-4ee8-ab81-1d0de1b47017 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:15.444490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-139fcfb2-a2c2-4ee8-ab81-1d0de1b47017 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:15.445230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-139fcfb2-a2c2-4ee8-ab81-1d0de1b47017 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:15.445696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-139fcfb2-a2c2-4ee8-ab81-1d0de1b47017 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:15.446131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-139fcfb2-a2c2-4ee8-ab81-1d0de1b47017 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:15.581032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-139fcfb2-a2c2-4ee8-ab81-1d0de1b47017 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:15.588987 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-139fcfb2-a2c2-4ee8-ab81-1d0de1b47017 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.157675 Aug 27 05:09:15.589575 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3044/6034] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:15 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:16.610524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2d69abac-dd7a-4b98-a2dd-67d55dadbba7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:16.611153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2d69abac-dd7a-4b98-a2dd-67d55dadbba7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:16.618693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d69abac-dd7a-4b98-a2dd-67d55dadbba7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:16.619229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d69abac-dd7a-4b98-a2dd-67d55dadbba7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:16.619651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d69abac-dd7a-4b98-a2dd-67d55dadbba7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:16.620288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d69abac-dd7a-4b98-a2dd-67d55dadbba7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:16.620771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d69abac-dd7a-4b98-a2dd-67d55dadbba7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:16.621230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d69abac-dd7a-4b98-a2dd-67d55dadbba7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:16.760207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2d69abac-dd7a-4b98-a2dd-67d55dadbba7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:16.767936 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2d69abac-dd7a-4b98-a2dd-67d55dadbba7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.161443 Aug 27 05:09:16.769185 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2991/6035] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:16 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:17.789435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-646a0f22-77c8-4a98-8a10-94c7f12ee6ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:17.790073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-646a0f22-77c8-4a98-8a10-94c7f12ee6ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:17.797430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-646a0f22-77c8-4a98-8a10-94c7f12ee6ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:17.797947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-646a0f22-77c8-4a98-8a10-94c7f12ee6ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:17.798401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-646a0f22-77c8-4a98-8a10-94c7f12ee6ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:17.799124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-646a0f22-77c8-4a98-8a10-94c7f12ee6ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:17.799628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-646a0f22-77c8-4a98-8a10-94c7f12ee6ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:17.800050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-646a0f22-77c8-4a98-8a10-94c7f12ee6ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:17.938886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-646a0f22-77c8-4a98-8a10-94c7f12ee6ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:17.947585 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-646a0f22-77c8-4a98-8a10-94c7f12ee6ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.162153 Aug 27 05:09:17.948179 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3045/6036] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:17 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:18.967693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e019b354-779b-4d4a-ab71-fd7985097221 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:18.968319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e019b354-779b-4d4a-ab71-fd7985097221 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:18.975972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e019b354-779b-4d4a-ab71-fd7985097221 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:18.976463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e019b354-779b-4d4a-ab71-fd7985097221 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:18.976975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e019b354-779b-4d4a-ab71-fd7985097221 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:18.977758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e019b354-779b-4d4a-ab71-fd7985097221 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:18.978226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e019b354-779b-4d4a-ab71-fd7985097221 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:18.978663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e019b354-779b-4d4a-ab71-fd7985097221 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:19.117227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e019b354-779b-4d4a-ab71-fd7985097221 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:19.126537 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e019b354-779b-4d4a-ab71-fd7985097221 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.162696 Aug 27 05:09:19.127210 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2992/6037] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:18 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:20.147261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c488153-ad12-464e-ac7e-04931b1ddf90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:20.147954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7c488153-ad12-464e-ac7e-04931b1ddf90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:20.155002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c488153-ad12-464e-ac7e-04931b1ddf90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:20.155507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c488153-ad12-464e-ac7e-04931b1ddf90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:20.155962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c488153-ad12-464e-ac7e-04931b1ddf90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:20.156703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c488153-ad12-464e-ac7e-04931b1ddf90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:20.157170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c488153-ad12-464e-ac7e-04931b1ddf90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:20.157609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c488153-ad12-464e-ac7e-04931b1ddf90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:20.174524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:20.301685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7c488153-ad12-464e-ac7e-04931b1ddf90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:20.309988 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7c488153-ad12-464e-ac7e-04931b1ddf90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.166628 Aug 27 05:09:20.310573 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3046/6038] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:20 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:21.331018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-74b39faf-d078-4af7-a28b-0f3323ceef47 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:21.331641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-74b39faf-d078-4af7-a28b-0f3323ceef47 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:21.338814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74b39faf-d078-4af7-a28b-0f3323ceef47 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:21.339305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74b39faf-d078-4af7-a28b-0f3323ceef47 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:21.339748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74b39faf-d078-4af7-a28b-0f3323ceef47 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:21.340523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74b39faf-d078-4af7-a28b-0f3323ceef47 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:21.341018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74b39faf-d078-4af7-a28b-0f3323ceef47 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:21.341447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74b39faf-d078-4af7-a28b-0f3323ceef47 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:21.474706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-74b39faf-d078-4af7-a28b-0f3323ceef47 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:21.482992 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-74b39faf-d078-4af7-a28b-0f3323ceef47 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.155829 Aug 27 05:09:21.483789 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2993/6039] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:21 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:22.505343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc505656-1fe0-4fb1-b941-8343583ba425 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:22.505973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fc505656-1fe0-4fb1-b941-8343583ba425 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:22.519792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc505656-1fe0-4fb1-b941-8343583ba425 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:22.520489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc505656-1fe0-4fb1-b941-8343583ba425 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:22.521004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc505656-1fe0-4fb1-b941-8343583ba425 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:22.521738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc505656-1fe0-4fb1-b941-8343583ba425 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:22.522218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc505656-1fe0-4fb1-b941-8343583ba425 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:22.522665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc505656-1fe0-4fb1-b941-8343583ba425 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:22.654418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fc505656-1fe0-4fb1-b941-8343583ba425 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:22.662529 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc505656-1fe0-4fb1-b941-8343583ba425 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.161637 Aug 27 05:09:22.663124 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3047/6040] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:22 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:23.683244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fe0a56e5-e851-402a-b44b-23694f19dc0e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:23.683867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fe0a56e5-e851-402a-b44b-23694f19dc0e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:23.691405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe0a56e5-e851-402a-b44b-23694f19dc0e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:23.691896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe0a56e5-e851-402a-b44b-23694f19dc0e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:23.692342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe0a56e5-e851-402a-b44b-23694f19dc0e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:23.693200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe0a56e5-e851-402a-b44b-23694f19dc0e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:23.693666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe0a56e5-e851-402a-b44b-23694f19dc0e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:23.694096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe0a56e5-e851-402a-b44b-23694f19dc0e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:23.829528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fe0a56e5-e851-402a-b44b-23694f19dc0e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:23.837508 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fe0a56e5-e851-402a-b44b-23694f19dc0e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.158158 Aug 27 05:09:23.838097 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2994/6041] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:23 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:24.858486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a204a6c2-316f-40e2-819b-d475f8403781 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:24.859132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a204a6c2-316f-40e2-819b-d475f8403781 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:24.866852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a204a6c2-316f-40e2-819b-d475f8403781 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:24.867363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a204a6c2-316f-40e2-819b-d475f8403781 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:24.867822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a204a6c2-316f-40e2-819b-d475f8403781 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:24.868555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a204a6c2-316f-40e2-819b-d475f8403781 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:24.869071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a204a6c2-316f-40e2-819b-d475f8403781 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:24.869502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a204a6c2-316f-40e2-819b-d475f8403781 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:25.003253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a204a6c2-316f-40e2-819b-d475f8403781 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:25.011279 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a204a6c2-316f-40e2-819b-d475f8403781 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.156740 Aug 27 05:09:25.012092 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3048/6042] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:24 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:26.033122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a9a9741a-c864-479e-828d-eae731fe5cc4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:26.033743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a9a9741a-c864-479e-828d-eae731fe5cc4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:26.041417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9a9741a-c864-479e-828d-eae731fe5cc4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:26.041908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9a9741a-c864-479e-828d-eae731fe5cc4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:26.042350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9a9741a-c864-479e-828d-eae731fe5cc4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:26.043071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9a9741a-c864-479e-828d-eae731fe5cc4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:26.043537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9a9741a-c864-479e-828d-eae731fe5cc4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:26.043962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9a9741a-c864-479e-828d-eae731fe5cc4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:26.178894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a9a9741a-c864-479e-828d-eae731fe5cc4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:26.186852 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a9a9741a-c864-479e-828d-eae731fe5cc4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.157775 Aug 27 05:09:26.187437 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2995/6043] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:26 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:27.208841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a46bb32-787b-4f8f-a205-43119fa3c32b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:27.209502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5a46bb32-787b-4f8f-a205-43119fa3c32b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:27.216545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a46bb32-787b-4f8f-a205-43119fa3c32b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:27.217060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a46bb32-787b-4f8f-a205-43119fa3c32b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:27.217514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a46bb32-787b-4f8f-a205-43119fa3c32b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:27.218229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a46bb32-787b-4f8f-a205-43119fa3c32b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:27.218703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a46bb32-787b-4f8f-a205-43119fa3c32b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:27.219146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a46bb32-787b-4f8f-a205-43119fa3c32b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:27.361630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5a46bb32-787b-4f8f-a205-43119fa3c32b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:27.370088 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5a46bb32-787b-4f8f-a205-43119fa3c32b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.165937 Aug 27 05:09:27.370668 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3049/6044] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:27 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:28.391244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ac674620-58ce-4cff-bc4d-8d3a3038c7e4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:28.391884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ac674620-58ce-4cff-bc4d-8d3a3038c7e4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:28.399680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac674620-58ce-4cff-bc4d-8d3a3038c7e4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:28.400165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac674620-58ce-4cff-bc4d-8d3a3038c7e4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:28.400630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac674620-58ce-4cff-bc4d-8d3a3038c7e4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:28.401318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac674620-58ce-4cff-bc4d-8d3a3038c7e4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:28.401770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac674620-58ce-4cff-bc4d-8d3a3038c7e4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:28.402198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac674620-58ce-4cff-bc4d-8d3a3038c7e4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:28.538018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac674620-58ce-4cff-bc4d-8d3a3038c7e4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:28.546240 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ac674620-58ce-4cff-bc4d-8d3a3038c7e4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.158838 Aug 27 05:09:28.546843 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2996/6045] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:28 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:29.567566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d4a5a42-9d63-45a0-8e5f-231b31c13fd0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:29.568196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1d4a5a42-9d63-45a0-8e5f-231b31c13fd0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:29.575499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d4a5a42-9d63-45a0-8e5f-231b31c13fd0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:29.576014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d4a5a42-9d63-45a0-8e5f-231b31c13fd0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:29.576477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d4a5a42-9d63-45a0-8e5f-231b31c13fd0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:29.577207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d4a5a42-9d63-45a0-8e5f-231b31c13fd0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:29.577776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d4a5a42-9d63-45a0-8e5f-231b31c13fd0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:29.578214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d4a5a42-9d63-45a0-8e5f-231b31c13fd0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:29.709917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1d4a5a42-9d63-45a0-8e5f-231b31c13fd0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:29.718430 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d4a5a42-9d63-45a0-8e5f-231b31c13fd0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.155337 Aug 27 05:09:29.719030 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3050/6046] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:29 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:30.739501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fb9f9ea1-50ea-48d7-9f10-23e8ef64b9f9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:30.740015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fb9f9ea1-50ea-48d7-9f10-23e8ef64b9f9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:30.742728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=36 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:30.748087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb9f9ea1-50ea-48d7-9f10-23e8ef64b9f9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:30.748599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb9f9ea1-50ea-48d7-9f10-23e8ef64b9f9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:30.749035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb9f9ea1-50ea-48d7-9f10-23e8ef64b9f9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:30.749728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb9f9ea1-50ea-48d7-9f10-23e8ef64b9f9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:30.750178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb9f9ea1-50ea-48d7-9f10-23e8ef64b9f9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:30.750623 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb9f9ea1-50ea-48d7-9f10-23e8ef64b9f9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:30.890938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fb9f9ea1-50ea-48d7-9f10-23e8ef64b9f9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:30.900752 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fb9f9ea1-50ea-48d7-9f10-23e8ef64b9f9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1510 microversion: 2.1 time: 0.165199 Aug 27 05:09:30.901411 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2997/6047] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:30 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:31.922198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1787c8c-e134-4d86-ad80-04146029de62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:31.922843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f1787c8c-e134-4d86-ad80-04146029de62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:31.934284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1787c8c-e134-4d86-ad80-04146029de62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:31.934752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1787c8c-e134-4d86-ad80-04146029de62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:31.935340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1787c8c-e134-4d86-ad80-04146029de62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:31.936954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1787c8c-e134-4d86-ad80-04146029de62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:31.937232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1787c8c-e134-4d86-ad80-04146029de62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:31.937817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1787c8c-e134-4d86-ad80-04146029de62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:32.076500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1787c8c-e134-4d86-ad80-04146029de62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:32.084568 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1787c8c-e134-4d86-ad80-04146029de62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1487 microversion: 2.1 time: 0.166554 Aug 27 05:09:32.085160 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3051/6048] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:31 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1487 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:32.106647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ed9a5e12-414e-464b-aee7-b39d1e036885 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:32.109313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ed9a5e12-414e-464b-aee7-b39d1e036885 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:32.116921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed9a5e12-414e-464b-aee7-b39d1e036885 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:32.117481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed9a5e12-414e-464b-aee7-b39d1e036885 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:32.117989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed9a5e12-414e-464b-aee7-b39d1e036885 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:32.118752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed9a5e12-414e-464b-aee7-b39d1e036885 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:32.119274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed9a5e12-414e-464b-aee7-b39d1e036885 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:32.119766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed9a5e12-414e-464b-aee7-b39d1e036885 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:32.171242 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ed9a5e12-414e-464b-aee7-b39d1e036885 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 200 len: 177 microversion: 2.1 time: 0.069304 Aug 27 05:09:32.172159 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2998/6049] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:32 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 177 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:32.182836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58444df3-48f8-4f13-aea1-1bd025b24d91 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:32.183477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-58444df3-48f8-4f13-aea1-1bd025b24d91 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:32.189727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58444df3-48f8-4f13-aea1-1bd025b24d91 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:32.190188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58444df3-48f8-4f13-aea1-1bd025b24d91 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:32.190678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58444df3-48f8-4f13-aea1-1bd025b24d91 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:32.191427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58444df3-48f8-4f13-aea1-1bd025b24d91 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:32.191907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58444df3-48f8-4f13-aea1-1bd025b24d91 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:32.192351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58444df3-48f8-4f13-aea1-1bd025b24d91 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:32.326929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-58444df3-48f8-4f13-aea1-1bd025b24d91 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:32.335103 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-58444df3-48f8-4f13-aea1-1bd025b24d91 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.156540 Aug 27 05:09:32.335725 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3052/6050] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:32 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:32.363228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-84c13256-51ba-4355-b990-2ed95d916863 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:32.367631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-84c13256-51ba-4355-b990-2ed95d916863 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:32.375499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84c13256-51ba-4355-b990-2ed95d916863 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:32.376105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84c13256-51ba-4355-b990-2ed95d916863 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:32.376642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84c13256-51ba-4355-b990-2ed95d916863 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:32.377449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84c13256-51ba-4355-b990-2ed95d916863 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:32.377974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84c13256-51ba-4355-b990-2ed95d916863 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:32.378472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84c13256-51ba-4355-b990-2ed95d916863 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:32.514859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-84c13256-51ba-4355-b990-2ed95d916863 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:32.522091 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-84c13256-51ba-4355-b990-2ed95d916863 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.163700 Aug 27 05:09:32.522781 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 2999/6051] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:32 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:32.545705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a9998c76-9aad-46cc-8bdf-fc394cc4739c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:32.546760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a9998c76-9aad-46cc-8bdf-fc394cc4739c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:32.555525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9998c76-9aad-46cc-8bdf-fc394cc4739c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:32.556273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9998c76-9aad-46cc-8bdf-fc394cc4739c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:32.556992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9998c76-9aad-46cc-8bdf-fc394cc4739c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:32.558063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9998c76-9aad-46cc-8bdf-fc394cc4739c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:32.558783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9998c76-9aad-46cc-8bdf-fc394cc4739c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:32.559443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9998c76-9aad-46cc-8bdf-fc394cc4739c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:32.710817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a9998c76-9aad-46cc-8bdf-fc394cc4739c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:32.719403 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a9998c76-9aad-46cc-8bdf-fc394cc4739c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.179919 Aug 27 05:09:32.720014 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3053/6052] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:32 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:32.744208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-24c3a5f0-ba3d-4701-b10e-6655e059212b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:32.744208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-24c3a5f0-ba3d-4701-b10e-6655e059212b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:32.751253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24c3a5f0-ba3d-4701-b10e-6655e059212b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:32.751804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24c3a5f0-ba3d-4701-b10e-6655e059212b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:32.752277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24c3a5f0-ba3d-4701-b10e-6655e059212b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:32.753203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24c3a5f0-ba3d-4701-b10e-6655e059212b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:32.753667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24c3a5f0-ba3d-4701-b10e-6655e059212b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:32.754094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24c3a5f0-ba3d-4701-b10e-6655e059212b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:32.898128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-24c3a5f0-ba3d-4701-b10e-6655e059212b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:32.906475 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-24c3a5f0-ba3d-4701-b10e-6655e059212b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.167143 Aug 27 05:09:32.907003 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3000/6053] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:32 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:32.967591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1343532251", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "3b8ed832-ef0e-4e8a-a972-17542970b368"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:33.028512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] validate_networks() for [('3b8ed832-ef0e-4e8a-a972-17542970b368', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:09:33.415131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:09:33.415591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:09:33.416097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:09:33.416519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:09:33.416965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:09:33.426766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:33.427267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:33.427723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:33.429146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:33.429627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:33.430068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:33.448154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Getting quotas for project 631787d4099e4245be9291f39ff6b2bd. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:09:33.453640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Getting quotas for user c77d065776e448f08f0a1d6fde1aff3c and project 631787d4099e4245be9291f39ff6b2bd. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:09:33.466560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:09:33.469008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:09:33.539879 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e03abe3-9778-40a5-8907-8a95fce96aea tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576329 Aug 27 05:09:33.540764 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3054/6054] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:09:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:09:33.551920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4fa3e0ad-03ee-4c4e-84ce-ec3a55a94783 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:33.552651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4fa3e0ad-03ee-4c4e-84ce-ec3a55a94783 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:33.621727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4fa3e0ad-03ee-4c4e-84ce-ec3a55a94783 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:33.629433 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4fa3e0ad-03ee-4c4e-84ce-ec3a55a94783 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1215 microversion: 2.1 time: 0.081873 Aug 27 05:09:33.630403 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3001/6055] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:33 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:34.447024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-769e3a16-bd6e-4fc7-987e-a340f6c13cda tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:34.450131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-769e3a16-bd6e-4fc7-987e-a340f6c13cda tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:34.459352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-769e3a16-bd6e-4fc7-987e-a340f6c13cda tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:34.460106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-769e3a16-bd6e-4fc7-987e-a340f6c13cda tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:34.460579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-769e3a16-bd6e-4fc7-987e-a340f6c13cda tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:34.461758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-769e3a16-bd6e-4fc7-987e-a340f6c13cda tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:34.462383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-769e3a16-bd6e-4fc7-987e-a340f6c13cda tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:34.462822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-769e3a16-bd6e-4fc7-987e-a340f6c13cda tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:34.523172 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-769e3a16-bd6e-4fc7-987e-a340f6c13cda tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29/action" status: 200 len: 24566 microversion: 2.1 time: 0.080099 Aug 27 05:09:34.524310 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3055/6056] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:34 2022] POST /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29/action => generated 24566 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:09:34.650833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e78c3f88-783b-4748-86bc-8c820bc554df tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:34.652144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e78c3f88-783b-4748-86bc-8c820bc554df tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:34.660237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e78c3f88-783b-4748-86bc-8c820bc554df tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:34.660799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e78c3f88-783b-4748-86bc-8c820bc554df tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:34.661244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e78c3f88-783b-4748-86bc-8c820bc554df tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:34.661959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e78c3f88-783b-4748-86bc-8c820bc554df tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:34.662421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e78c3f88-783b-4748-86bc-8c820bc554df tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:34.662851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e78c3f88-783b-4748-86bc-8c820bc554df tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:34.727061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e78c3f88-783b-4748-86bc-8c820bc554df tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:34.735056 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e78c3f88-783b-4748-86bc-8c820bc554df tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1267 microversion: 2.1 time: 0.088339 Aug 27 05:09:34.735642 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3002/6057] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:34 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:35.757950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47e34a85-327b-418e-9fdb-b3bc5d1c0e87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:35.759121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47e34a85-327b-418e-9fdb-b3bc5d1c0e87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:35.769312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e34a85-327b-418e-9fdb-b3bc5d1c0e87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:35.770187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e34a85-327b-418e-9fdb-b3bc5d1c0e87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:35.770660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e34a85-327b-418e-9fdb-b3bc5d1c0e87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:35.771397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e34a85-327b-418e-9fdb-b3bc5d1c0e87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:35.772393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e34a85-327b-418e-9fdb-b3bc5d1c0e87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:35.773162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e34a85-327b-418e-9fdb-b3bc5d1c0e87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:36.010864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47e34a85-327b-418e-9fdb-b3bc5d1c0e87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:36.022686 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47e34a85-327b-418e-9fdb-b3bc5d1c0e87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1315 microversion: 2.1 time: 0.269212 Aug 27 05:09:36.027689 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3056/6058] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:35 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:36.778131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d2b6e0a7-aab8-430f-84a9-cf4b778a52aa req-9c36da55-9eab-468f-a626-8f671208e2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7633563-6f4b-43e7-8cee-b12816f797b1", "tag": "c0a18698-a5ef-4ff7-a331-35a65ce4e762"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:36.828658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d2b6e0a7-aab8-430f-84a9-cf4b778a52aa req-9c36da55-9eab-468f-a626-8f671208e2c6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:36.829144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d2b6e0a7-aab8-430f-84a9-cf4b778a52aa req-9c36da55-9eab-468f-a626-8f671208e2c6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:36.829581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d2b6e0a7-aab8-430f-84a9-cf4b778a52aa req-9c36da55-9eab-468f-a626-8f671208e2c6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:36.852841 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d2b6e0a7-aab8-430f-84a9-cf4b778a52aa req-9c36da55-9eab-468f-a626-8f671208e2c6 service nova] Creating event network-changed:c0a18698-a5ef-4ff7-a331-35a65ce4e762 for instance c7633563-6f4b-43e7-8cee-b12816f797b1 on n-h1-854823-1 Aug 27 05:09:36.857742 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d2b6e0a7-aab8-430f-84a9-cf4b778a52aa req-9c36da55-9eab-468f-a626-8f671208e2c6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083638 Aug 27 05:09:36.858348 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3003/6059] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:09:37.050684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6d64308-2daa-47aa-b81c-93b41a7af7cb tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:37.052279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6d64308-2daa-47aa-b81c-93b41a7af7cb tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:37.057064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:37.068856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6d64308-2daa-47aa-b81c-93b41a7af7cb tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:37.069789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6d64308-2daa-47aa-b81c-93b41a7af7cb tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:37.070247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6d64308-2daa-47aa-b81c-93b41a7af7cb tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:37.071209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6d64308-2daa-47aa-b81c-93b41a7af7cb tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:37.071625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6d64308-2daa-47aa-b81c-93b41a7af7cb tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:37.072057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6d64308-2daa-47aa-b81c-93b41a7af7cb tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:37.330120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f6d64308-2daa-47aa-b81c-93b41a7af7cb tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:37.353073 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6d64308-2daa-47aa-b81c-93b41a7af7cb tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1315 microversion: 2.1 time: 0.307660 Aug 27 05:09:37.368177 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3057/6060] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:37 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:38.377902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-672b4e73-bdb8-4604-bf54-38d3c9ecec89 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:38.378791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-672b4e73-bdb8-4604-bf54-38d3c9ecec89 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:38.387549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-672b4e73-bdb8-4604-bf54-38d3c9ecec89 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:38.388294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-672b4e73-bdb8-4604-bf54-38d3c9ecec89 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:38.388784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-672b4e73-bdb8-4604-bf54-38d3c9ecec89 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:38.389686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-672b4e73-bdb8-4604-bf54-38d3c9ecec89 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:38.390142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-672b4e73-bdb8-4604-bf54-38d3c9ecec89 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:38.390566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-672b4e73-bdb8-4604-bf54-38d3c9ecec89 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:38.544768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-672b4e73-bdb8-4604-bf54-38d3c9ecec89 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:38.554771 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-672b4e73-bdb8-4604-bf54-38d3c9ecec89 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1315 microversion: 2.1 time: 0.182395 Aug 27 05:09:38.560797 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3004/6061] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:38 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:38.777903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84d230d1-2e6f-4285-bf7d-55cd0a557172 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:38.779071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-84d230d1-2e6f-4285-bf7d-55cd0a557172 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:38.787446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84d230d1-2e6f-4285-bf7d-55cd0a557172 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:38.788205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84d230d1-2e6f-4285-bf7d-55cd0a557172 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:38.790112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84d230d1-2e6f-4285-bf7d-55cd0a557172 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:38.790918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84d230d1-2e6f-4285-bf7d-55cd0a557172 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:38.791506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84d230d1-2e6f-4285-bf7d-55cd0a557172 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:38.792021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84d230d1-2e6f-4285-bf7d-55cd0a557172 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:38.818489 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-84d230d1-2e6f-4285-bf7d-55cd0a557172 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/ips" status: 200 len: 149 microversion: 2.1 time: 0.044808 Aug 27 05:09:38.819395 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3058/6062] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 05:09:38 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:39.583170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-95ca89f2-71c8-4253-b29c-27096eac2682 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:39.583956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-95ca89f2-71c8-4253-b29c-27096eac2682 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:39.598111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95ca89f2-71c8-4253-b29c-27096eac2682 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:39.599271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95ca89f2-71c8-4253-b29c-27096eac2682 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:39.602236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95ca89f2-71c8-4253-b29c-27096eac2682 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:39.603320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95ca89f2-71c8-4253-b29c-27096eac2682 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:39.604690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95ca89f2-71c8-4253-b29c-27096eac2682 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:39.607178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95ca89f2-71c8-4253-b29c-27096eac2682 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:39.638207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=88 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:39.774603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-95ca89f2-71c8-4253-b29c-27096eac2682 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:39.782964 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-95ca89f2-71c8-4253-b29c-27096eac2682 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1315 microversion: 2.1 time: 0.204079 Aug 27 05:09:39.784765 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3005/6063] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:39 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:40.298687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-804f3e65-fbe5-41ae-b050-8eaaecfc07a7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e6613a2-5d3d-4bf5-9b70-00f0a3603c95"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:40.302061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-804f3e65-fbe5-41ae-b050-8eaaecfc07a7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:40.310399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-804f3e65-fbe5-41ae-b050-8eaaecfc07a7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:40.312115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-804f3e65-fbe5-41ae-b050-8eaaecfc07a7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:40.312915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-804f3e65-fbe5-41ae-b050-8eaaecfc07a7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:40.313807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-804f3e65-fbe5-41ae-b050-8eaaecfc07a7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:40.314469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-804f3e65-fbe5-41ae-b050-8eaaecfc07a7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:40.315089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-804f3e65-fbe5-41ae-b050-8eaaecfc07a7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:40.806678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1103c7d8-d7c3-4bf4-bef8-2be4fd737af2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:40.807927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1103c7d8-d7c3-4bf4-bef8-2be4fd737af2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:40.817407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1103c7d8-d7c3-4bf4-bef8-2be4fd737af2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:40.818239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1103c7d8-d7c3-4bf4-bef8-2be4fd737af2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:40.818895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1103c7d8-d7c3-4bf4-bef8-2be4fd737af2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:40.820485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1103c7d8-d7c3-4bf4-bef8-2be4fd737af2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:40.821228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1103c7d8-d7c3-4bf4-bef8-2be4fd737af2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:40.821928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1103c7d8-d7c3-4bf4-bef8-2be4fd737af2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:41.059650 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-804f3e65-fbe5-41ae-b050-8eaaecfc07a7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "POST /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761246 Aug 27 05:09:41.088262 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3059/6064] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:09:40 2022] POST /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments => generated 194 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:41.199363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1103c7d8-d7c3-4bf4-bef8-2be4fd737af2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:41.210227 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1103c7d8-d7c3-4bf4-bef8-2be4fd737af2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1315 microversion: 2.1 time: 0.407957 Aug 27 05:09:41.211206 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3006/6065] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:40 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:42.248104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54caf99c-4c06-4c34-acb4-80bbd7d74b75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:42.248858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-54caf99c-4c06-4c34-acb4-80bbd7d74b75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:42.265429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54caf99c-4c06-4c34-acb4-80bbd7d74b75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:42.266397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54caf99c-4c06-4c34-acb4-80bbd7d74b75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:42.267117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54caf99c-4c06-4c34-acb4-80bbd7d74b75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:42.268381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54caf99c-4c06-4c34-acb4-80bbd7d74b75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:42.269384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54caf99c-4c06-4c34-acb4-80bbd7d74b75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:42.270474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54caf99c-4c06-4c34-acb4-80bbd7d74b75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:42.630773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-54caf99c-4c06-4c34-acb4-80bbd7d74b75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:42.641080 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-54caf99c-4c06-4c34-acb4-80bbd7d74b75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1315 microversion: 2.1 time: 0.398463 Aug 27 05:09:42.642239 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3060/6066] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:42 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:43.680443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7f489291-a2b9-4092-87dc-0a74550365fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:43.684490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7f489291-a2b9-4092-87dc-0a74550365fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:43.714086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:43.717693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f489291-a2b9-4092-87dc-0a74550365fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:43.718430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f489291-a2b9-4092-87dc-0a74550365fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:43.719216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f489291-a2b9-4092-87dc-0a74550365fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:43.720505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f489291-a2b9-4092-87dc-0a74550365fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:43.720687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f489291-a2b9-4092-87dc-0a74550365fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:43.721121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f489291-a2b9-4092-87dc-0a74550365fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:43.979765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7f489291-a2b9-4092-87dc-0a74550365fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:43.993773 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7f489291-a2b9-4092-87dc-0a74550365fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1315 microversion: 2.1 time: 0.321880 Aug 27 05:09:43.999197 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3007/6067] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:43 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:44.525870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f9f1b337-559f-406d-9140-02fe9dcc6496 req-081732f4-b514-4888-a7d6-d03672ab29ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7633563-6f4b-43e7-8cee-b12816f797b1", "name": "network-vif-plugged", "status": "completed", "tag": "c0a18698-a5ef-4ff7-a331-35a65ce4e762"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:44.543251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:44.544608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:44.548165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f9f1b337-559f-406d-9140-02fe9dcc6496 req-081732f4-b514-4888-a7d6-d03672ab29ab service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:44.549708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f9f1b337-559f-406d-9140-02fe9dcc6496 req-081732f4-b514-4888-a7d6-d03672ab29ab service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:44.550733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f9f1b337-559f-406d-9140-02fe9dcc6496 req-081732f4-b514-4888-a7d6-d03672ab29ab service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:44.571429 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f9f1b337-559f-406d-9140-02fe9dcc6496 req-081732f4-b514-4888-a7d6-d03672ab29ab service nova] Creating event network-vif-plugged:c0a18698-a5ef-4ff7-a331-35a65ce4e762 for instance c7633563-6f4b-43e7-8cee-b12816f797b1 on n-h1-854823-1 Aug 27 05:09:44.582139 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f9f1b337-559f-406d-9140-02fe9dcc6496 req-081732f4-b514-4888-a7d6-d03672ab29ab service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060022 Aug 27 05:09:44.583337 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3061/6068] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:45.028178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8d46b8d4-7035-43b5-a61f-77179a3b9334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:45.029430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8d46b8d4-7035-43b5-a61f-77179a3b9334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:45.042184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d46b8d4-7035-43b5-a61f-77179a3b9334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:45.042970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d46b8d4-7035-43b5-a61f-77179a3b9334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:45.044639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d46b8d4-7035-43b5-a61f-77179a3b9334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:45.044933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d46b8d4-7035-43b5-a61f-77179a3b9334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:45.045700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d46b8d4-7035-43b5-a61f-77179a3b9334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:45.046167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d46b8d4-7035-43b5-a61f-77179a3b9334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:45.274859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8d46b8d4-7035-43b5-a61f-77179a3b9334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:45.282988 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8d46b8d4-7035-43b5-a61f-77179a3b9334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1315 microversion: 2.1 time: 0.266870 Aug 27 05:09:45.284180 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3008/6069] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:45 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:45.648749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71228424-9f42-4121-865e-14501cc9b5c0"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:45.652761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:45.677670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:45.679305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:45.682351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:45.685932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:45.689060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:45.691969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:45.880868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:09:45.881455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:09:45.885176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:09:45.885802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:09:45.889542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:09:45.926188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:45.981707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:45.991896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:45.992808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:45.993457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:45.994525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:45.995211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:45.995814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:46.056127 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c6eee51-dd5b-49ec-aa64-f4a086253a9a tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29/action" status: 202 len: 1135 microversion: 2.1 time: 0.411924 Aug 27 05:09:46.058704 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3062/6070] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:45 2022] POST /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29/action => generated 1135 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 05:09:46.077481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7f9adde1-4695-4dfd-83e6-1cd373e557b5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:46.078845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7f9adde1-4695-4dfd-83e6-1cd373e557b5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:46.087938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f9adde1-4695-4dfd-83e6-1cd373e557b5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:46.088849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f9adde1-4695-4dfd-83e6-1cd373e557b5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:46.089449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f9adde1-4695-4dfd-83e6-1cd373e557b5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:46.090330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f9adde1-4695-4dfd-83e6-1cd373e557b5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:46.090955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f9adde1-4695-4dfd-83e6-1cd373e557b5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:46.091532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f9adde1-4695-4dfd-83e6-1cd373e557b5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:46.305349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cbd8444d-62b7-47ca-933b-18c4e577dd23 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:46.306173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cbd8444d-62b7-47ca-933b-18c4e577dd23 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:46.320144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbd8444d-62b7-47ca-933b-18c4e577dd23 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:46.321143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbd8444d-62b7-47ca-933b-18c4e577dd23 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:46.322993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbd8444d-62b7-47ca-933b-18c4e577dd23 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:46.325440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbd8444d-62b7-47ca-933b-18c4e577dd23 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:46.325754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbd8444d-62b7-47ca-933b-18c4e577dd23 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:46.326210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbd8444d-62b7-47ca-933b-18c4e577dd23 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:46.326399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7f9adde1-4695-4dfd-83e6-1cd373e557b5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:46.336868 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7f9adde1-4695-4dfd-83e6-1cd373e557b5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.263822 Aug 27 05:09:46.343179 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3009/6071] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:46 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:46.622059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cbd8444d-62b7-47ca-933b-18c4e577dd23 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:46.631867 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cbd8444d-62b7-47ca-933b-18c4e577dd23 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1315 microversion: 2.1 time: 0.331075 Aug 27 05:09:46.645453 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3063/6072] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:46 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:47.391736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fa880eab-0f7c-4f1b-a66e-a43059dc1a4d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:47.392375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fa880eab-0f7c-4f1b-a66e-a43059dc1a4d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:47.405585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa880eab-0f7c-4f1b-a66e-a43059dc1a4d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:47.406386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa880eab-0f7c-4f1b-a66e-a43059dc1a4d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:47.407072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa880eab-0f7c-4f1b-a66e-a43059dc1a4d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:47.408836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa880eab-0f7c-4f1b-a66e-a43059dc1a4d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:47.409675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa880eab-0f7c-4f1b-a66e-a43059dc1a4d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:47.410785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fa880eab-0f7c-4f1b-a66e-a43059dc1a4d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:47.577165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fa880eab-0f7c-4f1b-a66e-a43059dc1a4d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:47.588367 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fa880eab-0f7c-4f1b-a66e-a43059dc1a4d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.202834 Aug 27 05:09:47.589425 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3010/6073] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:47 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:47.654847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e381cc2-e00a-44dd-9506-e2cc89bf98be tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:47.655820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e381cc2-e00a-44dd-9506-e2cc89bf98be tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:47.665195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e381cc2-e00a-44dd-9506-e2cc89bf98be tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:47.665195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e381cc2-e00a-44dd-9506-e2cc89bf98be tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:47.665195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e381cc2-e00a-44dd-9506-e2cc89bf98be tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:47.666187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e381cc2-e00a-44dd-9506-e2cc89bf98be tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:47.666662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e381cc2-e00a-44dd-9506-e2cc89bf98be tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:47.667105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e381cc2-e00a-44dd-9506-e2cc89bf98be tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:47.864068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1e381cc2-e00a-44dd-9506-e2cc89bf98be tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:47.882587 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e381cc2-e00a-44dd-9506-e2cc89bf98be tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1502 microversion: 2.1 time: 0.231510 Aug 27 05:09:47.883650 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3064/6074] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:47 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:47.913546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f060b396-f5ad-4db0-9f4b-abd85df6aa5c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:47.916627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f060b396-f5ad-4db0-9f4b-abd85df6aa5c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:47.925164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f060b396-f5ad-4db0-9f4b-abd85df6aa5c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:47.926026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f060b396-f5ad-4db0-9f4b-abd85df6aa5c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:47.927450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f060b396-f5ad-4db0-9f4b-abd85df6aa5c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:47.928999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f060b396-f5ad-4db0-9f4b-abd85df6aa5c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:47.929915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f060b396-f5ad-4db0-9f4b-abd85df6aa5c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:47.930956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f060b396-f5ad-4db0-9f4b-abd85df6aa5c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:47.967902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-548990659", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1893726088", "security_groups": [{"name": "tempest-secgroup-smoke-933956386"}], "block_device_mapping_v2": [{"uuid": "f796610e-e628-4d3b-8627-e0559ac9519f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b9321d5-af89-499e-b147-430b2ec333ca"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:48.007653 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f060b396-f5ad-4db0-9f4b-abd85df6aa5c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action" status: 200 len: 14 microversion: 2.1 time: 0.098483 Aug 27 05:09:48.011780 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3011/6075] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:47 2022] POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:09:48.181371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] validate_networks() for [('0b9321d5-af89-499e-b147-430b2ec333ca', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:09:48.608379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:09:48.608867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:09:48.609527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:09:48.610018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:09:48.610448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:09:48.613574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f47f29d0-7ee2-4d97-9cf8-2329c97b4421 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:48.614512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f47f29d0-7ee2-4d97-9cf8-2329c97b4421 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:48.621286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:48.621823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:48.622734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:48.623545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:48.623648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f47f29d0-7ee2-4d97-9cf8-2329c97b4421 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:48.624023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:48.624138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f47f29d0-7ee2-4d97-9cf8-2329c97b4421 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:48.624464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:48.624919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f47f29d0-7ee2-4d97-9cf8-2329c97b4421 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:48.625840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f47f29d0-7ee2-4d97-9cf8-2329c97b4421 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:48.626378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f47f29d0-7ee2-4d97-9cf8-2329c97b4421 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:48.626904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f47f29d0-7ee2-4d97-9cf8-2329c97b4421 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:48.644132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:09:48.650499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Getting quotas for user 8376c4e2cf814a8b8b1e2a8e404b0187 and project d0535d0245ac4d30bf63b15724beb0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:09:48.730029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:09:48.732495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f796610e-e628-4d3b-8627-e0559ac9519f',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:09:48.829360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f47f29d0-7ee2-4d97-9cf8-2329c97b4421 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:48.844191 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f47f29d0-7ee2-4d97-9cf8-2329c97b4421 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.236059 Aug 27 05:09:48.844901 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3012/6076] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:48 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:48.896559 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12edb56a-6fc8-4beb-9878-a8d3e1bd7309 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.933397 Aug 27 05:09:48.897287 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3065/6077] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:09:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:09:48.910532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a77bb01-414f-4d2c-acd8-e9d7c3208709 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:48.911167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a77bb01-414f-4d2c-acd8-e9d7c3208709 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:48.981197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6a77bb01-414f-4d2c-acd8-e9d7c3208709 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:48.990579 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a77bb01-414f-4d2c-acd8-e9d7c3208709 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1094 microversion: 2.1 time: 0.084098 Aug 27 05:09:49.003914 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3013/6078] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:48 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:49.022912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd87c8e3-b531-404a-9b12-ab5c95213888 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:49.025895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd87c8e3-b531-404a-9b12-ab5c95213888 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:49.034115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd87c8e3-b531-404a-9b12-ab5c95213888 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:49.034793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd87c8e3-b531-404a-9b12-ab5c95213888 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:49.035341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd87c8e3-b531-404a-9b12-ab5c95213888 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:49.036318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd87c8e3-b531-404a-9b12-ab5c95213888 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:49.036882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd87c8e3-b531-404a-9b12-ab5c95213888 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:49.037432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd87c8e3-b531-404a-9b12-ab5c95213888 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:49.089499 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd87c8e3-b531-404a-9b12-ab5c95213888 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action" status: 200 len: 14 microversion: 2.1 time: 0.073563 Aug 27 05:09:49.091237 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3066/6079] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:49 2022] POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:09:49.867293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0bef9709-3648-4490-b96a-da1ad585cfb7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:49.868065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0bef9709-3648-4490-b96a-da1ad585cfb7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:49.875507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bef9709-3648-4490-b96a-da1ad585cfb7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:49.876076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bef9709-3648-4490-b96a-da1ad585cfb7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:49.876619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bef9709-3648-4490-b96a-da1ad585cfb7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:49.877395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bef9709-3648-4490-b96a-da1ad585cfb7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:49.877933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bef9709-3648-4490-b96a-da1ad585cfb7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:49.878444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bef9709-3648-4490-b96a-da1ad585cfb7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:50.012391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12f72999-7783-4174-91e2-fe75ed8bf733 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:50.013480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12f72999-7783-4174-91e2-fe75ed8bf733 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:50.018422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0bef9709-3648-4490-b96a-da1ad585cfb7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:50.022081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12f72999-7783-4174-91e2-fe75ed8bf733 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:50.022697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12f72999-7783-4174-91e2-fe75ed8bf733 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:50.023377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12f72999-7783-4174-91e2-fe75ed8bf733 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:50.024201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12f72999-7783-4174-91e2-fe75ed8bf733 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:50.024778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12f72999-7783-4174-91e2-fe75ed8bf733 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:50.025292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12f72999-7783-4174-91e2-fe75ed8bf733 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:50.026812 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0bef9709-3648-4490-b96a-da1ad585cfb7 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.163519 Aug 27 05:09:50.031241 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3014/6080] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:49 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:50.093341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-12f72999-7783-4174-91e2-fe75ed8bf733 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:50.104371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-671efc09-5b20-4480-8f1c-bdaf8ab2496b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:50.105031 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12f72999-7783-4174-91e2-fe75ed8bf733 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1192 microversion: 2.1 time: 0.096908 Aug 27 05:09:50.114377 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3067/6081] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:50 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:50.122973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-671efc09-5b20-4480-8f1c-bdaf8ab2496b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:50.133262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-671efc09-5b20-4480-8f1c-bdaf8ab2496b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:50.134049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-671efc09-5b20-4480-8f1c-bdaf8ab2496b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:50.135051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-671efc09-5b20-4480-8f1c-bdaf8ab2496b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:50.136813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-671efc09-5b20-4480-8f1c-bdaf8ab2496b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:50.137568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-671efc09-5b20-4480-8f1c-bdaf8ab2496b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:50.138926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-671efc09-5b20-4480-8f1c-bdaf8ab2496b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:50.196374 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-671efc09-5b20-4480-8f1c-bdaf8ab2496b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action" status: 200 len: 14 microversion: 2.1 time: 0.097139 Aug 27 05:09:50.197302 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3015/6082] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:50 2022] POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:09:51.050871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8bd5980-4e63-4042-8000-a0a6009c615e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:51.052304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b8bd5980-4e63-4042-8000-a0a6009c615e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:51.062582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8bd5980-4e63-4042-8000-a0a6009c615e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:51.066729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8bd5980-4e63-4042-8000-a0a6009c615e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:51.067466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8bd5980-4e63-4042-8000-a0a6009c615e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:51.070166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8bd5980-4e63-4042-8000-a0a6009c615e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:51.070855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8bd5980-4e63-4042-8000-a0a6009c615e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:51.071477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8bd5980-4e63-4042-8000-a0a6009c615e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:51.130976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-70c6b033-83da-4df1-b609-39ea809f3b71 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:51.131702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-70c6b033-83da-4df1-b609-39ea809f3b71 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:51.150224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70c6b033-83da-4df1-b609-39ea809f3b71 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:51.150725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70c6b033-83da-4df1-b609-39ea809f3b71 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:51.151168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70c6b033-83da-4df1-b609-39ea809f3b71 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:51.152203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70c6b033-83da-4df1-b609-39ea809f3b71 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:51.158970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70c6b033-83da-4df1-b609-39ea809f3b71 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:51.159444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70c6b033-83da-4df1-b609-39ea809f3b71 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:51.382581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b8bd5980-4e63-4042-8000-a0a6009c615e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:51.392244 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b8bd5980-4e63-4042-8000-a0a6009c615e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.347052 Aug 27 05:09:51.397542 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3068/6083] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:51 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:51.407686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c0de47a2-e65c-4d48-8903-384729d45a90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:51.414950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c0de47a2-e65c-4d48-8903-384729d45a90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:51.426832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0de47a2-e65c-4d48-8903-384729d45a90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:51.427422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0de47a2-e65c-4d48-8903-384729d45a90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:51.433288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0de47a2-e65c-4d48-8903-384729d45a90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:51.436120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0de47a2-e65c-4d48-8903-384729d45a90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:51.437162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0de47a2-e65c-4d48-8903-384729d45a90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:51.437783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0de47a2-e65c-4d48-8903-384729d45a90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:51.490858 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c0de47a2-e65c-4d48-8903-384729d45a90 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action" status: 200 len: 14 microversion: 2.1 time: 0.091813 Aug 27 05:09:51.492092 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3069/6084] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:51 2022] POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:09:51.636981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-70c6b033-83da-4df1-b609-39ea809f3b71 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:51.645751 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-70c6b033-83da-4df1-b609-39ea809f3b71 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1277 microversion: 2.1 time: 0.520273 Aug 27 05:09:51.646540 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3016/6085] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:51 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1277 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:52.018153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-426c9a07-23ca-464a-bf29-7fa20420a956 req-5437a85e-a40d-4b9d-a119-a90f0fb3f3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee5152a-fc8b-4030-8124-ba770b583613", "tag": "c98f302a-c0c6-4949-83df-8de3742feedd"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:52.045659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-426c9a07-23ca-464a-bf29-7fa20420a956 req-5437a85e-a40d-4b9d-a119-a90f0fb3f3b4 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.046760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-426c9a07-23ca-464a-bf29-7fa20420a956 req-5437a85e-a40d-4b9d-a119-a90f0fb3f3b4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.047529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-426c9a07-23ca-464a-bf29-7fa20420a956 req-5437a85e-a40d-4b9d-a119-a90f0fb3f3b4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.071673 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-426c9a07-23ca-464a-bf29-7fa20420a956 req-5437a85e-a40d-4b9d-a119-a90f0fb3f3b4 service nova] Creating event network-changed:c98f302a-c0c6-4949-83df-8de3742feedd for instance 9ee5152a-fc8b-4030-8124-ba770b583613 on n-h2-854823-1 Aug 27 05:09:52.078737 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-426c9a07-23ca-464a-bf29-7fa20420a956 req-5437a85e-a40d-4b9d-a119-a90f0fb3f3b4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071459 Aug 27 05:09:52.079559 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3070/6086] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:09:52.428300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ca95997-69c2-4e2d-81c2-d6f03b3f4960 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:52.434072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1ca95997-69c2-4e2d-81c2-d6f03b3f4960 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:52.444220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ca95997-69c2-4e2d-81c2-d6f03b3f4960 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.445022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ca95997-69c2-4e2d-81c2-d6f03b3f4960 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.445618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ca95997-69c2-4e2d-81c2-d6f03b3f4960 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.446489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ca95997-69c2-4e2d-81c2-d6f03b3f4960 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.447313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ca95997-69c2-4e2d-81c2-d6f03b3f4960 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.462405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ca95997-69c2-4e2d-81c2-d6f03b3f4960 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.503774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ff73f05-3b5d-4c80-8de5-69b795e83ab1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:52.506364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ff73f05-3b5d-4c80-8de5-69b795e83ab1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:52.518155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ff73f05-3b5d-4c80-8de5-69b795e83ab1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.519071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ff73f05-3b5d-4c80-8de5-69b795e83ab1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.520404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ff73f05-3b5d-4c80-8de5-69b795e83ab1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.521503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ff73f05-3b5d-4c80-8de5-69b795e83ab1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.522052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ff73f05-3b5d-4c80-8de5-69b795e83ab1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.522657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ff73f05-3b5d-4c80-8de5-69b795e83ab1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.576185 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ff73f05-3b5d-4c80-8de5-69b795e83ab1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action" status: 200 len: 14 microversion: 2.1 time: 0.076658 Aug 27 05:09:52.576877 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3071/6087] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:52 2022] POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 05:09:52.647368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1ca95997-69c2-4e2d-81c2-d6f03b3f4960 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:52.655998 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1ca95997-69c2-4e2d-81c2-d6f03b3f4960 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.236623 Aug 27 05:09:52.656627 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3017/6088] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:52 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:52.672365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8e04ad4-1816-40ec-bf49-a83e14ea8adb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:52.674204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8e04ad4-1816-40ec-bf49-a83e14ea8adb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:52.681776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8e04ad4-1816-40ec-bf49-a83e14ea8adb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.682424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8e04ad4-1816-40ec-bf49-a83e14ea8adb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.682997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8e04ad4-1816-40ec-bf49-a83e14ea8adb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.684208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8e04ad4-1816-40ec-bf49-a83e14ea8adb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:52.684762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8e04ad4-1816-40ec-bf49-a83e14ea8adb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:52.685273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8e04ad4-1816-40ec-bf49-a83e14ea8adb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:52.830108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8e04ad4-1816-40ec-bf49-a83e14ea8adb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:52.839036 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8e04ad4-1816-40ec-bf49-a83e14ea8adb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1277 microversion: 2.1 time: 0.171237 Aug 27 05:09:52.839880 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3072/6089] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:52 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:53.587674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59d02559-8df9-4d5f-b061-c49db13bb49c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:53.590081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-59d02559-8df9-4d5f-b061-c49db13bb49c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:53.597400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59d02559-8df9-4d5f-b061-c49db13bb49c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:53.597896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59d02559-8df9-4d5f-b061-c49db13bb49c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:53.598365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59d02559-8df9-4d5f-b061-c49db13bb49c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:53.599066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59d02559-8df9-4d5f-b061-c49db13bb49c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:53.599521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59d02559-8df9-4d5f-b061-c49db13bb49c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:53.599943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59d02559-8df9-4d5f-b061-c49db13bb49c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:53.678285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4fbbd706-de23-4afb-8a3e-9b05d6574aba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:53.678904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4fbbd706-de23-4afb-8a3e-9b05d6574aba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:53.685929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fbbd706-de23-4afb-8a3e-9b05d6574aba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:53.686429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fbbd706-de23-4afb-8a3e-9b05d6574aba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:53.686875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fbbd706-de23-4afb-8a3e-9b05d6574aba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:53.687586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fbbd706-de23-4afb-8a3e-9b05d6574aba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:53.688053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fbbd706-de23-4afb-8a3e-9b05d6574aba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:53.688490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fbbd706-de23-4afb-8a3e-9b05d6574aba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:53.835416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4fbbd706-de23-4afb-8a3e-9b05d6574aba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:53.846447 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4fbbd706-de23-4afb-8a3e-9b05d6574aba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.172596 Aug 27 05:09:53.852303 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3073/6090] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:53 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:53.860763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30fc6f4e-234a-4b37-89f5-bac01f62209e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:53.861582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-30fc6f4e-234a-4b37-89f5-bac01f62209e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:53.864257 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-59d02559-8df9-4d5f-b061-c49db13bb49c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action" status: 200 len: 14 microversion: 2.1 time: 0.280199 Aug 27 05:09:53.865225 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3018/6091] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:53 2022] POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action => generated 14 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:09:53.871695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30fc6f4e-234a-4b37-89f5-bac01f62209e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:53.872570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30fc6f4e-234a-4b37-89f5-bac01f62209e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:53.873088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30fc6f4e-234a-4b37-89f5-bac01f62209e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:53.873817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30fc6f4e-234a-4b37-89f5-bac01f62209e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:53.874283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30fc6f4e-234a-4b37-89f5-bac01f62209e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:53.874722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30fc6f4e-234a-4b37-89f5-bac01f62209e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:54.033678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-30fc6f4e-234a-4b37-89f5-bac01f62209e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:54.041805 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-30fc6f4e-234a-4b37-89f5-bac01f62209e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1277 microversion: 2.1 time: 0.185573 Aug 27 05:09:54.043104 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3074/6092] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:53 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:54.647959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c076ad25-2371-4832-8ca5-cd09c857f5e0 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Action: 'create', calling method: .version_select at 0x7f1f21facd30>, body: {"keypair": {"name": "tempest-keypair-1066855837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlbB2GdzGxP2zebCjR9aTqAVUzHiKHhdFQV06lfeAiArV9iHANRZvxXs61P6vXZd9J0V0YTOaTho1eaXy08lhPrq72wYe/7WQaKaAlo6a9mrdDxtGSznhsgvULWE5svXw=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:54.667713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-c076ad25-2371-4832-8ca5-cd09c857f5e0 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:09:54.673299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-c076ad25-2371-4832-8ca5-cd09c857f5e0 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for user dc1b938c06bd432496e8ae8b24965678 and project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:09:54.698774 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c076ad25-2371-4832-8ca5-cd09c857f5e0 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054900 Aug 27 05:09:54.699511 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3019/6093] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:09:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:09:54.876251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-069373bd-52a4-46e9-9880-be97d8e0e9cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:54.877462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8939404c-71df-4571-8666-ba0b3dd3f0fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:54.878116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8939404c-71df-4571-8666-ba0b3dd3f0fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:54.883566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-069373bd-52a4-46e9-9880-be97d8e0e9cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:54.895540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8939404c-71df-4571-8666-ba0b3dd3f0fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:54.896066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8939404c-71df-4571-8666-ba0b3dd3f0fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:54.896582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8939404c-71df-4571-8666-ba0b3dd3f0fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:54.897314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8939404c-71df-4571-8666-ba0b3dd3f0fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:54.899472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-069373bd-52a4-46e9-9880-be97d8e0e9cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:54.899989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-069373bd-52a4-46e9-9880-be97d8e0e9cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:54.900420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-069373bd-52a4-46e9-9880-be97d8e0e9cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:54.901157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-069373bd-52a4-46e9-9880-be97d8e0e9cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:54.901621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-069373bd-52a4-46e9-9880-be97d8e0e9cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:54.902053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-069373bd-52a4-46e9-9880-be97d8e0e9cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:54.906585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8939404c-71df-4571-8666-ba0b3dd3f0fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:54.907056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8939404c-71df-4571-8666-ba0b3dd3f0fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:54.947258 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-069373bd-52a4-46e9-9880-be97d8e0e9cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action" status: 200 len: 14 microversion: 2.1 time: 0.075330 Aug 27 05:09:54.949404 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3020/6094] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:54 2022] POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 05:09:55.067395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-62377119-71ad-4056-baa7-511e6862c560 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:55.070436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-62377119-71ad-4056-baa7-511e6862c560 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:55.083200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62377119-71ad-4056-baa7-511e6862c560 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:55.084032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62377119-71ad-4056-baa7-511e6862c560 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:55.084877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62377119-71ad-4056-baa7-511e6862c560 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:55.086055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62377119-71ad-4056-baa7-511e6862c560 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:55.086764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62377119-71ad-4056-baa7-511e6862c560 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:55.087352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62377119-71ad-4056-baa7-511e6862c560 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:55.091799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8939404c-71df-4571-8666-ba0b3dd3f0fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:55.103605 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8939404c-71df-4571-8666-ba0b3dd3f0fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.238792 Aug 27 05:09:55.109022 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3075/6095] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:54 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:55.293845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-62377119-71ad-4056-baa7-511e6862c560 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:55.304011 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-62377119-71ad-4056-baa7-511e6862c560 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1277 microversion: 2.1 time: 0.244242 Aug 27 05:09:55.304950 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3021/6096] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:55 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1277 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:55.962260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1cb1a0aa-ff3e-45ce-82e6-2f97fa5d9907 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:55.965212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1cb1a0aa-ff3e-45ce-82e6-2f97fa5d9907 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:55.973362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cb1a0aa-ff3e-45ce-82e6-2f97fa5d9907 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:55.973874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cb1a0aa-ff3e-45ce-82e6-2f97fa5d9907 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:55.974331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cb1a0aa-ff3e-45ce-82e6-2f97fa5d9907 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:55.975617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cb1a0aa-ff3e-45ce-82e6-2f97fa5d9907 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:55.976093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cb1a0aa-ff3e-45ce-82e6-2f97fa5d9907 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:55.977200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cb1a0aa-ff3e-45ce-82e6-2f97fa5d9907 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:56.019873 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1cb1a0aa-ff3e-45ce-82e6-2f97fa5d9907 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action" status: 200 len: 14 microversion: 2.1 time: 0.062849 Aug 27 05:09:56.020879 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3076/6097] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:55 2022] POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:09:56.131346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0e930d03-0ba4-4b2a-8deb-6f194871ddba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:56.132049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0e930d03-0ba4-4b2a-8deb-6f194871ddba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:56.140260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e930d03-0ba4-4b2a-8deb-6f194871ddba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:56.140787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e930d03-0ba4-4b2a-8deb-6f194871ddba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:56.141234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e930d03-0ba4-4b2a-8deb-6f194871ddba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:56.141954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e930d03-0ba4-4b2a-8deb-6f194871ddba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:56.142600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e930d03-0ba4-4b2a-8deb-6f194871ddba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:56.143040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e930d03-0ba4-4b2a-8deb-6f194871ddba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:56.209210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1556604084", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d0ae2b2-26fa-4f3d-bb3c-eb9fbaada560"}], "security_groups": [{"name": "tempest-securitygroup--301140611"}], "key_name": "tempest-keypair-1066855837", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:56.295617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0e930d03-0ba4-4b2a-8deb-6f194871ddba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:56.303759 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0e930d03-0ba4-4b2a-8deb-6f194871ddba tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.177414 Aug 27 05:09:56.304360 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3022/6098] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:56 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:56.326853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] validate_networks() for [('1d0ae2b2-26fa-4f3d-bb3c-eb9fbaada560', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:09:56.327600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ca870ae9-602a-4ba1-98d5-4f52fafc5b5b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:56.328305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ca870ae9-602a-4ba1-98d5-4f52fafc5b5b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:56.335251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca870ae9-602a-4ba1-98d5-4f52fafc5b5b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:56.336163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca870ae9-602a-4ba1-98d5-4f52fafc5b5b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:56.336718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca870ae9-602a-4ba1-98d5-4f52fafc5b5b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:56.337801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca870ae9-602a-4ba1-98d5-4f52fafc5b5b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:56.338338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca870ae9-602a-4ba1-98d5-4f52fafc5b5b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:56.338850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca870ae9-602a-4ba1-98d5-4f52fafc5b5b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:56.492079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ca870ae9-602a-4ba1-98d5-4f52fafc5b5b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:56.500513 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ca870ae9-602a-4ba1-98d5-4f52fafc5b5b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1277 microversion: 2.1 time: 0.178109 Aug 27 05:09:56.501639 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3023/6099] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:56 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:56.727407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:09:56.727907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:09:56.728434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:09:56.728886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:09:56.729343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:09:56.738703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:56.739138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:56.739591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:56.740336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:56.740830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:56.741273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:56.760132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:09:56.766225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for user dc1b938c06bd432496e8ae8b24965678 and project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:09:56.779684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:09:56.782325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:09:56.831047 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2d9176b2-edb7-48b4-a7f0-174b5fe1d207 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.630840 Aug 27 05:09:56.832733 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3077/6100] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:09:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:09:56.844318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7fccd70b-1a6b-4705-bcae-f478e93391cd tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:56.845780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7fccd70b-1a6b-4705-bcae-f478e93391cd tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:56.904038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7fccd70b-1a6b-4705-bcae-f478e93391cd tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:56.913092 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7fccd70b-1a6b-4705-bcae-f478e93391cd tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1242 microversion: 2.1 time: 0.073046 Aug 27 05:09:56.913990 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3024/6101] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:56 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:09:57.032417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e38a828-251a-438a-ab50-a48f368372c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:57.035240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e38a828-251a-438a-ab50-a48f368372c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:57.041902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e38a828-251a-438a-ab50-a48f368372c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:57.042601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e38a828-251a-438a-ab50-a48f368372c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:57.043895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e38a828-251a-438a-ab50-a48f368372c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:57.044953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e38a828-251a-438a-ab50-a48f368372c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:57.045698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e38a828-251a-438a-ab50-a48f368372c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:57.046299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e38a828-251a-438a-ab50-a48f368372c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:57.105480 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e38a828-251a-438a-ab50-a48f368372c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action" status: 200 len: 14 microversion: 2.1 time: 0.077527 Aug 27 05:09:57.106804 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3078/6102] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:57 2022] POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:09:57.325915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9c191550-ca39-4d8d-aa3e-5dd3e04250fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:57.326533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9c191550-ca39-4d8d-aa3e-5dd3e04250fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:57.339087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c191550-ca39-4d8d-aa3e-5dd3e04250fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:57.339599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c191550-ca39-4d8d-aa3e-5dd3e04250fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:57.340056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c191550-ca39-4d8d-aa3e-5dd3e04250fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:57.340842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c191550-ca39-4d8d-aa3e-5dd3e04250fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:57.341366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c191550-ca39-4d8d-aa3e-5dd3e04250fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:57.353251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c191550-ca39-4d8d-aa3e-5dd3e04250fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:57.524026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0e09f4e-62fc-43c5-ba80-a6773bf85947 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:57.525068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0e09f4e-62fc-43c5-ba80-a6773bf85947 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:57.540242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e09f4e-62fc-43c5-ba80-a6773bf85947 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:57.547528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e09f4e-62fc-43c5-ba80-a6773bf85947 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:57.548734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e09f4e-62fc-43c5-ba80-a6773bf85947 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:57.549541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e09f4e-62fc-43c5-ba80-a6773bf85947 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:57.550043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e09f4e-62fc-43c5-ba80-a6773bf85947 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:57.550584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e09f4e-62fc-43c5-ba80-a6773bf85947 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:57.571737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9c191550-ca39-4d8d-aa3e-5dd3e04250fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:57.585574 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9c191550-ca39-4d8d-aa3e-5dd3e04250fc tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.263484 Aug 27 05:09:57.586366 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3025/6103] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:57 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:57.778066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0e09f4e-62fc-43c5-ba80-a6773bf85947 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:57.787298 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0e09f4e-62fc-43c5-ba80-a6773bf85947 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1277 microversion: 2.1 time: 0.268474 Aug 27 05:09:57.788251 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3079/6104] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:57 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1277 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:57.935425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f4d3565-00f3-4462-8ac8-12c7f5a2fc77 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:57.936409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4f4d3565-00f3-4462-8ac8-12c7f5a2fc77 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:57.943616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f4d3565-00f3-4462-8ac8-12c7f5a2fc77 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:57.944116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f4d3565-00f3-4462-8ac8-12c7f5a2fc77 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:57.944880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f4d3565-00f3-4462-8ac8-12c7f5a2fc77 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:57.945609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f4d3565-00f3-4462-8ac8-12c7f5a2fc77 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:57.946102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f4d3565-00f3-4462-8ac8-12c7f5a2fc77 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:57.946538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f4d3565-00f3-4462-8ac8-12c7f5a2fc77 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:57.964329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:58.012230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4f4d3565-00f3-4462-8ac8-12c7f5a2fc77 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:58.020696 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4f4d3565-00f3-4462-8ac8-12c7f5a2fc77 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1294 microversion: 2.1 time: 0.090070 Aug 27 05:09:58.021286 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3026/6105] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:57 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:58.118197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d479f7f8-6c20-4dab-85d0-c00867bf0173 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:58.121251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d479f7f8-6c20-4dab-85d0-c00867bf0173 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:58.129525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d479f7f8-6c20-4dab-85d0-c00867bf0173 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:58.130105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d479f7f8-6c20-4dab-85d0-c00867bf0173 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:58.130502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d479f7f8-6c20-4dab-85d0-c00867bf0173 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:58.131237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d479f7f8-6c20-4dab-85d0-c00867bf0173 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:58.131717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d479f7f8-6c20-4dab-85d0-c00867bf0173 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:58.132163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d479f7f8-6c20-4dab-85d0-c00867bf0173 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:58.184454 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d479f7f8-6c20-4dab-85d0-c00867bf0173 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action" status: 200 len: 14 microversion: 2.1 time: 0.069094 Aug 27 05:09:58.185824 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3080/6106] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:58 2022] POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:09:58.613103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a9f29a70-b3cf-46d6-a006-c37e5d1dcf77 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:58.613637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a9f29a70-b3cf-46d6-a006-c37e5d1dcf77 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:58.620992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9f29a70-b3cf-46d6-a006-c37e5d1dcf77 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:58.622968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9f29a70-b3cf-46d6-a006-c37e5d1dcf77 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:58.623478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9f29a70-b3cf-46d6-a006-c37e5d1dcf77 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:58.624219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9f29a70-b3cf-46d6-a006-c37e5d1dcf77 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:58.624821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9f29a70-b3cf-46d6-a006-c37e5d1dcf77 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:58.625253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9f29a70-b3cf-46d6-a006-c37e5d1dcf77 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:58.781026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a9f29a70-b3cf-46d6-a006-c37e5d1dcf77 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:58.790320 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a9f29a70-b3cf-46d6-a006-c37e5d1dcf77 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.181245 Aug 27 05:09:58.790940 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3027/6107] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:58 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:58.811467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-edb86aba-6963-4e97-9340-164af0989d49 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:58.812677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-edb86aba-6963-4e97-9340-164af0989d49 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:58.821731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edb86aba-6963-4e97-9340-164af0989d49 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:58.822510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edb86aba-6963-4e97-9340-164af0989d49 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:58.823138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edb86aba-6963-4e97-9340-164af0989d49 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:58.824057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edb86aba-6963-4e97-9340-164af0989d49 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:58.825022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edb86aba-6963-4e97-9340-164af0989d49 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:58.825704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edb86aba-6963-4e97-9340-164af0989d49 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:59.043176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98a19470-496b-48f9-bfc3-910df885db96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:59.052349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98a19470-496b-48f9-bfc3-910df885db96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:59.071361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a19470-496b-48f9-bfc3-910df885db96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:59.076014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a19470-496b-48f9-bfc3-910df885db96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:59.077056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a19470-496b-48f9-bfc3-910df885db96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:59.081497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a19470-496b-48f9-bfc3-910df885db96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:59.082196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a19470-496b-48f9-bfc3-910df885db96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:59.082784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98a19470-496b-48f9-bfc3-910df885db96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:59.201108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-98a19470-496b-48f9-bfc3-910df885db96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:59.212832 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-98a19470-496b-48f9-bfc3-910df885db96 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1300 microversion: 2.1 time: 0.173103 Aug 27 05:09:59.214624 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3028/6108] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:59 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1300 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:59.221271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f454e6bb-0e23-4afe-9c60-188ad9bbf132 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:09:59.226494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-edb86aba-6963-4e97-9340-164af0989d49 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:09:59.238455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f454e6bb-0e23-4afe-9c60-188ad9bbf132 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:59.246267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f454e6bb-0e23-4afe-9c60-188ad9bbf132 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:59.247621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f454e6bb-0e23-4afe-9c60-188ad9bbf132 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:59.248720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f454e6bb-0e23-4afe-9c60-188ad9bbf132 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:59.249709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f454e6bb-0e23-4afe-9c60-188ad9bbf132 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:59.250176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f454e6bb-0e23-4afe-9c60-188ad9bbf132 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:59.250857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f454e6bb-0e23-4afe-9c60-188ad9bbf132 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:59.257995 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-edb86aba-6963-4e97-9340-164af0989d49 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1277 microversion: 2.1 time: 0.450836 Aug 27 05:09:59.259290 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3081/6109] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:58 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1277 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:09:59.345962 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f454e6bb-0e23-4afe-9c60-188ad9bbf132 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action" status: 200 len: 14 microversion: 2.1 time: 0.129401 Aug 27 05:09:59.350020 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3029/6110] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:09:59 2022] POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:09:59.821267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d139d16a-0ee8-4292-81d3-2985fb4d8fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:09:59.822781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d139d16a-0ee8-4292-81d3-2985fb4d8fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:09:59.836680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d139d16a-0ee8-4292-81d3-2985fb4d8fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:59.839400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d139d16a-0ee8-4292-81d3-2985fb4d8fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:59.843244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d139d16a-0ee8-4292-81d3-2985fb4d8fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:59.844211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d139d16a-0ee8-4292-81d3-2985fb4d8fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:09:59.844976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d139d16a-0ee8-4292-81d3-2985fb4d8fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:09:59.846947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d139d16a-0ee8-4292-81d3-2985fb4d8fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:09:59.873512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:00.099949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d139d16a-0ee8-4292-81d3-2985fb4d8fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:00.109536 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d139d16a-0ee8-4292-81d3-2985fb4d8fc3 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.297285 Aug 27 05:10:00.110334 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3082/6111] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:09:59 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:00.238859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8dc1ad43-b253-43db-9d6b-b0e6e8b0b4e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:00.240361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8dc1ad43-b253-43db-9d6b-b0e6e8b0b4e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:00.258996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dc1ad43-b253-43db-9d6b-b0e6e8b0b4e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.259500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dc1ad43-b253-43db-9d6b-b0e6e8b0b4e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.259945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dc1ad43-b253-43db-9d6b-b0e6e8b0b4e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.260710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dc1ad43-b253-43db-9d6b-b0e6e8b0b4e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.261172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dc1ad43-b253-43db-9d6b-b0e6e8b0b4e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.261732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8dc1ad43-b253-43db-9d6b-b0e6e8b0b4e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.284379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3322f4db-0a73-4f6f-8b41-bdd848e54910 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:00.286054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3322f4db-0a73-4f6f-8b41-bdd848e54910 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:00.306411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3322f4db-0a73-4f6f-8b41-bdd848e54910 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.307298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3322f4db-0a73-4f6f-8b41-bdd848e54910 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.309432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3322f4db-0a73-4f6f-8b41-bdd848e54910 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.310767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3322f4db-0a73-4f6f-8b41-bdd848e54910 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.313317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3322f4db-0a73-4f6f-8b41-bdd848e54910 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.314776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3322f4db-0a73-4f6f-8b41-bdd848e54910 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.483281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8dc1ad43-b253-43db-9d6b-b0e6e8b0b4e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:00.498540 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8dc1ad43-b253-43db-9d6b-b0e6e8b0b4e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1367 microversion: 2.1 time: 0.264637 Aug 27 05:10:00.499407 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3030/6112] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:00 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:00.508782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f0eecaad-0f5e-4e26-be19-0a4c62154fe4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:00.508782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f0eecaad-0f5e-4e26-be19-0a4c62154fe4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:00.521470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0eecaad-0f5e-4e26-be19-0a4c62154fe4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.522168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0eecaad-0f5e-4e26-be19-0a4c62154fe4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.522614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0eecaad-0f5e-4e26-be19-0a4c62154fe4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.523490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0eecaad-0f5e-4e26-be19-0a4c62154fe4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.524067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0eecaad-0f5e-4e26-be19-0a4c62154fe4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.524374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f0eecaad-0f5e-4e26-be19-0a4c62154fe4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.592385 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f0eecaad-0f5e-4e26-be19-0a4c62154fe4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action" status: 200 len: 16396 microversion: 2.1 time: 0.091607 Aug 27 05:10:00.599377 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3031/6113] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:00 2022] POST /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1/action => generated 16396 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:10:00.605920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-dd3f1925-2c5a-4d87-8934-70df1d473796 req-bbf8248b-00db-4937-a437-47bef6c6e7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986bd712-6d0e-49a2-8bd4-a5bdc6186b4a", "tag": "ddedb5a2-d20a-4db5-a003-bcc5ded9a212"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:00.621348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-dd3f1925-2c5a-4d87-8934-70df1d473796 req-bbf8248b-00db-4937-a437-47bef6c6e7d9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.622277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-dd3f1925-2c5a-4d87-8934-70df1d473796 req-bbf8248b-00db-4937-a437-47bef6c6e7d9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.622870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-dd3f1925-2c5a-4d87-8934-70df1d473796 req-bbf8248b-00db-4937-a437-47bef6c6e7d9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.638831 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-dd3f1925-2c5a-4d87-8934-70df1d473796 req-bbf8248b-00db-4937-a437-47bef6c6e7d9 service nova] Creating event network-changed:ddedb5a2-d20a-4db5-a003-bcc5ded9a212 for instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a on n-h1-854823-1 Aug 27 05:10:00.647342 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-dd3f1925-2c5a-4d87-8934-70df1d473796 req-bbf8248b-00db-4937-a437-47bef6c6e7d9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046211 Aug 27 05:10:00.648136 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3032/6114] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:00.654692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-93d82629-9da9-4663-8123-78aa3b30c1fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:00.655728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-93d82629-9da9-4663-8123-78aa3b30c1fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:00.664253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93d82629-9da9-4663-8123-78aa3b30c1fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.664777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93d82629-9da9-4663-8123-78aa3b30c1fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.665219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93d82629-9da9-4663-8123-78aa3b30c1fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.665355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3322f4db-0a73-4f6f-8b41-bdd848e54910 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:00.666215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93d82629-9da9-4663-8123-78aa3b30c1fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.667377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93d82629-9da9-4663-8123-78aa3b30c1fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.667973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-93d82629-9da9-4663-8123-78aa3b30c1fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.674119 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3322f4db-0a73-4f6f-8b41-bdd848e54910 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1265 microversion: 2.1 time: 0.397295 Aug 27 05:10:00.674739 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3083/6115] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:00 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1265 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:10:00.843030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-93d82629-9da9-4663-8123-78aa3b30c1fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:00.855754 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-93d82629-9da9-4663-8123-78aa3b30c1fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.206036 Aug 27 05:10:00.856972 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3033/6116] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:00 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:00.886406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37aedbc8-04a2-4559-b0e0-a7e4b3ea7ab5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:00.887039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37aedbc8-04a2-4559-b0e0-a7e4b3ea7ab5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:00.893757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37aedbc8-04a2-4559-b0e0-a7e4b3ea7ab5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.894449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37aedbc8-04a2-4559-b0e0-a7e4b3ea7ab5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.895199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37aedbc8-04a2-4559-b0e0-a7e4b3ea7ab5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:00.896106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37aedbc8-04a2-4559-b0e0-a7e4b3ea7ab5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:00.896603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37aedbc8-04a2-4559-b0e0-a7e4b3ea7ab5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:00.897051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37aedbc8-04a2-4559-b0e0-a7e4b3ea7ab5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.135057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d4c7ea25-bf17-49a6-b11d-1cb4953bb191 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:01.135673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d4c7ea25-bf17-49a6-b11d-1cb4953bb191 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:01.145023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:01.150127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4c7ea25-bf17-49a6-b11d-1cb4953bb191 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.151398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4c7ea25-bf17-49a6-b11d-1cb4953bb191 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.152090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4c7ea25-bf17-49a6-b11d-1cb4953bb191 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.153369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4c7ea25-bf17-49a6-b11d-1cb4953bb191 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.153564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-37aedbc8-04a2-4559-b0e0-a7e4b3ea7ab5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:01.154281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4c7ea25-bf17-49a6-b11d-1cb4953bb191 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.154878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4c7ea25-bf17-49a6-b11d-1cb4953bb191 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.167662 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37aedbc8-04a2-4559-b0e0-a7e4b3ea7ab5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.285021 Aug 27 05:10:01.188974 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3084/6117] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:00 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:01.203073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bd805c8-7206-41a0-955a-2f85c8034009 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:01.204950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6bd805c8-7206-41a0-955a-2f85c8034009 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:01.212891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bd805c8-7206-41a0-955a-2f85c8034009 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.213649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bd805c8-7206-41a0-955a-2f85c8034009 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.214453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bd805c8-7206-41a0-955a-2f85c8034009 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.215240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bd805c8-7206-41a0-955a-2f85c8034009 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.216024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bd805c8-7206-41a0-955a-2f85c8034009 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.226540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bd805c8-7206-41a0-955a-2f85c8034009 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.331708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d4c7ea25-bf17-49a6-b11d-1cb4953bb191 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:01.347183 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d4c7ea25-bf17-49a6-b11d-1cb4953bb191 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.216512 Aug 27 05:10:01.348322 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3034/6118] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:01 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:01.416333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6bd805c8-7206-41a0-955a-2f85c8034009 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:01.426402 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6bd805c8-7206-41a0-955a-2f85c8034009 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.235127 Aug 27 05:10:01.441048 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3085/6119] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:01 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:01.447180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2fb3de70-3960-47a6-b9a0-748bc118ffaa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:01.447804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2fb3de70-3960-47a6-b9a0-748bc118ffaa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:01.459989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fb3de70-3960-47a6-b9a0-748bc118ffaa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.460491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fb3de70-3960-47a6-b9a0-748bc118ffaa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.460963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fb3de70-3960-47a6-b9a0-748bc118ffaa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.461667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fb3de70-3960-47a6-b9a0-748bc118ffaa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.462132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fb3de70-3960-47a6-b9a0-748bc118ffaa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.462565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fb3de70-3960-47a6-b9a0-748bc118ffaa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.524362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c0fcb41-de73-44bb-9162-5b945bb895a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:01.525259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c0fcb41-de73-44bb-9162-5b945bb895a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:01.532749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c0fcb41-de73-44bb-9162-5b945bb895a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.533377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c0fcb41-de73-44bb-9162-5b945bb895a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.534053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c0fcb41-de73-44bb-9162-5b945bb895a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.535104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c0fcb41-de73-44bb-9162-5b945bb895a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.536371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c0fcb41-de73-44bb-9162-5b945bb895a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.537383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c0fcb41-de73-44bb-9162-5b945bb895a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.633026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2fb3de70-3960-47a6-b9a0-748bc118ffaa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:01.643259 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2fb3de70-3960-47a6-b9a0-748bc118ffaa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.199924 Aug 27 05:10:01.644428 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3035/6120] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:01 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:01.665359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f9586f8f-d502-41a0-b1f4-8ae870c661ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:01.666263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f9586f8f-d502-41a0-b1f4-8ae870c661ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:01.676009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9586f8f-d502-41a0-b1f4-8ae870c661ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.676969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9586f8f-d502-41a0-b1f4-8ae870c661ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.677818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9586f8f-d502-41a0-b1f4-8ae870c661ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.678671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9586f8f-d502-41a0-b1f4-8ae870c661ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.680018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9586f8f-d502-41a0-b1f4-8ae870c661ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.680641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f9586f8f-d502-41a0-b1f4-8ae870c661ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.727494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c0fcb41-de73-44bb-9162-5b945bb895a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:01.738096 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c0fcb41-de73-44bb-9162-5b945bb895a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1367 microversion: 2.1 time: 0.217978 Aug 27 05:10:01.739173 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3086/6121] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:01 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:01.740342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f9586f8f-d502-41a0-b1f4-8ae870c661ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Locking {{(pid=128870) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 27 05:10:01.744963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-742a0a89-3275-49c6-9279-5ae5a2e0c2f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:01.745972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-742a0a89-3275-49c6-9279-5ae5a2e0c2f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:01.753118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-742a0a89-3275-49c6-9279-5ae5a2e0c2f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.753637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-742a0a89-3275-49c6-9279-5ae5a2e0c2f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.754120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-742a0a89-3275-49c6-9279-5ae5a2e0c2f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.754850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-742a0a89-3275-49c6-9279-5ae5a2e0c2f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.755328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-742a0a89-3275-49c6-9279-5ae5a2e0c2f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.755777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-742a0a89-3275-49c6-9279-5ae5a2e0c2f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.811561 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f9586f8f-d502-41a0-b1f4-8ae870c661ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.150622 Aug 27 05:10:01.812763 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3036/6122] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:01 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:10:01.835735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f7601077-7bd3-48f6-8e63-d3a050dde64b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:01.842222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f7601077-7bd3-48f6-8e63-d3a050dde64b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:01.857594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7601077-7bd3-48f6-8e63-d3a050dde64b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.858217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7601077-7bd3-48f6-8e63-d3a050dde64b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.858666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7601077-7bd3-48f6-8e63-d3a050dde64b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.859981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7601077-7bd3-48f6-8e63-d3a050dde64b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:01.860458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7601077-7bd3-48f6-8e63-d3a050dde64b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:01.861626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f7601077-7bd3-48f6-8e63-d3a050dde64b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:01.950474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-742a0a89-3275-49c6-9279-5ae5a2e0c2f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:01.968037 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-742a0a89-3275-49c6-9279-5ae5a2e0c2f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1265 microversion: 2.1 time: 0.227499 Aug 27 05:10:01.980378 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3087/6123] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:01 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:02.024425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f7601077-7bd3-48f6-8e63-d3a050dde64b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:02.033886 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f7601077-7bd3-48f6-8e63-d3a050dde64b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.208371 Aug 27 05:10:02.034546 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3037/6124] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:01 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:02.055090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a63b04e7-0c42-41e4-afe0-71e056f1e87f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:02.063381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a63b04e7-0c42-41e4-afe0-71e056f1e87f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.064151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a63b04e7-0c42-41e4-afe0-71e056f1e87f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.064650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a63b04e7-0c42-41e4-afe0-71e056f1e87f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.095988 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a63b04e7-0c42-41e4-afe0-71e056f1e87f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] HTTP exception thrown: Instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 is locked Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a63b04e7-0c42-41e4-afe0-71e056f1e87f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Request method failure captured: Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action HTTP/1.1 Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 15 Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaZv2aB3wi4p2ta_SwSOAroy6qWH8PAZgVgvjt7PNCeaO1q9sfV_T1h1o-qcz1FOLmfm-41NolP0vc49g-2MIC8-G8Z_I52AM012oGBtQuU3sFanTjEYda1awukXW4Z1sJJ4GEHRYmxEHv2qli_g5GHzaix6XaX2XvkLh9U24G_dy90 Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 631787d4099e4245be9291f39ff6b2bd Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-312006175 Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-312006175 Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 631787d4099e4245be9291f39ff6b2bd Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-312006175 Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-312006175-project Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: c77d065776e448f08f0a1d6fde1aff3c Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-312006175-project Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: {"os-stop": {}} Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 is locked Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '3f54d929-acc6-47f3-96a7-708032ccd9d9', 'body': {'os-stop': {}}} Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 is locked Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 is locked Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 is locked Aug 27 05:10:02.098507 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:02.103126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a63b04e7-0c42-41e4-afe0-71e056f1e87f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Returning 409 to user: Instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 is locked {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:02.103126 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a63b04e7-0c42-41e4-afe0-71e056f1e87f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 409 len: 107 microversion: 2.1 time: 0.049239 Aug 27 05:10:02.104122 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3088/6125] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:02 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 107 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 05:10:02.109419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e4eab8c7-f718-49e2-9895-8c338f254886 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:02.110097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e4eab8c7-f718-49e2-9895-8c338f254886 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:02.116693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4eab8c7-f718-49e2-9895-8c338f254886 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.117143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4eab8c7-f718-49e2-9895-8c338f254886 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.117675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4eab8c7-f718-49e2-9895-8c338f254886 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.118363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4eab8c7-f718-49e2-9895-8c338f254886 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.118797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4eab8c7-f718-49e2-9895-8c338f254886 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.119219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4eab8c7-f718-49e2-9895-8c338f254886 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.176551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e4eab8c7-f718-49e2-9895-8c338f254886 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Unlocking {{(pid=128870) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 27 05:10:02.234491 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e4eab8c7-f718-49e2-9895-8c338f254886 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.128970 Aug 27 05:10:02.238313 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3038/6126] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:02 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:10:02.244505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d03a9421-d07d-4c5f-984c-20fe76583e33 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:02.248934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:02.254736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d03a9421-d07d-4c5f-984c-20fe76583e33 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.255317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d03a9421-d07d-4c5f-984c-20fe76583e33 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.256126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d03a9421-d07d-4c5f-984c-20fe76583e33 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.284121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d03a9421-d07d-4c5f-984c-20fe76583e33 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Going to try to stop instance {{(pid=128869) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:10:02.335213 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d03a9421-d07d-4c5f-984c-20fe76583e33 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.095003 Aug 27 05:10:02.336036 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3089/6127] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:02 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:10:02.344235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c9b3c0c0-44ae-490e-803b-b9cb9ffbf18f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:02.345059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c9b3c0c0-44ae-490e-803b-b9cb9ffbf18f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:02.358652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9b3c0c0-44ae-490e-803b-b9cb9ffbf18f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.359399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9b3c0c0-44ae-490e-803b-b9cb9ffbf18f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.360011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9b3c0c0-44ae-490e-803b-b9cb9ffbf18f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.361100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9b3c0c0-44ae-490e-803b-b9cb9ffbf18f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.361640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9b3c0c0-44ae-490e-803b-b9cb9ffbf18f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.362121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9b3c0c0-44ae-490e-803b-b9cb9ffbf18f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.381389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abb6dd9c-0dd5-4f8e-96ae-7c8b64eeef7e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:02.382627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-abb6dd9c-0dd5-4f8e-96ae-7c8b64eeef7e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:02.392615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abb6dd9c-0dd5-4f8e-96ae-7c8b64eeef7e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.393511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abb6dd9c-0dd5-4f8e-96ae-7c8b64eeef7e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.394153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abb6dd9c-0dd5-4f8e-96ae-7c8b64eeef7e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.395323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abb6dd9c-0dd5-4f8e-96ae-7c8b64eeef7e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.396004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abb6dd9c-0dd5-4f8e-96ae-7c8b64eeef7e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.397153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abb6dd9c-0dd5-4f8e-96ae-7c8b64eeef7e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.405315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:02.567785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c9b3c0c0-44ae-490e-803b-b9cb9ffbf18f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:02.577427 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c9b3c0c0-44ae-490e-803b-b9cb9ffbf18f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.237007 Aug 27 05:10:02.578317 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3039/6128] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:02 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:02.580728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-abb6dd9c-0dd5-4f8e-96ae-7c8b64eeef7e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:02.589368 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-abb6dd9c-0dd5-4f8e-96ae-7c8b64eeef7e tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.216081 Aug 27 05:10:02.593200 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3090/6129] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:02 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:02.760301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-87e9f831-0230-484c-9bec-52b83841959d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:02.761236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-87e9f831-0230-484c-9bec-52b83841959d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:02.768582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87e9f831-0230-484c-9bec-52b83841959d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.769169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87e9f831-0230-484c-9bec-52b83841959d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.769693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87e9f831-0230-484c-9bec-52b83841959d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.770774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87e9f831-0230-484c-9bec-52b83841959d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.771053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87e9f831-0230-484c-9bec-52b83841959d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.771831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87e9f831-0230-484c-9bec-52b83841959d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:02.909458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-87e9f831-0230-484c-9bec-52b83841959d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:02.917390 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-87e9f831-0230-484c-9bec-52b83841959d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1367 microversion: 2.1 time: 0.161002 Aug 27 05:10:02.917947 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3040/6130] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:02 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:02.991473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60118a2f-edb5-4e8c-874a-1651fe1c21d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:02.992096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60118a2f-edb5-4e8c-874a-1651fe1c21d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:02.998676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60118a2f-edb5-4e8c-874a-1651fe1c21d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:02.999110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60118a2f-edb5-4e8c-874a-1651fe1c21d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:02.999555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60118a2f-edb5-4e8c-874a-1651fe1c21d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:03.000260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60118a2f-edb5-4e8c-874a-1651fe1c21d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:03.000758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60118a2f-edb5-4e8c-874a-1651fe1c21d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:03.001688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60118a2f-edb5-4e8c-874a-1651fe1c21d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:03.167954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60118a2f-edb5-4e8c-874a-1651fe1c21d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:03.176590 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60118a2f-edb5-4e8c-874a-1651fe1c21d5 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1265 microversion: 2.1 time: 0.189068 Aug 27 05:10:03.177690 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3091/6131] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:02 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:03.599804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-739cbcf1-0516-4d25-afa7-fa20bb3cfaed tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:03.600423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-739cbcf1-0516-4d25-afa7-fa20bb3cfaed tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:03.607406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-739cbcf1-0516-4d25-afa7-fa20bb3cfaed tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:03.607893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-739cbcf1-0516-4d25-afa7-fa20bb3cfaed tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:03.608363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-739cbcf1-0516-4d25-afa7-fa20bb3cfaed tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:03.609090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-739cbcf1-0516-4d25-afa7-fa20bb3cfaed tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:03.609550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-739cbcf1-0516-4d25-afa7-fa20bb3cfaed tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:03.609979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-739cbcf1-0516-4d25-afa7-fa20bb3cfaed tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:03.616277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3df3e24-2c15-462f-898f-e6a7796d26de tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:03.616874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c3df3e24-2c15-462f-898f-e6a7796d26de tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:03.624177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3df3e24-2c15-462f-898f-e6a7796d26de tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:03.624755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3df3e24-2c15-462f-898f-e6a7796d26de tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:03.625215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3df3e24-2c15-462f-898f-e6a7796d26de tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:03.626143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3df3e24-2c15-462f-898f-e6a7796d26de tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:03.626787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3df3e24-2c15-462f-898f-e6a7796d26de tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:03.627421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3df3e24-2c15-462f-898f-e6a7796d26de tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:03.758280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-739cbcf1-0516-4d25-afa7-fa20bb3cfaed tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:03.767430 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-739cbcf1-0516-4d25-afa7-fa20bb3cfaed tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.172155 Aug 27 05:10:03.768383 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3041/6132] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:03 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:03.777560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3df3e24-2c15-462f-898f-e6a7796d26de tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:03.786170 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3df3e24-2c15-462f-898f-e6a7796d26de tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1689 microversion: 2.1 time: 0.174317 Aug 27 05:10:03.786757 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3092/6133] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:03 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:03.938291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-76a44494-8759-4908-8269-29a7f28c7bb9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:03.939644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-76a44494-8759-4908-8269-29a7f28c7bb9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:03.945939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76a44494-8759-4908-8269-29a7f28c7bb9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:03.946664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76a44494-8759-4908-8269-29a7f28c7bb9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:03.947259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76a44494-8759-4908-8269-29a7f28c7bb9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:03.948225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76a44494-8759-4908-8269-29a7f28c7bb9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:03.948873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76a44494-8759-4908-8269-29a7f28c7bb9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:03.949616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76a44494-8759-4908-8269-29a7f28c7bb9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.112252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-76a44494-8759-4908-8269-29a7f28c7bb9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:04.124247 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-76a44494-8759-4908-8269-29a7f28c7bb9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1367 microversion: 2.1 time: 0.189894 Aug 27 05:10:04.132963 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3042/6134] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:03 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:04.205327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e4d0366-9030-4f3a-a771-8fa302cd8a0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:04.207419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e4d0366-9030-4f3a-a771-8fa302cd8a0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:04.214900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e4d0366-9030-4f3a-a771-8fa302cd8a0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.215728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e4d0366-9030-4f3a-a771-8fa302cd8a0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.216999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e4d0366-9030-4f3a-a771-8fa302cd8a0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.218097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e4d0366-9030-4f3a-a771-8fa302cd8a0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.219271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e4d0366-9030-4f3a-a771-8fa302cd8a0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.220361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e4d0366-9030-4f3a-a771-8fa302cd8a0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.566135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e4d0366-9030-4f3a-a771-8fa302cd8a0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:04.574849 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e4d0366-9030-4f3a-a771-8fa302cd8a0f tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1265 microversion: 2.1 time: 0.378988 Aug 27 05:10:04.575577 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3093/6135] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:04 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1265 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:04.790602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0c18f427-af09-416b-9f65-372d6a1d374f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:04.791416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0c18f427-af09-416b-9f65-372d6a1d374f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:04.799750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c18f427-af09-416b-9f65-372d6a1d374f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.800474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c18f427-af09-416b-9f65-372d6a1d374f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.807698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdbb48b5-8626-4eff-bb8e-a38de0b44fe2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:04.808332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bdbb48b5-8626-4eff-bb8e-a38de0b44fe2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:04.814502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c18f427-af09-416b-9f65-372d6a1d374f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.815293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c18f427-af09-416b-9f65-372d6a1d374f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.817087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c18f427-af09-416b-9f65-372d6a1d374f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.817713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdbb48b5-8626-4eff-bb8e-a38de0b44fe2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.818318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0c18f427-af09-416b-9f65-372d6a1d374f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.819000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdbb48b5-8626-4eff-bb8e-a38de0b44fe2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.821962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdbb48b5-8626-4eff-bb8e-a38de0b44fe2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.822951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdbb48b5-8626-4eff-bb8e-a38de0b44fe2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:04.823587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdbb48b5-8626-4eff-bb8e-a38de0b44fe2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:04.824846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdbb48b5-8626-4eff-bb8e-a38de0b44fe2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:04.994366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0c18f427-af09-416b-9f65-372d6a1d374f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:05.004264 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0c18f427-af09-416b-9f65-372d6a1d374f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.218950 Aug 27 05:10:05.004894 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3043/6136] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:04 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:05.009856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdbb48b5-8626-4eff-bb8e-a38de0b44fe2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:05.018061 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdbb48b5-8626-4eff-bb8e-a38de0b44fe2 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1695 microversion: 2.1 time: 0.214417 Aug 27 05:10:05.018651 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3094/6137] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:04 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1695 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:10:05.147318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1b8d7355-795a-466a-ba4e-15e1f950f0e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:05.147936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1b8d7355-795a-466a-ba4e-15e1f950f0e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:05.154548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b8d7355-795a-466a-ba4e-15e1f950f0e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:05.155093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b8d7355-795a-466a-ba4e-15e1f950f0e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:05.155533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b8d7355-795a-466a-ba4e-15e1f950f0e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:05.156229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b8d7355-795a-466a-ba4e-15e1f950f0e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:05.156723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b8d7355-795a-466a-ba4e-15e1f950f0e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:05.157147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b8d7355-795a-466a-ba4e-15e1f950f0e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:05.296611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1b8d7355-795a-466a-ba4e-15e1f950f0e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:05.305274 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1b8d7355-795a-466a-ba4e-15e1f950f0e1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1367 microversion: 2.1 time: 0.161889 Aug 27 05:10:05.305884 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3044/6138] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:05 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:05.596561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-980c2025-f5a9-4a93-85e8-9f3e929ee06c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:05.597412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-980c2025-f5a9-4a93-85e8-9f3e929ee06c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:05.604354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-980c2025-f5a9-4a93-85e8-9f3e929ee06c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:05.604893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-980c2025-f5a9-4a93-85e8-9f3e929ee06c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:05.605349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-980c2025-f5a9-4a93-85e8-9f3e929ee06c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:05.606079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-980c2025-f5a9-4a93-85e8-9f3e929ee06c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:05.606549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-980c2025-f5a9-4a93-85e8-9f3e929ee06c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:05.607011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-980c2025-f5a9-4a93-85e8-9f3e929ee06c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:05.754935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-980c2025-f5a9-4a93-85e8-9f3e929ee06c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:05.763050 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-980c2025-f5a9-4a93-85e8-9f3e929ee06c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1265 microversion: 2.1 time: 0.171318 Aug 27 05:10:05.763636 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3095/6139] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:05 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:06.025639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2a513534-5587-47b5-a6de-054aef4de7cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:06.026431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2a513534-5587-47b5-a6de-054aef4de7cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:06.033694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a513534-5587-47b5-a6de-054aef4de7cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.034192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a513534-5587-47b5-a6de-054aef4de7cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.034771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a513534-5587-47b5-a6de-054aef4de7cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.035486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a513534-5587-47b5-a6de-054aef4de7cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.035974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a513534-5587-47b5-a6de-054aef4de7cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.036390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a513534-5587-47b5-a6de-054aef4de7cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.043264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a2fc6e09-1aab-4e2d-acde-3f7a538e0bf8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:06.043902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a2fc6e09-1aab-4e2d-acde-3f7a538e0bf8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:06.051332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2fc6e09-1aab-4e2d-acde-3f7a538e0bf8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.051844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2fc6e09-1aab-4e2d-acde-3f7a538e0bf8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.052390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2fc6e09-1aab-4e2d-acde-3f7a538e0bf8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.053690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2fc6e09-1aab-4e2d-acde-3f7a538e0bf8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.053811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2fc6e09-1aab-4e2d-acde-3f7a538e0bf8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.054186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2fc6e09-1aab-4e2d-acde-3f7a538e0bf8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.195607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a513534-5587-47b5-a6de-054aef4de7cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:06.214969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a2fc6e09-1aab-4e2d-acde-3f7a538e0bf8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:06.215732 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2a513534-5587-47b5-a6de-054aef4de7cc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.193865 Aug 27 05:10:06.216776 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3045/6140] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:06 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:06.223707 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a2fc6e09-1aab-4e2d-acde-3f7a538e0bf8 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1695 microversion: 2.1 time: 0.184387 Aug 27 05:10:06.224805 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3096/6141] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:06 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:06.326125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7e2ee958-85fb-4e65-9b81-67917fdd5988 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:06.326765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7e2ee958-85fb-4e65-9b81-67917fdd5988 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:06.333349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e2ee958-85fb-4e65-9b81-67917fdd5988 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.333843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e2ee958-85fb-4e65-9b81-67917fdd5988 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.334286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e2ee958-85fb-4e65-9b81-67917fdd5988 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.334985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e2ee958-85fb-4e65-9b81-67917fdd5988 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.335444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e2ee958-85fb-4e65-9b81-67917fdd5988 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.335870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e2ee958-85fb-4e65-9b81-67917fdd5988 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.472268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7e2ee958-85fb-4e65-9b81-67917fdd5988 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:06.489024 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7e2ee958-85fb-4e65-9b81-67917fdd5988 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1367 microversion: 2.1 time: 0.166787 Aug 27 05:10:06.489810 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3046/6142] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:06 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:06.785096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73b35bf4-d7fc-4d3c-81ef-4fcbd905b00e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:06.785779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73b35bf4-d7fc-4d3c-81ef-4fcbd905b00e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:06.788464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:06.789167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:06.795753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b35bf4-d7fc-4d3c-81ef-4fcbd905b00e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.796260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b35bf4-d7fc-4d3c-81ef-4fcbd905b00e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.796734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b35bf4-d7fc-4d3c-81ef-4fcbd905b00e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.797447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b35bf4-d7fc-4d3c-81ef-4fcbd905b00e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:06.798589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b35bf4-d7fc-4d3c-81ef-4fcbd905b00e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:06.799295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b35bf4-d7fc-4d3c-81ef-4fcbd905b00e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:06.950127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-73b35bf4-d7fc-4d3c-81ef-4fcbd905b00e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:06.959866 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-73b35bf4-d7fc-4d3c-81ef-4fcbd905b00e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1265 microversion: 2.1 time: 0.179045 Aug 27 05:10:06.960666 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3097/6143] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:06 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:07.239659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c773769f-1d55-422d-9b3f-bc1a1968e58e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:07.242691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c773769f-1d55-422d-9b3f-bc1a1968e58e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:07.249028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-44f889a5-9eef-42c6-a5e4-bab0e09ca792 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:07.251121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-44f889a5-9eef-42c6-a5e4-bab0e09ca792 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:07.254020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:07.257752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c773769f-1d55-422d-9b3f-bc1a1968e58e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:07.258493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c773769f-1d55-422d-9b3f-bc1a1968e58e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:07.259370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c773769f-1d55-422d-9b3f-bc1a1968e58e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:07.260233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c773769f-1d55-422d-9b3f-bc1a1968e58e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:07.263134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c773769f-1d55-422d-9b3f-bc1a1968e58e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:07.263748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c773769f-1d55-422d-9b3f-bc1a1968e58e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:07.265025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44f889a5-9eef-42c6-a5e4-bab0e09ca792 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:07.266398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44f889a5-9eef-42c6-a5e4-bab0e09ca792 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:07.267489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44f889a5-9eef-42c6-a5e4-bab0e09ca792 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:07.269267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44f889a5-9eef-42c6-a5e4-bab0e09ca792 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:07.270350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44f889a5-9eef-42c6-a5e4-bab0e09ca792 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:07.271552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44f889a5-9eef-42c6-a5e4-bab0e09ca792 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:07.298578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:07.477603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-44f889a5-9eef-42c6-a5e4-bab0e09ca792 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:07.489506 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-44f889a5-9eef-42c6-a5e4-bab0e09ca792 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1695 microversion: 2.1 time: 0.246592 Aug 27 05:10:07.491112 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3098/6144] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:07 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1695 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:07.525561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c773769f-1d55-422d-9b3f-bc1a1968e58e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:07.535467 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c773769f-1d55-422d-9b3f-bc1a1968e58e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.301459 Aug 27 05:10:07.536781 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3047/6145] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:07 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:07.610835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32fb08a5-a678-4700-82e7-c38272efad05 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:07.611543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32fb08a5-a678-4700-82e7-c38272efad05 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:07.619742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32fb08a5-a678-4700-82e7-c38272efad05 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:07.620253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32fb08a5-a678-4700-82e7-c38272efad05 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:07.620733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32fb08a5-a678-4700-82e7-c38272efad05 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:07.621483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32fb08a5-a678-4700-82e7-c38272efad05 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:07.622200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32fb08a5-a678-4700-82e7-c38272efad05 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:07.622643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32fb08a5-a678-4700-82e7-c38272efad05 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:07.773588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32fb08a5-a678-4700-82e7-c38272efad05 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:07.781591 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32fb08a5-a678-4700-82e7-c38272efad05 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1367 microversion: 2.1 time: 0.174878 Aug 27 05:10:07.782300 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3099/6146] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:07 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:07.983439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-daea4f6b-8b50-4dd1-a60e-6d62330090fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:07.984585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-daea4f6b-8b50-4dd1-a60e-6d62330090fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:07.992734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-daea4f6b-8b50-4dd1-a60e-6d62330090fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:07.993314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-daea4f6b-8b50-4dd1-a60e-6d62330090fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:07.993963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-daea4f6b-8b50-4dd1-a60e-6d62330090fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:07.994923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-daea4f6b-8b50-4dd1-a60e-6d62330090fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:07.996804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-daea4f6b-8b50-4dd1-a60e-6d62330090fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:07.997854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-daea4f6b-8b50-4dd1-a60e-6d62330090fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.171152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-daea4f6b-8b50-4dd1-a60e-6d62330090fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:08.181047 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-daea4f6b-8b50-4dd1-a60e-6d62330090fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1265 microversion: 2.1 time: 0.203557 Aug 27 05:10:08.182477 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3048/6147] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:07 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:08.513836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14e95b76-0344-48f6-95a4-d1dfcf7b4310 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:08.515393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14e95b76-0344-48f6-95a4-d1dfcf7b4310 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:08.523134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14e95b76-0344-48f6-95a4-d1dfcf7b4310 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.523636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14e95b76-0344-48f6-95a4-d1dfcf7b4310 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.524085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14e95b76-0344-48f6-95a4-d1dfcf7b4310 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.524827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14e95b76-0344-48f6-95a4-d1dfcf7b4310 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.525302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14e95b76-0344-48f6-95a4-d1dfcf7b4310 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.525740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14e95b76-0344-48f6-95a4-d1dfcf7b4310 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.556962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fed0a88b-cb19-4184-aee2-c1dc8d957e08 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:08.558238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fed0a88b-cb19-4184-aee2-c1dc8d957e08 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:08.566841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fed0a88b-cb19-4184-aee2-c1dc8d957e08 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.567889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fed0a88b-cb19-4184-aee2-c1dc8d957e08 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.568863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fed0a88b-cb19-4184-aee2-c1dc8d957e08 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.569779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fed0a88b-cb19-4184-aee2-c1dc8d957e08 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.570298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fed0a88b-cb19-4184-aee2-c1dc8d957e08 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.570819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fed0a88b-cb19-4184-aee2-c1dc8d957e08 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.683225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14e95b76-0344-48f6-95a4-d1dfcf7b4310 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:08.694458 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14e95b76-0344-48f6-95a4-d1dfcf7b4310 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1680 microversion: 2.1 time: 0.184516 Aug 27 05:10:08.696886 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3100/6148] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:08 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:08.719064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-eedbe946-418f-44fc-8ef3-ae6de19c42a4 req-d092364f-ea31-4f6b-a6c3-8c8c82a20df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986bd712-6d0e-49a2-8bd4-a5bdc6186b4a", "name": "network-vif-plugged", "status": "completed", "tag": "ddedb5a2-d20a-4db5-a003-bcc5ded9a212"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:08.740709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-eedbe946-418f-44fc-8ef3-ae6de19c42a4 req-d092364f-ea31-4f6b-a6c3-8c8c82a20df4 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.741209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-eedbe946-418f-44fc-8ef3-ae6de19c42a4 req-d092364f-ea31-4f6b-a6c3-8c8c82a20df4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.745941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-eedbe946-418f-44fc-8ef3-ae6de19c42a4 req-d092364f-ea31-4f6b-a6c3-8c8c82a20df4 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.773195 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-eedbe946-418f-44fc-8ef3-ae6de19c42a4 req-d092364f-ea31-4f6b-a6c3-8c8c82a20df4 service nova] Creating event network-vif-plugged:ddedb5a2-d20a-4db5-a003-bcc5ded9a212 for instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a on n-h1-854823-1 Aug 27 05:10:08.786139 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-eedbe946-418f-44fc-8ef3-ae6de19c42a4 req-d092364f-ea31-4f6b-a6c3-8c8c82a20df4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087609 Aug 27 05:10:08.790039 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3101/6149] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:08.804113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5fd0b0e-e20d-4bb0-8e0c-12090cc19e6a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:08.810205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d5fd0b0e-e20d-4bb0-8e0c-12090cc19e6a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:08.818770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5fd0b0e-e20d-4bb0-8e0c-12090cc19e6a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.819476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5fd0b0e-e20d-4bb0-8e0c-12090cc19e6a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.820063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fed0a88b-cb19-4184-aee2-c1dc8d957e08 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:08.820349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5fd0b0e-e20d-4bb0-8e0c-12090cc19e6a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.821458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5fd0b0e-e20d-4bb0-8e0c-12090cc19e6a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:08.822096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5fd0b0e-e20d-4bb0-8e0c-12090cc19e6a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:08.822966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5fd0b0e-e20d-4bb0-8e0c-12090cc19e6a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:08.830082 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fed0a88b-cb19-4184-aee2-c1dc8d957e08 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.276459 Aug 27 05:10:08.833017 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3049/6150] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:08 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:10:09.055188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d5fd0b0e-e20d-4bb0-8e0c-12090cc19e6a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:09.063208 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5fd0b0e-e20d-4bb0-8e0c-12090cc19e6a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1367 microversion: 2.1 time: 0.263836 Aug 27 05:10:09.064470 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3102/6151] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:08 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:09.205731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-180d33ca-6a5c-4e8f-9ecb-e2a8b0e2a669 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:09.206391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-180d33ca-6a5c-4e8f-9ecb-e2a8b0e2a669 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:09.212556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-180d33ca-6a5c-4e8f-9ecb-e2a8b0e2a669 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:09.213070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-180d33ca-6a5c-4e8f-9ecb-e2a8b0e2a669 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:09.213518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-180d33ca-6a5c-4e8f-9ecb-e2a8b0e2a669 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:09.214228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-180d33ca-6a5c-4e8f-9ecb-e2a8b0e2a669 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:09.214716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-180d33ca-6a5c-4e8f-9ecb-e2a8b0e2a669 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:09.215151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-180d33ca-6a5c-4e8f-9ecb-e2a8b0e2a669 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:09.357925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-180d33ca-6a5c-4e8f-9ecb-e2a8b0e2a669 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:09.366925 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-180d33ca-6a5c-4e8f-9ecb-e2a8b0e2a669 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1265 microversion: 2.1 time: 0.166348 Aug 27 05:10:09.368021 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3050/6152] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:09 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:09.852207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d4cebb1-21f0-4438-b3ee-834e3dcbd841 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:09.852879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d4cebb1-21f0-4438-b3ee-834e3dcbd841 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:09.855229 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:10:09.855385 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:10:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 (ip 10.222.0.79) !!! Aug 27 05:10:09.863614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d4cebb1-21f0-4438-b3ee-834e3dcbd841 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:09.864130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d4cebb1-21f0-4438-b3ee-834e3dcbd841 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:09.864619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d4cebb1-21f0-4438-b3ee-834e3dcbd841 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:09.865352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d4cebb1-21f0-4438-b3ee-834e3dcbd841 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:09.865830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d4cebb1-21f0-4438-b3ee-834e3dcbd841 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:09.866275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d4cebb1-21f0-4438-b3ee-834e3dcbd841 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:10.006648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d4cebb1-21f0-4438-b3ee-834e3dcbd841 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:10.015786 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d4cebb1-21f0-4438-b3ee-834e3dcbd841 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.167795 Aug 27 05:10:10.016394 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3103/6153] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:09 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:10.085334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2b47382d-77d5-4730-a3e1-e3f8b491d5b2 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:10.085920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2b47382d-77d5-4730-a3e1-e3f8b491d5b2 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:10.092847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b47382d-77d5-4730-a3e1-e3f8b491d5b2 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:10.093331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b47382d-77d5-4730-a3e1-e3f8b491d5b2 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:10.093769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b47382d-77d5-4730-a3e1-e3f8b491d5b2 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:10.094462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b47382d-77d5-4730-a3e1-e3f8b491d5b2 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:10.095495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b47382d-77d5-4730-a3e1-e3f8b491d5b2 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:10.095935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b47382d-77d5-4730-a3e1-e3f8b491d5b2 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:10.228134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2b47382d-77d5-4730-a3e1-e3f8b491d5b2 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:10.236025 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2b47382d-77d5-4730-a3e1-e3f8b491d5b2 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1367 microversion: 2.1 time: 0.154615 Aug 27 05:10:10.236630 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3051/6154] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:10 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:10.389049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-efc8e941-2805-4580-a0ca-4dce4a8f2eae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:10.389568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-efc8e941-2805-4580-a0ca-4dce4a8f2eae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:10.396219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efc8e941-2805-4580-a0ca-4dce4a8f2eae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:10.396801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efc8e941-2805-4580-a0ca-4dce4a8f2eae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:10.397252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efc8e941-2805-4580-a0ca-4dce4a8f2eae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:10.397960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efc8e941-2805-4580-a0ca-4dce4a8f2eae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:10.398470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efc8e941-2805-4580-a0ca-4dce4a8f2eae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:10.398886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efc8e941-2805-4580-a0ca-4dce4a8f2eae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:10.528106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-efc8e941-2805-4580-a0ca-4dce4a8f2eae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:10.535992 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-efc8e941-2805-4580-a0ca-4dce4a8f2eae tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1265 microversion: 2.1 time: 0.151091 Aug 27 05:10:10.536587 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3104/6155] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:10 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:10.841029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ee90b6c4-df59-4f92-ac0a-fd426f2c1716 req-29f369a7-3007-407a-af6b-b60cc9cb9920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee5152a-fc8b-4030-8124-ba770b583613", "name": "network-vif-plugged", "status": "completed", "tag": "c98f302a-c0c6-4949-83df-8de3742feedd"}, {"server_uuid": "aa772619-856a-4d48-981c-e4f2cdd39e29", "name": "network-vif-plugged", "status": "completed", "tag": "2be38a72-a68a-4e59-9f92-1a716c927f84"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:10.851710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ee90b6c4-df59-4f92-ac0a-fd426f2c1716 req-29f369a7-3007-407a-af6b-b60cc9cb9920 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:10.852192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ee90b6c4-df59-4f92-ac0a-fd426f2c1716 req-29f369a7-3007-407a-af6b-b60cc9cb9920 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:10.852661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ee90b6c4-df59-4f92-ac0a-fd426f2c1716 req-29f369a7-3007-407a-af6b-b60cc9cb9920 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:10.865587 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ee90b6c4-df59-4f92-ac0a-fd426f2c1716 req-29f369a7-3007-407a-af6b-b60cc9cb9920 service nova] Creating event network-vif-plugged:c98f302a-c0c6-4949-83df-8de3742feedd for instance 9ee5152a-fc8b-4030-8124-ba770b583613 on n-h2-854823-1 Aug 27 05:10:10.866098 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ee90b6c4-df59-4f92-ac0a-fd426f2c1716 req-29f369a7-3007-407a-af6b-b60cc9cb9920 service nova] Creating event network-vif-plugged:2be38a72-a68a-4e59-9f92-1a716c927f84 for instance aa772619-856a-4d48-981c-e4f2cdd39e29 on n-h2-854823-1 Aug 27 05:10:10.872812 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ee90b6c4-df59-4f92-ac0a-fd426f2c1716 req-29f369a7-3007-407a-af6b-b60cc9cb9920 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035542 Aug 27 05:10:10.873404 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3052/6156] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:11.043773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca5a6cbb-3cc7-4901-bfb3-6e7d6f970edc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:11.044401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca5a6cbb-3cc7-4901-bfb3-6e7d6f970edc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:11.052016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca5a6cbb-3cc7-4901-bfb3-6e7d6f970edc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:11.052522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca5a6cbb-3cc7-4901-bfb3-6e7d6f970edc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:11.053129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca5a6cbb-3cc7-4901-bfb3-6e7d6f970edc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:11.053860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca5a6cbb-3cc7-4901-bfb3-6e7d6f970edc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:11.054338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca5a6cbb-3cc7-4901-bfb3-6e7d6f970edc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:11.054779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca5a6cbb-3cc7-4901-bfb3-6e7d6f970edc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:11.194576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca5a6cbb-3cc7-4901-bfb3-6e7d6f970edc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:11.203245 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca5a6cbb-3cc7-4901-bfb3-6e7d6f970edc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.163361 Aug 27 05:10:11.203862 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3105/6157] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:11 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:11.259818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-74ff2ccb-ef3c-4b4e-8333-c7aeb7757d3c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:11.260775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-74ff2ccb-ef3c-4b4e-8333-c7aeb7757d3c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:11.267247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ff2ccb-ef3c-4b4e-8333-c7aeb7757d3c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:11.267726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ff2ccb-ef3c-4b4e-8333-c7aeb7757d3c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:11.268171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ff2ccb-ef3c-4b4e-8333-c7aeb7757d3c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:11.268937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ff2ccb-ef3c-4b4e-8333-c7aeb7757d3c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:11.269400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ff2ccb-ef3c-4b4e-8333-c7aeb7757d3c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:11.269833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-74ff2ccb-ef3c-4b4e-8333-c7aeb7757d3c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:11.411580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-74ff2ccb-ef3c-4b4e-8333-c7aeb7757d3c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:11.420308 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-74ff2ccb-ef3c-4b4e-8333-c7aeb7757d3c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1556 microversion: 2.1 time: 0.166397 Aug 27 05:10:11.420988 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3053/6158] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:11 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:11.442254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f4dfc97-e1de-4303-b7b8-88664d29b5d6 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:11.442769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f4dfc97-e1de-4303-b7b8-88664d29b5d6 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:11.448961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f4dfc97-e1de-4303-b7b8-88664d29b5d6 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:11.449462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f4dfc97-e1de-4303-b7b8-88664d29b5d6 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:11.449910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f4dfc97-e1de-4303-b7b8-88664d29b5d6 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:11.450622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f4dfc97-e1de-4303-b7b8-88664d29b5d6 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:11.451095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f4dfc97-e1de-4303-b7b8-88664d29b5d6 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:11.451666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f4dfc97-e1de-4303-b7b8-88664d29b5d6 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:11.535832 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f4dfc97-e1de-4303-b7b8-88664d29b5d6 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098123 Aug 27 05:10:11.536582 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3106/6159] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 05:10:11 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:11.560014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-89d4444c-b7be-41ed-abc9-83a9072b328e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:11.560947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-89d4444c-b7be-41ed-abc9-83a9072b328e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:11.568400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-89d4444c-b7be-41ed-abc9-83a9072b328e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:11.569117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-89d4444c-b7be-41ed-abc9-83a9072b328e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:11.569620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-89d4444c-b7be-41ed-abc9-83a9072b328e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:11.570342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-89d4444c-b7be-41ed-abc9-83a9072b328e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:11.570828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-89d4444c-b7be-41ed-abc9-83a9072b328e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:11.571427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-89d4444c-b7be-41ed-abc9-83a9072b328e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:11.712679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-89d4444c-b7be-41ed-abc9-83a9072b328e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:11.720626 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-89d4444c-b7be-41ed-abc9-83a9072b328e tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1265 microversion: 2.1 time: 0.166749 Aug 27 05:10:11.721759 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3054/6160] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:11 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:12.226385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-877d0e0a-7ed8-4650-a613-0b18ef4ba453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:12.227156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-877d0e0a-7ed8-4650-a613-0b18ef4ba453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:12.234208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-877d0e0a-7ed8-4650-a613-0b18ef4ba453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:12.234803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-877d0e0a-7ed8-4650-a613-0b18ef4ba453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:12.235332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-877d0e0a-7ed8-4650-a613-0b18ef4ba453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:12.236127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-877d0e0a-7ed8-4650-a613-0b18ef4ba453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:12.237242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-877d0e0a-7ed8-4650-a613-0b18ef4ba453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:12.237761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-877d0e0a-7ed8-4650-a613-0b18ef4ba453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:12.743588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a6888467-5b10-4b7a-8583-c104a834c3af tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:12.744320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a6888467-5b10-4b7a-8583-c104a834c3af tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:12.752138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6888467-5b10-4b7a-8583-c104a834c3af tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:12.752717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6888467-5b10-4b7a-8583-c104a834c3af tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:12.753156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6888467-5b10-4b7a-8583-c104a834c3af tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:12.753867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6888467-5b10-4b7a-8583-c104a834c3af tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:12.754325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6888467-5b10-4b7a-8583-c104a834c3af tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:12.754748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6888467-5b10-4b7a-8583-c104a834c3af tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:12.808650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-877d0e0a-7ed8-4650-a613-0b18ef4ba453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:12.829721 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-877d0e0a-7ed8-4650-a613-0b18ef4ba453 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.597097 Aug 27 05:10:12.831043 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3107/6161] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:12 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:12.938913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a6888467-5b10-4b7a-8583-c104a834c3af tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:12.948291 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a6888467-5b10-4b7a-8583-c104a834c3af tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1452 microversion: 2.1 time: 0.209036 Aug 27 05:10:12.948928 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3055/6162] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:12 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:12.969956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ab66cc3-bc14-428d-8dc9-8b39821771f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:12.970621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ab66cc3-bc14-428d-8dc9-8b39821771f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:12.983110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ab66cc3-bc14-428d-8dc9-8b39821771f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:12.983627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ab66cc3-bc14-428d-8dc9-8b39821771f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:12.984097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ab66cc3-bc14-428d-8dc9-8b39821771f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:12.984904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ab66cc3-bc14-428d-8dc9-8b39821771f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:12.985442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ab66cc3-bc14-428d-8dc9-8b39821771f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:12.985894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ab66cc3-bc14-428d-8dc9-8b39821771f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:13.026776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-43300a7e-ae40-46de-bc6d-dabad783340f req-abbbbc06-bb00-42c6-b506-646d41ec6dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986bd712-6d0e-49a2-8bd4-a5bdc6186b4a", "tag": "ddedb5a2-d20a-4db5-a003-bcc5ded9a212"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:13.037930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-43300a7e-ae40-46de-bc6d-dabad783340f req-abbbbc06-bb00-42c6-b506-646d41ec6dbe service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:13.038417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-43300a7e-ae40-46de-bc6d-dabad783340f req-abbbbc06-bb00-42c6-b506-646d41ec6dbe service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:13.038852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-43300a7e-ae40-46de-bc6d-dabad783340f req-abbbbc06-bb00-42c6-b506-646d41ec6dbe service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:13.051429 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-43300a7e-ae40-46de-bc6d-dabad783340f req-abbbbc06-bb00-42c6-b506-646d41ec6dbe service nova] Creating event network-changed:ddedb5a2-d20a-4db5-a003-bcc5ded9a212 for instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a on n-h1-854823-1 Aug 27 05:10:13.056461 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-43300a7e-ae40-46de-bc6d-dabad783340f req-abbbbc06-bb00-42c6-b506-646d41ec6dbe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033732 Aug 27 05:10:13.057442 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3056/6163] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:10:13.175507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ab66cc3-bc14-428d-8dc9-8b39821771f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:13.185758 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ab66cc3-bc14-428d-8dc9-8b39821771f4 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1452 microversion: 2.1 time: 0.219668 Aug 27 05:10:13.186367 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3108/6164] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:12 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1452 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:13.854934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-41da92dd-d4d5-4b2d-9249-914b0119b10c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:13.859992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-41da92dd-d4d5-4b2d-9249-914b0119b10c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:13.882974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41da92dd-d4d5-4b2d-9249-914b0119b10c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:13.885052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41da92dd-d4d5-4b2d-9249-914b0119b10c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:13.886378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41da92dd-d4d5-4b2d-9249-914b0119b10c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:13.888867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41da92dd-d4d5-4b2d-9249-914b0119b10c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:13.891924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41da92dd-d4d5-4b2d-9249-914b0119b10c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:13.894081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-41da92dd-d4d5-4b2d-9249-914b0119b10c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:13.918236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:14.270596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-41da92dd-d4d5-4b2d-9249-914b0119b10c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:14.278793 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-41da92dd-d4d5-4b2d-9249-914b0119b10c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1655 microversion: 2.1 time: 0.429202 Aug 27 05:10:14.279400 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3057/6165] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:13 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1655 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:14.305245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e0070bb-6f76-4cba-bf3f-4a8d0515fd6b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:14.315266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e0070bb-6f76-4cba-bf3f-4a8d0515fd6b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:14.316147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e0070bb-6f76-4cba-bf3f-4a8d0515fd6b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:14.317416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e0070bb-6f76-4cba-bf3f-4a8d0515fd6b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:14.357569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e0070bb-6f76-4cba-bf3f-4a8d0515fd6b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Going to try to start instance {{(pid=128869) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 05:10:14.430394 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e0070bb-6f76-4cba-bf3f-4a8d0515fd6b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.128644 Aug 27 05:10:14.441595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-206d21c1-834c-4886-a544-279d3c0f5cf3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:14.443314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-206d21c1-834c-4886-a544-279d3c0f5cf3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:14.449059 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3109/6166] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:14 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:10:14.457904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-206d21c1-834c-4886-a544-279d3c0f5cf3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:14.474214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-206d21c1-834c-4886-a544-279d3c0f5cf3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:14.475007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-206d21c1-834c-4886-a544-279d3c0f5cf3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:14.475908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-206d21c1-834c-4886-a544-279d3c0f5cf3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:14.477247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-206d21c1-834c-4886-a544-279d3c0f5cf3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:14.477910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-206d21c1-834c-4886-a544-279d3c0f5cf3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:14.935973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-206d21c1-834c-4886-a544-279d3c0f5cf3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:14.945655 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-206d21c1-834c-4886-a544-279d3c0f5cf3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1664 microversion: 2.1 time: 0.509463 Aug 27 05:10:14.957960 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3058/6167] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:14 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1664 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:10:15.969516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-87c99288-fd21-4b52-aa3c-5f75fe603f55 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:15.970233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-87c99288-fd21-4b52-aa3c-5f75fe603f55 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:15.977473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87c99288-fd21-4b52-aa3c-5f75fe603f55 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:15.977977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87c99288-fd21-4b52-aa3c-5f75fe603f55 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:15.978695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87c99288-fd21-4b52-aa3c-5f75fe603f55 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:15.979339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87c99288-fd21-4b52-aa3c-5f75fe603f55 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:15.979977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87c99288-fd21-4b52-aa3c-5f75fe603f55 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:15.980420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87c99288-fd21-4b52-aa3c-5f75fe603f55 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.129063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-87c99288-fd21-4b52-aa3c-5f75fe603f55 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:16.139276 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-87c99288-fd21-4b52-aa3c-5f75fe603f55 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.173900 Aug 27 05:10:16.140369 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3110/6168] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:15 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:16.160085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-499dc605-ec31-43f2-8360-12e2e7cb32a9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:16.160739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-499dc605-ec31-43f2-8360-12e2e7cb32a9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:16.173371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-499dc605-ec31-43f2-8360-12e2e7cb32a9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.176886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-499dc605-ec31-43f2-8360-12e2e7cb32a9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.177504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-499dc605-ec31-43f2-8360-12e2e7cb32a9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.178647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-499dc605-ec31-43f2-8360-12e2e7cb32a9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.179375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-499dc605-ec31-43f2-8360-12e2e7cb32a9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.180044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-499dc605-ec31-43f2-8360-12e2e7cb32a9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.415394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-499dc605-ec31-43f2-8360-12e2e7cb32a9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:16.419300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-31184298-0a6c-42a1-b5d3-8b141e78120d req-20c6bb9e-aee7-4360-898a-23d3c05eaca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee5152a-fc8b-4030-8124-ba770b583613", "tag": "c98f302a-c0c6-4949-83df-8de3742feedd"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:16.429217 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-499dc605-ec31-43f2-8360-12e2e7cb32a9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.273026 Aug 27 05:10:16.430050 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3059/6169] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:16 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:16.438493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-31184298-0a6c-42a1-b5d3-8b141e78120d req-20c6bb9e-aee7-4360-898a-23d3c05eaca3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.439264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-31184298-0a6c-42a1-b5d3-8b141e78120d req-20c6bb9e-aee7-4360-898a-23d3c05eaca3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.445833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-31184298-0a6c-42a1-b5d3-8b141e78120d req-20c6bb9e-aee7-4360-898a-23d3c05eaca3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.450368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-19ea636e-556d-465d-a1b0-627c0f72653e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:16.450887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-19ea636e-556d-465d-a1b0-627c0f72653e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:16.471603 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-31184298-0a6c-42a1-b5d3-8b141e78120d req-20c6bb9e-aee7-4360-898a-23d3c05eaca3 service nova] Creating event network-changed:c98f302a-c0c6-4949-83df-8de3742feedd for instance 9ee5152a-fc8b-4030-8124-ba770b583613 on n-h2-854823-1 Aug 27 05:10:16.472311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19ea636e-556d-465d-a1b0-627c0f72653e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.475834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19ea636e-556d-465d-a1b0-627c0f72653e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.477650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19ea636e-556d-465d-a1b0-627c0f72653e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.478365 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-31184298-0a6c-42a1-b5d3-8b141e78120d req-20c6bb9e-aee7-4360-898a-23d3c05eaca3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062835 Aug 27 05:10:16.479233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19ea636e-556d-465d-a1b0-627c0f72653e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.479530 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3111/6170] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:10:16.480350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19ea636e-556d-465d-a1b0-627c0f72653e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.481883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19ea636e-556d-465d-a1b0-627c0f72653e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.556260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-19ea636e-556d-465d-a1b0-627c0f72653e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Unlocking {{(pid=128870) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 27 05:10:16.618537 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-19ea636e-556d-465d-a1b0-627c0f72653e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.172527 Aug 27 05:10:16.619199 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3060/6171] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:16 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:10:16.635531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c31e16c-9c90-4d48-b62d-8be0abb102bc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:16.636678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c31e16c-9c90-4d48-b62d-8be0abb102bc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:16.647370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c31e16c-9c90-4d48-b62d-8be0abb102bc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.648834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c31e16c-9c90-4d48-b62d-8be0abb102bc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.649779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c31e16c-9c90-4d48-b62d-8be0abb102bc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.650933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c31e16c-9c90-4d48-b62d-8be0abb102bc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.652127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c31e16c-9c90-4d48-b62d-8be0abb102bc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.652828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c31e16c-9c90-4d48-b62d-8be0abb102bc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.857378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c31e16c-9c90-4d48-b62d-8be0abb102bc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:16.867187 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c31e16c-9c90-4d48-b62d-8be0abb102bc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.238897 Aug 27 05:10:16.868108 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3112/6172] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:16 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:16.888403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b795f6f7-0f00-47c8-b7ef-200c3094403b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:16.888924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b795f6f7-0f00-47c8-b7ef-200c3094403b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:16.895615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b795f6f7-0f00-47c8-b7ef-200c3094403b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.896111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b795f6f7-0f00-47c8-b7ef-200c3094403b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.896610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b795f6f7-0f00-47c8-b7ef-200c3094403b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:16.897326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b795f6f7-0f00-47c8-b7ef-200c3094403b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:16.897786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b795f6f7-0f00-47c8-b7ef-200c3094403b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:16.898411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b795f6f7-0f00-47c8-b7ef-200c3094403b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.161126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b795f6f7-0f00-47c8-b7ef-200c3094403b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:17.177851 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b795f6f7-0f00-47c8-b7ef-200c3094403b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.293379 Aug 27 05:10:17.179121 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3061/6173] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:16 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:17.198756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a40d0e7a-1e68-4086-bdd8-f203c4ebc8b6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:17.199508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a40d0e7a-1e68-4086-bdd8-f203c4ebc8b6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:17.208098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a40d0e7a-1e68-4086-bdd8-f203c4ebc8b6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.208623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a40d0e7a-1e68-4086-bdd8-f203c4ebc8b6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.209107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a40d0e7a-1e68-4086-bdd8-f203c4ebc8b6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.209826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a40d0e7a-1e68-4086-bdd8-f203c4ebc8b6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.210294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a40d0e7a-1e68-4086-bdd8-f203c4ebc8b6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.210733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a40d0e7a-1e68-4086-bdd8-f203c4ebc8b6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.366445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a40d0e7a-1e68-4086-bdd8-f203c4ebc8b6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:17.374912 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a40d0e7a-1e68-4086-bdd8-f203c4ebc8b6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.180511 Aug 27 05:10:17.376153 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3113/6174] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:17 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:17.396386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7f8400c2-6b39-4a81-be8e-05b7dcd8d00a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:17.397031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7f8400c2-6b39-4a81-be8e-05b7dcd8d00a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:17.404253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f8400c2-6b39-4a81-be8e-05b7dcd8d00a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.404776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f8400c2-6b39-4a81-be8e-05b7dcd8d00a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.405206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f8400c2-6b39-4a81-be8e-05b7dcd8d00a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.406540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f8400c2-6b39-4a81-be8e-05b7dcd8d00a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.406992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f8400c2-6b39-4a81-be8e-05b7dcd8d00a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.407414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f8400c2-6b39-4a81-be8e-05b7dcd8d00a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.483933 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7f8400c2-6b39-4a81-be8e-05b7dcd8d00a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.091746 Aug 27 05:10:17.488151 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3062/6175] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:17 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:10:17.493563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36e38615-082b-43ac-8af0-c5c2f705fc8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:17.494202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36e38615-082b-43ac-8af0-c5c2f705fc8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:17.500785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36e38615-082b-43ac-8af0-c5c2f705fc8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.501301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36e38615-082b-43ac-8af0-c5c2f705fc8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.501761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36e38615-082b-43ac-8af0-c5c2f705fc8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.502542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36e38615-082b-43ac-8af0-c5c2f705fc8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:17.503047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36e38615-082b-43ac-8af0-c5c2f705fc8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:17.503521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36e38615-082b-43ac-8af0-c5c2f705fc8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:17.672467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36e38615-082b-43ac-8af0-c5c2f705fc8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:17.683803 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36e38615-082b-43ac-8af0-c5c2f705fc8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1673 microversion: 2.1 time: 0.192744 Aug 27 05:10:17.685108 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3114/6176] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:17 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:18.709149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-493ac8a3-cb94-4ab5-93f3-fed3da514a94 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:18.709951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-493ac8a3-cb94-4ab5-93f3-fed3da514a94 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:18.717460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-493ac8a3-cb94-4ab5-93f3-fed3da514a94 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:18.717960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-493ac8a3-cb94-4ab5-93f3-fed3da514a94 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:18.718410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-493ac8a3-cb94-4ab5-93f3-fed3da514a94 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:18.719126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-493ac8a3-cb94-4ab5-93f3-fed3da514a94 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:18.719588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-493ac8a3-cb94-4ab5-93f3-fed3da514a94 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:18.720018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-493ac8a3-cb94-4ab5-93f3-fed3da514a94 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:18.854931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-493ac8a3-cb94-4ab5-93f3-fed3da514a94 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:18.863291 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-493ac8a3-cb94-4ab5-93f3-fed3da514a94 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1653 microversion: 2.1 time: 0.159176 Aug 27 05:10:18.863870 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3063/6177] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:18 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1653 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:10:18.884611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34222e3f-01dd-4772-ac50-cd1420f8d5db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:18.885253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34222e3f-01dd-4772-ac50-cd1420f8d5db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:18.892180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34222e3f-01dd-4772-ac50-cd1420f8d5db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:18.893353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34222e3f-01dd-4772-ac50-cd1420f8d5db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:18.893802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34222e3f-01dd-4772-ac50-cd1420f8d5db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:18.894505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34222e3f-01dd-4772-ac50-cd1420f8d5db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:18.894971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34222e3f-01dd-4772-ac50-cd1420f8d5db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:18.895402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34222e3f-01dd-4772-ac50-cd1420f8d5db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:18.926559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:18.969342 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34222e3f-01dd-4772-ac50-cd1420f8d5db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.088389 Aug 27 05:10:18.973217 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3115/6178] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:18 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:10:18.978296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9bac4920-aca6-4105-85cc-1b33dcf1d39f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:18.978915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9bac4920-aca6-4105-85cc-1b33dcf1d39f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:18.992832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bac4920-aca6-4105-85cc-1b33dcf1d39f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:18.993338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bac4920-aca6-4105-85cc-1b33dcf1d39f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:18.993868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bac4920-aca6-4105-85cc-1b33dcf1d39f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:18.994833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bac4920-aca6-4105-85cc-1b33dcf1d39f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:18.995519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bac4920-aca6-4105-85cc-1b33dcf1d39f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:18.996190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bac4920-aca6-4105-85cc-1b33dcf1d39f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:19.137870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9bac4920-aca6-4105-85cc-1b33dcf1d39f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:19.145956 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9bac4920-aca6-4105-85cc-1b33dcf1d39f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1660 microversion: 2.1 time: 0.171432 Aug 27 05:10:19.146721 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3064/6179] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:18 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1660 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:20.168139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfd2b11d-6b04-459d-ae5a-65d68e933d75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:20.168883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dfd2b11d-6b04-459d-ae5a-65d68e933d75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:20.176773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd2b11d-6b04-459d-ae5a-65d68e933d75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.177449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd2b11d-6b04-459d-ae5a-65d68e933d75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.177723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd2b11d-6b04-459d-ae5a-65d68e933d75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.178461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd2b11d-6b04-459d-ae5a-65d68e933d75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.178898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd2b11d-6b04-459d-ae5a-65d68e933d75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.179340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd2b11d-6b04-459d-ae5a-65d68e933d75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.319704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dfd2b11d-6b04-459d-ae5a-65d68e933d75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:20.328165 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dfd2b11d-6b04-459d-ae5a-65d68e933d75 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.164674 Aug 27 05:10:20.328869 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3116/6180] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:20 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:20.348906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-db0f9b0c-7fe9-4ab2-8162-5c2f41fb2236 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:20.349519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-db0f9b0c-7fe9-4ab2-8162-5c2f41fb2236 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:20.358300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db0f9b0c-7fe9-4ab2-8162-5c2f41fb2236 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.358787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db0f9b0c-7fe9-4ab2-8162-5c2f41fb2236 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.359224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db0f9b0c-7fe9-4ab2-8162-5c2f41fb2236 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.359945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db0f9b0c-7fe9-4ab2-8162-5c2f41fb2236 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.360395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db0f9b0c-7fe9-4ab2-8162-5c2f41fb2236 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.360846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db0f9b0c-7fe9-4ab2-8162-5c2f41fb2236 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.494940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-db0f9b0c-7fe9-4ab2-8162-5c2f41fb2236 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:20.503793 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-db0f9b0c-7fe9-4ab2-8162-5c2f41fb2236 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.158827 Aug 27 05:10:20.504461 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3065/6181] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:20 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:20.525178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2404e58a-2724-4971-8f15-652099ed0855 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:20.526055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2404e58a-2724-4971-8f15-652099ed0855 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:20.532688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2404e58a-2724-4971-8f15-652099ed0855 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.533242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2404e58a-2724-4971-8f15-652099ed0855 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.533885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2404e58a-2724-4971-8f15-652099ed0855 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.534618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2404e58a-2724-4971-8f15-652099ed0855 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.535090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2404e58a-2724-4971-8f15-652099ed0855 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.535535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2404e58a-2724-4971-8f15-652099ed0855 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.672858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2404e58a-2724-4971-8f15-652099ed0855 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:20.681026 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2404e58a-2724-4971-8f15-652099ed0855 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.159717 Aug 27 05:10:20.681564 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3117/6182] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:20 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:20.700372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8861019a-8dd1-449e-b477-99c237497605 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:20.701117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8861019a-8dd1-449e-b477-99c237497605 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:20.707864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8861019a-8dd1-449e-b477-99c237497605 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.708343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8861019a-8dd1-449e-b477-99c237497605 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.708831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8861019a-8dd1-449e-b477-99c237497605 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.709523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8861019a-8dd1-449e-b477-99c237497605 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.709976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8861019a-8dd1-449e-b477-99c237497605 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.710393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8861019a-8dd1-449e-b477-99c237497605 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.849578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8861019a-8dd1-449e-b477-99c237497605 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:20.857524 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8861019a-8dd1-449e-b477-99c237497605 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.160897 Aug 27 05:10:20.858295 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3066/6183] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:20 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:20.878137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-708bd2e3-e270-43fd-ae6f-e04a01d8886b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:20.878758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-708bd2e3-e270-43fd-ae6f-e04a01d8886b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:20.884774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-708bd2e3-e270-43fd-ae6f-e04a01d8886b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.885330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-708bd2e3-e270-43fd-ae6f-e04a01d8886b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.885715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-708bd2e3-e270-43fd-ae6f-e04a01d8886b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:20.886412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-708bd2e3-e270-43fd-ae6f-e04a01d8886b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:20.886877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-708bd2e3-e270-43fd-ae6f-e04a01d8886b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:20.887311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-708bd2e3-e270-43fd-ae6f-e04a01d8886b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:21.021149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-708bd2e3-e270-43fd-ae6f-e04a01d8886b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:21.029248 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-708bd2e3-e270-43fd-ae6f-e04a01d8886b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.155519 Aug 27 05:10:21.030149 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3118/6184] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:20 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:21.049605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b6be2f8c-cd15-4313-9e0c-7ec87ff8cc73 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:21.050332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b6be2f8c-cd15-4313-9e0c-7ec87ff8cc73 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:21.057196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6be2f8c-cd15-4313-9e0c-7ec87ff8cc73 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:21.057794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6be2f8c-cd15-4313-9e0c-7ec87ff8cc73 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:21.058312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6be2f8c-cd15-4313-9e0c-7ec87ff8cc73 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:21.059094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6be2f8c-cd15-4313-9e0c-7ec87ff8cc73 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:21.059629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6be2f8c-cd15-4313-9e0c-7ec87ff8cc73 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:21.060124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b6be2f8c-cd15-4313-9e0c-7ec87ff8cc73 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:21.202896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b6be2f8c-cd15-4313-9e0c-7ec87ff8cc73 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:21.210957 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b6be2f8c-cd15-4313-9e0c-7ec87ff8cc73 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.165283 Aug 27 05:10:21.211683 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3067/6185] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:21 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:36.945235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92978b5b-fb75-4a90-befd-166953097f10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:36.948735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92978b5b-fb75-4a90-befd-166953097f10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:36.952333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=59 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:36.953088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:36.959722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92978b5b-fb75-4a90-befd-166953097f10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:36.960249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92978b5b-fb75-4a90-befd-166953097f10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:36.960801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92978b5b-fb75-4a90-befd-166953097f10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:36.961600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92978b5b-fb75-4a90-befd-166953097f10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:36.962081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92978b5b-fb75-4a90-befd-166953097f10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:36.962591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92978b5b-fb75-4a90-befd-166953097f10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:37.025574 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92978b5b-fb75-4a90-befd-166953097f10 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "POST /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29/action" status: 200 len: 24565 microversion: 2.1 time: 0.084517 Aug 27 05:10:37.032421 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3119/6186] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:10:36 2022] POST /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29/action => generated 24565 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:10:40.000427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=67 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:40.001118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:40.130544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-98c4bbfe-f9fb-4f7b-9172-853ede34878a tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:40.131153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98c4bbfe-f9fb-4f7b-9172-853ede34878a tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:40.137700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98c4bbfe-f9fb-4f7b-9172-853ede34878a tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:40.138264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98c4bbfe-f9fb-4f7b-9172-853ede34878a tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:40.138707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98c4bbfe-f9fb-4f7b-9172-853ede34878a tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:40.139494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98c4bbfe-f9fb-4f7b-9172-853ede34878a tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:40.139953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98c4bbfe-f9fb-4f7b-9172-853ede34878a tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:40.140443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-98c4bbfe-f9fb-4f7b-9172-853ede34878a tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:40.170051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-98c4bbfe-f9fb-4f7b-9172-853ede34878a tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:10:40.259742 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-98c4bbfe-f9fb-4f7b-9172-853ede34878a tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "DELETE /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 204 len: 0 microversion: 2.1 time: 0.264199 Aug 27 05:10:40.260837 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3068/6187] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:10:39 2022] DELETE /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:10:40.272301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50a3e3ad-e852-4009-89ca-d43968ebc4ae tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:40.273051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50a3e3ad-e852-4009-89ca-d43968ebc4ae tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:40.281132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a3e3ad-e852-4009-89ca-d43968ebc4ae tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:40.281640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a3e3ad-e852-4009-89ca-d43968ebc4ae tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:40.282183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a3e3ad-e852-4009-89ca-d43968ebc4ae tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:40.283540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a3e3ad-e852-4009-89ca-d43968ebc4ae tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:40.284147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a3e3ad-e852-4009-89ca-d43968ebc4ae tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:40.284623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50a3e3ad-e852-4009-89ca-d43968ebc4ae tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:40.440358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50a3e3ad-e852-4009-89ca-d43968ebc4ae tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:40.448510 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50a3e3ad-e852-4009-89ca-d43968ebc4ae tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1733 microversion: 2.1 time: 0.181407 Aug 27 05:10:40.449198 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3120/6188] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:40 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:41.472593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-325681d5-0585-4757-b050-1a6efcef038b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:41.473244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-325681d5-0585-4757-b050-1a6efcef038b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:41.481577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-325681d5-0585-4757-b050-1a6efcef038b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:41.482114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-325681d5-0585-4757-b050-1a6efcef038b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:41.482549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-325681d5-0585-4757-b050-1a6efcef038b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:41.483305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-325681d5-0585-4757-b050-1a6efcef038b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:41.483831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-325681d5-0585-4757-b050-1a6efcef038b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:41.484270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-325681d5-0585-4757-b050-1a6efcef038b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:41.628520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-325681d5-0585-4757-b050-1a6efcef038b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:41.637439 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-325681d5-0585-4757-b050-1a6efcef038b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1733 microversion: 2.1 time: 0.169557 Aug 27 05:10:41.638065 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3069/6189] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:41 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:42.660401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39da463a-eee6-4813-9a32-209f8f9f524b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:42.661214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39da463a-eee6-4813-9a32-209f8f9f524b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:42.669222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39da463a-eee6-4813-9a32-209f8f9f524b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:42.669743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39da463a-eee6-4813-9a32-209f8f9f524b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:42.670199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39da463a-eee6-4813-9a32-209f8f9f524b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:42.670948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39da463a-eee6-4813-9a32-209f8f9f524b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:42.671430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39da463a-eee6-4813-9a32-209f8f9f524b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:42.671865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39da463a-eee6-4813-9a32-209f8f9f524b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:42.867370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-39da463a-eee6-4813-9a32-209f8f9f524b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ef6237278a408799a22a5d83d8e7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024d1b3e6bb4d5d9e6b6a38d346eed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:42.876252 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39da463a-eee6-4813-9a32-209f8f9f524b tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 200 len: 1733 microversion: 2.1 time: 0.220453 Aug 27 05:10:42.887787 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3121/6190] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:42 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 1733 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:43.110611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-cf1ba424-c5ca-47a9-9a51-c9117b6d86d0 req-387ec1a2-4fdd-4433-bc1a-f33cd0d3cfb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82956fdf-e10f-4f30-835f-9c025da46479", "name": "network-vif-deleted", "tag": "000cfb7d-f84b-4f34-afa8-cf1e87bb3337"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:43.136565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cf1ba424-c5ca-47a9-9a51-c9117b6d86d0 req-387ec1a2-4fdd-4433-bc1a-f33cd0d3cfb2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:43.137363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cf1ba424-c5ca-47a9-9a51-c9117b6d86d0 req-387ec1a2-4fdd-4433-bc1a-f33cd0d3cfb2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:43.138088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cf1ba424-c5ca-47a9-9a51-c9117b6d86d0 req-387ec1a2-4fdd-4433-bc1a-f33cd0d3cfb2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:43.157502 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-cf1ba424-c5ca-47a9-9a51-c9117b6d86d0 req-387ec1a2-4fdd-4433-bc1a-f33cd0d3cfb2 service nova] Creating event network-vif-deleted:000cfb7d-f84b-4f34-afa8-cf1e87bb3337 for instance 82956fdf-e10f-4f30-835f-9c025da46479 on n-h2-854823-1 Aug 27 05:10:43.168508 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-cf1ba424-c5ca-47a9-9a51-c9117b6d86d0 req-387ec1a2-4fdd-4433-bc1a-f33cd0d3cfb2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059603 Aug 27 05:10:43.172771 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3070/6191] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:43.898020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d54ee37-de06-47e2-83fc-105f6593e09c tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:43.898645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1d54ee37-de06-47e2-83fc-105f6593e09c tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:43.908283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d54ee37-de06-47e2-83fc-105f6593e09c tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:43.909636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d54ee37-de06-47e2-83fc-105f6593e09c tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:43.910508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d54ee37-de06-47e2-83fc-105f6593e09c tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:43.912366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d54ee37-de06-47e2-83fc-105f6593e09c tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:43.913316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d54ee37-de06-47e2-83fc-105f6593e09c tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:43.913695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d54ee37-de06-47e2-83fc-105f6593e09c tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:43.930428 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1d54ee37-de06-47e2-83fc-105f6593e09c tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] HTTP exception thrown: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d54ee37-de06-47e2-83fc-105f6593e09c tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Request method failure captured: Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 HTTP/1.1 Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaYU746jQVRhiwwRq5FDmUo5Khy3xIJO2Uy3KhjHQ2Gva3qo-lG4jqeHtoI5nMuh-m6uezC7lWFXJ9rIVyWccgEzmz8xEWKKCtMMInXLSJJS5v3EDOSLnLgF8Dtl6tEYcWK94CdIMfiF5fHNtJ1730xK9Mkj0wDe5-_eTbHsgUy2DoE Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d024d1b3e6bb4d5d9e6b6a38d346eed8 Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestServerBasicOps-562442287 Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d024d1b3e6bb4d5d9e6b6a38d346eed8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d024d1b3e6bb4d5d9e6b6a38d346eed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d024d1b3e6bb4d5d9e6b6a38d346eed8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d024d1b3e6bb4d5d9e6b6a38d346eed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestServerBasicOps-562442287 Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d024d1b3e6bb4d5d9e6b6a38d346eed8 Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestServerBasicOps-562442287 Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestServerBasicOps-562442287-project Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1ef6237278a408799a22a5d83d8e7c3 Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestServerBasicOps-562442287-project Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '82956fdf-e10f-4f30-835f-9c025da46479'} Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:43.932457 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:43.936246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:43.936246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:43.936246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:43.936246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:43.936246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:43.936246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:43.936246 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:43.936246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d54ee37-de06-47e2-83fc-105f6593e09c tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Returning 404 to user: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:43.936246 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d54ee37-de06-47e2-83fc-105f6593e09c tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 404 len: 111 microversion: 2.1 time: 0.039901 Aug 27 05:10:43.936246 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3122/6192] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:43 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:44.418936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5e61f667-2dc8-4488-ab0d-c45e98bc22b7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:44.419519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5e61f667-2dc8-4488-ab0d-c45e98bc22b7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:44.427140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e61f667-2dc8-4488-ab0d-c45e98bc22b7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:44.427604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e61f667-2dc8-4488-ab0d-c45e98bc22b7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:44.428058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e61f667-2dc8-4488-ab0d-c45e98bc22b7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:44.428844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e61f667-2dc8-4488-ab0d-c45e98bc22b7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:44.429298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e61f667-2dc8-4488-ab0d-c45e98bc22b7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:44.429719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e61f667-2dc8-4488-ab0d-c45e98bc22b7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:44.443239 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-5e61f667-2dc8-4488-ab0d-c45e98bc22b7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] HTTP exception thrown: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5e61f667-2dc8-4488-ab0d-c45e98bc22b7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Request method failure captured: Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 HTTP/1.1 Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaYU746jQVRhiwwRq5FDmUo5Khy3xIJO2Uy3KhjHQ2Gva3qo-lG4jqeHtoI5nMuh-m6uezC7lWFXJ9rIVyWccgEzmz8xEWKKCtMMInXLSJJS5v3EDOSLnLgF8Dtl6tEYcWK94CdIMfiF5fHNtJ1730xK9Mkj0wDe5-_eTbHsgUy2DoE Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: d024d1b3e6bb4d5d9e6b6a38d346eed8 Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestServerBasicOps-562442287 Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d024d1b3e6bb4d5d9e6b6a38d346eed8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d024d1b3e6bb4d5d9e6b6a38d346eed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d024d1b3e6bb4d5d9e6b6a38d346eed8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d024d1b3e6bb4d5d9e6b6a38d346eed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestServerBasicOps-562442287 Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: d024d1b3e6bb4d5d9e6b6a38d346eed8 Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestServerBasicOps-562442287 Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestServerBasicOps-562442287-project Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a1ef6237278a408799a22a5d83d8e7c3 Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestServerBasicOps-562442287-project Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '82956fdf-e10f-4f30-835f-9c025da46479'} Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:44.444956 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:44.452827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:44.452827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:10:44.452827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:44.452827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:10:44.452827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:44.452827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:44.452827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:44.452827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:44.452827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:44.452827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:44.452827 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:10:44.452827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5e61f667-2dc8-4488-ab0d-c45e98bc22b7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Returning 404 to user: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:44.452827 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5e61f667-2dc8-4488-ab0d-c45e98bc22b7 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "DELETE /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 404 len: 111 microversion: 2.1 time: 0.031884 Aug 27 05:10:44.452827 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3071/6193] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:10:44 2022] DELETE /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:44.457864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-974b2061-9104-4fbd-8a70-91c22277bbcc tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:44.458503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-974b2061-9104-4fbd-8a70-91c22277bbcc tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] [instance: 82956fdf-e10f-4f30-835f-9c025da46479] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:44.465363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-974b2061-9104-4fbd-8a70-91c22277bbcc tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:44.465876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-974b2061-9104-4fbd-8a70-91c22277bbcc tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:44.466371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-974b2061-9104-4fbd-8a70-91c22277bbcc tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:44.467100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-974b2061-9104-4fbd-8a70-91c22277bbcc tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:44.467575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-974b2061-9104-4fbd-8a70-91c22277bbcc tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:44.468022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-974b2061-9104-4fbd-8a70-91c22277bbcc tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:44.482740 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-974b2061-9104-4fbd-8a70-91c22277bbcc tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] HTTP exception thrown: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-974b2061-9104-4fbd-8a70-91c22277bbcc tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Request method failure captured: Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 HTTP/1.1 Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaYU746jQVRhiwwRq5FDmUo5Khy3xIJO2Uy3KhjHQ2Gva3qo-lG4jqeHtoI5nMuh-m6uezC7lWFXJ9rIVyWccgEzmz8xEWKKCtMMInXLSJJS5v3EDOSLnLgF8Dtl6tEYcWK94CdIMfiF5fHNtJ1730xK9Mkj0wDe5-_eTbHsgUy2DoE Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d024d1b3e6bb4d5d9e6b6a38d346eed8 Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestServerBasicOps-562442287 Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d024d1b3e6bb4d5d9e6b6a38d346eed8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d024d1b3e6bb4d5d9e6b6a38d346eed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d024d1b3e6bb4d5d9e6b6a38d346eed8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d024d1b3e6bb4d5d9e6b6a38d346eed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestServerBasicOps-562442287 Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d024d1b3e6bb4d5d9e6b6a38d346eed8 Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestServerBasicOps-562442287 Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestServerBasicOps-562442287-project Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a1ef6237278a408799a22a5d83d8e7c3 Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestServerBasicOps-562442287-project Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '82956fdf-e10f-4f30-835f-9c025da46479'} Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:44.484263 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:44.488662 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:44.488662 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:44.488662 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:44.488662 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:44.488662 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:44.488662 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. Aug 27 05:10:44.488662 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:10:44.488662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-974b2061-9104-4fbd-8a70-91c22277bbcc tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Returning 404 to user: Instance 82956fdf-e10f-4f30-835f-9c025da46479 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:44.488662 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-974b2061-9104-4fbd-8a70-91c22277bbcc tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479" status: 404 len: 111 microversion: 2.1 time: 0.033478 Aug 27 05:10:44.488662 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3123/6194] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:44 2022] GET /compute/v2.1/servers/82956fdf-e10f-4f30-835f-9c025da46479 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:44.657632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ccadff8c-f763-49b0-b6a1-aa374c938a78 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] Calling method '.version_select at 0x7f1f213dda60>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:44.681022 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ccadff8c-f763-49b0-b6a1-aa374c938a78 tempest-TestServerBasicOps-562442287 tempest-TestServerBasicOps-562442287-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2091912062" status: 202 len: 0 microversion: 2.1 time: 0.027107 Aug 27 05:10:44.682116 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3072/6195] 10.222.0.79 () {58 vars in 1254 bytes} [Sat Aug 27 05:10:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2091912062 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:10:49.710364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d144029d-f74d-4d88-bc1b-83821ea0c72d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:49.710886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d144029d-f74d-4d88-bc1b-83821ea0c72d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:49.722290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d144029d-f74d-4d88-bc1b-83821ea0c72d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:49.723735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d144029d-f74d-4d88-bc1b-83821ea0c72d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:49.724367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d144029d-f74d-4d88-bc1b-83821ea0c72d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:49.726052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d144029d-f74d-4d88-bc1b-83821ea0c72d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:49.726699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d144029d-f74d-4d88-bc1b-83821ea0c72d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:49.728016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d144029d-f74d-4d88-bc1b-83821ea0c72d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:49.759329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d144029d-f74d-4d88-bc1b-83821ea0c72d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:10:49.768011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-21e88b5d-1646-4a33-b215-a54d3cb5f53c req-f518e5ae-3db8-4404-b3fe-982e9841bd7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa772619-856a-4d48-981c-e4f2cdd39e29", "tag": "2be38a72-a68a-4e59-9f92-1a716c927f84"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:49.788286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-21e88b5d-1646-4a33-b215-a54d3cb5f53c req-f518e5ae-3db8-4404-b3fe-982e9841bd7a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:49.788804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-21e88b5d-1646-4a33-b215-a54d3cb5f53c req-f518e5ae-3db8-4404-b3fe-982e9841bd7a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:49.789244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-21e88b5d-1646-4a33-b215-a54d3cb5f53c req-f518e5ae-3db8-4404-b3fe-982e9841bd7a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:49.824020 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-21e88b5d-1646-4a33-b215-a54d3cb5f53c req-f518e5ae-3db8-4404-b3fe-982e9841bd7a service nova] Creating event network-changed:2be38a72-a68a-4e59-9f92-1a716c927f84 for instance aa772619-856a-4d48-981c-e4f2cdd39e29 on n-h2-854823-1 Aug 27 05:10:49.830891 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-21e88b5d-1646-4a33-b215-a54d3cb5f53c req-f518e5ae-3db8-4404-b3fe-982e9841bd7a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071790 Aug 27 05:10:49.832026 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3073/6196] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:10:49.865616 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d144029d-f74d-4d88-bc1b-83821ea0c72d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 204 len: 0 microversion: 2.1 time: 0.157259 Aug 27 05:10:49.866255 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3124/6197] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:10:49 2022] DELETE /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:10:49.876075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5162670-e190-422f-8108-3f90137348c5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:49.876825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f5162670-e190-422f-8108-3f90137348c5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:49.884080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5162670-e190-422f-8108-3f90137348c5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:49.884757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5162670-e190-422f-8108-3f90137348c5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:49.885210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5162670-e190-422f-8108-3f90137348c5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:49.886235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5162670-e190-422f-8108-3f90137348c5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:49.886710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5162670-e190-422f-8108-3f90137348c5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:49.887153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5162670-e190-422f-8108-3f90137348c5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:50.179500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f5162670-e190-422f-8108-3f90137348c5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:50.189288 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f5162670-e190-422f-8108-3f90137348c5 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1686 microversion: 2.1 time: 0.317214 Aug 27 05:10:50.200978 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3074/6198] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:49 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1686 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:51.213940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27e99fdf-52d9-421b-81c1-fde93cb40adf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:51.216729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-27e99fdf-52d9-421b-81c1-fde93cb40adf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:51.232056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27e99fdf-52d9-421b-81c1-fde93cb40adf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:51.232590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27e99fdf-52d9-421b-81c1-fde93cb40adf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:51.233051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27e99fdf-52d9-421b-81c1-fde93cb40adf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:51.233784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27e99fdf-52d9-421b-81c1-fde93cb40adf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:51.234261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27e99fdf-52d9-421b-81c1-fde93cb40adf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:51.234703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27e99fdf-52d9-421b-81c1-fde93cb40adf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:51.597946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-27e99fdf-52d9-421b-81c1-fde93cb40adf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:51.607001 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-27e99fdf-52d9-421b-81c1-fde93cb40adf tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1686 microversion: 2.1 time: 0.397943 Aug 27 05:10:51.625299 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3125/6199] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:51 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1686 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:52.211361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-826445e2-03ff-4025-8c68-191eff32de66 req-f6284397-6810-43a0-b1b7-28177b218627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa772619-856a-4d48-981c-e4f2cdd39e29", "name": "network-vif-deleted", "tag": "2be38a72-a68a-4e59-9f92-1a716c927f84"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:10:52.243889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-826445e2-03ff-4025-8c68-191eff32de66 req-f6284397-6810-43a0-b1b7-28177b218627 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:52.245061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-826445e2-03ff-4025-8c68-191eff32de66 req-f6284397-6810-43a0-b1b7-28177b218627 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:52.245873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-826445e2-03ff-4025-8c68-191eff32de66 req-f6284397-6810-43a0-b1b7-28177b218627 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:52.270370 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-826445e2-03ff-4025-8c68-191eff32de66 req-f6284397-6810-43a0-b1b7-28177b218627 service nova] Creating event network-vif-deleted:2be38a72-a68a-4e59-9f92-1a716c927f84 for instance aa772619-856a-4d48-981c-e4f2cdd39e29 on n-h2-854823-1 Aug 27 05:10:52.278561 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-826445e2-03ff-4025-8c68-191eff32de66 req-f6284397-6810-43a0-b1b7-28177b218627 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071254 Aug 27 05:10:52.279755 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3075/6200] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:10:52.638203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9023243-b840-41c2-91ab-b5b8f0cbce87 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:52.638986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9023243-b840-41c2-91ab-b5b8f0cbce87 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:52.653360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023243-b840-41c2-91ab-b5b8f0cbce87 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:52.655641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023243-b840-41c2-91ab-b5b8f0cbce87 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:52.658248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023243-b840-41c2-91ab-b5b8f0cbce87 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:52.659310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023243-b840-41c2-91ab-b5b8f0cbce87 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:52.667848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023243-b840-41c2-91ab-b5b8f0cbce87 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:52.668935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023243-b840-41c2-91ab-b5b8f0cbce87 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:52.737856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023243-b840-41c2-91ab-b5b8f0cbce87 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:52.738348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023243-b840-41c2-91ab-b5b8f0cbce87 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:52.738799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9023243-b840-41c2-91ab-b5b8f0cbce87 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:52.739262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-b9023243-b840-41c2-91ab-b5b8f0cbce87 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lazy-loading 'fault' on Instance uuid aa772619-856a-4d48-981c-e4f2cdd39e29 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:10:52.798240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9023243-b840-41c2-91ab-b5b8f0cbce87 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e508461869c24fb3ad1641d830e2b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c34a6245d5c46f6babc0b7775512d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:10:52.808081 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9023243-b840-41c2-91ab-b5b8f0cbce87 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 200 len: 1355 microversion: 2.1 time: 0.174337 Aug 27 05:10:52.809877 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3126/6201] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:52 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 1355 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:10:53.832566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3360c741-69e1-4dfc-af47-d148da6bcb6d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:53.833904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3360c741-69e1-4dfc-af47-d148da6bcb6d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] [instance: aa772619-856a-4d48-981c-e4f2cdd39e29] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:10:53.842074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3360c741-69e1-4dfc-af47-d148da6bcb6d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:53.842843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3360c741-69e1-4dfc-af47-d148da6bcb6d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:53.843457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3360c741-69e1-4dfc-af47-d148da6bcb6d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:53.844333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3360c741-69e1-4dfc-af47-d148da6bcb6d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:10:53.845635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3360c741-69e1-4dfc-af47-d148da6bcb6d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:10:53.846236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3360c741-69e1-4dfc-af47-d148da6bcb6d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:10:53.864690 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-3360c741-69e1-4dfc-af47-d148da6bcb6d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] HTTP exception thrown: Instance aa772619-856a-4d48-981c-e4f2cdd39e29 could not be found. Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3360c741-69e1-4dfc-af47-d148da6bcb6d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Request method failure captured: Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 HTTP/1.1 Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaRLmGBWEgwXQ5YrU3e-W09M-LG1_uBsJAS_ya1U9ZYATItKtu2g488KSFy-iTE2V_v7BoakUfBk6IbcG40wQ3Zjfp3X3qOXFXfrymr-WhwLzX-o71ez1rD8Ed7CjlUefvAzorMpVDawtgICzWr1EdH9eXF9QcoonuA5HE1Rfgy_-qk Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 7c34a6245d5c46f6babc0b7775512d84 Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-511432365 Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7c34a6245d5c46f6babc0b7775512d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestNetworkAdvancedServerOps-511432365 Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 7c34a6245d5c46f6babc0b7775512d84 Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-511432365 Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestNetworkAdvancedServerOps-511432365-project Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: e508461869c24fb3ad1641d830e2b22a Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestNetworkAdvancedServerOps-511432365-project Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance aa772619-856a-4d48-981c-e4f2cdd39e29 could not be found. Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'aa772619-856a-4d48-981c-e4f2cdd39e29'} Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa772619-856a-4d48-981c-e4f2cdd39e29 could not be found. Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa772619-856a-4d48-981c-e4f2cdd39e29 could not be found. Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:10:53.866681 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:10:53.871591 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:10:53.871591 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:10:53.871591 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:10:53.871591 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:10:53.871591 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:10:53.871591 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:10:53.871591 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa772619-856a-4d48-981c-e4f2cdd39e29 could not be found. Aug 27 05:10:53.871591 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:10:53.873341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3360c741-69e1-4dfc-af47-d148da6bcb6d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Returning 404 to user: Instance aa772619-856a-4d48-981c-e4f2cdd39e29 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:10:53.875358 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3360c741-69e1-4dfc-af47-d148da6bcb6d tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29" status: 404 len: 111 microversion: 2.1 time: 0.048389 Aug 27 05:10:53.877068 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3076/6202] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:10:53 2022] GET /compute/v2.1/servers/aa772619-856a-4d48-981c-e4f2cdd39e29 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:10:58.118273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-efe49f66-d081-4d2b-90c7-4af7859c8b19 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] Calling method '.version_select at 0x7f1f21060280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:10:58.178631 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-efe49f66-d081-4d2b-90c7-4af7859c8b19 tempest-TestNetworkAdvancedServerOps-511432365 tempest-TestNetworkAdvancedServerOps-511432365-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1106153915" status: 202 len: 0 microversion: 2.1 time: 0.064123 Aug 27 05:10:58.180673 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3127/6203] 10.222.0.79 () {58 vars in 1284 bytes} [Sat Aug 27 05:10:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1106153915 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:11:00.034808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8426b46b-79a1-47ed-8f8f-5865bae438b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:00.040741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8426b46b-79a1-47ed-8f8f-5865bae438b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:00.052045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8426b46b-79a1-47ed-8f8f-5865bae438b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:00.052990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8426b46b-79a1-47ed-8f8f-5865bae438b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:00.053445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8426b46b-79a1-47ed-8f8f-5865bae438b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:00.054506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8426b46b-79a1-47ed-8f8f-5865bae438b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:00.054991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8426b46b-79a1-47ed-8f8f-5865bae438b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:00.055422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8426b46b-79a1-47ed-8f8f-5865bae438b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:00.146536 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8426b46b-79a1-47ed-8f8f-5865bae438b4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.117355 Aug 27 05:11:00.147641 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3077/6204] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:11:00 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:11:00.160185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76d56b48-ec28-4b57-a357-5e819fde90a0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:00.161974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76d56b48-ec28-4b57-a357-5e819fde90a0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:00.173720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d56b48-ec28-4b57-a357-5e819fde90a0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:00.174537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d56b48-ec28-4b57-a357-5e819fde90a0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:00.175036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d56b48-ec28-4b57-a357-5e819fde90a0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:00.175979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d56b48-ec28-4b57-a357-5e819fde90a0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:00.177005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d56b48-ec28-4b57-a357-5e819fde90a0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:00.177490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d56b48-ec28-4b57-a357-5e819fde90a0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:00.410664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-76d56b48-ec28-4b57-a357-5e819fde90a0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:00.420498 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76d56b48-ec28-4b57-a357-5e819fde90a0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1670 microversion: 2.1 time: 0.267916 Aug 27 05:11:00.421968 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3128/6205] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:00 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1670 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:01.443668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a5033565-df69-4b02-9467-abdb0998173b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:01.444376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a5033565-df69-4b02-9467-abdb0998173b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:01.461519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5033565-df69-4b02-9467-abdb0998173b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:01.462295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5033565-df69-4b02-9467-abdb0998173b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:01.462871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5033565-df69-4b02-9467-abdb0998173b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:01.463719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5033565-df69-4b02-9467-abdb0998173b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:01.464323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5033565-df69-4b02-9467-abdb0998173b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:01.464862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a5033565-df69-4b02-9467-abdb0998173b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:01.677510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a5033565-df69-4b02-9467-abdb0998173b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:01.687696 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a5033565-df69-4b02-9467-abdb0998173b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.248494 Aug 27 05:11:01.692580 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3078/6206] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:01 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:02.936012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-226184055", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "e83fa355-16d0-4922-8c89-e5d8daab60dd"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:02.994430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] validate_networks() for [('e83fa355-16d0-4922-8c89-e5d8daab60dd', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:11:03.387082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:11:03.387689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:11:03.388417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:11:03.388880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:11:03.389571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:11:03.400357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:03.400897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:03.401349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:03.402095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:03.402568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:03.403008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:03.420026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Getting quotas for project 6723b9190a3d4e01b81e5bb01e640fd3. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:11:03.425891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Getting quotas for user b2f2c1e27ba541fa9937aa259c4c0159 and project 6723b9190a3d4e01b81e5bb01e640fd3. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:11:03.439100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:11:03.441496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:11:03.495656 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b71bf76b-3c7e-420a-8114-6a5d062d66a2 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693969 Aug 27 05:11:03.496505 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3129/6207] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:11:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:11:03.508235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3191e848-9185-4533-b105-5cd5f9b45405 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:03.509478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3191e848-9185-4533-b105-5cd5f9b45405 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:03.568960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3191e848-9185-4533-b105-5cd5f9b45405 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:03.578174 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3191e848-9185-4533-b105-5cd5f9b45405 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1214 microversion: 2.1 time: 0.073742 Aug 27 05:11:03.579770 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3079/6208] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:03 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:04.600612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-19fe2e8d-cc82-452f-8939-80d1ba0b08cd tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:04.601257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-19fe2e8d-cc82-452f-8939-80d1ba0b08cd tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:04.607582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19fe2e8d-cc82-452f-8939-80d1ba0b08cd tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:04.608093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19fe2e8d-cc82-452f-8939-80d1ba0b08cd tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:04.608769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19fe2e8d-cc82-452f-8939-80d1ba0b08cd tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:04.609603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19fe2e8d-cc82-452f-8939-80d1ba0b08cd tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:04.610645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19fe2e8d-cc82-452f-8939-80d1ba0b08cd tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:04.611095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19fe2e8d-cc82-452f-8939-80d1ba0b08cd tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:04.681566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-19fe2e8d-cc82-452f-8939-80d1ba0b08cd tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:04.689611 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-19fe2e8d-cc82-452f-8939-80d1ba0b08cd tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1266 microversion: 2.1 time: 0.093855 Aug 27 05:11:04.690427 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3130/6209] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:04 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:05.711007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e4c9861a-6add-4192-9419-12a1fe0d0ae4 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:05.712834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e4c9861a-6add-4192-9419-12a1fe0d0ae4 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:05.722695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4c9861a-6add-4192-9419-12a1fe0d0ae4 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:05.728249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4c9861a-6add-4192-9419-12a1fe0d0ae4 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:05.728867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4c9861a-6add-4192-9419-12a1fe0d0ae4 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:05.730668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4c9861a-6add-4192-9419-12a1fe0d0ae4 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:05.731494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4c9861a-6add-4192-9419-12a1fe0d0ae4 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:05.733438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4c9861a-6add-4192-9419-12a1fe0d0ae4 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:05.811915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e4c9861a-6add-4192-9419-12a1fe0d0ae4 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:05.823379 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e4c9861a-6add-4192-9419-12a1fe0d0ae4 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1272 microversion: 2.1 time: 0.116478 Aug 27 05:11:05.825604 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3080/6210] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:05 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:06.847312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38037753-ddae-4819-8420-3ceedf699894 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:06.848634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38037753-ddae-4819-8420-3ceedf699894 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:06.856017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38037753-ddae-4819-8420-3ceedf699894 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:06.856883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38037753-ddae-4819-8420-3ceedf699894 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:06.857417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38037753-ddae-4819-8420-3ceedf699894 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:06.858220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38037753-ddae-4819-8420-3ceedf699894 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:06.858760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38037753-ddae-4819-8420-3ceedf699894 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:06.859516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38037753-ddae-4819-8420-3ceedf699894 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:06.953125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e471a037-b949-4d56-878c-4025a30c7573 req-b56ecbe8-a137-42cc-bd53-1bdbd6d25099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac48dae3-7862-4ab0-a4b3-818136c670c3", "tag": "056cc13b-e9f0-4009-9b62-f7ba7ebe4ce1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:06.965796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e471a037-b949-4d56-878c-4025a30c7573 req-b56ecbe8-a137-42cc-bd53-1bdbd6d25099 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:06.966751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e471a037-b949-4d56-878c-4025a30c7573 req-b56ecbe8-a137-42cc-bd53-1bdbd6d25099 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:06.967415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e471a037-b949-4d56-878c-4025a30c7573 req-b56ecbe8-a137-42cc-bd53-1bdbd6d25099 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:06.989443 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e471a037-b949-4d56-878c-4025a30c7573 req-b56ecbe8-a137-42cc-bd53-1bdbd6d25099 service nova] Creating event network-changed:056cc13b-e9f0-4009-9b62-f7ba7ebe4ce1 for instance ac48dae3-7862-4ab0-a4b3-818136c670c3 on n-h1-854823-1 Aug 27 05:11:06.995599 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e471a037-b949-4d56-878c-4025a30c7573 req-b56ecbe8-a137-42cc-bd53-1bdbd6d25099 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047138 Aug 27 05:11:06.996978 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3081/6211] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:07.161876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-38037753-ddae-4819-8420-3ceedf699894 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:07.166731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:07.183504 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-38037753-ddae-4819-8420-3ceedf699894 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1314 microversion: 2.1 time: 0.340714 Aug 27 05:11:07.189291 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3131/6212] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:06 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:08.218669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5b0a086-e75a-42a4-9cbc-d74eb3e7cf61 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:08.219773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f5b0a086-e75a-42a4-9cbc-d74eb3e7cf61 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:08.227978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5b0a086-e75a-42a4-9cbc-d74eb3e7cf61 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:08.228637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5b0a086-e75a-42a4-9cbc-d74eb3e7cf61 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:08.229218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5b0a086-e75a-42a4-9cbc-d74eb3e7cf61 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:08.230420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5b0a086-e75a-42a4-9cbc-d74eb3e7cf61 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:08.230680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5b0a086-e75a-42a4-9cbc-d74eb3e7cf61 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:08.231115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5b0a086-e75a-42a4-9cbc-d74eb3e7cf61 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:08.418065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f5b0a086-e75a-42a4-9cbc-d74eb3e7cf61 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:08.429000 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f5b0a086-e75a-42a4-9cbc-d74eb3e7cf61 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1314 microversion: 2.1 time: 0.216329 Aug 27 05:11:08.429606 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3082/6213] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:08 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:09.452368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7725cfdd-84bd-4f4d-93c0-2381fcc7eea9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:09.453022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7725cfdd-84bd-4f4d-93c0-2381fcc7eea9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:09.456519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:09.464923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7725cfdd-84bd-4f4d-93c0-2381fcc7eea9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:09.465522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7725cfdd-84bd-4f4d-93c0-2381fcc7eea9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:09.465985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7725cfdd-84bd-4f4d-93c0-2381fcc7eea9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:09.466707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7725cfdd-84bd-4f4d-93c0-2381fcc7eea9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:09.467177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7725cfdd-84bd-4f4d-93c0-2381fcc7eea9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:09.467614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7725cfdd-84bd-4f4d-93c0-2381fcc7eea9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:09.639606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7725cfdd-84bd-4f4d-93c0-2381fcc7eea9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:09.648672 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7725cfdd-84bd-4f4d-93c0-2381fcc7eea9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1314 microversion: 2.1 time: 0.200571 Aug 27 05:11:09.649525 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3132/6214] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:09 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:10.670144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-50d8387b-216e-410b-b800-0c3736063e0a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:10.670789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-50d8387b-216e-410b-b800-0c3736063e0a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:10.674068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:10.679953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50d8387b-216e-410b-b800-0c3736063e0a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:10.680450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50d8387b-216e-410b-b800-0c3736063e0a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:10.680954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50d8387b-216e-410b-b800-0c3736063e0a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:10.681687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50d8387b-216e-410b-b800-0c3736063e0a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:10.682149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50d8387b-216e-410b-b800-0c3736063e0a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:10.682660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50d8387b-216e-410b-b800-0c3736063e0a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:10.686540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:10.841416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-50d8387b-216e-410b-b800-0c3736063e0a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:10.851180 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-50d8387b-216e-410b-b800-0c3736063e0a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1314 microversion: 2.1 time: 0.184993 Aug 27 05:11:10.851990 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3083/6215] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:10 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:11.873590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ebb36416-d66b-40f0-bb22-e5b8b4e017a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:11.874216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ebb36416-d66b-40f0-bb22-e5b8b4e017a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:11.881580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebb36416-d66b-40f0-bb22-e5b8b4e017a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:11.882082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebb36416-d66b-40f0-bb22-e5b8b4e017a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:11.882532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebb36416-d66b-40f0-bb22-e5b8b4e017a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:11.883356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebb36416-d66b-40f0-bb22-e5b8b4e017a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:11.883933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebb36416-d66b-40f0-bb22-e5b8b4e017a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:11.884380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebb36416-d66b-40f0-bb22-e5b8b4e017a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:12.027883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ebb36416-d66b-40f0-bb22-e5b8b4e017a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:12.036313 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ebb36416-d66b-40f0-bb22-e5b8b4e017a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1314 microversion: 2.1 time: 0.166845 Aug 27 05:11:12.036937 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3133/6216] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:11 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:13.057076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f281303f-2d1f-4d94-b893-36a06f18a868 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:13.057779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f281303f-2d1f-4d94-b893-36a06f18a868 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:13.067788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f281303f-2d1f-4d94-b893-36a06f18a868 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:13.068786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f281303f-2d1f-4d94-b893-36a06f18a868 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:13.068935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f281303f-2d1f-4d94-b893-36a06f18a868 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:13.069859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f281303f-2d1f-4d94-b893-36a06f18a868 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:13.070322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f281303f-2d1f-4d94-b893-36a06f18a868 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:13.071064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f281303f-2d1f-4d94-b893-36a06f18a868 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:13.227022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f281303f-2d1f-4d94-b893-36a06f18a868 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:13.235368 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f281303f-2d1f-4d94-b893-36a06f18a868 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1314 microversion: 2.1 time: 0.182859 Aug 27 05:11:13.236040 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3084/6217] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:13 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:14.372302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86aab819-3b01-4234-9913-1c433a7cb689 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:14.373548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86aab819-3b01-4234-9913-1c433a7cb689 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:14.377241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:14.378139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:14.386782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86aab819-3b01-4234-9913-1c433a7cb689 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:14.387563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86aab819-3b01-4234-9913-1c433a7cb689 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:14.388196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86aab819-3b01-4234-9913-1c433a7cb689 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:14.388988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86aab819-3b01-4234-9913-1c433a7cb689 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:14.389468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86aab819-3b01-4234-9913-1c433a7cb689 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:14.389939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86aab819-3b01-4234-9913-1c433a7cb689 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:14.533561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86aab819-3b01-4234-9913-1c433a7cb689 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:14.544180 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86aab819-3b01-4234-9913-1c433a7cb689 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1314 microversion: 2.1 time: 0.176333 Aug 27 05:11:14.544901 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3134/6218] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:14 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:15.118298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-bcf8c6c5-de75-46f0-aca0-9739ce46dc8c req-a6d2baa5-9e54-42ee-a54b-e9d454706aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac48dae3-7862-4ab0-a4b3-818136c670c3", "name": "network-vif-plugged", "status": "completed", "tag": "056cc13b-e9f0-4009-9b62-f7ba7ebe4ce1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:15.127883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:15.140419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bcf8c6c5-de75-46f0-aca0-9739ce46dc8c req-a6d2baa5-9e54-42ee-a54b-e9d454706aa2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:15.141895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bcf8c6c5-de75-46f0-aca0-9739ce46dc8c req-a6d2baa5-9e54-42ee-a54b-e9d454706aa2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:15.142474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bcf8c6c5-de75-46f0-aca0-9739ce46dc8c req-a6d2baa5-9e54-42ee-a54b-e9d454706aa2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:15.155690 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-bcf8c6c5-de75-46f0-aca0-9739ce46dc8c req-a6d2baa5-9e54-42ee-a54b-e9d454706aa2 service nova] Creating event network-vif-plugged:056cc13b-e9f0-4009-9b62-f7ba7ebe4ce1 for instance ac48dae3-7862-4ab0-a4b3-818136c670c3 on n-h1-854823-1 Aug 27 05:11:15.166254 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-bcf8c6c5-de75-46f0-aca0-9739ce46dc8c req-a6d2baa5-9e54-42ee-a54b-e9d454706aa2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052093 Aug 27 05:11:15.167434 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3085/6219] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:15.566012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c134cd90-ea92-4b86-8dec-3ae5e89eeda5 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:15.566787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c134cd90-ea92-4b86-8dec-3ae5e89eeda5 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:15.574541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c134cd90-ea92-4b86-8dec-3ae5e89eeda5 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:15.575054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c134cd90-ea92-4b86-8dec-3ae5e89eeda5 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:15.575511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c134cd90-ea92-4b86-8dec-3ae5e89eeda5 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:15.576271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c134cd90-ea92-4b86-8dec-3ae5e89eeda5 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:15.576791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c134cd90-ea92-4b86-8dec-3ae5e89eeda5 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:15.578056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c134cd90-ea92-4b86-8dec-3ae5e89eeda5 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:15.721865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c134cd90-ea92-4b86-8dec-3ae5e89eeda5 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:15.731573 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c134cd90-ea92-4b86-8dec-3ae5e89eeda5 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1314 microversion: 2.1 time: 0.170114 Aug 27 05:11:15.732331 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3135/6220] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:15 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:16.756009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3c5800a4-2766-4ea3-8086-2822f6c5d103 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:16.756902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3c5800a4-2766-4ea3-8086-2822f6c5d103 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:16.763315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c5800a4-2766-4ea3-8086-2822f6c5d103 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:16.763810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c5800a4-2766-4ea3-8086-2822f6c5d103 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:16.764252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c5800a4-2766-4ea3-8086-2822f6c5d103 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:16.764983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c5800a4-2766-4ea3-8086-2822f6c5d103 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:16.765440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c5800a4-2766-4ea3-8086-2822f6c5d103 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:16.765869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3c5800a4-2766-4ea3-8086-2822f6c5d103 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:16.909466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3c5800a4-2766-4ea3-8086-2822f6c5d103 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:16.917739 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3c5800a4-2766-4ea3-8086-2822f6c5d103 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1314 microversion: 2.1 time: 0.167312 Aug 27 05:11:16.918340 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3086/6221] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:16 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:17.940278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39c9cd34-7387-4a37-899d-e3727d60c063 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:17.941318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39c9cd34-7387-4a37-899d-e3727d60c063 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:17.949005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39c9cd34-7387-4a37-899d-e3727d60c063 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:17.949583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39c9cd34-7387-4a37-899d-e3727d60c063 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:17.950408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39c9cd34-7387-4a37-899d-e3727d60c063 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:17.951168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39c9cd34-7387-4a37-899d-e3727d60c063 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:17.951637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39c9cd34-7387-4a37-899d-e3727d60c063 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:17.952086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39c9cd34-7387-4a37-899d-e3727d60c063 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:18.097563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-39c9cd34-7387-4a37-899d-e3727d60c063 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:18.108728 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39c9cd34-7387-4a37-899d-e3727d60c063 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1501 microversion: 2.1 time: 0.173128 Aug 27 05:11:18.110104 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3136/6222] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:17 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:18.131190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-62da1a9f-3ff3-40e1-8191-a0ee66ad52dc tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:18.131862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-62da1a9f-3ff3-40e1-8191-a0ee66ad52dc tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:18.138936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62da1a9f-3ff3-40e1-8191-a0ee66ad52dc tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:18.139424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62da1a9f-3ff3-40e1-8191-a0ee66ad52dc tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:18.139944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62da1a9f-3ff3-40e1-8191-a0ee66ad52dc tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:18.140757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62da1a9f-3ff3-40e1-8191-a0ee66ad52dc tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:18.141214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62da1a9f-3ff3-40e1-8191-a0ee66ad52dc tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:18.141689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62da1a9f-3ff3-40e1-8191-a0ee66ad52dc tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:18.283995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-62da1a9f-3ff3-40e1-8191-a0ee66ad52dc tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:18.292311 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-62da1a9f-3ff3-40e1-8191-a0ee66ad52dc tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1501 microversion: 2.1 time: 0.165035 Aug 27 05:11:18.292914 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3087/6223] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:18 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:18.312802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2e4f464-c26e-4170-86e9-376f88bed0e7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:18.313636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2e4f464-c26e-4170-86e9-376f88bed0e7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:18.320865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2e4f464-c26e-4170-86e9-376f88bed0e7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:18.321767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2e4f464-c26e-4170-86e9-376f88bed0e7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:18.322521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2e4f464-c26e-4170-86e9-376f88bed0e7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:18.323489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2e4f464-c26e-4170-86e9-376f88bed0e7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:18.324069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2e4f464-c26e-4170-86e9-376f88bed0e7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:18.324757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2e4f464-c26e-4170-86e9-376f88bed0e7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:18.350708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-c2e4f464-c26e-4170-86e9-376f88bed0e7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lazy-loading 'flavor' on Instance uuid ac48dae3-7862-4ab0-a4b3-818136c670c3 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:11:18.422990 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2e4f464-c26e-4170-86e9-376f88bed0e7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "POST /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3/action" status: 202 len: 0 microversion: 2.1 time: 0.113812 Aug 27 05:11:18.426787 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3137/6224] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:11:18 2022] POST /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:11:18.437709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3989988b-d9ed-4d18-bdd6-01168ccd6bf9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:18.438431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3989988b-d9ed-4d18-bdd6-01168ccd6bf9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:18.445443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3989988b-d9ed-4d18-bdd6-01168ccd6bf9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:18.445947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3989988b-d9ed-4d18-bdd6-01168ccd6bf9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:18.446388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3989988b-d9ed-4d18-bdd6-01168ccd6bf9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:18.447139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3989988b-d9ed-4d18-bdd6-01168ccd6bf9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:18.447601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3989988b-d9ed-4d18-bdd6-01168ccd6bf9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:18.448027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3989988b-d9ed-4d18-bdd6-01168ccd6bf9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:18.588709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3989988b-d9ed-4d18-bdd6-01168ccd6bf9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:18.607049 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3989988b-d9ed-4d18-bdd6-01168ccd6bf9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1509 microversion: 2.1 time: 0.162934 Aug 27 05:11:18.607049 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3088/6225] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:18 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:19.620315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8010fa2d-97e6-4e8a-bd68-71d0bbe77de7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:19.621169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8010fa2d-97e6-4e8a-bd68-71d0bbe77de7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:19.628898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8010fa2d-97e6-4e8a-bd68-71d0bbe77de7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:19.629410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8010fa2d-97e6-4e8a-bd68-71d0bbe77de7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:19.629869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8010fa2d-97e6-4e8a-bd68-71d0bbe77de7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:19.630596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8010fa2d-97e6-4e8a-bd68-71d0bbe77de7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:19.631081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8010fa2d-97e6-4e8a-bd68-71d0bbe77de7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:19.631525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8010fa2d-97e6-4e8a-bd68-71d0bbe77de7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:19.786176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8010fa2d-97e6-4e8a-bd68-71d0bbe77de7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:19.794517 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8010fa2d-97e6-4e8a-bd68-71d0bbe77de7 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1492 microversion: 2.1 time: 0.179888 Aug 27 05:11:19.795104 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3138/6226] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:19 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1492 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:19.816026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-14416c90-3d66-476c-b7d5-9815d06ea43d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:19.816625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-14416c90-3d66-476c-b7d5-9815d06ea43d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:19.824447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14416c90-3d66-476c-b7d5-9815d06ea43d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:19.825185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14416c90-3d66-476c-b7d5-9815d06ea43d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:19.825626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14416c90-3d66-476c-b7d5-9815d06ea43d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:19.826330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14416c90-3d66-476c-b7d5-9815d06ea43d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:19.826796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14416c90-3d66-476c-b7d5-9815d06ea43d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:19.827227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14416c90-3d66-476c-b7d5-9815d06ea43d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:19.898920 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-14416c90-3d66-476c-b7d5-9815d06ea43d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "POST /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3/action" status: 202 len: 0 microversion: 2.1 time: 0.086805 Aug 27 05:11:19.900334 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3089/6227] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:11:19 2022] POST /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:11:19.908368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92031c57-05d3-4f04-81fd-30b819fe82cb tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:19.909026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92031c57-05d3-4f04-81fd-30b819fe82cb tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:19.915482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92031c57-05d3-4f04-81fd-30b819fe82cb tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:19.915994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92031c57-05d3-4f04-81fd-30b819fe82cb tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:19.916449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92031c57-05d3-4f04-81fd-30b819fe82cb tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:19.917203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92031c57-05d3-4f04-81fd-30b819fe82cb tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:19.917759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92031c57-05d3-4f04-81fd-30b819fe82cb tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:19.918274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92031c57-05d3-4f04-81fd-30b819fe82cb tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:20.115045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92031c57-05d3-4f04-81fd-30b819fe82cb tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:20.127478 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92031c57-05d3-4f04-81fd-30b819fe82cb tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1498 microversion: 2.1 time: 0.223563 Aug 27 05:11:20.128412 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3139/6228] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:19 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1498 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:21.151102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c211945c-99e1-45a4-8bd7-7b5672f4065a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:21.151935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c211945c-99e1-45a4-8bd7-7b5672f4065a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:21.158867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c211945c-99e1-45a4-8bd7-7b5672f4065a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:21.159376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c211945c-99e1-45a4-8bd7-7b5672f4065a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:21.159825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c211945c-99e1-45a4-8bd7-7b5672f4065a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:21.160606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c211945c-99e1-45a4-8bd7-7b5672f4065a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:21.161071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c211945c-99e1-45a4-8bd7-7b5672f4065a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:21.161501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c211945c-99e1-45a4-8bd7-7b5672f4065a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:21.308654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c211945c-99e1-45a4-8bd7-7b5672f4065a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:21.320318 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c211945c-99e1-45a4-8bd7-7b5672f4065a tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1498 microversion: 2.1 time: 0.174340 Aug 27 05:11:21.334478 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3090/6229] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:21 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1498 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:22.342340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3589d16e-d2e4-4e8a-8ed0-aea460230086 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:22.342982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3589d16e-d2e4-4e8a-8ed0-aea460230086 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:22.349936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3589d16e-d2e4-4e8a-8ed0-aea460230086 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:22.350429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3589d16e-d2e4-4e8a-8ed0-aea460230086 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:22.350870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3589d16e-d2e4-4e8a-8ed0-aea460230086 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:22.352487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3589d16e-d2e4-4e8a-8ed0-aea460230086 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:22.352487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3589d16e-d2e4-4e8a-8ed0-aea460230086 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:22.352487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3589d16e-d2e4-4e8a-8ed0-aea460230086 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:22.488994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3589d16e-d2e4-4e8a-8ed0-aea460230086 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:22.497750 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3589d16e-d2e4-4e8a-8ed0-aea460230086 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1501 microversion: 2.1 time: 0.159286 Aug 27 05:11:22.498333 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3140/6230] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:22 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:22.520695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d99f7080-e889-473e-96eb-6168b22e863b tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:22.521270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d99f7080-e889-473e-96eb-6168b22e863b tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:22.527943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d99f7080-e889-473e-96eb-6168b22e863b tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:22.528384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d99f7080-e889-473e-96eb-6168b22e863b tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:22.528851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d99f7080-e889-473e-96eb-6168b22e863b tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:22.529559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d99f7080-e889-473e-96eb-6168b22e863b tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:22.530010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d99f7080-e889-473e-96eb-6168b22e863b tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:22.530431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d99f7080-e889-473e-96eb-6168b22e863b tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:22.552951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-d99f7080-e889-473e-96eb-6168b22e863b tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lazy-loading 'flavor' on Instance uuid ac48dae3-7862-4ab0-a4b3-818136c670c3 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:11:22.620075 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d99f7080-e889-473e-96eb-6168b22e863b tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "POST /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3/action" status: 202 len: 0 microversion: 2.1 time: 0.103894 Aug 27 05:11:22.620761 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3091/6231] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:11:22 2022] POST /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:11:22.630715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a30ee6d7-60da-4d18-8cdb-ca36cb4d30e6 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:22.631646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a30ee6d7-60da-4d18-8cdb-ca36cb4d30e6 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:22.637844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a30ee6d7-60da-4d18-8cdb-ca36cb4d30e6 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:22.638382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a30ee6d7-60da-4d18-8cdb-ca36cb4d30e6 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:22.638975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a30ee6d7-60da-4d18-8cdb-ca36cb4d30e6 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:22.639786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a30ee6d7-60da-4d18-8cdb-ca36cb4d30e6 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:22.640339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a30ee6d7-60da-4d18-8cdb-ca36cb4d30e6 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:22.640871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a30ee6d7-60da-4d18-8cdb-ca36cb4d30e6 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:22.780147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a30ee6d7-60da-4d18-8cdb-ca36cb4d30e6 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:22.788739 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a30ee6d7-60da-4d18-8cdb-ca36cb4d30e6 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1509 microversion: 2.1 time: 0.162125 Aug 27 05:11:22.789243 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3141/6232] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:22 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:23.811912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3273817e-7359-44d3-8301-8b36a73c7d65 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:23.812654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3273817e-7359-44d3-8301-8b36a73c7d65 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:23.819527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3273817e-7359-44d3-8301-8b36a73c7d65 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:23.820183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3273817e-7359-44d3-8301-8b36a73c7d65 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:23.821000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3273817e-7359-44d3-8301-8b36a73c7d65 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:23.822205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3273817e-7359-44d3-8301-8b36a73c7d65 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:23.823010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3273817e-7359-44d3-8301-8b36a73c7d65 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:23.823772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3273817e-7359-44d3-8301-8b36a73c7d65 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:23.975262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3273817e-7359-44d3-8301-8b36a73c7d65 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:23.983237 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3273817e-7359-44d3-8301-8b36a73c7d65 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1492 microversion: 2.1 time: 0.176551 Aug 27 05:11:23.984022 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3092/6233] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:23 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1492 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:24.008389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-413bd9b5-faa6-48d5-9066-b5f676ae95a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:24.010324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-413bd9b5-faa6-48d5-9066-b5f676ae95a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:24.017833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-413bd9b5-faa6-48d5-9066-b5f676ae95a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:24.018357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-413bd9b5-faa6-48d5-9066-b5f676ae95a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:24.018828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-413bd9b5-faa6-48d5-9066-b5f676ae95a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:24.019567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-413bd9b5-faa6-48d5-9066-b5f676ae95a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:24.020134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-413bd9b5-faa6-48d5-9066-b5f676ae95a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:24.020640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-413bd9b5-faa6-48d5-9066-b5f676ae95a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:24.096355 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-413bd9b5-faa6-48d5-9066-b5f676ae95a9 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "POST /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3/action" status: 202 len: 0 microversion: 2.1 time: 0.091919 Aug 27 05:11:24.097248 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3142/6234] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:11:24 2022] POST /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:11:24.106690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-33bb1406-5934-411a-b826-a8bb123885ed tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:24.112154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-33bb1406-5934-411a-b826-a8bb123885ed tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:24.125127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33bb1406-5934-411a-b826-a8bb123885ed tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:24.126262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33bb1406-5934-411a-b826-a8bb123885ed tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:24.126709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33bb1406-5934-411a-b826-a8bb123885ed tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:24.127418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33bb1406-5934-411a-b826-a8bb123885ed tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:24.127878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33bb1406-5934-411a-b826-a8bb123885ed tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:24.128302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33bb1406-5934-411a-b826-a8bb123885ed tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:24.275760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-33bb1406-5934-411a-b826-a8bb123885ed tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:24.283959 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-33bb1406-5934-411a-b826-a8bb123885ed tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1498 microversion: 2.1 time: 0.181113 Aug 27 05:11:24.284884 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3093/6235] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:24 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1498 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:25.305592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae8714d0-dfbe-4338-8791-09c27fd9c00d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:25.306378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae8714d0-dfbe-4338-8791-09c27fd9c00d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:25.313934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae8714d0-dfbe-4338-8791-09c27fd9c00d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:25.314450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae8714d0-dfbe-4338-8791-09c27fd9c00d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:25.314906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae8714d0-dfbe-4338-8791-09c27fd9c00d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:25.315639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae8714d0-dfbe-4338-8791-09c27fd9c00d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:25.316116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae8714d0-dfbe-4338-8791-09c27fd9c00d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:25.316580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae8714d0-dfbe-4338-8791-09c27fd9c00d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:25.453673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ae8714d0-dfbe-4338-8791-09c27fd9c00d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:25.461593 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae8714d0-dfbe-4338-8791-09c27fd9c00d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1498 microversion: 2.1 time: 0.160275 Aug 27 05:11:25.462179 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3143/6236] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:25 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:26.483049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9cb847a1-60cc-4872-b3ff-22ecd5c55413 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:26.483663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9cb847a1-60cc-4872-b3ff-22ecd5c55413 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:26.492351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9cb847a1-60cc-4872-b3ff-22ecd5c55413 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:26.492888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9cb847a1-60cc-4872-b3ff-22ecd5c55413 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:26.493359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9cb847a1-60cc-4872-b3ff-22ecd5c55413 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:26.494089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9cb847a1-60cc-4872-b3ff-22ecd5c55413 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:26.494564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9cb847a1-60cc-4872-b3ff-22ecd5c55413 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:26.494980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9cb847a1-60cc-4872-b3ff-22ecd5c55413 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:26.667462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9cb847a1-60cc-4872-b3ff-22ecd5c55413 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:26.677905 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9cb847a1-60cc-4872-b3ff-22ecd5c55413 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1501 microversion: 2.1 time: 0.198960 Aug 27 05:11:26.692572 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3094/6237] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:26 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1501 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:26.702372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0405155e-0953-4cd3-b60e-5b2742cc8eba tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:26.703079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0405155e-0953-4cd3-b60e-5b2742cc8eba tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:26.713093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0405155e-0953-4cd3-b60e-5b2742cc8eba tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:26.713696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0405155e-0953-4cd3-b60e-5b2742cc8eba tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:26.714125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0405155e-0953-4cd3-b60e-5b2742cc8eba tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:26.715015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0405155e-0953-4cd3-b60e-5b2742cc8eba tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:26.715521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0405155e-0953-4cd3-b60e-5b2742cc8eba tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:26.715981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0405155e-0953-4cd3-b60e-5b2742cc8eba tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:26.748211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0405155e-0953-4cd3-b60e-5b2742cc8eba tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:11:26.789355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:26.839915 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0405155e-0953-4cd3-b60e-5b2742cc8eba tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 204 len: 0 microversion: 2.1 time: 0.141365 Aug 27 05:11:26.840668 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3144/6238] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:11:26 2022] DELETE /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:11:26.849095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-948497bf-4e1b-4af3-83d2-6f2603d89162 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:26.849719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-948497bf-4e1b-4af3-83d2-6f2603d89162 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:26.856205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-948497bf-4e1b-4af3-83d2-6f2603d89162 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:26.856747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-948497bf-4e1b-4af3-83d2-6f2603d89162 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:26.857195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-948497bf-4e1b-4af3-83d2-6f2603d89162 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:26.857897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-948497bf-4e1b-4af3-83d2-6f2603d89162 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:26.858362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-948497bf-4e1b-4af3-83d2-6f2603d89162 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:26.858815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-948497bf-4e1b-4af3-83d2-6f2603d89162 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:26.990769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-948497bf-4e1b-4af3-83d2-6f2603d89162 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:26.999292 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-948497bf-4e1b-4af3-83d2-6f2603d89162 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1507 microversion: 2.1 time: 0.154125 Aug 27 05:11:26.999877 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3095/6239] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:26 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:28.021374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7fdbcb03-853f-45f7-9e2f-e10d9bc421b0 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:28.022124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7fdbcb03-853f-45f7-9e2f-e10d9bc421b0 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:28.029026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fdbcb03-853f-45f7-9e2f-e10d9bc421b0 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:28.029534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fdbcb03-853f-45f7-9e2f-e10d9bc421b0 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:28.029990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fdbcb03-853f-45f7-9e2f-e10d9bc421b0 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:28.030716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fdbcb03-853f-45f7-9e2f-e10d9bc421b0 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:28.031192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fdbcb03-853f-45f7-9e2f-e10d9bc421b0 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:28.031637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fdbcb03-853f-45f7-9e2f-e10d9bc421b0 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:28.165486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7fdbcb03-853f-45f7-9e2f-e10d9bc421b0 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:28.174231 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7fdbcb03-853f-45f7-9e2f-e10d9bc421b0 tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1507 microversion: 2.1 time: 0.157143 Aug 27 05:11:28.174853 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3145/6240] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:28 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:29.195317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8223d64e-99a7-4c95-a6b3-0d039f115c9e tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:29.196933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8223d64e-99a7-4c95-a6b3-0d039f115c9e tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:29.204776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8223d64e-99a7-4c95-a6b3-0d039f115c9e tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:29.205274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8223d64e-99a7-4c95-a6b3-0d039f115c9e tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:29.205721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8223d64e-99a7-4c95-a6b3-0d039f115c9e tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:29.206608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8223d64e-99a7-4c95-a6b3-0d039f115c9e tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:29.207075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8223d64e-99a7-4c95-a6b3-0d039f115c9e tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:29.207500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8223d64e-99a7-4c95-a6b3-0d039f115c9e tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:29.374420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8223d64e-99a7-4c95-a6b3-0d039f115c9e tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f2c1e27ba541fa9937aa259c4c0159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6723b9190a3d4e01b81e5bb01e640fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:29.383433 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8223d64e-99a7-4c95-a6b3-0d039f115c9e tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 200 len: 1507 microversion: 2.1 time: 0.192001 Aug 27 05:11:29.384222 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3096/6241] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:29 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:29.424722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4dfea7f1-bb83-4368-a072-48ada88bf9f7 req-4f11ea4d-f542-4fa2-8e45-ae698e80d227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac48dae3-7862-4ab0-a4b3-818136c670c3", "name": "network-vif-deleted", "tag": "056cc13b-e9f0-4009-9b62-f7ba7ebe4ce1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:29.437042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4dfea7f1-bb83-4368-a072-48ada88bf9f7 req-4f11ea4d-f542-4fa2-8e45-ae698e80d227 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:29.437548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4dfea7f1-bb83-4368-a072-48ada88bf9f7 req-4f11ea4d-f542-4fa2-8e45-ae698e80d227 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:29.438598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4dfea7f1-bb83-4368-a072-48ada88bf9f7 req-4f11ea4d-f542-4fa2-8e45-ae698e80d227 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:29.450334 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4dfea7f1-bb83-4368-a072-48ada88bf9f7 req-4f11ea4d-f542-4fa2-8e45-ae698e80d227 service nova] Creating event network-vif-deleted:056cc13b-e9f0-4009-9b62-f7ba7ebe4ce1 for instance ac48dae3-7862-4ab0-a4b3-818136c670c3 on n-h1-854823-1 Aug 27 05:11:29.455471 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4dfea7f1-bb83-4368-a072-48ada88bf9f7 req-4f11ea4d-f542-4fa2-8e45-ae698e80d227 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037531 Aug 27 05:11:29.456096 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3146/6242] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:30.405486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-97a3ae74-74ea-460a-8743-812ba1b7b23d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:30.406109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-97a3ae74-74ea-460a-8743-812ba1b7b23d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] [instance: ac48dae3-7862-4ab0-a4b3-818136c670c3] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:30.413855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97a3ae74-74ea-460a-8743-812ba1b7b23d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:30.414359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97a3ae74-74ea-460a-8743-812ba1b7b23d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:30.414797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97a3ae74-74ea-460a-8743-812ba1b7b23d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:30.415501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97a3ae74-74ea-460a-8743-812ba1b7b23d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:30.415961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97a3ae74-74ea-460a-8743-812ba1b7b23d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:30.416602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-97a3ae74-74ea-460a-8743-812ba1b7b23d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:30.430906 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-97a3ae74-74ea-460a-8743-812ba1b7b23d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] HTTP exception thrown: Instance ac48dae3-7862-4ab0-a4b3-818136c670c3 could not be found. Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-97a3ae74-74ea-460a-8743-812ba1b7b23d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Request method failure captured: Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 HTTP/1.1 Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCadlguqy1fPaAMRCkskN_1_LMYm1WdWRAaWCZb7FbFP7WylOXPudg4tKhrki_V4UQdxMy2jrpOul7Zy5DQEbUPM0SKfpJGu5XKImvjMV8GtLMzkMJ68HIlkyQ-GqgJp15rzpSDDvSFi-lQNO848xqw7PJMMBBlY7RCArazej2KW_MAg Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 6723b9190a3d4e01b81e5bb01e640fd3 Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestServerAdvancedOps-1022455902 Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6723b9190a3d4e01b81e5bb01e640fd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6723b9190a3d4e01b81e5bb01e640fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6723b9190a3d4e01b81e5bb01e640fd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6723b9190a3d4e01b81e5bb01e640fd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestServerAdvancedOps-1022455902 Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 6723b9190a3d4e01b81e5bb01e640fd3 Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestServerAdvancedOps-1022455902 Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestServerAdvancedOps-1022455902-project Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: b2f2c1e27ba541fa9937aa259c4c0159 Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestServerAdvancedOps-1022455902-project Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance ac48dae3-7862-4ab0-a4b3-818136c670c3 could not be found. Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'ac48dae3-7862-4ab0-a4b3-818136c670c3'} Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac48dae3-7862-4ab0-a4b3-818136c670c3 could not be found. Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac48dae3-7862-4ab0-a4b3-818136c670c3 could not be found. Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:30.432665 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:11:30.440237 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:30.440237 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:30.440237 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:30.440237 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:30.440237 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:30.440237 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac48dae3-7862-4ab0-a4b3-818136c670c3 could not be found. Aug 27 05:11:30.440237 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:11:30.440237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-97a3ae74-74ea-460a-8743-812ba1b7b23d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] Returning 404 to user: Instance ac48dae3-7862-4ab0-a4b3-818136c670c3 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:30.440237 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-97a3ae74-74ea-460a-8743-812ba1b7b23d tempest-TestServerAdvancedOps-1022455902 tempest-TestServerAdvancedOps-1022455902-project] 10.222.0.79 "GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3" status: 404 len: 111 microversion: 2.1 time: 0.032488 Aug 27 05:11:30.440237 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3097/6243] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:30 2022] GET /compute/v2.1/servers/ac48dae3-7862-4ab0-a4b3-818136c670c3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:11:40.251107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-87d5ee7c-52c6-469f-8613-f7b32cca1d5b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:40.252765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-87d5ee7c-52c6-469f-8613-f7b32cca1d5b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:40.265088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0a2fe67-36f9-49d0-be2c-1bbf146524ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:40.266741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c0a2fe67-36f9-49d0-be2c-1bbf146524ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:40.274624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:40.276693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:40.278428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0a2fe67-36f9-49d0-be2c-1bbf146524ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.280401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87d5ee7c-52c6-469f-8613-f7b32cca1d5b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.280952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87d5ee7c-52c6-469f-8613-f7b32cca1d5b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.281997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87d5ee7c-52c6-469f-8613-f7b32cca1d5b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.282889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0a2fe67-36f9-49d0-be2c-1bbf146524ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.283794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0a2fe67-36f9-49d0-be2c-1bbf146524ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.285046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0a2fe67-36f9-49d0-be2c-1bbf146524ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.285519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0a2fe67-36f9-49d0-be2c-1bbf146524ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.286112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0a2fe67-36f9-49d0-be2c-1bbf146524ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.294941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87d5ee7c-52c6-469f-8613-f7b32cca1d5b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.295681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87d5ee7c-52c6-469f-8613-f7b32cca1d5b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.296159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87d5ee7c-52c6-469f-8613-f7b32cca1d5b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.344225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:40.354077 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c0a2fe67-36f9-49d0-be2c-1bbf146524ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a/ips" status: 200 len: 148 microversion: 2.1 time: 0.087608 Aug 27 05:11:40.354760 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3098/6244] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 05:11:40 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a/ips => generated 148 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:11:40.367729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5e16e53-dc51-4eab-bec2-be895c1476aa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e6613a2-5d3d-4bf5-9b70-00f0a3603c95"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:40.370412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f5e16e53-dc51-4eab-bec2-be895c1476aa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:40.386926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5e16e53-dc51-4eab-bec2-be895c1476aa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.388755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5e16e53-dc51-4eab-bec2-be895c1476aa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.389218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5e16e53-dc51-4eab-bec2-be895c1476aa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.389946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5e16e53-dc51-4eab-bec2-be895c1476aa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.390411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5e16e53-dc51-4eab-bec2-be895c1476aa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.391418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f5e16e53-dc51-4eab-bec2-be895c1476aa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.506477 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-f5e16e53-dc51-4eab-bec2-be895c1476aa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] HTTP exception thrown: Invalid volume: volume 4e6613a2-5d3d-4bf5-9b70-00f0a3603c95 is already attached to instances: d1fdabdb-6353-46ce-9239-bc41ad53212e Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5e16e53-dc51-4eab-bec2-be895c1476aa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Request method failure captured: Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a/os-volume_attachments HTTP/1.1 Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 74 Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaaigp07zvkISHb29u2Quk6NjhbfN1zEDCSkQQoinW0uynW7tNECIjPZRDz_K75qhqu2Icv_5PRsBA8URuVfOgE2knALTSJ-lxCAlMfLfMaApUY2YZNmhuhErGrmBQkx_kPARWtJeBImZcDnJdIllkJtA8jOXs3vwkeuSJPXsJdeNoo Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: dc1b938c06bd432496e8ae8b24965678 Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: {"volumeAttachment": {"volumeId": "4e6613a2-5d3d-4bf5-9b70-00f0a3603c95"}} Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: exception: Invalid volume: volume 4e6613a2-5d3d-4bf5-9b70-00f0a3603c95 is already attached to instances: d1fdabdb-6353-46ce-9239-bc41ad53212e Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'server_id': '986bd712-6d0e-49a2-8bd4-a5bdc6186b4a', 'body': {'volumeAttachment': {'volumeId': '4e6613a2-5d3d-4bf5-9b70-00f0a3603c95'}}} Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4e6613a2-5d3d-4bf5-9b70-00f0a3603c95 is already attached to instances: d1fdabdb-6353-46ce-9239-bc41ad53212e Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:11:40.515072 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4e6613a2-5d3d-4bf5-9b70-00f0a3603c95 is already attached to instances: d1fdabdb-6353-46ce-9239-bc41ad53212e Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4e6613a2-5d3d-4bf5-9b70-00f0a3603c95 is already attached to instances: d1fdabdb-6353-46ce-9239-bc41ad53212e Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f5e16e53-dc51-4eab-bec2-be895c1476aa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Returning 400 to user: Invalid volume: volume 4e6613a2-5d3d-4bf5-9b70-00f0a3603c95 is already attached to instances: d1fdabdb-6353-46ce-9239-bc41ad53212e {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f5e16e53-dc51-4eab-bec2-be895c1476aa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "POST /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.154206 Aug 27 05:11:40.522290 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3099/6245] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:11:40 2022] POST /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a/os-volume_attachments => generated 174 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:11:40.531945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-71ffdc85-c357-4160-966b-554497966465 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:40.534582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-71ffdc85-c357-4160-966b-554497966465 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:40.546263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71ffdc85-c357-4160-966b-554497966465 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.555735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71ffdc85-c357-4160-966b-554497966465 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.559432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71ffdc85-c357-4160-966b-554497966465 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.560303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71ffdc85-c357-4160-966b-554497966465 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.562216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71ffdc85-c357-4160-966b-554497966465 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.563363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71ffdc85-c357-4160-966b-554497966465 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.583661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-87d5ee7c-52c6-469f-8613-f7b32cca1d5b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:40.599464 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-87d5ee7c-52c6-469f-8613-f7b32cca1d5b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.352925 Aug 27 05:11:40.601082 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3147/6246] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:40 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:40.622532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a2cf8c54-58aa-40e6-9d12-9afc7fca22dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:40.622729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-71ffdc85-c357-4160-966b-554497966465 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:11:40.623627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a2cf8c54-58aa-40e6-9d12-9afc7fca22dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:40.634873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2cf8c54-58aa-40e6-9d12-9afc7fca22dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.637338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2cf8c54-58aa-40e6-9d12-9afc7fca22dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.637956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2cf8c54-58aa-40e6-9d12-9afc7fca22dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.639081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2cf8c54-58aa-40e6-9d12-9afc7fca22dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.639703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2cf8c54-58aa-40e6-9d12-9afc7fca22dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.641636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2cf8c54-58aa-40e6-9d12-9afc7fca22dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.816205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=36 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:40.856092 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-71ffdc85-c357-4160-966b-554497966465 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 204 len: 0 microversion: 2.1 time: 0.332312 Aug 27 05:11:40.857015 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3100/6247] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:11:40 2022] DELETE /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:11:40.867936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-67fcbbdb-7b3b-46bb-8897-fada3491380d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:40.868713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-67fcbbdb-7b3b-46bb-8897-fada3491380d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:40.884962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67fcbbdb-7b3b-46bb-8897-fada3491380d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.885745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67fcbbdb-7b3b-46bb-8897-fada3491380d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.886366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67fcbbdb-7b3b-46bb-8897-fada3491380d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.889444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67fcbbdb-7b3b-46bb-8897-fada3491380d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.890117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67fcbbdb-7b3b-46bb-8897-fada3491380d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.890773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67fcbbdb-7b3b-46bb-8897-fada3491380d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.928262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a2cf8c54-58aa-40e6-9d12-9afc7fca22dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:40.940688 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a2cf8c54-58aa-40e6-9d12-9afc7fca22dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.322899 Aug 27 05:11:40.941845 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3148/6248] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:40 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:40.974697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-635fcde6-b316-400a-ab6b-9eee63f680ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:40.975390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-635fcde6-b316-400a-ab6b-9eee63f680ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:40.986693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-635fcde6-b316-400a-ab6b-9eee63f680ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.987607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-635fcde6-b316-400a-ab6b-9eee63f680ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.988180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-635fcde6-b316-400a-ab6b-9eee63f680ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:40.990814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-635fcde6-b316-400a-ab6b-9eee63f680ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:40.990814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-635fcde6-b316-400a-ab6b-9eee63f680ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:40.990814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-635fcde6-b316-400a-ab6b-9eee63f680ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:41.174234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-635fcde6-b316-400a-ab6b-9eee63f680ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:41.185807 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-635fcde6-b316-400a-ab6b-9eee63f680ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.224029 Aug 27 05:11:41.187075 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3149/6249] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:40 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:41.198686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-67fcbbdb-7b3b-46bb-8897-fada3491380d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:41.212504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97b56ef3-17a8-42d9-9950-f98eb2c89ec9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:41.213591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97b56ef3-17a8-42d9-9950-f98eb2c89ec9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:41.215444 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-67fcbbdb-7b3b-46bb-8897-fada3491380d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1680 microversion: 2.1 time: 0.352806 Aug 27 05:11:41.216389 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3101/6250] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:40 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1680 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:41.226496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97b56ef3-17a8-42d9-9950-f98eb2c89ec9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:41.228261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97b56ef3-17a8-42d9-9950-f98eb2c89ec9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:41.230001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97b56ef3-17a8-42d9-9950-f98eb2c89ec9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:41.231290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97b56ef3-17a8-42d9-9950-f98eb2c89ec9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:41.232648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97b56ef3-17a8-42d9-9950-f98eb2c89ec9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:41.233104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97b56ef3-17a8-42d9-9950-f98eb2c89ec9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:41.446490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97b56ef3-17a8-42d9-9950-f98eb2c89ec9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:41.456926 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97b56ef3-17a8-42d9-9950-f98eb2c89ec9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.249160 Aug 27 05:11:41.458236 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3150/6251] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:41 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:41.592166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-534882365", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "3b8ed832-ef0e-4e8a-a972-17542970b368"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:41.685155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] validate_networks() for [('3b8ed832-ef0e-4e8a-a972-17542970b368', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:11:42.243569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7cd73c1f-bd7e-4fa5-bcf2-2adc9cde9838 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:42.244332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7cd73c1f-bd7e-4fa5-bcf2-2adc9cde9838 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:42.263324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cd73c1f-bd7e-4fa5-bcf2-2adc9cde9838 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:42.263936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cd73c1f-bd7e-4fa5-bcf2-2adc9cde9838 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:42.265412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cd73c1f-bd7e-4fa5-bcf2-2adc9cde9838 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:42.268897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cd73c1f-bd7e-4fa5-bcf2-2adc9cde9838 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:42.270173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cd73c1f-bd7e-4fa5-bcf2-2adc9cde9838 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:42.272866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cd73c1f-bd7e-4fa5-bcf2-2adc9cde9838 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:42.658472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:11:42.658940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:11:42.659614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:11:42.660220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:11:42.661136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:11:42.681668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7cd73c1f-bd7e-4fa5-bcf2-2adc9cde9838 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:42.684783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:42.685334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:42.686319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:42.687130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:42.687665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:42.689646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:42.691695 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7cd73c1f-bd7e-4fa5-bcf2-2adc9cde9838 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1680 microversion: 2.1 time: 0.454979 Aug 27 05:11:42.698922 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3151/6252] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:42 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1680 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:42.754421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Getting quotas for project 631787d4099e4245be9291f39ff6b2bd. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:11:42.765847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Getting quotas for user c77d065776e448f08f0a1d6fde1aff3c and project 631787d4099e4245be9291f39ff6b2bd. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:11:42.786540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:11:42.795598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:11:42.870504 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2daf6930-6f0b-4aff-8605-9c48714f60d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.282951 Aug 27 05:11:42.878408 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3102/6253] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:11:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:11:42.884822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6dc6c473-cf51-41cc-bfab-be505f078a68 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:42.885812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6dc6c473-cf51-41cc-bfab-be505f078a68 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:43.063937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6dc6c473-cf51-41cc-bfab-be505f078a68 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:43.086212 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6dc6c473-cf51-41cc-bfab-be505f078a68 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 200 len: 1214 microversion: 2.1 time: 0.200242 Aug 27 05:11:43.089150 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3152/6254] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:42 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 1214 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:43.729338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1a7f9bbc-0d95-4291-8861-099f62ae337f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:43.729995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1a7f9bbc-0d95-4291-8861-099f62ae337f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:43.752767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a7f9bbc-0d95-4291-8861-099f62ae337f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:43.753261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a7f9bbc-0d95-4291-8861-099f62ae337f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:43.753892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a7f9bbc-0d95-4291-8861-099f62ae337f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:43.754621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a7f9bbc-0d95-4291-8861-099f62ae337f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:43.755096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a7f9bbc-0d95-4291-8861-099f62ae337f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:43.755520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1a7f9bbc-0d95-4291-8861-099f62ae337f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:44.118631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8d47f60-f8be-4f89-9375-ebca3c8ddafa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:44.119368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8d47f60-f8be-4f89-9375-ebca3c8ddafa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:44.146254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d47f60-f8be-4f89-9375-ebca3c8ddafa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:44.146796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d47f60-f8be-4f89-9375-ebca3c8ddafa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:44.147249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d47f60-f8be-4f89-9375-ebca3c8ddafa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:44.148010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d47f60-f8be-4f89-9375-ebca3c8ddafa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:44.148490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d47f60-f8be-4f89-9375-ebca3c8ddafa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:44.148987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d47f60-f8be-4f89-9375-ebca3c8ddafa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:44.358633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1a7f9bbc-0d95-4291-8861-099f62ae337f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:44.368197 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1a7f9bbc-0d95-4291-8861-099f62ae337f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1613 microversion: 2.1 time: 0.643618 Aug 27 05:11:44.368849 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3103/6255] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:43 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1613 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:44.401249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8d47f60-f8be-4f89-9375-ebca3c8ddafa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:44.415035 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8d47f60-f8be-4f89-9375-ebca3c8ddafa tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 200 len: 1210 microversion: 2.1 time: 0.310033 Aug 27 05:11:44.423432 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3153/6256] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:44 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 1210 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:44.669380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-456e1c26-3769-463e-bb5c-3e0507c4e39d req-360d6ca8-ebd8-4827-aea8-07dda635035a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986bd712-6d0e-49a2-8bd4-a5bdc6186b4a", "name": "network-vif-deleted", "tag": "ddedb5a2-d20a-4db5-a003-bcc5ded9a212"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:44.687241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-456e1c26-3769-463e-bb5c-3e0507c4e39d req-360d6ca8-ebd8-4827-aea8-07dda635035a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:44.687793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-456e1c26-3769-463e-bb5c-3e0507c4e39d req-360d6ca8-ebd8-4827-aea8-07dda635035a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:44.688240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-456e1c26-3769-463e-bb5c-3e0507c4e39d req-360d6ca8-ebd8-4827-aea8-07dda635035a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:44.711677 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-456e1c26-3769-463e-bb5c-3e0507c4e39d req-360d6ca8-ebd8-4827-aea8-07dda635035a service nova] Creating event network-vif-deleted:ddedb5a2-d20a-4db5-a003-bcc5ded9a212 for instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a on n-h1-854823-1 Aug 27 05:11:44.724841 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-456e1c26-3769-463e-bb5c-3e0507c4e39d req-360d6ca8-ebd8-4827-aea8-07dda635035a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067133 Aug 27 05:11:44.733573 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3104/6257] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:45.394979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c43f417-252f-4e95-8d32-0f8f1350c0e3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:45.395611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4c43f417-252f-4e95-8d32-0f8f1350c0e3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:45.413164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c43f417-252f-4e95-8d32-0f8f1350c0e3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:45.416016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c43f417-252f-4e95-8d32-0f8f1350c0e3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:45.416500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c43f417-252f-4e95-8d32-0f8f1350c0e3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:45.417789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c43f417-252f-4e95-8d32-0f8f1350c0e3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:45.418303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c43f417-252f-4e95-8d32-0f8f1350c0e3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:45.423429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c43f417-252f-4e95-8d32-0f8f1350c0e3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:45.447488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1b38afa0-269e-499b-b223-55f5fde2673d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:45.449453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1b38afa0-269e-499b-b223-55f5fde2673d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:45.462867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b38afa0-269e-499b-b223-55f5fde2673d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:45.465152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b38afa0-269e-499b-b223-55f5fde2673d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:45.465812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b38afa0-269e-499b-b223-55f5fde2673d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:45.470979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b38afa0-269e-499b-b223-55f5fde2673d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:45.471619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b38afa0-269e-499b-b223-55f5fde2673d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:45.472244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1b38afa0-269e-499b-b223-55f5fde2673d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:45.535879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c43f417-252f-4e95-8d32-0f8f1350c0e3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:45.539442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c43f417-252f-4e95-8d32-0f8f1350c0e3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:45.540192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c43f417-252f-4e95-8d32-0f8f1350c0e3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:45.541015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-4c43f417-252f-4e95-8d32-0f8f1350c0e3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lazy-loading 'fault' on Instance uuid 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:11:45.673609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c43f417-252f-4e95-8d32-0f8f1350c0e3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:45.685660 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c43f417-252f-4e95-8d32-0f8f1350c0e3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 200 len: 1332 microversion: 2.1 time: 0.295324 Aug 27 05:11:45.686850 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3154/6258] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:45 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 1332 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:45.785181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1b38afa0-269e-499b-b223-55f5fde2673d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:45.797801 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1b38afa0-269e-499b-b223-55f5fde2673d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 200 len: 1272 microversion: 2.1 time: 0.353846 Aug 27 05:11:45.816212 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3105/6259] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:45 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 1272 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:46.718843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee74c6d7-73a1-4821-8e09-06f260a779c1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:46.719541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee74c6d7-73a1-4821-8e09-06f260a779c1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:46.738923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee74c6d7-73a1-4821-8e09-06f260a779c1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:46.739718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee74c6d7-73a1-4821-8e09-06f260a779c1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:46.740404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee74c6d7-73a1-4821-8e09-06f260a779c1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:46.742663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee74c6d7-73a1-4821-8e09-06f260a779c1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:46.744026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee74c6d7-73a1-4821-8e09-06f260a779c1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:46.744677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee74c6d7-73a1-4821-8e09-06f260a779c1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:46.767473 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ee74c6d7-73a1-4821-8e09-06f260a779c1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] HTTP exception thrown: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee74c6d7-73a1-4821-8e09-06f260a779c1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Request method failure captured: Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a HTTP/1.1 Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaaigp07zvkISHb29u2Quk6NjhbfN1zEDCSkQQoinW0uynW7tNECIjPZRDz_K75qhqu2Icv_5PRsBA8URuVfOgE2knALTSJ-lxCAlMfLfMaApUY2YZNmhuhErGrmBQkx_kPARWtJeBImZcDnJdIllkJtA8jOXs3vwkeuSJPXsJdeNoo Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: dc1b938c06bd432496e8ae8b24965678 Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '986bd712-6d0e-49a2-8bd4-a5bdc6186b4a'} Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:11:46.770688 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:11:46.774591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:11:46.774591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:11:46.774591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:11:46.774591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:11:46.774591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:11:46.774591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:11:46.774591 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:11:46.778707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee74c6d7-73a1-4821-8e09-06f260a779c1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Returning 404 to user: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:11:46.779850 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee74c6d7-73a1-4821-8e09-06f260a779c1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 404 len: 111 microversion: 2.1 time: 0.072458 Aug 27 05:11:46.782397 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3155/6260] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:46 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:11:46.790857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6490263d-f55f-48c8-a004-a7df06fd5c80 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '.version_select at 0x7f1f21a36ee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:46.823428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8ed5ba2-d245-474a-8040-e0ca8dc35b3a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:46.824066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8ed5ba2-d245-474a-8040-e0ca8dc35b3a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:46.840080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ed5ba2-d245-474a-8040-e0ca8dc35b3a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:46.840642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ed5ba2-d245-474a-8040-e0ca8dc35b3a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:46.841248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ed5ba2-d245-474a-8040-e0ca8dc35b3a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:46.841983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ed5ba2-d245-474a-8040-e0ca8dc35b3a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:46.849819 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6490263d-f55f-48c8-a004-a7df06fd5c80 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1066855837" status: 202 len: 0 microversion: 2.1 time: 0.062822 Aug 27 05:11:46.853914 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3106/6261] 10.222.0.79 () {58 vars in 1221 bytes} [Sat Aug 27 05:11:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1066855837 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:11:46.854178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ed5ba2-d245-474a-8040-e0ca8dc35b3a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:46.854178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ed5ba2-d245-474a-8040-e0ca8dc35b3a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:47.392178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8ed5ba2-d245-474a-8040-e0ca8dc35b3a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:47.405304 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8ed5ba2-d245-474a-8040-e0ca8dc35b3a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 200 len: 1314 microversion: 2.1 time: 0.586611 Aug 27 05:11:47.416554 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3156/6262] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:46 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:48.383166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-7e8e3904-76d9-43f0-8f0f-9cbb9a8bf572 req-091ab871-9859-45f5-8f5f-517463dc5c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8325ecc1-c663-4d65-81a3-ba46c2d5e692", "tag": "69d1487f-d7df-4113-8980-babffb74e9df"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:48.418118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7e8e3904-76d9-43f0-8f0f-9cbb9a8bf572 req-091ab871-9859-45f5-8f5f-517463dc5c6b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:48.419503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7e8e3904-76d9-43f0-8f0f-9cbb9a8bf572 req-091ab871-9859-45f5-8f5f-517463dc5c6b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:48.420207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7e8e3904-76d9-43f0-8f0f-9cbb9a8bf572 req-091ab871-9859-45f5-8f5f-517463dc5c6b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:48.437906 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-7e8e3904-76d9-43f0-8f0f-9cbb9a8bf572 req-091ab871-9859-45f5-8f5f-517463dc5c6b service nova] Creating event network-changed:69d1487f-d7df-4113-8980-babffb74e9df for instance 8325ecc1-c663-4d65-81a3-ba46c2d5e692 on n-h2-854823-1 Aug 27 05:11:48.440796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3794f42-f811-4be6-a12b-9eb27b62abe6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:48.442361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b3794f42-f811-4be6-a12b-9eb27b62abe6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:48.443052 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-7e8e3904-76d9-43f0-8f0f-9cbb9a8bf572 req-091ab871-9859-45f5-8f5f-517463dc5c6b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071546 Aug 27 05:11:48.444261 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3107/6263] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:48.455996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3794f42-f811-4be6-a12b-9eb27b62abe6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:48.460060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3794f42-f811-4be6-a12b-9eb27b62abe6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:48.461991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3794f42-f811-4be6-a12b-9eb27b62abe6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:48.463192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3794f42-f811-4be6-a12b-9eb27b62abe6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:48.466722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3794f42-f811-4be6-a12b-9eb27b62abe6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:48.467520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3794f42-f811-4be6-a12b-9eb27b62abe6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:48.767199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-925e7b48-b00f-41cc-8d0b-0266210d94e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:48.769224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-925e7b48-b00f-41cc-8d0b-0266210d94e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:48.769927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-925e7b48-b00f-41cc-8d0b-0266210d94e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:48.770569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-925e7b48-b00f-41cc-8d0b-0266210d94e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:48.771477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-925e7b48-b00f-41cc-8d0b-0266210d94e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:48.772913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-925e7b48-b00f-41cc-8d0b-0266210d94e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:48.775853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-925e7b48-b00f-41cc-8d0b-0266210d94e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:48.841264 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-925e7b48-b00f-41cc-8d0b-0266210d94e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.395156 Aug 27 05:11:48.843698 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3108/6264] 10.222.0.79 () {58 vars in 1185 bytes} [Sat Aug 27 05:11:48 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:49.024785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1300320377", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "availability_zone": "nova:n-h2-854823-1", "networks": [{"uuid": "11ecf8b7-d620-4685-862d-8c77bc01caf7"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:49.134742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] validate_networks() for [('11ecf8b7-d620-4685-862d-8c77bc01caf7', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:11:49.228189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b3794f42-f811-4be6-a12b-9eb27b62abe6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:49.238605 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3794f42-f811-4be6-a12b-9eb27b62abe6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 200 len: 1314 microversion: 2.1 time: 0.811649 Aug 27 05:11:49.252742 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3157/6265] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:48 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:49.337735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d28a8b7c-c974-4794-8c83-7f733f18cb1b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:49.339464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d28a8b7c-c974-4794-8c83-7f733f18cb1b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:49.346258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d28a8b7c-c974-4794-8c83-7f733f18cb1b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:49.347014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d28a8b7c-c974-4794-8c83-7f733f18cb1b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:49.347635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d28a8b7c-c974-4794-8c83-7f733f18cb1b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:49.348513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d28a8b7c-c974-4794-8c83-7f733f18cb1b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:49.349172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d28a8b7c-c974-4794-8c83-7f733f18cb1b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:49.349763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d28a8b7c-c974-4794-8c83-7f733f18cb1b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:49.460868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-d28a8b7c-c974-4794-8c83-7f733f18cb1b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lazy-loading 'services' on Instance uuid d1fdabdb-6353-46ce-9239-bc41ad53212e {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:11:49.555710 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d28a8b7c-c974-4794-8c83-7f733f18cb1b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments/4e6613a2-5d3d-4bf5-9b70-00f0a3603c95" status: 202 len: 0 microversion: 2.1 time: 0.228558 Aug 27 05:11:49.556402 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3158/6266] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:11:49 2022] DELETE /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments/4e6613a2-5d3d-4bf5-9b70-00f0a3603c95 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:11:49.565937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8a6b57c-2da7-4abf-9e69-2583f677f4c9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:49.568517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8a6b57c-2da7-4abf-9e69-2583f677f4c9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:49.576232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8a6b57c-2da7-4abf-9e69-2583f677f4c9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:49.576782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8a6b57c-2da7-4abf-9e69-2583f677f4c9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:49.577239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8a6b57c-2da7-4abf-9e69-2583f677f4c9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:49.578528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8a6b57c-2da7-4abf-9e69-2583f677f4c9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:49.579043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8a6b57c-2da7-4abf-9e69-2583f677f4c9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:49.579486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8a6b57c-2da7-4abf-9e69-2583f677f4c9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:49.615101 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8a6b57c-2da7-4abf-9e69-2583f677f4c9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053999 Aug 27 05:11:49.615710 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3159/6267] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:11:49 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:49.686149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:11:49.686595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:11:49.687891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:11:49.688567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:11:49.689255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:11:49.700125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:49.700938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:49.701477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:49.702353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:49.702982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:49.703484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:49.724925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Getting quotas for project 3273e40cb2c1441a88189118fba1afc2. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:11:49.731141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Getting quotas for user 4d456f673d624515befe6cf676622ed7 and project 3273e40cb2c1441a88189118fba1afc2. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:11:49.746019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:11:49.748753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:11:49.793885 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2aacf493-2252-4f72-b5b1-41436d7e6c93 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.773109 Aug 27 05:11:49.801758 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3109/6268] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:11:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:11:49.806676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9fb2f3f3-d498-4753-a03a-796ee468ec2a tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:49.807309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9fb2f3f3-d498-4753-a03a-796ee468ec2a tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:49.894384 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9fb2f3f3-d498-4753-a03a-796ee468ec2a tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1329 microversion: 2.1 time: 0.091137 Aug 27 05:11:49.896604 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3160/6269] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:49 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1329 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:50.261611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-027c1b68-780a-4c28-be10-c3b0f71aba4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:50.262240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-027c1b68-780a-4c28-be10-c3b0f71aba4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:50.269731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-027c1b68-780a-4c28-be10-c3b0f71aba4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:50.270414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-027c1b68-780a-4c28-be10-c3b0f71aba4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:50.271660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-027c1b68-780a-4c28-be10-c3b0f71aba4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:50.272503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-027c1b68-780a-4c28-be10-c3b0f71aba4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:50.273252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-027c1b68-780a-4c28-be10-c3b0f71aba4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:50.274073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-027c1b68-780a-4c28-be10-c3b0f71aba4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:50.453475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-027c1b68-780a-4c28-be10-c3b0f71aba4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:50.464817 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-027c1b68-780a-4c28-be10-c3b0f71aba4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 200 len: 1314 microversion: 2.1 time: 0.207284 Aug 27 05:11:50.466157 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3110/6270] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:50 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:50.628068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8fc3f06e-aecc-495d-a636-805f088f9356 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:50.631647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8fc3f06e-aecc-495d-a636-805f088f9356 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:50.651623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fc3f06e-aecc-495d-a636-805f088f9356 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:50.653554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fc3f06e-aecc-495d-a636-805f088f9356 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:50.655368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fc3f06e-aecc-495d-a636-805f088f9356 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:50.656723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fc3f06e-aecc-495d-a636-805f088f9356 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:50.658934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fc3f06e-aecc-495d-a636-805f088f9356 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:50.660773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fc3f06e-aecc-495d-a636-805f088f9356 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:50.736382 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8fc3f06e-aecc-495d-a636-805f088f9356 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112513 Aug 27 05:11:50.737441 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3161/6271] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:11:50 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:50.916666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7025a91-7d17-4347-8427-87734d6f6add tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:50.917295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c7025a91-7d17-4347-8427-87734d6f6add tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:50.926408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7025a91-7d17-4347-8427-87734d6f6add tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:50.934305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7025a91-7d17-4347-8427-87734d6f6add tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:50.936949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7025a91-7d17-4347-8427-87734d6f6add tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:50.938899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7025a91-7d17-4347-8427-87734d6f6add tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:50.942583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7025a91-7d17-4347-8427-87734d6f6add tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:50.943260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7025a91-7d17-4347-8427-87734d6f6add tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:51.069930 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7025a91-7d17-4347-8427-87734d6f6add tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1416 microversion: 2.1 time: 0.157606 Aug 27 05:11:51.073861 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3111/6272] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:50 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1416 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:51.490399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89f45554-7524-44e6-9666-c0b1da573815 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:51.491103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89f45554-7524-44e6-9666-c0b1da573815 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:51.507027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f45554-7524-44e6-9666-c0b1da573815 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:51.520900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f45554-7524-44e6-9666-c0b1da573815 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:51.521900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f45554-7524-44e6-9666-c0b1da573815 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:51.522905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f45554-7524-44e6-9666-c0b1da573815 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:51.523562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f45554-7524-44e6-9666-c0b1da573815 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:51.524165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f45554-7524-44e6-9666-c0b1da573815 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:51.754557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3edc6513-60b9-4842-885c-2661ce1edcba tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:51.763078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3edc6513-60b9-4842-885c-2661ce1edcba tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:51.784901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89f45554-7524-44e6-9666-c0b1da573815 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:51.800292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3edc6513-60b9-4842-885c-2661ce1edcba tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:51.802113 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89f45554-7524-44e6-9666-c0b1da573815 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 200 len: 1314 microversion: 2.1 time: 0.315361 Aug 27 05:11:51.804323 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3162/6273] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:51 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:51.818774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3edc6513-60b9-4842-885c-2661ce1edcba tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:51.820254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3edc6513-60b9-4842-885c-2661ce1edcba tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:51.825410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3edc6513-60b9-4842-885c-2661ce1edcba tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:51.828204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3edc6513-60b9-4842-885c-2661ce1edcba tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:51.828728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3edc6513-60b9-4842-885c-2661ce1edcba tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:51.887019 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3edc6513-60b9-4842-885c-2661ce1edcba tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141945 Aug 27 05:11:51.890049 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3112/6274] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:11:51 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:52.097793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce7d280a-5138-4f30-b357-fb14c49da9e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:52.098874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce7d280a-5138-4f30-b357-fb14c49da9e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:52.108616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7d280a-5138-4f30-b357-fb14c49da9e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:52.118832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7d280a-5138-4f30-b357-fb14c49da9e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:52.119681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7d280a-5138-4f30-b357-fb14c49da9e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:52.121583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7d280a-5138-4f30-b357-fb14c49da9e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:52.122365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7d280a-5138-4f30-b357-fb14c49da9e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:52.123181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7d280a-5138-4f30-b357-fb14c49da9e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:52.303616 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce7d280a-5138-4f30-b357-fb14c49da9e6 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1422 microversion: 2.1 time: 0.209779 Aug 27 05:11:52.308045 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3163/6275] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:52 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1422 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:52.832418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dc271e20-8ecd-4a7f-9b31-1719a4a2ac62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:52.833139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dc271e20-8ecd-4a7f-9b31-1719a4a2ac62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:52.844445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc271e20-8ecd-4a7f-9b31-1719a4a2ac62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:52.852232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc271e20-8ecd-4a7f-9b31-1719a4a2ac62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:52.852825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc271e20-8ecd-4a7f-9b31-1719a4a2ac62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:52.854372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc271e20-8ecd-4a7f-9b31-1719a4a2ac62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:52.855755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc271e20-8ecd-4a7f-9b31-1719a4a2ac62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:52.859111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc271e20-8ecd-4a7f-9b31-1719a4a2ac62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:52.907365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95a4363e-5e67-4935-a1c6-c1cb4e5b8830 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:52.910847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95a4363e-5e67-4935-a1c6-c1cb4e5b8830 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:52.934701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95a4363e-5e67-4935-a1c6-c1cb4e5b8830 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:52.935480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95a4363e-5e67-4935-a1c6-c1cb4e5b8830 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:52.936144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95a4363e-5e67-4935-a1c6-c1cb4e5b8830 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:52.937275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95a4363e-5e67-4935-a1c6-c1cb4e5b8830 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:52.937934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95a4363e-5e67-4935-a1c6-c1cb4e5b8830 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:52.938653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95a4363e-5e67-4935-a1c6-c1cb4e5b8830 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:52.983506 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95a4363e-5e67-4935-a1c6-c1cb4e5b8830 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086837 Aug 27 05:11:52.985785 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3164/6276] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:11:52 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:53.333617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7790384a-1751-4757-b2ec-1e3599f61cff tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:53.334263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7790384a-1751-4757-b2ec-1e3599f61cff tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:53.344138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7790384a-1751-4757-b2ec-1e3599f61cff tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:53.344755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7790384a-1751-4757-b2ec-1e3599f61cff tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:53.345226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7790384a-1751-4757-b2ec-1e3599f61cff tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:53.345970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7790384a-1751-4757-b2ec-1e3599f61cff tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:53.346511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7790384a-1751-4757-b2ec-1e3599f61cff tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:53.350834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7790384a-1751-4757-b2ec-1e3599f61cff tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:53.399311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:53.530047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dc271e20-8ecd-4a7f-9b31-1719a4a2ac62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:53.538568 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dc271e20-8ecd-4a7f-9b31-1719a4a2ac62 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 200 len: 1314 microversion: 2.1 time: 0.711027 Aug 27 05:11:53.539158 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3113/6277] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:52 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:53.657034 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7790384a-1751-4757-b2ec-1e3599f61cff tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1464 microversion: 2.1 time: 0.331739 Aug 27 05:11:53.659145 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3165/6278] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:53 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1464 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:53.996810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1699a2f8-99c1-48fc-80d5-f15dbf41d777 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:54.000242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1699a2f8-99c1-48fc-80d5-f15dbf41d777 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:54.017238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1699a2f8-99c1-48fc-80d5-f15dbf41d777 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:54.023031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1699a2f8-99c1-48fc-80d5-f15dbf41d777 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:54.024393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1699a2f8-99c1-48fc-80d5-f15dbf41d777 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:54.025548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1699a2f8-99c1-48fc-80d5-f15dbf41d777 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:54.026264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1699a2f8-99c1-48fc-80d5-f15dbf41d777 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:54.026953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1699a2f8-99c1-48fc-80d5-f15dbf41d777 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:54.086814 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1699a2f8-99c1-48fc-80d5-f15dbf41d777 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095107 Aug 27 05:11:54.087792 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3114/6279] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:11:53 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:54.219685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-04f0e9b3-266d-4350-8745-92817af85092 req-a34afefb-6eb2-49f5-89e8-443749304d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8325ecc1-c663-4d65-81a3-ba46c2d5e692", "name": "network-vif-plugged", "status": "completed", "tag": "69d1487f-d7df-4113-8980-babffb74e9df"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:54.241780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-04f0e9b3-266d-4350-8745-92817af85092 req-a34afefb-6eb2-49f5-89e8-443749304d7e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:54.246922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-04f0e9b3-266d-4350-8745-92817af85092 req-a34afefb-6eb2-49f5-89e8-443749304d7e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:54.247674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-04f0e9b3-266d-4350-8745-92817af85092 req-a34afefb-6eb2-49f5-89e8-443749304d7e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:54.282658 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-04f0e9b3-266d-4350-8745-92817af85092 req-a34afefb-6eb2-49f5-89e8-443749304d7e service nova] Creating event network-vif-plugged:69d1487f-d7df-4113-8980-babffb74e9df for instance 8325ecc1-c663-4d65-81a3-ba46c2d5e692 on n-h2-854823-1 Aug 27 05:11:54.305170 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-04f0e9b3-266d-4350-8745-92817af85092 req-a34afefb-6eb2-49f5-89e8-443749304d7e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090588 Aug 27 05:11:54.306451 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3166/6280] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:54.563692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bf0ec7a8-0aa5-4ac4-81b1-8449416fbb4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:54.564580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bf0ec7a8-0aa5-4ac4-81b1-8449416fbb4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:54.581920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0ec7a8-0aa5-4ac4-81b1-8449416fbb4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:54.582810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0ec7a8-0aa5-4ac4-81b1-8449416fbb4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:54.589826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0ec7a8-0aa5-4ac4-81b1-8449416fbb4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:54.592981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0ec7a8-0aa5-4ac4-81b1-8449416fbb4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:54.597029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0ec7a8-0aa5-4ac4-81b1-8449416fbb4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:54.597737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bf0ec7a8-0aa5-4ac4-81b1-8449416fbb4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:54.683188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ae95e78-d4cf-479a-aa81-9d6e634a0d3b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:54.684275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ae95e78-d4cf-479a-aa81-9d6e634a0d3b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:54.699027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ae95e78-d4cf-479a-aa81-9d6e634a0d3b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:54.700777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ae95e78-d4cf-479a-aa81-9d6e634a0d3b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:54.700777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ae95e78-d4cf-479a-aa81-9d6e634a0d3b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:54.701457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ae95e78-d4cf-479a-aa81-9d6e634a0d3b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:54.701900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ae95e78-d4cf-479a-aa81-9d6e634a0d3b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:54.702505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ae95e78-d4cf-479a-aa81-9d6e634a0d3b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:55.006989 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ae95e78-d4cf-479a-aa81-9d6e634a0d3b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1464 microversion: 2.1 time: 0.328083 Aug 27 05:11:55.007610 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3167/6281] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:54 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1464 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:55.031944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3bae841c-5269-490c-b8ed-04ec3f5b60b6 req-0e6e3218-9ce1-46a4-b1b2-6b012cbed556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d762d84-c8ea-4836-994e-aa0b6104e079", "tag": "1b17c1aa-0dc0-4edb-8d9d-4fd4977d4fcf"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:55.044283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3bae841c-5269-490c-b8ed-04ec3f5b60b6 req-0e6e3218-9ce1-46a4-b1b2-6b012cbed556 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:55.045097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3bae841c-5269-490c-b8ed-04ec3f5b60b6 req-0e6e3218-9ce1-46a4-b1b2-6b012cbed556 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:55.045717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3bae841c-5269-490c-b8ed-04ec3f5b60b6 req-0e6e3218-9ce1-46a4-b1b2-6b012cbed556 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:55.080261 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3bae841c-5269-490c-b8ed-04ec3f5b60b6 req-0e6e3218-9ce1-46a4-b1b2-6b012cbed556 service nova] Creating event network-changed:1b17c1aa-0dc0-4edb-8d9d-4fd4977d4fcf for instance 3d762d84-c8ea-4836-994e-aa0b6104e079 on n-h2-854823-1 Aug 27 05:11:55.098543 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3bae841c-5269-490c-b8ed-04ec3f5b60b6 req-0e6e3218-9ce1-46a4-b1b2-6b012cbed556 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072313 Aug 27 05:11:55.110406 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3168/6282] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:55.129554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e2d93257-26d8-412c-8e16-61b9ed7d5276 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:55.141660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e2d93257-26d8-412c-8e16-61b9ed7d5276 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:55.149785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2d93257-26d8-412c-8e16-61b9ed7d5276 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:55.150770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2d93257-26d8-412c-8e16-61b9ed7d5276 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:55.151605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2d93257-26d8-412c-8e16-61b9ed7d5276 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:55.152495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2d93257-26d8-412c-8e16-61b9ed7d5276 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:55.153140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2d93257-26d8-412c-8e16-61b9ed7d5276 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:55.154052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2d93257-26d8-412c-8e16-61b9ed7d5276 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:55.192950 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e2d93257-26d8-412c-8e16-61b9ed7d5276 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081104 Aug 27 05:11:55.194367 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3169/6283] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:11:55 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:55.235005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bf0ec7a8-0aa5-4ac4-81b1-8449416fbb4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:55.243644 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bf0ec7a8-0aa5-4ac4-81b1-8449416fbb4b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 200 len: 1314 microversion: 2.1 time: 0.686338 Aug 27 05:11:55.244451 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3115/6284] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:54 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 1314 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:56.032251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bb5ed3dd-a06b-4c18-9c04-5810423225aa tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:56.033617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bb5ed3dd-a06b-4c18-9c04-5810423225aa tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:56.041842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb5ed3dd-a06b-4c18-9c04-5810423225aa tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:56.042550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb5ed3dd-a06b-4c18-9c04-5810423225aa tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:56.043237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb5ed3dd-a06b-4c18-9c04-5810423225aa tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:56.044130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb5ed3dd-a06b-4c18-9c04-5810423225aa tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:56.044802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb5ed3dd-a06b-4c18-9c04-5810423225aa tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:56.045433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb5ed3dd-a06b-4c18-9c04-5810423225aa tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:56.195099 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bb5ed3dd-a06b-4c18-9c04-5810423225aa tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1464 microversion: 2.1 time: 0.167617 Aug 27 05:11:56.212314 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3170/6285] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:56 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1464 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:56.215570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5d8ba974-4dbd-4680-90f8-39c369a5a400 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:56.217962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5d8ba974-4dbd-4680-90f8-39c369a5a400 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:56.225839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d8ba974-4dbd-4680-90f8-39c369a5a400 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:56.226540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d8ba974-4dbd-4680-90f8-39c369a5a400 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:56.227185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d8ba974-4dbd-4680-90f8-39c369a5a400 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:56.227904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d8ba974-4dbd-4680-90f8-39c369a5a400 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:56.228368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d8ba974-4dbd-4680-90f8-39c369a5a400 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:56.228822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d8ba974-4dbd-4680-90f8-39c369a5a400 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:56.267236 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5d8ba974-4dbd-4680-90f8-39c369a5a400 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062663 Aug 27 05:11:56.272144 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3116/6286] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:11:56 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:56.346209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4005571e-4837-4ba2-88b6-22e622d23fbd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:56.346981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4005571e-4837-4ba2-88b6-22e622d23fbd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:56.356840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4005571e-4837-4ba2-88b6-22e622d23fbd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:56.357376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4005571e-4837-4ba2-88b6-22e622d23fbd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:56.357838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4005571e-4837-4ba2-88b6-22e622d23fbd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:56.358670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4005571e-4837-4ba2-88b6-22e622d23fbd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:56.360396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4005571e-4837-4ba2-88b6-22e622d23fbd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:56.360893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4005571e-4837-4ba2-88b6-22e622d23fbd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:56.540495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4005571e-4837-4ba2-88b6-22e622d23fbd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:56.550760 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4005571e-4837-4ba2-88b6-22e622d23fbd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 200 len: 1501 microversion: 2.1 time: 0.285376 Aug 27 05:11:56.568510 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3171/6287] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:56 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 1501 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:56.575098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-32b08a35-51eb-4418-941c-39da3c15c4e2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:56.575813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-32b08a35-51eb-4418-941c-39da3c15c4e2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:56.586434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32b08a35-51eb-4418-941c-39da3c15c4e2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:56.587245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32b08a35-51eb-4418-941c-39da3c15c4e2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:56.588096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32b08a35-51eb-4418-941c-39da3c15c4e2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:56.589798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32b08a35-51eb-4418-941c-39da3c15c4e2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:56.594151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32b08a35-51eb-4418-941c-39da3c15c4e2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:56.595643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32b08a35-51eb-4418-941c-39da3c15c4e2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:56.759066 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.network.security_group_api [None req-32b08a35-51eb-4418-941c-39da3c15c4e2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Removing security group 8d5abbb9-01be-47fe-a418-213a176dfd4f from port 69d1487f-d7df-4113-8980-babffb74e9df Aug 27 05:11:57.169815 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-32b08a35-51eb-4418-941c-39da3c15c4e2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692/action" status: 202 len: 0 microversion: 2.1 time: 0.599588 Aug 27 05:11:57.171016 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3117/6288] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:11:56 2022] POST /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692/action => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:11:57.184116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e2e1c0ae-101d-4525-966d-c17ea9890d7d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:57.186664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e2e1c0ae-101d-4525-966d-c17ea9890d7d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:57.187758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-6ce2bb28-6e0a-40cc-a5cc-141603ac976e req-c01ce4ab-9a5c-4959-bdb4-841fa48c5d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8325ecc1-c663-4d65-81a3-ba46c2d5e692", "tag": "69d1487f-d7df-4113-8980-babffb74e9df"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:57.203657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2e1c0ae-101d-4525-966d-c17ea9890d7d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.204613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2e1c0ae-101d-4525-966d-c17ea9890d7d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.205207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2e1c0ae-101d-4525-966d-c17ea9890d7d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:57.205345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6ce2bb28-6e0a-40cc-a5cc-141603ac976e req-c01ce4ab-9a5c-4959-bdb4-841fa48c5d3b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.205737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6ce2bb28-6e0a-40cc-a5cc-141603ac976e req-c01ce4ab-9a5c-4959-bdb4-841fa48c5d3b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.206180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6ce2bb28-6e0a-40cc-a5cc-141603ac976e req-c01ce4ab-9a5c-4959-bdb4-841fa48c5d3b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:57.208936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2e1c0ae-101d-4525-966d-c17ea9890d7d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.209699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2e1c0ae-101d-4525-966d-c17ea9890d7d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.210527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2e1c0ae-101d-4525-966d-c17ea9890d7d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:57.230993 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-6ce2bb28-6e0a-40cc-a5cc-141603ac976e req-c01ce4ab-9a5c-4959-bdb4-841fa48c5d3b service nova] Creating event network-changed:69d1487f-d7df-4113-8980-babffb74e9df for instance 8325ecc1-c663-4d65-81a3-ba46c2d5e692 on n-h2-854823-1 Aug 27 05:11:57.238849 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-6ce2bb28-6e0a-40cc-a5cc-141603ac976e req-c01ce4ab-9a5c-4959-bdb4-841fa48c5d3b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055226 Aug 27 05:11:57.239480 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3118/6289] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:11:57.270150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-887ca601-6dbe-419e-abe4-4b6c2dbfd5e1 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:57.271006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-887ca601-6dbe-419e-abe4-4b6c2dbfd5e1 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:57.282064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-887ca601-6dbe-419e-abe4-4b6c2dbfd5e1 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.282809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-887ca601-6dbe-419e-abe4-4b6c2dbfd5e1 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.283399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-887ca601-6dbe-419e-abe4-4b6c2dbfd5e1 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:57.284390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-887ca601-6dbe-419e-abe4-4b6c2dbfd5e1 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.285046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-887ca601-6dbe-419e-abe4-4b6c2dbfd5e1 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.285648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-887ca601-6dbe-419e-abe4-4b6c2dbfd5e1 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:57.299648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:57.364462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e2e1c0ae-101d-4525-966d-c17ea9890d7d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:57.381327 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e2e1c0ae-101d-4525-966d-c17ea9890d7d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 200 len: 1459 microversion: 2.1 time: 0.205651 Aug 27 05:11:57.387239 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3172/6290] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:57 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 1459 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:57.399010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3bf6a448-0678-426b-b308-1c74d39e6456 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:57.417338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3bf6a448-0678-426b-b308-1c74d39e6456 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:57.431790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bf6a448-0678-426b-b308-1c74d39e6456 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.434389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bf6a448-0678-426b-b308-1c74d39e6456 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.435586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bf6a448-0678-426b-b308-1c74d39e6456 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:57.441687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bf6a448-0678-426b-b308-1c74d39e6456 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.442651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bf6a448-0678-426b-b308-1c74d39e6456 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.444110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bf6a448-0678-426b-b308-1c74d39e6456 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:57.519152 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3bf6a448-0678-426b-b308-1c74d39e6456 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130338 Aug 27 05:11:57.519982 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3173/6291] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:11:57 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:11:57.524778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a56f5426-d618-4be5-8965-9b670785ae66 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:57.525410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a56f5426-d618-4be5-8965-9b670785ae66 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:57.534019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56f5426-d618-4be5-8965-9b670785ae66 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.534570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56f5426-d618-4be5-8965-9b670785ae66 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.535426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56f5426-d618-4be5-8965-9b670785ae66 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:57.535758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56f5426-d618-4be5-8965-9b670785ae66 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.536240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56f5426-d618-4be5-8965-9b670785ae66 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.536722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56f5426-d618-4be5-8965-9b670785ae66 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:57.692626 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-887ca601-6dbe-419e-abe4-4b6c2dbfd5e1 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1464 microversion: 2.1 time: 0.447571 Aug 27 05:11:57.694415 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3119/6292] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:57 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1464 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:57.700600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-719a4c9b-3cbf-4f76-aaae-664497210e7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:57.701603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-719a4c9b-3cbf-4f76-aaae-664497210e7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:57.710470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-719a4c9b-3cbf-4f76-aaae-664497210e7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.711137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-719a4c9b-3cbf-4f76-aaae-664497210e7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.711908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-719a4c9b-3cbf-4f76-aaae-664497210e7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:57.712787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-719a4c9b-3cbf-4f76-aaae-664497210e7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.713484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-719a4c9b-3cbf-4f76-aaae-664497210e7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.714836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-719a4c9b-3cbf-4f76-aaae-664497210e7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:57.761621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-719a4c9b-3cbf-4f76-aaae-664497210e7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:11:57.866648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a56f5426-d618-4be5-8965-9b670785ae66 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:57.879234 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a56f5426-d618-4be5-8965-9b670785ae66 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.357969 Aug 27 05:11:57.879955 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3174/6293] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:57 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:57.916172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96838967-1df3-48fc-82f7-b3fc00f7e4d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:57.916839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-96838967-1df3-48fc-82f7-b3fc00f7e4d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:57.925003 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-719a4c9b-3cbf-4f76-aaae-664497210e7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 204 len: 0 microversion: 2.1 time: 0.225094 Aug 27 05:11:57.926818 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3120/6294] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:11:57 2022] DELETE /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:11:57.927830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96838967-1df3-48fc-82f7-b3fc00f7e4d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.928365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96838967-1df3-48fc-82f7-b3fc00f7e4d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.928860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96838967-1df3-48fc-82f7-b3fc00f7e4d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:57.932104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96838967-1df3-48fc-82f7-b3fc00f7e4d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.934077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96838967-1df3-48fc-82f7-b3fc00f7e4d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.934077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96838967-1df3-48fc-82f7-b3fc00f7e4d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:57.939937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1df6ed28-afcb-4e35-bc44-2b3f0daa8346 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:57.941170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1df6ed28-afcb-4e35-bc44-2b3f0daa8346 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:57.948718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1df6ed28-afcb-4e35-bc44-2b3f0daa8346 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.949462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1df6ed28-afcb-4e35-bc44-2b3f0daa8346 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.950125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1df6ed28-afcb-4e35-bc44-2b3f0daa8346 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:57.951507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1df6ed28-afcb-4e35-bc44-2b3f0daa8346 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:57.952229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1df6ed28-afcb-4e35-bc44-2b3f0daa8346 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:57.952918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1df6ed28-afcb-4e35-bc44-2b3f0daa8346 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:58.201775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1df6ed28-afcb-4e35-bc44-2b3f0daa8346 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:58.212907 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1df6ed28-afcb-4e35-bc44-2b3f0daa8346 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1680 microversion: 2.1 time: 0.279587 Aug 27 05:11:58.213862 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3121/6295] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:57 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1680 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:58.729876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7e311986-cbdb-4eea-8264-412ecde2f127 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:58.730787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7e311986-cbdb-4eea-8264-412ecde2f127 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:58.740304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e311986-cbdb-4eea-8264-412ecde2f127 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:58.740803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e311986-cbdb-4eea-8264-412ecde2f127 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:58.741248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e311986-cbdb-4eea-8264-412ecde2f127 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:58.742212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e311986-cbdb-4eea-8264-412ecde2f127 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:58.742902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e311986-cbdb-4eea-8264-412ecde2f127 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:58.743551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e311986-cbdb-4eea-8264-412ecde2f127 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:58.757864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-96838967-1df3-48fc-82f7-b3fc00f7e4d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:58.767511 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96838967-1df3-48fc-82f7-b3fc00f7e4d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.855427 Aug 27 05:11:58.768315 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3175/6296] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:57 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:58.788746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b440962b-f05d-4f78-ab65-f7413abcd5e9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:58.789617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b440962b-f05d-4f78-ab65-f7413abcd5e9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:58.798888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b440962b-f05d-4f78-ab65-f7413abcd5e9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:58.799713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b440962b-f05d-4f78-ab65-f7413abcd5e9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:58.800392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b440962b-f05d-4f78-ab65-f7413abcd5e9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:58.801341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b440962b-f05d-4f78-ab65-f7413abcd5e9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:58.802224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b440962b-f05d-4f78-ab65-f7413abcd5e9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:58.802983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b440962b-f05d-4f78-ab65-f7413abcd5e9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:58.906004 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7e311986-cbdb-4eea-8264-412ecde2f127 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1464 microversion: 2.1 time: 0.180973 Aug 27 05:11:58.917329 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3122/6297] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:58 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1464 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:58.955568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b440962b-f05d-4f78-ab65-f7413abcd5e9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:58.964898 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b440962b-f05d-4f78-ab65-f7413abcd5e9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.180107 Aug 27 05:11:58.965552 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3176/6298] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:58 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:11:58.989029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-769fcb0c-922d-440f-ba06-a4508a00cdb2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:58.990549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-769fcb0c-922d-440f-ba06-a4508a00cdb2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:59.000647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-769fcb0c-922d-440f-ba06-a4508a00cdb2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:59.001123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-769fcb0c-922d-440f-ba06-a4508a00cdb2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:59.001559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-769fcb0c-922d-440f-ba06-a4508a00cdb2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:59.002645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-769fcb0c-922d-440f-ba06-a4508a00cdb2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:59.002751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-769fcb0c-922d-440f-ba06-a4508a00cdb2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:59.003221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-769fcb0c-922d-440f-ba06-a4508a00cdb2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:59.206766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-769fcb0c-922d-440f-ba06-a4508a00cdb2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:59.216203 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-769fcb0c-922d-440f-ba06-a4508a00cdb2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.234561 Aug 27 05:11:59.216832 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3123/6299] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:58 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:59.238742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6096177e-d599-4881-b25c-8ed6b57696c8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:59.239115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6096177e-d599-4881-b25c-8ed6b57696c8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:59.247219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6096177e-d599-4881-b25c-8ed6b57696c8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:59.247961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6096177e-d599-4881-b25c-8ed6b57696c8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:59.248409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6096177e-d599-4881-b25c-8ed6b57696c8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:59.249152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6096177e-d599-4881-b25c-8ed6b57696c8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:59.250297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6096177e-d599-4881-b25c-8ed6b57696c8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:59.250738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6096177e-d599-4881-b25c-8ed6b57696c8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:59.278676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-88276168", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "3b8ed832-ef0e-4e8a-a972-17542970b368"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:11:59.338594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] validate_networks() for [('3b8ed832-ef0e-4e8a-a972-17542970b368', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:11:59.396579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6096177e-d599-4881-b25c-8ed6b57696c8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:11:59.405224 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6096177e-d599-4881-b25c-8ed6b57696c8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1680 microversion: 2.1 time: 0.170986 Aug 27 05:11:59.406052 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3177/6300] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:59 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:11:59.712645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:59.741898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:11:59.743445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:11:59.744132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:11:59.744790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:11:59.745413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:11:59.750091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=12 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:59.763258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:59.764244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:59.765668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:59.766647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:59.767331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:59.768093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:59.803520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Getting quotas for project 631787d4099e4245be9291f39ff6b2bd. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:11:59.809163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Getting quotas for user c77d065776e448f08f0a1d6fde1aff3c and project 631787d4099e4245be9291f39ff6b2bd. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:11:59.813482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:59.825438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:11:59.828331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:11:59.887893 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a7457dfd-899e-402b-9ba0-9924a13d5657 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612850 Aug 27 05:11:59.889255 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3124/6301] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:11:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:11:59.900570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-454256b5-9565-4330-88f6-8f7b0821492e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:59.901807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-454256b5-9565-4330-88f6-8f7b0821492e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:59.904154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:59.927199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-02e1ebba-71ff-47b5-873e-0c055295fb37 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:11:59.928542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-02e1ebba-71ff-47b5-873e-0c055295fb37 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:11:59.955245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02e1ebba-71ff-47b5-873e-0c055295fb37 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:59.955471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02e1ebba-71ff-47b5-873e-0c055295fb37 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:59.955813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02e1ebba-71ff-47b5-873e-0c055295fb37 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:11:59.964880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02e1ebba-71ff-47b5-873e-0c055295fb37 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:11:59.965896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02e1ebba-71ff-47b5-873e-0c055295fb37 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:11:59.965896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02e1ebba-71ff-47b5-873e-0c055295fb37 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:00.077126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-454256b5-9565-4330-88f6-8f7b0821492e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:00.086814 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-454256b5-9565-4330-88f6-8f7b0821492e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1213 microversion: 2.1 time: 0.188082 Aug 27 05:12:00.087963 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3178/6302] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:59 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1213 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:00.212607 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-02e1ebba-71ff-47b5-873e-0c055295fb37 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1464 microversion: 2.1 time: 0.289107 Aug 27 05:12:00.213554 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3125/6303] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:11:59 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1464 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:00.342188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0fd0e6c4-986e-41f0-96dc-da14007a233c req-eeb1ef88-7c7a-427b-8ecd-4fb3c1335162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d762d84-c8ea-4836-994e-aa0b6104e079", "name": "network-vif-plugged", "status": "completed", "tag": "1b17c1aa-0dc0-4edb-8d9d-4fd4977d4fcf"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:00.369238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0fd0e6c4-986e-41f0-96dc-da14007a233c req-eeb1ef88-7c7a-427b-8ecd-4fb3c1335162 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:00.370018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0fd0e6c4-986e-41f0-96dc-da14007a233c req-eeb1ef88-7c7a-427b-8ecd-4fb3c1335162 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:00.370952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0fd0e6c4-986e-41f0-96dc-da14007a233c req-eeb1ef88-7c7a-427b-8ecd-4fb3c1335162 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:00.386506 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0fd0e6c4-986e-41f0-96dc-da14007a233c req-eeb1ef88-7c7a-427b-8ecd-4fb3c1335162 service nova] Creating event network-vif-plugged:1b17c1aa-0dc0-4edb-8d9d-4fd4977d4fcf for instance 3d762d84-c8ea-4836-994e-aa0b6104e079 on n-h2-854823-1 Aug 27 05:12:00.399197 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0fd0e6c4-986e-41f0-96dc-da14007a233c req-eeb1ef88-7c7a-427b-8ecd-4fb3c1335162 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065552 Aug 27 05:12:00.400451 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3179/6304] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:00.438578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-19c266de-7676-41f7-ae46-82682f4cd510 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:00.439719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-19c266de-7676-41f7-ae46-82682f4cd510 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:00.453346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19c266de-7676-41f7-ae46-82682f4cd510 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:00.454361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19c266de-7676-41f7-ae46-82682f4cd510 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:00.455140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19c266de-7676-41f7-ae46-82682f4cd510 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:00.456232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19c266de-7676-41f7-ae46-82682f4cd510 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:00.456982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19c266de-7676-41f7-ae46-82682f4cd510 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:00.457640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19c266de-7676-41f7-ae46-82682f4cd510 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:00.676464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-19c266de-7676-41f7-ae46-82682f4cd510 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:00.693471 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-19c266de-7676-41f7-ae46-82682f4cd510 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1680 microversion: 2.1 time: 0.269991 Aug 27 05:12:00.695084 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3126/6305] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:00 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1680 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:01.109462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-08048870-00f0-42a1-a394-8f79c4f8fa6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:01.110466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-08048870-00f0-42a1-a394-8f79c4f8fa6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:01.119701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08048870-00f0-42a1-a394-8f79c4f8fa6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:01.120509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08048870-00f0-42a1-a394-8f79c4f8fa6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:01.121505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08048870-00f0-42a1-a394-8f79c4f8fa6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:01.122296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08048870-00f0-42a1-a394-8f79c4f8fa6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:01.122832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08048870-00f0-42a1-a394-8f79c4f8fa6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:01.123340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08048870-00f0-42a1-a394-8f79c4f8fa6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:01.235745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7a346a74-bbbf-4605-8dda-f1cc6ea285b0 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:01.237233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7a346a74-bbbf-4605-8dda-f1cc6ea285b0 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:01.238537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-08048870-00f0-42a1-a394-8f79c4f8fa6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:01.246004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a346a74-bbbf-4605-8dda-f1cc6ea285b0 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:01.247970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a346a74-bbbf-4605-8dda-f1cc6ea285b0 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:01.248850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a346a74-bbbf-4605-8dda-f1cc6ea285b0 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:01.250730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a346a74-bbbf-4605-8dda-f1cc6ea285b0 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:01.252042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a346a74-bbbf-4605-8dda-f1cc6ea285b0 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:01.252620 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-08048870-00f0-42a1-a394-8f79c4f8fa6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1265 microversion: 2.1 time: 0.147765 Aug 27 05:12:01.252999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a346a74-bbbf-4605-8dda-f1cc6ea285b0 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:01.265956 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3180/6306] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:01 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:01.452221 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7a346a74-bbbf-4605-8dda-f1cc6ea285b0 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1464 microversion: 2.1 time: 0.221104 Aug 27 05:12:01.452960 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3127/6307] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:01 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1464 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:01.717047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c4d38a5-f3a8-40ac-b208-b11efd2a58f9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:01.718125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c4d38a5-f3a8-40ac-b208-b11efd2a58f9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:01.727393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d38a5-f3a8-40ac-b208-b11efd2a58f9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:01.728594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d38a5-f3a8-40ac-b208-b11efd2a58f9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:01.729295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d38a5-f3a8-40ac-b208-b11efd2a58f9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:01.730622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d38a5-f3a8-40ac-b208-b11efd2a58f9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:01.731849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d38a5-f3a8-40ac-b208-b11efd2a58f9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:01.732445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d38a5-f3a8-40ac-b208-b11efd2a58f9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:01.746921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-0cb6d859-a705-4696-9090-2a1d82366727 req-fbcca1cc-a01d-43b0-bf2a-d84a4c1dad05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fdabdb-6353-46ce-9239-bc41ad53212e", "name": "network-vif-deleted", "tag": "c9df8fc7-dcb3-4177-af25-45f0708c8a3b"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:01.771940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0cb6d859-a705-4696-9090-2a1d82366727 req-fbcca1cc-a01d-43b0-bf2a-d84a4c1dad05 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:01.772861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0cb6d859-a705-4696-9090-2a1d82366727 req-fbcca1cc-a01d-43b0-bf2a-d84a4c1dad05 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:01.773626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0cb6d859-a705-4696-9090-2a1d82366727 req-fbcca1cc-a01d-43b0-bf2a-d84a4c1dad05 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:01.791987 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-0cb6d859-a705-4696-9090-2a1d82366727 req-fbcca1cc-a01d-43b0-bf2a-d84a4c1dad05 service nova] Creating event network-vif-deleted:c9df8fc7-dcb3-4177-af25-45f0708c8a3b for instance d1fdabdb-6353-46ce-9239-bc41ad53212e on n-h1-854823-1 Aug 27 05:12:01.799168 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-0cb6d859-a705-4696-9090-2a1d82366727 req-fbcca1cc-a01d-43b0-bf2a-d84a4c1dad05 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056462 Aug 27 05:12:01.800330 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3128/6308] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:01.909570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c4d38a5-f3a8-40ac-b208-b11efd2a58f9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:01.918167 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c4d38a5-f3a8-40ac-b208-b11efd2a58f9 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 200 len: 1612 microversion: 2.1 time: 0.205708 Aug 27 05:12:01.918771 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3181/6309] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:01 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 1612 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:02.009079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-30929c7a-85fb-4bc2-b64a-61e7a13b30fb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:02.009721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-30929c7a-85fb-4bc2-b64a-61e7a13b30fb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:02.028752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30929c7a-85fb-4bc2-b64a-61e7a13b30fb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.029002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30929c7a-85fb-4bc2-b64a-61e7a13b30fb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.029244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30929c7a-85fb-4bc2-b64a-61e7a13b30fb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.035594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30929c7a-85fb-4bc2-b64a-61e7a13b30fb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.036082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30929c7a-85fb-4bc2-b64a-61e7a13b30fb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.036520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-30929c7a-85fb-4bc2-b64a-61e7a13b30fb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.143222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-30929c7a-85fb-4bc2-b64a-61e7a13b30fb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:12:02.282287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45fbba2f-f6c7-4fb9-a7e4-b6c9268ecb70 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:02.286599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-45fbba2f-f6c7-4fb9-a7e4-b6c9268ecb70 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:02.312442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fbba2f-f6c7-4fb9-a7e4-b6c9268ecb70 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.316211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fbba2f-f6c7-4fb9-a7e4-b6c9268ecb70 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.319518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fbba2f-f6c7-4fb9-a7e4-b6c9268ecb70 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.320521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fbba2f-f6c7-4fb9-a7e4-b6c9268ecb70 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.324403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fbba2f-f6c7-4fb9-a7e4-b6c9268ecb70 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.325328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fbba2f-f6c7-4fb9-a7e4-b6c9268ecb70 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.395082 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-30929c7a-85fb-4bc2-b64a-61e7a13b30fb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 204 len: 0 microversion: 2.1 time: 0.390400 Aug 27 05:12:02.399902 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3129/6310] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:12:02 2022] DELETE /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:12:02.405427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-913f9a98-60bf-43f3-93da-430e3c9da4bb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:02.406285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-913f9a98-60bf-43f3-93da-430e3c9da4bb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:02.424124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-913f9a98-60bf-43f3-93da-430e3c9da4bb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.425045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-913f9a98-60bf-43f3-93da-430e3c9da4bb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.425709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-913f9a98-60bf-43f3-93da-430e3c9da4bb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.426668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-913f9a98-60bf-43f3-93da-430e3c9da4bb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.427344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-913f9a98-60bf-43f3-93da-430e3c9da4bb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.428040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-913f9a98-60bf-43f3-93da-430e3c9da4bb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.474818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-45fbba2f-f6c7-4fb9-a7e4-b6c9268ecb70 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:02.490438 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45fbba2f-f6c7-4fb9-a7e4-b6c9268ecb70 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1271 microversion: 2.1 time: 0.220426 Aug 27 05:12:02.491283 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3182/6311] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:02 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:02.504752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f213836a-e14b-40fb-bb78-f0d6f523ebae tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:02.505203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f213836a-e14b-40fb-bb78-f0d6f523ebae tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:02.522489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f213836a-e14b-40fb-bb78-f0d6f523ebae tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.525193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f213836a-e14b-40fb-bb78-f0d6f523ebae tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.525729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f213836a-e14b-40fb-bb78-f0d6f523ebae tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.528833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f213836a-e14b-40fb-bb78-f0d6f523ebae tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.529389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f213836a-e14b-40fb-bb78-f0d6f523ebae tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.529972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f213836a-e14b-40fb-bb78-f0d6f523ebae tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.629771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-913f9a98-60bf-43f3-93da-430e3c9da4bb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:02.639130 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-913f9a98-60bf-43f3-93da-430e3c9da4bb tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1577 microversion: 2.1 time: 0.238138 Aug 27 05:12:02.639948 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3130/6312] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:02 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1577 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:02.869441 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f213836a-e14b-40fb-bb78-f0d6f523ebae tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1649 microversion: 2.1 time: 0.375509 Aug 27 05:12:02.870041 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3183/6313] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:02 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1649 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:02.890156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ad26e419-4d67-4623-b1df-eed510525aab tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:02.891123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ad26e419-4d67-4623-b1df-eed510525aab tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:02.898129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad26e419-4d67-4623-b1df-eed510525aab tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.905350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad26e419-4d67-4623-b1df-eed510525aab tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.906630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad26e419-4d67-4623-b1df-eed510525aab tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.907884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad26e419-4d67-4623-b1df-eed510525aab tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.908429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad26e419-4d67-4623-b1df-eed510525aab tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.908958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad26e419-4d67-4623-b1df-eed510525aab tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.940611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf28152a-6b7a-4308-80f0-c479bf346851 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:02.941600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf28152a-6b7a-4308-80f0-c479bf346851 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:02.951939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf28152a-6b7a-4308-80f0-c479bf346851 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.956192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf28152a-6b7a-4308-80f0-c479bf346851 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.957163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf28152a-6b7a-4308-80f0-c479bf346851 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:02.958135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf28152a-6b7a-4308-80f0-c479bf346851 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:02.958826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf28152a-6b7a-4308-80f0-c479bf346851 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:02.960681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf28152a-6b7a-4308-80f0-c479bf346851 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:03.002140 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-cf28152a-6b7a-4308-80f0-c479bf346851 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] HTTP exception thrown: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf28152a-6b7a-4308-80f0-c479bf346851 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Request method failure captured: Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e HTTP/1.1 Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaaigp07zvkISHb29u2Quk6NjhbfN1zEDCSkQQoinW0uynW7tNECIjPZRDz_K75qhqu2Icv_5PRsBA8URuVfOgE2knALTSJ-lxCAlMfLfMaApUY2YZNmhuhErGrmBQkx_kPARWtJeBImZcDnJdIllkJtA8jOXs3vwkeuSJPXsJdeNoo Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: dc1b938c06bd432496e8ae8b24965678 Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'd1fdabdb-6353-46ce-9239-bc41ad53212e'} Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:03.004254 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:03.008973 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:03.008973 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:03.008973 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:03.008973 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:03.008973 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:03.008973 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:12:03.008973 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:03.010799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf28152a-6b7a-4308-80f0-c479bf346851 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Returning 404 to user: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:03.012026 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf28152a-6b7a-4308-80f0-c479bf346851 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 404 len: 111 microversion: 2.1 time: 0.076508 Aug 27 05:12:03.016990 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3184/6314] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:02 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:12:03.023841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82428ae8-c97a-4ae2-accd-ab55a1e65385 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '.version_select at 0x7f1f2209b670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:03.067349 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-82428ae8-c97a-4ae2-accd-ab55a1e65385 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-717512700" status: 202 len: 0 microversion: 2.1 time: 0.048934 Aug 27 05:12:03.072811 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3185/6315] 10.222.0.79 () {58 vars in 1218 bytes} [Sat Aug 27 05:12:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-717512700 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:12:03.194626 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ad26e419-4d67-4623-b1df-eed510525aab tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1649 microversion: 2.1 time: 0.307967 Aug 27 05:12:03.196084 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3131/6316] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:02 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1649 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:03.218078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b81d4fb-a53a-44e6-8f74-f27a791c1df2 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:03.219961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b81d4fb-a53a-44e6-8f74-f27a791c1df2 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:03.231306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b81d4fb-a53a-44e6-8f74-f27a791c1df2 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:03.232141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b81d4fb-a53a-44e6-8f74-f27a791c1df2 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:03.232788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b81d4fb-a53a-44e6-8f74-f27a791c1df2 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:03.234891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b81d4fb-a53a-44e6-8f74-f27a791c1df2 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:03.236951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b81d4fb-a53a-44e6-8f74-f27a791c1df2 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:03.237600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b81d4fb-a53a-44e6-8f74-f27a791c1df2 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:03.282302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:03.513280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-152e7331-e753-4d95-b753-9b7adee4d861 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:03.517371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-152e7331-e753-4d95-b753-9b7adee4d861 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:03.524959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-152e7331-e753-4d95-b753-9b7adee4d861 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:03.525456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-152e7331-e753-4d95-b753-9b7adee4d861 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:03.526375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-152e7331-e753-4d95-b753-9b7adee4d861 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:03.527099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-152e7331-e753-4d95-b753-9b7adee4d861 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:03.527878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-152e7331-e753-4d95-b753-9b7adee4d861 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:03.528470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-152e7331-e753-4d95-b753-9b7adee4d861 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:03.813023 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b81d4fb-a53a-44e6-8f74-f27a791c1df2 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1649 microversion: 2.1 time: 0.599062 Aug 27 05:12:03.840752 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3186/6317] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:03 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1649 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:03.856221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb34f764-307c-43b0-bb7a-29e34f2c5430 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:03.869119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb34f764-307c-43b0-bb7a-29e34f2c5430 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:03.880284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb34f764-307c-43b0-bb7a-29e34f2c5430 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:03.881361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb34f764-307c-43b0-bb7a-29e34f2c5430 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:03.882176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb34f764-307c-43b0-bb7a-29e34f2c5430 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:03.883827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb34f764-307c-43b0-bb7a-29e34f2c5430 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:03.885547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb34f764-307c-43b0-bb7a-29e34f2c5430 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:03.886467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb34f764-307c-43b0-bb7a-29e34f2c5430 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:04.100034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-152e7331-e753-4d95-b753-9b7adee4d861 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:04.113936 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-152e7331-e753-4d95-b753-9b7adee4d861 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1313 microversion: 2.1 time: 0.605694 Aug 27 05:12:04.128376 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3132/6318] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:03 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:04.133693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e9ee4d2e-42db-4339-9968-aa27d2fc7d46 req-96c171b7-fa3a-4c8c-a3b2-aab8a7de6b6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee5152a-fc8b-4030-8124-ba770b583613", "tag": "c98f302a-c0c6-4949-83df-8de3742feedd"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:04.143960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e9ee4d2e-42db-4339-9968-aa27d2fc7d46 req-96c171b7-fa3a-4c8c-a3b2-aab8a7de6b6a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:04.144958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e9ee4d2e-42db-4339-9968-aa27d2fc7d46 req-96c171b7-fa3a-4c8c-a3b2-aab8a7de6b6a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:04.145657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e9ee4d2e-42db-4339-9968-aa27d2fc7d46 req-96c171b7-fa3a-4c8c-a3b2-aab8a7de6b6a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:04.160492 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e9ee4d2e-42db-4339-9968-aa27d2fc7d46 req-96c171b7-fa3a-4c8c-a3b2-aab8a7de6b6a service nova] Creating event network-changed:c98f302a-c0c6-4949-83df-8de3742feedd for instance 9ee5152a-fc8b-4030-8124-ba770b583613 on n-h2-854823-1 Aug 27 05:12:04.166306 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e9ee4d2e-42db-4339-9968-aa27d2fc7d46 req-96c171b7-fa3a-4c8c-a3b2-aab8a7de6b6a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036285 Aug 27 05:12:04.167125 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3133/6319] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:04.172967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2080286164", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "availability_zone": "nova:n-h1-854823-1", "networks": [{"uuid": "11ecf8b7-d620-4685-862d-8c77bc01caf7"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:04.251273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] validate_networks() for [('11ecf8b7-d620-4685-862d-8c77bc01caf7', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:12:04.809636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eb34f764-307c-43b0-bb7a-29e34f2c5430 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:04.818224 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb34f764-307c-43b0-bb7a-29e34f2c5430 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1577 microversion: 2.1 time: 0.975424 Aug 27 05:12:04.824074 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3187/6320] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:03 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1577 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:05.010956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c760ac93-b3dc-40a3-bb25-1a89525cfab3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Action: 'create', calling method: .version_select at 0x7f1f20e614c0>, body: {"keypair": {"name": "tempest-keypair-552894400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW/nDjVyfiumfZbonBHaOZQYkNqtNrxo7vtD72amuPZs1MEZDy383dwjEEbWOrNmCjBzpMiCXi1NhNnHAF51qHaUwNHkH+08G6oXGdHTjBbsVIp0ATm1h9Q1X1+HWSFvA=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:05.049387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c760ac93-b3dc-40a3-bb25-1a89525cfab3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:05.056120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c760ac93-b3dc-40a3-bb25-1a89525cfab3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for user dc1b938c06bd432496e8ae8b24965678 and project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:05.059266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:05.096542 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c760ac93-b3dc-40a3-bb25-1a89525cfab3 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.096771 Aug 27 05:12:05.099761 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3188/6321] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:12:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:05.138378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f113a29e-93be-4095-92cd-0cacc681fe4e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:05.139211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f113a29e-93be-4095-92cd-0cacc681fe4e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:05.152782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f113a29e-93be-4095-92cd-0cacc681fe4e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:05.155026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f113a29e-93be-4095-92cd-0cacc681fe4e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:05.155727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f113a29e-93be-4095-92cd-0cacc681fe4e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:05.158854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f113a29e-93be-4095-92cd-0cacc681fe4e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:05.159523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f113a29e-93be-4095-92cd-0cacc681fe4e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:05.161604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f113a29e-93be-4095-92cd-0cacc681fe4e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:05.323145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:12:05.323702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:12:05.323945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:12:05.324363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:12:05.324821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:12:05.342807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:05.343755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:05.344412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:05.346456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:05.351417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:05.352098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:05.397195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Getting quotas for project 3273e40cb2c1441a88189118fba1afc2. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:05.417248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Getting quotas for user 4d456f673d624515befe6cf676622ed7 and project 3273e40cb2c1441a88189118fba1afc2. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:05.460447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:12:05.466646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:12:05.562968 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-621cf0dc-24ce-47ff-9396-112ff356c811 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.394380 Aug 27 05:12:05.563778 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3134/6322] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:12:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:12:05.584831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8e269e1d-f17e-4883-b74c-4e67933c6901 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:05.585465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8e269e1d-f17e-4883-b74c-4e67933c6901 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:05.746018 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8e269e1d-f17e-4883-b74c-4e67933c6901 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1329 microversion: 2.1 time: 0.164952 Aug 27 05:12:05.751041 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3135/6323] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:05 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1329 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:05.788181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f113a29e-93be-4095-92cd-0cacc681fe4e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:05.805125 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f113a29e-93be-4095-92cd-0cacc681fe4e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1313 microversion: 2.1 time: 0.668528 Aug 27 05:12:05.805821 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3189/6324] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:05 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1313 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:05.848286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-522d3511-323b-4b65-a0d6-a909610a4d4c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:05.871722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-522d3511-323b-4b65-a0d6-a909610a4d4c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:05.873113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-522d3511-323b-4b65-a0d6-a909610a4d4c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:05.873616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-522d3511-323b-4b65-a0d6-a909610a4d4c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:05.874430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-522d3511-323b-4b65-a0d6-a909610a4d4c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:05.875371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-522d3511-323b-4b65-a0d6-a909610a4d4c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:05.875603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-522d3511-323b-4b65-a0d6-a909610a4d4c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:05.876070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-522d3511-323b-4b65-a0d6-a909610a4d4c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:05.882935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:05.990615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-522d3511-323b-4b65-a0d6-a909610a4d4c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:06.015828 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-522d3511-323b-4b65-a0d6-a909610a4d4c tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1391 microversion: 2.1 time: 0.169507 Aug 27 05:12:06.016468 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3136/6325] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:05 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:06.426988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-35403533-1548-478d-a896-a76fe6001ee8 req-fd07b074-0a2c-4f2b-9246-2e94a4205b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f9bd9b-ec72-448f-98aa-b22068f937f7", "tag": "b7db674b-4f43-4293-83ee-29b5dc589d90"}, {"server_uuid": "9ee5152a-fc8b-4030-8124-ba770b583613", "name": "network-vif-deleted", "tag": "c98f302a-c0c6-4949-83df-8de3742feedd"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:06.440329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-35403533-1548-478d-a896-a76fe6001ee8 req-fd07b074-0a2c-4f2b-9246-2e94a4205b59 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:06.441511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-35403533-1548-478d-a896-a76fe6001ee8 req-fd07b074-0a2c-4f2b-9246-2e94a4205b59 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:06.442188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-35403533-1548-478d-a896-a76fe6001ee8 req-fd07b074-0a2c-4f2b-9246-2e94a4205b59 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:06.457525 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-35403533-1548-478d-a896-a76fe6001ee8 req-fd07b074-0a2c-4f2b-9246-2e94a4205b59 service nova] Creating event network-changed:b7db674b-4f43-4293-83ee-29b5dc589d90 for instance 69f9bd9b-ec72-448f-98aa-b22068f937f7 on n-h1-854823-1 Aug 27 05:12:06.458755 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-35403533-1548-478d-a896-a76fe6001ee8 req-fd07b074-0a2c-4f2b-9246-2e94a4205b59 service nova] Creating event network-vif-deleted:c98f302a-c0c6-4949-83df-8de3742feedd for instance 9ee5152a-fc8b-4030-8124-ba770b583613 on n-h2-854823-1 Aug 27 05:12:06.485270 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-35403533-1548-478d-a896-a76fe6001ee8 req-fd07b074-0a2c-4f2b-9246-2e94a4205b59 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.066160 Aug 27 05:12:06.486412 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3190/6326] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:12:06.777340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3321ae9f-8c32-480a-b1b3-9904b28848f5 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:06.779608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3321ae9f-8c32-480a-b1b3-9904b28848f5 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:06.790996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3321ae9f-8c32-480a-b1b3-9904b28848f5 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:06.792849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3321ae9f-8c32-480a-b1b3-9904b28848f5 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:06.794073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3321ae9f-8c32-480a-b1b3-9904b28848f5 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:06.795125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3321ae9f-8c32-480a-b1b3-9904b28848f5 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:06.796074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3321ae9f-8c32-480a-b1b3-9904b28848f5 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:06.796756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3321ae9f-8c32-480a-b1b3-9904b28848f5 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:06.829361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d10c1a97-ecf0-45e9-9954-d06d3b618827 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:06.830806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d10c1a97-ecf0-45e9-9954-d06d3b618827 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:06.853084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10c1a97-ecf0-45e9-9954-d06d3b618827 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:06.854928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10c1a97-ecf0-45e9-9954-d06d3b618827 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:06.857403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10c1a97-ecf0-45e9-9954-d06d3b618827 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:06.860800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10c1a97-ecf0-45e9-9954-d06d3b618827 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:06.862669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10c1a97-ecf0-45e9-9954-d06d3b618827 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:06.864674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10c1a97-ecf0-45e9-9954-d06d3b618827 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:06.980921 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3321ae9f-8c32-480a-b1b3-9904b28848f5 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1416 microversion: 2.1 time: 0.208549 Aug 27 05:12:06.984036 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3137/6327] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:06 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1416 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:07.037122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a8ba659d-ab42-4f6a-94f3-bc26b2283048 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:07.039232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a8ba659d-ab42-4f6a-94f3-bc26b2283048 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:07.046439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8ba659d-ab42-4f6a-94f3-bc26b2283048 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:07.047788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8ba659d-ab42-4f6a-94f3-bc26b2283048 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:07.048410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8ba659d-ab42-4f6a-94f3-bc26b2283048 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:07.049351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8ba659d-ab42-4f6a-94f3-bc26b2283048 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:07.049974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8ba659d-ab42-4f6a-94f3-bc26b2283048 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:07.051417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8ba659d-ab42-4f6a-94f3-bc26b2283048 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:07.139721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a8ba659d-ab42-4f6a-94f3-bc26b2283048 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:07.153752 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a8ba659d-ab42-4f6a-94f3-bc26b2283048 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1225 microversion: 2.1 time: 0.120365 Aug 27 05:12:07.154505 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3138/6328] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:07 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:07.245850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d10c1a97-ecf0-45e9-9954-d06d3b618827 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:07.256942 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d10c1a97-ecf0-45e9-9954-d06d3b618827 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1313 microversion: 2.1 time: 0.434493 Aug 27 05:12:07.271970 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3191/6329] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:06 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:07.993097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1415590301", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d0ae2b2-26fa-4f3d-bb3c-eb9fbaada560"}], "security_groups": [{"name": "tempest-securitygroup--1458555700"}], "key_name": "tempest-keypair-552894400", "user_data": "}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:08.005743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70a849e2-1ae7-4f5f-970b-9640be8d9f89 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:08.007307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-70a849e2-1ae7-4f5f-970b-9640be8d9f89 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:08.021235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70a849e2-1ae7-4f5f-970b-9640be8d9f89 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:08.022054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70a849e2-1ae7-4f5f-970b-9640be8d9f89 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:08.022692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70a849e2-1ae7-4f5f-970b-9640be8d9f89 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:08.028791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70a849e2-1ae7-4f5f-970b-9640be8d9f89 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:08.029309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70a849e2-1ae7-4f5f-970b-9640be8d9f89 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:08.029773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70a849e2-1ae7-4f5f-970b-9640be8d9f89 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:08.135194 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-70a849e2-1ae7-4f5f-970b-9640be8d9f89 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1416 microversion: 2.1 time: 0.133161 Aug 27 05:12:08.137015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] validate_networks() for [('1d0ae2b2-26fa-4f3d-bb3c-eb9fbaada560', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:12:08.141156 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3192/6330] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:08 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1416 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:08.175732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9c1cd73-68e2-4751-aae3-72b2f044fc7a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:08.176919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e9c1cd73-68e2-4751-aae3-72b2f044fc7a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:08.193371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9c1cd73-68e2-4751-aae3-72b2f044fc7a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:08.194646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9c1cd73-68e2-4751-aae3-72b2f044fc7a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:08.195296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9c1cd73-68e2-4751-aae3-72b2f044fc7a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:08.196238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9c1cd73-68e2-4751-aae3-72b2f044fc7a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:08.213424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9c1cd73-68e2-4751-aae3-72b2f044fc7a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:08.214356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9c1cd73-68e2-4751-aae3-72b2f044fc7a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:08.295382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e9c1cd73-68e2-4751-aae3-72b2f044fc7a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:08.305842 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9c1cd73-68e2-4751-aae3-72b2f044fc7a tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1225 microversion: 2.1 time: 0.133975 Aug 27 05:12:08.307040 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3193/6331] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:08 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1225 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:08.312947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0adb13c7-c106-4e7e-80a1-f46cf6ad826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:08.313816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0adb13c7-c106-4e7e-80a1-f46cf6ad826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:08.320933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0adb13c7-c106-4e7e-80a1-f46cf6ad826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:08.321886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0adb13c7-c106-4e7e-80a1-f46cf6ad826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:08.322502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0adb13c7-c106-4e7e-80a1-f46cf6ad826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:08.323421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0adb13c7-c106-4e7e-80a1-f46cf6ad826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:08.324066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0adb13c7-c106-4e7e-80a1-f46cf6ad826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:08.324760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0adb13c7-c106-4e7e-80a1-f46cf6ad826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:08.497314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0adb13c7-c106-4e7e-80a1-f46cf6ad826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:08.507482 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0adb13c7-c106-4e7e-80a1-f46cf6ad826f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1313 microversion: 2.1 time: 0.199139 Aug 27 05:12:08.527847 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3194/6332] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:08 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:09.084068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:12:09.085039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:12:09.085756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:12:09.086489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:12:09.087074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:12:09.096221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:09.097694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:09.098307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:09.099221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:09.100011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:09.100650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:09.119640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:12:09.126677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for user dc1b938c06bd432496e8ae8b24965678 and project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:12:09.141564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:12:09.143893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:12:09.165954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8b91987-65c4-4421-9197-56515a2e0749 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:09.167817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8b91987-65c4-4421-9197-56515a2e0749 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:09.176640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b91987-65c4-4421-9197-56515a2e0749 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:09.178035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b91987-65c4-4421-9197-56515a2e0749 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:09.178749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b91987-65c4-4421-9197-56515a2e0749 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:09.179861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b91987-65c4-4421-9197-56515a2e0749 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:09.180558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b91987-65c4-4421-9197-56515a2e0749 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:09.181274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b91987-65c4-4421-9197-56515a2e0749 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:09.210830 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-59ba13b8-4417-48ce-9d3b-da654028c13f tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.223023 Aug 27 05:12:09.211823 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3139/6333] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:12:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:12:09.224213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e5c29756-4f17-47ff-bf98-183177db3c03 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:09.225127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e5c29756-4f17-47ff-bf98-183177db3c03 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:09.303936 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8b91987-65c4-4421-9197-56515a2e0749 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1416 microversion: 2.1 time: 0.141200 Aug 27 05:12:09.305155 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3195/6334] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:09 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1416 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:09.331635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-becbfdcd-524e-4d79-aab3-0d2f97697af6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:09.332843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-becbfdcd-524e-4d79-aab3-0d2f97697af6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:09.343199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-becbfdcd-524e-4d79-aab3-0d2f97697af6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:09.343891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-becbfdcd-524e-4d79-aab3-0d2f97697af6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:09.344504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-becbfdcd-524e-4d79-aab3-0d2f97697af6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:09.345457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-becbfdcd-524e-4d79-aab3-0d2f97697af6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:09.346092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-becbfdcd-524e-4d79-aab3-0d2f97697af6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:09.347163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-becbfdcd-524e-4d79-aab3-0d2f97697af6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:09.362379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e5c29756-4f17-47ff-bf98-183177db3c03 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:09.381041 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e5c29756-4f17-47ff-bf98-183177db3c03 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1241 microversion: 2.1 time: 0.161043 Aug 27 05:12:09.396009 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3140/6335] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:09 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:09.432247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-becbfdcd-524e-4d79-aab3-0d2f97697af6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:09.443359 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-becbfdcd-524e-4d79-aab3-0d2f97697af6 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1225 microversion: 2.1 time: 0.116550 Aug 27 05:12:09.458193 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3196/6336] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:09 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:09.535366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef579179-9c1c-47a2-b0fc-d03751ca0b4a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:09.538087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ef579179-9c1c-47a2-b0fc-d03751ca0b4a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:09.551673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef579179-9c1c-47a2-b0fc-d03751ca0b4a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:09.552678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef579179-9c1c-47a2-b0fc-d03751ca0b4a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:09.553513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef579179-9c1c-47a2-b0fc-d03751ca0b4a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:09.554951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef579179-9c1c-47a2-b0fc-d03751ca0b4a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:09.554951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef579179-9c1c-47a2-b0fc-d03751ca0b4a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:09.556682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef579179-9c1c-47a2-b0fc-d03751ca0b4a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:09.976877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef579179-9c1c-47a2-b0fc-d03751ca0b4a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:09.990984 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ef579179-9c1c-47a2-b0fc-d03751ca0b4a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1313 microversion: 2.1 time: 0.459313 Aug 27 05:12:09.994687 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3141/6337] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:09 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:10.326239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f7b7f61-1fea-437a-a280-4a92d0fce913 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:10.326876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6f7b7f61-1fea-437a-a280-4a92d0fce913 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:10.350848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f7b7f61-1fea-437a-a280-4a92d0fce913 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:10.351649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f7b7f61-1fea-437a-a280-4a92d0fce913 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:10.352288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f7b7f61-1fea-437a-a280-4a92d0fce913 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:10.353210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f7b7f61-1fea-437a-a280-4a92d0fce913 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:10.353853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f7b7f61-1fea-437a-a280-4a92d0fce913 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:10.354298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f7b7f61-1fea-437a-a280-4a92d0fce913 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:10.403715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d31a0033-958e-445d-a2b1-a923856d0d54 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:10.404901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d31a0033-958e-445d-a2b1-a923856d0d54 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:10.429056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d31a0033-958e-445d-a2b1-a923856d0d54 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:10.433361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d31a0033-958e-445d-a2b1-a923856d0d54 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:10.433859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d31a0033-958e-445d-a2b1-a923856d0d54 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:10.435747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d31a0033-958e-445d-a2b1-a923856d0d54 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:10.438460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d31a0033-958e-445d-a2b1-a923856d0d54 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:10.441154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d31a0033-958e-445d-a2b1-a923856d0d54 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:10.484076 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6f7b7f61-1fea-437a-a280-4a92d0fce913 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1422 microversion: 2.1 time: 0.157666 Aug 27 05:12:10.485571 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3197/6338] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:10 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1422 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:10.492637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-caf48e12-342b-45cf-9442-89821f3e9444 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:10.493634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-caf48e12-342b-45cf-9442-89821f3e9444 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:10.521610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf48e12-342b-45cf-9442-89821f3e9444 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:10.522512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf48e12-342b-45cf-9442-89821f3e9444 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:10.524100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf48e12-342b-45cf-9442-89821f3e9444 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:10.528501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf48e12-342b-45cf-9442-89821f3e9444 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:10.529298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf48e12-342b-45cf-9442-89821f3e9444 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:10.530109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf48e12-342b-45cf-9442-89821f3e9444 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:10.603698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d31a0033-958e-445d-a2b1-a923856d0d54 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:10.613528 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d31a0033-958e-445d-a2b1-a923856d0d54 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1293 microversion: 2.1 time: 0.213956 Aug 27 05:12:10.632418 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3142/6339] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:10 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1293 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:10.633968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-caf48e12-342b-45cf-9442-89821f3e9444 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:10.645977 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-caf48e12-342b-45cf-9442-89821f3e9444 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1225 microversion: 2.1 time: 0.159084 Aug 27 05:12:10.657034 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3198/6340] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:10 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1225 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:11.016374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc8f34c3-e530-4879-bbfc-20cdcd095805 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:11.017190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bc8f34c3-e530-4879-bbfc-20cdcd095805 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:11.033479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc8f34c3-e530-4879-bbfc-20cdcd095805 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:11.035584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc8f34c3-e530-4879-bbfc-20cdcd095805 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:11.038847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc8f34c3-e530-4879-bbfc-20cdcd095805 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:11.040746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc8f34c3-e530-4879-bbfc-20cdcd095805 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:11.041631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc8f34c3-e530-4879-bbfc-20cdcd095805 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:11.042215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc8f34c3-e530-4879-bbfc-20cdcd095805 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:11.385233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bc8f34c3-e530-4879-bbfc-20cdcd095805 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:11.397698 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bc8f34c3-e530-4879-bbfc-20cdcd095805 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1313 microversion: 2.1 time: 0.385716 Aug 27 05:12:11.398323 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3143/6341] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:11 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:11.508557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88f3719f-5512-496e-a4c4-edb52ce53657 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:11.509926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88f3719f-5512-496e-a4c4-edb52ce53657 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:11.539229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88f3719f-5512-496e-a4c4-edb52ce53657 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:11.539767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88f3719f-5512-496e-a4c4-edb52ce53657 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:11.540282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88f3719f-5512-496e-a4c4-edb52ce53657 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:11.541649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88f3719f-5512-496e-a4c4-edb52ce53657 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:11.542309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88f3719f-5512-496e-a4c4-edb52ce53657 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:11.542898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88f3719f-5512-496e-a4c4-edb52ce53657 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:11.637124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-662272a7-9fbe-469b-8adf-4c0fee86bf75 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:11.638602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-662272a7-9fbe-469b-8adf-4c0fee86bf75 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:11.651955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-662272a7-9fbe-469b-8adf-4c0fee86bf75 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:11.656229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-662272a7-9fbe-469b-8adf-4c0fee86bf75 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:11.657702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-662272a7-9fbe-469b-8adf-4c0fee86bf75 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:11.668622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-662272a7-9fbe-469b-8adf-4c0fee86bf75 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:11.670157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-662272a7-9fbe-469b-8adf-4c0fee86bf75 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:11.673649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-662272a7-9fbe-469b-8adf-4c0fee86bf75 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:11.839726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-662272a7-9fbe-469b-8adf-4c0fee86bf75 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:11.850997 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-662272a7-9fbe-469b-8adf-4c0fee86bf75 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1299 microversion: 2.1 time: 0.217362 Aug 27 05:12:11.852659 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3144/6342] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:11 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:11.869758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e9021182-55ab-4af3-bdda-3c91de302757 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:11.872280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e9021182-55ab-4af3-bdda-3c91de302757 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:11.890985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9021182-55ab-4af3-bdda-3c91de302757 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:11.892450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9021182-55ab-4af3-bdda-3c91de302757 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:11.893331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9021182-55ab-4af3-bdda-3c91de302757 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:11.894590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9021182-55ab-4af3-bdda-3c91de302757 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:11.895412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9021182-55ab-4af3-bdda-3c91de302757 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:11.896368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e9021182-55ab-4af3-bdda-3c91de302757 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:11.980741 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88f3719f-5512-496e-a4c4-edb52ce53657 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1464 microversion: 2.1 time: 0.477061 Aug 27 05:12:11.984763 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3199/6343] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:11 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1464 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:11.997020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e9021182-55ab-4af3-bdda-3c91de302757 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:12.006095 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e9021182-55ab-4af3-bdda-3c91de302757 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1225 microversion: 2.1 time: 0.151314 Aug 27 05:12:12.007544 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3145/6344] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:11 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1225 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:12.072472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cbb98f1b-c4dc-4048-972d-aa65080dc1cc req-3180d8c8-296b-4d64-b1b4-397e37a3711a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b8b47d-b09a-4cf3-b402-a87f32185c01", "tag": "a8772ce6-682f-4fbb-81d7-76e609796198"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:12.094172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cbb98f1b-c4dc-4048-972d-aa65080dc1cc req-3180d8c8-296b-4d64-b1b4-397e37a3711a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:12.094679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cbb98f1b-c4dc-4048-972d-aa65080dc1cc req-3180d8c8-296b-4d64-b1b4-397e37a3711a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:12.095122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cbb98f1b-c4dc-4048-972d-aa65080dc1cc req-3180d8c8-296b-4d64-b1b4-397e37a3711a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:12.113724 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cbb98f1b-c4dc-4048-972d-aa65080dc1cc req-3180d8c8-296b-4d64-b1b4-397e37a3711a service nova] Creating event network-changed:a8772ce6-682f-4fbb-81d7-76e609796198 for instance e1b8b47d-b09a-4cf3-b402-a87f32185c01 on n-h1-854823-1 Aug 27 05:12:12.127532 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cbb98f1b-c4dc-4048-972d-aa65080dc1cc req-3180d8c8-296b-4d64-b1b4-397e37a3711a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058733 Aug 27 05:12:12.129537 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3200/6345] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:12.419199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e5b684cb-db3b-47e1-bb8e-7b182a0e0c0f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:12.420920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e5b684cb-db3b-47e1-bb8e-7b182a0e0c0f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:12.433121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5b684cb-db3b-47e1-bb8e-7b182a0e0c0f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:12.435475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5b684cb-db3b-47e1-bb8e-7b182a0e0c0f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:12.438752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5b684cb-db3b-47e1-bb8e-7b182a0e0c0f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:12.439691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5b684cb-db3b-47e1-bb8e-7b182a0e0c0f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:12.441036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5b684cb-db3b-47e1-bb8e-7b182a0e0c0f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:12.441771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5b684cb-db3b-47e1-bb8e-7b182a0e0c0f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:12.758776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e5b684cb-db3b-47e1-bb8e-7b182a0e0c0f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:12.780967 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e5b684cb-db3b-47e1-bb8e-7b182a0e0c0f tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1313 microversion: 2.1 time: 0.364899 Aug 27 05:12:12.784401 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3146/6346] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:12 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:12.880225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e11cdff-9781-44d2-a514-1e8a1981b628 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:12.881552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e11cdff-9781-44d2-a514-1e8a1981b628 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:12.895853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e11cdff-9781-44d2-a514-1e8a1981b628 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:12.896718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e11cdff-9781-44d2-a514-1e8a1981b628 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:12.897337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e11cdff-9781-44d2-a514-1e8a1981b628 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:12.898232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e11cdff-9781-44d2-a514-1e8a1981b628 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:12.899747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e11cdff-9781-44d2-a514-1e8a1981b628 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:12.900371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e11cdff-9781-44d2-a514-1e8a1981b628 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.002061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c49f04b-8734-4f80-894a-1b83c8daeb1f tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:13.003112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4c49f04b-8734-4f80-894a-1b83c8daeb1f tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:13.009571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c49f04b-8734-4f80-894a-1b83c8daeb1f tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.010311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c49f04b-8734-4f80-894a-1b83c8daeb1f tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.010905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c49f04b-8734-4f80-894a-1b83c8daeb1f tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.011770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c49f04b-8734-4f80-894a-1b83c8daeb1f tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.013860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c49f04b-8734-4f80-894a-1b83c8daeb1f tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.015024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c49f04b-8734-4f80-894a-1b83c8daeb1f tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.199021 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4c49f04b-8734-4f80-894a-1b83c8daeb1f tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1464 microversion: 2.1 time: 0.200587 Aug 27 05:12:13.223900 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3147/6347] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:12 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1464 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:13.229469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3da2bdd0-6199-461f-9677-e36cf41d55f1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:13.230427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3da2bdd0-6199-461f-9677-e36cf41d55f1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:13.237812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da2bdd0-6199-461f-9677-e36cf41d55f1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.238577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da2bdd0-6199-461f-9677-e36cf41d55f1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.239229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da2bdd0-6199-461f-9677-e36cf41d55f1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.240276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da2bdd0-6199-461f-9677-e36cf41d55f1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.241007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da2bdd0-6199-461f-9677-e36cf41d55f1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.241598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da2bdd0-6199-461f-9677-e36cf41d55f1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.284010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da2bdd0-6199-461f-9677-e36cf41d55f1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.285200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da2bdd0-6199-461f-9677-e36cf41d55f1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.285903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3da2bdd0-6199-461f-9677-e36cf41d55f1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.286542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-3da2bdd0-6199-461f-9677-e36cf41d55f1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lazy-loading 'fault' on Instance uuid 9ee5152a-fc8b-4030-8124-ba770b583613 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:13.337300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3da2bdd0-6199-461f-9677-e36cf41d55f1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:13.346284 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3da2bdd0-6199-461f-9677-e36cf41d55f1 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 200 len: 1184 microversion: 2.1 time: 0.120468 Aug 27 05:12:13.354869 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3148/6348] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:13 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 1184 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:13.516326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8bde7457-9070-4f5b-abe1-2ca205ddd1d4 req-b7da76bc-fd62-49e7-acc0-6df039b3344b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f9bd9b-ec72-448f-98aa-b22068f937f7", "name": "network-vif-plugged", "status": "completed", "tag": "b7db674b-4f43-4293-83ee-29b5dc589d90"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:13.521841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:13.544302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8bde7457-9070-4f5b-abe1-2ca205ddd1d4 req-b7da76bc-fd62-49e7-acc0-6df039b3344b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.545037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8bde7457-9070-4f5b-abe1-2ca205ddd1d4 req-b7da76bc-fd62-49e7-acc0-6df039b3344b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.545389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8bde7457-9070-4f5b-abe1-2ca205ddd1d4 req-b7da76bc-fd62-49e7-acc0-6df039b3344b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.571561 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8bde7457-9070-4f5b-abe1-2ca205ddd1d4 req-b7da76bc-fd62-49e7-acc0-6df039b3344b service nova] Creating event network-vif-plugged:b7db674b-4f43-4293-83ee-29b5dc589d90 for instance 69f9bd9b-ec72-448f-98aa-b22068f937f7 on n-h1-854823-1 Aug 27 05:12:13.585172 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8bde7457-9070-4f5b-abe1-2ca205ddd1d4 req-b7da76bc-fd62-49e7-acc0-6df039b3344b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072587 Aug 27 05:12:13.589386 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3149/6349] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:12:13.631111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4e11cdff-9781-44d2-a514-1e8a1981b628 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:13.640355 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e11cdff-9781-44d2-a514-1e8a1981b628 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1367 microversion: 2.1 time: 0.766028 Aug 27 05:12:13.641159 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3201/6350] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:12 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1367 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:13.809397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e4381ef0-de5e-4cb0-97d0-2d8b1e319101 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:13.810251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e4381ef0-de5e-4cb0-97d0-2d8b1e319101 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:13.816966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4381ef0-de5e-4cb0-97d0-2d8b1e319101 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.817582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4381ef0-de5e-4cb0-97d0-2d8b1e319101 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.818210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4381ef0-de5e-4cb0-97d0-2d8b1e319101 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.819043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4381ef0-de5e-4cb0-97d0-2d8b1e319101 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.819600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4381ef0-de5e-4cb0-97d0-2d8b1e319101 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.820998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e4381ef0-de5e-4cb0-97d0-2d8b1e319101 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.952755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-fe7b6572-227f-42e6-abe4-45a36d44229b req-6ba916a9-f130-4be1-9770-f9e45d713db5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda2a251-0067-45d0-b424-3b6214b1c3a5", "tag": "fb4bfa18-8d02-4ee3-b43c-9382211134ba"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:13.968868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fe7b6572-227f-42e6-abe4-45a36d44229b req-6ba916a9-f130-4be1-9770-f9e45d713db5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:13.976138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fe7b6572-227f-42e6-abe4-45a36d44229b req-6ba916a9-f130-4be1-9770-f9e45d713db5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:13.981783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fe7b6572-227f-42e6-abe4-45a36d44229b req-6ba916a9-f130-4be1-9770-f9e45d713db5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:13.996967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e4381ef0-de5e-4cb0-97d0-2d8b1e319101 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:14.003571 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-fe7b6572-227f-42e6-abe4-45a36d44229b req-6ba916a9-f130-4be1-9770-f9e45d713db5 service nova] Creating event network-changed:fb4bfa18-8d02-4ee3-b43c-9382211134ba for instance fda2a251-0067-45d0-b424-3b6214b1c3a5 on n-h2-854823-1 Aug 27 05:12:14.008188 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e4381ef0-de5e-4cb0-97d0-2d8b1e319101 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1313 microversion: 2.1 time: 0.204321 Aug 27 05:12:14.009269 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-fe7b6572-227f-42e6-abe4-45a36d44229b req-6ba916a9-f130-4be1-9770-f9e45d713db5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062301 Aug 27 05:12:14.009917 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3202/6351] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:12:14.010075 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3150/6352] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:13 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:14.235587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d4b855c4-3142-4b61-a835-bd60d7c9a47e tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:14.236702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d4b855c4-3142-4b61-a835-bd60d7c9a47e tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:14.245658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4b855c4-3142-4b61-a835-bd60d7c9a47e tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:14.246435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4b855c4-3142-4b61-a835-bd60d7c9a47e tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:14.247577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4b855c4-3142-4b61-a835-bd60d7c9a47e tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:14.248766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4b855c4-3142-4b61-a835-bd60d7c9a47e tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:14.250371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4b855c4-3142-4b61-a835-bd60d7c9a47e tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:14.250665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4b855c4-3142-4b61-a835-bd60d7c9a47e tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:14.374907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c3fd5c7-6487-4484-a9d8-61a72a870ec3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:14.376629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c3fd5c7-6487-4484-a9d8-61a72a870ec3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 9ee5152a-fc8b-4030-8124-ba770b583613] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:14.391878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c3fd5c7-6487-4484-a9d8-61a72a870ec3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:14.393575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c3fd5c7-6487-4484-a9d8-61a72a870ec3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:14.394248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c3fd5c7-6487-4484-a9d8-61a72a870ec3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:14.395676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c3fd5c7-6487-4484-a9d8-61a72a870ec3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:14.396369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c3fd5c7-6487-4484-a9d8-61a72a870ec3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:14.408561 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d4b855c4-3142-4b61-a835-bd60d7c9a47e tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1464 microversion: 2.1 time: 0.180617 Aug 27 05:12:14.409047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c3fd5c7-6487-4484-a9d8-61a72a870ec3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:14.413577 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3151/6353] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:14 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1464 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:14.424872 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0c3fd5c7-6487-4484-a9d8-61a72a870ec3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance 9ee5152a-fc8b-4030-8124-ba770b583613 could not be found. Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c3fd5c7-6487-4484-a9d8-61a72a870ec3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 HTTP/1.1 Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 9ee5152a-fc8b-4030-8124-ba770b583613 could not be found. Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '9ee5152a-fc8b-4030-8124-ba770b583613'} Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee5152a-fc8b-4030-8124-ba770b583613 could not be found. Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee5152a-fc8b-4030-8124-ba770b583613 could not be found. Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:14.426813 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:14.431672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:14.431672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:14.431672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:14.431672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:14.431672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:14.431672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee5152a-fc8b-4030-8124-ba770b583613 could not be found. Aug 27 05:12:14.431672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:14.432245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c3fd5c7-6487-4484-a9d8-61a72a870ec3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance 9ee5152a-fc8b-4030-8124-ba770b583613 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:14.433015 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c3fd5c7-6487-4484-a9d8-61a72a870ec3 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613" status: 404 len: 111 microversion: 2.1 time: 0.068093 Aug 27 05:12:14.437230 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3203/6354] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:14 2022] GET /compute/v2.1/servers/9ee5152a-fc8b-4030-8124-ba770b583613 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:12:14.664179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e5528525-cae0-4277-9e99-769c48507500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:14.665964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e5528525-cae0-4277-9e99-769c48507500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:14.674311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5528525-cae0-4277-9e99-769c48507500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:14.675184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5528525-cae0-4277-9e99-769c48507500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:14.675792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5528525-cae0-4277-9e99-769c48507500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:14.676709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5528525-cae0-4277-9e99-769c48507500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:14.677354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5528525-cae0-4277-9e99-769c48507500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:14.677948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5528525-cae0-4277-9e99-769c48507500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:14.849906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e5528525-cae0-4277-9e99-769c48507500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:14.861299 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e5528525-cae0-4277-9e99-769c48507500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1367 microversion: 2.1 time: 0.203364 Aug 27 05:12:14.875612 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3152/6355] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:14 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:15.035654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-00bdf495-5f9a-443d-bd43-9d899a0f2d8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:15.037435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-00bdf495-5f9a-443d-bd43-9d899a0f2d8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:15.046342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00bdf495-5f9a-443d-bd43-9d899a0f2d8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:15.047153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00bdf495-5f9a-443d-bd43-9d899a0f2d8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:15.047750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00bdf495-5f9a-443d-bd43-9d899a0f2d8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:15.048823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00bdf495-5f9a-443d-bd43-9d899a0f2d8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:15.049807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00bdf495-5f9a-443d-bd43-9d899a0f2d8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:15.051173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00bdf495-5f9a-443d-bd43-9d899a0f2d8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:15.075722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:15.244979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-00bdf495-5f9a-443d-bd43-9d899a0f2d8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:15.258581 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-00bdf495-5f9a-443d-bd43-9d899a0f2d8c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1313 microversion: 2.1 time: 0.230273 Aug 27 05:12:15.260183 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3204/6356] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:15 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:15.434481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b55b72cc-c9d3-4b90-b082-537124e932bb tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:15.435404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b55b72cc-c9d3-4b90-b082-537124e932bb tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:15.450834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b55b72cc-c9d3-4b90-b082-537124e932bb tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:15.451662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b55b72cc-c9d3-4b90-b082-537124e932bb tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:15.452333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b55b72cc-c9d3-4b90-b082-537124e932bb tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:15.455905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b55b72cc-c9d3-4b90-b082-537124e932bb tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:15.456824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b55b72cc-c9d3-4b90-b082-537124e932bb tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:15.475052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b55b72cc-c9d3-4b90-b082-537124e932bb tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:15.828780 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b55b72cc-c9d3-4b90-b082-537124e932bb tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1464 microversion: 2.1 time: 0.397711 Aug 27 05:12:15.830623 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3153/6357] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:15 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1464 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:15.883639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26d0f1a8-8bd5-49c2-8124-64120f66bafc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:15.884649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26d0f1a8-8bd5-49c2-8124-64120f66bafc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:15.901064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d0f1a8-8bd5-49c2-8124-64120f66bafc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:15.906246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d0f1a8-8bd5-49c2-8124-64120f66bafc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:15.907646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d0f1a8-8bd5-49c2-8124-64120f66bafc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:15.909036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d0f1a8-8bd5-49c2-8124-64120f66bafc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:15.909791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d0f1a8-8bd5-49c2-8124-64120f66bafc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:15.910493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d0f1a8-8bd5-49c2-8124-64120f66bafc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:16.179407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26d0f1a8-8bd5-49c2-8124-64120f66bafc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:16.191437 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26d0f1a8-8bd5-49c2-8124-64120f66bafc tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1367 microversion: 2.1 time: 0.312679 Aug 27 05:12:16.192598 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3205/6358] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:15 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:16.283502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9c8cbc7f-b80b-46d5-ac72-103f44e61ba0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:16.284733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9c8cbc7f-b80b-46d5-ac72-103f44e61ba0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:16.306171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c8cbc7f-b80b-46d5-ac72-103f44e61ba0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:16.309822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c8cbc7f-b80b-46d5-ac72-103f44e61ba0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:16.311088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c8cbc7f-b80b-46d5-ac72-103f44e61ba0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:16.314003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c8cbc7f-b80b-46d5-ac72-103f44e61ba0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:16.314983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c8cbc7f-b80b-46d5-ac72-103f44e61ba0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:16.315843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c8cbc7f-b80b-46d5-ac72-103f44e61ba0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:16.502992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9c8cbc7f-b80b-46d5-ac72-103f44e61ba0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:16.505320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:16.519333 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9c8cbc7f-b80b-46d5-ac72-103f44e61ba0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1313 microversion: 2.1 time: 0.241491 Aug 27 05:12:16.520022 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3154/6359] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:16 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:16.850915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6158f731-3cf0-4402-b602-df5dd87cd5e9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:16.851571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6158f731-3cf0-4402-b602-df5dd87cd5e9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:16.858519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6158f731-3cf0-4402-b602-df5dd87cd5e9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:16.858638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6158f731-3cf0-4402-b602-df5dd87cd5e9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:16.859014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6158f731-3cf0-4402-b602-df5dd87cd5e9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:16.859905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6158f731-3cf0-4402-b602-df5dd87cd5e9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:16.861004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6158f731-3cf0-4402-b602-df5dd87cd5e9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:16.861444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6158f731-3cf0-4402-b602-df5dd87cd5e9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:16.991687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:16.998370 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6158f731-3cf0-4402-b602-df5dd87cd5e9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1464 microversion: 2.1 time: 0.151191 Aug 27 05:12:16.999234 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3206/6360] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:16 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:17.227890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cd1f5732-ab66-4412-9e6a-c58826220a55 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:17.229022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cd1f5732-ab66-4412-9e6a-c58826220a55 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:17.242126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd1f5732-ab66-4412-9e6a-c58826220a55 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:17.243117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd1f5732-ab66-4412-9e6a-c58826220a55 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:17.243790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd1f5732-ab66-4412-9e6a-c58826220a55 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:17.245264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd1f5732-ab66-4412-9e6a-c58826220a55 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:17.246451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd1f5732-ab66-4412-9e6a-c58826220a55 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:17.247233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cd1f5732-ab66-4412-9e6a-c58826220a55 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:17.449494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cd1f5732-ab66-4412-9e6a-c58826220a55 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:17.460883 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cd1f5732-ab66-4412-9e6a-c58826220a55 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1367 microversion: 2.1 time: 0.251549 Aug 27 05:12:17.461802 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3155/6361] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:17 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:17.539734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23dbe82c-394d-40c2-b4ca-477cae56dade tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:17.541162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-23dbe82c-394d-40c2-b4ca-477cae56dade tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:17.548634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23dbe82c-394d-40c2-b4ca-477cae56dade tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:17.549146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23dbe82c-394d-40c2-b4ca-477cae56dade tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:17.549778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23dbe82c-394d-40c2-b4ca-477cae56dade tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:17.551001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23dbe82c-394d-40c2-b4ca-477cae56dade tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:17.551686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23dbe82c-394d-40c2-b4ca-477cae56dade tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:17.552345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23dbe82c-394d-40c2-b4ca-477cae56dade tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:17.712257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-23dbe82c-394d-40c2-b4ca-477cae56dade tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:17.726847 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23dbe82c-394d-40c2-b4ca-477cae56dade tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1500 microversion: 2.1 time: 0.191340 Aug 27 05:12:17.732235 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3207/6362] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:17 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1500 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:17.753044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c79e3f8-00c7-47dd-90b2-238b97876c52 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:17.753701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8c79e3f8-00c7-47dd-90b2-238b97876c52 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:17.761303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c79e3f8-00c7-47dd-90b2-238b97876c52 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:17.761940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c79e3f8-00c7-47dd-90b2-238b97876c52 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:17.762626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c79e3f8-00c7-47dd-90b2-238b97876c52 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:17.763552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c79e3f8-00c7-47dd-90b2-238b97876c52 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:17.764094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c79e3f8-00c7-47dd-90b2-238b97876c52 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:17.764795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c79e3f8-00c7-47dd-90b2-238b97876c52 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:17.898688 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8c79e3f8-00c7-47dd-90b2-238b97876c52 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7/action" status: 202 len: 0 microversion: 2.1 time: 0.153001 Aug 27 05:12:17.903065 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3156/6363] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:12:17 2022] POST /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:12:17.910562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8595f2b-768f-4f7f-b80d-e577c3434df4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:17.911479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a8595f2b-768f-4f7f-b80d-e577c3434df4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:17.924445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8595f2b-768f-4f7f-b80d-e577c3434df4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:17.928059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8595f2b-768f-4f7f-b80d-e577c3434df4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:17.928759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8595f2b-768f-4f7f-b80d-e577c3434df4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:17.929772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8595f2b-768f-4f7f-b80d-e577c3434df4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:17.930322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8595f2b-768f-4f7f-b80d-e577c3434df4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:17.930934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8595f2b-768f-4f7f-b80d-e577c3434df4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:18.021690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f49dedc2-935d-4ba4-b32f-2aa157c68a61 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:18.022680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f49dedc2-935d-4ba4-b32f-2aa157c68a61 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:18.037360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f49dedc2-935d-4ba4-b32f-2aa157c68a61 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:18.037873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f49dedc2-935d-4ba4-b32f-2aa157c68a61 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:18.038321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f49dedc2-935d-4ba4-b32f-2aa157c68a61 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:18.039038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f49dedc2-935d-4ba4-b32f-2aa157c68a61 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:18.039497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f49dedc2-935d-4ba4-b32f-2aa157c68a61 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:18.039948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f49dedc2-935d-4ba4-b32f-2aa157c68a61 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:18.182275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8595f2b-768f-4f7f-b80d-e577c3434df4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:18.195200 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8595f2b-768f-4f7f-b80d-e577c3434df4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1505 microversion: 2.1 time: 0.289271 Aug 27 05:12:18.197770 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3208/6364] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:17 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:18.290160 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f49dedc2-935d-4ba4-b32f-2aa157c68a61 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1464 microversion: 2.1 time: 0.272740 Aug 27 05:12:18.292300 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3157/6365] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:18 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1464 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:18.403285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-34aa1f1e-cf57-40ef-aa26-42bc63a5af3f req-bbf8507a-310d-45df-a725-5b3dcdab9ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda2a251-0067-45d0-b424-3b6214b1c3a5", "name": "network-vif-plugged", "status": "completed", "tag": "fb4bfa18-8d02-4ee3-b43c-9382211134ba"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:18.428392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-34aa1f1e-cf57-40ef-aa26-42bc63a5af3f req-bbf8507a-310d-45df-a725-5b3dcdab9ad5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:18.429334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-34aa1f1e-cf57-40ef-aa26-42bc63a5af3f req-bbf8507a-310d-45df-a725-5b3dcdab9ad5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:18.429775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-34aa1f1e-cf57-40ef-aa26-42bc63a5af3f req-bbf8507a-310d-45df-a725-5b3dcdab9ad5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:18.445681 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-34aa1f1e-cf57-40ef-aa26-42bc63a5af3f req-bbf8507a-310d-45df-a725-5b3dcdab9ad5 service nova] Creating event network-vif-plugged:fb4bfa18-8d02-4ee3-b43c-9382211134ba for instance fda2a251-0067-45d0-b424-3b6214b1c3a5 on n-h2-854823-1 Aug 27 05:12:18.451313 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-34aa1f1e-cf57-40ef-aa26-42bc63a5af3f req-bbf8507a-310d-45df-a725-5b3dcdab9ad5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051904 Aug 27 05:12:18.453411 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3209/6366] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:18.485453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-37a7ac98-76e4-41f8-a9a9-d8663e761daa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:18.486075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-37a7ac98-76e4-41f8-a9a9-d8663e761daa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:18.497227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37a7ac98-76e4-41f8-a9a9-d8663e761daa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:18.497729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37a7ac98-76e4-41f8-a9a9-d8663e761daa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:18.498174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37a7ac98-76e4-41f8-a9a9-d8663e761daa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:18.498928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37a7ac98-76e4-41f8-a9a9-d8663e761daa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:18.500197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37a7ac98-76e4-41f8-a9a9-d8663e761daa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:18.501050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37a7ac98-76e4-41f8-a9a9-d8663e761daa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:18.644997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-37a7ac98-76e4-41f8-a9a9-d8663e761daa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:18.652739 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-37a7ac98-76e4-41f8-a9a9-d8663e761daa tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1367 microversion: 2.1 time: 0.172514 Aug 27 05:12:18.653303 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3158/6367] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:18 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:19.220011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-774b7180-01a7-4895-89f1-b78900392589 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:19.220671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-774b7180-01a7-4895-89f1-b78900392589 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:19.227883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-774b7180-01a7-4895-89f1-b78900392589 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:19.228389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-774b7180-01a7-4895-89f1-b78900392589 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:19.228868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-774b7180-01a7-4895-89f1-b78900392589 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:19.229585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-774b7180-01a7-4895-89f1-b78900392589 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:19.230054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-774b7180-01a7-4895-89f1-b78900392589 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:19.230493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-774b7180-01a7-4895-89f1-b78900392589 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:19.317782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6f6347b7-a489-4126-955d-24a76895f230 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:19.318737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6f6347b7-a489-4126-955d-24a76895f230 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:19.321796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:19.329850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6347b7-a489-4126-955d-24a76895f230 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:19.330374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6347b7-a489-4126-955d-24a76895f230 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:19.330813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6347b7-a489-4126-955d-24a76895f230 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:19.331727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6347b7-a489-4126-955d-24a76895f230 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:19.332231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6347b7-a489-4126-955d-24a76895f230 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:19.332896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f6347b7-a489-4126-955d-24a76895f230 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:19.369752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=22 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:19.459305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-774b7180-01a7-4895-89f1-b78900392589 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:19.468595 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-774b7180-01a7-4895-89f1-b78900392589 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1485 microversion: 2.1 time: 0.252964 Aug 27 05:12:19.475685 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3210/6368] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:19 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1485 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:19.494129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d93346d-e3f7-4d5f-b92f-3e4608e2cace tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:19.494698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1d93346d-e3f7-4d5f-b92f-3e4608e2cace tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:19.512003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d93346d-e3f7-4d5f-b92f-3e4608e2cace tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:19.513177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d93346d-e3f7-4d5f-b92f-3e4608e2cace tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:19.516560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d93346d-e3f7-4d5f-b92f-3e4608e2cace tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:19.520515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d93346d-e3f7-4d5f-b92f-3e4608e2cace tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:19.521475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d93346d-e3f7-4d5f-b92f-3e4608e2cace tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:19.521916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d93346d-e3f7-4d5f-b92f-3e4608e2cace tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:19.545112 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6f6347b7-a489-4126-955d-24a76895f230 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1464 microversion: 2.1 time: 0.229874 Aug 27 05:12:19.562212 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3159/6369] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:19 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1464 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:19.567269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-1d93346d-e3f7-4d5f-b92f-3e4608e2cace tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lazy-loading 'flavor' on Instance uuid 69f9bd9b-ec72-448f-98aa-b22068f937f7 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:19.674411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2fa79f5a-bbe4-44d0-8382-b86e4d5340b4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:19.675251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2fa79f5a-bbe4-44d0-8382-b86e4d5340b4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:19.684889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fa79f5a-bbe4-44d0-8382-b86e4d5340b4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:19.685394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fa79f5a-bbe4-44d0-8382-b86e4d5340b4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:19.685986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fa79f5a-bbe4-44d0-8382-b86e4d5340b4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:19.701204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fa79f5a-bbe4-44d0-8382-b86e4d5340b4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:19.701204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fa79f5a-bbe4-44d0-8382-b86e4d5340b4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:19.701204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2fa79f5a-bbe4-44d0-8382-b86e4d5340b4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:19.864075 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d93346d-e3f7-4d5f-b92f-3e4608e2cace tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7/action" status: 202 len: 0 microversion: 2.1 time: 0.374503 Aug 27 05:12:19.865083 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3211/6370] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:12:19 2022] POST /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:12:19.875568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b5ca16c-dc0c-4c45-b0b7-01ac1ff6bd83 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:19.876981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b5ca16c-dc0c-4c45-b0b7-01ac1ff6bd83 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:19.892707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5ca16c-dc0c-4c45-b0b7-01ac1ff6bd83 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:19.893627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5ca16c-dc0c-4c45-b0b7-01ac1ff6bd83 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:19.894367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5ca16c-dc0c-4c45-b0b7-01ac1ff6bd83 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:19.895337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5ca16c-dc0c-4c45-b0b7-01ac1ff6bd83 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:19.896231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5ca16c-dc0c-4c45-b0b7-01ac1ff6bd83 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:19.897502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5ca16c-dc0c-4c45-b0b7-01ac1ff6bd83 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:20.018676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2fa79f5a-bbe4-44d0-8382-b86e4d5340b4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:20.028202 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2fa79f5a-bbe4-44d0-8382-b86e4d5340b4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1367 microversion: 2.1 time: 0.359131 Aug 27 05:12:20.029122 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3160/6371] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:19 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:20.096963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b5ca16c-dc0c-4c45-b0b7-01ac1ff6bd83 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:20.106802 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b5ca16c-dc0c-4c45-b0b7-01ac1ff6bd83 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1491 microversion: 2.1 time: 0.236037 Aug 27 05:12:20.108326 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3212/6372] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:19 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1491 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:20.468345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1c0580dc-bea5-4645-b6b0-1bb13d997bc9 req-c6e3e971-95aa-46ed-8040-e05ccb2d9139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b8b47d-b09a-4cf3-b402-a87f32185c01", "name": "network-vif-plugged", "status": "completed", "tag": "a8772ce6-682f-4fbb-81d7-76e609796198"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:20.486448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1c0580dc-bea5-4645-b6b0-1bb13d997bc9 req-c6e3e971-95aa-46ed-8040-e05ccb2d9139 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:20.487101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1c0580dc-bea5-4645-b6b0-1bb13d997bc9 req-c6e3e971-95aa-46ed-8040-e05ccb2d9139 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:20.487570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1c0580dc-bea5-4645-b6b0-1bb13d997bc9 req-c6e3e971-95aa-46ed-8040-e05ccb2d9139 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:20.501944 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1c0580dc-bea5-4645-b6b0-1bb13d997bc9 req-c6e3e971-95aa-46ed-8040-e05ccb2d9139 service nova] Creating event network-vif-plugged:a8772ce6-682f-4fbb-81d7-76e609796198 for instance e1b8b47d-b09a-4cf3-b402-a87f32185c01 on n-h1-854823-1 Aug 27 05:12:20.507197 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1c0580dc-bea5-4645-b6b0-1bb13d997bc9 req-c6e3e971-95aa-46ed-8040-e05ccb2d9139 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042665 Aug 27 05:12:20.514178 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3161/6373] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:12:20.568281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f796314-63da-458c-a6db-dd53dbb73ab9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:20.569082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f796314-63da-458c-a6db-dd53dbb73ab9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:20.578348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f796314-63da-458c-a6db-dd53dbb73ab9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:20.578955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f796314-63da-458c-a6db-dd53dbb73ab9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:20.579424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f796314-63da-458c-a6db-dd53dbb73ab9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:20.580255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f796314-63da-458c-a6db-dd53dbb73ab9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:20.580771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f796314-63da-458c-a6db-dd53dbb73ab9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:20.581218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f796314-63da-458c-a6db-dd53dbb73ab9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:20.742953 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f796314-63da-458c-a6db-dd53dbb73ab9 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1464 microversion: 2.1 time: 0.178928 Aug 27 05:12:20.743537 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3213/6374] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:20 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1464 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:21.055579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d19590b5-8cbc-403e-93cf-bd4f6502d76b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:21.057184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d19590b5-8cbc-403e-93cf-bd4f6502d76b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:21.072196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d19590b5-8cbc-403e-93cf-bd4f6502d76b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.072727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d19590b5-8cbc-403e-93cf-bd4f6502d76b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.073170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d19590b5-8cbc-403e-93cf-bd4f6502d76b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.073882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d19590b5-8cbc-403e-93cf-bd4f6502d76b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.074347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d19590b5-8cbc-403e-93cf-bd4f6502d76b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.074779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d19590b5-8cbc-403e-93cf-bd4f6502d76b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.130471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-24b3095b-9c10-405a-b0ae-2e0f1ce579a3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:21.131521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-24b3095b-9c10-405a-b0ae-2e0f1ce579a3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:21.137689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-24b3095b-9c10-405a-b0ae-2e0f1ce579a3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.138195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-24b3095b-9c10-405a-b0ae-2e0f1ce579a3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.138646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-24b3095b-9c10-405a-b0ae-2e0f1ce579a3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.139984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-24b3095b-9c10-405a-b0ae-2e0f1ce579a3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.140454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-24b3095b-9c10-405a-b0ae-2e0f1ce579a3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.141112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-24b3095b-9c10-405a-b0ae-2e0f1ce579a3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.217758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d19590b5-8cbc-403e-93cf-bd4f6502d76b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:21.228739 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d19590b5-8cbc-403e-93cf-bd4f6502d76b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1556 microversion: 2.1 time: 0.178002 Aug 27 05:12:21.233768 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3162/6375] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:21 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:21.252676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e7c95838-2846-4045-8712-855f752f792a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:21.253501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e7c95838-2846-4045-8712-855f752f792a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:21.260267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7c95838-2846-4045-8712-855f752f792a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.260778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7c95838-2846-4045-8712-855f752f792a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.261214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7c95838-2846-4045-8712-855f752f792a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.261916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7c95838-2846-4045-8712-855f752f792a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.262447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7c95838-2846-4045-8712-855f752f792a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.262876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e7c95838-2846-4045-8712-855f752f792a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.360383 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e7c95838-2846-4045-8712-855f752f792a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113919 Aug 27 05:12:21.365449 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3163/6376] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 05:12:21 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:12:21.371694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-24b3095b-9c10-405a-b0ae-2e0f1ce579a3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:21.384256 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-24b3095b-9c10-405a-b0ae-2e0f1ce579a3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1491 microversion: 2.1 time: 0.257610 Aug 27 05:12:21.399228 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3214/6377] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:21 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1491 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:21.765802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d6145216-3978-4e9d-a84b-99151d07afa7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:21.766437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d6145216-3978-4e9d-a84b-99151d07afa7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:21.772696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6145216-3978-4e9d-a84b-99151d07afa7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.773646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6145216-3978-4e9d-a84b-99151d07afa7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.775759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6145216-3978-4e9d-a84b-99151d07afa7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:21.776702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6145216-3978-4e9d-a84b-99151d07afa7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:21.777331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6145216-3978-4e9d-a84b-99151d07afa7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:21.777926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6145216-3978-4e9d-a84b-99151d07afa7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:22.040815 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d6145216-3978-4e9d-a84b-99151d07afa7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1464 microversion: 2.1 time: 0.280528 Aug 27 05:12:22.041402 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3164/6378] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:21 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1464 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:22.068100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-592e6234-4796-4d95-b56d-42f66b04cd48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:22.068747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-592e6234-4796-4d95-b56d-42f66b04cd48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:22.078246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-896be2f0-49c3-4d8a-9f7f-4601b83e7016 req-04bdc061-2a7e-4090-939d-2a910b318fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1de3f97-c882-44a1-bb4e-89e450bdb01e", "tag": "66099720-3a60-4878-a03f-475ad084c6d4"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:22.089154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-592e6234-4796-4d95-b56d-42f66b04cd48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:22.090243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-592e6234-4796-4d95-b56d-42f66b04cd48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:22.090788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-592e6234-4796-4d95-b56d-42f66b04cd48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:22.091631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-592e6234-4796-4d95-b56d-42f66b04cd48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:22.093828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-592e6234-4796-4d95-b56d-42f66b04cd48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:22.094068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-896be2f0-49c3-4d8a-9f7f-4601b83e7016 req-04bdc061-2a7e-4090-939d-2a910b318fa0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:22.094594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-896be2f0-49c3-4d8a-9f7f-4601b83e7016 req-04bdc061-2a7e-4090-939d-2a910b318fa0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:22.094721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-592e6234-4796-4d95-b56d-42f66b04cd48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:22.095039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-896be2f0-49c3-4d8a-9f7f-4601b83e7016 req-04bdc061-2a7e-4090-939d-2a910b318fa0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:22.111997 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-896be2f0-49c3-4d8a-9f7f-4601b83e7016 req-04bdc061-2a7e-4090-939d-2a910b318fa0 service nova] Creating event network-changed:66099720-3a60-4878-a03f-475ad084c6d4 for instance d1de3f97-c882-44a1-bb4e-89e450bdb01e on n-h1-854823-1 Aug 27 05:12:22.117598 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-896be2f0-49c3-4d8a-9f7f-4601b83e7016 req-04bdc061-2a7e-4090-939d-2a910b318fa0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043664 Aug 27 05:12:22.118802 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3165/6379] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:22.159202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-592e6234-4796-4d95-b56d-42f66b04cd48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:12:22.269831 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-592e6234-4796-4d95-b56d-42f66b04cd48 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 204 len: 0 microversion: 2.1 time: 0.206368 Aug 27 05:12:22.274563 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3215/6380] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:12:22 2022] DELETE /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:12:22.281532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a94104de-ec7d-4d27-9415-98bdaffd45fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:22.282985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a94104de-ec7d-4d27-9415-98bdaffd45fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:22.290933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a94104de-ec7d-4d27-9415-98bdaffd45fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:22.291655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a94104de-ec7d-4d27-9415-98bdaffd45fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:22.292280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a94104de-ec7d-4d27-9415-98bdaffd45fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:22.294319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a94104de-ec7d-4d27-9415-98bdaffd45fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:22.294971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a94104de-ec7d-4d27-9415-98bdaffd45fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:22.295605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a94104de-ec7d-4d27-9415-98bdaffd45fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:22.409284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f952a52e-adec-4382-a493-01799388d876 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:22.410172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f952a52e-adec-4382-a493-01799388d876 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:22.417564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f952a52e-adec-4382-a493-01799388d876 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:22.418350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f952a52e-adec-4382-a493-01799388d876 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:22.419065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f952a52e-adec-4382-a493-01799388d876 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:22.420201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f952a52e-adec-4382-a493-01799388d876 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:22.421521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f952a52e-adec-4382-a493-01799388d876 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:22.422084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f952a52e-adec-4382-a493-01799388d876 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:22.662638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f952a52e-adec-4382-a493-01799388d876 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:22.673184 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f952a52e-adec-4382-a493-01799388d876 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1512 microversion: 2.1 time: 0.270374 Aug 27 05:12:22.688257 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3216/6381] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:22 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:22.909035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a94104de-ec7d-4d27-9415-98bdaffd45fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:22.921425 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a94104de-ec7d-4d27-9415-98bdaffd45fd tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1577 microversion: 2.1 time: 0.644222 Aug 27 05:12:22.922285 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3166/6382] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:22 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1577 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:23.062539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-831dd8de-0d4f-462c-aaa1-ef9564e439c7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:23.063424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-831dd8de-0d4f-462c-aaa1-ef9564e439c7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:23.073173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-831dd8de-0d4f-462c-aaa1-ef9564e439c7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:23.074665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-831dd8de-0d4f-462c-aaa1-ef9564e439c7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:23.075554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-831dd8de-0d4f-462c-aaa1-ef9564e439c7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:23.076446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-831dd8de-0d4f-462c-aaa1-ef9564e439c7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:23.077744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-831dd8de-0d4f-462c-aaa1-ef9564e439c7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:23.079381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-831dd8de-0d4f-462c-aaa1-ef9564e439c7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:23.085941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a78a39dd-4b74-4533-a017-d94d64b0385a req-80828092-0a76-45da-a53a-9af3bc6306e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda2a251-0067-45d0-b424-3b6214b1c3a5", "tag": "fb4bfa18-8d02-4ee3-b43c-9382211134ba"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:23.106002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a78a39dd-4b74-4533-a017-d94d64b0385a req-80828092-0a76-45da-a53a-9af3bc6306e8 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:23.113465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a78a39dd-4b74-4533-a017-d94d64b0385a req-80828092-0a76-45da-a53a-9af3bc6306e8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:23.113955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a78a39dd-4b74-4533-a017-d94d64b0385a req-80828092-0a76-45da-a53a-9af3bc6306e8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:23.130445 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a78a39dd-4b74-4533-a017-d94d64b0385a req-80828092-0a76-45da-a53a-9af3bc6306e8 service nova] Creating event network-changed:fb4bfa18-8d02-4ee3-b43c-9382211134ba for instance fda2a251-0067-45d0-b424-3b6214b1c3a5 on n-h2-854823-1 Aug 27 05:12:23.136190 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a78a39dd-4b74-4533-a017-d94d64b0385a req-80828092-0a76-45da-a53a-9af3bc6306e8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054207 Aug 27 05:12:23.140967 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3167/6383] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:23.374838 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-831dd8de-0d4f-462c-aaa1-ef9564e439c7 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1464 microversion: 2.1 time: 0.316782 Aug 27 05:12:23.382340 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3217/6384] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:23 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1464 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:23.696556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a195b691-cbdd-4762-8800-f78e0d6a0c1d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:23.697528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a195b691-cbdd-4762-8800-f78e0d6a0c1d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:23.704910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a195b691-cbdd-4762-8800-f78e0d6a0c1d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:23.705734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a195b691-cbdd-4762-8800-f78e0d6a0c1d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:23.706403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a195b691-cbdd-4762-8800-f78e0d6a0c1d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:23.707570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a195b691-cbdd-4762-8800-f78e0d6a0c1d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:23.709815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a195b691-cbdd-4762-8800-f78e0d6a0c1d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:23.710575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a195b691-cbdd-4762-8800-f78e0d6a0c1d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:23.976400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a195b691-cbdd-4762-8800-f78e0d6a0c1d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:23.991758 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a195b691-cbdd-4762-8800-f78e0d6a0c1d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1512 microversion: 2.1 time: 0.299724 Aug 27 05:12:23.994277 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3168/6385] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:23 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:24.201441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-51119cd7-ec8b-418d-8b32-a5159843a99d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:24.202218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-51119cd7-ec8b-418d-8b32-a5159843a99d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:24.208927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51119cd7-ec8b-418d-8b32-a5159843a99d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.209786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51119cd7-ec8b-418d-8b32-a5159843a99d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.210314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51119cd7-ec8b-418d-8b32-a5159843a99d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.215669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51119cd7-ec8b-418d-8b32-a5159843a99d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.216260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51119cd7-ec8b-418d-8b32-a5159843a99d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.216819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51119cd7-ec8b-418d-8b32-a5159843a99d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.386665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-51119cd7-ec8b-418d-8b32-a5159843a99d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:24.396015 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-51119cd7-ec8b-418d-8b32-a5159843a99d tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1577 microversion: 2.1 time: 0.456455 Aug 27 05:12:24.401574 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3218/6386] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:23 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1577 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:24.405471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-38a4ba54-6424-4ed3-90e8-8718917b7e24 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:24.406789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-38a4ba54-6424-4ed3-90e8-8718917b7e24 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:24.415697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38a4ba54-6424-4ed3-90e8-8718917b7e24 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.416655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38a4ba54-6424-4ed3-90e8-8718917b7e24 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.417463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38a4ba54-6424-4ed3-90e8-8718917b7e24 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.418890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38a4ba54-6424-4ed3-90e8-8718917b7e24 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.419764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38a4ba54-6424-4ed3-90e8-8718917b7e24 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.424014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38a4ba54-6424-4ed3-90e8-8718917b7e24 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.629779 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-38a4ba54-6424-4ed3-90e8-8718917b7e24 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1648 microversion: 2.1 time: 0.232922 Aug 27 05:12:24.630451 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3169/6387] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:24 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1648 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:24.651195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f12f564c-7733-453f-a3b2-05c0a66fd3c4 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:24.652141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f12f564c-7733-453f-a3b2-05c0a66fd3c4 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:24.664241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f12f564c-7733-453f-a3b2-05c0a66fd3c4 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.665053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f12f564c-7733-453f-a3b2-05c0a66fd3c4 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.665679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f12f564c-7733-453f-a3b2-05c0a66fd3c4 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.666612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f12f564c-7733-453f-a3b2-05c0a66fd3c4 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:24.667239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f12f564c-7733-453f-a3b2-05c0a66fd3c4 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:24.667849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f12f564c-7733-453f-a3b2-05c0a66fd3c4 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:24.972368 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f12f564c-7733-453f-a3b2-05c0a66fd3c4 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1648 microversion: 2.1 time: 0.325336 Aug 27 05:12:24.973442 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3219/6388] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:24 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1648 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:24.993877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-33fa6117-2e88-4c28-a18a-b15230460d43 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:24.994758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-33fa6117-2e88-4c28-a18a-b15230460d43 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:25.002218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33fa6117-2e88-4c28-a18a-b15230460d43 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.002933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33fa6117-2e88-4c28-a18a-b15230460d43 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.003537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33fa6117-2e88-4c28-a18a-b15230460d43 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.004417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33fa6117-2e88-4c28-a18a-b15230460d43 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.005194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33fa6117-2e88-4c28-a18a-b15230460d43 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.005797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33fa6117-2e88-4c28-a18a-b15230460d43 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.017129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40271c0b-0930-4c11-b0e4-198d22e1d2a1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:25.017756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40271c0b-0930-4c11-b0e4-198d22e1d2a1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:25.030970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40271c0b-0930-4c11-b0e4-198d22e1d2a1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.031455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40271c0b-0930-4c11-b0e4-198d22e1d2a1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.032448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40271c0b-0930-4c11-b0e4-198d22e1d2a1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.033716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40271c0b-0930-4c11-b0e4-198d22e1d2a1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.034431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40271c0b-0930-4c11-b0e4-198d22e1d2a1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.035313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40271c0b-0930-4c11-b0e4-198d22e1d2a1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.067779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:25.180723 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-33fa6117-2e88-4c28-a18a-b15230460d43 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1648 microversion: 2.1 time: 0.190556 Aug 27 05:12:25.188642 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3170/6389] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:24 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1648 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:25.204267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5b30df01-6dd9-4563-a6e0-b7b5b6c5d79a tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:25.205113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5b30df01-6dd9-4563-a6e0-b7b5b6c5d79a tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:25.212022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b30df01-6dd9-4563-a6e0-b7b5b6c5d79a tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.212945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b30df01-6dd9-4563-a6e0-b7b5b6c5d79a tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.213639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b30df01-6dd9-4563-a6e0-b7b5b6c5d79a tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.214609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b30df01-6dd9-4563-a6e0-b7b5b6c5d79a tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.215291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b30df01-6dd9-4563-a6e0-b7b5b6c5d79a tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.215950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b30df01-6dd9-4563-a6e0-b7b5b6c5d79a tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.254142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5b30df01-6dd9-4563-a6e0-b7b5b6c5d79a tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:12:25.298289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40271c0b-0930-4c11-b0e4-198d22e1d2a1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:25.309959 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40271c0b-0930-4c11-b0e4-198d22e1d2a1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1512 microversion: 2.1 time: 0.298382 Aug 27 05:12:25.311357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:25.312103 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3220/6390] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:25 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1512 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:25.318541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-74d13d13-343b-41f1-9856-2ee52112a3fd req-9e3351af-4841-4e37-bddc-fce561c439bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1de3f97-c882-44a1-bb4e-89e450bdb01e", "name": "network-vif-deleted", "tag": "66099720-3a60-4878-a03f-475ad084c6d4"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:25.333074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-74d13d13-343b-41f1-9856-2ee52112a3fd req-9e3351af-4841-4e37-bddc-fce561c439bb service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.333883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-74d13d13-343b-41f1-9856-2ee52112a3fd req-9e3351af-4841-4e37-bddc-fce561c439bb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.334237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-74d13d13-343b-41f1-9856-2ee52112a3fd req-9e3351af-4841-4e37-bddc-fce561c439bb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.350806 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-74d13d13-343b-41f1-9856-2ee52112a3fd req-9e3351af-4841-4e37-bddc-fce561c439bb service nova] Creating event network-vif-deleted:66099720-3a60-4878-a03f-475ad084c6d4 for instance d1de3f97-c882-44a1-bb4e-89e450bdb01e on n-h1-854823-1 Aug 27 05:12:25.362228 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-74d13d13-343b-41f1-9856-2ee52112a3fd req-9e3351af-4841-4e37-bddc-fce561c439bb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048529 Aug 27 05:12:25.368267 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3221/6391] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:25.409327 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5b30df01-6dd9-4563-a6e0-b7b5b6c5d79a tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "DELETE /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 204 len: 0 microversion: 2.1 time: 0.209566 Aug 27 05:12:25.409937 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3171/6392] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:12:25 2022] DELETE /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:12:25.418833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39943cb8-a305-4977-8db6-e821c25332b3 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:25.419549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39943cb8-a305-4977-8db6-e821c25332b3 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:25.419786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fabb0693-c45c-4e2c-add7-9973777c607b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:25.420388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fabb0693-c45c-4e2c-add7-9973777c607b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:25.426624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39943cb8-a305-4977-8db6-e821c25332b3 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.427824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39943cb8-a305-4977-8db6-e821c25332b3 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.428360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39943cb8-a305-4977-8db6-e821c25332b3 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.429132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39943cb8-a305-4977-8db6-e821c25332b3 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.429601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39943cb8-a305-4977-8db6-e821c25332b3 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.430033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39943cb8-a305-4977-8db6-e821c25332b3 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.439423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabb0693-c45c-4e2c-add7-9973777c607b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.439934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabb0693-c45c-4e2c-add7-9973777c607b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.440374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabb0693-c45c-4e2c-add7-9973777c607b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.441119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabb0693-c45c-4e2c-add7-9973777c607b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.441587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabb0693-c45c-4e2c-add7-9973777c607b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.442020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fabb0693-c45c-4e2c-add7-9973777c607b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.579360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fabb0693-c45c-4e2c-add7-9973777c607b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:25.588810 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fabb0693-c45c-4e2c-add7-9973777c607b tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1225 microversion: 2.1 time: 0.172996 Aug 27 05:12:25.590366 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3172/6393] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:25 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1225 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:25.648501 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39943cb8-a305-4977-8db6-e821c25332b3 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1654 microversion: 2.1 time: 0.233092 Aug 27 05:12:25.650131 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3222/6394] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:25 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1654 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:25.718573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-bfa60c4d-4a92-4a4a-a2d3-84ec0ae503b8 req-ac2c29cf-a9f4-438d-9c7a-9de43ba66114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f9bd9b-ec72-448f-98aa-b22068f937f7", "name": "network-vif-plugged", "status": "completed", "tag": "b7db674b-4f43-4293-83ee-29b5dc589d90"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:25.730951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bfa60c4d-4a92-4a4a-a2d3-84ec0ae503b8 req-ac2c29cf-a9f4-438d-9c7a-9de43ba66114 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:25.731433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bfa60c4d-4a92-4a4a-a2d3-84ec0ae503b8 req-ac2c29cf-a9f4-438d-9c7a-9de43ba66114 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:25.731858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-bfa60c4d-4a92-4a4a-a2d3-84ec0ae503b8 req-ac2c29cf-a9f4-438d-9c7a-9de43ba66114 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:25.745260 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-bfa60c4d-4a92-4a4a-a2d3-84ec0ae503b8 req-ac2c29cf-a9f4-438d-9c7a-9de43ba66114 service nova] Creating event network-vif-plugged:b7db674b-4f43-4293-83ee-29b5dc589d90 for instance 69f9bd9b-ec72-448f-98aa-b22068f937f7 on n-h1-854823-1 Aug 27 05:12:25.751562 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-bfa60c4d-4a92-4a4a-a2d3-84ec0ae503b8 req-ac2c29cf-a9f4-438d-9c7a-9de43ba66114 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038286 Aug 27 05:12:25.752672 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3173/6395] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:26.334353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c4114f0b-c2e4-492d-a450-470301010ea2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:26.335079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c4114f0b-c2e4-492d-a450-470301010ea2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:26.342422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4114f0b-c2e4-492d-a450-470301010ea2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:26.343014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4114f0b-c2e4-492d-a450-470301010ea2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:26.343547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4114f0b-c2e4-492d-a450-470301010ea2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:26.344347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4114f0b-c2e4-492d-a450-470301010ea2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:26.344920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4114f0b-c2e4-492d-a450-470301010ea2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:26.345445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4114f0b-c2e4-492d-a450-470301010ea2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:26.493338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c4114f0b-c2e4-492d-a450-470301010ea2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:26.501897 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c4114f0b-c2e4-492d-a450-470301010ea2 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1512 microversion: 2.1 time: 0.172021 Aug 27 05:12:26.502604 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3223/6396] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:26 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:26.612587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0f3e0192-495e-4e88-8982-e278a91190aa tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:26.613545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0f3e0192-495e-4e88-8982-e278a91190aa tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:26.620193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f3e0192-495e-4e88-8982-e278a91190aa tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:26.620841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f3e0192-495e-4e88-8982-e278a91190aa tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:26.621638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f3e0192-495e-4e88-8982-e278a91190aa tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:26.622433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f3e0192-495e-4e88-8982-e278a91190aa tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:26.622997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f3e0192-495e-4e88-8982-e278a91190aa tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:26.623526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0f3e0192-495e-4e88-8982-e278a91190aa tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:26.671114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ce43c1c-6a26-48ef-8c59-0b11a1a04f32 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:26.671995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9ce43c1c-6a26-48ef-8c59-0b11a1a04f32 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:26.678329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce43c1c-6a26-48ef-8c59-0b11a1a04f32 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:26.679054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce43c1c-6a26-48ef-8c59-0b11a1a04f32 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:26.679679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce43c1c-6a26-48ef-8c59-0b11a1a04f32 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:26.680589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce43c1c-6a26-48ef-8c59-0b11a1a04f32 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:26.681211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce43c1c-6a26-48ef-8c59-0b11a1a04f32 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:26.681804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce43c1c-6a26-48ef-8c59-0b11a1a04f32 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:26.695240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0f3e0192-495e-4e88-8982-e278a91190aa tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:26.706072 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0f3e0192-495e-4e88-8982-e278a91190aa tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1225 microversion: 2.1 time: 0.098753 Aug 27 05:12:26.720840 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3174/6397] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:26 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:26.831236 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ce43c1c-6a26-48ef-8c59-0b11a1a04f32 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1654 microversion: 2.1 time: 0.163765 Aug 27 05:12:26.832202 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3224/6398] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:26 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1654 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:27.523436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a56f5b7d-4395-4ef7-a997-ea0b584be8af tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:27.524359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a56f5b7d-4395-4ef7-a997-ea0b584be8af tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:27.531530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a56f5b7d-4395-4ef7-a997-ea0b584be8af tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.538718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a56f5b7d-4395-4ef7-a997-ea0b584be8af tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.539477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a56f5b7d-4395-4ef7-a997-ea0b584be8af tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.540437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a56f5b7d-4395-4ef7-a997-ea0b584be8af tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.541100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a56f5b7d-4395-4ef7-a997-ea0b584be8af tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.541685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a56f5b7d-4395-4ef7-a997-ea0b584be8af tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.727961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c78026ec-9c28-4f15-abde-27ca6c889b09 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:27.728614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c78026ec-9c28-4f15-abde-27ca6c889b09 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:27.753478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c78026ec-9c28-4f15-abde-27ca6c889b09 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.754229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c78026ec-9c28-4f15-abde-27ca6c889b09 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.754698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c78026ec-9c28-4f15-abde-27ca6c889b09 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.755454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c78026ec-9c28-4f15-abde-27ca6c889b09 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.755926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c78026ec-9c28-4f15-abde-27ca6c889b09 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.756364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c78026ec-9c28-4f15-abde-27ca6c889b09 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.806205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a56f5b7d-4395-4ef7-a997-ea0b584be8af tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:27.818398 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a56f5b7d-4395-4ef7-a997-ea0b584be8af tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1512 microversion: 2.1 time: 0.298801 Aug 27 05:12:27.838288 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3175/6399] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:27 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:27.850067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-fa46f713-d833-4a00-954e-7e57d22e1196 req-cb59200b-9fb9-4a6c-85cf-8f47042d5c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b8b47d-b09a-4cf3-b402-a87f32185c01", "name": "network-vif-deleted", "tag": "a8772ce6-682f-4fbb-81d7-76e609796198"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:27.904522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fa46f713-d833-4a00-954e-7e57d22e1196 req-cb59200b-9fb9-4a6c-85cf-8f47042d5c2e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:27.907139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fa46f713-d833-4a00-954e-7e57d22e1196 req-cb59200b-9fb9-4a6c-85cf-8f47042d5c2e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:27.908776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fa46f713-d833-4a00-954e-7e57d22e1196 req-cb59200b-9fb9-4a6c-85cf-8f47042d5c2e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:27.953186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c78026ec-9c28-4f15-abde-27ca6c889b09 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:27.959318 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-fa46f713-d833-4a00-954e-7e57d22e1196 req-cb59200b-9fb9-4a6c-85cf-8f47042d5c2e service nova] Creating event network-vif-deleted:a8772ce6-682f-4fbb-81d7-76e609796198 for instance e1b8b47d-b09a-4cf3-b402-a87f32185c01 on n-h1-854823-1 Aug 27 05:12:27.967846 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-fa46f713-d833-4a00-954e-7e57d22e1196 req-cb59200b-9fb9-4a6c-85cf-8f47042d5c2e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125200 Aug 27 05:12:27.971896 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3176/6400] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:27.978339 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c78026ec-9c28-4f15-abde-27ca6c889b09 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1225 microversion: 2.1 time: 0.248401 Aug 27 05:12:27.981856 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3225/6401] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:27 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1225 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:27.987197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-76177b61-db01-498f-b003-cc51b4cf83cc tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:27.989168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-76177b61-db01-498f-b003-cc51b4cf83cc tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:28.005075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76177b61-db01-498f-b003-cc51b4cf83cc tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:28.006531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76177b61-db01-498f-b003-cc51b4cf83cc tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:28.009303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76177b61-db01-498f-b003-cc51b4cf83cc tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:28.011702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76177b61-db01-498f-b003-cc51b4cf83cc tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:28.012302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76177b61-db01-498f-b003-cc51b4cf83cc tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:28.013238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76177b61-db01-498f-b003-cc51b4cf83cc tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:28.118305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76177b61-db01-498f-b003-cc51b4cf83cc tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:28.123560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76177b61-db01-498f-b003-cc51b4cf83cc tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:28.125324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-76177b61-db01-498f-b003-cc51b4cf83cc tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:28.127313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-76177b61-db01-498f-b003-cc51b4cf83cc tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lazy-loading 'fault' on Instance uuid e1b8b47d-b09a-4cf3-b402-a87f32185c01 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:28.257447 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-76177b61-db01-498f-b003-cc51b4cf83cc tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 200 len: 1454 microversion: 2.1 time: 0.283779 Aug 27 05:12:28.261752 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3177/6402] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:27 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 1454 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:28.846135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-498d3f9a-59a2-4c4f-a0eb-9bb65eab65a7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:28.846778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-498d3f9a-59a2-4c4f-a0eb-9bb65eab65a7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:28.853842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-498d3f9a-59a2-4c4f-a0eb-9bb65eab65a7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:28.864710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-498d3f9a-59a2-4c4f-a0eb-9bb65eab65a7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:28.865992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-498d3f9a-59a2-4c4f-a0eb-9bb65eab65a7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:28.867068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-498d3f9a-59a2-4c4f-a0eb-9bb65eab65a7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:28.867676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-498d3f9a-59a2-4c4f-a0eb-9bb65eab65a7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:28.868338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-498d3f9a-59a2-4c4f-a0eb-9bb65eab65a7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.002041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-73d70e6a-7a89-46e0-8725-f3f6370259ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:29.003548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-73d70e6a-7a89-46e0-8725-f3f6370259ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:29.030398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73d70e6a-7a89-46e0-8725-f3f6370259ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.032658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73d70e6a-7a89-46e0-8725-f3f6370259ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.036456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73d70e6a-7a89-46e0-8725-f3f6370259ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.039845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73d70e6a-7a89-46e0-8725-f3f6370259ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.043037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73d70e6a-7a89-46e0-8725-f3f6370259ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.045329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73d70e6a-7a89-46e0-8725-f3f6370259ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.070972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-498d3f9a-59a2-4c4f-a0eb-9bb65eab65a7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:29.084320 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-498d3f9a-59a2-4c4f-a0eb-9bb65eab65a7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1507 microversion: 2.1 time: 0.243372 Aug 27 05:12:29.089887 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3226/6403] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:28 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:29.157525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-73d70e6a-7a89-46e0-8725-f3f6370259ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:29.166330 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-73d70e6a-7a89-46e0-8725-f3f6370259ed tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1225 microversion: 2.1 time: 0.170969 Aug 27 05:12:29.167457 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3178/6404] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:28 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1225 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:29.282089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ab010c5-a880-4b78-92ce-7b2c11e54232 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:29.282918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ab010c5-a880-4b78-92ce-7b2c11e54232 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: e1b8b47d-b09a-4cf3-b402-a87f32185c01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:29.289809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ab010c5-a880-4b78-92ce-7b2c11e54232 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.290651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ab010c5-a880-4b78-92ce-7b2c11e54232 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.291410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ab010c5-a880-4b78-92ce-7b2c11e54232 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.292345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ab010c5-a880-4b78-92ce-7b2c11e54232 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.292914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ab010c5-a880-4b78-92ce-7b2c11e54232 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.293611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ab010c5-a880-4b78-92ce-7b2c11e54232 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.307932 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1ab010c5-a880-4b78-92ce-7b2c11e54232 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] HTTP exception thrown: Instance e1b8b47d-b09a-4cf3-b402-a87f32185c01 could not be found. Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ab010c5-a880-4b78-92ce-7b2c11e54232 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Request method failure captured: Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 HTTP/1.1 Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaeUqvGFLVHitiqvLL5Zrv-8smmSvh8bA-1tK7N4fwAv1QPyYxiRPkGfhk7oWLyvdyvV58dX-2G5ahFC01TO_LPQ5lcoTXKHj_IWiyhphmNRk0PbQNocxSB3voI88WAFmGZMm2JyrS2J5w6vboX2owmSpAp6FhJHvTRbwXWMG7NcMws Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 3273e40cb2c1441a88189118fba1afc2 Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestServerMultinode-17214583 Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3273e40cb2c1441a88189118fba1afc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3273e40cb2c1441a88189118fba1afc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3273e40cb2c1441a88189118fba1afc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3273e40cb2c1441a88189118fba1afc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestServerMultinode-17214583 Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 3273e40cb2c1441a88189118fba1afc2 Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestServerMultinode-17214583 Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestServerMultinode-17214583-project-admin Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 4d456f673d624515befe6cf676622ed7 Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestServerMultinode-17214583-project-admin Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance e1b8b47d-b09a-4cf3-b402-a87f32185c01 could not be found. Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'e1b8b47d-b09a-4cf3-b402-a87f32185c01'} Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b8b47d-b09a-4cf3-b402-a87f32185c01 could not be found. Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b8b47d-b09a-4cf3-b402-a87f32185c01 could not be found. Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:29.310170 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:29.315967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:29.315967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:29.315967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:29.315967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:29.315967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:29.315967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b8b47d-b09a-4cf3-b402-a87f32185c01 could not be found. Aug 27 05:12:29.315967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:12:29.315967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ab010c5-a880-4b78-92ce-7b2c11e54232 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Returning 404 to user: Instance e1b8b47d-b09a-4cf3-b402-a87f32185c01 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:29.315967 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ab010c5-a880-4b78-92ce-7b2c11e54232 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01" status: 404 len: 111 microversion: 2.1 time: 0.034706 Aug 27 05:12:29.320622 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3227/6405] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:29 2022] GET /compute/v2.1/servers/e1b8b47d-b09a-4cf3-b402-a87f32185c01 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:12:29.322389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-620e75cc-1d9a-4e3a-ad75-1b3659a5412b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:29.322897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-620e75cc-1d9a-4e3a-ad75-1b3659a5412b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:29.335467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-620e75cc-1d9a-4e3a-ad75-1b3659a5412b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.336899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-620e75cc-1d9a-4e3a-ad75-1b3659a5412b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.337522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-620e75cc-1d9a-4e3a-ad75-1b3659a5412b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.338570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-620e75cc-1d9a-4e3a-ad75-1b3659a5412b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.339289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-620e75cc-1d9a-4e3a-ad75-1b3659a5412b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.340007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-620e75cc-1d9a-4e3a-ad75-1b3659a5412b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.379408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-620e75cc-1d9a-4e3a-ad75-1b3659a5412b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:12:29.547253 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-620e75cc-1d9a-4e3a-ad75-1b3659a5412b tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "DELETE /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 204 len: 0 microversion: 2.1 time: 0.228702 Aug 27 05:12:29.548086 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3179/6406] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:12:29 2022] DELETE /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:12:29.557627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-220c78f7-fe70-4820-a5b5-bcc2e95aa073 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:29.558270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-220c78f7-fe70-4820-a5b5-bcc2e95aa073 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:29.567063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-220c78f7-fe70-4820-a5b5-bcc2e95aa073 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.567634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-220c78f7-fe70-4820-a5b5-bcc2e95aa073 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.568100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-220c78f7-fe70-4820-a5b5-bcc2e95aa073 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.568979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-220c78f7-fe70-4820-a5b5-bcc2e95aa073 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:29.569667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-220c78f7-fe70-4820-a5b5-bcc2e95aa073 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:29.570278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-220c78f7-fe70-4820-a5b5-bcc2e95aa073 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:29.818914 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-220c78f7-fe70-4820-a5b5-bcc2e95aa073 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1655 microversion: 2.1 time: 0.265879 Aug 27 05:12:29.822410 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3228/6407] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:29 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1655 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:30.114459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6ea5d65b-3900-4a0f-aef2-7f487b2b46e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:30.115746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6ea5d65b-3900-4a0f-aef2-7f487b2b46e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:30.127078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ea5d65b-3900-4a0f-aef2-7f487b2b46e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.127834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ea5d65b-3900-4a0f-aef2-7f487b2b46e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.132228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ea5d65b-3900-4a0f-aef2-7f487b2b46e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.136359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ea5d65b-3900-4a0f-aef2-7f487b2b46e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.136922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ea5d65b-3900-4a0f-aef2-7f487b2b46e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.137381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6ea5d65b-3900-4a0f-aef2-7f487b2b46e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.187446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18575ad2-26f9-4974-8e4a-77ee909de898 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:30.188101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18575ad2-26f9-4974-8e4a-77ee909de898 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:30.212419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18575ad2-26f9-4974-8e4a-77ee909de898 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.212987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18575ad2-26f9-4974-8e4a-77ee909de898 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.213441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18575ad2-26f9-4974-8e4a-77ee909de898 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.214179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18575ad2-26f9-4974-8e4a-77ee909de898 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.214649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18575ad2-26f9-4974-8e4a-77ee909de898 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.217673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18575ad2-26f9-4974-8e4a-77ee909de898 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.329740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18575ad2-26f9-4974-8e4a-77ee909de898 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8376c4e2cf814a8b8b1e2a8e404b0187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0535d0245ac4d30bf63b15724beb0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:30.339421 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18575ad2-26f9-4974-8e4a-77ee909de898 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 200 len: 1225 microversion: 2.1 time: 0.155833 Aug 27 05:12:30.342570 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3229/6408] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:30 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 1225 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:30.391848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6ea5d65b-3900-4a0f-aef2-7f487b2b46e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:30.403846 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6ea5d65b-3900-4a0f-aef2-7f487b2b46e0 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1507 microversion: 2.1 time: 0.293420 Aug 27 05:12:30.405393 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3180/6409] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:30 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1507 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:30.847035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc8cdbab-2363-485d-97fd-28fd1b367676 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:30.848126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc8cdbab-2363-485d-97fd-28fd1b367676 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:30.854751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc8cdbab-2363-485d-97fd-28fd1b367676 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.855263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc8cdbab-2363-485d-97fd-28fd1b367676 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.855910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc8cdbab-2363-485d-97fd-28fd1b367676 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:30.856851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc8cdbab-2363-485d-97fd-28fd1b367676 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:30.857623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc8cdbab-2363-485d-97fd-28fd1b367676 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:30.858720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc8cdbab-2363-485d-97fd-28fd1b367676 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:31.057822 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc8cdbab-2363-485d-97fd-28fd1b367676 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1655 microversion: 2.1 time: 0.214462 Aug 27 05:12:31.058681 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3230/6410] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:30 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1655 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:31.369249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8dd2389-44c7-4d35-badf-bec3dae77704 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:31.371192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d8dd2389-44c7-4d35-badf-bec3dae77704 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: d1de3f97-c882-44a1-bb4e-89e450bdb01e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:31.385473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8dd2389-44c7-4d35-badf-bec3dae77704 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:31.386203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8dd2389-44c7-4d35-badf-bec3dae77704 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:31.393180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8dd2389-44c7-4d35-badf-bec3dae77704 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:31.394145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8dd2389-44c7-4d35-badf-bec3dae77704 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:31.394787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8dd2389-44c7-4d35-badf-bec3dae77704 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:31.395384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8dd2389-44c7-4d35-badf-bec3dae77704 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:31.428579 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-d8dd2389-44c7-4d35-badf-bec3dae77704 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance d1de3f97-c882-44a1-bb4e-89e450bdb01e could not be found. Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8dd2389-44c7-4d35-badf-bec3dae77704 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e HTTP/1.1 Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance d1de3f97-c882-44a1-bb4e-89e450bdb01e could not be found. Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'd1de3f97-c882-44a1-bb4e-89e450bdb01e'} Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1de3f97-c882-44a1-bb4e-89e450bdb01e could not be found. Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1de3f97-c882-44a1-bb4e-89e450bdb01e could not be found. Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:31.430303 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:31.441052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:31.441052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:31.441052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:31.441052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:31.441052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:31.441052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1de3f97-c882-44a1-bb4e-89e450bdb01e could not be found. Aug 27 05:12:31.441052 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:31.441052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8dd2389-44c7-4d35-badf-bec3dae77704 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance d1de3f97-c882-44a1-bb4e-89e450bdb01e could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:31.442129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e853f667-4527-40b6-9e99-f5880fc4d0de tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:31.442129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e853f667-4527-40b6-9e99-f5880fc4d0de tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:31.442554 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d8dd2389-44c7-4d35-badf-bec3dae77704 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e" status: 404 len: 111 microversion: 2.1 time: 0.066820 Aug 27 05:12:31.442554 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3181/6411] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:31 2022] GET /compute/v2.1/servers/d1de3f97-c882-44a1-bb4e-89e450bdb01e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:12:31.449261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e853f667-4527-40b6-9e99-f5880fc4d0de tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:31.450018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e853f667-4527-40b6-9e99-f5880fc4d0de tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:31.450698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e853f667-4527-40b6-9e99-f5880fc4d0de tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:31.452149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e853f667-4527-40b6-9e99-f5880fc4d0de tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:31.452861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e853f667-4527-40b6-9e99-f5880fc4d0de tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:31.453939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e853f667-4527-40b6-9e99-f5880fc4d0de tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.080420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e6eadeb-0cec-4eec-8846-1c2ef7bdb107 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:32.081363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e6eadeb-0cec-4eec-8846-1c2ef7bdb107 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:32.104630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e6eadeb-0cec-4eec-8846-1c2ef7bdb107 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.111969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e6eadeb-0cec-4eec-8846-1c2ef7bdb107 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.112806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e6eadeb-0cec-4eec-8846-1c2ef7bdb107 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.122026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e6eadeb-0cec-4eec-8846-1c2ef7bdb107 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.122486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e6eadeb-0cec-4eec-8846-1c2ef7bdb107 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.124179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e6eadeb-0cec-4eec-8846-1c2ef7bdb107 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.228818 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e6eadeb-0cec-4eec-8846-1c2ef7bdb107 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1613 microversion: 2.1 time: 0.152993 Aug 27 05:12:32.243524 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3182/6412] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:32 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1613 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:32.249928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5ec94a92-6fec-4e77-a4ed-b093a9995661 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:32.250620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5ec94a92-6fec-4e77-a4ed-b093a9995661 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:32.257322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ec94a92-6fec-4e77-a4ed-b093a9995661 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.257825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ec94a92-6fec-4e77-a4ed-b093a9995661 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.258350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ec94a92-6fec-4e77-a4ed-b093a9995661 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.259073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ec94a92-6fec-4e77-a4ed-b093a9995661 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.259954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ec94a92-6fec-4e77-a4ed-b093a9995661 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.260399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ec94a92-6fec-4e77-a4ed-b093a9995661 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.276908 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-5ec94a92-6fec-4e77-a4ed-b093a9995661 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5ec94a92-6fec-4e77-a4ed-b093a9995661 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e HTTP/1.1 Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '7a094869-315b-493d-ad12-b727bfae7d9e'} Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:12:32.278505 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:12:32.289673 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:12:32.289673 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:32.289673 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:32.289673 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:32.289673 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:32.289673 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:32.289673 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:32.289673 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:32.289673 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:32.289673 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:12:32.289673 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:32.289673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5ec94a92-6fec-4e77-a4ed-b093a9995661 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:32.289673 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5ec94a92-6fec-4e77-a4ed-b093a9995661 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 404 len: 111 microversion: 2.1 time: 0.035613 Aug 27 05:12:32.289673 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3183/6413] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:12:32 2022] DELETE /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:12:32.291515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e853f667-4527-40b6-9e99-f5880fc4d0de tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:32.291688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-db7b427d-a9fa-4888-9d93-6e93a7790322 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:32.291688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-db7b427d-a9fa-4888-9d93-6e93a7790322 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] [instance: 7a094869-315b-493d-ad12-b727bfae7d9e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:32.296046 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e853f667-4527-40b6-9e99-f5880fc4d0de tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1507 microversion: 2.1 time: 0.870693 Aug 27 05:12:32.309066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db7b427d-a9fa-4888-9d93-6e93a7790322 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.309066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db7b427d-a9fa-4888-9d93-6e93a7790322 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.309066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db7b427d-a9fa-4888-9d93-6e93a7790322 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.309066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db7b427d-a9fa-4888-9d93-6e93a7790322 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.309066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db7b427d-a9fa-4888-9d93-6e93a7790322 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.309066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db7b427d-a9fa-4888-9d93-6e93a7790322 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.310050 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3231/6414] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:31 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1507 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:32.325444 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-db7b427d-a9fa-4888-9d93-6e93a7790322 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] HTTP exception thrown: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-db7b427d-a9fa-4888-9d93-6e93a7790322 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Request method failure captured: Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e HTTP/1.1 Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaQkuAJY0OCDdiPttuU00KVxX-tC9mgFYK0gH-RMLigoW5bKgbLmvHFagzRwkhJbMyuQMrlMwVAtDCC-zAP56mkdTO5FCKQkV0XmdSVOqQnJyFoGteXfGd6V-Rp5W3gGPNxbwmvHxwteLl5hAeTrzpJKr15EgqJepIqJJvglg9mWEDY Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0535d0245ac4d30bf63b15724beb0e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestVolumeBootPattern-982799981 Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: d0535d0245ac4d30bf63b15724beb0e5 Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestVolumeBootPattern-982799981 Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 8376c4e2cf814a8b8b1e2a8e404b0187 Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestVolumeBootPattern-982799981-project Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '7a094869-315b-493d-ad12-b727bfae7d9e'} Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:32.327826 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:32.335531 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:32.335531 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:32.335531 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:32.335531 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:32.335531 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:32.335531 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. Aug 27 05:12:32.335531 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:32.335531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-db7b427d-a9fa-4888-9d93-6e93a7790322 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Returning 404 to user: Instance 7a094869-315b-493d-ad12-b727bfae7d9e could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:32.335531 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-db7b427d-a9fa-4888-9d93-6e93a7790322 tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e" status: 404 len: 111 microversion: 2.1 time: 0.044137 Aug 27 05:12:32.335531 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3184/6415] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:32 2022] GET /compute/v2.1/servers/7a094869-315b-493d-ad12-b727bfae7d9e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:12:32.403645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5fb92b96-41be-4fe9-a33e-088024d4e0c1 req-41095794-63d8-472e-abb4-672960d48301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d762d84-c8ea-4836-994e-aa0b6104e079", "name": "network-vif-deleted", "tag": "1b17c1aa-0dc0-4edb-8d9d-4fd4977d4fcf"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:32.414930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5fb92b96-41be-4fe9-a33e-088024d4e0c1 req-41095794-63d8-472e-abb4-672960d48301 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:32.415471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5fb92b96-41be-4fe9-a33e-088024d4e0c1 req-41095794-63d8-472e-abb4-672960d48301 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:32.415924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5fb92b96-41be-4fe9-a33e-088024d4e0c1 req-41095794-63d8-472e-abb4-672960d48301 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:32.429081 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5fb92b96-41be-4fe9-a33e-088024d4e0c1 req-41095794-63d8-472e-abb4-672960d48301 service nova] Creating event network-vif-deleted:1b17c1aa-0dc0-4edb-8d9d-4fd4977d4fcf for instance 3d762d84-c8ea-4836-994e-aa0b6104e079 on n-h2-854823-1 Aug 27 05:12:32.434657 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5fb92b96-41be-4fe9-a33e-088024d4e0c1 req-41095794-63d8-472e-abb4-672960d48301 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041513 Aug 27 05:12:32.439707 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3232/6416] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:12:33.252947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-17f56705-d55d-4cd7-a9bf-cd8ffb4d7b26 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:33.254291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-17f56705-d55d-4cd7-a9bf-cd8ffb4d7b26 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:33.262905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17f56705-d55d-4cd7-a9bf-cd8ffb4d7b26 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:33.263621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17f56705-d55d-4cd7-a9bf-cd8ffb4d7b26 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:33.264885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17f56705-d55d-4cd7-a9bf-cd8ffb4d7b26 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:33.265993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17f56705-d55d-4cd7-a9bf-cd8ffb4d7b26 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:33.266918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17f56705-d55d-4cd7-a9bf-cd8ffb4d7b26 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:33.267669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17f56705-d55d-4cd7-a9bf-cd8ffb4d7b26 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:33.304336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17f56705-d55d-4cd7-a9bf-cd8ffb4d7b26 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:33.305248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17f56705-d55d-4cd7-a9bf-cd8ffb4d7b26 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:33.305923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17f56705-d55d-4cd7-a9bf-cd8ffb4d7b26 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:33.306389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-17f56705-d55d-4cd7-a9bf-cd8ffb4d7b26 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lazy-loading 'fault' on Instance uuid 3d762d84-c8ea-4836-994e-aa0b6104e079 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:12:33.316987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b9b559b-b315-4bbb-bab0-e760e5b0640e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:33.317928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b9b559b-b315-4bbb-bab0-e760e5b0640e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:33.341570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:33.343868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b9b559b-b315-4bbb-bab0-e760e5b0640e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:33.349268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b9b559b-b315-4bbb-bab0-e760e5b0640e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:33.349753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b9b559b-b315-4bbb-bab0-e760e5b0640e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:33.353539 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b9b559b-b315-4bbb-bab0-e760e5b0640e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:33.354069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b9b559b-b315-4bbb-bab0-e760e5b0640e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:33.354514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b9b559b-b315-4bbb-bab0-e760e5b0640e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:33.428738 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-17f56705-d55d-4cd7-a9bf-cd8ffb4d7b26 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 200 len: 1454 microversion: 2.1 time: 0.180780 Aug 27 05:12:33.430097 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3185/6417] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:33 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:33.533287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b9b559b-b315-4bbb-bab0-e760e5b0640e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:33.544256 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b9b559b-b315-4bbb-bab0-e760e5b0640e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1507 microversion: 2.1 time: 0.231199 Aug 27 05:12:33.545532 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3233/6418] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:33 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:34.450706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6393c6f2-6a11-4188-89a6-dca56a3fa205 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:34.452247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6393c6f2-6a11-4188-89a6-dca56a3fa205 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] [instance: 3d762d84-c8ea-4836-994e-aa0b6104e079] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:34.473688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6393c6f2-6a11-4188-89a6-dca56a3fa205 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:34.474465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6393c6f2-6a11-4188-89a6-dca56a3fa205 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:34.475060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6393c6f2-6a11-4188-89a6-dca56a3fa205 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:34.475950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6393c6f2-6a11-4188-89a6-dca56a3fa205 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:34.476607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6393c6f2-6a11-4188-89a6-dca56a3fa205 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:34.477275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6393c6f2-6a11-4188-89a6-dca56a3fa205 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:34.513965 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-6393c6f2-6a11-4188-89a6-dca56a3fa205 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] HTTP exception thrown: Instance 3d762d84-c8ea-4836-994e-aa0b6104e079 could not be found. Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6393c6f2-6a11-4188-89a6-dca56a3fa205 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Request method failure captured: Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 HTTP/1.1 Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaeUqvGFLVHitiqvLL5Zrv-8smmSvh8bA-1tK7N4fwAv1QPyYxiRPkGfhk7oWLyvdyvV58dX-2G5ahFC01TO_LPQ5lcoTXKHj_IWiyhphmNRk0PbQNocxSB3voI88WAFmGZMm2JyrS2J5w6vboX2owmSpAp6FhJHvTRbwXWMG7NcMws Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 3273e40cb2c1441a88189118fba1afc2 Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestServerMultinode-17214583 Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3273e40cb2c1441a88189118fba1afc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3273e40cb2c1441a88189118fba1afc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3273e40cb2c1441a88189118fba1afc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3273e40cb2c1441a88189118fba1afc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestServerMultinode-17214583 Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 3273e40cb2c1441a88189118fba1afc2 Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestServerMultinode-17214583 Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestServerMultinode-17214583-project-admin Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 4d456f673d624515befe6cf676622ed7 Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestServerMultinode-17214583-project-admin Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 3d762d84-c8ea-4836-994e-aa0b6104e079 could not be found. Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '3d762d84-c8ea-4836-994e-aa0b6104e079'} Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d762d84-c8ea-4836-994e-aa0b6104e079 could not be found. Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d762d84-c8ea-4836-994e-aa0b6104e079 could not be found. Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:12:34.515791 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:34.520445 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:12:34.520445 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:12:34.520445 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:12:34.520445 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:12:34.520445 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:12:34.520445 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d762d84-c8ea-4836-994e-aa0b6104e079 could not be found. Aug 27 05:12:34.520445 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:12:34.522932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6393c6f2-6a11-4188-89a6-dca56a3fa205 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] Returning 404 to user: Instance 3d762d84-c8ea-4836-994e-aa0b6104e079 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:12:34.525576 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6393c6f2-6a11-4188-89a6-dca56a3fa205 tempest-TestServerMultinode-17214583 tempest-TestServerMultinode-17214583-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079" status: 404 len: 111 microversion: 2.1 time: 0.078681 Aug 27 05:12:34.526717 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3186/6419] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:34 2022] GET /compute/v2.1/servers/3d762d84-c8ea-4836-994e-aa0b6104e079 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:12:34.566826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95483f28-af7f-49c8-8ed4-94808dd755c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:34.567900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95483f28-af7f-49c8-8ed4-94808dd755c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:34.585646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95483f28-af7f-49c8-8ed4-94808dd755c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:34.586245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95483f28-af7f-49c8-8ed4-94808dd755c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:34.588035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95483f28-af7f-49c8-8ed4-94808dd755c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:34.589665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95483f28-af7f-49c8-8ed4-94808dd755c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:34.591302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95483f28-af7f-49c8-8ed4-94808dd755c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:34.595087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95483f28-af7f-49c8-8ed4-94808dd755c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:34.884944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95483f28-af7f-49c8-8ed4-94808dd755c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:34.894030 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95483f28-af7f-49c8-8ed4-94808dd755c4 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1507 microversion: 2.1 time: 0.332953 Aug 27 05:12:34.897284 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3234/6420] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:34 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:35.920144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7aaf6d5c-6ef4-40ae-9cd8-a79664ef0199 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:35.920958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7aaf6d5c-6ef4-40ae-9cd8-a79664ef0199 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:35.940556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aaf6d5c-6ef4-40ae-9cd8-a79664ef0199 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:35.941321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aaf6d5c-6ef4-40ae-9cd8-a79664ef0199 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:35.941986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aaf6d5c-6ef4-40ae-9cd8-a79664ef0199 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:35.942906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aaf6d5c-6ef4-40ae-9cd8-a79664ef0199 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:35.943535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aaf6d5c-6ef4-40ae-9cd8-a79664ef0199 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:35.944149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7aaf6d5c-6ef4-40ae-9cd8-a79664ef0199 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:36.406504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7aaf6d5c-6ef4-40ae-9cd8-a79664ef0199 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:36.415694 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7aaf6d5c-6ef4-40ae-9cd8-a79664ef0199 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1507 microversion: 2.1 time: 0.499857 Aug 27 05:12:36.423431 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3187/6421] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:35 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:37.315793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f3ed195-b1f7-41b3-8d3a-a4e36a0fe3ee tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] Calling method '.version_select at 0x7f1f20643a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:37.393877 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f3ed195-b1f7-41b3-8d3a-a4e36a0fe3ee tempest-TestVolumeBootPattern-982799981 tempest-TestVolumeBootPattern-982799981-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1893726088" status: 202 len: 0 microversion: 2.1 time: 0.089577 Aug 27 05:12:37.398300 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3235/6422] 10.222.0.79 () {58 vars in 1263 bytes} [Sat Aug 27 05:12:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1893726088 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:12:37.444167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-748d0904-ae44-4400-aa60-63b15273b17b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:37.445406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-748d0904-ae44-4400-aa60-63b15273b17b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:37.455792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748d0904-ae44-4400-aa60-63b15273b17b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:37.460262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748d0904-ae44-4400-aa60-63b15273b17b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:37.462989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748d0904-ae44-4400-aa60-63b15273b17b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:37.464140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748d0904-ae44-4400-aa60-63b15273b17b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:37.467898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748d0904-ae44-4400-aa60-63b15273b17b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:37.468584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-748d0904-ae44-4400-aa60-63b15273b17b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:37.949054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-748d0904-ae44-4400-aa60-63b15273b17b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:37.966804 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-748d0904-ae44-4400-aa60-63b15273b17b tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1507 microversion: 2.1 time: 0.527278 Aug 27 05:12:37.981729 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3188/6423] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:37 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1507 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:38.994191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-08b7cc8c-1de8-4cd2-b7df-0bed4e749d9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:38.995429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-08b7cc8c-1de8-4cd2-b7df-0bed4e749d9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:39.011024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08b7cc8c-1de8-4cd2-b7df-0bed4e749d9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.013146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08b7cc8c-1de8-4cd2-b7df-0bed4e749d9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.013646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08b7cc8c-1de8-4cd2-b7df-0bed4e749d9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.014597 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08b7cc8c-1de8-4cd2-b7df-0bed4e749d9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:39.018396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08b7cc8c-1de8-4cd2-b7df-0bed4e749d9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:39.018872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08b7cc8c-1de8-4cd2-b7df-0bed4e749d9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:39.423378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-08b7cc8c-1de8-4cd2-b7df-0bed4e749d9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:39.499588 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-08b7cc8c-1de8-4cd2-b7df-0bed4e749d9c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1507 microversion: 2.1 time: 0.510142 Aug 27 05:12:39.525057 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3236/6424] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:38 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1507 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:40.532212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9c1c8fd2-51ae-421e-ae84-a48e538f2fdd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:40.532846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9c1c8fd2-51ae-421e-ae84-a48e538f2fdd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:40.540152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c1c8fd2-51ae-421e-ae84-a48e538f2fdd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.540909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c1c8fd2-51ae-421e-ae84-a48e538f2fdd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.541539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c1c8fd2-51ae-421e-ae84-a48e538f2fdd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.542403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c1c8fd2-51ae-421e-ae84-a48e538f2fdd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:40.543018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c1c8fd2-51ae-421e-ae84-a48e538f2fdd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:40.543596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c1c8fd2-51ae-421e-ae84-a48e538f2fdd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:40.570763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:41.055876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9c1c8fd2-51ae-421e-ae84-a48e538f2fdd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:41.074810 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9c1c8fd2-51ae-421e-ae84-a48e538f2fdd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1507 microversion: 2.1 time: 0.547325 Aug 27 05:12:41.076031 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3189/6425] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:40 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1507 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:42.096493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7d53bc6-35a5-432d-a769-3823b956a49e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:42.097181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7d53bc6-35a5-432d-a769-3823b956a49e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:42.117321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d53bc6-35a5-432d-a769-3823b956a49e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:42.117842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d53bc6-35a5-432d-a769-3823b956a49e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:42.118292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d53bc6-35a5-432d-a769-3823b956a49e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:42.119023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d53bc6-35a5-432d-a769-3823b956a49e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:42.119491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d53bc6-35a5-432d-a769-3823b956a49e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:42.119929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d53bc6-35a5-432d-a769-3823b956a49e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:42.646318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7d53bc6-35a5-432d-a769-3823b956a49e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:42.654622 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7d53bc6-35a5-432d-a769-3823b956a49e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1507 microversion: 2.1 time: 0.563115 Aug 27 05:12:42.665446 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3237/6426] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:42 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1507 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:43.680013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a941138e-ccd6-43f9-aba2-0ecb552a912a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:43.681839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a941138e-ccd6-43f9-aba2-0ecb552a912a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:43.688940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:43.703549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a941138e-ccd6-43f9-aba2-0ecb552a912a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:43.704373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a941138e-ccd6-43f9-aba2-0ecb552a912a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:43.709752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a941138e-ccd6-43f9-aba2-0ecb552a912a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:43.711556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a941138e-ccd6-43f9-aba2-0ecb552a912a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:43.712209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a941138e-ccd6-43f9-aba2-0ecb552a912a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:43.712832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a941138e-ccd6-43f9-aba2-0ecb552a912a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:44.497406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a941138e-ccd6-43f9-aba2-0ecb552a912a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:44.507607 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a941138e-ccd6-43f9-aba2-0ecb552a912a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1507 microversion: 2.1 time: 0.831935 Aug 27 05:12:44.528207 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3190/6427] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:43 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1507 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:45.540031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e78e2d8c-b92a-4373-8c17-45db5aaf50ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:45.540851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e78e2d8c-b92a-4373-8c17-45db5aaf50ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:45.557434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e78e2d8c-b92a-4373-8c17-45db5aaf50ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:45.565535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e78e2d8c-b92a-4373-8c17-45db5aaf50ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:45.569031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e78e2d8c-b92a-4373-8c17-45db5aaf50ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:45.573094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e78e2d8c-b92a-4373-8c17-45db5aaf50ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:45.580376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e78e2d8c-b92a-4373-8c17-45db5aaf50ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:45.583863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e78e2d8c-b92a-4373-8c17-45db5aaf50ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:45.989168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e78e2d8c-b92a-4373-8c17-45db5aaf50ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:46.005108 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e78e2d8c-b92a-4373-8c17-45db5aaf50ad tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1507 microversion: 2.1 time: 0.469333 Aug 27 05:12:46.016949 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3238/6428] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:45 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1507 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:47.042052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-46fbbd66-1998-40b6-8c6f-a795b218f16d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:47.045583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-46fbbd66-1998-40b6-8c6f-a795b218f16d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:47.055920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46fbbd66-1998-40b6-8c6f-a795b218f16d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:47.056461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46fbbd66-1998-40b6-8c6f-a795b218f16d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:47.057203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46fbbd66-1998-40b6-8c6f-a795b218f16d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:47.058054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46fbbd66-1998-40b6-8c6f-a795b218f16d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:47.059975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46fbbd66-1998-40b6-8c6f-a795b218f16d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:47.060930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46fbbd66-1998-40b6-8c6f-a795b218f16d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:47.353339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-46fbbd66-1998-40b6-8c6f-a795b218f16d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:47.368142 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-46fbbd66-1998-40b6-8c6f-a795b218f16d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1507 microversion: 2.1 time: 0.341691 Aug 27 05:12:47.368781 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3191/6429] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:47 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1507 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:48.390798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d64dbb4-92ad-488c-82cb-b9854c1f09ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:48.391348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d64dbb4-92ad-488c-82cb-b9854c1f09ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:48.398533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d64dbb4-92ad-488c-82cb-b9854c1f09ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:48.401319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d64dbb4-92ad-488c-82cb-b9854c1f09ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:48.407177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d64dbb4-92ad-488c-82cb-b9854c1f09ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:48.407953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d64dbb4-92ad-488c-82cb-b9854c1f09ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:48.408439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d64dbb4-92ad-488c-82cb-b9854c1f09ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:48.409075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d64dbb4-92ad-488c-82cb-b9854c1f09ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:48.682269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d64dbb4-92ad-488c-82cb-b9854c1f09ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:48.701423 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d64dbb4-92ad-488c-82cb-b9854c1f09ba tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1504 microversion: 2.1 time: 0.315223 Aug 27 05:12:48.702274 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3239/6430] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:48 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:12:49.642966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d9c961b6-233b-4214-9c5a-ece948046ac2 req-db27dee4-99ac-4407-beaa-ed30466eb768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f9bd9b-ec72-448f-98aa-b22068f937f7", "name": "network-vif-unplugged", "status": "completed", "tag": "b7db674b-4f43-4293-83ee-29b5dc589d90"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:49.668255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d9c961b6-233b-4214-9c5a-ece948046ac2 req-db27dee4-99ac-4407-beaa-ed30466eb768 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:49.668897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d9c961b6-233b-4214-9c5a-ece948046ac2 req-db27dee4-99ac-4407-beaa-ed30466eb768 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:49.669878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d9c961b6-233b-4214-9c5a-ece948046ac2 req-db27dee4-99ac-4407-beaa-ed30466eb768 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:49.687807 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d9c961b6-233b-4214-9c5a-ece948046ac2 req-db27dee4-99ac-4407-beaa-ed30466eb768 service nova] Creating event network-vif-unplugged:b7db674b-4f43-4293-83ee-29b5dc589d90 for instance 69f9bd9b-ec72-448f-98aa-b22068f937f7 on n-h1-854823-1 Aug 27 05:12:49.697249 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d9c961b6-233b-4214-9c5a-ece948046ac2 req-db27dee4-99ac-4407-beaa-ed30466eb768 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063403 Aug 27 05:12:49.698477 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3192/6431] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:12:49.727619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d8ecc30-eb65-4c61-b014-45357d60c410 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:49.728906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d8ecc30-eb65-4c61-b014-45357d60c410 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:49.738179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d8ecc30-eb65-4c61-b014-45357d60c410 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:49.739023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d8ecc30-eb65-4c61-b014-45357d60c410 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:49.739642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d8ecc30-eb65-4c61-b014-45357d60c410 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:49.740713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d8ecc30-eb65-4c61-b014-45357d60c410 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:49.741477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d8ecc30-eb65-4c61-b014-45357d60c410 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:49.742083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d8ecc30-eb65-4c61-b014-45357d60c410 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:49.749874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:49.935586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d8ecc30-eb65-4c61-b014-45357d60c410 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:49.947789 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d8ecc30-eb65-4c61-b014-45357d60c410 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1504 microversion: 2.1 time: 0.226200 Aug 27 05:12:49.949686 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3240/6432] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:49 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:50.971760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-66099617-6e12-49ba-af2f-47cb2a7348b9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:50.974098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-66099617-6e12-49ba-af2f-47cb2a7348b9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:50.995008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66099617-6e12-49ba-af2f-47cb2a7348b9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:50.999678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66099617-6e12-49ba-af2f-47cb2a7348b9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:51.002113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66099617-6e12-49ba-af2f-47cb2a7348b9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:51.003032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66099617-6e12-49ba-af2f-47cb2a7348b9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:51.003684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66099617-6e12-49ba-af2f-47cb2a7348b9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:51.005334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-66099617-6e12-49ba-af2f-47cb2a7348b9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:51.214105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-66099617-6e12-49ba-af2f-47cb2a7348b9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:51.232423 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-66099617-6e12-49ba-af2f-47cb2a7348b9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 200 len: 1447 microversion: 2.1 time: 0.265001 Aug 27 05:12:51.234031 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3193/6433] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:50 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 1447 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:51.260304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-80172301-fa6d-4de9-852b-9138d31c5035 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:51.260957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-80172301-fa6d-4de9-852b-9138d31c5035 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:51.271033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80172301-fa6d-4de9-852b-9138d31c5035 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:51.271906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80172301-fa6d-4de9-852b-9138d31c5035 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:51.272680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80172301-fa6d-4de9-852b-9138d31c5035 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:51.273622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80172301-fa6d-4de9-852b-9138d31c5035 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:51.274441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80172301-fa6d-4de9-852b-9138d31c5035 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:51.275091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80172301-fa6d-4de9-852b-9138d31c5035 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:51.477307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80172301-fa6d-4de9-852b-9138d31c5035 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:51.488937 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-80172301-fa6d-4de9-852b-9138d31c5035 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.232619 Aug 27 05:12:51.489577 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3241/6434] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:51 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:51.528235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e547f262-7723-4349-9559-44424913f05c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:51.529420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e547f262-7723-4349-9559-44424913f05c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:51.536431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e547f262-7723-4349-9559-44424913f05c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:51.537177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e547f262-7723-4349-9559-44424913f05c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:51.537934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e547f262-7723-4349-9559-44424913f05c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:51.538824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e547f262-7723-4349-9559-44424913f05c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:51.539454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e547f262-7723-4349-9559-44424913f05c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:51.540048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e547f262-7723-4349-9559-44424913f05c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:51.736925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e547f262-7723-4349-9559-44424913f05c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:51.749083 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e547f262-7723-4349-9559-44424913f05c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.224318 Aug 27 05:12:51.757445 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3194/6435] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:51 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:51.774679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a51e026-541d-472a-abb1-90f350663ac3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:51.775640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a51e026-541d-472a-abb1-90f350663ac3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:51.788476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a51e026-541d-472a-abb1-90f350663ac3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:51.789236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a51e026-541d-472a-abb1-90f350663ac3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:51.789832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a51e026-541d-472a-abb1-90f350663ac3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:51.791125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a51e026-541d-472a-abb1-90f350663ac3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:51.791734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a51e026-541d-472a-abb1-90f350663ac3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:51.792311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a51e026-541d-472a-abb1-90f350663ac3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:51.979844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2a51e026-541d-472a-abb1-90f350663ac3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:51.990979 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a51e026-541d-472a-abb1-90f350663ac3 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.221339 Aug 27 05:12:52.000846 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3242/6436] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:51 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:52.018967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-65fa6426-afad-4703-8424-33620b1e106c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:52.019597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-65fa6426-afad-4703-8424-33620b1e106c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:52.029973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65fa6426-afad-4703-8424-33620b1e106c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.030547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65fa6426-afad-4703-8424-33620b1e106c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.031006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65fa6426-afad-4703-8424-33620b1e106c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.031873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65fa6426-afad-4703-8424-33620b1e106c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.032588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65fa6426-afad-4703-8424-33620b1e106c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.033234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-65fa6426-afad-4703-8424-33620b1e106c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.227965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-65fa6426-afad-4703-8424-33620b1e106c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:52.237268 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-65fa6426-afad-4703-8424-33620b1e106c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.222267 Aug 27 05:12:52.238213 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3195/6437] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:52 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:52.257955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18633809-2684-4729-b043-41d7162210b1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:12:52.265043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18633809-2684-4729-b043-41d7162210b1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.266428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18633809-2684-4729-b043-41d7162210b1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.267106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18633809-2684-4729-b043-41d7162210b1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.292006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18633809-2684-4729-b043-41d7162210b1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Going to try to stop instance {{(pid=128869) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:12:52.341164 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18633809-2684-4729-b043-41d7162210b1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.087059 Aug 27 05:12:52.342815 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3243/6438] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:12:52 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:12:52.352029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c2b77a4f-6859-425f-a70c-53d99f8300fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:52.353186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c2b77a4f-6859-425f-a70c-53d99f8300fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:52.360685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2b77a4f-6859-425f-a70c-53d99f8300fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.361535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2b77a4f-6859-425f-a70c-53d99f8300fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.362356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2b77a4f-6859-425f-a70c-53d99f8300fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.363305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2b77a4f-6859-425f-a70c-53d99f8300fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:52.364001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2b77a4f-6859-425f-a70c-53d99f8300fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:52.364823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2b77a4f-6859-425f-a70c-53d99f8300fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:52.536210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c2b77a4f-6859-425f-a70c-53d99f8300fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:52.544314 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c2b77a4f-6859-425f-a70c-53d99f8300fc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.196925 Aug 27 05:12:52.545085 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3196/6439] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:52 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:53.566779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fefbe6b0-5483-4fc0-9e42-97485732b2d6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:53.567574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fefbe6b0-5483-4fc0-9e42-97485732b2d6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:53.573831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fefbe6b0-5483-4fc0-9e42-97485732b2d6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:53.574342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fefbe6b0-5483-4fc0-9e42-97485732b2d6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:53.574793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fefbe6b0-5483-4fc0-9e42-97485732b2d6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:53.575997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fefbe6b0-5483-4fc0-9e42-97485732b2d6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:53.576469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fefbe6b0-5483-4fc0-9e42-97485732b2d6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:53.576936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fefbe6b0-5483-4fc0-9e42-97485732b2d6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:53.720484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fefbe6b0-5483-4fc0-9e42-97485732b2d6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:53.728689 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fefbe6b0-5483-4fc0-9e42-97485732b2d6 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.167095 Aug 27 05:12:53.729290 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3244/6440] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:53 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:54.751336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-338859d1-facc-4746-9a10-aca23e8542ab tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:54.751984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-338859d1-facc-4746-9a10-aca23e8542ab tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:54.759515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-338859d1-facc-4746-9a10-aca23e8542ab tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:54.760030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-338859d1-facc-4746-9a10-aca23e8542ab tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:54.760475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-338859d1-facc-4746-9a10-aca23e8542ab tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:54.761240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-338859d1-facc-4746-9a10-aca23e8542ab tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:54.761712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-338859d1-facc-4746-9a10-aca23e8542ab tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:54.762151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-338859d1-facc-4746-9a10-aca23e8542ab tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:54.917374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-338859d1-facc-4746-9a10-aca23e8542ab tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:54.926923 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-338859d1-facc-4746-9a10-aca23e8542ab tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.180138 Aug 27 05:12:54.928648 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3197/6441] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:54 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:55.948604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94eab32d-4a71-43a0-a568-e5920b1c51ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:55.949240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94eab32d-4a71-43a0-a568-e5920b1c51ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:55.956519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94eab32d-4a71-43a0-a568-e5920b1c51ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:55.957058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94eab32d-4a71-43a0-a568-e5920b1c51ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:55.957515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94eab32d-4a71-43a0-a568-e5920b1c51ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:55.958234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94eab32d-4a71-43a0-a568-e5920b1c51ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:55.958713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94eab32d-4a71-43a0-a568-e5920b1c51ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:55.959160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94eab32d-4a71-43a0-a568-e5920b1c51ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:56.096481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94eab32d-4a71-43a0-a568-e5920b1c51ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:56.105313 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94eab32d-4a71-43a0-a568-e5920b1c51ce tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.160749 Aug 27 05:12:56.105915 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3245/6442] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:55 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:57.128292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-63c575a4-6106-4a8e-9073-235e43d1762e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:57.129306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-63c575a4-6106-4a8e-9073-235e43d1762e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:57.136297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63c575a4-6106-4a8e-9073-235e43d1762e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:57.136809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63c575a4-6106-4a8e-9073-235e43d1762e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:57.137335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63c575a4-6106-4a8e-9073-235e43d1762e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:57.138555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63c575a4-6106-4a8e-9073-235e43d1762e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:57.139015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63c575a4-6106-4a8e-9073-235e43d1762e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:57.139431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63c575a4-6106-4a8e-9073-235e43d1762e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:57.276021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-63c575a4-6106-4a8e-9073-235e43d1762e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:57.283935 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-63c575a4-6106-4a8e-9073-235e43d1762e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.159762 Aug 27 05:12:57.284544 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3198/6443] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:57 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:58.305216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c933d801-1f39-4ff3-af83-9538a1075142 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:58.305882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c933d801-1f39-4ff3-af83-9538a1075142 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:58.313892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c933d801-1f39-4ff3-af83-9538a1075142 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:58.314493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c933d801-1f39-4ff3-af83-9538a1075142 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:58.315055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c933d801-1f39-4ff3-af83-9538a1075142 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:58.315809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c933d801-1f39-4ff3-af83-9538a1075142 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:58.316293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c933d801-1f39-4ff3-af83-9538a1075142 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:58.316779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c933d801-1f39-4ff3-af83-9538a1075142 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:58.455835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c933d801-1f39-4ff3-af83-9538a1075142 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:58.464005 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c933d801-1f39-4ff3-af83-9538a1075142 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.162728 Aug 27 05:12:58.464616 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3246/6444] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:58 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:12:59.485868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-caadd87f-97b3-4d12-b98a-675ca431ae48 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:12:59.486482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-caadd87f-97b3-4d12-b98a-675ca431ae48 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:12:59.493411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-caadd87f-97b3-4d12-b98a-675ca431ae48 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:59.494162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-caadd87f-97b3-4d12-b98a-675ca431ae48 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:59.494598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-caadd87f-97b3-4d12-b98a-675ca431ae48 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:59.495283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-caadd87f-97b3-4d12-b98a-675ca431ae48 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:12:59.495986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-caadd87f-97b3-4d12-b98a-675ca431ae48 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:12:59.496422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-caadd87f-97b3-4d12-b98a-675ca431ae48 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:12:59.641803 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-caadd87f-97b3-4d12-b98a-675ca431ae48 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:12:59.650367 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-caadd87f-97b3-4d12-b98a-675ca431ae48 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.168367 Aug 27 05:12:59.650988 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3199/6445] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:12:59 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:00.673347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13edfeaf-c07c-45a9-a65f-57c45dd11c50 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:00.673981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13edfeaf-c07c-45a9-a65f-57c45dd11c50 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:00.682869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13edfeaf-c07c-45a9-a65f-57c45dd11c50 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:00.683381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13edfeaf-c07c-45a9-a65f-57c45dd11c50 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:00.683837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13edfeaf-c07c-45a9-a65f-57c45dd11c50 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:00.684592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13edfeaf-c07c-45a9-a65f-57c45dd11c50 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:00.685072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13edfeaf-c07c-45a9-a65f-57c45dd11c50 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:00.685517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13edfeaf-c07c-45a9-a65f-57c45dd11c50 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:00.819494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13edfeaf-c07c-45a9-a65f-57c45dd11c50 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:00.827690 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13edfeaf-c07c-45a9-a65f-57c45dd11c50 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.158854 Aug 27 05:13:00.828295 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3247/6446] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:00 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:01.327543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1f1d1c98-6d3a-4958-9605-18edfa02ef88 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:01.328073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1f1d1c98-6d3a-4958-9605-18edfa02ef88 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:01.334265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f1d1c98-6d3a-4958-9605-18edfa02ef88 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:01.334757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f1d1c98-6d3a-4958-9605-18edfa02ef88 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:01.335219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f1d1c98-6d3a-4958-9605-18edfa02ef88 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:01.335924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f1d1c98-6d3a-4958-9605-18edfa02ef88 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:01.336385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f1d1c98-6d3a-4958-9605-18edfa02ef88 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:01.336848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f1d1c98-6d3a-4958-9605-18edfa02ef88 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:01.361436 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1f1d1c98-6d3a-4958-9605-18edfa02ef88 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/ips" status: 200 len: 149 microversion: 2.1 time: 0.299684 Aug 27 05:13:01.362010 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3200/6447] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 05:13:01 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/ips => generated 149 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:01.849640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f4c0872a-ff53-48ab-97de-d77ab987093d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:01.850347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f4c0872a-ff53-48ab-97de-d77ab987093d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:01.857811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4c0872a-ff53-48ab-97de-d77ab987093d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:01.858482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4c0872a-ff53-48ab-97de-d77ab987093d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:01.859154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4c0872a-ff53-48ab-97de-d77ab987093d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:01.860095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4c0872a-ff53-48ab-97de-d77ab987093d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:01.860707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4c0872a-ff53-48ab-97de-d77ab987093d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:01.861241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4c0872a-ff53-48ab-97de-d77ab987093d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:02.004212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f4c0872a-ff53-48ab-97de-d77ab987093d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:02.014128 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f4c0872a-ff53-48ab-97de-d77ab987093d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1678 microversion: 2.1 time: 0.168374 Aug 27 05:13:02.014928 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3248/6448] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:01 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:02.724981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1e0c9a60-85d9-4474-b300-5ca4b4f4ea7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97944783-0706-4c21-ba37-1e0aeeb7c422"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:02.727429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1e0c9a60-85d9-4474-b300-5ca4b4f4ea7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:02.734951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e0c9a60-85d9-4474-b300-5ca4b4f4ea7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:02.735449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e0c9a60-85d9-4474-b300-5ca4b4f4ea7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:02.735903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e0c9a60-85d9-4474-b300-5ca4b4f4ea7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:02.736646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e0c9a60-85d9-4474-b300-5ca4b4f4ea7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:02.737113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e0c9a60-85d9-4474-b300-5ca4b4f4ea7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:02.737545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e0c9a60-85d9-4474-b300-5ca4b4f4ea7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:03.015437 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1e0c9a60-85d9-4474-b300-5ca4b4f4ea7b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "POST /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294274 Aug 27 05:13:03.016227 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3201/6449] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:13:02 2022] POST /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:03.035866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2776f38d-4b06-4ebd-9e5e-408c46a41489 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:03.036755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2776f38d-4b06-4ebd-9e5e-408c46a41489 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:03.056043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2776f38d-4b06-4ebd-9e5e-408c46a41489 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:03.056960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2776f38d-4b06-4ebd-9e5e-408c46a41489 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:03.057472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2776f38d-4b06-4ebd-9e5e-408c46a41489 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:03.058221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2776f38d-4b06-4ebd-9e5e-408c46a41489 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:03.058700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2776f38d-4b06-4ebd-9e5e-408c46a41489 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:03.061482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2776f38d-4b06-4ebd-9e5e-408c46a41489 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:03.220122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2776f38d-4b06-4ebd-9e5e-408c46a41489 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:03.230167 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2776f38d-4b06-4ebd-9e5e-408c46a41489 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1655 microversion: 2.1 time: 0.198429 Aug 27 05:13:03.230939 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3249/6450] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:03 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1655 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:03.253266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-71f539cb-4a95-43b1-87da-002cdf7acc2d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:03.261019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71f539cb-4a95-43b1-87da-002cdf7acc2d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:03.261505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71f539cb-4a95-43b1-87da-002cdf7acc2d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:03.262155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71f539cb-4a95-43b1-87da-002cdf7acc2d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:03.287865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-71f539cb-4a95-43b1-87da-002cdf7acc2d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Going to try to start instance {{(pid=128870) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 05:13:03.333355 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-71f539cb-4a95-43b1-87da-002cdf7acc2d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.084011 Aug 27 05:13:03.334214 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3202/6451] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:13:03 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:13:03.342497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9dcad1d2-93e1-4a1e-9c1c-bceb391b5e6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:03.343132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9dcad1d2-93e1-4a1e-9c1c-bceb391b5e6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:03.351578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dcad1d2-93e1-4a1e-9c1c-bceb391b5e6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:03.352096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dcad1d2-93e1-4a1e-9c1c-bceb391b5e6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:03.352580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dcad1d2-93e1-4a1e-9c1c-bceb391b5e6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:03.354504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dcad1d2-93e1-4a1e-9c1c-bceb391b5e6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:03.355250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dcad1d2-93e1-4a1e-9c1c-bceb391b5e6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:03.355892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dcad1d2-93e1-4a1e-9c1c-bceb391b5e6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:03.557695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9dcad1d2-93e1-4a1e-9c1c-bceb391b5e6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:03.575914 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9dcad1d2-93e1-4a1e-9c1c-bceb391b5e6c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1664 microversion: 2.1 time: 0.237327 Aug 27 05:13:03.578066 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3250/6452] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:03 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1664 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:04.600763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2db8d66f-e412-4d5a-ae90-3ca9a2b19f59 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:04.602235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2db8d66f-e412-4d5a-ae90-3ca9a2b19f59 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:04.609684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2db8d66f-e412-4d5a-ae90-3ca9a2b19f59 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:04.610290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2db8d66f-e412-4d5a-ae90-3ca9a2b19f59 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:04.610802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2db8d66f-e412-4d5a-ae90-3ca9a2b19f59 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:04.611580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2db8d66f-e412-4d5a-ae90-3ca9a2b19f59 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:04.612287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2db8d66f-e412-4d5a-ae90-3ca9a2b19f59 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:04.612811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2db8d66f-e412-4d5a-ae90-3ca9a2b19f59 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:04.764231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2db8d66f-e412-4d5a-ae90-3ca9a2b19f59 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:04.772977 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2db8d66f-e412-4d5a-ae90-3ca9a2b19f59 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1664 microversion: 2.1 time: 0.178998 Aug 27 05:13:04.773593 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3203/6453] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:04 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:05.794542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-674ee005-f3d9-41d0-8daf-1166b8942653 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:05.795241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-674ee005-f3d9-41d0-8daf-1166b8942653 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:05.798070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:05.805267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-674ee005-f3d9-41d0-8daf-1166b8942653 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.805728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-674ee005-f3d9-41d0-8daf-1166b8942653 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.806175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-674ee005-f3d9-41d0-8daf-1166b8942653 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.807156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-674ee005-f3d9-41d0-8daf-1166b8942653 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.807633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-674ee005-f3d9-41d0-8daf-1166b8942653 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.808069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-674ee005-f3d9-41d0-8daf-1166b8942653 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.955619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-674ee005-f3d9-41d0-8daf-1166b8942653 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:05.964845 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-674ee005-f3d9-41d0-8daf-1166b8942653 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.174340 Aug 27 05:13:05.965681 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3251/6454] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:05 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:05.987175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6561a711-4d42-4424-bdc1-3e72914c87e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:05.987865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6561a711-4d42-4424-bdc1-3e72914c87e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:05.995930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6561a711-4d42-4424-bdc1-3e72914c87e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.996868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6561a711-4d42-4424-bdc1-3e72914c87e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.997380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6561a711-4d42-4424-bdc1-3e72914c87e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:05.998142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6561a711-4d42-4424-bdc1-3e72914c87e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:05.998666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6561a711-4d42-4424-bdc1-3e72914c87e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:05.999154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6561a711-4d42-4424-bdc1-3e72914c87e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.140229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6561a711-4d42-4424-bdc1-3e72914c87e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:06.142645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:06.150455 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6561a711-4d42-4424-bdc1-3e72914c87e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.167627 Aug 27 05:13:06.151052 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3204/6455] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:05 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:06.175227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-036803f7-58e2-4b39-b8b3-5d8a88b19552 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:06.175880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-036803f7-58e2-4b39-b8b3-5d8a88b19552 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:06.182121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036803f7-58e2-4b39-b8b3-5d8a88b19552 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.182633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036803f7-58e2-4b39-b8b3-5d8a88b19552 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.183090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036803f7-58e2-4b39-b8b3-5d8a88b19552 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.184186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036803f7-58e2-4b39-b8b3-5d8a88b19552 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.188809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036803f7-58e2-4b39-b8b3-5d8a88b19552 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.189454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036803f7-58e2-4b39-b8b3-5d8a88b19552 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.368055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-036803f7-58e2-4b39-b8b3-5d8a88b19552 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:06.389357 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-036803f7-58e2-4b39-b8b3-5d8a88b19552 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.217585 Aug 27 05:13:06.400651 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3252/6456] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:06 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:06.413194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e6e2c667-3eb5-484f-aaa3-2603f936dce9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:06.413715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e6e2c667-3eb5-484f-aaa3-2603f936dce9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:06.422026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6e2c667-3eb5-484f-aaa3-2603f936dce9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.422531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6e2c667-3eb5-484f-aaa3-2603f936dce9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.422972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6e2c667-3eb5-484f-aaa3-2603f936dce9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.423688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6e2c667-3eb5-484f-aaa3-2603f936dce9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.424152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6e2c667-3eb5-484f-aaa3-2603f936dce9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.424631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e6e2c667-3eb5-484f-aaa3-2603f936dce9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.609868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e6e2c667-3eb5-484f-aaa3-2603f936dce9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:06.619226 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e6e2c667-3eb5-484f-aaa3-2603f936dce9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.210547 Aug 27 05:13:06.619749 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3205/6457] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:06 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:06.640324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dcc9b374-2b9b-4417-9918-61c468e0f2ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:06.641324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dcc9b374-2b9b-4417-9918-61c468e0f2ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:06.647652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcc9b374-2b9b-4417-9918-61c468e0f2ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.648414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcc9b374-2b9b-4417-9918-61c468e0f2ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.649045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcc9b374-2b9b-4417-9918-61c468e0f2ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.649944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcc9b374-2b9b-4417-9918-61c468e0f2ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.650577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcc9b374-2b9b-4417-9918-61c468e0f2ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.651264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcc9b374-2b9b-4417-9918-61c468e0f2ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.901532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dcc9b374-2b9b-4417-9918-61c468e0f2ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:06.911790 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dcc9b374-2b9b-4417-9918-61c468e0f2ef tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.275880 Aug 27 05:13:06.913471 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3253/6458] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:06 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:06.932644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d0547267-186a-44c8-8ef2-8bc805e52aa1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:06.933180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d0547267-186a-44c8-8ef2-8bc805e52aa1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:06.939353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0547267-186a-44c8-8ef2-8bc805e52aa1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.939855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0547267-186a-44c8-8ef2-8bc805e52aa1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.940296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0547267-186a-44c8-8ef2-8bc805e52aa1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.941038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0547267-186a-44c8-8ef2-8bc805e52aa1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:06.941761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0547267-186a-44c8-8ef2-8bc805e52aa1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:06.942421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0547267-186a-44c8-8ef2-8bc805e52aa1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:06.970070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-d0547267-186a-44c8-8ef2-8bc805e52aa1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lazy-loading 'flavor' on Instance uuid 3f54d929-acc6-47f3-96a7-708032ccd9d9 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:13:07.051541 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d0547267-186a-44c8-8ef2-8bc805e52aa1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.122561 Aug 27 05:13:07.062361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62eb34e4-ead4-424a-8506-f0d6a9082f9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:07.063380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-62eb34e4-ead4-424a-8506-f0d6a9082f9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:07.067067 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3206/6459] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:13:06 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:13:07.071926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62eb34e4-ead4-424a-8506-f0d6a9082f9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:07.072785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62eb34e4-ead4-424a-8506-f0d6a9082f9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:07.073517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62eb34e4-ead4-424a-8506-f0d6a9082f9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:07.074511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62eb34e4-ead4-424a-8506-f0d6a9082f9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:07.075247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62eb34e4-ead4-424a-8506-f0d6a9082f9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:07.076124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62eb34e4-ead4-424a-8506-f0d6a9082f9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:07.309119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-62eb34e4-ead4-424a-8506-f0d6a9082f9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:07.326721 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62eb34e4-ead4-424a-8506-f0d6a9082f9d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1676 microversion: 2.1 time: 0.269051 Aug 27 05:13:07.327931 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3254/6460] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:07 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1676 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:08.352097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-35fe84b6-812e-4e8f-8cde-8cb76e326fee tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:08.352869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-35fe84b6-812e-4e8f-8cde-8cb76e326fee tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:08.359785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35fe84b6-812e-4e8f-8cde-8cb76e326fee tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.360202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35fe84b6-812e-4e8f-8cde-8cb76e326fee tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.360679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35fe84b6-812e-4e8f-8cde-8cb76e326fee tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.361385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35fe84b6-812e-4e8f-8cde-8cb76e326fee tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.361851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35fe84b6-812e-4e8f-8cde-8cb76e326fee tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.362283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-35fe84b6-812e-4e8f-8cde-8cb76e326fee tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.510093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-35fe84b6-812e-4e8f-8cde-8cb76e326fee tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:08.518416 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-35fe84b6-812e-4e8f-8cde-8cb76e326fee tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1659 microversion: 2.1 time: 0.171469 Aug 27 05:13:08.526439 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3207/6461] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:08 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1659 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:08.539519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86fef0e3-2f0c-4139-8d97-2d4791272323 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:08.540136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86fef0e3-2f0c-4139-8d97-2d4791272323 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:08.547775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86fef0e3-2f0c-4139-8d97-2d4791272323 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.548291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86fef0e3-2f0c-4139-8d97-2d4791272323 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.548774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86fef0e3-2f0c-4139-8d97-2d4791272323 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.549508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86fef0e3-2f0c-4139-8d97-2d4791272323 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.549986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86fef0e3-2f0c-4139-8d97-2d4791272323 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.550603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86fef0e3-2f0c-4139-8d97-2d4791272323 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.578750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:08.622134 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86fef0e3-2f0c-4139-8d97-2d4791272323 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.085949 Aug 27 05:13:08.624598 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3255/6462] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:13:08 2022] POST /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:13:08.633532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2bb91d68-cd9d-4594-a490-9a7cd9e3f1d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:08.634744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2bb91d68-cd9d-4594-a490-9a7cd9e3f1d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:08.645010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bb91d68-cd9d-4594-a490-9a7cd9e3f1d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.645514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bb91d68-cd9d-4594-a490-9a7cd9e3f1d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.645959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bb91d68-cd9d-4594-a490-9a7cd9e3f1d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.646673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bb91d68-cd9d-4594-a490-9a7cd9e3f1d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:08.647137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bb91d68-cd9d-4594-a490-9a7cd9e3f1d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:08.647569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2bb91d68-cd9d-4594-a490-9a7cd9e3f1d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:08.790300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2bb91d68-cd9d-4594-a490-9a7cd9e3f1d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:08.807732 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2bb91d68-cd9d-4594-a490-9a7cd9e3f1d1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1665 microversion: 2.1 time: 0.179427 Aug 27 05:13:08.808585 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3208/6463] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:08 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1665 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:09.832407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd0e4336-b1f5-4622-84eb-ce1898002b03 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:09.833326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd0e4336-b1f5-4622-84eb-ce1898002b03 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:09.840256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd0e4336-b1f5-4622-84eb-ce1898002b03 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:09.840832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd0e4336-b1f5-4622-84eb-ce1898002b03 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:09.841507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd0e4336-b1f5-4622-84eb-ce1898002b03 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.842573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd0e4336-b1f5-4622-84eb-ce1898002b03 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:09.843036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd0e4336-b1f5-4622-84eb-ce1898002b03 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:09.843518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd0e4336-b1f5-4622-84eb-ce1898002b03 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:09.996166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd0e4336-b1f5-4622-84eb-ce1898002b03 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:10.005717 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd0e4336-b1f5-4622-84eb-ce1898002b03 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1665 microversion: 2.1 time: 0.178705 Aug 27 05:13:10.006406 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3256/6464] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:09 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1665 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:11.026992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0ebbab85-4ca7-4edf-881e-8c4607ae6be8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:11.028171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0ebbab85-4ca7-4edf-881e-8c4607ae6be8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:11.037929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ebbab85-4ca7-4edf-881e-8c4607ae6be8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:11.038722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ebbab85-4ca7-4edf-881e-8c4607ae6be8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:11.039196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ebbab85-4ca7-4edf-881e-8c4607ae6be8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:11.040881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ebbab85-4ca7-4edf-881e-8c4607ae6be8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:11.041182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ebbab85-4ca7-4edf-881e-8c4607ae6be8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:11.042009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ebbab85-4ca7-4edf-881e-8c4607ae6be8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:11.217604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0ebbab85-4ca7-4edf-881e-8c4607ae6be8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:11.226198 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0ebbab85-4ca7-4edf-881e-8c4607ae6be8 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.202938 Aug 27 05:13:11.227410 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3209/6465] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:11 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:11.250505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03e7f980-f890-4016-a93c-25429bfe44bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:11.251452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03e7f980-f890-4016-a93c-25429bfe44bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:11.258631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03e7f980-f890-4016-a93c-25429bfe44bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:11.259109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03e7f980-f890-4016-a93c-25429bfe44bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:11.259567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03e7f980-f890-4016-a93c-25429bfe44bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:11.260287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03e7f980-f890-4016-a93c-25429bfe44bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:11.260993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03e7f980-f890-4016-a93c-25429bfe44bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:11.261598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03e7f980-f890-4016-a93c-25429bfe44bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:11.399814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-03e7f980-f890-4016-a93c-25429bfe44bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:11.412060 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03e7f980-f890-4016-a93c-25429bfe44bf tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1668 microversion: 2.1 time: 0.167950 Aug 27 05:13:11.412692 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3257/6466] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:11 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:11.433383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:11.433892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:11.440162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:11.440696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:11.441143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:11.442283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:11.442409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:11.442741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:11.472052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:11.482033 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.compute.api [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Working on deleting snapshot 2814be99-ee5d-47ad-a20c-8c2ca0ffdbf8 from shelved instance... Aug 27 05:13:12.068662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Doing local delete in cell e7bc291f-2aa3-4d66-a942-e096e031ad4c(cell1) {{(pid=128870) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 27 05:13:12.069383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:12.069870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:12.070312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:12.070741 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.compute.api [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 27 05:13:12.074531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] deallocate_for_instance() {{(pid=128870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 27 05:13:12.618392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Updating instance_info_cache with network_info: [] {{(pid=128870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 05:13:12.620174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-338598e9-ba45-4d36-a561-f1a982e895b6 req-200d6105-fac3-4bba-8652-62243927982a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f9bd9b-ec72-448f-98aa-b22068f937f7", "name": "network-vif-deleted", "tag": "b7db674b-4f43-4293-83ee-29b5dc589d90"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:12.639447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-338598e9-ba45-4d36-a561-f1a982e895b6 req-200d6105-fac3-4bba-8652-62243927982a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:12.639938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-338598e9-ba45-4d36-a561-f1a982e895b6 req-200d6105-fac3-4bba-8652-62243927982a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:12.640588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-338598e9-ba45-4d36-a561-f1a982e895b6 req-200d6105-fac3-4bba-8652-62243927982a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:12.678834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.compute.server_external_events [req-338598e9-ba45-4d36-a561-f1a982e895b6 req-200d6105-fac3-4bba-8652-62243927982a service nova] Unable to find a host for instance 69f9bd9b-ec72-448f-98aa-b22068f937f7. Dropping event network-vif-deleted {{(pid=128869) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 05:13:12.679764 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-338598e9-ba45-4d36-a561-f1a982e895b6 req-200d6105-fac3-4bba-8652-62243927982a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.064499 Aug 27 05:13:12.680374 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3258/6467] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 66 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 27 05:13:12.946296 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8d91495e-fd70-4d13-9c87-795a3deea18c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "DELETE /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 204 len: 0 microversion: 2.1 time: 1.516807 Aug 27 05:13:12.947225 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3210/6468] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:11 2022] DELETE /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 0 bytes in 1518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:13:12.955935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7880c8ce-31c7-47ba-b4a5-5d39bb2ba9c7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:12.956598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7880c8ce-31c7-47ba-b4a5-5d39bb2ba9c7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 69f9bd9b-ec72-448f-98aa-b22068f937f7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:12.963440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7880c8ce-31c7-47ba-b4a5-5d39bb2ba9c7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:12.963981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7880c8ce-31c7-47ba-b4a5-5d39bb2ba9c7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:12.964437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7880c8ce-31c7-47ba-b4a5-5d39bb2ba9c7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:12.965192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7880c8ce-31c7-47ba-b4a5-5d39bb2ba9c7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:12.965664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7880c8ce-31c7-47ba-b4a5-5d39bb2ba9c7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:12.966889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7880c8ce-31c7-47ba-b4a5-5d39bb2ba9c7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:12.981185 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7880c8ce-31c7-47ba-b4a5-5d39bb2ba9c7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] HTTP exception thrown: Instance 69f9bd9b-ec72-448f-98aa-b22068f937f7 could not be found. Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7880c8ce-31c7-47ba-b4a5-5d39bb2ba9c7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Request method failure captured: Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 HTTP/1.1 Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaZv2aB3wi4p2ta_SwSOAroy6qWH8PAZgVgvjt7PNCeaO1q9sfV_T1h1o-qcz1FOLmfm-41NolP0vc49g-2MIC8-G8Z_I52AM012oGBtQuU3sFanTjEYda1awukXW4Z1sJJ4GEHRYmxEHv2qli_g5GHzaix6XaX2XvkLh9U24G_dy90 Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 631787d4099e4245be9291f39ff6b2bd Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 631787d4099e4245be9291f39ff6b2bd Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-312006175-project Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: c77d065776e448f08f0a1d6fde1aff3c Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-312006175-project Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 69f9bd9b-ec72-448f-98aa-b22068f937f7 could not be found. Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '69f9bd9b-ec72-448f-98aa-b22068f937f7'} Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f9bd9b-ec72-448f-98aa-b22068f937f7 could not be found. Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f9bd9b-ec72-448f-98aa-b22068f937f7 could not be found. Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:12.983107 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:12.987965 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:12.987965 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:12.987965 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:12.987965 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:12.987965 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:12.987965 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f9bd9b-ec72-448f-98aa-b22068f937f7 could not be found. Aug 27 05:13:12.987965 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:12.989205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7880c8ce-31c7-47ba-b4a5-5d39bb2ba9c7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Returning 404 to user: Instance 69f9bd9b-ec72-448f-98aa-b22068f937f7 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:12.990099 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7880c8ce-31c7-47ba-b4a5-5d39bb2ba9c7 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7" status: 404 len: 111 microversion: 2.1 time: 0.038136 Aug 27 05:13:12.990684 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3259/6469] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:12 2022] GET /compute/v2.1/servers/69f9bd9b-ec72-448f-98aa-b22068f937f7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:12.999196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-64c3cd83-192a-48e6-81df-937c8425722e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:12.999691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-64c3cd83-192a-48e6-81df-937c8425722e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:13.007415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64c3cd83-192a-48e6-81df-937c8425722e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:13.007915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64c3cd83-192a-48e6-81df-937c8425722e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:13.008351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64c3cd83-192a-48e6-81df-937c8425722e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:13.009256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64c3cd83-192a-48e6-81df-937c8425722e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:13.009718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64c3cd83-192a-48e6-81df-937c8425722e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:13.010146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64c3cd83-192a-48e6-81df-937c8425722e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:13.038270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-64c3cd83-192a-48e6-81df-937c8425722e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:13.094570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=19,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:13.129002 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-64c3cd83-192a-48e6-81df-937c8425722e tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 204 len: 0 microversion: 2.1 time: 0.133652 Aug 27 05:13:13.132642 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3211/6470] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:12 2022] DELETE /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:13:13.139116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fada8c98-2152-4cfa-993c-94d08ea51b87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:13.139747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fada8c98-2152-4cfa-993c-94d08ea51b87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:13.146211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fada8c98-2152-4cfa-993c-94d08ea51b87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:13.146708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fada8c98-2152-4cfa-993c-94d08ea51b87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:13.147305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fada8c98-2152-4cfa-993c-94d08ea51b87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:13.148013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fada8c98-2152-4cfa-993c-94d08ea51b87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:13.148496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fada8c98-2152-4cfa-993c-94d08ea51b87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:13.148953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fada8c98-2152-4cfa-993c-94d08ea51b87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:13.232845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fada8c98-2152-4cfa-993c-94d08ea51b87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:13.241077 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fada8c98-2152-4cfa-993c-94d08ea51b87 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 200 len: 1465 microversion: 2.1 time: 0.106686 Aug 27 05:13:13.241662 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3260/6471] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:13 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 1465 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:14.263342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b41d5271-9772-4688-b9ab-88a9480d4f9a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:14.264064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b41d5271-9772-4688-b9ab-88a9480d4f9a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:14.267265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:14.272738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b41d5271-9772-4688-b9ab-88a9480d4f9a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:14.273238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b41d5271-9772-4688-b9ab-88a9480d4f9a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:14.273677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b41d5271-9772-4688-b9ab-88a9480d4f9a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:14.274394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b41d5271-9772-4688-b9ab-88a9480d4f9a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:14.274861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b41d5271-9772-4688-b9ab-88a9480d4f9a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:14.275295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b41d5271-9772-4688-b9ab-88a9480d4f9a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:14.366942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b41d5271-9772-4688-b9ab-88a9480d4f9a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:14.375435 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b41d5271-9772-4688-b9ab-88a9480d4f9a tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 200 len: 1465 microversion: 2.1 time: 0.116418 Aug 27 05:13:14.376025 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3212/6472] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:14 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 1465 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:15.397145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25d7f470-732c-4c57-a1f7-211fc9ca25dc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:15.398426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25d7f470-732c-4c57-a1f7-211fc9ca25dc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:15.406620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25d7f470-732c-4c57-a1f7-211fc9ca25dc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:15.412592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25d7f470-732c-4c57-a1f7-211fc9ca25dc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:15.413944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25d7f470-732c-4c57-a1f7-211fc9ca25dc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:15.420260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25d7f470-732c-4c57-a1f7-211fc9ca25dc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:15.421094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25d7f470-732c-4c57-a1f7-211fc9ca25dc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:15.421769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25d7f470-732c-4c57-a1f7-211fc9ca25dc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:15.585119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25d7f470-732c-4c57-a1f7-211fc9ca25dc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:15.623687 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25d7f470-732c-4c57-a1f7-211fc9ca25dc tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 200 len: 1465 microversion: 2.1 time: 0.230702 Aug 27 05:13:15.624679 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3261/6473] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:15 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 1465 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:15.661707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-68904e99-70af-4829-b269-f9924cbc5809 req-2c2dd524-f950-41a7-b19e-b863534b9658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8325ecc1-c663-4d65-81a3-ba46c2d5e692", "name": "network-vif-deleted", "tag": "69d1487f-d7df-4113-8980-babffb74e9df"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:15.695692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-68904e99-70af-4829-b269-f9924cbc5809 req-2c2dd524-f950-41a7-b19e-b863534b9658 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:15.696362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-68904e99-70af-4829-b269-f9924cbc5809 req-2c2dd524-f950-41a7-b19e-b863534b9658 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:15.697083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-68904e99-70af-4829-b269-f9924cbc5809 req-2c2dd524-f950-41a7-b19e-b863534b9658 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:15.730813 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-68904e99-70af-4829-b269-f9924cbc5809 req-2c2dd524-f950-41a7-b19e-b863534b9658 service nova] Creating event network-vif-deleted:69d1487f-d7df-4113-8980-babffb74e9df for instance 8325ecc1-c663-4d65-81a3-ba46c2d5e692 on n-h2-854823-1 Aug 27 05:13:15.743407 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-68904e99-70af-4829-b269-f9924cbc5809 req-2c2dd524-f950-41a7-b19e-b863534b9658 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086832 Aug 27 05:13:15.744157 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3213/6474] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:16.053361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e60dc64-74b3-445b-a3f6-2d256f67003c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97944783-0706-4c21-ba37-1e0aeeb7c422"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:16.055755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e60dc64-74b3-445b-a3f6-2d256f67003c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:16.064217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e60dc64-74b3-445b-a3f6-2d256f67003c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.065564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e60dc64-74b3-445b-a3f6-2d256f67003c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.066016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e60dc64-74b3-445b-a3f6-2d256f67003c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.066740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e60dc64-74b3-445b-a3f6-2d256f67003c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.067210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e60dc64-74b3-445b-a3f6-2d256f67003c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.067646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e60dc64-74b3-445b-a3f6-2d256f67003c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.155370 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8e60dc64-74b3-445b-a3f6-2d256f67003c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] HTTP exception thrown: Invalid volume: volume 97944783-0706-4c21-ba37-1e0aeeb7c422 is already attached to instances: fda2a251-0067-45d0-b424-3b6214b1c3a5 Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e60dc64-74b3-445b-a3f6-2d256f67003c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Request method failure captured: Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments HTTP/1.1 Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 74 Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaaigp07zvkISHb29u2Quk6NjhbfN1zEDCSkQQoinW0uynW7tNECIjPZRDz_K75qhqu2Icv_5PRsBA8URuVfOgE2knALTSJ-lxCAlMfLfMaApUY2YZNmhuhErGrmBQkx_kPARWtJeBImZcDnJdIllkJtA8jOXs3vwkeuSJPXsJdeNoo Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: dc1b938c06bd432496e8ae8b24965678 Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: {"volumeAttachment": {"volumeId": "97944783-0706-4c21-ba37-1e0aeeb7c422"}} Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid volume: volume 97944783-0706-4c21-ba37-1e0aeeb7c422 is already attached to instances: fda2a251-0067-45d0-b424-3b6214b1c3a5 Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'server_id': 'fda2a251-0067-45d0-b424-3b6214b1c3a5', 'body': {'volumeAttachment': {'volumeId': '97944783-0706-4c21-ba37-1e0aeeb7c422'}}} Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 97944783-0706-4c21-ba37-1e0aeeb7c422 is already attached to instances: fda2a251-0067-45d0-b424-3b6214b1c3a5 Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:13:16.157492 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 97944783-0706-4c21-ba37-1e0aeeb7c422 is already attached to instances: fda2a251-0067-45d0-b424-3b6214b1c3a5 Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 97944783-0706-4c21-ba37-1e0aeeb7c422 is already attached to instances: fda2a251-0067-45d0-b424-3b6214b1c3a5 Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.162406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e60dc64-74b3-445b-a3f6-2d256f67003c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Returning 400 to user: Invalid volume: volume 97944783-0706-4c21-ba37-1e0aeeb7c422 is already attached to instances: fda2a251-0067-45d0-b424-3b6214b1c3a5 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:16.163879 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e60dc64-74b3-445b-a3f6-2d256f67003c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "POST /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113856 Aug 27 05:13:16.167753 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3262/6475] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:13:16 2022] POST /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:13:16.237873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a7c41ff-3fa9-4730-a89a-835412d8e396 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:16.238583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a7c41ff-3fa9-4730-a89a-835412d8e396 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:16.247105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a7c41ff-3fa9-4730-a89a-835412d8e396 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.247765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a7c41ff-3fa9-4730-a89a-835412d8e396 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.248212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a7c41ff-3fa9-4730-a89a-835412d8e396 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.249077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a7c41ff-3fa9-4730-a89a-835412d8e396 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.249529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a7c41ff-3fa9-4730-a89a-835412d8e396 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.250123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a7c41ff-3fa9-4730-a89a-835412d8e396 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.344330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-6a7c41ff-3fa9-4730-a89a-835412d8e396 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lazy-loading 'services' on Instance uuid fda2a251-0067-45d0-b424-3b6214b1c3a5 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:13:16.426152 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a7c41ff-3fa9-4730-a89a-835412d8e396 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments/97944783-0706-4c21-ba37-1e0aeeb7c422" status: 202 len: 0 microversion: 2.1 time: 0.193311 Aug 27 05:13:16.426778 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3214/6476] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:13:16 2022] DELETE /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments/97944783-0706-4c21-ba37-1e0aeeb7c422 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:13:16.437146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09272b97-710e-43aa-8816-07f125d05720 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:16.439453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-09272b97-710e-43aa-8816-07f125d05720 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:16.448359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09272b97-710e-43aa-8816-07f125d05720 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.449168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09272b97-710e-43aa-8816-07f125d05720 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.449716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09272b97-710e-43aa-8816-07f125d05720 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.450527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09272b97-710e-43aa-8816-07f125d05720 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.451638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09272b97-710e-43aa-8816-07f125d05720 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.452143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09272b97-710e-43aa-8816-07f125d05720 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.486377 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09272b97-710e-43aa-8816-07f125d05720 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054244 Aug 27 05:13:16.487846 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3263/6477] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:13:16 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:16.645872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb8172bb-9218-4c79-bbca-e2f0b78015ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:16.646565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eb8172bb-9218-4c79-bbca-e2f0b78015ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 8325ecc1-c663-4d65-81a3-ba46c2d5e692] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:16.652822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb8172bb-9218-4c79-bbca-e2f0b78015ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.653303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb8172bb-9218-4c79-bbca-e2f0b78015ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.653743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb8172bb-9218-4c79-bbca-e2f0b78015ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.654467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb8172bb-9218-4c79-bbca-e2f0b78015ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.654917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb8172bb-9218-4c79-bbca-e2f0b78015ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.655336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb8172bb-9218-4c79-bbca-e2f0b78015ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.670554 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-eb8172bb-9218-4c79-bbca-e2f0b78015ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] HTTP exception thrown: Instance 8325ecc1-c663-4d65-81a3-ba46c2d5e692 could not be found. Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb8172bb-9218-4c79-bbca-e2f0b78015ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Request method failure captured: Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 HTTP/1.1 Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaZv2aB3wi4p2ta_SwSOAroy6qWH8PAZgVgvjt7PNCeaO1q9sfV_T1h1o-qcz1FOLmfm-41NolP0vc49g-2MIC8-G8Z_I52AM012oGBtQuU3sFanTjEYda1awukXW4Z1sJJ4GEHRYmxEHv2qli_g5GHzaix6XaX2XvkLh9U24G_dy90 Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 631787d4099e4245be9291f39ff6b2bd Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 631787d4099e4245be9291f39ff6b2bd Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerActionsTestJSON-312006175-project Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: c77d065776e448f08f0a1d6fde1aff3c Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerActionsTestJSON-312006175-project Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 8325ecc1-c663-4d65-81a3-ba46c2d5e692 could not be found. Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '8325ecc1-c663-4d65-81a3-ba46c2d5e692'} Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8325ecc1-c663-4d65-81a3-ba46c2d5e692 could not be found. Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8325ecc1-c663-4d65-81a3-ba46c2d5e692 could not be found. Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:16.672267 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.676457 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:16.676457 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:16.676457 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:16.676457 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:16.676457 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:16.676457 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8325ecc1-c663-4d65-81a3-ba46c2d5e692 could not be found. Aug 27 05:13:16.676457 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:16.676457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb8172bb-9218-4c79-bbca-e2f0b78015ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Returning 404 to user: Instance 8325ecc1-c663-4d65-81a3-ba46c2d5e692 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:16.676457 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb8172bb-9218-4c79-bbca-e2f0b78015ac tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692" status: 404 len: 111 microversion: 2.1 time: 0.032229 Aug 27 05:13:16.676457 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3215/6478] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:16 2022] GET /compute/v2.1/servers/8325ecc1-c663-4d65-81a3-ba46c2d5e692 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:16.683145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-457224d3-7d68-40c1-8894-9addce586615 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:16.683655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-457224d3-7d68-40c1-8894-9addce586615 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:16.691664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-457224d3-7d68-40c1-8894-9addce586615 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.691664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-457224d3-7d68-40c1-8894-9addce586615 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.691664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-457224d3-7d68-40c1-8894-9addce586615 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.692305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-457224d3-7d68-40c1-8894-9addce586615 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.692800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-457224d3-7d68-40c1-8894-9addce586615 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.693241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-457224d3-7d68-40c1-8894-9addce586615 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.719998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-457224d3-7d68-40c1-8894-9addce586615 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:16.806879 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-457224d3-7d68-40c1-8894-9addce586615 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 204 len: 0 microversion: 2.1 time: 0.127297 Aug 27 05:13:16.812463 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3264/6479] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:16 2022] DELETE /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:13:16.819655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3ece1ac2-ec3d-4c43-85fd-17d492d2ded1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:16.820307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3ece1ac2-ec3d-4c43-85fd-17d492d2ded1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:16.827494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ece1ac2-ec3d-4c43-85fd-17d492d2ded1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.827998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ece1ac2-ec3d-4c43-85fd-17d492d2ded1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.828473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ece1ac2-ec3d-4c43-85fd-17d492d2ded1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:16.829368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ece1ac2-ec3d-4c43-85fd-17d492d2ded1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:16.829832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ece1ac2-ec3d-4c43-85fd-17d492d2ded1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:16.830779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ece1ac2-ec3d-4c43-85fd-17d492d2ded1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:17.000787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3ece1ac2-ec3d-4c43-85fd-17d492d2ded1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:17.011624 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3ece1ac2-ec3d-4c43-85fd-17d492d2ded1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1508 microversion: 2.1 time: 0.196902 Aug 27 05:13:17.013091 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3216/6480] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:16 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:17.500235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc3dbf0a-d116-4465-b813-af235110641d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:17.502621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bc3dbf0a-d116-4465-b813-af235110641d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:17.520075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3dbf0a-d116-4465-b813-af235110641d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:17.520772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3dbf0a-d116-4465-b813-af235110641d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:17.521325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3dbf0a-d116-4465-b813-af235110641d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:17.522164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3dbf0a-d116-4465-b813-af235110641d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:17.522740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3dbf0a-d116-4465-b813-af235110641d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:17.523279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3dbf0a-d116-4465-b813-af235110641d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:17.559903 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc3dbf0a-d116-4465-b813-af235110641d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064244 Aug 27 05:13:17.565642 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3265/6481] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:13:17 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:18.034381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e5fe2d0d-0dd1-4ea0-85fe-9e0938c1b26d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:18.035612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e5fe2d0d-0dd1-4ea0-85fe-9e0938c1b26d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:18.043488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5fe2d0d-0dd1-4ea0-85fe-9e0938c1b26d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:18.044238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5fe2d0d-0dd1-4ea0-85fe-9e0938c1b26d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:18.045445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5fe2d0d-0dd1-4ea0-85fe-9e0938c1b26d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:18.046331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5fe2d0d-0dd1-4ea0-85fe-9e0938c1b26d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:18.046959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5fe2d0d-0dd1-4ea0-85fe-9e0938c1b26d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:18.047577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e5fe2d0d-0dd1-4ea0-85fe-9e0938c1b26d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:18.196901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e5fe2d0d-0dd1-4ea0-85fe-9e0938c1b26d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:18.217806 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e5fe2d0d-0dd1-4ea0-85fe-9e0938c1b26d tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1508 microversion: 2.1 time: 0.182481 Aug 27 05:13:18.222268 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3217/6482] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:18 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:18.573675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d6e7ea6-b9af-484f-a019-e492f82ecd04 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:18.576183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1d6e7ea6-b9af-484f-a019-e492f82ecd04 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:18.583657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d6e7ea6-b9af-484f-a019-e492f82ecd04 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:18.584173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d6e7ea6-b9af-484f-a019-e492f82ecd04 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:18.584665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d6e7ea6-b9af-484f-a019-e492f82ecd04 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:18.585420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d6e7ea6-b9af-484f-a019-e492f82ecd04 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:18.586046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d6e7ea6-b9af-484f-a019-e492f82ecd04 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:18.586497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d6e7ea6-b9af-484f-a019-e492f82ecd04 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:18.623800 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d6e7ea6-b9af-484f-a019-e492f82ecd04 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054369 Aug 27 05:13:18.629157 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3266/6483] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:13:18 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:19.244472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b65a81ea-51d5-40c3-ad55-503a752cc550 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:19.245113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b65a81ea-51d5-40c3-ad55-503a752cc550 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:19.259699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e24127a5-503a-4cc8-ae46-bef9f1d328e6 req-97308442-fad3-48da-a279-63f873c128de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7633563-6f4b-43e7-8cee-b12816f797b1", "name": "network-vif-deleted", "tag": "c0a18698-a5ef-4ff7-a331-35a65ce4e762"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:19.270345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b65a81ea-51d5-40c3-ad55-503a752cc550 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:19.270788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b65a81ea-51d5-40c3-ad55-503a752cc550 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:19.271389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b65a81ea-51d5-40c3-ad55-503a752cc550 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:19.272072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b65a81ea-51d5-40c3-ad55-503a752cc550 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:19.272567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b65a81ea-51d5-40c3-ad55-503a752cc550 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:19.273011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b65a81ea-51d5-40c3-ad55-503a752cc550 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:19.274692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e24127a5-503a-4cc8-ae46-bef9f1d328e6 req-97308442-fad3-48da-a279-63f873c128de service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:19.275359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e24127a5-503a-4cc8-ae46-bef9f1d328e6 req-97308442-fad3-48da-a279-63f873c128de service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:19.276102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e24127a5-503a-4cc8-ae46-bef9f1d328e6 req-97308442-fad3-48da-a279-63f873c128de service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:19.293061 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e24127a5-503a-4cc8-ae46-bef9f1d328e6 req-97308442-fad3-48da-a279-63f873c128de service nova] Creating event network-vif-deleted:c0a18698-a5ef-4ff7-a331-35a65ce4e762 for instance c7633563-6f4b-43e7-8cee-b12816f797b1 on n-h1-854823-1 Aug 27 05:13:19.301869 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e24127a5-503a-4cc8-ae46-bef9f1d328e6 req-97308442-fad3-48da-a279-63f873c128de service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047041 Aug 27 05:13:19.307460 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3267/6484] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:19.393238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b65a81ea-51d5-40c3-ad55-503a752cc550 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:19.403470 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b65a81ea-51d5-40c3-ad55-503a752cc550 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1466 microversion: 2.1 time: 0.163446 Aug 27 05:13:19.404406 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3218/6485] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:19 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1466 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:19.637502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ccdc41e4-3a78-4ed9-b8b7-5572ae209875 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:19.641068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ccdc41e4-3a78-4ed9-b8b7-5572ae209875 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:19.649914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccdc41e4-3a78-4ed9-b8b7-5572ae209875 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:19.667308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccdc41e4-3a78-4ed9-b8b7-5572ae209875 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:19.668632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccdc41e4-3a78-4ed9-b8b7-5572ae209875 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:19.670156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccdc41e4-3a78-4ed9-b8b7-5572ae209875 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:19.670821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccdc41e4-3a78-4ed9-b8b7-5572ae209875 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:19.672028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccdc41e4-3a78-4ed9-b8b7-5572ae209875 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:19.715420 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ccdc41e4-3a78-4ed9-b8b7-5572ae209875 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082449 Aug 27 05:13:19.716391 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3268/6486] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:13:19 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:20.425801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b22aedff-d75e-431b-ac0d-77d49289e674 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:20.427275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b22aedff-d75e-431b-ac0d-77d49289e674 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:20.435090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22aedff-d75e-431b-ac0d-77d49289e674 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.435606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22aedff-d75e-431b-ac0d-77d49289e674 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.436041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22aedff-d75e-431b-ac0d-77d49289e674 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.436767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22aedff-d75e-431b-ac0d-77d49289e674 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.437223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22aedff-d75e-431b-ac0d-77d49289e674 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.437789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22aedff-d75e-431b-ac0d-77d49289e674 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.474024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22aedff-d75e-431b-ac0d-77d49289e674 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.474559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22aedff-d75e-431b-ac0d-77d49289e674 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.475028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22aedff-d75e-431b-ac0d-77d49289e674 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.475527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-b22aedff-d75e-431b-ac0d-77d49289e674 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lazy-loading 'fault' on Instance uuid c7633563-6f4b-43e7-8cee-b12816f797b1 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:13:20.523858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b22aedff-d75e-431b-ac0d-77d49289e674 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:20.540085 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b22aedff-d75e-431b-ac0d-77d49289e674 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 200 len: 1305 microversion: 2.1 time: 0.118068 Aug 27 05:13:20.541155 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3219/6487] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:20 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:20.727938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5fcc0863-6b68-4368-9cf5-4468496d7f48 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:20.730697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5fcc0863-6b68-4368-9cf5-4468496d7f48 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:20.737872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fcc0863-6b68-4368-9cf5-4468496d7f48 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.738595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fcc0863-6b68-4368-9cf5-4468496d7f48 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.739264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fcc0863-6b68-4368-9cf5-4468496d7f48 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.740320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fcc0863-6b68-4368-9cf5-4468496d7f48 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:20.740982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fcc0863-6b68-4368-9cf5-4468496d7f48 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:20.741769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fcc0863-6b68-4368-9cf5-4468496d7f48 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:20.777964 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5fcc0863-6b68-4368-9cf5-4468496d7f48 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054286 Aug 27 05:13:20.778810 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3269/6488] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:13:20 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:21.561917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3ae61342-5f42-4b4e-9de1-ef90b48a38e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:21.562746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3ae61342-5f42-4b4e-9de1-ef90b48a38e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: c7633563-6f4b-43e7-8cee-b12816f797b1] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:21.570747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ae61342-5f42-4b4e-9de1-ef90b48a38e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.571240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ae61342-5f42-4b4e-9de1-ef90b48a38e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.571714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ae61342-5f42-4b4e-9de1-ef90b48a38e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.572383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ae61342-5f42-4b4e-9de1-ef90b48a38e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.577923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ae61342-5f42-4b4e-9de1-ef90b48a38e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.578374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ae61342-5f42-4b4e-9de1-ef90b48a38e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.602355 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-3ae61342-5f42-4b4e-9de1-ef90b48a38e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] HTTP exception thrown: Instance c7633563-6f4b-43e7-8cee-b12816f797b1 could not be found. Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3ae61342-5f42-4b4e-9de1-ef90b48a38e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Request method failure captured: Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 HTTP/1.1 Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaZv2aB3wi4p2ta_SwSOAroy6qWH8PAZgVgvjt7PNCeaO1q9sfV_T1h1o-qcz1FOLmfm-41NolP0vc49g-2MIC8-G8Z_I52AM012oGBtQuU3sFanTjEYda1awukXW4Z1sJJ4GEHRYmxEHv2qli_g5GHzaix6XaX2XvkLh9U24G_dy90 Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 631787d4099e4245be9291f39ff6b2bd Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 631787d4099e4245be9291f39ff6b2bd Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerActionsTestJSON-312006175-project Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: c77d065776e448f08f0a1d6fde1aff3c Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerActionsTestJSON-312006175-project Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance c7633563-6f4b-43e7-8cee-b12816f797b1 could not be found. Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'c7633563-6f4b-43e7-8cee-b12816f797b1'} Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7633563-6f4b-43e7-8cee-b12816f797b1 could not be found. Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7633563-6f4b-43e7-8cee-b12816f797b1 could not be found. Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:21.605401 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:21.610672 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:21.610672 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:21.610672 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:21.610672 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:21.610672 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:21.610672 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7633563-6f4b-43e7-8cee-b12816f797b1 could not be found. Aug 27 05:13:21.610672 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:21.610672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3ae61342-5f42-4b4e-9de1-ef90b48a38e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Returning 404 to user: Instance c7633563-6f4b-43e7-8cee-b12816f797b1 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:21.610672 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3ae61342-5f42-4b4e-9de1-ef90b48a38e5 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1" status: 404 len: 111 microversion: 2.1 time: 0.049185 Aug 27 05:13:21.610672 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3220/6489] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:21 2022] GET /compute/v2.1/servers/c7633563-6f4b-43e7-8cee-b12816f797b1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:13:21.619019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-346799ff-cb65-4e75-be7e-770a56a69289 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:21.620821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-346799ff-cb65-4e75-be7e-770a56a69289 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:21.630689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346799ff-cb65-4e75-be7e-770a56a69289 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.631565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346799ff-cb65-4e75-be7e-770a56a69289 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.632211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346799ff-cb65-4e75-be7e-770a56a69289 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.633486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346799ff-cb65-4e75-be7e-770a56a69289 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.634078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346799ff-cb65-4e75-be7e-770a56a69289 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.634770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346799ff-cb65-4e75-be7e-770a56a69289 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.663315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-346799ff-cb65-4e75-be7e-770a56a69289 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:21.707952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:21.760133 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-346799ff-cb65-4e75-be7e-770a56a69289 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 204 len: 0 microversion: 2.1 time: 0.146614 Aug 27 05:13:21.760978 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3270/6490] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:21 2022] DELETE /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:13:21.769431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-64ef1d1f-446e-4088-a79d-007e891979dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:21.770278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-64ef1d1f-446e-4088-a79d-007e891979dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:21.776646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64ef1d1f-446e-4088-a79d-007e891979dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.777356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64ef1d1f-446e-4088-a79d-007e891979dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.777966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64ef1d1f-446e-4088-a79d-007e891979dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.778829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64ef1d1f-446e-4088-a79d-007e891979dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.779485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64ef1d1f-446e-4088-a79d-007e891979dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.780066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-64ef1d1f-446e-4088-a79d-007e891979dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.791343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9051171-c783-481f-b4db-2ce50f128d85 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:21.793612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9051171-c783-481f-b4db-2ce50f128d85 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:21.800501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9051171-c783-481f-b4db-2ce50f128d85 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.801542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9051171-c783-481f-b4db-2ce50f128d85 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.802159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9051171-c783-481f-b4db-2ce50f128d85 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.803066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9051171-c783-481f-b4db-2ce50f128d85 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.803695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9051171-c783-481f-b4db-2ce50f128d85 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.804367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9051171-c783-481f-b4db-2ce50f128d85 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.840515 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9051171-c783-481f-b4db-2ce50f128d85 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053482 Aug 27 05:13:21.841534 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3271/6491] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:13:21 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 05:13:21.921011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30badf85-5a66-4359-a117-fa3522f72b50 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:21.921788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-30badf85-5a66-4359-a117-fa3522f72b50 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:21.928335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30badf85-5a66-4359-a117-fa3522f72b50 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.929119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30badf85-5a66-4359-a117-fa3522f72b50 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.929905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30badf85-5a66-4359-a117-fa3522f72b50 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.930801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30badf85-5a66-4359-a117-fa3522f72b50 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:21.931439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30badf85-5a66-4359-a117-fa3522f72b50 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:21.932254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30badf85-5a66-4359-a117-fa3522f72b50 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:21.947218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-64ef1d1f-446e-4088-a79d-007e891979dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:21.955931 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-64ef1d1f-446e-4088-a79d-007e891979dd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1493 microversion: 2.1 time: 0.190155 Aug 27 05:13:21.964863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-30badf85-5a66-4359-a117-fa3522f72b50 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:21.969904 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3221/6492] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:21 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1493 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:22.056946 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-30badf85-5a66-4359-a117-fa3522f72b50 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 204 len: 0 microversion: 2.1 time: 0.140680 Aug 27 05:13:22.063757 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3272/6493] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:21 2022] DELETE /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:13:22.069225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6d2b50f7-75fa-4801-bb33-f1042eec56ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:22.069849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6d2b50f7-75fa-4801-bb33-f1042eec56ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:22.076840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d2b50f7-75fa-4801-bb33-f1042eec56ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:22.077307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d2b50f7-75fa-4801-bb33-f1042eec56ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:22.078068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d2b50f7-75fa-4801-bb33-f1042eec56ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:22.078888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d2b50f7-75fa-4801-bb33-f1042eec56ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:22.079370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d2b50f7-75fa-4801-bb33-f1042eec56ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:22.079996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6d2b50f7-75fa-4801-bb33-f1042eec56ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:22.229536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6d2b50f7-75fa-4801-bb33-f1042eec56ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:22.242515 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6d2b50f7-75fa-4801-bb33-f1042eec56ac tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1681 microversion: 2.1 time: 0.177833 Aug 27 05:13:22.256560 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3222/6494] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:22 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:22.978014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1890f57f-e515-4e17-9826-d9048bff0858 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:22.978778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1890f57f-e515-4e17-9826-d9048bff0858 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:22.985575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1890f57f-e515-4e17-9826-d9048bff0858 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:22.986187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1890f57f-e515-4e17-9826-d9048bff0858 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:22.986711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1890f57f-e515-4e17-9826-d9048bff0858 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:22.987502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1890f57f-e515-4e17-9826-d9048bff0858 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:22.988050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1890f57f-e515-4e17-9826-d9048bff0858 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:22.988612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1890f57f-e515-4e17-9826-d9048bff0858 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:23.211569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1890f57f-e515-4e17-9826-d9048bff0858 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:23.219766 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1890f57f-e515-4e17-9826-d9048bff0858 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1493 microversion: 2.1 time: 0.246101 Aug 27 05:13:23.221292 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3273/6495] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:22 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1493 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:23.266417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-83b09be2-bc06-471d-967f-716664524c91 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:23.267206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-83b09be2-bc06-471d-967f-716664524c91 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:23.275997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83b09be2-bc06-471d-967f-716664524c91 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:23.277018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83b09be2-bc06-471d-967f-716664524c91 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:23.277673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83b09be2-bc06-471d-967f-716664524c91 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:23.278625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83b09be2-bc06-471d-967f-716664524c91 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:23.279339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83b09be2-bc06-471d-967f-716664524c91 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:23.280306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83b09be2-bc06-471d-967f-716664524c91 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:23.462292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-83b09be2-bc06-471d-967f-716664524c91 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:23.471162 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-83b09be2-bc06-471d-967f-716664524c91 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1681 microversion: 2.1 time: 0.209451 Aug 27 05:13:23.472137 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3223/6496] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:23 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:24.243250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd9bd577-b5a9-4c6b-888d-45e4256c40bd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:24.244562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd9bd577-b5a9-4c6b-888d-45e4256c40bd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:24.252562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd9bd577-b5a9-4c6b-888d-45e4256c40bd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:24.253363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd9bd577-b5a9-4c6b-888d-45e4256c40bd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:24.254054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd9bd577-b5a9-4c6b-888d-45e4256c40bd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:24.255093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd9bd577-b5a9-4c6b-888d-45e4256c40bd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:24.255865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd9bd577-b5a9-4c6b-888d-45e4256c40bd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:24.256477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd9bd577-b5a9-4c6b-888d-45e4256c40bd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:24.495637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-02ba8c4c-c5bf-4903-ab1c-b611f5004c37 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:24.496264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-02ba8c4c-c5bf-4903-ab1c-b611f5004c37 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:24.516860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02ba8c4c-c5bf-4903-ab1c-b611f5004c37 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:24.517364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02ba8c4c-c5bf-4903-ab1c-b611f5004c37 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:24.517810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02ba8c4c-c5bf-4903-ab1c-b611f5004c37 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:24.518529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02ba8c4c-c5bf-4903-ab1c-b611f5004c37 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:24.518991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02ba8c4c-c5bf-4903-ab1c-b611f5004c37 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:24.519421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-02ba8c4c-c5bf-4903-ab1c-b611f5004c37 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:24.663405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd9bd577-b5a9-4c6b-888d-45e4256c40bd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:24.676606 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd9bd577-b5a9-4c6b-888d-45e4256c40bd tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 200 len: 1493 microversion: 2.1 time: 0.436914 Aug 27 05:13:24.677274 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3274/6497] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:24 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 1493 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:24.740234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-92e007d8-1c87-4f64-9513-f3e2a1a3387e req-ebdc43c6-16a4-4da6-a5e7-b135d79ca431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d82ec7-fd33-4c19-a1fa-7c315638e864", "name": "network-vif-deleted", "tag": "d994e15f-12a7-4d03-8d1f-a78bdfb5f9f3"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:24.767940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-92e007d8-1c87-4f64-9513-f3e2a1a3387e req-ebdc43c6-16a4-4da6-a5e7-b135d79ca431 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:24.768395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-92e007d8-1c87-4f64-9513-f3e2a1a3387e req-ebdc43c6-16a4-4da6-a5e7-b135d79ca431 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:24.768888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-92e007d8-1c87-4f64-9513-f3e2a1a3387e req-ebdc43c6-16a4-4da6-a5e7-b135d79ca431 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:24.802425 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-92e007d8-1c87-4f64-9513-f3e2a1a3387e req-ebdc43c6-16a4-4da6-a5e7-b135d79ca431 service nova] Creating event network-vif-deleted:d994e15f-12a7-4d03-8d1f-a78bdfb5f9f3 for instance f9d82ec7-fd33-4c19-a1fa-7c315638e864 on n-h1-854823-1 Aug 27 05:13:24.817810 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-92e007d8-1c87-4f64-9513-f3e2a1a3387e req-ebdc43c6-16a4-4da6-a5e7-b135d79ca431 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082433 Aug 27 05:13:24.818449 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3275/6498] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:24.864789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-02ba8c4c-c5bf-4903-ab1c-b611f5004c37 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:24.878840 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-02ba8c4c-c5bf-4903-ab1c-b611f5004c37 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1681 microversion: 2.1 time: 0.388505 Aug 27 05:13:24.879711 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3224/6499] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:24 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1681 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:25.485651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8a65565a-9a80-4e3c-b02c-2e6061366989 req-ad4ad324-d2f6-4468-9a14-7abc13f357f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda2a251-0067-45d0-b424-3b6214b1c3a5", "name": "network-vif-deleted", "tag": "fb4bfa18-8d02-4ee3-b43c-9382211134ba"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:25.497204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8a65565a-9a80-4e3c-b02c-2e6061366989 req-ad4ad324-d2f6-4468-9a14-7abc13f357f7 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.497911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8a65565a-9a80-4e3c-b02c-2e6061366989 req-ad4ad324-d2f6-4468-9a14-7abc13f357f7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.498418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8a65565a-9a80-4e3c-b02c-2e6061366989 req-ad4ad324-d2f6-4468-9a14-7abc13f357f7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.514633 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8a65565a-9a80-4e3c-b02c-2e6061366989 req-ad4ad324-d2f6-4468-9a14-7abc13f357f7 service nova] Creating event network-vif-deleted:fb4bfa18-8d02-4ee3-b43c-9382211134ba for instance fda2a251-0067-45d0-b424-3b6214b1c3a5 on n-h2-854823-1 Aug 27 05:13:25.520288 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8a65565a-9a80-4e3c-b02c-2e6061366989 req-ad4ad324-d2f6-4468-9a14-7abc13f357f7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039374 Aug 27 05:13:25.524954 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3276/6500] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:25.702655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4f6a1a9-513c-473a-8629-dfc2a701f63c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:25.703560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f4f6a1a9-513c-473a-8629-dfc2a701f63c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: f9d82ec7-fd33-4c19-a1fa-7c315638e864] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:25.731814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4f6a1a9-513c-473a-8629-dfc2a701f63c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.732640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4f6a1a9-513c-473a-8629-dfc2a701f63c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.733788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4f6a1a9-513c-473a-8629-dfc2a701f63c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.734632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4f6a1a9-513c-473a-8629-dfc2a701f63c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.735298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4f6a1a9-513c-473a-8629-dfc2a701f63c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.735835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4f6a1a9-513c-473a-8629-dfc2a701f63c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.770015 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-f4f6a1a9-513c-473a-8629-dfc2a701f63c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] HTTP exception thrown: Instance f9d82ec7-fd33-4c19-a1fa-7c315638e864 could not be found. Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4f6a1a9-513c-473a-8629-dfc2a701f63c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Request method failure captured: Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 HTTP/1.1 Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaZv2aB3wi4p2ta_SwSOAroy6qWH8PAZgVgvjt7PNCeaO1q9sfV_T1h1o-qcz1FOLmfm-41NolP0vc49g-2MIC8-G8Z_I52AM012oGBtQuU3sFanTjEYda1awukXW4Z1sJJ4GEHRYmxEHv2qli_g5GHzaix6XaX2XvkLh9U24G_dy90 Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 631787d4099e4245be9291f39ff6b2bd Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 631787d4099e4245be9291f39ff6b2bd Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerActionsTestJSON-312006175-project Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: c77d065776e448f08f0a1d6fde1aff3c Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerActionsTestJSON-312006175-project Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance f9d82ec7-fd33-4c19-a1fa-7c315638e864 could not be found. Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'f9d82ec7-fd33-4c19-a1fa-7c315638e864'} Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d82ec7-fd33-4c19-a1fa-7c315638e864 could not be found. Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d82ec7-fd33-4c19-a1fa-7c315638e864 could not be found. Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:25.773891 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:25.777949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:25.777949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:25.777949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:25.777949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:25.777949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:25.777949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d82ec7-fd33-4c19-a1fa-7c315638e864 could not be found. Aug 27 05:13:25.777949 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:25.789074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4f6a1a9-513c-473a-8629-dfc2a701f63c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Returning 404 to user: Instance f9d82ec7-fd33-4c19-a1fa-7c315638e864 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:25.792467 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f4f6a1a9-513c-473a-8629-dfc2a701f63c tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864" status: 404 len: 111 microversion: 2.1 time: 0.097265 Aug 27 05:13:25.796632 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3225/6501] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:25 2022] GET /compute/v2.1/servers/f9d82ec7-fd33-4c19-a1fa-7c315638e864 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:25.804508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-61e4a9c6-7a1d-4449-bc5d-29402cfb0686 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:25.805483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-61e4a9c6-7a1d-4449-bc5d-29402cfb0686 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:25.813743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61e4a9c6-7a1d-4449-bc5d-29402cfb0686 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.816588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61e4a9c6-7a1d-4449-bc5d-29402cfb0686 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.817382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61e4a9c6-7a1d-4449-bc5d-29402cfb0686 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.818652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61e4a9c6-7a1d-4449-bc5d-29402cfb0686 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.819374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61e4a9c6-7a1d-4449-bc5d-29402cfb0686 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.820076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61e4a9c6-7a1d-4449-bc5d-29402cfb0686 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.868297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-61e4a9c6-7a1d-4449-bc5d-29402cfb0686 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:25.901491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1f551e55-7859-44e3-9f6b-4d5a87a8085b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:25.902434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1f551e55-7859-44e3-9f6b-4d5a87a8085b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:25.909454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f551e55-7859-44e3-9f6b-4d5a87a8085b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.910063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f551e55-7859-44e3-9f6b-4d5a87a8085b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.910600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f551e55-7859-44e3-9f6b-4d5a87a8085b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.911555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f551e55-7859-44e3-9f6b-4d5a87a8085b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.913121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f551e55-7859-44e3-9f6b-4d5a87a8085b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.913651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f551e55-7859-44e3-9f6b-4d5a87a8085b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.975232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f551e55-7859-44e3-9f6b-4d5a87a8085b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:25.976044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f551e55-7859-44e3-9f6b-4d5a87a8085b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:25.976504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f551e55-7859-44e3-9f6b-4d5a87a8085b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:25.977002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-1f551e55-7859-44e3-9f6b-4d5a87a8085b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lazy-loading 'fault' on Instance uuid fda2a251-0067-45d0-b424-3b6214b1c3a5 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:13:26.009588 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-61e4a9c6-7a1d-4449-bc5d-29402cfb0686 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 204 len: 0 microversion: 2.1 time: 0.208967 Aug 27 05:13:26.010940 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3277/6502] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:13:25 2022] DELETE /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:13:26.028407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9dbc1d99-3150-4d5d-aa80-1c5f338a46c1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:26.030487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9dbc1d99-3150-4d5d-aa80-1c5f338a46c1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:26.042864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbc1d99-3150-4d5d-aa80-1c5f338a46c1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:26.043738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbc1d99-3150-4d5d-aa80-1c5f338a46c1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:26.044408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbc1d99-3150-4d5d-aa80-1c5f338a46c1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:26.045985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbc1d99-3150-4d5d-aa80-1c5f338a46c1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:26.046248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1f551e55-7859-44e3-9f6b-4d5a87a8085b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:26.047704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbc1d99-3150-4d5d-aa80-1c5f338a46c1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:26.048407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbc1d99-3150-4d5d-aa80-1c5f338a46c1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:26.057793 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1f551e55-7859-44e3-9f6b-4d5a87a8085b tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1331 microversion: 2.1 time: 0.158532 Aug 27 05:13:26.059279 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3226/6503] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:25 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1331 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:26.277404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9dbc1d99-3150-4d5d-aa80-1c5f338a46c1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:26.291687 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9dbc1d99-3150-4d5d-aa80-1c5f338a46c1 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1674 microversion: 2.1 time: 0.271414 Aug 27 05:13:26.292761 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3278/6504] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:26 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1674 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:27.087164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb040ce5-792f-4b77-ac6e-2d6d60000b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:27.087770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eb040ce5-792f-4b77-ac6e-2d6d60000b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:27.095106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb040ce5-792f-4b77-ac6e-2d6d60000b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:27.095648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb040ce5-792f-4b77-ac6e-2d6d60000b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:27.096091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb040ce5-792f-4b77-ac6e-2d6d60000b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:27.096860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb040ce5-792f-4b77-ac6e-2d6d60000b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:27.097524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb040ce5-792f-4b77-ac6e-2d6d60000b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:27.098115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb040ce5-792f-4b77-ac6e-2d6d60000b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:27.138414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb040ce5-792f-4b77-ac6e-2d6d60000b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:27.139483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb040ce5-792f-4b77-ac6e-2d6d60000b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:27.139932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb040ce5-792f-4b77-ac6e-2d6d60000b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:27.140394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-eb040ce5-792f-4b77-ac6e-2d6d60000b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lazy-loading 'fault' on Instance uuid fda2a251-0067-45d0-b424-3b6214b1c3a5 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:13:27.196308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb040ce5-792f-4b77-ac6e-2d6d60000b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:27.204323 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb040ce5-792f-4b77-ac6e-2d6d60000b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 200 len: 1331 microversion: 2.1 time: 0.121844 Aug 27 05:13:27.205201 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3227/6505] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:27 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 1331 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:27.315032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc35e161-318a-4663-8130-1c0ae7608cb9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:27.315778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc35e161-318a-4663-8130-1c0ae7608cb9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:27.323233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc35e161-318a-4663-8130-1c0ae7608cb9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:27.323914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc35e161-318a-4663-8130-1c0ae7608cb9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:27.324550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc35e161-318a-4663-8130-1c0ae7608cb9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:27.325423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc35e161-318a-4663-8130-1c0ae7608cb9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:27.326080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc35e161-318a-4663-8130-1c0ae7608cb9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:27.326517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc35e161-318a-4663-8130-1c0ae7608cb9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:27.473954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cc35e161-318a-4663-8130-1c0ae7608cb9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:27.489918 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc35e161-318a-4663-8130-1c0ae7608cb9 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1674 microversion: 2.1 time: 0.180498 Aug 27 05:13:27.490608 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3279/6506] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:27 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:28.227651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-22d3d69b-0346-48da-8c6b-0d42b262c215 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:28.229021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-22d3d69b-0346-48da-8c6b-0d42b262c215 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:28.237631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22d3d69b-0346-48da-8c6b-0d42b262c215 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:28.238207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22d3d69b-0346-48da-8c6b-0d42b262c215 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:28.239047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22d3d69b-0346-48da-8c6b-0d42b262c215 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:28.239991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22d3d69b-0346-48da-8c6b-0d42b262c215 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:28.242007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22d3d69b-0346-48da-8c6b-0d42b262c215 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:28.242457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22d3d69b-0346-48da-8c6b-0d42b262c215 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:28.264599 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-22d3d69b-0346-48da-8c6b-0d42b262c215 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] HTTP exception thrown: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-22d3d69b-0346-48da-8c6b-0d42b262c215 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Request method failure captured: Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 HTTP/1.1 Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaaigp07zvkISHb29u2Quk6NjhbfN1zEDCSkQQoinW0uynW7tNECIjPZRDz_K75qhqu2Icv_5PRsBA8URuVfOgE2knALTSJ-lxCAlMfLfMaApUY2YZNmhuhErGrmBQkx_kPARWtJeBImZcDnJdIllkJtA8jOXs3vwkeuSJPXsJdeNoo Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: dc1b938c06bd432496e8ae8b24965678 Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'fda2a251-0067-45d0-b424-3b6214b1c3a5'} Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:28.267234 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:28.272364 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:28.272364 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:28.272364 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:28.272364 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:28.272364 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:28.272364 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:13:28.272364 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:13:28.273929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-22d3d69b-0346-48da-8c6b-0d42b262c215 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Returning 404 to user: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:28.275171 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-22d3d69b-0346-48da-8c6b-0d42b262c215 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 404 len: 111 microversion: 2.1 time: 0.052238 Aug 27 05:13:28.276933 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3228/6507] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:28 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:28.287117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83ac3c2f-5230-4b43-a13b-ab528bef34f5 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '.version_select at 0x7f1f2053bb80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:28.308714 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83ac3c2f-5230-4b43-a13b-ab528bef34f5 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-552894400" status: 202 len: 0 microversion: 2.1 time: 0.026234 Aug 27 05:13:28.314348 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3280/6508] 10.222.0.79 () {58 vars in 1218 bytes} [Sat Aug 27 05:13:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-552894400 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:13:28.517074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ee81dee8-e9b7-40d5-80d3-56c97fef34db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:28.518386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ee81dee8-e9b7-40d5-80d3-56c97fef34db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:28.529830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee81dee8-e9b7-40d5-80d3-56c97fef34db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:28.530417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee81dee8-e9b7-40d5-80d3-56c97fef34db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:28.531142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee81dee8-e9b7-40d5-80d3-56c97fef34db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:28.532565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee81dee8-e9b7-40d5-80d3-56c97fef34db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:28.533361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee81dee8-e9b7-40d5-80d3-56c97fef34db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:28.534111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee81dee8-e9b7-40d5-80d3-56c97fef34db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:28.879243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ee81dee8-e9b7-40d5-80d3-56c97fef34db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:28.888393 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ee81dee8-e9b7-40d5-80d3-56c97fef34db tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1674 microversion: 2.1 time: 0.380784 Aug 27 05:13:28.896923 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3229/6509] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:28 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1674 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:29.204876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf1e684c-79b2-4d20-a453-637c544af2f4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Action: 'create', calling method: .version_select at 0x7f1f2052faf0>, body: {"keypair": {"name": "tempest-keypair-2027271462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM8YdF0hJP6awl50Hl6aozvs0x76ImXCU9sFS83RRhMYfsHe9451PYzDUE9OaInGRauR9jjV2MKj+TY61L0Phdv6qebSfRx9onTQzvGqXfriZFcB8uMb2RqX15kspig1A=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:29.233717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-cf1e684c-79b2-4d20-a453-637c544af2f4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:13:29.241182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-cf1e684c-79b2-4d20-a453-637c544af2f4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for user dc1b938c06bd432496e8ae8b24965678 and project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:13:29.289533 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf1e684c-79b2-4d20-a453-637c544af2f4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088981 Aug 27 05:13:29.290218 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3281/6510] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:13:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:29.919280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2d2a2cbb-d5a5-48f6-8bbc-4e4cfae8a334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:29.920764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2d2a2cbb-d5a5-48f6-8bbc-4e4cfae8a334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:29.933476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d2a2cbb-d5a5-48f6-8bbc-4e4cfae8a334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:29.937192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d2a2cbb-d5a5-48f6-8bbc-4e4cfae8a334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:29.937776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d2a2cbb-d5a5-48f6-8bbc-4e4cfae8a334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:29.938685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d2a2cbb-d5a5-48f6-8bbc-4e4cfae8a334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:29.941570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d2a2cbb-d5a5-48f6-8bbc-4e4cfae8a334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:29.942155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2d2a2cbb-d5a5-48f6-8bbc-4e4cfae8a334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:29.945606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:30.223130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2d2a2cbb-d5a5-48f6-8bbc-4e4cfae8a334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77d065776e448f08f0a1d6fde1aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631787d4099e4245be9291f39ff6b2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:30.227418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-89f53320-f166-43f4-a441-c83b4a3fb616 req-ba54d7e9-99ff-43fd-bd59-18a6969fe008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f54d929-acc6-47f3-96a7-708032ccd9d9", "name": "network-vif-deleted", "tag": "060a48ca-cf07-4257-8892-27d740101396"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:30.231731 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2d2a2cbb-d5a5-48f6-8bbc-4e4cfae8a334 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 200 len: 1607 microversion: 2.1 time: 0.317384 Aug 27 05:13:30.235661 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3230/6511] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:29 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 1607 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:30.257237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-89f53320-f166-43f4-a441-c83b4a3fb616 req-ba54d7e9-99ff-43fd-bd59-18a6969fe008 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:30.258161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-89f53320-f166-43f4-a441-c83b4a3fb616 req-ba54d7e9-99ff-43fd-bd59-18a6969fe008 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:30.262944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-89f53320-f166-43f4-a441-c83b4a3fb616 req-ba54d7e9-99ff-43fd-bd59-18a6969fe008 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:30.283984 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-89f53320-f166-43f4-a441-c83b4a3fb616 req-ba54d7e9-99ff-43fd-bd59-18a6969fe008 service nova] Creating event network-vif-deleted:060a48ca-cf07-4257-8892-27d740101396 for instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 on n-h2-854823-1 Aug 27 05:13:30.289286 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-89f53320-f166-43f4-a441-c83b4a3fb616 req-ba54d7e9-99ff-43fd-bd59-18a6969fe008 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070497 Aug 27 05:13:30.290788 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3282/6512] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:31.158043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-90066197", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d0ae2b2-26fa-4f3d-bb3c-eb9fbaada560"}], "security_groups": [{"name": "tempest-securitygroup--523442856"}], "key_name": "tempest-keypair-2027271462", "user_data": "}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:31.254901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5680cc57-762a-43b8-a1d2-2446f5aad462 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:31.255989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5680cc57-762a-43b8-a1d2-2446f5aad462 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] [instance: 3f54d929-acc6-47f3-96a7-708032ccd9d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:31.258139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:31.266351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5680cc57-762a-43b8-a1d2-2446f5aad462 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:31.267244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5680cc57-762a-43b8-a1d2-2446f5aad462 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:31.267903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5680cc57-762a-43b8-a1d2-2446f5aad462 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:31.269073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5680cc57-762a-43b8-a1d2-2446f5aad462 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:31.269897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5680cc57-762a-43b8-a1d2-2446f5aad462 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:31.271102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5680cc57-762a-43b8-a1d2-2446f5aad462 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:31.294918 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-5680cc57-762a-43b8-a1d2-2446f5aad462 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] HTTP exception thrown: Instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 could not be found. Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5680cc57-762a-43b8-a1d2-2446f5aad462 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Request method failure captured: Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 HTTP/1.1 Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaZv2aB3wi4p2ta_SwSOAroy6qWH8PAZgVgvjt7PNCeaO1q9sfV_T1h1o-qcz1FOLmfm-41NolP0vc49g-2MIC8-G8Z_I52AM012oGBtQuU3sFanTjEYda1awukXW4Z1sJJ4GEHRYmxEHv2qli_g5GHzaix6XaX2XvkLh9U24G_dy90 Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 631787d4099e4245be9291f39ff6b2bd Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/631787d4099e4245be9291f39ff6b2bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 631787d4099e4245be9291f39ff6b2bd Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-312006175 Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-312006175-project Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: c77d065776e448f08f0a1d6fde1aff3c Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-312006175-project Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 could not be found. Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '3f54d929-acc6-47f3-96a7-708032ccd9d9'} Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 could not be found. Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 could not be found. Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:31.297020 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:31.303125 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:31.303125 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:31.303125 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:31.303125 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:31.303125 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:31.303125 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 could not be found. Aug 27 05:13:31.303125 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:31.306002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5680cc57-762a-43b8-a1d2-2446f5aad462 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Returning 404 to user: Instance 3f54d929-acc6-47f3-96a7-708032ccd9d9 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:31.307155 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5680cc57-762a-43b8-a1d2-2446f5aad462 tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9" status: 404 len: 111 microversion: 2.1 time: 0.058017 Aug 27 05:13:31.307862 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3283/6513] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:31 2022] GET /compute/v2.1/servers/3f54d929-acc6-47f3-96a7-708032ccd9d9 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:13:31.321864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f2a6412-5272-4a58-a7fe-c10add6144ab tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] Calling method '.version_select at 0x7f1f2346a430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:31.355328 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f2a6412-5272-4a58-a7fe-c10add6144ab tempest-ServerActionsTestJSON-312006175 tempest-ServerActionsTestJSON-312006175-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140678373" status: 202 len: 0 microversion: 2.1 time: 0.036421 Aug 27 05:13:31.355673 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3284/6514] 10.222.0.79 () {58 vars in 1221 bytes} [Sat Aug 27 05:13:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140678373 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:13:31.399574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] validate_networks() for [('1d0ae2b2-26fa-4f3d-bb3c-eb9fbaada560', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:13:32.150771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:13:32.151214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:13:32.151892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:13:32.152986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:13:32.153585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:13:32.183452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:32.184101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:32.184504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:32.185366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:32.185889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:32.190140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:32.224026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:13:32.232356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Getting quotas for user dc1b938c06bd432496e8ae8b24965678 and project f65ba45be6a54b4f9aa0edabf60011c9. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:13:32.252753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:13:32.255810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:13:32.332180 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c3f8654b-1f03-4614-8eb3-ba49cfa51c1d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.180084 Aug 27 05:13:32.338832 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3231/6515] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:13:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:13:32.347441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab6a2b9a-3a00-4136-9981-63a1eb5b3cb1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:32.348107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab6a2b9a-3a00-4136-9981-63a1eb5b3cb1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:32.485804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab6a2b9a-3a00-4136-9981-63a1eb5b3cb1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:32.494543 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab6a2b9a-3a00-4136-9981-63a1eb5b3cb1 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1240 microversion: 2.1 time: 0.153718 Aug 27 05:13:32.495172 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3285/6516] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:32 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1240 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:33.515689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1e2be744-2063-4549-911a-bede9db16537 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:33.517048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1e2be744-2063-4549-911a-bede9db16537 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:33.525005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e2be744-2063-4549-911a-bede9db16537 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:33.525649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e2be744-2063-4549-911a-bede9db16537 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:33.526218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e2be744-2063-4549-911a-bede9db16537 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:33.527358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e2be744-2063-4549-911a-bede9db16537 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:33.527843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e2be744-2063-4549-911a-bede9db16537 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:33.528275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e2be744-2063-4549-911a-bede9db16537 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:33.607275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e2be744-2063-4549-911a-bede9db16537 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:33.618120 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1e2be744-2063-4549-911a-bede9db16537 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1292 microversion: 2.1 time: 0.107444 Aug 27 05:13:33.619360 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3232/6517] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:33 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1292 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:34.645779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7dcf018-f8da-4e26-8ea7-8ca1c2ec27bd tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:34.647317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7dcf018-f8da-4e26-8ea7-8ca1c2ec27bd tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:34.681380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7dcf018-f8da-4e26-8ea7-8ca1c2ec27bd tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:34.685005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7dcf018-f8da-4e26-8ea7-8ca1c2ec27bd tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:34.685851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7dcf018-f8da-4e26-8ea7-8ca1c2ec27bd tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:34.688270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7dcf018-f8da-4e26-8ea7-8ca1c2ec27bd tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:34.689252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7dcf018-f8da-4e26-8ea7-8ca1c2ec27bd tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:34.691142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7dcf018-f8da-4e26-8ea7-8ca1c2ec27bd tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:35.345997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7dcf018-f8da-4e26-8ea7-8ca1c2ec27bd tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:35.359388 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7dcf018-f8da-4e26-8ea7-8ca1c2ec27bd tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1365 microversion: 2.1 time: 0.721960 Aug 27 05:13:35.361353 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3286/6518] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:34 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1365 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:35.896710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-fa26d629-7b31-4640-960d-8d0e6bac396c req-85d62efa-bff3-415d-bd7b-afb227c3a5ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776eecfe-8c9b-4dac-b8ff-99c1bbc42226", "tag": "6d5e361c-1c69-4f29-84f0-7966de2bfadc"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:35.918336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fa26d629-7b31-4640-960d-8d0e6bac396c req-85d62efa-bff3-415d-bd7b-afb227c3a5ec service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:35.919249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fa26d629-7b31-4640-960d-8d0e6bac396c req-85d62efa-bff3-415d-bd7b-afb227c3a5ec service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:35.920906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fa26d629-7b31-4640-960d-8d0e6bac396c req-85d62efa-bff3-415d-bd7b-afb227c3a5ec service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:35.937353 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-fa26d629-7b31-4640-960d-8d0e6bac396c req-85d62efa-bff3-415d-bd7b-afb227c3a5ec service nova] Creating event network-changed:6d5e361c-1c69-4f29-84f0-7966de2bfadc for instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 on n-h1-854823-1 Aug 27 05:13:35.943804 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-fa26d629-7b31-4640-960d-8d0e6bac396c req-85d62efa-bff3-415d-bd7b-afb227c3a5ec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052173 Aug 27 05:13:35.945044 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3233/6519] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:36.386859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-17611f38-5937-41bf-a7a9-655a476b7107 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:36.390471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-17611f38-5937-41bf-a7a9-655a476b7107 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:36.405467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17611f38-5937-41bf-a7a9-655a476b7107 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:36.406367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17611f38-5937-41bf-a7a9-655a476b7107 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:36.407212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17611f38-5937-41bf-a7a9-655a476b7107 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:36.408447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17611f38-5937-41bf-a7a9-655a476b7107 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:36.409108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17611f38-5937-41bf-a7a9-655a476b7107 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:36.409739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17611f38-5937-41bf-a7a9-655a476b7107 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:36.589901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-17611f38-5937-41bf-a7a9-655a476b7107 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:36.599363 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-17611f38-5937-41bf-a7a9-655a476b7107 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1365 microversion: 2.1 time: 0.219375 Aug 27 05:13:36.600126 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3287/6520] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:36 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:37.624810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94aaee30-a243-4f78-94ca-56b1a2a0d479 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:37.625524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94aaee30-a243-4f78-94ca-56b1a2a0d479 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:37.632734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94aaee30-a243-4f78-94ca-56b1a2a0d479 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:37.633240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94aaee30-a243-4f78-94ca-56b1a2a0d479 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:37.633692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94aaee30-a243-4f78-94ca-56b1a2a0d479 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:37.634432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94aaee30-a243-4f78-94ca-56b1a2a0d479 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:37.634926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94aaee30-a243-4f78-94ca-56b1a2a0d479 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:37.635363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94aaee30-a243-4f78-94ca-56b1a2a0d479 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:37.724614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-947594165", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": "none"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:37.773868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94aaee30-a243-4f78-94ca-56b1a2a0d479 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:37.781523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:13:37.781958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:13:37.782123 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94aaee30-a243-4f78-94ca-56b1a2a0d479 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1365 microversion: 2.1 time: 0.161883 Aug 27 05:13:37.782437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:13:37.782719 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3288/6521] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:37 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:37.782859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:13:37.783254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:13:37.792028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:37.792517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:37.792990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:37.793724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:37.794783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:37.795750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:37.813213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Getting quotas for project f9a973171de940f0bdf5bdee830dcc22. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:13:37.818470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Getting quotas for user a4e4f2a7afe34d23855017c1e3451c2c and project f9a973171de940f0bdf5bdee830dcc22. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:13:37.831223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:13:37.833680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] [instance: 36408219-4078-4c71-9c55-b800213d9378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:13:37.879054 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d5665758-e41f-4fbd-819f-7cda36ecad75 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.277578 Aug 27 05:13:37.879797 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3234/6522] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 05:13:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 279 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 05:13:37.890921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a024cc6-baab-4d55-802e-9dd8c74aa662 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:37.891745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a024cc6-baab-4d55-802e-9dd8c74aa662 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] [instance: 36408219-4078-4c71-9c55-b800213d9378] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:37.948694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a024cc6-baab-4d55-802e-9dd8c74aa662 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:37.956264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a024cc6-baab-4d55-802e-9dd8c74aa662 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:37.957760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a024cc6-baab-4d55-802e-9dd8c74aa662 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:37.965749 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a024cc6-baab-4d55-802e-9dd8c74aa662 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] 10.222.0.79 "GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378" status: 200 len: 1280 microversion: 2.47 time: 0.078882 Aug 27 05:13:37.966371 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3289/6523] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:37 2022] GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378 => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:38.804856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5bd6e0f1-0944-4b52-9219-da2a3dd66dfb tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:38.805491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5bd6e0f1-0944-4b52-9219-da2a3dd66dfb tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:38.812973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bd6e0f1-0944-4b52-9219-da2a3dd66dfb tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:38.813464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bd6e0f1-0944-4b52-9219-da2a3dd66dfb tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:38.813906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bd6e0f1-0944-4b52-9219-da2a3dd66dfb tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:38.814607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bd6e0f1-0944-4b52-9219-da2a3dd66dfb tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:38.815070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bd6e0f1-0944-4b52-9219-da2a3dd66dfb tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:38.815513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bd6e0f1-0944-4b52-9219-da2a3dd66dfb tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:38.953276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5bd6e0f1-0944-4b52-9219-da2a3dd66dfb tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:38.962975 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5bd6e0f1-0944-4b52-9219-da2a3dd66dfb tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1365 microversion: 2.1 time: 0.162995 Aug 27 05:13:38.963574 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3235/6524] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:38 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:38.990057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a03bec7d-676a-4dfc-84b7-40a6d8542279 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:38.991201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a03bec7d-676a-4dfc-84b7-40a6d8542279 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] [instance: 36408219-4078-4c71-9c55-b800213d9378] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:39.000108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a03bec7d-676a-4dfc-84b7-40a6d8542279 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:39.000885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a03bec7d-676a-4dfc-84b7-40a6d8542279 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:39.001339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a03bec7d-676a-4dfc-84b7-40a6d8542279 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:39.002268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a03bec7d-676a-4dfc-84b7-40a6d8542279 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:39.003014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a03bec7d-676a-4dfc-84b7-40a6d8542279 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:39.003616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a03bec7d-676a-4dfc-84b7-40a6d8542279 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:39.113721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a03bec7d-676a-4dfc-84b7-40a6d8542279 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:39.122939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a03bec7d-676a-4dfc-84b7-40a6d8542279 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:39.125522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a03bec7d-676a-4dfc-84b7-40a6d8542279 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:39.126694 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a03bec7d-676a-4dfc-84b7-40a6d8542279 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] 10.222.0.79 "GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378" status: 200 len: 1340 microversion: 2.47 time: 0.141509 Aug 27 05:13:39.127274 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3290/6525] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:38 2022] GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378 => generated 1340 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:39.983597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-109f161f-2ccc-4832-8d2b-be12fc9f9047 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:39.984259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-109f161f-2ccc-4832-8d2b-be12fc9f9047 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:39.992637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-109f161f-2ccc-4832-8d2b-be12fc9f9047 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:39.993161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-109f161f-2ccc-4832-8d2b-be12fc9f9047 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:39.993596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-109f161f-2ccc-4832-8d2b-be12fc9f9047 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:39.994296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-109f161f-2ccc-4832-8d2b-be12fc9f9047 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:39.994749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-109f161f-2ccc-4832-8d2b-be12fc9f9047 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:39.995171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-109f161f-2ccc-4832-8d2b-be12fc9f9047 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:40.129442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-109f161f-2ccc-4832-8d2b-be12fc9f9047 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:40.137358 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-109f161f-2ccc-4832-8d2b-be12fc9f9047 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1365 microversion: 2.1 time: 0.158023 Aug 27 05:13:40.137946 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3236/6526] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:39 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:40.150458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a18a8791-a236-4926-aa0a-882def064fe8 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:40.151085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a18a8791-a236-4926-aa0a-882def064fe8 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] [instance: 36408219-4078-4c71-9c55-b800213d9378] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:40.158729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a18a8791-a236-4926-aa0a-882def064fe8 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:40.159246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a18a8791-a236-4926-aa0a-882def064fe8 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:40.159691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a18a8791-a236-4926-aa0a-882def064fe8 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:40.160414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a18a8791-a236-4926-aa0a-882def064fe8 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:40.160894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a18a8791-a236-4926-aa0a-882def064fe8 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:40.161362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a18a8791-a236-4926-aa0a-882def064fe8 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:40.165747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:40.227616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a18a8791-a236-4926-aa0a-882def064fe8 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:40.237495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a18a8791-a236-4926-aa0a-882def064fe8 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:40.239001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a18a8791-a236-4926-aa0a-882def064fe8 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:40.240270 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a18a8791-a236-4926-aa0a-882def064fe8 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] 10.222.0.79 "GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378" status: 200 len: 1338 microversion: 2.47 time: 0.093808 Aug 27 05:13:40.240889 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3291/6527] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:40 2022] GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378 => generated 1338 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:41.159137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0e0d96c8-7272-44fc-a9bc-2522389ea447 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:41.159746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0e0d96c8-7272-44fc-a9bc-2522389ea447 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:41.166622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e0d96c8-7272-44fc-a9bc-2522389ea447 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:41.167190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e0d96c8-7272-44fc-a9bc-2522389ea447 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:41.167620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e0d96c8-7272-44fc-a9bc-2522389ea447 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:41.168309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e0d96c8-7272-44fc-a9bc-2522389ea447 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:41.168854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e0d96c8-7272-44fc-a9bc-2522389ea447 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:41.169279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e0d96c8-7272-44fc-a9bc-2522389ea447 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:41.263638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e69ff90e-8955-4099-aac1-07a6c67c5520 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:41.264269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e69ff90e-8955-4099-aac1-07a6c67c5520 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] [instance: 36408219-4078-4c71-9c55-b800213d9378] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:41.271305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e69ff90e-8955-4099-aac1-07a6c67c5520 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:41.271836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e69ff90e-8955-4099-aac1-07a6c67c5520 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:41.272368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e69ff90e-8955-4099-aac1-07a6c67c5520 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:41.273122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e69ff90e-8955-4099-aac1-07a6c67c5520 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:41.273594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e69ff90e-8955-4099-aac1-07a6c67c5520 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:41.274058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e69ff90e-8955-4099-aac1-07a6c67c5520 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:41.306829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0e0d96c8-7272-44fc-a9bc-2522389ea447 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:41.316422 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0e0d96c8-7272-44fc-a9bc-2522389ea447 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1365 microversion: 2.1 time: 0.160885 Aug 27 05:13:41.328553 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3237/6528] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:41 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:41.345807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e69ff90e-8955-4099-aac1-07a6c67c5520 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:41.354772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e69ff90e-8955-4099-aac1-07a6c67c5520 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:41.356248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e69ff90e-8955-4099-aac1-07a6c67c5520 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:41.357507 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e69ff90e-8955-4099-aac1-07a6c67c5520 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] 10.222.0.79 "GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378" status: 200 len: 1338 microversion: 2.47 time: 0.097890 Aug 27 05:13:41.358773 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3292/6529] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:41 2022] GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378 => generated 1338 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:13:41.993277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-9963ec79-0a9d-4594-aa5b-11a698330578 req-6d541ca4-3c4c-4bd6-abc2-6c89f068d106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776eecfe-8c9b-4dac-b8ff-99c1bbc42226", "name": "network-vif-plugged", "status": "completed", "tag": "6d5e361c-1c69-4f29-84f0-7966de2bfadc"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:42.003716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9963ec79-0a9d-4594-aa5b-11a698330578 req-6d541ca4-3c4c-4bd6-abc2-6c89f068d106 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.004201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9963ec79-0a9d-4594-aa5b-11a698330578 req-6d541ca4-3c4c-4bd6-abc2-6c89f068d106 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.004668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9963ec79-0a9d-4594-aa5b-11a698330578 req-6d541ca4-3c4c-4bd6-abc2-6c89f068d106 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.018442 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-9963ec79-0a9d-4594-aa5b-11a698330578 req-6d541ca4-3c4c-4bd6-abc2-6c89f068d106 service nova] Creating event network-vif-plugged:6d5e361c-1c69-4f29-84f0-7966de2bfadc for instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 on n-h1-854823-1 Aug 27 05:13:42.023505 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-9963ec79-0a9d-4594-aa5b-11a698330578 req-6d541ca4-3c4c-4bd6-abc2-6c89f068d106 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097628 Aug 27 05:13:42.024120 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3238/6530] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:42.338169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2def441d-94c0-4955-9c30-23321e0e22cf tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:42.338709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2def441d-94c0-4955-9c30-23321e0e22cf tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:42.346694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2def441d-94c0-4955-9c30-23321e0e22cf tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.347226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2def441d-94c0-4955-9c30-23321e0e22cf tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.347695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2def441d-94c0-4955-9c30-23321e0e22cf tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.348444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2def441d-94c0-4955-9c30-23321e0e22cf tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.348943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2def441d-94c0-4955-9c30-23321e0e22cf tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.349389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2def441d-94c0-4955-9c30-23321e0e22cf tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.382470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-911c5c89-c51f-447f-825d-cba3c7be7d34 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:42.383201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-911c5c89-c51f-447f-825d-cba3c7be7d34 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] [instance: 36408219-4078-4c71-9c55-b800213d9378] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:42.389531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-911c5c89-c51f-447f-825d-cba3c7be7d34 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.390012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-911c5c89-c51f-447f-825d-cba3c7be7d34 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.390449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-911c5c89-c51f-447f-825d-cba3c7be7d34 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.391143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-911c5c89-c51f-447f-825d-cba3c7be7d34 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.391612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-911c5c89-c51f-447f-825d-cba3c7be7d34 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.392017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-911c5c89-c51f-447f-825d-cba3c7be7d34 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.459355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-911c5c89-c51f-447f-825d-cba3c7be7d34 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:42.467632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-911c5c89-c51f-447f-825d-cba3c7be7d34 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:42.469099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-911c5c89-c51f-447f-825d-cba3c7be7d34 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:42.470296 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-911c5c89-c51f-447f-825d-cba3c7be7d34 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] 10.222.0.79 "GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378" status: 200 len: 1359 microversion: 2.47 time: 0.093071 Aug 27 05:13:42.470855 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3239/6531] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:42 2022] GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378 => generated 1359 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:13:42.488731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2def441d-94c0-4955-9c30-23321e0e22cf tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:42.493274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-57152266-0ed0-4c0f-9dc5-52733a7277eb tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2034514924"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:42.495628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-57152266-0ed0-4c0f-9dc5-52733a7277eb tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] [instance: 36408219-4078-4c71-9c55-b800213d9378] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:42.497112 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2def441d-94c0-4955-9c30-23321e0e22cf tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1365 microversion: 2.1 time: 0.163131 Aug 27 05:13:42.503026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57152266-0ed0-4c0f-9dc5-52733a7277eb tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.503509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57152266-0ed0-4c0f-9dc5-52733a7277eb tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.503946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57152266-0ed0-4c0f-9dc5-52733a7277eb tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.504668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57152266-0ed0-4c0f-9dc5-52733a7277eb tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.505120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57152266-0ed0-4c0f-9dc5-52733a7277eb tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.505672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57152266-0ed0-4c0f-9dc5-52733a7277eb tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.511595 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3293/6532] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:42 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:42.710495 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-57152266-0ed0-4c0f-9dc5-52733a7277eb tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] 10.222.0.79 "POST /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378/action" status: 202 len: 52 microversion: 2.47 time: 0.220846 Aug 27 05:13:42.711627 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3240/6533] 10.222.0.79 () {62 vars in 1319 bytes} [Sat Aug 27 05:13:42 2022] POST /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378/action => generated 52 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Aug 27 05:13:42.722947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bee61084-49cd-476a-bebe-eb75e722d134 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:42.723466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bee61084-49cd-476a-bebe-eb75e722d134 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] [instance: 36408219-4078-4c71-9c55-b800213d9378] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:42.730517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bee61084-49cd-476a-bebe-eb75e722d134 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.731037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bee61084-49cd-476a-bebe-eb75e722d134 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.731496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bee61084-49cd-476a-bebe-eb75e722d134 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.732231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bee61084-49cd-476a-bebe-eb75e722d134 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.733474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bee61084-49cd-476a-bebe-eb75e722d134 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.733992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bee61084-49cd-476a-bebe-eb75e722d134 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.762242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bee61084-49cd-476a-bebe-eb75e722d134 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] [instance: 36408219-4078-4c71-9c55-b800213d9378] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:13:42.844637 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bee61084-49cd-476a-bebe-eb75e722d134 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] 10.222.0.79 "DELETE /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378" status: 204 len: 0 microversion: 2.47 time: 0.125445 Aug 27 05:13:42.848410 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3294/6534] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 05:13:42 2022] DELETE /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 05:13:42.856225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-56939748-8c39-4895-ba6f-99c747e06a26 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:42.856965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-56939748-8c39-4895-ba6f-99c747e06a26 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] [instance: 36408219-4078-4c71-9c55-b800213d9378] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:42.865265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56939748-8c39-4895-ba6f-99c747e06a26 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.865760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56939748-8c39-4895-ba6f-99c747e06a26 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.866273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56939748-8c39-4895-ba6f-99c747e06a26 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.866906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56939748-8c39-4895-ba6f-99c747e06a26 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:42.867368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56939748-8c39-4895-ba6f-99c747e06a26 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:42.867798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56939748-8c39-4895-ba6f-99c747e06a26 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:42.936593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-56939748-8c39-4895-ba6f-99c747e06a26 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:42.945711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-56939748-8c39-4895-ba6f-99c747e06a26 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:42.947173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-56939748-8c39-4895-ba6f-99c747e06a26 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:42.948361 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-56939748-8c39-4895-ba6f-99c747e06a26 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] 10.222.0.79 "GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378" status: 200 len: 1365 microversion: 2.47 time: 0.097061 Aug 27 05:13:42.948964 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3241/6535] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:42 2022] GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378 => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:43.521384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed540692-ad19-4aba-a301-41ecafe00194 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:43.522100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ed540692-ad19-4aba-a301-41ecafe00194 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:43.529481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed540692-ad19-4aba-a301-41ecafe00194 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:43.530114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed540692-ad19-4aba-a301-41ecafe00194 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:43.530556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed540692-ad19-4aba-a301-41ecafe00194 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:43.531296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed540692-ad19-4aba-a301-41ecafe00194 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:43.531762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed540692-ad19-4aba-a301-41ecafe00194 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:43.532192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed540692-ad19-4aba-a301-41ecafe00194 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:43.673035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed540692-ad19-4aba-a301-41ecafe00194 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:43.680926 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ed540692-ad19-4aba-a301-41ecafe00194 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1365 microversion: 2.1 time: 0.163811 Aug 27 05:13:43.681533 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3295/6536] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:43 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:43.971552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c2dddc08-ddfa-422f-9b19-ae18c375a111 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:43.972656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c2dddc08-ddfa-422f-9b19-ae18c375a111 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] [instance: 36408219-4078-4c71-9c55-b800213d9378] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:43.980870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2dddc08-ddfa-422f-9b19-ae18c375a111 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:43.981355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2dddc08-ddfa-422f-9b19-ae18c375a111 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:43.981791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2dddc08-ddfa-422f-9b19-ae18c375a111 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:43.982481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2dddc08-ddfa-422f-9b19-ae18c375a111 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:43.983438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2dddc08-ddfa-422f-9b19-ae18c375a111 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:43.983861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2dddc08-ddfa-422f-9b19-ae18c375a111 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.049886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c2dddc08-ddfa-422f-9b19-ae18c375a111 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:44.059044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c2dddc08-ddfa-422f-9b19-ae18c375a111 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:44.060549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c2dddc08-ddfa-422f-9b19-ae18c375a111 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:44.061733 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c2dddc08-ddfa-422f-9b19-ae18c375a111 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] 10.222.0.79 "GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378" status: 200 len: 1365 microversion: 2.47 time: 0.094406 Aug 27 05:13:44.062321 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3242/6537] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:43 2022] GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378 => generated 1365 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:44.702847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e6f3df2-bb8c-4d08-9a94-b9b5d9d1831d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:44.703464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e6f3df2-bb8c-4d08-9a94-b9b5d9d1831d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:44.710610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e6f3df2-bb8c-4d08-9a94-b9b5d9d1831d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:44.711108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e6f3df2-bb8c-4d08-9a94-b9b5d9d1831d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:44.711586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e6f3df2-bb8c-4d08-9a94-b9b5d9d1831d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.712296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e6f3df2-bb8c-4d08-9a94-b9b5d9d1831d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:44.712793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e6f3df2-bb8c-4d08-9a94-b9b5d9d1831d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:44.713276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e6f3df2-bb8c-4d08-9a94-b9b5d9d1831d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.842937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0e6f3df2-bb8c-4d08-9a94-b9b5d9d1831d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:44.851106 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e6f3df2-bb8c-4d08-9a94-b9b5d9d1831d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1555 microversion: 2.1 time: 0.152658 Aug 27 05:13:44.851737 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3296/6538] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:44 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:44.874170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3a41102f-58b2-4033-aeeb-a3226f4ce794 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:44.874658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3a41102f-58b2-4033-aeeb-a3226f4ce794 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:44.876686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:44.882470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a41102f-58b2-4033-aeeb-a3226f4ce794 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:44.882956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a41102f-58b2-4033-aeeb-a3226f4ce794 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:44.883383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a41102f-58b2-4033-aeeb-a3226f4ce794 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.884075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a41102f-58b2-4033-aeeb-a3226f4ce794 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:44.884523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a41102f-58b2-4033-aeeb-a3226f4ce794 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:44.884963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a41102f-58b2-4033-aeeb-a3226f4ce794 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:44.970306 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3a41102f-58b2-4033-aeeb-a3226f4ce794 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100122 Aug 27 05:13:44.971126 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3243/6539] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 05:13:44 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:45.085236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0abc3e8e-35e3-400c-8067-9a59b9d850ef tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:45.085788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0abc3e8e-35e3-400c-8067-9a59b9d850ef tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] [instance: 36408219-4078-4c71-9c55-b800213d9378] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:45.091880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0abc3e8e-35e3-400c-8067-9a59b9d850ef tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:45.092929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0abc3e8e-35e3-400c-8067-9a59b9d850ef tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:45.093384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0abc3e8e-35e3-400c-8067-9a59b9d850ef tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:45.094106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0abc3e8e-35e3-400c-8067-9a59b9d850ef tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:45.094576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0abc3e8e-35e3-400c-8067-9a59b9d850ef tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:45.096262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0abc3e8e-35e3-400c-8067-9a59b9d850ef tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:45.161689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0abc3e8e-35e3-400c-8067-9a59b9d850ef tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:45.170212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0abc3e8e-35e3-400c-8067-9a59b9d850ef tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:45.171745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0abc3e8e-35e3-400c-8067-9a59b9d850ef tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e4f2a7afe34d23855017c1e3451c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a973171de940f0bdf5bdee830dcc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:45.172981 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0abc3e8e-35e3-400c-8067-9a59b9d850ef tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] 10.222.0.79 "GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378" status: 200 len: 1365 microversion: 2.47 time: 0.091858 Aug 27 05:13:45.173581 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3297/6540] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:45 2022] GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378 => generated 1365 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:13:45.958567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ca5105ea-b234-4594-ae14-b59623278b1c req-dc8390da-7dc1-417f-bbe6-7facd2bd4a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776eecfe-8c9b-4dac-b8ff-99c1bbc42226", "tag": "6d5e361c-1c69-4f29-84f0-7966de2bfadc"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:45.968836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ca5105ea-b234-4594-ae14-b59623278b1c req-dc8390da-7dc1-417f-bbe6-7facd2bd4a41 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:45.969318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ca5105ea-b234-4594-ae14-b59623278b1c req-dc8390da-7dc1-417f-bbe6-7facd2bd4a41 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:45.969745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ca5105ea-b234-4594-ae14-b59623278b1c req-dc8390da-7dc1-417f-bbe6-7facd2bd4a41 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:45.981321 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ca5105ea-b234-4594-ae14-b59623278b1c req-dc8390da-7dc1-417f-bbe6-7facd2bd4a41 service nova] Creating event network-changed:6d5e361c-1c69-4f29-84f0-7966de2bfadc for instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 on n-h1-854823-1 Aug 27 05:13:45.986385 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ca5105ea-b234-4594-ae14-b59623278b1c req-dc8390da-7dc1-417f-bbe6-7facd2bd4a41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033218 Aug 27 05:13:45.987302 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3244/6541] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:13:46.197000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32b34921-e8e6-40e0-8b18-92825ace3467 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:46.197796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32b34921-e8e6-40e0-8b18-92825ace3467 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] [instance: 36408219-4078-4c71-9c55-b800213d9378] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:46.206006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32b34921-e8e6-40e0-8b18-92825ace3467 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:46.206525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32b34921-e8e6-40e0-8b18-92825ace3467 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:46.207054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32b34921-e8e6-40e0-8b18-92825ace3467 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:46.207847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32b34921-e8e6-40e0-8b18-92825ace3467 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:46.208576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32b34921-e8e6-40e0-8b18-92825ace3467 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:46.209017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32b34921-e8e6-40e0-8b18-92825ace3467 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:46.224616 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-32b34921-e8e6-40e0-8b18-92825ace3467 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] HTTP exception thrown: Instance 36408219-4078-4c71-9c55-b800213d9378 could not be found. Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32b34921-e8e6-40e0-8b18-92825ace3467 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Request method failure captured: Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378 HTTP/1.1 Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCagBxj5yRbrS-M3HuQVjTOEfPXuuqXXwCf03aKe6d7Isb_lzgkN2Yc6jurbxop1Xl2b_551VaoCOyehQKhtvDLwhOnKy7q7EaBdpwHzpJ6B0kzQPesE61intdHLzjpJFGPpZ7ePiyemPzMCbBlPU-TuOSpjENIs8a6C_OEOO7xqh-VE Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: f9a973171de940f0bdf5bdee830dcc22 Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersAaction247Test-1107948769 Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9a973171de940f0bdf5bdee830dcc22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f9a973171de940f0bdf5bdee830dcc22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f9a973171de940f0bdf5bdee830dcc22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9a973171de940f0bdf5bdee830dcc22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersAaction247Test-1107948769 Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: f9a973171de940f0bdf5bdee830dcc22 Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersAaction247Test-1107948769 Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersAaction247Test-1107948769-project Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: a4e4f2a7afe34d23855017c1e3451c2c Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersAaction247Test-1107948769-project Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 36408219-4078-4c71-9c55-b800213d9378 could not be found. Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '36408219-4078-4c71-9c55-b800213d9378'} Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36408219-4078-4c71-9c55-b800213d9378 could not be found. Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36408219-4078-4c71-9c55-b800213d9378 could not be found. Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:46.226713 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:13:46.230951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:46.230951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:13:46.230951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:13:46.230951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:13:46.230951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:13:46.230951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:13:46.230951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36408219-4078-4c71-9c55-b800213d9378 could not be found. Aug 27 05:13:46.230951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:13:46.230951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32b34921-e8e6-40e0-8b18-92825ace3467 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] Returning 404 to user: Instance 36408219-4078-4c71-9c55-b800213d9378 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:13:46.230951 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32b34921-e8e6-40e0-8b18-92825ace3467 tempest-ServersAaction247Test-1107948769 tempest-ServersAaction247Test-1107948769-project] 10.222.0.79 "GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378" status: 404 len: 111 microversion: 2.47 time: 0.035518 Aug 27 05:13:46.230951 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3298/6542] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:13:46 2022] GET /compute/v2.1/servers/36408219-4078-4c71-9c55-b800213d9378 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:13:52.020746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:52.022722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=12 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:52.160725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1758529536", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1e3f8526-f9ac-45d0-b6f6-7110f51faec5"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:52.224034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] validate_networks() for [('1e3f8526-f9ac-45d0-b6f6-7110f51faec5', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:13:52.637325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:13:52.637750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:13:52.639155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:13:52.640133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:13:52.640575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:13:52.650819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:52.651628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:52.652197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:52.653911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:52.653911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:52.653911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:52.685401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Getting quotas for project c3ef5a6ae1eb45f49df363d20e0d9396. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:13:52.692116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Getting quotas for user c91214a4c9894e4ab0d42447c858a8ae and project c3ef5a6ae1eb45f49df363d20e0d9396. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:13:52.705886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:13:52.708330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:13:52.766705 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-543607eb-c241-4ea8-bdfd-666a982e56b5 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748214 Aug 27 05:13:52.767963 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3245/6543] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:13:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:13:52.778924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2179ecb-a721-4c28-8ed0-1cde00dc9e15 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:52.779569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2179ecb-a721-4c28-8ed0-1cde00dc9e15 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:52.793460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:52.871625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c2179ecb-a721-4c28-8ed0-1cde00dc9e15 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c91214a4c9894e4ab0d42447c858a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ef5a6ae1eb45f49df363d20e0d9396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:52.881310 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2179ecb-a721-4c28-8ed0-1cde00dc9e15 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 200 len: 1217 microversion: 2.1 time: 0.105957 Aug 27 05:13:52.881760 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3299/6544] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:52 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:53.905832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68a064cc-32a6-4ab6-8c66-fe6ae83a91b2 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:53.906464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-68a064cc-32a6-4ab6-8c66-fe6ae83a91b2 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:53.914018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68a064cc-32a6-4ab6-8c66-fe6ae83a91b2 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:53.914616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68a064cc-32a6-4ab6-8c66-fe6ae83a91b2 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:53.915156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68a064cc-32a6-4ab6-8c66-fe6ae83a91b2 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:53.915872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68a064cc-32a6-4ab6-8c66-fe6ae83a91b2 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:53.916341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68a064cc-32a6-4ab6-8c66-fe6ae83a91b2 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:53.916795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68a064cc-32a6-4ab6-8c66-fe6ae83a91b2 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:54.325705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-68a064cc-32a6-4ab6-8c66-fe6ae83a91b2 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c91214a4c9894e4ab0d42447c858a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ef5a6ae1eb45f49df363d20e0d9396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:54.333639 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-68a064cc-32a6-4ab6-8c66-fe6ae83a91b2 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 200 len: 1277 microversion: 2.1 time: 0.433299 Aug 27 05:13:54.334331 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3246/6545] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:53 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 1277 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:55.355563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1093435e-d9f2-43b6-bfe6-4ee47354a66d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:55.357220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1093435e-d9f2-43b6-bfe6-4ee47354a66d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:55.366103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1093435e-d9f2-43b6-bfe6-4ee47354a66d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:55.366622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1093435e-d9f2-43b6-bfe6-4ee47354a66d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:55.367079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1093435e-d9f2-43b6-bfe6-4ee47354a66d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:55.367806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1093435e-d9f2-43b6-bfe6-4ee47354a66d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:55.368381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1093435e-d9f2-43b6-bfe6-4ee47354a66d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:55.368852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1093435e-d9f2-43b6-bfe6-4ee47354a66d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:55.527656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1093435e-d9f2-43b6-bfe6-4ee47354a66d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c91214a4c9894e4ab0d42447c858a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ef5a6ae1eb45f49df363d20e0d9396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:55.535599 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1093435e-d9f2-43b6-bfe6-4ee47354a66d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 200 len: 1317 microversion: 2.1 time: 0.185101 Aug 27 05:13:55.537225 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3300/6546] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:55 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:55.605216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-6b2dbd19-3d11-4e15-974d-35fd607fc72d req-b260a242-1dc5-43e4-8e72-698ab017bc9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01211635-5db7-431f-8281-776db227e539", "tag": "ab3e5256-294d-4198-92c5-6beb471c1d3c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:13:55.625472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6b2dbd19-3d11-4e15-974d-35fd607fc72d req-b260a242-1dc5-43e4-8e72-698ab017bc9a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:55.626257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6b2dbd19-3d11-4e15-974d-35fd607fc72d req-b260a242-1dc5-43e4-8e72-698ab017bc9a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:55.626870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6b2dbd19-3d11-4e15-974d-35fd607fc72d req-b260a242-1dc5-43e4-8e72-698ab017bc9a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:55.641082 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-6b2dbd19-3d11-4e15-974d-35fd607fc72d req-b260a242-1dc5-43e4-8e72-698ab017bc9a service nova] Creating event network-changed:ab3e5256-294d-4198-92c5-6beb471c1d3c for instance 01211635-5db7-431f-8281-776db227e539 on n-h2-854823-1 Aug 27 05:13:55.646966 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-6b2dbd19-3d11-4e15-974d-35fd607fc72d req-b260a242-1dc5-43e4-8e72-698ab017bc9a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045983 Aug 27 05:13:55.648442 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3247/6547] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:13:56.558139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-305fe304-4981-4290-8aa4-08ee44dba4ca tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:56.558772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-305fe304-4981-4290-8aa4-08ee44dba4ca tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:56.566216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-305fe304-4981-4290-8aa4-08ee44dba4ca tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:56.566714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-305fe304-4981-4290-8aa4-08ee44dba4ca tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:56.567164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-305fe304-4981-4290-8aa4-08ee44dba4ca tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:56.567871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-305fe304-4981-4290-8aa4-08ee44dba4ca tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:56.568338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-305fe304-4981-4290-8aa4-08ee44dba4ca tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:56.568835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-305fe304-4981-4290-8aa4-08ee44dba4ca tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:56.700212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-305fe304-4981-4290-8aa4-08ee44dba4ca tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c91214a4c9894e4ab0d42447c858a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ef5a6ae1eb45f49df363d20e0d9396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:56.710253 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-305fe304-4981-4290-8aa4-08ee44dba4ca tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 200 len: 1317 microversion: 2.1 time: 0.156205 Aug 27 05:13:56.710841 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3301/6548] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:56 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:13:57.731883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2ee1c520-2d0c-458a-83c4-f0c65f7025cf tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:57.732611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2ee1c520-2d0c-458a-83c4-f0c65f7025cf tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:57.739733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ee1c520-2d0c-458a-83c4-f0c65f7025cf tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:57.740161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ee1c520-2d0c-458a-83c4-f0c65f7025cf tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:57.740618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ee1c520-2d0c-458a-83c4-f0c65f7025cf tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:57.741312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ee1c520-2d0c-458a-83c4-f0c65f7025cf tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:57.741765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ee1c520-2d0c-458a-83c4-f0c65f7025cf tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:57.742182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ee1c520-2d0c-458a-83c4-f0c65f7025cf tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:57.873299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2ee1c520-2d0c-458a-83c4-f0c65f7025cf tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c91214a4c9894e4ab0d42447c858a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ef5a6ae1eb45f49df363d20e0d9396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:57.881747 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2ee1c520-2d0c-458a-83c4-f0c65f7025cf tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 200 len: 1317 microversion: 2.1 time: 0.154154 Aug 27 05:13:57.882318 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3248/6549] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:57 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:13:58.902873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c107bbb9-b69b-4dcd-9a46-4314e51ced73 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:13:58.903503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c107bbb9-b69b-4dcd-9a46-4314e51ced73 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:13:58.911123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c107bbb9-b69b-4dcd-9a46-4314e51ced73 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:58.911622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c107bbb9-b69b-4dcd-9a46-4314e51ced73 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:58.912078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c107bbb9-b69b-4dcd-9a46-4314e51ced73 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:58.912807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c107bbb9-b69b-4dcd-9a46-4314e51ced73 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:13:58.913277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c107bbb9-b69b-4dcd-9a46-4314e51ced73 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:13:58.913717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c107bbb9-b69b-4dcd-9a46-4314e51ced73 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:13:59.044383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c107bbb9-b69b-4dcd-9a46-4314e51ced73 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c91214a4c9894e4ab0d42447c858a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ef5a6ae1eb45f49df363d20e0d9396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:13:59.052103 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c107bbb9-b69b-4dcd-9a46-4314e51ced73 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 200 len: 1317 microversion: 2.1 time: 0.153364 Aug 27 05:13:59.052708 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3302/6550] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:13:58 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:00.073464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f49b50ac-f285-4568-9dca-47e287731e47 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:00.074081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f49b50ac-f285-4568-9dca-47e287731e47 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:00.080963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f49b50ac-f285-4568-9dca-47e287731e47 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:00.081452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f49b50ac-f285-4568-9dca-47e287731e47 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:00.081885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f49b50ac-f285-4568-9dca-47e287731e47 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:00.082580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f49b50ac-f285-4568-9dca-47e287731e47 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:00.083037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f49b50ac-f285-4568-9dca-47e287731e47 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:00.083467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f49b50ac-f285-4568-9dca-47e287731e47 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:00.086129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:00.223822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f49b50ac-f285-4568-9dca-47e287731e47 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c91214a4c9894e4ab0d42447c858a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ef5a6ae1eb45f49df363d20e0d9396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:00.231510 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f49b50ac-f285-4568-9dca-47e287731e47 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 200 len: 1317 microversion: 2.1 time: 0.161993 Aug 27 05:14:00.232092 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3249/6551] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:00 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:01.253189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-80812aa6-e707-4975-9937-8e2aeeccc217 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:01.253821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-80812aa6-e707-4975-9937-8e2aeeccc217 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:01.261151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80812aa6-e707-4975-9937-8e2aeeccc217 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:01.261649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80812aa6-e707-4975-9937-8e2aeeccc217 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:01.262093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80812aa6-e707-4975-9937-8e2aeeccc217 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:01.262802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80812aa6-e707-4975-9937-8e2aeeccc217 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:01.263270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80812aa6-e707-4975-9937-8e2aeeccc217 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:01.263707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80812aa6-e707-4975-9937-8e2aeeccc217 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:01.397396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80812aa6-e707-4975-9937-8e2aeeccc217 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c91214a4c9894e4ab0d42447c858a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ef5a6ae1eb45f49df363d20e0d9396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:01.405270 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-80812aa6-e707-4975-9937-8e2aeeccc217 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 200 len: 1317 microversion: 2.1 time: 0.156984 Aug 27 05:14:01.405853 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3303/6552] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:01 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:02.426153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-89a9a7f7-725d-40c0-a992-c53cf0665412 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:02.426674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-89a9a7f7-725d-40c0-a992-c53cf0665412 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:02.433494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-89a9a7f7-725d-40c0-a992-c53cf0665412 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:02.433976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-89a9a7f7-725d-40c0-a992-c53cf0665412 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:02.434566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-89a9a7f7-725d-40c0-a992-c53cf0665412 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:02.435271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-89a9a7f7-725d-40c0-a992-c53cf0665412 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:02.435708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-89a9a7f7-725d-40c0-a992-c53cf0665412 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:02.436132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-89a9a7f7-725d-40c0-a992-c53cf0665412 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:02.570362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-89a9a7f7-725d-40c0-a992-c53cf0665412 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c91214a4c9894e4ab0d42447c858a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ef5a6ae1eb45f49df363d20e0d9396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:02.578925 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-89a9a7f7-725d-40c0-a992-c53cf0665412 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 200 len: 1317 microversion: 2.1 time: 0.156636 Aug 27 05:14:02.579557 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3250/6553] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:02 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:02.644960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4462623b-dbd5-4e28-b153-488849ecf4a1 req-206786d4-7efb-45c5-88a6-4c7cb876ee07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01211635-5db7-431f-8281-776db227e539", "name": "network-vif-plugged", "status": "completed", "tag": "ab3e5256-294d-4198-92c5-6beb471c1d3c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:02.650808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:02.657713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4462623b-dbd5-4e28-b153-488849ecf4a1 req-206786d4-7efb-45c5-88a6-4c7cb876ee07 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:02.658223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4462623b-dbd5-4e28-b153-488849ecf4a1 req-206786d4-7efb-45c5-88a6-4c7cb876ee07 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:02.658678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4462623b-dbd5-4e28-b153-488849ecf4a1 req-206786d4-7efb-45c5-88a6-4c7cb876ee07 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:02.672404 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4462623b-dbd5-4e28-b153-488849ecf4a1 req-206786d4-7efb-45c5-88a6-4c7cb876ee07 service nova] Creating event network-vif-plugged:ab3e5256-294d-4198-92c5-6beb471c1d3c for instance 01211635-5db7-431f-8281-776db227e539 on n-h2-854823-1 Aug 27 05:14:02.677448 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4462623b-dbd5-4e28-b153-488849ecf4a1 req-206786d4-7efb-45c5-88a6-4c7cb876ee07 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036303 Aug 27 05:14:02.678003 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3304/6554] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:03.600838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e34ffe0-5f12-46c2-bbca-66059c17733a tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:03.601457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e34ffe0-5f12-46c2-bbca-66059c17733a tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:03.603362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:03.604073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:03.610908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e34ffe0-5f12-46c2-bbca-66059c17733a tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:03.611391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e34ffe0-5f12-46c2-bbca-66059c17733a tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:03.611851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e34ffe0-5f12-46c2-bbca-66059c17733a tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:03.612622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e34ffe0-5f12-46c2-bbca-66059c17733a tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:03.613086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e34ffe0-5f12-46c2-bbca-66059c17733a tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:03.613515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e34ffe0-5f12-46c2-bbca-66059c17733a tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:03.754288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9e34ffe0-5f12-46c2-bbca-66059c17733a tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c91214a4c9894e4ab0d42447c858a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ef5a6ae1eb45f49df363d20e0d9396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:03.762201 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e34ffe0-5f12-46c2-bbca-66059c17733a tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 200 len: 1317 microversion: 2.1 time: 0.165396 Aug 27 05:14:03.762791 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3251/6555] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:03 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:04.780311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:04.786070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ca991a7-2494-4500-acb9-4b79576ea405 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:04.786778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ca991a7-2494-4500-acb9-4b79576ea405 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:04.793248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca991a7-2494-4500-acb9-4b79576ea405 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:04.793748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca991a7-2494-4500-acb9-4b79576ea405 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:04.794195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca991a7-2494-4500-acb9-4b79576ea405 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:04.794884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca991a7-2494-4500-acb9-4b79576ea405 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:04.795349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca991a7-2494-4500-acb9-4b79576ea405 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:04.795782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca991a7-2494-4500-acb9-4b79576ea405 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:04.926944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ca991a7-2494-4500-acb9-4b79576ea405 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c91214a4c9894e4ab0d42447c858a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ef5a6ae1eb45f49df363d20e0d9396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:04.934827 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ca991a7-2494-4500-acb9-4b79576ea405 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 200 len: 1505 microversion: 2.1 time: 0.155441 Aug 27 05:14:04.935407 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3305/6556] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:04 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:04.955568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9192a3a7-ef6f-4e67-bf21-8d01194d649b tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:04.956125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9192a3a7-ef6f-4e67-bf21-8d01194d649b tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:04.963062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9192a3a7-ef6f-4e67-bf21-8d01194d649b tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:04.963544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9192a3a7-ef6f-4e67-bf21-8d01194d649b tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:04.963980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9192a3a7-ef6f-4e67-bf21-8d01194d649b tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:04.965004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9192a3a7-ef6f-4e67-bf21-8d01194d649b tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:04.965454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9192a3a7-ef6f-4e67-bf21-8d01194d649b tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:04.965876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9192a3a7-ef6f-4e67-bf21-8d01194d649b tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:04.989605 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9192a3a7-ef6f-4e67-bf21-8d01194d649b tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539/ips" status: 200 len: 108 microversion: 2.1 time: 0.038414 Aug 27 05:14:04.990185 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3252/6557] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 05:14:04 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539/ips => generated 108 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:05.003864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba3a4ee9-17c2-42b4-bf76-526d5aa97404 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:05.004483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba3a4ee9-17c2-42b4-bf76-526d5aa97404 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:05.011047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba3a4ee9-17c2-42b4-bf76-526d5aa97404 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:05.011790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba3a4ee9-17c2-42b4-bf76-526d5aa97404 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:05.012430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba3a4ee9-17c2-42b4-bf76-526d5aa97404 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:05.013188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba3a4ee9-17c2-42b4-bf76-526d5aa97404 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:05.013673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba3a4ee9-17c2-42b4-bf76-526d5aa97404 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:05.014117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba3a4ee9-17c2-42b4-bf76-526d5aa97404 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:05.038729 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba3a4ee9-17c2-42b4-bf76-526d5aa97404 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539/ips" status: 200 len: 108 microversion: 2.1 time: 0.039579 Aug 27 05:14:05.039234 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3306/6558] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 05:14:04 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539/ips => generated 108 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:05.050029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-70a94213-2067-45fd-a57c-74ecb63df0d8 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:05.050557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-70a94213-2067-45fd-a57c-74ecb63df0d8 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:05.056703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70a94213-2067-45fd-a57c-74ecb63df0d8 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:05.057184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70a94213-2067-45fd-a57c-74ecb63df0d8 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:05.057618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70a94213-2067-45fd-a57c-74ecb63df0d8 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:05.058303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70a94213-2067-45fd-a57c-74ecb63df0d8 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:05.058754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70a94213-2067-45fd-a57c-74ecb63df0d8 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:05.059176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70a94213-2067-45fd-a57c-74ecb63df0d8 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:05.082975 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-70a94213-2067-45fd-a57c-74ecb63df0d8 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539/ips/tempest-ServerAddressesTestJSON-183879618-network" status: 200 len: 93 microversion: 2.1 time: 0.036739 Aug 27 05:14:05.083558 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3253/6559] 10.222.0.79 () {58 vars in 1398 bytes} [Sat Aug 27 05:14:05 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539/ips/tempest-ServerAddressesTestJSON-183879618-network => generated 93 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:14:05.094970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf16aa30-3601-46bb-b101-ccd3b362be48 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:05.095522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf16aa30-3601-46bb-b101-ccd3b362be48 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:05.102474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf16aa30-3601-46bb-b101-ccd3b362be48 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:05.102982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf16aa30-3601-46bb-b101-ccd3b362be48 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:05.103446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf16aa30-3601-46bb-b101-ccd3b362be48 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:05.104187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf16aa30-3601-46bb-b101-ccd3b362be48 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:05.104693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf16aa30-3601-46bb-b101-ccd3b362be48 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:05.105139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf16aa30-3601-46bb-b101-ccd3b362be48 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:05.130391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf16aa30-3601-46bb-b101-ccd3b362be48 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:14:05.164384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:05.207820 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf16aa30-3601-46bb-b101-ccd3b362be48 tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "DELETE /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 204 len: 0 microversion: 2.1 time: 0.116338 Aug 27 05:14:05.208415 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3307/6560] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:14:05 2022] DELETE /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:14:05.217039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f8402bf-4e0a-44ae-bec7-87a44d6ab53d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:05.217660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4f8402bf-4e0a-44ae-bec7-87a44d6ab53d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:05.223645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f8402bf-4e0a-44ae-bec7-87a44d6ab53d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:05.224124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f8402bf-4e0a-44ae-bec7-87a44d6ab53d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:05.224631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f8402bf-4e0a-44ae-bec7-87a44d6ab53d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:05.225310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f8402bf-4e0a-44ae-bec7-87a44d6ab53d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:05.225766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f8402bf-4e0a-44ae-bec7-87a44d6ab53d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:05.226184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4f8402bf-4e0a-44ae-bec7-87a44d6ab53d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:05.363063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4f8402bf-4e0a-44ae-bec7-87a44d6ab53d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c91214a4c9894e4ab0d42447c858a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ef5a6ae1eb45f49df363d20e0d9396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:05.378120 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4f8402bf-4e0a-44ae-bec7-87a44d6ab53d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 200 len: 1511 microversion: 2.1 time: 0.164078 Aug 27 05:14:05.378744 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3254/6561] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:05 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:06.399986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-48549248-7f7b-442a-8f38-abdea96653fb tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:06.400700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-48549248-7f7b-442a-8f38-abdea96653fb tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:06.407753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48549248-7f7b-442a-8f38-abdea96653fb tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:06.408255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48549248-7f7b-442a-8f38-abdea96653fb tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:06.408740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48549248-7f7b-442a-8f38-abdea96653fb tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:06.409480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48549248-7f7b-442a-8f38-abdea96653fb tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:06.409941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48549248-7f7b-442a-8f38-abdea96653fb tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:06.410373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48549248-7f7b-442a-8f38-abdea96653fb tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:06.624328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-48549248-7f7b-442a-8f38-abdea96653fb tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c91214a4c9894e4ab0d42447c858a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ef5a6ae1eb45f49df363d20e0d9396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:06.634340 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-48549248-7f7b-442a-8f38-abdea96653fb tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 200 len: 1511 microversion: 2.1 time: 0.238641 Aug 27 05:14:06.641148 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3308/6562] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:06 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 1511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:07.165755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-7ed33e90-02a8-43d9-8609-526abcfc01bd req-35e6a7a0-6d9d-432c-93d1-2e4f3590650d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01211635-5db7-431f-8281-776db227e539", "name": "network-vif-deleted", "tag": "ab3e5256-294d-4198-92c5-6beb471c1d3c"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:07.179187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7ed33e90-02a8-43d9-8609-526abcfc01bd req-35e6a7a0-6d9d-432c-93d1-2e4f3590650d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:07.179991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7ed33e90-02a8-43d9-8609-526abcfc01bd req-35e6a7a0-6d9d-432c-93d1-2e4f3590650d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:07.180426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7ed33e90-02a8-43d9-8609-526abcfc01bd req-35e6a7a0-6d9d-432c-93d1-2e4f3590650d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:07.193971 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-7ed33e90-02a8-43d9-8609-526abcfc01bd req-35e6a7a0-6d9d-432c-93d1-2e4f3590650d service nova] Creating event network-vif-deleted:ab3e5256-294d-4198-92c5-6beb471c1d3c for instance 01211635-5db7-431f-8281-776db227e539 on n-h2-854823-1 Aug 27 05:14:07.200324 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-7ed33e90-02a8-43d9-8609-526abcfc01bd req-35e6a7a0-6d9d-432c-93d1-2e4f3590650d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118596 Aug 27 05:14:07.201876 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3255/6563] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:07.660600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f9058b8-8fe6-44a5-9f0e-28fc6d0dcb1d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:07.660600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f9058b8-8fe6-44a5-9f0e-28fc6d0dcb1d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] [instance: 01211635-5db7-431f-8281-776db227e539] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:07.662844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f9058b8-8fe6-44a5-9f0e-28fc6d0dcb1d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:07.663716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f9058b8-8fe6-44a5-9f0e-28fc6d0dcb1d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:07.664550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f9058b8-8fe6-44a5-9f0e-28fc6d0dcb1d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:07.665815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f9058b8-8fe6-44a5-9f0e-28fc6d0dcb1d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:07.666663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f9058b8-8fe6-44a5-9f0e-28fc6d0dcb1d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:07.667494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f9058b8-8fe6-44a5-9f0e-28fc6d0dcb1d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:07.686922 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8f9058b8-8fe6-44a5-9f0e-28fc6d0dcb1d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] HTTP exception thrown: Instance 01211635-5db7-431f-8281-776db227e539 could not be found. Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f9058b8-8fe6-44a5-9f0e-28fc6d0dcb1d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Request method failure captured: Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 HTTP/1.1 Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCagPfS_QALTuYEkxxRmhRsFIPxPWYDlLuh6CR1WTjtNCyWICouy5pG7WZ7vGywSE9N_krfVDOYMA8mEdERp7STkg6D6GqcFuaWCn5Bt6_bRYyGmUDsq4dVz8tAtuxmA7X-wLfz2yxwOpe7yrvFZyYD4J0O-VSMfBQGBOYhUQgSvx6do Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: c3ef5a6ae1eb45f49df363d20e0d9396 Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerAddressesTestJSON-2075956510 Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c3ef5a6ae1eb45f49df363d20e0d9396"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c3ef5a6ae1eb45f49df363d20e0d9396"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c3ef5a6ae1eb45f49df363d20e0d9396"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c3ef5a6ae1eb45f49df363d20e0d9396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerAddressesTestJSON-2075956510 Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: c3ef5a6ae1eb45f49df363d20e0d9396 Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2075956510 Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerAddressesTestJSON-2075956510-project Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: c91214a4c9894e4ab0d42447c858a8ae Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerAddressesTestJSON-2075956510-project Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 01211635-5db7-431f-8281-776db227e539 could not be found. Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '01211635-5db7-431f-8281-776db227e539'} Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01211635-5db7-431f-8281-776db227e539 could not be found. Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01211635-5db7-431f-8281-776db227e539 could not be found. Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:07.689365 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:14:07.694307 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:07.694307 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:14:07.694307 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:14:07.694307 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:14:07.694307 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:14:07.694307 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01211635-5db7-431f-8281-776db227e539 could not be found. Aug 27 05:14:07.694307 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:14:07.694307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f9058b8-8fe6-44a5-9f0e-28fc6d0dcb1d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] Returning 404 to user: Instance 01211635-5db7-431f-8281-776db227e539 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:14:07.694307 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f9058b8-8fe6-44a5-9f0e-28fc6d0dcb1d tempest-ServerAddressesTestJSON-2075956510 tempest-ServerAddressesTestJSON-2075956510-project] 10.222.0.79 "GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539" status: 404 len: 111 microversion: 2.1 time: 0.040100 Aug 27 05:14:07.694307 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3309/6564] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:07 2022] GET /compute/v2.1/servers/01211635-5db7-431f-8281-776db227e539 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:14:16.565165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-160479573", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "77ce2559-af37-4a03-aee8-4735f58f1dd2"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:16.573842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:16.619384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] validate_networks() for [('77ce2559-af37-4a03-aee8-4735f58f1dd2', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:14:17.090872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:14:17.091315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:14:17.091824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:14:17.092229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:14:17.092800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:14:17.101768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:17.102277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:17.102736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:17.103459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:17.103913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:17.104329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:17.123655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:14:17.130262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for user 3d3d0735d85744b3a52e0e0d6dd64174 and project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:14:17.144498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:14:17.146922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:14:17.200288 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bbd77134-9dc6-49f4-944f-80bc8ecedfda tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771490 Aug 27 05:14:17.201249 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3256/6565] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:14:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:14:17.212289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7036ae2f-feaa-4d0e-9795-ab18687f7587 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:17.213268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7036ae2f-feaa-4d0e-9795-ab18687f7587 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:17.279697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7036ae2f-feaa-4d0e-9795-ab18687f7587 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:17.286962 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7036ae2f-feaa-4d0e-9795-ab18687f7587 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 200 len: 1192 microversion: 2.1 time: 0.078531 Aug 27 05:14:17.287721 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3310/6566] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:17 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 1192 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:18.308559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-32161bb9-c7e5-4873-ac03-17921c3d3992 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:18.309231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-32161bb9-c7e5-4873-ac03-17921c3d3992 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:18.327979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32161bb9-c7e5-4873-ac03-17921c3d3992 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:18.328486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32161bb9-c7e5-4873-ac03-17921c3d3992 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:18.329594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32161bb9-c7e5-4873-ac03-17921c3d3992 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:18.330278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32161bb9-c7e5-4873-ac03-17921c3d3992 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:18.330739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32161bb9-c7e5-4873-ac03-17921c3d3992 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:18.331172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32161bb9-c7e5-4873-ac03-17921c3d3992 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:18.420483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-32161bb9-c7e5-4873-ac03-17921c3d3992 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:18.429146 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-32161bb9-c7e5-4873-ac03-17921c3d3992 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 200 len: 1252 microversion: 2.1 time: 0.125468 Aug 27 05:14:18.429758 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3257/6567] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:18 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 1252 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:19.451579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f585132-3982-4cfb-a62c-4ac5cbb7d3c4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:19.458466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f585132-3982-4cfb-a62c-4ac5cbb7d3c4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:19.460734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:19.472052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f585132-3982-4cfb-a62c-4ac5cbb7d3c4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:19.472593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f585132-3982-4cfb-a62c-4ac5cbb7d3c4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:19.473202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f585132-3982-4cfb-a62c-4ac5cbb7d3c4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:19.473935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f585132-3982-4cfb-a62c-4ac5cbb7d3c4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:19.474403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f585132-3982-4cfb-a62c-4ac5cbb7d3c4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:19.474971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f585132-3982-4cfb-a62c-4ac5cbb7d3c4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:19.615587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8f585132-3982-4cfb-a62c-4ac5cbb7d3c4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:19.624545 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f585132-3982-4cfb-a62c-4ac5cbb7d3c4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 200 len: 1292 microversion: 2.1 time: 0.176919 Aug 27 05:14:19.625811 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3311/6568] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:19 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 1292 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:19.844883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d1daf16e-7b0c-4826-a51c-b5bbea3d81f2 req-0e5e5814-bb22-4306-9c06-13d105a25b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40122696-5020-4974-81a3-df95d8cf8d01", "tag": "cdafc48e-fc01-46e5-a121-d5a31e1b3270"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:19.858379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d1daf16e-7b0c-4826-a51c-b5bbea3d81f2 req-0e5e5814-bb22-4306-9c06-13d105a25b4a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:19.858867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d1daf16e-7b0c-4826-a51c-b5bbea3d81f2 req-0e5e5814-bb22-4306-9c06-13d105a25b4a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:19.859949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d1daf16e-7b0c-4826-a51c-b5bbea3d81f2 req-0e5e5814-bb22-4306-9c06-13d105a25b4a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:19.873110 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d1daf16e-7b0c-4826-a51c-b5bbea3d81f2 req-0e5e5814-bb22-4306-9c06-13d105a25b4a service nova] Creating event network-changed:cdafc48e-fc01-46e5-a121-d5a31e1b3270 for instance 40122696-5020-4974-81a3-df95d8cf8d01 on n-h2-854823-1 Aug 27 05:14:19.878433 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d1daf16e-7b0c-4826-a51c-b5bbea3d81f2 req-0e5e5814-bb22-4306-9c06-13d105a25b4a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037371 Aug 27 05:14:19.879034 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3258/6569] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:20.648044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e099e790-5c36-40f0-927b-e5fffc666910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:20.648609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e099e790-5c36-40f0-927b-e5fffc666910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:20.655540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e099e790-5c36-40f0-927b-e5fffc666910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:20.656049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e099e790-5c36-40f0-927b-e5fffc666910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:20.656572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e099e790-5c36-40f0-927b-e5fffc666910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:20.657324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e099e790-5c36-40f0-927b-e5fffc666910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:20.657711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e099e790-5c36-40f0-927b-e5fffc666910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:20.658153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e099e790-5c36-40f0-927b-e5fffc666910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:20.789625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e099e790-5c36-40f0-927b-e5fffc666910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:20.798303 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e099e790-5c36-40f0-927b-e5fffc666910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 200 len: 1292 microversion: 2.1 time: 0.153720 Aug 27 05:14:20.799036 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3312/6570] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:20 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 1292 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:21.820821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d99f9666-20b3-4310-a549-527d20992dc4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:21.821456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d99f9666-20b3-4310-a549-527d20992dc4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:21.827677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d99f9666-20b3-4310-a549-527d20992dc4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:21.828163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d99f9666-20b3-4310-a549-527d20992dc4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:21.828636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d99f9666-20b3-4310-a549-527d20992dc4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:21.829828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d99f9666-20b3-4310-a549-527d20992dc4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:21.830287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d99f9666-20b3-4310-a549-527d20992dc4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:21.830719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d99f9666-20b3-4310-a549-527d20992dc4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:21.962634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d99f9666-20b3-4310-a549-527d20992dc4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:21.970419 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d99f9666-20b3-4310-a549-527d20992dc4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 200 len: 1292 microversion: 2.1 time: 0.154862 Aug 27 05:14:21.970991 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3259/6571] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:21 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 1292 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:22.991649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56d6edf7-371c-4854-9ad7-85a81e874b71 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:22.992207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-56d6edf7-371c-4854-9ad7-85a81e874b71 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:22.998690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56d6edf7-371c-4854-9ad7-85a81e874b71 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:22.999188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56d6edf7-371c-4854-9ad7-85a81e874b71 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:22.999635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56d6edf7-371c-4854-9ad7-85a81e874b71 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:23.000347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56d6edf7-371c-4854-9ad7-85a81e874b71 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:23.001107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56d6edf7-371c-4854-9ad7-85a81e874b71 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:23.001541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56d6edf7-371c-4854-9ad7-85a81e874b71 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:23.135273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-56d6edf7-371c-4854-9ad7-85a81e874b71 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:23.144686 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-56d6edf7-371c-4854-9ad7-85a81e874b71 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 200 len: 1292 microversion: 2.1 time: 0.157248 Aug 27 05:14:23.145271 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3313/6572] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:22 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 1292 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:24.165840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-33428fdf-1a2d-4627-a43e-1d2b13e0b7cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:24.166479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-33428fdf-1a2d-4627-a43e-1d2b13e0b7cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:24.173793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33428fdf-1a2d-4627-a43e-1d2b13e0b7cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:24.174302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33428fdf-1a2d-4627-a43e-1d2b13e0b7cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:24.174755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33428fdf-1a2d-4627-a43e-1d2b13e0b7cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:24.175895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33428fdf-1a2d-4627-a43e-1d2b13e0b7cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:24.176353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33428fdf-1a2d-4627-a43e-1d2b13e0b7cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:24.176798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33428fdf-1a2d-4627-a43e-1d2b13e0b7cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:24.312694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-33428fdf-1a2d-4627-a43e-1d2b13e0b7cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:24.320373 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-33428fdf-1a2d-4627-a43e-1d2b13e0b7cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 200 len: 1292 microversion: 2.1 time: 0.158499 Aug 27 05:14:24.320994 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3260/6573] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:24 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 1292 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:25.341076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5ec2324-c2fc-4ed0-a183-a43208781980 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:25.341697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d5ec2324-c2fc-4ed0-a183-a43208781980 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:25.350217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ec2324-c2fc-4ed0-a183-a43208781980 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:25.350721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ec2324-c2fc-4ed0-a183-a43208781980 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:25.351176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ec2324-c2fc-4ed0-a183-a43208781980 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:25.351879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ec2324-c2fc-4ed0-a183-a43208781980 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:25.352347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ec2324-c2fc-4ed0-a183-a43208781980 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:25.352802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ec2324-c2fc-4ed0-a183-a43208781980 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:25.484949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d5ec2324-c2fc-4ed0-a183-a43208781980 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:25.492928 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5ec2324-c2fc-4ed0-a183-a43208781980 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 200 len: 1292 microversion: 2.1 time: 0.155709 Aug 27 05:14:25.493512 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3314/6574] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:25 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 1292 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:26.513709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-312341fc-0308-4582-9508-00e608eaeccf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:26.514325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-312341fc-0308-4582-9508-00e608eaeccf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:26.521254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-312341fc-0308-4582-9508-00e608eaeccf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:26.521744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-312341fc-0308-4582-9508-00e608eaeccf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:26.522416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-312341fc-0308-4582-9508-00e608eaeccf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:26.523436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-312341fc-0308-4582-9508-00e608eaeccf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:26.524076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-312341fc-0308-4582-9508-00e608eaeccf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:26.524682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-312341fc-0308-4582-9508-00e608eaeccf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:26.656502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-312341fc-0308-4582-9508-00e608eaeccf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:26.665075 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-312341fc-0308-4582-9508-00e608eaeccf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 200 len: 1292 microversion: 2.1 time: 0.155223 Aug 27 05:14:26.665775 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3261/6575] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:26 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 1292 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:26.746463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f24efdc2-12e1-45ac-9589-a37953b703a2 req-4e5209f5-a845-4bd3-ab40-40a8aa1c877c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40122696-5020-4974-81a3-df95d8cf8d01", "name": "network-vif-plugged", "status": "completed", "tag": "cdafc48e-fc01-46e5-a121-d5a31e1b3270"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:26.759142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f24efdc2-12e1-45ac-9589-a37953b703a2 req-4e5209f5-a845-4bd3-ab40-40a8aa1c877c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:26.759654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f24efdc2-12e1-45ac-9589-a37953b703a2 req-4e5209f5-a845-4bd3-ab40-40a8aa1c877c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:26.760098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f24efdc2-12e1-45ac-9589-a37953b703a2 req-4e5209f5-a845-4bd3-ab40-40a8aa1c877c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:26.772036 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f24efdc2-12e1-45ac-9589-a37953b703a2 req-4e5209f5-a845-4bd3-ab40-40a8aa1c877c service nova] Creating event network-vif-plugged:cdafc48e-fc01-46e5-a121-d5a31e1b3270 for instance 40122696-5020-4974-81a3-df95d8cf8d01 on n-h2-854823-1 Aug 27 05:14:26.777036 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f24efdc2-12e1-45ac-9589-a37953b703a2 req-4e5209f5-a845-4bd3-ab40-40a8aa1c877c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034622 Aug 27 05:14:26.777638 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3315/6576] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:27.686518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fe3d529a-99ed-4160-a11e-2372ce22d2ff tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:27.687140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fe3d529a-99ed-4160-a11e-2372ce22d2ff tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:27.689716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:27.690396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:27.697736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe3d529a-99ed-4160-a11e-2372ce22d2ff tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:27.698232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe3d529a-99ed-4160-a11e-2372ce22d2ff tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:27.698677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe3d529a-99ed-4160-a11e-2372ce22d2ff tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:27.699373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe3d529a-99ed-4160-a11e-2372ce22d2ff tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:27.699833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe3d529a-99ed-4160-a11e-2372ce22d2ff tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:27.700264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe3d529a-99ed-4160-a11e-2372ce22d2ff tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:27.833104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fe3d529a-99ed-4160-a11e-2372ce22d2ff tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:27.840890 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fe3d529a-99ed-4160-a11e-2372ce22d2ff tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 200 len: 1292 microversion: 2.1 time: 0.158359 Aug 27 05:14:27.841474 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3262/6577] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:27 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 1292 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:28.861911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b7be8e32-7387-45fc-902c-f794ce73c918 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:28.862622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b7be8e32-7387-45fc-902c-f794ce73c918 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:28.864678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:28.871487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7be8e32-7387-45fc-902c-f794ce73c918 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:28.871979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7be8e32-7387-45fc-902c-f794ce73c918 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:28.872421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7be8e32-7387-45fc-902c-f794ce73c918 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:28.873145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7be8e32-7387-45fc-902c-f794ce73c918 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:28.873610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7be8e32-7387-45fc-902c-f794ce73c918 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:28.874044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7be8e32-7387-45fc-902c-f794ce73c918 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:29.007963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b7be8e32-7387-45fc-902c-f794ce73c918 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:29.017549 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b7be8e32-7387-45fc-902c-f794ce73c918 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 200 len: 1473 microversion: 2.1 time: 0.159143 Aug 27 05:14:29.018179 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3316/6578] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:28 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 1473 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:29.078707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1146474717", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:29.135604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] validate_networks() for [('77ce2559-af37-4a03-aee8-4735f58f1dd2', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:14:29.498990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:14:29.499421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:14:29.500024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:14:29.500469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:14:29.500923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:14:29.510108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:29.510603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:29.511048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:29.511782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:29.512243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:29.512708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:29.529579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:14:29.535335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for user 3d3d0735d85744b3a52e0e0d6dd64174 and project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:14:29.547962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:14:29.550878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 400842fe-f04e-4eaa-a7ee-dc102b473e83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:14:29.596075 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-870a734b-170a-4f69-9dfd-dd1797332ac3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521600 Aug 27 05:14:29.596767 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3263/6579] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:14:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:14:29.607567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b99ec28b-78b4-4743-ad1e-fa4a7ebcc5c0 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:29.608088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b99ec28b-78b4-4743-ad1e-fa4a7ebcc5c0 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 400842fe-f04e-4eaa-a7ee-dc102b473e83] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:29.624806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b99ec28b-78b4-4743-ad1e-fa4a7ebcc5c0 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 400842fe-f04e-4eaa-a7ee-dc102b473e83] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:14:29.816135 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b99ec28b-78b4-4743-ad1e-fa4a7ebcc5c0 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/400842fe-f04e-4eaa-a7ee-dc102b473e83" status: 204 len: 0 microversion: 2.1 time: 0.212253 Aug 27 05:14:29.816973 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3317/6580] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:14:29 2022] DELETE /compute/v2.1/servers/400842fe-f04e-4eaa-a7ee-dc102b473e83 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:14:29.825348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6e5de44e-1e47-4221-8932-a98e93c2f5c3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:29.826052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6e5de44e-1e47-4221-8932-a98e93c2f5c3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 400842fe-f04e-4eaa-a7ee-dc102b473e83] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:29.841923 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-6e5de44e-1e47-4221-8932-a98e93c2f5c3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6e5de44e-1e47-4221-8932-a98e93c2f5c3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/400842fe-f04e-4eaa-a7ee-dc102b473e83 HTTP/1.1 Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '400842fe-f04e-4eaa-a7ee-dc102b473e83'} Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:14:29.844372 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6e5de44e-1e47-4221-8932-a98e93c2f5c3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6e5de44e-1e47-4221-8932-a98e93c2f5c3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/400842fe-f04e-4eaa-a7ee-dc102b473e83" status: 404 len: 111 microversion: 2.1 time: 0.025278 Aug 27 05:14:29.850386 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3264/6581] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:29 2022] GET /compute/v2.1/servers/400842fe-f04e-4eaa-a7ee-dc102b473e83 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:14:29.903801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1085034705", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "77ce2559-af37-4a03-aee8-4735f58f1dd2"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:29.959464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] validate_networks() for [('77ce2559-af37-4a03-aee8-4735f58f1dd2', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:14:30.387050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:14:30.387480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:14:30.387963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:14:30.388383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:14:30.388846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:14:30.398753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:30.399240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:30.399685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:30.400413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:30.400901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:30.401334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:30.418610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:14:30.423926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for user 3d3d0735d85744b3a52e0e0d6dd64174 and project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:14:30.436880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:14:30.439716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:14:30.485395 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc49b39d-4a6a-4fad-9a3a-543c77bbec6e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585666 Aug 27 05:14:30.486100 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3318/6582] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:14:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:14:30.497730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f12bc76e-ad42-4c93-abee-6fba8728362c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:30.498350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f12bc76e-ad42-4c93-abee-6fba8728362c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:30.552645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f12bc76e-ad42-4c93-abee-6fba8728362c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:30.561233 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f12bc76e-ad42-4c93-abee-6fba8728362c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 200 len: 1221 microversion: 2.1 time: 0.068351 Aug 27 05:14:30.561812 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3265/6583] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:30 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 1221 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:31.583207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a801a32d-975b-41aa-a233-8ae53a5e6d66 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:31.583823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a801a32d-975b-41aa-a233-8ae53a5e6d66 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:31.591661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a801a32d-975b-41aa-a233-8ae53a5e6d66 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:31.592403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a801a32d-975b-41aa-a233-8ae53a5e6d66 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:31.592880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a801a32d-975b-41aa-a233-8ae53a5e6d66 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:31.593827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a801a32d-975b-41aa-a233-8ae53a5e6d66 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:31.594492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a801a32d-975b-41aa-a233-8ae53a5e6d66 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:31.595783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a801a32d-975b-41aa-a233-8ae53a5e6d66 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:31.678328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a801a32d-975b-41aa-a233-8ae53a5e6d66 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:31.686135 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a801a32d-975b-41aa-a233-8ae53a5e6d66 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 200 len: 1291 microversion: 2.1 time: 0.107450 Aug 27 05:14:31.686942 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3319/6584] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:31 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 1291 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:32.707393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b7b2718e-c9df-4f57-8fe3-13c6f8aa2135 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:32.708011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b7b2718e-c9df-4f57-8fe3-13c6f8aa2135 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:32.715109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7b2718e-c9df-4f57-8fe3-13c6f8aa2135 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:32.715596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7b2718e-c9df-4f57-8fe3-13c6f8aa2135 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:32.716043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7b2718e-c9df-4f57-8fe3-13c6f8aa2135 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:32.716758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7b2718e-c9df-4f57-8fe3-13c6f8aa2135 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:32.717217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7b2718e-c9df-4f57-8fe3-13c6f8aa2135 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:32.717679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b7b2718e-c9df-4f57-8fe3-13c6f8aa2135 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:32.722969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=70 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:32.859749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b7b2718e-c9df-4f57-8fe3-13c6f8aa2135 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:32.871414 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b7b2718e-c9df-4f57-8fe3-13c6f8aa2135 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 200 len: 1321 microversion: 2.1 time: 0.167758 Aug 27 05:14:32.884034 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3266/6585] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:32 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:32.959757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-08f0c01f-6312-4210-807e-c0694fb062a7 req-86af7b0d-e92a-477a-8dd1-b3f66368a120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed650dd-f60f-4bfb-9a9b-61500407568a", "tag": "9148647f-b789-491a-92c9-79a647828994"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:32.965024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:32.971805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08f0c01f-6312-4210-807e-c0694fb062a7 req-86af7b0d-e92a-477a-8dd1-b3f66368a120 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:32.972337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08f0c01f-6312-4210-807e-c0694fb062a7 req-86af7b0d-e92a-477a-8dd1-b3f66368a120 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:32.972947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08f0c01f-6312-4210-807e-c0694fb062a7 req-86af7b0d-e92a-477a-8dd1-b3f66368a120 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:32.985681 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-08f0c01f-6312-4210-807e-c0694fb062a7 req-86af7b0d-e92a-477a-8dd1-b3f66368a120 service nova] Creating event network-changed:9148647f-b789-491a-92c9-79a647828994 for instance 1ed650dd-f60f-4bfb-9a9b-61500407568a on n-h1-854823-1 Aug 27 05:14:32.990756 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-08f0c01f-6312-4210-807e-c0694fb062a7 req-86af7b0d-e92a-477a-8dd1-b3f66368a120 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120067 Aug 27 05:14:32.991392 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3320/6586] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:14:33.897561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5a1eb985-6f71-44aa-99ab-ce58f56f5ef7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:33.898178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5a1eb985-6f71-44aa-99ab-ce58f56f5ef7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:33.905086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a1eb985-6f71-44aa-99ab-ce58f56f5ef7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:33.905573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a1eb985-6f71-44aa-99ab-ce58f56f5ef7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:33.906015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a1eb985-6f71-44aa-99ab-ce58f56f5ef7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:33.906710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a1eb985-6f71-44aa-99ab-ce58f56f5ef7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:33.907165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a1eb985-6f71-44aa-99ab-ce58f56f5ef7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:33.908090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5a1eb985-6f71-44aa-99ab-ce58f56f5ef7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:34.040302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5a1eb985-6f71-44aa-99ab-ce58f56f5ef7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:34.048878 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5a1eb985-6f71-44aa-99ab-ce58f56f5ef7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 200 len: 1321 microversion: 2.1 time: 0.154675 Aug 27 05:14:34.049452 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3267/6587] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:33 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:35.072323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40031a3b-e3b1-4f6e-ac74-6174bf20ff6c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:35.073006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40031a3b-e3b1-4f6e-ac74-6174bf20ff6c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:35.080126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40031a3b-e3b1-4f6e-ac74-6174bf20ff6c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:35.080651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40031a3b-e3b1-4f6e-ac74-6174bf20ff6c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:35.081096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40031a3b-e3b1-4f6e-ac74-6174bf20ff6c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:35.081798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40031a3b-e3b1-4f6e-ac74-6174bf20ff6c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:35.082258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40031a3b-e3b1-4f6e-ac74-6174bf20ff6c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:35.082689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40031a3b-e3b1-4f6e-ac74-6174bf20ff6c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:35.215145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40031a3b-e3b1-4f6e-ac74-6174bf20ff6c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:35.223207 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40031a3b-e3b1-4f6e-ac74-6174bf20ff6c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 200 len: 1321 microversion: 2.1 time: 0.156375 Aug 27 05:14:35.223791 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3321/6588] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:35 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:36.243485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aa231bb3-85ad-4214-855c-e85e23b09c39 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:36.244105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aa231bb3-85ad-4214-855c-e85e23b09c39 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:36.251202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa231bb3-85ad-4214-855c-e85e23b09c39 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:36.252213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa231bb3-85ad-4214-855c-e85e23b09c39 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:36.252723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa231bb3-85ad-4214-855c-e85e23b09c39 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:36.253480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa231bb3-85ad-4214-855c-e85e23b09c39 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:36.253950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa231bb3-85ad-4214-855c-e85e23b09c39 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:36.254383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa231bb3-85ad-4214-855c-e85e23b09c39 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:36.386904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aa231bb3-85ad-4214-855c-e85e23b09c39 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:36.395161 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aa231bb3-85ad-4214-855c-e85e23b09c39 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 200 len: 1321 microversion: 2.1 time: 0.155775 Aug 27 05:14:36.395734 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3268/6589] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:36 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:37.415744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-397685ff-241c-4325-89a4-c4e00563aa18 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:37.416374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-397685ff-241c-4325-89a4-c4e00563aa18 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:37.423869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-397685ff-241c-4325-89a4-c4e00563aa18 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:37.424375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-397685ff-241c-4325-89a4-c4e00563aa18 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:37.424852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-397685ff-241c-4325-89a4-c4e00563aa18 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:37.425563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-397685ff-241c-4325-89a4-c4e00563aa18 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:37.426034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-397685ff-241c-4325-89a4-c4e00563aa18 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:37.426477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-397685ff-241c-4325-89a4-c4e00563aa18 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:37.554903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-397685ff-241c-4325-89a4-c4e00563aa18 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:37.562660 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-397685ff-241c-4325-89a4-c4e00563aa18 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 200 len: 1321 microversion: 2.1 time: 0.150920 Aug 27 05:14:37.563238 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3322/6590] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:37 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:38.105774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-da900ebb-b71e-47ca-995c-e172417fe9ef req-33a752a8-2e0a-4416-a497-b81d53c7a9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed650dd-f60f-4bfb-9a9b-61500407568a", "name": "network-vif-plugged", "status": "completed", "tag": "9148647f-b789-491a-92c9-79a647828994"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:38.118580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-da900ebb-b71e-47ca-995c-e172417fe9ef req-33a752a8-2e0a-4416-a497-b81d53c7a9e6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:38.119079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-da900ebb-b71e-47ca-995c-e172417fe9ef req-33a752a8-2e0a-4416-a497-b81d53c7a9e6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:38.119744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-da900ebb-b71e-47ca-995c-e172417fe9ef req-33a752a8-2e0a-4416-a497-b81d53c7a9e6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:38.131367 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-da900ebb-b71e-47ca-995c-e172417fe9ef req-33a752a8-2e0a-4416-a497-b81d53c7a9e6 service nova] Creating event network-vif-plugged:9148647f-b789-491a-92c9-79a647828994 for instance 1ed650dd-f60f-4bfb-9a9b-61500407568a on n-h1-854823-1 Aug 27 05:14:38.136927 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-da900ebb-b71e-47ca-995c-e172417fe9ef req-33a752a8-2e0a-4416-a497-b81d53c7a9e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035202 Aug 27 05:14:38.137551 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3269/6591] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:38.584015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e2de911-8f71-422d-aa1a-62658650fe52 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:38.584696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e2de911-8f71-422d-aa1a-62658650fe52 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:38.591753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2de911-8f71-422d-aa1a-62658650fe52 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:38.592250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2de911-8f71-422d-aa1a-62658650fe52 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:38.592731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2de911-8f71-422d-aa1a-62658650fe52 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:38.593468 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2de911-8f71-422d-aa1a-62658650fe52 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:38.593935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2de911-8f71-422d-aa1a-62658650fe52 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:38.594724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2de911-8f71-422d-aa1a-62658650fe52 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:38.727291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e2de911-8f71-422d-aa1a-62658650fe52 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:38.734960 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e2de911-8f71-422d-aa1a-62658650fe52 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 200 len: 1321 microversion: 2.1 time: 0.155530 Aug 27 05:14:38.735549 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3323/6592] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:38 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:39.757566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c192377b-6207-4e0c-ad35-2a19b8c8f25e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:39.758560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c192377b-6207-4e0c-ad35-2a19b8c8f25e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:39.761026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:39.768988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c192377b-6207-4e0c-ad35-2a19b8c8f25e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:39.769501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c192377b-6207-4e0c-ad35-2a19b8c8f25e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:39.769944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c192377b-6207-4e0c-ad35-2a19b8c8f25e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:39.770721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c192377b-6207-4e0c-ad35-2a19b8c8f25e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:39.771614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c192377b-6207-4e0c-ad35-2a19b8c8f25e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:39.772081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c192377b-6207-4e0c-ad35-2a19b8c8f25e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:39.906558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c192377b-6207-4e0c-ad35-2a19b8c8f25e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:39.915004 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c192377b-6207-4e0c-ad35-2a19b8c8f25e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 200 len: 1502 microversion: 2.1 time: 0.161844 Aug 27 05:14:39.915571 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3270/6593] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:39 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:39.935488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-422e5f3b-03be-4507-b159-4bf847f9462c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:39.936124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-422e5f3b-03be-4507-b159-4bf847f9462c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:39.943500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-422e5f3b-03be-4507-b159-4bf847f9462c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:39.944008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-422e5f3b-03be-4507-b159-4bf847f9462c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:39.944789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-422e5f3b-03be-4507-b159-4bf847f9462c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:39.945337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-422e5f3b-03be-4507-b159-4bf847f9462c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:39.945814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-422e5f3b-03be-4507-b159-4bf847f9462c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:39.946260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-422e5f3b-03be-4507-b159-4bf847f9462c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:40.081808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-422e5f3b-03be-4507-b159-4bf847f9462c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:40.089714 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-422e5f3b-03be-4507-b159-4bf847f9462c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 200 len: 1502 microversion: 2.1 time: 0.158193 Aug 27 05:14:40.090307 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3324/6594] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:39 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:40.112035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ff3a088-f3b3-4c92-8004-20e341a9c0d0 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:40.112610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1ff3a088-f3b3-4c92-8004-20e341a9c0d0 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:40.120084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ff3a088-f3b3-4c92-8004-20e341a9c0d0 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:40.120581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ff3a088-f3b3-4c92-8004-20e341a9c0d0 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:40.121016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ff3a088-f3b3-4c92-8004-20e341a9c0d0 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:40.121699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ff3a088-f3b3-4c92-8004-20e341a9c0d0 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:40.122151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ff3a088-f3b3-4c92-8004-20e341a9c0d0 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:40.122570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ff3a088-f3b3-4c92-8004-20e341a9c0d0 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:40.147368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1ff3a088-f3b3-4c92-8004-20e341a9c0d0 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:14:40.222739 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1ff3a088-f3b3-4c92-8004-20e341a9c0d0 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 204 len: 0 microversion: 2.1 time: 0.115008 Aug 27 05:14:40.223403 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3271/6595] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:14:40 2022] DELETE /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:14:40.232007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86991fb3-7b2e-4769-b881-dd7a81d8353e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:40.232660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86991fb3-7b2e-4769-b881-dd7a81d8353e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:40.239343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86991fb3-7b2e-4769-b881-dd7a81d8353e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:40.239838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86991fb3-7b2e-4769-b881-dd7a81d8353e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:40.240284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86991fb3-7b2e-4769-b881-dd7a81d8353e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:40.241047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86991fb3-7b2e-4769-b881-dd7a81d8353e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:40.241501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86991fb3-7b2e-4769-b881-dd7a81d8353e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:40.241935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86991fb3-7b2e-4769-b881-dd7a81d8353e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:40.371792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86991fb3-7b2e-4769-b881-dd7a81d8353e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:40.379912 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86991fb3-7b2e-4769-b881-dd7a81d8353e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 200 len: 1508 microversion: 2.1 time: 0.151921 Aug 27 05:14:40.380499 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3325/6596] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:40 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:41.401804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-61e79818-c64f-4be8-add9-0dab594db5fa tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:41.402505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-61e79818-c64f-4be8-add9-0dab594db5fa tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:41.404426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:41.410881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61e79818-c64f-4be8-add9-0dab594db5fa tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:41.411365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61e79818-c64f-4be8-add9-0dab594db5fa tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:41.411796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61e79818-c64f-4be8-add9-0dab594db5fa tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:41.412493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61e79818-c64f-4be8-add9-0dab594db5fa tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:41.413148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61e79818-c64f-4be8-add9-0dab594db5fa tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:41.413392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61e79818-c64f-4be8-add9-0dab594db5fa tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:41.543267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-61e79818-c64f-4be8-add9-0dab594db5fa tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:41.551537 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-61e79818-c64f-4be8-add9-0dab594db5fa tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 200 len: 1508 microversion: 2.1 time: 0.154058 Aug 27 05:14:41.552114 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3272/6597] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:41 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:42.223704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dba9fcf9-09c3-4d61-92cf-02f45f467c93 req-5afc075f-0e70-4dee-b75a-19eb2df147b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed650dd-f60f-4bfb-9a9b-61500407568a", "name": "network-vif-deleted", "tag": "9148647f-b789-491a-92c9-79a647828994"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:42.245170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:42.246086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:42.249216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dba9fcf9-09c3-4d61-92cf-02f45f467c93 req-5afc075f-0e70-4dee-b75a-19eb2df147b6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:42.249823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dba9fcf9-09c3-4d61-92cf-02f45f467c93 req-5afc075f-0e70-4dee-b75a-19eb2df147b6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:42.250363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dba9fcf9-09c3-4d61-92cf-02f45f467c93 req-5afc075f-0e70-4dee-b75a-19eb2df147b6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:42.272852 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dba9fcf9-09c3-4d61-92cf-02f45f467c93 req-5afc075f-0e70-4dee-b75a-19eb2df147b6 service nova] Creating event network-vif-deleted:9148647f-b789-491a-92c9-79a647828994 for instance 1ed650dd-f60f-4bfb-9a9b-61500407568a on n-h1-854823-1 Aug 27 05:14:42.278272 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dba9fcf9-09c3-4d61-92cf-02f45f467c93 req-5afc075f-0e70-4dee-b75a-19eb2df147b6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058840 Aug 27 05:14:42.278947 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3326/6598] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:42.572149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5598e42b-c532-4fd1-a6b3-18619a29725b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:42.572879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5598e42b-c532-4fd1-a6b3-18619a29725b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:42.579722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5598e42b-c532-4fd1-a6b3-18619a29725b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:42.580200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5598e42b-c532-4fd1-a6b3-18619a29725b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:42.580659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5598e42b-c532-4fd1-a6b3-18619a29725b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:42.581342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5598e42b-c532-4fd1-a6b3-18619a29725b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:42.581816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5598e42b-c532-4fd1-a6b3-18619a29725b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:42.582241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5598e42b-c532-4fd1-a6b3-18619a29725b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:42.613323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5598e42b-c532-4fd1-a6b3-18619a29725b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:42.613806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5598e42b-c532-4fd1-a6b3-18619a29725b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:42.614236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5598e42b-c532-4fd1-a6b3-18619a29725b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:42.614678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-5598e42b-c532-4fd1-a6b3-18619a29725b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lazy-loading 'fault' on Instance uuid 1ed650dd-f60f-4bfb-9a9b-61500407568a {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:14:42.659080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5598e42b-c532-4fd1-a6b3-18619a29725b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:42.667955 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5598e42b-c532-4fd1-a6b3-18619a29725b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 200 len: 1311 microversion: 2.1 time: 0.099660 Aug 27 05:14:42.668638 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3273/6599] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:42 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:43.693303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a46d234-8a51-4a4b-8433-a12738987ae4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:43.694016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a46d234-8a51-4a4b-8433-a12738987ae4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:43.700829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a46d234-8a51-4a4b-8433-a12738987ae4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:43.701333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a46d234-8a51-4a4b-8433-a12738987ae4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:43.701778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a46d234-8a51-4a4b-8433-a12738987ae4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:43.702482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a46d234-8a51-4a4b-8433-a12738987ae4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:43.702943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a46d234-8a51-4a4b-8433-a12738987ae4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:43.703374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a46d234-8a51-4a4b-8433-a12738987ae4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:43.717182 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7a46d234-8a51-4a4b-8433-a12738987ae4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a46d234-8a51-4a4b-8433-a12738987ae4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a HTTP/1.1 Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '1ed650dd-f60f-4bfb-9a9b-61500407568a'} Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:14:43.718809 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:43.723812 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:14:43.723812 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:14:43.723812 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:14:43.723812 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:14:43.723812 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:14:43.723812 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:14:43.723812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a46d234-8a51-4a4b-8433-a12738987ae4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:14:43.723812 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a46d234-8a51-4a4b-8433-a12738987ae4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 404 len: 111 microversion: 2.1 time: 0.033052 Aug 27 05:14:43.723812 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3327/6600] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:43 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:14:43.733583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5eb3e27b-a1ff-42cf-9bed-09904941b281 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Action: 'create', calling method: .version_select at 0x7f1f20848dc0>, body: {"keypair": {"name": "tempest-key-481061132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0NRDdZInVDztWPXGT1VazybgwEprheE3qp8mmgZCqbtMxZiQm0z9eqKfE73dJt/eYZLkaj1sWVmIORCjKbFvGS9GCrbD0MU/Pm+2I9NykBr8v/p+kMCD9yqH+DD/Ve2w=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:43.750135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-5eb3e27b-a1ff-42cf-9bed-09904941b281 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for project cc1e6863fdac49b486519421d1c8181b. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:14:43.759396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-5eb3e27b-a1ff-42cf-9bed-09904941b281 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for user 3d3d0735d85744b3a52e0e0d6dd64174 and project cc1e6863fdac49b486519421d1c8181b. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:14:43.785057 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5eb3e27b-a1ff-42cf-9bed-09904941b281 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.055344 Aug 27 05:14:43.785670 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3274/6601] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:14:43 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:43.796665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c98ea2a-a31f-471a-b87e-fbf6e248d6ad tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '.version_select at 0x7f1f204c5940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:43.800554 n-d-854823-1 devstack@n-api.service[128869]: WARNING oslo_db.sqlalchemy.utils [None req-0c98ea2a-a31f-471a-b87e-fbf6e248d6ad tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 05:14:43.806409 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c98ea2a-a31f-471a-b87e-fbf6e248d6ad tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.013726 Aug 27 05:14:43.806976 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3328/6602] 10.222.0.79 () {58 vars in 1137 bytes} [Sat Aug 27 05:14:43 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:14:43.856253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1076979827", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "key_name": "tempest-key-481061132", "networks": [{"uuid": "77ce2559-af37-4a03-aee8-4735f58f1dd2"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:43.908593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] validate_networks() for [('77ce2559-af37-4a03-aee8-4735f58f1dd2', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:14:44.288271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:14:44.288728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:14:44.289199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:14:44.289611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:14:44.290018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:14:44.299406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:44.299885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:44.300314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:44.301067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:44.301519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:44.301939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:44.319137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:14:44.324353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for user 3d3d0735d85744b3a52e0e0d6dd64174 and project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:14:44.326652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:44.338721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:14:44.341041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:14:44.388127 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-00d4faf0-bc09-4e96-944d-5aab056e87b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535889 Aug 27 05:14:44.388822 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3275/6603] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:14:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:14:44.399271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6c41f84-be29-44f3-b182-3e059a4379c8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:44.399891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6c41f84-be29-44f3-b182-3e059a4379c8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:44.453993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d6c41f84-be29-44f3-b182-3e059a4379c8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:44.461728 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6c41f84-be29-44f3-b182-3e059a4379c8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 200 len: 1228 microversion: 2.1 time: 0.066318 Aug 27 05:14:44.462289 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3329/6604] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:44 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 1228 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:45.483971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-994d1b26-360f-4676-b480-bc3362d9bd7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:45.484674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-994d1b26-360f-4676-b480-bc3362d9bd7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:45.492332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-994d1b26-360f-4676-b480-bc3362d9bd7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:45.492554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-994d1b26-360f-4676-b480-bc3362d9bd7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:45.492981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-994d1b26-360f-4676-b480-bc3362d9bd7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:45.493692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-994d1b26-360f-4676-b480-bc3362d9bd7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:45.494154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-994d1b26-360f-4676-b480-bc3362d9bd7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:45.494709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-994d1b26-360f-4676-b480-bc3362d9bd7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:45.560959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-994d1b26-360f-4676-b480-bc3362d9bd7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:45.568898 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-994d1b26-360f-4676-b480-bc3362d9bd7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 200 len: 1298 microversion: 2.1 time: 0.089939 Aug 27 05:14:45.569962 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3276/6605] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:45 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:46.591363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1535bad4-84fd-4bc1-bd49-35685216f9e2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:46.592031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1535bad4-84fd-4bc1-bd49-35685216f9e2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:46.598958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1535bad4-84fd-4bc1-bd49-35685216f9e2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:46.599470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1535bad4-84fd-4bc1-bd49-35685216f9e2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:46.599928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1535bad4-84fd-4bc1-bd49-35685216f9e2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:46.600781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1535bad4-84fd-4bc1-bd49-35685216f9e2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:46.601305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1535bad4-84fd-4bc1-bd49-35685216f9e2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:46.601774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1535bad4-84fd-4bc1-bd49-35685216f9e2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:46.671844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ad1a1ef4-38e6-4c3e-8dd3-a370291f58f3 req-1b3b5d5c-a80c-4914-92d5-c57284427730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69439461-f0f0-4a9f-a536-ccee5ac8f974", "tag": "afb306f0-6b77-4fd9-8d3d-2b11faf9b8fa"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:46.685443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ad1a1ef4-38e6-4c3e-8dd3-a370291f58f3 req-1b3b5d5c-a80c-4914-92d5-c57284427730 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:46.685961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ad1a1ef4-38e6-4c3e-8dd3-a370291f58f3 req-1b3b5d5c-a80c-4914-92d5-c57284427730 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:46.686625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ad1a1ef4-38e6-4c3e-8dd3-a370291f58f3 req-1b3b5d5c-a80c-4914-92d5-c57284427730 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:46.708172 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ad1a1ef4-38e6-4c3e-8dd3-a370291f58f3 req-1b3b5d5c-a80c-4914-92d5-c57284427730 service nova] Creating event network-changed:afb306f0-6b77-4fd9-8d3d-2b11faf9b8fa for instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 on n-h1-854823-1 Aug 27 05:14:46.715356 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ad1a1ef4-38e6-4c3e-8dd3-a370291f58f3 req-1b3b5d5c-a80c-4914-92d5-c57284427730 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047347 Aug 27 05:14:46.715986 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3277/6606] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:46.854049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1535bad4-84fd-4bc1-bd49-35685216f9e2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:46.862452 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1535bad4-84fd-4bc1-bd49-35685216f9e2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 200 len: 1328 microversion: 2.1 time: 0.275064 Aug 27 05:14:46.863038 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3330/6607] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:46 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 1328 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:47.885528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9bf37a09-9dde-44d5-af5c-dcfe7654086b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:47.886223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9bf37a09-9dde-44d5-af5c-dcfe7654086b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:47.892384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bf37a09-9dde-44d5-af5c-dcfe7654086b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:47.892895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bf37a09-9dde-44d5-af5c-dcfe7654086b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:47.893332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bf37a09-9dde-44d5-af5c-dcfe7654086b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:47.894010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bf37a09-9dde-44d5-af5c-dcfe7654086b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:47.894460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bf37a09-9dde-44d5-af5c-dcfe7654086b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:47.894888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9bf37a09-9dde-44d5-af5c-dcfe7654086b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:48.022937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9bf37a09-9dde-44d5-af5c-dcfe7654086b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:48.030617 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9bf37a09-9dde-44d5-af5c-dcfe7654086b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 200 len: 1328 microversion: 2.1 time: 0.150168 Aug 27 05:14:48.031240 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3278/6608] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:47 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 1328 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:49.051586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da465fc8-9c86-49c5-9ff6-10ff962759f9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:49.052203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da465fc8-9c86-49c5-9ff6-10ff962759f9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:49.059351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da465fc8-9c86-49c5-9ff6-10ff962759f9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:49.059845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da465fc8-9c86-49c5-9ff6-10ff962759f9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:49.060291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da465fc8-9c86-49c5-9ff6-10ff962759f9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:49.061031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da465fc8-9c86-49c5-9ff6-10ff962759f9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:49.061494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da465fc8-9c86-49c5-9ff6-10ff962759f9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:49.061926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da465fc8-9c86-49c5-9ff6-10ff962759f9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:49.193832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da465fc8-9c86-49c5-9ff6-10ff962759f9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:49.202008 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da465fc8-9c86-49c5-9ff6-10ff962759f9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 200 len: 1328 microversion: 2.1 time: 0.154687 Aug 27 05:14:49.202598 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3331/6609] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:49 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 1328 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:50.224359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1682ed9f-3206-46ca-8a05-e03995f5f8e8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:50.225063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1682ed9f-3206-46ca-8a05-e03995f5f8e8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:50.231745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1682ed9f-3206-46ca-8a05-e03995f5f8e8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:50.232232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1682ed9f-3206-46ca-8a05-e03995f5f8e8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:50.232707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1682ed9f-3206-46ca-8a05-e03995f5f8e8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:50.233401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1682ed9f-3206-46ca-8a05-e03995f5f8e8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:50.233853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1682ed9f-3206-46ca-8a05-e03995f5f8e8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:50.234281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1682ed9f-3206-46ca-8a05-e03995f5f8e8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:50.371670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1682ed9f-3206-46ca-8a05-e03995f5f8e8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:50.380137 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1682ed9f-3206-46ca-8a05-e03995f5f8e8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 200 len: 1328 microversion: 2.1 time: 0.160208 Aug 27 05:14:50.380745 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3279/6610] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:50 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 1328 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:51.399902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abf86b07-a423-4b8b-aead-e982b721b07e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:51.400551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-abf86b07-a423-4b8b-aead-e982b721b07e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:51.407567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abf86b07-a423-4b8b-aead-e982b721b07e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:51.408073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abf86b07-a423-4b8b-aead-e982b721b07e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:51.408549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abf86b07-a423-4b8b-aead-e982b721b07e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:51.409261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abf86b07-a423-4b8b-aead-e982b721b07e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:51.409736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abf86b07-a423-4b8b-aead-e982b721b07e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:51.410181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abf86b07-a423-4b8b-aead-e982b721b07e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:51.412992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=89 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:51.550935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-abf86b07-a423-4b8b-aead-e982b721b07e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:51.558822 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-abf86b07-a423-4b8b-aead-e982b721b07e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 200 len: 1328 microversion: 2.1 time: 0.162810 Aug 27 05:14:51.559406 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3332/6611] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:51 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 1328 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:52.221534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-17d27a67-b686-4a39-bd8b-a711ae1cd7ba req-157bd1c8-d5b0-4c2f-bcf0-fb79593d0c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69439461-f0f0-4a9f-a536-ccee5ac8f974", "name": "network-vif-plugged", "status": "completed", "tag": "afb306f0-6b77-4fd9-8d3d-2b11faf9b8fa"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:52.233237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-17d27a67-b686-4a39-bd8b-a711ae1cd7ba req-157bd1c8-d5b0-4c2f-bcf0-fb79593d0c9e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:52.233719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-17d27a67-b686-4a39-bd8b-a711ae1cd7ba req-157bd1c8-d5b0-4c2f-bcf0-fb79593d0c9e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:52.234155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-17d27a67-b686-4a39-bd8b-a711ae1cd7ba req-157bd1c8-d5b0-4c2f-bcf0-fb79593d0c9e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:52.246232 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-17d27a67-b686-4a39-bd8b-a711ae1cd7ba req-157bd1c8-d5b0-4c2f-bcf0-fb79593d0c9e service nova] Creating event network-vif-plugged:afb306f0-6b77-4fd9-8d3d-2b11faf9b8fa for instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 on n-h1-854823-1 Aug 27 05:14:52.251169 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-17d27a67-b686-4a39-bd8b-a711ae1cd7ba req-157bd1c8-d5b0-4c2f-bcf0-fb79593d0c9e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033977 Aug 27 05:14:52.251805 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3280/6612] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:14:52.579566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75e2f604-fe1e-47fb-a6ef-39013e4a3076 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:52.580677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75e2f604-fe1e-47fb-a6ef-39013e4a3076 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:52.587559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e2f604-fe1e-47fb-a6ef-39013e4a3076 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:52.588056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e2f604-fe1e-47fb-a6ef-39013e4a3076 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:52.588506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e2f604-fe1e-47fb-a6ef-39013e4a3076 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:52.589236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e2f604-fe1e-47fb-a6ef-39013e4a3076 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:52.589704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e2f604-fe1e-47fb-a6ef-39013e4a3076 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:52.590142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75e2f604-fe1e-47fb-a6ef-39013e4a3076 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:52.723944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75e2f604-fe1e-47fb-a6ef-39013e4a3076 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:52.731831 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75e2f604-fe1e-47fb-a6ef-39013e4a3076 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 200 len: 1328 microversion: 2.1 time: 0.156207 Aug 27 05:14:52.732435 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3333/6613] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:52 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 1328 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:53.755569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-72a55866-7bc8-4c4c-b9f0-55e8285a605e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:53.756183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-72a55866-7bc8-4c4c-b9f0-55e8285a605e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:53.762465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72a55866-7bc8-4c4c-b9f0-55e8285a605e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:53.762956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72a55866-7bc8-4c4c-b9f0-55e8285a605e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:53.763397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72a55866-7bc8-4c4c-b9f0-55e8285a605e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:53.764091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72a55866-7bc8-4c4c-b9f0-55e8285a605e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:53.764626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72a55866-7bc8-4c4c-b9f0-55e8285a605e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:53.765061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72a55866-7bc8-4c4c-b9f0-55e8285a605e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:53.901592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-72a55866-7bc8-4c4c-b9f0-55e8285a605e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:53.909854 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-72a55866-7bc8-4c4c-b9f0-55e8285a605e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 200 len: 1328 microversion: 2.1 time: 0.159813 Aug 27 05:14:53.910433 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3281/6614] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:53 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 1328 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:54.931070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f6e4424-05fa-439c-b8dc-b920636f434d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:54.931716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f6e4424-05fa-439c-b8dc-b920636f434d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:54.934594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:54.939966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f6e4424-05fa-439c-b8dc-b920636f434d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:54.940457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f6e4424-05fa-439c-b8dc-b920636f434d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:54.940928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f6e4424-05fa-439c-b8dc-b920636f434d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:54.941626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f6e4424-05fa-439c-b8dc-b920636f434d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:54.942090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f6e4424-05fa-439c-b8dc-b920636f434d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:54.942521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f6e4424-05fa-439c-b8dc-b920636f434d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:55.075935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8f6e4424-05fa-439c-b8dc-b920636f434d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:55.083590 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f6e4424-05fa-439c-b8dc-b920636f434d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 200 len: 1509 microversion: 2.1 time: 0.156423 Aug 27 05:14:55.084164 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3334/6615] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:54 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:14:55.104619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-beeac247-daf5-40e7-aadd-ba8f041699d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:55.105267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-beeac247-daf5-40e7-aadd-ba8f041699d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:55.107255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:55.107909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=10 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:55.115772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-beeac247-daf5-40e7-aadd-ba8f041699d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:55.116254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-beeac247-daf5-40e7-aadd-ba8f041699d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:55.116760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-beeac247-daf5-40e7-aadd-ba8f041699d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:55.117451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-beeac247-daf5-40e7-aadd-ba8f041699d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:55.117907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-beeac247-daf5-40e7-aadd-ba8f041699d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:55.118330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-beeac247-daf5-40e7-aadd-ba8f041699d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:55.253369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-beeac247-daf5-40e7-aadd-ba8f041699d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:55.262022 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-beeac247-daf5-40e7-aadd-ba8f041699d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 200 len: 1509 microversion: 2.1 time: 0.161726 Aug 27 05:14:55.262619 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3282/6616] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:55 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:55.282401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-274a69b8-b204-4d22-a5fe-bd74a0e503ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:55.282852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-274a69b8-b204-4d22-a5fe-bd74a0e503ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:55.289541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-274a69b8-b204-4d22-a5fe-bd74a0e503ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:55.290042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-274a69b8-b204-4d22-a5fe-bd74a0e503ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:55.290499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-274a69b8-b204-4d22-a5fe-bd74a0e503ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:55.291199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-274a69b8-b204-4d22-a5fe-bd74a0e503ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:55.291669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-274a69b8-b204-4d22-a5fe-bd74a0e503ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:55.292109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-274a69b8-b204-4d22-a5fe-bd74a0e503ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:55.316451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-274a69b8-b204-4d22-a5fe-bd74a0e503ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:14:55.390742 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-274a69b8-b204-4d22-a5fe-bd74a0e503ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 204 len: 0 microversion: 2.1 time: 0.112036 Aug 27 05:14:55.391572 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3335/6617] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:14:55 2022] DELETE /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:14:55.400169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0adbee1a-4cf1-4637-989d-cecef993057e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:55.400899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0adbee1a-4cf1-4637-989d-cecef993057e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:55.407088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0adbee1a-4cf1-4637-989d-cecef993057e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:55.407576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0adbee1a-4cf1-4637-989d-cecef993057e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:55.408009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0adbee1a-4cf1-4637-989d-cecef993057e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:55.409372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0adbee1a-4cf1-4637-989d-cecef993057e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:55.409829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0adbee1a-4cf1-4637-989d-cecef993057e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:55.410255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0adbee1a-4cf1-4637-989d-cecef993057e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:55.539466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0adbee1a-4cf1-4637-989d-cecef993057e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:55.547090 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0adbee1a-4cf1-4637-989d-cecef993057e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 200 len: 1515 microversion: 2.1 time: 0.150808 Aug 27 05:14:55.547662 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3283/6618] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:55 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:56.567994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c01759f7-ffab-43b8-9d2d-1d954a61c09e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:56.568730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c01759f7-ffab-43b8-9d2d-1d954a61c09e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:56.575756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01759f7-ffab-43b8-9d2d-1d954a61c09e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:56.576248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01759f7-ffab-43b8-9d2d-1d954a61c09e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:56.576728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01759f7-ffab-43b8-9d2d-1d954a61c09e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:56.577422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01759f7-ffab-43b8-9d2d-1d954a61c09e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:56.577884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01759f7-ffab-43b8-9d2d-1d954a61c09e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:56.578315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01759f7-ffab-43b8-9d2d-1d954a61c09e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:56.709721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c01759f7-ffab-43b8-9d2d-1d954a61c09e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:56.717718 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c01759f7-ffab-43b8-9d2d-1d954a61c09e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 200 len: 1515 microversion: 2.1 time: 0.154084 Aug 27 05:14:56.718306 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3336/6619] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:56 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:57.519097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-33390cfc-797a-4385-9416-e604eb08210a req-07a95316-47cd-4da2-a071-70b782e08f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69439461-f0f0-4a9f-a536-ccee5ac8f974", "name": "network-vif-deleted", "tag": "afb306f0-6b77-4fd9-8d3d-2b11faf9b8fa"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:57.532000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-33390cfc-797a-4385-9416-e604eb08210a req-07a95316-47cd-4da2-a071-70b782e08f8b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:57.532868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-33390cfc-797a-4385-9416-e604eb08210a req-07a95316-47cd-4da2-a071-70b782e08f8b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:57.533500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-33390cfc-797a-4385-9416-e604eb08210a req-07a95316-47cd-4da2-a071-70b782e08f8b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:57.547479 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-33390cfc-797a-4385-9416-e604eb08210a req-07a95316-47cd-4da2-a071-70b782e08f8b service nova] Creating event network-vif-deleted:afb306f0-6b77-4fd9-8d3d-2b11faf9b8fa for instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 on n-h1-854823-1 Aug 27 05:14:57.557843 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-33390cfc-797a-4385-9416-e604eb08210a req-07a95316-47cd-4da2-a071-70b782e08f8b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043225 Aug 27 05:14:57.558469 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3284/6620] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:14:57.739531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9eb19a6-2e12-4d12-be51-21e2c8294c61 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:57.740153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9eb19a6-2e12-4d12-be51-21e2c8294c61 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:57.747345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9eb19a6-2e12-4d12-be51-21e2c8294c61 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:57.747850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9eb19a6-2e12-4d12-be51-21e2c8294c61 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:57.748302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9eb19a6-2e12-4d12-be51-21e2c8294c61 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:57.749039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9eb19a6-2e12-4d12-be51-21e2c8294c61 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:57.749510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9eb19a6-2e12-4d12-be51-21e2c8294c61 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:57.749979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9eb19a6-2e12-4d12-be51-21e2c8294c61 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:57.781793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9eb19a6-2e12-4d12-be51-21e2c8294c61 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:57.782286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9eb19a6-2e12-4d12-be51-21e2c8294c61 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:57.782764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9eb19a6-2e12-4d12-be51-21e2c8294c61 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:57.783278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-b9eb19a6-2e12-4d12-be51-21e2c8294c61 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lazy-loading 'fault' on Instance uuid 69439461-f0f0-4a9f-a536-ccee5ac8f974 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:14:57.824474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9eb19a6-2e12-4d12-be51-21e2c8294c61 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:57.832250 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9eb19a6-2e12-4d12-be51-21e2c8294c61 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 200 len: 1318 microversion: 2.1 time: 0.097028 Aug 27 05:14:57.832848 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3337/6621] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:57 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 1318 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:14:58.853244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-101cf567-9967-4f12-8443-0defe2bd897b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:58.853937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-101cf567-9967-4f12-8443-0defe2bd897b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:58.861089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-101cf567-9967-4f12-8443-0defe2bd897b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:58.861592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-101cf567-9967-4f12-8443-0defe2bd897b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:58.862024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-101cf567-9967-4f12-8443-0defe2bd897b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:58.862712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-101cf567-9967-4f12-8443-0defe2bd897b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:58.863163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-101cf567-9967-4f12-8443-0defe2bd897b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:58.863584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-101cf567-9967-4f12-8443-0defe2bd897b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:58.866188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:58.879493 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-101cf567-9967-4f12-8443-0defe2bd897b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-101cf567-9967-4f12-8443-0defe2bd897b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 HTTP/1.1 Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '69439461-f0f0-4a9f-a536-ccee5ac8f974'} Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:14:58.881238 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:14:58.886346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:14:58.886346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:14:58.886346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:14:58.886346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:14:58.886346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:14:58.886346 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:14:58.886346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-101cf567-9967-4f12-8443-0defe2bd897b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:14:58.886346 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-101cf567-9967-4f12-8443-0defe2bd897b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 404 len: 111 microversion: 2.1 time: 0.033867 Aug 27 05:14:58.886346 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3285/6622] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:58 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:14:58.891567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a516883-e832-411f-a61f-3658bd63fd45 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '.version_select at 0x7f1f206438b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:58.911237 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a516883-e832-411f-a61f-3658bd63fd45 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-key-481061132" status: 202 len: 0 microversion: 2.1 time: 0.023483 Aug 27 05:14:58.911821 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3338/6623] 10.222.0.79 () {58 vars in 1206 bytes} [Sat Aug 27 05:14:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-481061132 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:14:58.961063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1277782712", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "77ce2559-af37-4a03-aee8-4735f58f1dd2"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:14:59.014458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] validate_networks() for [('77ce2559-af37-4a03-aee8-4735f58f1dd2', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:14:59.384502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:14:59.385042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:14:59.385549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:14:59.385960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:14:59.386378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:14:59.396108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:59.396638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:59.397079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:59.398257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:14:59.398448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:14:59.398884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:14:59.421448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:14:59.427330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for user 3d3d0735d85744b3a52e0e0d6dd64174 and project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:14:59.439684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:14:59.442028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:14:59.489173 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8ad04207-8566-451f-8c3a-37321a563939 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531840 Aug 27 05:14:59.490056 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3286/6624] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:14:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:14:59.500943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ff206c6-beb8-4747-819b-9193ee4a9021 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:14:59.501665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ff206c6-beb8-4747-819b-9193ee4a9021 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:14:59.562710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ff206c6-beb8-4747-819b-9193ee4a9021 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:14:59.569583 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ff206c6-beb8-4747-819b-9193ee4a9021 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 200 len: 1209 microversion: 2.1 time: 0.072801 Aug 27 05:14:59.570167 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3339/6625] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:14:59 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 1209 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:00.590405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cdea0f68-1e23-489f-9c73-05558b2a23c6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:00.591672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cdea0f68-1e23-489f-9c73-05558b2a23c6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:00.600439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdea0f68-1e23-489f-9c73-05558b2a23c6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:00.600975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdea0f68-1e23-489f-9c73-05558b2a23c6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:00.601422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdea0f68-1e23-489f-9c73-05558b2a23c6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:00.602134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdea0f68-1e23-489f-9c73-05558b2a23c6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:00.602596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdea0f68-1e23-489f-9c73-05558b2a23c6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:00.603025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdea0f68-1e23-489f-9c73-05558b2a23c6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:00.668430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cdea0f68-1e23-489f-9c73-05558b2a23c6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:00.677543 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cdea0f68-1e23-489f-9c73-05558b2a23c6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 200 len: 1279 microversion: 2.1 time: 0.091349 Aug 27 05:15:00.678128 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3287/6626] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:00 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:01.699907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c927d4d-d312-49fd-8d6c-5d6f6bab30d5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:01.700567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4c927d4d-d312-49fd-8d6c-5d6f6bab30d5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:01.707509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c927d4d-d312-49fd-8d6c-5d6f6bab30d5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:01.708078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c927d4d-d312-49fd-8d6c-5d6f6bab30d5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:01.709705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c927d4d-d312-49fd-8d6c-5d6f6bab30d5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:01.710382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c927d4d-d312-49fd-8d6c-5d6f6bab30d5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:01.710941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c927d4d-d312-49fd-8d6c-5d6f6bab30d5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:01.711715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c927d4d-d312-49fd-8d6c-5d6f6bab30d5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:01.875649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e129f58e-0f15-4bc5-84da-91504ef5c748 req-8c0687a1-55c9-48a8-b075-014423f1b869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcb4ea51-3a82-4889-b687-2eb25d961c19", "tag": "fb57b6d0-1d09-4038-9c22-3138de1a0694"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:01.888246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e129f58e-0f15-4bc5-84da-91504ef5c748 req-8c0687a1-55c9-48a8-b075-014423f1b869 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:01.888900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e129f58e-0f15-4bc5-84da-91504ef5c748 req-8c0687a1-55c9-48a8-b075-014423f1b869 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:01.889563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e129f58e-0f15-4bc5-84da-91504ef5c748 req-8c0687a1-55c9-48a8-b075-014423f1b869 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:01.902487 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e129f58e-0f15-4bc5-84da-91504ef5c748 req-8c0687a1-55c9-48a8-b075-014423f1b869 service nova] Creating event network-changed:fb57b6d0-1d09-4038-9c22-3138de1a0694 for instance bcb4ea51-3a82-4889-b687-2eb25d961c19 on n-h1-854823-1 Aug 27 05:15:01.908275 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e129f58e-0f15-4bc5-84da-91504ef5c748 req-8c0687a1-55c9-48a8-b075-014423f1b869 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036629 Aug 27 05:15:01.909405 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3288/6627] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:01.944851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c927d4d-d312-49fd-8d6c-5d6f6bab30d5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:01.953333 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c927d4d-d312-49fd-8d6c-5d6f6bab30d5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 200 len: 1309 microversion: 2.1 time: 0.258085 Aug 27 05:15:01.953917 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3340/6628] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:01 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 1309 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:02.977332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4174b63f-88f9-45c7-8c27-e5fe9d272fb7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:02.977948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4174b63f-88f9-45c7-8c27-e5fe9d272fb7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:02.984090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4174b63f-88f9-45c7-8c27-e5fe9d272fb7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:02.984601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4174b63f-88f9-45c7-8c27-e5fe9d272fb7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:02.985035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4174b63f-88f9-45c7-8c27-e5fe9d272fb7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:02.985721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4174b63f-88f9-45c7-8c27-e5fe9d272fb7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:02.986171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4174b63f-88f9-45c7-8c27-e5fe9d272fb7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:02.986593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4174b63f-88f9-45c7-8c27-e5fe9d272fb7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:03.117525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4174b63f-88f9-45c7-8c27-e5fe9d272fb7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:03.125429 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4174b63f-88f9-45c7-8c27-e5fe9d272fb7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 200 len: 1309 microversion: 2.1 time: 0.153269 Aug 27 05:15:03.126205 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3289/6629] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:02 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:04.147138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-756ba715-d2d7-46a5-b382-25b1035cd7b2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:04.147798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-756ba715-d2d7-46a5-b382-25b1035cd7b2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:04.154791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-756ba715-d2d7-46a5-b382-25b1035cd7b2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:04.155291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-756ba715-d2d7-46a5-b382-25b1035cd7b2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:04.155741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-756ba715-d2d7-46a5-b382-25b1035cd7b2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:04.156456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-756ba715-d2d7-46a5-b382-25b1035cd7b2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:04.156953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-756ba715-d2d7-46a5-b382-25b1035cd7b2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:04.157392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-756ba715-d2d7-46a5-b382-25b1035cd7b2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:04.291233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-756ba715-d2d7-46a5-b382-25b1035cd7b2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:04.299310 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-756ba715-d2d7-46a5-b382-25b1035cd7b2 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 200 len: 1309 microversion: 2.1 time: 0.156089 Aug 27 05:15:04.299901 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3341/6630] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:04 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 1309 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:05.321188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b21601ce-d2da-4cba-b418-9648dd58d96c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:05.321765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b21601ce-d2da-4cba-b418-9648dd58d96c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:05.329063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b21601ce-d2da-4cba-b418-9648dd58d96c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:05.329560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b21601ce-d2da-4cba-b418-9648dd58d96c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:05.330001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b21601ce-d2da-4cba-b418-9648dd58d96c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:05.330738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b21601ce-d2da-4cba-b418-9648dd58d96c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:05.331286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b21601ce-d2da-4cba-b418-9648dd58d96c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:05.331720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b21601ce-d2da-4cba-b418-9648dd58d96c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:05.480307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b21601ce-d2da-4cba-b418-9648dd58d96c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:05.491152 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b21601ce-d2da-4cba-b418-9648dd58d96c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 200 len: 1309 microversion: 2.1 time: 0.174099 Aug 27 05:15:05.491748 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3290/6631] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:05 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 1309 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:06.511859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef34f9b4-85ed-42da-9116-d393afb9f977 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:06.512489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef34f9b4-85ed-42da-9116-d393afb9f977 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:06.515304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:06.521462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef34f9b4-85ed-42da-9116-d393afb9f977 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:06.521970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef34f9b4-85ed-42da-9116-d393afb9f977 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:06.522428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef34f9b4-85ed-42da-9116-d393afb9f977 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:06.523209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef34f9b4-85ed-42da-9116-d393afb9f977 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:06.523684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef34f9b4-85ed-42da-9116-d393afb9f977 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:06.524126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef34f9b4-85ed-42da-9116-d393afb9f977 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:06.652095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef34f9b4-85ed-42da-9116-d393afb9f977 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:06.659837 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef34f9b4-85ed-42da-9116-d393afb9f977 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 200 len: 1309 microversion: 2.1 time: 0.151991 Aug 27 05:15:06.660407 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3342/6632] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:06 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 1309 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:07.680150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bffd4ede-5c88-4eb3-96a0-c7f713839cd9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:07.680780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bffd4ede-5c88-4eb3-96a0-c7f713839cd9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:07.687672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bffd4ede-5c88-4eb3-96a0-c7f713839cd9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:07.688154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bffd4ede-5c88-4eb3-96a0-c7f713839cd9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:07.688611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bffd4ede-5c88-4eb3-96a0-c7f713839cd9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:07.689298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bffd4ede-5c88-4eb3-96a0-c7f713839cd9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:07.689774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bffd4ede-5c88-4eb3-96a0-c7f713839cd9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:07.690191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bffd4ede-5c88-4eb3-96a0-c7f713839cd9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:07.824363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bffd4ede-5c88-4eb3-96a0-c7f713839cd9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:07.832082 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bffd4ede-5c88-4eb3-96a0-c7f713839cd9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 200 len: 1309 microversion: 2.1 time: 0.155824 Aug 27 05:15:07.832698 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3291/6633] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:07 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 1309 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:08.381490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5198ebad-7c5a-431f-80f9-3d89288ac596 req-5f2a364c-d173-4f26-aab3-022167bbb0ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcb4ea51-3a82-4889-b687-2eb25d961c19", "name": "network-vif-plugged", "status": "completed", "tag": "fb57b6d0-1d09-4038-9c22-3138de1a0694"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:08.391849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5198ebad-7c5a-431f-80f9-3d89288ac596 req-5f2a364c-d173-4f26-aab3-022167bbb0ff service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:08.392340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5198ebad-7c5a-431f-80f9-3d89288ac596 req-5f2a364c-d173-4f26-aab3-022167bbb0ff service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:08.392802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5198ebad-7c5a-431f-80f9-3d89288ac596 req-5f2a364c-d173-4f26-aab3-022167bbb0ff service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:08.405658 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5198ebad-7c5a-431f-80f9-3d89288ac596 req-5f2a364c-d173-4f26-aab3-022167bbb0ff service nova] Creating event network-vif-plugged:fb57b6d0-1d09-4038-9c22-3138de1a0694 for instance bcb4ea51-3a82-4889-b687-2eb25d961c19 on n-h1-854823-1 Aug 27 05:15:08.410558 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5198ebad-7c5a-431f-80f9-3d89288ac596 req-5f2a364c-d173-4f26-aab3-022167bbb0ff service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033717 Aug 27 05:15:08.411171 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3343/6634] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:08.852577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3170b024-8065-4233-ae97-88d0f57246c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:08.853275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3170b024-8065-4233-ae97-88d0f57246c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:08.860258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3170b024-8065-4233-ae97-88d0f57246c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:08.861374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3170b024-8065-4233-ae97-88d0f57246c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:08.862300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3170b024-8065-4233-ae97-88d0f57246c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:08.862984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3170b024-8065-4233-ae97-88d0f57246c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:08.863436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3170b024-8065-4233-ae97-88d0f57246c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:08.863854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3170b024-8065-4233-ae97-88d0f57246c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:08.993775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3170b024-8065-4233-ae97-88d0f57246c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:09.002061 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3170b024-8065-4233-ae97-88d0f57246c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 200 len: 1309 microversion: 2.1 time: 0.153687 Aug 27 05:15:09.003211 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3292/6635] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:08 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:10.022113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:10.026803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92df92ac-9145-4b85-b524-2ba27c01855c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:10.027493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92df92ac-9145-4b85-b524-2ba27c01855c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:10.034148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92df92ac-9145-4b85-b524-2ba27c01855c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:10.034660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92df92ac-9145-4b85-b524-2ba27c01855c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:10.035240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92df92ac-9145-4b85-b524-2ba27c01855c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:10.035967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92df92ac-9145-4b85-b524-2ba27c01855c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:10.036445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92df92ac-9145-4b85-b524-2ba27c01855c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:10.036922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92df92ac-9145-4b85-b524-2ba27c01855c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:10.172961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92df92ac-9145-4b85-b524-2ba27c01855c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:10.180904 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92df92ac-9145-4b85-b524-2ba27c01855c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 200 len: 1490 microversion: 2.1 time: 0.160626 Aug 27 05:15:10.181490 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3344/6636] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:10 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 1490 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:10.240912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1277782712", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "77ce2559-af37-4a03-aee8-4735f58f1dd2"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:10.249317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:10.249976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:10.299655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] validate_networks() for [('77ce2559-af37-4a03-aee8-4735f58f1dd2', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:15:10.959353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:15:10.959782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:15:10.960266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:15:10.960748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:15:10.961131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:15:10.969861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:10.970358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:10.970799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:10.972025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:10.972489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:10.972940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:10.990114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:15:10.995708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for user 3d3d0735d85744b3a52e0e0d6dd64174 and project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:15:11.008446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:15:11.010859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:15:11.057744 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9ac6fdc6-77fa-42cb-b9d6-402fe52d779d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820155 Aug 27 05:15:11.058852 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3293/6637] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:15:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:15:11.069638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f663fdc7-ce55-49fc-9a96-48dc44b2f841 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:11.070500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f663fdc7-ce55-49fc-9a96-48dc44b2f841 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:11.125641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f663fdc7-ce55-49fc-9a96-48dc44b2f841 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:11.133108 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f663fdc7-ce55-49fc-9a96-48dc44b2f841 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 200 len: 1209 microversion: 2.1 time: 0.067334 Aug 27 05:15:11.133707 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3345/6638] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:11 2022] GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 1209 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:12.159307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-83b9de15-1297-4526-8db2-2f40123bc177 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:12.160331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-83b9de15-1297-4526-8db2-2f40123bc177 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:12.173260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83b9de15-1297-4526-8db2-2f40123bc177 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:12.174191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83b9de15-1297-4526-8db2-2f40123bc177 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:12.175479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83b9de15-1297-4526-8db2-2f40123bc177 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:12.176755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83b9de15-1297-4526-8db2-2f40123bc177 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:12.177578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83b9de15-1297-4526-8db2-2f40123bc177 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:12.178360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83b9de15-1297-4526-8db2-2f40123bc177 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:12.276957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-83b9de15-1297-4526-8db2-2f40123bc177 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:12.286703 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-83b9de15-1297-4526-8db2-2f40123bc177 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 200 len: 1261 microversion: 2.1 time: 0.135817 Aug 27 05:15:12.288034 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3294/6639] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:12 2022] GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 1261 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:12.815782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3c320f5-6a9a-4a1a-af50-41048af88245 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:12.816364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e3c320f5-6a9a-4a1a-af50-41048af88245 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:12.823984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3c320f5-6a9a-4a1a-af50-41048af88245 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:12.824492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3c320f5-6a9a-4a1a-af50-41048af88245 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:12.824978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3c320f5-6a9a-4a1a-af50-41048af88245 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:12.825696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3c320f5-6a9a-4a1a-af50-41048af88245 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:12.826174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3c320f5-6a9a-4a1a-af50-41048af88245 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:12.826619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3c320f5-6a9a-4a1a-af50-41048af88245 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:12.853990 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3c320f5-6a9a-4a1a-af50-41048af88245 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/ips" status: 200 len: 150 microversion: 2.1 time: 0.042171 Aug 27 05:15:12.854594 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3346/6640] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 05:15:12 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:13.310024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a42e3fd3-08f7-4438-a61b-7faf66e51beb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:13.311377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a42e3fd3-08f7-4438-a61b-7faf66e51beb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:13.319478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42e3fd3-08f7-4438-a61b-7faf66e51beb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:13.320424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42e3fd3-08f7-4438-a61b-7faf66e51beb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:13.321556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42e3fd3-08f7-4438-a61b-7faf66e51beb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:13.322850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42e3fd3-08f7-4438-a61b-7faf66e51beb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:13.323529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42e3fd3-08f7-4438-a61b-7faf66e51beb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:13.324192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42e3fd3-08f7-4438-a61b-7faf66e51beb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:13.526152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a42e3fd3-08f7-4438-a61b-7faf66e51beb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:13.534252 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a42e3fd3-08f7-4438-a61b-7faf66e51beb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 200 len: 1309 microversion: 2.1 time: 0.228311 Aug 27 05:15:13.534945 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3295/6641] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:13 2022] GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 1309 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:13.811470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0b915d22-f9a1-433d-a141-bb572772271f req-1c89f35f-73a5-4e86-88f3-c8a3b5bd510a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d9cc91-8988-4026-bd36-1f5792b527b2", "tag": "22bff99c-742e-4d61-8a81-b78987cce690"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:13.824892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0b915d22-f9a1-433d-a141-bb572772271f req-1c89f35f-73a5-4e86-88f3-c8a3b5bd510a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:13.825567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0b915d22-f9a1-433d-a141-bb572772271f req-1c89f35f-73a5-4e86-88f3-c8a3b5bd510a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:13.826096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0b915d22-f9a1-433d-a141-bb572772271f req-1c89f35f-73a5-4e86-88f3-c8a3b5bd510a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:13.851336 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0b915d22-f9a1-433d-a141-bb572772271f req-1c89f35f-73a5-4e86-88f3-c8a3b5bd510a service nova] Creating event network-changed:22bff99c-742e-4d61-8a81-b78987cce690 for instance 48d9cc91-8988-4026-bd36-1f5792b527b2 on n-h2-854823-1 Aug 27 05:15:13.856891 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0b915d22-f9a1-433d-a141-bb572772271f req-1c89f35f-73a5-4e86-88f3-c8a3b5bd510a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050862 Aug 27 05:15:13.857563 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3347/6642] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:14.293768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f099db97-5887-4a58-9a3e-8cfb693d908d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc94e97e-67e7-4706-89fa-2afbec76ee41"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:14.296233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f099db97-5887-4a58-9a3e-8cfb693d908d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.303218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f099db97-5887-4a58-9a3e-8cfb693d908d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.303704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f099db97-5887-4a58-9a3e-8cfb693d908d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.304177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f099db97-5887-4a58-9a3e-8cfb693d908d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.305220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f099db97-5887-4a58-9a3e-8cfb693d908d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.305709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f099db97-5887-4a58-9a3e-8cfb693d908d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.306134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f099db97-5887-4a58-9a3e-8cfb693d908d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.545736 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f099db97-5887-4a58-9a3e-8cfb693d908d tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "POST /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256593 Aug 27 05:15:14.546417 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3296/6643] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:15:14 2022] POST /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:14.555734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-298fe9b5-28f5-4803-a83f-f8c20d479dc9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:14.556520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-298fe9b5-28f5-4803-a83f-f8c20d479dc9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:14.564156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-298fe9b5-28f5-4803-a83f-f8c20d479dc9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.565470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-298fe9b5-28f5-4803-a83f-f8c20d479dc9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.566156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-298fe9b5-28f5-4803-a83f-f8c20d479dc9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.567103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-298fe9b5-28f5-4803-a83f-f8c20d479dc9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:14.567810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-298fe9b5-28f5-4803-a83f-f8c20d479dc9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:14.568514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-298fe9b5-28f5-4803-a83f-f8c20d479dc9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:14.710059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-298fe9b5-28f5-4803-a83f-f8c20d479dc9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:14.717887 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-298fe9b5-28f5-4803-a83f-f8c20d479dc9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 200 len: 1309 microversion: 2.1 time: 0.166437 Aug 27 05:15:14.718483 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3348/6644] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:14 2022] GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 1309 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:15.740360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fb1472dd-018d-4129-b5b3-be7b3706a8c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:15.741216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fb1472dd-018d-4129-b5b3-be7b3706a8c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:15.743175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=9 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:15.750026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1472dd-018d-4129-b5b3-be7b3706a8c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.750911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1472dd-018d-4129-b5b3-be7b3706a8c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.751554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1472dd-018d-4129-b5b3-be7b3706a8c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.752582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1472dd-018d-4129-b5b3-be7b3706a8c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:15.753276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1472dd-018d-4129-b5b3-be7b3706a8c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:15.754157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fb1472dd-018d-4129-b5b3-be7b3706a8c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:15.932441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fb1472dd-018d-4129-b5b3-be7b3706a8c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:15.941190 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fb1472dd-018d-4129-b5b3-be7b3706a8c1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 200 len: 1309 microversion: 2.1 time: 0.206043 Aug 27 05:15:15.941869 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3297/6645] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:15 2022] GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 1309 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:16.962180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb5d4bb0-5e11-4510-b6b9-c6414e2b0114 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:16.963075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fb5d4bb0-5e11-4510-b6b9-c6414e2b0114 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:16.972073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb5d4bb0-5e11-4510-b6b9-c6414e2b0114 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:16.972907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb5d4bb0-5e11-4510-b6b9-c6414e2b0114 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:16.973629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb5d4bb0-5e11-4510-b6b9-c6414e2b0114 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:16.974532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb5d4bb0-5e11-4510-b6b9-c6414e2b0114 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:16.975014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb5d4bb0-5e11-4510-b6b9-c6414e2b0114 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:16.975463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb5d4bb0-5e11-4510-b6b9-c6414e2b0114 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:17.119852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fb5d4bb0-5e11-4510-b6b9-c6414e2b0114 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:17.128206 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fb5d4bb0-5e11-4510-b6b9-c6414e2b0114 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 200 len: 1309 microversion: 2.1 time: 0.169617 Aug 27 05:15:17.129125 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3349/6646] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:16 2022] GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 1309 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:18.149723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-38e52f18-7b1e-4923-b431-743f5f1c363b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:18.150567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-38e52f18-7b1e-4923-b431-743f5f1c363b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:18.157844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38e52f18-7b1e-4923-b431-743f5f1c363b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:18.158346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38e52f18-7b1e-4923-b431-743f5f1c363b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:18.159302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38e52f18-7b1e-4923-b431-743f5f1c363b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:18.160003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38e52f18-7b1e-4923-b431-743f5f1c363b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:18.160455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38e52f18-7b1e-4923-b431-743f5f1c363b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:18.160928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38e52f18-7b1e-4923-b431-743f5f1c363b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:18.391588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-38e52f18-7b1e-4923-b431-743f5f1c363b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:18.399993 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-38e52f18-7b1e-4923-b431-743f5f1c363b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 200 len: 1309 microversion: 2.1 time: 0.254146 Aug 27 05:15:18.400951 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3298/6647] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:18 2022] GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 1309 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:18.956820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-98783141-b597-40e4-8acc-288afcf7fb06 req-5007e859-c351-4969-9a9c-fb65c9fa5a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d9cc91-8988-4026-bd36-1f5792b527b2", "name": "network-vif-plugged", "status": "completed", "tag": "22bff99c-742e-4d61-8a81-b78987cce690"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:18.967764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-98783141-b597-40e4-8acc-288afcf7fb06 req-5007e859-c351-4969-9a9c-fb65c9fa5a3f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:18.968511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-98783141-b597-40e4-8acc-288afcf7fb06 req-5007e859-c351-4969-9a9c-fb65c9fa5a3f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:18.969164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-98783141-b597-40e4-8acc-288afcf7fb06 req-5007e859-c351-4969-9a9c-fb65c9fa5a3f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:18.982140 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-98783141-b597-40e4-8acc-288afcf7fb06 req-5007e859-c351-4969-9a9c-fb65c9fa5a3f service nova] Creating event network-vif-plugged:22bff99c-742e-4d61-8a81-b78987cce690 for instance 48d9cc91-8988-4026-bd36-1f5792b527b2 on n-h2-854823-1 Aug 27 05:15:18.987926 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-98783141-b597-40e4-8acc-288afcf7fb06 req-5007e859-c351-4969-9a9c-fb65c9fa5a3f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035437 Aug 27 05:15:18.989114 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3350/6648] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:19.421407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2df714ba-7506-4d67-8849-e966839e2a5d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:19.422018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2df714ba-7506-4d67-8849-e966839e2a5d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:19.429644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2df714ba-7506-4d67-8849-e966839e2a5d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:19.430135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2df714ba-7506-4d67-8849-e966839e2a5d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:19.430566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2df714ba-7506-4d67-8849-e966839e2a5d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:19.431254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2df714ba-7506-4d67-8849-e966839e2a5d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:19.431713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2df714ba-7506-4d67-8849-e966839e2a5d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:19.432133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2df714ba-7506-4d67-8849-e966839e2a5d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:19.569322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2df714ba-7506-4d67-8849-e966839e2a5d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:19.576987 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2df714ba-7506-4d67-8849-e966839e2a5d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 200 len: 1309 microversion: 2.1 time: 0.159422 Aug 27 05:15:19.577593 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3299/6649] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:19 2022] GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 1309 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:20.599070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4f4beb0-434a-45a8-a683-f41a90acaad5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:20.599815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4f4beb0-434a-45a8-a683-f41a90acaad5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:20.606281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f4beb0-434a-45a8-a683-f41a90acaad5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:20.606781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f4beb0-434a-45a8-a683-f41a90acaad5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:20.607233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f4beb0-434a-45a8-a683-f41a90acaad5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:20.607951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f4beb0-434a-45a8-a683-f41a90acaad5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:20.608423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f4beb0-434a-45a8-a683-f41a90acaad5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:20.608899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f4beb0-434a-45a8-a683-f41a90acaad5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:20.740465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4f4beb0-434a-45a8-a683-f41a90acaad5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:20.748225 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4f4beb0-434a-45a8-a683-f41a90acaad5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 200 len: 1490 microversion: 2.1 time: 0.154284 Aug 27 05:15:20.748904 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3351/6650] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:20 2022] GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 1490 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:20.769720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d159cd8b-8921-4004-b082-fb42b9494386 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:20.770332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d159cd8b-8921-4004-b082-fb42b9494386 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:20.777160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d159cd8b-8921-4004-b082-fb42b9494386 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:20.777694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d159cd8b-8921-4004-b082-fb42b9494386 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:20.778132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d159cd8b-8921-4004-b082-fb42b9494386 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:20.778819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d159cd8b-8921-4004-b082-fb42b9494386 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:20.779278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d159cd8b-8921-4004-b082-fb42b9494386 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:20.779702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d159cd8b-8921-4004-b082-fb42b9494386 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:20.907554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d159cd8b-8921-4004-b082-fb42b9494386 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:20.915323 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d159cd8b-8921-4004-b082-fb42b9494386 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 200 len: 1490 microversion: 2.1 time: 0.150012 Aug 27 05:15:20.915892 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3300/6651] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:20 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 1490 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:20.935619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a7c7dfe-89ce-44f1-a1da-e87539af1671 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:20.936242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a7c7dfe-89ce-44f1-a1da-e87539af1671 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:20.942996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7c7dfe-89ce-44f1-a1da-e87539af1671 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:20.943500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7c7dfe-89ce-44f1-a1da-e87539af1671 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:20.944063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7c7dfe-89ce-44f1-a1da-e87539af1671 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:20.944737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7c7dfe-89ce-44f1-a1da-e87539af1671 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:20.945226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7c7dfe-89ce-44f1-a1da-e87539af1671 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:20.945658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a7c7dfe-89ce-44f1-a1da-e87539af1671 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:20.948477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:21.081280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a7c7dfe-89ce-44f1-a1da-e87539af1671 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:21.089050 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a7c7dfe-89ce-44f1-a1da-e87539af1671 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 200 len: 1490 microversion: 2.1 time: 0.157313 Aug 27 05:15:21.089629 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3352/6652] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:20 2022] GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 1490 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:21.108867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-72578c05-cc52-4b62-b5ca-3cf9f4c8222f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:21.109363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-72578c05-cc52-4b62-b5ca-3cf9f4c8222f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:21.111211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:21.112371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:21.118208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72578c05-cc52-4b62-b5ca-3cf9f4c8222f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:21.118690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72578c05-cc52-4b62-b5ca-3cf9f4c8222f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:21.119158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72578c05-cc52-4b62-b5ca-3cf9f4c8222f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:21.119846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72578c05-cc52-4b62-b5ca-3cf9f4c8222f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:21.120314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72578c05-cc52-4b62-b5ca-3cf9f4c8222f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:21.120755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-72578c05-cc52-4b62-b5ca-3cf9f4c8222f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:21.146599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-72578c05-cc52-4b62-b5ca-3cf9f4c8222f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:15:21.191084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:21.223360 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-72578c05-cc52-4b62-b5ca-3cf9f4c8222f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 204 len: 0 microversion: 2.1 time: 0.118010 Aug 27 05:15:21.224082 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3301/6653] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:21 2022] DELETE /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:15:21.232717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c8d05be-7b44-4710-8144-2282c8d28bfb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:21.233228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c8d05be-7b44-4710-8144-2282c8d28bfb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:21.235063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:21.240960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c8d05be-7b44-4710-8144-2282c8d28bfb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:21.241466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c8d05be-7b44-4710-8144-2282c8d28bfb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:21.241921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c8d05be-7b44-4710-8144-2282c8d28bfb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:21.242634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c8d05be-7b44-4710-8144-2282c8d28bfb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:21.243107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c8d05be-7b44-4710-8144-2282c8d28bfb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:21.243557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c8d05be-7b44-4710-8144-2282c8d28bfb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:21.376403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c8d05be-7b44-4710-8144-2282c8d28bfb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:21.384642 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c8d05be-7b44-4710-8144-2282c8d28bfb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 200 len: 1496 microversion: 2.1 time: 0.156056 Aug 27 05:15:21.385159 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3353/6654] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:21 2022] GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 1496 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:22.405815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0cf329ed-6d7e-43a5-9718-6699aee4d7f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:22.406601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0cf329ed-6d7e-43a5-9718-6699aee4d7f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:22.413725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cf329ed-6d7e-43a5-9718-6699aee4d7f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:22.414227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cf329ed-6d7e-43a5-9718-6699aee4d7f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:22.414679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cf329ed-6d7e-43a5-9718-6699aee4d7f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:22.415659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cf329ed-6d7e-43a5-9718-6699aee4d7f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:22.415981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cf329ed-6d7e-43a5-9718-6699aee4d7f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:22.416547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cf329ed-6d7e-43a5-9718-6699aee4d7f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:22.917633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0cf329ed-6d7e-43a5-9718-6699aee4d7f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:22.927040 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0cf329ed-6d7e-43a5-9718-6699aee4d7f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 200 len: 1496 microversion: 2.1 time: 0.525361 Aug 27 05:15:22.927583 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3302/6655] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:22 2022] GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 1496 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:23.202482 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-70fa381e-a90d-4a88-bb0b-7a17b13a8934 req-e9e1a573-7714-4511-9b20-1eacdd9315c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d9cc91-8988-4026-bd36-1f5792b527b2", "name": "network-vif-deleted", "tag": "22bff99c-742e-4d61-8a81-b78987cce690"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:23.217097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-70fa381e-a90d-4a88-bb0b-7a17b13a8934 req-e9e1a573-7714-4511-9b20-1eacdd9315c6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:23.217633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-70fa381e-a90d-4a88-bb0b-7a17b13a8934 req-e9e1a573-7714-4511-9b20-1eacdd9315c6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:23.218182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-70fa381e-a90d-4a88-bb0b-7a17b13a8934 req-e9e1a573-7714-4511-9b20-1eacdd9315c6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:23.237757 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-70fa381e-a90d-4a88-bb0b-7a17b13a8934 req-e9e1a573-7714-4511-9b20-1eacdd9315c6 service nova] Creating event network-vif-deleted:22bff99c-742e-4d61-8a81-b78987cce690 for instance 48d9cc91-8988-4026-bd36-1f5792b527b2 on n-h2-854823-1 Aug 27 05:15:23.243384 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-70fa381e-a90d-4a88-bb0b-7a17b13a8934 req-e9e1a573-7714-4511-9b20-1eacdd9315c6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044290 Aug 27 05:15:23.244214 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3354/6656] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:23.948008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e848cb6-369b-4313-839a-3975849ca82d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:23.948578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4e848cb6-369b-4313-839a-3975849ca82d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:23.955401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e848cb6-369b-4313-839a-3975849ca82d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:23.955906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e848cb6-369b-4313-839a-3975849ca82d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:23.956329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e848cb6-369b-4313-839a-3975849ca82d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:23.957054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e848cb6-369b-4313-839a-3975849ca82d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:23.957514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e848cb6-369b-4313-839a-3975849ca82d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:23.957942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e848cb6-369b-4313-839a-3975849ca82d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:23.971064 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-4e848cb6-369b-4313-839a-3975849ca82d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e848cb6-369b-4313-839a-3975849ca82d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 HTTP/1.1 Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '48d9cc91-8988-4026-bd36-1f5792b527b2'} Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:23.972970 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:23.978811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:23.978811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:23.978811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:23.978811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:23.978811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:15:23.978811 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:23.978811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e848cb6-369b-4313-839a-3975849ca82d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:23.978811 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4e848cb6-369b-4313-839a-3975849ca82d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 404 len: 111 microversion: 2.1 time: 0.030461 Aug 27 05:15:23.978811 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3303/6657] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:23 2022] GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:23.985107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ce81215-def0-4b8c-b498-4d92e0fee600 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:23.985702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ce81215-def0-4b8c-b498-4d92e0fee600 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:23.992395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce81215-def0-4b8c-b498-4d92e0fee600 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:23.992927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce81215-def0-4b8c-b498-4d92e0fee600 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:23.993378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce81215-def0-4b8c-b498-4d92e0fee600 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:23.994107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce81215-def0-4b8c-b498-4d92e0fee600 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:23.994571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce81215-def0-4b8c-b498-4d92e0fee600 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:23.995006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce81215-def0-4b8c-b498-4d92e0fee600 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:24.020393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ce81215-def0-4b8c-b498-4d92e0fee600 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:15:24.096282 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ce81215-def0-4b8c-b498-4d92e0fee600 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 204 len: 0 microversion: 2.1 time: 0.115104 Aug 27 05:15:24.099935 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3355/6658] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:23 2022] DELETE /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:15:24.107067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ca7ce8f1-dc60-4be3-a644-2bafca36347e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:24.107690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ca7ce8f1-dc60-4be3-a644-2bafca36347e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:24.116981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca7ce8f1-dc60-4be3-a644-2bafca36347e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:24.117484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca7ce8f1-dc60-4be3-a644-2bafca36347e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:24.117927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca7ce8f1-dc60-4be3-a644-2bafca36347e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:24.118640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca7ce8f1-dc60-4be3-a644-2bafca36347e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:24.119101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca7ce8f1-dc60-4be3-a644-2bafca36347e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:24.119540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca7ce8f1-dc60-4be3-a644-2bafca36347e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:24.255715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ca7ce8f1-dc60-4be3-a644-2bafca36347e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:24.263640 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ca7ce8f1-dc60-4be3-a644-2bafca36347e tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 200 len: 1496 microversion: 2.1 time: 0.160768 Aug 27 05:15:24.264215 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3304/6659] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:24 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 1496 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:25.284997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8c5a2e6-8a90-48b4-a9c1-aa70d9f4a804 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:25.285720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b8c5a2e6-8a90-48b4-a9c1-aa70d9f4a804 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:25.292661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c5a2e6-8a90-48b4-a9c1-aa70d9f4a804 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:25.293164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c5a2e6-8a90-48b4-a9c1-aa70d9f4a804 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:25.293619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c5a2e6-8a90-48b4-a9c1-aa70d9f4a804 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:25.294345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c5a2e6-8a90-48b4-a9c1-aa70d9f4a804 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:25.294815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c5a2e6-8a90-48b4-a9c1-aa70d9f4a804 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:25.295258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c5a2e6-8a90-48b4-a9c1-aa70d9f4a804 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:25.429331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b8c5a2e6-8a90-48b4-a9c1-aa70d9f4a804 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:25.437326 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b8c5a2e6-8a90-48b4-a9c1-aa70d9f4a804 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 200 len: 1496 microversion: 2.1 time: 0.156585 Aug 27 05:15:25.437914 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3356/6660] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:25 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:26.459443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-283a4bfc-d1d9-460c-8d5f-bf3607c62ddc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:26.460071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-283a4bfc-d1d9-460c-8d5f-bf3607c62ddc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:26.467007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-283a4bfc-d1d9-460c-8d5f-bf3607c62ddc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:26.467525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-283a4bfc-d1d9-460c-8d5f-bf3607c62ddc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:26.467960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-283a4bfc-d1d9-460c-8d5f-bf3607c62ddc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:26.468682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-283a4bfc-d1d9-460c-8d5f-bf3607c62ddc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:26.469783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-283a4bfc-d1d9-460c-8d5f-bf3607c62ddc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:26.470215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-283a4bfc-d1d9-460c-8d5f-bf3607c62ddc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:26.623594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-283a4bfc-d1d9-460c-8d5f-bf3607c62ddc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:26.632207 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-283a4bfc-d1d9-460c-8d5f-bf3607c62ddc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 200 len: 1496 microversion: 2.1 time: 0.177266 Aug 27 05:15:26.633028 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3305/6661] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:26 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 1496 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:26.974359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ea26156a-d7e1-4dc4-a103-825c6fb8e905 req-920a2dd5-f38d-4fdc-96b8-8252ada2a561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcb4ea51-3a82-4889-b687-2eb25d961c19", "name": "network-vif-deleted", "tag": "fb57b6d0-1d09-4038-9c22-3138de1a0694"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:26.987477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ea26156a-d7e1-4dc4-a103-825c6fb8e905 req-920a2dd5-f38d-4fdc-96b8-8252ada2a561 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:26.987901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ea26156a-d7e1-4dc4-a103-825c6fb8e905 req-920a2dd5-f38d-4fdc-96b8-8252ada2a561 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:26.988352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ea26156a-d7e1-4dc4-a103-825c6fb8e905 req-920a2dd5-f38d-4fdc-96b8-8252ada2a561 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:27.007241 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ea26156a-d7e1-4dc4-a103-825c6fb8e905 req-920a2dd5-f38d-4fdc-96b8-8252ada2a561 service nova] Creating event network-vif-deleted:fb57b6d0-1d09-4038-9c22-3138de1a0694 for instance bcb4ea51-3a82-4889-b687-2eb25d961c19 on n-h1-854823-1 Aug 27 05:15:27.013487 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ea26156a-d7e1-4dc4-a103-825c6fb8e905 req-920a2dd5-f38d-4fdc-96b8-8252ada2a561 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044294 Aug 27 05:15:27.014682 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3357/6662] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:27.507190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3337774b-31bc-4931-9d9f-f7c2544a8003 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:27.507734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3337774b-31bc-4931-9d9f-f7c2544a8003 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:27.515711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3337774b-31bc-4931-9d9f-f7c2544a8003 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:27.516212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3337774b-31bc-4931-9d9f-f7c2544a8003 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:27.516677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3337774b-31bc-4931-9d9f-f7c2544a8003 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:27.517427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3337774b-31bc-4931-9d9f-f7c2544a8003 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:27.518026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3337774b-31bc-4931-9d9f-f7c2544a8003 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:27.519404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3337774b-31bc-4931-9d9f-f7c2544a8003 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:27.603932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-3337774b-31bc-4931-9d9f-f7c2544a8003 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lazy-loading 'services' on Instance uuid 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:15:27.654859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9bd0ac70-7d0e-4c04-94be-9b254d12da59 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:27.655897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9bd0ac70-7d0e-4c04-94be-9b254d12da59 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:27.664016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bd0ac70-7d0e-4c04-94be-9b254d12da59 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:27.664760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bd0ac70-7d0e-4c04-94be-9b254d12da59 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:27.665071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bd0ac70-7d0e-4c04-94be-9b254d12da59 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:27.665874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bd0ac70-7d0e-4c04-94be-9b254d12da59 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:27.666504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bd0ac70-7d0e-4c04-94be-9b254d12da59 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:27.667166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bd0ac70-7d0e-4c04-94be-9b254d12da59 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:27.675101 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3337774b-31bc-4931-9d9f-f7c2544a8003 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments/fc94e97e-67e7-4706-89fa-2afbec76ee41" status: 202 len: 0 microversion: 2.1 time: 0.171951 Aug 27 05:15:27.675866 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3306/6663] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:15:27 2022] DELETE /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments/fc94e97e-67e7-4706-89fa-2afbec76ee41 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:15:27.683416 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9bd0ac70-7d0e-4c04-94be-9b254d12da59 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:15:27.684640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-67a73e71-8b28-4635-9bbb-119746557cef tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9bd0ac70-7d0e-4c04-94be-9b254d12da59 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 HTTP/1.1 Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'bcb4ea51-3a82-4889-b687-2eb25d961c19'} Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:27.685128 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:27.689921 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:27.689921 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:27.689921 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:27.689921 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:27.689921 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:15:27.689921 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:27.690552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-67a73e71-8b28-4635-9bbb-119746557cef tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:27.691323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9bd0ac70-7d0e-4c04-94be-9b254d12da59 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:27.692387 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9bd0ac70-7d0e-4c04-94be-9b254d12da59 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 404 len: 111 microversion: 2.1 time: 0.041870 Aug 27 05:15:27.693096 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3358/6664] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:27 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:27.694097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67a73e71-8b28-4635-9bbb-119746557cef tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:27.694584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67a73e71-8b28-4635-9bbb-119746557cef tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:27.695322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67a73e71-8b28-4635-9bbb-119746557cef tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:27.696343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67a73e71-8b28-4635-9bbb-119746557cef tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:27.696998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67a73e71-8b28-4635-9bbb-119746557cef tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:27.697430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67a73e71-8b28-4635-9bbb-119746557cef tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:27.734441 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-67a73e71-8b28-4635-9bbb-119746557cef tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053971 Aug 27 05:15:27.734984 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3307/6665] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:15:27 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:15:27.751502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-175171471", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "77ce2559-af37-4a03-aee8-4735f58f1dd2"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:27.805636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] validate_networks() for [('77ce2559-af37-4a03-aee8-4735f58f1dd2', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:15:28.190921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:15:28.191515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:15:28.191826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:15:28.192272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:15:28.192726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:15:28.202961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:28.203459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:28.203951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:28.204905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:28.205376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:28.206495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:28.223540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:15:28.229148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for user 3d3d0735d85744b3a52e0e0d6dd64174 and project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:15:28.242554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:15:28.244599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:15:28.292102 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-faffda05-e032-4887-b3e1-229a30de3c63 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544523 Aug 27 05:15:28.293240 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3359/6666] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:15:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:15:28.304204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8d09d31e-c332-401b-b0bf-ff0c554fce26 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:28.305154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8d09d31e-c332-401b-b0bf-ff0c554fce26 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:28.372317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8d09d31e-c332-401b-b0bf-ff0c554fce26 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:28.381599 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8d09d31e-c332-401b-b0bf-ff0c554fce26 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1208 microversion: 2.1 time: 0.080812 Aug 27 05:15:28.385334 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3308/6667] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:28 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1208 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:28.747794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bfeb07bc-396b-4035-9fbc-5a0b2044359a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:28.750239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bfeb07bc-396b-4035-9fbc-5a0b2044359a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:28.759319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfeb07bc-396b-4035-9fbc-5a0b2044359a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:28.760234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfeb07bc-396b-4035-9fbc-5a0b2044359a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:28.761019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfeb07bc-396b-4035-9fbc-5a0b2044359a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:28.761823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfeb07bc-396b-4035-9fbc-5a0b2044359a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:28.763176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfeb07bc-396b-4035-9fbc-5a0b2044359a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:28.763949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfeb07bc-396b-4035-9fbc-5a0b2044359a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:28.798954 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bfeb07bc-396b-4035-9fbc-5a0b2044359a tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056142 Aug 27 05:15:28.800521 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3360/6668] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:15:28 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:29.405593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a996a37f-be80-43e1-96ce-4d1fc22a78fc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:29.406142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a996a37f-be80-43e1-96ce-4d1fc22a78fc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:29.413952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a996a37f-be80-43e1-96ce-4d1fc22a78fc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:29.414459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a996a37f-be80-43e1-96ce-4d1fc22a78fc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:29.414903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a996a37f-be80-43e1-96ce-4d1fc22a78fc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:29.415656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a996a37f-be80-43e1-96ce-4d1fc22a78fc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:29.416292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a996a37f-be80-43e1-96ce-4d1fc22a78fc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:29.417411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a996a37f-be80-43e1-96ce-4d1fc22a78fc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:29.527654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a996a37f-be80-43e1-96ce-4d1fc22a78fc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:29.548096 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a996a37f-be80-43e1-96ce-4d1fc22a78fc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1260 microversion: 2.1 time: 0.146158 Aug 27 05:15:29.553259 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3309/6669] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:29 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:29.812370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbdb3644-0a14-4ec4-bdae-f7e4eec76500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:29.815859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dbdb3644-0a14-4ec4-bdae-f7e4eec76500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:29.823633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbdb3644-0a14-4ec4-bdae-f7e4eec76500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:29.824151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbdb3644-0a14-4ec4-bdae-f7e4eec76500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:29.824636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbdb3644-0a14-4ec4-bdae-f7e4eec76500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:29.825564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbdb3644-0a14-4ec4-bdae-f7e4eec76500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:29.826039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbdb3644-0a14-4ec4-bdae-f7e4eec76500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:29.826486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbdb3644-0a14-4ec4-bdae-f7e4eec76500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:29.861193 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbdb3644-0a14-4ec4-bdae-f7e4eec76500 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052917 Aug 27 05:15:29.863056 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3361/6670] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:15:29 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:30.571188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8189260f-f3f8-42df-b0f6-5030e71740f4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:30.571958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8189260f-f3f8-42df-b0f6-5030e71740f4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:30.579439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8189260f-f3f8-42df-b0f6-5030e71740f4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:30.580088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8189260f-f3f8-42df-b0f6-5030e71740f4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:30.580552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8189260f-f3f8-42df-b0f6-5030e71740f4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:30.582052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8189260f-f3f8-42df-b0f6-5030e71740f4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:30.582518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8189260f-f3f8-42df-b0f6-5030e71740f4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:30.582946 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8189260f-f3f8-42df-b0f6-5030e71740f4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:30.856117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8189260f-f3f8-42df-b0f6-5030e71740f4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:30.864781 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8189260f-f3f8-42df-b0f6-5030e71740f4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1308 microversion: 2.1 time: 0.297746 Aug 27 05:15:30.865661 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3310/6671] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:30 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:30.875953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ab73deb-9e5e-417a-b60e-c964bed830a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:30.878639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8ab73deb-9e5e-417a-b60e-c964bed830a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:30.886001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ab73deb-9e5e-417a-b60e-c964bed830a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:30.886734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ab73deb-9e5e-417a-b60e-c964bed830a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:30.887260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ab73deb-9e5e-417a-b60e-c964bed830a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:30.888046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ab73deb-9e5e-417a-b60e-c964bed830a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:30.888731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ab73deb-9e5e-417a-b60e-c964bed830a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:30.889718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ab73deb-9e5e-417a-b60e-c964bed830a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:30.921284 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8ab73deb-9e5e-417a-b60e-c964bed830a8 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050072 Aug 27 05:15:30.925834 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3362/6672] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:15:30 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:30.984782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-4c7267a1-0148-4630-a37d-6345e0bc13eb req-46d97e13-64be-46d0-a1e2-5f54f2d958c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d35993-95e0-4ec8-afe2-ba7453ff3b66", "tag": "97c134f7-89ee-43c0-b352-343960404b48"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:30.996200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4c7267a1-0148-4630-a37d-6345e0bc13eb req-46d97e13-64be-46d0-a1e2-5f54f2d958c9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:30.997009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4c7267a1-0148-4630-a37d-6345e0bc13eb req-46d97e13-64be-46d0-a1e2-5f54f2d958c9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:30.997627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4c7267a1-0148-4630-a37d-6345e0bc13eb req-46d97e13-64be-46d0-a1e2-5f54f2d958c9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:31.020316 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-4c7267a1-0148-4630-a37d-6345e0bc13eb req-46d97e13-64be-46d0-a1e2-5f54f2d958c9 service nova] Creating event network-changed:97c134f7-89ee-43c0-b352-343960404b48 for instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 on n-h2-854823-1 Aug 27 05:15:31.025496 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-4c7267a1-0148-4630-a37d-6345e0bc13eb req-46d97e13-64be-46d0-a1e2-5f54f2d958c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044767 Aug 27 05:15:31.026110 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3311/6673] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:31.886529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-07c1c8c3-d839-4f15-9c94-19cf197c0a51 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:31.887215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-07c1c8c3-d839-4f15-9c94-19cf197c0a51 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:31.894372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c1c8c3-d839-4f15-9c94-19cf197c0a51 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:31.894880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c1c8c3-d839-4f15-9c94-19cf197c0a51 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:31.895332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c1c8c3-d839-4f15-9c94-19cf197c0a51 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:31.896052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c1c8c3-d839-4f15-9c94-19cf197c0a51 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:31.896544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c1c8c3-d839-4f15-9c94-19cf197c0a51 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:31.897207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c1c8c3-d839-4f15-9c94-19cf197c0a51 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:31.935154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5c79924c-6474-4f4f-8b89-5fb2e4367001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:31.937551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5c79924c-6474-4f4f-8b89-5fb2e4367001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:31.944307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c79924c-6474-4f4f-8b89-5fb2e4367001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:31.944897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c79924c-6474-4f4f-8b89-5fb2e4367001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:31.945406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c79924c-6474-4f4f-8b89-5fb2e4367001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:31.946506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c79924c-6474-4f4f-8b89-5fb2e4367001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:31.947049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c79924c-6474-4f4f-8b89-5fb2e4367001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:31.947530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c79924c-6474-4f4f-8b89-5fb2e4367001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:31.979279 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5c79924c-6474-4f4f-8b89-5fb2e4367001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049426 Aug 27 05:15:31.983181 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3312/6674] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:15:31 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:15:32.035406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-07c1c8c3-d839-4f15-9c94-19cf197c0a51 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:32.043302 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-07c1c8c3-d839-4f15-9c94-19cf197c0a51 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1308 microversion: 2.1 time: 0.160753 Aug 27 05:15:32.044474 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3363/6675] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:31 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1308 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:32.991930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9c6db78a-9c48-4962-8945-c636e2f758f4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:32.994160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9c6db78a-9c48-4962-8945-c636e2f758f4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:33.001064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c6db78a-9c48-4962-8945-c636e2f758f4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.001556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c6db78a-9c48-4962-8945-c636e2f758f4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.001998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c6db78a-9c48-4962-8945-c636e2f758f4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.002690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c6db78a-9c48-4962-8945-c636e2f758f4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.003158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c6db78a-9c48-4962-8945-c636e2f758f4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.003586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c6db78a-9c48-4962-8945-c636e2f758f4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.034596 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9c6db78a-9c48-4962-8945-c636e2f758f4 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047164 Aug 27 05:15:33.035242 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3313/6676] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:15:32 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:15:33.064487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de79f33c-39e6-442c-b147-8cc98441a2f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:33.065165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-de79f33c-39e6-442c-b147-8cc98441a2f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:33.072675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de79f33c-39e6-442c-b147-8cc98441a2f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.073420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de79f33c-39e6-442c-b147-8cc98441a2f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.073876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de79f33c-39e6-442c-b147-8cc98441a2f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.074600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de79f33c-39e6-442c-b147-8cc98441a2f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.075072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de79f33c-39e6-442c-b147-8cc98441a2f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.075510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de79f33c-39e6-442c-b147-8cc98441a2f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.102593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3a8c0b40-4c59-42e9-bfaf-7cf2ab66a51c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:33.103102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3a8c0b40-4c59-42e9-bfaf-7cf2ab66a51c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:33.109544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b40-4c59-42e9-bfaf-7cf2ab66a51c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.110064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b40-4c59-42e9-bfaf-7cf2ab66a51c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.110511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b40-4c59-42e9-bfaf-7cf2ab66a51c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.111238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b40-4c59-42e9-bfaf-7cf2ab66a51c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.111705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b40-4c59-42e9-bfaf-7cf2ab66a51c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.112141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b40-4c59-42e9-bfaf-7cf2ab66a51c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.144549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3a8c0b40-4c59-42e9-bfaf-7cf2ab66a51c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:15:33.247323 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3a8c0b40-4c59-42e9-bfaf-7cf2ab66a51c tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 204 len: 0 microversion: 2.1 time: 0.148759 Aug 27 05:15:33.252096 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3314/6677] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:33 2022] DELETE /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:15:33.263386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0ec91617-0ae1-479c-8dbf-fefe9988f933 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:33.264295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0ec91617-0ae1-479c-8dbf-fefe9988f933 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:33.272339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ec91617-0ae1-479c-8dbf-fefe9988f933 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.272743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ec91617-0ae1-479c-8dbf-fefe9988f933 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.273193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ec91617-0ae1-479c-8dbf-fefe9988f933 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.274188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ec91617-0ae1-479c-8dbf-fefe9988f933 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:33.274662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ec91617-0ae1-479c-8dbf-fefe9988f933 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:33.275096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ec91617-0ae1-479c-8dbf-fefe9988f933 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:33.419184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0ec91617-0ae1-479c-8dbf-fefe9988f933 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:33.427187 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0ec91617-0ae1-479c-8dbf-fefe9988f933 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1680 microversion: 2.1 time: 0.168447 Aug 27 05:15:33.427774 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3315/6678] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:33 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:33.494329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de79f33c-39e6-442c-b147-8cc98441a2f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:33.502145 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de79f33c-39e6-442c-b147-8cc98441a2f6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1308 microversion: 2.1 time: 0.441688 Aug 27 05:15:33.502718 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3364/6679] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:33 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:34.448295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1cbb2cc5-14ac-4da0-8802-05bbdbd42f21 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:34.448949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1cbb2cc5-14ac-4da0-8802-05bbdbd42f21 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:34.455960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cbb2cc5-14ac-4da0-8802-05bbdbd42f21 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:34.456451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cbb2cc5-14ac-4da0-8802-05bbdbd42f21 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:34.456924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cbb2cc5-14ac-4da0-8802-05bbdbd42f21 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:34.458120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cbb2cc5-14ac-4da0-8802-05bbdbd42f21 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:34.458583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cbb2cc5-14ac-4da0-8802-05bbdbd42f21 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:34.459012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cbb2cc5-14ac-4da0-8802-05bbdbd42f21 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:34.524357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3a9236b-2808-418a-bc86-09dc2e57b910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:34.525036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b3a9236b-2808-418a-bc86-09dc2e57b910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:34.531549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3a9236b-2808-418a-bc86-09dc2e57b910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:34.532054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3a9236b-2808-418a-bc86-09dc2e57b910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:34.532564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3a9236b-2808-418a-bc86-09dc2e57b910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:34.533518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3a9236b-2808-418a-bc86-09dc2e57b910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:34.533995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3a9236b-2808-418a-bc86-09dc2e57b910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:34.534442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3a9236b-2808-418a-bc86-09dc2e57b910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:34.594586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1cbb2cc5-14ac-4da0-8802-05bbdbd42f21 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:34.603659 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1cbb2cc5-14ac-4da0-8802-05bbdbd42f21 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1680 microversion: 2.1 time: 0.159135 Aug 27 05:15:34.604243 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3316/6680] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:34 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:34.666448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b3a9236b-2808-418a-bc86-09dc2e57b910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:34.674106 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3a9236b-2808-418a-bc86-09dc2e57b910 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1308 microversion: 2.1 time: 0.154650 Aug 27 05:15:34.674685 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3365/6681] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:34 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1308 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:35.625473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8719e5e8-9884-4bb4-8bc1-1a33a75b69ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:35.626118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8719e5e8-9884-4bb4-8bc1-1a33a75b69ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:35.633618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8719e5e8-9884-4bb4-8bc1-1a33a75b69ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:35.634111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8719e5e8-9884-4bb4-8bc1-1a33a75b69ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:35.634553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8719e5e8-9884-4bb4-8bc1-1a33a75b69ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:35.635250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8719e5e8-9884-4bb4-8bc1-1a33a75b69ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:35.635704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8719e5e8-9884-4bb4-8bc1-1a33a75b69ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:35.636128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8719e5e8-9884-4bb4-8bc1-1a33a75b69ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:35.694585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bfb9ec9b-247b-4029-a1df-0199526a69cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:35.695206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bfb9ec9b-247b-4029-a1df-0199526a69cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:35.702979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb9ec9b-247b-4029-a1df-0199526a69cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:35.703489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb9ec9b-247b-4029-a1df-0199526a69cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:35.703934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb9ec9b-247b-4029-a1df-0199526a69cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:35.704854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb9ec9b-247b-4029-a1df-0199526a69cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:35.705321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb9ec9b-247b-4029-a1df-0199526a69cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:35.705927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb9ec9b-247b-4029-a1df-0199526a69cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:35.780217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8719e5e8-9884-4bb4-8bc1-1a33a75b69ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:35.789336 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8719e5e8-9884-4bb4-8bc1-1a33a75b69ee tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1680 microversion: 2.1 time: 0.167691 Aug 27 05:15:35.789940 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3317/6682] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:35 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:36.237420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bfb9ec9b-247b-4029-a1df-0199526a69cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:36.245496 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bfb9ec9b-247b-4029-a1df-0199526a69cd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1308 microversion: 2.1 time: 0.554772 Aug 27 05:15:36.246447 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3366/6683] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:35 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1308 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:36.454987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-19b511a8-c5c2-441a-98b0-387158827c0f req-29cd7ed3-2624-4831-b0d6-68e6dfb9477e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776eecfe-8c9b-4dac-b8ff-99c1bbc42226", "name": "network-vif-deleted", "tag": "6d5e361c-1c69-4f29-84f0-7966de2bfadc"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:36.467776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-19b511a8-c5c2-441a-98b0-387158827c0f req-29cd7ed3-2624-4831-b0d6-68e6dfb9477e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:36.468461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-19b511a8-c5c2-441a-98b0-387158827c0f req-29cd7ed3-2624-4831-b0d6-68e6dfb9477e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:36.469977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-19b511a8-c5c2-441a-98b0-387158827c0f req-29cd7ed3-2624-4831-b0d6-68e6dfb9477e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:36.479028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:36.492662 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-19b511a8-c5c2-441a-98b0-387158827c0f req-29cd7ed3-2624-4831-b0d6-68e6dfb9477e service nova] Creating event network-vif-deleted:6d5e361c-1c69-4f29-84f0-7966de2bfadc for instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 on n-h1-854823-1 Aug 27 05:15:36.498982 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-19b511a8-c5c2-441a-98b0-387158827c0f req-29cd7ed3-2624-4831-b0d6-68e6dfb9477e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047634 Aug 27 05:15:36.500320 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3318/6684] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:36.811129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-364c39de-ecaa-400e-9eb9-297b319db001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:36.811766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-364c39de-ecaa-400e-9eb9-297b319db001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:36.814695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:36.820864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364c39de-ecaa-400e-9eb9-297b319db001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:36.821382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364c39de-ecaa-400e-9eb9-297b319db001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:36.821839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364c39de-ecaa-400e-9eb9-297b319db001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:36.822575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364c39de-ecaa-400e-9eb9-297b319db001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:36.823055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364c39de-ecaa-400e-9eb9-297b319db001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:36.823503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364c39de-ecaa-400e-9eb9-297b319db001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:36.859449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364c39de-ecaa-400e-9eb9-297b319db001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:36.859958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364c39de-ecaa-400e-9eb9-297b319db001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:36.860412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364c39de-ecaa-400e-9eb9-297b319db001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:36.860946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-364c39de-ecaa-400e-9eb9-297b319db001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lazy-loading 'fault' on Instance uuid 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:15:36.906752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-364c39de-ecaa-400e-9eb9-297b319db001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b938c06bd432496e8ae8b24965678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ba45be6a54b4f9aa0edabf60011c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:36.924505 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-364c39de-ecaa-400e-9eb9-297b319db001 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 200 len: 1330 microversion: 2.1 time: 0.116825 Aug 27 05:15:36.926039 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3367/6685] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:36 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 1330 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:37.140456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-0a5fa51f-90d7-482e-87d0-34e380f653ae req-a53f14c5-cbdd-4c7c-ba09-e06b4e43924a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d35993-95e0-4ec8-afe2-ba7453ff3b66", "name": "network-vif-plugged", "status": "completed", "tag": "97c134f7-89ee-43c0-b352-343960404b48"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:37.162030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0a5fa51f-90d7-482e-87d0-34e380f653ae req-a53f14c5-cbdd-4c7c-ba09-e06b4e43924a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:37.163141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0a5fa51f-90d7-482e-87d0-34e380f653ae req-a53f14c5-cbdd-4c7c-ba09-e06b4e43924a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:37.164152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-0a5fa51f-90d7-482e-87d0-34e380f653ae req-a53f14c5-cbdd-4c7c-ba09-e06b4e43924a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:37.193385 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-0a5fa51f-90d7-482e-87d0-34e380f653ae req-a53f14c5-cbdd-4c7c-ba09-e06b4e43924a service nova] Creating event network-vif-plugged:97c134f7-89ee-43c0-b352-343960404b48 for instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 on n-h2-854823-1 Aug 27 05:15:37.202799 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-0a5fa51f-90d7-482e-87d0-34e380f653ae req-a53f14c5-cbdd-4c7c-ba09-e06b4e43924a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071492 Aug 27 05:15:37.203902 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3319/6686] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:37.266737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe5a074a-cb11-468c-9a64-6ee4bd8c272a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:37.267376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe5a074a-cb11-468c-9a64-6ee4bd8c272a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:37.279451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe5a074a-cb11-468c-9a64-6ee4bd8c272a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:37.280077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe5a074a-cb11-468c-9a64-6ee4bd8c272a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:37.280559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe5a074a-cb11-468c-9a64-6ee4bd8c272a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:37.281328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe5a074a-cb11-468c-9a64-6ee4bd8c272a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:37.281801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe5a074a-cb11-468c-9a64-6ee4bd8c272a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:37.282244 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe5a074a-cb11-468c-9a64-6ee4bd8c272a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:37.424103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe5a074a-cb11-468c-9a64-6ee4bd8c272a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:37.432374 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe5a074a-cb11-468c-9a64-6ee4bd8c272a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1308 microversion: 2.1 time: 0.169597 Aug 27 05:15:37.433019 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3368/6687] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:37 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:37.948736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0b51726e-0c03-4eae-94cf-2ca686772c3e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:37.949443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0b51726e-0c03-4eae-94cf-2ca686772c3e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:37.955727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b51726e-0c03-4eae-94cf-2ca686772c3e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:37.956213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b51726e-0c03-4eae-94cf-2ca686772c3e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:37.956693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b51726e-0c03-4eae-94cf-2ca686772c3e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:37.957389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b51726e-0c03-4eae-94cf-2ca686772c3e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:37.958486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b51726e-0c03-4eae-94cf-2ca686772c3e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:37.961582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0b51726e-0c03-4eae-94cf-2ca686772c3e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:37.973969 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-0b51726e-0c03-4eae-94cf-2ca686772c3e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] HTTP exception thrown: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0b51726e-0c03-4eae-94cf-2ca686772c3e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Request method failure captured: Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 HTTP/1.1 Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaaigp07zvkISHb29u2Quk6NjhbfN1zEDCSkQQoinW0uynW7tNECIjPZRDz_K75qhqu2Icv_5PRsBA8URuVfOgE2knALTSJ-lxCAlMfLfMaApUY2YZNmhuhErGrmBQkx_kPARWtJeBImZcDnJdIllkJtA8jOXs3vwkeuSJPXsJdeNoo Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: dc1b938c06bd432496e8ae8b24965678 Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '776eecfe-8c9b-4dac-b8ff-99c1bbc42226'} Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:37.975685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:37.985148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:37.985148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:37.985148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:37.985148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:37.985148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:37.985148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:37.985148 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:37.985148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0b51726e-0c03-4eae-94cf-2ca686772c3e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Returning 404 to user: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:37.985148 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0b51726e-0c03-4eae-94cf-2ca686772c3e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 404 len: 111 microversion: 2.1 time: 0.032885 Aug 27 05:15:37.985148 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3320/6688] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:37 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:37.991451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20bd8795-b521-47bf-864f-5eebbedd46f7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '.version_select at 0x7f1f20df5a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:38.014203 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20bd8795-b521-47bf-864f-5eebbedd46f7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027271462" status: 202 len: 0 microversion: 2.1 time: 0.027248 Aug 27 05:15:38.014810 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3369/6689] 10.222.0.79 () {58 vars in 1221 bytes} [Sat Aug 27 05:15:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027271462 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:15:38.453239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-16c6ba17-6c38-47b1-8561-f57374f237ae tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:38.453890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-16c6ba17-6c38-47b1-8561-f57374f237ae tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:38.456690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:38.462986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16c6ba17-6c38-47b1-8561-f57374f237ae tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:38.463603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16c6ba17-6c38-47b1-8561-f57374f237ae tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:38.464152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16c6ba17-6c38-47b1-8561-f57374f237ae tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:38.464966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16c6ba17-6c38-47b1-8561-f57374f237ae tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:38.465505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16c6ba17-6c38-47b1-8561-f57374f237ae tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:38.465993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-16c6ba17-6c38-47b1-8561-f57374f237ae tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:38.710295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-16c6ba17-6c38-47b1-8561-f57374f237ae tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:38.719827 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-16c6ba17-6c38-47b1-8561-f57374f237ae tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1308 microversion: 2.1 time: 0.271150 Aug 27 05:15:38.720777 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3321/6690] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:38 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1308 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:39.739195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:39.739941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:39.746372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c867e413-30fc-4940-bf9f-84e30e03de5a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:39.746999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c867e413-30fc-4940-bf9f-84e30e03de5a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:39.754095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c867e413-30fc-4940-bf9f-84e30e03de5a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:39.754604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c867e413-30fc-4940-bf9f-84e30e03de5a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:39.755319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c867e413-30fc-4940-bf9f-84e30e03de5a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:39.756041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c867e413-30fc-4940-bf9f-84e30e03de5a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:39.756518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c867e413-30fc-4940-bf9f-84e30e03de5a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:39.756985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c867e413-30fc-4940-bf9f-84e30e03de5a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:39.772315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:39.892902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c867e413-30fc-4940-bf9f-84e30e03de5a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:39.901783 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c867e413-30fc-4940-bf9f-84e30e03de5a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1490 microversion: 2.1 time: 0.163408 Aug 27 05:15:39.902484 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3370/6691] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:39 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1490 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:39.922102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4917e14d-39c3-4560-b41a-22ce017aae91 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:39.924676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4917e14d-39c3-4560-b41a-22ce017aae91 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:39.931681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4917e14d-39c3-4560-b41a-22ce017aae91 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:39.932166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4917e14d-39c3-4560-b41a-22ce017aae91 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:39.932667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4917e14d-39c3-4560-b41a-22ce017aae91 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:39.933364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4917e14d-39c3-4560-b41a-22ce017aae91 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:39.933823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4917e14d-39c3-4560-b41a-22ce017aae91 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:39.934246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4917e14d-39c3-4560-b41a-22ce017aae91 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:40.002136 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4917e14d-39c3-4560-b41a-22ce017aae91 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "PUT /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1085 microversion: 2.1 time: 0.083911 Aug 27 05:15:40.014976 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3322/6692] 10.222.0.79 () {60 vars in 1256 bytes} [Sat Aug 27 05:15:39 2022] PUT /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1085 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:40.021124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e259070c-86fb-4aa7-83e8-26e59ae4e8a8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:40.021920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e259070c-86fb-4aa7-83e8-26e59ae4e8a8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:40.028208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e259070c-86fb-4aa7-83e8-26e59ae4e8a8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:40.028752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e259070c-86fb-4aa7-83e8-26e59ae4e8a8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:40.029214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e259070c-86fb-4aa7-83e8-26e59ae4e8a8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:40.029931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e259070c-86fb-4aa7-83e8-26e59ae4e8a8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:40.030409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e259070c-86fb-4aa7-83e8-26e59ae4e8a8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:40.030858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e259070c-86fb-4aa7-83e8-26e59ae4e8a8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:40.173130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e259070c-86fb-4aa7-83e8-26e59ae4e8a8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:40.182888 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e259070c-86fb-4aa7-83e8-26e59ae4e8a8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1511 microversion: 2.1 time: 0.166405 Aug 27 05:15:40.183692 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3371/6693] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:40 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:40.202719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7b9ffdee-319e-4f56-8da5-993611b6da09 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:40.203332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7b9ffdee-319e-4f56-8da5-993611b6da09 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:40.210100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b9ffdee-319e-4f56-8da5-993611b6da09 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:40.210100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b9ffdee-319e-4f56-8da5-993611b6da09 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:40.210437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b9ffdee-319e-4f56-8da5-993611b6da09 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:40.211146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b9ffdee-319e-4f56-8da5-993611b6da09 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:40.211595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b9ffdee-319e-4f56-8da5-993611b6da09 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:40.212016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b9ffdee-319e-4f56-8da5-993611b6da09 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:40.349766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b9ffdee-319e-4f56-8da5-993611b6da09 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:40.358892 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7b9ffdee-319e-4f56-8da5-993611b6da09 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1511 microversion: 2.1 time: 0.160021 Aug 27 05:15:40.359608 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3323/6694] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:40 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:40.378997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6dcb2cd-0336-45c5-aeb4-e628c4dab585 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:40.379606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6dcb2cd-0336-45c5-aeb4-e628c4dab585 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:40.386207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6dcb2cd-0336-45c5-aeb4-e628c4dab585 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:40.386717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6dcb2cd-0336-45c5-aeb4-e628c4dab585 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:40.387175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6dcb2cd-0336-45c5-aeb4-e628c4dab585 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:40.387894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6dcb2cd-0336-45c5-aeb4-e628c4dab585 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:40.388368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6dcb2cd-0336-45c5-aeb4-e628c4dab585 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:40.388833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6dcb2cd-0336-45c5-aeb4-e628c4dab585 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:40.415564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6dcb2cd-0336-45c5-aeb4-e628c4dab585 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:15:40.497742 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6dcb2cd-0336-45c5-aeb4-e628c4dab585 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 204 len: 0 microversion: 2.1 time: 0.122290 Aug 27 05:15:40.498521 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3372/6695] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:40 2022] DELETE /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:15:40.507346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5ff6ff9d-2650-4e53-a154-f9b66c5aff78 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:40.508138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5ff6ff9d-2650-4e53-a154-f9b66c5aff78 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:40.514653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ff6ff9d-2650-4e53-a154-f9b66c5aff78 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:40.515276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ff6ff9d-2650-4e53-a154-f9b66c5aff78 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:40.515826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ff6ff9d-2650-4e53-a154-f9b66c5aff78 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:40.516664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ff6ff9d-2650-4e53-a154-f9b66c5aff78 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:40.517226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ff6ff9d-2650-4e53-a154-f9b66c5aff78 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:40.517866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ff6ff9d-2650-4e53-a154-f9b66c5aff78 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:40.655383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5ff6ff9d-2650-4e53-a154-f9b66c5aff78 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:40.663543 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5ff6ff9d-2650-4e53-a154-f9b66c5aff78 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1517 microversion: 2.1 time: 0.160459 Aug 27 05:15:40.664131 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3324/6696] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:40 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:41.685143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79133668-c916-481d-b8a4-61a1953afee4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:41.685811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-79133668-c916-481d-b8a4-61a1953afee4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:41.694043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79133668-c916-481d-b8a4-61a1953afee4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:41.694550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79133668-c916-481d-b8a4-61a1953afee4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:41.695007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79133668-c916-481d-b8a4-61a1953afee4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:41.695732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79133668-c916-481d-b8a4-61a1953afee4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:41.696209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79133668-c916-481d-b8a4-61a1953afee4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:41.696680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79133668-c916-481d-b8a4-61a1953afee4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:41.831297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-79133668-c916-481d-b8a4-61a1953afee4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:41.839332 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-79133668-c916-481d-b8a4-61a1953afee4 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1517 microversion: 2.1 time: 0.158577 Aug 27 05:15:41.839909 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3373/6697] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:41 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:41.984292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c4bbbc9-8ba6-49af-8c68-72eb4db0f373 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:41.985158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8c4bbbc9-8ba6-49af-8c68-72eb4db0f373 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:41.992663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c4bbbc9-8ba6-49af-8c68-72eb4db0f373 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:41.993163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c4bbbc9-8ba6-49af-8c68-72eb4db0f373 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:41.993604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c4bbbc9-8ba6-49af-8c68-72eb4db0f373 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:41.994311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c4bbbc9-8ba6-49af-8c68-72eb4db0f373 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:41.994771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c4bbbc9-8ba6-49af-8c68-72eb4db0f373 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:41.995228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c4bbbc9-8ba6-49af-8c68-72eb4db0f373 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:42.010158 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-8c4bbbc9-8ba6-49af-8c68-72eb4db0f373 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] HTTP exception thrown: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c4bbbc9-8ba6-49af-8c68-72eb4db0f373 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Request method failure captured: Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 HTTP/1.1 Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaaigp07zvkISHb29u2Quk6NjhbfN1zEDCSkQQoinW0uynW7tNECIjPZRDz_K75qhqu2Icv_5PRsBA8URuVfOgE2knALTSJ-lxCAlMfLfMaApUY2YZNmhuhErGrmBQkx_kPARWtJeBImZcDnJdIllkJtA8jOXs3vwkeuSJPXsJdeNoo Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: dc1b938c06bd432496e8ae8b24965678 Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '776eecfe-8c9b-4dac-b8ff-99c1bbc42226'} Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:42.011765 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:42.017325 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:42.017325 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:42.017325 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:42.017325 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:42.017325 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:42.017325 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:42.017325 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:42.017325 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:42.017325 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:42.017325 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:42.017325 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:42.017325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c4bbbc9-8ba6-49af-8c68-72eb4db0f373 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Returning 404 to user: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:42.017325 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8c4bbbc9-8ba6-49af-8c68-72eb4db0f373 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 404 len: 111 microversion: 2.1 time: 0.032855 Aug 27 05:15:42.017325 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3325/6698] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:41 2022] DELETE /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:42.022325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-874d88f9-2ba8-47a1-b991-971a286abcf7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:42.022979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-874d88f9-2ba8-47a1-b991-971a286abcf7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 776eecfe-8c9b-4dac-b8ff-99c1bbc42226] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:42.029840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-874d88f9-2ba8-47a1-b991-971a286abcf7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:42.030356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-874d88f9-2ba8-47a1-b991-971a286abcf7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:42.030816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-874d88f9-2ba8-47a1-b991-971a286abcf7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:42.031772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-874d88f9-2ba8-47a1-b991-971a286abcf7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:42.032262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-874d88f9-2ba8-47a1-b991-971a286abcf7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:42.032742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-874d88f9-2ba8-47a1-b991-971a286abcf7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:42.049420 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-874d88f9-2ba8-47a1-b991-971a286abcf7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] HTTP exception thrown: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-874d88f9-2ba8-47a1-b991-971a286abcf7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Request method failure captured: Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 HTTP/1.1 Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaaigp07zvkISHb29u2Quk6NjhbfN1zEDCSkQQoinW0uynW7tNECIjPZRDz_K75qhqu2Icv_5PRsBA8URuVfOgE2knALTSJ-lxCAlMfLfMaApUY2YZNmhuhErGrmBQkx_kPARWtJeBImZcDnJdIllkJtA8jOXs3vwkeuSJPXsJdeNoo Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: dc1b938c06bd432496e8ae8b24965678 Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '776eecfe-8c9b-4dac-b8ff-99c1bbc42226'} Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:42.051778 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:42.056963 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:42.056963 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:42.056963 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:42.056963 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:42.056963 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:42.056963 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. Aug 27 05:15:42.056963 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:42.056963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-874d88f9-2ba8-47a1-b991-971a286abcf7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Returning 404 to user: Instance 776eecfe-8c9b-4dac-b8ff-99c1bbc42226 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:42.056963 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-874d88f9-2ba8-47a1-b991-971a286abcf7 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226" status: 404 len: 111 microversion: 2.1 time: 0.035048 Aug 27 05:15:42.058047 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3374/6699] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:42 2022] GET /compute/v2.1/servers/776eecfe-8c9b-4dac-b8ff-99c1bbc42226 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:42.488129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a36abdfb-0f27-4f08-9924-37442abac723 req-527508b7-9c2a-45d6-9d8d-6fcdc8468a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d35993-95e0-4ec8-afe2-ba7453ff3b66", "name": "network-vif-deleted", "tag": "97c134f7-89ee-43c0-b352-343960404b48"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:42.500117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a36abdfb-0f27-4f08-9924-37442abac723 req-527508b7-9c2a-45d6-9d8d-6fcdc8468a7d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:42.501880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a36abdfb-0f27-4f08-9924-37442abac723 req-527508b7-9c2a-45d6-9d8d-6fcdc8468a7d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:42.504297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a36abdfb-0f27-4f08-9924-37442abac723 req-527508b7-9c2a-45d6-9d8d-6fcdc8468a7d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:42.531437 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a36abdfb-0f27-4f08-9924-37442abac723 req-527508b7-9c2a-45d6-9d8d-6fcdc8468a7d service nova] Creating event network-vif-deleted:97c134f7-89ee-43c0-b352-343960404b48 for instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 on n-h2-854823-1 Aug 27 05:15:42.542127 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a36abdfb-0f27-4f08-9924-37442abac723 req-527508b7-9c2a-45d6-9d8d-6fcdc8468a7d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058045 Aug 27 05:15:42.548146 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3326/6700] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:42.860678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5dc0b92a-1409-4926-9456-c6f93b3caa94 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:42.861306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5dc0b92a-1409-4926-9456-c6f93b3caa94 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:42.868726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dc0b92a-1409-4926-9456-c6f93b3caa94 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:42.869227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dc0b92a-1409-4926-9456-c6f93b3caa94 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:42.869685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dc0b92a-1409-4926-9456-c6f93b3caa94 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:42.870401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dc0b92a-1409-4926-9456-c6f93b3caa94 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:42.870868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dc0b92a-1409-4926-9456-c6f93b3caa94 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:42.871308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dc0b92a-1409-4926-9456-c6f93b3caa94 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:42.906408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dc0b92a-1409-4926-9456-c6f93b3caa94 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:42.906927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dc0b92a-1409-4926-9456-c6f93b3caa94 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:42.907383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dc0b92a-1409-4926-9456-c6f93b3caa94 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:42.907875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-5dc0b92a-1409-4926-9456-c6f93b3caa94 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lazy-loading 'fault' on Instance uuid 50d35993-95e0-4ec8-afe2-ba7453ff3b66 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:15:42.951899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5dc0b92a-1409-4926-9456-c6f93b3caa94 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:42.961457 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5dc0b92a-1409-4926-9456-c6f93b3caa94 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 200 len: 1319 microversion: 2.1 time: 0.104649 Aug 27 05:15:42.962052 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3375/6701] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:42 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 1319 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:43.983197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd07f1c4-359d-48a1-95f4-ecd6d1d9f5bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:43.983819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fd07f1c4-359d-48a1-95f4-ecd6d1d9f5bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:43.990701 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd07f1c4-359d-48a1-95f4-ecd6d1d9f5bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:43.991186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd07f1c4-359d-48a1-95f4-ecd6d1d9f5bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:43.991626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd07f1c4-359d-48a1-95f4-ecd6d1d9f5bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:43.992324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd07f1c4-359d-48a1-95f4-ecd6d1d9f5bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:43.992925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd07f1c4-359d-48a1-95f4-ecd6d1d9f5bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:43.993362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fd07f1c4-359d-48a1-95f4-ecd6d1d9f5bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.007513 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-fd07f1c4-359d-48a1-95f4-ecd6d1d9f5bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd07f1c4-359d-48a1-95f4-ecd6d1d9f5bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 HTTP/1.1 Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '50d35993-95e0-4ec8-afe2-ba7453ff3b66'} Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.009206 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:44.014193 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:44.014193 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:44.014193 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:44.014193 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:44.014193 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:15:44.014193 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:44.014193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fd07f1c4-359d-48a1-95f4-ecd6d1d9f5bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:44.014193 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fd07f1c4-359d-48a1-95f4-ecd6d1d9f5bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 404 len: 111 microversion: 2.1 time: 0.032763 Aug 27 05:15:44.014193 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3327/6702] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:43 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:44.066310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-357256226", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "77ce2559-af37-4a03-aee8-4735f58f1dd2"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:44.121165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] validate_networks() for [('77ce2559-af37-4a03-aee8-4735f58f1dd2', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:15:44.506931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:15:44.507388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:15:44.507876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:15:44.508483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:15:44.508956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:15:44.518130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.518627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.519079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.519819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:44.520918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:44.521357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:44.538833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:15:44.544374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Getting quotas for user 3d3d0735d85744b3a52e0e0d6dd64174 and project cc1e6863fdac49b486519421d1c8181b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:15:44.556931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:15:44.559295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:15:44.607638 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-67c8abb6-be87-4095-a5d3-ec811b15bc80 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545308 Aug 27 05:15:44.608563 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3376/6703] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:15:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:15:44.619474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-60c9ca81-869c-4f5e-8181-21143bfaf9d3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:44.620092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-60c9ca81-869c-4f5e-8181-21143bfaf9d3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:44.678797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-60c9ca81-869c-4f5e-8181-21143bfaf9d3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:44.687558 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-60c9ca81-869c-4f5e-8181-21143bfaf9d3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1208 microversion: 2.1 time: 0.071827 Aug 27 05:15:44.694464 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3328/6704] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:44 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1208 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:45.325612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f31edbb-ba0b-4c23-9e5b-d2a319a01b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:45.326125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f31edbb-ba0b-4c23-9e5b-d2a319a01b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:45.333029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f31edbb-ba0b-4c23-9e5b-d2a319a01b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:45.333532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f31edbb-ba0b-4c23-9e5b-d2a319a01b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:45.333980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f31edbb-ba0b-4c23-9e5b-d2a319a01b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:45.334718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f31edbb-ba0b-4c23-9e5b-d2a319a01b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:45.335196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f31edbb-ba0b-4c23-9e5b-d2a319a01b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:45.335635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f31edbb-ba0b-4c23-9e5b-d2a319a01b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:45.350939 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7f31edbb-ba0b-4c23-9e5b-d2a319a01b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] HTTP exception thrown: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f31edbb-ba0b-4c23-9e5b-d2a319a01b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Request method failure captured: Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 HTTP/1.1 Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaaigp07zvkISHb29u2Quk6NjhbfN1zEDCSkQQoinW0uynW7tNECIjPZRDz_K75qhqu2Icv_5PRsBA8URuVfOgE2knALTSJ-lxCAlMfLfMaApUY2YZNmhuhErGrmBQkx_kPARWtJeBImZcDnJdIllkJtA8jOXs3vwkeuSJPXsJdeNoo Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: dc1b938c06bd432496e8ae8b24965678 Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'fda2a251-0067-45d0-b424-3b6214b1c3a5'} Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:45.352573 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:45.357804 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:15:45.357804 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.357804 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:45.357804 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.357804 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:45.357804 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:45.357804 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:45.357804 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:45.357804 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:45.357804 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:15:45.357804 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.357804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f31edbb-ba0b-4c23-9e5b-d2a319a01b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Returning 404 to user: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:45.357804 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f31edbb-ba0b-4c23-9e5b-d2a319a01b5e tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 404 len: 111 microversion: 2.1 time: 0.033833 Aug 27 05:15:45.357804 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3377/6705] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:45 2022] DELETE /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:45.362825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-19672392-a15a-4f98-8bda-9d47d54252ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:45.363465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-19672392-a15a-4f98-8bda-9d47d54252ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: fda2a251-0067-45d0-b424-3b6214b1c3a5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:45.372098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19672392-a15a-4f98-8bda-9d47d54252ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:45.372625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19672392-a15a-4f98-8bda-9d47d54252ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:45.373052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19672392-a15a-4f98-8bda-9d47d54252ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:45.373742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19672392-a15a-4f98-8bda-9d47d54252ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:45.374196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19672392-a15a-4f98-8bda-9d47d54252ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:45.374616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19672392-a15a-4f98-8bda-9d47d54252ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:45.388058 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-19672392-a15a-4f98-8bda-9d47d54252ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] HTTP exception thrown: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-19672392-a15a-4f98-8bda-9d47d54252ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Request method failure captured: Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 HTTP/1.1 Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaaigp07zvkISHb29u2Quk6NjhbfN1zEDCSkQQoinW0uynW7tNECIjPZRDz_K75qhqu2Icv_5PRsBA8URuVfOgE2knALTSJ-lxCAlMfLfMaApUY2YZNmhuhErGrmBQkx_kPARWtJeBImZcDnJdIllkJtA8jOXs3vwkeuSJPXsJdeNoo Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: dc1b938c06bd432496e8ae8b24965678 Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'fda2a251-0067-45d0-b424-3b6214b1c3a5'} Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:45.389616 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.394581 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:45.394581 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:45.394581 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:45.394581 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:45.394581 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:45.394581 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. Aug 27 05:15:45.394581 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.394581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-19672392-a15a-4f98-8bda-9d47d54252ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Returning 404 to user: Instance fda2a251-0067-45d0-b424-3b6214b1c3a5 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:45.394581 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-19672392-a15a-4f98-8bda-9d47d54252ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5" status: 404 len: 111 microversion: 2.1 time: 0.032063 Aug 27 05:15:45.394581 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3329/6706] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:45 2022] GET /compute/v2.1/servers/fda2a251-0067-45d0-b424-3b6214b1c3a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:45.399573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a234d80-6889-43b2-a420-a78ff4f7d098 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:45.400077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a234d80-6889-43b2-a420-a78ff4f7d098 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:45.406197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a234d80-6889-43b2-a420-a78ff4f7d098 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:45.406695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a234d80-6889-43b2-a420-a78ff4f7d098 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:45.407142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a234d80-6889-43b2-a420-a78ff4f7d098 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:45.407843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a234d80-6889-43b2-a420-a78ff4f7d098 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:45.408308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a234d80-6889-43b2-a420-a78ff4f7d098 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:45.408772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a234d80-6889-43b2-a420-a78ff4f7d098 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:45.422435 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4a234d80-6889-43b2-a420-a78ff4f7d098 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] HTTP exception thrown: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a234d80-6889-43b2-a420-a78ff4f7d098 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Request method failure captured: Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a HTTP/1.1 Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaaigp07zvkISHb29u2Quk6NjhbfN1zEDCSkQQoinW0uynW7tNECIjPZRDz_K75qhqu2Icv_5PRsBA8URuVfOgE2knALTSJ-lxCAlMfLfMaApUY2YZNmhuhErGrmBQkx_kPARWtJeBImZcDnJdIllkJtA8jOXs3vwkeuSJPXsJdeNoo Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: dc1b938c06bd432496e8ae8b24965678 Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '986bd712-6d0e-49a2-8bd4-a5bdc6186b4a'} Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:45.424030 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:45.429140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:15:45.429140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.429140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:45.429140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.429140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:45.429140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:45.429140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:45.429140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:45.429140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:45.429140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:15:45.429140 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.429140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a234d80-6889-43b2-a420-a78ff4f7d098 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Returning 404 to user: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:45.429140 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a234d80-6889-43b2-a420-a78ff4f7d098 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 404 len: 111 microversion: 2.1 time: 0.029735 Aug 27 05:15:45.429140 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3378/6707] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:45 2022] DELETE /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:15:45.437597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0d6b3c6e-69d4-4b86-b358-5ccb0d5d07ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:45.438217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0d6b3c6e-69d4-4b86-b358-5ccb0d5d07ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:45.444494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d6b3c6e-69d4-4b86-b358-5ccb0d5d07ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:45.445070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d6b3c6e-69d4-4b86-b358-5ccb0d5d07ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:45.445544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d6b3c6e-69d4-4b86-b358-5ccb0d5d07ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:45.446259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d6b3c6e-69d4-4b86-b358-5ccb0d5d07ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:45.446713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d6b3c6e-69d4-4b86-b358-5ccb0d5d07ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:45.447141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0d6b3c6e-69d4-4b86-b358-5ccb0d5d07ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:45.461523 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-0d6b3c6e-69d4-4b86-b358-5ccb0d5d07ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] HTTP exception thrown: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0d6b3c6e-69d4-4b86-b358-5ccb0d5d07ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Request method failure captured: Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a HTTP/1.1 Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaaigp07zvkISHb29u2Quk6NjhbfN1zEDCSkQQoinW0uynW7tNECIjPZRDz_K75qhqu2Icv_5PRsBA8URuVfOgE2knALTSJ-lxCAlMfLfMaApUY2YZNmhuhErGrmBQkx_kPARWtJeBImZcDnJdIllkJtA8jOXs3vwkeuSJPXsJdeNoo Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: dc1b938c06bd432496e8ae8b24965678 Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '986bd712-6d0e-49a2-8bd4-a5bdc6186b4a'} Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:45.463181 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.467790 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:45.467790 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:45.467790 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:45.467790 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:45.467790 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:45.467790 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. Aug 27 05:15:45.467790 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:45.467790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0d6b3c6e-69d4-4b86-b358-5ccb0d5d07ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Returning 404 to user: Instance 986bd712-6d0e-49a2-8bd4-a5bdc6186b4a could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:45.467790 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0d6b3c6e-69d4-4b86-b358-5ccb0d5d07ca tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a" status: 404 len: 111 microversion: 2.1 time: 0.032143 Aug 27 05:15:45.467790 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3330/6708] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:45 2022] GET /compute/v2.1/servers/986bd712-6d0e-49a2-8bd4-a5bdc6186b4a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:45.710854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9034d1d9-6e9a-4e8f-a706-1a51b0bbe648 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:45.711554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9034d1d9-6e9a-4e8f-a706-1a51b0bbe648 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:45.719724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9034d1d9-6e9a-4e8f-a706-1a51b0bbe648 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:45.725349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9034d1d9-6e9a-4e8f-a706-1a51b0bbe648 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:45.726549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9034d1d9-6e9a-4e8f-a706-1a51b0bbe648 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:45.727788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9034d1d9-6e9a-4e8f-a706-1a51b0bbe648 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:45.728865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9034d1d9-6e9a-4e8f-a706-1a51b0bbe648 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:45.729649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9034d1d9-6e9a-4e8f-a706-1a51b0bbe648 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:45.825355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9034d1d9-6e9a-4e8f-a706-1a51b0bbe648 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:45.835096 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9034d1d9-6e9a-4e8f-a706-1a51b0bbe648 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1268 microversion: 2.1 time: 0.130249 Aug 27 05:15:45.835695 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3379/6709] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:45 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1268 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:46.855607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-38616532-6e52-4589-bb16-43f63963d09a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:46.856217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-38616532-6e52-4589-bb16-43f63963d09a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:46.860404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:46.864853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38616532-6e52-4589-bb16-43f63963d09a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:46.865344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38616532-6e52-4589-bb16-43f63963d09a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:46.865783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38616532-6e52-4589-bb16-43f63963d09a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:46.866479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38616532-6e52-4589-bb16-43f63963d09a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:46.866922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38616532-6e52-4589-bb16-43f63963d09a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:46.867624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38616532-6e52-4589-bb16-43f63963d09a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:47.008921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-38616532-6e52-4589-bb16-43f63963d09a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:47.017054 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-38616532-6e52-4589-bb16-43f63963d09a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1308 microversion: 2.1 time: 0.165480 Aug 27 05:15:47.017634 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3331/6710] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:46 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1308 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:47.148820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9e604c8b-477d-49e4-92ef-3c7f7d0f56e1 req-306b2309-98d0-4a53-af0e-c317580e686c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fba5da4-1fe7-4d08-b51b-398d616cac3a", "tag": "9e0ba1eb-76b8-45ca-b3b8-b61bc01c5348"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:47.166702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9e604c8b-477d-49e4-92ef-3c7f7d0f56e1 req-306b2309-98d0-4a53-af0e-c317580e686c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:47.167700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9e604c8b-477d-49e4-92ef-3c7f7d0f56e1 req-306b2309-98d0-4a53-af0e-c317580e686c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:47.168365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9e604c8b-477d-49e4-92ef-3c7f7d0f56e1 req-306b2309-98d0-4a53-af0e-c317580e686c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:47.183349 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9e604c8b-477d-49e4-92ef-3c7f7d0f56e1 req-306b2309-98d0-4a53-af0e-c317580e686c service nova] Creating event network-changed:9e0ba1eb-76b8-45ca-b3b8-b61bc01c5348 for instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a on n-h1-854823-1 Aug 27 05:15:47.189251 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9e604c8b-477d-49e4-92ef-3c7f7d0f56e1 req-306b2309-98d0-4a53-af0e-c317580e686c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045311 Aug 27 05:15:47.190794 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3380/6711] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:48.038689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5bc013fc-238c-49f8-8d0c-98b952ab4c86 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:48.039302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5bc013fc-238c-49f8-8d0c-98b952ab4c86 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:48.046210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bc013fc-238c-49f8-8d0c-98b952ab4c86 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:48.046695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bc013fc-238c-49f8-8d0c-98b952ab4c86 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:48.047133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bc013fc-238c-49f8-8d0c-98b952ab4c86 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:48.047826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bc013fc-238c-49f8-8d0c-98b952ab4c86 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:48.048287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bc013fc-238c-49f8-8d0c-98b952ab4c86 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:48.048745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bc013fc-238c-49f8-8d0c-98b952ab4c86 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:48.190417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5bc013fc-238c-49f8-8d0c-98b952ab4c86 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:48.199209 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5bc013fc-238c-49f8-8d0c-98b952ab4c86 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1308 microversion: 2.1 time: 0.164461 Aug 27 05:15:48.200243 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3332/6712] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:48 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:48.758595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bfd718f-0938-41f5-91a6-4217a79d6aab tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:48.759216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0bfd718f-0938-41f5-91a6-4217a79d6aab tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:48.766690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bfd718f-0938-41f5-91a6-4217a79d6aab tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:48.767224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bfd718f-0938-41f5-91a6-4217a79d6aab tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:48.767667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bfd718f-0938-41f5-91a6-4217a79d6aab tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:48.768375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bfd718f-0938-41f5-91a6-4217a79d6aab tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:48.768871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bfd718f-0938-41f5-91a6-4217a79d6aab tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:48.769307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bfd718f-0938-41f5-91a6-4217a79d6aab tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:48.783373 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0bfd718f-0938-41f5-91a6-4217a79d6aab tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] HTTP exception thrown: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bfd718f-0938-41f5-91a6-4217a79d6aab tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Request method failure captured: Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e HTTP/1.1 Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaaigp07zvkISHb29u2Quk6NjhbfN1zEDCSkQQoinW0uynW7tNECIjPZRDz_K75qhqu2Icv_5PRsBA8URuVfOgE2knALTSJ-lxCAlMfLfMaApUY2YZNmhuhErGrmBQkx_kPARWtJeBImZcDnJdIllkJtA8jOXs3vwkeuSJPXsJdeNoo Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: dc1b938c06bd432496e8ae8b24965678 Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'd1fdabdb-6353-46ce-9239-bc41ad53212e'} Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:48.785224 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:48.793359 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:15:48.793359 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:48.793359 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:48.793359 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:48.793359 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:48.793359 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:48.793359 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:48.793359 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:48.793359 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:48.793359 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:15:48.793359 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:15:48.793359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bfd718f-0938-41f5-91a6-4217a79d6aab tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Returning 404 to user: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:48.793359 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0bfd718f-0938-41f5-91a6-4217a79d6aab tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 404 len: 111 microversion: 2.1 time: 0.033426 Aug 27 05:15:48.793359 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3381/6713] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:15:48 2022] DELETE /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:48.799655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-225c0df5-5791-4d88-8603-55e34d3bb259 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:48.800268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-225c0df5-5791-4d88-8603-55e34d3bb259 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] [instance: d1fdabdb-6353-46ce-9239-bc41ad53212e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:48.807109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-225c0df5-5791-4d88-8603-55e34d3bb259 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:48.808158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-225c0df5-5791-4d88-8603-55e34d3bb259 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:48.808621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-225c0df5-5791-4d88-8603-55e34d3bb259 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:48.809323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-225c0df5-5791-4d88-8603-55e34d3bb259 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:48.809781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-225c0df5-5791-4d88-8603-55e34d3bb259 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:48.810199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-225c0df5-5791-4d88-8603-55e34d3bb259 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:48.824435 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-225c0df5-5791-4d88-8603-55e34d3bb259 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] HTTP exception thrown: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-225c0df5-5791-4d88-8603-55e34d3bb259 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Request method failure captured: Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e HTTP/1.1 Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaaigp07zvkISHb29u2Quk6NjhbfN1zEDCSkQQoinW0uynW7tNECIjPZRDz_K75qhqu2Icv_5PRsBA8URuVfOgE2knALTSJ-lxCAlMfLfMaApUY2YZNmhuhErGrmBQkx_kPARWtJeBImZcDnJdIllkJtA8jOXs3vwkeuSJPXsJdeNoo Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f65ba45be6a54b4f9aa0edabf60011c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: f65ba45be6a54b4f9aa0edabf60011c9 Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1652272903 Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: dc1b938c06bd432496e8ae8b24965678 Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-AttachVolumeNegativeTest-1652272903-project Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'd1fdabdb-6353-46ce-9239-bc41ad53212e'} Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:48.826012 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:48.830773 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:48.830773 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:48.830773 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:48.830773 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:48.830773 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:48.830773 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. Aug 27 05:15:48.830773 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:48.830773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-225c0df5-5791-4d88-8603-55e34d3bb259 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] Returning 404 to user: Instance d1fdabdb-6353-46ce-9239-bc41ad53212e could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:48.830773 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-225c0df5-5791-4d88-8603-55e34d3bb259 tempest-AttachVolumeNegativeTest-1652272903 tempest-AttachVolumeNegativeTest-1652272903-project] 10.222.0.79 "GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e" status: 404 len: 111 microversion: 2.1 time: 0.031658 Aug 27 05:15:48.830773 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3333/6714] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:48 2022] GET /compute/v2.1/servers/d1fdabdb-6353-46ce-9239-bc41ad53212e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:49.220259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a85ca58f-4fd6-41e7-bf01-c791d3f84b95 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:49.220994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a85ca58f-4fd6-41e7-bf01-c791d3f84b95 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:49.227795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85ca58f-4fd6-41e7-bf01-c791d3f84b95 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:49.228512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85ca58f-4fd6-41e7-bf01-c791d3f84b95 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:49.229275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85ca58f-4fd6-41e7-bf01-c791d3f84b95 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:49.230336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85ca58f-4fd6-41e7-bf01-c791d3f84b95 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:49.230897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85ca58f-4fd6-41e7-bf01-c791d3f84b95 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:49.231337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85ca58f-4fd6-41e7-bf01-c791d3f84b95 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:49.382378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a85ca58f-4fd6-41e7-bf01-c791d3f84b95 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:49.390691 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a85ca58f-4fd6-41e7-bf01-c791d3f84b95 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1308 microversion: 2.1 time: 0.174315 Aug 27 05:15:49.391282 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3382/6715] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:49 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:50.413147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a35769c2-baa8-44b5-90db-2f294f2c0b90 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:50.414434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a35769c2-baa8-44b5-90db-2f294f2c0b90 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:50.421471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a35769c2-baa8-44b5-90db-2f294f2c0b90 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:50.421965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a35769c2-baa8-44b5-90db-2f294f2c0b90 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:50.422411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a35769c2-baa8-44b5-90db-2f294f2c0b90 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:50.423123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a35769c2-baa8-44b5-90db-2f294f2c0b90 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:50.423588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a35769c2-baa8-44b5-90db-2f294f2c0b90 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:50.424021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a35769c2-baa8-44b5-90db-2f294f2c0b90 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:50.669603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a35769c2-baa8-44b5-90db-2f294f2c0b90 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:50.682935 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a35769c2-baa8-44b5-90db-2f294f2c0b90 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1308 microversion: 2.1 time: 0.274078 Aug 27 05:15:50.706024 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3334/6716] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:50 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1308 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:51.714000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec7b1926-9512-4f23-bd9c-1fc2e702d036 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:51.717169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec7b1926-9512-4f23-bd9c-1fc2e702d036 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:51.732258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec7b1926-9512-4f23-bd9c-1fc2e702d036 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:51.734094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec7b1926-9512-4f23-bd9c-1fc2e702d036 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:51.734793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec7b1926-9512-4f23-bd9c-1fc2e702d036 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:51.736092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec7b1926-9512-4f23-bd9c-1fc2e702d036 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:51.736788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec7b1926-9512-4f23-bd9c-1fc2e702d036 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:51.740202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec7b1926-9512-4f23-bd9c-1fc2e702d036 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:51.951231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec7b1926-9512-4f23-bd9c-1fc2e702d036 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:51.960673 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec7b1926-9512-4f23-bd9c-1fc2e702d036 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1308 microversion: 2.1 time: 0.256374 Aug 27 05:15:51.962233 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3383/6717] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:51 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:52.622762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8b1168dc-4cbd-4033-a0cb-c6f8c1ed5d47 req-34dc28a0-0fc0-4080-a039-6731a133bf6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fba5da4-1fe7-4d08-b51b-398d616cac3a", "name": "network-vif-plugged", "status": "completed", "tag": "9e0ba1eb-76b8-45ca-b3b8-b61bc01c5348"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:52.635664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8b1168dc-4cbd-4033-a0cb-c6f8c1ed5d47 req-34dc28a0-0fc0-4080-a039-6731a133bf6f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:52.636437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8b1168dc-4cbd-4033-a0cb-c6f8c1ed5d47 req-34dc28a0-0fc0-4080-a039-6731a133bf6f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:52.636987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8b1168dc-4cbd-4033-a0cb-c6f8c1ed5d47 req-34dc28a0-0fc0-4080-a039-6731a133bf6f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:52.649800 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8b1168dc-4cbd-4033-a0cb-c6f8c1ed5d47 req-34dc28a0-0fc0-4080-a039-6731a133bf6f service nova] Creating event network-vif-plugged:9e0ba1eb-76b8-45ca-b3b8-b61bc01c5348 for instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a on n-h1-854823-1 Aug 27 05:15:52.655339 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8b1168dc-4cbd-4033-a0cb-c6f8c1ed5d47 req-34dc28a0-0fc0-4080-a039-6731a133bf6f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036477 Aug 27 05:15:52.656059 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3335/6718] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:52.983998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12c8c5f4-6d02-4d60-8404-e5fc2b6df41f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:52.984689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12c8c5f4-6d02-4d60-8404-e5fc2b6df41f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:52.991798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12c8c5f4-6d02-4d60-8404-e5fc2b6df41f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:52.992299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12c8c5f4-6d02-4d60-8404-e5fc2b6df41f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:52.992883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12c8c5f4-6d02-4d60-8404-e5fc2b6df41f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:52.993869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12c8c5f4-6d02-4d60-8404-e5fc2b6df41f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:52.994348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12c8c5f4-6d02-4d60-8404-e5fc2b6df41f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:52.994795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12c8c5f4-6d02-4d60-8404-e5fc2b6df41f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:53.130928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-12c8c5f4-6d02-4d60-8404-e5fc2b6df41f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:53.139223 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12c8c5f4-6d02-4d60-8404-e5fc2b6df41f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1308 microversion: 2.1 time: 0.159507 Aug 27 05:15:53.139999 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3384/6719] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:52 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:53.272646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-844f9e48-ed96-4ef5-ba8c-57772ce69720 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Action: 'create', calling method: .version_select at 0x7f1f20a42430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1156789178"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:53.566189 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-844f9e48-ed96-4ef5-ba8c-57772ce69720 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.411610 Aug 27 05:15:53.567205 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3336/6720] 10.222.0.79 () {60 vars in 1155 bytes} [Sat Aug 27 05:15:53 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 413 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 05:15:53.579447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e3abf42-0ae4-407d-9207-553a1f70cfe8 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f20e61d30>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:53.631028 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e3abf42-0ae4-407d-9207-553a1f70cfe8 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a" status: 200 len: 345 microversion: 2.1 time: 0.055174 Aug 27 05:15:53.631631 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3385/6721] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 05:15:53 2022] GET /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:54.160759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3f4a5c30-8d67-48f7-813d-3649fd903ce5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:54.161700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3f4a5c30-8d67-48f7-813d-3649fd903ce5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:54.169303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f4a5c30-8d67-48f7-813d-3649fd903ce5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:54.169884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f4a5c30-8d67-48f7-813d-3649fd903ce5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:54.170388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f4a5c30-8d67-48f7-813d-3649fd903ce5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:54.171306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f4a5c30-8d67-48f7-813d-3649fd903ce5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:54.171841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f4a5c30-8d67-48f7-813d-3649fd903ce5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:54.172339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f4a5c30-8d67-48f7-813d-3649fd903ce5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:54.321294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3f4a5c30-8d67-48f7-813d-3649fd903ce5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:54.330241 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3f4a5c30-8d67-48f7-813d-3649fd903ce5 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1308 microversion: 2.1 time: 0.174889 Aug 27 05:15:54.330955 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3337/6722] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:54 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:54.642646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:54.643426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:54.647386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12282034-d353-440d-9631-0a7f91d69323 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f2050ab80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:54.695317 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12282034-d353-440d-9631-0a7f91d69323 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a" status: 200 len: 346 microversion: 2.1 time: 0.054365 Aug 27 05:15:54.695934 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3386/6723] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 05:15:54 2022] GET /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:54.708784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-23e248f0-df78-4781-893b-3632b19cd841 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Action: 'create', calling method: .version_select at 0x7f1f20858ee0>, body: {"snapshot": {"volume_id": "39f2a13a-0388-4190-830e-d2839d0f702a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-45715958"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:54.718049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:54.859878 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-23e248f0-df78-4781-893b-3632b19cd841 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.155504 Aug 27 05:15:54.864580 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3338/6724] 10.222.0.79 () {60 vars in 1162 bytes} [Sat Aug 27 05:15:54 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:54.871347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23712a4c-d57f-4731-ba45-4d319a0c47ad tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f2117da60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:54.906705 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23712a4c-d57f-4731-ba45-4d319a0c47ad tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6" status: 200 len: 285 microversion: 2.1 time: 0.039360 Aug 27 05:15:54.907371 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3387/6725] 10.222.0.79 () {58 vars in 1251 bytes} [Sat Aug 27 05:15:54 2022] GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6 => generated 285 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:54.918075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-208c4e3c-1ec3-4b61-ade1-b0d0089c32e8 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f208628b0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:54.949848 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-208c4e3c-1ec3-4b61-ade1-b0d0089c32e8 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.035715 Aug 27 05:15:54.950461 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3339/6726] 10.222.0.79 () {58 vars in 1140 bytes} [Sat Aug 27 05:15:54 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:54.962008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5f07749-9772-4d7f-8af2-ed0244f552fe tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f219419d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:54.991153 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5f07749-9772-4d7f-8af2-ed0244f552fe tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6" status: 200 len: 285 microversion: 2.1 time: 0.033640 Aug 27 05:15:54.991732 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3388/6727] 10.222.0.79 () {58 vars in 1251 bytes} [Sat Aug 27 05:15:54 2022] GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:55.354510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-586a3b93-8e79-430c-b967-9123efef6a93 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:55.355377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-586a3b93-8e79-430c-b967-9123efef6a93 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:55.361816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-586a3b93-8e79-430c-b967-9123efef6a93 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:55.362297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-586a3b93-8e79-430c-b967-9123efef6a93 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:55.362733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-586a3b93-8e79-430c-b967-9123efef6a93 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:55.363434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-586a3b93-8e79-430c-b967-9123efef6a93 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:55.363886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-586a3b93-8e79-430c-b967-9123efef6a93 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:55.365192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-586a3b93-8e79-430c-b967-9123efef6a93 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:55.499450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-586a3b93-8e79-430c-b967-9123efef6a93 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:55.508258 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-586a3b93-8e79-430c-b967-9123efef6a93 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1489 microversion: 2.1 time: 0.159362 Aug 27 05:15:55.508984 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3340/6728] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:55 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1489 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:15:55.529389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f53ac7ed-d432-4d4c-a37a-c5f66dc83d32 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-204434446"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:55.531936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f53ac7ed-d432-4d4c-a37a-c5f66dc83d32 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:55.539261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f53ac7ed-d432-4d4c-a37a-c5f66dc83d32 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:55.539769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f53ac7ed-d432-4d4c-a37a-c5f66dc83d32 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:55.540215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f53ac7ed-d432-4d4c-a37a-c5f66dc83d32 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:55.540959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f53ac7ed-d432-4d4c-a37a-c5f66dc83d32 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:55.541424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f53ac7ed-d432-4d4c-a37a-c5f66dc83d32 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:55.541865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f53ac7ed-d432-4d4c-a37a-c5f66dc83d32 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:55.609295 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f53ac7ed-d432-4d4c-a37a-c5f66dc83d32 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "PUT /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1074 microversion: 2.1 time: 0.083650 Aug 27 05:15:55.620552 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3389/6729] 10.222.0.79 () {60 vars in 1256 bytes} [Sat Aug 27 05:15:55 2022] PUT /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1074 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:55.626853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e01db27b-d017-4ef9-a93c-222ab5406e3f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:55.627461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e01db27b-d017-4ef9-a93c-222ab5406e3f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:55.635749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e01db27b-d017-4ef9-a93c-222ab5406e3f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:55.636243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e01db27b-d017-4ef9-a93c-222ab5406e3f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:55.636712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e01db27b-d017-4ef9-a93c-222ab5406e3f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:55.637410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e01db27b-d017-4ef9-a93c-222ab5406e3f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:55.637865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e01db27b-d017-4ef9-a93c-222ab5406e3f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:55.638288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e01db27b-d017-4ef9-a93c-222ab5406e3f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:55.772880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e01db27b-d017-4ef9-a93c-222ab5406e3f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:55.780658 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e01db27b-d017-4ef9-a93c-222ab5406e3f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1500 microversion: 2.1 time: 0.157676 Aug 27 05:15:55.781240 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3341/6730] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:55 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:55.800577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-036b8780-2d2a-49d7-bce7-6649e3076c74 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:55.801291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-036b8780-2d2a-49d7-bce7-6649e3076c74 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:55.808370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036b8780-2d2a-49d7-bce7-6649e3076c74 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:55.808977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036b8780-2d2a-49d7-bce7-6649e3076c74 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:55.809501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036b8780-2d2a-49d7-bce7-6649e3076c74 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:55.810275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036b8780-2d2a-49d7-bce7-6649e3076c74 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:55.810983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036b8780-2d2a-49d7-bce7-6649e3076c74 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:55.811492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036b8780-2d2a-49d7-bce7-6649e3076c74 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:55.944209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-036b8780-2d2a-49d7-bce7-6649e3076c74 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:55.952069 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-036b8780-2d2a-49d7-bce7-6649e3076c74 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1500 microversion: 2.1 time: 0.155528 Aug 27 05:15:55.953282 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3390/6731] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:55 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:55.973511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e900c7fc-fbbc-4b8c-b9a9-6d1037ca2dd1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:15:55.979711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e900c7fc-fbbc-4b8c-b9a9-6d1037ca2dd1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:55.980196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e900c7fc-fbbc-4b8c-b9a9-6d1037ca2dd1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:55.980660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e900c7fc-fbbc-4b8c-b9a9-6d1037ca2dd1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:56.004104 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe6dbb68-8e5d-4ec4-8614-3fbd1b32cfbb tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f21008e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:56.006918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e900c7fc-fbbc-4b8c-b9a9-6d1037ca2dd1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Going to try to stop instance {{(pid=128870) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:15:56.038263 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe6dbb68-8e5d-4ec4-8614-3fbd1b32cfbb tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6" status: 200 len: 285 microversion: 2.1 time: 0.038548 Aug 27 05:15:56.039139 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3391/6732] 10.222.0.79 () {58 vars in 1251 bytes} [Sat Aug 27 05:15:55 2022] GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6 => generated 285 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:15:56.067983 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e900c7fc-fbbc-4b8c-b9a9-6d1037ca2dd1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "POST /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a/action" status: 202 len: 0 microversion: 2.1 time: 0.097697 Aug 27 05:15:56.068929 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3342/6733] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:15:55 2022] POST /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:15:56.083092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3043d138-f424-4344-8753-96d2249d2896 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:56.086141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3043d138-f424-4344-8753-96d2249d2896 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:56.093229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3043d138-f424-4344-8753-96d2249d2896 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:56.093740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3043d138-f424-4344-8753-96d2249d2896 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:56.094327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3043d138-f424-4344-8753-96d2249d2896 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:56.095078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3043d138-f424-4344-8753-96d2249d2896 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:56.095734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3043d138-f424-4344-8753-96d2249d2896 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:56.096175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3043d138-f424-4344-8753-96d2249d2896 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:56.300006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3043d138-f424-4344-8753-96d2249d2896 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:56.308948 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3043d138-f424-4344-8753-96d2249d2896 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.231638 Aug 27 05:15:56.309561 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3392/6734] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:56 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:57.051920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a431e249-d86b-42e8-a907-7a5183c794fe tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f208589d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:57.082553 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a431e249-d86b-42e8-a907-7a5183c794fe tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6" status: 200 len: 286 microversion: 2.1 time: 0.035814 Aug 27 05:15:57.083954 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3343/6735] 10.222.0.79 () {58 vars in 1251 bytes} [Sat Aug 27 05:15:57 2022] GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:57.095107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-308c5947-e8ff-4fff-9ab2-75110b4b3e2f tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f21008ca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:57.155814 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-308c5947-e8ff-4fff-9ab2-75110b4b3e2f tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "DELETE /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6" status: 202 len: 0 microversion: 2.1 time: 0.064506 Aug 27 05:15:57.156686 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3393/6736] 10.222.0.79 () {58 vars in 1254 bytes} [Sat Aug 27 05:15:57 2022] DELETE /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:15:57.165224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cab1a6b5-458b-4174-a500-9d212d36f79d tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f208e0820>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:57.196843 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cab1a6b5-458b-4174-a500-9d212d36f79d tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6" status: 200 len: 285 microversion: 2.1 time: 0.035607 Aug 27 05:15:57.197426 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3344/6737] 10.222.0.79 () {58 vars in 1251 bytes} [Sat Aug 27 05:15:57 2022] GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:15:57.330916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-424364c5-2624-4dfc-9681-01e8d95f63de tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:57.331465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-424364c5-2624-4dfc-9681-01e8d95f63de tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:57.339519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424364c5-2624-4dfc-9681-01e8d95f63de tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:57.340083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424364c5-2624-4dfc-9681-01e8d95f63de tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:57.340573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424364c5-2624-4dfc-9681-01e8d95f63de tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:57.341299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424364c5-2624-4dfc-9681-01e8d95f63de tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:57.341772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424364c5-2624-4dfc-9681-01e8d95f63de tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:57.342214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-424364c5-2624-4dfc-9681-01e8d95f63de tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:57.357387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:57.478152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-424364c5-2624-4dfc-9681-01e8d95f63de tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:57.486534 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-424364c5-2624-4dfc-9681-01e8d95f63de tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.159637 Aug 27 05:15:57.487223 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3394/6738] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:57 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:58.212779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ffc21495-a857-4693-bbc4-ff66c48943c1 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f208e0e50>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:58.243017 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ffc21495-a857-4693-bbc4-ff66c48943c1 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6" status: 200 len: 285 microversion: 2.1 time: 0.036506 Aug 27 05:15:58.243794 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3345/6739] 10.222.0.79 () {58 vars in 1251 bytes} [Sat Aug 27 05:15:58 2022] GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6 => generated 285 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:58.509235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82729633-7110-468f-bba7-fa608e68b0ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:58.509888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-82729633-7110-468f-bba7-fa608e68b0ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:58.518235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82729633-7110-468f-bba7-fa608e68b0ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:58.518684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82729633-7110-468f-bba7-fa608e68b0ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:58.519141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82729633-7110-468f-bba7-fa608e68b0ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:58.519876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82729633-7110-468f-bba7-fa608e68b0ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:58.520353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82729633-7110-468f-bba7-fa608e68b0ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:58.521320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82729633-7110-468f-bba7-fa608e68b0ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:58.655837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-82729633-7110-468f-bba7-fa608e68b0ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:58.663619 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-82729633-7110-468f-bba7-fa608e68b0ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.158762 Aug 27 05:15:58.664186 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3395/6740] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:58 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:15:59.257573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d678c50f-13a7-4dda-a081-e21a72ea732f tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f208621f0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:59.282331 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-d678c50f-13a7-4dda-a081-e21a72ea732f tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] HTTP exception thrown: Snapshot 85b860f5-2560-4908-bb01-8f7155fbc2a6 could not be found. Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d678c50f-13a7-4dda-a081-e21a72ea732f tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Request method failure captured: Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6 HTTP/1.1 Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaiJ5nV0Vznyk_bnlZQWl4QtbuLkMGmMt6alRLvHLDjSfwPcfFwlOQIBMy6U7Vh7g-5YkfiSj6sZ0ZoZo6bks-BdQyt_kDUcwYWWtzfAuXpFI0llshYPrm_IUrzRbiJklmg8J-Q5XBPQKQurLC3uHk_ZqggyGaVdPkR06G7EC1m1Btk Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 7d3bc15a7cf94d63922fd6ca27d9a05c Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1648849487 Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1648849487 Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 7d3bc15a7cf94d63922fd6ca27d9a05c Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1648849487 Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-VolumesSnapshotsTestJSON-1648849487-project Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: e6c3d7035ce74552b2ee0fff450fbaf3 Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1648849487-project Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: exception: Snapshot 85b860f5-2560-4908-bb01-8f7155fbc2a6 could not be found. Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '85b860f5-2560-4908-bb01-8f7155fbc2a6'} Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 85b860f5-2560-4908-bb01-8f7155fbc2a6 could not be found. (HTTP 404) (Request-ID: req-3471dc32-0976-42ca-86d7-83b37df27cad) Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 05:15:59.293564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 85b860f5-2560-4908-bb01-8f7155fbc2a6 could not be found. Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 85b860f5-2560-4908-bb01-8f7155fbc2a6 could not be found. Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 85b860f5-2560-4908-bb01-8f7155fbc2a6 could not be found. Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d678c50f-13a7-4dda-a081-e21a72ea732f tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Returning 404 to user: Snapshot 85b860f5-2560-4908-bb01-8f7155fbc2a6 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d678c50f-13a7-4dda-a081-e21a72ea732f tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6" status: 404 len: 111 microversion: 2.1 time: 0.043077 Aug 27 05:15:59.298275 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3346/6741] 10.222.0.79 () {58 vars in 1251 bytes} [Sat Aug 27 05:15:59 2022] GET /compute/v2.1/os-snapshots/85b860f5-2560-4908-bb01-8f7155fbc2a6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:59.304352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5495325e-420a-45fa-856c-5a59daee9efa tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f204c5670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:59.367073 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5495325e-420a-45fa-856c-5a59daee9efa tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a" status: 202 len: 0 microversion: 2.1 time: 0.066615 Aug 27 05:15:59.367964 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3396/6742] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 05:15:59 2022] DELETE /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:15:59.376167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4f45c2cc-51e3-4e3f-8d47-25339bca9cad tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f214d5f70>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:59.424441 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4f45c2cc-51e3-4e3f-8d47-25339bca9cad tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a" status: 200 len: 345 microversion: 2.1 time: 0.052770 Aug 27 05:15:59.425129 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3347/6743] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 05:15:59 2022] GET /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:15:59.685772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1f8d71d-9e63-4c94-9feb-4a1482a92bcc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:15:59.686316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1f8d71d-9e63-4c94-9feb-4a1482a92bcc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:15:59.693586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1f8d71d-9e63-4c94-9feb-4a1482a92bcc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:59.694092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1f8d71d-9e63-4c94-9feb-4a1482a92bcc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:59.694550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1f8d71d-9e63-4c94-9feb-4a1482a92bcc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:59.695268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1f8d71d-9e63-4c94-9feb-4a1482a92bcc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:15:59.695793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1f8d71d-9e63-4c94-9feb-4a1482a92bcc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:15:59.696194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1f8d71d-9e63-4c94-9feb-4a1482a92bcc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:15:59.830521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1f8d71d-9e63-4c94-9feb-4a1482a92bcc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:15:59.838566 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1f8d71d-9e63-4c94-9feb-4a1482a92bcc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.157750 Aug 27 05:15:59.839155 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3397/6744] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:15:59 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:00.440216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a79cfb35-bbcd-4bb3-b132-28c86686d38b tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f208e0820>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:00.489867 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a79cfb35-bbcd-4bb3-b132-28c86686d38b tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a" status: 200 len: 345 microversion: 2.1 time: 0.053901 Aug 27 05:16:00.490448 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3348/6745] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 05:16:00 2022] GET /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:16:00.859658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f03c7611-256d-406a-addd-e10c4747fec8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:00.860211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f03c7611-256d-406a-addd-e10c4747fec8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:00.867879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f03c7611-256d-406a-addd-e10c4747fec8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:00.868426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f03c7611-256d-406a-addd-e10c4747fec8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:00.868910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f03c7611-256d-406a-addd-e10c4747fec8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:00.869623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f03c7611-256d-406a-addd-e10c4747fec8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:00.870098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f03c7611-256d-406a-addd-e10c4747fec8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:00.870543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f03c7611-256d-406a-addd-e10c4747fec8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:01.004025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f03c7611-256d-406a-addd-e10c4747fec8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:01.012657 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f03c7611-256d-406a-addd-e10c4747fec8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.157078 Aug 27 05:16:01.013249 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3398/6746] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:00 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:16:01.504114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-503b0736-e254-4c51-9b13-fd6cc4bd3ab9 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f20a425e0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:01.536855 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-503b0736-e254-4c51-9b13-fd6cc4bd3ab9 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] HTTP exception thrown: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-503b0736-e254-4c51-9b13-fd6cc4bd3ab9 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Request method failure captured: Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a HTTP/1.1 Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaiJ5nV0Vznyk_bnlZQWl4QtbuLkMGmMt6alRLvHLDjSfwPcfFwlOQIBMy6U7Vh7g-5YkfiSj6sZ0ZoZo6bks-BdQyt_kDUcwYWWtzfAuXpFI0llshYPrm_IUrzRbiJklmg8J-Q5XBPQKQurLC3uHk_ZqggyGaVdPkR06G7EC1m1Btk Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 7d3bc15a7cf94d63922fd6ca27d9a05c Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1648849487 Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1648849487 Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 7d3bc15a7cf94d63922fd6ca27d9a05c Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1648849487 Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-VolumesSnapshotsTestJSON-1648849487-project Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: e6c3d7035ce74552b2ee0fff450fbaf3 Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1648849487-project Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: exception: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '39f2a13a-0388-4190-830e-d2839d0f702a'} Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. (HTTP 404) (Request-ID: req-ab128d00-2f34-458d-8c0b-15205645c10e) Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 05:16:01.538829 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-503b0736-e254-4c51-9b13-fd6cc4bd3ab9 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Returning 404 to user: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-503b0736-e254-4c51-9b13-fd6cc4bd3ab9 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a" status: 404 len: 109 microversion: 2.1 time: 0.041109 Aug 27 05:16:01.543373 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3349/6747] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 05:16:01 2022] GET /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:01.552313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcd4f8f1-3060-4b05-9b60-f5726ca016a6 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f2199c430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:01.581690 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-fcd4f8f1-3060-4b05-9b60-f5726ca016a6 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] HTTP exception thrown: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcd4f8f1-3060-4b05-9b60-f5726ca016a6 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Request method failure captured: Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a HTTP/1.1 Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaiJ5nV0Vznyk_bnlZQWl4QtbuLkMGmMt6alRLvHLDjSfwPcfFwlOQIBMy6U7Vh7g-5YkfiSj6sZ0ZoZo6bks-BdQyt_kDUcwYWWtzfAuXpFI0llshYPrm_IUrzRbiJklmg8J-Q5XBPQKQurLC3uHk_ZqggyGaVdPkR06G7EC1m1Btk Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 7d3bc15a7cf94d63922fd6ca27d9a05c Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1648849487 Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1648849487 Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 7d3bc15a7cf94d63922fd6ca27d9a05c Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1648849487 Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-VolumesSnapshotsTestJSON-1648849487-project Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: e6c3d7035ce74552b2ee0fff450fbaf3 Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1648849487-project Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: method: Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: exception: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '39f2a13a-0388-4190-830e-d2839d0f702a'} Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. (HTTP 404) (Request-ID: req-cd01a417-294d-4bfc-83e7-2170d2bc4fa3) Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 05:16:01.583765 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcd4f8f1-3060-4b05-9b60-f5726ca016a6 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Returning 404 to user: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fcd4f8f1-3060-4b05-9b60-f5726ca016a6 tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a" status: 404 len: 109 microversion: 2.1 time: 0.037482 Aug 27 05:16:01.588953 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3399/6748] 10.222.0.79 () {58 vars in 1248 bytes} [Sat Aug 27 05:16:01 2022] DELETE /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:01.594093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-52fb74af-3718-47ec-a740-5330a54045df tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Calling method '.version_select at 0x7f1f208e0f70>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:01.623439 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-52fb74af-3718-47ec-a740-5330a54045df tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] HTTP exception thrown: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-52fb74af-3718-47ec-a740-5330a54045df tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Request method failure captured: Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a HTTP/1.1 Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaiJ5nV0Vznyk_bnlZQWl4QtbuLkMGmMt6alRLvHLDjSfwPcfFwlOQIBMy6U7Vh7g-5YkfiSj6sZ0ZoZo6bks-BdQyt_kDUcwYWWtzfAuXpFI0llshYPrm_IUrzRbiJklmg8J-Q5XBPQKQurLC3uHk_ZqggyGaVdPkR06G7EC1m1Btk Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 7d3bc15a7cf94d63922fd6ca27d9a05c Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1648849487 Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7d3bc15a7cf94d63922fd6ca27d9a05c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1648849487 Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 7d3bc15a7cf94d63922fd6ca27d9a05c Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1648849487 Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-VolumesSnapshotsTestJSON-1648849487-project Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: e6c3d7035ce74552b2ee0fff450fbaf3 Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1648849487-project Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: method: Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: exception: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '39f2a13a-0388-4190-830e-d2839d0f702a'} Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. (HTTP 404) (Request-ID: req-d546eeea-0f0b-4376-a3df-565ad57b0a8e) Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 05:16:01.625462 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-52fb74af-3718-47ec-a740-5330a54045df tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] Returning 404 to user: Volume 39f2a13a-0388-4190-830e-d2839d0f702a could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-52fb74af-3718-47ec-a740-5330a54045df tempest-VolumesSnapshotsTestJSON-1648849487 tempest-VolumesSnapshotsTestJSON-1648849487-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a" status: 404 len: 109 microversion: 2.1 time: 0.036736 Aug 27 05:16:01.633646 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3350/6749] 10.222.0.79 () {58 vars in 1245 bytes} [Sat Aug 27 05:16:01 2022] GET /compute/v2.1/os-volumes/39f2a13a-0388-4190-830e-d2839d0f702a => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:02.037486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86b391e4-9e47-4232-bafa-2ee054b3f08a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:02.039485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86b391e4-9e47-4232-bafa-2ee054b3f08a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:02.051355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b391e4-9e47-4232-bafa-2ee054b3f08a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:02.052713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b391e4-9e47-4232-bafa-2ee054b3f08a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:02.053598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b391e4-9e47-4232-bafa-2ee054b3f08a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:02.054884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b391e4-9e47-4232-bafa-2ee054b3f08a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:02.055824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b391e4-9e47-4232-bafa-2ee054b3f08a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:02.056910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b391e4-9e47-4232-bafa-2ee054b3f08a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:02.267458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86b391e4-9e47-4232-bafa-2ee054b3f08a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:02.278105 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86b391e4-9e47-4232-bafa-2ee054b3f08a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.246825 Aug 27 05:16:02.279848 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3400/6750] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:02 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:03.307375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-befd3f2f-fde0-479a-832c-5f16ba2dedfd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:03.308413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-befd3f2f-fde0-479a-832c-5f16ba2dedfd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:03.314347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-befd3f2f-fde0-479a-832c-5f16ba2dedfd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:03.314832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-befd3f2f-fde0-479a-832c-5f16ba2dedfd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:03.315274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-befd3f2f-fde0-479a-832c-5f16ba2dedfd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:03.315985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-befd3f2f-fde0-479a-832c-5f16ba2dedfd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:03.316444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-befd3f2f-fde0-479a-832c-5f16ba2dedfd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:03.316904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-befd3f2f-fde0-479a-832c-5f16ba2dedfd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:03.777399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-befd3f2f-fde0-479a-832c-5f16ba2dedfd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:03.779976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:03.787126 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-befd3f2f-fde0-479a-832c-5f16ba2dedfd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.485950 Aug 27 05:16:03.787819 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3351/6751] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:03 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:04.809000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac68d12a-a5d6-4e64-9726-f55a137550d8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:04.809627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac68d12a-a5d6-4e64-9726-f55a137550d8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:04.816337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac68d12a-a5d6-4e64-9726-f55a137550d8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:04.816871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac68d12a-a5d6-4e64-9726-f55a137550d8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:04.817319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac68d12a-a5d6-4e64-9726-f55a137550d8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:04.818080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac68d12a-a5d6-4e64-9726-f55a137550d8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:04.818547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac68d12a-a5d6-4e64-9726-f55a137550d8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:04.818982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac68d12a-a5d6-4e64-9726-f55a137550d8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:05.004995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac68d12a-a5d6-4e64-9726-f55a137550d8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:05.013161 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac68d12a-a5d6-4e64-9726-f55a137550d8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.208237 Aug 27 05:16:05.013758 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3401/6752] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:04 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:06.035806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-38f69357-d17d-4aac-ba9f-f6a5de76316c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:06.036420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-38f69357-d17d-4aac-ba9f-f6a5de76316c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:06.044145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38f69357-d17d-4aac-ba9f-f6a5de76316c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:06.044673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38f69357-d17d-4aac-ba9f-f6a5de76316c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:06.045116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38f69357-d17d-4aac-ba9f-f6a5de76316c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:06.045818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38f69357-d17d-4aac-ba9f-f6a5de76316c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:06.046278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38f69357-d17d-4aac-ba9f-f6a5de76316c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:06.046708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-38f69357-d17d-4aac-ba9f-f6a5de76316c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:06.195680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-38f69357-d17d-4aac-ba9f-f6a5de76316c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:06.204543 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-38f69357-d17d-4aac-ba9f-f6a5de76316c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.173064 Aug 27 05:16:06.205487 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3352/6753] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:06 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:07.226674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0070319d-3caa-4368-88f3-300546c434b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:07.227532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0070319d-3caa-4368-88f3-300546c434b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:07.230410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:07.235760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0070319d-3caa-4368-88f3-300546c434b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:07.236341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0070319d-3caa-4368-88f3-300546c434b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:07.236814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0070319d-3caa-4368-88f3-300546c434b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:07.237530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0070319d-3caa-4368-88f3-300546c434b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:07.237995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0070319d-3caa-4368-88f3-300546c434b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:07.238434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0070319d-3caa-4368-88f3-300546c434b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:07.426742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0070319d-3caa-4368-88f3-300546c434b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:07.435630 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0070319d-3caa-4368-88f3-300546c434b3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.212797 Aug 27 05:16:07.436218 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3402/6754] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:07 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:08.456786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-79d19f84-ee95-4c98-857e-4e3527a3c8bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:08.457402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-79d19f84-ee95-4c98-857e-4e3527a3c8bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:08.465249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79d19f84-ee95-4c98-857e-4e3527a3c8bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:08.465733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79d19f84-ee95-4c98-857e-4e3527a3c8bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:08.466170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79d19f84-ee95-4c98-857e-4e3527a3c8bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:08.466866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79d19f84-ee95-4c98-857e-4e3527a3c8bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:08.467317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79d19f84-ee95-4c98-857e-4e3527a3c8bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:08.467744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79d19f84-ee95-4c98-857e-4e3527a3c8bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:08.614508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-79d19f84-ee95-4c98-857e-4e3527a3c8bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:08.623000 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-79d19f84-ee95-4c98-857e-4e3527a3c8bb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.170035 Aug 27 05:16:08.623620 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3353/6755] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:08 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:09.645167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b534af1d-5981-4bbd-8c20-bcf6e4ca8a50 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:09.646373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b534af1d-5981-4bbd-8c20-bcf6e4ca8a50 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:09.653615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b534af1d-5981-4bbd-8c20-bcf6e4ca8a50 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:09.654203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b534af1d-5981-4bbd-8c20-bcf6e4ca8a50 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:09.654712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b534af1d-5981-4bbd-8c20-bcf6e4ca8a50 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:09.655522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b534af1d-5981-4bbd-8c20-bcf6e4ca8a50 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:09.656004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b534af1d-5981-4bbd-8c20-bcf6e4ca8a50 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:09.656448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b534af1d-5981-4bbd-8c20-bcf6e4ca8a50 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:09.798604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b534af1d-5981-4bbd-8c20-bcf6e4ca8a50 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:09.806813 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b534af1d-5981-4bbd-8c20-bcf6e4ca8a50 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.165646 Aug 27 05:16:09.807542 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3403/6756] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:09 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:10.827517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b5e293c0-6dc5-4099-ba6b-e6fe4ca10afd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:10.828135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b5e293c0-6dc5-4099-ba6b-e6fe4ca10afd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:10.835310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5e293c0-6dc5-4099-ba6b-e6fe4ca10afd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:10.835790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5e293c0-6dc5-4099-ba6b-e6fe4ca10afd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:10.836222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5e293c0-6dc5-4099-ba6b-e6fe4ca10afd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:10.836955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5e293c0-6dc5-4099-ba6b-e6fe4ca10afd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:10.837402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5e293c0-6dc5-4099-ba6b-e6fe4ca10afd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:10.837826 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5e293c0-6dc5-4099-ba6b-e6fe4ca10afd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:10.976131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b5e293c0-6dc5-4099-ba6b-e6fe4ca10afd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:10.984489 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b5e293c0-6dc5-4099-ba6b-e6fe4ca10afd tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.161256 Aug 27 05:16:10.985106 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3354/6757] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:10 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:12.006723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e7390d5f-1b8a-453d-8c5b-438334f11ed8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:12.007437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e7390d5f-1b8a-453d-8c5b-438334f11ed8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:12.014911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7390d5f-1b8a-453d-8c5b-438334f11ed8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:12.015500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7390d5f-1b8a-453d-8c5b-438334f11ed8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:12.016021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7390d5f-1b8a-453d-8c5b-438334f11ed8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:12.016838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7390d5f-1b8a-453d-8c5b-438334f11ed8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:12.017396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7390d5f-1b8a-453d-8c5b-438334f11ed8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:12.017924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7390d5f-1b8a-453d-8c5b-438334f11ed8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:12.155467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e7390d5f-1b8a-453d-8c5b-438334f11ed8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:12.166747 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e7390d5f-1b8a-453d-8c5b-438334f11ed8 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.164952 Aug 27 05:16:12.167613 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3404/6758] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:12 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:13.190094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7a4703c1-5f4f-41e9-ac68-220fe49d70bc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:13.190695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7a4703c1-5f4f-41e9-ac68-220fe49d70bc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:13.197968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a4703c1-5f4f-41e9-ac68-220fe49d70bc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:13.198354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a4703c1-5f4f-41e9-ac68-220fe49d70bc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:13.198798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a4703c1-5f4f-41e9-ac68-220fe49d70bc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:13.199502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a4703c1-5f4f-41e9-ac68-220fe49d70bc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:13.199961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a4703c1-5f4f-41e9-ac68-220fe49d70bc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:13.200389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a4703c1-5f4f-41e9-ac68-220fe49d70bc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:13.337947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7a4703c1-5f4f-41e9-ac68-220fe49d70bc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:13.346643 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7a4703c1-5f4f-41e9-ac68-220fe49d70bc tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.160608 Aug 27 05:16:13.347235 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3355/6759] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:13 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:14.370040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0733db02-fd82-4c19-930b-951a96f42ac1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:14.370772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0733db02-fd82-4c19-930b-951a96f42ac1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:14.378469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0733db02-fd82-4c19-930b-951a96f42ac1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:14.378998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0733db02-fd82-4c19-930b-951a96f42ac1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:14.379454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0733db02-fd82-4c19-930b-951a96f42ac1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:14.380700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0733db02-fd82-4c19-930b-951a96f42ac1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:14.381168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0733db02-fd82-4c19-930b-951a96f42ac1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:14.381905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0733db02-fd82-4c19-930b-951a96f42ac1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:14.519612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0733db02-fd82-4c19-930b-951a96f42ac1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:14.529138 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0733db02-fd82-4c19-930b-951a96f42ac1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.163081 Aug 27 05:16:14.529725 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3405/6760] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:14 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:15.550447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dc3264e3-dd40-4e66-a953-2831b5fcf846 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:15.551137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dc3264e3-dd40-4e66-a953-2831b5fcf846 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:15.559050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc3264e3-dd40-4e66-a953-2831b5fcf846 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:15.559537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc3264e3-dd40-4e66-a953-2831b5fcf846 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:15.559974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc3264e3-dd40-4e66-a953-2831b5fcf846 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:15.560712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc3264e3-dd40-4e66-a953-2831b5fcf846 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:15.561168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc3264e3-dd40-4e66-a953-2831b5fcf846 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:15.561587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dc3264e3-dd40-4e66-a953-2831b5fcf846 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:15.699647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dc3264e3-dd40-4e66-a953-2831b5fcf846 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:15.707526 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dc3264e3-dd40-4e66-a953-2831b5fcf846 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.161107 Aug 27 05:16:15.708102 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3356/6761] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:15 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:16.729371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cdc38359-ed8a-4b59-be31-686b59272a7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:16.730009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cdc38359-ed8a-4b59-be31-686b59272a7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:16.738303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdc38359-ed8a-4b59-be31-686b59272a7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:16.738820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdc38359-ed8a-4b59-be31-686b59272a7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:16.739296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdc38359-ed8a-4b59-be31-686b59272a7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:16.740591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdc38359-ed8a-4b59-be31-686b59272a7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:16.741063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdc38359-ed8a-4b59-be31-686b59272a7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:16.741498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cdc38359-ed8a-4b59-be31-686b59272a7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:16.899168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cdc38359-ed8a-4b59-be31-686b59272a7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:16.908108 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cdc38359-ed8a-4b59-be31-686b59272a7a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.182664 Aug 27 05:16:16.908964 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3406/6762] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:16 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:17.930696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-88346d63-48ef-4ffa-bc49-1683d0fc77fb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:17.931870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-88346d63-48ef-4ffa-bc49-1683d0fc77fb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:17.934944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=30 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:17.940552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88346d63-48ef-4ffa-bc49-1683d0fc77fb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:17.941044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88346d63-48ef-4ffa-bc49-1683d0fc77fb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:17.941489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88346d63-48ef-4ffa-bc49-1683d0fc77fb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:17.942189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88346d63-48ef-4ffa-bc49-1683d0fc77fb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:17.942653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88346d63-48ef-4ffa-bc49-1683d0fc77fb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:17.943082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88346d63-48ef-4ffa-bc49-1683d0fc77fb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:18.077013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-88346d63-48ef-4ffa-bc49-1683d0fc77fb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:18.085234 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-88346d63-48ef-4ffa-bc49-1683d0fc77fb tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.159017 Aug 27 05:16:18.085811 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3357/6763] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:17 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:19.109794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5be80e88-b5b5-4a2b-bf05-20c5ecc290ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:19.110454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5be80e88-b5b5-4a2b-bf05-20c5ecc290ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:19.117150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5be80e88-b5b5-4a2b-bf05-20c5ecc290ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:19.117658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5be80e88-b5b5-4a2b-bf05-20c5ecc290ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:19.118303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5be80e88-b5b5-4a2b-bf05-20c5ecc290ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:19.119027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5be80e88-b5b5-4a2b-bf05-20c5ecc290ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:19.119522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5be80e88-b5b5-4a2b-bf05-20c5ecc290ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:19.119950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5be80e88-b5b5-4a2b-bf05-20c5ecc290ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:19.256323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5be80e88-b5b5-4a2b-bf05-20c5ecc290ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:19.264756 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5be80e88-b5b5-4a2b-bf05-20c5ecc290ac tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.160019 Aug 27 05:16:19.265332 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3407/6764] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:19 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:20.285705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-94ea3da7-3fa9-4f32-9dbd-5c2134076576 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:20.286461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-94ea3da7-3fa9-4f32-9dbd-5c2134076576 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:20.293347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94ea3da7-3fa9-4f32-9dbd-5c2134076576 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:20.293842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94ea3da7-3fa9-4f32-9dbd-5c2134076576 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:20.294276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94ea3da7-3fa9-4f32-9dbd-5c2134076576 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:20.294983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94ea3da7-3fa9-4f32-9dbd-5c2134076576 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:20.295534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94ea3da7-3fa9-4f32-9dbd-5c2134076576 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:20.295926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-94ea3da7-3fa9-4f32-9dbd-5c2134076576 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:20.491493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-94ea3da7-3fa9-4f32-9dbd-5c2134076576 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:20.499577 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-94ea3da7-3fa9-4f32-9dbd-5c2134076576 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.217655 Aug 27 05:16:20.505340 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3358/6765] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:20 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:21.521970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-560ab013-6808-441a-98e4-1b0bc3ca497c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:21.522588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-560ab013-6808-441a-98e4-1b0bc3ca497c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:21.529437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-560ab013-6808-441a-98e4-1b0bc3ca497c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:21.529933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-560ab013-6808-441a-98e4-1b0bc3ca497c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:21.530382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-560ab013-6808-441a-98e4-1b0bc3ca497c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:21.531088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-560ab013-6808-441a-98e4-1b0bc3ca497c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:21.531551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-560ab013-6808-441a-98e4-1b0bc3ca497c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:21.531997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-560ab013-6808-441a-98e4-1b0bc3ca497c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:21.674077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-560ab013-6808-441a-98e4-1b0bc3ca497c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:21.684732 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-560ab013-6808-441a-98e4-1b0bc3ca497c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.166941 Aug 27 05:16:21.685599 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3408/6766] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:21 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:22.706392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-78d603c1-ce56-4e14-9ceb-586b8569e771 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:22.706920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-78d603c1-ce56-4e14-9ceb-586b8569e771 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:22.714247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78d603c1-ce56-4e14-9ceb-586b8569e771 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:22.714775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78d603c1-ce56-4e14-9ceb-586b8569e771 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:22.715216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78d603c1-ce56-4e14-9ceb-586b8569e771 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:22.716102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78d603c1-ce56-4e14-9ceb-586b8569e771 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:22.716596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78d603c1-ce56-4e14-9ceb-586b8569e771 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:22.717031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78d603c1-ce56-4e14-9ceb-586b8569e771 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:22.862765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-78d603c1-ce56-4e14-9ceb-586b8569e771 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:22.872352 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-78d603c1-ce56-4e14-9ceb-586b8569e771 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.170001 Aug 27 05:16:22.872962 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3359/6767] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:22 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:23.894721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c39b9b03-4083-4065-ae40-de09a552620a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:23.895616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c39b9b03-4083-4065-ae40-de09a552620a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:23.903887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c39b9b03-4083-4065-ae40-de09a552620a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:23.904372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c39b9b03-4083-4065-ae40-de09a552620a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:23.904848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c39b9b03-4083-4065-ae40-de09a552620a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:23.905619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c39b9b03-4083-4065-ae40-de09a552620a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:23.906089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c39b9b03-4083-4065-ae40-de09a552620a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:23.906526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c39b9b03-4083-4065-ae40-de09a552620a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:24.053155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c39b9b03-4083-4065-ae40-de09a552620a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:24.070288 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c39b9b03-4083-4065-ae40-de09a552620a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.179394 Aug 27 05:16:24.071145 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3409/6768] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:23 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:25.092254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9991dadb-c4fc-4d89-9300-4643761fb817 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:25.093777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9991dadb-c4fc-4d89-9300-4643761fb817 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:25.101761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9991dadb-c4fc-4d89-9300-4643761fb817 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:25.102966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9991dadb-c4fc-4d89-9300-4643761fb817 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:25.103206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9991dadb-c4fc-4d89-9300-4643761fb817 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:25.104025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9991dadb-c4fc-4d89-9300-4643761fb817 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:25.104910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9991dadb-c4fc-4d89-9300-4643761fb817 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:25.105589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9991dadb-c4fc-4d89-9300-4643761fb817 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:25.260912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9991dadb-c4fc-4d89-9300-4643761fb817 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:25.275260 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9991dadb-c4fc-4d89-9300-4643761fb817 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.186579 Aug 27 05:16:25.276115 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3360/6769] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:25 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:26.298574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-041c873c-466d-4b19-80e0-1f945d95d6d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:26.299398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-041c873c-466d-4b19-80e0-1f945d95d6d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:26.307326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-041c873c-466d-4b19-80e0-1f945d95d6d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:26.307835 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-041c873c-466d-4b19-80e0-1f945d95d6d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:26.308282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-041c873c-466d-4b19-80e0-1f945d95d6d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:26.309036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-041c873c-466d-4b19-80e0-1f945d95d6d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:26.309535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-041c873c-466d-4b19-80e0-1f945d95d6d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:26.309969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-041c873c-466d-4b19-80e0-1f945d95d6d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:26.589971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-041c873c-466d-4b19-80e0-1f945d95d6d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:26.598219 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-041c873c-466d-4b19-80e0-1f945d95d6d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1510 microversion: 2.1 time: 0.304621 Aug 27 05:16:26.599532 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3410/6770] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:26 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1510 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:27.622655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2428e329-f314-4c3f-8f04-d84653f44ae3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:27.623360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2428e329-f314-4c3f-8f04-d84653f44ae3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:27.631137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2428e329-f314-4c3f-8f04-d84653f44ae3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:27.631710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2428e329-f314-4c3f-8f04-d84653f44ae3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:27.632664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2428e329-f314-4c3f-8f04-d84653f44ae3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:27.633542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2428e329-f314-4c3f-8f04-d84653f44ae3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:27.634236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2428e329-f314-4c3f-8f04-d84653f44ae3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:27.638893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2428e329-f314-4c3f-8f04-d84653f44ae3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:27.788025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2428e329-f314-4c3f-8f04-d84653f44ae3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:27.797019 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2428e329-f314-4c3f-8f04-d84653f44ae3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1487 microversion: 2.1 time: 0.179400 Aug 27 05:16:27.797618 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3361/6771] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:27 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1487 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:27.821618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4fb4d7b4-e16c-4608-b749-a09dff01b4d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1779011334"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:27.824236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4fb4d7b4-e16c-4608-b749-a09dff01b4d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:27.831429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fb4d7b4-e16c-4608-b749-a09dff01b4d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:27.831931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fb4d7b4-e16c-4608-b749-a09dff01b4d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:27.832628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fb4d7b4-e16c-4608-b749-a09dff01b4d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:27.833563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fb4d7b4-e16c-4608-b749-a09dff01b4d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:27.834038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fb4d7b4-e16c-4608-b749-a09dff01b4d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:27.834485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fb4d7b4-e16c-4608-b749-a09dff01b4d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:27.855894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=88 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:27.921425 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4fb4d7b4-e16c-4608-b749-a09dff01b4d7 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "PUT /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1061 microversion: 2.1 time: 0.103797 Aug 27 05:16:27.934427 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3411/6772] 10.222.0.79 () {60 vars in 1256 bytes} [Sat Aug 27 05:16:27 2022] PUT /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1061 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:27.940260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d67e917-6047-409a-ad9d-cf780b78f432 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:27.940907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9d67e917-6047-409a-ad9d-cf780b78f432 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:27.947980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d67e917-6047-409a-ad9d-cf780b78f432 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:27.948485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d67e917-6047-409a-ad9d-cf780b78f432 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:27.949108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d67e917-6047-409a-ad9d-cf780b78f432 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:27.949824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d67e917-6047-409a-ad9d-cf780b78f432 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:27.950284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d67e917-6047-409a-ad9d-cf780b78f432 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:27.950718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d67e917-6047-409a-ad9d-cf780b78f432 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:28.097085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9d67e917-6047-409a-ad9d-cf780b78f432 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:28.098927 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9d67e917-6047-409a-ad9d-cf780b78f432 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1488 microversion: 2.1 time: 0.163016 Aug 27 05:16:28.100237 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3362/6773] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:27 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1488 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:28.121261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce18b1ad-9c4a-4dda-9af6-7fecab37de0b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:28.121818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce18b1ad-9c4a-4dda-9af6-7fecab37de0b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:28.128608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce18b1ad-9c4a-4dda-9af6-7fecab37de0b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:28.129085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce18b1ad-9c4a-4dda-9af6-7fecab37de0b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:28.129538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce18b1ad-9c4a-4dda-9af6-7fecab37de0b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:28.130256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce18b1ad-9c4a-4dda-9af6-7fecab37de0b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:28.130761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce18b1ad-9c4a-4dda-9af6-7fecab37de0b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:28.131371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce18b1ad-9c4a-4dda-9af6-7fecab37de0b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:28.273609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce18b1ad-9c4a-4dda-9af6-7fecab37de0b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:28.281485 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce18b1ad-9c4a-4dda-9af6-7fecab37de0b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1488 microversion: 2.1 time: 0.164199 Aug 27 05:16:28.282497 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3412/6774] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:28 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1488 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:28.302207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-26cb90ab-6309-4a35-addc-2f7b15a8573b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:28.302771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-26cb90ab-6309-4a35-addc-2f7b15a8573b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:28.309238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26cb90ab-6309-4a35-addc-2f7b15a8573b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:28.309779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26cb90ab-6309-4a35-addc-2f7b15a8573b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:28.310218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26cb90ab-6309-4a35-addc-2f7b15a8573b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:28.310917 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26cb90ab-6309-4a35-addc-2f7b15a8573b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:28.311746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26cb90ab-6309-4a35-addc-2f7b15a8573b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:28.311873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26cb90ab-6309-4a35-addc-2f7b15a8573b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:28.339472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-26cb90ab-6309-4a35-addc-2f7b15a8573b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:16:28.428946 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-26cb90ab-6309-4a35-addc-2f7b15a8573b tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 204 len: 0 microversion: 2.1 time: 0.130184 Aug 27 05:16:28.429558 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3363/6775] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:16:28 2022] DELETE /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:16:28.437868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b54d21af-fb97-4fe4-84aa-5d5ac0f5c16c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:28.438505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b54d21af-fb97-4fe4-84aa-5d5ac0f5c16c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:28.445674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54d21af-fb97-4fe4-84aa-5d5ac0f5c16c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:28.446179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54d21af-fb97-4fe4-84aa-5d5ac0f5c16c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:28.446629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54d21af-fb97-4fe4-84aa-5d5ac0f5c16c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:28.447401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54d21af-fb97-4fe4-84aa-5d5ac0f5c16c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:28.447926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54d21af-fb97-4fe4-84aa-5d5ac0f5c16c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:28.448375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54d21af-fb97-4fe4-84aa-5d5ac0f5c16c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:28.610001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b54d21af-fb97-4fe4-84aa-5d5ac0f5c16c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:28.618709 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b54d21af-fb97-4fe4-84aa-5d5ac0f5c16c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1494 microversion: 2.1 time: 0.184934 Aug 27 05:16:28.619317 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3413/6776] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:28 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1494 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:16:29.640844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-490b0310-b974-483d-9d39-1571f1c4402c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:29.641570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-490b0310-b974-483d-9d39-1571f1c4402c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:29.649169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-490b0310-b974-483d-9d39-1571f1c4402c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:29.649668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-490b0310-b974-483d-9d39-1571f1c4402c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:29.650197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-490b0310-b974-483d-9d39-1571f1c4402c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:29.651083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-490b0310-b974-483d-9d39-1571f1c4402c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:29.651783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-490b0310-b974-483d-9d39-1571f1c4402c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:29.652348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-490b0310-b974-483d-9d39-1571f1c4402c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:29.796925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-490b0310-b974-483d-9d39-1571f1c4402c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:29.805335 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-490b0310-b974-483d-9d39-1571f1c4402c tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 200 len: 1494 microversion: 2.1 time: 0.168691 Aug 27 05:16:29.819182 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3364/6777] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:29 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 1494 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:30.237771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-33c3f35d-b6bc-4c46-a7ed-0c9028a13d23 req-7eff55fa-1374-4577-b6e1-e4e3ebd05426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fba5da4-1fe7-4d08-b51b-398d616cac3a", "name": "network-vif-deleted", "tag": "9e0ba1eb-76b8-45ca-b3b8-b61bc01c5348"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:30.251295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-33c3f35d-b6bc-4c46-a7ed-0c9028a13d23 req-7eff55fa-1374-4577-b6e1-e4e3ebd05426 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:30.252197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-33c3f35d-b6bc-4c46-a7ed-0c9028a13d23 req-7eff55fa-1374-4577-b6e1-e4e3ebd05426 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:30.252933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-33c3f35d-b6bc-4c46-a7ed-0c9028a13d23 req-7eff55fa-1374-4577-b6e1-e4e3ebd05426 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:30.268641 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-33c3f35d-b6bc-4c46-a7ed-0c9028a13d23 req-7eff55fa-1374-4577-b6e1-e4e3ebd05426 service nova] Creating event network-vif-deleted:9e0ba1eb-76b8-45ca-b3b8-b61bc01c5348 for instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a on n-h1-854823-1 Aug 27 05:16:30.275781 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-33c3f35d-b6bc-4c46-a7ed-0c9028a13d23 req-7eff55fa-1374-4577-b6e1-e4e3ebd05426 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042865 Aug 27 05:16:30.279569 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3414/6778] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:16:30.829853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-baf4b509-a378-44f6-8b0c-f97ffc638856 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:30.830480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-baf4b509-a378-44f6-8b0c-f97ffc638856 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:30.838337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-baf4b509-a378-44f6-8b0c-f97ffc638856 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:30.838829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-baf4b509-a378-44f6-8b0c-f97ffc638856 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:30.839520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-baf4b509-a378-44f6-8b0c-f97ffc638856 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:30.840099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-baf4b509-a378-44f6-8b0c-f97ffc638856 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:30.840633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-baf4b509-a378-44f6-8b0c-f97ffc638856 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:30.841102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-baf4b509-a378-44f6-8b0c-f97ffc638856 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:30.857213 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-baf4b509-a378-44f6-8b0c-f97ffc638856 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-baf4b509-a378-44f6-8b0c-f97ffc638856 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a HTTP/1.1 Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '4fba5da4-1fe7-4d08-b51b-398d616cac3a'} Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.859124 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:30.863770 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:30.863770 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:30.863770 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:30.863770 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:30.863770 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.863770 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.863770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-baf4b509-a378-44f6-8b0c-f97ffc638856 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:30.863770 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-baf4b509-a378-44f6-8b0c-f97ffc638856 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 404 len: 111 microversion: 2.1 time: 0.035000 Aug 27 05:16:30.863770 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3365/6779] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:30 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:30.877236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a815727-0bd5-4143-80b6-d8d2363b87e1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:30.877842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a815727-0bd5-4143-80b6-d8d2363b87e1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:30.885114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a815727-0bd5-4143-80b6-d8d2363b87e1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:30.885617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a815727-0bd5-4143-80b6-d8d2363b87e1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:30.886247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a815727-0bd5-4143-80b6-d8d2363b87e1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:30.886965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a815727-0bd5-4143-80b6-d8d2363b87e1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:30.887433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a815727-0bd5-4143-80b6-d8d2363b87e1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:30.887873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a815727-0bd5-4143-80b6-d8d2363b87e1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:30.902541 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9a815727-0bd5-4143-80b6-d8d2363b87e1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a815727-0bd5-4143-80b6-d8d2363b87e1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a HTTP/1.1 Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '4fba5da4-1fe7-4d08-b51b-398d616cac3a'} Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:30.904257 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.908448 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.908448 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:30.908448 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.908448 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:30.908448 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:30.908448 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:30.908448 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:30.908448 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:30.908448 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.908448 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.908448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a815727-0bd5-4143-80b6-d8d2363b87e1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:30.908448 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a815727-0bd5-4143-80b6-d8d2363b87e1 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 404 len: 111 microversion: 2.1 time: 0.033208 Aug 27 05:16:30.908448 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3415/6780] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:16:30 2022] DELETE /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:30.915100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-efe67f49-898c-4ec5-96d9-599fa4abb283 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:30.915808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-efe67f49-898c-4ec5-96d9-599fa4abb283 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 4fba5da4-1fe7-4d08-b51b-398d616cac3a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:30.922414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efe67f49-898c-4ec5-96d9-599fa4abb283 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:30.922905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efe67f49-898c-4ec5-96d9-599fa4abb283 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:30.923377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efe67f49-898c-4ec5-96d9-599fa4abb283 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:30.924081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efe67f49-898c-4ec5-96d9-599fa4abb283 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:30.924611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efe67f49-898c-4ec5-96d9-599fa4abb283 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:30.924992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-efe67f49-898c-4ec5-96d9-599fa4abb283 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:30.939325 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-efe67f49-898c-4ec5-96d9-599fa4abb283 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-efe67f49-898c-4ec5-96d9-599fa4abb283 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a HTTP/1.1 Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '4fba5da4-1fe7-4d08-b51b-398d616cac3a'} Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.940932 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:30.945842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:30.945842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:30.945842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:30.945842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:30.945842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. Aug 27 05:16:30.945842 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.945842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-efe67f49-898c-4ec5-96d9-599fa4abb283 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 4fba5da4-1fe7-4d08-b51b-398d616cac3a could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:30.945842 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-efe67f49-898c-4ec5-96d9-599fa4abb283 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a" status: 404 len: 111 microversion: 2.1 time: 0.031646 Aug 27 05:16:30.945842 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3366/6781] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:30 2022] GET /compute/v2.1/servers/4fba5da4-1fe7-4d08-b51b-398d616cac3a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:30.952172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe6549ec-8248-4f55-9d7e-8d1a35fe3c07 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:30.952749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe6549ec-8248-4f55-9d7e-8d1a35fe3c07 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:30.959556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe6549ec-8248-4f55-9d7e-8d1a35fe3c07 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:30.960050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe6549ec-8248-4f55-9d7e-8d1a35fe3c07 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:30.960520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe6549ec-8248-4f55-9d7e-8d1a35fe3c07 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:30.961251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe6549ec-8248-4f55-9d7e-8d1a35fe3c07 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:30.961724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe6549ec-8248-4f55-9d7e-8d1a35fe3c07 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:30.962163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe6549ec-8248-4f55-9d7e-8d1a35fe3c07 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:30.976821 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-fe6549ec-8248-4f55-9d7e-8d1a35fe3c07 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe6549ec-8248-4f55-9d7e-8d1a35fe3c07 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 HTTP/1.1 Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '50d35993-95e0-4ec8-afe2-ba7453ff3b66'} Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:30.978428 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:16:30.983837 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.983837 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:30.983837 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.983837 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:30.983837 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:30.983837 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:30.983837 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:30.983837 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:30.983837 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:16:30.983837 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:30.983837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe6549ec-8248-4f55-9d7e-8d1a35fe3c07 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:30.983837 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe6549ec-8248-4f55-9d7e-8d1a35fe3c07 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 404 len: 111 microversion: 2.1 time: 0.031790 Aug 27 05:16:30.983837 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3416/6782] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:16:30 2022] DELETE /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:30.988519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7e8cb2dc-9cfa-4c72-829a-0f1e3dc0b302 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:30.989239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7e8cb2dc-9cfa-4c72-829a-0f1e3dc0b302 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 50d35993-95e0-4ec8-afe2-ba7453ff3b66] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:30.995464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e8cb2dc-9cfa-4c72-829a-0f1e3dc0b302 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:30.995953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e8cb2dc-9cfa-4c72-829a-0f1e3dc0b302 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:30.996605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e8cb2dc-9cfa-4c72-829a-0f1e3dc0b302 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:30.997310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e8cb2dc-9cfa-4c72-829a-0f1e3dc0b302 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:30.997790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e8cb2dc-9cfa-4c72-829a-0f1e3dc0b302 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:30.998202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7e8cb2dc-9cfa-4c72-829a-0f1e3dc0b302 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.013078 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-7e8cb2dc-9cfa-4c72-829a-0f1e3dc0b302 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7e8cb2dc-9cfa-4c72-829a-0f1e3dc0b302 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 HTTP/1.1 Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '50d35993-95e0-4ec8-afe2-ba7453ff3b66'} Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.014564 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.023492 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.023492 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.023492 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:31.023492 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:31.023492 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. Aug 27 05:16:31.023492 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.023492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7e8cb2dc-9cfa-4c72-829a-0f1e3dc0b302 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 50d35993-95e0-4ec8-afe2-ba7453ff3b66 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:31.023492 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7e8cb2dc-9cfa-4c72-829a-0f1e3dc0b302 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66" status: 404 len: 111 microversion: 2.1 time: 0.031432 Aug 27 05:16:31.023492 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3367/6783] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:30 2022] GET /compute/v2.1/servers/50d35993-95e0-4ec8-afe2-ba7453ff3b66 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:31.025506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09624602-e28c-4e85-bd13-d07d0404b958 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:31.026028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-09624602-e28c-4e85-bd13-d07d0404b958 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:31.032412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09624602-e28c-4e85-bd13-d07d0404b958 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.032955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09624602-e28c-4e85-bd13-d07d0404b958 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.033411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09624602-e28c-4e85-bd13-d07d0404b958 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.034126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09624602-e28c-4e85-bd13-d07d0404b958 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.034600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09624602-e28c-4e85-bd13-d07d0404b958 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.035040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09624602-e28c-4e85-bd13-d07d0404b958 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.050326 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-09624602-e28c-4e85-bd13-d07d0404b958 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09624602-e28c-4e85-bd13-d07d0404b958 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 HTTP/1.1 Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '48d9cc91-8988-4026-bd36-1f5792b527b2'} Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:31.051948 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:16:31.056049 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.056049 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.056049 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.056049 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.056049 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.056049 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.056049 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:31.056049 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:31.056049 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:16:31.056049 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.056049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09624602-e28c-4e85-bd13-d07d0404b958 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:31.056049 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09624602-e28c-4e85-bd13-d07d0404b958 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 404 len: 111 microversion: 2.1 time: 0.032900 Aug 27 05:16:31.056049 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3417/6784] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:16:31 2022] DELETE /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:31.062415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7b348b5-4dbe-4105-a307-53da667c6221 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:31.063236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c7b348b5-4dbe-4105-a307-53da667c6221 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 48d9cc91-8988-4026-bd36-1f5792b527b2] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:31.070038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7b348b5-4dbe-4105-a307-53da667c6221 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.070561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7b348b5-4dbe-4105-a307-53da667c6221 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.071007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7b348b5-4dbe-4105-a307-53da667c6221 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.071790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7b348b5-4dbe-4105-a307-53da667c6221 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.072249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7b348b5-4dbe-4105-a307-53da667c6221 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.072729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7b348b5-4dbe-4105-a307-53da667c6221 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.087313 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-c7b348b5-4dbe-4105-a307-53da667c6221 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7b348b5-4dbe-4105-a307-53da667c6221 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 HTTP/1.1 Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '48d9cc91-8988-4026-bd36-1f5792b527b2'} Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.088914 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.093358 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.093358 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.093358 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:31.093358 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:31.093358 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. Aug 27 05:16:31.093358 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.093358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7b348b5-4dbe-4105-a307-53da667c6221 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 48d9cc91-8988-4026-bd36-1f5792b527b2 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:31.093358 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7b348b5-4dbe-4105-a307-53da667c6221 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2" status: 404 len: 111 microversion: 2.1 time: 0.031903 Aug 27 05:16:31.093358 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3368/6785] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:31 2022] GET /compute/v2.1/servers/48d9cc91-8988-4026-bd36-1f5792b527b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:31.099514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5eebbecb-9dea-49d8-9018-ad59ee18d61a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:31.100030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5eebbecb-9dea-49d8-9018-ad59ee18d61a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:31.106291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eebbecb-9dea-49d8-9018-ad59ee18d61a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.106801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eebbecb-9dea-49d8-9018-ad59ee18d61a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.107274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eebbecb-9dea-49d8-9018-ad59ee18d61a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.107994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eebbecb-9dea-49d8-9018-ad59ee18d61a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.108465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eebbecb-9dea-49d8-9018-ad59ee18d61a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.108948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eebbecb-9dea-49d8-9018-ad59ee18d61a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.122905 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-5eebbecb-9dea-49d8-9018-ad59ee18d61a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5eebbecb-9dea-49d8-9018-ad59ee18d61a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 HTTP/1.1 Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'bcb4ea51-3a82-4889-b687-2eb25d961c19'} Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:31.124502 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:16:31.128950 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.128950 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.128950 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.128950 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.128950 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.128950 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.128950 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:31.128950 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:31.128950 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:16:31.128950 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.128950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5eebbecb-9dea-49d8-9018-ad59ee18d61a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:31.128950 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5eebbecb-9dea-49d8-9018-ad59ee18d61a tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 404 len: 111 microversion: 2.1 time: 0.030480 Aug 27 05:16:31.128950 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3418/6786] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:16:31 2022] DELETE /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:31.136056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d492529c-dc41-4bda-9a12-ac743d752f56 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:31.136806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d492529c-dc41-4bda-9a12-ac743d752f56 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: bcb4ea51-3a82-4889-b687-2eb25d961c19] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:31.143179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d492529c-dc41-4bda-9a12-ac743d752f56 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.143675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d492529c-dc41-4bda-9a12-ac743d752f56 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.144121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d492529c-dc41-4bda-9a12-ac743d752f56 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.144869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d492529c-dc41-4bda-9a12-ac743d752f56 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.145318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d492529c-dc41-4bda-9a12-ac743d752f56 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.145749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d492529c-dc41-4bda-9a12-ac743d752f56 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.163577 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-d492529c-dc41-4bda-9a12-ac743d752f56 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d492529c-dc41-4bda-9a12-ac743d752f56 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 HTTP/1.1 Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'bcb4ea51-3a82-4889-b687-2eb25d961c19'} Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.165175 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.170302 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.170302 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.170302 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:31.170302 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:31.170302 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. Aug 27 05:16:31.170302 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.170302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d492529c-dc41-4bda-9a12-ac743d752f56 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance bcb4ea51-3a82-4889-b687-2eb25d961c19 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:31.170302 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d492529c-dc41-4bda-9a12-ac743d752f56 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19" status: 404 len: 111 microversion: 2.1 time: 0.034732 Aug 27 05:16:31.170302 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3369/6787] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:31 2022] GET /compute/v2.1/servers/bcb4ea51-3a82-4889-b687-2eb25d961c19 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:31.177694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8acae5c-2f37-4741-a206-1c32d87d7e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:31.178455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8acae5c-2f37-4741-a206-1c32d87d7e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:31.185382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8acae5c-2f37-4741-a206-1c32d87d7e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.185887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8acae5c-2f37-4741-a206-1c32d87d7e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.186367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8acae5c-2f37-4741-a206-1c32d87d7e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.187126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8acae5c-2f37-4741-a206-1c32d87d7e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.187592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8acae5c-2f37-4741-a206-1c32d87d7e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.188030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8acae5c-2f37-4741-a206-1c32d87d7e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.203105 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d8acae5c-2f37-4741-a206-1c32d87d7e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8acae5c-2f37-4741-a206-1c32d87d7e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 HTTP/1.1 Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '69439461-f0f0-4a9f-a536-ccee5ac8f974'} Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:31.204776 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:16:31.210109 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.210109 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.210109 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.210109 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.210109 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.210109 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.210109 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:31.210109 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:31.210109 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:16:31.210109 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.210109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8acae5c-2f37-4741-a206-1c32d87d7e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:31.210109 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8acae5c-2f37-4741-a206-1c32d87d7e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 404 len: 111 microversion: 2.1 time: 0.032907 Aug 27 05:16:31.210109 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3419/6788] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:16:31 2022] DELETE /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:31.217706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2caf75c8-7316-4153-bc49-37b33e5c9e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:31.218331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2caf75c8-7316-4153-bc49-37b33e5c9e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 69439461-f0f0-4a9f-a536-ccee5ac8f974] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:31.224548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2caf75c8-7316-4153-bc49-37b33e5c9e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.225077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2caf75c8-7316-4153-bc49-37b33e5c9e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.225524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2caf75c8-7316-4153-bc49-37b33e5c9e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.226224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2caf75c8-7316-4153-bc49-37b33e5c9e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.226681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2caf75c8-7316-4153-bc49-37b33e5c9e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.227253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2caf75c8-7316-4153-bc49-37b33e5c9e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.232681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:31.243477 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-2caf75c8-7316-4153-bc49-37b33e5c9e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2caf75c8-7316-4153-bc49-37b33e5c9e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 HTTP/1.1 Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '69439461-f0f0-4a9f-a536-ccee5ac8f974'} Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.245045 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.249509 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.249509 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.249509 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:31.249509 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:31.249509 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. Aug 27 05:16:31.249509 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.249509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2caf75c8-7316-4153-bc49-37b33e5c9e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 69439461-f0f0-4a9f-a536-ccee5ac8f974 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:31.249509 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2caf75c8-7316-4153-bc49-37b33e5c9e6f tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974" status: 404 len: 111 microversion: 2.1 time: 0.032718 Aug 27 05:16:31.249509 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3370/6789] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:31 2022] GET /compute/v2.1/servers/69439461-f0f0-4a9f-a536-ccee5ac8f974 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:31.256489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64beb00e-dd18-4527-a64c-c773a5415ff3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:31.257590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-64beb00e-dd18-4527-a64c-c773a5415ff3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:31.265247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64beb00e-dd18-4527-a64c-c773a5415ff3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.265763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64beb00e-dd18-4527-a64c-c773a5415ff3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.266285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64beb00e-dd18-4527-a64c-c773a5415ff3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.267074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64beb00e-dd18-4527-a64c-c773a5415ff3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.267631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64beb00e-dd18-4527-a64c-c773a5415ff3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.268153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64beb00e-dd18-4527-a64c-c773a5415ff3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.287884 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-64beb00e-dd18-4527-a64c-c773a5415ff3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64beb00e-dd18-4527-a64c-c773a5415ff3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a HTTP/1.1 Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '1ed650dd-f60f-4bfb-9a9b-61500407568a'} Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:31.290617 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:16:31.295453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.295453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.295453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.295453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.295453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.295453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.295453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:31.295453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:31.295453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:16:31.295453 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.295453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64beb00e-dd18-4527-a64c-c773a5415ff3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:31.295453 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64beb00e-dd18-4527-a64c-c773a5415ff3 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 404 len: 111 microversion: 2.1 time: 0.041879 Aug 27 05:16:31.297410 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3420/6790] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:16:31 2022] DELETE /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:31.303137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fbc3196d-3c1c-4fe4-85b6-681471e023d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:31.303750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fbc3196d-3c1c-4fe4-85b6-681471e023d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 1ed650dd-f60f-4bfb-9a9b-61500407568a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:31.311748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbc3196d-3c1c-4fe4-85b6-681471e023d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.312238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbc3196d-3c1c-4fe4-85b6-681471e023d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.312704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbc3196d-3c1c-4fe4-85b6-681471e023d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.313403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbc3196d-3c1c-4fe4-85b6-681471e023d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.313961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbc3196d-3c1c-4fe4-85b6-681471e023d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.314389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fbc3196d-3c1c-4fe4-85b6-681471e023d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.330349 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-fbc3196d-3c1c-4fe4-85b6-681471e023d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fbc3196d-3c1c-4fe4-85b6-681471e023d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a HTTP/1.1 Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '1ed650dd-f60f-4bfb-9a9b-61500407568a'} Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.331905 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.336669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.336669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.336669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:31.336669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:31.336669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. Aug 27 05:16:31.336669 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.336669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fbc3196d-3c1c-4fe4-85b6-681471e023d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 1ed650dd-f60f-4bfb-9a9b-61500407568a could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:31.336669 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fbc3196d-3c1c-4fe4-85b6-681471e023d6 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a" status: 404 len: 111 microversion: 2.1 time: 0.034655 Aug 27 05:16:31.336669 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3371/6791] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:31 2022] GET /compute/v2.1/servers/1ed650dd-f60f-4bfb-9a9b-61500407568a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:31.342902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac958b91-54a7-41e1-9b6b-2544578467b9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:31.343426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac958b91-54a7-41e1-9b6b-2544578467b9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 400842fe-f04e-4eaa-a7ee-dc102b473e83] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:31.350384 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ac958b91-54a7-41e1-9b6b-2544578467b9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac958b91-54a7-41e1-9b6b-2544578467b9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/400842fe-f04e-4eaa-a7ee-dc102b473e83 HTTP/1.1 Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '400842fe-f04e-4eaa-a7ee-dc102b473e83'} Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.352054 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.356951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.356951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.356951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.356951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:31.356951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:31.356951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:16:31.356951 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.356951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac958b91-54a7-41e1-9b6b-2544578467b9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:31.356951 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac958b91-54a7-41e1-9b6b-2544578467b9 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/400842fe-f04e-4eaa-a7ee-dc102b473e83" status: 404 len: 111 microversion: 2.1 time: 0.014868 Aug 27 05:16:31.356951 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3421/6792] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:16:31 2022] DELETE /compute/v2.1/servers/400842fe-f04e-4eaa-a7ee-dc102b473e83 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:31.363832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5121b3e6-4633-4bf1-95b6-a751e8a06ebf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:31.364444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5121b3e6-4633-4bf1-95b6-a751e8a06ebf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 400842fe-f04e-4eaa-a7ee-dc102b473e83] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:31.370955 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-5121b3e6-4633-4bf1-95b6-a751e8a06ebf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5121b3e6-4633-4bf1-95b6-a751e8a06ebf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/400842fe-f04e-4eaa-a7ee-dc102b473e83 HTTP/1.1 Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '400842fe-f04e-4eaa-a7ee-dc102b473e83'} Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:31.372475 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:31.377645 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:31.377645 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:31.377645 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. Aug 27 05:16:31.377645 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:31.377645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5121b3e6-4633-4bf1-95b6-a751e8a06ebf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 400842fe-f04e-4eaa-a7ee-dc102b473e83 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:31.377645 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5121b3e6-4633-4bf1-95b6-a751e8a06ebf tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/400842fe-f04e-4eaa-a7ee-dc102b473e83" status: 404 len: 111 microversion: 2.1 time: 0.014183 Aug 27 05:16:31.377645 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3372/6793] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:31 2022] GET /compute/v2.1/servers/400842fe-f04e-4eaa-a7ee-dc102b473e83 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:31.383961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-acd97187-9b8d-4e53-bbed-5ddb4ecfb49d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:31.384898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-acd97187-9b8d-4e53-bbed-5ddb4ecfb49d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:31.392249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acd97187-9b8d-4e53-bbed-5ddb4ecfb49d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.392605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acd97187-9b8d-4e53-bbed-5ddb4ecfb49d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.392897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acd97187-9b8d-4e53-bbed-5ddb4ecfb49d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.393612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acd97187-9b8d-4e53-bbed-5ddb4ecfb49d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.394074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acd97187-9b8d-4e53-bbed-5ddb4ecfb49d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.394508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acd97187-9b8d-4e53-bbed-5ddb4ecfb49d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.421036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-acd97187-9b8d-4e53-bbed-5ddb4ecfb49d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:16:31.511921 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-acd97187-9b8d-4e53-bbed-5ddb4ecfb49d tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "DELETE /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 204 len: 0 microversion: 2.1 time: 0.132480 Aug 27 05:16:31.512576 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3422/6794] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:16:31 2022] DELETE /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:16:31.521135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0e32d269-b679-4ef0-b5c9-a15d414104ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:31.521631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0e32d269-b679-4ef0-b5c9-a15d414104ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:31.529544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e32d269-b679-4ef0-b5c9-a15d414104ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.530033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e32d269-b679-4ef0-b5c9-a15d414104ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.530469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e32d269-b679-4ef0-b5c9-a15d414104ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.531169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e32d269-b679-4ef0-b5c9-a15d414104ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:31.531624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e32d269-b679-4ef0-b5c9-a15d414104ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:31.532046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e32d269-b679-4ef0-b5c9-a15d414104ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:31.747604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0e32d269-b679-4ef0-b5c9-a15d414104ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:31.755741 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0e32d269-b679-4ef0-b5c9-a15d414104ec tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 200 len: 1479 microversion: 2.1 time: 0.238720 Aug 27 05:16:31.756327 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3373/6795] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:31 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 1479 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:32.777674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e63c4f8c-45f8-40b2-809f-2ba903daaf17 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:32.778398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e63c4f8c-45f8-40b2-809f-2ba903daaf17 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:32.785359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e63c4f8c-45f8-40b2-809f-2ba903daaf17 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:32.785877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e63c4f8c-45f8-40b2-809f-2ba903daaf17 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:32.786325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e63c4f8c-45f8-40b2-809f-2ba903daaf17 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:32.787078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e63c4f8c-45f8-40b2-809f-2ba903daaf17 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:32.787551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e63c4f8c-45f8-40b2-809f-2ba903daaf17 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:32.788000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e63c4f8c-45f8-40b2-809f-2ba903daaf17 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:32.928815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e63c4f8c-45f8-40b2-809f-2ba903daaf17 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:32.937683 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e63c4f8c-45f8-40b2-809f-2ba903daaf17 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 200 len: 1479 microversion: 2.1 time: 0.164219 Aug 27 05:16:32.938284 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3423/6796] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:32 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 1479 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:33.644480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-50f6739f-b299-4813-9771-69a2db1736fa req-1c86354c-07c9-49d3-9ec5-91a68700f780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40122696-5020-4974-81a3-df95d8cf8d01", "name": "network-vif-deleted", "tag": "cdafc48e-fc01-46e5-a121-d5a31e1b3270"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:33.656295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-50f6739f-b299-4813-9771-69a2db1736fa req-1c86354c-07c9-49d3-9ec5-91a68700f780 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:33.656801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-50f6739f-b299-4813-9771-69a2db1736fa req-1c86354c-07c9-49d3-9ec5-91a68700f780 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:33.657240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-50f6739f-b299-4813-9771-69a2db1736fa req-1c86354c-07c9-49d3-9ec5-91a68700f780 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:33.671562 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-50f6739f-b299-4813-9771-69a2db1736fa req-1c86354c-07c9-49d3-9ec5-91a68700f780 service nova] Creating event network-vif-deleted:cdafc48e-fc01-46e5-a121-d5a31e1b3270 for instance 40122696-5020-4974-81a3-df95d8cf8d01 on n-h2-854823-1 Aug 27 05:16:33.676642 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-50f6739f-b299-4813-9771-69a2db1736fa req-1c86354c-07c9-49d3-9ec5-91a68700f780 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037340 Aug 27 05:16:33.677758 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3374/6797] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:16:33.961082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a0ade91-95c5-4806-bdc4-4919666b0205 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:33.961759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a0ade91-95c5-4806-bdc4-4919666b0205 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:33.984976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0ade91-95c5-4806-bdc4-4919666b0205 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:33.985502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0ade91-95c5-4806-bdc4-4919666b0205 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:33.985957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0ade91-95c5-4806-bdc4-4919666b0205 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:33.986695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0ade91-95c5-4806-bdc4-4919666b0205 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:33.987176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0ade91-95c5-4806-bdc4-4919666b0205 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:33.987634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0ade91-95c5-4806-bdc4-4919666b0205 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:34.023812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0ade91-95c5-4806-bdc4-4919666b0205 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:34.024624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0ade91-95c5-4806-bdc4-4919666b0205 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:34.025087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0ade91-95c5-4806-bdc4-4919666b0205 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:34.025567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-7a0ade91-95c5-4806-bdc4-4919666b0205 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lazy-loading 'fault' on Instance uuid 40122696-5020-4974-81a3-df95d8cf8d01 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:16:34.073504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a0ade91-95c5-4806-bdc4-4919666b0205 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3d0735d85744b3a52e0e0d6dd64174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e6863fdac49b486519421d1c8181b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:34.082100 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a0ade91-95c5-4806-bdc4-4919666b0205 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 200 len: 1282 microversion: 2.1 time: 0.125206 Aug 27 05:16:34.082778 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3424/6798] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:33 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 1282 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:16:35.104046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c5a8f51-6ca8-44fc-b4ca-40b53e762089 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:35.104804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1c5a8f51-6ca8-44fc-b4ca-40b53e762089 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] [instance: 40122696-5020-4974-81a3-df95d8cf8d01] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:35.111251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c5a8f51-6ca8-44fc-b4ca-40b53e762089 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:35.111744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c5a8f51-6ca8-44fc-b4ca-40b53e762089 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:35.112190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c5a8f51-6ca8-44fc-b4ca-40b53e762089 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:35.112928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c5a8f51-6ca8-44fc-b4ca-40b53e762089 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:35.113395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c5a8f51-6ca8-44fc-b4ca-40b53e762089 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:35.113825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c5a8f51-6ca8-44fc-b4ca-40b53e762089 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:35.129561 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-1c5a8f51-6ca8-44fc-b4ca-40b53e762089 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] HTTP exception thrown: Instance 40122696-5020-4974-81a3-df95d8cf8d01 could not be found. Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c5a8f51-6ca8-44fc-b4ca-40b53e762089 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Request method failure captured: Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 HTTP/1.1 Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCago5tO5G450c84t43TFrbDNt7uGtGbX2ZyUDZWcUJ2TLaU4Z6cG35QToZ76I_QP9crsqV0Cs9Bje0rHiZtf5j8fVwgoFINCXbGAHM6f3AjHyoNnBVGXdwJIxiaHipnvmXIdwvrCh2WHXqf-qaS5oJqWR8fVa3PWcjpoj5a0GbW4IJA Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cc1e6863fdac49b486519421d1c8181b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersTestJSON-688641032 Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: cc1e6863fdac49b486519421d1c8181b Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersTestJSON-688641032 Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersTestJSON-688641032-project Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 3d3d0735d85744b3a52e0e0d6dd64174 Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersTestJSON-688641032-project Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 40122696-5020-4974-81a3-df95d8cf8d01 could not be found. Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '40122696-5020-4974-81a3-df95d8cf8d01'} Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40122696-5020-4974-81a3-df95d8cf8d01 could not be found. Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40122696-5020-4974-81a3-df95d8cf8d01 could not be found. Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:35.132059 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:16:35.137345 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:16:35.137345 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:16:35.137345 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:16:35.137345 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:16:35.137345 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40122696-5020-4974-81a3-df95d8cf8d01 could not be found. Aug 27 05:16:35.137345 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:16:35.137345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c5a8f51-6ca8-44fc-b4ca-40b53e762089 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] Returning 404 to user: Instance 40122696-5020-4974-81a3-df95d8cf8d01 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:16:35.137345 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1c5a8f51-6ca8-44fc-b4ca-40b53e762089 tempest-ServersTestJSON-688641032 tempest-ServersTestJSON-688641032-project] 10.222.0.79 "GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01" status: 404 len: 111 microversion: 2.1 time: 0.035029 Aug 27 05:16:35.137345 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3375/6799] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:16:35 2022] GET /compute/v2.1/servers/40122696-5020-4974-81a3-df95d8cf8d01 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:16:41.473248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1356027628", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": "none"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:41.481098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:41.539188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:16:41.539627 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:16:41.540127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:16:41.540826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:16:41.541463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:16:41.557888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:41.558398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:41.559070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:41.559841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:41.560322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:41.560789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:41.585675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Getting quotas for project 9936d1768ca44b9ab75f5772870a706b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:41.591621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Getting quotas for user a4b2675391f14be890a0d801d63449b8 and project 9936d1768ca44b9ab75f5772870a706b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:41.604819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:16:41.607178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:16:41.657681 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-19483873-c58d-4969-b032-a6091749876e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.325949 Aug 27 05:16:41.660701 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3425/6800] 10.222.0.79 () {62 vars in 1188 bytes} [Sat Aug 27 05:16:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 330 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 05:16:41.669614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8d99f493-4478-4feb-929f-e6d19a4c0fbd tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:41.670872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8d99f493-4478-4feb-929f-e6d19a4c0fbd tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:41.754491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8d99f493-4478-4feb-929f-e6d19a4c0fbd tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:41.766394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8d99f493-4478-4feb-929f-e6d19a4c0fbd tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:41.768471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8d99f493-4478-4feb-929f-e6d19a4c0fbd tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:41.769869 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8d99f493-4478-4feb-929f-e6d19a4c0fbd tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1278 microversion: 2.54 time: 0.104476 Aug 27 05:16:41.771010 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3376/6801] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:41 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1278 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:42.795544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e086efd-73ea-4494-ba2d-12463d000d81 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:42.796180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e086efd-73ea-4494-ba2d-12463d000d81 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:42.803394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e086efd-73ea-4494-ba2d-12463d000d81 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:42.803905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e086efd-73ea-4494-ba2d-12463d000d81 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:42.804361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e086efd-73ea-4494-ba2d-12463d000d81 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:42.805105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e086efd-73ea-4494-ba2d-12463d000d81 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:42.805580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e086efd-73ea-4494-ba2d-12463d000d81 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:42.806320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e086efd-73ea-4494-ba2d-12463d000d81 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:42.884735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e086efd-73ea-4494-ba2d-12463d000d81 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:42.896825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e086efd-73ea-4494-ba2d-12463d000d81 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:42.898580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e086efd-73ea-4494-ba2d-12463d000d81 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:42.899805 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e086efd-73ea-4494-ba2d-12463d000d81 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1330 microversion: 2.54 time: 0.109415 Aug 27 05:16:42.901084 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3426/6802] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:42 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1330 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:43.925964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-187ad17d-127e-4b70-af73-739d4fb59b5c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:43.926719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-187ad17d-127e-4b70-af73-739d4fb59b5c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:43.936349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-187ad17d-127e-4b70-af73-739d4fb59b5c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:43.936975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-187ad17d-127e-4b70-af73-739d4fb59b5c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:43.937489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-187ad17d-127e-4b70-af73-739d4fb59b5c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:43.944248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-187ad17d-127e-4b70-af73-739d4fb59b5c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:43.944594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-187ad17d-127e-4b70-af73-739d4fb59b5c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:43.945011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-187ad17d-127e-4b70-af73-739d4fb59b5c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:44.050645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-187ad17d-127e-4b70-af73-739d4fb59b5c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:44.059633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-187ad17d-127e-4b70-af73-739d4fb59b5c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:44.061098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-187ad17d-127e-4b70-af73-739d4fb59b5c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:44.062248 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-187ad17d-127e-4b70-af73-739d4fb59b5c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1336 microversion: 2.54 time: 0.141176 Aug 27 05:16:44.062820 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3377/6803] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:43 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1336 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:45.087374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa495399-8403-4eb9-8b04-ad93a9862fb2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:45.088144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fa495399-8403-4eb9-8b04-ad93a9862fb2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:45.095162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa495399-8403-4eb9-8b04-ad93a9862fb2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:45.095714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa495399-8403-4eb9-8b04-ad93a9862fb2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:45.096977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa495399-8403-4eb9-8b04-ad93a9862fb2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:45.097863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa495399-8403-4eb9-8b04-ad93a9862fb2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:45.098342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa495399-8403-4eb9-8b04-ad93a9862fb2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:45.098781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa495399-8403-4eb9-8b04-ad93a9862fb2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:45.169277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa495399-8403-4eb9-8b04-ad93a9862fb2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:45.178108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa495399-8403-4eb9-8b04-ad93a9862fb2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:45.179602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa495399-8403-4eb9-8b04-ad93a9862fb2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:45.180799 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa495399-8403-4eb9-8b04-ad93a9862fb2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1336 microversion: 2.54 time: 0.098058 Aug 27 05:16:45.181386 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3427/6804] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:45 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:46.204568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a4a1c201-ce65-4c92-8a0e-aec90d6dd396 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:46.205295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a4a1c201-ce65-4c92-8a0e-aec90d6dd396 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:46.213341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4a1c201-ce65-4c92-8a0e-aec90d6dd396 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:46.213869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4a1c201-ce65-4c92-8a0e-aec90d6dd396 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:46.214400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4a1c201-ce65-4c92-8a0e-aec90d6dd396 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:46.215201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4a1c201-ce65-4c92-8a0e-aec90d6dd396 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:46.215744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4a1c201-ce65-4c92-8a0e-aec90d6dd396 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:46.216249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4a1c201-ce65-4c92-8a0e-aec90d6dd396 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:46.288877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a4a1c201-ce65-4c92-8a0e-aec90d6dd396 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:46.297335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a4a1c201-ce65-4c92-8a0e-aec90d6dd396 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:46.298802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a4a1c201-ce65-4c92-8a0e-aec90d6dd396 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:46.299929 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a4a1c201-ce65-4c92-8a0e-aec90d6dd396 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1336 microversion: 2.54 time: 0.099512 Aug 27 05:16:46.300521 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3378/6805] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:46 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:47.323897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-773cb2a9-c783-4875-b0cb-861fb41ed814 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:47.324589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-773cb2a9-c783-4875-b0cb-861fb41ed814 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:47.333073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773cb2a9-c783-4875-b0cb-861fb41ed814 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:47.333588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773cb2a9-c783-4875-b0cb-861fb41ed814 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:47.334316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773cb2a9-c783-4875-b0cb-861fb41ed814 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:47.334967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773cb2a9-c783-4875-b0cb-861fb41ed814 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:47.335453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773cb2a9-c783-4875-b0cb-861fb41ed814 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:47.335899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773cb2a9-c783-4875-b0cb-861fb41ed814 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:47.405977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-773cb2a9-c783-4875-b0cb-861fb41ed814 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:47.414754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-773cb2a9-c783-4875-b0cb-861fb41ed814 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:47.416226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-773cb2a9-c783-4875-b0cb-861fb41ed814 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:47.417491 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-773cb2a9-c783-4875-b0cb-861fb41ed814 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1357 microversion: 2.54 time: 0.097761 Aug 27 05:16:47.432698 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3428/6806] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:47 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1357 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:47.444385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b862b653-f18e-4618-a2d2-09ecca55d866 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Action: 'create', calling method: .version_select at 0x7f1f20862ca0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-810234104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETUupzN/c/kYOGfG8ntAJN+YCE3xODFiCmZN1t289GQ3+aIkqhhDXBAjuZC1L/J/1AuRjPqXzP3LHrbKMPPCGtW+lKogVLKkRom057ReI3MDzXYQZBnJiNwHcFyIWYsUw=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:47.462079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-b862b653-f18e-4618-a2d2-09ecca55d866 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Getting quotas for project 9936d1768ca44b9ab75f5772870a706b. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:16:47.468639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-b862b653-f18e-4618-a2d2-09ecca55d866 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Getting quotas for user a4b2675391f14be890a0d801d63449b8 and project 9936d1768ca44b9ab75f5772870a706b. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:16:47.496804 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b862b653-f18e-4618-a2d2-09ecca55d866 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.056494 Aug 27 05:16:47.497624 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3379/6807] 10.222.0.79 () {62 vars in 1200 bytes} [Sat Aug 27 05:16:47 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 05:16:47.508639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-810234104", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:16:47.511558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:47.517813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:47.518320 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:47.518802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:47.519508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:47.519983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:47.520429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:47.607651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:16:47.608098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:16:47.608625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:16:47.609058 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:16:47.609488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:16:47.677129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:47.695158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:47.703047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:47.703560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:47.704016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:47.704767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:47.705415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:47.706024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:47.738905 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-805f5311-3e7b-4fce-890e-93f9e6c7791c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "POST /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5/action" status: 202 len: 1139 microversion: 2.54 time: 0.234447 Aug 27 05:16:47.739555 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3429/6808] 10.222.0.79 () {62 vars in 1320 bytes} [Sat Aug 27 05:16:47 2022] POST /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5/action => generated 1139 bytes in 236 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 05:16:47.758454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8b40bc52-fe93-4181-aee4-0a1bd556c5ff tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:47.759081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8b40bc52-fe93-4181-aee4-0a1bd556c5ff tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:47.765723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b40bc52-fe93-4181-aee4-0a1bd556c5ff tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:47.766218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b40bc52-fe93-4181-aee4-0a1bd556c5ff tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:47.766661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b40bc52-fe93-4181-aee4-0a1bd556c5ff tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:47.767366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b40bc52-fe93-4181-aee4-0a1bd556c5ff tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:47.767827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b40bc52-fe93-4181-aee4-0a1bd556c5ff tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:47.768257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8b40bc52-fe93-4181-aee4-0a1bd556c5ff tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:47.845534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8b40bc52-fe93-4181-aee4-0a1bd556c5ff tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:47.854775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8b40bc52-fe93-4181-aee4-0a1bd556c5ff tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:47.856265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8b40bc52-fe93-4181-aee4-0a1bd556c5ff tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:47.857477 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8b40bc52-fe93-4181-aee4-0a1bd556c5ff tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.103355 Aug 27 05:16:47.858043 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3380/6809] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:47 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:48.884878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8dd7f95c-1754-4408-b351-42bc7389fd7d tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:48.885525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8dd7f95c-1754-4408-b351-42bc7389fd7d tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:48.897283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dd7f95c-1754-4408-b351-42bc7389fd7d tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:48.897971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dd7f95c-1754-4408-b351-42bc7389fd7d tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:48.898604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dd7f95c-1754-4408-b351-42bc7389fd7d tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:48.899431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dd7f95c-1754-4408-b351-42bc7389fd7d tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:48.900197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dd7f95c-1754-4408-b351-42bc7389fd7d tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:48.900779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dd7f95c-1754-4408-b351-42bc7389fd7d tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:49.170052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8dd7f95c-1754-4408-b351-42bc7389fd7d tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:49.180302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8dd7f95c-1754-4408-b351-42bc7389fd7d tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:49.182119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8dd7f95c-1754-4408-b351-42bc7389fd7d tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:49.184702 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8dd7f95c-1754-4408-b351-42bc7389fd7d tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.307713 Aug 27 05:16:49.185672 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3430/6810] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:48 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:50.222234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b234911c-40f4-41f7-b10b-975feb2e8377 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:50.223081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b234911c-40f4-41f7-b10b-975feb2e8377 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:50.231584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:50.242648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b234911c-40f4-41f7-b10b-975feb2e8377 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:50.244790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b234911c-40f4-41f7-b10b-975feb2e8377 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:50.246766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b234911c-40f4-41f7-b10b-975feb2e8377 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:50.248298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b234911c-40f4-41f7-b10b-975feb2e8377 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:50.250138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b234911c-40f4-41f7-b10b-975feb2e8377 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:50.251950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b234911c-40f4-41f7-b10b-975feb2e8377 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:50.464741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b234911c-40f4-41f7-b10b-975feb2e8377 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:50.475902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b234911c-40f4-41f7-b10b-975feb2e8377 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:50.486852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b234911c-40f4-41f7-b10b-975feb2e8377 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:50.488794 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b234911c-40f4-41f7-b10b-975feb2e8377 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.272506 Aug 27 05:16:50.489735 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3381/6811] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:50 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:51.516401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a497b9d-4c29-4b7f-959c-536d6d8550f3 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:51.524735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a497b9d-4c29-4b7f-959c-536d6d8550f3 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:51.535088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a497b9d-4c29-4b7f-959c-536d6d8550f3 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:51.536134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a497b9d-4c29-4b7f-959c-536d6d8550f3 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:51.536913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a497b9d-4c29-4b7f-959c-536d6d8550f3 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:51.538899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a497b9d-4c29-4b7f-959c-536d6d8550f3 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:51.539809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a497b9d-4c29-4b7f-959c-536d6d8550f3 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:51.540995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a497b9d-4c29-4b7f-959c-536d6d8550f3 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:51.576370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:51.617007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:51.726022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a497b9d-4c29-4b7f-959c-536d6d8550f3 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:51.736508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a497b9d-4c29-4b7f-959c-536d6d8550f3 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:51.738157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a497b9d-4c29-4b7f-959c-536d6d8550f3 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:51.739486 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a497b9d-4c29-4b7f-959c-536d6d8550f3 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.228283 Aug 27 05:16:51.740245 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3431/6812] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:51 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:52.763929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-310937c3-7d36-448e-b145-560013e5a214 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:52.765281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-310937c3-7d36-448e-b145-560013e5a214 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:52.792332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-310937c3-7d36-448e-b145-560013e5a214 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:52.792884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-310937c3-7d36-448e-b145-560013e5a214 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:52.793466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-310937c3-7d36-448e-b145-560013e5a214 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:52.794054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-310937c3-7d36-448e-b145-560013e5a214 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:52.794898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-310937c3-7d36-448e-b145-560013e5a214 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:52.795444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-310937c3-7d36-448e-b145-560013e5a214 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:52.911851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-310937c3-7d36-448e-b145-560013e5a214 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:52.944070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-310937c3-7d36-448e-b145-560013e5a214 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:52.950844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-310937c3-7d36-448e-b145-560013e5a214 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:52.954665 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-310937c3-7d36-448e-b145-560013e5a214 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.195390 Aug 27 05:16:52.956755 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3382/6813] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:52 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:53.981780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38b73750-283b-46b9-abb0-f6d97ddb8478 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:53.982344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38b73750-283b-46b9-abb0-f6d97ddb8478 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:53.989365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38b73750-283b-46b9-abb0-f6d97ddb8478 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:53.989878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38b73750-283b-46b9-abb0-f6d97ddb8478 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:53.990334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38b73750-283b-46b9-abb0-f6d97ddb8478 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:53.991066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38b73750-283b-46b9-abb0-f6d97ddb8478 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:53.991541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38b73750-283b-46b9-abb0-f6d97ddb8478 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:53.991986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38b73750-283b-46b9-abb0-f6d97ddb8478 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:54.082119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-38b73750-283b-46b9-abb0-f6d97ddb8478 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:54.091354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-38b73750-283b-46b9-abb0-f6d97ddb8478 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:54.093112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-38b73750-283b-46b9-abb0-f6d97ddb8478 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:54.094984 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-38b73750-283b-46b9-abb0-f6d97ddb8478 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.116689 Aug 27 05:16:54.095727 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3432/6814] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:53 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:55.118257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c086aca9-ac3e-4755-b3f9-75e32e1205c6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:55.118915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c086aca9-ac3e-4755-b3f9-75e32e1205c6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:55.126376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c086aca9-ac3e-4755-b3f9-75e32e1205c6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:55.126875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c086aca9-ac3e-4755-b3f9-75e32e1205c6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:55.127373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c086aca9-ac3e-4755-b3f9-75e32e1205c6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:55.128210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c086aca9-ac3e-4755-b3f9-75e32e1205c6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:55.128625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c086aca9-ac3e-4755-b3f9-75e32e1205c6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:55.129114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c086aca9-ac3e-4755-b3f9-75e32e1205c6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:55.205402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c086aca9-ac3e-4755-b3f9-75e32e1205c6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:55.214894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c086aca9-ac3e-4755-b3f9-75e32e1205c6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:55.217099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c086aca9-ac3e-4755-b3f9-75e32e1205c6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:55.218317 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c086aca9-ac3e-4755-b3f9-75e32e1205c6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.104261 Aug 27 05:16:55.218881 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3383/6815] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:55 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:56.243033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25f26f45-a24f-4ad8-8d83-87315bcbd1e2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:56.243717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25f26f45-a24f-4ad8-8d83-87315bcbd1e2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:56.251911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25f26f45-a24f-4ad8-8d83-87315bcbd1e2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:56.252697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25f26f45-a24f-4ad8-8d83-87315bcbd1e2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:56.253178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25f26f45-a24f-4ad8-8d83-87315bcbd1e2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:56.253943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25f26f45-a24f-4ad8-8d83-87315bcbd1e2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:56.254386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25f26f45-a24f-4ad8-8d83-87315bcbd1e2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:56.254834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25f26f45-a24f-4ad8-8d83-87315bcbd1e2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:56.367769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25f26f45-a24f-4ad8-8d83-87315bcbd1e2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:56.376677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25f26f45-a24f-4ad8-8d83-87315bcbd1e2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:56.378316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25f26f45-a24f-4ad8-8d83-87315bcbd1e2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:56.379806 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25f26f45-a24f-4ad8-8d83-87315bcbd1e2 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.141909 Aug 27 05:16:56.382592 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3433/6816] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:56 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:57.403984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f8f573c4-b478-481f-8613-7a02bc98e6cb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:57.405432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f8f573c4-b478-481f-8613-7a02bc98e6cb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:57.413953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8f573c4-b478-481f-8613-7a02bc98e6cb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:57.414653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8f573c4-b478-481f-8613-7a02bc98e6cb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:57.415104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8f573c4-b478-481f-8613-7a02bc98e6cb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:57.415993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8f573c4-b478-481f-8613-7a02bc98e6cb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:57.416679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8f573c4-b478-481f-8613-7a02bc98e6cb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:57.417295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8f573c4-b478-481f-8613-7a02bc98e6cb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:57.486911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:57.493159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f8f573c4-b478-481f-8613-7a02bc98e6cb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:57.502444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f8f573c4-b478-481f-8613-7a02bc98e6cb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:57.504319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f8f573c4-b478-481f-8613-7a02bc98e6cb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:57.506437 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f8f573c4-b478-481f-8613-7a02bc98e6cb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.105827 Aug 27 05:16:57.507604 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3384/6817] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:57 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:58.531525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14207893-ede9-4bdd-9290-f5eb2f72141a tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:58.532336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14207893-ede9-4bdd-9290-f5eb2f72141a tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:58.540060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14207893-ede9-4bdd-9290-f5eb2f72141a tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:58.540978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14207893-ede9-4bdd-9290-f5eb2f72141a tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:58.541723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14207893-ede9-4bdd-9290-f5eb2f72141a tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:58.542547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14207893-ede9-4bdd-9290-f5eb2f72141a tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:58.543308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14207893-ede9-4bdd-9290-f5eb2f72141a tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:58.543762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14207893-ede9-4bdd-9290-f5eb2f72141a tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:58.645231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14207893-ede9-4bdd-9290-f5eb2f72141a tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:58.654225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14207893-ede9-4bdd-9290-f5eb2f72141a tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:58.655693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14207893-ede9-4bdd-9290-f5eb2f72141a tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:58.656917 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14207893-ede9-4bdd-9290-f5eb2f72141a tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.129387 Aug 27 05:16:58.657489 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3434/6818] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:58 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:16:59.681980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bd7de2c0-4a08-42a4-bfbf-a42b234440b6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:16:59.682580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bd7de2c0-4a08-42a4-bfbf-a42b234440b6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:16:59.692398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd7de2c0-4a08-42a4-bfbf-a42b234440b6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:59.694300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd7de2c0-4a08-42a4-bfbf-a42b234440b6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:59.695223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd7de2c0-4a08-42a4-bfbf-a42b234440b6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:59.696113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd7de2c0-4a08-42a4-bfbf-a42b234440b6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:16:59.696981 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd7de2c0-4a08-42a4-bfbf-a42b234440b6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:16:59.697585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bd7de2c0-4a08-42a4-bfbf-a42b234440b6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:16:59.836759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bd7de2c0-4a08-42a4-bfbf-a42b234440b6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:59.845250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bd7de2c0-4a08-42a4-bfbf-a42b234440b6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:59.846708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bd7de2c0-4a08-42a4-bfbf-a42b234440b6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:16:59.847887 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bd7de2c0-4a08-42a4-bfbf-a42b234440b6 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.170907 Aug 27 05:16:59.848665 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3385/6819] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:16:59 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:00.871499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25ea2c01-eba8-43c6-a41f-be86623b1a55 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:00.877797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25ea2c01-eba8-43c6-a41f-be86623b1a55 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:00.890228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25ea2c01-eba8-43c6-a41f-be86623b1a55 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:00.890753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25ea2c01-eba8-43c6-a41f-be86623b1a55 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:00.891212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25ea2c01-eba8-43c6-a41f-be86623b1a55 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:00.892134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25ea2c01-eba8-43c6-a41f-be86623b1a55 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:00.892668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25ea2c01-eba8-43c6-a41f-be86623b1a55 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:00.893124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25ea2c01-eba8-43c6-a41f-be86623b1a55 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:00.973472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25ea2c01-eba8-43c6-a41f-be86623b1a55 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:00.981663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25ea2c01-eba8-43c6-a41f-be86623b1a55 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:00.983129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25ea2c01-eba8-43c6-a41f-be86623b1a55 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:00.984318 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25ea2c01-eba8-43c6-a41f-be86623b1a55 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.116954 Aug 27 05:17:00.984917 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3435/6820] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:00 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:02.008354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-26892364-d325-41e2-a0cd-c912173f509f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:02.009267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-26892364-d325-41e2-a0cd-c912173f509f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:02.016150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26892364-d325-41e2-a0cd-c912173f509f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:02.016685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26892364-d325-41e2-a0cd-c912173f509f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:02.017130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26892364-d325-41e2-a0cd-c912173f509f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:02.017866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26892364-d325-41e2-a0cd-c912173f509f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:02.018339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26892364-d325-41e2-a0cd-c912173f509f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:02.018771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-26892364-d325-41e2-a0cd-c912173f509f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:02.021526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=62 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:02.098600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-26892364-d325-41e2-a0cd-c912173f509f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:02.108434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-26892364-d325-41e2-a0cd-c912173f509f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:02.109722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-26892364-d325-41e2-a0cd-c912173f509f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:02.111008 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-26892364-d325-41e2-a0cd-c912173f509f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.107435 Aug 27 05:17:02.112582 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3386/6821] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:02 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:03.136771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c9214956-b009-4145-a328-777039813fc1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:03.137526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c9214956-b009-4145-a328-777039813fc1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:03.144581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9214956-b009-4145-a328-777039813fc1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:03.145293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9214956-b009-4145-a328-777039813fc1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:03.145748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9214956-b009-4145-a328-777039813fc1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:03.147720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9214956-b009-4145-a328-777039813fc1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:03.148496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9214956-b009-4145-a328-777039813fc1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:03.149329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9214956-b009-4145-a328-777039813fc1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:03.217716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c9214956-b009-4145-a328-777039813fc1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:03.226099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c9214956-b009-4145-a328-777039813fc1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:03.227577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c9214956-b009-4145-a328-777039813fc1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:03.228882 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c9214956-b009-4145-a328-777039813fc1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.098073 Aug 27 05:17:03.229467 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3436/6822] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:03 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:04.252304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aff982f2-50c6-48ab-9e25-6e6e9f8730e9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:04.252864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aff982f2-50c6-48ab-9e25-6e6e9f8730e9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:04.260252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aff982f2-50c6-48ab-9e25-6e6e9f8730e9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:04.260788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aff982f2-50c6-48ab-9e25-6e6e9f8730e9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:04.261234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aff982f2-50c6-48ab-9e25-6e6e9f8730e9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:04.262171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aff982f2-50c6-48ab-9e25-6e6e9f8730e9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:04.262806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aff982f2-50c6-48ab-9e25-6e6e9f8730e9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:04.263250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aff982f2-50c6-48ab-9e25-6e6e9f8730e9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:04.341828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aff982f2-50c6-48ab-9e25-6e6e9f8730e9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:04.352089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aff982f2-50c6-48ab-9e25-6e6e9f8730e9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:04.354042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aff982f2-50c6-48ab-9e25-6e6e9f8730e9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:04.355499 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aff982f2-50c6-48ab-9e25-6e6e9f8730e9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.108160 Aug 27 05:17:04.356070 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3387/6823] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:04 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:05.379059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf8b4eac-72b1-4d25-ac02-3798a54b9910 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:05.380280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf8b4eac-72b1-4d25-ac02-3798a54b9910 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:05.387510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf8b4eac-72b1-4d25-ac02-3798a54b9910 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:05.388019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf8b4eac-72b1-4d25-ac02-3798a54b9910 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:05.388471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf8b4eac-72b1-4d25-ac02-3798a54b9910 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:05.389299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf8b4eac-72b1-4d25-ac02-3798a54b9910 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:05.389807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf8b4eac-72b1-4d25-ac02-3798a54b9910 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:05.390257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf8b4eac-72b1-4d25-ac02-3798a54b9910 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:05.459207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bf8b4eac-72b1-4d25-ac02-3798a54b9910 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:05.467809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bf8b4eac-72b1-4d25-ac02-3798a54b9910 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:05.469467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bf8b4eac-72b1-4d25-ac02-3798a54b9910 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:05.470693 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf8b4eac-72b1-4d25-ac02-3798a54b9910 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.096034 Aug 27 05:17:05.471279 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3437/6824] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:05 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:17:06.494947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-258c1bcc-861e-4953-ae8b-c1d0037df166 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:06.495653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-258c1bcc-861e-4953-ae8b-c1d0037df166 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:06.502802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-258c1bcc-861e-4953-ae8b-c1d0037df166 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:06.503292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-258c1bcc-861e-4953-ae8b-c1d0037df166 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:06.503730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-258c1bcc-861e-4953-ae8b-c1d0037df166 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:06.504429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-258c1bcc-861e-4953-ae8b-c1d0037df166 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:06.504915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-258c1bcc-861e-4953-ae8b-c1d0037df166 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:06.505349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-258c1bcc-861e-4953-ae8b-c1d0037df166 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:06.572879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-258c1bcc-861e-4953-ae8b-c1d0037df166 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:06.581078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-258c1bcc-861e-4953-ae8b-c1d0037df166 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:06.582459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-258c1bcc-861e-4953-ae8b-c1d0037df166 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:06.583623 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-258c1bcc-861e-4953-ae8b-c1d0037df166 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.093114 Aug 27 05:17:06.584181 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3388/6825] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:06 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:07.606869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2470e0e4-f99d-484a-91f8-b7e2fc60abd8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:07.607754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2470e0e4-f99d-484a-91f8-b7e2fc60abd8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:07.614776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2470e0e4-f99d-484a-91f8-b7e2fc60abd8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:07.615355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2470e0e4-f99d-484a-91f8-b7e2fc60abd8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:07.616314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2470e0e4-f99d-484a-91f8-b7e2fc60abd8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:07.617070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2470e0e4-f99d-484a-91f8-b7e2fc60abd8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:07.617580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2470e0e4-f99d-484a-91f8-b7e2fc60abd8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:07.618027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2470e0e4-f99d-484a-91f8-b7e2fc60abd8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:07.685948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2470e0e4-f99d-484a-91f8-b7e2fc60abd8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:07.694537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2470e0e4-f99d-484a-91f8-b7e2fc60abd8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:07.696015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2470e0e4-f99d-484a-91f8-b7e2fc60abd8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:07.697476 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2470e0e4-f99d-484a-91f8-b7e2fc60abd8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.094607 Aug 27 05:17:07.698050 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3438/6826] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:07 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:08.720789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-90cf054e-8d02-4200-ba69-4b70342794f1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:08.721471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-90cf054e-8d02-4200-ba69-4b70342794f1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:08.728376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90cf054e-8d02-4200-ba69-4b70342794f1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:08.729130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90cf054e-8d02-4200-ba69-4b70342794f1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:08.729366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90cf054e-8d02-4200-ba69-4b70342794f1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:08.730086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90cf054e-8d02-4200-ba69-4b70342794f1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:08.730551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90cf054e-8d02-4200-ba69-4b70342794f1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:08.730982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-90cf054e-8d02-4200-ba69-4b70342794f1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:08.800929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-90cf054e-8d02-4200-ba69-4b70342794f1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:08.810495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-90cf054e-8d02-4200-ba69-4b70342794f1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:08.811953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-90cf054e-8d02-4200-ba69-4b70342794f1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:08.813167 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-90cf054e-8d02-4200-ba69-4b70342794f1 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.096703 Aug 27 05:17:08.813743 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3389/6827] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:08 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:09.836898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0c3e04f-dd04-4e34-b689-27e4685bde61 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:09.837670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0c3e04f-dd04-4e34-b689-27e4685bde61 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:09.845417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c3e04f-dd04-4e34-b689-27e4685bde61 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:09.845934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c3e04f-dd04-4e34-b689-27e4685bde61 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:09.846395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c3e04f-dd04-4e34-b689-27e4685bde61 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:09.847125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c3e04f-dd04-4e34-b689-27e4685bde61 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:09.847605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c3e04f-dd04-4e34-b689-27e4685bde61 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:09.848085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c3e04f-dd04-4e34-b689-27e4685bde61 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:09.917950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0c3e04f-dd04-4e34-b689-27e4685bde61 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:09.926335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0c3e04f-dd04-4e34-b689-27e4685bde61 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:09.928484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0c3e04f-dd04-4e34-b689-27e4685bde61 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:09.929715 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0c3e04f-dd04-4e34-b689-27e4685bde61 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.096881 Aug 27 05:17:09.930298 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3439/6828] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:09 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:10.953547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-314fda3c-6791-4760-82ba-616b78a2d554 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:10.954126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-314fda3c-6791-4760-82ba-616b78a2d554 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:10.961887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-314fda3c-6791-4760-82ba-616b78a2d554 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:10.962373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-314fda3c-6791-4760-82ba-616b78a2d554 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:10.962914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-314fda3c-6791-4760-82ba-616b78a2d554 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:10.963719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-314fda3c-6791-4760-82ba-616b78a2d554 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:10.964920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-314fda3c-6791-4760-82ba-616b78a2d554 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:10.965965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-314fda3c-6791-4760-82ba-616b78a2d554 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:11.031563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-314fda3c-6791-4760-82ba-616b78a2d554 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:11.040093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-314fda3c-6791-4760-82ba-616b78a2d554 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:11.041583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-314fda3c-6791-4760-82ba-616b78a2d554 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:11.042771 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-314fda3c-6791-4760-82ba-616b78a2d554 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.093315 Aug 27 05:17:11.043343 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3390/6829] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:10 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:12.066553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4657dcfa-3c06-4d25-a61d-c9796780d42c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:12.067205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4657dcfa-3c06-4d25-a61d-c9796780d42c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:12.071773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:12.075763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657dcfa-3c06-4d25-a61d-c9796780d42c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:12.076487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657dcfa-3c06-4d25-a61d-c9796780d42c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:12.076983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657dcfa-3c06-4d25-a61d-c9796780d42c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:12.077686 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657dcfa-3c06-4d25-a61d-c9796780d42c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:12.078157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657dcfa-3c06-4d25-a61d-c9796780d42c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:12.078794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4657dcfa-3c06-4d25-a61d-c9796780d42c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:12.146465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4657dcfa-3c06-4d25-a61d-c9796780d42c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:12.155531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4657dcfa-3c06-4d25-a61d-c9796780d42c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:12.157089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4657dcfa-3c06-4d25-a61d-c9796780d42c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:12.158295 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4657dcfa-3c06-4d25-a61d-c9796780d42c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.095722 Aug 27 05:17:12.158864 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3440/6830] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:12 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:13.182479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1dd968cf-c189-49ce-be67-173239776c71 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:13.183099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1dd968cf-c189-49ce-be67-173239776c71 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:13.190072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dd968cf-c189-49ce-be67-173239776c71 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:13.190649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dd968cf-c189-49ce-be67-173239776c71 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:13.191100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dd968cf-c189-49ce-be67-173239776c71 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:13.191806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dd968cf-c189-49ce-be67-173239776c71 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:13.192267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dd968cf-c189-49ce-be67-173239776c71 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:13.192724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dd968cf-c189-49ce-be67-173239776c71 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:13.261751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1dd968cf-c189-49ce-be67-173239776c71 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:13.270024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1dd968cf-c189-49ce-be67-173239776c71 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:13.271484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1dd968cf-c189-49ce-be67-173239776c71 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:13.272686 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1dd968cf-c189-49ce-be67-173239776c71 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.094082 Aug 27 05:17:13.273261 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3391/6831] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:13 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:14.295709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c554ac6e-1472-4f2b-89b9-31b8ed9bac0f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:14.296448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c554ac6e-1472-4f2b-89b9-31b8ed9bac0f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:14.303615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c554ac6e-1472-4f2b-89b9-31b8ed9bac0f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:14.304118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c554ac6e-1472-4f2b-89b9-31b8ed9bac0f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:14.304590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c554ac6e-1472-4f2b-89b9-31b8ed9bac0f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:14.305303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c554ac6e-1472-4f2b-89b9-31b8ed9bac0f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:14.305774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c554ac6e-1472-4f2b-89b9-31b8ed9bac0f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:14.306420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c554ac6e-1472-4f2b-89b9-31b8ed9bac0f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:14.374674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c554ac6e-1472-4f2b-89b9-31b8ed9bac0f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:14.384052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c554ac6e-1472-4f2b-89b9-31b8ed9bac0f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:14.385860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c554ac6e-1472-4f2b-89b9-31b8ed9bac0f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:14.387065 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c554ac6e-1472-4f2b-89b9-31b8ed9bac0f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.095393 Aug 27 05:17:14.387667 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3441/6832] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:14 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:15.415432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-83d85b14-8ec2-4455-bd8f-51cd70e302b7 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:15.416081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-83d85b14-8ec2-4455-bd8f-51cd70e302b7 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:15.423247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83d85b14-8ec2-4455-bd8f-51cd70e302b7 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:15.423738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83d85b14-8ec2-4455-bd8f-51cd70e302b7 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:15.424178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83d85b14-8ec2-4455-bd8f-51cd70e302b7 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:15.424916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83d85b14-8ec2-4455-bd8f-51cd70e302b7 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:15.425379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83d85b14-8ec2-4455-bd8f-51cd70e302b7 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:15.425807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83d85b14-8ec2-4455-bd8f-51cd70e302b7 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:15.493641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-83d85b14-8ec2-4455-bd8f-51cd70e302b7 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:15.501845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-83d85b14-8ec2-4455-bd8f-51cd70e302b7 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:15.503286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-83d85b14-8ec2-4455-bd8f-51cd70e302b7 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:15.504475 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-83d85b14-8ec2-4455-bd8f-51cd70e302b7 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.093634 Aug 27 05:17:15.505074 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3392/6833] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:15 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:16.529222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96935e50-8014-4e38-8cd3-cd9765fb5874 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:16.529854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-96935e50-8014-4e38-8cd3-cd9765fb5874 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:16.536849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96935e50-8014-4e38-8cd3-cd9765fb5874 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:16.537351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96935e50-8014-4e38-8cd3-cd9765fb5874 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:16.537833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96935e50-8014-4e38-8cd3-cd9765fb5874 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:16.538552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96935e50-8014-4e38-8cd3-cd9765fb5874 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:16.539028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96935e50-8014-4e38-8cd3-cd9765fb5874 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:16.539470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96935e50-8014-4e38-8cd3-cd9765fb5874 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:16.607867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-96935e50-8014-4e38-8cd3-cd9765fb5874 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:16.617076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-96935e50-8014-4e38-8cd3-cd9765fb5874 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:16.618553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-96935e50-8014-4e38-8cd3-cd9765fb5874 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:16.619775 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96935e50-8014-4e38-8cd3-cd9765fb5874 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.094702 Aug 27 05:17:16.620341 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3442/6834] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:16 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:17.644857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6f2ba87a-9a21-461f-bcc4-affe65ca59f9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:17.645584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6f2ba87a-9a21-461f-bcc4-affe65ca59f9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:17.651883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f2ba87a-9a21-461f-bcc4-affe65ca59f9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:17.652376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f2ba87a-9a21-461f-bcc4-affe65ca59f9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:17.652838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f2ba87a-9a21-461f-bcc4-affe65ca59f9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:17.653536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f2ba87a-9a21-461f-bcc4-affe65ca59f9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:17.654022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f2ba87a-9a21-461f-bcc4-affe65ca59f9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:17.654891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f2ba87a-9a21-461f-bcc4-affe65ca59f9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:17.722682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6f2ba87a-9a21-461f-bcc4-affe65ca59f9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:17.732201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6f2ba87a-9a21-461f-bcc4-affe65ca59f9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:17.733703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6f2ba87a-9a21-461f-bcc4-affe65ca59f9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:17.734921 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6f2ba87a-9a21-461f-bcc4-affe65ca59f9 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.095725 Aug 27 05:17:17.735485 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3393/6835] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:17 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:18.758448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83e47a5e-1a6a-473b-b56e-a71001129d80 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:18.759079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-83e47a5e-1a6a-473b-b56e-a71001129d80 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:18.766982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83e47a5e-1a6a-473b-b56e-a71001129d80 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:18.767620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83e47a5e-1a6a-473b-b56e-a71001129d80 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:18.768156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83e47a5e-1a6a-473b-b56e-a71001129d80 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:18.769112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83e47a5e-1a6a-473b-b56e-a71001129d80 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:18.769569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83e47a5e-1a6a-473b-b56e-a71001129d80 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:18.770334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83e47a5e-1a6a-473b-b56e-a71001129d80 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:18.773282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=83 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:18.838785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83e47a5e-1a6a-473b-b56e-a71001129d80 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:18.847334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83e47a5e-1a6a-473b-b56e-a71001129d80 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:18.848840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83e47a5e-1a6a-473b-b56e-a71001129d80 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:18.850655 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83e47a5e-1a6a-473b-b56e-a71001129d80 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.096510 Aug 27 05:17:18.851238 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3443/6836] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:18 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:19.874809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-912a3886-0857-467d-8f6f-b7f2e5141f8e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:19.875429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-912a3886-0857-467d-8f6f-b7f2e5141f8e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:19.882784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-912a3886-0857-467d-8f6f-b7f2e5141f8e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:19.883274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-912a3886-0857-467d-8f6f-b7f2e5141f8e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:19.883726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-912a3886-0857-467d-8f6f-b7f2e5141f8e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:19.884794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-912a3886-0857-467d-8f6f-b7f2e5141f8e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:19.885457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-912a3886-0857-467d-8f6f-b7f2e5141f8e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:19.885899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-912a3886-0857-467d-8f6f-b7f2e5141f8e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:19.950735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-912a3886-0857-467d-8f6f-b7f2e5141f8e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:19.958944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-912a3886-0857-467d-8f6f-b7f2e5141f8e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:19.960925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-912a3886-0857-467d-8f6f-b7f2e5141f8e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:19.962103 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-912a3886-0857-467d-8f6f-b7f2e5141f8e tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1408 microversion: 2.54 time: 0.091354 Aug 27 05:17:19.962716 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3394/6837] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:19 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1408 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:20.986678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f17b84e-6677-4112-a2b6-2e5967f3db36 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:20.987323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f17b84e-6677-4112-a2b6-2e5967f3db36 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:20.996156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f17b84e-6677-4112-a2b6-2e5967f3db36 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:20.996738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f17b84e-6677-4112-a2b6-2e5967f3db36 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:20.997198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f17b84e-6677-4112-a2b6-2e5967f3db36 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:20.997975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f17b84e-6677-4112-a2b6-2e5967f3db36 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:20.999028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f17b84e-6677-4112-a2b6-2e5967f3db36 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:20.999028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f17b84e-6677-4112-a2b6-2e5967f3db36 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:21.071912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f17b84e-6677-4112-a2b6-2e5967f3db36 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:21.080744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f17b84e-6677-4112-a2b6-2e5967f3db36 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:21.082238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f17b84e-6677-4112-a2b6-2e5967f3db36 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:21.083438 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f17b84e-6677-4112-a2b6-2e5967f3db36 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1414 microversion: 2.54 time: 0.101437 Aug 27 05:17:21.084194 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3444/6838] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:20 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:22.110430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-361a2269-9bba-4ae2-8522-e5e2f8006d3b tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:22.111122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-361a2269-9bba-4ae2-8522-e5e2f8006d3b tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:22.113904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=28 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:22.119583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-361a2269-9bba-4ae2-8522-e5e2f8006d3b tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:22.120336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-361a2269-9bba-4ae2-8522-e5e2f8006d3b tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:22.120874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-361a2269-9bba-4ae2-8522-e5e2f8006d3b tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:22.121584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-361a2269-9bba-4ae2-8522-e5e2f8006d3b tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:22.122172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-361a2269-9bba-4ae2-8522-e5e2f8006d3b tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:22.122605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-361a2269-9bba-4ae2-8522-e5e2f8006d3b tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:22.188631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-361a2269-9bba-4ae2-8522-e5e2f8006d3b tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:22.197651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-361a2269-9bba-4ae2-8522-e5e2f8006d3b tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:22.199724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-361a2269-9bba-4ae2-8522-e5e2f8006d3b tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:22.200940 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-361a2269-9bba-4ae2-8522-e5e2f8006d3b tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1414 microversion: 2.54 time: 0.095030 Aug 27 05:17:22.201513 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3395/6839] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:22 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:17:23.227125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-338ee016-750a-4830-a830-a31c2e3a3014 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:23.227767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-338ee016-750a-4830-a830-a31c2e3a3014 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:23.236891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-338ee016-750a-4830-a830-a31c2e3a3014 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:23.236891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-338ee016-750a-4830-a830-a31c2e3a3014 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:23.236891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-338ee016-750a-4830-a830-a31c2e3a3014 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:23.236891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-338ee016-750a-4830-a830-a31c2e3a3014 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:23.236891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-338ee016-750a-4830-a830-a31c2e3a3014 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:23.237374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-338ee016-750a-4830-a830-a31c2e3a3014 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:23.307287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-338ee016-750a-4830-a830-a31c2e3a3014 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:23.315822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-338ee016-750a-4830-a830-a31c2e3a3014 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:23.317327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-338ee016-750a-4830-a830-a31c2e3a3014 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:23.318579 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-338ee016-750a-4830-a830-a31c2e3a3014 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1414 microversion: 2.54 time: 0.096162 Aug 27 05:17:23.319137 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3445/6840] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:23 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:24.341498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-69c3325c-8e18-4d25-b1fd-b6208d7e5173 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:24.342239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-69c3325c-8e18-4d25-b1fd-b6208d7e5173 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:24.349260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69c3325c-8e18-4d25-b1fd-b6208d7e5173 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:24.349776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69c3325c-8e18-4d25-b1fd-b6208d7e5173 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:24.350215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69c3325c-8e18-4d25-b1fd-b6208d7e5173 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:24.351123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69c3325c-8e18-4d25-b1fd-b6208d7e5173 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:24.351607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69c3325c-8e18-4d25-b1fd-b6208d7e5173 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:24.352726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69c3325c-8e18-4d25-b1fd-b6208d7e5173 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:24.420970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-69c3325c-8e18-4d25-b1fd-b6208d7e5173 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:24.429847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-69c3325c-8e18-4d25-b1fd-b6208d7e5173 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:24.432936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-69c3325c-8e18-4d25-b1fd-b6208d7e5173 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:24.434652 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-69c3325c-8e18-4d25-b1fd-b6208d7e5173 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1414 microversion: 2.54 time: 0.097179 Aug 27 05:17:24.435475 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3396/6841] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:24 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 05:17:25.458727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed12e99f-4ae1-4001-bb1d-e2f1761d00b8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:25.459283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ed12e99f-4ae1-4001-bb1d-e2f1761d00b8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:25.466727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed12e99f-4ae1-4001-bb1d-e2f1761d00b8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:25.467481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed12e99f-4ae1-4001-bb1d-e2f1761d00b8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:25.467929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed12e99f-4ae1-4001-bb1d-e2f1761d00b8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:25.468846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed12e99f-4ae1-4001-bb1d-e2f1761d00b8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:25.469351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed12e99f-4ae1-4001-bb1d-e2f1761d00b8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:25.469786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed12e99f-4ae1-4001-bb1d-e2f1761d00b8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:25.545483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed12e99f-4ae1-4001-bb1d-e2f1761d00b8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:25.555860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed12e99f-4ae1-4001-bb1d-e2f1761d00b8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:25.557691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed12e99f-4ae1-4001-bb1d-e2f1761d00b8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:25.558964 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ed12e99f-4ae1-4001-bb1d-e2f1761d00b8 tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1399 microversion: 2.54 time: 0.104920 Aug 27 05:17:25.559548 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3446/6842] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:25 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1399 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:25.582099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a87f2a8d-51ae-478a-aa22-357739a7e29c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '.version_select at 0x7f1f20aac160>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:25.604938 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a87f2a8d-51ae-478a-aa22-357739a7e29c tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-810234104" status: 204 len: 0 microversion: 2.54 time: 0.026911 Aug 27 05:17:25.605551 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3397/6843] 10.222.0.79 () {60 vars in 1316 bytes} [Sat Aug 27 05:17:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-810234104 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:17:25.621964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6dfa41a-095b-49da-8f6f-73321fd238ba tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:25.622481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6dfa41a-095b-49da-8f6f-73321fd238ba tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:25.629026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6dfa41a-095b-49da-8f6f-73321fd238ba tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:25.629532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6dfa41a-095b-49da-8f6f-73321fd238ba tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:25.629981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6dfa41a-095b-49da-8f6f-73321fd238ba tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:25.630697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6dfa41a-095b-49da-8f6f-73321fd238ba tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:25.631164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6dfa41a-095b-49da-8f6f-73321fd238ba tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:25.631605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6dfa41a-095b-49da-8f6f-73321fd238ba tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:25.657349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6dfa41a-095b-49da-8f6f-73321fd238ba tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:17:25.735635 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6dfa41a-095b-49da-8f6f-73321fd238ba tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 204 len: 0 microversion: 2.54 time: 0.118217 Aug 27 05:17:25.736356 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3447/6844] 10.222.0.79 () {60 vars in 1280 bytes} [Sat Aug 27 05:17:25 2022] DELETE /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 05:17:25.745283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b97fd159-049b-42c1-b928-1902780f58ce tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:25.745901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b97fd159-049b-42c1-b928-1902780f58ce tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:25.752809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b97fd159-049b-42c1-b928-1902780f58ce tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:25.753528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b97fd159-049b-42c1-b928-1902780f58ce tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:25.754122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b97fd159-049b-42c1-b928-1902780f58ce tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:25.754975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b97fd159-049b-42c1-b928-1902780f58ce tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:25.755587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b97fd159-049b-42c1-b928-1902780f58ce tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:25.756177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b97fd159-049b-42c1-b928-1902780f58ce tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:25.827765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b97fd159-049b-42c1-b928-1902780f58ce tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:25.837795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b97fd159-049b-42c1-b928-1902780f58ce tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:25.839243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b97fd159-049b-42c1-b928-1902780f58ce tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:25.840640 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b97fd159-049b-42c1-b928-1902780f58ce tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1405 microversion: 2.54 time: 0.100167 Aug 27 05:17:25.841207 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3398/6845] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:25 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1405 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:26.864681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-036daeb5-2181-4f7c-9e97-6c034072b67f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:26.865422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-036daeb5-2181-4f7c-9e97-6c034072b67f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:26.872561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036daeb5-2181-4f7c-9e97-6c034072b67f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:26.873066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036daeb5-2181-4f7c-9e97-6c034072b67f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:26.873726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036daeb5-2181-4f7c-9e97-6c034072b67f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:26.874443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036daeb5-2181-4f7c-9e97-6c034072b67f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:26.875075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036daeb5-2181-4f7c-9e97-6c034072b67f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:26.875658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036daeb5-2181-4f7c-9e97-6c034072b67f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:26.942249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-036daeb5-2181-4f7c-9e97-6c034072b67f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:26.950848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-036daeb5-2181-4f7c-9e97-6c034072b67f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:26.952341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-036daeb5-2181-4f7c-9e97-6c034072b67f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4b2675391f14be890a0d801d63449b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9936d1768ca44b9ab75f5772870a706b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:17:26.953615 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-036daeb5-2181-4f7c-9e97-6c034072b67f tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 200 len: 1405 microversion: 2.54 time: 0.093377 Aug 27 05:17:26.954195 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3448/6846] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:26 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 1405 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 05:17:27.981835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-389b6de6-b7a8-4761-97af-2852220fcdfb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:27.983827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-389b6de6-b7a8-4761-97af-2852220fcdfb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] [instance: 0a881d2a-c425-4814-b119-117fb89b71b5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:17:27.991211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-389b6de6-b7a8-4761-97af-2852220fcdfb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:27.991702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-389b6de6-b7a8-4761-97af-2852220fcdfb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:27.992149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-389b6de6-b7a8-4761-97af-2852220fcdfb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:27.993490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-389b6de6-b7a8-4761-97af-2852220fcdfb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:17:27.993937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-389b6de6-b7a8-4761-97af-2852220fcdfb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:17:27.994373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-389b6de6-b7a8-4761-97af-2852220fcdfb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:17:28.011456 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-389b6de6-b7a8-4761-97af-2852220fcdfb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] HTTP exception thrown: Instance 0a881d2a-c425-4814-b119-117fb89b71b5 could not be found. Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-389b6de6-b7a8-4761-97af-2852220fcdfb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Request method failure captured: Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 HTTP/1.1 Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCai5JDfeD3gYa-C4YfUqRb9w1MZNkK1Hj534e_dzpuI1i6H9Qhm0dZln1y2bTfeBtfXjXXk0nh61hVpjtn_kYkFpj122gmE1iokcaVPnrMFXVv-CAgH4JGpJqQn0H6gXlaX4s95c8bcCEXD53QL9Y2Y9r0podxY6fhiVgbr3d5m-eNU Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Openstack-Nova-Api-Version: 2.54 Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 9936d1768ca44b9ab75f5772870a706b Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerShowV254Test-1275546723 Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9936d1768ca44b9ab75f5772870a706b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9936d1768ca44b9ab75f5772870a706b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9936d1768ca44b9ab75f5772870a706b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9936d1768ca44b9ab75f5772870a706b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerShowV254Test-1275546723 Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 9936d1768ca44b9ab75f5772870a706b Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerShowV254Test-1275546723 Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerShowV254Test-1275546723-project Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: a4b2675391f14be890a0d801d63449b8 Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerShowV254Test-1275546723-project Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 0a881d2a-c425-4814-b119-117fb89b71b5 could not be found. Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '0a881d2a-c425-4814-b119-117fb89b71b5'} Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a881d2a-c425-4814-b119-117fb89b71b5 could not be found. Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a881d2a-c425-4814-b119-117fb89b71b5 could not be found. Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:17:28.013054 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:17:28.018334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:17:28.018334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:17:28.018334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:17:28.018334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:17:28.018334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:17:28.018334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a881d2a-c425-4814-b119-117fb89b71b5 could not be found. Aug 27 05:17:28.018334 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:17:28.018334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-389b6de6-b7a8-4761-97af-2852220fcdfb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] Returning 404 to user: Instance 0a881d2a-c425-4814-b119-117fb89b71b5 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:17:28.018334 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-389b6de6-b7a8-4761-97af-2852220fcdfb tempest-ServerShowV254Test-1275546723 tempest-ServerShowV254Test-1275546723-project] 10.222.0.79 "GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5" status: 404 len: 111 microversion: 2.54 time: 0.039618 Aug 27 05:17:28.018334 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3399/6847] 10.222.0.79 () {60 vars in 1277 bytes} [Sat Aug 27 05:17:27 2022] GET /compute/v2.1/servers/0a881d2a-c425-4814-b119-117fb89b71b5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:17:29.694625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c65f05e6-1825-4229-9d05-f3787dc7537a tempest-ExtensionsTest-707170721 tempest-ExtensionsTest-707170721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:29.697601 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c65f05e6-1825-4229-9d05-f3787dc7537a tempest-ExtensionsTest-707170721 tempest-ExtensionsTest-707170721-project] 10.222.0.79 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.141359 Aug 27 05:17:29.698288 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3449/6848] 10.222.0.79 () {58 vars in 1170 bytes} [Sat Aug 27 05:17:29 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:29.707293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c2f249ff-9589-412a-bd69-853890eac482 tempest-ExtensionsTest-707170721 tempest-ExtensionsTest-707170721-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:29.709538 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c2f249ff-9589-412a-bd69-853890eac482 tempest-ExtensionsTest-707170721 tempest-ExtensionsTest-707170721-project] 10.222.0.79 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006142 Aug 27 05:17:29.710150 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3400/6849] 10.222.0.79 () {58 vars in 1134 bytes} [Sat Aug 27 05:17:29 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:17:31.490370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3c6d908-d094-4a22-abbc-73e82c22fa36 tempest-QuotasTestJSON-353348328 tempest-QuotasTestJSON-353348328-project] Calling method '.version_select at 0x7f1f21008430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:31.551115 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3c6d908-d094-4a22-abbc-73e82c22fa36 tempest-QuotasTestJSON-353348328 tempest-QuotasTestJSON-353348328-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/d2e1a9e18bc74158a5a1ec0c15db9488/defaults" status: 200 len: 371 microversion: 2.1 time: 0.295190 Aug 27 05:17:31.551779 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3450/6850] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 05:17:31 2022] GET /compute/v2.1/os-quota-sets/d2e1a9e18bc74158a5a1ec0c15db9488/defaults => generated 371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:31.566552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c5013902-6dca-4eb7-a447-35f6366aa571 tempest-QuotasTestJSON-353348328 tempest-QuotasTestJSON-353348328-project] Calling method '.version_select at 0x7f1f21125ca0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:31.647334 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c5013902-6dca-4eb7-a447-35f6366aa571 tempest-QuotasTestJSON-353348328 tempest-QuotasTestJSON-353348328-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/d2e1a9e18bc74158a5a1ec0c15db9488" status: 200 len: 371 microversion: 2.1 time: 0.086052 Aug 27 05:17:31.647943 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3401/6851] 10.222.0.79 () {58 vars in 1242 bytes} [Sat Aug 27 05:17:31 2022] GET /compute/v2.1/os-quota-sets/d2e1a9e18bc74158a5a1ec0c15db9488 => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:31.662216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-610f7063-8e73-4b95-866f-6ee46574eaad tempest-QuotasTestJSON-353348328 tempest-QuotasTestJSON-353348328-project] Calling method '.version_select at 0x7f1f218f3430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:31.722052 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-610f7063-8e73-4b95-866f-6ee46574eaad tempest-QuotasTestJSON-353348328 tempest-QuotasTestJSON-353348328-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/d2e1a9e18bc74158a5a1ec0c15db9488/defaults" status: 200 len: 371 microversion: 2.1 time: 0.063664 Aug 27 05:17:31.722785 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3451/6852] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 05:17:31 2022] GET /compute/v2.1/os-quota-sets/d2e1a9e18bc74158a5a1ec0c15db9488/defaults => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:31.736291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-772a9ded-5db7-48bc-b16a-b1120a1ec020 tempest-QuotasTestJSON-353348328 tempest-QuotasTestJSON-353348328-project] Calling method '.version_select at 0x7f1f25e4a670>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:31.802891 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-772a9ded-5db7-48bc-b16a-b1120a1ec020 tempest-QuotasTestJSON-353348328 tempest-QuotasTestJSON-353348328-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/d2e1a9e18bc74158a5a1ec0c15db9488" status: 200 len: 371 microversion: 2.1 time: 0.070661 Aug 27 05:17:31.803582 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3402/6853] 10.222.0.79 () {58 vars in 1242 bytes} [Sat Aug 27 05:17:31 2022] GET /compute/v2.1/os-quota-sets/d2e1a9e18bc74158a5a1ec0c15db9488 => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:31.814970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8db84c5-54b0-45a6-9c08-f5a875fd587c tempest-QuotasTestJSON-353348328 tempest-QuotasTestJSON-353348328-project] Calling method '.version_select at 0x7f1f218d9a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:31.903186 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8db84c5-54b0-45a6-9c08-f5a875fd587c tempest-QuotasTestJSON-353348328 tempest-QuotasTestJSON-353348328-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/d2e1a9e18bc74158a5a1ec0c15db9488?user_id=f391c22e10ad45c49d540a766fb08d36" status: 200 len: 371 microversion: 2.1 time: 0.092108 Aug 27 05:17:31.911815 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3452/6854] 10.222.0.79 () {58 vars in 1323 bytes} [Sat Aug 27 05:17:31 2022] GET /compute/v2.1/os-quota-sets/d2e1a9e18bc74158a5a1ec0c15db9488?user_id=f391c22e10ad45c49d540a766fb08d36 => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:33.983707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-be7a8f93-efec-455a-ac9d-c578fe6bff44 tempest-ComputeTenantNetworksTest-1679163250 tempest-ComputeTenantNetworksTest-1679163250-project] Calling method '.version_select at 0x7f1f213fe0d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:34.191978 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-be7a8f93-efec-455a-ac9d-c578fe6bff44 tempest-ComputeTenantNetworksTest-1679163250 tempest-ComputeTenantNetworksTest-1679163250-project] 10.222.0.79 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.330976 Aug 27 05:17:34.192680 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3403/6855] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 05:17:33 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:17:34.203826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0aa39a68-da58-4d2b-8d8e-f76ca6242834 tempest-ComputeTenantNetworksTest-1679163250 tempest-ComputeTenantNetworksTest-1679163250-project] Calling method '.version_select at 0x7f1f21dd74c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:17:34.299530 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0aa39a68-da58-4d2b-8d8e-f76ca6242834 tempest-ComputeTenantNetworksTest-1679163250 tempest-ComputeTenantNetworksTest-1679163250-project] 10.222.0.79 "GET /compute/v2.1/os-tenant-networks/1eb06d4d-ee59-455d-89a8-0ec182d5db18" status: 200 len: 140 microversion: 2.1 time: 0.099435 Aug 27 05:17:34.307165 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3453/6856] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 05:17:34 2022] GET /compute/v2.1/os-tenant-networks/1eb06d4d-ee59-455d-89a8-0ec182d5db18 => generated 140 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:29.794984 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30b4270-6763-4864-8153-10d27fd192b5] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 05:23:29.795797 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2badfd4b-a808-402a-925c-31461d1cb878] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 05:23:29.796754 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 05:23:29.796900 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 05:23:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.79) !!! Aug 27 05:23:29.797793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=73 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:29.798745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:29.799226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:29.800162 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 05:23:29.800397 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 05:23:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.79) !!! Aug 27 05:23:29.801499 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 05:23:29.801632 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 05:23:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.79) !!! Aug 27 05:23:29.812114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8db73a25-0f03-49f3-bf47-e71e9daf8198 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Action: 'create', calling method: .version_select at 0x7f1f21a04820>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1491669495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY+abRiqq0cONUNieCRZUcF6P3ESxWXfwIenHPDifW4TcyG2RcMxqI0mBJPbdtIz5PBLa1i+w0wYgW7+f/DIVr6Ve7Karw2cyz2jkIe1qBkirO8ulVEI12ty0BSvOyhTg=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:29.831286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-8db73a25-0f03-49f3-bf47-e71e9daf8198 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Getting quotas for project db6a40b9a5e947fab83d42c1f2485e08. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:23:29.836275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-8db73a25-0f03-49f3-bf47-e71e9daf8198 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Getting quotas for user 06d192270bb6485f995f3f8f9b378ee7 and project db6a40b9a5e947fab83d42c1f2485e08. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:23:29.865480 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8db73a25-0f03-49f3-bf47-e71e9daf8198 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.072002 Aug 27 05:23:29.866013 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3404/6857] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:23:29 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:30.827990 n-d-854823-1 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c18b0a9-ed40-4090-a136-c7167e1677a5] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 05:23:30.828972 n-d-854823-1 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5167bf5-c65d-49e1-967f-4d4da9273246] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 05:23:30.829480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:30.830269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:30.831008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:30.832042 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:23:30.832191 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:23:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.79) !!! Aug 27 05:23:30.834843 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:23:30.834971 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:23:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.79) !!! Aug 27 05:23:30.837035 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 05:23:30.837179 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:23:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.79) !!! Aug 27 05:23:30.843671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-241989731", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "dc40eb91-e44c-4da0-b094-83a761747131", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1491669495", "security_groups": [{"name": "tempest-secgroup-smoke-262658427"}], "networks": [{"uuid": "e8946536-dcfb-465b-a608-f1770441b86c"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:31.152347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] validate_networks() for [('e8946536-dcfb-465b-a608-f1770441b86c', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:23:31.844101 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5167bf5-c65d-49e1-967f-4d4da9273246] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40034. Aug 27 05:23:31.845944 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c18b0a9-ed40-4090-a136-c7167e1677a5] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40032. Aug 27 05:23:31.928315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:23:31.928801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:23:31.929296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:23:31.929726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:23:31.930157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:23:31.939288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:31.939788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:31.940241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:31.941035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:31.941511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:31.941958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:31.959667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Getting quotas for project db6a40b9a5e947fab83d42c1f2485e08. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:23:31.965544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Getting quotas for user 06d192270bb6485f995f3f8f9b378ee7 and project db6a40b9a5e947fab83d42c1f2485e08. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:23:32.026206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:23:32.028379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc40eb91-e44c-4da0-b094-83a761747131',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:23:32.156831 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4fe2920d-8167-4b96-a631-c0472b1f78dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.330531 Aug 27 05:23:32.157508 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3454/6858] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:23:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:23:32.170061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ff3ed54-d0e6-45b3-8da7-22323ff5aab6 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:32.170686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1ff3ed54-d0e6-45b3-8da7-22323ff5aab6 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:32.183136 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30b4270-6763-4864-8153-10d27fd192b5] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40044. Aug 27 05:23:32.185825 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] [2badfd4b-a808-402a-925c-31461d1cb878] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40046. Aug 27 05:23:32.336436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1ff3ed54-d0e6-45b3-8da7-22323ff5aab6 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:32.344644 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1ff3ed54-d0e6-45b3-8da7-22323ff5aab6 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1098 microversion: 2.1 time: 0.180192 Aug 27 05:23:32.345231 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3405/6859] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:32 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1098 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:33.366252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98e8747f-97ec-4240-869d-5e5efe095656 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:33.366910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98e8747f-97ec-4240-869d-5e5efe095656 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:33.378068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e8747f-97ec-4240-869d-5e5efe095656 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:33.378779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e8747f-97ec-4240-869d-5e5efe095656 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:33.379248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e8747f-97ec-4240-869d-5e5efe095656 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:33.379986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e8747f-97ec-4240-869d-5e5efe095656 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:33.380465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e8747f-97ec-4240-869d-5e5efe095656 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:33.380940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e8747f-97ec-4240-869d-5e5efe095656 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:33.460895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-98e8747f-97ec-4240-869d-5e5efe095656 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:33.470121 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98e8747f-97ec-4240-869d-5e5efe095656 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1204 microversion: 2.1 time: 0.108703 Aug 27 05:23:33.471038 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3455/6860] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:33 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1204 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:34.491774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5391561d-f6b0-46ce-ba93-6cc44865dd12 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:34.492631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5391561d-f6b0-46ce-ba93-6cc44865dd12 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:34.501667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5391561d-f6b0-46ce-ba93-6cc44865dd12 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:34.502301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5391561d-f6b0-46ce-ba93-6cc44865dd12 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:34.502851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5391561d-f6b0-46ce-ba93-6cc44865dd12 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:34.503696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5391561d-f6b0-46ce-ba93-6cc44865dd12 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:34.504261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5391561d-f6b0-46ce-ba93-6cc44865dd12 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:34.504855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5391561d-f6b0-46ce-ba93-6cc44865dd12 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:34.654609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5391561d-f6b0-46ce-ba93-6cc44865dd12 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:34.663269 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5391561d-f6b0-46ce-ba93-6cc44865dd12 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1281 microversion: 2.1 time: 0.175423 Aug 27 05:23:34.664919 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3406/6861] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:34 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1281 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:34.927225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d12fcac6-440d-4897-a384-9d9969ba9b29 req-5786bdb5-ab0d-4f91-9f6d-8a788db67568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e047c0f-e987-4b3a-bded-c8e6f8e42931", "tag": "47134ce5-c70c-4703-8468-a127c8b06db4"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:34.938094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d12fcac6-440d-4897-a384-9d9969ba9b29 req-5786bdb5-ab0d-4f91-9f6d-8a788db67568 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:34.938862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d12fcac6-440d-4897-a384-9d9969ba9b29 req-5786bdb5-ab0d-4f91-9f6d-8a788db67568 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:34.939317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d12fcac6-440d-4897-a384-9d9969ba9b29 req-5786bdb5-ab0d-4f91-9f6d-8a788db67568 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:34.953079 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d12fcac6-440d-4897-a384-9d9969ba9b29 req-5786bdb5-ab0d-4f91-9f6d-8a788db67568 service nova] Creating event network-changed:47134ce5-c70c-4703-8468-a127c8b06db4 for instance 6e047c0f-e987-4b3a-bded-c8e6f8e42931 on n-h1-854823-1 Aug 27 05:23:34.959923 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d12fcac6-440d-4897-a384-9d9969ba9b29 req-5786bdb5-ab0d-4f91-9f6d-8a788db67568 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126819 Aug 27 05:23:34.961103 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3456/6862] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:35.685903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-adc29260-662e-4bab-897a-1c29e54c3048 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:35.686527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-adc29260-662e-4bab-897a-1c29e54c3048 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:35.693941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adc29260-662e-4bab-897a-1c29e54c3048 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:35.694449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adc29260-662e-4bab-897a-1c29e54c3048 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:35.695118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adc29260-662e-4bab-897a-1c29e54c3048 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:35.695856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adc29260-662e-4bab-897a-1c29e54c3048 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:35.696566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adc29260-662e-4bab-897a-1c29e54c3048 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:35.697204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-adc29260-662e-4bab-897a-1c29e54c3048 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:35.851831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-adc29260-662e-4bab-897a-1c29e54c3048 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:35.859915 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-adc29260-662e-4bab-897a-1c29e54c3048 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1281 microversion: 2.1 time: 0.178456 Aug 27 05:23:35.860499 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3407/6863] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:35 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1281 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:36.882082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ce61121-aba5-4ce2-9b32-df380375cd0d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:36.882959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0ce61121-aba5-4ce2-9b32-df380375cd0d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:36.891021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ce61121-aba5-4ce2-9b32-df380375cd0d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:36.891522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ce61121-aba5-4ce2-9b32-df380375cd0d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:36.891986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ce61121-aba5-4ce2-9b32-df380375cd0d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:36.892733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ce61121-aba5-4ce2-9b32-df380375cd0d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:36.893201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ce61121-aba5-4ce2-9b32-df380375cd0d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:36.893642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ce61121-aba5-4ce2-9b32-df380375cd0d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:37.084596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0ce61121-aba5-4ce2-9b32-df380375cd0d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:37.093696 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ce61121-aba5-4ce2-9b32-df380375cd0d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1281 microversion: 2.1 time: 0.216087 Aug 27 05:23:37.094287 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3457/6864] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:36 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1281 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:38.119410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ad1a8fd2-bba4-4108-848e-f8334ac19b64 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:38.120347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ad1a8fd2-bba4-4108-848e-f8334ac19b64 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:38.129547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad1a8fd2-bba4-4108-848e-f8334ac19b64 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:38.130043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad1a8fd2-bba4-4108-848e-f8334ac19b64 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:38.130526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad1a8fd2-bba4-4108-848e-f8334ac19b64 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:38.131213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad1a8fd2-bba4-4108-848e-f8334ac19b64 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:38.131676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad1a8fd2-bba4-4108-848e-f8334ac19b64 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:38.132111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ad1a8fd2-bba4-4108-848e-f8334ac19b64 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:38.284602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ad1a8fd2-bba4-4108-848e-f8334ac19b64 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:38.299564 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ad1a8fd2-bba4-4108-848e-f8334ac19b64 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1281 microversion: 2.1 time: 0.187664 Aug 27 05:23:38.300393 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3408/6865] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:38 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:39.319866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8713ab19-bed9-4a9a-92db-65e9a9a108dd tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:39.320503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8713ab19-bed9-4a9a-92db-65e9a9a108dd tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:39.328471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8713ab19-bed9-4a9a-92db-65e9a9a108dd tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:39.329015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8713ab19-bed9-4a9a-92db-65e9a9a108dd tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:39.329481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8713ab19-bed9-4a9a-92db-65e9a9a108dd tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:39.330206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8713ab19-bed9-4a9a-92db-65e9a9a108dd tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:39.330687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8713ab19-bed9-4a9a-92db-65e9a9a108dd tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:39.331137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8713ab19-bed9-4a9a-92db-65e9a9a108dd tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:39.467519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8713ab19-bed9-4a9a-92db-65e9a9a108dd tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:39.475437 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8713ab19-bed9-4a9a-92db-65e9a9a108dd tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1269 microversion: 2.1 time: 0.159543 Aug 27 05:23:39.476054 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3458/6866] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:39 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:40.496635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-09e09723-5839-4378-975a-3f5b8e30bcd3 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:40.497262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-09e09723-5839-4378-975a-3f5b8e30bcd3 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:40.504284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09e09723-5839-4378-975a-3f5b8e30bcd3 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:40.504822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09e09723-5839-4378-975a-3f5b8e30bcd3 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:40.505261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09e09723-5839-4378-975a-3f5b8e30bcd3 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:40.505963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09e09723-5839-4378-975a-3f5b8e30bcd3 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:40.506424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09e09723-5839-4378-975a-3f5b8e30bcd3 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:40.506855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09e09723-5839-4378-975a-3f5b8e30bcd3 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:40.640838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-09e09723-5839-4378-975a-3f5b8e30bcd3 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:40.648816 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-09e09723-5839-4378-975a-3f5b8e30bcd3 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1269 microversion: 2.1 time: 0.156423 Aug 27 05:23:40.649394 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3409/6867] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:40 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:41.670162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f07d1151-c332-44dd-ad40-071e8bd54ea5 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:41.670799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f07d1151-c332-44dd-ad40-071e8bd54ea5 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:41.677860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f07d1151-c332-44dd-ad40-071e8bd54ea5 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.678366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f07d1151-c332-44dd-ad40-071e8bd54ea5 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.678823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f07d1151-c332-44dd-ad40-071e8bd54ea5 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.679542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f07d1151-c332-44dd-ad40-071e8bd54ea5 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:41.680018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f07d1151-c332-44dd-ad40-071e8bd54ea5 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:41.680465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f07d1151-c332-44dd-ad40-071e8bd54ea5 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:41.818644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f07d1151-c332-44dd-ad40-071e8bd54ea5 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:41.829449 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f07d1151-c332-44dd-ad40-071e8bd54ea5 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1269 microversion: 2.1 time: 0.163110 Aug 27 05:23:41.830118 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3459/6868] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:41 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:42.850430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4764a49a-c85b-4b54-a5e9-a4429639661f tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:42.851045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4764a49a-c85b-4b54-a5e9-a4429639661f tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:42.853757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:42.859023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4764a49a-c85b-4b54-a5e9-a4429639661f tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:42.859505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4764a49a-c85b-4b54-a5e9-a4429639661f tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:42.859940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4764a49a-c85b-4b54-a5e9-a4429639661f tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:42.860651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4764a49a-c85b-4b54-a5e9-a4429639661f tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:42.861107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4764a49a-c85b-4b54-a5e9-a4429639661f tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:42.861526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4764a49a-c85b-4b54-a5e9-a4429639661f tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:42.992640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4764a49a-c85b-4b54-a5e9-a4429639661f tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:43.000596 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4764a49a-c85b-4b54-a5e9-a4429639661f tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1269 microversion: 2.1 time: 0.153926 Aug 27 05:23:43.001114 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3410/6869] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:42 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:44.021951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29667915-ccf2-4130-9e83-578922db4aa2 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:44.022586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29667915-ccf2-4130-9e83-578922db4aa2 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:44.024582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:44.025277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:44.032287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29667915-ccf2-4130-9e83-578922db4aa2 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:44.032812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29667915-ccf2-4130-9e83-578922db4aa2 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:44.033266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29667915-ccf2-4130-9e83-578922db4aa2 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:44.034013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29667915-ccf2-4130-9e83-578922db4aa2 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:44.034485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29667915-ccf2-4130-9e83-578922db4aa2 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:44.034926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29667915-ccf2-4130-9e83-578922db4aa2 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:44.173702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29667915-ccf2-4130-9e83-578922db4aa2 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:44.181881 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29667915-ccf2-4130-9e83-578922db4aa2 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1269 microversion: 2.1 time: 0.164056 Aug 27 05:23:44.182479 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3460/6870] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:44 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:45.202523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef92bc3b-8033-40c7-8560-4fc611b82dde tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:45.203082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ef92bc3b-8033-40c7-8560-4fc611b82dde tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:45.209957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef92bc3b-8033-40c7-8560-4fc611b82dde tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:45.210447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef92bc3b-8033-40c7-8560-4fc611b82dde tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:45.210889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef92bc3b-8033-40c7-8560-4fc611b82dde tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:45.211587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef92bc3b-8033-40c7-8560-4fc611b82dde tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:45.212057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef92bc3b-8033-40c7-8560-4fc611b82dde tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:45.212617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef92bc3b-8033-40c7-8560-4fc611b82dde tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:45.345733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ef92bc3b-8033-40c7-8560-4fc611b82dde tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:45.353651 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ef92bc3b-8033-40c7-8560-4fc611b82dde tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1269 microversion: 2.1 time: 0.155240 Aug 27 05:23:45.354251 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3411/6871] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:45 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:46.375293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88e5e70f-0aa2-4de3-9cc1-b827a1a51eeb tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:46.375932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88e5e70f-0aa2-4de3-9cc1-b827a1a51eeb tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:46.382996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88e5e70f-0aa2-4de3-9cc1-b827a1a51eeb tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:46.383505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88e5e70f-0aa2-4de3-9cc1-b827a1a51eeb tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:46.384235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88e5e70f-0aa2-4de3-9cc1-b827a1a51eeb tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:46.384743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88e5e70f-0aa2-4de3-9cc1-b827a1a51eeb tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:46.385225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88e5e70f-0aa2-4de3-9cc1-b827a1a51eeb tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:46.385678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88e5e70f-0aa2-4de3-9cc1-b827a1a51eeb tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:46.520016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88e5e70f-0aa2-4de3-9cc1-b827a1a51eeb tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:46.528154 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88e5e70f-0aa2-4de3-9cc1-b827a1a51eeb tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1269 microversion: 2.1 time: 0.157430 Aug 27 05:23:46.528788 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3461/6872] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:46 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:47.548663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-70ffcc91-001e-4c5b-96fc-9f167f79d2a4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:47.549284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-70ffcc91-001e-4c5b-96fc-9f167f79d2a4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:47.556155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70ffcc91-001e-4c5b-96fc-9f167f79d2a4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:47.556682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70ffcc91-001e-4c5b-96fc-9f167f79d2a4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:47.557128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70ffcc91-001e-4c5b-96fc-9f167f79d2a4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:47.557830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70ffcc91-001e-4c5b-96fc-9f167f79d2a4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:47.558357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70ffcc91-001e-4c5b-96fc-9f167f79d2a4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:47.558792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70ffcc91-001e-4c5b-96fc-9f167f79d2a4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:47.691538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-70ffcc91-001e-4c5b-96fc-9f167f79d2a4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:47.700026 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-70ffcc91-001e-4c5b-96fc-9f167f79d2a4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1269 microversion: 2.1 time: 0.155352 Aug 27 05:23:47.700609 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3412/6873] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:47 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:48.720661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4b7783d-37bd-4f3f-ac96-f7d906673235 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:48.721281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4b7783d-37bd-4f3f-ac96-f7d906673235 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:48.728050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b7783d-37bd-4f3f-ac96-f7d906673235 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:48.728560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b7783d-37bd-4f3f-ac96-f7d906673235 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:48.729024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b7783d-37bd-4f3f-ac96-f7d906673235 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:48.730375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b7783d-37bd-4f3f-ac96-f7d906673235 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:48.730851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b7783d-37bd-4f3f-ac96-f7d906673235 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:48.731345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b7783d-37bd-4f3f-ac96-f7d906673235 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:48.871129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-096f8af9-b98b-4950-b20e-9dcb187d63a3 req-c7a21c6d-1596-4e7a-97eb-4c4c2165d96c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e047c0f-e987-4b3a-bded-c8e6f8e42931", "name": "network-vif-plugged", "status": "completed", "tag": "47134ce5-c70c-4703-8468-a127c8b06db4"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:48.880869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-096f8af9-b98b-4950-b20e-9dcb187d63a3 req-c7a21c6d-1596-4e7a-97eb-4c4c2165d96c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:48.881276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-096f8af9-b98b-4950-b20e-9dcb187d63a3 req-c7a21c6d-1596-4e7a-97eb-4c4c2165d96c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:48.881691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-096f8af9-b98b-4950-b20e-9dcb187d63a3 req-c7a21c6d-1596-4e7a-97eb-4c4c2165d96c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:48.893376 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-096f8af9-b98b-4950-b20e-9dcb187d63a3 req-c7a21c6d-1596-4e7a-97eb-4c4c2165d96c service nova] Creating event network-vif-plugged:47134ce5-c70c-4703-8468-a127c8b06db4 for instance 6e047c0f-e987-4b3a-bded-c8e6f8e42931 on n-h1-854823-1 Aug 27 05:23:48.894545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4b7783d-37bd-4f3f-ac96-f7d906673235 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:48.899786 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-096f8af9-b98b-4950-b20e-9dcb187d63a3 req-c7a21c6d-1596-4e7a-97eb-4c4c2165d96c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115228 Aug 27 05:23:48.900400 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3413/6874] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:23:48.905571 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4b7783d-37bd-4f3f-ac96-f7d906673235 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1269 microversion: 2.1 time: 0.189002 Aug 27 05:23:48.906147 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3462/6875] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:48 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1269 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:49.927998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cbea3e23-707f-44a4-b260-631c06ffe88d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:49.928725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cbea3e23-707f-44a4-b260-631c06ffe88d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:49.935049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbea3e23-707f-44a4-b260-631c06ffe88d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:49.935536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbea3e23-707f-44a4-b260-631c06ffe88d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:49.935974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbea3e23-707f-44a4-b260-631c06ffe88d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:49.936715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbea3e23-707f-44a4-b260-631c06ffe88d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:49.937169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbea3e23-707f-44a4-b260-631c06ffe88d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:49.937598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cbea3e23-707f-44a4-b260-631c06ffe88d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:50.072374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cbea3e23-707f-44a4-b260-631c06ffe88d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:50.082566 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cbea3e23-707f-44a4-b260-631c06ffe88d tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1269 microversion: 2.1 time: 0.159673 Aug 27 05:23:50.083166 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3414/6876] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:49 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:51.103303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58a77efb-d842-467f-a9d9-e1ce148e8d87 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:51.103909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-58a77efb-d842-467f-a9d9-e1ce148e8d87 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:51.111011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58a77efb-d842-467f-a9d9-e1ce148e8d87 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:51.111520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58a77efb-d842-467f-a9d9-e1ce148e8d87 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:51.111980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58a77efb-d842-467f-a9d9-e1ce148e8d87 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:51.112739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58a77efb-d842-467f-a9d9-e1ce148e8d87 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:51.113218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58a77efb-d842-467f-a9d9-e1ce148e8d87 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:51.113663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58a77efb-d842-467f-a9d9-e1ce148e8d87 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:51.251751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-58a77efb-d842-467f-a9d9-e1ce148e8d87 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:51.259843 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-58a77efb-d842-467f-a9d9-e1ce148e8d87 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1459 microversion: 2.1 time: 0.160482 Aug 27 05:23:51.260803 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3463/6877] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:51 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1459 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:51.281230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-51844168-c3ff-4063-a7d5-2d083b4d2f78 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:23:51.282015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-51844168-c3ff-4063-a7d5-2d083b4d2f78 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:23:51.289200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51844168-c3ff-4063-a7d5-2d083b4d2f78 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:51.289778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51844168-c3ff-4063-a7d5-2d083b4d2f78 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:51.290301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51844168-c3ff-4063-a7d5-2d083b4d2f78 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:51.291111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51844168-c3ff-4063-a7d5-2d083b4d2f78 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:51.291646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51844168-c3ff-4063-a7d5-2d083b4d2f78 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:51.292146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51844168-c3ff-4063-a7d5-2d083b4d2f78 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:51.434862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-51844168-c3ff-4063-a7d5-2d083b4d2f78 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:23:51.444052 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-51844168-c3ff-4063-a7d5-2d083b4d2f78 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1459 microversion: 2.1 time: 0.167319 Aug 27 05:23:51.444634 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3415/6878] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:23:51 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1459 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:23:53.517763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-eb125dbc-8f75-42ef-a138-76b5c60a7dd9 req-4635613f-e821-40c0-9e23-5007dbb3bc3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e047c0f-e987-4b3a-bded-c8e6f8e42931", "tag": "47134ce5-c70c-4703-8468-a127c8b06db4"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:53.530442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-eb125dbc-8f75-42ef-a138-76b5c60a7dd9 req-4635613f-e821-40c0-9e23-5007dbb3bc3d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:53.531502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-eb125dbc-8f75-42ef-a138-76b5c60a7dd9 req-4635613f-e821-40c0-9e23-5007dbb3bc3d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:53.532055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-eb125dbc-8f75-42ef-a138-76b5c60a7dd9 req-4635613f-e821-40c0-9e23-5007dbb3bc3d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:53.548297 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-eb125dbc-8f75-42ef-a138-76b5c60a7dd9 req-4635613f-e821-40c0-9e23-5007dbb3bc3d service nova] Creating event network-changed:47134ce5-c70c-4703-8468-a127c8b06db4 for instance 6e047c0f-e987-4b3a-bded-c8e6f8e42931 on n-h1-854823-1 Aug 27 05:23:53.560181 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-eb125dbc-8f75-42ef-a138-76b5c60a7dd9 req-4635613f-e821-40c0-9e23-5007dbb3bc3d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046816 Aug 27 05:23:53.561168 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3464/6879] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:23:55.579061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-181f57af-e89b-41f5-889f-651558db8920 req-c7f0ea95-7b1a-4980-a30a-32c3cdc8300f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e047c0f-e987-4b3a-bded-c8e6f8e42931", "tag": "47134ce5-c70c-4703-8468-a127c8b06db4"}, {"name": "network-changed", "server_uuid": "6e047c0f-e987-4b3a-bded-c8e6f8e42931", "tag": "47134ce5-c70c-4703-8468-a127c8b06db4"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:23:55.590489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-181f57af-e89b-41f5-889f-651558db8920 req-c7f0ea95-7b1a-4980-a30a-32c3cdc8300f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:23:55.590970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-181f57af-e89b-41f5-889f-651558db8920 req-c7f0ea95-7b1a-4980-a30a-32c3cdc8300f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:23:55.591642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-181f57af-e89b-41f5-889f-651558db8920 req-c7f0ea95-7b1a-4980-a30a-32c3cdc8300f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:23:55.603276 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-181f57af-e89b-41f5-889f-651558db8920 req-c7f0ea95-7b1a-4980-a30a-32c3cdc8300f service nova] Creating event network-changed:47134ce5-c70c-4703-8468-a127c8b06db4 for instance 6e047c0f-e987-4b3a-bded-c8e6f8e42931 on n-h1-854823-1 Aug 27 05:23:55.603877 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-181f57af-e89b-41f5-889f-651558db8920 req-c7f0ea95-7b1a-4980-a30a-32c3cdc8300f service nova] Creating event network-changed:47134ce5-c70c-4703-8468-a127c8b06db4 for instance 6e047c0f-e987-4b3a-bded-c8e6f8e42931 on n-h1-854823-1 Aug 27 05:23:55.609335 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-181f57af-e89b-41f5-889f-651558db8920 req-c7f0ea95-7b1a-4980-a30a-32c3cdc8300f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034007 Aug 27 05:23:55.609970 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3416/6880] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:24:24.538235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:24.539400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=54 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:24.542176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:24.543611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=58 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:24.543794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26531f3e-de37-475b-b4c2-580244c663dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:24.544472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26531f3e-de37-475b-b4c2-580244c663dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:24.549282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-11fab8aa-1eab-46ed-b6d7-5572b5a59d2b req-35158f48-cb4e-4926-84f8-13be48f3b8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e047c0f-e987-4b3a-bded-c8e6f8e42931", "tag": "47134ce5-c70c-4703-8468-a127c8b06db4"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:24.553139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26531f3e-de37-475b-b4c2-580244c663dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:24.553654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26531f3e-de37-475b-b4c2-580244c663dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:24.554112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26531f3e-de37-475b-b4c2-580244c663dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:24.554990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26531f3e-de37-475b-b4c2-580244c663dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:24.555458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26531f3e-de37-475b-b4c2-580244c663dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:24.556139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26531f3e-de37-475b-b4c2-580244c663dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:24.564121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-11fab8aa-1eab-46ed-b6d7-5572b5a59d2b req-35158f48-cb4e-4926-84f8-13be48f3b8d8 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:24.564626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-11fab8aa-1eab-46ed-b6d7-5572b5a59d2b req-35158f48-cb4e-4926-84f8-13be48f3b8d8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:24.565058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-11fab8aa-1eab-46ed-b6d7-5572b5a59d2b req-35158f48-cb4e-4926-84f8-13be48f3b8d8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:24.580100 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-11fab8aa-1eab-46ed-b6d7-5572b5a59d2b req-35158f48-cb4e-4926-84f8-13be48f3b8d8 service nova] Creating event network-changed:47134ce5-c70c-4703-8468-a127c8b06db4 for instance 6e047c0f-e987-4b3a-bded-c8e6f8e42931 on n-h1-854823-1 Aug 27 05:24:24.585906 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-11fab8aa-1eab-46ed-b6d7-5572b5a59d2b req-35158f48-cb4e-4926-84f8-13be48f3b8d8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045861 Aug 27 05:24:24.586379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26531f3e-de37-475b-b4c2-580244c663dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:24:24.586860 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3417/6881] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:24:24.693064 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26531f3e-de37-475b-b4c2-580244c663dc tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 204 len: 0 microversion: 2.1 time: 0.155934 Aug 27 05:24:24.694065 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3465/6882] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:24:24 2022] DELETE /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:24:24.704896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c17314cd-87c9-4b81-9c44-a04f4a7b0e97 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:24.705599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c17314cd-87c9-4b81-9c44-a04f4a7b0e97 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:24.711972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c17314cd-87c9-4b81-9c44-a04f4a7b0e97 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:24.712668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c17314cd-87c9-4b81-9c44-a04f4a7b0e97 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:24.712941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c17314cd-87c9-4b81-9c44-a04f4a7b0e97 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:24.713657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c17314cd-87c9-4b81-9c44-a04f4a7b0e97 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:24.714098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c17314cd-87c9-4b81-9c44-a04f4a7b0e97 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:24.714906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c17314cd-87c9-4b81-9c44-a04f4a7b0e97 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:24.854207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c17314cd-87c9-4b81-9c44-a04f4a7b0e97 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:24.862176 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c17314cd-87c9-4b81-9c44-a04f4a7b0e97 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1584 microversion: 2.1 time: 0.162561 Aug 27 05:24:24.862755 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3418/6883] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:24 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1584 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:25.884523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77031923-b762-4917-910d-ba6b3e4cc645 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:25.885354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-77031923-b762-4917-910d-ba6b3e4cc645 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:25.892168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77031923-b762-4917-910d-ba6b3e4cc645 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:25.892710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77031923-b762-4917-910d-ba6b3e4cc645 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:25.893157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77031923-b762-4917-910d-ba6b3e4cc645 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:25.893885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77031923-b762-4917-910d-ba6b3e4cc645 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:25.894351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77031923-b762-4917-910d-ba6b3e4cc645 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:25.894792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77031923-b762-4917-910d-ba6b3e4cc645 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:26.097838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-77031923-b762-4917-910d-ba6b3e4cc645 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:26.105962 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77031923-b762-4917-910d-ba6b3e4cc645 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1584 microversion: 2.1 time: 0.225730 Aug 27 05:24:26.106738 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3466/6884] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:25 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1584 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:26.854589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-19e32484-73a2-4d7f-8d46-de8cb9413c7e req-53500927-ee24-4c8e-bcdd-853a6103fedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e047c0f-e987-4b3a-bded-c8e6f8e42931", "name": "network-vif-deleted", "tag": "47134ce5-c70c-4703-8468-a127c8b06db4"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:26.868068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-19e32484-73a2-4d7f-8d46-de8cb9413c7e req-53500927-ee24-4c8e-bcdd-853a6103fedf service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:26.868635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-19e32484-73a2-4d7f-8d46-de8cb9413c7e req-53500927-ee24-4c8e-bcdd-853a6103fedf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:26.869026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-19e32484-73a2-4d7f-8d46-de8cb9413c7e req-53500927-ee24-4c8e-bcdd-853a6103fedf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:26.886618 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-19e32484-73a2-4d7f-8d46-de8cb9413c7e req-53500927-ee24-4c8e-bcdd-853a6103fedf service nova] Creating event network-vif-deleted:47134ce5-c70c-4703-8468-a127c8b06db4 for instance 6e047c0f-e987-4b3a-bded-c8e6f8e42931 on n-h1-854823-1 Aug 27 05:24:26.892190 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-19e32484-73a2-4d7f-8d46-de8cb9413c7e req-53500927-ee24-4c8e-bcdd-853a6103fedf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041294 Aug 27 05:24:26.893011 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3419/6885] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:24:27.130021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c249cc4-9a42-4d99-bcc4-b6064beeddb0 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:27.130973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c249cc4-9a42-4d99-bcc4-b6064beeddb0 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:27.143769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c249cc4-9a42-4d99-bcc4-b6064beeddb0 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:27.146790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c249cc4-9a42-4d99-bcc4-b6064beeddb0 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:27.148329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c249cc4-9a42-4d99-bcc4-b6064beeddb0 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:27.149343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c249cc4-9a42-4d99-bcc4-b6064beeddb0 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:27.150128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c249cc4-9a42-4d99-bcc4-b6064beeddb0 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:27.150825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c249cc4-9a42-4d99-bcc4-b6064beeddb0 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:27.225883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c249cc4-9a42-4d99-bcc4-b6064beeddb0 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:27.234070 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c249cc4-9a42-4d99-bcc4-b6064beeddb0 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1229 microversion: 2.1 time: 0.110426 Aug 27 05:24:27.236558 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3467/6886] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:27 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1229 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:28.257924 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bb423782-410c-47d0-b06c-bb04619377e4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:28.258636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bb423782-410c-47d0-b06c-bb04619377e4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:28.265027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb423782-410c-47d0-b06c-bb04619377e4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:28.266104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb423782-410c-47d0-b06c-bb04619377e4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:28.266553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb423782-410c-47d0-b06c-bb04619377e4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:28.267256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb423782-410c-47d0-b06c-bb04619377e4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:28.267713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb423782-410c-47d0-b06c-bb04619377e4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:28.268137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bb423782-410c-47d0-b06c-bb04619377e4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:28.351220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bb423782-410c-47d0-b06c-bb04619377e4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:28.360083 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bb423782-410c-47d0-b06c-bb04619377e4 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1229 microversion: 2.1 time: 0.106700 Aug 27 05:24:28.360700 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3420/6887] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:28 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1229 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:29.383717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3403f1f-bf71-48c3-a0a2-96875e8ae4c6 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:29.385211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e3403f1f-bf71-48c3-a0a2-96875e8ae4c6 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:29.392303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3403f1f-bf71-48c3-a0a2-96875e8ae4c6 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:29.392832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3403f1f-bf71-48c3-a0a2-96875e8ae4c6 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:29.393286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3403f1f-bf71-48c3-a0a2-96875e8ae4c6 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:29.394007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3403f1f-bf71-48c3-a0a2-96875e8ae4c6 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:29.394612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3403f1f-bf71-48c3-a0a2-96875e8ae4c6 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:29.395137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3403f1f-bf71-48c3-a0a2-96875e8ae4c6 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:29.459918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e3403f1f-bf71-48c3-a0a2-96875e8ae4c6 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:29.467955 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3403f1f-bf71-48c3-a0a2-96875e8ae4c6 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1229 microversion: 2.1 time: 0.089188 Aug 27 05:24:29.469087 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3468/6888] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:29 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1229 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:30.489382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-910963a4-3cce-4675-886f-f0ca274ee0d9 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:30.489993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-910963a4-3cce-4675-886f-f0ca274ee0d9 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:30.498598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-910963a4-3cce-4675-886f-f0ca274ee0d9 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:30.499087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-910963a4-3cce-4675-886f-f0ca274ee0d9 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:30.499522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-910963a4-3cce-4675-886f-f0ca274ee0d9 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:30.500741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-910963a4-3cce-4675-886f-f0ca274ee0d9 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:30.501195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-910963a4-3cce-4675-886f-f0ca274ee0d9 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:30.501614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-910963a4-3cce-4675-886f-f0ca274ee0d9 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:30.565236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-910963a4-3cce-4675-886f-f0ca274ee0d9 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d192270bb6485f995f3f8f9b378ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6a40b9a5e947fab83d42c1f2485e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:30.573199 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-910963a4-3cce-4675-886f-f0ca274ee0d9 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 200 len: 1229 microversion: 2.1 time: 0.087851 Aug 27 05:24:30.573767 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3421/6889] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:30 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 1229 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:31.595804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05745085-8ca6-48af-8c33-904917cfaa98 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:31.596446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05745085-8ca6-48af-8c33-904917cfaa98 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] [instance: 6e047c0f-e987-4b3a-bded-c8e6f8e42931] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:31.604670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05745085-8ca6-48af-8c33-904917cfaa98 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:31.604951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05745085-8ca6-48af-8c33-904917cfaa98 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:31.605700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05745085-8ca6-48af-8c33-904917cfaa98 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:31.606132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05745085-8ca6-48af-8c33-904917cfaa98 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:31.606630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05745085-8ca6-48af-8c33-904917cfaa98 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:31.607071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05745085-8ca6-48af-8c33-904917cfaa98 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:31.622722 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-05745085-8ca6-48af-8c33-904917cfaa98 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] HTTP exception thrown: Instance 6e047c0f-e987-4b3a-bded-c8e6f8e42931 could not be found. Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05745085-8ca6-48af-8c33-904917cfaa98 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Request method failure captured: Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 HTTP/1.1 Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCanguNczuISk4ZvEsH84Sz2zloBNbyeuZ7S5HaaWkxdXs5OGrdGh1fEyYF9j_wCgbZKxnde4tfmr9FP7KWPeGUAyc2o3tU4bVngLXcSpfwwQb1HibBItKxOe5LwnqHWmGlVK4LzAtL16Bv9hk1rxyq8MglqfmqBd93VEqm_pXPQzgeo Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: db6a40b9a5e947fab83d42c1f2485e08 Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBackupRestore-1310961560 Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db6a40b9a5e947fab83d42c1f2485e08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db6a40b9a5e947fab83d42c1f2485e08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db6a40b9a5e947fab83d42c1f2485e08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db6a40b9a5e947fab83d42c1f2485e08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBackupRestore-1310961560 Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: db6a40b9a5e947fab83d42c1f2485e08 Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1310961560 Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBackupRestore-1310961560-project Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 06d192270bb6485f995f3f8f9b378ee7 Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBackupRestore-1310961560-project Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 6e047c0f-e987-4b3a-bded-c8e6f8e42931 could not be found. Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '6e047c0f-e987-4b3a-bded-c8e6f8e42931'} Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e047c0f-e987-4b3a-bded-c8e6f8e42931 could not be found. Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e047c0f-e987-4b3a-bded-c8e6f8e42931 could not be found. Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:24:31.624438 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:24:31.630645 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:24:31.630645 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:24:31.630645 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:24:31.630645 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:24:31.630645 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:24:31.630645 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e047c0f-e987-4b3a-bded-c8e6f8e42931 could not be found. Aug 27 05:24:31.630645 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:24:31.630645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05745085-8ca6-48af-8c33-904917cfaa98 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Returning 404 to user: Instance 6e047c0f-e987-4b3a-bded-c8e6f8e42931 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:24:31.630645 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05745085-8ca6-48af-8c33-904917cfaa98 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931" status: 404 len: 111 microversion: 2.1 time: 0.035093 Aug 27 05:24:31.630645 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3469/6890] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:31 2022] GET /compute/v2.1/servers/6e047c0f-e987-4b3a-bded-c8e6f8e42931 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:24:31.789644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-944db2f1-8287-4510-b734-0e0a20f551c1 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] Calling method '.version_select at 0x7f1f217d88b0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:31.829298 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-944db2f1-8287-4510-b734-0e0a20f551c1 tempest-TestVolumeBackupRestore-1310961560 tempest-TestVolumeBackupRestore-1310961560-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1491669495" status: 202 len: 0 microversion: 2.1 time: 0.043506 Aug 27 05:24:31.829904 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3422/6891] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 05:24:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1491669495 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:24:54.221313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:54.222169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:54.336035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-803532684", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:24:54.389368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:24:54.664219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:24:54.664681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:24:54.665173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:24:54.665598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:24:54.666063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:24:54.675754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:54.676264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:54.676763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:54.677524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:54.678005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:54.678453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:54.698591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Getting quotas for project 915fd4a98d554a138ebcb59ce35c7b62. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:24:54.704575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Getting quotas for user b791986dcfc7488885df5b6c397cc260 and project 915fd4a98d554a138ebcb59ce35c7b62. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:24:54.717114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:24:54.720021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:24:54.764748 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5942dedf-82ed-4b5a-9c06-2dbd0c413df4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549165 Aug 27 05:24:54.766026 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3470/6892] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:24:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:24:54.776590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=22 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:54.777342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:24:54.781957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d0378277-4745-435d-a233-578295706f7f tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:54.782573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d0378277-4745-435d-a233-578295706f7f tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:54.838114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d0378277-4745-435d-a233-578295706f7f tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:54.845693 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d0378277-4745-435d-a233-578295706f7f tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1221 microversion: 2.1 time: 0.071218 Aug 27 05:24:54.846274 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3423/6893] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:54 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:55.867623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b122312-6698-4a4f-b73d-60b9ecf32c17 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:55.868284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4b122312-6698-4a4f-b73d-60b9ecf32c17 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:55.926958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4b122312-6698-4a4f-b73d-60b9ecf32c17 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:55.934889 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b122312-6698-4a4f-b73d-60b9ecf32c17 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1221 microversion: 2.1 time: 0.072453 Aug 27 05:24:55.935467 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3471/6894] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:55 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1221 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:56.957265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-00e41ecc-c104-4c7d-89e5-e3cf18cf02fe tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:56.957890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-00e41ecc-c104-4c7d-89e5-e3cf18cf02fe tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:57.015225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-00e41ecc-c104-4c7d-89e5-e3cf18cf02fe tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:57.023012 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-00e41ecc-c104-4c7d-89e5-e3cf18cf02fe tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1221 microversion: 2.1 time: 0.070329 Aug 27 05:24:57.023590 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3424/6895] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:56 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:24:58.044024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01ac3076-9b40-47d1-89d0-8bcf1c1128d7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:58.044691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01ac3076-9b40-47d1-89d0-8bcf1c1128d7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:58.099828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01ac3076-9b40-47d1-89d0-8bcf1c1128d7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:58.107043 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01ac3076-9b40-47d1-89d0-8bcf1c1128d7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1221 microversion: 2.1 time: 0.067113 Aug 27 05:24:58.107615 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3472/6896] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:58 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1221 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:24:59.127610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2a887d53-f6f2-4edb-bf63-fc1a1aa6b52a tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:24:59.128217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2a887d53-f6f2-4edb-bf63-fc1a1aa6b52a tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:24:59.135710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a887d53-f6f2-4edb-bf63-fc1a1aa6b52a tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:59.136195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a887d53-f6f2-4edb-bf63-fc1a1aa6b52a tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:59.136659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a887d53-f6f2-4edb-bf63-fc1a1aa6b52a tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:59.137360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a887d53-f6f2-4edb-bf63-fc1a1aa6b52a tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:24:59.137813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a887d53-f6f2-4edb-bf63-fc1a1aa6b52a tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:24:59.138234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a887d53-f6f2-4edb-bf63-fc1a1aa6b52a tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:24:59.200356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a887d53-f6f2-4edb-bf63-fc1a1aa6b52a tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:24:59.208623 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2a887d53-f6f2-4edb-bf63-fc1a1aa6b52a tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1225 microversion: 2.1 time: 0.084924 Aug 27 05:24:59.209215 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3425/6897] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:24:59 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:00.230113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-175ba60a-de16-4a27-b8bc-34bec9c924d1 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:00.230768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-175ba60a-de16-4a27-b8bc-34bec9c924d1 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:00.239215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175ba60a-de16-4a27-b8bc-34bec9c924d1 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:00.239748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175ba60a-de16-4a27-b8bc-34bec9c924d1 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:00.240189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175ba60a-de16-4a27-b8bc-34bec9c924d1 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:00.240945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175ba60a-de16-4a27-b8bc-34bec9c924d1 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:00.241413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175ba60a-de16-4a27-b8bc-34bec9c924d1 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:00.242462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175ba60a-de16-4a27-b8bc-34bec9c924d1 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:00.312978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-175ba60a-de16-4a27-b8bc-34bec9c924d1 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:00.321020 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-175ba60a-de16-4a27-b8bc-34bec9c924d1 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1279 microversion: 2.1 time: 0.094650 Aug 27 05:25:00.321390 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3473/6898] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:00 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:01.343962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-df409145-ecb4-4997-8af0-b25eb0630ad7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:01.346552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-df409145-ecb4-4997-8af0-b25eb0630ad7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:01.352872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-df409145-ecb4-4997-8af0-b25eb0630ad7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:01.353640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-df409145-ecb4-4997-8af0-b25eb0630ad7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:01.354659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-df409145-ecb4-4997-8af0-b25eb0630ad7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:01.355710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-df409145-ecb4-4997-8af0-b25eb0630ad7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:01.356346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-df409145-ecb4-4997-8af0-b25eb0630ad7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:01.356798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-42ec642c-aef7-44fc-91aa-e405a6ac52ab req-a63acc28-13f5-4567-86b9-49e6a548abd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbed2ffe-62ce-442b-a3e7-98a1ec643e9c", "tag": "83ebe1c5-6e36-4087-9781-2ee0f856cfee"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:01.357232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-df409145-ecb4-4997-8af0-b25eb0630ad7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:01.371477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42ec642c-aef7-44fc-91aa-e405a6ac52ab req-a63acc28-13f5-4567-86b9-49e6a548abd7 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:01.371979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42ec642c-aef7-44fc-91aa-e405a6ac52ab req-a63acc28-13f5-4567-86b9-49e6a548abd7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:01.372709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42ec642c-aef7-44fc-91aa-e405a6ac52ab req-a63acc28-13f5-4567-86b9-49e6a548abd7 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:01.386359 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-42ec642c-aef7-44fc-91aa-e405a6ac52ab req-a63acc28-13f5-4567-86b9-49e6a548abd7 service nova] Creating event network-changed:83ebe1c5-6e36-4087-9781-2ee0f856cfee for instance fbed2ffe-62ce-442b-a3e7-98a1ec643e9c on n-h1-854823-1 Aug 27 05:25:01.392944 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-42ec642c-aef7-44fc-91aa-e405a6ac52ab req-a63acc28-13f5-4567-86b9-49e6a548abd7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045308 Aug 27 05:25:01.394371 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3474/6899] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:01.507871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-df409145-ecb4-4997-8af0-b25eb0630ad7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:01.517230 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-df409145-ecb4-4997-8af0-b25eb0630ad7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1321 microversion: 2.1 time: 0.178506 Aug 27 05:25:01.517822 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3426/6900] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:01 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:02.540158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a410b0a6-7ff6-44d3-86f9-4f34025538d3 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:02.540930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a410b0a6-7ff6-44d3-86f9-4f34025538d3 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:02.547397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a410b0a6-7ff6-44d3-86f9-4f34025538d3 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:02.548487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a410b0a6-7ff6-44d3-86f9-4f34025538d3 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:02.548965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a410b0a6-7ff6-44d3-86f9-4f34025538d3 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:02.549681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a410b0a6-7ff6-44d3-86f9-4f34025538d3 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:02.550152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a410b0a6-7ff6-44d3-86f9-4f34025538d3 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:02.550596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a410b0a6-7ff6-44d3-86f9-4f34025538d3 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:02.680576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a410b0a6-7ff6-44d3-86f9-4f34025538d3 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:02.689705 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a410b0a6-7ff6-44d3-86f9-4f34025538d3 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1321 microversion: 2.1 time: 0.153440 Aug 27 05:25:02.689705 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3475/6901] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:02 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:03.708366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a4cd2a28-f9b2-49f4-94b5-d2566cfdf3fa tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:03.709079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a4cd2a28-f9b2-49f4-94b5-d2566cfdf3fa tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:03.715179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4cd2a28-f9b2-49f4-94b5-d2566cfdf3fa tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:03.715668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4cd2a28-f9b2-49f4-94b5-d2566cfdf3fa tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:03.716109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4cd2a28-f9b2-49f4-94b5-d2566cfdf3fa tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:03.716839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4cd2a28-f9b2-49f4-94b5-d2566cfdf3fa tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:03.717296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4cd2a28-f9b2-49f4-94b5-d2566cfdf3fa tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:03.717721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4cd2a28-f9b2-49f4-94b5-d2566cfdf3fa tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:03.848299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a4cd2a28-f9b2-49f4-94b5-d2566cfdf3fa tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:03.857527 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a4cd2a28-f9b2-49f4-94b5-d2566cfdf3fa tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1321 microversion: 2.1 time: 0.153303 Aug 27 05:25:03.858118 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3427/6902] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:03 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:04.878749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4d0ff25d-67cb-466f-b2a2-49abdcf6623c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:04.879376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4d0ff25d-67cb-466f-b2a2-49abdcf6623c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:04.882265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:04.888010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d0ff25d-67cb-466f-b2a2-49abdcf6623c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:04.888519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d0ff25d-67cb-466f-b2a2-49abdcf6623c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:04.888998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d0ff25d-67cb-466f-b2a2-49abdcf6623c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:04.889712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d0ff25d-67cb-466f-b2a2-49abdcf6623c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:04.890185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d0ff25d-67cb-466f-b2a2-49abdcf6623c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:04.890630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d0ff25d-67cb-466f-b2a2-49abdcf6623c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:05.022172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4d0ff25d-67cb-466f-b2a2-49abdcf6623c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:05.030036 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4d0ff25d-67cb-466f-b2a2-49abdcf6623c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1321 microversion: 2.1 time: 0.155268 Aug 27 05:25:05.030647 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3476/6903] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:04 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:06.051877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-47d35836-3388-4530-bd6c-357fe22e707c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:06.052496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-47d35836-3388-4530-bd6c-357fe22e707c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:06.059577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47d35836-3388-4530-bd6c-357fe22e707c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:06.060070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47d35836-3388-4530-bd6c-357fe22e707c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:06.060507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47d35836-3388-4530-bd6c-357fe22e707c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:06.061229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47d35836-3388-4530-bd6c-357fe22e707c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:06.061687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47d35836-3388-4530-bd6c-357fe22e707c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:06.062127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47d35836-3388-4530-bd6c-357fe22e707c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:06.195105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-47d35836-3388-4530-bd6c-357fe22e707c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:06.202866 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-47d35836-3388-4530-bd6c-357fe22e707c tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1321 microversion: 2.1 time: 0.155503 Aug 27 05:25:06.203472 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3428/6904] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:06 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:07.114581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-712698e9-86a3-4422-806c-6f9497c2ed1c req-413827b3-3bcc-46ed-949f-7effdec81ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbed2ffe-62ce-442b-a3e7-98a1ec643e9c", "name": "network-vif-plugged", "status": "completed", "tag": "83ebe1c5-6e36-4087-9781-2ee0f856cfee"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:07.126978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-712698e9-86a3-4422-806c-6f9497c2ed1c req-413827b3-3bcc-46ed-949f-7effdec81ab5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:07.127669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-712698e9-86a3-4422-806c-6f9497c2ed1c req-413827b3-3bcc-46ed-949f-7effdec81ab5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:07.128134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-712698e9-86a3-4422-806c-6f9497c2ed1c req-413827b3-3bcc-46ed-949f-7effdec81ab5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:07.139992 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-712698e9-86a3-4422-806c-6f9497c2ed1c req-413827b3-3bcc-46ed-949f-7effdec81ab5 service nova] Creating event network-vif-plugged:83ebe1c5-6e36-4087-9781-2ee0f856cfee for instance fbed2ffe-62ce-442b-a3e7-98a1ec643e9c on n-h1-854823-1 Aug 27 05:25:07.145279 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-712698e9-86a3-4422-806c-6f9497c2ed1c req-413827b3-3bcc-46ed-949f-7effdec81ab5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034960 Aug 27 05:25:07.146068 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3477/6905] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:07.224075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8bea7e03-8b4e-4f37-8444-e99ea9d01b84 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:07.224757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8bea7e03-8b4e-4f37-8444-e99ea9d01b84 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:07.226715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:07.233194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bea7e03-8b4e-4f37-8444-e99ea9d01b84 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:07.233785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bea7e03-8b4e-4f37-8444-e99ea9d01b84 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:07.234300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bea7e03-8b4e-4f37-8444-e99ea9d01b84 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:07.235711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bea7e03-8b4e-4f37-8444-e99ea9d01b84 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:07.236243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bea7e03-8b4e-4f37-8444-e99ea9d01b84 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:07.236771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8bea7e03-8b4e-4f37-8444-e99ea9d01b84 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:07.371788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8bea7e03-8b4e-4f37-8444-e99ea9d01b84 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:07.379481 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8bea7e03-8b4e-4f37-8444-e99ea9d01b84 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1321 microversion: 2.1 time: 0.159992 Aug 27 05:25:07.380061 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3429/6906] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:07 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:08.397943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:08.404246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-620b4121-6c27-433d-9168-af8a2e761051 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:08.405288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-620b4121-6c27-433d-9168-af8a2e761051 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:08.412937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-620b4121-6c27-433d-9168-af8a2e761051 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:08.413443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-620b4121-6c27-433d-9168-af8a2e761051 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:08.413894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-620b4121-6c27-433d-9168-af8a2e761051 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:08.414613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-620b4121-6c27-433d-9168-af8a2e761051 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:08.415083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-620b4121-6c27-433d-9168-af8a2e761051 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:08.415523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-620b4121-6c27-433d-9168-af8a2e761051 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:08.551417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-620b4121-6c27-433d-9168-af8a2e761051 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:08.560693 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-620b4121-6c27-433d-9168-af8a2e761051 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1321 microversion: 2.1 time: 0.164000 Aug 27 05:25:08.561291 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3478/6907] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:08 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:09.582692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1425aa7b-9af5-4be0-83c9-16eb4f484fe4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:09.583312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1425aa7b-9af5-4be0-83c9-16eb4f484fe4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:09.590327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1425aa7b-9af5-4be0-83c9-16eb4f484fe4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:09.590818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1425aa7b-9af5-4be0-83c9-16eb4f484fe4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:09.591260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1425aa7b-9af5-4be0-83c9-16eb4f484fe4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:09.591960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1425aa7b-9af5-4be0-83c9-16eb4f484fe4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:09.592423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1425aa7b-9af5-4be0-83c9-16eb4f484fe4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:09.592887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1425aa7b-9af5-4be0-83c9-16eb4f484fe4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:09.723846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1425aa7b-9af5-4be0-83c9-16eb4f484fe4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:09.731579 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1425aa7b-9af5-4be0-83c9-16eb4f484fe4 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1471 microversion: 2.1 time: 0.153418 Aug 27 05:25:09.732156 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3430/6908] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:09 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:09.803754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4fa4a3a8-10e2-48da-afa8-e4130728c8e8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Calling method '.version_select at 0x7f1f25cc1550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:09.870548 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4fa4a3a8-10e2-48da-afa8-e4130728c8e8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/19d9e579d63942129ac9f40cf6b5cc9f" status: 200 len: 371 microversion: 2.1 time: 0.120641 Aug 27 05:25:09.871138 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3479/6909] 10.222.0.79 () {58 vars in 1242 bytes} [Sat Aug 27 05:25:09 2022] GET /compute/v2.1/os-quota-sets/19d9e579d63942129ac9f40cf6b5cc9f => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:09.882344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f50ccadc-8e7a-4654-9263-0d2ded29ef4f tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-252979567", "id": 1487727407, "os-flavor-access:is_public": "True"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:09.903282 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f50ccadc-8e7a-4654-9263-0d2ded29ef4f tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.024597 Aug 27 05:25:09.903894 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3431/6910] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:09 2022] POST /compute/v2.1/flavors => generated 437 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:09.916402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1487727407"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:09.918712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:09.924990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:09.925491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:09.925944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:09.926657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:09.927127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:09.927569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.013242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1e579127fd574035b22c9b3b99a7faa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9e579d63942129ac9f40cf6b5cc9f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:10.020309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-252979567 {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:25:10.027661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.028164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.028693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.029447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.029923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.030365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.050841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Getting quotas for project 915fd4a98d554a138ebcb59ce35c7b62. Resources: {'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:25:10.055954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Getting quotas for user b791986dcfc7488885df5b6c397cc260 and project 915fd4a98d554a138ebcb59ce35c7b62. Resources: {'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:25:10.071130 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.compute.api [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] ram quota exceeded for 19d9e579d63942129ac9f40cf6b5cc9f, tried to resize instance. Aug 27 05:25:10.071697 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Request method failure captured: Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c/action HTTP/1.1 Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 39 Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCaqmWNCGM5qevlygfMql8GZUWx_wcurFrgAHJ6Py-aetNiPEIZkJc2tpMh-CPkV_LnwtDlhiROb9Udtf3xgEQa4LFnKp-4KHihuniyZWHzv2S0kns3dKtLwDNVZ-lDRcTbtqgNPdWr751eQcEBt1zpC9K6OYew71MGpSNiLplqIIUdM Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 19d9e579d63942129ac9f40cf6b5cc9f Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1171339443 Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Role: admin,reader,member Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: admin,reader,member Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19d9e579d63942129ac9f40cf6b5cc9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_19d9e579d63942129ac9f40cf6b5cc9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/19d9e579d63942129ac9f40cf6b5cc9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19d9e579d63942129ac9f40cf6b5cc9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1171339443 Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 19d9e579d63942129ac9f40cf6b5cc9f Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1171339443 Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersAdminNegativeTestJSON-1171339443-project-admin Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 1e579127fd574035b22c9b3b99a7faa9 Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1171339443-project-admin Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: {"resize": {"flavorRef": "1487727407"}} Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'fbed2ffe-62ce-442b-a3e7-98a1ec643e9c', 'body': {'resize': {'flavorRef': '1487727407'}}} Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:25:10.083810 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa42c9b6-fa43-423a-8020-48586fef63b8 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c/action" status: 403 len: 118 microversion: 2.1 time: 0.173064 Aug 27 05:25:10.087749 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3480/6911] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:25:09 2022] POST /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c/action => generated 118 bytes in 174 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:25:10.094595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-22076d63-78ec-46a3-8cb9-525994796f62 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:10.111773 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-22076d63-78ec-46a3-8cb9-525994796f62 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1487727407" status: 202 len: 0 microversion: 2.1 time: 0.020952 Aug 27 05:25:10.112340 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3432/6912] 10.222.0.79 () {58 vars in 1161 bytes} [Sat Aug 27 05:25:10 2022] DELETE /compute/v2.1/flavors/1487727407 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:25:10.120279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a73a43c8-8d0d-4fe1-8691-d9c736cc5c36 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:10.141681 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a73a43c8-8d0d-4fe1-8691-d9c736cc5c36 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024458 Aug 27 05:25:10.142797 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3481/6913] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 05:25:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:10.162256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f0170df5-5481-41d3-82ca-1f819ceeb747 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Calling method '.version_select at 0x7f1f25e710d0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:10.236088 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f0170df5-5481-41d3-82ca-1f819ceeb747 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/19d9e579d63942129ac9f40cf6b5cc9f" status: 200 len: 371 microversion: 2.1 time: 0.077574 Aug 27 05:25:10.236699 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3433/6914] 10.222.0.79 () {58 vars in 1242 bytes} [Sat Aug 27 05:25:10 2022] GET /compute/v2.1/os-quota-sets/19d9e579d63942129ac9f40cf6b5cc9f => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:10.247783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-735f5af5-70de-431c-ae90-f346f5a7e5d3 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1904178419", "id": 868572273, "os-flavor-access:is_public": "True"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:10.266970 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-735f5af5-70de-431c-ae90-f346f5a7e5d3 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.022169 Aug 27 05:25:10.267501 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3482/6915] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:10 2022] POST /compute/v2.1/flavors => generated 434 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:10.279368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "868572273"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:10.281748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:10.287728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.288211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.288669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.289374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.289829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.290249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.497561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1e579127fd574035b22c9b3b99a7faa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9e579d63942129ac9f40cf6b5cc9f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:10.504797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1904178419 {{(pid=128870) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:25:10.511627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.512115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.512581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.513323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.513782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.515211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.536776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Getting quotas for project 915fd4a98d554a138ebcb59ce35c7b62. Resources: {'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:25:10.541862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Getting quotas for user b791986dcfc7488885df5b6c397cc260 and project 915fd4a98d554a138ebcb59ce35c7b62. Resources: {'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:25:10.555622 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.compute.api [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] cores quota exceeded for 19d9e579d63942129ac9f40cf6b5cc9f, tried to resize instance. Aug 27 05:25:10.556165 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Request method failure captured: Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c/action HTTP/1.1 Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 38 Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaqmWNCGM5qevlygfMql8GZUWx_wcurFrgAHJ6Py-aetNiPEIZkJc2tpMh-CPkV_LnwtDlhiROb9Udtf3xgEQa4LFnKp-4KHihuniyZWHzv2S0kns3dKtLwDNVZ-lDRcTbtqgNPdWr751eQcEBt1zpC9K6OYew71MGpSNiLplqIIUdM Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 19d9e579d63942129ac9f40cf6b5cc9f Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1171339443 Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Role: admin,reader,member Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: admin,reader,member Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19d9e579d63942129ac9f40cf6b5cc9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_19d9e579d63942129ac9f40cf6b5cc9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/19d9e579d63942129ac9f40cf6b5cc9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19d9e579d63942129ac9f40cf6b5cc9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1171339443 Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 19d9e579d63942129ac9f40cf6b5cc9f Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1171339443 Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersAdminNegativeTestJSON-1171339443-project-admin Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 1e579127fd574035b22c9b3b99a7faa9 Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1171339443-project-admin Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: {"resize": {"flavorRef": "868572273"}} Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'fbed2ffe-62ce-442b-a3e7-98a1ec643e9c', 'body': {'resize': {'flavorRef': '868572273'}}} Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:25:10.558247 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8a1f3170-67f4-4317-841b-c2f1963e29a0 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c/action" status: 403 len: 113 microversion: 2.1 time: 0.284229 Aug 27 05:25:10.562081 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3434/6916] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:25:10 2022] POST /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c/action => generated 113 bytes in 285 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:25:10.569026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6db939f2-186b-4287-a11a-35d385384501 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:10.586544 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6db939f2-186b-4287-a11a-35d385384501 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/868572273" status: 202 len: 0 microversion: 2.1 time: 0.021238 Aug 27 05:25:10.587121 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3483/6917] 10.222.0.79 () {58 vars in 1158 bytes} [Sat Aug 27 05:25:10 2022] DELETE /compute/v2.1/flavors/868572273 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:25:10.594960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-05c17296-5c5e-4226-b336-9efbc32680d1 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:10.616511 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-05c17296-5c5e-4226-b336-9efbc32680d1 tempest-ServersAdminNegativeTestJSON-1171339443 tempest-ServersAdminNegativeTestJSON-1171339443-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025224 Aug 27 05:25:10.617089 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3435/6918] 10.222.0.79 () {58 vars in 1146 bytes} [Sat Aug 27 05:25:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:10.636777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98eaf1ba-4f97-4b76-a3b5-019caaaa2224 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:10.637302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98eaf1ba-4f97-4b76-a3b5-019caaaa2224 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:10.643557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98eaf1ba-4f97-4b76-a3b5-019caaaa2224 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.644062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98eaf1ba-4f97-4b76-a3b5-019caaaa2224 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.644521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98eaf1ba-4f97-4b76-a3b5-019caaaa2224 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.645267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98eaf1ba-4f97-4b76-a3b5-019caaaa2224 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.645787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98eaf1ba-4f97-4b76-a3b5-019caaaa2224 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.646279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98eaf1ba-4f97-4b76-a3b5-019caaaa2224 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.671712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98eaf1ba-4f97-4b76-a3b5-019caaaa2224 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:25:10.755369 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98eaf1ba-4f97-4b76-a3b5-019caaaa2224 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 204 len: 0 microversion: 2.1 time: 0.122290 Aug 27 05:25:10.756288 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3484/6919] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:25:10 2022] DELETE /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:25:10.764973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4a0aaa99-2b6a-485d-a15b-294758ed639b tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:10.765286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4a0aaa99-2b6a-485d-a15b-294758ed639b tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:10.771403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0aaa99-2b6a-485d-a15b-294758ed639b tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.771890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0aaa99-2b6a-485d-a15b-294758ed639b tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.772616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0aaa99-2b6a-485d-a15b-294758ed639b tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.773394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0aaa99-2b6a-485d-a15b-294758ed639b tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:10.773853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0aaa99-2b6a-485d-a15b-294758ed639b tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:10.774282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a0aaa99-2b6a-485d-a15b-294758ed639b tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:10.910708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4a0aaa99-2b6a-485d-a15b-294758ed639b tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:10.918710 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4a0aaa99-2b6a-485d-a15b-294758ed639b tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1477 microversion: 2.1 time: 0.158071 Aug 27 05:25:10.919287 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3436/6920] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:10 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:11.941398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f5482e9-997f-4fa8-8616-7911c99306e7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:11.942124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f5482e9-997f-4fa8-8616-7911c99306e7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:11.949670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f5482e9-997f-4fa8-8616-7911c99306e7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:11.950176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f5482e9-997f-4fa8-8616-7911c99306e7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:11.950636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f5482e9-997f-4fa8-8616-7911c99306e7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:11.951351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f5482e9-997f-4fa8-8616-7911c99306e7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:11.951828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f5482e9-997f-4fa8-8616-7911c99306e7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:11.952303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f5482e9-997f-4fa8-8616-7911c99306e7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:12.087204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f5482e9-997f-4fa8-8616-7911c99306e7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:12.095314 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f5482e9-997f-4fa8-8616-7911c99306e7 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1477 microversion: 2.1 time: 0.158864 Aug 27 05:25:12.096434 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3485/6921] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:11 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1477 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:12.838709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e91427ca-421a-4c7a-b5c6-2d5a42ab7484 req-5de55ae1-a918-4bf0-86af-636d72cb7810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbed2ffe-62ce-442b-a3e7-98a1ec643e9c", "name": "network-vif-deleted", "tag": "83ebe1c5-6e36-4087-9781-2ee0f856cfee"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:12.850979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e91427ca-421a-4c7a-b5c6-2d5a42ab7484 req-5de55ae1-a918-4bf0-86af-636d72cb7810 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:12.851572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e91427ca-421a-4c7a-b5c6-2d5a42ab7484 req-5de55ae1-a918-4bf0-86af-636d72cb7810 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:12.852104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e91427ca-421a-4c7a-b5c6-2d5a42ab7484 req-5de55ae1-a918-4bf0-86af-636d72cb7810 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:12.866340 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e91427ca-421a-4c7a-b5c6-2d5a42ab7484 req-5de55ae1-a918-4bf0-86af-636d72cb7810 service nova] Creating event network-vif-deleted:83ebe1c5-6e36-4087-9781-2ee0f856cfee for instance fbed2ffe-62ce-442b-a3e7-98a1ec643e9c on n-h1-854823-1 Aug 27 05:25:12.871823 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e91427ca-421a-4c7a-b5c6-2d5a42ab7484 req-5de55ae1-a918-4bf0-86af-636d72cb7810 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036887 Aug 27 05:25:12.872650 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3437/6922] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:13.117257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99d4ab70-695f-4497-bc5e-9a8a616f9211 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:13.118014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99d4ab70-695f-4497-bc5e-9a8a616f9211 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:13.124923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99d4ab70-695f-4497-bc5e-9a8a616f9211 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:13.125449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99d4ab70-695f-4497-bc5e-9a8a616f9211 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:13.125902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99d4ab70-695f-4497-bc5e-9a8a616f9211 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:13.126615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99d4ab70-695f-4497-bc5e-9a8a616f9211 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:13.127087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99d4ab70-695f-4497-bc5e-9a8a616f9211 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:13.127532 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99d4ab70-695f-4497-bc5e-9a8a616f9211 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:13.159106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99d4ab70-695f-4497-bc5e-9a8a616f9211 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:13.159600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99d4ab70-695f-4497-bc5e-9a8a616f9211 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:13.160053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99d4ab70-695f-4497-bc5e-9a8a616f9211 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:13.160514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-99d4ab70-695f-4497-bc5e-9a8a616f9211 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lazy-loading 'fault' on Instance uuid fbed2ffe-62ce-442b-a3e7-98a1ec643e9c {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:25:13.205634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99d4ab70-695f-4497-bc5e-9a8a616f9211 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b791986dcfc7488885df5b6c397cc260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915fd4a98d554a138ebcb59ce35c7b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:13.213429 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99d4ab70-695f-4497-bc5e-9a8a616f9211 tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 200 len: 1311 microversion: 2.1 time: 0.100303 Aug 27 05:25:13.214006 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3486/6923] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:13 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:14.236096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0d07abd-4a56-4cc0-a021-0d80379ee0bf tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:14.236844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c0d07abd-4a56-4cc0-a021-0d80379ee0bf tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] [instance: fbed2ffe-62ce-442b-a3e7-98a1ec643e9c] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:14.243046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0d07abd-4a56-4cc0-a021-0d80379ee0bf tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:14.243525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0d07abd-4a56-4cc0-a021-0d80379ee0bf tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:14.243957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0d07abd-4a56-4cc0-a021-0d80379ee0bf tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:14.244687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0d07abd-4a56-4cc0-a021-0d80379ee0bf tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:14.245126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0d07abd-4a56-4cc0-a021-0d80379ee0bf tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:14.245551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c0d07abd-4a56-4cc0-a021-0d80379ee0bf tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:14.258698 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-c0d07abd-4a56-4cc0-a021-0d80379ee0bf tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] HTTP exception thrown: Instance fbed2ffe-62ce-442b-a3e7-98a1ec643e9c could not be found. Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0d07abd-4a56-4cc0-a021-0d80379ee0bf tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Request method failure captured: Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c HTTP/1.1 Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCaql0PeoF3430uQVs3JV-kvSgi1VwCVA0YpZqNcQ6wrM_TXTC1zK-yfanXQsRlSIXFkXWXVVvZw6kV65L4qOYGv6DL0N_rdaE_XuRCYwqu3SHD3TMpEoSymAM2qKlJ0LXBnr1hjUriG5GTnL03wairvoGOd1wm8jZFtzipTB6WJefGY Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 915fd4a98d554a138ebcb59ce35c7b62 Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1938446319 Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/915fd4a98d554a138ebcb59ce35c7b62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_915fd4a98d554a138ebcb59ce35c7b62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/915fd4a98d554a138ebcb59ce35c7b62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/915fd4a98d554a138ebcb59ce35c7b62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1938446319 Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 915fd4a98d554a138ebcb59ce35c7b62 Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1938446319 Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersAdminNegativeTestJSON-1938446319-project Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: b791986dcfc7488885df5b6c397cc260 Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1938446319-project Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance fbed2ffe-62ce-442b-a3e7-98a1ec643e9c could not be found. Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'fbed2ffe-62ce-442b-a3e7-98a1ec643e9c'} Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbed2ffe-62ce-442b-a3e7-98a1ec643e9c could not be found. Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbed2ffe-62ce-442b-a3e7-98a1ec643e9c could not be found. Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:25:14.260308 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:25:14.264074 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:25:14.264074 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:25:14.264074 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:25:14.264074 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:25:14.264074 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:25:14.264074 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:25:14.264074 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbed2ffe-62ce-442b-a3e7-98a1ec643e9c could not be found. Aug 27 05:25:14.264074 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:25:14.264074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c0d07abd-4a56-4cc0-a021-0d80379ee0bf tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] Returning 404 to user: Instance fbed2ffe-62ce-442b-a3e7-98a1ec643e9c could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:25:14.264074 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c0d07abd-4a56-4cc0-a021-0d80379ee0bf tempest-ServersAdminNegativeTestJSON-1938446319 tempest-ServersAdminNegativeTestJSON-1938446319-project] 10.222.0.79 "GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c" status: 404 len: 111 microversion: 2.1 time: 0.030802 Aug 27 05:25:14.264074 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3438/6924] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:14 2022] GET /compute/v2.1/servers/fbed2ffe-62ce-442b-a3e7-98a1ec643e9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:25:20.437541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:20.439616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:20.569102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-95662760", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "45d2f5ec-1a11-41be-be26-34e9913dc465"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:20.625737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] validate_networks() for [('45d2f5ec-1a11-41be-be26-34e9913dc465', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:25:20.996869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:25:20.997354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:25:20.997847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:25:20.998278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:25:20.998741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:25:21.008275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:21.008801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:21.009428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:21.010185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:21.010665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:21.011111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:21.029190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Getting quotas for project 0d9901a3aafe410ca0ce533b0a4e63da. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:25:21.034856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Getting quotas for user c3e6392b2cf942d4811b24530668c535 and project 0d9901a3aafe410ca0ce533b0a4e63da. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:25:21.050594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:25:21.051426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:25:21.102695 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af7a5426-589c-4207-9662-edf61392f23b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670557 Aug 27 05:25:21.103383 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3487/6925] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:25:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:25:21.114643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2bd51f30-13e7-4d01-8d52-5b07f9a7ffd8 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:21.115606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2bd51f30-13e7-4d01-8d52-5b07f9a7ffd8 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:21.120777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:21.122121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:21.185219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2bd51f30-13e7-4d01-8d52-5b07f9a7ffd8 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:21.193127 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2bd51f30-13e7-4d01-8d52-5b07f9a7ffd8 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1213 microversion: 2.1 time: 0.082222 Aug 27 05:25:21.205965 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3439/6926] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:21 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:22.214987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e5bb2a50-5ba6-4af5-b6f3-9880d397150b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:22.216649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e5bb2a50-5ba6-4af5-b6f3-9880d397150b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:22.224947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5bb2a50-5ba6-4af5-b6f3-9880d397150b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:22.225782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5bb2a50-5ba6-4af5-b6f3-9880d397150b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:22.226330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5bb2a50-5ba6-4af5-b6f3-9880d397150b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:22.227432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5bb2a50-5ba6-4af5-b6f3-9880d397150b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:22.228019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5bb2a50-5ba6-4af5-b6f3-9880d397150b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:22.228682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5bb2a50-5ba6-4af5-b6f3-9880d397150b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:22.315876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e5bb2a50-5ba6-4af5-b6f3-9880d397150b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:22.323942 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e5bb2a50-5ba6-4af5-b6f3-9880d397150b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1283 microversion: 2.1 time: 0.114255 Aug 27 05:25:22.324703 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3488/6927] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:22 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1283 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:23.347411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2a9c45c7-573f-4a89-a32b-3dd6c78eea46 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:23.348065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2a9c45c7-573f-4a89-a32b-3dd6c78eea46 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:23.357860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9c45c7-573f-4a89-a32b-3dd6c78eea46 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:23.359148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9c45c7-573f-4a89-a32b-3dd6c78eea46 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:23.359915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9c45c7-573f-4a89-a32b-3dd6c78eea46 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:23.360947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9c45c7-573f-4a89-a32b-3dd6c78eea46 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:23.361580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9c45c7-573f-4a89-a32b-3dd6c78eea46 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:23.362160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a9c45c7-573f-4a89-a32b-3dd6c78eea46 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:23.539804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a9c45c7-573f-4a89-a32b-3dd6c78eea46 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:23.549689 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2a9c45c7-573f-4a89-a32b-3dd6c78eea46 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1313 microversion: 2.1 time: 0.206850 Aug 27 05:25:23.564197 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3440/6928] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:23 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:23.662017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-477eadc9-b8a9-41fe-ac18-1633adffe5c8 req-b52d3d3a-4a9b-42d9-b8ff-b42a7ef1999a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a47c381-328b-42a4-808d-906fa1c3cb30", "tag": "bf7bd53a-37d2-40db-bb81-2d11c625440a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:23.681348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-477eadc9-b8a9-41fe-ac18-1633adffe5c8 req-b52d3d3a-4a9b-42d9-b8ff-b42a7ef1999a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:23.681860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-477eadc9-b8a9-41fe-ac18-1633adffe5c8 req-b52d3d3a-4a9b-42d9-b8ff-b42a7ef1999a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:23.682296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-477eadc9-b8a9-41fe-ac18-1633adffe5c8 req-b52d3d3a-4a9b-42d9-b8ff-b42a7ef1999a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:23.697440 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-477eadc9-b8a9-41fe-ac18-1633adffe5c8 req-b52d3d3a-4a9b-42d9-b8ff-b42a7ef1999a service nova] Creating event network-changed:bf7bd53a-37d2-40db-bb81-2d11c625440a for instance 3a47c381-328b-42a4-808d-906fa1c3cb30 on n-h1-854823-1 Aug 27 05:25:23.702704 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-477eadc9-b8a9-41fe-ac18-1633adffe5c8 req-b52d3d3a-4a9b-42d9-b8ff-b42a7ef1999a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046342 Aug 27 05:25:23.704249 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3489/6929] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:24.571265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-006253c8-b9d7-42bb-ab83-0a2aa08e4a14 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:24.572221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-006253c8-b9d7-42bb-ab83-0a2aa08e4a14 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:24.579768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-006253c8-b9d7-42bb-ab83-0a2aa08e4a14 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:24.580244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-006253c8-b9d7-42bb-ab83-0a2aa08e4a14 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:24.580705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-006253c8-b9d7-42bb-ab83-0a2aa08e4a14 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:24.581390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-006253c8-b9d7-42bb-ab83-0a2aa08e4a14 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:24.581841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-006253c8-b9d7-42bb-ab83-0a2aa08e4a14 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:24.582262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-006253c8-b9d7-42bb-ab83-0a2aa08e4a14 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:24.711937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-006253c8-b9d7-42bb-ab83-0a2aa08e4a14 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:24.719934 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-006253c8-b9d7-42bb-ab83-0a2aa08e4a14 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1313 microversion: 2.1 time: 0.152788 Aug 27 05:25:24.720508 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3441/6930] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:24 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:25.742405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81664891-8f43-4079-a3c1-9a9c0d6449d4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:25.743028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-81664891-8f43-4079-a3c1-9a9c0d6449d4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:25.745012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:25.750954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81664891-8f43-4079-a3c1-9a9c0d6449d4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:25.751452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81664891-8f43-4079-a3c1-9a9c0d6449d4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:25.751899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81664891-8f43-4079-a3c1-9a9c0d6449d4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:25.752635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81664891-8f43-4079-a3c1-9a9c0d6449d4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:25.753106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81664891-8f43-4079-a3c1-9a9c0d6449d4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:25.753544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81664891-8f43-4079-a3c1-9a9c0d6449d4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:25.756823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:25.887919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-81664891-8f43-4079-a3c1-9a9c0d6449d4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:25.896290 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-81664891-8f43-4079-a3c1-9a9c0d6449d4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1313 microversion: 2.1 time: 0.159202 Aug 27 05:25:25.896906 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3490/6931] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:25 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:26.917369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d7bcf4ec-a653-45eb-89e4-e5d7c002145d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:26.917990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d7bcf4ec-a653-45eb-89e4-e5d7c002145d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:26.920751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:26.926155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7bcf4ec-a653-45eb-89e4-e5d7c002145d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:26.926642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7bcf4ec-a653-45eb-89e4-e5d7c002145d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:26.927086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7bcf4ec-a653-45eb-89e4-e5d7c002145d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:26.927787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7bcf4ec-a653-45eb-89e4-e5d7c002145d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:26.928252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7bcf4ec-a653-45eb-89e4-e5d7c002145d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:26.928717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7bcf4ec-a653-45eb-89e4-e5d7c002145d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:26.932117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=72 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:27.063281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d7bcf4ec-a653-45eb-89e4-e5d7c002145d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:27.070948 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d7bcf4ec-a653-45eb-89e4-e5d7c002145d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1313 microversion: 2.1 time: 0.157614 Aug 27 05:25:27.071515 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3442/6932] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:26 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:28.092363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90e88a67-dafc-4776-952f-41d1c7c61c1e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:28.093036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90e88a67-dafc-4776-952f-41d1c7c61c1e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:28.100451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90e88a67-dafc-4776-952f-41d1c7c61c1e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:28.101003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90e88a67-dafc-4776-952f-41d1c7c61c1e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:28.101459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90e88a67-dafc-4776-952f-41d1c7c61c1e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:28.102179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90e88a67-dafc-4776-952f-41d1c7c61c1e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:28.102646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90e88a67-dafc-4776-952f-41d1c7c61c1e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:28.103087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90e88a67-dafc-4776-952f-41d1c7c61c1e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:28.237849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-90e88a67-dafc-4776-952f-41d1c7c61c1e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:28.245668 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90e88a67-dafc-4776-952f-41d1c7c61c1e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1313 microversion: 2.1 time: 0.158225 Aug 27 05:25:28.246290 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3491/6933] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:28 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:29.237577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a7ffa40d-2323-4311-a12f-452854a866a5 req-5c947dcb-66e7-4cd0-a4d3-5ca4812dd555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a47c381-328b-42a4-808d-906fa1c3cb30", "name": "network-vif-plugged", "status": "completed", "tag": "bf7bd53a-37d2-40db-bb81-2d11c625440a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:29.248818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a7ffa40d-2323-4311-a12f-452854a866a5 req-5c947dcb-66e7-4cd0-a4d3-5ca4812dd555 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:29.249348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a7ffa40d-2323-4311-a12f-452854a866a5 req-5c947dcb-66e7-4cd0-a4d3-5ca4812dd555 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:29.249791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a7ffa40d-2323-4311-a12f-452854a866a5 req-5c947dcb-66e7-4cd0-a4d3-5ca4812dd555 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:29.261869 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a7ffa40d-2323-4311-a12f-452854a866a5 req-5c947dcb-66e7-4cd0-a4d3-5ca4812dd555 service nova] Creating event network-vif-plugged:bf7bd53a-37d2-40db-bb81-2d11c625440a for instance 3a47c381-328b-42a4-808d-906fa1c3cb30 on n-h1-854823-1 Aug 27 05:25:29.267757 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a7ffa40d-2323-4311-a12f-452854a866a5 req-5c947dcb-66e7-4cd0-a4d3-5ca4812dd555 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034209 Aug 27 05:25:29.268517 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3443/6934] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:25:29.268657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28c815ea-f524-4c57-aca1-6fee06250655 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:29.269242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-28c815ea-f524-4c57-aca1-6fee06250655 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:29.277678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28c815ea-f524-4c57-aca1-6fee06250655 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:29.278182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28c815ea-f524-4c57-aca1-6fee06250655 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:29.278632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28c815ea-f524-4c57-aca1-6fee06250655 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:29.279370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28c815ea-f524-4c57-aca1-6fee06250655 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:29.279997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28c815ea-f524-4c57-aca1-6fee06250655 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:29.280489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28c815ea-f524-4c57-aca1-6fee06250655 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:29.473727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-28c815ea-f524-4c57-aca1-6fee06250655 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:29.482018 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-28c815ea-f524-4c57-aca1-6fee06250655 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1313 microversion: 2.1 time: 0.219949 Aug 27 05:25:29.482701 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3492/6935] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:29 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:30.505030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e1b48362-de3d-4711-a62f-2584113f2940 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:30.505742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e1b48362-de3d-4711-a62f-2584113f2940 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:30.512225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1b48362-de3d-4711-a62f-2584113f2940 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:30.512809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1b48362-de3d-4711-a62f-2584113f2940 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:30.513428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1b48362-de3d-4711-a62f-2584113f2940 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:30.514298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1b48362-de3d-4711-a62f-2584113f2940 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:30.514940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1b48362-de3d-4711-a62f-2584113f2940 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:30.515535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1b48362-de3d-4711-a62f-2584113f2940 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:30.648210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e1b48362-de3d-4711-a62f-2584113f2940 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:30.656159 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e1b48362-de3d-4711-a62f-2584113f2940 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1313 microversion: 2.1 time: 0.156322 Aug 27 05:25:30.657390 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3444/6936] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:30 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:31.677863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37c79740-20f7-49cd-90bb-da9fc303bddf tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:31.678489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37c79740-20f7-49cd-90bb-da9fc303bddf tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:31.681285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:31.681976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:31.688343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37c79740-20f7-49cd-90bb-da9fc303bddf tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:31.688875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37c79740-20f7-49cd-90bb-da9fc303bddf tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:31.689330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37c79740-20f7-49cd-90bb-da9fc303bddf tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:31.690038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37c79740-20f7-49cd-90bb-da9fc303bddf tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:31.690512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37c79740-20f7-49cd-90bb-da9fc303bddf tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:31.690952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37c79740-20f7-49cd-90bb-da9fc303bddf tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:31.824122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-37c79740-20f7-49cd-90bb-da9fc303bddf tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:31.831973 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37c79740-20f7-49cd-90bb-da9fc303bddf tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1499 microversion: 2.1 time: 0.158164 Aug 27 05:25:31.832575 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3493/6937] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:31 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1499 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:25:31.852757 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:25:31.855581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:31.857652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:31.864506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:31.865025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:31.865487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:31.866218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:31.866720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:31.867152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:31.897980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:31.903909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Old instance type m1.heat2, new instance type m1.heat {{(pid=128870) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:25:31.910899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:25:31.911323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:25:31.911800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:25:31.912215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:25:31.912650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:25:31.978740 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d8982b23-f8f9-4285-8f5f-cfcb96ec5391 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "POST /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30/action" status: 202 len: 0 microversion: 2.1 time: 0.130059 Aug 27 05:25:31.979369 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3445/6938] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:25:31 2022] POST /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:25:31.988263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8921f5ae-66a9-4b49-8ba7-d270e9c3b294 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:31.989112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8921f5ae-66a9-4b49-8ba7-d270e9c3b294 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:31.995421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8921f5ae-66a9-4b49-8ba7-d270e9c3b294 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:31.995926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8921f5ae-66a9-4b49-8ba7-d270e9c3b294 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:31.996381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8921f5ae-66a9-4b49-8ba7-d270e9c3b294 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:31.997129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8921f5ae-66a9-4b49-8ba7-d270e9c3b294 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:31.997605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8921f5ae-66a9-4b49-8ba7-d270e9c3b294 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:31.998045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8921f5ae-66a9-4b49-8ba7-d270e9c3b294 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:32.135403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8921f5ae-66a9-4b49-8ba7-d270e9c3b294 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:32.143951 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8921f5ae-66a9-4b49-8ba7-d270e9c3b294 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1508 microversion: 2.1 time: 0.160260 Aug 27 05:25:32.144661 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3494/6939] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:31 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:33.167337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-104cc08f-4a90-4ea6-9ab8-fc491ef0365b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:33.167898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-104cc08f-4a90-4ea6-9ab8-fc491ef0365b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:33.175211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-104cc08f-4a90-4ea6-9ab8-fc491ef0365b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:33.175696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-104cc08f-4a90-4ea6-9ab8-fc491ef0365b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:33.176185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-104cc08f-4a90-4ea6-9ab8-fc491ef0365b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:33.177073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-104cc08f-4a90-4ea6-9ab8-fc491ef0365b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:33.177630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-104cc08f-4a90-4ea6-9ab8-fc491ef0365b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:33.178029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-104cc08f-4a90-4ea6-9ab8-fc491ef0365b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:33.317068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-104cc08f-4a90-4ea6-9ab8-fc491ef0365b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:33.327341 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-104cc08f-4a90-4ea6-9ab8-fc491ef0365b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1508 microversion: 2.1 time: 0.164608 Aug 27 05:25:33.328393 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3446/6940] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:33 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:34.349814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea1bef4d-d9cb-44dc-a089-6e574ce01f45 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:34.350496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea1bef4d-d9cb-44dc-a089-6e574ce01f45 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:34.358274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea1bef4d-d9cb-44dc-a089-6e574ce01f45 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:34.359075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea1bef4d-d9cb-44dc-a089-6e574ce01f45 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:34.360226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea1bef4d-d9cb-44dc-a089-6e574ce01f45 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:34.361026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea1bef4d-d9cb-44dc-a089-6e574ce01f45 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:34.361531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea1bef4d-d9cb-44dc-a089-6e574ce01f45 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:34.362144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea1bef4d-d9cb-44dc-a089-6e574ce01f45 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:34.507321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ea1bef4d-d9cb-44dc-a089-6e574ce01f45 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:34.515397 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea1bef4d-d9cb-44dc-a089-6e574ce01f45 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1508 microversion: 2.1 time: 0.170099 Aug 27 05:25:34.516037 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3495/6941] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:34 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:35.536491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-85492470-18c8-432d-83bf-096914fa5f6d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:35.537138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-85492470-18c8-432d-83bf-096914fa5f6d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:35.544024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85492470-18c8-432d-83bf-096914fa5f6d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:35.544513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85492470-18c8-432d-83bf-096914fa5f6d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:35.544994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85492470-18c8-432d-83bf-096914fa5f6d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:35.545697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85492470-18c8-432d-83bf-096914fa5f6d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:35.546157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85492470-18c8-432d-83bf-096914fa5f6d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:35.546583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85492470-18c8-432d-83bf-096914fa5f6d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:35.675580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-85492470-18c8-432d-83bf-096914fa5f6d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:35.683307 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-85492470-18c8-432d-83bf-096914fa5f6d tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.150805 Aug 27 05:25:35.683880 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3447/6942] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:35 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:36.705905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-792606e9-e18c-4c55-ba75-1fe9eaadd233 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:36.706528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-792606e9-e18c-4c55-ba75-1fe9eaadd233 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:36.713552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-792606e9-e18c-4c55-ba75-1fe9eaadd233 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:36.714053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-792606e9-e18c-4c55-ba75-1fe9eaadd233 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:36.714501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-792606e9-e18c-4c55-ba75-1fe9eaadd233 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:36.715218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-792606e9-e18c-4c55-ba75-1fe9eaadd233 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:36.715685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-792606e9-e18c-4c55-ba75-1fe9eaadd233 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:36.716122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-792606e9-e18c-4c55-ba75-1fe9eaadd233 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:36.848372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-792606e9-e18c-4c55-ba75-1fe9eaadd233 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:36.856697 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-792606e9-e18c-4c55-ba75-1fe9eaadd233 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.155220 Aug 27 05:25:36.857297 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3496/6943] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:36 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:37.877312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-42731f91-fa0d-4dab-a3bd-342e06ce9e2b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:37.877933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-42731f91-fa0d-4dab-a3bd-342e06ce9e2b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:37.885141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42731f91-fa0d-4dab-a3bd-342e06ce9e2b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:37.885645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42731f91-fa0d-4dab-a3bd-342e06ce9e2b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:37.886085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42731f91-fa0d-4dab-a3bd-342e06ce9e2b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:37.886777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42731f91-fa0d-4dab-a3bd-342e06ce9e2b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:37.887237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42731f91-fa0d-4dab-a3bd-342e06ce9e2b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:37.887664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-42731f91-fa0d-4dab-a3bd-342e06ce9e2b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:38.025421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-42731f91-fa0d-4dab-a3bd-342e06ce9e2b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:38.033089 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-42731f91-fa0d-4dab-a3bd-342e06ce9e2b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.160310 Aug 27 05:25:38.033670 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3448/6944] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:37 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:39.053263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef1882a7-f8b2-4114-befe-7f45c5516059 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:39.053891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef1882a7-f8b2-4114-befe-7f45c5516059 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:39.061140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1882a7-f8b2-4114-befe-7f45c5516059 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:39.061637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1882a7-f8b2-4114-befe-7f45c5516059 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:39.062087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1882a7-f8b2-4114-befe-7f45c5516059 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:39.062797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1882a7-f8b2-4114-befe-7f45c5516059 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:39.063261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1882a7-f8b2-4114-befe-7f45c5516059 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:39.063698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1882a7-f8b2-4114-befe-7f45c5516059 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:39.199285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef1882a7-f8b2-4114-befe-7f45c5516059 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:39.207748 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef1882a7-f8b2-4114-befe-7f45c5516059 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.158475 Aug 27 05:25:39.208326 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3497/6945] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:39 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:40.228500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e46c6b56-522e-49d0-88c9-8894ad9fc698 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:40.229137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e46c6b56-522e-49d0-88c9-8894ad9fc698 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:40.236663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e46c6b56-522e-49d0-88c9-8894ad9fc698 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:40.237145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e46c6b56-522e-49d0-88c9-8894ad9fc698 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:40.237587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e46c6b56-522e-49d0-88c9-8894ad9fc698 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:40.238270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e46c6b56-522e-49d0-88c9-8894ad9fc698 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:40.238723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e46c6b56-522e-49d0-88c9-8894ad9fc698 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:40.239145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e46c6b56-522e-49d0-88c9-8894ad9fc698 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:40.368008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e46c6b56-522e-49d0-88c9-8894ad9fc698 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:40.375752 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e46c6b56-522e-49d0-88c9-8894ad9fc698 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.151128 Aug 27 05:25:40.376327 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3449/6946] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:40 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:41.398031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a44e76c-08e3-490f-9205-7de5e2df5528 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:41.398612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a44e76c-08e3-490f-9205-7de5e2df5528 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:41.406762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a44e76c-08e3-490f-9205-7de5e2df5528 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:41.407769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a44e76c-08e3-490f-9205-7de5e2df5528 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:41.408298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a44e76c-08e3-490f-9205-7de5e2df5528 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:41.409152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a44e76c-08e3-490f-9205-7de5e2df5528 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:41.409827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a44e76c-08e3-490f-9205-7de5e2df5528 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:41.410038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a44e76c-08e3-490f-9205-7de5e2df5528 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:41.544654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a44e76c-08e3-490f-9205-7de5e2df5528 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:41.553067 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a44e76c-08e3-490f-9205-7de5e2df5528 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.159573 Aug 27 05:25:41.553659 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3498/6947] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:41 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:42.574012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-082ba64c-1a06-45e8-977b-73b77fb66f25 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:42.574624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-082ba64c-1a06-45e8-977b-73b77fb66f25 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:42.582111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-082ba64c-1a06-45e8-977b-73b77fb66f25 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:42.582592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-082ba64c-1a06-45e8-977b-73b77fb66f25 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:42.583024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-082ba64c-1a06-45e8-977b-73b77fb66f25 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:42.583710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-082ba64c-1a06-45e8-977b-73b77fb66f25 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:42.584164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-082ba64c-1a06-45e8-977b-73b77fb66f25 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:42.584612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-082ba64c-1a06-45e8-977b-73b77fb66f25 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:42.724152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-082ba64c-1a06-45e8-977b-73b77fb66f25 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:42.732681 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-082ba64c-1a06-45e8-977b-73b77fb66f25 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.162546 Aug 27 05:25:42.733258 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3450/6948] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:42 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:43.753674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cd8a7aa4-9a69-4b2a-a00e-3a9486ea75dc tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:43.754226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cd8a7aa4-9a69-4b2a-a00e-3a9486ea75dc tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:43.761332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8a7aa4-9a69-4b2a-a00e-3a9486ea75dc tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:43.761832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8a7aa4-9a69-4b2a-a00e-3a9486ea75dc tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:43.762283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8a7aa4-9a69-4b2a-a00e-3a9486ea75dc tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:43.762992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8a7aa4-9a69-4b2a-a00e-3a9486ea75dc tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:43.763467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8a7aa4-9a69-4b2a-a00e-3a9486ea75dc tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:43.763905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8a7aa4-9a69-4b2a-a00e-3a9486ea75dc tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:43.893548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cd8a7aa4-9a69-4b2a-a00e-3a9486ea75dc tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:43.901775 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cd8a7aa4-9a69-4b2a-a00e-3a9486ea75dc tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.152094 Aug 27 05:25:43.902390 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3499/6949] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:43 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:44.924097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c560207-cbf9-42dd-91dd-bb2ec72b37ef tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:44.924735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8c560207-cbf9-42dd-91dd-bb2ec72b37ef tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:44.931605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c560207-cbf9-42dd-91dd-bb2ec72b37ef tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:44.932084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c560207-cbf9-42dd-91dd-bb2ec72b37ef tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:44.932514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c560207-cbf9-42dd-91dd-bb2ec72b37ef tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:44.933222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c560207-cbf9-42dd-91dd-bb2ec72b37ef tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:44.933671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c560207-cbf9-42dd-91dd-bb2ec72b37ef tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:44.934091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c560207-cbf9-42dd-91dd-bb2ec72b37ef tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:45.062287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8c560207-cbf9-42dd-91dd-bb2ec72b37ef tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:45.070715 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8c560207-cbf9-42dd-91dd-bb2ec72b37ef tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.150994 Aug 27 05:25:45.071296 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3451/6950] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:44 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:46.092089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcb84145-3055-41a2-a9e5-2b4057a33b43 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:46.092833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fcb84145-3055-41a2-a9e5-2b4057a33b43 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:46.100345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcb84145-3055-41a2-a9e5-2b4057a33b43 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:46.100896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcb84145-3055-41a2-a9e5-2b4057a33b43 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:46.101510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcb84145-3055-41a2-a9e5-2b4057a33b43 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:46.102259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcb84145-3055-41a2-a9e5-2b4057a33b43 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:46.102844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcb84145-3055-41a2-a9e5-2b4057a33b43 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:46.103300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcb84145-3055-41a2-a9e5-2b4057a33b43 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:46.236599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fcb84145-3055-41a2-a9e5-2b4057a33b43 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:46.244473 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fcb84145-3055-41a2-a9e5-2b4057a33b43 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.156339 Aug 27 05:25:46.245098 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3500/6951] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:46 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:47.265602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-69bfa401-75cf-4811-a7b0-ff8de5c2cf6a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:47.266228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-69bfa401-75cf-4811-a7b0-ff8de5c2cf6a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:47.273934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69bfa401-75cf-4811-a7b0-ff8de5c2cf6a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:47.274424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69bfa401-75cf-4811-a7b0-ff8de5c2cf6a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:47.274868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69bfa401-75cf-4811-a7b0-ff8de5c2cf6a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:47.275572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69bfa401-75cf-4811-a7b0-ff8de5c2cf6a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:47.276033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69bfa401-75cf-4811-a7b0-ff8de5c2cf6a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:47.276463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69bfa401-75cf-4811-a7b0-ff8de5c2cf6a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:47.406511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-69bfa401-75cf-4811-a7b0-ff8de5c2cf6a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:47.415054 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-69bfa401-75cf-4811-a7b0-ff8de5c2cf6a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.153443 Aug 27 05:25:47.415631 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3452/6952] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:47 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:48.436153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-360c952b-0d9e-4737-92ff-99c5314cd51e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:48.436809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-360c952b-0d9e-4737-92ff-99c5314cd51e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:48.444443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-360c952b-0d9e-4737-92ff-99c5314cd51e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:48.444992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-360c952b-0d9e-4737-92ff-99c5314cd51e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:48.445444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-360c952b-0d9e-4737-92ff-99c5314cd51e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:48.446160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-360c952b-0d9e-4737-92ff-99c5314cd51e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:48.446633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-360c952b-0d9e-4737-92ff-99c5314cd51e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:48.447074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-360c952b-0d9e-4737-92ff-99c5314cd51e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:48.577697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-360c952b-0d9e-4737-92ff-99c5314cd51e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:48.585596 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-360c952b-0d9e-4737-92ff-99c5314cd51e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.153423 Aug 27 05:25:48.586233 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3501/6953] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:48 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:49.606586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5c065b02-e08e-4f5f-9965-530bc6f1facd tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:49.607121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5c065b02-e08e-4f5f-9965-530bc6f1facd tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:49.613995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c065b02-e08e-4f5f-9965-530bc6f1facd tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:49.614477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c065b02-e08e-4f5f-9965-530bc6f1facd tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:49.614915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c065b02-e08e-4f5f-9965-530bc6f1facd tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:49.615602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c065b02-e08e-4f5f-9965-530bc6f1facd tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:49.616057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c065b02-e08e-4f5f-9965-530bc6f1facd tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:49.616478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c065b02-e08e-4f5f-9965-530bc6f1facd tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:49.747893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5c065b02-e08e-4f5f-9965-530bc6f1facd tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:49.756058 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5c065b02-e08e-4f5f-9965-530bc6f1facd tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.153549 Aug 27 05:25:49.756675 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3453/6954] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:49 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:50.778255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c7ff62c-f9e1-4e92-9d12-c06e92e2da2a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:50.778893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c7ff62c-f9e1-4e92-9d12-c06e92e2da2a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:50.786508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c7ff62c-f9e1-4e92-9d12-c06e92e2da2a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:50.787013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c7ff62c-f9e1-4e92-9d12-c06e92e2da2a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:50.787467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c7ff62c-f9e1-4e92-9d12-c06e92e2da2a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:50.788183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c7ff62c-f9e1-4e92-9d12-c06e92e2da2a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:50.788720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c7ff62c-f9e1-4e92-9d12-c06e92e2da2a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:50.789185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c7ff62c-f9e1-4e92-9d12-c06e92e2da2a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:50.921983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c7ff62c-f9e1-4e92-9d12-c06e92e2da2a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:50.929942 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c7ff62c-f9e1-4e92-9d12-c06e92e2da2a tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.155675 Aug 27 05:25:50.930525 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3502/6955] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:50 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:51.950569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0acc5cd8-a23a-427b-be00-1aef543cac72 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:51.951094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0acc5cd8-a23a-427b-be00-1aef543cac72 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:51.958694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0acc5cd8-a23a-427b-be00-1aef543cac72 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:51.959182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0acc5cd8-a23a-427b-be00-1aef543cac72 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:51.959624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0acc5cd8-a23a-427b-be00-1aef543cac72 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:51.960326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0acc5cd8-a23a-427b-be00-1aef543cac72 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:51.960814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0acc5cd8-a23a-427b-be00-1aef543cac72 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:51.961244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0acc5cd8-a23a-427b-be00-1aef543cac72 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:52.091602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0acc5cd8-a23a-427b-be00-1aef543cac72 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:52.099467 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0acc5cd8-a23a-427b-be00-1aef543cac72 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.152966 Aug 27 05:25:52.100081 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3454/6956] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:51 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:53.122487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb78673f-a605-4a75-bed8-dcdbc434df70 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:53.123126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fb78673f-a605-4a75-bed8-dcdbc434df70 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:53.130435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb78673f-a605-4a75-bed8-dcdbc434df70 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:53.130938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb78673f-a605-4a75-bed8-dcdbc434df70 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:53.131383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb78673f-a605-4a75-bed8-dcdbc434df70 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:53.132100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb78673f-a605-4a75-bed8-dcdbc434df70 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:53.132747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb78673f-a605-4a75-bed8-dcdbc434df70 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:53.133520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb78673f-a605-4a75-bed8-dcdbc434df70 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:53.276591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fb78673f-a605-4a75-bed8-dcdbc434df70 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:53.285942 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fb78673f-a605-4a75-bed8-dcdbc434df70 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.167367 Aug 27 05:25:53.286531 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3503/6957] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:53 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:54.307205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1998ee85-f7e7-431b-b4a5-af723da4b7c3 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:54.307815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1998ee85-f7e7-431b-b4a5-af723da4b7c3 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:54.314852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1998ee85-f7e7-431b-b4a5-af723da4b7c3 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:54.315333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1998ee85-f7e7-431b-b4a5-af723da4b7c3 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:54.315768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1998ee85-f7e7-431b-b4a5-af723da4b7c3 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:54.316454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1998ee85-f7e7-431b-b4a5-af723da4b7c3 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:54.316941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1998ee85-f7e7-431b-b4a5-af723da4b7c3 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:54.317393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1998ee85-f7e7-431b-b4a5-af723da4b7c3 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:54.451324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1998ee85-f7e7-431b-b4a5-af723da4b7c3 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:54.459128 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1998ee85-f7e7-431b-b4a5-af723da4b7c3 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.155980 Aug 27 05:25:54.459711 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3455/6958] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:54 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:55.480595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a1aad07-a7a1-4f9f-a852-d947cfa5cca2 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:55.481156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a1aad07-a7a1-4f9f-a852-d947cfa5cca2 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:55.488837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a1aad07-a7a1-4f9f-a852-d947cfa5cca2 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:55.489343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a1aad07-a7a1-4f9f-a852-d947cfa5cca2 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:55.489836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a1aad07-a7a1-4f9f-a852-d947cfa5cca2 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:55.490589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a1aad07-a7a1-4f9f-a852-d947cfa5cca2 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:55.491085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a1aad07-a7a1-4f9f-a852-d947cfa5cca2 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:55.491529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a1aad07-a7a1-4f9f-a852-d947cfa5cca2 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:55.624240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a1aad07-a7a1-4f9f-a852-d947cfa5cca2 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:55.632720 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a1aad07-a7a1-4f9f-a852-d947cfa5cca2 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.156164 Aug 27 05:25:55.633312 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3504/6959] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:55 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:56.653363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ac3325ba-cd94-432e-8464-203ce5eb89ce tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:56.653991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ac3325ba-cd94-432e-8464-203ce5eb89ce tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:56.661429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac3325ba-cd94-432e-8464-203ce5eb89ce tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:56.661920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac3325ba-cd94-432e-8464-203ce5eb89ce tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:56.662362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac3325ba-cd94-432e-8464-203ce5eb89ce tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:56.663055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac3325ba-cd94-432e-8464-203ce5eb89ce tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:56.663535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac3325ba-cd94-432e-8464-203ce5eb89ce tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:56.664102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ac3325ba-cd94-432e-8464-203ce5eb89ce tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:56.794265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ac3325ba-cd94-432e-8464-203ce5eb89ce tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:56.802800 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ac3325ba-cd94-432e-8464-203ce5eb89ce tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.153345 Aug 27 05:25:56.803402 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3456/6960] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:56 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:57.823982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-71c2556f-95e8-4e64-bdc3-22cbde9acde4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:57.824765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-71c2556f-95e8-4e64-bdc3-22cbde9acde4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:57.827333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=30 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:57.833789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71c2556f-95e8-4e64-bdc3-22cbde9acde4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:57.834297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71c2556f-95e8-4e64-bdc3-22cbde9acde4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:57.834752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71c2556f-95e8-4e64-bdc3-22cbde9acde4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:57.835477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71c2556f-95e8-4e64-bdc3-22cbde9acde4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:57.835954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71c2556f-95e8-4e64-bdc3-22cbde9acde4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:57.836397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71c2556f-95e8-4e64-bdc3-22cbde9acde4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:57.839442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=90 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:57.972358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71c2556f-95e8-4e64-bdc3-22cbde9acde4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:57.980492 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-71c2556f-95e8-4e64-bdc3-22cbde9acde4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.160532 Aug 27 05:25:57.981104 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3505/6961] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:57 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:25:59.001769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4a211288-6ff6-41e9-af43-f08d8fc8c119 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:25:59.002385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4a211288-6ff6-41e9-af43-f08d8fc8c119 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:25:59.005329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=34 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:59.010686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a211288-6ff6-41e9-af43-f08d8fc8c119 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:59.011172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a211288-6ff6-41e9-af43-f08d8fc8c119 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:59.011605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a211288-6ff6-41e9-af43-f08d8fc8c119 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:59.012297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a211288-6ff6-41e9-af43-f08d8fc8c119 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:25:59.012786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a211288-6ff6-41e9-af43-f08d8fc8c119 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:25:59.013213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4a211288-6ff6-41e9-af43-f08d8fc8c119 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:25:59.015995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:25:59.149339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4a211288-6ff6-41e9-af43-f08d8fc8c119 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:25:59.157724 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4a211288-6ff6-41e9-af43-f08d8fc8c119 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.159380 Aug 27 05:25:59.158314 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3457/6962] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:25:58 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:00.180057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8586008f-391f-4174-90d8-d6ced0cdb250 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:00.181317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8586008f-391f-4174-90d8-d6ced0cdb250 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:00.187705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8586008f-391f-4174-90d8-d6ced0cdb250 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:00.188726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8586008f-391f-4174-90d8-d6ced0cdb250 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:00.189179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8586008f-391f-4174-90d8-d6ced0cdb250 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:00.189895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8586008f-391f-4174-90d8-d6ced0cdb250 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:00.190368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8586008f-391f-4174-90d8-d6ced0cdb250 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:00.190810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8586008f-391f-4174-90d8-d6ced0cdb250 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:00.320286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8586008f-391f-4174-90d8-d6ced0cdb250 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:00.328103 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8586008f-391f-4174-90d8-d6ced0cdb250 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.152910 Aug 27 05:26:00.329357 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3506/6963] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:00 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:01.349333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a6cfe644-7264-4cad-a621-517496f64f8e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:01.349892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a6cfe644-7264-4cad-a621-517496f64f8e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:01.356893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6cfe644-7264-4cad-a621-517496f64f8e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:01.357380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6cfe644-7264-4cad-a621-517496f64f8e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:01.357820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6cfe644-7264-4cad-a621-517496f64f8e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:01.358516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6cfe644-7264-4cad-a621-517496f64f8e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:01.358975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6cfe644-7264-4cad-a621-517496f64f8e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:01.359403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6cfe644-7264-4cad-a621-517496f64f8e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:01.499731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a6cfe644-7264-4cad-a621-517496f64f8e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:01.508379 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a6cfe644-7264-4cad-a621-517496f64f8e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1513 microversion: 2.1 time: 0.163619 Aug 27 05:26:01.509139 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3458/6964] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:01 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:02.527054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ce95cba5-468a-4813-bcd4-172188d8b928 req-f4ba5f7f-5d5e-4607-b73e-8056abd5ee72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a47c381-328b-42a4-808d-906fa1c3cb30", "name": "network-vif-unplugged", "status": "completed", "tag": "bf7bd53a-37d2-40db-bb81-2d11c625440a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:02.530880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4d67dafe-52d6-4bbe-9c01-d64f54064c02 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:02.531516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4d67dafe-52d6-4bbe-9c01-d64f54064c02 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:02.537075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce95cba5-468a-4813-bcd4-172188d8b928 req-f4ba5f7f-5d5e-4607-b73e-8056abd5ee72 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:02.537586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce95cba5-468a-4813-bcd4-172188d8b928 req-f4ba5f7f-5d5e-4607-b73e-8056abd5ee72 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:02.538043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce95cba5-468a-4813-bcd4-172188d8b928 req-f4ba5f7f-5d5e-4607-b73e-8056abd5ee72 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:02.538487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d67dafe-52d6-4bbe-9c01-d64f54064c02 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:02.539248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d67dafe-52d6-4bbe-9c01-d64f54064c02 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:02.539938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d67dafe-52d6-4bbe-9c01-d64f54064c02 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:02.540953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d67dafe-52d6-4bbe-9c01-d64f54064c02 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:02.541649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d67dafe-52d6-4bbe-9c01-d64f54064c02 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:02.542418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4d67dafe-52d6-4bbe-9c01-d64f54064c02 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:02.552700 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ce95cba5-468a-4813-bcd4-172188d8b928 req-f4ba5f7f-5d5e-4607-b73e-8056abd5ee72 service nova] Creating event network-vif-unplugged:bf7bd53a-37d2-40db-bb81-2d11c625440a for instance 3a47c381-328b-42a4-808d-906fa1c3cb30 on n-h2-854823-1 Aug 27 05:26:02.558943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-ce95cba5-468a-4813-bcd4-172188d8b928 req-f4ba5f7f-5d5e-4607-b73e-8056abd5ee72 service nova] Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:26:02.572437 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ce95cba5-468a-4813-bcd4-172188d8b928 req-f4ba5f7f-5d5e-4607-b73e-8056abd5ee72 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121566 Aug 27 05:26:02.573652 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3507/6965] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:02.752251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4d67dafe-52d6-4bbe-9c01-d64f54064c02 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:02.764084 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4d67dafe-52d6-4bbe-9c01-d64f54064c02 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1512 microversion: 2.1 time: 0.237097 Aug 27 05:26:02.765102 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3459/6966] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:02 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:03.795674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b6bb4b47-cc97-481f-91eb-066e2d6711db tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:03.796424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b6bb4b47-cc97-481f-91eb-066e2d6711db tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:03.802713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6bb4b47-cc97-481f-91eb-066e2d6711db tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:03.803216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6bb4b47-cc97-481f-91eb-066e2d6711db tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:03.803674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6bb4b47-cc97-481f-91eb-066e2d6711db tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:03.804395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6bb4b47-cc97-481f-91eb-066e2d6711db tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:03.804896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6bb4b47-cc97-481f-91eb-066e2d6711db tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:03.805339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6bb4b47-cc97-481f-91eb-066e2d6711db tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:03.943360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b6bb4b47-cc97-481f-91eb-066e2d6711db tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:03.951404 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b6bb4b47-cc97-481f-91eb-066e2d6711db tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1510 microversion: 2.1 time: 0.160947 Aug 27 05:26:03.951988 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3508/6967] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:03 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:04.592821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1171d229-7953-43ba-84bf-6261c782754a req-49f73e02-9b94-46ec-85ab-dad3a3db414a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a47c381-328b-42a4-808d-906fa1c3cb30", "tag": "bf7bd53a-37d2-40db-bb81-2d11c625440a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:04.603457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1171d229-7953-43ba-84bf-6261c782754a req-49f73e02-9b94-46ec-85ab-dad3a3db414a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:04.603938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1171d229-7953-43ba-84bf-6261c782754a req-49f73e02-9b94-46ec-85ab-dad3a3db414a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:04.604371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1171d229-7953-43ba-84bf-6261c782754a req-49f73e02-9b94-46ec-85ab-dad3a3db414a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:04.617268 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1171d229-7953-43ba-84bf-6261c782754a req-49f73e02-9b94-46ec-85ab-dad3a3db414a service nova] Creating event network-changed:bf7bd53a-37d2-40db-bb81-2d11c625440a for instance 3a47c381-328b-42a4-808d-906fa1c3cb30 on n-h2-854823-1 Aug 27 05:26:04.622603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-1171d229-7953-43ba-84bf-6261c782754a req-49f73e02-9b94-46ec-85ab-dad3a3db414a service nova] Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:26:04.634057 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1171d229-7953-43ba-84bf-6261c782754a req-49f73e02-9b94-46ec-85ab-dad3a3db414a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045152 Aug 27 05:26:04.634669 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3460/6968] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:04.973483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47b25f34-8ed9-4f50-a4eb-a7ab8a3f1a99 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:04.974127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47b25f34-8ed9-4f50-a4eb-a7ab8a3f1a99 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:04.981268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b25f34-8ed9-4f50-a4eb-a7ab8a3f1a99 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:04.981783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b25f34-8ed9-4f50-a4eb-a7ab8a3f1a99 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:04.982240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b25f34-8ed9-4f50-a4eb-a7ab8a3f1a99 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:04.982968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b25f34-8ed9-4f50-a4eb-a7ab8a3f1a99 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:04.983444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b25f34-8ed9-4f50-a4eb-a7ab8a3f1a99 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:04.983888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b25f34-8ed9-4f50-a4eb-a7ab8a3f1a99 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:05.218911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47b25f34-8ed9-4f50-a4eb-a7ab8a3f1a99 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:05.245717 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47b25f34-8ed9-4f50-a4eb-a7ab8a3f1a99 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1510 microversion: 2.1 time: 0.275609 Aug 27 05:26:05.247191 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3509/6969] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:04 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1510 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:06.284269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-40a19f16-ec61-4871-b24e-bade0efc425f tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:06.285004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-40a19f16-ec61-4871-b24e-bade0efc425f tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:06.291390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40a19f16-ec61-4871-b24e-bade0efc425f tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:06.291876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40a19f16-ec61-4871-b24e-bade0efc425f tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:06.292313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40a19f16-ec61-4871-b24e-bade0efc425f tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:06.293037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40a19f16-ec61-4871-b24e-bade0efc425f tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:06.293496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40a19f16-ec61-4871-b24e-bade0efc425f tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:06.293923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40a19f16-ec61-4871-b24e-bade0efc425f tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:06.428604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-40a19f16-ec61-4871-b24e-bade0efc425f tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:06.436497 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-40a19f16-ec61-4871-b24e-bade0efc425f tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1507 microversion: 2.1 time: 0.157914 Aug 27 05:26:06.437098 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3461/6970] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:06 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:06.457215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7fe1467e-5673-472d-9436-eb49da5e3d68 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:06.457736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7fe1467e-5673-472d-9436-eb49da5e3d68 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:06.464988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fe1467e-5673-472d-9436-eb49da5e3d68 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:06.465495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fe1467e-5673-472d-9436-eb49da5e3d68 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:06.465946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fe1467e-5673-472d-9436-eb49da5e3d68 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:06.466663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fe1467e-5673-472d-9436-eb49da5e3d68 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:06.467137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fe1467e-5673-472d-9436-eb49da5e3d68 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:06.467581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fe1467e-5673-472d-9436-eb49da5e3d68 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:06.498673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7fe1467e-5673-472d-9436-eb49da5e3d68 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:26:06.551402 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.compute.api [None req-7fe1467e-5673-472d-9436-eb49da5e3d68 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Found an unconfirmed migration during delete, id: 16, status: finished Aug 27 05:26:07.501322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-c69db6cf-7ebd-45b6-9025-99177c67245a req-2a8ebc04-55b7-46de-8c97-c6d37adb6d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a47c381-328b-42a4-808d-906fa1c3cb30", "name": "network-vif-plugged", "status": "completed", "tag": "bf7bd53a-37d2-40db-bb81-2d11c625440a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:07.513039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c69db6cf-7ebd-45b6-9025-99177c67245a req-2a8ebc04-55b7-46de-8c97-c6d37adb6d7c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:07.513791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c69db6cf-7ebd-45b6-9025-99177c67245a req-2a8ebc04-55b7-46de-8c97-c6d37adb6d7c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:07.514466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-c69db6cf-7ebd-45b6-9025-99177c67245a req-2a8ebc04-55b7-46de-8c97-c6d37adb6d7c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:07.529840 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-c69db6cf-7ebd-45b6-9025-99177c67245a req-2a8ebc04-55b7-46de-8c97-c6d37adb6d7c service nova] Creating event network-vif-plugged:bf7bd53a-37d2-40db-bb81-2d11c625440a for instance 3a47c381-328b-42a4-808d-906fa1c3cb30 on n-h2-854823-1 Aug 27 05:26:07.535884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-c69db6cf-7ebd-45b6-9025-99177c67245a req-2a8ebc04-55b7-46de-8c97-c6d37adb6d7c service nova] Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:26:07.548792 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-c69db6cf-7ebd-45b6-9025-99177c67245a req-2a8ebc04-55b7-46de-8c97-c6d37adb6d7c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051355 Aug 27 05:26:07.549708 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3462/6971] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:26:07.943762 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7fe1467e-5673-472d-9436-eb49da5e3d68 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 204 len: 0 microversion: 2.1 time: 1.490187 Aug 27 05:26:07.944451 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3510/6972] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:26:06 2022] DELETE /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 0 bytes in 1492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:26:07.953474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bdfc5e67-4ad6-43a4-9bac-8246a4c126e7 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:07.954740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bdfc5e67-4ad6-43a4-9bac-8246a4c126e7 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:07.961254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bdfc5e67-4ad6-43a4-9bac-8246a4c126e7 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:07.961735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bdfc5e67-4ad6-43a4-9bac-8246a4c126e7 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:07.962176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bdfc5e67-4ad6-43a4-9bac-8246a4c126e7 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:07.962867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bdfc5e67-4ad6-43a4-9bac-8246a4c126e7 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:07.963316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bdfc5e67-4ad6-43a4-9bac-8246a4c126e7 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:07.963739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bdfc5e67-4ad6-43a4-9bac-8246a4c126e7 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:08.099351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bdfc5e67-4ad6-43a4-9bac-8246a4c126e7 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:08.107103 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bdfc5e67-4ad6-43a4-9bac-8246a4c126e7 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1499 microversion: 2.1 time: 0.157938 Aug 27 05:26:08.107675 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3463/6973] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:07 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1499 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:09.129573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9df58d3e-a18c-4e27-9587-e4e5d9e9dcc5 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:09.130297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9df58d3e-a18c-4e27-9587-e4e5d9e9dcc5 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:09.137279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9df58d3e-a18c-4e27-9587-e4e5d9e9dcc5 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:09.137784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9df58d3e-a18c-4e27-9587-e4e5d9e9dcc5 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:09.138240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9df58d3e-a18c-4e27-9587-e4e5d9e9dcc5 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:09.138951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9df58d3e-a18c-4e27-9587-e4e5d9e9dcc5 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:09.139424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9df58d3e-a18c-4e27-9587-e4e5d9e9dcc5 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:09.139896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9df58d3e-a18c-4e27-9587-e4e5d9e9dcc5 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:09.596747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9df58d3e-a18c-4e27-9587-e4e5d9e9dcc5 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e6392b2cf942d4811b24530668c535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9901a3aafe410ca0ce533b0a4e63da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:09.604885 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9df58d3e-a18c-4e27-9587-e4e5d9e9dcc5 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 200 len: 1499 microversion: 2.1 time: 0.479655 Aug 27 05:26:09.605496 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3511/6974] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:09 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 1499 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:09.800068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-db4bb628-d461-49c5-99d9-60954054fda7 req-8e517e12-712d-4659-9767-59a45a567266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a47c381-328b-42a4-808d-906fa1c3cb30", "name": "network-vif-deleted", "tag": "bf7bd53a-37d2-40db-bb81-2d11c625440a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:09.810901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-db4bb628-d461-49c5-99d9-60954054fda7 req-8e517e12-712d-4659-9767-59a45a567266 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:09.811671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-db4bb628-d461-49c5-99d9-60954054fda7 req-8e517e12-712d-4659-9767-59a45a567266 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:09.812105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-db4bb628-d461-49c5-99d9-60954054fda7 req-8e517e12-712d-4659-9767-59a45a567266 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:09.827440 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-db4bb628-d461-49c5-99d9-60954054fda7 req-8e517e12-712d-4659-9767-59a45a567266 service nova] Creating event network-vif-deleted:bf7bd53a-37d2-40db-bb81-2d11c625440a for instance 3a47c381-328b-42a4-808d-906fa1c3cb30 on n-h2-854823-1 Aug 27 05:26:09.832788 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-db4bb628-d461-49c5-99d9-60954054fda7 req-8e517e12-712d-4659-9767-59a45a567266 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036978 Aug 27 05:26:09.833425 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3464/6975] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:10.627558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f6005ce-ec2a-47f6-a334-9be55725cee4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:10.628189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f6005ce-ec2a-47f6-a334-9be55725cee4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:10.635269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f6005ce-ec2a-47f6-a334-9be55725cee4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:10.635773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f6005ce-ec2a-47f6-a334-9be55725cee4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:10.636227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f6005ce-ec2a-47f6-a334-9be55725cee4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:10.636971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f6005ce-ec2a-47f6-a334-9be55725cee4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:10.637446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f6005ce-ec2a-47f6-a334-9be55725cee4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:10.637886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f6005ce-ec2a-47f6-a334-9be55725cee4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:10.652221 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-2f6005ce-ec2a-47f6-a334-9be55725cee4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] HTTP exception thrown: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f6005ce-ec2a-47f6-a334-9be55725cee4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Request method failure captured: Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 HTTP/1.1 Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCarAYQQ1JoH2JewAITJ_RRQlPtsE1nG5u7V-U0IQPowDwyo3HmQEVuJY-4hLaEqCA-Tm3P3rowYyenFBfymY-yaAg6XMMkKQQhe3WPtVCqBnWA57LT0LyUpolqGZhJaBCtlOtmPAae9_JCiKo5N5LFCSAQZ33ZQYZ4hQQNhx-qZ94aE Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 0d9901a3aafe410ca0ce533b0a4e63da Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-1503033383 Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0d9901a3aafe410ca0ce533b0a4e63da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0d9901a3aafe410ca0ce533b0a4e63da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0d9901a3aafe410ca0ce533b0a4e63da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0d9901a3aafe410ca0ce533b0a4e63da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-1503033383 Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 0d9901a3aafe410ca0ce533b0a4e63da Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-1503033383 Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-1503033383-project Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: c3e6392b2cf942d4811b24530668c535 Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-1503033383-project Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '3a47c381-328b-42a4-808d-906fa1c3cb30'} Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:10.653967 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.658622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:10.658622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:10.658622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:10.658622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:10.658622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:10.658622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.658622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.658622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f6005ce-ec2a-47f6-a334-9be55725cee4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Returning 404 to user: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:10.658622 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f6005ce-ec2a-47f6-a334-9be55725cee4 tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 404 len: 111 microversion: 2.1 time: 0.032451 Aug 27 05:26:10.658622 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3512/6976] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:10 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:26:10.672955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7ff31cfe-c3c6-47d0-baef-201c073f4a3b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:10.673564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7ff31cfe-c3c6-47d0-baef-201c073f4a3b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:10.679799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ff31cfe-c3c6-47d0-baef-201c073f4a3b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:10.680317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ff31cfe-c3c6-47d0-baef-201c073f4a3b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:10.680787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ff31cfe-c3c6-47d0-baef-201c073f4a3b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:10.681571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ff31cfe-c3c6-47d0-baef-201c073f4a3b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:10.682032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ff31cfe-c3c6-47d0-baef-201c073f4a3b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:10.682452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ff31cfe-c3c6-47d0-baef-201c073f4a3b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:10.696379 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-7ff31cfe-c3c6-47d0-baef-201c073f4a3b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] HTTP exception thrown: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7ff31cfe-c3c6-47d0-baef-201c073f4a3b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Request method failure captured: Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 HTTP/1.1 Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCarAYQQ1JoH2JewAITJ_RRQlPtsE1nG5u7V-U0IQPowDwyo3HmQEVuJY-4hLaEqCA-Tm3P3rowYyenFBfymY-yaAg6XMMkKQQhe3WPtVCqBnWA57LT0LyUpolqGZhJaBCtlOtmPAae9_JCiKo5N5LFCSAQZ33ZQYZ4hQQNhx-qZ94aE Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 0d9901a3aafe410ca0ce533b0a4e63da Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-DeleteServersTestJSON-1503033383 Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0d9901a3aafe410ca0ce533b0a4e63da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0d9901a3aafe410ca0ce533b0a4e63da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0d9901a3aafe410ca0ce533b0a4e63da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0d9901a3aafe410ca0ce533b0a4e63da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-DeleteServersTestJSON-1503033383 Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 0d9901a3aafe410ca0ce533b0a4e63da Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-DeleteServersTestJSON-1503033383 Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-DeleteServersTestJSON-1503033383-project Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: c3e6392b2cf942d4811b24530668c535 Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-DeleteServersTestJSON-1503033383-project Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '3a47c381-328b-42a4-808d-906fa1c3cb30'} Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:26:10.698060 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:26:10.702085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.702085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.702085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:10.702085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.702085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:10.702085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:10.702085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:10.702085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:10.702085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:10.702085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.702085 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.702085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7ff31cfe-c3c6-47d0-baef-201c073f4a3b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Returning 404 to user: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:10.702085 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7ff31cfe-c3c6-47d0-baef-201c073f4a3b tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 404 len: 111 microversion: 2.1 time: 0.031654 Aug 27 05:26:10.702085 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3465/6977] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:26:10 2022] DELETE /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:26:10.708967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4e584ed-0608-4e38-b015-296f2bd4c98e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:10.709607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e4e584ed-0608-4e38-b015-296f2bd4c98e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] [instance: 3a47c381-328b-42a4-808d-906fa1c3cb30] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:10.716050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4e584ed-0608-4e38-b015-296f2bd4c98e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:10.716596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4e584ed-0608-4e38-b015-296f2bd4c98e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:10.717051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4e584ed-0608-4e38-b015-296f2bd4c98e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:10.717764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4e584ed-0608-4e38-b015-296f2bd4c98e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:10.718257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4e584ed-0608-4e38-b015-296f2bd4c98e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:10.718694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4e584ed-0608-4e38-b015-296f2bd4c98e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:10.732215 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e4e584ed-0608-4e38-b015-296f2bd4c98e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] HTTP exception thrown: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4e584ed-0608-4e38-b015-296f2bd4c98e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Request method failure captured: Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 HTTP/1.1 Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCarAYQQ1JoH2JewAITJ_RRQlPtsE1nG5u7V-U0IQPowDwyo3HmQEVuJY-4hLaEqCA-Tm3P3rowYyenFBfymY-yaAg6XMMkKQQhe3WPtVCqBnWA57LT0LyUpolqGZhJaBCtlOtmPAae9_JCiKo5N5LFCSAQZ33ZQYZ4hQQNhx-qZ94aE Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 0d9901a3aafe410ca0ce533b0a4e63da Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-1503033383 Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0d9901a3aafe410ca0ce533b0a4e63da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0d9901a3aafe410ca0ce533b0a4e63da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0d9901a3aafe410ca0ce533b0a4e63da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0d9901a3aafe410ca0ce533b0a4e63da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-1503033383 Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 0d9901a3aafe410ca0ce533b0a4e63da Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-1503033383 Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-1503033383-project Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: c3e6392b2cf942d4811b24530668c535 Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-1503033383-project Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '3a47c381-328b-42a4-808d-906fa1c3cb30'} Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:26:10.733839 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.737481 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:26:10.737481 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:26:10.737481 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:26:10.737481 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:26:10.737481 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:26:10.737481 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. Aug 27 05:26:10.737481 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:26:10.737481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4e584ed-0608-4e38-b015-296f2bd4c98e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] Returning 404 to user: Instance 3a47c381-328b-42a4-808d-906fa1c3cb30 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:26:10.737481 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e4e584ed-0608-4e38-b015-296f2bd4c98e tempest-DeleteServersTestJSON-1503033383 tempest-DeleteServersTestJSON-1503033383-project] 10.222.0.79 "GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30" status: 404 len: 111 microversion: 2.1 time: 0.030263 Aug 27 05:26:10.737481 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3513/6978] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:10 2022] GET /compute/v2.1/servers/3a47c381-328b-42a4-808d-906fa1c3cb30 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:26:19.441241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-644730200", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "8f87eb41-2240-4767-b14b-646011a21339"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:19.502014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] validate_networks() for [('8f87eb41-2240-4767-b14b-646011a21339', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:26:20.047767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:26:20.048311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:26:20.048809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:26:20.049220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:26:20.049635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:26:20.059285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:20.059768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:20.060237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:20.061134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:20.061590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:20.062013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:20.081913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Getting quotas for project 438e558b80bd46a595a05b8eb7d1501d. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:26:20.087460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Getting quotas for user 9a375dc3c8a04f7087ba9c55e96eb621 and project 438e558b80bd46a595a05b8eb7d1501d. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:26:20.101167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:26:20.103728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:26:20.151704 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-090b1e61-8971-42f0-b351-2d1cfc7e3443 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872576 Aug 27 05:26:20.152416 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3466/6979] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:26:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:26:20.164123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3ad75744-c091-4805-b1d3-5fa46ba142d4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:20.164782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3ad75744-c091-4805-b1d3-5fa46ba142d4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:20.231497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3ad75744-c091-4805-b1d3-5fa46ba142d4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:20.238746 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3ad75744-c091-4805-b1d3-5fa46ba142d4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1217 microversion: 2.1 time: 0.078514 Aug 27 05:26:20.239423 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3514/6980] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:20 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:21.263210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-460a8182-647b-436d-ae59-29ce758d0b6c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:21.265305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-460a8182-647b-436d-ae59-29ce758d0b6c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:21.275438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-460a8182-647b-436d-ae59-29ce758d0b6c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:21.276173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-460a8182-647b-436d-ae59-29ce758d0b6c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:21.277156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-460a8182-647b-436d-ae59-29ce758d0b6c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:21.278275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-460a8182-647b-436d-ae59-29ce758d0b6c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:21.278978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-460a8182-647b-436d-ae59-29ce758d0b6c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:21.280153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-460a8182-647b-436d-ae59-29ce758d0b6c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:21.379023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-460a8182-647b-436d-ae59-29ce758d0b6c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:21.388507 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-460a8182-647b-436d-ae59-29ce758d0b6c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1277 microversion: 2.1 time: 0.131460 Aug 27 05:26:21.389967 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3467/6981] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:21 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1277 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:22.410357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dedf2be0-be82-44d0-a20e-278ffe68e38c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:22.410987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dedf2be0-be82-44d0-a20e-278ffe68e38c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:22.419131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:22.421554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dedf2be0-be82-44d0-a20e-278ffe68e38c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:22.422289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dedf2be0-be82-44d0-a20e-278ffe68e38c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:22.422924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dedf2be0-be82-44d0-a20e-278ffe68e38c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:22.423934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dedf2be0-be82-44d0-a20e-278ffe68e38c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:22.424565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dedf2be0-be82-44d0-a20e-278ffe68e38c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:22.425164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dedf2be0-be82-44d0-a20e-278ffe68e38c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:22.588787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dedf2be0-be82-44d0-a20e-278ffe68e38c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:22.598370 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dedf2be0-be82-44d0-a20e-278ffe68e38c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1317 microversion: 2.1 time: 0.192359 Aug 27 05:26:22.600246 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3515/6982] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:22 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:22.768852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d43126a5-30f1-4665-ba0c-7f4bb058761e req-84235739-97f7-44e5-9758-43300b77601f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5e6e98-efea-4fbe-b32f-bea91e1a65de", "tag": "1f69d19e-c5b0-433a-96ff-22560f09144a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:22.783861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d43126a5-30f1-4665-ba0c-7f4bb058761e req-84235739-97f7-44e5-9758-43300b77601f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:22.784440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d43126a5-30f1-4665-ba0c-7f4bb058761e req-84235739-97f7-44e5-9758-43300b77601f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:22.785089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d43126a5-30f1-4665-ba0c-7f4bb058761e req-84235739-97f7-44e5-9758-43300b77601f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:22.807984 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d43126a5-30f1-4665-ba0c-7f4bb058761e req-84235739-97f7-44e5-9758-43300b77601f service nova] Creating event network-changed:1f69d19e-c5b0-433a-96ff-22560f09144a for instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de on n-h2-854823-1 Aug 27 05:26:22.814976 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d43126a5-30f1-4665-ba0c-7f4bb058761e req-84235739-97f7-44e5-9758-43300b77601f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056220 Aug 27 05:26:22.815756 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3468/6983] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:23.619944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4846e895-e6cc-4626-8356-bea47ab1e74c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:23.620469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4846e895-e6cc-4626-8356-bea47ab1e74c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:23.627830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4846e895-e6cc-4626-8356-bea47ab1e74c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:23.628323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4846e895-e6cc-4626-8356-bea47ab1e74c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:23.628797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4846e895-e6cc-4626-8356-bea47ab1e74c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:23.629519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4846e895-e6cc-4626-8356-bea47ab1e74c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:23.629972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4846e895-e6cc-4626-8356-bea47ab1e74c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:23.630409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4846e895-e6cc-4626-8356-bea47ab1e74c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:23.763694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4846e895-e6cc-4626-8356-bea47ab1e74c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:23.772277 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4846e895-e6cc-4626-8356-bea47ab1e74c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1317 microversion: 2.1 time: 0.156330 Aug 27 05:26:23.772890 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3516/6984] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:23 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:24.794463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a8c55d0b-0ca3-4345-94ff-ddfc3aecbb0d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:24.795203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a8c55d0b-0ca3-4345-94ff-ddfc3aecbb0d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:24.802013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8c55d0b-0ca3-4345-94ff-ddfc3aecbb0d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:24.802505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8c55d0b-0ca3-4345-94ff-ddfc3aecbb0d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:24.802945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8c55d0b-0ca3-4345-94ff-ddfc3aecbb0d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:24.803652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8c55d0b-0ca3-4345-94ff-ddfc3aecbb0d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:24.804115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8c55d0b-0ca3-4345-94ff-ddfc3aecbb0d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:24.804571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8c55d0b-0ca3-4345-94ff-ddfc3aecbb0d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:25.183257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a8c55d0b-0ca3-4345-94ff-ddfc3aecbb0d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:25.191647 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a8c55d0b-0ca3-4345-94ff-ddfc3aecbb0d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1317 microversion: 2.1 time: 0.402292 Aug 27 05:26:25.192266 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3469/6985] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:24 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:26.212654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcf86ea3-5755-4059-b811-d735f198e360 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:26.213290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fcf86ea3-5755-4059-b811-d735f198e360 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:26.220317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcf86ea3-5755-4059-b811-d735f198e360 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:26.220847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcf86ea3-5755-4059-b811-d735f198e360 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:26.221319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcf86ea3-5755-4059-b811-d735f198e360 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:26.222049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcf86ea3-5755-4059-b811-d735f198e360 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:26.222521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcf86ea3-5755-4059-b811-d735f198e360 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:26.222963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcf86ea3-5755-4059-b811-d735f198e360 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:26.355445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fcf86ea3-5755-4059-b811-d735f198e360 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:26.363895 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fcf86ea3-5755-4059-b811-d735f198e360 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1317 microversion: 2.1 time: 0.155212 Aug 27 05:26:26.364497 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3517/6986] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:26 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:27.385351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-69bd8b0f-3f22-448e-bcb0-2af96ce373ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:27.385872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-69bd8b0f-3f22-448e-bcb0-2af96ce373ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:27.392860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69bd8b0f-3f22-448e-bcb0-2af96ce373ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:27.393349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69bd8b0f-3f22-448e-bcb0-2af96ce373ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:27.393788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69bd8b0f-3f22-448e-bcb0-2af96ce373ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:27.394489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69bd8b0f-3f22-448e-bcb0-2af96ce373ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:27.394947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69bd8b0f-3f22-448e-bcb0-2af96ce373ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:27.395375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69bd8b0f-3f22-448e-bcb0-2af96ce373ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:27.536488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-69bd8b0f-3f22-448e-bcb0-2af96ce373ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:27.544660 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-69bd8b0f-3f22-448e-bcb0-2af96ce373ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1317 microversion: 2.1 time: 0.163214 Aug 27 05:26:27.545257 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3470/6987] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:27 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:27.615378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1e0304e3-5110-4a1c-b5e2-016ce56b91b6 req-e809ef04-bacb-41ee-8dd2-8d73a7af81b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5e6e98-efea-4fbe-b32f-bea91e1a65de", "name": "network-vif-plugged", "status": "completed", "tag": "1f69d19e-c5b0-433a-96ff-22560f09144a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:27.626498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1e0304e3-5110-4a1c-b5e2-016ce56b91b6 req-e809ef04-bacb-41ee-8dd2-8d73a7af81b0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:27.627032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1e0304e3-5110-4a1c-b5e2-016ce56b91b6 req-e809ef04-bacb-41ee-8dd2-8d73a7af81b0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:27.627505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1e0304e3-5110-4a1c-b5e2-016ce56b91b6 req-e809ef04-bacb-41ee-8dd2-8d73a7af81b0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:27.642590 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1e0304e3-5110-4a1c-b5e2-016ce56b91b6 req-e809ef04-bacb-41ee-8dd2-8d73a7af81b0 service nova] Creating event network-vif-plugged:1f69d19e-c5b0-433a-96ff-22560f09144a for instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de on n-h2-854823-1 Aug 27 05:26:27.652197 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1e0304e3-5110-4a1c-b5e2-016ce56b91b6 req-e809ef04-bacb-41ee-8dd2-8d73a7af81b0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040447 Aug 27 05:26:27.652873 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3518/6988] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:26:28.565965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e58cfbc3-b354-410a-a082-2370bb19a614 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:28.567175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e58cfbc3-b354-410a-a082-2370bb19a614 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:28.574194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e58cfbc3-b354-410a-a082-2370bb19a614 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:28.574671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e58cfbc3-b354-410a-a082-2370bb19a614 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:28.575102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e58cfbc3-b354-410a-a082-2370bb19a614 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:28.575792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e58cfbc3-b354-410a-a082-2370bb19a614 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:28.576244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e58cfbc3-b354-410a-a082-2370bb19a614 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:28.576705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e58cfbc3-b354-410a-a082-2370bb19a614 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:28.725943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e58cfbc3-b354-410a-a082-2370bb19a614 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:28.734337 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e58cfbc3-b354-410a-a082-2370bb19a614 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1317 microversion: 2.1 time: 0.172241 Aug 27 05:26:28.735596 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3471/6989] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:28 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:29.757191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1c892cdf-ffdc-41cd-850d-3c7e927a94de tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:29.757939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1c892cdf-ffdc-41cd-850d-3c7e927a94de tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:29.759910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:29.765658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c892cdf-ffdc-41cd-850d-3c7e927a94de tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:29.766168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c892cdf-ffdc-41cd-850d-3c7e927a94de tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:29.766625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c892cdf-ffdc-41cd-850d-3c7e927a94de tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:29.767346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c892cdf-ffdc-41cd-850d-3c7e927a94de tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:29.767826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c892cdf-ffdc-41cd-850d-3c7e927a94de tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:29.768270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c892cdf-ffdc-41cd-850d-3c7e927a94de tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:29.904634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c892cdf-ffdc-41cd-850d-3c7e927a94de tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:29.913309 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1c892cdf-ffdc-41cd-850d-3c7e927a94de tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1507 microversion: 2.1 time: 0.161157 Aug 27 05:26:29.914278 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3519/6990] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:29 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:29.933906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-398d51a1-1157-43af-9dda-bb20e82bd63a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:29.934523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-398d51a1-1157-43af-9dda-bb20e82bd63a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:29.937325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:29.942700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-398d51a1-1157-43af-9dda-bb20e82bd63a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:29.943187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-398d51a1-1157-43af-9dda-bb20e82bd63a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:29.943624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-398d51a1-1157-43af-9dda-bb20e82bd63a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:29.944481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-398d51a1-1157-43af-9dda-bb20e82bd63a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:29.944980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-398d51a1-1157-43af-9dda-bb20e82bd63a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:29.945402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-398d51a1-1157-43af-9dda-bb20e82bd63a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:29.948958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=70 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:30.070167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:30.084646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-398d51a1-1157-43af-9dda-bb20e82bd63a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:30.092709 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-398d51a1-1157-43af-9dda-bb20e82bd63a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1507 microversion: 2.1 time: 0.162678 Aug 27 05:26:30.093300 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3472/6991] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:29 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:30.115862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a4c0643-3d3f-4067-9980-3f3680090d31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:30.118549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a4c0643-3d3f-4067-9980-3f3680090d31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:30.124818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a4c0643-3d3f-4067-9980-3f3680090d31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.125325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a4c0643-3d3f-4067-9980-3f3680090d31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.125783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a4c0643-3d3f-4067-9980-3f3680090d31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.126535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a4c0643-3d3f-4067-9980-3f3680090d31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.127012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a4c0643-3d3f-4067-9980-3f3680090d31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.127454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a4c0643-3d3f-4067-9980-3f3680090d31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.193591 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a4c0643-3d3f-4067-9980-3f3680090d31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "PUT /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1079 microversion: 2.1 time: 0.083590 Aug 27 05:26:30.194278 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3520/6992] 10.222.0.79 () {60 vars in 1256 bytes} [Sat Aug 27 05:26:30 2022] PUT /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1079 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:30.212308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-853db151-d63d-40d5-97da-3cc6c45b5736 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:30.212968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-853db151-d63d-40d5-97da-3cc6c45b5736 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:30.214823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:30.220603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-853db151-d63d-40d5-97da-3cc6c45b5736 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.221104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-853db151-d63d-40d5-97da-3cc6c45b5736 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.221549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-853db151-d63d-40d5-97da-3cc6c45b5736 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.222258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-853db151-d63d-40d5-97da-3cc6c45b5736 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.222728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-853db151-d63d-40d5-97da-3cc6c45b5736 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.223162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-853db151-d63d-40d5-97da-3cc6c45b5736 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.356394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-853db151-d63d-40d5-97da-3cc6c45b5736 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:30.364585 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-853db151-d63d-40d5-97da-3cc6c45b5736 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1505 microversion: 2.1 time: 0.156662 Aug 27 05:26:30.365161 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3473/6993] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:30 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:30.384861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-856d9366-eacf-4f55-8c00-ba5c18be46ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:30.385492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-856d9366-eacf-4f55-8c00-ba5c18be46ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:30.387372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:30.393541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-856d9366-eacf-4f55-8c00-ba5c18be46ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.394050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-856d9366-eacf-4f55-8c00-ba5c18be46ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.394506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-856d9366-eacf-4f55-8c00-ba5c18be46ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.395217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-856d9366-eacf-4f55-8c00-ba5c18be46ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.395689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-856d9366-eacf-4f55-8c00-ba5c18be46ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.396129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-856d9366-eacf-4f55-8c00-ba5c18be46ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.528652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-856d9366-eacf-4f55-8c00-ba5c18be46ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:30.536884 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-856d9366-eacf-4f55-8c00-ba5c18be46ae tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1505 microversion: 2.1 time: 0.155936 Aug 27 05:26:30.537483 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3521/6994] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:30 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:30.557712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:26:30.559915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:30.567795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.568286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.568766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.569473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.569929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.570358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.604923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:30.611743 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Old instance type m1.heat2, new instance type m1.heat {{(pid=128870) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:26:30.618455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:26:30.618881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:26:30.619362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:26:30.619778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:26:30.620195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:26:30.691512 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-56c30065-917e-4d5c-a2b2-8cdae7049ff5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "POST /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de/action" status: 202 len: 0 microversion: 2.1 time: 0.137726 Aug 27 05:26:30.692139 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3474/6995] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:26:30 2022] POST /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:26:30.700329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-038afe6f-ecd1-48a4-b990-61228a6961ce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:30.700987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-038afe6f-ecd1-48a4-b990-61228a6961ce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:30.708656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-038afe6f-ecd1-48a4-b990-61228a6961ce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.709162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-038afe6f-ecd1-48a4-b990-61228a6961ce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.709894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-038afe6f-ecd1-48a4-b990-61228a6961ce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.710967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-038afe6f-ecd1-48a4-b990-61228a6961ce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:30.711448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-038afe6f-ecd1-48a4-b990-61228a6961ce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:30.711887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-038afe6f-ecd1-48a4-b990-61228a6961ce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:30.853673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-038afe6f-ecd1-48a4-b990-61228a6961ce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:30.862564 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-038afe6f-ecd1-48a4-b990-61228a6961ce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1516 microversion: 2.1 time: 0.166078 Aug 27 05:26:30.867288 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3522/6996] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:30 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:31.885561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-161feaa0-be1d-49d3-ae5e-89cd2713f2a0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:31.886291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-161feaa0-be1d-49d3-ae5e-89cd2713f2a0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:31.893293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-161feaa0-be1d-49d3-ae5e-89cd2713f2a0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:31.893779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-161feaa0-be1d-49d3-ae5e-89cd2713f2a0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:31.894216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-161feaa0-be1d-49d3-ae5e-89cd2713f2a0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:31.894912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-161feaa0-be1d-49d3-ae5e-89cd2713f2a0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:31.895369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-161feaa0-be1d-49d3-ae5e-89cd2713f2a0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:31.895795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-161feaa0-be1d-49d3-ae5e-89cd2713f2a0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:32.072737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-161feaa0-be1d-49d3-ae5e-89cd2713f2a0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:32.081068 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-161feaa0-be1d-49d3-ae5e-89cd2713f2a0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1516 microversion: 2.1 time: 0.200354 Aug 27 05:26:32.081652 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3475/6997] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:31 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:33.102251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f759f3ff-0588-4fc1-83f4-616a48e61ec8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:33.102885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f759f3ff-0588-4fc1-83f4-616a48e61ec8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:33.110149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f759f3ff-0588-4fc1-83f4-616a48e61ec8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:33.110651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f759f3ff-0588-4fc1-83f4-616a48e61ec8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:33.111107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f759f3ff-0588-4fc1-83f4-616a48e61ec8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:33.111826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f759f3ff-0588-4fc1-83f4-616a48e61ec8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:33.112302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f759f3ff-0588-4fc1-83f4-616a48e61ec8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:33.112771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f759f3ff-0588-4fc1-83f4-616a48e61ec8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:33.249779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f759f3ff-0588-4fc1-83f4-616a48e61ec8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:33.258136 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f759f3ff-0588-4fc1-83f4-616a48e61ec8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.160104 Aug 27 05:26:33.258870 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3523/6998] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:33 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:34.279195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0a0f8543-f2c9-4ae6-95b8-138502205f15 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:34.279802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0a0f8543-f2c9-4ae6-95b8-138502205f15 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:34.286100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a0f8543-f2c9-4ae6-95b8-138502205f15 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:34.286583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a0f8543-f2c9-4ae6-95b8-138502205f15 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:34.287018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a0f8543-f2c9-4ae6-95b8-138502205f15 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:34.287708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a0f8543-f2c9-4ae6-95b8-138502205f15 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:34.288168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a0f8543-f2c9-4ae6-95b8-138502205f15 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:34.288613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a0f8543-f2c9-4ae6-95b8-138502205f15 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:34.423251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0a0f8543-f2c9-4ae6-95b8-138502205f15 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:34.431443 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0a0f8543-f2c9-4ae6-95b8-138502205f15 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.156372 Aug 27 05:26:34.432024 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3476/6999] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:34 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:35.452571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee0c3633-5757-463d-8e9c-4a6cbf08d842 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:35.453272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee0c3633-5757-463d-8e9c-4a6cbf08d842 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:35.460822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0c3633-5757-463d-8e9c-4a6cbf08d842 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:35.461323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0c3633-5757-463d-8e9c-4a6cbf08d842 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:35.461775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0c3633-5757-463d-8e9c-4a6cbf08d842 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:35.462491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0c3633-5757-463d-8e9c-4a6cbf08d842 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:35.462968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0c3633-5757-463d-8e9c-4a6cbf08d842 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:35.463408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0c3633-5757-463d-8e9c-4a6cbf08d842 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:35.596938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee0c3633-5757-463d-8e9c-4a6cbf08d842 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:35.606024 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee0c3633-5757-463d-8e9c-4a6cbf08d842 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.157431 Aug 27 05:26:35.606619 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3524/7000] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:35 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:36.627435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-92729b4e-87f1-480d-8410-d7301f4e21c5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:36.628079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-92729b4e-87f1-480d-8410-d7301f4e21c5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:36.635021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92729b4e-87f1-480d-8410-d7301f4e21c5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:36.635500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92729b4e-87f1-480d-8410-d7301f4e21c5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:36.635936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92729b4e-87f1-480d-8410-d7301f4e21c5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:36.636647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92729b4e-87f1-480d-8410-d7301f4e21c5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:36.637105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92729b4e-87f1-480d-8410-d7301f4e21c5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:36.637535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92729b4e-87f1-480d-8410-d7301f4e21c5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:36.770407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-92729b4e-87f1-480d-8410-d7301f4e21c5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:36.779118 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-92729b4e-87f1-480d-8410-d7301f4e21c5 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.155559 Aug 27 05:26:36.779709 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3477/7001] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:36 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:37.799929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64a2e97d-38da-44e8-898d-c526bde4ef03 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:37.800612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-64a2e97d-38da-44e8-898d-c526bde4ef03 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:37.807794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64a2e97d-38da-44e8-898d-c526bde4ef03 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:37.808293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64a2e97d-38da-44e8-898d-c526bde4ef03 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:37.808822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64a2e97d-38da-44e8-898d-c526bde4ef03 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:37.809765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64a2e97d-38da-44e8-898d-c526bde4ef03 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:37.810241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64a2e97d-38da-44e8-898d-c526bde4ef03 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:37.810683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64a2e97d-38da-44e8-898d-c526bde4ef03 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:37.945053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-64a2e97d-38da-44e8-898d-c526bde4ef03 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:37.952906 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64a2e97d-38da-44e8-898d-c526bde4ef03 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.157565 Aug 27 05:26:37.953493 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3525/7002] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:37 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:38.974295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7b287f5f-389b-45e5-9e74-aa1392b7f30e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:38.974954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7b287f5f-389b-45e5-9e74-aa1392b7f30e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:38.981868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b287f5f-389b-45e5-9e74-aa1392b7f30e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:38.982352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b287f5f-389b-45e5-9e74-aa1392b7f30e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:38.982787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b287f5f-389b-45e5-9e74-aa1392b7f30e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:38.983480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b287f5f-389b-45e5-9e74-aa1392b7f30e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:38.983939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b287f5f-389b-45e5-9e74-aa1392b7f30e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:38.984913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7b287f5f-389b-45e5-9e74-aa1392b7f30e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:39.125639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7b287f5f-389b-45e5-9e74-aa1392b7f30e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:39.133558 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7b287f5f-389b-45e5-9e74-aa1392b7f30e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.163228 Aug 27 05:26:39.134136 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3478/7003] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:38 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:40.155081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89ec2e37-c1a8-4776-9d1c-9eeb90124189 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:40.155719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89ec2e37-c1a8-4776-9d1c-9eeb90124189 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:40.163268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89ec2e37-c1a8-4776-9d1c-9eeb90124189 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:40.163782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89ec2e37-c1a8-4776-9d1c-9eeb90124189 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:40.164237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89ec2e37-c1a8-4776-9d1c-9eeb90124189 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:40.165004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89ec2e37-c1a8-4776-9d1c-9eeb90124189 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:40.165479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89ec2e37-c1a8-4776-9d1c-9eeb90124189 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:40.165931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89ec2e37-c1a8-4776-9d1c-9eeb90124189 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:40.295273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89ec2e37-c1a8-4776-9d1c-9eeb90124189 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:40.303788 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89ec2e37-c1a8-4776-9d1c-9eeb90124189 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.152665 Aug 27 05:26:40.304384 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3526/7004] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:40 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:41.324860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b73d68ec-8b09-49fd-96b2-da955f2f033b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:41.325506 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b73d68ec-8b09-49fd-96b2-da955f2f033b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:41.333126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b73d68ec-8b09-49fd-96b2-da955f2f033b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:41.333618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b73d68ec-8b09-49fd-96b2-da955f2f033b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:41.334056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b73d68ec-8b09-49fd-96b2-da955f2f033b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:41.334755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b73d68ec-8b09-49fd-96b2-da955f2f033b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:41.335214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b73d68ec-8b09-49fd-96b2-da955f2f033b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:41.335640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b73d68ec-8b09-49fd-96b2-da955f2f033b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:41.467393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b73d68ec-8b09-49fd-96b2-da955f2f033b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:41.475159 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b73d68ec-8b09-49fd-96b2-da955f2f033b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.154385 Aug 27 05:26:41.476054 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3479/7005] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:41 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:42.496425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a735376-1a8e-41c3-8dde-d21243ea73d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:42.497092 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a735376-1a8e-41c3-8dde-d21243ea73d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:42.504273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a735376-1a8e-41c3-8dde-d21243ea73d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:42.504840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a735376-1a8e-41c3-8dde-d21243ea73d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:42.505305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a735376-1a8e-41c3-8dde-d21243ea73d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:42.506030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a735376-1a8e-41c3-8dde-d21243ea73d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:42.506555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a735376-1a8e-41c3-8dde-d21243ea73d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:42.507165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a735376-1a8e-41c3-8dde-d21243ea73d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:42.643140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a735376-1a8e-41c3-8dde-d21243ea73d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:42.651283 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a735376-1a8e-41c3-8dde-d21243ea73d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.158828 Aug 27 05:26:42.651887 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3527/7006] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:42 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:43.672755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a202195a-e085-49a1-b176-2dc5703704a9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:43.673372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a202195a-e085-49a1-b176-2dc5703704a9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:43.680271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a202195a-e085-49a1-b176-2dc5703704a9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:43.680988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a202195a-e085-49a1-b176-2dc5703704a9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:43.681249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a202195a-e085-49a1-b176-2dc5703704a9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:43.681945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a202195a-e085-49a1-b176-2dc5703704a9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:43.682407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a202195a-e085-49a1-b176-2dc5703704a9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:43.682838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a202195a-e085-49a1-b176-2dc5703704a9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:43.816520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a202195a-e085-49a1-b176-2dc5703704a9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:43.824218 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a202195a-e085-49a1-b176-2dc5703704a9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.155436 Aug 27 05:26:43.824827 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3480/7007] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:43 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:44.846070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c223fb2f-4d6d-4829-9274-4260af0a7f31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:44.846704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c223fb2f-4d6d-4829-9274-4260af0a7f31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:44.853744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c223fb2f-4d6d-4829-9274-4260af0a7f31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:44.854265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c223fb2f-4d6d-4829-9274-4260af0a7f31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:44.854701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c223fb2f-4d6d-4829-9274-4260af0a7f31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:44.855412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c223fb2f-4d6d-4829-9274-4260af0a7f31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:44.855914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c223fb2f-4d6d-4829-9274-4260af0a7f31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:44.856354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c223fb2f-4d6d-4829-9274-4260af0a7f31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:44.984094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c223fb2f-4d6d-4829-9274-4260af0a7f31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:44.992500 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c223fb2f-4d6d-4829-9274-4260af0a7f31 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.150971 Aug 27 05:26:44.993170 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3528/7008] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:44 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:46.013551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-40313985-fc22-4e30-99d5-770ae31c58d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:46.014173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-40313985-fc22-4e30-99d5-770ae31c58d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:46.021129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40313985-fc22-4e30-99d5-770ae31c58d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:46.021619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40313985-fc22-4e30-99d5-770ae31c58d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:46.022060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40313985-fc22-4e30-99d5-770ae31c58d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:46.022808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40313985-fc22-4e30-99d5-770ae31c58d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:46.023269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40313985-fc22-4e30-99d5-770ae31c58d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:46.023958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40313985-fc22-4e30-99d5-770ae31c58d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:46.151952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-40313985-fc22-4e30-99d5-770ae31c58d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:46.160879 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-40313985-fc22-4e30-99d5-770ae31c58d6 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.151174 Aug 27 05:26:46.161467 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3481/7009] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:46 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:47.182545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce44782c-c2c7-4866-a86d-0009ce711001 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:47.183178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce44782c-c2c7-4866-a86d-0009ce711001 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:47.190851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce44782c-c2c7-4866-a86d-0009ce711001 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:47.191361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce44782c-c2c7-4866-a86d-0009ce711001 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:47.191849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce44782c-c2c7-4866-a86d-0009ce711001 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:47.192606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce44782c-c2c7-4866-a86d-0009ce711001 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:47.193089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce44782c-c2c7-4866-a86d-0009ce711001 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:47.193536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce44782c-c2c7-4866-a86d-0009ce711001 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:47.331623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce44782c-c2c7-4866-a86d-0009ce711001 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:47.339498 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce44782c-c2c7-4866-a86d-0009ce711001 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.160933 Aug 27 05:26:47.340079 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3529/7010] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:47 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:48.362196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-10f3b0b3-9596-492c-9394-028dc52253c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:48.362842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-10f3b0b3-9596-492c-9394-028dc52253c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:48.369823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10f3b0b3-9596-492c-9394-028dc52253c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:48.370309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10f3b0b3-9596-492c-9394-028dc52253c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:48.370750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10f3b0b3-9596-492c-9394-028dc52253c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:48.371446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10f3b0b3-9596-492c-9394-028dc52253c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:48.371909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10f3b0b3-9596-492c-9394-028dc52253c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:48.372349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10f3b0b3-9596-492c-9394-028dc52253c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:48.507027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10f3b0b3-9596-492c-9394-028dc52253c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:48.519462 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-10f3b0b3-9596-492c-9394-028dc52253c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.160843 Aug 27 05:26:48.520502 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3482/7011] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:48 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:49.541345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b4e9fdb3-8969-4d9b-b341-a94574ad328b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:49.541974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b4e9fdb3-8969-4d9b-b341-a94574ad328b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:49.549389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4e9fdb3-8969-4d9b-b341-a94574ad328b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:49.549882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4e9fdb3-8969-4d9b-b341-a94574ad328b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:49.550358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4e9fdb3-8969-4d9b-b341-a94574ad328b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:49.551061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4e9fdb3-8969-4d9b-b341-a94574ad328b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:49.551529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4e9fdb3-8969-4d9b-b341-a94574ad328b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:49.551967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4e9fdb3-8969-4d9b-b341-a94574ad328b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:49.685510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b4e9fdb3-8969-4d9b-b341-a94574ad328b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:49.693282 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b4e9fdb3-8969-4d9b-b341-a94574ad328b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.156003 Aug 27 05:26:49.693907 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3530/7012] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:49 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:50.714742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0aeb8ed1-8b0b-47d7-85ea-348740b27fa0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:50.715359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0aeb8ed1-8b0b-47d7-85ea-348740b27fa0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:50.723345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0aeb8ed1-8b0b-47d7-85ea-348740b27fa0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:50.723834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0aeb8ed1-8b0b-47d7-85ea-348740b27fa0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:50.724470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0aeb8ed1-8b0b-47d7-85ea-348740b27fa0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:50.725027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0aeb8ed1-8b0b-47d7-85ea-348740b27fa0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:50.725482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0aeb8ed1-8b0b-47d7-85ea-348740b27fa0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:50.725908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0aeb8ed1-8b0b-47d7-85ea-348740b27fa0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:50.856742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0aeb8ed1-8b0b-47d7-85ea-348740b27fa0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:50.866910 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0aeb8ed1-8b0b-47d7-85ea-348740b27fa0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.156069 Aug 27 05:26:50.867490 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3483/7013] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:50 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:51.888934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e05b9023-495a-4581-a34c-fdf588dbecad tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:51.889490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e05b9023-495a-4581-a34c-fdf588dbecad tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:51.896484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e05b9023-495a-4581-a34c-fdf588dbecad tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:51.897080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e05b9023-495a-4581-a34c-fdf588dbecad tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:51.897484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e05b9023-495a-4581-a34c-fdf588dbecad tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:51.898216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e05b9023-495a-4581-a34c-fdf588dbecad tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:51.898958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e05b9023-495a-4581-a34c-fdf588dbecad tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:51.899818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e05b9023-495a-4581-a34c-fdf588dbecad tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:51.919903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:26:51.948434 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:26:51.948692 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:26:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de (ip 10.222.0.79) !!! Aug 27 05:26:52.042340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e05b9023-495a-4581-a34c-fdf588dbecad tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:52.051219 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e05b9023-495a-4581-a34c-fdf588dbecad tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.166444 Aug 27 05:26:52.051809 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3531/7014] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:51 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:53.071875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6b2dc021-8044-442f-ada6-bf93f4e9f516 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:53.072493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6b2dc021-8044-442f-ada6-bf93f4e9f516 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:53.079687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b2dc021-8044-442f-ada6-bf93f4e9f516 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:53.080500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b2dc021-8044-442f-ada6-bf93f4e9f516 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:53.081402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b2dc021-8044-442f-ada6-bf93f4e9f516 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:53.082134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b2dc021-8044-442f-ada6-bf93f4e9f516 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:53.082564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b2dc021-8044-442f-ada6-bf93f4e9f516 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:53.082989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6b2dc021-8044-442f-ada6-bf93f4e9f516 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:53.218883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6b2dc021-8044-442f-ada6-bf93f4e9f516 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:53.227637 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6b2dc021-8044-442f-ada6-bf93f4e9f516 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.159722 Aug 27 05:26:53.228225 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3484/7015] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:53 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:54.248606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6e92968-8542-433d-9ec8-eaa3630f602f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:54.249274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e6e92968-8542-433d-9ec8-eaa3630f602f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:54.256502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6e92968-8542-433d-9ec8-eaa3630f602f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:54.257045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6e92968-8542-433d-9ec8-eaa3630f602f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:54.257490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6e92968-8542-433d-9ec8-eaa3630f602f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:54.258204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6e92968-8542-433d-9ec8-eaa3630f602f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:54.258672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6e92968-8542-433d-9ec8-eaa3630f602f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:54.259108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6e92968-8542-433d-9ec8-eaa3630f602f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:54.393186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e6e92968-8542-433d-9ec8-eaa3630f602f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:54.401889 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6e92968-8542-433d-9ec8-eaa3630f602f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.157281 Aug 27 05:26:54.402488 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3532/7016] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:54 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:55.423749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb7f0d30-4d9e-4236-9901-44cf49d4451d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:55.424274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eb7f0d30-4d9e-4236-9901-44cf49d4451d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:55.431098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7f0d30-4d9e-4236-9901-44cf49d4451d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:55.431582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7f0d30-4d9e-4236-9901-44cf49d4451d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:55.432021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7f0d30-4d9e-4236-9901-44cf49d4451d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:55.432741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7f0d30-4d9e-4236-9901-44cf49d4451d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:55.433204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7f0d30-4d9e-4236-9901-44cf49d4451d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:55.433631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb7f0d30-4d9e-4236-9901-44cf49d4451d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:55.567789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb7f0d30-4d9e-4236-9901-44cf49d4451d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:55.575665 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb7f0d30-4d9e-4236-9901-44cf49d4451d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.156003 Aug 27 05:26:55.576239 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3485/7017] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:55 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:26:56.597948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-395d75d0-d51b-4eec-863c-c6e8c2803191 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:56.598575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-395d75d0-d51b-4eec-863c-c6e8c2803191 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:56.605690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-395d75d0-d51b-4eec-863c-c6e8c2803191 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:56.606203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-395d75d0-d51b-4eec-863c-c6e8c2803191 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:56.606659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-395d75d0-d51b-4eec-863c-c6e8c2803191 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:56.607388 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-395d75d0-d51b-4eec-863c-c6e8c2803191 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:56.607866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-395d75d0-d51b-4eec-863c-c6e8c2803191 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:56.608315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-395d75d0-d51b-4eec-863c-c6e8c2803191 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:56.749873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-395d75d0-d51b-4eec-863c-c6e8c2803191 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:56.757686 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-395d75d0-d51b-4eec-863c-c6e8c2803191 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.164333 Aug 27 05:26:56.758266 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3533/7018] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:56 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:57.778652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0fc8565a-1670-4661-a8fc-8085d0652dd0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:57.779269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0fc8565a-1670-4661-a8fc-8085d0652dd0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:57.787035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fc8565a-1670-4661-a8fc-8085d0652dd0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:57.787514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fc8565a-1670-4661-a8fc-8085d0652dd0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:57.787951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fc8565a-1670-4661-a8fc-8085d0652dd0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:57.788664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fc8565a-1670-4661-a8fc-8085d0652dd0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:57.789133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fc8565a-1670-4661-a8fc-8085d0652dd0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:57.789549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0fc8565a-1670-4661-a8fc-8085d0652dd0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:57.920493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0fc8565a-1670-4661-a8fc-8085d0652dd0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:57.928426 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0fc8565a-1670-4661-a8fc-8085d0652dd0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.153686 Aug 27 05:26:57.929034 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3486/7019] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:57 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:26:58.950063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c81c3bc6-211e-4504-8f7c-a2cb5c97d223 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:26:58.950696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c81c3bc6-211e-4504-8f7c-a2cb5c97d223 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:26:58.958336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81c3bc6-211e-4504-8f7c-a2cb5c97d223 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:58.958838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81c3bc6-211e-4504-8f7c-a2cb5c97d223 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:58.959295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81c3bc6-211e-4504-8f7c-a2cb5c97d223 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:58.960001 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81c3bc6-211e-4504-8f7c-a2cb5c97d223 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:26:58.960473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81c3bc6-211e-4504-8f7c-a2cb5c97d223 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:26:58.960943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c81c3bc6-211e-4504-8f7c-a2cb5c97d223 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:26:59.095426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c81c3bc6-211e-4504-8f7c-a2cb5c97d223 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:26:59.103654 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c81c3bc6-211e-4504-8f7c-a2cb5c97d223 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1521 microversion: 2.1 time: 0.157583 Aug 27 05:26:59.104241 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3534/7020] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:26:58 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:00.125012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f969df52-0a0f-4a30-b75f-48d3cacc4748 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:00.125739 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f969df52-0a0f-4a30-b75f-48d3cacc4748 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:00.128565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=34 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:00.134545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f969df52-0a0f-4a30-b75f-48d3cacc4748 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:00.135029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f969df52-0a0f-4a30-b75f-48d3cacc4748 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:00.135460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f969df52-0a0f-4a30-b75f-48d3cacc4748 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:00.136160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f969df52-0a0f-4a30-b75f-48d3cacc4748 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:00.136636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f969df52-0a0f-4a30-b75f-48d3cacc4748 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:00.137057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f969df52-0a0f-4a30-b75f-48d3cacc4748 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:00.139804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:00.278568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f969df52-0a0f-4a30-b75f-48d3cacc4748 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:00.286371 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f969df52-0a0f-4a30-b75f-48d3cacc4748 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1520 microversion: 2.1 time: 0.165291 Aug 27 05:27:00.287161 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3487/7021] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:00 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:00.525860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-699356a8-fc93-43c6-a675-81ebcbf82088 req-599b4d51-3522-4659-a749-5f08d540ddd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5e6e98-efea-4fbe-b32f-bea91e1a65de", "name": "network-vif-unplugged", "status": "completed", "tag": "1f69d19e-c5b0-433a-96ff-22560f09144a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:00.531563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=32 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:00.537302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-699356a8-fc93-43c6-a675-81ebcbf82088 req-599b4d51-3522-4659-a749-5f08d540ddd5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:00.537880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-699356a8-fc93-43c6-a675-81ebcbf82088 req-599b4d51-3522-4659-a749-5f08d540ddd5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:00.538322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-699356a8-fc93-43c6-a675-81ebcbf82088 req-599b4d51-3522-4659-a749-5f08d540ddd5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:00.551357 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-699356a8-fc93-43c6-a675-81ebcbf82088 req-599b4d51-3522-4659-a749-5f08d540ddd5 service nova] Creating event network-vif-unplugged:1f69d19e-c5b0-433a-96ff-22560f09144a for instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de on n-h1-854823-1 Aug 27 05:27:00.557353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-699356a8-fc93-43c6-a675-81ebcbf82088 req-599b4d51-3522-4659-a749-5f08d540ddd5 service nova] Instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:27:00.569643 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-699356a8-fc93-43c6-a675-81ebcbf82088 req-599b4d51-3522-4659-a749-5f08d540ddd5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047879 Aug 27 05:27:00.570330 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3535/7022] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:01.307583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bc5707c8-e0c6-46dd-83be-8aa668dbfbb0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:01.308229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bc5707c8-e0c6-46dd-83be-8aa668dbfbb0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:01.315042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc5707c8-e0c6-46dd-83be-8aa668dbfbb0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:01.315565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc5707c8-e0c6-46dd-83be-8aa668dbfbb0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:01.315973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc5707c8-e0c6-46dd-83be-8aa668dbfbb0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:01.316691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc5707c8-e0c6-46dd-83be-8aa668dbfbb0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:01.317155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc5707c8-e0c6-46dd-83be-8aa668dbfbb0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:01.317580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bc5707c8-e0c6-46dd-83be-8aa668dbfbb0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:01.453012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bc5707c8-e0c6-46dd-83be-8aa668dbfbb0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:01.461278 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bc5707c8-e0c6-46dd-83be-8aa668dbfbb0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1520 microversion: 2.1 time: 0.157632 Aug 27 05:27:01.461909 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3488/7023] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:01 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:02.485152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-04c734a7-cda5-417b-b251-85045f3ca7d7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:02.485887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-04c734a7-cda5-417b-b251-85045f3ca7d7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:02.492892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04c734a7-cda5-417b-b251-85045f3ca7d7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:02.493386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04c734a7-cda5-417b-b251-85045f3ca7d7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:02.493832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04c734a7-cda5-417b-b251-85045f3ca7d7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:02.494535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04c734a7-cda5-417b-b251-85045f3ca7d7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:02.495003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04c734a7-cda5-417b-b251-85045f3ca7d7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:02.495438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04c734a7-cda5-417b-b251-85045f3ca7d7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:02.599112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-26ec584b-bd20-45d0-8610-2ca4abd6eedc req-09723d23-beec-4f94-b4f2-79d95747d230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5e6e98-efea-4fbe-b32f-bea91e1a65de", "tag": "1f69d19e-c5b0-433a-96ff-22560f09144a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:02.608870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-26ec584b-bd20-45d0-8610-2ca4abd6eedc req-09723d23-beec-4f94-b4f2-79d95747d230 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:02.609353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-26ec584b-bd20-45d0-8610-2ca4abd6eedc req-09723d23-beec-4f94-b4f2-79d95747d230 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:02.609789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-26ec584b-bd20-45d0-8610-2ca4abd6eedc req-09723d23-beec-4f94-b4f2-79d95747d230 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:02.622770 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-26ec584b-bd20-45d0-8610-2ca4abd6eedc req-09723d23-beec-4f94-b4f2-79d95747d230 service nova] Creating event network-changed:1f69d19e-c5b0-433a-96ff-22560f09144a for instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de on n-h1-854823-1 Aug 27 05:27:02.628117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-26ec584b-bd20-45d0-8610-2ca4abd6eedc req-09723d23-beec-4f94-b4f2-79d95747d230 service nova] Instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:27:02.632699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-04c734a7-cda5-417b-b251-85045f3ca7d7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:02.639123 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-26ec584b-bd20-45d0-8610-2ca4abd6eedc req-09723d23-beec-4f94-b4f2-79d95747d230 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044451 Aug 27 05:27:02.639739 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3489/7024] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:02.640714 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-04c734a7-cda5-417b-b251-85045f3ca7d7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1518 microversion: 2.1 time: 0.160845 Aug 27 05:27:02.641303 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3536/7025] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:02 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:03.663102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ebba36e3-c338-491a-9564-46a6e0f1c58c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:03.663799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ebba36e3-c338-491a-9564-46a6e0f1c58c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:03.670125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebba36e3-c338-491a-9564-46a6e0f1c58c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:03.670615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebba36e3-c338-491a-9564-46a6e0f1c58c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:03.671047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebba36e3-c338-491a-9564-46a6e0f1c58c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:03.671769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebba36e3-c338-491a-9564-46a6e0f1c58c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:03.672224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebba36e3-c338-491a-9564-46a6e0f1c58c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:03.672688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebba36e3-c338-491a-9564-46a6e0f1c58c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:03.813762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ebba36e3-c338-491a-9564-46a6e0f1c58c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:03.822028 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ebba36e3-c338-491a-9564-46a6e0f1c58c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1518 microversion: 2.1 time: 0.164484 Aug 27 05:27:03.822599 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3490/7026] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:03 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:04.842421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8497aaa7-b487-4853-b9b4-8f141ff722da tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:04.843059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8497aaa7-b487-4853-b9b4-8f141ff722da tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:04.850649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8497aaa7-b487-4853-b9b4-8f141ff722da tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:04.851156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8497aaa7-b487-4853-b9b4-8f141ff722da tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:04.851612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8497aaa7-b487-4853-b9b4-8f141ff722da tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:04.852329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8497aaa7-b487-4853-b9b4-8f141ff722da tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:04.852929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8497aaa7-b487-4853-b9b4-8f141ff722da tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:04.853354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8497aaa7-b487-4853-b9b4-8f141ff722da tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:04.985292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8497aaa7-b487-4853-b9b4-8f141ff722da tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:04.993887 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8497aaa7-b487-4853-b9b4-8f141ff722da tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1515 microversion: 2.1 time: 0.155416 Aug 27 05:27:04.994474 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3537/7027] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:04 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:05.014563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-57bd14a0-d790-4f9e-af7c-d95deb7f7188 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:05.015106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-57bd14a0-d790-4f9e-af7c-d95deb7f7188 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:05.021991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57bd14a0-d790-4f9e-af7c-d95deb7f7188 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:05.022478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57bd14a0-d790-4f9e-af7c-d95deb7f7188 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:05.022921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57bd14a0-d790-4f9e-af7c-d95deb7f7188 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:05.023615 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57bd14a0-d790-4f9e-af7c-d95deb7f7188 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:05.024338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57bd14a0-d790-4f9e-af7c-d95deb7f7188 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:05.024792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-57bd14a0-d790-4f9e-af7c-d95deb7f7188 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:05.085468 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-57bd14a0-d790-4f9e-af7c-d95deb7f7188 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "POST /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de/action" status: 204 len: 0 microversion: 2.1 time: 0.074657 Aug 27 05:27:05.086276 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3491/7028] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:27:05 2022] POST /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:27:05.094246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65dd6fd1-7039-46e5-a579-da925afded1e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:05.094885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65dd6fd1-7039-46e5-a579-da925afded1e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:05.101187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65dd6fd1-7039-46e5-a579-da925afded1e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:05.101695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65dd6fd1-7039-46e5-a579-da925afded1e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:05.102151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65dd6fd1-7039-46e5-a579-da925afded1e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:05.102869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65dd6fd1-7039-46e5-a579-da925afded1e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:05.103340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65dd6fd1-7039-46e5-a579-da925afded1e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:05.103783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65dd6fd1-7039-46e5-a579-da925afded1e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:05.249630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65dd6fd1-7039-46e5-a579-da925afded1e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:05.258035 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65dd6fd1-7039-46e5-a579-da925afded1e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1515 microversion: 2.1 time: 0.167722 Aug 27 05:27:05.258618 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3538/7029] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:05 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:06.281404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-32414bfc-c823-462b-a0f1-581f127a05cc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:06.283172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-32414bfc-c823-462b-a0f1-581f127a05cc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:06.289375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32414bfc-c823-462b-a0f1-581f127a05cc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:06.289867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32414bfc-c823-462b-a0f1-581f127a05cc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:06.290313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32414bfc-c823-462b-a0f1-581f127a05cc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:06.291015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32414bfc-c823-462b-a0f1-581f127a05cc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:06.291476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32414bfc-c823-462b-a0f1-581f127a05cc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:06.291908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32414bfc-c823-462b-a0f1-581f127a05cc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:06.429536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-32414bfc-c823-462b-a0f1-581f127a05cc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:06.438549 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-32414bfc-c823-462b-a0f1-581f127a05cc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1515 microversion: 2.1 time: 0.161355 Aug 27 05:27:06.439241 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3492/7030] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:06 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:07.464496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0682bb9-39e7-4d2d-bc89-dd453bc2c59c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:07.465171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0682bb9-39e7-4d2d-bc89-dd453bc2c59c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:07.471267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0682bb9-39e7-4d2d-bc89-dd453bc2c59c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:07.471774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0682bb9-39e7-4d2d-bc89-dd453bc2c59c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:07.472234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0682bb9-39e7-4d2d-bc89-dd453bc2c59c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:07.473107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0682bb9-39e7-4d2d-bc89-dd453bc2c59c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:07.473588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0682bb9-39e7-4d2d-bc89-dd453bc2c59c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:07.474038 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0682bb9-39e7-4d2d-bc89-dd453bc2c59c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:07.619701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0682bb9-39e7-4d2d-bc89-dd453bc2c59c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:07.630117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-2863a342-6e78-45e7-afac-55e1c974b0a0 req-af79d59b-6c01-4b76-8b3b-8d32363857cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5e6e98-efea-4fbe-b32f-bea91e1a65de", "name": "network-vif-plugged", "status": "completed", "tag": "1f69d19e-c5b0-433a-96ff-22560f09144a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:07.631943 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0682bb9-39e7-4d2d-bc89-dd453bc2c59c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1507 microversion: 2.1 time: 0.175020 Aug 27 05:27:07.632938 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3539/7031] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:07 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:07.640606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2863a342-6e78-45e7-afac-55e1c974b0a0 req-af79d59b-6c01-4b76-8b3b-8d32363857cb service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:07.641283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2863a342-6e78-45e7-afac-55e1c974b0a0 req-af79d59b-6c01-4b76-8b3b-8d32363857cb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:07.641714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2863a342-6e78-45e7-afac-55e1c974b0a0 req-af79d59b-6c01-4b76-8b3b-8d32363857cb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:07.652477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-326dc8d0-55a2-46ef-96a3-11750ae90f9d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:07.653395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-326dc8d0-55a2-46ef-96a3-11750ae90f9d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:07.654191 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-2863a342-6e78-45e7-afac-55e1c974b0a0 req-af79d59b-6c01-4b76-8b3b-8d32363857cb service nova] Creating event network-vif-plugged:1f69d19e-c5b0-433a-96ff-22560f09144a for instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de on n-h1-854823-1 Aug 27 05:27:07.659132 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-2863a342-6e78-45e7-afac-55e1c974b0a0 req-af79d59b-6c01-4b76-8b3b-8d32363857cb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033172 Aug 27 05:27:07.660573 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3493/7032] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:07.660982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326dc8d0-55a2-46ef-96a3-11750ae90f9d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:07.661501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326dc8d0-55a2-46ef-96a3-11750ae90f9d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:07.661960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326dc8d0-55a2-46ef-96a3-11750ae90f9d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:07.662700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326dc8d0-55a2-46ef-96a3-11750ae90f9d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:07.663171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326dc8d0-55a2-46ef-96a3-11750ae90f9d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:07.663624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326dc8d0-55a2-46ef-96a3-11750ae90f9d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:07.796848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-326dc8d0-55a2-46ef-96a3-11750ae90f9d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:07.805458 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-326dc8d0-55a2-46ef-96a3-11750ae90f9d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1507 microversion: 2.1 time: 0.157130 Aug 27 05:27:07.806119 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3540/7033] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:07 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:07.828978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7668bece-64aa-4718-8158-0a5be426111f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Action: 'create', calling method: .version_select at 0x7f1f2174bf70>, body: {"keypair": {"name": "tempest-keypair-1679953105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBkavjCvRKYaO2ilFiOAVkokq0t58lMYNi7FSrl4NwRkRAl1kOjeMHfbBWS+EjhnZz+1uPoUsyamzoV74kys1f2k9iQpFSImHVJpE5r38gzdaifA5Hx0a9jFi8LT3OLMw=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:07.844258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-7668bece-64aa-4718-8158-0a5be426111f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Getting quotas for project 438e558b80bd46a595a05b8eb7d1501d. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:27:07.849996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-7668bece-64aa-4718-8158-0a5be426111f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Getting quotas for user 9a375dc3c8a04f7087ba9c55e96eb621 and project 438e558b80bd46a595a05b8eb7d1501d. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:27:07.874945 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7668bece-64aa-4718-8158-0a5be426111f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050201 Aug 27 05:27:07.875564 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3494/7034] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:27:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:09.060009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5426587d-b10a-4c76-aa8e-6e46b6953278 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:09.060670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5426587d-b10a-4c76-aa8e-6e46b6953278 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:09.068037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5426587d-b10a-4c76-aa8e-6e46b6953278 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:09.068772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5426587d-b10a-4c76-aa8e-6e46b6953278 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:09.069230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5426587d-b10a-4c76-aa8e-6e46b6953278 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:09.069938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5426587d-b10a-4c76-aa8e-6e46b6953278 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:09.070406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5426587d-b10a-4c76-aa8e-6e46b6953278 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:09.070844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5426587d-b10a-4c76-aa8e-6e46b6953278 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:09.201683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5426587d-b10a-4c76-aa8e-6e46b6953278 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:09.210544 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5426587d-b10a-4c76-aa8e-6e46b6953278 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 200 len: 1507 microversion: 2.1 time: 0.154444 Aug 27 05:27:09.211076 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3541/7035] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:09 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:09.233529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a54d9298-906e-4660-9cba-bcfeb76da7f8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:09.234175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a54d9298-906e-4660-9cba-bcfeb76da7f8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:09.241009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a54d9298-906e-4660-9cba-bcfeb76da7f8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:09.241500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a54d9298-906e-4660-9cba-bcfeb76da7f8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:09.241942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a54d9298-906e-4660-9cba-bcfeb76da7f8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:09.242645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a54d9298-906e-4660-9cba-bcfeb76da7f8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:09.243106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a54d9298-906e-4660-9cba-bcfeb76da7f8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:09.243541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a54d9298-906e-4660-9cba-bcfeb76da7f8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:09.268812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a54d9298-906e-4660-9cba-bcfeb76da7f8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:27:09.350039 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a54d9298-906e-4660-9cba-bcfeb76da7f8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 204 len: 0 microversion: 2.1 time: 0.123234 Aug 27 05:27:09.350922 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3495/7036] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:27:09 2022] DELETE /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:27:09.409306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-17048178", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "8f87eb41-2240-4767-b14b-646011a21339"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:09.462158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] validate_networks() for [('8f87eb41-2240-4767-b14b-646011a21339', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:27:09.838555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:27:09.839075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:27:09.839608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:27:09.840037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:27:09.840469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:27:09.850161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:09.850683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:09.851139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:09.851894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:09.852366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:09.852843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:09.870932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Getting quotas for project 438e558b80bd46a595a05b8eb7d1501d. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:27:09.876250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Getting quotas for user 9a375dc3c8a04f7087ba9c55e96eb621 and project 438e558b80bd46a595a05b8eb7d1501d. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:27:09.888847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:27:09.891170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:27:09.937071 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66dcca31-cd0c-4643-b6d6-b0eaba39dbcf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531634 Aug 27 05:27:09.937746 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3542/7037] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:27:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:27:09.949578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dd6a5aee-ca9d-4801-894b-89bac3ef8a9f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:09.950394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dd6a5aee-ca9d-4801-894b-89bac3ef8a9f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:10.006149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dd6a5aee-ca9d-4801-894b-89bac3ef8a9f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:10.013699 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dd6a5aee-ca9d-4801-894b-89bac3ef8a9f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1216 microversion: 2.1 time: 0.068212 Aug 27 05:27:10.014168 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3496/7038] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:09 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:11.036186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf9f25d7-f728-40f2-bbb8-2a81742cf14b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:11.036840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf9f25d7-f728-40f2-bbb8-2a81742cf14b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:11.043911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf9f25d7-f728-40f2-bbb8-2a81742cf14b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:11.044409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf9f25d7-f728-40f2-bbb8-2a81742cf14b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:11.044890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf9f25d7-f728-40f2-bbb8-2a81742cf14b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:11.045602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf9f25d7-f728-40f2-bbb8-2a81742cf14b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:11.046078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf9f25d7-f728-40f2-bbb8-2a81742cf14b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:11.046520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf9f25d7-f728-40f2-bbb8-2a81742cf14b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:11.109847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf9f25d7-f728-40f2-bbb8-2a81742cf14b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:11.117736 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf9f25d7-f728-40f2-bbb8-2a81742cf14b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1268 microversion: 2.1 time: 0.087075 Aug 27 05:27:11.118309 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3543/7039] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:11 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1268 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:11.896041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a0806657-4430-4a66-b532-e84acd0ad734 req-a28eca79-0fb2-406a-b4ec-4d4bc99edb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5e6e98-efea-4fbe-b32f-bea91e1a65de", "name": "network-vif-deleted", "tag": "1f69d19e-c5b0-433a-96ff-22560f09144a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:11.911559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a0806657-4430-4a66-b532-e84acd0ad734 req-a28eca79-0fb2-406a-b4ec-4d4bc99edb93 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:11.912394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a0806657-4430-4a66-b532-e84acd0ad734 req-a28eca79-0fb2-406a-b4ec-4d4bc99edb93 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:11.913147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a0806657-4430-4a66-b532-e84acd0ad734 req-a28eca79-0fb2-406a-b4ec-4d4bc99edb93 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:11.925009 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a0806657-4430-4a66-b532-e84acd0ad734 req-a28eca79-0fb2-406a-b4ec-4d4bc99edb93 service nova] Creating event network-vif-deleted:1f69d19e-c5b0-433a-96ff-22560f09144a for instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de on n-h1-854823-1 Aug 27 05:27:11.930855 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a0806657-4430-4a66-b532-e84acd0ad734 req-a28eca79-0fb2-406a-b4ec-4d4bc99edb93 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041032 Aug 27 05:27:11.931729 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3497/7040] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:12.139369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3cbb53bc-84b5-44fa-ab6b-afbd4262cb97 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:12.140304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3cbb53bc-84b5-44fa-ab6b-afbd4262cb97 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:12.149880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cbb53bc-84b5-44fa-ab6b-afbd4262cb97 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:12.150623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cbb53bc-84b5-44fa-ab6b-afbd4262cb97 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:12.151084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cbb53bc-84b5-44fa-ab6b-afbd4262cb97 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:12.151878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cbb53bc-84b5-44fa-ab6b-afbd4262cb97 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:12.152457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cbb53bc-84b5-44fa-ab6b-afbd4262cb97 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:12.153167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cbb53bc-84b5-44fa-ab6b-afbd4262cb97 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:12.307489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3cbb53bc-84b5-44fa-ab6b-afbd4262cb97 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:12.315611 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3cbb53bc-84b5-44fa-ab6b-afbd4262cb97 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1316 microversion: 2.1 time: 0.180480 Aug 27 05:27:12.316800 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3544/7041] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:12 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:12.845972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-be4a04e5-b6f9-45e4-bdf9-aea92e670775 req-595fe2a0-220b-43c9-b9b4-0213693deb30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5d8131-3721-40fa-bb18-22353580f20f", "tag": "24f914a4-a9fa-4c43-93dc-5ed69c2ee926"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:12.859539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-be4a04e5-b6f9-45e4-bdf9-aea92e670775 req-595fe2a0-220b-43c9-b9b4-0213693deb30 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:12.859942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-be4a04e5-b6f9-45e4-bdf9-aea92e670775 req-595fe2a0-220b-43c9-b9b4-0213693deb30 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:12.860860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-be4a04e5-b6f9-45e4-bdf9-aea92e670775 req-595fe2a0-220b-43c9-b9b4-0213693deb30 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:12.874095 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-be4a04e5-b6f9-45e4-bdf9-aea92e670775 req-595fe2a0-220b-43c9-b9b4-0213693deb30 service nova] Creating event network-changed:24f914a4-a9fa-4c43-93dc-5ed69c2ee926 for instance 7b5d8131-3721-40fa-bb18-22353580f20f on n-h1-854823-1 Aug 27 05:27:12.880023 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-be4a04e5-b6f9-45e4-bdf9-aea92e670775 req-595fe2a0-220b-43c9-b9b4-0213693deb30 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039662 Aug 27 05:27:12.880670 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3498/7042] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:13.337904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39740c26-b361-4417-afd2-89ff53fbfa44 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:13.338557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39740c26-b361-4417-afd2-89ff53fbfa44 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:13.345398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39740c26-b361-4417-afd2-89ff53fbfa44 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:13.345898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39740c26-b361-4417-afd2-89ff53fbfa44 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:13.346343 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39740c26-b361-4417-afd2-89ff53fbfa44 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:13.347044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39740c26-b361-4417-afd2-89ff53fbfa44 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:13.348191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39740c26-b361-4417-afd2-89ff53fbfa44 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:13.348653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39740c26-b361-4417-afd2-89ff53fbfa44 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:13.479684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-39740c26-b361-4417-afd2-89ff53fbfa44 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:13.487601 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39740c26-b361-4417-afd2-89ff53fbfa44 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1316 microversion: 2.1 time: 0.153662 Aug 27 05:27:13.488497 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3545/7043] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:13 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:14.509145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dd0f1a0f-37ea-4075-a145-e8fa0c0124c8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:14.509861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dd0f1a0f-37ea-4075-a145-e8fa0c0124c8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:14.517229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd0f1a0f-37ea-4075-a145-e8fa0c0124c8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:14.517724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd0f1a0f-37ea-4075-a145-e8fa0c0124c8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:14.518168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd0f1a0f-37ea-4075-a145-e8fa0c0124c8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:14.518871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd0f1a0f-37ea-4075-a145-e8fa0c0124c8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:14.519329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd0f1a0f-37ea-4075-a145-e8fa0c0124c8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:14.519756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dd0f1a0f-37ea-4075-a145-e8fa0c0124c8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:14.651567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dd0f1a0f-37ea-4075-a145-e8fa0c0124c8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:14.659242 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dd0f1a0f-37ea-4075-a145-e8fa0c0124c8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1316 microversion: 2.1 time: 0.154364 Aug 27 05:27:14.660313 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3499/7044] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:14 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:15.682118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d478c45b-ee71-46be-b4fd-18d2eb1b9585 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:15.683430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d478c45b-ee71-46be-b4fd-18d2eb1b9585 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:15.691760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d478c45b-ee71-46be-b4fd-18d2eb1b9585 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:15.692371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d478c45b-ee71-46be-b4fd-18d2eb1b9585 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:15.692937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d478c45b-ee71-46be-b4fd-18d2eb1b9585 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:15.693779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d478c45b-ee71-46be-b4fd-18d2eb1b9585 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:15.694324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d478c45b-ee71-46be-b4fd-18d2eb1b9585 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:15.694958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d478c45b-ee71-46be-b4fd-18d2eb1b9585 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:15.833563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d478c45b-ee71-46be-b4fd-18d2eb1b9585 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:15.842022 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d478c45b-ee71-46be-b4fd-18d2eb1b9585 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1316 microversion: 2.1 time: 0.164765 Aug 27 05:27:15.842623 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3546/7045] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:15 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:16.863100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-defb3830-e422-41a4-b17f-2b5e3b184061 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:16.863718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-defb3830-e422-41a4-b17f-2b5e3b184061 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:16.870801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-defb3830-e422-41a4-b17f-2b5e3b184061 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:16.871291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-defb3830-e422-41a4-b17f-2b5e3b184061 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:16.871735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-defb3830-e422-41a4-b17f-2b5e3b184061 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:16.872436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-defb3830-e422-41a4-b17f-2b5e3b184061 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:16.872926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-defb3830-e422-41a4-b17f-2b5e3b184061 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:16.873359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-defb3830-e422-41a4-b17f-2b5e3b184061 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:17.007014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-defb3830-e422-41a4-b17f-2b5e3b184061 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:17.014670 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-defb3830-e422-41a4-b17f-2b5e3b184061 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1316 microversion: 2.1 time: 0.155474 Aug 27 05:27:17.015242 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3500/7046] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:16 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:17.643858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2a568226-2b68-44b5-8ac8-1f84401e710d req-01da669e-daef-4733-ab32-594d2bc00498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5d8131-3721-40fa-bb18-22353580f20f", "name": "network-vif-plugged", "status": "completed", "tag": "24f914a4-a9fa-4c43-93dc-5ed69c2ee926"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:17.655253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2a568226-2b68-44b5-8ac8-1f84401e710d req-01da669e-daef-4733-ab32-594d2bc00498 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:17.655756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2a568226-2b68-44b5-8ac8-1f84401e710d req-01da669e-daef-4733-ab32-594d2bc00498 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:17.656276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2a568226-2b68-44b5-8ac8-1f84401e710d req-01da669e-daef-4733-ab32-594d2bc00498 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:17.667651 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2a568226-2b68-44b5-8ac8-1f84401e710d req-01da669e-daef-4733-ab32-594d2bc00498 service nova] Creating event network-vif-plugged:24f914a4-a9fa-4c43-93dc-5ed69c2ee926 for instance 7b5d8131-3721-40fa-bb18-22353580f20f on n-h1-854823-1 Aug 27 05:27:17.673034 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2a568226-2b68-44b5-8ac8-1f84401e710d req-01da669e-daef-4733-ab32-594d2bc00498 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032882 Aug 27 05:27:17.673687 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3547/7047] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:18.035577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3f3df402-8335-49e8-b7a0-3b9739eca4b0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:18.036125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3f3df402-8335-49e8-b7a0-3b9739eca4b0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:18.043125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f3df402-8335-49e8-b7a0-3b9739eca4b0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:18.043612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f3df402-8335-49e8-b7a0-3b9739eca4b0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:18.044053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f3df402-8335-49e8-b7a0-3b9739eca4b0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:18.044776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f3df402-8335-49e8-b7a0-3b9739eca4b0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:18.045240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f3df402-8335-49e8-b7a0-3b9739eca4b0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:18.045673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3f3df402-8335-49e8-b7a0-3b9739eca4b0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:18.180677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3f3df402-8335-49e8-b7a0-3b9739eca4b0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:18.188439 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3f3df402-8335-49e8-b7a0-3b9739eca4b0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1316 microversion: 2.1 time: 0.156987 Aug 27 05:27:18.189047 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3501/7048] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:18 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:19.211059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5bc85c6e-1fd7-42aa-bc6c-c50ff3faa545 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:19.211794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5bc85c6e-1fd7-42aa-bc6c-c50ff3faa545 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:19.218174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bc85c6e-1fd7-42aa-bc6c-c50ff3faa545 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:19.218673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bc85c6e-1fd7-42aa-bc6c-c50ff3faa545 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:19.219120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bc85c6e-1fd7-42aa-bc6c-c50ff3faa545 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:19.219826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bc85c6e-1fd7-42aa-bc6c-c50ff3faa545 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:19.220291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bc85c6e-1fd7-42aa-bc6c-c50ff3faa545 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:19.220766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bc85c6e-1fd7-42aa-bc6c-c50ff3faa545 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:19.365771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5bc85c6e-1fd7-42aa-bc6c-c50ff3faa545 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:19.373985 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5bc85c6e-1fd7-42aa-bc6c-c50ff3faa545 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1506 microversion: 2.1 time: 0.168554 Aug 27 05:27:19.374577 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3548/7049] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:19 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:19.393853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3cb7ff83-23ee-4c98-b15b-9a1082066273 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:19.395035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3cb7ff83-23ee-4c98-b15b-9a1082066273 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:19.402157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cb7ff83-23ee-4c98-b15b-9a1082066273 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:19.402645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cb7ff83-23ee-4c98-b15b-9a1082066273 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:19.403081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cb7ff83-23ee-4c98-b15b-9a1082066273 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:19.403778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cb7ff83-23ee-4c98-b15b-9a1082066273 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:19.404236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cb7ff83-23ee-4c98-b15b-9a1082066273 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:19.404692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3cb7ff83-23ee-4c98-b15b-9a1082066273 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:19.606912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3cb7ff83-23ee-4c98-b15b-9a1082066273 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:19.615854 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3cb7ff83-23ee-4c98-b15b-9a1082066273 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1506 microversion: 2.1 time: 0.225285 Aug 27 05:27:19.616063 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3502/7050] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:19 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:19.635793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:19.638375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:19.645087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:19.645592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:19.646230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:19.646961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:19.647442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:19.647891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:19.676909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:19.683359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Old instance type m1.heat2, new instance type m1.heat {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:27:19.686203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:19.691318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:27:19.691759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:27:19.692242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:27:19.692700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:27:19.693130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:27:19.757495 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab6ed30a-ba7c-4cfa-9d82-7dffb99b666c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "POST /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f/action" status: 202 len: 0 microversion: 2.1 time: 0.125684 Aug 27 05:27:19.758504 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3549/7051] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:27:19 2022] POST /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:27:19.766373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8083741e-e9df-4c02-8fe4-a123e4e90031 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:19.766997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8083741e-e9df-4c02-8fe4-a123e4e90031 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:19.774431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8083741e-e9df-4c02-8fe4-a123e4e90031 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:19.774950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8083741e-e9df-4c02-8fe4-a123e4e90031 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:19.775378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8083741e-e9df-4c02-8fe4-a123e4e90031 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:19.776101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8083741e-e9df-4c02-8fe4-a123e4e90031 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:19.776599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8083741e-e9df-4c02-8fe4-a123e4e90031 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:19.777039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8083741e-e9df-4c02-8fe4-a123e4e90031 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:20.010708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:20.033039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8083741e-e9df-4c02-8fe4-a123e4e90031 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:20.045457 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8083741e-e9df-4c02-8fe4-a123e4e90031 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1513 microversion: 2.1 time: 0.282152 Aug 27 05:27:20.046200 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3503/7052] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:19 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1513 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:21.068196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e0863523-1742-4c7f-bf14-b8d393caeb55 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:21.069017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e0863523-1742-4c7f-bf14-b8d393caeb55 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:21.070943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:21.071618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:21.083229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0863523-1742-4c7f-bf14-b8d393caeb55 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:21.083720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0863523-1742-4c7f-bf14-b8d393caeb55 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:21.084302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0863523-1742-4c7f-bf14-b8d393caeb55 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:21.084977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0863523-1742-4c7f-bf14-b8d393caeb55 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:21.085642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0863523-1742-4c7f-bf14-b8d393caeb55 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:21.086363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0863523-1742-4c7f-bf14-b8d393caeb55 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:21.227975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e0863523-1742-4c7f-bf14-b8d393caeb55 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:21.235923 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e0863523-1742-4c7f-bf14-b8d393caeb55 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1513 microversion: 2.1 time: 0.172515 Aug 27 05:27:21.236519 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3550/7053] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:21 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:22.257766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-84c4786d-bb7a-4426-820c-6e4feaccb65c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:22.258412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-84c4786d-bb7a-4426-820c-6e4feaccb65c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:22.265421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84c4786d-bb7a-4426-820c-6e4feaccb65c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:22.265908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84c4786d-bb7a-4426-820c-6e4feaccb65c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:22.266353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84c4786d-bb7a-4426-820c-6e4feaccb65c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:22.267057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84c4786d-bb7a-4426-820c-6e4feaccb65c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:22.267522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84c4786d-bb7a-4426-820c-6e4feaccb65c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:22.267952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84c4786d-bb7a-4426-820c-6e4feaccb65c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:22.398310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-84c4786d-bb7a-4426-820c-6e4feaccb65c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:22.406274 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-84c4786d-bb7a-4426-820c-6e4feaccb65c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.153318 Aug 27 05:27:22.406852 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3504/7054] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:22 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:23.428376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e5daf7b-5a2d-4a6f-b555-d57645f4086d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:23.428960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e5daf7b-5a2d-4a6f-b555-d57645f4086d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:23.435904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e5daf7b-5a2d-4a6f-b555-d57645f4086d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:23.436406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e5daf7b-5a2d-4a6f-b555-d57645f4086d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:23.436960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e5daf7b-5a2d-4a6f-b555-d57645f4086d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:23.437678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e5daf7b-5a2d-4a6f-b555-d57645f4086d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:23.438157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e5daf7b-5a2d-4a6f-b555-d57645f4086d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:23.438598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e5daf7b-5a2d-4a6f-b555-d57645f4086d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:23.570298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e5daf7b-5a2d-4a6f-b555-d57645f4086d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:23.578068 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e5daf7b-5a2d-4a6f-b555-d57645f4086d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.153796 Aug 27 05:27:23.578647 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3551/7055] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:23 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:24.599265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e3bb99db-e3cd-49a1-b1a3-98c1cad39bb8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:24.599968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e3bb99db-e3cd-49a1-b1a3-98c1cad39bb8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:24.607071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3bb99db-e3cd-49a1-b1a3-98c1cad39bb8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:24.607556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3bb99db-e3cd-49a1-b1a3-98c1cad39bb8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:24.607992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3bb99db-e3cd-49a1-b1a3-98c1cad39bb8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:24.608729 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3bb99db-e3cd-49a1-b1a3-98c1cad39bb8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:24.609187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3bb99db-e3cd-49a1-b1a3-98c1cad39bb8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:24.609613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3bb99db-e3cd-49a1-b1a3-98c1cad39bb8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:24.614045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:24.744962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e3bb99db-e3cd-49a1-b1a3-98c1cad39bb8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:24.752858 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e3bb99db-e3cd-49a1-b1a3-98c1cad39bb8 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.157473 Aug 27 05:27:24.753431 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3505/7056] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:24 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:25.774629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5646fbb-0fe7-43a0-92b9-3225152a6404 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:25.775253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d5646fbb-0fe7-43a0-92b9-3225152a6404 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:25.782155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5646fbb-0fe7-43a0-92b9-3225152a6404 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:25.782650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5646fbb-0fe7-43a0-92b9-3225152a6404 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:25.783097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5646fbb-0fe7-43a0-92b9-3225152a6404 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:25.783793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5646fbb-0fe7-43a0-92b9-3225152a6404 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:25.784257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5646fbb-0fe7-43a0-92b9-3225152a6404 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:25.785213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5646fbb-0fe7-43a0-92b9-3225152a6404 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:25.915569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d5646fbb-0fe7-43a0-92b9-3225152a6404 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:25.923325 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5646fbb-0fe7-43a0-92b9-3225152a6404 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.152963 Aug 27 05:27:25.923904 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3552/7057] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:25 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:26.945265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-95e5b800-7cc8-4ef7-9a9b-e317fac8654c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:26.945875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-95e5b800-7cc8-4ef7-9a9b-e317fac8654c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:26.952760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95e5b800-7cc8-4ef7-9a9b-e317fac8654c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:26.953243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95e5b800-7cc8-4ef7-9a9b-e317fac8654c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:26.953674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95e5b800-7cc8-4ef7-9a9b-e317fac8654c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:26.954357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95e5b800-7cc8-4ef7-9a9b-e317fac8654c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:26.954805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95e5b800-7cc8-4ef7-9a9b-e317fac8654c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:26.955227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95e5b800-7cc8-4ef7-9a9b-e317fac8654c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:27.088792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-95e5b800-7cc8-4ef7-9a9b-e317fac8654c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:27.096474 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-95e5b800-7cc8-4ef7-9a9b-e317fac8654c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.155842 Aug 27 05:27:27.097950 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3506/7058] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:26 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:28.117614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8816bcb4-88cf-4e8b-b4c4-688dfc0ac964 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:28.118159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8816bcb4-88cf-4e8b-b4c4-688dfc0ac964 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:28.124951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8816bcb4-88cf-4e8b-b4c4-688dfc0ac964 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:28.125442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8816bcb4-88cf-4e8b-b4c4-688dfc0ac964 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:28.125887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8816bcb4-88cf-4e8b-b4c4-688dfc0ac964 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:28.126588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8816bcb4-88cf-4e8b-b4c4-688dfc0ac964 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:28.127053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8816bcb4-88cf-4e8b-b4c4-688dfc0ac964 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:28.127485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8816bcb4-88cf-4e8b-b4c4-688dfc0ac964 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:28.257414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8816bcb4-88cf-4e8b-b4c4-688dfc0ac964 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:28.265242 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8816bcb4-88cf-4e8b-b4c4-688dfc0ac964 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.151652 Aug 27 05:27:28.265815 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3553/7059] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:28 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:29.287306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a7a580b9-f409-4444-8d1c-a5305f48337e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:29.287921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a7a580b9-f409-4444-8d1c-a5305f48337e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:29.294953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7a580b9-f409-4444-8d1c-a5305f48337e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:29.295444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7a580b9-f409-4444-8d1c-a5305f48337e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:29.295915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7a580b9-f409-4444-8d1c-a5305f48337e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:29.296654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7a580b9-f409-4444-8d1c-a5305f48337e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:29.297119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7a580b9-f409-4444-8d1c-a5305f48337e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:29.297549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a7a580b9-f409-4444-8d1c-a5305f48337e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:29.436279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a7a580b9-f409-4444-8d1c-a5305f48337e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:29.444219 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a7a580b9-f409-4444-8d1c-a5305f48337e tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.161614 Aug 27 05:27:29.444832 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3507/7060] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:29 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:30.464986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ad93a2e-930e-4868-884d-ba8351e67235 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:30.465608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ad93a2e-930e-4868-884d-ba8351e67235 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:30.472575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad93a2e-930e-4868-884d-ba8351e67235 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:30.473074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad93a2e-930e-4868-884d-ba8351e67235 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:30.473520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad93a2e-930e-4868-884d-ba8351e67235 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:30.474881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad93a2e-930e-4868-884d-ba8351e67235 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:30.475346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad93a2e-930e-4868-884d-ba8351e67235 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:30.475782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad93a2e-930e-4868-884d-ba8351e67235 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:30.610021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ad93a2e-930e-4868-884d-ba8351e67235 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:30.617968 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ad93a2e-930e-4868-884d-ba8351e67235 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.156933 Aug 27 05:27:30.618547 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3554/7061] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:30 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:31.639277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ab84f850-05c6-4636-b393-bd21c897a103 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:31.639926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ab84f850-05c6-4636-b393-bd21c897a103 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:31.642824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:31.649642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab84f850-05c6-4636-b393-bd21c897a103 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:31.650205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab84f850-05c6-4636-b393-bd21c897a103 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:31.650648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab84f850-05c6-4636-b393-bd21c897a103 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:31.651340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab84f850-05c6-4636-b393-bd21c897a103 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:31.651798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab84f850-05c6-4636-b393-bd21c897a103 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:31.652227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab84f850-05c6-4636-b393-bd21c897a103 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:31.782121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ab84f850-05c6-4636-b393-bd21c897a103 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:31.791174 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ab84f850-05c6-4636-b393-bd21c897a103 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.155770 Aug 27 05:27:31.791758 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3508/7062] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:31 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:32.812826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4558fd3a-9fc9-4e11-90f9-6e9989b0c402 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:32.813475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4558fd3a-9fc9-4e11-90f9-6e9989b0c402 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:32.815510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:32.820681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4558fd3a-9fc9-4e11-90f9-6e9989b0c402 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:32.821185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4558fd3a-9fc9-4e11-90f9-6e9989b0c402 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:32.821640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4558fd3a-9fc9-4e11-90f9-6e9989b0c402 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:32.822383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4558fd3a-9fc9-4e11-90f9-6e9989b0c402 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:32.822857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4558fd3a-9fc9-4e11-90f9-6e9989b0c402 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:32.823294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4558fd3a-9fc9-4e11-90f9-6e9989b0c402 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:32.951929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4558fd3a-9fc9-4e11-90f9-6e9989b0c402 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:32.960257 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4558fd3a-9fc9-4e11-90f9-6e9989b0c402 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.151654 Aug 27 05:27:32.960874 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3555/7063] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:32 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:33.981540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5cd85b60-d480-4c53-8f07-d194d7fd83bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:33.982154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5cd85b60-d480-4c53-8f07-d194d7fd83bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:33.988306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd85b60-d480-4c53-8f07-d194d7fd83bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:33.988818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd85b60-d480-4c53-8f07-d194d7fd83bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:33.989888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd85b60-d480-4c53-8f07-d194d7fd83bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:33.990608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd85b60-d480-4c53-8f07-d194d7fd83bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:33.991137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd85b60-d480-4c53-8f07-d194d7fd83bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:33.991571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cd85b60-d480-4c53-8f07-d194d7fd83bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:34.124370 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5cd85b60-d480-4c53-8f07-d194d7fd83bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:34.132192 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5cd85b60-d480-4c53-8f07-d194d7fd83bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.154975 Aug 27 05:27:34.132852 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3509/7064] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:33 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:35.154595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01c8c794-ad70-4f77-b337-88ee6f8d64ac tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:35.155227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01c8c794-ad70-4f77-b337-88ee6f8d64ac tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:35.162246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01c8c794-ad70-4f77-b337-88ee6f8d64ac tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:35.162742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01c8c794-ad70-4f77-b337-88ee6f8d64ac tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:35.163196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01c8c794-ad70-4f77-b337-88ee6f8d64ac tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:35.163917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01c8c794-ad70-4f77-b337-88ee6f8d64ac tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:35.164387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01c8c794-ad70-4f77-b337-88ee6f8d64ac tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:35.164962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01c8c794-ad70-4f77-b337-88ee6f8d64ac tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:35.302287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01c8c794-ad70-4f77-b337-88ee6f8d64ac tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:35.310224 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01c8c794-ad70-4f77-b337-88ee6f8d64ac tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.159694 Aug 27 05:27:35.310822 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3556/7065] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:35 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:36.331239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-17ba577d-ddcc-4e5a-9b45-17641f83e3f7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:36.331847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-17ba577d-ddcc-4e5a-9b45-17641f83e3f7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:36.338973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ba577d-ddcc-4e5a-9b45-17641f83e3f7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:36.339463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ba577d-ddcc-4e5a-9b45-17641f83e3f7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:36.339893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ba577d-ddcc-4e5a-9b45-17641f83e3f7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:36.340603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ba577d-ddcc-4e5a-9b45-17641f83e3f7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:36.341057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ba577d-ddcc-4e5a-9b45-17641f83e3f7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:36.341476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-17ba577d-ddcc-4e5a-9b45-17641f83e3f7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:36.475378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-17ba577d-ddcc-4e5a-9b45-17641f83e3f7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:36.483499 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-17ba577d-ddcc-4e5a-9b45-17641f83e3f7 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.156098 Aug 27 05:27:36.484090 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3510/7066] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:36 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:37.506225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e25fb95-29cb-4833-9c1a-cc4e18e0b35f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:37.506914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e25fb95-29cb-4833-9c1a-cc4e18e0b35f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:37.513150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e25fb95-29cb-4833-9c1a-cc4e18e0b35f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:37.513663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e25fb95-29cb-4833-9c1a-cc4e18e0b35f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:37.514124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e25fb95-29cb-4833-9c1a-cc4e18e0b35f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:37.514852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e25fb95-29cb-4833-9c1a-cc4e18e0b35f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:37.515327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e25fb95-29cb-4833-9c1a-cc4e18e0b35f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:37.515772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e25fb95-29cb-4833-9c1a-cc4e18e0b35f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:37.648577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e25fb95-29cb-4833-9c1a-cc4e18e0b35f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:37.656593 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e25fb95-29cb-4833-9c1a-cc4e18e0b35f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.156061 Aug 27 05:27:37.657181 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3557/7067] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:37 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:38.678093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5e291e4f-8b9f-4969-9ba0-ae74ce8ec330 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:38.678625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5e291e4f-8b9f-4969-9ba0-ae74ce8ec330 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:38.685574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e291e4f-8b9f-4969-9ba0-ae74ce8ec330 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:38.686059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e291e4f-8b9f-4969-9ba0-ae74ce8ec330 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:38.686500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e291e4f-8b9f-4969-9ba0-ae74ce8ec330 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:38.687193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e291e4f-8b9f-4969-9ba0-ae74ce8ec330 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:38.687653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e291e4f-8b9f-4969-9ba0-ae74ce8ec330 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:38.688083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e291e4f-8b9f-4969-9ba0-ae74ce8ec330 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:38.817044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5e291e4f-8b9f-4969-9ba0-ae74ce8ec330 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:38.824823 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5e291e4f-8b9f-4969-9ba0-ae74ce8ec330 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.150683 Aug 27 05:27:38.825514 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3511/7068] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:38 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:39.846308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-41cfb6f9-0ae7-4657-951f-3f9919c94e9c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:39.846940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41cfb6f9-0ae7-4657-951f-3f9919c94e9c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:39.853905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cfb6f9-0ae7-4657-951f-3f9919c94e9c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:39.854403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cfb6f9-0ae7-4657-951f-3f9919c94e9c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:39.854851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cfb6f9-0ae7-4657-951f-3f9919c94e9c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:39.855560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cfb6f9-0ae7-4657-951f-3f9919c94e9c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:39.856032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cfb6f9-0ae7-4657-951f-3f9919c94e9c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:39.856474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cfb6f9-0ae7-4657-951f-3f9919c94e9c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:39.989022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-41cfb6f9-0ae7-4657-951f-3f9919c94e9c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:39.996860 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-41cfb6f9-0ae7-4657-951f-3f9919c94e9c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.154454 Aug 27 05:27:39.997441 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3558/7069] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:39 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:41.018105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e3e8ff68-6e1e-418a-a108-5a5517e7cb1b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:41.018721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e3e8ff68-6e1e-418a-a108-5a5517e7cb1b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:41.025982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3e8ff68-6e1e-418a-a108-5a5517e7cb1b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:41.026464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3e8ff68-6e1e-418a-a108-5a5517e7cb1b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:41.026898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3e8ff68-6e1e-418a-a108-5a5517e7cb1b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:41.027616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3e8ff68-6e1e-418a-a108-5a5517e7cb1b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:41.028047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3e8ff68-6e1e-418a-a108-5a5517e7cb1b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:41.028505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e3e8ff68-6e1e-418a-a108-5a5517e7cb1b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:41.163876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e3e8ff68-6e1e-418a-a108-5a5517e7cb1b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:41.171640 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e3e8ff68-6e1e-418a-a108-5a5517e7cb1b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.157465 Aug 27 05:27:41.172217 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3512/7070] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:41 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:42.193353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a42ace27-b65a-4ccd-bc4a-352bd6c069d9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:42.193977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a42ace27-b65a-4ccd-bc4a-352bd6c069d9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:42.200907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a42ace27-b65a-4ccd-bc4a-352bd6c069d9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:42.201400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a42ace27-b65a-4ccd-bc4a-352bd6c069d9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:42.201846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a42ace27-b65a-4ccd-bc4a-352bd6c069d9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:42.202542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a42ace27-b65a-4ccd-bc4a-352bd6c069d9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:42.203004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a42ace27-b65a-4ccd-bc4a-352bd6c069d9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:42.203434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a42ace27-b65a-4ccd-bc4a-352bd6c069d9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:42.336941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a42ace27-b65a-4ccd-bc4a-352bd6c069d9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:42.344737 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a42ace27-b65a-4ccd-bc4a-352bd6c069d9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.155364 Aug 27 05:27:42.345323 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3559/7071] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:42 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:43.366420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c6cd2fea-1bb7-422a-9846-2f552beebc32 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:43.366974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c6cd2fea-1bb7-422a-9846-2f552beebc32 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:43.373997 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6cd2fea-1bb7-422a-9846-2f552beebc32 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:43.374489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6cd2fea-1bb7-422a-9846-2f552beebc32 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:43.374933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6cd2fea-1bb7-422a-9846-2f552beebc32 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:43.375636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6cd2fea-1bb7-422a-9846-2f552beebc32 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:43.376098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6cd2fea-1bb7-422a-9846-2f552beebc32 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:43.376541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6cd2fea-1bb7-422a-9846-2f552beebc32 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:43.509857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c6cd2fea-1bb7-422a-9846-2f552beebc32 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:43.517710 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c6cd2fea-1bb7-422a-9846-2f552beebc32 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.155893 Aug 27 05:27:43.518286 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3513/7072] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:43 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:44.538174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ca82177-bfcd-464d-b2ca-dd14c085a258 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:44.538795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0ca82177-bfcd-464d-b2ca-dd14c085a258 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:44.545803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca82177-bfcd-464d-b2ca-dd14c085a258 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:44.546296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca82177-bfcd-464d-b2ca-dd14c085a258 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:44.546744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca82177-bfcd-464d-b2ca-dd14c085a258 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:44.547446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca82177-bfcd-464d-b2ca-dd14c085a258 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:44.547942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca82177-bfcd-464d-b2ca-dd14c085a258 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:44.548375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca82177-bfcd-464d-b2ca-dd14c085a258 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:44.677385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0ca82177-bfcd-464d-b2ca-dd14c085a258 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:44.686048 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ca82177-bfcd-464d-b2ca-dd14c085a258 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.151777 Aug 27 05:27:44.686634 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3560/7073] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:44 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:45.707337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1216f4db-c4e5-49a6-adce-84a170d3a318 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:45.707955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1216f4db-c4e5-49a6-adce-84a170d3a318 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:45.715099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1216f4db-c4e5-49a6-adce-84a170d3a318 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:45.715586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1216f4db-c4e5-49a6-adce-84a170d3a318 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:45.716114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1216f4db-c4e5-49a6-adce-84a170d3a318 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:45.716788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1216f4db-c4e5-49a6-adce-84a170d3a318 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:45.717251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1216f4db-c4e5-49a6-adce-84a170d3a318 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:45.717683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1216f4db-c4e5-49a6-adce-84a170d3a318 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:45.851777 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1216f4db-c4e5-49a6-adce-84a170d3a318 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:45.859583 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1216f4db-c4e5-49a6-adce-84a170d3a318 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.156200 Aug 27 05:27:45.860158 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3514/7074] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:45 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:46.880553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6ce4b2e-d235-444d-9279-6c78f8f459bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:46.881207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6ce4b2e-d235-444d-9279-6c78f8f459bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:46.888131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ce4b2e-d235-444d-9279-6c78f8f459bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:46.888673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ce4b2e-d235-444d-9279-6c78f8f459bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:46.889134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ce4b2e-d235-444d-9279-6c78f8f459bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:46.889846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ce4b2e-d235-444d-9279-6c78f8f459bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:46.890321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ce4b2e-d235-444d-9279-6c78f8f459bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:46.890765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ce4b2e-d235-444d-9279-6c78f8f459bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:47.020986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f6ce4b2e-d235-444d-9279-6c78f8f459bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:47.029888 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6ce4b2e-d235-444d-9279-6c78f8f459bf tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.153346 Aug 27 05:27:47.030483 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3561/7075] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:46 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:48.057818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5ded2f31-76b2-4863-bde5-06cd93f21938 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:48.058430 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5ded2f31-76b2-4863-bde5-06cd93f21938 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:48.065577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ded2f31-76b2-4863-bde5-06cd93f21938 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:48.066074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ded2f31-76b2-4863-bde5-06cd93f21938 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:48.066519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ded2f31-76b2-4863-bde5-06cd93f21938 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:48.067217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ded2f31-76b2-4863-bde5-06cd93f21938 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:48.067679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ded2f31-76b2-4863-bde5-06cd93f21938 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:48.068117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ded2f31-76b2-4863-bde5-06cd93f21938 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:48.199880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5ded2f31-76b2-4863-bde5-06cd93f21938 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:48.207791 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5ded2f31-76b2-4863-bde5-06cd93f21938 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1518 microversion: 2.1 time: 0.154004 Aug 27 05:27:48.208363 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3515/7076] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:48 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:49.029135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-10a340c9-1a9f-49b2-b146-88f212a4e8a7 req-2ef49195-c813-404a-bb68-74d3c0a54293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5d8131-3721-40fa-bb18-22353580f20f", "name": "network-vif-unplugged", "status": "completed", "tag": "24f914a4-a9fa-4c43-93dc-5ed69c2ee926"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:49.041226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10a340c9-1a9f-49b2-b146-88f212a4e8a7 req-2ef49195-c813-404a-bb68-74d3c0a54293 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:49.041798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10a340c9-1a9f-49b2-b146-88f212a4e8a7 req-2ef49195-c813-404a-bb68-74d3c0a54293 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:49.042317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10a340c9-1a9f-49b2-b146-88f212a4e8a7 req-2ef49195-c813-404a-bb68-74d3c0a54293 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:49.058287 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-10a340c9-1a9f-49b2-b146-88f212a4e8a7 req-2ef49195-c813-404a-bb68-74d3c0a54293 service nova] Creating event network-vif-unplugged:24f914a4-a9fa-4c43-93dc-5ed69c2ee926 for instance 7b5d8131-3721-40fa-bb18-22353580f20f on n-h2-854823-1 Aug 27 05:27:49.063860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-10a340c9-1a9f-49b2-b146-88f212a4e8a7 req-2ef49195-c813-404a-bb68-74d3c0a54293 service nova] Instance 7b5d8131-3721-40fa-bb18-22353580f20f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:27:49.074939 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-10a340c9-1a9f-49b2-b146-88f212a4e8a7 req-2ef49195-c813-404a-bb68-74d3c0a54293 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050287 Aug 27 05:27:49.075988 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3562/7077] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:49.229371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ab8b072f-f138-4824-814b-ea538b73cae4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:49.230009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ab8b072f-f138-4824-814b-ea538b73cae4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:49.236921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab8b072f-f138-4824-814b-ea538b73cae4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:49.237410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab8b072f-f138-4824-814b-ea538b73cae4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:49.237849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab8b072f-f138-4824-814b-ea538b73cae4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:49.238557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab8b072f-f138-4824-814b-ea538b73cae4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:49.239011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab8b072f-f138-4824-814b-ea538b73cae4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:49.239614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab8b072f-f138-4824-814b-ea538b73cae4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:49.467218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ab8b072f-f138-4824-814b-ea538b73cae4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:49.475270 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ab8b072f-f138-4824-814b-ea538b73cae4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1517 microversion: 2.1 time: 0.250369 Aug 27 05:27:49.476092 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3516/7078] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:49 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1517 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:50.497831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-264baafc-4657-458a-ab43-19483ab943c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:50.498549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-264baafc-4657-458a-ab43-19483ab943c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:50.504797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264baafc-4657-458a-ab43-19483ab943c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:50.505299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264baafc-4657-458a-ab43-19483ab943c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:50.506386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264baafc-4657-458a-ab43-19483ab943c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:50.507103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264baafc-4657-458a-ab43-19483ab943c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:50.507575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264baafc-4657-458a-ab43-19483ab943c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:50.508047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264baafc-4657-458a-ab43-19483ab943c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:50.510883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:50.645889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-264baafc-4657-458a-ab43-19483ab943c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:50.654162 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-264baafc-4657-458a-ab43-19483ab943c9 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1515 microversion: 2.1 time: 0.161546 Aug 27 05:27:50.654744 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3563/7079] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:50 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:51.097028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-9d57ea26-0ebb-4255-9c30-a05129bf84f9 req-d0355d82-bab4-4db4-aa23-ad312977139e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5d8131-3721-40fa-bb18-22353580f20f", "tag": "24f914a4-a9fa-4c43-93dc-5ed69c2ee926"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:51.107770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9d57ea26-0ebb-4255-9c30-a05129bf84f9 req-d0355d82-bab4-4db4-aa23-ad312977139e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:51.107996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9d57ea26-0ebb-4255-9c30-a05129bf84f9 req-d0355d82-bab4-4db4-aa23-ad312977139e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:51.108433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9d57ea26-0ebb-4255-9c30-a05129bf84f9 req-d0355d82-bab4-4db4-aa23-ad312977139e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:51.123480 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-9d57ea26-0ebb-4255-9c30-a05129bf84f9 req-d0355d82-bab4-4db4-aa23-ad312977139e service nova] Creating event network-changed:24f914a4-a9fa-4c43-93dc-5ed69c2ee926 for instance 7b5d8131-3721-40fa-bb18-22353580f20f on n-h2-854823-1 Aug 27 05:27:51.129654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-9d57ea26-0ebb-4255-9c30-a05129bf84f9 req-d0355d82-bab4-4db4-aa23-ad312977139e service nova] Instance 7b5d8131-3721-40fa-bb18-22353580f20f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:27:51.141169 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-9d57ea26-0ebb-4255-9c30-a05129bf84f9 req-d0355d82-bab4-4db4-aa23-ad312977139e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047773 Aug 27 05:27:51.141794 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3517/7080] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:51.674902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a7aae5e-7c65-4713-8289-33e270d59cce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:51.676164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5a7aae5e-7c65-4713-8289-33e270d59cce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:51.690466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a7aae5e-7c65-4713-8289-33e270d59cce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:51.691213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a7aae5e-7c65-4713-8289-33e270d59cce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:51.691888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a7aae5e-7c65-4713-8289-33e270d59cce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:51.693069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a7aae5e-7c65-4713-8289-33e270d59cce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:51.694376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a7aae5e-7c65-4713-8289-33e270d59cce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:51.695035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a7aae5e-7c65-4713-8289-33e270d59cce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:51.904434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5a7aae5e-7c65-4713-8289-33e270d59cce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:51.914024 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5a7aae5e-7c65-4713-8289-33e270d59cce tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1515 microversion: 2.1 time: 0.243000 Aug 27 05:27:51.918796 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3564/7081] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:51 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1515 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:52.937599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a082031-c32d-42f3-99b2-8c4d3f90de7d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:52.938304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a082031-c32d-42f3-99b2-8c4d3f90de7d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:52.945238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a082031-c32d-42f3-99b2-8c4d3f90de7d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:52.945723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a082031-c32d-42f3-99b2-8c4d3f90de7d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:52.946162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a082031-c32d-42f3-99b2-8c4d3f90de7d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:52.946857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a082031-c32d-42f3-99b2-8c4d3f90de7d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:52.947319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a082031-c32d-42f3-99b2-8c4d3f90de7d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:52.947751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a082031-c32d-42f3-99b2-8c4d3f90de7d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:53.079286 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6a082031-c32d-42f3-99b2-8c4d3f90de7d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:53.087101 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a082031-c32d-42f3-99b2-8c4d3f90de7d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1512 microversion: 2.1 time: 0.154702 Aug 27 05:27:53.087678 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3518/7082] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:52 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:53.107424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-984950a1-1b9f-4812-9f6a-d309253cd18a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:53.107976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-984950a1-1b9f-4812-9f6a-d309253cd18a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:53.114900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-984950a1-1b9f-4812-9f6a-d309253cd18a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:53.115935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-984950a1-1b9f-4812-9f6a-d309253cd18a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:53.115935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-984950a1-1b9f-4812-9f6a-d309253cd18a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:53.117157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-984950a1-1b9f-4812-9f6a-d309253cd18a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:53.117625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-984950a1-1b9f-4812-9f6a-d309253cd18a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:53.118062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-984950a1-1b9f-4812-9f6a-d309253cd18a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:53.178292 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-984950a1-1b9f-4812-9f6a-d309253cd18a tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "POST /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f/action" status: 204 len: 0 microversion: 2.1 time: 0.074012 Aug 27 05:27:53.178951 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3565/7083] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:27:53 2022] POST /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:27:53.187232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4452d629-1d6a-437f-ba23-d8be10dc400f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:53.188155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4452d629-1d6a-437f-ba23-d8be10dc400f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:53.195133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4452d629-1d6a-437f-ba23-d8be10dc400f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:53.195747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4452d629-1d6a-437f-ba23-d8be10dc400f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:53.196364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4452d629-1d6a-437f-ba23-d8be10dc400f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:53.197337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4452d629-1d6a-437f-ba23-d8be10dc400f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:53.197799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4452d629-1d6a-437f-ba23-d8be10dc400f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:53.198231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4452d629-1d6a-437f-ba23-d8be10dc400f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:53.405371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4452d629-1d6a-437f-ba23-d8be10dc400f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:53.413689 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4452d629-1d6a-437f-ba23-d8be10dc400f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1512 microversion: 2.1 time: 0.230250 Aug 27 05:27:53.414285 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3519/7084] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:53 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:54.205655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3eff6dc6-3579-4697-b057-d68824221e4d req-f2ca164f-65dc-4a34-ba36-9f431babe171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5d8131-3721-40fa-bb18-22353580f20f", "name": "network-vif-plugged", "status": "completed", "tag": "24f914a4-a9fa-4c43-93dc-5ed69c2ee926"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:54.217755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3eff6dc6-3579-4697-b057-d68824221e4d req-f2ca164f-65dc-4a34-ba36-9f431babe171 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.218417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3eff6dc6-3579-4697-b057-d68824221e4d req-f2ca164f-65dc-4a34-ba36-9f431babe171 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.218870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3eff6dc6-3579-4697-b057-d68824221e4d req-f2ca164f-65dc-4a34-ba36-9f431babe171 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.232150 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3eff6dc6-3579-4697-b057-d68824221e4d req-f2ca164f-65dc-4a34-ba36-9f431babe171 service nova] Creating event network-vif-plugged:24f914a4-a9fa-4c43-93dc-5ed69c2ee926 for instance 7b5d8131-3721-40fa-bb18-22353580f20f on n-h2-854823-1 Aug 27 05:27:54.237647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-3eff6dc6-3579-4697-b057-d68824221e4d req-f2ca164f-65dc-4a34-ba36-9f431babe171 service nova] Instance 7b5d8131-3721-40fa-bb18-22353580f20f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:27:54.256272 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3eff6dc6-3579-4697-b057-d68824221e4d req-f2ca164f-65dc-4a34-ba36-9f431babe171 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054876 Aug 27 05:27:54.259822 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3566/7085] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:54.434323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2e38e9ef-b350-4bb1-b477-504e935ea9e1 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:54.434915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2e38e9ef-b350-4bb1-b477-504e935ea9e1 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:54.442310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e38e9ef-b350-4bb1-b477-504e935ea9e1 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.442797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e38e9ef-b350-4bb1-b477-504e935ea9e1 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.443235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e38e9ef-b350-4bb1-b477-504e935ea9e1 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.443942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e38e9ef-b350-4bb1-b477-504e935ea9e1 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.444390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e38e9ef-b350-4bb1-b477-504e935ea9e1 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.444844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2e38e9ef-b350-4bb1-b477-504e935ea9e1 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.590753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2e38e9ef-b350-4bb1-b477-504e935ea9e1 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:54.598380 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2e38e9ef-b350-4bb1-b477-504e935ea9e1 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1504 microversion: 2.1 time: 0.167935 Aug 27 05:27:54.598960 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3520/7086] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:54 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:54.620050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9117c762-b5a6-4570-b99a-2da56c71da3b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:54.620814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9117c762-b5a6-4570-b99a-2da56c71da3b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:54.626988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9117c762-b5a6-4570-b99a-2da56c71da3b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.627487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9117c762-b5a6-4570-b99a-2da56c71da3b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.627941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9117c762-b5a6-4570-b99a-2da56c71da3b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.628702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9117c762-b5a6-4570-b99a-2da56c71da3b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.629179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9117c762-b5a6-4570-b99a-2da56c71da3b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.629621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9117c762-b5a6-4570-b99a-2da56c71da3b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.764842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9117c762-b5a6-4570-b99a-2da56c71da3b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:54.773790 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9117c762-b5a6-4570-b99a-2da56c71da3b tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1504 microversion: 2.1 time: 0.158270 Aug 27 05:27:54.774621 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3567/7087] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:54 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:54.793543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7a91a626-3226-41f0-a514-cf6eaead16fc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:54.794167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7a91a626-3226-41f0-a514-cf6eaead16fc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:54.800199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a91a626-3226-41f0-a514-cf6eaead16fc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.800732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a91a626-3226-41f0-a514-cf6eaead16fc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.801183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a91a626-3226-41f0-a514-cf6eaead16fc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.801879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a91a626-3226-41f0-a514-cf6eaead16fc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.802360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a91a626-3226-41f0-a514-cf6eaead16fc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.802782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7a91a626-3226-41f0-a514-cf6eaead16fc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.806811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=93 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:27:54.931649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7a91a626-3226-41f0-a514-cf6eaead16fc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:54.939795 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7a91a626-3226-41f0-a514-cf6eaead16fc tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1504 microversion: 2.1 time: 0.150135 Aug 27 05:27:54.940378 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3521/7088] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:54 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:54.960101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf433ed1-57c2-4d68-9798-7ef3a1f281e4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:54.960629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf433ed1-57c2-4d68-9798-7ef3a1f281e4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:54.966662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf433ed1-57c2-4d68-9798-7ef3a1f281e4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.967102 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf433ed1-57c2-4d68-9798-7ef3a1f281e4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.967547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf433ed1-57c2-4d68-9798-7ef3a1f281e4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.968246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf433ed1-57c2-4d68-9798-7ef3a1f281e4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:54.968750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf433ed1-57c2-4d68-9798-7ef3a1f281e4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:54.969183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf433ed1-57c2-4d68-9798-7ef3a1f281e4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:54.994425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf433ed1-57c2-4d68-9798-7ef3a1f281e4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:27:55.071122 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf433ed1-57c2-4d68-9798-7ef3a1f281e4 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 204 len: 0 microversion: 2.1 time: 0.114910 Aug 27 05:27:55.071733 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3568/7089] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:27:54 2022] DELETE /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:27:55.091165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b22b6a8d-c03d-4085-883b-4745f3cc5f2c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:55.091929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b22b6a8d-c03d-4085-883b-4745f3cc5f2c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:55.098291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22b6a8d-c03d-4085-883b-4745f3cc5f2c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:55.098787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22b6a8d-c03d-4085-883b-4745f3cc5f2c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:55.099227 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22b6a8d-c03d-4085-883b-4745f3cc5f2c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:55.100554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22b6a8d-c03d-4085-883b-4745f3cc5f2c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:55.101022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22b6a8d-c03d-4085-883b-4745f3cc5f2c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:55.101454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b22b6a8d-c03d-4085-883b-4745f3cc5f2c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:55.131972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b22b6a8d-c03d-4085-883b-4745f3cc5f2c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:27:55.176720 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.compute.api [None req-b22b6a8d-c03d-4085-883b-4745f3cc5f2c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Instance is already in deleting state, ignoring this request Aug 27 05:27:55.177584 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b22b6a8d-c03d-4085-883b-4745f3cc5f2c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 204 len: 0 microversion: 2.1 time: 0.090545 Aug 27 05:27:55.178162 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3522/7090] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:27:55 2022] DELETE /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:27:55.186946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85564ac3-a777-43a1-972e-f4813656267d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:55.187666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-85564ac3-a777-43a1-972e-f4813656267d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:55.194010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85564ac3-a777-43a1-972e-f4813656267d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:55.194510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85564ac3-a777-43a1-972e-f4813656267d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:55.194964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85564ac3-a777-43a1-972e-f4813656267d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:55.195674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85564ac3-a777-43a1-972e-f4813656267d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:55.196141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85564ac3-a777-43a1-972e-f4813656267d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:55.196635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85564ac3-a777-43a1-972e-f4813656267d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:55.329655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-85564ac3-a777-43a1-972e-f4813656267d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:55.338006 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-85564ac3-a777-43a1-972e-f4813656267d tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1510 microversion: 2.1 time: 0.155331 Aug 27 05:27:55.338591 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3569/7091] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:55 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:27:56.359426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ebf1a364-5d34-489a-87ef-61e9cae18a7f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:56.360045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ebf1a364-5d34-489a-87ef-61e9cae18a7f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:56.369363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebf1a364-5d34-489a-87ef-61e9cae18a7f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:56.369855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebf1a364-5d34-489a-87ef-61e9cae18a7f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:56.370294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebf1a364-5d34-489a-87ef-61e9cae18a7f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:56.371002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebf1a364-5d34-489a-87ef-61e9cae18a7f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:56.371456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebf1a364-5d34-489a-87ef-61e9cae18a7f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:56.371905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebf1a364-5d34-489a-87ef-61e9cae18a7f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:56.511050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ebf1a364-5d34-489a-87ef-61e9cae18a7f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a375dc3c8a04f7087ba9c55e96eb621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438e558b80bd46a595a05b8eb7d1501d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:27:56.519137 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ebf1a364-5d34-489a-87ef-61e9cae18a7f tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 200 len: 1510 microversion: 2.1 time: 0.163617 Aug 27 05:27:56.519722 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3523/7092] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:56 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:27:57.007789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b789ca57-7b94-41a3-8929-5a19f62c9ee0 req-25c9b798-1690-4c86-90e2-b9ea0fc17cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5d8131-3721-40fa-bb18-22353580f20f", "name": "network-vif-deleted", "tag": "24f914a4-a9fa-4c43-93dc-5ed69c2ee926"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:27:57.019569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b789ca57-7b94-41a3-8929-5a19f62c9ee0 req-25c9b798-1690-4c86-90e2-b9ea0fc17cef service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:57.020828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b789ca57-7b94-41a3-8929-5a19f62c9ee0 req-25c9b798-1690-4c86-90e2-b9ea0fc17cef service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:57.022512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b789ca57-7b94-41a3-8929-5a19f62c9ee0 req-25c9b798-1690-4c86-90e2-b9ea0fc17cef service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:57.036241 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b789ca57-7b94-41a3-8929-5a19f62c9ee0 req-25c9b798-1690-4c86-90e2-b9ea0fc17cef service nova] Creating event network-vif-deleted:24f914a4-a9fa-4c43-93dc-5ed69c2ee926 for instance 7b5d8131-3721-40fa-bb18-22353580f20f on n-h2-854823-1 Aug 27 05:27:57.044009 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b789ca57-7b94-41a3-8929-5a19f62c9ee0 req-25c9b798-1690-4c86-90e2-b9ea0fc17cef service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040485 Aug 27 05:27:57.044402 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3570/7093] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:27:57.541786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68bf952d-061b-418e-ab7f-8e1de3a07833 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:57.542400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-68bf952d-061b-418e-ab7f-8e1de3a07833 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: 7b5d8131-3721-40fa-bb18-22353580f20f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:57.548436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68bf952d-061b-418e-ab7f-8e1de3a07833 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:57.548962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68bf952d-061b-418e-ab7f-8e1de3a07833 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:57.549398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68bf952d-061b-418e-ab7f-8e1de3a07833 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:57.550088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68bf952d-061b-418e-ab7f-8e1de3a07833 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:57.550546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68bf952d-061b-418e-ab7f-8e1de3a07833 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:57.550969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68bf952d-061b-418e-ab7f-8e1de3a07833 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:57.564720 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-68bf952d-061b-418e-ab7f-8e1de3a07833 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] HTTP exception thrown: Instance 7b5d8131-3721-40fa-bb18-22353580f20f could not be found. Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68bf952d-061b-418e-ab7f-8e1de3a07833 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Request method failure captured: Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f HTTP/1.1 Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCar7cWb_A8fdEEF2XnyCMfqIewfJxRlaWddiI9E_3D8fYdUKmctG3AhrlINdxCUtsGhFtOlvEbZWwNFv8LZYDgg5RmLR4nlsQy3SqS-qEjImATKfPUM-8UGWHITArAi5kowQ1Uyz6CTtwhGZrsis8OMUcGLN8t7I-fvJTZ6Y4P9NyaA Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 438e558b80bd46a595a05b8eb7d1501d Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2085243521 Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/438e558b80bd46a595a05b8eb7d1501d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_438e558b80bd46a595a05b8eb7d1501d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/438e558b80bd46a595a05b8eb7d1501d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/438e558b80bd46a595a05b8eb7d1501d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerDiskConfigTestJSON-2085243521 Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 438e558b80bd46a595a05b8eb7d1501d Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2085243521 Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerDiskConfigTestJSON-2085243521-project Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 9a375dc3c8a04f7087ba9c55e96eb621 Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerDiskConfigTestJSON-2085243521-project Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 7b5d8131-3721-40fa-bb18-22353580f20f could not be found. Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '7b5d8131-3721-40fa-bb18-22353580f20f'} Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b5d8131-3721-40fa-bb18-22353580f20f could not be found. Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b5d8131-3721-40fa-bb18-22353580f20f could not be found. Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:57.566339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:27:57.571614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:57.571614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:57.571614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:57.571614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:27:57.571614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:27:57.571614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b5d8131-3721-40fa-bb18-22353580f20f could not be found. Aug 27 05:27:57.571614 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:27:57.571614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68bf952d-061b-418e-ab7f-8e1de3a07833 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Returning 404 to user: Instance 7b5d8131-3721-40fa-bb18-22353580f20f could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:27:57.571614 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-68bf952d-061b-418e-ab7f-8e1de3a07833 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f" status: 404 len: 111 microversion: 2.1 time: 0.031336 Aug 27 05:27:57.571614 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3524/7094] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:57 2022] GET /compute/v2.1/servers/7b5d8131-3721-40fa-bb18-22353580f20f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:27:57.579243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-461ac1b0-f8a5-41d3-b9e1-3d1cb91c7604 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '.version_select at 0x7f1f21a623a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:57.603375 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-461ac1b0-f8a5-41d3-b9e1-3d1cb91c7604 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679953105" status: 202 len: 0 microversion: 2.1 time: 0.028223 Aug 27 05:27:57.603970 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3571/7095] 10.222.0.79 () {58 vars in 1221 bytes} [Sat Aug 27 05:27:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679953105 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:27:58.221338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-73994da1-6392-4440-8789-a44178ab65d0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:58.221844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-73994da1-6392-4440-8789-a44178ab65d0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:58.228934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73994da1-6392-4440-8789-a44178ab65d0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:58.229421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73994da1-6392-4440-8789-a44178ab65d0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:58.229859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73994da1-6392-4440-8789-a44178ab65d0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:58.230557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73994da1-6392-4440-8789-a44178ab65d0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:58.231013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73994da1-6392-4440-8789-a44178ab65d0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:58.231440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-73994da1-6392-4440-8789-a44178ab65d0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:58.244903 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-73994da1-6392-4440-8789-a44178ab65d0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] HTTP exception thrown: Instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de could not be found. Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-73994da1-6392-4440-8789-a44178ab65d0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Request method failure captured: Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de HTTP/1.1 Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCar7cWb_A8fdEEF2XnyCMfqIewfJxRlaWddiI9E_3D8fYdUKmctG3AhrlINdxCUtsGhFtOlvEbZWwNFv8LZYDgg5RmLR4nlsQy3SqS-qEjImATKfPUM-8UGWHITArAi5kowQ1Uyz6CTtwhGZrsis8OMUcGLN8t7I-fvJTZ6Y4P9NyaA Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 438e558b80bd46a595a05b8eb7d1501d Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2085243521 Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/438e558b80bd46a595a05b8eb7d1501d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_438e558b80bd46a595a05b8eb7d1501d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/438e558b80bd46a595a05b8eb7d1501d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/438e558b80bd46a595a05b8eb7d1501d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerDiskConfigTestJSON-2085243521 Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 438e558b80bd46a595a05b8eb7d1501d Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2085243521 Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerDiskConfigTestJSON-2085243521-project Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 9a375dc3c8a04f7087ba9c55e96eb621 Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerDiskConfigTestJSON-2085243521-project Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de could not be found. Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'aa5e6e98-efea-4fbe-b32f-bea91e1a65de'} Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de could not be found. Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:27:58.246435 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:27:58.250180 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de could not be found. Aug 27 05:27:58.250180 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.250180 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:58.250180 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.250180 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:58.250180 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:58.250180 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:58.250180 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:27:58.250180 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:27:58.250180 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de could not be found. Aug 27 05:27:58.250180 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.250180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-73994da1-6392-4440-8789-a44178ab65d0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Returning 404 to user: Instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:27:58.250180 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-73994da1-6392-4440-8789-a44178ab65d0 tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 404 len: 111 microversion: 2.1 time: 0.030452 Aug 27 05:27:58.250180 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3525/7096] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:27:58 2022] DELETE /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:27:58.257586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85b24784-bbc7-4be1-9614-90d0342a389c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:27:58.258345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-85b24784-bbc7-4be1-9614-90d0342a389c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] [instance: aa5e6e98-efea-4fbe-b32f-bea91e1a65de] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:27:58.265145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85b24784-bbc7-4be1-9614-90d0342a389c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:58.265655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85b24784-bbc7-4be1-9614-90d0342a389c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:58.266108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85b24784-bbc7-4be1-9614-90d0342a389c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:58.266819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85b24784-bbc7-4be1-9614-90d0342a389c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:27:58.267294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85b24784-bbc7-4be1-9614-90d0342a389c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:27:58.267739 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85b24784-bbc7-4be1-9614-90d0342a389c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:27:58.281989 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-85b24784-bbc7-4be1-9614-90d0342a389c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] HTTP exception thrown: Instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de could not be found. Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85b24784-bbc7-4be1-9614-90d0342a389c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Request method failure captured: Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de HTTP/1.1 Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCar7cWb_A8fdEEF2XnyCMfqIewfJxRlaWddiI9E_3D8fYdUKmctG3AhrlINdxCUtsGhFtOlvEbZWwNFv8LZYDgg5RmLR4nlsQy3SqS-qEjImATKfPUM-8UGWHITArAi5kowQ1Uyz6CTtwhGZrsis8OMUcGLN8t7I-fvJTZ6Y4P9NyaA Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 438e558b80bd46a595a05b8eb7d1501d Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2085243521 Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/438e558b80bd46a595a05b8eb7d1501d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_438e558b80bd46a595a05b8eb7d1501d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/438e558b80bd46a595a05b8eb7d1501d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/438e558b80bd46a595a05b8eb7d1501d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerDiskConfigTestJSON-2085243521 Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 438e558b80bd46a595a05b8eb7d1501d Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2085243521 Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerDiskConfigTestJSON-2085243521-project Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 9a375dc3c8a04f7087ba9c55e96eb621 Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerDiskConfigTestJSON-2085243521-project Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de could not be found. Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'aa5e6e98-efea-4fbe-b32f-bea91e1a65de'} Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de could not be found. Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de could not be found. Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:27:58.283674 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.288299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:27:58.288299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:27:58.288299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:27:58.288299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:27:58.288299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:27:58.288299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de could not be found. Aug 27 05:27:58.288299 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:27:58.288299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85b24784-bbc7-4be1-9614-90d0342a389c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] Returning 404 to user: Instance aa5e6e98-efea-4fbe-b32f-bea91e1a65de could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:27:58.288299 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-85b24784-bbc7-4be1-9614-90d0342a389c tempest-ServerDiskConfigTestJSON-2085243521 tempest-ServerDiskConfigTestJSON-2085243521-project] 10.222.0.79 "GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de" status: 404 len: 111 microversion: 2.1 time: 0.032549 Aug 27 05:27:58.288299 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3572/7097] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:27:58 2022] GET /compute/v2.1/servers/aa5e6e98-efea-4fbe-b32f-bea91e1a65de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:28:06.705978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eea119fc-a9bf-4360-b56c-d52356843289 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'create', calling method: .version_select at 0x7f1f21f7a4c0>, body: {"keypair": {"name": "tempest-keypair-2067790246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1K+bYqDnX1jgQIJ0Ck20pTsE3ABcECKPPZRvWSlUnIAm3kWa4uGVAQjLcR8dihGeVkxW2xONST/CTDVWXQxRIGViJD2iGwail8h6JHkhn3z6pp+7qWBtuK4bxcXvu3YA=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:06.712487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=36 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:06.725443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-eea119fc-a9bf-4360-b56c-d52356843289 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Getting quotas for project e2a7ba2c76574547b50a17bb289f2c8b. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:28:06.731291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-eea119fc-a9bf-4360-b56c-d52356843289 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Getting quotas for user cdebfdf54a7e4026bfa98c8c308a4456 and project e2a7ba2c76574547b50a17bb289f2c8b. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:28:06.756991 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eea119fc-a9bf-4360-b56c-d52356843289 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.191123 Aug 27 05:28:06.757596 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3526/7098] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:28:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:28:08.055152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1574408507", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d36ef21-7849-4c26-ad65-ccb331d9c655"}], "security_groups": [{"name": "tempest-securitygroup--772549537"}], "key_name": "tempest-keypair-2067790246", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:08.064008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:08.164826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] validate_networks() for [('3d36ef21-7849-4c26-ad65-ccb331d9c655', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:28:08.277114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:08.559980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:28:08.560613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:28:08.561116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:28:08.562606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:28:08.562606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:28:08.572222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:08.572758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:08.573207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:08.574019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:08.574491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:08.575052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:08.592508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Getting quotas for project e2a7ba2c76574547b50a17bb289f2c8b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:28:08.598903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Getting quotas for user cdebfdf54a7e4026bfa98c8c308a4456 and project e2a7ba2c76574547b50a17bb289f2c8b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:28:08.611046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:28:08.613399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:28:08.661664 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8ce73efb-85fa-40ac-8dea-a9860451a3e7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.611497 Aug 27 05:28:08.663172 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3573/7099] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:28:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:28:08.671567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:08.676268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-74ae7045-c65f-47ce-90b6-bbe7c62f8f75 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:08.676922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-74ae7045-c65f-47ce-90b6-bbe7c62f8f75 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:08.742393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-74ae7045-c65f-47ce-90b6-bbe7c62f8f75 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:08.749603 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-74ae7045-c65f-47ce-90b6-bbe7c62f8f75 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1239 microversion: 2.1 time: 0.079833 Aug 27 05:28:08.763267 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3527/7100] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:08 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:09.773239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-321d7fd4-d8fe-4488-b013-f5df6972823f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:09.774748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-321d7fd4-d8fe-4488-b013-f5df6972823f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:09.784017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321d7fd4-d8fe-4488-b013-f5df6972823f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:09.784555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321d7fd4-d8fe-4488-b013-f5df6972823f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:09.785098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321d7fd4-d8fe-4488-b013-f5df6972823f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:09.786352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321d7fd4-d8fe-4488-b013-f5df6972823f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:09.786872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321d7fd4-d8fe-4488-b013-f5df6972823f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:09.787837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321d7fd4-d8fe-4488-b013-f5df6972823f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:09.858225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-321d7fd4-d8fe-4488-b013-f5df6972823f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:09.867255 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-321d7fd4-d8fe-4488-b013-f5df6972823f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1291 microversion: 2.1 time: 0.099926 Aug 27 05:28:09.867955 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3574/7101] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:09 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1291 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:10.889943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-87b100e6-1564-4762-8fb1-1ac69d1237fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:10.890507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-87b100e6-1564-4762-8fb1-1ac69d1237fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:10.898086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87b100e6-1564-4762-8fb1-1ac69d1237fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:10.898578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87b100e6-1564-4762-8fb1-1ac69d1237fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:10.899206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87b100e6-1564-4762-8fb1-1ac69d1237fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:10.900163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87b100e6-1564-4762-8fb1-1ac69d1237fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:10.900650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87b100e6-1564-4762-8fb1-1ac69d1237fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:10.901082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-87b100e6-1564-4762-8fb1-1ac69d1237fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:11.089264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-87b100e6-1564-4762-8fb1-1ac69d1237fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:11.097950 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-87b100e6-1564-4762-8fb1-1ac69d1237fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1364 microversion: 2.1 time: 0.211954 Aug 27 05:28:11.098551 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3528/7102] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:10 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:11.317841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a6bf5a6a-04a9-4f06-8fb4-00d5729362ed req-4d0f1727-1c27-404e-bec0-a5bd83430eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8abccf90-b9e0-4ec9-a1bc-94a103f00664", "tag": "1f931702-5db1-440e-bb19-c0090b45b1cf"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:11.330433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a6bf5a6a-04a9-4f06-8fb4-00d5729362ed req-4d0f1727-1c27-404e-bec0-a5bd83430eff service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:11.330923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a6bf5a6a-04a9-4f06-8fb4-00d5729362ed req-4d0f1727-1c27-404e-bec0-a5bd83430eff service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:11.331373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a6bf5a6a-04a9-4f06-8fb4-00d5729362ed req-4d0f1727-1c27-404e-bec0-a5bd83430eff service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:11.345302 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a6bf5a6a-04a9-4f06-8fb4-00d5729362ed req-4d0f1727-1c27-404e-bec0-a5bd83430eff service nova] Creating event network-changed:1f931702-5db1-440e-bb19-c0090b45b1cf for instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 on n-h2-854823-1 Aug 27 05:28:11.350791 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a6bf5a6a-04a9-4f06-8fb4-00d5729362ed req-4d0f1727-1c27-404e-bec0-a5bd83430eff service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040675 Aug 27 05:28:11.351576 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3575/7103] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:28:12.119367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cfbd2563-e803-4c20-a5f3-6f1d09480e9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:12.119983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cfbd2563-e803-4c20-a5f3-6f1d09480e9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:12.126937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfbd2563-e803-4c20-a5f3-6f1d09480e9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:12.127448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfbd2563-e803-4c20-a5f3-6f1d09480e9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:12.127884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfbd2563-e803-4c20-a5f3-6f1d09480e9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:12.128588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfbd2563-e803-4c20-a5f3-6f1d09480e9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:12.129044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfbd2563-e803-4c20-a5f3-6f1d09480e9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:12.129469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfbd2563-e803-4c20-a5f3-6f1d09480e9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:12.523097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cfbd2563-e803-4c20-a5f3-6f1d09480e9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:12.532628 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cfbd2563-e803-4c20-a5f3-6f1d09480e9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1364 microversion: 2.1 time: 0.417091 Aug 27 05:28:12.533212 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3529/7104] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:12 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1364 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:13.555544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1c6095c1-ce8e-4af5-b6a7-256598992c8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:13.556286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1c6095c1-ce8e-4af5-b6a7-256598992c8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:13.562565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c6095c1-ce8e-4af5-b6a7-256598992c8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:13.563064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c6095c1-ce8e-4af5-b6a7-256598992c8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:13.563524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c6095c1-ce8e-4af5-b6a7-256598992c8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:13.564246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c6095c1-ce8e-4af5-b6a7-256598992c8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:13.564743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c6095c1-ce8e-4af5-b6a7-256598992c8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:13.565183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c6095c1-ce8e-4af5-b6a7-256598992c8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:13.695236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c6095c1-ce8e-4af5-b6a7-256598992c8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:13.703287 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1c6095c1-ce8e-4af5-b6a7-256598992c8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1364 microversion: 2.1 time: 0.153623 Aug 27 05:28:13.703881 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3576/7105] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:13 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:14.723356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-225e2941-c537-4184-b101-35fd372b8677 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:14.724043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-225e2941-c537-4184-b101-35fd372b8677 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:14.731312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-225e2941-c537-4184-b101-35fd372b8677 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:14.731808 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-225e2941-c537-4184-b101-35fd372b8677 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:14.732248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-225e2941-c537-4184-b101-35fd372b8677 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:14.732988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-225e2941-c537-4184-b101-35fd372b8677 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:14.733449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-225e2941-c537-4184-b101-35fd372b8677 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:14.733875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-225e2941-c537-4184-b101-35fd372b8677 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:14.871323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-225e2941-c537-4184-b101-35fd372b8677 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:14.878974 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-225e2941-c537-4184-b101-35fd372b8677 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1364 microversion: 2.1 time: 0.159506 Aug 27 05:28:14.879549 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3530/7106] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:14 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:15.899931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6277277-0647-49b4-afe9-343c8f74448d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:15.900589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e6277277-0647-49b4-afe9-343c8f74448d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:15.907509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6277277-0647-49b4-afe9-343c8f74448d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:15.908036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6277277-0647-49b4-afe9-343c8f74448d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:15.908495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6277277-0647-49b4-afe9-343c8f74448d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:15.909229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6277277-0647-49b4-afe9-343c8f74448d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:15.909707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6277277-0647-49b4-afe9-343c8f74448d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:15.910151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6277277-0647-49b4-afe9-343c8f74448d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:16.049067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e6277277-0647-49b4-afe9-343c8f74448d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:16.057492 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6277277-0647-49b4-afe9-343c8f74448d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1364 microversion: 2.1 time: 0.162380 Aug 27 05:28:16.058087 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3577/7107] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:15 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:16.328972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d851ebef-a2a6-419c-9f36-142c45e6cec6 req-16ea39bf-97d4-432a-85f4-96f858c4d303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8abccf90-b9e0-4ec9-a1bc-94a103f00664", "name": "network-vif-plugged", "status": "completed", "tag": "1f931702-5db1-440e-bb19-c0090b45b1cf"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:16.340666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d851ebef-a2a6-419c-9f36-142c45e6cec6 req-16ea39bf-97d4-432a-85f4-96f858c4d303 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:16.341337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d851ebef-a2a6-419c-9f36-142c45e6cec6 req-16ea39bf-97d4-432a-85f4-96f858c4d303 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:16.341784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d851ebef-a2a6-419c-9f36-142c45e6cec6 req-16ea39bf-97d4-432a-85f4-96f858c4d303 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:16.358578 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d851ebef-a2a6-419c-9f36-142c45e6cec6 req-16ea39bf-97d4-432a-85f4-96f858c4d303 service nova] Creating event network-vif-plugged:1f931702-5db1-440e-bb19-c0090b45b1cf for instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 on n-h2-854823-1 Aug 27 05:28:16.364457 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d851ebef-a2a6-419c-9f36-142c45e6cec6 req-16ea39bf-97d4-432a-85f4-96f858c4d303 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039248 Aug 27 05:28:16.365753 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3531/7108] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:28:17.077680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db901e5e-6a10-4be3-a4d4-448b10596c40 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:17.078305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db901e5e-6a10-4be3-a4d4-448b10596c40 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:17.085745 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db901e5e-6a10-4be3-a4d4-448b10596c40 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:17.086249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db901e5e-6a10-4be3-a4d4-448b10596c40 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:17.086706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db901e5e-6a10-4be3-a4d4-448b10596c40 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:17.087415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db901e5e-6a10-4be3-a4d4-448b10596c40 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:17.087886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db901e5e-6a10-4be3-a4d4-448b10596c40 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:17.088328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db901e5e-6a10-4be3-a4d4-448b10596c40 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:17.215540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db901e5e-6a10-4be3-a4d4-448b10596c40 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:17.223268 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db901e5e-6a10-4be3-a4d4-448b10596c40 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1364 microversion: 2.1 time: 0.149564 Aug 27 05:28:17.223853 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3578/7109] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:17 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:18.246400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-384c4149-2fc9-47cb-a0c7-059292a924d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:18.247108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-384c4149-2fc9-47cb-a0c7-059292a924d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:18.253552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-384c4149-2fc9-47cb-a0c7-059292a924d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:18.254043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-384c4149-2fc9-47cb-a0c7-059292a924d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:18.254485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-384c4149-2fc9-47cb-a0c7-059292a924d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:18.255284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-384c4149-2fc9-47cb-a0c7-059292a924d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:18.255747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-384c4149-2fc9-47cb-a0c7-059292a924d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:18.256184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-384c4149-2fc9-47cb-a0c7-059292a924d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:18.397455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-384c4149-2fc9-47cb-a0c7-059292a924d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:18.407769 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-384c4149-2fc9-47cb-a0c7-059292a924d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1551 microversion: 2.1 time: 0.167238 Aug 27 05:28:18.408347 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3532/7110] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:18 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1551 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:28:18.430206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c044765-6c3e-42b5-8dcf-0ad40823da65 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:18.430763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c044765-6c3e-42b5-8dcf-0ad40823da65 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:18.437685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c044765-6c3e-42b5-8dcf-0ad40823da65 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:18.438204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c044765-6c3e-42b5-8dcf-0ad40823da65 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:18.438653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c044765-6c3e-42b5-8dcf-0ad40823da65 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:18.439366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c044765-6c3e-42b5-8dcf-0ad40823da65 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:18.439839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c044765-6c3e-42b5-8dcf-0ad40823da65 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:18.440280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c044765-6c3e-42b5-8dcf-0ad40823da65 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:18.520469 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c044765-6c3e-42b5-8dcf-0ad40823da65 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094193 Aug 27 05:28:18.521286 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3579/7111] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 05:28:18 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:28:19.775665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-626fad9f-c860-49ca-bc81-90abd14cb75e req-b3161579-ffee-4bc2-bdfe-609233dc5fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8abccf90-b9e0-4ec9-a1bc-94a103f00664", "tag": "1f931702-5db1-440e-bb19-c0090b45b1cf"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:19.780514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:19.787076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-626fad9f-c860-49ca-bc81-90abd14cb75e req-b3161579-ffee-4bc2-bdfe-609233dc5fd5 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:19.787595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-626fad9f-c860-49ca-bc81-90abd14cb75e req-b3161579-ffee-4bc2-bdfe-609233dc5fd5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:19.788049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-626fad9f-c860-49ca-bc81-90abd14cb75e req-b3161579-ffee-4bc2-bdfe-609233dc5fd5 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:19.799934 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-626fad9f-c860-49ca-bc81-90abd14cb75e req-b3161579-ffee-4bc2-bdfe-609233dc5fd5 service nova] Creating event network-changed:1f931702-5db1-440e-bb19-c0090b45b1cf for instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 on n-h2-854823-1 Aug 27 05:28:19.806227 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-626fad9f-c860-49ca-bc81-90abd14cb75e req-b3161579-ffee-4bc2-bdfe-609233dc5fd5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033874 Aug 27 05:28:19.807058 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3533/7112] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:28:56.000987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:56.001777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:56.003506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:56.004165 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=32 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:56.009902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-022aef90-6f34-4621-99d3-7fad5db8d5b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:56.010565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-022aef90-6f34-4621-99d3-7fad5db8d5b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:56.020252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-022aef90-6f34-4621-99d3-7fad5db8d5b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:56.020789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-022aef90-6f34-4621-99d3-7fad5db8d5b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:56.021236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-022aef90-6f34-4621-99d3-7fad5db8d5b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:56.021955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-022aef90-6f34-4621-99d3-7fad5db8d5b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:56.022417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-022aef90-6f34-4621-99d3-7fad5db8d5b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:56.022852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-022aef90-6f34-4621-99d3-7fad5db8d5b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:56.227268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-022aef90-6f34-4621-99d3-7fad5db8d5b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:56.236721 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-022aef90-6f34-4621-99d3-7fad5db8d5b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1670 microversion: 2.1 time: 0.236525 Aug 27 05:28:56.237609 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3580/7113] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:55 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1670 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:56.256557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:56.257433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=28 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:28:56.258928 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 27 05:28:56.263102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-32ab2474-8536-4e23-9818-f902f911e10a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:56.263816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-32ab2474-8536-4e23-9818-f902f911e10a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:56.273168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32ab2474-8536-4e23-9818-f902f911e10a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:56.273665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32ab2474-8536-4e23-9818-f902f911e10a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:56.274111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32ab2474-8536-4e23-9818-f902f911e10a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:56.274813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32ab2474-8536-4e23-9818-f902f911e10a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:56.275546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32ab2474-8536-4e23-9818-f902f911e10a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:56.275973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32ab2474-8536-4e23-9818-f902f911e10a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:56.468821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-32ab2474-8536-4e23-9818-f902f911e10a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:56.476866 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-32ab2474-8536-4e23-9818-f902f911e10a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1670 microversion: 2.1 time: 0.222453 Aug 27 05:28:56.477459 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3534/7114] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:56 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1670 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:56.497451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-279ed7b9-c633-4be3-9993-31d5947601c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:56.498078 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-279ed7b9-c633-4be3-9993-31d5947601c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:56.504108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-279ed7b9-c633-4be3-9993-31d5947601c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:56.504726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-279ed7b9-c633-4be3-9993-31d5947601c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:56.505184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-279ed7b9-c633-4be3-9993-31d5947601c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:56.505893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-279ed7b9-c633-4be3-9993-31d5947601c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:56.506373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-279ed7b9-c633-4be3-9993-31d5947601c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:56.506872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-279ed7b9-c633-4be3-9993-31d5947601c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:56.636810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-279ed7b9-c633-4be3-9993-31d5947601c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:56.644716 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-279ed7b9-c633-4be3-9993-31d5947601c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1670 microversion: 2.1 time: 0.151160 Aug 27 05:28:56.645360 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3581/7115] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:56 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:56.665655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:28:56.668451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:56.674586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:56.675096 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:56.675531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:56.676214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:56.676704 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:56.677129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:56.707463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:56.713308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Old instance type m1.heat2, new instance type m1.heat {{(pid=128870) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:28:56.720151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:28:56.720642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:28:56.721114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:28:56.721521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:28:56.721931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:28:56.785640 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-030124a5-ed76-48b0-af4a-3db7d78ccdee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664/action" status: 202 len: 0 microversion: 2.1 time: 0.123771 Aug 27 05:28:56.786275 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3535/7116] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:28:56 2022] POST /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:28:56.795301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60b7228f-2c13-43ba-93c1-9af559fb8170 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:56.795954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60b7228f-2c13-43ba-93c1-9af559fb8170 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:56.802451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60b7228f-2c13-43ba-93c1-9af559fb8170 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:56.802953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60b7228f-2c13-43ba-93c1-9af559fb8170 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:56.803431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60b7228f-2c13-43ba-93c1-9af559fb8170 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:56.804141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60b7228f-2c13-43ba-93c1-9af559fb8170 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:56.804633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60b7228f-2c13-43ba-93c1-9af559fb8170 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:56.805067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60b7228f-2c13-43ba-93c1-9af559fb8170 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:56.944301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60b7228f-2c13-43ba-93c1-9af559fb8170 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:56.952840 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60b7228f-2c13-43ba-93c1-9af559fb8170 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1679 microversion: 2.1 time: 0.162174 Aug 27 05:28:56.953431 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3582/7117] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:56 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:57.975755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-064df726-9c66-40b2-8211-f313b6b4b2b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:57.976428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-064df726-9c66-40b2-8211-f313b6b4b2b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:57.983197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-064df726-9c66-40b2-8211-f313b6b4b2b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:57.983687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-064df726-9c66-40b2-8211-f313b6b4b2b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:57.984125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-064df726-9c66-40b2-8211-f313b6b4b2b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:57.984860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-064df726-9c66-40b2-8211-f313b6b4b2b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:57.985319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-064df726-9c66-40b2-8211-f313b6b4b2b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:57.985740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-064df726-9c66-40b2-8211-f313b6b4b2b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:58.195610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-064df726-9c66-40b2-8211-f313b6b4b2b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:58.203424 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-064df726-9c66-40b2-8211-f313b6b4b2b6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1679 microversion: 2.1 time: 0.232742 Aug 27 05:28:58.204095 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3536/7118] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:57 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:28:59.225312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f3fe017-d429-48a5-ae2a-ea62948413a1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:28:59.225932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f3fe017-d429-48a5-ae2a-ea62948413a1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:28:59.233390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f3fe017-d429-48a5-ae2a-ea62948413a1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:59.233887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f3fe017-d429-48a5-ae2a-ea62948413a1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:59.234335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f3fe017-d429-48a5-ae2a-ea62948413a1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:59.235036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f3fe017-d429-48a5-ae2a-ea62948413a1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:28:59.235503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f3fe017-d429-48a5-ae2a-ea62948413a1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:28:59.235982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f3fe017-d429-48a5-ae2a-ea62948413a1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:28:59.368614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f3fe017-d429-48a5-ae2a-ea62948413a1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:28:59.376961 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f3fe017-d429-48a5-ae2a-ea62948413a1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1684 microversion: 2.1 time: 0.155579 Aug 27 05:28:59.377540 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3583/7119] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:28:59 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:00.398292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-974e08a2-80f6-4b06-ba1c-3d33dda839b7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:00.398922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-974e08a2-80f6-4b06-ba1c-3d33dda839b7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:00.406111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-974e08a2-80f6-4b06-ba1c-3d33dda839b7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:00.406592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-974e08a2-80f6-4b06-ba1c-3d33dda839b7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:00.407027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-974e08a2-80f6-4b06-ba1c-3d33dda839b7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:00.407714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-974e08a2-80f6-4b06-ba1c-3d33dda839b7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:00.408170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-974e08a2-80f6-4b06-ba1c-3d33dda839b7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:00.408626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-974e08a2-80f6-4b06-ba1c-3d33dda839b7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:00.537204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-974e08a2-80f6-4b06-ba1c-3d33dda839b7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:00.544893 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-974e08a2-80f6-4b06-ba1c-3d33dda839b7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1684 microversion: 2.1 time: 0.150592 Aug 27 05:29:00.545467 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3537/7120] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:00 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:01.566925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20df414c-b987-4135-9518-d6f9c5ab1ac0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:01.567554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20df414c-b987-4135-9518-d6f9c5ab1ac0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:01.575010 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20df414c-b987-4135-9518-d6f9c5ab1ac0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:01.575511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20df414c-b987-4135-9518-d6f9c5ab1ac0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:01.575966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20df414c-b987-4135-9518-d6f9c5ab1ac0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:01.576798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20df414c-b987-4135-9518-d6f9c5ab1ac0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:01.577299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20df414c-b987-4135-9518-d6f9c5ab1ac0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:01.577746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20df414c-b987-4135-9518-d6f9c5ab1ac0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:01.710231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-20df414c-b987-4135-9518-d6f9c5ab1ac0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:01.718806 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20df414c-b987-4135-9518-d6f9c5ab1ac0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1684 microversion: 2.1 time: 0.155946 Aug 27 05:29:01.719402 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3584/7121] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:01 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:02.741493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-50a543bc-292f-4df9-9f1a-555722743b51 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:02.742028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-50a543bc-292f-4df9-9f1a-555722743b51 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:02.748943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50a543bc-292f-4df9-9f1a-555722743b51 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:02.749599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50a543bc-292f-4df9-9f1a-555722743b51 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:02.750236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50a543bc-292f-4df9-9f1a-555722743b51 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:02.751113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50a543bc-292f-4df9-9f1a-555722743b51 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:02.751580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50a543bc-292f-4df9-9f1a-555722743b51 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:02.752015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50a543bc-292f-4df9-9f1a-555722743b51 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:02.884769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-50a543bc-292f-4df9-9f1a-555722743b51 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:02.892938 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-50a543bc-292f-4df9-9f1a-555722743b51 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1684 microversion: 2.1 time: 0.155652 Aug 27 05:29:02.893516 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3538/7122] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:02 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:03.914898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c6609c87-c4b9-4236-b638-9faa491724f0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:03.915606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c6609c87-c4b9-4236-b638-9faa491724f0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:03.923600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6609c87-c4b9-4236-b638-9faa491724f0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:03.924130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6609c87-c4b9-4236-b638-9faa491724f0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:03.924608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6609c87-c4b9-4236-b638-9faa491724f0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:03.925317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6609c87-c4b9-4236-b638-9faa491724f0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:03.925787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6609c87-c4b9-4236-b638-9faa491724f0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:03.926233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6609c87-c4b9-4236-b638-9faa491724f0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:04.057665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c6609c87-c4b9-4236-b638-9faa491724f0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:04.065494 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c6609c87-c4b9-4236-b638-9faa491724f0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1684 microversion: 2.1 time: 0.154529 Aug 27 05:29:04.066086 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3585/7123] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:03 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:05.086698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ed7be37a-305f-48c6-8d6b-f377220d1e9d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:05.087271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ed7be37a-305f-48c6-8d6b-f377220d1e9d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:05.094176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed7be37a-305f-48c6-8d6b-f377220d1e9d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:05.094670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed7be37a-305f-48c6-8d6b-f377220d1e9d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:05.095117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed7be37a-305f-48c6-8d6b-f377220d1e9d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:05.095813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed7be37a-305f-48c6-8d6b-f377220d1e9d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:05.096284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed7be37a-305f-48c6-8d6b-f377220d1e9d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:05.096754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed7be37a-305f-48c6-8d6b-f377220d1e9d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:05.231121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed7be37a-305f-48c6-8d6b-f377220d1e9d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:05.238911 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ed7be37a-305f-48c6-8d6b-f377220d1e9d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1684 microversion: 2.1 time: 0.156223 Aug 27 05:29:05.239493 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3539/7124] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:05 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:06.260791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ff5d0fe-f2f6-4497-82fc-c6d320d18d73 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:06.262111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ff5d0fe-f2f6-4497-82fc-c6d320d18d73 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:06.269194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ff5d0fe-f2f6-4497-82fc-c6d320d18d73 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:06.269699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ff5d0fe-f2f6-4497-82fc-c6d320d18d73 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:06.270157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ff5d0fe-f2f6-4497-82fc-c6d320d18d73 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:06.270877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ff5d0fe-f2f6-4497-82fc-c6d320d18d73 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:06.271357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ff5d0fe-f2f6-4497-82fc-c6d320d18d73 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:06.271799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ff5d0fe-f2f6-4497-82fc-c6d320d18d73 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:06.406310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4ff5d0fe-f2f6-4497-82fc-c6d320d18d73 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:06.415268 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ff5d0fe-f2f6-4497-82fc-c6d320d18d73 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1684 microversion: 2.1 time: 0.157733 Aug 27 05:29:06.415869 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3586/7125] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:06 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:29:07.438057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-71b5cdf3-a5c1-43c3-898d-fd91a7df485a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:07.438705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-71b5cdf3-a5c1-43c3-898d-fd91a7df485a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:07.445843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71b5cdf3-a5c1-43c3-898d-fd91a7df485a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:07.446326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71b5cdf3-a5c1-43c3-898d-fd91a7df485a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:07.446761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71b5cdf3-a5c1-43c3-898d-fd91a7df485a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:07.447446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71b5cdf3-a5c1-43c3-898d-fd91a7df485a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:07.447899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71b5cdf3-a5c1-43c3-898d-fd91a7df485a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:07.448321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71b5cdf3-a5c1-43c3-898d-fd91a7df485a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:07.582169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-71b5cdf3-a5c1-43c3-898d-fd91a7df485a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:07.589871 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-71b5cdf3-a5c1-43c3-898d-fd91a7df485a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1684 microversion: 2.1 time: 0.156614 Aug 27 05:29:07.590441 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3540/7126] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:07 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:08.611571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1450175a-eb70-4ec3-9b91-31d298885814 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:08.612118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1450175a-eb70-4ec3-9b91-31d298885814 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:08.619116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1450175a-eb70-4ec3-9b91-31d298885814 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:08.619621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1450175a-eb70-4ec3-9b91-31d298885814 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:08.620069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1450175a-eb70-4ec3-9b91-31d298885814 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:08.620810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1450175a-eb70-4ec3-9b91-31d298885814 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:08.621285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1450175a-eb70-4ec3-9b91-31d298885814 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:08.621720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1450175a-eb70-4ec3-9b91-31d298885814 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:08.750751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1450175a-eb70-4ec3-9b91-31d298885814 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:08.758536 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1450175a-eb70-4ec3-9b91-31d298885814 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1684 microversion: 2.1 time: 0.151030 Aug 27 05:29:08.759121 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3587/7127] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:08 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:09.780452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-03f4b192-25a6-4181-8b51-785013c40512 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:09.781093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-03f4b192-25a6-4181-8b51-785013c40512 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:09.787927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03f4b192-25a6-4181-8b51-785013c40512 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:09.788418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03f4b192-25a6-4181-8b51-785013c40512 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:09.788876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03f4b192-25a6-4181-8b51-785013c40512 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:09.789572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03f4b192-25a6-4181-8b51-785013c40512 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:09.790028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03f4b192-25a6-4181-8b51-785013c40512 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:09.790450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-03f4b192-25a6-4181-8b51-785013c40512 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:09.922321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-03f4b192-25a6-4181-8b51-785013c40512 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:09.929993 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-03f4b192-25a6-4181-8b51-785013c40512 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1684 microversion: 2.1 time: 0.154401 Aug 27 05:29:09.930572 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3541/7128] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:09 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:10.951544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-afd89417-f3c6-4b46-87e2-b85fd83f233e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:10.952280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-afd89417-f3c6-4b46-87e2-b85fd83f233e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:10.959813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afd89417-f3c6-4b46-87e2-b85fd83f233e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:10.960309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afd89417-f3c6-4b46-87e2-b85fd83f233e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:10.960787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afd89417-f3c6-4b46-87e2-b85fd83f233e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:10.961500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afd89417-f3c6-4b46-87e2-b85fd83f233e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:10.961965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afd89417-f3c6-4b46-87e2-b85fd83f233e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:10.962406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afd89417-f3c6-4b46-87e2-b85fd83f233e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:11.094764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-afd89417-f3c6-4b46-87e2-b85fd83f233e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:11.102702 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-afd89417-f3c6-4b46-87e2-b85fd83f233e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1683 microversion: 2.1 time: 0.155174 Aug 27 05:29:11.103291 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3588/7129] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:10 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:11.358002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1fa3876b-906a-40ac-be51-a213a8068c0d req-c2ecb131-0fbb-4fd2-be23-e2f46ee0447d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8abccf90-b9e0-4ec9-a1bc-94a103f00664", "name": "network-vif-unplugged", "status": "completed", "tag": "1f931702-5db1-440e-bb19-c0090b45b1cf"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:11.368766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1fa3876b-906a-40ac-be51-a213a8068c0d req-c2ecb131-0fbb-4fd2-be23-e2f46ee0447d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:11.369240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1fa3876b-906a-40ac-be51-a213a8068c0d req-c2ecb131-0fbb-4fd2-be23-e2f46ee0447d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:11.369665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1fa3876b-906a-40ac-be51-a213a8068c0d req-c2ecb131-0fbb-4fd2-be23-e2f46ee0447d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:11.382588 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1fa3876b-906a-40ac-be51-a213a8068c0d req-c2ecb131-0fbb-4fd2-be23-e2f46ee0447d service nova] Creating event network-vif-unplugged:1f931702-5db1-440e-bb19-c0090b45b1cf for instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 on n-h1-854823-1 Aug 27 05:29:11.388369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-1fa3876b-906a-40ac-be51-a213a8068c0d req-c2ecb131-0fbb-4fd2-be23-e2f46ee0447d service nova] Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:29:11.399098 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1fa3876b-906a-40ac-be51-a213a8068c0d req-c2ecb131-0fbb-4fd2-be23-e2f46ee0447d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044961 Aug 27 05:29:11.399709 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3542/7130] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:29:12.124143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-141ffe04-b7d0-4fa8-b720-4c3d3d9beb99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:12.124962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-141ffe04-b7d0-4fa8-b720-4c3d3d9beb99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:12.132545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-141ffe04-b7d0-4fa8-b720-4c3d3d9beb99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:12.133068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-141ffe04-b7d0-4fa8-b720-4c3d3d9beb99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:12.133523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-141ffe04-b7d0-4fa8-b720-4c3d3d9beb99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:12.134257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-141ffe04-b7d0-4fa8-b720-4c3d3d9beb99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:12.134734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-141ffe04-b7d0-4fa8-b720-4c3d3d9beb99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:12.135200 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-141ffe04-b7d0-4fa8-b720-4c3d3d9beb99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:12.279114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-141ffe04-b7d0-4fa8-b720-4c3d3d9beb99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:12.288151 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-141ffe04-b7d0-4fa8-b720-4c3d3d9beb99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1683 microversion: 2.1 time: 0.168534 Aug 27 05:29:12.288785 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3589/7131] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:12 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:13.311672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4b3407c0-cdf5-4d0d-8e0c-03269487476a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:13.312385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4b3407c0-cdf5-4d0d-8e0c-03269487476a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:13.318697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b3407c0-cdf5-4d0d-8e0c-03269487476a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:13.319175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b3407c0-cdf5-4d0d-8e0c-03269487476a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:13.319607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b3407c0-cdf5-4d0d-8e0c-03269487476a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:13.320303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b3407c0-cdf5-4d0d-8e0c-03269487476a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:13.320769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b3407c0-cdf5-4d0d-8e0c-03269487476a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:13.321192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b3407c0-cdf5-4d0d-8e0c-03269487476a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:13.430833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7d580799-3edc-4963-bfbf-69d676c4abe0 req-50d21d1a-4868-447c-8c3f-5cdb3e035d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8abccf90-b9e0-4ec9-a1bc-94a103f00664", "tag": "1f931702-5db1-440e-bb19-c0090b45b1cf"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:13.441773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7d580799-3edc-4963-bfbf-69d676c4abe0 req-50d21d1a-4868-447c-8c3f-5cdb3e035d97 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:13.442389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7d580799-3edc-4963-bfbf-69d676c4abe0 req-50d21d1a-4868-447c-8c3f-5cdb3e035d97 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:13.442839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7d580799-3edc-4963-bfbf-69d676c4abe0 req-50d21d1a-4868-447c-8c3f-5cdb3e035d97 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:13.455152 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7d580799-3edc-4963-bfbf-69d676c4abe0 req-50d21d1a-4868-447c-8c3f-5cdb3e035d97 service nova] Creating event network-changed:1f931702-5db1-440e-bb19-c0090b45b1cf for instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 on n-h1-854823-1 Aug 27 05:29:13.458476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4b3407c0-cdf5-4d0d-8e0c-03269487476a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:13.461357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-7d580799-3edc-4963-bfbf-69d676c4abe0 req-50d21d1a-4868-447c-8c3f-5cdb3e035d97 service nova] Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:29:13.466790 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4b3407c0-cdf5-4d0d-8e0c-03269487476a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1681 microversion: 2.1 time: 0.159648 Aug 27 05:29:13.467661 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3543/7132] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:13 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:13.473464 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7d580799-3edc-4963-bfbf-69d676c4abe0 req-50d21d1a-4868-447c-8c3f-5cdb3e035d97 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046288 Aug 27 05:29:13.474072 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3590/7133] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:29:14.488930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e08d66a1-e661-4889-8186-418d37d7d417 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:14.489368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e08d66a1-e661-4889-8186-418d37d7d417 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:14.495853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e08d66a1-e661-4889-8186-418d37d7d417 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:14.496353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e08d66a1-e661-4889-8186-418d37d7d417 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:14.496821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e08d66a1-e661-4889-8186-418d37d7d417 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:14.497522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e08d66a1-e661-4889-8186-418d37d7d417 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:14.497984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e08d66a1-e661-4889-8186-418d37d7d417 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:14.498419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e08d66a1-e661-4889-8186-418d37d7d417 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:14.633759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e08d66a1-e661-4889-8186-418d37d7d417 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:14.641387 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e08d66a1-e661-4889-8186-418d37d7d417 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1681 microversion: 2.1 time: 0.156664 Aug 27 05:29:14.641958 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3544/7134] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:14 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:15.664938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a9552c2-f7e9-4eca-ba0c-a4f08b8a1dd0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:15.665716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a9552c2-f7e9-4eca-ba0c-a4f08b8a1dd0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:15.672715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a9552c2-f7e9-4eca-ba0c-a4f08b8a1dd0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:15.673393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a9552c2-f7e9-4eca-ba0c-a4f08b8a1dd0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:15.673847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a9552c2-f7e9-4eca-ba0c-a4f08b8a1dd0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:15.674582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a9552c2-f7e9-4eca-ba0c-a4f08b8a1dd0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:15.675051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a9552c2-f7e9-4eca-ba0c-a4f08b8a1dd0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:15.675495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a9552c2-f7e9-4eca-ba0c-a4f08b8a1dd0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:15.807066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a9552c2-f7e9-4eca-ba0c-a4f08b8a1dd0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:15.815484 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a9552c2-f7e9-4eca-ba0c-a4f08b8a1dd0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1678 microversion: 2.1 time: 0.156170 Aug 27 05:29:15.816057 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3591/7135] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:15 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:15.835930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cdfa201e-bd4f-4f2e-820e-53b2b6a860f5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:15.836476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cdfa201e-bd4f-4f2e-820e-53b2b6a860f5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:15.843361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdfa201e-bd4f-4f2e-820e-53b2b6a860f5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:15.843849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdfa201e-bd4f-4f2e-820e-53b2b6a860f5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:15.844294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdfa201e-bd4f-4f2e-820e-53b2b6a860f5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:15.845017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdfa201e-bd4f-4f2e-820e-53b2b6a860f5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:15.845482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdfa201e-bd4f-4f2e-820e-53b2b6a860f5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:15.845916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cdfa201e-bd4f-4f2e-820e-53b2b6a860f5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:15.904429 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cdfa201e-bd4f-4f2e-820e-53b2b6a860f5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664/action" status: 204 len: 0 microversion: 2.1 time: 0.072437 Aug 27 05:29:15.905099 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3545/7136] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:29:15 2022] POST /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:29:15.913787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d072514e-c67f-44cc-8ca6-0f4c958d9fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:15.914416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d072514e-c67f-44cc-8ca6-0f4c958d9fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:15.921373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d072514e-c67f-44cc-8ca6-0f4c958d9fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:15.921886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d072514e-c67f-44cc-8ca6-0f4c958d9fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:15.922336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d072514e-c67f-44cc-8ca6-0f4c958d9fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:15.923049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d072514e-c67f-44cc-8ca6-0f4c958d9fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:15.923521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d072514e-c67f-44cc-8ca6-0f4c958d9fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:15.924013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d072514e-c67f-44cc-8ca6-0f4c958d9fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:16.067786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d072514e-c67f-44cc-8ca6-0f4c958d9fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:16.076392 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d072514e-c67f-44cc-8ca6-0f4c958d9fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1678 microversion: 2.1 time: 0.166549 Aug 27 05:29:16.077043 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3592/7137] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:15 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:29:17.103886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4d89cd7-e16b-46b5-9a3d-fc02b1dfb0bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:17.105129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f4d89cd7-e16b-46b5-9a3d-fc02b1dfb0bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:17.115437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4d89cd7-e16b-46b5-9a3d-fc02b1dfb0bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:17.116144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4d89cd7-e16b-46b5-9a3d-fc02b1dfb0bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:17.116832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4d89cd7-e16b-46b5-9a3d-fc02b1dfb0bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:17.117782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4d89cd7-e16b-46b5-9a3d-fc02b1dfb0bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:17.118398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4d89cd7-e16b-46b5-9a3d-fc02b1dfb0bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:17.118999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4d89cd7-e16b-46b5-9a3d-fc02b1dfb0bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:17.259392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f4d89cd7-e16b-46b5-9a3d-fc02b1dfb0bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:17.267879 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f4d89cd7-e16b-46b5-9a3d-fc02b1dfb0bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1678 microversion: 2.1 time: 0.173315 Aug 27 05:29:17.268458 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3546/7138] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:17 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:18.214079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-62e413b5-ab8d-4cc3-8585-13629c74ad06 req-e9c6d934-e13a-4180-b93f-671413c4dd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8abccf90-b9e0-4ec9-a1bc-94a103f00664", "name": "network-vif-plugged", "status": "completed", "tag": "1f931702-5db1-440e-bb19-c0090b45b1cf"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:18.224233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-62e413b5-ab8d-4cc3-8585-13629c74ad06 req-e9c6d934-e13a-4180-b93f-671413c4dd93 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.224768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-62e413b5-ab8d-4cc3-8585-13629c74ad06 req-e9c6d934-e13a-4180-b93f-671413c4dd93 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.225224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-62e413b5-ab8d-4cc3-8585-13629c74ad06 req-e9c6d934-e13a-4180-b93f-671413c4dd93 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:18.236854 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-62e413b5-ab8d-4cc3-8585-13629c74ad06 req-e9c6d934-e13a-4180-b93f-671413c4dd93 service nova] Creating event network-vif-plugged:1f931702-5db1-440e-bb19-c0090b45b1cf for instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 on n-h1-854823-1 Aug 27 05:29:18.241871 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-62e413b5-ab8d-4cc3-8585-13629c74ad06 req-e9c6d934-e13a-4180-b93f-671413c4dd93 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103090 Aug 27 05:29:18.242539 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3593/7139] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:29:18.289819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b5dde4f9-f5d8-42c9-ac45-39725b543e2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:18.290464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b5dde4f9-f5d8-42c9-ac45-39725b543e2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:18.297541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5dde4f9-f5d8-42c9-ac45-39725b543e2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.298027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5dde4f9-f5d8-42c9-ac45-39725b543e2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.298465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5dde4f9-f5d8-42c9-ac45-39725b543e2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:18.299158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5dde4f9-f5d8-42c9-ac45-39725b543e2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.299612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5dde4f9-f5d8-42c9-ac45-39725b543e2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.300034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5dde4f9-f5d8-42c9-ac45-39725b543e2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:18.431937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b5dde4f9-f5d8-42c9-ac45-39725b543e2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:18.440232 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b5dde4f9-f5d8-42c9-ac45-39725b543e2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1670 microversion: 2.1 time: 0.154331 Aug 27 05:29:18.440837 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3547/7140] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:18 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:18.461724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee4fca0f-762f-4670-9cbb-dde13dfab6ee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:18.462434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee4fca0f-762f-4670-9cbb-dde13dfab6ee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:18.468644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee4fca0f-762f-4670-9cbb-dde13dfab6ee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.469140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee4fca0f-762f-4670-9cbb-dde13dfab6ee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.469586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee4fca0f-762f-4670-9cbb-dde13dfab6ee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:18.470281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee4fca0f-762f-4670-9cbb-dde13dfab6ee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.470751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee4fca0f-762f-4670-9cbb-dde13dfab6ee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.471186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee4fca0f-762f-4670-9cbb-dde13dfab6ee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:18.602788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee4fca0f-762f-4670-9cbb-dde13dfab6ee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:18.611542 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee4fca0f-762f-4670-9cbb-dde13dfab6ee tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1670 microversion: 2.1 time: 0.154061 Aug 27 05:29:18.612128 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3594/7141] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:18 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:29:18.632205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-864f488b-c98e-4be2-85b9-5992c283f4e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:18.632852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-864f488b-c98e-4be2-85b9-5992c283f4e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:18.638882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-864f488b-c98e-4be2-85b9-5992c283f4e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.639375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-864f488b-c98e-4be2-85b9-5992c283f4e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.639810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-864f488b-c98e-4be2-85b9-5992c283f4e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:18.640499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-864f488b-c98e-4be2-85b9-5992c283f4e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.640983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-864f488b-c98e-4be2-85b9-5992c283f4e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.641407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-864f488b-c98e-4be2-85b9-5992c283f4e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:18.659224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:18.778474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-864f488b-c98e-4be2-85b9-5992c283f4e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:18.786169 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-864f488b-c98e-4be2-85b9-5992c283f4e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1670 microversion: 2.1 time: 0.158115 Aug 27 05:29:18.786789 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3548/7142] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:18 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:18.806616 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-277ef628-7181-45ce-a43a-31602cee88ad tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:18.807065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-277ef628-7181-45ce-a43a-31602cee88ad tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:18.813770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277ef628-7181-45ce-a43a-31602cee88ad tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.814273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277ef628-7181-45ce-a43a-31602cee88ad tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.814724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277ef628-7181-45ce-a43a-31602cee88ad tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:18.815429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277ef628-7181-45ce-a43a-31602cee88ad tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.815903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277ef628-7181-45ce-a43a-31602cee88ad tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.816346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277ef628-7181-45ce-a43a-31602cee88ad tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:18.842525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-277ef628-7181-45ce-a43a-31602cee88ad tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:29:18.893491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:18.922894 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-277ef628-7181-45ce-a43a-31602cee88ad tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 204 len: 0 microversion: 2.1 time: 0.119924 Aug 27 05:29:18.923577 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3595/7143] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:29:18 2022] DELETE /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:29:18.931927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a4b6e6cb-42ba-4f79-b267-01c3730ef17f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:18.932570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a4b6e6cb-42ba-4f79-b267-01c3730ef17f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:18.939045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4b6e6cb-42ba-4f79-b267-01c3730ef17f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.939541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4b6e6cb-42ba-4f79-b267-01c3730ef17f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.939983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4b6e6cb-42ba-4f79-b267-01c3730ef17f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:18.940720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4b6e6cb-42ba-4f79-b267-01c3730ef17f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:18.941250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4b6e6cb-42ba-4f79-b267-01c3730ef17f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:18.941694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a4b6e6cb-42ba-4f79-b267-01c3730ef17f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:19.069892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a4b6e6cb-42ba-4f79-b267-01c3730ef17f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:19.078199 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a4b6e6cb-42ba-4f79-b267-01c3730ef17f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1676 microversion: 2.1 time: 0.150135 Aug 27 05:29:19.078769 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3549/7144] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:18 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:29:20.099847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af38ad2a-e637-47b1-a191-3b6a5461f8b4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:20.100589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af38ad2a-e637-47b1-a191-3b6a5461f8b4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:20.107419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af38ad2a-e637-47b1-a191-3b6a5461f8b4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:20.107914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af38ad2a-e637-47b1-a191-3b6a5461f8b4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:20.108372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af38ad2a-e637-47b1-a191-3b6a5461f8b4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:20.109109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af38ad2a-e637-47b1-a191-3b6a5461f8b4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:20.109600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af38ad2a-e637-47b1-a191-3b6a5461f8b4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:20.110036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af38ad2a-e637-47b1-a191-3b6a5461f8b4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:20.251612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af38ad2a-e637-47b1-a191-3b6a5461f8b4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:20.259302 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af38ad2a-e637-47b1-a191-3b6a5461f8b4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1676 microversion: 2.1 time: 0.163761 Aug 27 05:29:20.259874 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3596/7145] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:20 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:21.255343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-82b0e05a-115e-473a-96b7-8b70fd426457 req-62f1beae-24c5-48af-9953-a13ca0ee6088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8abccf90-b9e0-4ec9-a1bc-94a103f00664", "name": "network-vif-deleted", "tag": "1f931702-5db1-440e-bb19-c0090b45b1cf"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:21.265864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-82b0e05a-115e-473a-96b7-8b70fd426457 req-62f1beae-24c5-48af-9953-a13ca0ee6088 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:21.266323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-82b0e05a-115e-473a-96b7-8b70fd426457 req-62f1beae-24c5-48af-9953-a13ca0ee6088 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:21.266756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-82b0e05a-115e-473a-96b7-8b70fd426457 req-62f1beae-24c5-48af-9953-a13ca0ee6088 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:21.279772 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-82b0e05a-115e-473a-96b7-8b70fd426457 req-62f1beae-24c5-48af-9953-a13ca0ee6088 service nova] Creating event network-vif-deleted:1f931702-5db1-440e-bb19-c0090b45b1cf for instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 on n-h1-854823-1 Aug 27 05:29:21.285033 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-82b0e05a-115e-473a-96b7-8b70fd426457 req-62f1beae-24c5-48af-9953-a13ca0ee6088 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033399 Aug 27 05:29:21.285878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68508a22-f728-4b18-b27d-c186e232687b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:21.286423 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3550/7146] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:21.286559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68508a22-f728-4b18-b27d-c186e232687b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:21.297300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68508a22-f728-4b18-b27d-c186e232687b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:21.297822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68508a22-f728-4b18-b27d-c186e232687b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:21.298276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68508a22-f728-4b18-b27d-c186e232687b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:21.299583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68508a22-f728-4b18-b27d-c186e232687b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:21.300420 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68508a22-f728-4b18-b27d-c186e232687b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:21.301046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68508a22-f728-4b18-b27d-c186e232687b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:21.374947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-68508a22-f728-4b18-b27d-c186e232687b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:21.385110 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68508a22-f728-4b18-b27d-c186e232687b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 200 len: 1324 microversion: 2.1 time: 0.107765 Aug 27 05:29:21.386036 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3597/7147] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:21 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 1324 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:22.408056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-47c10e05-061e-438c-aef8-9939ab22c33a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:22.408790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-47c10e05-061e-438c-aef8-9939ab22c33a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:22.415006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47c10e05-061e-438c-aef8-9939ab22c33a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:22.415496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47c10e05-061e-438c-aef8-9939ab22c33a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:22.415999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47c10e05-061e-438c-aef8-9939ab22c33a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:22.416735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47c10e05-061e-438c-aef8-9939ab22c33a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:22.417198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47c10e05-061e-438c-aef8-9939ab22c33a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:22.417630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47c10e05-061e-438c-aef8-9939ab22c33a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:22.432844 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-47c10e05-061e-438c-aef8-9939ab22c33a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-47c10e05-061e-438c-aef8-9939ab22c33a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 HTTP/1.1 Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '8abccf90-b9e0-4ec9-a1bc-94a103f00664'} Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:22.435136 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:29:22.443378 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:22.443378 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:22.443378 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:22.443378 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:29:22.443378 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:29:22.443378 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:29:22.443378 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:29:22.443378 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-47c10e05-061e-438c-aef8-9939ab22c33a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:29:22.443378 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-47c10e05-061e-438c-aef8-9939ab22c33a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 404 len: 111 microversion: 2.1 time: 0.033705 Aug 27 05:29:22.443378 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3551/7148] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:22 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:29:22.451580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65f31220-d21f-4fa9-95f4-7e45cc39189e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:22.452216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65f31220-d21f-4fa9-95f4-7e45cc39189e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:22.459239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f31220-d21f-4fa9-95f4-7e45cc39189e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:22.459761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f31220-d21f-4fa9-95f4-7e45cc39189e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:22.460193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f31220-d21f-4fa9-95f4-7e45cc39189e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:22.460977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f31220-d21f-4fa9-95f4-7e45cc39189e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:22.461452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f31220-d21f-4fa9-95f4-7e45cc39189e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:22.461892 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f31220-d21f-4fa9-95f4-7e45cc39189e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:22.476017 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-65f31220-d21f-4fa9-95f4-7e45cc39189e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65f31220-d21f-4fa9-95f4-7e45cc39189e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 HTTP/1.1 Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '8abccf90-b9e0-4ec9-a1bc-94a103f00664'} Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:29:22.477672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:29:22.481976 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:29:22.481976 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:29:22.481976 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:29:22.481976 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:29:22.481976 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:29:22.481976 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:29:22.481976 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:29:22.481976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65f31220-d21f-4fa9-95f4-7e45cc39189e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:29:22.481976 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65f31220-d21f-4fa9-95f4-7e45cc39189e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 404 len: 111 microversion: 2.1 time: 0.031493 Aug 27 05:29:22.481976 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3598/7149] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:22 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:29:22.528234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1992059273", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "3d36ef21-7849-4c26-ad65-ccb331d9c655"}], "security_groups": [{"name": "tempest-securitygroup--772549537"}], "key_name": "tempest-keypair-2067790246", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:22.647647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] validate_networks() for [('3d36ef21-7849-4c26-ad65-ccb331d9c655', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:29:23.014776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:29:23.015207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:29:23.015717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:29:23.016121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:29:23.016547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:29:23.026170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:23.026646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:23.027078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:23.027801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:23.028774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:23.029195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:23.047678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Getting quotas for project e2a7ba2c76574547b50a17bb289f2c8b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:29:23.053165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Getting quotas for user cdebfdf54a7e4026bfa98c8c308a4456 and project e2a7ba2c76574547b50a17bb289f2c8b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:29:23.065657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:29:23.068253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:29:23.117216 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a048aea4-c98f-4802-afe4-515ac79c07e5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.593651 Aug 27 05:29:23.117817 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3552/7150] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:29:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:29:23.128993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38f4ba9c-952d-4a8f-9fd3-088bb38d2950 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:23.129625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38f4ba9c-952d-4a8f-9fd3-088bb38d2950 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:23.187525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-38f4ba9c-952d-4a8f-9fd3-088bb38d2950 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:23.194886 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-38f4ba9c-952d-4a8f-9fd3-088bb38d2950 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1239 microversion: 2.1 time: 0.069896 Aug 27 05:29:23.195679 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3599/7151] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:23 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:29:24.218187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-62547b5a-815a-469d-bea2-e3dd0526bba2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:24.218832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-62547b5a-815a-469d-bea2-e3dd0526bba2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:24.226229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62547b5a-815a-469d-bea2-e3dd0526bba2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:24.226721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62547b5a-815a-469d-bea2-e3dd0526bba2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:24.227160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62547b5a-815a-469d-bea2-e3dd0526bba2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:24.227865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62547b5a-815a-469d-bea2-e3dd0526bba2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:24.228322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62547b5a-815a-469d-bea2-e3dd0526bba2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:24.228781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62547b5a-815a-469d-bea2-e3dd0526bba2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:24.294751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-62547b5a-815a-469d-bea2-e3dd0526bba2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:24.303265 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-62547b5a-815a-469d-bea2-e3dd0526bba2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1291 microversion: 2.1 time: 0.090518 Aug 27 05:29:24.303861 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3553/7152] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:24 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1291 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:25.325219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a145be4-08d3-45b1-8342-0914c35c6029 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:25.326028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a145be4-08d3-45b1-8342-0914c35c6029 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:25.333736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a145be4-08d3-45b1-8342-0914c35c6029 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:25.334240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a145be4-08d3-45b1-8342-0914c35c6029 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:25.334691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a145be4-08d3-45b1-8342-0914c35c6029 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:25.335402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a145be4-08d3-45b1-8342-0914c35c6029 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:25.335867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a145be4-08d3-45b1-8342-0914c35c6029 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:25.336305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a145be4-08d3-45b1-8342-0914c35c6029 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:25.469995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a145be4-08d3-45b1-8342-0914c35c6029 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:25.478626 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a145be4-08d3-45b1-8342-0914c35c6029 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1364 microversion: 2.1 time: 0.157361 Aug 27 05:29:25.479451 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3600/7153] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:25 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:25.918000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-99427fc1-f3aa-4653-a558-6a1549b02513 req-538b045a-d4da-4c5d-87d2-e4b4361b6fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b34e42ff-f325-421d-b150-3166d8410347", "tag": "77ee6a88-a062-4144-85e2-184095656ac8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:25.930404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-99427fc1-f3aa-4653-a558-6a1549b02513 req-538b045a-d4da-4c5d-87d2-e4b4361b6fa0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:25.930987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-99427fc1-f3aa-4653-a558-6a1549b02513 req-538b045a-d4da-4c5d-87d2-e4b4361b6fa0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:25.931414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-99427fc1-f3aa-4653-a558-6a1549b02513 req-538b045a-d4da-4c5d-87d2-e4b4361b6fa0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:25.944286 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-99427fc1-f3aa-4653-a558-6a1549b02513 req-538b045a-d4da-4c5d-87d2-e4b4361b6fa0 service nova] Creating event network-changed:77ee6a88-a062-4144-85e2-184095656ac8 for instance b34e42ff-f325-421d-b150-3166d8410347 on n-h2-854823-1 Aug 27 05:29:25.950754 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-99427fc1-f3aa-4653-a558-6a1549b02513 req-538b045a-d4da-4c5d-87d2-e4b4361b6fa0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036530 Aug 27 05:29:25.951778 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3554/7154] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:26.501529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-268495ec-d216-49a8-9ed2-967f9563d2c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:26.502172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-268495ec-d216-49a8-9ed2-967f9563d2c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:26.505051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:26.513280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-268495ec-d216-49a8-9ed2-967f9563d2c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:26.513444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-268495ec-d216-49a8-9ed2-967f9563d2c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:26.513818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-268495ec-d216-49a8-9ed2-967f9563d2c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:26.514531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-268495ec-d216-49a8-9ed2-967f9563d2c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:26.514997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-268495ec-d216-49a8-9ed2-967f9563d2c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:26.515429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-268495ec-d216-49a8-9ed2-967f9563d2c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:26.656097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-268495ec-d216-49a8-9ed2-967f9563d2c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:26.663855 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-268495ec-d216-49a8-9ed2-967f9563d2c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1364 microversion: 2.1 time: 0.166257 Aug 27 05:29:26.664432 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3601/7155] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:26 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:27.686225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d74fab5f-89e3-433c-8faf-4162f258a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:27.686866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d74fab5f-89e3-433c-8faf-4162f258a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:27.689696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:27.695831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d74fab5f-89e3-433c-8faf-4162f258a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:27.696327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d74fab5f-89e3-433c-8faf-4162f258a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:27.696794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d74fab5f-89e3-433c-8faf-4162f258a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:27.697501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d74fab5f-89e3-433c-8faf-4162f258a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:27.697961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d74fab5f-89e3-433c-8faf-4162f258a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:27.698387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d74fab5f-89e3-433c-8faf-4162f258a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:27.856389 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d74fab5f-89e3-433c-8faf-4162f258a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:27.864215 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d74fab5f-89e3-433c-8faf-4162f258a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1364 microversion: 2.1 time: 0.182952 Aug 27 05:29:27.864814 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3555/7156] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:27 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:28.886016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8f1548d-5ee4-4a46-b78a-7da142991be2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:28.886637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b8f1548d-5ee4-4a46-b78a-7da142991be2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:28.894278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8f1548d-5ee4-4a46-b78a-7da142991be2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:28.894778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8f1548d-5ee4-4a46-b78a-7da142991be2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:28.895227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8f1548d-5ee4-4a46-b78a-7da142991be2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:28.895929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8f1548d-5ee4-4a46-b78a-7da142991be2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:28.896398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8f1548d-5ee4-4a46-b78a-7da142991be2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:28.896866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8f1548d-5ee4-4a46-b78a-7da142991be2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:29.026778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b8f1548d-5ee4-4a46-b78a-7da142991be2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:29.034566 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b8f1548d-5ee4-4a46-b78a-7da142991be2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1364 microversion: 2.1 time: 0.152419 Aug 27 05:29:29.035162 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3602/7157] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:28 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:30.056351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dea31175-3aca-4295-8005-54940405e15c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:30.056993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dea31175-3aca-4295-8005-54940405e15c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:30.064600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea31175-3aca-4295-8005-54940405e15c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:30.065092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea31175-3aca-4295-8005-54940405e15c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:30.065535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea31175-3aca-4295-8005-54940405e15c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:30.066235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea31175-3aca-4295-8005-54940405e15c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:30.066697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea31175-3aca-4295-8005-54940405e15c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:30.067126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dea31175-3aca-4295-8005-54940405e15c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:30.204604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dea31175-3aca-4295-8005-54940405e15c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:30.212477 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dea31175-3aca-4295-8005-54940405e15c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1364 microversion: 2.1 time: 0.160110 Aug 27 05:29:30.213090 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3556/7158] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:30 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:30.703031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6b0cdc31-a0ec-4cfe-b25b-228ce7e957a4 req-0c4c16e8-58c4-49f0-a124-cfdf76087cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34e42ff-f325-421d-b150-3166d8410347", "name": "network-vif-plugged", "status": "completed", "tag": "77ee6a88-a062-4144-85e2-184095656ac8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:30.713970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6b0cdc31-a0ec-4cfe-b25b-228ce7e957a4 req-0c4c16e8-58c4-49f0-a124-cfdf76087cc3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:30.714478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6b0cdc31-a0ec-4cfe-b25b-228ce7e957a4 req-0c4c16e8-58c4-49f0-a124-cfdf76087cc3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:30.714933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6b0cdc31-a0ec-4cfe-b25b-228ce7e957a4 req-0c4c16e8-58c4-49f0-a124-cfdf76087cc3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:30.726333 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6b0cdc31-a0ec-4cfe-b25b-228ce7e957a4 req-0c4c16e8-58c4-49f0-a124-cfdf76087cc3 service nova] Creating event network-vif-plugged:77ee6a88-a062-4144-85e2-184095656ac8 for instance b34e42ff-f325-421d-b150-3166d8410347 on n-h2-854823-1 Aug 27 05:29:30.731944 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6b0cdc31-a0ec-4cfe-b25b-228ce7e957a4 req-0c4c16e8-58c4-49f0-a124-cfdf76087cc3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032812 Aug 27 05:29:30.732750 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3603/7159] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:31.234857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9c528bc7-58a4-491c-8059-25c67c3b46ff tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:31.235493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9c528bc7-58a4-491c-8059-25c67c3b46ff tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:31.243258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c528bc7-58a4-491c-8059-25c67c3b46ff tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:31.243741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c528bc7-58a4-491c-8059-25c67c3b46ff tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:31.244185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c528bc7-58a4-491c-8059-25c67c3b46ff tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:31.244908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c528bc7-58a4-491c-8059-25c67c3b46ff tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:31.245367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c528bc7-58a4-491c-8059-25c67c3b46ff tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:31.245793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9c528bc7-58a4-491c-8059-25c67c3b46ff tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:31.376542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9c528bc7-58a4-491c-8059-25c67c3b46ff tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:31.384304 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9c528bc7-58a4-491c-8059-25c67c3b46ff tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1364 microversion: 2.1 time: 0.153943 Aug 27 05:29:31.384936 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3557/7160] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:31 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:32.407784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e2121c5-e8db-4d99-92e5-e7dfa535a0ea tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:32.408496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e2121c5-e8db-4d99-92e5-e7dfa535a0ea tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:32.414905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2121c5-e8db-4d99-92e5-e7dfa535a0ea tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:32.415397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2121c5-e8db-4d99-92e5-e7dfa535a0ea tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:32.415848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2121c5-e8db-4d99-92e5-e7dfa535a0ea tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:32.416564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2121c5-e8db-4d99-92e5-e7dfa535a0ea tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:32.417035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2121c5-e8db-4d99-92e5-e7dfa535a0ea tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:32.417469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e2121c5-e8db-4d99-92e5-e7dfa535a0ea tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:32.554850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e2121c5-e8db-4d99-92e5-e7dfa535a0ea tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:29:32.562691 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e2121c5-e8db-4d99-92e5-e7dfa535a0ea tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1551 microversion: 2.1 time: 0.160149 Aug 27 05:29:32.563269 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3604/7161] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:29:32 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:29:32.584183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-67174b65-2411-4e41-814d-9c3c02245efc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:29:32.584721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-67174b65-2411-4e41-814d-9c3c02245efc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:29:32.591429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67174b65-2411-4e41-814d-9c3c02245efc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:32.591910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67174b65-2411-4e41-814d-9c3c02245efc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:32.592350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67174b65-2411-4e41-814d-9c3c02245efc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:32.593073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67174b65-2411-4e41-814d-9c3c02245efc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:32.593530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67174b65-2411-4e41-814d-9c3c02245efc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:32.593957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67174b65-2411-4e41-814d-9c3c02245efc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:32.675891 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-67174b65-2411-4e41-814d-9c3c02245efc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095652 Aug 27 05:29:32.676498 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3558/7162] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 05:29:32 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:29:33.641582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:29:33.706888 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ebe9449b-ce6e-4497-bb54-0a46d67cfbbd req-3f0f7468-845e-42c6-be51-54740effd54a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b34e42ff-f325-421d-b150-3166d8410347", "tag": "77ee6a88-a062-4144-85e2-184095656ac8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:29:33.716523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ebe9449b-ce6e-4497-bb54-0a46d67cfbbd req-3f0f7468-845e-42c6-be51-54740effd54a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:29:33.717049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ebe9449b-ce6e-4497-bb54-0a46d67cfbbd req-3f0f7468-845e-42c6-be51-54740effd54a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:29:33.717492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ebe9449b-ce6e-4497-bb54-0a46d67cfbbd req-3f0f7468-845e-42c6-be51-54740effd54a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:29:33.729114 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ebe9449b-ce6e-4497-bb54-0a46d67cfbbd req-3f0f7468-845e-42c6-be51-54740effd54a service nova] Creating event network-changed:77ee6a88-a062-4144-85e2-184095656ac8 for instance b34e42ff-f325-421d-b150-3166d8410347 on n-h2-854823-1 Aug 27 05:29:33.736255 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ebe9449b-ce6e-4497-bb54-0a46d67cfbbd req-3f0f7468-845e-42c6-be51-54740effd54a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098973 Aug 27 05:29:33.736843 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3605/7163] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:14.202673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:14.203449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:14.205373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=7 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:14.205991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=45 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:14.210632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-78656484-f048-4759-8d68-b85ce45ed941 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:14.218293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78656484-f048-4759-8d68-b85ce45ed941 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:14.218774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78656484-f048-4759-8d68-b85ce45ed941 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:14.219211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-78656484-f048-4759-8d68-b85ce45ed941 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:14.241592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-78656484-f048-4759-8d68-b85ce45ed941 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Going to try to stop instance {{(pid=128870) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:30:14.283911 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-78656484-f048-4759-8d68-b85ce45ed941 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347/action" status: 202 len: 0 microversion: 2.1 time: 0.081656 Aug 27 05:30:14.284502 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3559/7164] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:30:14 2022] POST /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:30:14.291281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=9 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:14.292169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=42 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:14.297172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84af5876-699f-45a8-8cc2-f73c39ece630 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:14.297905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-84af5876-699f-45a8-8cc2-f73c39ece630 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:14.305842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84af5876-699f-45a8-8cc2-f73c39ece630 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:14.306423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84af5876-699f-45a8-8cc2-f73c39ece630 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:14.306842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84af5876-699f-45a8-8cc2-f73c39ece630 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:14.307606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84af5876-699f-45a8-8cc2-f73c39ece630 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:14.308089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84af5876-699f-45a8-8cc2-f73c39ece630 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:14.308632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84af5876-699f-45a8-8cc2-f73c39ece630 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:14.631620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84af5876-699f-45a8-8cc2-f73c39ece630 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:14.639462 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-84af5876-699f-45a8-8cc2-f73c39ece630 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.350528 Aug 27 05:30:14.640049 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3606/7165] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:14 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:15.662057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4b0982e4-59fb-4d73-ae29-660ecc8b2fb8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:15.662758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4b0982e4-59fb-4d73-ae29-660ecc8b2fb8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:15.668999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0982e4-59fb-4d73-ae29-660ecc8b2fb8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:15.669971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0982e4-59fb-4d73-ae29-660ecc8b2fb8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:15.670410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0982e4-59fb-4d73-ae29-660ecc8b2fb8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:15.671098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0982e4-59fb-4d73-ae29-660ecc8b2fb8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:15.671555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0982e4-59fb-4d73-ae29-660ecc8b2fb8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:15.671974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b0982e4-59fb-4d73-ae29-660ecc8b2fb8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:15.923174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4b0982e4-59fb-4d73-ae29-660ecc8b2fb8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:15.930979 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4b0982e4-59fb-4d73-ae29-660ecc8b2fb8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.274120 Aug 27 05:30:15.931553 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3560/7166] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:15 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:16.953630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-51ac87bc-c99c-4416-a530-3e80db136431 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:16.954255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-51ac87bc-c99c-4416-a530-3e80db136431 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:16.961275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51ac87bc-c99c-4416-a530-3e80db136431 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:16.961775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51ac87bc-c99c-4416-a530-3e80db136431 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:16.962228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51ac87bc-c99c-4416-a530-3e80db136431 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:16.962941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51ac87bc-c99c-4416-a530-3e80db136431 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:16.963417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51ac87bc-c99c-4416-a530-3e80db136431 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:16.963857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51ac87bc-c99c-4416-a530-3e80db136431 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:17.094617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-51ac87bc-c99c-4416-a530-3e80db136431 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:17.102513 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-51ac87bc-c99c-4416-a530-3e80db136431 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.153525 Aug 27 05:30:17.103116 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3607/7167] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:16 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:18.123220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d651d38a-d3b9-44b2-90ba-e4c5d38cb4bf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:18.123867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d651d38a-d3b9-44b2-90ba-e4c5d38cb4bf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:18.130753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d651d38a-d3b9-44b2-90ba-e4c5d38cb4bf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:18.131245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d651d38a-d3b9-44b2-90ba-e4c5d38cb4bf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:18.131686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d651d38a-d3b9-44b2-90ba-e4c5d38cb4bf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:18.132387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d651d38a-d3b9-44b2-90ba-e4c5d38cb4bf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:18.132872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d651d38a-d3b9-44b2-90ba-e4c5d38cb4bf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:18.133302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d651d38a-d3b9-44b2-90ba-e4c5d38cb4bf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:18.270899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d651d38a-d3b9-44b2-90ba-e4c5d38cb4bf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:18.278912 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d651d38a-d3b9-44b2-90ba-e4c5d38cb4bf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.159635 Aug 27 05:30:18.279476 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3561/7168] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:18 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:19.300515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-763dc4a5-7aab-4d88-942e-a3f58f66d237 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:19.301176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-763dc4a5-7aab-4d88-942e-a3f58f66d237 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:19.308806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-763dc4a5-7aab-4d88-942e-a3f58f66d237 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:19.309306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-763dc4a5-7aab-4d88-942e-a3f58f66d237 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:19.309759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-763dc4a5-7aab-4d88-942e-a3f58f66d237 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:19.310462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-763dc4a5-7aab-4d88-942e-a3f58f66d237 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:19.310930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-763dc4a5-7aab-4d88-942e-a3f58f66d237 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:19.311366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-763dc4a5-7aab-4d88-942e-a3f58f66d237 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:19.443962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-763dc4a5-7aab-4d88-942e-a3f58f66d237 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:19.452583 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-763dc4a5-7aab-4d88-942e-a3f58f66d237 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.155962 Aug 27 05:30:19.453167 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3608/7169] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:19 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:20.473711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ea17a57a-5b70-4c59-a8eb-9c55b1768ace tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:20.474330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ea17a57a-5b70-4c59-a8eb-9c55b1768ace tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:20.481440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea17a57a-5b70-4c59-a8eb-9c55b1768ace tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:20.482578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea17a57a-5b70-4c59-a8eb-9c55b1768ace tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:20.483024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea17a57a-5b70-4c59-a8eb-9c55b1768ace tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:20.483756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea17a57a-5b70-4c59-a8eb-9c55b1768ace tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:20.484182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea17a57a-5b70-4c59-a8eb-9c55b1768ace tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:20.484643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ea17a57a-5b70-4c59-a8eb-9c55b1768ace tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:20.612864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ea17a57a-5b70-4c59-a8eb-9c55b1768ace tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:20.620592 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ea17a57a-5b70-4c59-a8eb-9c55b1768ace tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.150775 Aug 27 05:30:20.621172 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3562/7170] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:20 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:21.641658 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b725ae1-b833-45de-8efe-4c5657959be0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:21.642280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b725ae1-b833-45de-8efe-4c5657959be0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:21.649352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b725ae1-b833-45de-8efe-4c5657959be0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:21.649848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b725ae1-b833-45de-8efe-4c5657959be0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:21.650353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b725ae1-b833-45de-8efe-4c5657959be0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:21.651318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b725ae1-b833-45de-8efe-4c5657959be0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:21.651781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b725ae1-b833-45de-8efe-4c5657959be0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:21.652216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b725ae1-b833-45de-8efe-4c5657959be0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:21.780322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0b725ae1-b833-45de-8efe-4c5657959be0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:21.788349 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b725ae1-b833-45de-8efe-4c5657959be0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.150597 Aug 27 05:30:21.789024 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3609/7171] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:21 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:30:22.810075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-81d96cb2-f258-4ff3-8203-eebf05870f55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:22.810697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-81d96cb2-f258-4ff3-8203-eebf05870f55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:22.817616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81d96cb2-f258-4ff3-8203-eebf05870f55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:22.818099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81d96cb2-f258-4ff3-8203-eebf05870f55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:22.818537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81d96cb2-f258-4ff3-8203-eebf05870f55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:22.819229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81d96cb2-f258-4ff3-8203-eebf05870f55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:22.819687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81d96cb2-f258-4ff3-8203-eebf05870f55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:22.820111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-81d96cb2-f258-4ff3-8203-eebf05870f55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:22.951016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-81d96cb2-f258-4ff3-8203-eebf05870f55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:22.958812 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-81d96cb2-f258-4ff3-8203-eebf05870f55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.152644 Aug 27 05:30:22.959401 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3563/7172] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:22 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:23.979983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4520ad31-7b48-42f4-a439-6fae7bae2147 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:23.980687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4520ad31-7b48-42f4-a439-6fae7bae2147 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:23.988233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4520ad31-7b48-42f4-a439-6fae7bae2147 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:23.988780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4520ad31-7b48-42f4-a439-6fae7bae2147 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:23.989238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4520ad31-7b48-42f4-a439-6fae7bae2147 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:23.990229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4520ad31-7b48-42f4-a439-6fae7bae2147 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:23.990717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4520ad31-7b48-42f4-a439-6fae7bae2147 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:23.991164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4520ad31-7b48-42f4-a439-6fae7bae2147 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:24.119788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4520ad31-7b48-42f4-a439-6fae7bae2147 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:24.128697 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4520ad31-7b48-42f4-a439-6fae7bae2147 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.152439 Aug 27 05:30:24.129135 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3610/7173] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:23 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:25.149507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b8d13507-8a3a-448e-b31b-f6532565afae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:25.150119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b8d13507-8a3a-448e-b31b-f6532565afae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:25.157764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8d13507-8a3a-448e-b31b-f6532565afae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:25.158243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8d13507-8a3a-448e-b31b-f6532565afae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:25.158795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8d13507-8a3a-448e-b31b-f6532565afae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:25.159411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8d13507-8a3a-448e-b31b-f6532565afae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:25.159804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8d13507-8a3a-448e-b31b-f6532565afae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:25.160221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b8d13507-8a3a-448e-b31b-f6532565afae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:25.293570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b8d13507-8a3a-448e-b31b-f6532565afae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:25.302133 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b8d13507-8a3a-448e-b31b-f6532565afae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.156451 Aug 27 05:30:25.302716 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3564/7174] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:25 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:30:26.323505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c4fc66f4-f98f-4528-b2d5-b3e098f3234f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:26.324140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c4fc66f4-f98f-4528-b2d5-b3e098f3234f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:26.331318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4fc66f4-f98f-4528-b2d5-b3e098f3234f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:26.331939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4fc66f4-f98f-4528-b2d5-b3e098f3234f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:26.332379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4fc66f4-f98f-4528-b2d5-b3e098f3234f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:26.333126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4fc66f4-f98f-4528-b2d5-b3e098f3234f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:26.333609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4fc66f4-f98f-4528-b2d5-b3e098f3234f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:26.334055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4fc66f4-f98f-4528-b2d5-b3e098f3234f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:26.468655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c4fc66f4-f98f-4528-b2d5-b3e098f3234f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:26.476609 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c4fc66f4-f98f-4528-b2d5-b3e098f3234f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.157136 Aug 27 05:30:26.477199 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3611/7175] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:26 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:27.498415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6fc8f15c-218a-4de5-bb3e-6e95261c7275 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:27.499043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6fc8f15c-218a-4de5-bb3e-6e95261c7275 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:27.506027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fc8f15c-218a-4de5-bb3e-6e95261c7275 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:27.506518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fc8f15c-218a-4de5-bb3e-6e95261c7275 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:27.506961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fc8f15c-218a-4de5-bb3e-6e95261c7275 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:27.507659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fc8f15c-218a-4de5-bb3e-6e95261c7275 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:27.508133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fc8f15c-218a-4de5-bb3e-6e95261c7275 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:27.508586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6fc8f15c-218a-4de5-bb3e-6e95261c7275 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:27.638202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6fc8f15c-218a-4de5-bb3e-6e95261c7275 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:27.645999 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6fc8f15c-218a-4de5-bb3e-6e95261c7275 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.152016 Aug 27 05:30:27.646576 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3565/7176] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:27 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:28.667386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f921ed7-e00b-49e3-a8cf-8bf38113a8db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:28.667925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f921ed7-e00b-49e3-a8cf-8bf38113a8db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:28.674943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f921ed7-e00b-49e3-a8cf-8bf38113a8db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:28.675443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f921ed7-e00b-49e3-a8cf-8bf38113a8db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:28.675891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f921ed7-e00b-49e3-a8cf-8bf38113a8db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:28.676628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f921ed7-e00b-49e3-a8cf-8bf38113a8db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:28.677095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f921ed7-e00b-49e3-a8cf-8bf38113a8db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:28.677529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f921ed7-e00b-49e3-a8cf-8bf38113a8db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:28.805154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f921ed7-e00b-49e3-a8cf-8bf38113a8db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:28.813899 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f921ed7-e00b-49e3-a8cf-8bf38113a8db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.150546 Aug 27 05:30:28.814490 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3612/7177] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:28 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:29.839601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-529f2ae7-42c1-4998-9942-1b6dbf361ba7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:29.840220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-529f2ae7-42c1-4998-9942-1b6dbf361ba7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:29.847828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-529f2ae7-42c1-4998-9942-1b6dbf361ba7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:29.848318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-529f2ae7-42c1-4998-9942-1b6dbf361ba7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:29.848786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-529f2ae7-42c1-4998-9942-1b6dbf361ba7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:29.849486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-529f2ae7-42c1-4998-9942-1b6dbf361ba7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:29.849948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-529f2ae7-42c1-4998-9942-1b6dbf361ba7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:29.850372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-529f2ae7-42c1-4998-9942-1b6dbf361ba7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:29.983201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-529f2ae7-42c1-4998-9942-1b6dbf361ba7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:29.991453 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-529f2ae7-42c1-4998-9942-1b6dbf361ba7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1657 microversion: 2.1 time: 0.156051 Aug 27 05:30:29.992028 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3566/7178] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:29 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1657 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:30.011929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:30.014797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:30.021727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:30.022223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:30.022673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:30.023380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:30.023845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:30.024280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:30.055579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:30.061319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Old instance type m1.heat2, new instance type m1.heat {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:30:30.067796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:30:30.068225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:30:30.068737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:30:30.069158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:30:30.069578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:30:30.134368 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eef054da-369c-42e1-a43c-fa881e308305 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347/action" status: 202 len: 0 microversion: 2.1 time: 0.126346 Aug 27 05:30:30.134916 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3613/7179] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:30:30 2022] POST /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:30:30.143775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-51090d3d-fa5f-4c9f-a2ce-9ca4e70454e0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:30.144392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-51090d3d-fa5f-4c9f-a2ce-9ca4e70454e0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:30.150564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51090d3d-fa5f-4c9f-a2ce-9ca4e70454e0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:30.151457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51090d3d-fa5f-4c9f-a2ce-9ca4e70454e0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:30.151894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51090d3d-fa5f-4c9f-a2ce-9ca4e70454e0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:30.152650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51090d3d-fa5f-4c9f-a2ce-9ca4e70454e0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:30.153139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51090d3d-fa5f-4c9f-a2ce-9ca4e70454e0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:30.153562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-51090d3d-fa5f-4c9f-a2ce-9ca4e70454e0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:30.308491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-51090d3d-fa5f-4c9f-a2ce-9ca4e70454e0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:30.316957 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-51090d3d-fa5f-4c9f-a2ce-9ca4e70454e0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.177187 Aug 27 05:30:30.317572 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3567/7180] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:30 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:31.339748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac299bff-3bc8-4960-84de-45e07c14568f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:31.340379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac299bff-3bc8-4960-84de-45e07c14568f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:31.349016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac299bff-3bc8-4960-84de-45e07c14568f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:31.349967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac299bff-3bc8-4960-84de-45e07c14568f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:31.349967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac299bff-3bc8-4960-84de-45e07c14568f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:31.350693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac299bff-3bc8-4960-84de-45e07c14568f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:31.351169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac299bff-3bc8-4960-84de-45e07c14568f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:31.351621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac299bff-3bc8-4960-84de-45e07c14568f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:31.491249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac299bff-3bc8-4960-84de-45e07c14568f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:31.501456 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac299bff-3bc8-4960-84de-45e07c14568f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1680 microversion: 2.1 time: 0.166654 Aug 27 05:30:31.502189 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3614/7181] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:31 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:32.523703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e31a52e5-9a25-4cd1-a8c8-8d0a345aef55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:32.524331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e31a52e5-9a25-4cd1-a8c8-8d0a345aef55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:32.531267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e31a52e5-9a25-4cd1-a8c8-8d0a345aef55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:32.531819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e31a52e5-9a25-4cd1-a8c8-8d0a345aef55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:32.532302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e31a52e5-9a25-4cd1-a8c8-8d0a345aef55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:32.533044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e31a52e5-9a25-4cd1-a8c8-8d0a345aef55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:32.533513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e31a52e5-9a25-4cd1-a8c8-8d0a345aef55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:32.534046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e31a52e5-9a25-4cd1-a8c8-8d0a345aef55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:32.670888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e31a52e5-9a25-4cd1-a8c8-8d0a345aef55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:32.678670 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e31a52e5-9a25-4cd1-a8c8-8d0a345aef55 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1685 microversion: 2.1 time: 0.159177 Aug 27 05:30:32.679251 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3568/7182] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:32 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:33.699517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1300fe1d-09dc-43d2-8d31-1ec7c946c313 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:33.700152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1300fe1d-09dc-43d2-8d31-1ec7c946c313 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:33.706818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1300fe1d-09dc-43d2-8d31-1ec7c946c313 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:33.707317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1300fe1d-09dc-43d2-8d31-1ec7c946c313 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:33.707769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1300fe1d-09dc-43d2-8d31-1ec7c946c313 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:33.708474 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1300fe1d-09dc-43d2-8d31-1ec7c946c313 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:33.708979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1300fe1d-09dc-43d2-8d31-1ec7c946c313 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:33.709419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1300fe1d-09dc-43d2-8d31-1ec7c946c313 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:33.836844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1300fe1d-09dc-43d2-8d31-1ec7c946c313 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:33.844648 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1300fe1d-09dc-43d2-8d31-1ec7c946c313 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1685 microversion: 2.1 time: 0.149249 Aug 27 05:30:33.845227 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3615/7183] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:33 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:34.845001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-b131ad51-437a-443a-818f-2ba24df6e612 req-d9a5b2f5-f652-4e08-9d37-d155b80ccd26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34e42ff-f325-421d-b150-3166d8410347", "name": "network-vif-unplugged", "status": "completed", "tag": "77ee6a88-a062-4144-85e2-184095656ac8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:34.862105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b131ad51-437a-443a-818f-2ba24df6e612 req-d9a5b2f5-f652-4e08-9d37-d155b80ccd26 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:34.862852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b131ad51-437a-443a-818f-2ba24df6e612 req-d9a5b2f5-f652-4e08-9d37-d155b80ccd26 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:34.863512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-b131ad51-437a-443a-818f-2ba24df6e612 req-d9a5b2f5-f652-4e08-9d37-d155b80ccd26 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:34.870950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78f36e19-a965-407f-ae5f-8148e8d14577 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:34.871679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78f36e19-a965-407f-ae5f-8148e8d14577 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:34.879157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78f36e19-a965-407f-ae5f-8148e8d14577 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:34.879795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78f36e19-a965-407f-ae5f-8148e8d14577 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:34.880568 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-b131ad51-437a-443a-818f-2ba24df6e612 req-d9a5b2f5-f652-4e08-9d37-d155b80ccd26 service nova] Creating event network-vif-unplugged:77ee6a88-a062-4144-85e2-184095656ac8 for instance b34e42ff-f325-421d-b150-3166d8410347 on n-h1-854823-1 Aug 27 05:30:34.880818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78f36e19-a965-407f-ae5f-8148e8d14577 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:34.881646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78f36e19-a965-407f-ae5f-8148e8d14577 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:34.882981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78f36e19-a965-407f-ae5f-8148e8d14577 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:34.883536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78f36e19-a965-407f-ae5f-8148e8d14577 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:34.886317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-b131ad51-437a-443a-818f-2ba24df6e612 req-d9a5b2f5-f652-4e08-9d37-d155b80ccd26 service nova] Instance b34e42ff-f325-421d-b150-3166d8410347 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:30:34.898053 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-b131ad51-437a-443a-818f-2ba24df6e612 req-d9a5b2f5-f652-4e08-9d37-d155b80ccd26 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058226 Aug 27 05:30:34.898680 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3569/7184] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:35.037499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-78f36e19-a965-407f-ae5f-8148e8d14577 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:35.046669 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78f36e19-a965-407f-ae5f-8148e8d14577 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1684 microversion: 2.1 time: 0.182732 Aug 27 05:30:35.047262 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3616/7185] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:34 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1684 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:36.069453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1981259a-4997-4df8-8fc9-0b1ee79576bb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:36.070158 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1981259a-4997-4df8-8fc9-0b1ee79576bb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:36.076401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1981259a-4997-4df8-8fc9-0b1ee79576bb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:36.076918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1981259a-4997-4df8-8fc9-0b1ee79576bb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:36.077362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1981259a-4997-4df8-8fc9-0b1ee79576bb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:36.078059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1981259a-4997-4df8-8fc9-0b1ee79576bb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:36.078537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1981259a-4997-4df8-8fc9-0b1ee79576bb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:36.078971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1981259a-4997-4df8-8fc9-0b1ee79576bb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:36.209882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1981259a-4997-4df8-8fc9-0b1ee79576bb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:36.219119 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1981259a-4997-4df8-8fc9-0b1ee79576bb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1682 microversion: 2.1 time: 0.155014 Aug 27 05:30:36.219703 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3570/7186] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:36 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:36.929895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4abff2ba-8a5e-4ee9-b12e-566a26ba5914 req-8dc32bb0-a0dd-4775-a5ff-5daa2bdb865c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b34e42ff-f325-421d-b150-3166d8410347", "tag": "77ee6a88-a062-4144-85e2-184095656ac8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:36.941915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4abff2ba-8a5e-4ee9-b12e-566a26ba5914 req-8dc32bb0-a0dd-4775-a5ff-5daa2bdb865c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:36.942416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4abff2ba-8a5e-4ee9-b12e-566a26ba5914 req-8dc32bb0-a0dd-4775-a5ff-5daa2bdb865c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:36.942866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4abff2ba-8a5e-4ee9-b12e-566a26ba5914 req-8dc32bb0-a0dd-4775-a5ff-5daa2bdb865c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:36.955457 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4abff2ba-8a5e-4ee9-b12e-566a26ba5914 req-8dc32bb0-a0dd-4775-a5ff-5daa2bdb865c service nova] Creating event network-changed:77ee6a88-a062-4144-85e2-184095656ac8 for instance b34e42ff-f325-421d-b150-3166d8410347 on n-h1-854823-1 Aug 27 05:30:36.960787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-4abff2ba-8a5e-4ee9-b12e-566a26ba5914 req-8dc32bb0-a0dd-4775-a5ff-5daa2bdb865c service nova] Instance b34e42ff-f325-421d-b150-3166d8410347 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:30:36.971603 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4abff2ba-8a5e-4ee9-b12e-566a26ba5914 req-8dc32bb0-a0dd-4775-a5ff-5daa2bdb865c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045407 Aug 27 05:30:36.972197 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3617/7187] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:37.241635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5d5b51cc-f4a8-4093-a7ac-025ef5c7904a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:37.242255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5d5b51cc-f4a8-4093-a7ac-025ef5c7904a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:37.244719 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:30:37.244859 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 05:30:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 (ip 10.222.0.79) !!! Aug 27 05:30:37.256696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d5b51cc-f4a8-4093-a7ac-025ef5c7904a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:37.257198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d5b51cc-f4a8-4093-a7ac-025ef5c7904a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:37.257651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d5b51cc-f4a8-4093-a7ac-025ef5c7904a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:37.258365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d5b51cc-f4a8-4093-a7ac-025ef5c7904a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:37.258829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d5b51cc-f4a8-4093-a7ac-025ef5c7904a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:37.259265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d5b51cc-f4a8-4093-a7ac-025ef5c7904a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:37.398512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5d5b51cc-f4a8-4093-a7ac-025ef5c7904a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:37.406632 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5d5b51cc-f4a8-4093-a7ac-025ef5c7904a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1682 microversion: 2.1 time: 0.168939 Aug 27 05:30:37.407213 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3571/7188] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:37 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:30:38.430398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1919ffc8-d52b-448d-b7ae-df755cf84711 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:38.431418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1919ffc8-d52b-448d-b7ae-df755cf84711 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:38.440335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1919ffc8-d52b-448d-b7ae-df755cf84711 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:38.440914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1919ffc8-d52b-448d-b7ae-df755cf84711 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:38.441376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1919ffc8-d52b-448d-b7ae-df755cf84711 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:38.442120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1919ffc8-d52b-448d-b7ae-df755cf84711 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:38.442592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1919ffc8-d52b-448d-b7ae-df755cf84711 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:38.443213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1919ffc8-d52b-448d-b7ae-df755cf84711 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:38.593735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1919ffc8-d52b-448d-b7ae-df755cf84711 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:38.602349 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1919ffc8-d52b-448d-b7ae-df755cf84711 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1678 microversion: 2.1 time: 0.178575 Aug 27 05:30:38.603253 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3618/7189] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:38 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:30:38.624790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0cdd2abb-ea89-4e51-be81-0eae0918eacb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:38.625245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0cdd2abb-ea89-4e51-be81-0eae0918eacb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:38.631823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cdd2abb-ea89-4e51-be81-0eae0918eacb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:38.632327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cdd2abb-ea89-4e51-be81-0eae0918eacb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:38.632797 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cdd2abb-ea89-4e51-be81-0eae0918eacb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:38.633510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cdd2abb-ea89-4e51-be81-0eae0918eacb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:38.633974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cdd2abb-ea89-4e51-be81-0eae0918eacb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:38.634407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cdd2abb-ea89-4e51-be81-0eae0918eacb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:38.699325 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0cdd2abb-ea89-4e51-be81-0eae0918eacb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347/action" status: 204 len: 0 microversion: 2.1 time: 0.078080 Aug 27 05:30:38.700004 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3572/7190] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:30:38 2022] POST /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:30:38.709304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03ffd8d1-b9fb-49ac-b779-61d6f0d3a634 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:38.710118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03ffd8d1-b9fb-49ac-b779-61d6f0d3a634 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:38.726629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03ffd8d1-b9fb-49ac-b779-61d6f0d3a634 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:38.727171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03ffd8d1-b9fb-49ac-b779-61d6f0d3a634 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:38.727642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03ffd8d1-b9fb-49ac-b779-61d6f0d3a634 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:38.728368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03ffd8d1-b9fb-49ac-b779-61d6f0d3a634 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:38.728865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03ffd8d1-b9fb-49ac-b779-61d6f0d3a634 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:38.729348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03ffd8d1-b9fb-49ac-b779-61d6f0d3a634 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:38.954180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-03ffd8d1-b9fb-49ac-b779-61d6f0d3a634 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:38.962889 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03ffd8d1-b9fb-49ac-b779-61d6f0d3a634 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1678 microversion: 2.1 time: 0.257746 Aug 27 05:30:38.963488 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3619/7191] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:38 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1678 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:39.983854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f93ca387-c343-42d2-bf98-0751bde60158 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:39.984477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f93ca387-c343-42d2-bf98-0751bde60158 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:39.991607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93ca387-c343-42d2-bf98-0751bde60158 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:39.992086 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93ca387-c343-42d2-bf98-0751bde60158 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:39.992520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93ca387-c343-42d2-bf98-0751bde60158 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:39.993235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93ca387-c343-42d2-bf98-0751bde60158 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:39.993685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93ca387-c343-42d2-bf98-0751bde60158 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:39.994108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f93ca387-c343-42d2-bf98-0751bde60158 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:40.129425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f93ca387-c343-42d2-bf98-0751bde60158 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:40.131791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:40.139863 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f93ca387-c343-42d2-bf98-0751bde60158 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1657 microversion: 2.1 time: 0.160235 Aug 27 05:30:40.141421 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3573/7192] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:39 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1657 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:40.161701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35fe422b-3e1e-4d5a-93c8-867956ebbf6c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:40.162335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35fe422b-3e1e-4d5a-93c8-867956ebbf6c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:40.169246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35fe422b-3e1e-4d5a-93c8-867956ebbf6c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:40.169762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35fe422b-3e1e-4d5a-93c8-867956ebbf6c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:40.170220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35fe422b-3e1e-4d5a-93c8-867956ebbf6c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:40.170937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35fe422b-3e1e-4d5a-93c8-867956ebbf6c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:40.171412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35fe422b-3e1e-4d5a-93c8-867956ebbf6c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:40.171857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35fe422b-3e1e-4d5a-93c8-867956ebbf6c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:40.307312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35fe422b-3e1e-4d5a-93c8-867956ebbf6c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:40.316468 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35fe422b-3e1e-4d5a-93c8-867956ebbf6c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1657 microversion: 2.1 time: 0.158604 Aug 27 05:30:40.317088 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3620/7193] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:40 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1657 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:40.339278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f88636f5-6aa0-4629-9924-e5b07138ff2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:40.346589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f88636f5-6aa0-4629-9924-e5b07138ff2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:40.347089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f88636f5-6aa0-4629-9924-e5b07138ff2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:40.347535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f88636f5-6aa0-4629-9924-e5b07138ff2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:40.372656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f88636f5-6aa0-4629-9924-e5b07138ff2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Going to try to start instance {{(pid=128870) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 05:30:40.417836 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f88636f5-6aa0-4629-9924-e5b07138ff2a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347/action" status: 202 len: 0 microversion: 2.1 time: 0.082838 Aug 27 05:30:40.418568 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3574/7194] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:30:40 2022] POST /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:30:40.427678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5fb6eaec-1ea9-4bde-bb51-22a73f28ba89 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:40.428404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5fb6eaec-1ea9-4bde-bb51-22a73f28ba89 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:40.435185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fb6eaec-1ea9-4bde-bb51-22a73f28ba89 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:40.436344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fb6eaec-1ea9-4bde-bb51-22a73f28ba89 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:40.436910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fb6eaec-1ea9-4bde-bb51-22a73f28ba89 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:40.437716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fb6eaec-1ea9-4bde-bb51-22a73f28ba89 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:40.438257 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fb6eaec-1ea9-4bde-bb51-22a73f28ba89 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:40.438870 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fb6eaec-1ea9-4bde-bb51-22a73f28ba89 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:40.460328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:40.603029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5fb6eaec-1ea9-4bde-bb51-22a73f28ba89 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:40.611706 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5fb6eaec-1ea9-4bde-bb51-22a73f28ba89 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1666 microversion: 2.1 time: 0.188210 Aug 27 05:30:40.612723 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3621/7195] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:40 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1666 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:30:40.634763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-6f164a31-6596-4298-98db-24deb39e6884 req-5ef4190a-8154-4584-8c27-74c17c270991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34e42ff-f325-421d-b150-3166d8410347", "name": "network-vif-plugged", "status": "completed", "tag": "77ee6a88-a062-4144-85e2-184095656ac8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:40.645041 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6f164a31-6596-4298-98db-24deb39e6884 req-5ef4190a-8154-4584-8c27-74c17c270991 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:40.645522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6f164a31-6596-4298-98db-24deb39e6884 req-5ef4190a-8154-4584-8c27-74c17c270991 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:40.645951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6f164a31-6596-4298-98db-24deb39e6884 req-5ef4190a-8154-4584-8c27-74c17c270991 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:40.659004 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-6f164a31-6596-4298-98db-24deb39e6884 req-5ef4190a-8154-4584-8c27-74c17c270991 service nova] Creating event network-vif-plugged:77ee6a88-a062-4144-85e2-184095656ac8 for instance b34e42ff-f325-421d-b150-3166d8410347 on n-h1-854823-1 Aug 27 05:30:40.664185 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-6f164a31-6596-4298-98db-24deb39e6884 req-5ef4190a-8154-4584-8c27-74c17c270991 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106345 Aug 27 05:30:40.665011 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3575/7196] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:41.634011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-914de175-cf21-4796-842a-5d3a7cd2bcf0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:41.634742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-914de175-cf21-4796-842a-5d3a7cd2bcf0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:41.642723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914de175-cf21-4796-842a-5d3a7cd2bcf0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:41.643230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914de175-cf21-4796-842a-5d3a7cd2bcf0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:41.643683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914de175-cf21-4796-842a-5d3a7cd2bcf0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:41.644402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914de175-cf21-4796-842a-5d3a7cd2bcf0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:41.644902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914de175-cf21-4796-842a-5d3a7cd2bcf0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:41.645365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914de175-cf21-4796-842a-5d3a7cd2bcf0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:41.774328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-914de175-cf21-4796-842a-5d3a7cd2bcf0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:41.782576 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-914de175-cf21-4796-842a-5d3a7cd2bcf0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1666 microversion: 2.1 time: 0.152621 Aug 27 05:30:41.783171 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3622/7197] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:41 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:42.805526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8998f044-edb3-4831-8c6f-8f809c426d0d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:42.806272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8998f044-edb3-4831-8c6f-8f809c426d0d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:42.813161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8998f044-edb3-4831-8c6f-8f809c426d0d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:42.813653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8998f044-edb3-4831-8c6f-8f809c426d0d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:42.814093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8998f044-edb3-4831-8c6f-8f809c426d0d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:42.814785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8998f044-edb3-4831-8c6f-8f809c426d0d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:42.815250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8998f044-edb3-4831-8c6f-8f809c426d0d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:42.815678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8998f044-edb3-4831-8c6f-8f809c426d0d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:42.949316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8998f044-edb3-4831-8c6f-8f809c426d0d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:42.957078 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8998f044-edb3-4831-8c6f-8f809c426d0d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1670 microversion: 2.1 time: 0.156691 Aug 27 05:30:42.957655 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3576/7198] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:42 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:30:42.978251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-41b071b8-cc77-45ca-8d74-94c7fa553828 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:42.978770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41b071b8-cc77-45ca-8d74-94c7fa553828 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:42.986219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41b071b8-cc77-45ca-8d74-94c7fa553828 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:42.986728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41b071b8-cc77-45ca-8d74-94c7fa553828 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:42.987186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41b071b8-cc77-45ca-8d74-94c7fa553828 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:42.987968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41b071b8-cc77-45ca-8d74-94c7fa553828 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:42.988454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41b071b8-cc77-45ca-8d74-94c7fa553828 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:42.988926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41b071b8-cc77-45ca-8d74-94c7fa553828 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:43.014562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41b071b8-cc77-45ca-8d74-94c7fa553828 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:30:43.092407 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-41b071b8-cc77-45ca-8d74-94c7fa553828 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 204 len: 0 microversion: 2.1 time: 0.117716 Aug 27 05:30:43.093506 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3623/7199] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:30:42 2022] DELETE /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:30:43.103209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e55c6b68-dbf4-4fc2-ac82-3c9fd923b67c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:43.103861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e55c6b68-dbf4-4fc2-ac82-3c9fd923b67c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:43.110769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e55c6b68-dbf4-4fc2-ac82-3c9fd923b67c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:43.111263 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e55c6b68-dbf4-4fc2-ac82-3c9fd923b67c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:43.111702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e55c6b68-dbf4-4fc2-ac82-3c9fd923b67c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:43.112426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e55c6b68-dbf4-4fc2-ac82-3c9fd923b67c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:43.112936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e55c6b68-dbf4-4fc2-ac82-3c9fd923b67c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:43.113368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e55c6b68-dbf4-4fc2-ac82-3c9fd923b67c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:43.246786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e55c6b68-dbf4-4fc2-ac82-3c9fd923b67c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:43.255003 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e55c6b68-dbf4-4fc2-ac82-3c9fd923b67c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1676 microversion: 2.1 time: 0.155809 Aug 27 05:30:43.255611 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3577/7200] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:43 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:44.280034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1884f712-4a5f-4429-bf8c-75b8b0749888 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:44.281367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1884f712-4a5f-4429-bf8c-75b8b0749888 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:44.288231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1884f712-4a5f-4429-bf8c-75b8b0749888 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:44.288761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1884f712-4a5f-4429-bf8c-75b8b0749888 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:44.289204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1884f712-4a5f-4429-bf8c-75b8b0749888 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:44.289905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1884f712-4a5f-4429-bf8c-75b8b0749888 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:44.290371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1884f712-4a5f-4429-bf8c-75b8b0749888 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:44.290804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1884f712-4a5f-4429-bf8c-75b8b0749888 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:44.425503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1884f712-4a5f-4429-bf8c-75b8b0749888 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:44.433874 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1884f712-4a5f-4429-bf8c-75b8b0749888 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1676 microversion: 2.1 time: 0.160836 Aug 27 05:30:44.434458 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3624/7201] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:44 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:45.445762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-f9ce470d-230e-4beb-8c6c-548ac3127a3d req-eda8457a-d39d-4c8b-8bd8-d6071e224f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34e42ff-f325-421d-b150-3166d8410347", "name": "network-vif-deleted", "tag": "77ee6a88-a062-4144-85e2-184095656ac8"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:45.457583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3b1c883-822f-427e-a266-ad02bec4a714 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:45.458209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e3b1c883-822f-427e-a266-ad02bec4a714 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:45.462325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:45.465264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=39 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:45.476076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b1c883-822f-427e-a266-ad02bec4a714 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:45.476625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b1c883-822f-427e-a266-ad02bec4a714 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:45.477079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b1c883-822f-427e-a266-ad02bec4a714 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:45.477805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b1c883-822f-427e-a266-ad02bec4a714 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:45.478272 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b1c883-822f-427e-a266-ad02bec4a714 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:45.478710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b1c883-822f-427e-a266-ad02bec4a714 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:45.484765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f9ce470d-230e-4beb-8c6c-548ac3127a3d req-eda8457a-d39d-4c8b-8bd8-d6071e224f35 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:45.485251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f9ce470d-230e-4beb-8c6c-548ac3127a3d req-eda8457a-d39d-4c8b-8bd8-d6071e224f35 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:45.485674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f9ce470d-230e-4beb-8c6c-548ac3127a3d req-eda8457a-d39d-4c8b-8bd8-d6071e224f35 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:45.508777 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f9ce470d-230e-4beb-8c6c-548ac3127a3d req-eda8457a-d39d-4c8b-8bd8-d6071e224f35 service nova] Creating event network-vif-deleted:77ee6a88-a062-4144-85e2-184095656ac8 for instance b34e42ff-f325-421d-b150-3166d8410347 on n-h1-854823-1 Aug 27 05:30:45.522726 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-f9ce470d-230e-4beb-8c6c-548ac3127a3d req-eda8457a-d39d-4c8b-8bd8-d6071e224f35 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080688 Aug 27 05:30:45.523990 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3578/7202] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:45.915041 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e3b1c883-822f-427e-a266-ad02bec4a714 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:45.924379 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3b1c883-822f-427e-a266-ad02bec4a714 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 200 len: 1324 microversion: 2.1 time: 0.472879 Aug 27 05:30:45.925088 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3625/7203] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:45 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 1324 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:46.946313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7f2d3e3f-ba63-40ba-a031-ca6e5e621244 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:46.947018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7f2d3e3f-ba63-40ba-a031-ca6e5e621244 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:46.954960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f2d3e3f-ba63-40ba-a031-ca6e5e621244 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:46.955451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f2d3e3f-ba63-40ba-a031-ca6e5e621244 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:46.955894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f2d3e3f-ba63-40ba-a031-ca6e5e621244 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:46.956637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f2d3e3f-ba63-40ba-a031-ca6e5e621244 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:46.957129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f2d3e3f-ba63-40ba-a031-ca6e5e621244 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:46.957562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7f2d3e3f-ba63-40ba-a031-ca6e5e621244 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:46.970888 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-7f2d3e3f-ba63-40ba-a031-ca6e5e621244 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7f2d3e3f-ba63-40ba-a031-ca6e5e621244 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 HTTP/1.1 Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'b34e42ff-f325-421d-b150-3166d8410347'} Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:30:46.972518 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:30:46.977196 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:30:46.977196 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:30:46.977196 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:30:46.977196 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:30:46.977196 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:30:46.977196 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:30:46.977196 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:30:46.977196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7f2d3e3f-ba63-40ba-a031-ca6e5e621244 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:30:46.977196 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7f2d3e3f-ba63-40ba-a031-ca6e5e621244 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 404 len: 111 microversion: 2.1 time: 0.031883 Aug 27 05:30:46.977196 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3579/7204] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:46 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:30:46.988612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62a60070-3654-4db5-9d61-76aa84c41b30 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:46.989246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-62a60070-3654-4db5-9d61-76aa84c41b30 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:46.996180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62a60070-3654-4db5-9d61-76aa84c41b30 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:46.996718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62a60070-3654-4db5-9d61-76aa84c41b30 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:46.997172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62a60070-3654-4db5-9d61-76aa84c41b30 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:46.997878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62a60070-3654-4db5-9d61-76aa84c41b30 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:46.998365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62a60070-3654-4db5-9d61-76aa84c41b30 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:46.998791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62a60070-3654-4db5-9d61-76aa84c41b30 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:47.012713 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-62a60070-3654-4db5-9d61-76aa84c41b30 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62a60070-3654-4db5-9d61-76aa84c41b30 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 HTTP/1.1 Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'b34e42ff-f325-421d-b150-3166d8410347'} Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:30:47.014342 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:30:47.019207 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:30:47.019207 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:30:47.019207 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:30:47.019207 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:30:47.019207 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:30:47.019207 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:30:47.019207 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:30:47.019207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62a60070-3654-4db5-9d61-76aa84c41b30 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:30:47.019207 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62a60070-3654-4db5-9d61-76aa84c41b30 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 404 len: 111 microversion: 2.1 time: 0.031171 Aug 27 05:30:47.019207 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3626/7205] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:46 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:30:47.065304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-70929312", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "3d36ef21-7849-4c26-ad65-ccb331d9c655"}], "security_groups": [{"name": "tempest-securitygroup--772549537"}], "key_name": "tempest-keypair-2067790246", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:47.170631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] validate_networks() for [('3d36ef21-7849-4c26-ad65-ccb331d9c655', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:30:47.616612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:30:47.617046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:30:47.617534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:30:47.617951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:30:47.618372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:30:47.627312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:47.627891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:47.628340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:47.629187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:47.629654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:47.630088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:47.647070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Getting quotas for project e2a7ba2c76574547b50a17bb289f2c8b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:30:47.652626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Getting quotas for user cdebfdf54a7e4026bfa98c8c308a4456 and project e2a7ba2c76574547b50a17bb289f2c8b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:30:47.665521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:30:47.667819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:30:47.715986 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1f09e71e-02c5-41e3-852d-21403761c2ae tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.655162 Aug 27 05:30:47.716674 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3580/7206] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:30:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:30:47.728592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-962b0df0-a707-4881-8438-6dd1307ed2ec tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:47.729230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-962b0df0-a707-4881-8438-6dd1307ed2ec tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:47.783199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-962b0df0-a707-4881-8438-6dd1307ed2ec tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:47.790796 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-962b0df0-a707-4881-8438-6dd1307ed2ec tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1237 microversion: 2.1 time: 0.066111 Aug 27 05:30:47.791381 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3627/7207] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:47 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:48.815990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-59bab2d8-e13d-410d-9092-39ea93aa4c84 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:48.816636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-59bab2d8-e13d-410d-9092-39ea93aa4c84 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:48.824075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59bab2d8-e13d-410d-9092-39ea93aa4c84 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:48.824857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59bab2d8-e13d-410d-9092-39ea93aa4c84 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:48.825292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59bab2d8-e13d-410d-9092-39ea93aa4c84 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:48.825995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59bab2d8-e13d-410d-9092-39ea93aa4c84 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:48.826450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59bab2d8-e13d-410d-9092-39ea93aa4c84 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:48.826873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-59bab2d8-e13d-410d-9092-39ea93aa4c84 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:48.912360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-59bab2d8-e13d-410d-9092-39ea93aa4c84 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:48.920482 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-59bab2d8-e13d-410d-9092-39ea93aa4c84 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1295 microversion: 2.1 time: 0.110743 Aug 27 05:30:48.921777 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3581/7208] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:48 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1295 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:49.941778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4bd3bec6-4727-470d-bd8e-adeb9e96da4e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:49.942529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4bd3bec6-4727-470d-bd8e-adeb9e96da4e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:49.950706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd3bec6-4727-470d-bd8e-adeb9e96da4e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:49.951216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd3bec6-4727-470d-bd8e-adeb9e96da4e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:49.951673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd3bec6-4727-470d-bd8e-adeb9e96da4e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:49.952396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd3bec6-4727-470d-bd8e-adeb9e96da4e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:49.952900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd3bec6-4727-470d-bd8e-adeb9e96da4e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:49.953350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd3bec6-4727-470d-bd8e-adeb9e96da4e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:50.022280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-38279178-39fe-4203-97e5-329ac9b4ac9d req-d221d622-4b0c-409f-a386-1c6e6cc6ade6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33984b8b-7bba-4a1c-be2d-09536810a75b", "tag": "fde2cdc9-f813-4b41-ac00-c715d2c477b2"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:50.034656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-38279178-39fe-4203-97e5-329ac9b4ac9d req-d221d622-4b0c-409f-a386-1c6e6cc6ade6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:50.035144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-38279178-39fe-4203-97e5-329ac9b4ac9d req-d221d622-4b0c-409f-a386-1c6e6cc6ade6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:50.035584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-38279178-39fe-4203-97e5-329ac9b4ac9d req-d221d622-4b0c-409f-a386-1c6e6cc6ade6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:50.053115 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-38279178-39fe-4203-97e5-329ac9b4ac9d req-d221d622-4b0c-409f-a386-1c6e6cc6ade6 service nova] Creating event network-changed:fde2cdc9-f813-4b41-ac00-c715d2c477b2 for instance 33984b8b-7bba-4a1c-be2d-09536810a75b on n-h1-854823-1 Aug 27 05:30:50.058456 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-38279178-39fe-4203-97e5-329ac9b4ac9d req-d221d622-4b0c-409f-a386-1c6e6cc6ade6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039949 Aug 27 05:30:50.059377 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3582/7209] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:30:50.093785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4bd3bec6-4727-470d-bd8e-adeb9e96da4e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:50.102843 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4bd3bec6-4727-470d-bd8e-adeb9e96da4e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1362 microversion: 2.1 time: 0.164881 Aug 27 05:30:50.103591 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3628/7210] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:49 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:51.125961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-96a8d058-a0ad-4241-9dc8-7d65e363d7cd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:51.126740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-96a8d058-a0ad-4241-9dc8-7d65e363d7cd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:51.134387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96a8d058-a0ad-4241-9dc8-7d65e363d7cd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:51.134902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96a8d058-a0ad-4241-9dc8-7d65e363d7cd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:51.135329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96a8d058-a0ad-4241-9dc8-7d65e363d7cd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:51.136046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96a8d058-a0ad-4241-9dc8-7d65e363d7cd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:51.136507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96a8d058-a0ad-4241-9dc8-7d65e363d7cd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:51.136968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96a8d058-a0ad-4241-9dc8-7d65e363d7cd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:51.274957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-96a8d058-a0ad-4241-9dc8-7d65e363d7cd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:51.283857 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-96a8d058-a0ad-4241-9dc8-7d65e363d7cd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1362 microversion: 2.1 time: 0.163971 Aug 27 05:30:51.284840 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3583/7211] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:51 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:52.305994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a9e05205-e80a-4cb4-9944-e858fc120a60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:52.306615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a9e05205-e80a-4cb4-9944-e858fc120a60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:52.313491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9e05205-e80a-4cb4-9944-e858fc120a60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:52.313987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9e05205-e80a-4cb4-9944-e858fc120a60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:52.314470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9e05205-e80a-4cb4-9944-e858fc120a60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:52.315138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9e05205-e80a-4cb4-9944-e858fc120a60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:52.315605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9e05205-e80a-4cb4-9944-e858fc120a60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:52.316040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9e05205-e80a-4cb4-9944-e858fc120a60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:52.455509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a9e05205-e80a-4cb4-9944-e858fc120a60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:52.465617 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a9e05205-e80a-4cb4-9944-e858fc120a60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1362 microversion: 2.1 time: 0.163507 Aug 27 05:30:52.466203 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3629/7212] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:52 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:53.487585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b90f5d32-2516-4a89-9ab0-f72bf88b551a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:53.488326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b90f5d32-2516-4a89-9ab0-f72bf88b551a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:53.495188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b90f5d32-2516-4a89-9ab0-f72bf88b551a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:53.495669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b90f5d32-2516-4a89-9ab0-f72bf88b551a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:53.496102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b90f5d32-2516-4a89-9ab0-f72bf88b551a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:53.496810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b90f5d32-2516-4a89-9ab0-f72bf88b551a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:53.497264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b90f5d32-2516-4a89-9ab0-f72bf88b551a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:53.497688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b90f5d32-2516-4a89-9ab0-f72bf88b551a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:53.627942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b90f5d32-2516-4a89-9ab0-f72bf88b551a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:53.635743 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b90f5d32-2516-4a89-9ab0-f72bf88b551a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1362 microversion: 2.1 time: 0.152297 Aug 27 05:30:53.636318 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3584/7213] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:53 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:54.561980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-01482682-74ec-44e6-910b-2e52876eb2f5 req-3d2ccd27-334c-482d-a90b-92c2834fa3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33984b8b-7bba-4a1c-be2d-09536810a75b", "name": "network-vif-plugged", "status": "completed", "tag": "fde2cdc9-f813-4b41-ac00-c715d2c477b2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:54.573258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-01482682-74ec-44e6-910b-2e52876eb2f5 req-3d2ccd27-334c-482d-a90b-92c2834fa3e9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:54.573764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-01482682-74ec-44e6-910b-2e52876eb2f5 req-3d2ccd27-334c-482d-a90b-92c2834fa3e9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:54.574214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-01482682-74ec-44e6-910b-2e52876eb2f5 req-3d2ccd27-334c-482d-a90b-92c2834fa3e9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:54.586016 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-01482682-74ec-44e6-910b-2e52876eb2f5 req-3d2ccd27-334c-482d-a90b-92c2834fa3e9 service nova] Creating event network-vif-plugged:fde2cdc9-f813-4b41-ac00-c715d2c477b2 for instance 33984b8b-7bba-4a1c-be2d-09536810a75b on n-h1-854823-1 Aug 27 05:30:54.591102 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-01482682-74ec-44e6-910b-2e52876eb2f5 req-3d2ccd27-334c-482d-a90b-92c2834fa3e9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032805 Aug 27 05:30:54.591703 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3630/7214] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:54.657820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c9f4f5ed-b598-474c-a0bc-6ff295992496 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:54.658469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c9f4f5ed-b598-474c-a0bc-6ff295992496 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:54.665340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f4f5ed-b598-474c-a0bc-6ff295992496 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:54.665837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f4f5ed-b598-474c-a0bc-6ff295992496 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:54.666898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f4f5ed-b598-474c-a0bc-6ff295992496 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:54.667614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f4f5ed-b598-474c-a0bc-6ff295992496 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:54.668077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f4f5ed-b598-474c-a0bc-6ff295992496 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:54.668508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c9f4f5ed-b598-474c-a0bc-6ff295992496 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:54.832656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c9f4f5ed-b598-474c-a0bc-6ff295992496 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:54.840269 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c9f4f5ed-b598-474c-a0bc-6ff295992496 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1362 microversion: 2.1 time: 0.186951 Aug 27 05:30:54.840900 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3585/7215] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:54 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:55.862926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42b0cae4-fa98-432a-a6a7-637d60a9da2d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:55.863649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-42b0cae4-fa98-432a-a6a7-637d60a9da2d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:55.869968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b0cae4-fa98-432a-a6a7-637d60a9da2d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:55.870473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b0cae4-fa98-432a-a6a7-637d60a9da2d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:55.870930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b0cae4-fa98-432a-a6a7-637d60a9da2d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:55.871645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b0cae4-fa98-432a-a6a7-637d60a9da2d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:55.872121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b0cae4-fa98-432a-a6a7-637d60a9da2d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:55.872590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42b0cae4-fa98-432a-a6a7-637d60a9da2d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:56.004298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-42b0cae4-fa98-432a-a6a7-637d60a9da2d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:56.012087 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42b0cae4-fa98-432a-a6a7-637d60a9da2d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1362 microversion: 2.1 time: 0.154292 Aug 27 05:30:56.012697 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3631/7216] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:55 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:57.033699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9b5a9094-276c-406f-aeef-fdda0b4fe1da tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:57.034309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9b5a9094-276c-406f-aeef-fdda0b4fe1da tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:57.041221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b5a9094-276c-406f-aeef-fdda0b4fe1da tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:57.041700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b5a9094-276c-406f-aeef-fdda0b4fe1da tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:57.042130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b5a9094-276c-406f-aeef-fdda0b4fe1da tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:57.042818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b5a9094-276c-406f-aeef-fdda0b4fe1da tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:57.043277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b5a9094-276c-406f-aeef-fdda0b4fe1da tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:57.043697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9b5a9094-276c-406f-aeef-fdda0b4fe1da tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:57.175600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9b5a9094-276c-406f-aeef-fdda0b4fe1da tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:30:57.185908 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9b5a9094-276c-406f-aeef-fdda0b4fe1da tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1550 microversion: 2.1 time: 0.156704 Aug 27 05:30:57.186535 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3586/7217] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:30:57 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:30:57.206983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e4c3b78-caae-4ec0-954e-a2ff1836e6e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:30:57.207502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e4c3b78-caae-4ec0-954e-a2ff1836e6e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:30:57.214719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e4c3b78-caae-4ec0-954e-a2ff1836e6e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:57.215225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e4c3b78-caae-4ec0-954e-a2ff1836e6e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:57.215684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e4c3b78-caae-4ec0-954e-a2ff1836e6e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:57.216807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e4c3b78-caae-4ec0-954e-a2ff1836e6e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:57.216942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e4c3b78-caae-4ec0-954e-a2ff1836e6e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:57.217956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e4c3b78-caae-4ec0-954e-a2ff1836e6e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:57.313079 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e4c3b78-caae-4ec0-954e-a2ff1836e6e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109935 Aug 27 05:30:57.313676 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3632/7218] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 05:30:57 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:30:58.300172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:58.301784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:30:58.359644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a3d3dfdf-b68d-4fec-839a-8611819adc8a req-7416b9e3-1306-495c-bb63-e4b97b437416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33984b8b-7bba-4a1c-be2d-09536810a75b", "tag": "fde2cdc9-f813-4b41-ac00-c715d2c477b2"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:30:58.371851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a3d3dfdf-b68d-4fec-839a-8611819adc8a req-7416b9e3-1306-495c-bb63-e4b97b437416 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:30:58.372328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a3d3dfdf-b68d-4fec-839a-8611819adc8a req-7416b9e3-1306-495c-bb63-e4b97b437416 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:30:58.372783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a3d3dfdf-b68d-4fec-839a-8611819adc8a req-7416b9e3-1306-495c-bb63-e4b97b437416 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:30:58.386238 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a3d3dfdf-b68d-4fec-839a-8611819adc8a req-7416b9e3-1306-495c-bb63-e4b97b437416 service nova] Creating event network-changed:fde2cdc9-f813-4b41-ac00-c715d2c477b2 for instance 33984b8b-7bba-4a1c-be2d-09536810a75b on n-h1-854823-1 Aug 27 05:30:58.391460 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a3d3dfdf-b68d-4fec-839a-8611819adc8a req-7416b9e3-1306-495c-bb63-e4b97b437416 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095943 Aug 27 05:30:58.392063 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3587/7219] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:10.325868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:10.328036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=17 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:10.328735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:10.333413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:10.335623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:10.346314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:10.346659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:10.347111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:10.347827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:10.348301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:10.348769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:10.381077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:10.389371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Old instance type m1.heat2, new instance type m1.heat {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:32:10.395898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:32:10.396329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:32:10.396843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:32:10.397264 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:32:10.397678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:32:10.460836 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-255905af-6931-48fd-901e-9581bb4323c0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b/action" status: 202 len: 0 microversion: 2.1 time: 0.136166 Aug 27 05:32:10.461509 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3633/7220] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:32:10 2022] POST /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:32:10.468754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:10.469581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:10.474465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-367c4391-5fde-4937-ab59-a2ae075f5e35 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:10.475167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-367c4391-5fde-4937-ab59-a2ae075f5e35 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:10.491039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-367c4391-5fde-4937-ab59-a2ae075f5e35 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:10.491519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-367c4391-5fde-4937-ab59-a2ae075f5e35 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:10.491962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-367c4391-5fde-4937-ab59-a2ae075f5e35 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:10.492691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-367c4391-5fde-4937-ab59-a2ae075f5e35 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:10.493149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-367c4391-5fde-4937-ab59-a2ae075f5e35 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:10.493571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-367c4391-5fde-4937-ab59-a2ae075f5e35 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:10.664092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-367c4391-5fde-4937-ab59-a2ae075f5e35 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:10.672120 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-367c4391-5fde-4937-ab59-a2ae075f5e35 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1678 microversion: 2.1 time: 0.206185 Aug 27 05:32:10.672752 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3588/7221] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:10 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:32:11.693809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98581655-7475-465d-8f00-04aba3711625 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:11.694451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98581655-7475-465d-8f00-04aba3711625 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:11.701112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98581655-7475-465d-8f00-04aba3711625 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:11.701620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98581655-7475-465d-8f00-04aba3711625 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:11.702075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98581655-7475-465d-8f00-04aba3711625 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:11.702790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98581655-7475-465d-8f00-04aba3711625 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:11.703262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98581655-7475-465d-8f00-04aba3711625 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:11.703704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98581655-7475-465d-8f00-04aba3711625 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:11.839555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-98581655-7475-465d-8f00-04aba3711625 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:11.847534 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98581655-7475-465d-8f00-04aba3711625 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1678 microversion: 2.1 time: 0.157694 Aug 27 05:32:11.848117 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3634/7222] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:11 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:12.869421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1cc65fa5-aaeb-4aa1-afca-e00080df6f20 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:12.870069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1cc65fa5-aaeb-4aa1-afca-e00080df6f20 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:12.877411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cc65fa5-aaeb-4aa1-afca-e00080df6f20 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:12.877900 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cc65fa5-aaeb-4aa1-afca-e00080df6f20 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:12.878338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cc65fa5-aaeb-4aa1-afca-e00080df6f20 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:12.879085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cc65fa5-aaeb-4aa1-afca-e00080df6f20 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:12.879547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cc65fa5-aaeb-4aa1-afca-e00080df6f20 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:12.879976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1cc65fa5-aaeb-4aa1-afca-e00080df6f20 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:13.011748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1cc65fa5-aaeb-4aa1-afca-e00080df6f20 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:13.020204 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1cc65fa5-aaeb-4aa1-afca-e00080df6f20 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.154724 Aug 27 05:32:13.020809 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3589/7223] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:12 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:14.043547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c113c8f5-8d7d-4ef8-8077-5850abea6f2c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:14.044179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c113c8f5-8d7d-4ef8-8077-5850abea6f2c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:14.051188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c113c8f5-8d7d-4ef8-8077-5850abea6f2c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:14.051690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c113c8f5-8d7d-4ef8-8077-5850abea6f2c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:14.052143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c113c8f5-8d7d-4ef8-8077-5850abea6f2c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:14.052889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c113c8f5-8d7d-4ef8-8077-5850abea6f2c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:14.053366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c113c8f5-8d7d-4ef8-8077-5850abea6f2c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:14.053812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c113c8f5-8d7d-4ef8-8077-5850abea6f2c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:14.189463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c113c8f5-8d7d-4ef8-8077-5850abea6f2c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:14.197220 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c113c8f5-8d7d-4ef8-8077-5850abea6f2c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.157729 Aug 27 05:32:14.197800 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3635/7224] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:14 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:15.218721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5d366e64-d8c9-487a-bd22-b7cd8ddfb9db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:15.219327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5d366e64-d8c9-487a-bd22-b7cd8ddfb9db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:15.226819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d366e64-d8c9-487a-bd22-b7cd8ddfb9db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:15.227297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d366e64-d8c9-487a-bd22-b7cd8ddfb9db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:15.227731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d366e64-d8c9-487a-bd22-b7cd8ddfb9db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:15.228413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d366e64-d8c9-487a-bd22-b7cd8ddfb9db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:15.228898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d366e64-d8c9-487a-bd22-b7cd8ddfb9db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:15.229320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d366e64-d8c9-487a-bd22-b7cd8ddfb9db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:15.358545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5d366e64-d8c9-487a-bd22-b7cd8ddfb9db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:15.366450 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5d366e64-d8c9-487a-bd22-b7cd8ddfb9db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.151649 Aug 27 05:32:15.367034 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3590/7225] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:15 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:16.388055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60febe0a-0d37-43a0-9406-42dcc84acc60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:16.388719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60febe0a-0d37-43a0-9406-42dcc84acc60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:16.395637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60febe0a-0d37-43a0-9406-42dcc84acc60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:16.396142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60febe0a-0d37-43a0-9406-42dcc84acc60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:16.396623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60febe0a-0d37-43a0-9406-42dcc84acc60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:16.397340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60febe0a-0d37-43a0-9406-42dcc84acc60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:16.397817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60febe0a-0d37-43a0-9406-42dcc84acc60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:16.398261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60febe0a-0d37-43a0-9406-42dcc84acc60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:16.535991 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60febe0a-0d37-43a0-9406-42dcc84acc60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:16.546328 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60febe0a-0d37-43a0-9406-42dcc84acc60 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.162226 Aug 27 05:32:16.546926 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3636/7226] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:16 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:17.569152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-75f042a5-36ad-42d8-80eb-c46d89a7af31 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:17.569775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-75f042a5-36ad-42d8-80eb-c46d89a7af31 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:17.577379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75f042a5-36ad-42d8-80eb-c46d89a7af31 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:17.577865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75f042a5-36ad-42d8-80eb-c46d89a7af31 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:17.578302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75f042a5-36ad-42d8-80eb-c46d89a7af31 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:17.579641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75f042a5-36ad-42d8-80eb-c46d89a7af31 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:17.580100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75f042a5-36ad-42d8-80eb-c46d89a7af31 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:17.580558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75f042a5-36ad-42d8-80eb-c46d89a7af31 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:17.710989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-75f042a5-36ad-42d8-80eb-c46d89a7af31 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:17.718643 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-75f042a5-36ad-42d8-80eb-c46d89a7af31 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.153548 Aug 27 05:32:17.719222 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3591/7227] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:17 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:18.740558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe894230-3ac9-4c11-9d63-9281e1cde320 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:18.741163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe894230-3ac9-4c11-9d63-9281e1cde320 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:18.748519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe894230-3ac9-4c11-9d63-9281e1cde320 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:18.749033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe894230-3ac9-4c11-9d63-9281e1cde320 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:18.749478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe894230-3ac9-4c11-9d63-9281e1cde320 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:18.750218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe894230-3ac9-4c11-9d63-9281e1cde320 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:18.750690 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe894230-3ac9-4c11-9d63-9281e1cde320 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:18.751119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe894230-3ac9-4c11-9d63-9281e1cde320 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:18.886167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe894230-3ac9-4c11-9d63-9281e1cde320 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:18.894911 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe894230-3ac9-4c11-9d63-9281e1cde320 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.158992 Aug 27 05:32:18.895510 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3637/7228] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:18 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:19.915358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7594bc71-7658-4eb7-a0d3-94cae1e29d86 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:19.915982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7594bc71-7658-4eb7-a0d3-94cae1e29d86 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:19.923001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7594bc71-7658-4eb7-a0d3-94cae1e29d86 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:19.923488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7594bc71-7658-4eb7-a0d3-94cae1e29d86 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:19.923931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7594bc71-7658-4eb7-a0d3-94cae1e29d86 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:19.924656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7594bc71-7658-4eb7-a0d3-94cae1e29d86 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:19.925123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7594bc71-7658-4eb7-a0d3-94cae1e29d86 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:19.925551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7594bc71-7658-4eb7-a0d3-94cae1e29d86 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:20.059512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7594bc71-7658-4eb7-a0d3-94cae1e29d86 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:20.067244 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7594bc71-7658-4eb7-a0d3-94cae1e29d86 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.155809 Aug 27 05:32:20.067826 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3592/7229] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:19 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:21.088498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd9ceb17-03d2-498c-a5da-54868c9c5662 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:21.089157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd9ceb17-03d2-498c-a5da-54868c9c5662 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:21.096774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd9ceb17-03d2-498c-a5da-54868c9c5662 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:21.097280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd9ceb17-03d2-498c-a5da-54868c9c5662 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:21.097740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd9ceb17-03d2-498c-a5da-54868c9c5662 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:21.098455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd9ceb17-03d2-498c-a5da-54868c9c5662 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:21.098931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd9ceb17-03d2-498c-a5da-54868c9c5662 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:21.099376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd9ceb17-03d2-498c-a5da-54868c9c5662 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:21.231080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd9ceb17-03d2-498c-a5da-54868c9c5662 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:21.239732 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd9ceb17-03d2-498c-a5da-54868c9c5662 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.155157 Aug 27 05:32:21.240318 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3638/7230] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:21 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:22.260964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-865f74c8-954b-48cd-a973-2465e32ae185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:22.261585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-865f74c8-954b-48cd-a973-2465e32ae185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:22.268854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-865f74c8-954b-48cd-a973-2465e32ae185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:22.269349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-865f74c8-954b-48cd-a973-2465e32ae185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:22.269991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-865f74c8-954b-48cd-a973-2465e32ae185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:22.270563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-865f74c8-954b-48cd-a973-2465e32ae185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:22.271138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-865f74c8-954b-48cd-a973-2465e32ae185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:22.271635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-865f74c8-954b-48cd-a973-2465e32ae185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:22.489595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-865f74c8-954b-48cd-a973-2465e32ae185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:22.497422 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-865f74c8-954b-48cd-a973-2465e32ae185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.240423 Aug 27 05:32:22.498185 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3593/7231] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:22 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:23.518966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be9cfa15-3692-4d47-8fa5-c2741ff86ef8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:23.519603 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-be9cfa15-3692-4d47-8fa5-c2741ff86ef8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:23.526565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be9cfa15-3692-4d47-8fa5-c2741ff86ef8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:23.527328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be9cfa15-3692-4d47-8fa5-c2741ff86ef8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:23.527786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be9cfa15-3692-4d47-8fa5-c2741ff86ef8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:23.528496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be9cfa15-3692-4d47-8fa5-c2741ff86ef8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:23.528998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be9cfa15-3692-4d47-8fa5-c2741ff86ef8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:23.529440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be9cfa15-3692-4d47-8fa5-c2741ff86ef8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:23.662443 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be9cfa15-3692-4d47-8fa5-c2741ff86ef8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:23.670278 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be9cfa15-3692-4d47-8fa5-c2741ff86ef8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.155372 Aug 27 05:32:23.670876 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3639/7232] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:23 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:24.692176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6720a2c9-f192-4710-bf78-ccdd15461de8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:24.692948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6720a2c9-f192-4710-bf78-ccdd15461de8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:24.699778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6720a2c9-f192-4710-bf78-ccdd15461de8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:24.700252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6720a2c9-f192-4710-bf78-ccdd15461de8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:24.700721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6720a2c9-f192-4710-bf78-ccdd15461de8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:24.701403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6720a2c9-f192-4710-bf78-ccdd15461de8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:24.701854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6720a2c9-f192-4710-bf78-ccdd15461de8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:24.702274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6720a2c9-f192-4710-bf78-ccdd15461de8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:24.836183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6720a2c9-f192-4710-bf78-ccdd15461de8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:24.845930 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6720a2c9-f192-4710-bf78-ccdd15461de8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.157645 Aug 27 05:32:24.846610 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3594/7233] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:24 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:25.867894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6ff0b67-6052-4fd0-86db-c92a3e4d71fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:25.868556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6ff0b67-6052-4fd0-86db-c92a3e4d71fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:25.875416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ff0b67-6052-4fd0-86db-c92a3e4d71fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:25.875906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ff0b67-6052-4fd0-86db-c92a3e4d71fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:25.876360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ff0b67-6052-4fd0-86db-c92a3e4d71fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:25.877750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ff0b67-6052-4fd0-86db-c92a3e4d71fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:25.878226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ff0b67-6052-4fd0-86db-c92a3e4d71fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:25.878672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6ff0b67-6052-4fd0-86db-c92a3e4d71fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:26.010725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f6ff0b67-6052-4fd0-86db-c92a3e4d71fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:26.018719 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6ff0b67-6052-4fd0-86db-c92a3e4d71fb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.154790 Aug 27 05:32:26.019300 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3640/7234] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:25 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:27.040085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a5e2a2a-0faa-4f9a-a2f9-1dffda3c444c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:27.040732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a5e2a2a-0faa-4f9a-a2f9-1dffda3c444c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:27.047556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a5e2a2a-0faa-4f9a-a2f9-1dffda3c444c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:27.048036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a5e2a2a-0faa-4f9a-a2f9-1dffda3c444c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:27.048474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a5e2a2a-0faa-4f9a-a2f9-1dffda3c444c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:27.049201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a5e2a2a-0faa-4f9a-a2f9-1dffda3c444c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:27.049656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a5e2a2a-0faa-4f9a-a2f9-1dffda3c444c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:27.050083 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a5e2a2a-0faa-4f9a-a2f9-1dffda3c444c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:27.178842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6a5e2a2a-0faa-4f9a-a2f9-1dffda3c444c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:27.186645 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a5e2a2a-0faa-4f9a-a2f9-1dffda3c444c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.150478 Aug 27 05:32:27.187226 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3595/7235] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:27 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:28.208837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5fc69f5a-f856-48af-93b7-f48b4f6a5967 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:28.209471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5fc69f5a-f856-48af-93b7-f48b4f6a5967 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:28.216298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fc69f5a-f856-48af-93b7-f48b4f6a5967 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:28.216831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fc69f5a-f856-48af-93b7-f48b4f6a5967 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:28.217286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fc69f5a-f856-48af-93b7-f48b4f6a5967 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:28.217999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fc69f5a-f856-48af-93b7-f48b4f6a5967 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:28.218709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fc69f5a-f856-48af-93b7-f48b4f6a5967 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:28.218916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fc69f5a-f856-48af-93b7-f48b4f6a5967 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:28.350248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5fc69f5a-f856-48af-93b7-f48b4f6a5967 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:28.357974 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5fc69f5a-f856-48af-93b7-f48b4f6a5967 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.153724 Aug 27 05:32:28.358569 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3641/7236] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:28 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:29.379627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9415ae71-2da9-4ffa-9eea-df7055431757 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:29.380243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9415ae71-2da9-4ffa-9eea-df7055431757 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:29.387061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9415ae71-2da9-4ffa-9eea-df7055431757 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:29.387546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9415ae71-2da9-4ffa-9eea-df7055431757 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:29.387983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9415ae71-2da9-4ffa-9eea-df7055431757 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:29.388714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9415ae71-2da9-4ffa-9eea-df7055431757 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:29.389178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9415ae71-2da9-4ffa-9eea-df7055431757 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:29.389606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9415ae71-2da9-4ffa-9eea-df7055431757 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:29.566702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9415ae71-2da9-4ffa-9eea-df7055431757 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:29.574688 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9415ae71-2da9-4ffa-9eea-df7055431757 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1683 microversion: 2.1 time: 0.199237 Aug 27 05:32:29.575281 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3596/7237] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:29 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1683 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:30.128379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-128a19e0-9d76-433d-bd35-d2dcd5627907 req-9ab9075f-672d-4794-af22-db1a52522511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33984b8b-7bba-4a1c-be2d-09536810a75b", "name": "network-vif-unplugged", "status": "completed", "tag": "fde2cdc9-f813-4b41-ac00-c715d2c477b2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:30.138619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-128a19e0-9d76-433d-bd35-d2dcd5627907 req-9ab9075f-672d-4794-af22-db1a52522511 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:30.139119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-128a19e0-9d76-433d-bd35-d2dcd5627907 req-9ab9075f-672d-4794-af22-db1a52522511 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:30.139565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-128a19e0-9d76-433d-bd35-d2dcd5627907 req-9ab9075f-672d-4794-af22-db1a52522511 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:30.152822 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-128a19e0-9d76-433d-bd35-d2dcd5627907 req-9ab9075f-672d-4794-af22-db1a52522511 service nova] Creating event network-vif-unplugged:fde2cdc9-f813-4b41-ac00-c715d2c477b2 for instance 33984b8b-7bba-4a1c-be2d-09536810a75b on n-h2-854823-1 Aug 27 05:32:30.158348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-128a19e0-9d76-433d-bd35-d2dcd5627907 req-9ab9075f-672d-4794-af22-db1a52522511 service nova] Instance 33984b8b-7bba-4a1c-be2d-09536810a75b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:32:30.169258 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-128a19e0-9d76-433d-bd35-d2dcd5627907 req-9ab9075f-672d-4794-af22-db1a52522511 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045647 Aug 27 05:32:30.169877 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3642/7238] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:30.596980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-edf0c52d-d143-4047-ae94-bcce375d737b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:30.598259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-edf0c52d-d143-4047-ae94-bcce375d737b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:30.605216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edf0c52d-d143-4047-ae94-bcce375d737b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:30.605711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edf0c52d-d143-4047-ae94-bcce375d737b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:30.607028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edf0c52d-d143-4047-ae94-bcce375d737b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:30.608116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edf0c52d-d143-4047-ae94-bcce375d737b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:30.608616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edf0c52d-d143-4047-ae94-bcce375d737b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:30.609069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-edf0c52d-d143-4047-ae94-bcce375d737b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:30.744119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-edf0c52d-d143-4047-ae94-bcce375d737b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:30.753024 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-edf0c52d-d143-4047-ae94-bcce375d737b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1682 microversion: 2.1 time: 0.160109 Aug 27 05:32:30.753621 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3597/7239] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:30 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:31.775840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a85ebf0b-7393-4f77-9049-7b98d74fa943 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:31.776469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a85ebf0b-7393-4f77-9049-7b98d74fa943 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:31.782957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85ebf0b-7393-4f77-9049-7b98d74fa943 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:31.783464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85ebf0b-7393-4f77-9049-7b98d74fa943 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:31.783915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85ebf0b-7393-4f77-9049-7b98d74fa943 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:31.784653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85ebf0b-7393-4f77-9049-7b98d74fa943 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:31.785125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85ebf0b-7393-4f77-9049-7b98d74fa943 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:31.785567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85ebf0b-7393-4f77-9049-7b98d74fa943 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:31.913209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a85ebf0b-7393-4f77-9049-7b98d74fa943 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:31.921010 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a85ebf0b-7393-4f77-9049-7b98d74fa943 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1680 microversion: 2.1 time: 0.150477 Aug 27 05:32:31.921697 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3643/7240] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:31 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:32.196948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-a246fca6-b367-4cdc-8a00-c51a247dfb83 req-69081c0f-0ff0-447d-87a3-646443dcf359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33984b8b-7bba-4a1c-be2d-09536810a75b", "tag": "fde2cdc9-f813-4b41-ac00-c715d2c477b2"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:32.207242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a246fca6-b367-4cdc-8a00-c51a247dfb83 req-69081c0f-0ff0-447d-87a3-646443dcf359 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:32.207756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a246fca6-b367-4cdc-8a00-c51a247dfb83 req-69081c0f-0ff0-447d-87a3-646443dcf359 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:32.208184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-a246fca6-b367-4cdc-8a00-c51a247dfb83 req-69081c0f-0ff0-447d-87a3-646443dcf359 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:32.222791 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-a246fca6-b367-4cdc-8a00-c51a247dfb83 req-69081c0f-0ff0-447d-87a3-646443dcf359 service nova] Creating event network-changed:fde2cdc9-f813-4b41-ac00-c715d2c477b2 for instance 33984b8b-7bba-4a1c-be2d-09536810a75b on n-h2-854823-1 Aug 27 05:32:32.228258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-a246fca6-b367-4cdc-8a00-c51a247dfb83 req-69081c0f-0ff0-447d-87a3-646443dcf359 service nova] Instance 33984b8b-7bba-4a1c-be2d-09536810a75b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:32:32.240133 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-a246fca6-b367-4cdc-8a00-c51a247dfb83 req-69081c0f-0ff0-447d-87a3-646443dcf359 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046688 Aug 27 05:32:32.240790 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3598/7241] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:32.942929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09aae2de-11b6-4f20-9f78-dcdfd3829abe tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:32.943927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-09aae2de-11b6-4f20-9f78-dcdfd3829abe tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:32.955024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09aae2de-11b6-4f20-9f78-dcdfd3829abe tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:32.956562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09aae2de-11b6-4f20-9f78-dcdfd3829abe tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:32.956774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09aae2de-11b6-4f20-9f78-dcdfd3829abe tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:32.958036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09aae2de-11b6-4f20-9f78-dcdfd3829abe tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:32.958896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09aae2de-11b6-4f20-9f78-dcdfd3829abe tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:32.959728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09aae2de-11b6-4f20-9f78-dcdfd3829abe tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:33.186879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09aae2de-11b6-4f20-9f78-dcdfd3829abe tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:33.195606 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09aae2de-11b6-4f20-9f78-dcdfd3829abe tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1677 microversion: 2.1 time: 0.256938 Aug 27 05:32:33.196436 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3644/7242] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:32 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1677 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:33.219761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:33.220933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:33.227625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:33.228125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:33.228669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:33.229383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:33.229843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:33.230273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:33.270409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:33.270409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:33.270855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:33.272372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:33.272869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:33.273329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:33.299849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Getting quotas for project e2a7ba2c76574547b50a17bb289f2c8b. Resources: {'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:32:33.305254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Getting quotas for user cdebfdf54a7e4026bfa98c8c308a4456 and project e2a7ba2c76574547b50a17bb289f2c8b. Resources: {'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:32:33.414752 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-99e33dc9-54ca-40d6-93a4-9443bbfb1097 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b/action" status: 202 len: 0 microversion: 2.1 time: 0.200280 Aug 27 05:32:33.415378 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3599/7243] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:32:33 2022] POST /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:32:33.424023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d238c895-b902-49ca-abaa-f57f21b619c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:33.424695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d238c895-b902-49ca-abaa-f57f21b619c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:33.431156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d238c895-b902-49ca-abaa-f57f21b619c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:33.431663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d238c895-b902-49ca-abaa-f57f21b619c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:33.432322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d238c895-b902-49ca-abaa-f57f21b619c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:33.433255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d238c895-b902-49ca-abaa-f57f21b619c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:33.433938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d238c895-b902-49ca-abaa-f57f21b619c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:33.434613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d238c895-b902-49ca-abaa-f57f21b619c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:33.644312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d238c895-b902-49ca-abaa-f57f21b619c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:33.652466 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d238c895-b902-49ca-abaa-f57f21b619c9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1676 microversion: 2.1 time: 0.232587 Aug 27 05:32:33.653788 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3645/7244] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:33 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1676 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:34.675237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9d3f25a2-e525-42f5-b658-7e9277ca4782 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:34.675951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9d3f25a2-e525-42f5-b658-7e9277ca4782 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:34.685322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d3f25a2-e525-42f5-b658-7e9277ca4782 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:34.686072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d3f25a2-e525-42f5-b658-7e9277ca4782 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:34.686521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d3f25a2-e525-42f5-b658-7e9277ca4782 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:34.687301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d3f25a2-e525-42f5-b658-7e9277ca4782 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:34.687763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d3f25a2-e525-42f5-b658-7e9277ca4782 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:34.688199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9d3f25a2-e525-42f5-b658-7e9277ca4782 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:34.818122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9d3f25a2-e525-42f5-b658-7e9277ca4782 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:34.825853 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9d3f25a2-e525-42f5-b658-7e9277ca4782 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1676 microversion: 2.1 time: 0.155576 Aug 27 05:32:34.826427 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3600/7245] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:34 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:35.847269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e38768d2-b7bc-4f65-96d0-f64b441fc5f1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:35.847826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e38768d2-b7bc-4f65-96d0-f64b441fc5f1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:35.854730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e38768d2-b7bc-4f65-96d0-f64b441fc5f1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:35.855232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e38768d2-b7bc-4f65-96d0-f64b441fc5f1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:35.855681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e38768d2-b7bc-4f65-96d0-f64b441fc5f1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:35.856386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e38768d2-b7bc-4f65-96d0-f64b441fc5f1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:35.856959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e38768d2-b7bc-4f65-96d0-f64b441fc5f1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:35.857401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e38768d2-b7bc-4f65-96d0-f64b441fc5f1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:35.987233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e38768d2-b7bc-4f65-96d0-f64b441fc5f1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:35.995895 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e38768d2-b7bc-4f65-96d0-f64b441fc5f1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1676 microversion: 2.1 time: 0.152605 Aug 27 05:32:35.996484 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3646/7246] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:35 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:37.018956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-466680aa-3f9a-4807-8fd2-388f79a74ac1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:37.019586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-466680aa-3f9a-4807-8fd2-388f79a74ac1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:37.026677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-466680aa-3f9a-4807-8fd2-388f79a74ac1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:37.027424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-466680aa-3f9a-4807-8fd2-388f79a74ac1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:37.027866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-466680aa-3f9a-4807-8fd2-388f79a74ac1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:37.028591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-466680aa-3f9a-4807-8fd2-388f79a74ac1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:37.029053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-466680aa-3f9a-4807-8fd2-388f79a74ac1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:37.029482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-466680aa-3f9a-4807-8fd2-388f79a74ac1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:37.176748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-466680aa-3f9a-4807-8fd2-388f79a74ac1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:37.180299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:37.186270 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-466680aa-3f9a-4807-8fd2-388f79a74ac1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1676 microversion: 2.1 time: 0.172067 Aug 27 05:32:37.186844 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3601/7247] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:37 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:38.155891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-bf7ed5b7-7fd8-4bcd-bc37-d778ec23aaa4 req-36945901-0640-4746-a16f-aa06178817d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33984b8b-7bba-4a1c-be2d-09536810a75b", "tag": "fde2cdc9-f813-4b41-ac00-c715d2c477b2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:38.166742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bf7ed5b7-7fd8-4bcd-bc37-d778ec23aaa4 req-36945901-0640-4746-a16f-aa06178817d9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:38.167238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bf7ed5b7-7fd8-4bcd-bc37-d778ec23aaa4 req-36945901-0640-4746-a16f-aa06178817d9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:38.167688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bf7ed5b7-7fd8-4bcd-bc37-d778ec23aaa4 req-36945901-0640-4746-a16f-aa06178817d9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:38.179496 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-bf7ed5b7-7fd8-4bcd-bc37-d778ec23aaa4 req-36945901-0640-4746-a16f-aa06178817d9 service nova] Creating event network-changed:fde2cdc9-f813-4b41-ac00-c715d2c477b2 for instance 33984b8b-7bba-4a1c-be2d-09536810a75b on n-h1-854823-1 Aug 27 05:32:38.184912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-bf7ed5b7-7fd8-4bcd-bc37-d778ec23aaa4 req-36945901-0640-4746-a16f-aa06178817d9 service nova] Instance 33984b8b-7bba-4a1c-be2d-09536810a75b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:32:38.196213 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-bf7ed5b7-7fd8-4bcd-bc37-d778ec23aaa4 req-36945901-0640-4746-a16f-aa06178817d9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098344 Aug 27 05:32:38.196843 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3647/7248] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:38.214350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f8c8ddcb-03ed-46c9-97fe-f37b6e7eb1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:38.214965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f8c8ddcb-03ed-46c9-97fe-f37b6e7eb1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:38.224179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8c8ddcb-03ed-46c9-97fe-f37b6e7eb1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:38.224991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8c8ddcb-03ed-46c9-97fe-f37b6e7eb1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:38.225441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8c8ddcb-03ed-46c9-97fe-f37b6e7eb1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:38.226160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8c8ddcb-03ed-46c9-97fe-f37b6e7eb1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:38.226622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8c8ddcb-03ed-46c9-97fe-f37b6e7eb1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:38.227270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8c8ddcb-03ed-46c9-97fe-f37b6e7eb1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:38.492510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f8c8ddcb-03ed-46c9-97fe-f37b6e7eb1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:38.501271 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f8c8ddcb-03ed-46c9-97fe-f37b6e7eb1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1676 microversion: 2.1 time: 0.297540 Aug 27 05:32:38.503265 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3602/7249] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:38 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1676 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:39.525159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42e14fc1-18c7-4164-9506-524034c02b38 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:39.525871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-42e14fc1-18c7-4164-9506-524034c02b38 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:39.532437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42e14fc1-18c7-4164-9506-524034c02b38 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:39.533582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42e14fc1-18c7-4164-9506-524034c02b38 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:39.534032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42e14fc1-18c7-4164-9506-524034c02b38 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:39.534736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42e14fc1-18c7-4164-9506-524034c02b38 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:39.535203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42e14fc1-18c7-4164-9506-524034c02b38 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:39.535660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42e14fc1-18c7-4164-9506-524034c02b38 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:39.670438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-42e14fc1-18c7-4164-9506-524034c02b38 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:39.674135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:39.679518 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42e14fc1-18c7-4164-9506-524034c02b38 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1676 microversion: 2.1 time: 0.159475 Aug 27 05:32:39.680103 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3648/7250] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:39 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:40.700842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8aa32cb1-eade-496f-a2d4-65ad297d599c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:40.701463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8aa32cb1-eade-496f-a2d4-65ad297d599c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:40.704182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:40.709478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa32cb1-eade-496f-a2d4-65ad297d599c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:40.709975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa32cb1-eade-496f-a2d4-65ad297d599c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:40.710424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa32cb1-eade-496f-a2d4-65ad297d599c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:40.711133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa32cb1-eade-496f-a2d4-65ad297d599c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:40.711596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa32cb1-eade-496f-a2d4-65ad297d599c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:40.712028 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8aa32cb1-eade-496f-a2d4-65ad297d599c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:40.845896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8aa32cb1-eade-496f-a2d4-65ad297d599c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:40.853650 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8aa32cb1-eade-496f-a2d4-65ad297d599c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1676 microversion: 2.1 time: 0.156847 Aug 27 05:32:40.854213 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3603/7251] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:40 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:41.875988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a614dce2-ec10-46b1-a88f-10930e47ed7f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:41.877283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a614dce2-ec10-46b1-a88f-10930e47ed7f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:41.879826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=37 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:41.885666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a614dce2-ec10-46b1-a88f-10930e47ed7f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:41.886160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a614dce2-ec10-46b1-a88f-10930e47ed7f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:41.886607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a614dce2-ec10-46b1-a88f-10930e47ed7f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:41.887307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a614dce2-ec10-46b1-a88f-10930e47ed7f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:41.887773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a614dce2-ec10-46b1-a88f-10930e47ed7f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:41.888211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a614dce2-ec10-46b1-a88f-10930e47ed7f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:42.016209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a614dce2-ec10-46b1-a88f-10930e47ed7f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:42.024112 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a614dce2-ec10-46b1-a88f-10930e47ed7f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1669 microversion: 2.1 time: 0.152917 Aug 27 05:32:42.024720 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3649/7252] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:41 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:42.045191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b854457c-59a1-48e1-bc42-94461de0a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:42.045830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b854457c-59a1-48e1-bc42-94461de0a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:42.053366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b854457c-59a1-48e1-bc42-94461de0a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:42.053858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b854457c-59a1-48e1-bc42-94461de0a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:42.054290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b854457c-59a1-48e1-bc42-94461de0a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:42.054985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b854457c-59a1-48e1-bc42-94461de0a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:42.055439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b854457c-59a1-48e1-bc42-94461de0a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:42.055859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b854457c-59a1-48e1-bc42-94461de0a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:42.191844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b854457c-59a1-48e1-bc42-94461de0a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:42.199551 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b854457c-59a1-48e1-bc42-94461de0a2f7 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1669 microversion: 2.1 time: 0.158247 Aug 27 05:32:42.200135 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3604/7253] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:42 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:42.219254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e8b1275-4e1a-4d0b-bea4-c850cc3a0d22 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:42.220017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e8b1275-4e1a-4d0b-bea4-c850cc3a0d22 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:42.226553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e8b1275-4e1a-4d0b-bea4-c850cc3a0d22 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:42.227059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e8b1275-4e1a-4d0b-bea4-c850cc3a0d22 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:42.227514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e8b1275-4e1a-4d0b-bea4-c850cc3a0d22 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:42.228230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e8b1275-4e1a-4d0b-bea4-c850cc3a0d22 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:42.228740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e8b1275-4e1a-4d0b-bea4-c850cc3a0d22 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:42.229206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e8b1275-4e1a-4d0b-bea4-c850cc3a0d22 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:42.360131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2e8b1275-4e1a-4d0b-bea4-c850cc3a0d22 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:42.368623 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e8b1275-4e1a-4d0b-bea4-c850cc3a0d22 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1669 microversion: 2.1 time: 0.153341 Aug 27 05:32:42.369207 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3650/7254] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:42 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:42.389434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d7f0a985-8743-4901-a975-ece363543a2e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:42.389858 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d7f0a985-8743-4901-a975-ece363543a2e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:42.396371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7f0a985-8743-4901-a975-ece363543a2e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:42.396896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7f0a985-8743-4901-a975-ece363543a2e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:42.397339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7f0a985-8743-4901-a975-ece363543a2e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:42.398034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7f0a985-8743-4901-a975-ece363543a2e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:42.398491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7f0a985-8743-4901-a975-ece363543a2e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:42.398920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7f0a985-8743-4901-a975-ece363543a2e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:42.424282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d7f0a985-8743-4901-a975-ece363543a2e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:32:42.503221 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d7f0a985-8743-4901-a975-ece363543a2e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "DELETE /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 204 len: 0 microversion: 2.1 time: 0.117435 Aug 27 05:32:42.503830 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3605/7255] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:32:42 2022] DELETE /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:32:42.512551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f50efd87-8d13-4dc3-93a8-e20325b36536 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:42.513733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f50efd87-8d13-4dc3-93a8-e20325b36536 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:42.520036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f50efd87-8d13-4dc3-93a8-e20325b36536 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:42.520584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f50efd87-8d13-4dc3-93a8-e20325b36536 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:42.521397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f50efd87-8d13-4dc3-93a8-e20325b36536 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:42.522119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f50efd87-8d13-4dc3-93a8-e20325b36536 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:42.522590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f50efd87-8d13-4dc3-93a8-e20325b36536 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:42.523056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f50efd87-8d13-4dc3-93a8-e20325b36536 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:42.652309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f50efd87-8d13-4dc3-93a8-e20325b36536 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:42.660730 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f50efd87-8d13-4dc3-93a8-e20325b36536 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1675 microversion: 2.1 time: 0.152531 Aug 27 05:32:42.661307 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3651/7256] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:42 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:43.682598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3e9c4c09-6583-41f9-b0af-50e01400f7a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:43.683313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3e9c4c09-6583-41f9-b0af-50e01400f7a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:43.686228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:43.692260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e9c4c09-6583-41f9-b0af-50e01400f7a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:43.692787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e9c4c09-6583-41f9-b0af-50e01400f7a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:43.693236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e9c4c09-6583-41f9-b0af-50e01400f7a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:43.693939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e9c4c09-6583-41f9-b0af-50e01400f7a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:43.694408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e9c4c09-6583-41f9-b0af-50e01400f7a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:43.694837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3e9c4c09-6583-41f9-b0af-50e01400f7a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:43.823899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3e9c4c09-6583-41f9-b0af-50e01400f7a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:43.832308 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3e9c4c09-6583-41f9-b0af-50e01400f7a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1675 microversion: 2.1 time: 0.154073 Aug 27 05:32:43.832911 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3606/7257] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:43 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:44.853413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-834737fb-dfff-4e11-bca7-81222088054f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:44.854036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-834737fb-dfff-4e11-bca7-81222088054f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:44.861949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-834737fb-dfff-4e11-bca7-81222088054f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:44.862875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-834737fb-dfff-4e11-bca7-81222088054f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:44.863817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-834737fb-dfff-4e11-bca7-81222088054f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:44.864672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-834737fb-dfff-4e11-bca7-81222088054f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:44.865247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-834737fb-dfff-4e11-bca7-81222088054f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:44.866463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-834737fb-dfff-4e11-bca7-81222088054f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:44.931757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-834737fb-dfff-4e11-bca7-81222088054f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:44.943084 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-834737fb-dfff-4e11-bca7-81222088054f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 200 len: 1608 microversion: 2.1 time: 0.092703 Aug 27 05:32:44.943918 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3652/7258] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:44 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 1608 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:44.996836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d0690f21-d874-46c8-8c3f-7eff057ea41e req-f884e44d-f2e3-4dce-b004-1e6b39d4b098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33984b8b-7bba-4a1c-be2d-09536810a75b", "name": "network-vif-deleted", "tag": "fde2cdc9-f813-4b41-ac00-c715d2c477b2"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:45.012593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d0690f21-d874-46c8-8c3f-7eff057ea41e req-f884e44d-f2e3-4dce-b004-1e6b39d4b098 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:45.013768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d0690f21-d874-46c8-8c3f-7eff057ea41e req-f884e44d-f2e3-4dce-b004-1e6b39d4b098 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:45.014392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d0690f21-d874-46c8-8c3f-7eff057ea41e req-f884e44d-f2e3-4dce-b004-1e6b39d4b098 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:45.026906 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d0690f21-d874-46c8-8c3f-7eff057ea41e req-f884e44d-f2e3-4dce-b004-1e6b39d4b098 service nova] Creating event network-vif-deleted:fde2cdc9-f813-4b41-ac00-c715d2c477b2 for instance 33984b8b-7bba-4a1c-be2d-09536810a75b on n-h1-854823-1 Aug 27 05:32:45.034744 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d0690f21-d874-46c8-8c3f-7eff057ea41e req-f884e44d-f2e3-4dce-b004-1e6b39d4b098 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041701 Aug 27 05:32:45.035814 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3607/7259] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:45.964643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-621e7e5f-c88f-4544-bdc0-a81e4df6e30b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:45.965169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-621e7e5f-c88f-4544-bdc0-a81e4df6e30b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:45.972989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-621e7e5f-c88f-4544-bdc0-a81e4df6e30b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:45.973502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-621e7e5f-c88f-4544-bdc0-a81e4df6e30b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:45.973961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-621e7e5f-c88f-4544-bdc0-a81e4df6e30b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:45.974684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-621e7e5f-c88f-4544-bdc0-a81e4df6e30b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:45.975144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-621e7e5f-c88f-4544-bdc0-a81e4df6e30b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:45.975586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-621e7e5f-c88f-4544-bdc0-a81e4df6e30b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:45.992782 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-621e7e5f-c88f-4544-bdc0-a81e4df6e30b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-621e7e5f-c88f-4544-bdc0-a81e4df6e30b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b HTTP/1.1 Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '33984b8b-7bba-4a1c-be2d-09536810a75b'} Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:45.994470 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:32:45.998275 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:45.998275 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:32:45.998275 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:32:45.998275 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:32:45.998275 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:32:45.998275 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:32:45.998275 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:32:45.998275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-621e7e5f-c88f-4544-bdc0-a81e4df6e30b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:32:45.998275 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-621e7e5f-c88f-4544-bdc0-a81e4df6e30b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 404 len: 111 microversion: 2.1 time: 0.035380 Aug 27 05:32:45.998275 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3653/7260] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:45 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:32:46.010695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-85cd2800-c5ba-4310-923e-75ecee1f121c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:46.011433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-85cd2800-c5ba-4310-923e-75ecee1f121c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:46.019749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85cd2800-c5ba-4310-923e-75ecee1f121c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:46.020163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85cd2800-c5ba-4310-923e-75ecee1f121c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:46.020669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85cd2800-c5ba-4310-923e-75ecee1f121c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:46.021376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85cd2800-c5ba-4310-923e-75ecee1f121c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:46.025277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85cd2800-c5ba-4310-923e-75ecee1f121c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:46.025963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85cd2800-c5ba-4310-923e-75ecee1f121c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:46.042214 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-85cd2800-c5ba-4310-923e-75ecee1f121c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-85cd2800-c5ba-4310-923e-75ecee1f121c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b HTTP/1.1 Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '33984b8b-7bba-4a1c-be2d-09536810a75b'} Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:32:46.043887 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:32:46.048442 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:32:46.048442 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:32:46.048442 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:32:46.048442 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:32:46.048442 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:32:46.048442 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:32:46.048442 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:32:46.048442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-85cd2800-c5ba-4310-923e-75ecee1f121c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:32:46.048442 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-85cd2800-c5ba-4310-923e-75ecee1f121c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 404 len: 111 microversion: 2.1 time: 0.038979 Aug 27 05:32:46.048442 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3608/7261] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:46 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:32:46.095682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-999829855", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "3d36ef21-7849-4c26-ad65-ccb331d9c655"}], "security_groups": [{"name": "tempest-securitygroup--772549537"}], "key_name": "tempest-keypair-2067790246", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:46.198687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] validate_networks() for [('3d36ef21-7849-4c26-ad65-ccb331d9c655', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:32:46.646008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:32:46.646452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:32:46.646947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:32:46.647378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:32:46.647814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:32:46.659360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:46.659868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:46.660324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:46.661112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:46.661585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:46.662036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:46.681622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Getting quotas for project e2a7ba2c76574547b50a17bb289f2c8b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:32:46.686884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Getting quotas for user cdebfdf54a7e4026bfa98c8c308a4456 and project e2a7ba2c76574547b50a17bb289f2c8b. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:32:46.700036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:32:46.702576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:32:46.752558 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7cde0a64-ba52-4672-bf46-59217ab68f3a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.660308 Aug 27 05:32:46.753930 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3654/7262] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:32:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:32:46.764818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-04522762-84dc-471b-941a-306b3bb21e75 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:46.765687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-04522762-84dc-471b-941a-306b3bb21e75 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:46.822541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-04522762-84dc-471b-941a-306b3bb21e75 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:46.833032 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-04522762-84dc-471b-941a-306b3bb21e75 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1238 microversion: 2.1 time: 0.072160 Aug 27 05:32:46.833627 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3609/7263] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:46 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:47.855374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4eb9db97-af6c-4698-8263-c4c8b47d84b8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:47.856011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4eb9db97-af6c-4698-8263-c4c8b47d84b8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:47.865869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eb9db97-af6c-4698-8263-c4c8b47d84b8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:47.866383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eb9db97-af6c-4698-8263-c4c8b47d84b8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:47.866841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eb9db97-af6c-4698-8263-c4c8b47d84b8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:47.867572 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eb9db97-af6c-4698-8263-c4c8b47d84b8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:47.868050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eb9db97-af6c-4698-8263-c4c8b47d84b8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:47.868497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eb9db97-af6c-4698-8263-c4c8b47d84b8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:47.943441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4eb9db97-af6c-4698-8263-c4c8b47d84b8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:47.951366 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4eb9db97-af6c-4698-8263-c4c8b47d84b8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1308 microversion: 2.1 time: 0.101356 Aug 27 05:32:47.951950 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3655/7264] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:47 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:48.972801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-52bc6c22-e92f-42be-91bd-374b2c2e12bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:48.973666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-52bc6c22-e92f-42be-91bd-374b2c2e12bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:48.981088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52bc6c22-e92f-42be-91bd-374b2c2e12bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:48.981576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52bc6c22-e92f-42be-91bd-374b2c2e12bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:48.982016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52bc6c22-e92f-42be-91bd-374b2c2e12bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:48.982713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52bc6c22-e92f-42be-91bd-374b2c2e12bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:48.983175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52bc6c22-e92f-42be-91bd-374b2c2e12bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:48.983706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52bc6c22-e92f-42be-91bd-374b2c2e12bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:49.134088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-42face92-ac4b-4989-94ce-e2e1fe988835 req-27836374-9a8e-47f4-8768-9440e9648e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0334f97-6cec-413e-9395-3783f5ade31f", "tag": "0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:49.144298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42face92-ac4b-4989-94ce-e2e1fe988835 req-27836374-9a8e-47f4-8768-9440e9648e7a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:49.144816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42face92-ac4b-4989-94ce-e2e1fe988835 req-27836374-9a8e-47f4-8768-9440e9648e7a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:49.145263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42face92-ac4b-4989-94ce-e2e1fe988835 req-27836374-9a8e-47f4-8768-9440e9648e7a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:49.157045 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-42face92-ac4b-4989-94ce-e2e1fe988835 req-27836374-9a8e-47f4-8768-9440e9648e7a service nova] Creating event network-changed:0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a for instance a0334f97-6cec-413e-9395-3783f5ade31f on n-h1-854823-1 Aug 27 05:32:49.161933 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-42face92-ac4b-4989-94ce-e2e1fe988835 req-27836374-9a8e-47f4-8768-9440e9648e7a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031853 Aug 27 05:32:49.162554 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3656/7265] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:49.219846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-52bc6c22-e92f-42be-91bd-374b2c2e12bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:49.227719 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-52bc6c22-e92f-42be-91bd-374b2c2e12bc tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1363 microversion: 2.1 time: 0.258906 Aug 27 05:32:49.228295 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3610/7266] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:48 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:50.251203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e899a84e-9970-4cbe-997c-038c74be1539 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:50.252446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e899a84e-9970-4cbe-997c-038c74be1539 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:50.258695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e899a84e-9970-4cbe-997c-038c74be1539 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:50.259199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e899a84e-9970-4cbe-997c-038c74be1539 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:50.259649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e899a84e-9970-4cbe-997c-038c74be1539 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:50.260356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e899a84e-9970-4cbe-997c-038c74be1539 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:50.260869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e899a84e-9970-4cbe-997c-038c74be1539 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:50.261311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e899a84e-9970-4cbe-997c-038c74be1539 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:50.391432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e899a84e-9970-4cbe-997c-038c74be1539 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:50.399118 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e899a84e-9970-4cbe-997c-038c74be1539 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1363 microversion: 2.1 time: 0.153426 Aug 27 05:32:50.399690 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3657/7267] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:50 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:51.420197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b72cacda-0302-4a1e-9b6c-0a34b887defd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:51.420840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b72cacda-0302-4a1e-9b6c-0a34b887defd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:51.428672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b72cacda-0302-4a1e-9b6c-0a34b887defd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:51.429166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b72cacda-0302-4a1e-9b6c-0a34b887defd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:51.429613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b72cacda-0302-4a1e-9b6c-0a34b887defd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:51.430322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b72cacda-0302-4a1e-9b6c-0a34b887defd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:51.430784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b72cacda-0302-4a1e-9b6c-0a34b887defd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:51.431217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b72cacda-0302-4a1e-9b6c-0a34b887defd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:51.569969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b72cacda-0302-4a1e-9b6c-0a34b887defd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:51.578108 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b72cacda-0302-4a1e-9b6c-0a34b887defd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1363 microversion: 2.1 time: 0.161772 Aug 27 05:32:51.579051 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3611/7268] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:51 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:52.599156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b6213f3-3330-46ae-b880-e84c5896e28f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:52.599790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b6213f3-3330-46ae-b880-e84c5896e28f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:52.606783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b6213f3-3330-46ae-b880-e84c5896e28f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:52.607284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b6213f3-3330-46ae-b880-e84c5896e28f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:52.607741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b6213f3-3330-46ae-b880-e84c5896e28f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:52.608454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b6213f3-3330-46ae-b880-e84c5896e28f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:52.609631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b6213f3-3330-46ae-b880-e84c5896e28f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:52.610081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b6213f3-3330-46ae-b880-e84c5896e28f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:52.739310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b6213f3-3330-46ae-b880-e84c5896e28f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:52.747042 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b6213f3-3330-46ae-b880-e84c5896e28f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1363 microversion: 2.1 time: 0.151960 Aug 27 05:32:52.747631 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3658/7269] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:52 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:53.769279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-62fd1af6-110f-4e72-b381-728cb698786a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:53.769885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-62fd1af6-110f-4e72-b381-728cb698786a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:53.776838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62fd1af6-110f-4e72-b381-728cb698786a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:53.777576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62fd1af6-110f-4e72-b381-728cb698786a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:53.778008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62fd1af6-110f-4e72-b381-728cb698786a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:53.778697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62fd1af6-110f-4e72-b381-728cb698786a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:53.779147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62fd1af6-110f-4e72-b381-728cb698786a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:53.779606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62fd1af6-110f-4e72-b381-728cb698786a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:53.914233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-62fd1af6-110f-4e72-b381-728cb698786a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:53.922068 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-62fd1af6-110f-4e72-b381-728cb698786a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1363 microversion: 2.1 time: 0.157259 Aug 27 05:32:53.922651 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3612/7270] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:53 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:54.944551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f43335a1-f85b-4a90-a792-52603edab60d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:54.945337 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f43335a1-f85b-4a90-a792-52603edab60d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:54.951317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f43335a1-f85b-4a90-a792-52603edab60d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:54.951822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f43335a1-f85b-4a90-a792-52603edab60d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:54.952277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f43335a1-f85b-4a90-a792-52603edab60d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:54.953118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f43335a1-f85b-4a90-a792-52603edab60d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:54.953610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f43335a1-f85b-4a90-a792-52603edab60d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:54.954049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f43335a1-f85b-4a90-a792-52603edab60d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:55.091425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f43335a1-f85b-4a90-a792-52603edab60d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:55.100639 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f43335a1-f85b-4a90-a792-52603edab60d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1363 microversion: 2.1 time: 0.160457 Aug 27 05:32:55.100847 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3659/7271] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:54 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:55.172038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-6e6dcd85-c281-4a60-8fb1-05973c83af15 req-1ff91f06-dc74-4299-acfa-4ab05a46a2fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0334f97-6cec-413e-9395-3783f5ade31f", "name": "network-vif-plugged", "status": "completed", "tag": "0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:55.183404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6e6dcd85-c281-4a60-8fb1-05973c83af15 req-1ff91f06-dc74-4299-acfa-4ab05a46a2fc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:55.183899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6e6dcd85-c281-4a60-8fb1-05973c83af15 req-1ff91f06-dc74-4299-acfa-4ab05a46a2fc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:55.184330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6e6dcd85-c281-4a60-8fb1-05973c83af15 req-1ff91f06-dc74-4299-acfa-4ab05a46a2fc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:55.196125 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-6e6dcd85-c281-4a60-8fb1-05973c83af15 req-1ff91f06-dc74-4299-acfa-4ab05a46a2fc service nova] Creating event network-vif-plugged:0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a for instance a0334f97-6cec-413e-9395-3783f5ade31f on n-h1-854823-1 Aug 27 05:32:55.201219 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-6e6dcd85-c281-4a60-8fb1-05973c83af15 req-1ff91f06-dc74-4299-acfa-4ab05a46a2fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032854 Aug 27 05:32:55.201826 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3613/7272] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:56.121928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5cd6e797-89ef-4a8a-b03a-65753dc2e704 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:56.122590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5cd6e797-89ef-4a8a-b03a-65753dc2e704 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:56.129548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cd6e797-89ef-4a8a-b03a-65753dc2e704 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:56.130431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cd6e797-89ef-4a8a-b03a-65753dc2e704 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:56.130536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cd6e797-89ef-4a8a-b03a-65753dc2e704 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:56.131246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cd6e797-89ef-4a8a-b03a-65753dc2e704 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:56.131806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cd6e797-89ef-4a8a-b03a-65753dc2e704 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:56.132276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cd6e797-89ef-4a8a-b03a-65753dc2e704 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:56.263370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5cd6e797-89ef-4a8a-b03a-65753dc2e704 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:56.271794 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5cd6e797-89ef-4a8a-b03a-65753dc2e704 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1363 microversion: 2.1 time: 0.153837 Aug 27 05:32:56.272395 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3660/7273] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:56 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:57.293939 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-546e9f38-319c-4ceb-91d2-ecef473abf13 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:57.294638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-546e9f38-319c-4ceb-91d2-ecef473abf13 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:57.297429 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:57.303726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-546e9f38-319c-4ceb-91d2-ecef473abf13 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:57.304210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-546e9f38-319c-4ceb-91d2-ecef473abf13 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:57.304675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-546e9f38-319c-4ceb-91d2-ecef473abf13 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:57.305365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-546e9f38-319c-4ceb-91d2-ecef473abf13 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:57.305814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-546e9f38-319c-4ceb-91d2-ecef473abf13 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:57.306236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-546e9f38-319c-4ceb-91d2-ecef473abf13 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:57.434201 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-546e9f38-319c-4ceb-91d2-ecef473abf13 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:32:57.442800 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-546e9f38-319c-4ceb-91d2-ecef473abf13 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1550 microversion: 2.1 time: 0.153125 Aug 27 05:32:57.443382 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3614/7274] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:32:57 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:32:57.464990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3af549bc-bd66-405b-92b7-22d1190ecd79 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:32:57.465507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3af549bc-bd66-405b-92b7-22d1190ecd79 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:32:57.467504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:57.468471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:32:57.476351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af549bc-bd66-405b-92b7-22d1190ecd79 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:57.476894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af549bc-bd66-405b-92b7-22d1190ecd79 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:57.477357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af549bc-bd66-405b-92b7-22d1190ecd79 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:57.478080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af549bc-bd66-405b-92b7-22d1190ecd79 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:57.478557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af549bc-bd66-405b-92b7-22d1190ecd79 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:57.479003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af549bc-bd66-405b-92b7-22d1190ecd79 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:57.556693 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3af549bc-bd66-405b-92b7-22d1190ecd79 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096038 Aug 27 05:32:57.557316 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3661/7275] 10.222.0.79 () {58 vars in 1275 bytes} [Sat Aug 27 05:32:57 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:32:58.532872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-5eebbb97-6a22-4cbf-b86b-20e69c314ce0 req-28618de8-3d56-474f-a80a-0a0230ea21ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0334f97-6cec-413e-9395-3783f5ade31f", "tag": "0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:32:58.542872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5eebbb97-6a22-4cbf-b86b-20e69c314ce0 req-28618de8-3d56-474f-a80a-0a0230ea21ca service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:32:58.543345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5eebbb97-6a22-4cbf-b86b-20e69c314ce0 req-28618de8-3d56-474f-a80a-0a0230ea21ca service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:32:58.543770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-5eebbb97-6a22-4cbf-b86b-20e69c314ce0 req-28618de8-3d56-474f-a80a-0a0230ea21ca service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:32:58.556424 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-5eebbb97-6a22-4cbf-b86b-20e69c314ce0 req-28618de8-3d56-474f-a80a-0a0230ea21ca service nova] Creating event network-changed:0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a for instance a0334f97-6cec-413e-9395-3783f5ade31f on n-h1-854823-1 Aug 27 05:32:58.561730 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-5eebbb97-6a22-4cbf-b86b-20e69c314ce0 req-28618de8-3d56-474f-a80a-0a0230ea21ca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032759 Aug 27 05:32:58.562802 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3615/7276] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:34:12.013199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:12.014201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=64 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:12.015838 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:34:12.016178 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:34:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f (ip 10.222.0.79) !!! Aug 27 05:34:12.025734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31edf115-55ad-422a-9277-b13c2d3bfb7d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:12.026363 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31edf115-55ad-422a-9277-b13c2d3bfb7d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:12.034524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31edf115-55ad-422a-9277-b13c2d3bfb7d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:12.035024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31edf115-55ad-422a-9277-b13c2d3bfb7d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:12.035502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31edf115-55ad-422a-9277-b13c2d3bfb7d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:12.036206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31edf115-55ad-422a-9277-b13c2d3bfb7d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:12.036706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31edf115-55ad-422a-9277-b13c2d3bfb7d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:12.037148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31edf115-55ad-422a-9277-b13c2d3bfb7d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:12.173963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31edf115-55ad-422a-9277-b13c2d3bfb7d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:12.182518 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31edf115-55ad-422a-9277-b13c2d3bfb7d tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1669 microversion: 2.1 time: 0.172422 Aug 27 05:34:12.183101 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3662/7277] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:12 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1669 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:12.202488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:12.203240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:12.204352 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:34:12.204502 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 05:34:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f/os-volume_attachments (ip 10.222.0.79) !!! Aug 27 05:34:12.205549 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:34:12.205549 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 05:34:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f/os-volume_attachments (ip 10.222.0.79) !!! Aug 27 05:34:12.211144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c2be1e67-219a-46a6-b1e3-8fae5a19d425 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2d0d311-d214-4382-8af4-ae27dabf3eda"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:12.213563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c2be1e67-219a-46a6-b1e3-8fae5a19d425 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:12.224685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2be1e67-219a-46a6-b1e3-8fae5a19d425 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:12.225177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2be1e67-219a-46a6-b1e3-8fae5a19d425 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:12.225626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2be1e67-219a-46a6-b1e3-8fae5a19d425 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:12.226390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2be1e67-219a-46a6-b1e3-8fae5a19d425 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:12.226849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2be1e67-219a-46a6-b1e3-8fae5a19d425 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:12.227285 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2be1e67-219a-46a6-b1e3-8fae5a19d425 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:12.464910 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c2be1e67-219a-46a6-b1e3-8fae5a19d425 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264405 Aug 27 05:34:12.465620 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3616/7278] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:34:12 2022] POST /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:34:23.178055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:23.180350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:23.183231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:23.183918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:23.189904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:23.190412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:23.190868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:23.191592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:23.192067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:23.192513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:23.221916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:23.227860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Old instance type m1.heat2, new instance type m1.heat {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:34:23.234872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:34:23.235340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:34:23.235832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:34:23.236260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:34:23.236726 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:34:23.302302 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a617b1d4-4dab-408f-9866-2679debb1ba1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f/action" status: 202 len: 0 microversion: 2.1 time: 0.128188 Aug 27 05:34:23.306006 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3663/7279] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:34:23 2022] POST /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:34:23.312111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-83634eee-d967-407d-9eaa-752cc168b67f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:23.312975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-83634eee-d967-407d-9eaa-752cc168b67f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:23.316068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:23.316699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:23.339738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83634eee-d967-407d-9eaa-752cc168b67f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:23.340239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83634eee-d967-407d-9eaa-752cc168b67f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:23.340714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83634eee-d967-407d-9eaa-752cc168b67f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:23.341578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83634eee-d967-407d-9eaa-752cc168b67f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:23.342195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83634eee-d967-407d-9eaa-752cc168b67f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:23.342464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-83634eee-d967-407d-9eaa-752cc168b67f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:23.883078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-83634eee-d967-407d-9eaa-752cc168b67f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:23.892877 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-83634eee-d967-407d-9eaa-752cc168b67f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1724 microversion: 2.1 time: 0.585441 Aug 27 05:34:23.893672 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3617/7280] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:23 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1724 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:24.915969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc788f33-e794-42b4-a7ac-f4294a1a7204 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:24.916661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc788f33-e794-42b4-a7ac-f4294a1a7204 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:24.922747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc788f33-e794-42b4-a7ac-f4294a1a7204 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:24.923245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc788f33-e794-42b4-a7ac-f4294a1a7204 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:24.923696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc788f33-e794-42b4-a7ac-f4294a1a7204 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:24.924403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc788f33-e794-42b4-a7ac-f4294a1a7204 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:24.924957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc788f33-e794-42b4-a7ac-f4294a1a7204 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:24.925444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc788f33-e794-42b4-a7ac-f4294a1a7204 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:25.063811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dc788f33-e794-42b4-a7ac-f4294a1a7204 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:25.074090 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc788f33-e794-42b4-a7ac-f4294a1a7204 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1724 microversion: 2.1 time: 0.163140 Aug 27 05:34:25.075100 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3664/7281] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:24 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:26.096209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-14d4c2be-f170-4567-92ef-bdf3c3b2b5a3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:26.096862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-14d4c2be-f170-4567-92ef-bdf3c3b2b5a3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:26.104368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14d4c2be-f170-4567-92ef-bdf3c3b2b5a3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:26.104883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14d4c2be-f170-4567-92ef-bdf3c3b2b5a3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:26.105315 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14d4c2be-f170-4567-92ef-bdf3c3b2b5a3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:26.105999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14d4c2be-f170-4567-92ef-bdf3c3b2b5a3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:26.106451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14d4c2be-f170-4567-92ef-bdf3c3b2b5a3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:26.106873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-14d4c2be-f170-4567-92ef-bdf3c3b2b5a3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:26.244363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-14d4c2be-f170-4567-92ef-bdf3c3b2b5a3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:26.252729 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-14d4c2be-f170-4567-92ef-bdf3c3b2b5a3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1729 microversion: 2.1 time: 0.160428 Aug 27 05:34:26.253314 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3618/7282] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:26 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:27.273947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c318bb2-7c8a-416e-a9da-1063efb157e8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:27.274573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7c318bb2-7c8a-416e-a9da-1063efb157e8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:27.281965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c318bb2-7c8a-416e-a9da-1063efb157e8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:27.282465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c318bb2-7c8a-416e-a9da-1063efb157e8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:27.282915 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c318bb2-7c8a-416e-a9da-1063efb157e8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:27.283619 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c318bb2-7c8a-416e-a9da-1063efb157e8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:27.284088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c318bb2-7c8a-416e-a9da-1063efb157e8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:27.284540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c318bb2-7c8a-416e-a9da-1063efb157e8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:27.412825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7c318bb2-7c8a-416e-a9da-1063efb157e8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:27.421218 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7c318bb2-7c8a-416e-a9da-1063efb157e8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1729 microversion: 2.1 time: 0.151206 Aug 27 05:34:27.421798 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3665/7283] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:27 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:34:28.442806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aa32f2b2-5122-40dd-8a86-831f34166a99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:28.443427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aa32f2b2-5122-40dd-8a86-831f34166a99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:28.451033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa32f2b2-5122-40dd-8a86-831f34166a99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:28.451559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa32f2b2-5122-40dd-8a86-831f34166a99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:28.452046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa32f2b2-5122-40dd-8a86-831f34166a99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:28.452781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa32f2b2-5122-40dd-8a86-831f34166a99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:28.453244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa32f2b2-5122-40dd-8a86-831f34166a99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:28.453720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa32f2b2-5122-40dd-8a86-831f34166a99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:28.582261 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aa32f2b2-5122-40dd-8a86-831f34166a99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:28.591205 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aa32f2b2-5122-40dd-8a86-831f34166a99 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1729 microversion: 2.1 time: 0.152416 Aug 27 05:34:28.591793 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3619/7284] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:28 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:29.612644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e39c0ce-5d2b-4d70-9477-a2f7f8c266d0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:29.613151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e39c0ce-5d2b-4d70-9477-a2f7f8c266d0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:29.620022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e39c0ce-5d2b-4d70-9477-a2f7f8c266d0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:29.620521 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e39c0ce-5d2b-4d70-9477-a2f7f8c266d0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:29.621002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e39c0ce-5d2b-4d70-9477-a2f7f8c266d0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:29.621714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e39c0ce-5d2b-4d70-9477-a2f7f8c266d0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:29.622193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e39c0ce-5d2b-4d70-9477-a2f7f8c266d0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:29.622634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e39c0ce-5d2b-4d70-9477-a2f7f8c266d0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:29.758126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e39c0ce-5d2b-4d70-9477-a2f7f8c266d0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:29.766553 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e39c0ce-5d2b-4d70-9477-a2f7f8c266d0 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1729 microversion: 2.1 time: 0.158043 Aug 27 05:34:29.767146 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3666/7285] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:29 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:30.789224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c2260ca7-d59b-4472-9673-764bfd7ec181 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:30.789842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c2260ca7-d59b-4472-9673-764bfd7ec181 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:30.796728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2260ca7-d59b-4472-9673-764bfd7ec181 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:30.797216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2260ca7-d59b-4472-9673-764bfd7ec181 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:30.797658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2260ca7-d59b-4472-9673-764bfd7ec181 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:30.798352 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2260ca7-d59b-4472-9673-764bfd7ec181 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:30.798814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2260ca7-d59b-4472-9673-764bfd7ec181 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:30.799240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2260ca7-d59b-4472-9673-764bfd7ec181 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:30.932006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c2260ca7-d59b-4472-9673-764bfd7ec181 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:30.940269 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c2260ca7-d59b-4472-9673-764bfd7ec181 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1729 microversion: 2.1 time: 0.155430 Aug 27 05:34:30.940901 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3620/7286] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:30 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:31.962079 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c0138b98-2f47-4935-9995-c78417ede95a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:31.962650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c0138b98-2f47-4935-9995-c78417ede95a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:31.969026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0138b98-2f47-4935-9995-c78417ede95a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:31.969713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0138b98-2f47-4935-9995-c78417ede95a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:31.970175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0138b98-2f47-4935-9995-c78417ede95a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:31.970878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0138b98-2f47-4935-9995-c78417ede95a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:31.971344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0138b98-2f47-4935-9995-c78417ede95a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:31.971785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0138b98-2f47-4935-9995-c78417ede95a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:32.104203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c0138b98-2f47-4935-9995-c78417ede95a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:32.112470 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c0138b98-2f47-4935-9995-c78417ede95a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1729 microversion: 2.1 time: 0.155172 Aug 27 05:34:32.113075 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3667/7287] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:31 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:33.135722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5b5f4eba-70c4-4fa4-8d0d-fff3ec2702e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:33.136401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5b5f4eba-70c4-4fa4-8d0d-fff3ec2702e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:33.143190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b5f4eba-70c4-4fa4-8d0d-fff3ec2702e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:33.143685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b5f4eba-70c4-4fa4-8d0d-fff3ec2702e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:33.144140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b5f4eba-70c4-4fa4-8d0d-fff3ec2702e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:33.144872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b5f4eba-70c4-4fa4-8d0d-fff3ec2702e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:33.145339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b5f4eba-70c4-4fa4-8d0d-fff3ec2702e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:33.145773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b5f4eba-70c4-4fa4-8d0d-fff3ec2702e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:33.281830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5b5f4eba-70c4-4fa4-8d0d-fff3ec2702e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:33.290249 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5b5f4eba-70c4-4fa4-8d0d-fff3ec2702e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1729 microversion: 2.1 time: 0.159292 Aug 27 05:34:33.290834 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3621/7288] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:33 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:34.311709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bff7e67a-57a6-4d54-b878-8c87a1bfea8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:34.312362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bff7e67a-57a6-4d54-b878-8c87a1bfea8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:34.319428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bff7e67a-57a6-4d54-b878-8c87a1bfea8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:34.319927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bff7e67a-57a6-4d54-b878-8c87a1bfea8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:34.320916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bff7e67a-57a6-4d54-b878-8c87a1bfea8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:34.321624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bff7e67a-57a6-4d54-b878-8c87a1bfea8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:34.322095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bff7e67a-57a6-4d54-b878-8c87a1bfea8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:34.322533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bff7e67a-57a6-4d54-b878-8c87a1bfea8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:34.455072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bff7e67a-57a6-4d54-b878-8c87a1bfea8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:34.464080 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bff7e67a-57a6-4d54-b878-8c87a1bfea8e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1729 microversion: 2.1 time: 0.156361 Aug 27 05:34:34.464695 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3668/7289] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:34 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:35.485531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a6ce77ca-829b-47e3-bc5a-723faba58931 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:35.486148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a6ce77ca-829b-47e3-bc5a-723faba58931 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:35.493175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ce77ca-829b-47e3-bc5a-723faba58931 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:35.493668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ce77ca-829b-47e3-bc5a-723faba58931 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:35.494114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ce77ca-829b-47e3-bc5a-723faba58931 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:35.494810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ce77ca-829b-47e3-bc5a-723faba58931 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:35.495271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ce77ca-829b-47e3-bc5a-723faba58931 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:35.495702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a6ce77ca-829b-47e3-bc5a-723faba58931 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:35.625219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a6ce77ca-829b-47e3-bc5a-723faba58931 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:35.633362 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a6ce77ca-829b-47e3-bc5a-723faba58931 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1729 microversion: 2.1 time: 0.151843 Aug 27 05:34:35.633932 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3622/7290] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:35 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:36.655124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8358a8f4-4a5b-4e6e-a0b2-ae403dec6028 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:36.655810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8358a8f4-4a5b-4e6e-a0b2-ae403dec6028 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:36.662678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8358a8f4-4a5b-4e6e-a0b2-ae403dec6028 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:36.663214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8358a8f4-4a5b-4e6e-a0b2-ae403dec6028 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:36.663672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8358a8f4-4a5b-4e6e-a0b2-ae403dec6028 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:36.664903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8358a8f4-4a5b-4e6e-a0b2-ae403dec6028 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:36.665382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8358a8f4-4a5b-4e6e-a0b2-ae403dec6028 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:36.665826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8358a8f4-4a5b-4e6e-a0b2-ae403dec6028 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:36.797208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8358a8f4-4a5b-4e6e-a0b2-ae403dec6028 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:36.806176 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8358a8f4-4a5b-4e6e-a0b2-ae403dec6028 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1729 microversion: 2.1 time: 0.155439 Aug 27 05:34:36.806767 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3669/7291] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:36 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:37.827697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-49f08432-0786-4fa8-aa0b-2f52ee4d58eb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:37.828348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-49f08432-0786-4fa8-aa0b-2f52ee4d58eb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:37.835266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49f08432-0786-4fa8-aa0b-2f52ee4d58eb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:37.835758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49f08432-0786-4fa8-aa0b-2f52ee4d58eb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:37.836198 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49f08432-0786-4fa8-aa0b-2f52ee4d58eb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:37.836984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49f08432-0786-4fa8-aa0b-2f52ee4d58eb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:37.837448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49f08432-0786-4fa8-aa0b-2f52ee4d58eb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:37.837876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-49f08432-0786-4fa8-aa0b-2f52ee4d58eb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:37.977418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-49f08432-0786-4fa8-aa0b-2f52ee4d58eb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:37.985763 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-49f08432-0786-4fa8-aa0b-2f52ee4d58eb tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1729 microversion: 2.1 time: 0.161964 Aug 27 05:34:37.986340 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3623/7292] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:37 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:39.007783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf31383f-e19c-4a20-95e7-17f59bdc264b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:39.008932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf31383f-e19c-4a20-95e7-17f59bdc264b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:39.016235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf31383f-e19c-4a20-95e7-17f59bdc264b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:39.016786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf31383f-e19c-4a20-95e7-17f59bdc264b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:39.017241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf31383f-e19c-4a20-95e7-17f59bdc264b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:39.017966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf31383f-e19c-4a20-95e7-17f59bdc264b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:39.018467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf31383f-e19c-4a20-95e7-17f59bdc264b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:39.018912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf31383f-e19c-4a20-95e7-17f59bdc264b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:39.151579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf31383f-e19c-4a20-95e7-17f59bdc264b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:39.160992 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf31383f-e19c-4a20-95e7-17f59bdc264b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1729 microversion: 2.1 time: 0.157581 Aug 27 05:34:39.161583 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3670/7293] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:39 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:40.182055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-380ea106-5c4b-4ef9-bdb0-d1405d8fbdf6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:40.182666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-380ea106-5c4b-4ef9-bdb0-d1405d8fbdf6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:40.189925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-380ea106-5c4b-4ef9-bdb0-d1405d8fbdf6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:40.190419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-380ea106-5c4b-4ef9-bdb0-d1405d8fbdf6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:40.190863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-380ea106-5c4b-4ef9-bdb0-d1405d8fbdf6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:40.191574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-380ea106-5c4b-4ef9-bdb0-d1405d8fbdf6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:40.192034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-380ea106-5c4b-4ef9-bdb0-d1405d8fbdf6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:40.192467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-380ea106-5c4b-4ef9-bdb0-d1405d8fbdf6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:40.329309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8afa386d-c0dd-4a3c-936c-58454b836658 req-fadca94d-cdf5-49ea-a740-039a9b6010c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0334f97-6cec-413e-9395-3783f5ade31f", "name": "network-vif-unplugged", "status": "completed", "tag": "0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:40.337434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-380ea106-5c4b-4ef9-bdb0-d1405d8fbdf6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:40.343825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8afa386d-c0dd-4a3c-936c-58454b836658 req-fadca94d-cdf5-49ea-a740-039a9b6010c2 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:40.344615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8afa386d-c0dd-4a3c-936c-58454b836658 req-fadca94d-cdf5-49ea-a740-039a9b6010c2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:40.346502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8afa386d-c0dd-4a3c-936c-58454b836658 req-fadca94d-cdf5-49ea-a740-039a9b6010c2 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:40.346646 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-380ea106-5c4b-4ef9-bdb0-d1405d8fbdf6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1728 microversion: 2.1 time: 0.168588 Aug 27 05:34:40.347440 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3624/7294] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:40 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:40.371015 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8afa386d-c0dd-4a3c-936c-58454b836658 req-fadca94d-cdf5-49ea-a740-039a9b6010c2 service nova] Creating event network-vif-unplugged:0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a for instance a0334f97-6cec-413e-9395-3783f5ade31f on n-h2-854823-1 Aug 27 05:34:40.377868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-8afa386d-c0dd-4a3c-936c-58454b836658 req-fadca94d-cdf5-49ea-a740-039a9b6010c2 service nova] Instance a0334f97-6cec-413e-9395-3783f5ade31f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:34:40.389923 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8afa386d-c0dd-4a3c-936c-58454b836658 req-fadca94d-cdf5-49ea-a740-039a9b6010c2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065156 Aug 27 05:34:40.390743 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3671/7295] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:34:41.367259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8cdcb6d0-303a-45eb-a64e-ac2970989fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:41.367881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8cdcb6d0-303a-45eb-a64e-ac2970989fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:41.375029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cdcb6d0-303a-45eb-a64e-ac2970989fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:41.375433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cdcb6d0-303a-45eb-a64e-ac2970989fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:41.375878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cdcb6d0-303a-45eb-a64e-ac2970989fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:41.376600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cdcb6d0-303a-45eb-a64e-ac2970989fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:41.377064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cdcb6d0-303a-45eb-a64e-ac2970989fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:41.377495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8cdcb6d0-303a-45eb-a64e-ac2970989fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:41.516767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8cdcb6d0-303a-45eb-a64e-ac2970989fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:41.525572 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8cdcb6d0-303a-45eb-a64e-ac2970989fa2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1726 microversion: 2.1 time: 0.162237 Aug 27 05:34:41.526162 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3625/7296] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:41 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:34:42.414225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-520ea653-57e3-4367-a138-386c779fab39 req-ab3baa73-a9fe-4b3a-9edd-329430235783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0334f97-6cec-413e-9395-3783f5ade31f", "tag": "0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:42.424141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-520ea653-57e3-4367-a138-386c779fab39 req-ab3baa73-a9fe-4b3a-9edd-329430235783 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:42.424679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-520ea653-57e3-4367-a138-386c779fab39 req-ab3baa73-a9fe-4b3a-9edd-329430235783 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:42.425108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-520ea653-57e3-4367-a138-386c779fab39 req-ab3baa73-a9fe-4b3a-9edd-329430235783 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:42.437285 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-520ea653-57e3-4367-a138-386c779fab39 req-ab3baa73-a9fe-4b3a-9edd-329430235783 service nova] Creating event network-changed:0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a for instance a0334f97-6cec-413e-9395-3783f5ade31f on n-h2-854823-1 Aug 27 05:34:42.442718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-520ea653-57e3-4367-a138-386c779fab39 req-ab3baa73-a9fe-4b3a-9edd-329430235783 service nova] Instance a0334f97-6cec-413e-9395-3783f5ade31f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:34:42.455860 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-520ea653-57e3-4367-a138-386c779fab39 req-ab3baa73-a9fe-4b3a-9edd-329430235783 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046551 Aug 27 05:34:42.456850 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3672/7297] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:34:42.547396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d6e846ce-5efa-4f5b-abb4-2f6bdf3501ef tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:42.548894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d6e846ce-5efa-4f5b-abb4-2f6bdf3501ef tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:42.556976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6e846ce-5efa-4f5b-abb4-2f6bdf3501ef tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:42.557784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6e846ce-5efa-4f5b-abb4-2f6bdf3501ef tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:42.558653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6e846ce-5efa-4f5b-abb4-2f6bdf3501ef tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:42.559600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6e846ce-5efa-4f5b-abb4-2f6bdf3501ef tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:42.560277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6e846ce-5efa-4f5b-abb4-2f6bdf3501ef tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:42.560947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d6e846ce-5efa-4f5b-abb4-2f6bdf3501ef tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:42.792065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d6e846ce-5efa-4f5b-abb4-2f6bdf3501ef tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:42.806594 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d6e846ce-5efa-4f5b-abb4-2f6bdf3501ef tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1726 microversion: 2.1 time: 0.262913 Aug 27 05:34:42.807464 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3626/7298] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:42 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1726 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:43.828455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fae3f78e-c279-45f5-aa91-2f84c2125185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:43.829278 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fae3f78e-c279-45f5-aa91-2f84c2125185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:43.836753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fae3f78e-c279-45f5-aa91-2f84c2125185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:43.837265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fae3f78e-c279-45f5-aa91-2f84c2125185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:43.837720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fae3f78e-c279-45f5-aa91-2f84c2125185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:43.838432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fae3f78e-c279-45f5-aa91-2f84c2125185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:43.838909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fae3f78e-c279-45f5-aa91-2f84c2125185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:43.839382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fae3f78e-c279-45f5-aa91-2f84c2125185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:43.972450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fae3f78e-c279-45f5-aa91-2f84c2125185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:43.981949 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fae3f78e-c279-45f5-aa91-2f84c2125185 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1726 microversion: 2.1 time: 0.157327 Aug 27 05:34:43.982538 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3673/7299] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:43 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:45.002937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e484aa6e-1a57-438d-ab04-15dae4ce7f9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:45.003591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e484aa6e-1a57-438d-ab04-15dae4ce7f9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:45.010994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e484aa6e-1a57-438d-ab04-15dae4ce7f9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:45.011494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e484aa6e-1a57-438d-ab04-15dae4ce7f9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:45.011940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e484aa6e-1a57-438d-ab04-15dae4ce7f9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:45.012892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e484aa6e-1a57-438d-ab04-15dae4ce7f9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:45.013380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e484aa6e-1a57-438d-ab04-15dae4ce7f9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:45.013812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e484aa6e-1a57-438d-ab04-15dae4ce7f9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:45.157270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e484aa6e-1a57-438d-ab04-15dae4ce7f9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:45.166535 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e484aa6e-1a57-438d-ab04-15dae4ce7f9a tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1726 microversion: 2.1 time: 0.167528 Aug 27 05:34:45.167137 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3627/7300] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:44 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:46.188884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc274e4c-9012-4bce-93a8-e18a17b44f70 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:46.189722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bc274e4c-9012-4bce-93a8-e18a17b44f70 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:46.197398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc274e4c-9012-4bce-93a8-e18a17b44f70 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:46.197900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc274e4c-9012-4bce-93a8-e18a17b44f70 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:46.198353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc274e4c-9012-4bce-93a8-e18a17b44f70 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:46.199071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc274e4c-9012-4bce-93a8-e18a17b44f70 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:46.199545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc274e4c-9012-4bce-93a8-e18a17b44f70 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:46.199994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc274e4c-9012-4bce-93a8-e18a17b44f70 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:46.664446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bc274e4c-9012-4bce-93a8-e18a17b44f70 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:46.673834 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc274e4c-9012-4bce-93a8-e18a17b44f70 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1726 microversion: 2.1 time: 0.489216 Aug 27 05:34:46.674430 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3674/7301] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:46 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1726 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:47.695061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-88fdb815-0461-481a-ada2-e5eb34d88a3f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:47.695620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-88fdb815-0461-481a-ada2-e5eb34d88a3f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:47.702643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88fdb815-0461-481a-ada2-e5eb34d88a3f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:47.703125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88fdb815-0461-481a-ada2-e5eb34d88a3f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:47.703564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88fdb815-0461-481a-ada2-e5eb34d88a3f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:47.704252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88fdb815-0461-481a-ada2-e5eb34d88a3f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:47.704738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88fdb815-0461-481a-ada2-e5eb34d88a3f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:47.705173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-88fdb815-0461-481a-ada2-e5eb34d88a3f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:47.835530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-88fdb815-0461-481a-ada2-e5eb34d88a3f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:47.844682 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-88fdb815-0461-481a-ada2-e5eb34d88a3f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1726 microversion: 2.1 time: 0.153643 Aug 27 05:34:47.845258 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3628/7302] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:47 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:48.865410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e04d093-9291-45f1-9070-fc88cd01c0b9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:48.866113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e04d093-9291-45f1-9070-fc88cd01c0b9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:48.873764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e04d093-9291-45f1-9070-fc88cd01c0b9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:48.874364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e04d093-9291-45f1-9070-fc88cd01c0b9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:48.874829 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e04d093-9291-45f1-9070-fc88cd01c0b9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:48.875635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e04d093-9291-45f1-9070-fc88cd01c0b9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:48.876148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e04d093-9291-45f1-9070-fc88cd01c0b9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:48.876762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e04d093-9291-45f1-9070-fc88cd01c0b9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:49.007222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1e04d093-9291-45f1-9070-fc88cd01c0b9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:49.016162 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e04d093-9291-45f1-9070-fc88cd01c0b9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1726 microversion: 2.1 time: 0.154672 Aug 27 05:34:49.016799 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3675/7303] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:48 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:50.041317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-abe5491d-b73d-41e9-a9d9-9dc60a9c6081 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:50.041961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-abe5491d-b73d-41e9-a9d9-9dc60a9c6081 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:50.048899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abe5491d-b73d-41e9-a9d9-9dc60a9c6081 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:50.049382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abe5491d-b73d-41e9-a9d9-9dc60a9c6081 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:50.049819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abe5491d-b73d-41e9-a9d9-9dc60a9c6081 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:50.050510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abe5491d-b73d-41e9-a9d9-9dc60a9c6081 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:50.050971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abe5491d-b73d-41e9-a9d9-9dc60a9c6081 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:50.051398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-abe5491d-b73d-41e9-a9d9-9dc60a9c6081 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:50.185685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-abe5491d-b73d-41e9-a9d9-9dc60a9c6081 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:50.194291 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-abe5491d-b73d-41e9-a9d9-9dc60a9c6081 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1726 microversion: 2.1 time: 0.157549 Aug 27 05:34:50.194877 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3629/7304] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:50 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:51.216100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8f16e2d-35b6-4f6b-8f93-586846712fc2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:51.216795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8f16e2d-35b6-4f6b-8f93-586846712fc2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:51.223819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f16e2d-35b6-4f6b-8f93-586846712fc2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:51.224334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f16e2d-35b6-4f6b-8f93-586846712fc2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:51.224817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f16e2d-35b6-4f6b-8f93-586846712fc2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:51.225546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f16e2d-35b6-4f6b-8f93-586846712fc2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:51.226025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f16e2d-35b6-4f6b-8f93-586846712fc2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:51.226469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f16e2d-35b6-4f6b-8f93-586846712fc2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:51.362641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8f16e2d-35b6-4f6b-8f93-586846712fc2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:51.371077 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8f16e2d-35b6-4f6b-8f93-586846712fc2 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1726 microversion: 2.1 time: 0.159667 Aug 27 05:34:51.371666 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3676/7305] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:51 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:52.392302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f967307c-403a-4e48-8daa-d515aff66c82 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:52.392882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f967307c-403a-4e48-8daa-d515aff66c82 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:52.400328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f967307c-403a-4e48-8daa-d515aff66c82 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:52.400842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f967307c-403a-4e48-8daa-d515aff66c82 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:52.401280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f967307c-403a-4e48-8daa-d515aff66c82 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:52.401974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f967307c-403a-4e48-8daa-d515aff66c82 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:52.402432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f967307c-403a-4e48-8daa-d515aff66c82 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:52.402859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f967307c-403a-4e48-8daa-d515aff66c82 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:52.537811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f967307c-403a-4e48-8daa-d515aff66c82 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:52.546214 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f967307c-403a-4e48-8daa-d515aff66c82 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1726 microversion: 2.1 time: 0.157958 Aug 27 05:34:52.546805 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3630/7306] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:52 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:53.568548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6cddf42-0bbd-4ce1-96a1-72e628e9f502 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:53.569249 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e6cddf42-0bbd-4ce1-96a1-72e628e9f502 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:53.572207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=33 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:53.578379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6cddf42-0bbd-4ce1-96a1-72e628e9f502 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:53.578890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6cddf42-0bbd-4ce1-96a1-72e628e9f502 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:53.579344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6cddf42-0bbd-4ce1-96a1-72e628e9f502 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:53.580068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6cddf42-0bbd-4ce1-96a1-72e628e9f502 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:53.580551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6cddf42-0bbd-4ce1-96a1-72e628e9f502 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:53.581007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6cddf42-0bbd-4ce1-96a1-72e628e9f502 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:53.583970 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:53.715586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e6cddf42-0bbd-4ce1-96a1-72e628e9f502 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:53.724137 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6cddf42-0bbd-4ce1-96a1-72e628e9f502 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1726 microversion: 2.1 time: 0.159547 Aug 27 05:34:53.724758 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3677/7307] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:53 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:54.746487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-69a6a7e2-dcf8-4d62-814b-d58398880209 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:54.747413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-69a6a7e2-dcf8-4d62-814b-d58398880209 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:54.750446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=29 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:54.756847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69a6a7e2-dcf8-4d62-814b-d58398880209 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:54.757339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69a6a7e2-dcf8-4d62-814b-d58398880209 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:54.757779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69a6a7e2-dcf8-4d62-814b-d58398880209 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:54.758476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69a6a7e2-dcf8-4d62-814b-d58398880209 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:54.758962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69a6a7e2-dcf8-4d62-814b-d58398880209 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:54.759393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-69a6a7e2-dcf8-4d62-814b-d58398880209 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:54.762032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=85 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:34:54.895345 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-69a6a7e2-dcf8-4d62-814b-d58398880209 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:54.904708 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-69a6a7e2-dcf8-4d62-814b-d58398880209 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1723 microversion: 2.1 time: 0.162886 Aug 27 05:34:54.905291 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3631/7308] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:54 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:54.925124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:54.925682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:54.933061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:54.933566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:54.934050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:54.934895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:54.935375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:54.935824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:54.973675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:54.974173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:54.974625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:54.975370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:54.975844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:54.976288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:54.997862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Getting quotas for project e2a7ba2c76574547b50a17bb289f2c8b. Resources: {'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:34:55.006780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Getting quotas for user cdebfdf54a7e4026bfa98c8c308a4456 and project e2a7ba2c76574547b50a17bb289f2c8b. Resources: {'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:34:55.110694 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f8207f1-d6ac-4b2e-b374-fecf925090e3 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "POST /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f/action" status: 202 len: 0 microversion: 2.1 time: 0.189250 Aug 27 05:34:55.111464 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3678/7309] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:34:54 2022] POST /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:34:55.119738 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1fd1e6bf-0780-46d7-b621-70ecb6d03552 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:55.120365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1fd1e6bf-0780-46d7-b621-70ecb6d03552 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:55.126537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6bf-0780-46d7-b621-70ecb6d03552 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:55.127032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6bf-0780-46d7-b621-70ecb6d03552 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:55.127513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6bf-0780-46d7-b621-70ecb6d03552 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:55.128223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6bf-0780-46d7-b621-70ecb6d03552 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:55.128716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6bf-0780-46d7-b621-70ecb6d03552 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:55.129151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6bf-0780-46d7-b621-70ecb6d03552 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:55.264172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1fd1e6bf-0780-46d7-b621-70ecb6d03552 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:55.273422 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1fd1e6bf-0780-46d7-b621-70ecb6d03552 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.157661 Aug 27 05:34:55.274015 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3632/7310] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:55 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:56.295051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3312da2-199d-43c1-bf88-b41065a2b34c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:56.295776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b3312da2-199d-43c1-bf88-b41065a2b34c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:56.303753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3312da2-199d-43c1-bf88-b41065a2b34c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:56.304255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3312da2-199d-43c1-bf88-b41065a2b34c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:56.304760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3312da2-199d-43c1-bf88-b41065a2b34c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:56.305475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3312da2-199d-43c1-bf88-b41065a2b34c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:56.305979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3312da2-199d-43c1-bf88-b41065a2b34c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:56.306423 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3312da2-199d-43c1-bf88-b41065a2b34c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:56.443110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b3312da2-199d-43c1-bf88-b41065a2b34c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:56.453228 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3312da2-199d-43c1-bf88-b41065a2b34c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.162496 Aug 27 05:34:56.453929 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3679/7311] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:56 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:57.474761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5200affb-9b3b-4943-b8bf-de7a51eab826 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:57.475372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5200affb-9b3b-4943-b8bf-de7a51eab826 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:57.482478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5200affb-9b3b-4943-b8bf-de7a51eab826 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:57.483412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5200affb-9b3b-4943-b8bf-de7a51eab826 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:57.483412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5200affb-9b3b-4943-b8bf-de7a51eab826 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:57.484089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5200affb-9b3b-4943-b8bf-de7a51eab826 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:57.484555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5200affb-9b3b-4943-b8bf-de7a51eab826 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:57.485057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5200affb-9b3b-4943-b8bf-de7a51eab826 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:57.619876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5200affb-9b3b-4943-b8bf-de7a51eab826 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:57.628257 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5200affb-9b3b-4943-b8bf-de7a51eab826 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.157371 Aug 27 05:34:57.628879 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3633/7312] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:57 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:58.211118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ceee00b9-1411-47ab-b64a-45c5a43dee27 req-70d295e8-d5a6-4ffd-9030-c0aaf96e8b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0334f97-6cec-413e-9395-3783f5ade31f", "name": "network-vif-plugged", "status": "completed", "tag": "0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:34:58.226146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ceee00b9-1411-47ab-b64a-45c5a43dee27 req-70d295e8-d5a6-4ffd-9030-c0aaf96e8b7b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:58.227182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ceee00b9-1411-47ab-b64a-45c5a43dee27 req-70d295e8-d5a6-4ffd-9030-c0aaf96e8b7b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:58.228602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ceee00b9-1411-47ab-b64a-45c5a43dee27 req-70d295e8-d5a6-4ffd-9030-c0aaf96e8b7b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:58.241571 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ceee00b9-1411-47ab-b64a-45c5a43dee27 req-70d295e8-d5a6-4ffd-9030-c0aaf96e8b7b service nova] Creating event network-vif-plugged:0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a for instance a0334f97-6cec-413e-9395-3783f5ade31f on n-h2-854823-1 Aug 27 05:34:58.247660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-ceee00b9-1411-47ab-b64a-45c5a43dee27 req-70d295e8-d5a6-4ffd-9030-c0aaf96e8b7b service nova] Instance a0334f97-6cec-413e-9395-3783f5ade31f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:34:58.260768 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ceee00b9-1411-47ab-b64a-45c5a43dee27 req-70d295e8-d5a6-4ffd-9030-c0aaf96e8b7b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053372 Aug 27 05:34:58.261737 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3680/7313] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:34:58.650387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b1328627-7d88-4e08-85f8-30f55dfda125 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:58.651170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b1328627-7d88-4e08-85f8-30f55dfda125 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:58.658843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1328627-7d88-4e08-85f8-30f55dfda125 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:58.659328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1328627-7d88-4e08-85f8-30f55dfda125 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:58.659766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1328627-7d88-4e08-85f8-30f55dfda125 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:58.660460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1328627-7d88-4e08-85f8-30f55dfda125 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:58.660945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1328627-7d88-4e08-85f8-30f55dfda125 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:58.661363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1328627-7d88-4e08-85f8-30f55dfda125 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:58.798925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b1328627-7d88-4e08-85f8-30f55dfda125 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:58.807364 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b1328627-7d88-4e08-85f8-30f55dfda125 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.161444 Aug 27 05:34:58.807948 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3634/7314] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:58 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:34:59.830052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1114f8c7-c878-40d1-810d-3480fb54bd14 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:34:59.830796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1114f8c7-c878-40d1-810d-3480fb54bd14 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:34:59.839153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1114f8c7-c878-40d1-810d-3480fb54bd14 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:59.839666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1114f8c7-c878-40d1-810d-3480fb54bd14 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:59.840123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1114f8c7-c878-40d1-810d-3480fb54bd14 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:59.841073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1114f8c7-c878-40d1-810d-3480fb54bd14 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:34:59.841551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1114f8c7-c878-40d1-810d-3480fb54bd14 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:34:59.842000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1114f8c7-c878-40d1-810d-3480fb54bd14 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:34:59.980968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1114f8c7-c878-40d1-810d-3480fb54bd14 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:34:59.989655 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1114f8c7-c878-40d1-810d-3480fb54bd14 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.164253 Aug 27 05:34:59.990251 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3681/7315] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:34:59 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:35:00.527149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-8c83ac6d-7080-49da-a1a5-bd4906588a25 req-26579fa4-1c3f-49ca-8f26-9cb8b40458bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0334f97-6cec-413e-9395-3783f5ade31f", "name": "network-vif-unplugged", "status": "completed", "tag": "0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:00.538967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8c83ac6d-7080-49da-a1a5-bd4906588a25 req-26579fa4-1c3f-49ca-8f26-9cb8b40458bd service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:00.539459 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8c83ac6d-7080-49da-a1a5-bd4906588a25 req-26579fa4-1c3f-49ca-8f26-9cb8b40458bd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:00.539895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-8c83ac6d-7080-49da-a1a5-bd4906588a25 req-26579fa4-1c3f-49ca-8f26-9cb8b40458bd service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:00.552364 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-8c83ac6d-7080-49da-a1a5-bd4906588a25 req-26579fa4-1c3f-49ca-8f26-9cb8b40458bd service nova] Creating event network-vif-unplugged:0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a for instance a0334f97-6cec-413e-9395-3783f5ade31f on n-h1-854823-1 Aug 27 05:35:00.558839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-8c83ac6d-7080-49da-a1a5-bd4906588a25 req-26579fa4-1c3f-49ca-8f26-9cb8b40458bd service nova] Instance a0334f97-6cec-413e-9395-3783f5ade31f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:35:00.569844 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-8c83ac6d-7080-49da-a1a5-bd4906588a25 req-26579fa4-1c3f-49ca-8f26-9cb8b40458bd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046721 Aug 27 05:35:00.570464 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3635/7316] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:35:01.010595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74cb7d5a-57df-401d-a316-66230c690e49 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:01.011220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74cb7d5a-57df-401d-a316-66230c690e49 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:01.018565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cb7d5a-57df-401d-a316-66230c690e49 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:01.019066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cb7d5a-57df-401d-a316-66230c690e49 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:01.019512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cb7d5a-57df-401d-a316-66230c690e49 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:01.020224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cb7d5a-57df-401d-a316-66230c690e49 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:01.020723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cb7d5a-57df-401d-a316-66230c690e49 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:01.021168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cb7d5a-57df-401d-a316-66230c690e49 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:01.161473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-74cb7d5a-57df-401d-a316-66230c690e49 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:01.170721 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74cb7d5a-57df-401d-a316-66230c690e49 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.164245 Aug 27 05:35:01.171315 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3682/7317] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:01 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:02.193811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d3dadc8a-8a7e-475d-9557-f9ba65c30041 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:02.195574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d3dadc8a-8a7e-475d-9557-f9ba65c30041 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:02.202351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3dadc8a-8a7e-475d-9557-f9ba65c30041 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:02.202849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3dadc8a-8a7e-475d-9557-f9ba65c30041 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:02.203293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3dadc8a-8a7e-475d-9557-f9ba65c30041 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:02.203999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3dadc8a-8a7e-475d-9557-f9ba65c30041 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:02.204463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3dadc8a-8a7e-475d-9557-f9ba65c30041 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:02.204919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3dadc8a-8a7e-475d-9557-f9ba65c30041 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:02.338537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d3dadc8a-8a7e-475d-9557-f9ba65c30041 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:02.346940 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d3dadc8a-8a7e-475d-9557-f9ba65c30041 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.158309 Aug 27 05:35:02.347529 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3636/7318] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:02 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:02.611459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a29a8008-d950-4339-b0eb-d5772be509e4 req-31e1ee87-61bc-4999-b9be-bd40e6aff073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0334f97-6cec-413e-9395-3783f5ade31f", "tag": "0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:02.622210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a29a8008-d950-4339-b0eb-d5772be509e4 req-31e1ee87-61bc-4999-b9be-bd40e6aff073 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:02.622711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a29a8008-d950-4339-b0eb-d5772be509e4 req-31e1ee87-61bc-4999-b9be-bd40e6aff073 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:02.623164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a29a8008-d950-4339-b0eb-d5772be509e4 req-31e1ee87-61bc-4999-b9be-bd40e6aff073 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:02.634960 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a29a8008-d950-4339-b0eb-d5772be509e4 req-31e1ee87-61bc-4999-b9be-bd40e6aff073 service nova] Creating event network-changed:0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a for instance a0334f97-6cec-413e-9395-3783f5ade31f on n-h1-854823-1 Aug 27 05:35:02.640445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-a29a8008-d950-4339-b0eb-d5772be509e4 req-31e1ee87-61bc-4999-b9be-bd40e6aff073 service nova] Instance a0334f97-6cec-413e-9395-3783f5ade31f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:35:02.651560 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a29a8008-d950-4339-b0eb-d5772be509e4 req-31e1ee87-61bc-4999-b9be-bd40e6aff073 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043962 Aug 27 05:35:02.652172 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3683/7319] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:03.369365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e19fcf8-cbb2-4222-81e1-0feea2a29a27 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:03.370106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4e19fcf8-cbb2-4222-81e1-0feea2a29a27 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:03.377021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e19fcf8-cbb2-4222-81e1-0feea2a29a27 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:03.377512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e19fcf8-cbb2-4222-81e1-0feea2a29a27 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:03.377960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e19fcf8-cbb2-4222-81e1-0feea2a29a27 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:03.378657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e19fcf8-cbb2-4222-81e1-0feea2a29a27 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:03.379122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e19fcf8-cbb2-4222-81e1-0feea2a29a27 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:03.379551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e19fcf8-cbb2-4222-81e1-0feea2a29a27 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:03.520234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4e19fcf8-cbb2-4222-81e1-0feea2a29a27 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:03.529239 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4e19fcf8-cbb2-4222-81e1-0feea2a29a27 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.164263 Aug 27 05:35:03.529839 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3637/7320] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:03 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:04.550937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f8de339-280c-4e34-b2e9-6f6c7e4e75e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:04.551670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f8de339-280c-4e34-b2e9-6f6c7e4e75e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:04.559847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f8de339-280c-4e34-b2e9-6f6c7e4e75e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:04.560365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f8de339-280c-4e34-b2e9-6f6c7e4e75e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:04.560853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f8de339-280c-4e34-b2e9-6f6c7e4e75e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:04.561577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f8de339-280c-4e34-b2e9-6f6c7e4e75e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:04.562055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f8de339-280c-4e34-b2e9-6f6c7e4e75e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:04.562500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f8de339-280c-4e34-b2e9-6f6c7e4e75e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:04.698090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f8de339-280c-4e34-b2e9-6f6c7e4e75e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:04.706773 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f8de339-280c-4e34-b2e9-6f6c7e4e75e9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.160116 Aug 27 05:35:04.707364 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3684/7321] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:04 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:05.729042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7034c82-dbdc-4d5c-a51a-8dbad5256f95 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:05.729568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c7034c82-dbdc-4d5c-a51a-8dbad5256f95 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:05.736571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7034c82-dbdc-4d5c-a51a-8dbad5256f95 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:05.737066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7034c82-dbdc-4d5c-a51a-8dbad5256f95 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:05.737511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7034c82-dbdc-4d5c-a51a-8dbad5256f95 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:05.738207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7034c82-dbdc-4d5c-a51a-8dbad5256f95 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:05.738665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7034c82-dbdc-4d5c-a51a-8dbad5256f95 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:05.739095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7034c82-dbdc-4d5c-a51a-8dbad5256f95 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:05.874505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c7034c82-dbdc-4d5c-a51a-8dbad5256f95 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:05.882862 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7034c82-dbdc-4d5c-a51a-8dbad5256f95 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.158414 Aug 27 05:35:05.883447 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3638/7322] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:05 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:06.905334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2dc2f93-9d83-485c-982c-76e72f26c1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:06.905962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2dc2f93-9d83-485c-982c-76e72f26c1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:06.907976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:06.914342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2dc2f93-9d83-485c-982c-76e72f26c1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:06.915601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2dc2f93-9d83-485c-982c-76e72f26c1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:06.916060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2dc2f93-9d83-485c-982c-76e72f26c1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:06.916804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2dc2f93-9d83-485c-982c-76e72f26c1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:06.917287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2dc2f93-9d83-485c-982c-76e72f26c1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:06.917732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2dc2f93-9d83-485c-982c-76e72f26c1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:07.050030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c2dc2f93-9d83-485c-982c-76e72f26c1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:07.058574 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2dc2f93-9d83-485c-982c-76e72f26c1d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.157464 Aug 27 05:35:07.059381 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3685/7323] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:06 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:08.079807 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-11beeca1-aeb7-438d-a6d7-95dba9b79579 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:08.080454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-11beeca1-aeb7-438d-a6d7-95dba9b79579 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:08.087381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11beeca1-aeb7-438d-a6d7-95dba9b79579 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:08.087860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11beeca1-aeb7-438d-a6d7-95dba9b79579 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:08.088302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11beeca1-aeb7-438d-a6d7-95dba9b79579 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:08.089023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11beeca1-aeb7-438d-a6d7-95dba9b79579 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:08.089486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11beeca1-aeb7-438d-a6d7-95dba9b79579 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:08.090019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-11beeca1-aeb7-438d-a6d7-95dba9b79579 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:08.220438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-11beeca1-aeb7-438d-a6d7-95dba9b79579 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:08.229919 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-11beeca1-aeb7-438d-a6d7-95dba9b79579 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.154514 Aug 27 05:35:08.230444 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3639/7324] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:08 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:09.251293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdc5e0c3-d693-4de6-9cf0-a6e346bbd4a4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:09.252039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bdc5e0c3-d693-4de6-9cf0-a6e346bbd4a4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:09.258946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdc5e0c3-d693-4de6-9cf0-a6e346bbd4a4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:09.259449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdc5e0c3-d693-4de6-9cf0-a6e346bbd4a4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:09.259897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdc5e0c3-d693-4de6-9cf0-a6e346bbd4a4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:09.260631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdc5e0c3-d693-4de6-9cf0-a6e346bbd4a4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:09.261103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdc5e0c3-d693-4de6-9cf0-a6e346bbd4a4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:09.261579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdc5e0c3-d693-4de6-9cf0-a6e346bbd4a4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:09.394008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdc5e0c3-d693-4de6-9cf0-a6e346bbd4a4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:09.402809 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdc5e0c3-d693-4de6-9cf0-a6e346bbd4a4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.155474 Aug 27 05:35:09.403674 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3686/7325] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:09 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:10.424985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2a17540b-1c88-4e11-8544-492907d154db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:10.425521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2a17540b-1c88-4e11-8544-492907d154db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:10.432559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a17540b-1c88-4e11-8544-492907d154db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:10.433055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a17540b-1c88-4e11-8544-492907d154db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:10.433502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a17540b-1c88-4e11-8544-492907d154db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:10.434197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a17540b-1c88-4e11-8544-492907d154db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:10.434658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a17540b-1c88-4e11-8544-492907d154db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:10.435090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2a17540b-1c88-4e11-8544-492907d154db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:10.570827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2a17540b-1c88-4e11-8544-492907d154db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:10.581825 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2a17540b-1c88-4e11-8544-492907d154db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.160579 Aug 27 05:35:10.582611 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3640/7326] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:10 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:11.607995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c6ee50b-69c9-423a-a89d-adec9c103dbf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:11.608517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c6ee50b-69c9-423a-a89d-adec9c103dbf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:11.615303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6ee50b-69c9-423a-a89d-adec9c103dbf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:11.615791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6ee50b-69c9-423a-a89d-adec9c103dbf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:11.616233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6ee50b-69c9-423a-a89d-adec9c103dbf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:11.616966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6ee50b-69c9-423a-a89d-adec9c103dbf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:11.617428 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6ee50b-69c9-423a-a89d-adec9c103dbf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:11.617860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6ee50b-69c9-423a-a89d-adec9c103dbf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:11.750528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8c6ee50b-69c9-423a-a89d-adec9c103dbf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:11.759094 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8c6ee50b-69c9-423a-a89d-adec9c103dbf tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.155747 Aug 27 05:35:11.760219 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3687/7327] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:11 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:12.781561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ff2dd5e3-38b1-4896-bf5e-7322e5b5a0c5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:12.782179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ff2dd5e3-38b1-4896-bf5e-7322e5b5a0c5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:12.789572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff2dd5e3-38b1-4896-bf5e-7322e5b5a0c5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:12.790057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff2dd5e3-38b1-4896-bf5e-7322e5b5a0c5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:12.790526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff2dd5e3-38b1-4896-bf5e-7322e5b5a0c5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:12.791708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff2dd5e3-38b1-4896-bf5e-7322e5b5a0c5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:12.792166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff2dd5e3-38b1-4896-bf5e-7322e5b5a0c5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:12.792639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ff2dd5e3-38b1-4896-bf5e-7322e5b5a0c5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:12.923388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ff2dd5e3-38b1-4896-bf5e-7322e5b5a0c5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:12.931533 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ff2dd5e3-38b1-4896-bf5e-7322e5b5a0c5 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.154140 Aug 27 05:35:12.932105 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3641/7328] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:12 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:13.951937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c4bc9ae7-0645-4ec2-a9e2-1405d7c8a5a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:13.952568 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c4bc9ae7-0645-4ec2-a9e2-1405d7c8a5a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:13.959387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4bc9ae7-0645-4ec2-a9e2-1405d7c8a5a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:13.959882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4bc9ae7-0645-4ec2-a9e2-1405d7c8a5a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:13.960347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4bc9ae7-0645-4ec2-a9e2-1405d7c8a5a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:13.961064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4bc9ae7-0645-4ec2-a9e2-1405d7c8a5a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:13.961533 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4bc9ae7-0645-4ec2-a9e2-1405d7c8a5a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:13.961969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4bc9ae7-0645-4ec2-a9e2-1405d7c8a5a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:14.146294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c4bc9ae7-0645-4ec2-a9e2-1405d7c8a5a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:14.155803 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c4bc9ae7-0645-4ec2-a9e2-1405d7c8a5a8 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1722 microversion: 2.1 time: 0.207841 Aug 27 05:35:14.156382 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3688/7329] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:13 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:15.176715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-70150416-7a39-401a-83bc-54316d218795 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:15.177362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-70150416-7a39-401a-83bc-54316d218795 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:15.184941 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70150416-7a39-401a-83bc-54316d218795 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:15.186099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70150416-7a39-401a-83bc-54316d218795 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:15.186541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70150416-7a39-401a-83bc-54316d218795 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:15.187234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70150416-7a39-401a-83bc-54316d218795 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:15.187689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70150416-7a39-401a-83bc-54316d218795 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:15.188113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70150416-7a39-401a-83bc-54316d218795 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:15.362399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-70150416-7a39-401a-83bc-54316d218795 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:15.371337 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-70150416-7a39-401a-83bc-54316d218795 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1715 microversion: 2.1 time: 0.198460 Aug 27 05:35:15.371917 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3642/7330] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:15 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1715 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:15.392018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ce50825-f167-43a0-afd2-8bc9a60d009e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:15.392675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9ce50825-f167-43a0-afd2-8bc9a60d009e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:15.399438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce50825-f167-43a0-afd2-8bc9a60d009e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:15.399934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce50825-f167-43a0-afd2-8bc9a60d009e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:15.400386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce50825-f167-43a0-afd2-8bc9a60d009e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:15.401126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce50825-f167-43a0-afd2-8bc9a60d009e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:15.401598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce50825-f167-43a0-afd2-8bc9a60d009e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:15.402114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce50825-f167-43a0-afd2-8bc9a60d009e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:15.530836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9ce50825-f167-43a0-afd2-8bc9a60d009e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:15.539184 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ce50825-f167-43a0-afd2-8bc9a60d009e tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1715 microversion: 2.1 time: 0.151034 Aug 27 05:35:15.539767 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3689/7331] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:15 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:15.560119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9e422350-afda-44cf-9e9b-3eae4ba4510c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:15.560762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9e422350-afda-44cf-9e9b-3eae4ba4510c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:15.566681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e422350-afda-44cf-9e9b-3eae4ba4510c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:15.567157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e422350-afda-44cf-9e9b-3eae4ba4510c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:15.567589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e422350-afda-44cf-9e9b-3eae4ba4510c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:15.568271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e422350-afda-44cf-9e9b-3eae4ba4510c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:15.568783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e422350-afda-44cf-9e9b-3eae4ba4510c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:15.569210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9e422350-afda-44cf-9e9b-3eae4ba4510c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:15.983250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9e422350-afda-44cf-9e9b-3eae4ba4510c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:15.991638 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9e422350-afda-44cf-9e9b-3eae4ba4510c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1715 microversion: 2.1 time: 0.435901 Aug 27 05:35:15.992222 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3643/7332] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:15 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1715 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:16.013042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57beeef1-3a7d-49f9-b676-49bc502b5c48 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:16.013565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57beeef1-3a7d-49f9-b676-49bc502b5c48 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:16.019522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57beeef1-3a7d-49f9-b676-49bc502b5c48 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:16.020030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57beeef1-3a7d-49f9-b676-49bc502b5c48 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:16.020484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57beeef1-3a7d-49f9-b676-49bc502b5c48 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:16.021251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57beeef1-3a7d-49f9-b676-49bc502b5c48 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:16.021725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57beeef1-3a7d-49f9-b676-49bc502b5c48 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:16.022167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57beeef1-3a7d-49f9-b676-49bc502b5c48 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:16.049493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57beeef1-3a7d-49f9-b676-49bc502b5c48 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:35:16.073318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:16.126876 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57beeef1-3a7d-49f9-b676-49bc502b5c48 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 204 len: 0 microversion: 2.1 time: 0.117406 Aug 27 05:35:16.127488 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3690/7333] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:35:16 2022] DELETE /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:35:16.136377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99281d2c-01b0-4442-9d9e-2ce7c479b219 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:16.137154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-99281d2c-01b0-4442-9d9e-2ce7c479b219 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:16.143266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99281d2c-01b0-4442-9d9e-2ce7c479b219 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:16.143755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99281d2c-01b0-4442-9d9e-2ce7c479b219 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:16.144197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99281d2c-01b0-4442-9d9e-2ce7c479b219 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:16.144932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99281d2c-01b0-4442-9d9e-2ce7c479b219 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:16.145392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99281d2c-01b0-4442-9d9e-2ce7c479b219 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:16.145818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99281d2c-01b0-4442-9d9e-2ce7c479b219 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:16.278668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-99281d2c-01b0-4442-9d9e-2ce7c479b219 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:16.287445 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-99281d2c-01b0-4442-9d9e-2ce7c479b219 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1721 microversion: 2.1 time: 0.155334 Aug 27 05:35:16.288112 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3644/7334] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:16 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:17.310178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa98a9de-45c4-4619-a83a-5556e34540c1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:17.310908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fa98a9de-45c4-4619-a83a-5556e34540c1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:17.318022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa98a9de-45c4-4619-a83a-5556e34540c1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:17.318529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa98a9de-45c4-4619-a83a-5556e34540c1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:17.318987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa98a9de-45c4-4619-a83a-5556e34540c1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:17.319699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa98a9de-45c4-4619-a83a-5556e34540c1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:17.320176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa98a9de-45c4-4619-a83a-5556e34540c1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:17.320645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa98a9de-45c4-4619-a83a-5556e34540c1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:17.455359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa98a9de-45c4-4619-a83a-5556e34540c1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:17.464598 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa98a9de-45c4-4619-a83a-5556e34540c1 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1721 microversion: 2.1 time: 0.159372 Aug 27 05:35:17.465187 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3691/7335] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:17 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:17.828815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-7b8679da-08e4-4f5a-9d32-6d43a237d798 req-0cc9b94b-6f23-4135-aa4d-a20a1c3a20ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0334f97-6cec-413e-9395-3783f5ade31f", "name": "network-vif-plugged", "status": "completed", "tag": "0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:17.839840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7b8679da-08e4-4f5a-9d32-6d43a237d798 req-0cc9b94b-6f23-4135-aa4d-a20a1c3a20ac service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:17.840312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7b8679da-08e4-4f5a-9d32-6d43a237d798 req-0cc9b94b-6f23-4135-aa4d-a20a1c3a20ac service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:17.840775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7b8679da-08e4-4f5a-9d32-6d43a237d798 req-0cc9b94b-6f23-4135-aa4d-a20a1c3a20ac service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:17.852419 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-7b8679da-08e4-4f5a-9d32-6d43a237d798 req-0cc9b94b-6f23-4135-aa4d-a20a1c3a20ac service nova] Creating event network-vif-plugged:0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a for instance a0334f97-6cec-413e-9395-3783f5ade31f on n-h1-854823-1 Aug 27 05:35:17.857749 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-7b8679da-08e4-4f5a-9d32-6d43a237d798 req-0cc9b94b-6f23-4135-aa4d-a20a1c3a20ac service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033048 Aug 27 05:35:17.858449 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3645/7336] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:18.487873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b3c974b-0687-491c-9fbc-50879e4398e4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:18.489164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b3c974b-0687-491c-9fbc-50879e4398e4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:18.496695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b3c974b-0687-491c-9fbc-50879e4398e4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:18.497208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b3c974b-0687-491c-9fbc-50879e4398e4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:18.497662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b3c974b-0687-491c-9fbc-50879e4398e4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:18.498387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b3c974b-0687-491c-9fbc-50879e4398e4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:18.498856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b3c974b-0687-491c-9fbc-50879e4398e4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:18.499296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b3c974b-0687-491c-9fbc-50879e4398e4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:18.570774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b3c974b-0687-491c-9fbc-50879e4398e4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:18.580227 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b3c974b-0687-491c-9fbc-50879e4398e4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1654 microversion: 2.1 time: 0.096375 Aug 27 05:35:18.581117 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3692/7337] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:18 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1654 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:18.732867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-3a824730-c12a-4700-a0f2-9833eedefd4d req-2d948c78-cecb-4cb4-b564-48280d6c5c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0334f97-6cec-413e-9395-3783f5ade31f", "name": "network-vif-deleted", "tag": "0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:18.743103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3a824730-c12a-4700-a0f2-9833eedefd4d req-2d948c78-cecb-4cb4-b564-48280d6c5c96 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:18.743587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3a824730-c12a-4700-a0f2-9833eedefd4d req-2d948c78-cecb-4cb4-b564-48280d6c5c96 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:18.744330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3a824730-c12a-4700-a0f2-9833eedefd4d req-2d948c78-cecb-4cb4-b564-48280d6c5c96 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:18.758317 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-3a824730-c12a-4700-a0f2-9833eedefd4d req-2d948c78-cecb-4cb4-b564-48280d6c5c96 service nova] Creating event network-vif-deleted:0008b8bd-af4a-4e79-a9f1-a99ef13b2c1a for instance a0334f97-6cec-413e-9395-3783f5ade31f on n-h1-854823-1 Aug 27 05:35:18.763908 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-3a824730-c12a-4700-a0f2-9833eedefd4d req-2d948c78-cecb-4cb4-b564-48280d6c5c96 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035226 Aug 27 05:35:18.764917 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3646/7338] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:19.602927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-efcc92a2-b8b1-449d-87ac-a8488d9a26d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:19.603569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-efcc92a2-b8b1-449d-87ac-a8488d9a26d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:19.611345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efcc92a2-b8b1-449d-87ac-a8488d9a26d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:19.611781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efcc92a2-b8b1-449d-87ac-a8488d9a26d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:19.612260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efcc92a2-b8b1-449d-87ac-a8488d9a26d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:19.613195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efcc92a2-b8b1-449d-87ac-a8488d9a26d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:19.613678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efcc92a2-b8b1-449d-87ac-a8488d9a26d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:19.614127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efcc92a2-b8b1-449d-87ac-a8488d9a26d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:19.692106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-efcc92a2-b8b1-449d-87ac-a8488d9a26d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:19.703722 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-efcc92a2-b8b1-449d-87ac-a8488d9a26d4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1369 microversion: 2.1 time: 0.104762 Aug 27 05:35:19.704323 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3693/7339] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:19 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:20.733549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8e369c4d-f518-4425-a689-71a46046c1c4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:20.734147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8e369c4d-f518-4425-a689-71a46046c1c4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:20.740470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e369c4d-f518-4425-a689-71a46046c1c4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:20.740999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e369c4d-f518-4425-a689-71a46046c1c4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:20.741439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e369c4d-f518-4425-a689-71a46046c1c4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:20.742132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e369c4d-f518-4425-a689-71a46046c1c4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:20.742590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e369c4d-f518-4425-a689-71a46046c1c4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:20.743014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8e369c4d-f518-4425-a689-71a46046c1c4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:20.813597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8e369c4d-f518-4425-a689-71a46046c1c4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:20.822761 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8e369c4d-f518-4425-a689-71a46046c1c4 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1369 microversion: 2.1 time: 0.094800 Aug 27 05:35:20.823334 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3647/7340] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:20 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:21.843463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35e98899-df31-4d77-8a81-e905771750ab tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:21.844231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35e98899-df31-4d77-8a81-e905771750ab tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:21.851322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35e98899-df31-4d77-8a81-e905771750ab tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:21.851827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35e98899-df31-4d77-8a81-e905771750ab tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:21.852276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35e98899-df31-4d77-8a81-e905771750ab tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:21.853021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35e98899-df31-4d77-8a81-e905771750ab tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:21.853989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35e98899-df31-4d77-8a81-e905771750ab tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:21.854430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35e98899-df31-4d77-8a81-e905771750ab tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:21.918262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35e98899-df31-4d77-8a81-e905771750ab tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:21.926984 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35e98899-df31-4d77-8a81-e905771750ab tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1369 microversion: 2.1 time: 0.087485 Aug 27 05:35:21.927605 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3694/7341] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:21 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:22.947427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-67c1ff18-296e-497e-a663-4258c97c1a32 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:22.948044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-67c1ff18-296e-497e-a663-4258c97c1a32 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:22.955228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67c1ff18-296e-497e-a663-4258c97c1a32 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:22.955720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67c1ff18-296e-497e-a663-4258c97c1a32 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:22.956180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67c1ff18-296e-497e-a663-4258c97c1a32 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:22.957006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67c1ff18-296e-497e-a663-4258c97c1a32 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:22.957471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67c1ff18-296e-497e-a663-4258c97c1a32 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:22.957967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67c1ff18-296e-497e-a663-4258c97c1a32 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:22.991575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67c1ff18-296e-497e-a663-4258c97c1a32 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:22.992065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67c1ff18-296e-497e-a663-4258c97c1a32 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:22.992521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-67c1ff18-296e-497e-a663-4258c97c1a32 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:22.993004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-67c1ff18-296e-497e-a663-4258c97c1a32 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lazy-loading 'fault' on Instance uuid a0334f97-6cec-413e-9395-3783f5ade31f {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:35:23.038501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-67c1ff18-296e-497e-a663-4258c97c1a32 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebfdf54a7e4026bfa98c8c308a4456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a7ba2c76574547b50a17bb289f2c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:23.045649 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-67c1ff18-296e-497e-a663-4258c97c1a32 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 200 len: 1328 microversion: 2.1 time: 0.102318 Aug 27 05:35:23.046222 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3648/7342] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:22 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:24.066535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6115b13-f0ef-4c97-b4d8-9d5de4316da9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:24.067205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6115b13-f0ef-4c97-b4d8-9d5de4316da9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:24.070282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:24.076608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6115b13-f0ef-4c97-b4d8-9d5de4316da9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:24.077120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6115b13-f0ef-4c97-b4d8-9d5de4316da9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:24.077604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6115b13-f0ef-4c97-b4d8-9d5de4316da9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:24.078333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6115b13-f0ef-4c97-b4d8-9d5de4316da9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:24.078802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6115b13-f0ef-4c97-b4d8-9d5de4316da9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:24.079276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6115b13-f0ef-4c97-b4d8-9d5de4316da9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:24.093675 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d6115b13-f0ef-4c97-b4d8-9d5de4316da9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6115b13-f0ef-4c97-b4d8-9d5de4316da9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f HTTP/1.1 Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'a0334f97-6cec-413e-9395-3783f5ade31f'} Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:24.096215 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:24.100235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:24.100235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:24.100235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:24.100235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:24.100235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:24.100235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:24.100235 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:24.100235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6115b13-f0ef-4c97-b4d8-9d5de4316da9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:24.100235 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6115b13-f0ef-4c97-b4d8-9d5de4316da9 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 404 len: 111 microversion: 2.1 time: 0.034218 Aug 27 05:35:24.100235 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3695/7343] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:24 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:24.157547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cfd0ad57-7756-43db-a76a-470d69aa31c6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:24.159680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cfd0ad57-7756-43db-a76a-470d69aa31c6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:24.167266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfd0ad57-7756-43db-a76a-470d69aa31c6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:24.167762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfd0ad57-7756-43db-a76a-470d69aa31c6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:24.168307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfd0ad57-7756-43db-a76a-470d69aa31c6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:24.168934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfd0ad57-7756-43db-a76a-470d69aa31c6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:24.169394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfd0ad57-7756-43db-a76a-470d69aa31c6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:24.169824 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cfd0ad57-7756-43db-a76a-470d69aa31c6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:24.172492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=100 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:24.183717 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-cfd0ad57-7756-43db-a76a-470d69aa31c6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cfd0ad57-7756-43db-a76a-470d69aa31c6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f/os-volume_attachments HTTP/1.1 Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'server_id': 'a0334f97-6cec-413e-9395-3783f5ade31f'} Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:24.185409 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:24.189379 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:24.189379 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:24.189379 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:24.189379 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:24.189379 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:24.189379 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:24.189379 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:24.189379 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:24.189379 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:24.189379 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:24.189379 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:24.189379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cfd0ad57-7756-43db-a76a-470d69aa31c6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:24.189379 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cfd0ad57-7756-43db-a76a-470d69aa31c6 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033571 Aug 27 05:35:24.189379 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3649/7344] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:35:24 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:27.507939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56cf2cec-19a8-4704-999a-8abe65749810 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:27.508466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-56cf2cec-19a8-4704-999a-8abe65749810 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:27.515865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56cf2cec-19a8-4704-999a-8abe65749810 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.516370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56cf2cec-19a8-4704-999a-8abe65749810 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.516852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56cf2cec-19a8-4704-999a-8abe65749810 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.517571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56cf2cec-19a8-4704-999a-8abe65749810 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.518046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56cf2cec-19a8-4704-999a-8abe65749810 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.518485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56cf2cec-19a8-4704-999a-8abe65749810 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.533104 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-56cf2cec-19a8-4704-999a-8abe65749810 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56cf2cec-19a8-4704-999a-8abe65749810 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f HTTP/1.1 Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'a0334f97-6cec-413e-9395-3783f5ade31f'} Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:27.534886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:27.538394 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:27.538394 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.538394 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.538394 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.538394 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.538394 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.538394 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.538394 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:27.538394 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:27.538394 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:27.538394 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.538394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56cf2cec-19a8-4704-999a-8abe65749810 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:27.538394 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-56cf2cec-19a8-4704-999a-8abe65749810 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 404 len: 111 microversion: 2.1 time: 0.032398 Aug 27 05:35:27.538394 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3696/7345] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:35:27 2022] DELETE /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:27.545940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6f0a1949-3c98-48cb-b3e8-8ae386b0b88f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:27.546568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6f0a1949-3c98-48cb-b3e8-8ae386b0b88f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: a0334f97-6cec-413e-9395-3783f5ade31f] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:27.550706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=40 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:27.554553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f0a1949-3c98-48cb-b3e8-8ae386b0b88f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.555044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f0a1949-3c98-48cb-b3e8-8ae386b0b88f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.555481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f0a1949-3c98-48cb-b3e8-8ae386b0b88f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.556873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f0a1949-3c98-48cb-b3e8-8ae386b0b88f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.557342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f0a1949-3c98-48cb-b3e8-8ae386b0b88f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.557775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6f0a1949-3c98-48cb-b3e8-8ae386b0b88f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.572857 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-6f0a1949-3c98-48cb-b3e8-8ae386b0b88f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6f0a1949-3c98-48cb-b3e8-8ae386b0b88f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f HTTP/1.1 Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'a0334f97-6cec-413e-9395-3783f5ade31f'} Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.574476 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.578356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.578356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.578356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.578356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:27.578356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:27.578356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. Aug 27 05:35:27.578356 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.578356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6f0a1949-3c98-48cb-b3e8-8ae386b0b88f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance a0334f97-6cec-413e-9395-3783f5ade31f could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:27.578356 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6f0a1949-3c98-48cb-b3e8-8ae386b0b88f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f" status: 404 len: 111 microversion: 2.1 time: 0.033995 Aug 27 05:35:27.578356 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3650/7346] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:27 2022] GET /compute/v2.1/servers/a0334f97-6cec-413e-9395-3783f5ade31f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:27.584828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee5b0625-c426-4dda-9e07-fdf6631b50db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:27.585354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee5b0625-c426-4dda-9e07-fdf6631b50db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:27.591517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee5b0625-c426-4dda-9e07-fdf6631b50db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.592023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee5b0625-c426-4dda-9e07-fdf6631b50db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.592479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee5b0625-c426-4dda-9e07-fdf6631b50db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.593239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee5b0625-c426-4dda-9e07-fdf6631b50db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.593710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee5b0625-c426-4dda-9e07-fdf6631b50db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.594151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee5b0625-c426-4dda-9e07-fdf6631b50db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.609116 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ee5b0625-c426-4dda-9e07-fdf6631b50db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee5b0625-c426-4dda-9e07-fdf6631b50db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b HTTP/1.1 Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '33984b8b-7bba-4a1c-be2d-09536810a75b'} Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:27.610725 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:27.614808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:35:27.614808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.614808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.614808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.614808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.614808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.614808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.614808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:27.614808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:27.614808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:35:27.614808 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.614808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee5b0625-c426-4dda-9e07-fdf6631b50db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:27.614808 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee5b0625-c426-4dda-9e07-fdf6631b50db tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "DELETE /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 404 len: 111 microversion: 2.1 time: 0.031305 Aug 27 05:35:27.614808 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3697/7347] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:35:27 2022] DELETE /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:27.621390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7ebd14fd-369d-4fa8-b911-2671d43fb770 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:27.622013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7ebd14fd-369d-4fa8-b911-2671d43fb770 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 33984b8b-7bba-4a1c-be2d-09536810a75b] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:27.628225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ebd14fd-369d-4fa8-b911-2671d43fb770 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.628751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ebd14fd-369d-4fa8-b911-2671d43fb770 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.629194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ebd14fd-369d-4fa8-b911-2671d43fb770 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.629892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ebd14fd-369d-4fa8-b911-2671d43fb770 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.630353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ebd14fd-369d-4fa8-b911-2671d43fb770 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.630784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7ebd14fd-369d-4fa8-b911-2671d43fb770 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.644605 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-7ebd14fd-369d-4fa8-b911-2671d43fb770 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7ebd14fd-369d-4fa8-b911-2671d43fb770 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b HTTP/1.1 Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '33984b8b-7bba-4a1c-be2d-09536810a75b'} Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.646147 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.651018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.651018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.651018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.651018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:27.651018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:27.651018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. Aug 27 05:35:27.651018 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.651018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7ebd14fd-369d-4fa8-b911-2671d43fb770 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance 33984b8b-7bba-4a1c-be2d-09536810a75b could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:27.651018 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7ebd14fd-369d-4fa8-b911-2671d43fb770 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b" status: 404 len: 111 microversion: 2.1 time: 0.030711 Aug 27 05:35:27.651018 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3651/7348] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:27 2022] GET /compute/v2.1/servers/33984b8b-7bba-4a1c-be2d-09536810a75b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:27.657008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf7898da-c58d-4249-8e6a-78b929efbc34 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:27.657524 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf7898da-c58d-4249-8e6a-78b929efbc34 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:27.663668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf7898da-c58d-4249-8e6a-78b929efbc34 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.664174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf7898da-c58d-4249-8e6a-78b929efbc34 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.664660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf7898da-c58d-4249-8e6a-78b929efbc34 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.665379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf7898da-c58d-4249-8e6a-78b929efbc34 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.666353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf7898da-c58d-4249-8e6a-78b929efbc34 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.666796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf7898da-c58d-4249-8e6a-78b929efbc34 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.680811 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-cf7898da-c58d-4249-8e6a-78b929efbc34 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf7898da-c58d-4249-8e6a-78b929efbc34 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 HTTP/1.1 Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'b34e42ff-f325-421d-b150-3166d8410347'} Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:27.683137 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:27.687274 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:35:27.687274 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.687274 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.687274 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.687274 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.687274 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.687274 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.687274 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:27.687274 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:27.687274 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:35:27.687274 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.687274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf7898da-c58d-4249-8e6a-78b929efbc34 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:27.687274 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf7898da-c58d-4249-8e6a-78b929efbc34 tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 404 len: 111 microversion: 2.1 time: 0.031944 Aug 27 05:35:27.687274 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3698/7349] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:35:27 2022] DELETE /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:27.693660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-61860adf-c815-4d6a-b0aa-727c6f5300dd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:27.694354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-61860adf-c815-4d6a-b0aa-727c6f5300dd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: b34e42ff-f325-421d-b150-3166d8410347] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:27.700973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61860adf-c815-4d6a-b0aa-727c6f5300dd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.701561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61860adf-c815-4d6a-b0aa-727c6f5300dd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.702008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61860adf-c815-4d6a-b0aa-727c6f5300dd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.702957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61860adf-c815-4d6a-b0aa-727c6f5300dd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.703423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61860adf-c815-4d6a-b0aa-727c6f5300dd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.703851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61860adf-c815-4d6a-b0aa-727c6f5300dd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.718001 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-61860adf-c815-4d6a-b0aa-727c6f5300dd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-61860adf-c815-4d6a-b0aa-727c6f5300dd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 HTTP/1.1 Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'b34e42ff-f325-421d-b150-3166d8410347'} Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.719538 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.726339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.726339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.726339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.726339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:27.726339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:27.726339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. Aug 27 05:35:27.726339 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.726339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-61860adf-c815-4d6a-b0aa-727c6f5300dd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance b34e42ff-f325-421d-b150-3166d8410347 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:27.726339 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-61860adf-c815-4d6a-b0aa-727c6f5300dd tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347" status: 404 len: 111 microversion: 2.1 time: 0.031416 Aug 27 05:35:27.726339 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3652/7350] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:27 2022] GET /compute/v2.1/servers/b34e42ff-f325-421d-b150-3166d8410347 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:27.730106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c91ee89-5bd6-421d-9e03-f1c94e167a5f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:27.730620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c91ee89-5bd6-421d-9e03-f1c94e167a5f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:27.736802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c91ee89-5bd6-421d-9e03-f1c94e167a5f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.737299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c91ee89-5bd6-421d-9e03-f1c94e167a5f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.737748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c91ee89-5bd6-421d-9e03-f1c94e167a5f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.738461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c91ee89-5bd6-421d-9e03-f1c94e167a5f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.738931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c91ee89-5bd6-421d-9e03-f1c94e167a5f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.739361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c91ee89-5bd6-421d-9e03-f1c94e167a5f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.753623 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6c91ee89-5bd6-421d-9e03-f1c94e167a5f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c91ee89-5bd6-421d-9e03-f1c94e167a5f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 HTTP/1.1 Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '8abccf90-b9e0-4ec9-a1bc-94a103f00664'} Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:27.755196 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:27.759411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:35:27.759411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.759411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.759411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.759411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.759411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.759411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.759411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:27.759411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:27.759411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:35:27.759411 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.759411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c91ee89-5bd6-421d-9e03-f1c94e167a5f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:27.759411 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c91ee89-5bd6-421d-9e03-f1c94e167a5f tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 404 len: 111 microversion: 2.1 time: 0.030950 Aug 27 05:35:27.759411 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3699/7351] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:35:27 2022] DELETE /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:27.765792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d4018547-8af4-4029-a72d-1f095fbfe73b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:27.766410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d4018547-8af4-4029-a72d-1f095fbfe73b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] [instance: 8abccf90-b9e0-4ec9-a1bc-94a103f00664] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:27.772678 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4018547-8af4-4029-a72d-1f095fbfe73b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.773169 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4018547-8af4-4029-a72d-1f095fbfe73b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.773606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4018547-8af4-4029-a72d-1f095fbfe73b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.774302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4018547-8af4-4029-a72d-1f095fbfe73b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:27.774760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4018547-8af4-4029-a72d-1f095fbfe73b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:27.775183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d4018547-8af4-4029-a72d-1f095fbfe73b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:27.791817 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-d4018547-8af4-4029-a72d-1f095fbfe73b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] HTTP exception thrown: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d4018547-8af4-4029-a72d-1f095fbfe73b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Request method failure captured: Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 HTTP/1.1 Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCatmjSiUuBs5Y-40BnOMnVpKe30R_QibTPM4w185cEGbE82968j6K42mwca7ls7VKM8b5geykqEnLU-Yor_1KEpTkzHfBDE4cSwPhN3yXEFdlv5PoHw5a1KT5BBmdFhmo4bIIDsEbBQf08myy0JIv2pkfk_0l5Nk2GudsDTcDBkc0pU Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2a7ba2c76574547b50a17bb289f2c8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: e2a7ba2c76574547b50a17bb289f2c8b Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServerActionsTestJSON-158437960 Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: cdebfdf54a7e4026bfa98c8c308a4456 Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServerActionsTestJSON-158437960-project Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '8abccf90-b9e0-4ec9-a1bc-94a103f00664'} Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:35:27.793418 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.797685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:35:27.797685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:35:27.797685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:35:27.797685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:35:27.797685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:35:27.797685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. Aug 27 05:35:27.797685 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:35:27.797685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d4018547-8af4-4029-a72d-1f095fbfe73b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Returning 404 to user: Instance 8abccf90-b9e0-4ec9-a1bc-94a103f00664 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:35:27.797685 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d4018547-8af4-4029-a72d-1f095fbfe73b tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664" status: 404 len: 111 microversion: 2.1 time: 0.032967 Aug 27 05:35:27.797685 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3653/7352] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:27 2022] GET /compute/v2.1/servers/8abccf90-b9e0-4ec9-a1bc-94a103f00664 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:35:27.803929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a458d774-3ee7-4aeb-9011-492638be022c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] Calling method '.version_select at 0x7f1f20455f70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:27.828166 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a458d774-3ee7-4aeb-9011-492638be022c tempest-ServerActionsTestJSON-158437960 tempest-ServerActionsTestJSON-158437960-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067790246" status: 202 len: 0 microversion: 2.1 time: 0.028204 Aug 27 05:35:27.828813 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3700/7353] 10.222.0.79 () {58 vars in 1221 bytes} [Sat Aug 27 05:35:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067790246 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:35:37.344218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-787752401", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "c3be2966-ce3e-453f-a8b7-a8780e9c8117"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:37.410742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] validate_networks() for [('c3be2966-ce3e-453f-a8b7-a8780e9c8117', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:35:37.780108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=9 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:37.841733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:35:37.842232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:35:37.842781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:35:37.843288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:35:37.844398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:35:37.853775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:37.854343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:37.854974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:37.855770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:37.856296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:37.856839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:37.877095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Getting quotas for project be23ddf7a2ab4796a23f4a92145e1409. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:35:37.882711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Getting quotas for user c7d1df92577944f7b62671d2de4c22ee and project be23ddf7a2ab4796a23f4a92145e1409. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:35:37.896882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:35:37.899967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:35:37.952223 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-09d4cb0f-cba8-4f43-a7cd-b2cd1fb7ba8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746964 Aug 27 05:35:37.958012 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3654/7354] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:35:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 05:35:37.962243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:37.963290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:37.967956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5dfdb9b2-db1e-4d47-a13e-ffafc6aa0f8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:37.968747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5dfdb9b2-db1e-4d47-a13e-ffafc6aa0f8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:38.043895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5dfdb9b2-db1e-4d47-a13e-ffafc6aa0f8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:38.052089 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5dfdb9b2-db1e-4d47-a13e-ffafc6aa0f8b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1216 microversion: 2.1 time: 0.091699 Aug 27 05:35:38.052998 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3701/7355] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:37 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1216 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:35:39.075421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-19a3c2fc-a807-46d9-8d0c-8f5c5e019718 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:39.076001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-19a3c2fc-a807-46d9-8d0c-8f5c5e019718 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:39.082120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19a3c2fc-a807-46d9-8d0c-8f5c5e019718 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:39.082744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19a3c2fc-a807-46d9-8d0c-8f5c5e019718 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:39.083181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19a3c2fc-a807-46d9-8d0c-8f5c5e019718 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:39.083874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19a3c2fc-a807-46d9-8d0c-8f5c5e019718 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:39.084327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19a3c2fc-a807-46d9-8d0c-8f5c5e019718 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:39.084798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-19a3c2fc-a807-46d9-8d0c-8f5c5e019718 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:39.150681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-19a3c2fc-a807-46d9-8d0c-8f5c5e019718 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:39.159483 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-19a3c2fc-a807-46d9-8d0c-8f5c5e019718 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1268 microversion: 2.1 time: 0.089249 Aug 27 05:35:39.160084 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3655/7356] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:39 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1268 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:40.183401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a2898b3-eb3b-4090-92dd-a000e552d420 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:40.184152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a2898b3-eb3b-4090-92dd-a000e552d420 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:40.194313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a2898b3-eb3b-4090-92dd-a000e552d420 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:40.194951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a2898b3-eb3b-4090-92dd-a000e552d420 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:40.195724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a2898b3-eb3b-4090-92dd-a000e552d420 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:40.197020 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a2898b3-eb3b-4090-92dd-a000e552d420 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:40.197566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a2898b3-eb3b-4090-92dd-a000e552d420 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:40.198127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a2898b3-eb3b-4090-92dd-a000e552d420 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:40.493400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a2898b3-eb3b-4090-92dd-a000e552d420 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:40.503909 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a2898b3-eb3b-4090-92dd-a000e552d420 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1316 microversion: 2.1 time: 0.327268 Aug 27 05:35:40.505001 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3702/7357] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:40 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:40.950634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-260f7709-c6ea-4834-b98a-07a7638682c1 req-ed1d9b01-a13a-4272-a371-e82b7df51695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16119cd8-b1a7-4939-9653-66dcf08380e5", "tag": "19b9e45a-e963-46b7-aec9-c2baa588b886"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:40.972220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-260f7709-c6ea-4834-b98a-07a7638682c1 req-ed1d9b01-a13a-4272-a371-e82b7df51695 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:40.973943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-260f7709-c6ea-4834-b98a-07a7638682c1 req-ed1d9b01-a13a-4272-a371-e82b7df51695 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:40.974474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-260f7709-c6ea-4834-b98a-07a7638682c1 req-ed1d9b01-a13a-4272-a371-e82b7df51695 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:40.987105 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-260f7709-c6ea-4834-b98a-07a7638682c1 req-ed1d9b01-a13a-4272-a371-e82b7df51695 service nova] Creating event network-changed:19b9e45a-e963-46b7-aec9-c2baa588b886 for instance 16119cd8-b1a7-4939-9653-66dcf08380e5 on n-h2-854823-1 Aug 27 05:35:40.992280 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-260f7709-c6ea-4834-b98a-07a7638682c1 req-ed1d9b01-a13a-4272-a371-e82b7df51695 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046872 Aug 27 05:35:40.992932 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3656/7358] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:41.529689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dd8039af-7600-42e2-b342-825dbcfb878f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:41.530538 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dd8039af-7600-42e2-b342-825dbcfb878f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:41.537567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd8039af-7600-42e2-b342-825dbcfb878f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:41.538156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd8039af-7600-42e2-b342-825dbcfb878f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:41.538688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd8039af-7600-42e2-b342-825dbcfb878f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:41.539478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd8039af-7600-42e2-b342-825dbcfb878f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:41.540048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd8039af-7600-42e2-b342-825dbcfb878f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:41.541301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd8039af-7600-42e2-b342-825dbcfb878f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:41.671651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dd8039af-7600-42e2-b342-825dbcfb878f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:41.679454 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dd8039af-7600-42e2-b342-825dbcfb878f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1316 microversion: 2.1 time: 0.154971 Aug 27 05:35:41.680031 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3703/7359] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:41 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:42.701741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ea7b4b9-2fa4-46b9-8942-d49e3b1cb646 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:42.703794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1ea7b4b9-2fa4-46b9-8942-d49e3b1cb646 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:42.710676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ea7b4b9-2fa4-46b9-8942-d49e3b1cb646 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:42.711175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ea7b4b9-2fa4-46b9-8942-d49e3b1cb646 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:42.711791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ea7b4b9-2fa4-46b9-8942-d49e3b1cb646 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:42.712709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ea7b4b9-2fa4-46b9-8942-d49e3b1cb646 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:42.713665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ea7b4b9-2fa4-46b9-8942-d49e3b1cb646 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:42.714645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ea7b4b9-2fa4-46b9-8942-d49e3b1cb646 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:42.851518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1ea7b4b9-2fa4-46b9-8942-d49e3b1cb646 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:42.860124 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1ea7b4b9-2fa4-46b9-8942-d49e3b1cb646 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1316 microversion: 2.1 time: 0.164533 Aug 27 05:35:42.860741 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3657/7360] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:42 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:43.880975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ae086f8-2679-4123-911c-8a3f9045e555 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:43.881637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ae086f8-2679-4123-911c-8a3f9045e555 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:43.889301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae086f8-2679-4123-911c-8a3f9045e555 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:43.889799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae086f8-2679-4123-911c-8a3f9045e555 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:43.890253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae086f8-2679-4123-911c-8a3f9045e555 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:43.890995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae086f8-2679-4123-911c-8a3f9045e555 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:43.891466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae086f8-2679-4123-911c-8a3f9045e555 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:43.891914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae086f8-2679-4123-911c-8a3f9045e555 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:44.028678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ae086f8-2679-4123-911c-8a3f9045e555 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:44.036448 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ae086f8-2679-4123-911c-8a3f9045e555 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1316 microversion: 2.1 time: 0.159481 Aug 27 05:35:44.037063 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3704/7361] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:43 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:45.056813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c39ed69c-4fe2-43da-a5c4-7ae19cc7c9f6 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:45.057452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c39ed69c-4fe2-43da-a5c4-7ae19cc7c9f6 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:45.064680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c39ed69c-4fe2-43da-a5c4-7ae19cc7c9f6 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:45.065167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c39ed69c-4fe2-43da-a5c4-7ae19cc7c9f6 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:45.065605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c39ed69c-4fe2-43da-a5c4-7ae19cc7c9f6 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:45.066298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c39ed69c-4fe2-43da-a5c4-7ae19cc7c9f6 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:45.066756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c39ed69c-4fe2-43da-a5c4-7ae19cc7c9f6 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:45.067181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c39ed69c-4fe2-43da-a5c4-7ae19cc7c9f6 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:45.198761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c39ed69c-4fe2-43da-a5c4-7ae19cc7c9f6 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:45.206432 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c39ed69c-4fe2-43da-a5c4-7ae19cc7c9f6 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1316 microversion: 2.1 time: 0.153615 Aug 27 05:35:45.207013 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3658/7362] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:45 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:46.228375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-997a576d-698f-4a0b-b368-11c6f66d497e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:46.228956 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-997a576d-698f-4a0b-b368-11c6f66d497e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:46.235859 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-997a576d-698f-4a0b-b368-11c6f66d497e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:46.236359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-997a576d-698f-4a0b-b368-11c6f66d497e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:46.236839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-997a576d-698f-4a0b-b368-11c6f66d497e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:46.237596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-997a576d-698f-4a0b-b368-11c6f66d497e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:46.238071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-997a576d-698f-4a0b-b368-11c6f66d497e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:46.238507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-997a576d-698f-4a0b-b368-11c6f66d497e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:46.378108 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-997a576d-698f-4a0b-b368-11c6f66d497e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:46.386591 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-997a576d-698f-4a0b-b368-11c6f66d497e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1316 microversion: 2.1 time: 0.162210 Aug 27 05:35:46.387404 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3705/7363] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:46 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:46.492367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-05bbc40e-4767-4827-94d0-3333fabf4245 req-5e42e107-288e-42aa-b7e6-62f1d85f368b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16119cd8-b1a7-4939-9653-66dcf08380e5", "name": "network-vif-plugged", "status": "completed", "tag": "19b9e45a-e963-46b7-aec9-c2baa588b886"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:46.501910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-05bbc40e-4767-4827-94d0-3333fabf4245 req-5e42e107-288e-42aa-b7e6-62f1d85f368b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:46.502398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-05bbc40e-4767-4827-94d0-3333fabf4245 req-5e42e107-288e-42aa-b7e6-62f1d85f368b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:46.502832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-05bbc40e-4767-4827-94d0-3333fabf4245 req-5e42e107-288e-42aa-b7e6-62f1d85f368b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:46.515109 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-05bbc40e-4767-4827-94d0-3333fabf4245 req-5e42e107-288e-42aa-b7e6-62f1d85f368b service nova] Creating event network-vif-plugged:19b9e45a-e963-46b7-aec9-c2baa588b886 for instance 16119cd8-b1a7-4939-9653-66dcf08380e5 on n-h2-854823-1 Aug 27 05:35:46.520426 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-05bbc40e-4767-4827-94d0-3333fabf4245 req-5e42e107-288e-42aa-b7e6-62f1d85f368b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091470 Aug 27 05:35:46.521087 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3659/7364] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:47.408070 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05b2f0a7-d4d3-473d-af68-ad20f2032a24 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:47.408751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05b2f0a7-d4d3-473d-af68-ad20f2032a24 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:47.415500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05b2f0a7-d4d3-473d-af68-ad20f2032a24 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:47.415996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05b2f0a7-d4d3-473d-af68-ad20f2032a24 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:47.416450 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05b2f0a7-d4d3-473d-af68-ad20f2032a24 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:47.417749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05b2f0a7-d4d3-473d-af68-ad20f2032a24 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:47.418219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05b2f0a7-d4d3-473d-af68-ad20f2032a24 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:47.418667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05b2f0a7-d4d3-473d-af68-ad20f2032a24 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:47.550852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05b2f0a7-d4d3-473d-af68-ad20f2032a24 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:47.558600 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05b2f0a7-d4d3-473d-af68-ad20f2032a24 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1316 microversion: 2.1 time: 0.154519 Aug 27 05:35:47.559186 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3706/7365] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:47 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:48.577680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:48.578462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:48.582564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3840c792-fde3-485d-840d-252d8fee1bbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:48.583271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3840c792-fde3-485d-840d-252d8fee1bbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:48.591031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3840c792-fde3-485d-840d-252d8fee1bbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:48.591519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3840c792-fde3-485d-840d-252d8fee1bbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:48.591958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3840c792-fde3-485d-840d-252d8fee1bbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:48.592679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3840c792-fde3-485d-840d-252d8fee1bbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:48.593143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3840c792-fde3-485d-840d-252d8fee1bbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:48.593573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3840c792-fde3-485d-840d-252d8fee1bbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:48.725202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3840c792-fde3-485d-840d-252d8fee1bbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:48.733044 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3840c792-fde3-485d-840d-252d8fee1bbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1505 microversion: 2.1 time: 0.157236 Aug 27 05:35:48.733696 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3660/7366] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:48 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:48.792171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1068487274", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "c3be2966-ce3e-453f-a8b7-a8780e9c8117"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:48.800570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:48.848548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] validate_networks() for [('c3be2966-ce3e-453f-a8b7-a8780e9c8117', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:35:49.222292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:35:49.222733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:35:49.223224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:35:49.223647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:35:49.224075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:35:49.233818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:49.234311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:49.234759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:49.235501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:49.235971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:49.236433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:49.253792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Getting quotas for project be23ddf7a2ab4796a23f4a92145e1409. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:35:49.259180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Getting quotas for user c7d1df92577944f7b62671d2de4c22ee and project be23ddf7a2ab4796a23f4a92145e1409. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:35:49.272633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:35:49.274992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:35:49.320598 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5bba8b9-43e2-4b9b-8d33-045fe953cea8 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532268 Aug 27 05:35:49.321681 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3707/7367] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:35:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:35:49.331857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ddebfb06-bfd2-4d30-9a53-571c0ae718da tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:49.332470 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ddebfb06-bfd2-4d30-9a53-571c0ae718da tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:49.388334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ddebfb06-bfd2-4d30-9a53-571c0ae718da tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:49.395275 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ddebfb06-bfd2-4d30-9a53-571c0ae718da tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 200 len: 1217 microversion: 2.1 time: 0.067276 Aug 27 05:35:49.395852 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3661/7368] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:49 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:50.416140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-089fa886-8ab6-4460-ae06-6d243d13cfbb tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:50.418184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-089fa886-8ab6-4460-ae06-6d243d13cfbb tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:50.426413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089fa886-8ab6-4460-ae06-6d243d13cfbb tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:50.427171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089fa886-8ab6-4460-ae06-6d243d13cfbb tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:50.427816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089fa886-8ab6-4460-ae06-6d243d13cfbb tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:50.428900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089fa886-8ab6-4460-ae06-6d243d13cfbb tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:50.429632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089fa886-8ab6-4460-ae06-6d243d13cfbb tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:50.430146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089fa886-8ab6-4460-ae06-6d243d13cfbb tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:50.504679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-089fa886-8ab6-4460-ae06-6d243d13cfbb tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:50.513133 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-089fa886-8ab6-4460-ae06-6d243d13cfbb tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 200 len: 1287 microversion: 2.1 time: 0.101553 Aug 27 05:35:50.513755 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3708/7369] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:50 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 1287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:51.535716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-95667685-6971-40af-ae50-4ffa65016b69 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:51.536432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-95667685-6971-40af-ae50-4ffa65016b69 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:51.547632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95667685-6971-40af-ae50-4ffa65016b69 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:51.548271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95667685-6971-40af-ae50-4ffa65016b69 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:51.548817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95667685-6971-40af-ae50-4ffa65016b69 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:51.549605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95667685-6971-40af-ae50-4ffa65016b69 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:51.550138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95667685-6971-40af-ae50-4ffa65016b69 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:51.550621 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-95667685-6971-40af-ae50-4ffa65016b69 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:51.753341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-95667685-6971-40af-ae50-4ffa65016b69 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:51.762729 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-95667685-6971-40af-ae50-4ffa65016b69 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 200 len: 1317 microversion: 2.1 time: 0.231232 Aug 27 05:35:51.763487 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3662/7370] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:51 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:51.804155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-337eaf49-8b4c-40a8-8f33-3799e89ad87a req-0bd9876e-f9b9-4068-b347-97eb09569942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e050be-57ae-4498-86bd-28acb1be7ab9", "tag": "54e82a4e-6da6-42c2-af96-7a43ef122d44"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:51.815300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-337eaf49-8b4c-40a8-8f33-3799e89ad87a req-0bd9876e-f9b9-4068-b347-97eb09569942 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:51.815796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-337eaf49-8b4c-40a8-8f33-3799e89ad87a req-0bd9876e-f9b9-4068-b347-97eb09569942 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:51.816247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-337eaf49-8b4c-40a8-8f33-3799e89ad87a req-0bd9876e-f9b9-4068-b347-97eb09569942 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:51.830297 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-337eaf49-8b4c-40a8-8f33-3799e89ad87a req-0bd9876e-f9b9-4068-b347-97eb09569942 service nova] Creating event network-changed:54e82a4e-6da6-42c2-af96-7a43ef122d44 for instance 99e050be-57ae-4498-86bd-28acb1be7ab9 on n-h1-854823-1 Aug 27 05:35:51.836172 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-337eaf49-8b4c-40a8-8f33-3799e89ad87a req-0bd9876e-f9b9-4068-b347-97eb09569942 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035277 Aug 27 05:35:51.837158 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3709/7371] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:52.784915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4e5ef0f6-dbec-43a2-99ad-43c78f194c09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:52.785547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4e5ef0f6-dbec-43a2-99ad-43c78f194c09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:52.793595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e5ef0f6-dbec-43a2-99ad-43c78f194c09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:52.794069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e5ef0f6-dbec-43a2-99ad-43c78f194c09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:52.794499 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e5ef0f6-dbec-43a2-99ad-43c78f194c09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:52.795182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e5ef0f6-dbec-43a2-99ad-43c78f194c09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:52.795631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e5ef0f6-dbec-43a2-99ad-43c78f194c09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:52.796050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4e5ef0f6-dbec-43a2-99ad-43c78f194c09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:52.928801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4e5ef0f6-dbec-43a2-99ad-43c78f194c09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:52.936498 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4e5ef0f6-dbec-43a2-99ad-43c78f194c09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 200 len: 1317 microversion: 2.1 time: 0.155613 Aug 27 05:35:52.937094 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3663/7372] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:52 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:53.958087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5deb7c1e-6445-4b0d-b074-774a85cf09e7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:53.958810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5deb7c1e-6445-4b0d-b074-774a85cf09e7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:53.967205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5deb7c1e-6445-4b0d-b074-774a85cf09e7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:53.967704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5deb7c1e-6445-4b0d-b074-774a85cf09e7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:53.968151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5deb7c1e-6445-4b0d-b074-774a85cf09e7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:53.968894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5deb7c1e-6445-4b0d-b074-774a85cf09e7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:53.969367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5deb7c1e-6445-4b0d-b074-774a85cf09e7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:53.969808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5deb7c1e-6445-4b0d-b074-774a85cf09e7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:54.104478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5deb7c1e-6445-4b0d-b074-774a85cf09e7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:54.112276 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5deb7c1e-6445-4b0d-b074-774a85cf09e7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 200 len: 1317 microversion: 2.1 time: 0.158535 Aug 27 05:35:54.112899 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3710/7373] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:53 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:55.132971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-33a1294b-299d-4c7f-abdc-17d6dc79997e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:55.133630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-33a1294b-299d-4c7f-abdc-17d6dc79997e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:55.140447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33a1294b-299d-4c7f-abdc-17d6dc79997e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:55.140962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33a1294b-299d-4c7f-abdc-17d6dc79997e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:55.141393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33a1294b-299d-4c7f-abdc-17d6dc79997e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:55.142076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33a1294b-299d-4c7f-abdc-17d6dc79997e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:55.142537 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33a1294b-299d-4c7f-abdc-17d6dc79997e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:55.142954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-33a1294b-299d-4c7f-abdc-17d6dc79997e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:55.273653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-33a1294b-299d-4c7f-abdc-17d6dc79997e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:55.282253 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-33a1294b-299d-4c7f-abdc-17d6dc79997e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 200 len: 1317 microversion: 2.1 time: 0.153139 Aug 27 05:35:55.282834 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3664/7374] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:55 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:56.302971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8de04e28-97c2-4d74-b2e5-8090a5a90b51 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:56.303612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8de04e28-97c2-4d74-b2e5-8090a5a90b51 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:56.311289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8de04e28-97c2-4d74-b2e5-8090a5a90b51 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:56.311800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8de04e28-97c2-4d74-b2e5-8090a5a90b51 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:56.312250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8de04e28-97c2-4d74-b2e5-8090a5a90b51 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:56.313019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8de04e28-97c2-4d74-b2e5-8090a5a90b51 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:56.313495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8de04e28-97c2-4d74-b2e5-8090a5a90b51 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:56.313953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8de04e28-97c2-4d74-b2e5-8090a5a90b51 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:56.448876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8de04e28-97c2-4d74-b2e5-8090a5a90b51 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:56.457089 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8de04e28-97c2-4d74-b2e5-8090a5a90b51 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 200 len: 1317 microversion: 2.1 time: 0.158011 Aug 27 05:35:56.457906 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3711/7375] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:56 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:57.478336 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a78b1c91-8c39-4428-bbfc-8671ffb5e4a2 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:57.479606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a78b1c91-8c39-4428-bbfc-8671ffb5e4a2 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:57.486907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78b1c91-8c39-4428-bbfc-8671ffb5e4a2 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:57.487397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78b1c91-8c39-4428-bbfc-8671ffb5e4a2 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:57.487838 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78b1c91-8c39-4428-bbfc-8671ffb5e4a2 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:57.488550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78b1c91-8c39-4428-bbfc-8671ffb5e4a2 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:57.489043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78b1c91-8c39-4428-bbfc-8671ffb5e4a2 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:57.489472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a78b1c91-8c39-4428-bbfc-8671ffb5e4a2 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:57.617532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a78b1c91-8c39-4428-bbfc-8671ffb5e4a2 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:57.626073 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a78b1c91-8c39-4428-bbfc-8671ffb5e4a2 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 200 len: 1317 microversion: 2.1 time: 0.151653 Aug 27 05:35:57.626642 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3665/7376] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:57 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:57.999621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c3951ddc-2cb0-4d80-bcc7-a55cd7699418 req-c56f5a68-7430-46d5-9242-75d1a2b31b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e050be-57ae-4498-86bd-28acb1be7ab9", "name": "network-vif-plugged", "status": "completed", "tag": "54e82a4e-6da6-42c2-af96-7a43ef122d44"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:35:58.010696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c3951ddc-2cb0-4d80-bcc7-a55cd7699418 req-c56f5a68-7430-46d5-9242-75d1a2b31b93 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:58.010946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c3951ddc-2cb0-4d80-bcc7-a55cd7699418 req-c56f5a68-7430-46d5-9242-75d1a2b31b93 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:58.011394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c3951ddc-2cb0-4d80-bcc7-a55cd7699418 req-c56f5a68-7430-46d5-9242-75d1a2b31b93 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:58.023010 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c3951ddc-2cb0-4d80-bcc7-a55cd7699418 req-c56f5a68-7430-46d5-9242-75d1a2b31b93 service nova] Creating event network-vif-plugged:54e82a4e-6da6-42c2-af96-7a43ef122d44 for instance 99e050be-57ae-4498-86bd-28acb1be7ab9 on n-h1-854823-1 Aug 27 05:35:58.029729 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c3951ddc-2cb0-4d80-bcc7-a55cd7699418 req-c56f5a68-7430-46d5-9242-75d1a2b31b93 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034924 Aug 27 05:35:58.030305 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3712/7377] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:35:58.647164 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99f0a793-81d6-4334-80db-b607f2624575 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:58.647784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-99f0a793-81d6-4334-80db-b607f2624575 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:58.650542 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:58.656062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99f0a793-81d6-4334-80db-b607f2624575 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:58.656574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99f0a793-81d6-4334-80db-b607f2624575 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:58.657026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99f0a793-81d6-4334-80db-b607f2624575 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:58.657726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99f0a793-81d6-4334-80db-b607f2624575 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:58.658190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99f0a793-81d6-4334-80db-b607f2624575 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:58.658625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99f0a793-81d6-4334-80db-b607f2624575 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:58.788558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-99f0a793-81d6-4334-80db-b607f2624575 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:58.796188 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-99f0a793-81d6-4334-80db-b607f2624575 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 200 len: 1317 microversion: 2.1 time: 0.152970 Aug 27 05:35:58.796794 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3666/7378] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:58 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:59.815591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:59.816378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:35:59.821393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9bfda26-817e-40f9-9407-5d5fb95bf2f7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:59.822090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9bfda26-817e-40f9-9407-5d5fb95bf2f7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:59.829621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9bfda26-817e-40f9-9407-5d5fb95bf2f7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:59.830116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9bfda26-817e-40f9-9407-5d5fb95bf2f7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:59.830564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9bfda26-817e-40f9-9407-5d5fb95bf2f7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:59.831263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9bfda26-817e-40f9-9407-5d5fb95bf2f7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:35:59.831729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9bfda26-817e-40f9-9407-5d5fb95bf2f7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:35:59.832162 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9bfda26-817e-40f9-9407-5d5fb95bf2f7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:35:59.966478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9bfda26-817e-40f9-9407-5d5fb95bf2f7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:35:59.974259 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9bfda26-817e-40f9-9407-5d5fb95bf2f7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 200 len: 1507 microversion: 2.1 time: 0.160460 Aug 27 05:35:59.974839 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3713/7379] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:35:59 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:35:59.993937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6e5f2576-43aa-42c8-b49f-133dac1b0487 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:35:59.994440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6e5f2576-43aa-42c8-b49f-133dac1b0487 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:35:59.996302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:00.002477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e5f2576-43aa-42c8-b49f-133dac1b0487 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:00.002960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e5f2576-43aa-42c8-b49f-133dac1b0487 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:00.003396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e5f2576-43aa-42c8-b49f-133dac1b0487 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:00.004088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e5f2576-43aa-42c8-b49f-133dac1b0487 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:00.004563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e5f2576-43aa-42c8-b49f-133dac1b0487 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:00.004993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e5f2576-43aa-42c8-b49f-133dac1b0487 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:00.032045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6e5f2576-43aa-42c8-b49f-133dac1b0487 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:36:00.111987 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6e5f2576-43aa-42c8-b49f-133dac1b0487 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "DELETE /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 204 len: 0 microversion: 2.1 time: 0.121660 Aug 27 05:36:00.112626 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3667/7380] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:35:59 2022] DELETE /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:36:00.121171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e211b29-b5f4-42f8-bc19-4fbb14392f70 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:00.121794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e211b29-b5f4-42f8-bc19-4fbb14392f70 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:00.127732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e211b29-b5f4-42f8-bc19-4fbb14392f70 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:00.128227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e211b29-b5f4-42f8-bc19-4fbb14392f70 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:00.128719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e211b29-b5f4-42f8-bc19-4fbb14392f70 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:00.129451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e211b29-b5f4-42f8-bc19-4fbb14392f70 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:00.129912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e211b29-b5f4-42f8-bc19-4fbb14392f70 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:00.130349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e211b29-b5f4-42f8-bc19-4fbb14392f70 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:00.259785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4e211b29-b5f4-42f8-bc19-4fbb14392f70 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:00.268248 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e211b29-b5f4-42f8-bc19-4fbb14392f70 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 200 len: 1513 microversion: 2.1 time: 0.151535 Aug 27 05:36:00.268860 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3714/7381] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:00 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:01.289640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4eec79f1-fce7-4aef-91dd-2a8d45fd9277 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:01.290346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4eec79f1-fce7-4aef-91dd-2a8d45fd9277 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:01.297097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4eec79f1-fce7-4aef-91dd-2a8d45fd9277 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:01.297578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4eec79f1-fce7-4aef-91dd-2a8d45fd9277 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:01.298035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4eec79f1-fce7-4aef-91dd-2a8d45fd9277 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:01.298715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4eec79f1-fce7-4aef-91dd-2a8d45fd9277 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:01.299165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4eec79f1-fce7-4aef-91dd-2a8d45fd9277 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:01.299587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4eec79f1-fce7-4aef-91dd-2a8d45fd9277 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:01.434902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4eec79f1-fce7-4aef-91dd-2a8d45fd9277 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:01.442683 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4eec79f1-fce7-4aef-91dd-2a8d45fd9277 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 200 len: 1513 microversion: 2.1 time: 0.157277 Aug 27 05:36:01.443252 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3668/7382] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:01 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:02.067742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-846205b0-76b0-447c-a46e-f331f6b3c0c1 req-009dde0b-d5aa-4876-b380-45637dca469f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e050be-57ae-4498-86bd-28acb1be7ab9", "name": "network-vif-deleted", "tag": "54e82a4e-6da6-42c2-af96-7a43ef122d44"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:02.080503 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-846205b0-76b0-447c-a46e-f331f6b3c0c1 req-009dde0b-d5aa-4876-b380-45637dca469f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:02.081196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-846205b0-76b0-447c-a46e-f331f6b3c0c1 req-009dde0b-d5aa-4876-b380-45637dca469f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:02.081751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-846205b0-76b0-447c-a46e-f331f6b3c0c1 req-009dde0b-d5aa-4876-b380-45637dca469f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:02.111513 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-846205b0-76b0-447c-a46e-f331f6b3c0c1 req-009dde0b-d5aa-4876-b380-45637dca469f service nova] Creating event network-vif-deleted:54e82a4e-6da6-42c2-af96-7a43ef122d44 for instance 99e050be-57ae-4498-86bd-28acb1be7ab9 on n-h1-854823-1 Aug 27 05:36:02.118370 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-846205b0-76b0-447c-a46e-f331f6b3c0c1 req-009dde0b-d5aa-4876-b380-45637dca469f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055498 Aug 27 05:36:02.119300 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3715/7383] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:36:02.464442 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-da73dd67-f5ca-4b5c-a49c-09d25ef8acbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:02.465544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-da73dd67-f5ca-4b5c-a49c-09d25ef8acbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:02.472209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da73dd67-f5ca-4b5c-a49c-09d25ef8acbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:02.472659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da73dd67-f5ca-4b5c-a49c-09d25ef8acbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:02.473095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da73dd67-f5ca-4b5c-a49c-09d25ef8acbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:02.473793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da73dd67-f5ca-4b5c-a49c-09d25ef8acbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:02.474245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da73dd67-f5ca-4b5c-a49c-09d25ef8acbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:02.474666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da73dd67-f5ca-4b5c-a49c-09d25ef8acbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:02.510878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da73dd67-f5ca-4b5c-a49c-09d25ef8acbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:02.511737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da73dd67-f5ca-4b5c-a49c-09d25ef8acbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:02.512155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da73dd67-f5ca-4b5c-a49c-09d25ef8acbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:02.512820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-da73dd67-f5ca-4b5c-a49c-09d25ef8acbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lazy-loading 'fault' on Instance uuid 99e050be-57ae-4498-86bd-28acb1be7ab9 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:36:02.566677 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-da73dd67-f5ca-4b5c-a49c-09d25ef8acbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:02.578660 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-da73dd67-f5ca-4b5c-a49c-09d25ef8acbd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 200 len: 1307 microversion: 2.1 time: 0.118863 Aug 27 05:36:02.579339 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3669/7384] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:02 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 1307 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:03.603509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90387885-44b5-479c-bb56-1cbf2db3c171 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:03.604226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90387885-44b5-479c-bb56-1cbf2db3c171 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:03.611273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90387885-44b5-479c-bb56-1cbf2db3c171 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:03.611774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90387885-44b5-479c-bb56-1cbf2db3c171 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:03.612230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90387885-44b5-479c-bb56-1cbf2db3c171 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:03.612975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90387885-44b5-479c-bb56-1cbf2db3c171 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:03.613445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90387885-44b5-479c-bb56-1cbf2db3c171 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:03.613884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90387885-44b5-479c-bb56-1cbf2db3c171 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:03.630172 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-90387885-44b5-479c-bb56-1cbf2db3c171 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] HTTP exception thrown: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90387885-44b5-479c-bb56-1cbf2db3c171 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Request method failure captured: Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 HTTP/1.1 Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCa0pJX52e6T9LfMyEyp5MSV5Nl1lCChsdvNrEI5zV3RDraDK7SXSgPn5a6G3wbfxgqnu7Zyta-Biyuo_WLKJvIVjL4NYyeY5P9k4GwJvRZn8LaVGVMN9xoWSgrE9HRDBYdfUViyIp8Ed-DNdZkAG5285jcUe2l4Rnx1zfC8vYhwqW3k Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: be23ddf7a2ab4796a23f4a92145e1409 Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: be23ddf7a2ab4796a23f4a92145e1409 Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-277439967-project Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: c7d1df92577944f7b62671d2de4c22ee Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-277439967-project Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '99e050be-57ae-4498-86bd-28acb1be7ab9'} Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:03.631830 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:03.636886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:03.636886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:03.636886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:03.636886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:36:03.636886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:36:03.636886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:03.636886 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:03.636886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90387885-44b5-479c-bb56-1cbf2db3c171 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Returning 404 to user: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:36:03.636886 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90387885-44b5-479c-bb56-1cbf2db3c171 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 404 len: 111 microversion: 2.1 time: 0.035002 Aug 27 05:36:03.636886 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3716/7385] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:03 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:36:03.643332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-77df7da2-6260-4c53-bbcf-0bc383adfc09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:03.643955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-77df7da2-6260-4c53-bbcf-0bc383adfc09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:03.651683 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77df7da2-6260-4c53-bbcf-0bc383adfc09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:03.652176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77df7da2-6260-4c53-bbcf-0bc383adfc09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:03.652640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77df7da2-6260-4c53-bbcf-0bc383adfc09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:03.653608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77df7da2-6260-4c53-bbcf-0bc383adfc09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:03.654071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77df7da2-6260-4c53-bbcf-0bc383adfc09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:03.654504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77df7da2-6260-4c53-bbcf-0bc383adfc09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:03.785062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-77df7da2-6260-4c53-bbcf-0bc383adfc09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:03.793060 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-77df7da2-6260-4c53-bbcf-0bc383adfc09 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1505 microversion: 2.1 time: 0.153480 Aug 27 05:36:03.793646 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3670/7386] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:03 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:03.813208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50a9c9dc-ed62-4c0c-bc77-a98601782a81 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:03.815449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50a9c9dc-ed62-4c0c-bc77-a98601782a81 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: c875f11e-f827-4899-9f2f-7e2c9f536f3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:03.820980 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-50a9c9dc-ed62-4c0c-bc77-a98601782a81 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] HTTP exception thrown: Instance c875f11e-f827-4899-9f2f-7e2c9f536f3b could not be found. Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50a9c9dc-ed62-4c0c-bc77-a98601782a81 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Request method failure captured: Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/c875f11e-f827-4899-9f2f-7e2c9f536f3b/action HTTP/1.1 Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 32 Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCa0pJX52e6T9LfMyEyp5MSV5Nl1lCChsdvNrEI5zV3RDraDK7SXSgPn5a6G3wbfxgqnu7Zyta-Biyuo_WLKJvIVjL4NYyeY5P9k4GwJvRZn8LaVGVMN9xoWSgrE9HRDBYdfUViyIp8Ed-DNdZkAG5285jcUe2l4Rnx1zfC8vYhwqW3k Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: be23ddf7a2ab4796a23f4a92145e1409 Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: be23ddf7a2ab4796a23f4a92145e1409 Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-277439967-project Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: c7d1df92577944f7b62671d2de4c22ee Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-277439967-project Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: {"resize": {"flavorRef": "452"}} Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance c875f11e-f827-4899-9f2f-7e2c9f536f3b could not be found. Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'c875f11e-f827-4899-9f2f-7e2c9f536f3b', 'body': {'resize': {'flavorRef': '452'}}} Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c875f11e-f827-4899-9f2f-7e2c9f536f3b could not be found. Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:36:03.823033 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:36:03.827672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c875f11e-f827-4899-9f2f-7e2c9f536f3b could not be found. Aug 27 05:36:03.827672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:03.827672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:03.827672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:03.827672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:03.827672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:03.827672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:03.827672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:36:03.827672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:36:03.827672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c875f11e-f827-4899-9f2f-7e2c9f536f3b could not be found. Aug 27 05:36:03.827672 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:03.827672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50a9c9dc-ed62-4c0c-bc77-a98601782a81 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Returning 404 to user: Instance c875f11e-f827-4899-9f2f-7e2c9f536f3b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:36:03.827672 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50a9c9dc-ed62-4c0c-bc77-a98601782a81 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "POST /compute/v2.1/servers/c875f11e-f827-4899-9f2f-7e2c9f536f3b/action" status: 404 len: 111 microversion: 2.1 time: 0.015426 Aug 27 05:36:03.827672 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3717/7387] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:36:03 2022] POST /compute/v2.1/servers/c875f11e-f827-4899-9f2f-7e2c9f536f3b/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:36:03.833023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9035f3d3-28a4-4725-af2d-fab07fd8cc50 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:03.833663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9035f3d3-28a4-4725-af2d-fab07fd8cc50 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:03.840302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9035f3d3-28a4-4725-af2d-fab07fd8cc50 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:03.840816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9035f3d3-28a4-4725-af2d-fab07fd8cc50 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:03.841254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9035f3d3-28a4-4725-af2d-fab07fd8cc50 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:03.841950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9035f3d3-28a4-4725-af2d-fab07fd8cc50 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:03.842410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9035f3d3-28a4-4725-af2d-fab07fd8cc50 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:03.842839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9035f3d3-28a4-4725-af2d-fab07fd8cc50 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:03.860793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:03.974859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9035f3d3-28a4-4725-af2d-fab07fd8cc50 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:03.982593 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9035f3d3-28a4-4725-af2d-fab07fd8cc50 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1505 microversion: 2.1 time: 0.153385 Aug 27 05:36:03.983178 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3671/7388] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:03 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:04.004077 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c4c9965e-61e2-4d83-8cc1-df9de891f2a3 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:04.004659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c4c9965e-61e2-4d83-8cc1-df9de891f2a3 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:04.012909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4c9965e-61e2-4d83-8cc1-df9de891f2a3 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.013425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4c9965e-61e2-4d83-8cc1-df9de891f2a3 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.013883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4c9965e-61e2-4d83-8cc1-df9de891f2a3 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.014614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4c9965e-61e2-4d83-8cc1-df9de891f2a3 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.015096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4c9965e-61e2-4d83-8cc1-df9de891f2a3 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.015544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4c9965e-61e2-4d83-8cc1-df9de891f2a3 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.145548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c4c9965e-61e2-4d83-8cc1-df9de891f2a3 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:04.155092 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c4c9965e-61e2-4d83-8cc1-df9de891f2a3 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1505 microversion: 2.1 time: 0.154876 Aug 27 05:36:04.155691 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3718/7389] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:03 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:04.175235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb67c6f5-9104-44e8-8f0a-78f9218e5a9a tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "ee31cb14-bbef-4ebf-816f-59303bc2daaa"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:04.177591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eb67c6f5-9104-44e8-8f0a-78f9218e5a9a tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:04.184200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb67c6f5-9104-44e8-8f0a-78f9218e5a9a tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.184714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb67c6f5-9104-44e8-8f0a-78f9218e5a9a tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.185150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb67c6f5-9104-44e8-8f0a-78f9218e5a9a tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.185835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb67c6f5-9104-44e8-8f0a-78f9218e5a9a tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.186284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb67c6f5-9104-44e8-8f0a-78f9218e5a9a tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.186702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb67c6f5-9104-44e8-8f0a-78f9218e5a9a tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.272626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb67c6f5-9104-44e8-8f0a-78f9218e5a9a tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:04.279760 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-eb67c6f5-9104-44e8-8f0a-78f9218e5a9a tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] HTTP exception thrown: Flavor ee31cb14-bbef-4ebf-816f-59303bc2daaa could not be found. Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb67c6f5-9104-44e8-8f0a-78f9218e5a9a tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Request method failure captured: Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: request: POST /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5/action HTTP/1.1 Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 65 Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCa0pJX52e6T9LfMyEyp5MSV5Nl1lCChsdvNrEI5zV3RDraDK7SXSgPn5a6G3wbfxgqnu7Zyta-Biyuo_WLKJvIVjL4NYyeY5P9k4GwJvRZn8LaVGVMN9xoWSgrE9HRDBYdfUViyIp8Ed-DNdZkAG5285jcUe2l4Rnx1zfC8vYhwqW3k Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: be23ddf7a2ab4796a23f4a92145e1409 Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: be23ddf7a2ab4796a23f4a92145e1409 Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-277439967-project Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: c7d1df92577944f7b62671d2de4c22ee Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-277439967-project Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: {"resize": {"flavorRef": "ee31cb14-bbef-4ebf-816f-59303bc2daaa"}} Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: exception: Flavor ee31cb14-bbef-4ebf-816f-59303bc2daaa could not be found. Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '16119cd8-b1a7-4939-9653-66dcf08380e5', 'body': {'resize': {'flavorRef': 'ee31cb14-bbef-4ebf-816f-59303bc2daaa'}}} Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:36:04.287788 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ee31cb14-bbef-4ebf-816f-59303bc2daaa could not be found. Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor ee31cb14-bbef-4ebf-816f-59303bc2daaa could not be found. Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ee31cb14-bbef-4ebf-816f-59303bc2daaa could not be found. Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb67c6f5-9104-44e8-8f0a-78f9218e5a9a tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Returning 400 to user: Flavor ee31cb14-bbef-4ebf-816f-59303bc2daaa could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb67c6f5-9104-44e8-8f0a-78f9218e5a9a tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "POST /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5/action" status: 400 len: 107 microversion: 2.1 time: 0.117980 Aug 27 05:36:04.292863 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3672/7390] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:36:04 2022] POST /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5/action => generated 107 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:36:04.299050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f692e09d-de22-4a27-93d2-28da3670a952 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:04.299676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f692e09d-de22-4a27-93d2-28da3670a952 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:04.305697 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f692e09d-de22-4a27-93d2-28da3670a952 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.306191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f692e09d-de22-4a27-93d2-28da3670a952 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.306631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f692e09d-de22-4a27-93d2-28da3670a952 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.307928 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f692e09d-de22-4a27-93d2-28da3670a952 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.308390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f692e09d-de22-4a27-93d2-28da3670a952 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.308854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f692e09d-de22-4a27-93d2-28da3670a952 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.440931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f692e09d-de22-4a27-93d2-28da3670a952 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:04.448744 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f692e09d-de22-4a27-93d2-28da3670a952 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1505 microversion: 2.1 time: 0.153507 Aug 27 05:36:04.449334 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3719/7391] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:04 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:04.470007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6216be84-bea2-4e86-a96f-4b655e298f38 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:04.470626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6216be84-bea2-4e86-a96f-4b655e298f38 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:04.476688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6216be84-bea2-4e86-a96f-4b655e298f38 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.477181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6216be84-bea2-4e86-a96f-4b655e298f38 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.477629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6216be84-bea2-4e86-a96f-4b655e298f38 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.478330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6216be84-bea2-4e86-a96f-4b655e298f38 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.479290 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6216be84-bea2-4e86-a96f-4b655e298f38 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.479967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6216be84-bea2-4e86-a96f-4b655e298f38 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.613694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6216be84-bea2-4e86-a96f-4b655e298f38 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:04.621589 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6216be84-bea2-4e86-a96f-4b655e298f38 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1505 microversion: 2.1 time: 0.155583 Aug 27 05:36:04.622167 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3673/7392] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:04 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:04.641588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1027a5c4-005c-40c4-bd14-3c5ce92d5ecd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1027a5c4-005c-40c4-bd14-3c5ce92d5ecd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Request method failure captured: Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5/action HTTP/1.1 Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 29 Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCa0pJX52e6T9LfMyEyp5MSV5Nl1lCChsdvNrEI5zV3RDraDK7SXSgPn5a6G3wbfxgqnu7Zyta-Biyuo_WLKJvIVjL4NYyeY5P9k4GwJvRZn8LaVGVMN9xoWSgrE9HRDBYdfUViyIp8Ed-DNdZkAG5285jcUe2l4Rnx1zfC8vYhwqW3k Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: be23ddf7a2ab4796a23f4a92145e1409 Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: be23ddf7a2ab4796a23f4a92145e1409 Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-277439967-project Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: c7d1df92577944f7b62671d2de4c22ee Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-277439967-project Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: {"resize": {"flavorRef": ""}} Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '16119cd8-b1a7-4939-9653-66dcf08380e5', 'body': {'resize': {'flavorRef': ''}}} Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi '' Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.645231 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:04.649462 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.649462 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:04.649462 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:04.649462 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:04.649462 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 05:36:04.649462 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 05:36:04.649462 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 05:36:04.649462 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.649462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1027a5c4-005c-40c4-bd14-3c5ce92d5ecd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:36:04.649462 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1027a5c4-005c-40c4-bd14-3c5ce92d5ecd tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "POST /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5/action" status: 400 len: 113 microversion: 2.1 time: 0.009083 Aug 27 05:36:04.649462 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3720/7393] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:36:04 2022] POST /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 05:36:04.655730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5be0b1e3-c24f-4202-b49b-0394aee7ed5c tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:04.656349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5be0b1e3-c24f-4202-b49b-0394aee7ed5c tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:04.663239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5be0b1e3-c24f-4202-b49b-0394aee7ed5c tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.663730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5be0b1e3-c24f-4202-b49b-0394aee7ed5c tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.664171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5be0b1e3-c24f-4202-b49b-0394aee7ed5c tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.664903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5be0b1e3-c24f-4202-b49b-0394aee7ed5c tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.665365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5be0b1e3-c24f-4202-b49b-0394aee7ed5c tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.665798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5be0b1e3-c24f-4202-b49b-0394aee7ed5c tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.801601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5be0b1e3-c24f-4202-b49b-0394aee7ed5c tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:04.809670 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5be0b1e3-c24f-4202-b49b-0394aee7ed5c tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1505 microversion: 2.1 time: 0.158031 Aug 27 05:36:04.810407 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3674/7394] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:04 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:04.834181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96c52ae6-ccee-4528-9538-bcc4f5afd8d1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:04.834617 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-96c52ae6-ccee-4528-9538-bcc4f5afd8d1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:04.842611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96c52ae6-ccee-4528-9538-bcc4f5afd8d1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.843116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96c52ae6-ccee-4528-9538-bcc4f5afd8d1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.843570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96c52ae6-ccee-4528-9538-bcc4f5afd8d1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.844280 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96c52ae6-ccee-4528-9538-bcc4f5afd8d1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.844784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96c52ae6-ccee-4528-9538-bcc4f5afd8d1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.845226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96c52ae6-ccee-4528-9538-bcc4f5afd8d1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.859275 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-96c52ae6-ccee-4528-9538-bcc4f5afd8d1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] HTTP exception thrown: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96c52ae6-ccee-4528-9538-bcc4f5afd8d1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Request method failure captured: Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 HTTP/1.1 Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCa0pJX52e6T9LfMyEyp5MSV5Nl1lCChsdvNrEI5zV3RDraDK7SXSgPn5a6G3wbfxgqnu7Zyta-Biyuo_WLKJvIVjL4NYyeY5P9k4GwJvRZn8LaVGVMN9xoWSgrE9HRDBYdfUViyIp8Ed-DNdZkAG5285jcUe2l4Rnx1zfC8vYhwqW3k Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: be23ddf7a2ab4796a23f4a92145e1409 Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: be23ddf7a2ab4796a23f4a92145e1409 Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-277439967-project Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: c7d1df92577944f7b62671d2de4c22ee Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-277439967-project Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '99e050be-57ae-4498-86bd-28acb1be7ab9'} Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:36:04.860885 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:36:04.865622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:04.865622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.865622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:04.865622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.865622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:04.865622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:04.865622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:04.865622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:36:04.865622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:36:04.865622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:04.865622 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.865622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96c52ae6-ccee-4528-9538-bcc4f5afd8d1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Returning 404 to user: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:36:04.865622 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96c52ae6-ccee-4528-9538-bcc4f5afd8d1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "DELETE /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 404 len: 111 microversion: 2.1 time: 0.033296 Aug 27 05:36:04.865622 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3721/7395] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:36:04 2022] DELETE /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:36:04.870921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-13a53037-9b2f-4ffb-85ad-109b87c1e4c1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:04.871572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-13a53037-9b2f-4ffb-85ad-109b87c1e4c1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 99e050be-57ae-4498-86bd-28acb1be7ab9] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:04.878047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13a53037-9b2f-4ffb-85ad-109b87c1e4c1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.878539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13a53037-9b2f-4ffb-85ad-109b87c1e4c1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.878980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13a53037-9b2f-4ffb-85ad-109b87c1e4c1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.879676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13a53037-9b2f-4ffb-85ad-109b87c1e4c1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.880139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13a53037-9b2f-4ffb-85ad-109b87c1e4c1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.880596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13a53037-9b2f-4ffb-85ad-109b87c1e4c1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.894375 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-13a53037-9b2f-4ffb-85ad-109b87c1e4c1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] HTTP exception thrown: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-13a53037-9b2f-4ffb-85ad-109b87c1e4c1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Request method failure captured: Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 HTTP/1.1 Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCa0pJX52e6T9LfMyEyp5MSV5Nl1lCChsdvNrEI5zV3RDraDK7SXSgPn5a6G3wbfxgqnu7Zyta-Biyuo_WLKJvIVjL4NYyeY5P9k4GwJvRZn8LaVGVMN9xoWSgrE9HRDBYdfUViyIp8Ed-DNdZkAG5285jcUe2l4Rnx1zfC8vYhwqW3k Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: be23ddf7a2ab4796a23f4a92145e1409 Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: be23ddf7a2ab4796a23f4a92145e1409 Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-277439967-project Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: c7d1df92577944f7b62671d2de4c22ee Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-277439967-project Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '99e050be-57ae-4498-86bd-28acb1be7ab9'} Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:04.895942 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.901974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:04.901974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:04.901974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:04.901974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:36:04.901974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:36:04.901974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. Aug 27 05:36:04.901974 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:04.901974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-13a53037-9b2f-4ffb-85ad-109b87c1e4c1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Returning 404 to user: Instance 99e050be-57ae-4498-86bd-28acb1be7ab9 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:36:04.901974 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-13a53037-9b2f-4ffb-85ad-109b87c1e4c1 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9" status: 404 len: 111 microversion: 2.1 time: 0.030305 Aug 27 05:36:04.901974 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3675/7396] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:04 2022] GET /compute/v2.1/servers/99e050be-57ae-4498-86bd-28acb1be7ab9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:36:04.910031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-770e3752-4d05-4b1f-a3a2-3bd6748e23a7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:04.910031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-770e3752-4d05-4b1f-a3a2-3bd6748e23a7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:04.913757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-770e3752-4d05-4b1f-a3a2-3bd6748e23a7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.914261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-770e3752-4d05-4b1f-a3a2-3bd6748e23a7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.914710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-770e3752-4d05-4b1f-a3a2-3bd6748e23a7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.915413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-770e3752-4d05-4b1f-a3a2-3bd6748e23a7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:04.915876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-770e3752-4d05-4b1f-a3a2-3bd6748e23a7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:04.917772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-770e3752-4d05-4b1f-a3a2-3bd6748e23a7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:04.943056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-770e3752-4d05-4b1f-a3a2-3bd6748e23a7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:36:04.991906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:05.020440 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-770e3752-4d05-4b1f-a3a2-3bd6748e23a7 tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "DELETE /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 204 len: 0 microversion: 2.1 time: 0.117096 Aug 27 05:36:05.021261 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3722/7397] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:36:04 2022] DELETE /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:36:05.032248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f2adbf19-898d-413c-b523-3e8c1fa5af2f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:05.033057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f2adbf19-898d-413c-b523-3e8c1fa5af2f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:05.039571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2adbf19-898d-413c-b523-3e8c1fa5af2f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:05.040067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2adbf19-898d-413c-b523-3e8c1fa5af2f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:05.040512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2adbf19-898d-413c-b523-3e8c1fa5af2f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:05.041253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2adbf19-898d-413c-b523-3e8c1fa5af2f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:05.041712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2adbf19-898d-413c-b523-3e8c1fa5af2f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:05.042142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f2adbf19-898d-413c-b523-3e8c1fa5af2f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:05.185366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f2adbf19-898d-413c-b523-3e8c1fa5af2f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:05.193670 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f2adbf19-898d-413c-b523-3e8c1fa5af2f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1511 microversion: 2.1 time: 0.167786 Aug 27 05:36:05.194274 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3676/7398] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:05 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:06.216753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee6cd6b4-5190-4991-bf87-55e3658bbb8e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:06.217399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee6cd6b4-5190-4991-bf87-55e3658bbb8e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:06.224350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee6cd6b4-5190-4991-bf87-55e3658bbb8e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:06.224893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee6cd6b4-5190-4991-bf87-55e3658bbb8e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:06.225348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee6cd6b4-5190-4991-bf87-55e3658bbb8e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:06.226065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee6cd6b4-5190-4991-bf87-55e3658bbb8e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:06.226536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee6cd6b4-5190-4991-bf87-55e3658bbb8e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:06.226979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee6cd6b4-5190-4991-bf87-55e3658bbb8e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:06.363771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee6cd6b4-5190-4991-bf87-55e3658bbb8e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:06.371665 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee6cd6b4-5190-4991-bf87-55e3658bbb8e tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1511 microversion: 2.1 time: 0.159847 Aug 27 05:36:06.372243 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3723/7399] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:06 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:06.999375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-f2034c40-84c1-45f8-ab48-4fadcea9e77f req-d72c6115-57f0-43a4-b193-a4ff16aa2a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16119cd8-b1a7-4939-9653-66dcf08380e5", "name": "network-vif-deleted", "tag": "19b9e45a-e963-46b7-aec9-c2baa588b886"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:07.010431 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f2034c40-84c1-45f8-ab48-4fadcea9e77f req-d72c6115-57f0-43a4-b193-a4ff16aa2a91 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:07.010905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f2034c40-84c1-45f8-ab48-4fadcea9e77f req-d72c6115-57f0-43a4-b193-a4ff16aa2a91 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:07.011455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-f2034c40-84c1-45f8-ab48-4fadcea9e77f req-d72c6115-57f0-43a4-b193-a4ff16aa2a91 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:07.024374 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-f2034c40-84c1-45f8-ab48-4fadcea9e77f req-d72c6115-57f0-43a4-b193-a4ff16aa2a91 service nova] Creating event network-vif-deleted:19b9e45a-e963-46b7-aec9-c2baa588b886 for instance 16119cd8-b1a7-4939-9653-66dcf08380e5 on n-h2-854823-1 Aug 27 05:36:07.031386 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-f2034c40-84c1-45f8-ab48-4fadcea9e77f req-d72c6115-57f0-43a4-b193-a4ff16aa2a91 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105824 Aug 27 05:36:07.032334 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3677/7400] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:36:07.391742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31b81351-3c22-474c-bb7b-6e7c3fecf11b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:07.392376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31b81351-3c22-474c-bb7b-6e7c3fecf11b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:07.399748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b81351-3c22-474c-bb7b-6e7c3fecf11b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:07.400262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b81351-3c22-474c-bb7b-6e7c3fecf11b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:07.401828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b81351-3c22-474c-bb7b-6e7c3fecf11b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:07.401828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b81351-3c22-474c-bb7b-6e7c3fecf11b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:07.402178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b81351-3c22-474c-bb7b-6e7c3fecf11b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:07.402620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b81351-3c22-474c-bb7b-6e7c3fecf11b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:07.445085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b81351-3c22-474c-bb7b-6e7c3fecf11b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:07.445771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b81351-3c22-474c-bb7b-6e7c3fecf11b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:07.446227 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b81351-3c22-474c-bb7b-6e7c3fecf11b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:07.446706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-31b81351-3c22-474c-bb7b-6e7c3fecf11b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lazy-loading 'fault' on Instance uuid 16119cd8-b1a7-4939-9653-66dcf08380e5 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:36:07.490109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31b81351-3c22-474c-bb7b-6e7c3fecf11b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d1df92577944f7b62671d2de4c22ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be23ddf7a2ab4796a23f4a92145e1409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:07.499135 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31b81351-3c22-474c-bb7b-6e7c3fecf11b tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 200 len: 1306 microversion: 2.1 time: 0.111255 Aug 27 05:36:07.499733 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3724/7401] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:07 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 1306 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:08.521187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c6ad0a1-8f93-4ae2-84be-5bc9e38e5d9f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:08.521889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8c6ad0a1-8f93-4ae2-84be-5bc9e38e5d9f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] [instance: 16119cd8-b1a7-4939-9653-66dcf08380e5] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:08.528760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c6ad0a1-8f93-4ae2-84be-5bc9e38e5d9f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:08.529279 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c6ad0a1-8f93-4ae2-84be-5bc9e38e5d9f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:08.529726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c6ad0a1-8f93-4ae2-84be-5bc9e38e5d9f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:08.530441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c6ad0a1-8f93-4ae2-84be-5bc9e38e5d9f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:08.530909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c6ad0a1-8f93-4ae2-84be-5bc9e38e5d9f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:08.531383 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c6ad0a1-8f93-4ae2-84be-5bc9e38e5d9f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:08.545184 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-8c6ad0a1-8f93-4ae2-84be-5bc9e38e5d9f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] HTTP exception thrown: Instance 16119cd8-b1a7-4939-9653-66dcf08380e5 could not be found. Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c6ad0a1-8f93-4ae2-84be-5bc9e38e5d9f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Request method failure captured: Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 HTTP/1.1 Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCa0pJX52e6T9LfMyEyp5MSV5Nl1lCChsdvNrEI5zV3RDraDK7SXSgPn5a6G3wbfxgqnu7Zyta-Biyuo_WLKJvIVjL4NYyeY5P9k4GwJvRZn8LaVGVMN9xoWSgrE9HRDBYdfUViyIp8Ed-DNdZkAG5285jcUe2l4Rnx1zfC8vYhwqW3k Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: be23ddf7a2ab4796a23f4a92145e1409 Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be23ddf7a2ab4796a23f4a92145e1409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: be23ddf7a2ab4796a23f4a92145e1409 Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-ServersNegativeTestJSON-277439967 Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-ServersNegativeTestJSON-277439967-project Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: c7d1df92577944f7b62671d2de4c22ee Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-ServersNegativeTestJSON-277439967-project Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 16119cd8-b1a7-4939-9653-66dcf08380e5 could not be found. Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '16119cd8-b1a7-4939-9653-66dcf08380e5'} Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16119cd8-b1a7-4939-9653-66dcf08380e5 could not be found. Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16119cd8-b1a7-4939-9653-66dcf08380e5 could not be found. Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:36:08.546855 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:08.551013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:36:08.551013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:36:08.551013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:36:08.551013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:36:08.551013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:36:08.551013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16119cd8-b1a7-4939-9653-66dcf08380e5 could not be found. Aug 27 05:36:08.551013 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:36:08.551013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c6ad0a1-8f93-4ae2-84be-5bc9e38e5d9f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] Returning 404 to user: Instance 16119cd8-b1a7-4939-9653-66dcf08380e5 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:36:08.551013 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8c6ad0a1-8f93-4ae2-84be-5bc9e38e5d9f tempest-ServersNegativeTestJSON-277439967 tempest-ServersNegativeTestJSON-277439967-project] 10.222.0.79 "GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5" status: 404 len: 111 microversion: 2.1 time: 0.032296 Aug 27 05:36:08.551013 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3678/7402] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:08 2022] GET /compute/v2.1/servers/16119cd8-b1a7-4939-9653-66dcf08380e5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:36:40.373461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:40.374728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=14 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:40.569926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-16589cc8-8505-4a9b-a6da-295db30b8517 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Action: 'create', calling method: .version_select at 0x7f1f20557160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1973224455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXHchJ01QRXweDF0ukNC18yvlUwSRTOBrgAcA4OaQphQRnKD+gKqqWQpCneHh5DlFJU4oPbhs38/6/HJoLRGX/mIbEOyf0yiOpPYln4pCi7EsSvKmx+cTNl4xQXrq65Hw=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:40.586236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-16589cc8-8505-4a9b-a6da-295db30b8517 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Getting quotas for project 7693230823224454800700ef38887cf8. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:36:40.593368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-16589cc8-8505-4a9b-a6da-295db30b8517 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Getting quotas for user ff08b016916d424bb02fc85902c86e31 and project 7693230823224454800700ef38887cf8. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:36:40.621582 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-16589cc8-8505-4a9b-a6da-295db30b8517 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.254151 Aug 27 05:36:40.622229 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3725/7403] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:36:40 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:36:40.677181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1330503163", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1973224455", "networks": [{"uuid": "2f9ee00e-36e4-487c-9a94-85063157b8ec"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:40.686784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:40.687439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=30 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:40.737372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] validate_networks() for [('2f9ee00e-36e4-487c-9a94-85063157b8ec', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:36:41.125351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:36:41.125773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:36:41.126246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:36:41.126656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:36:41.127068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:36:41.136994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:41.137622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:41.138056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:41.138784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:41.139238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:41.139672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:41.159665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Getting quotas for project 7693230823224454800700ef38887cf8. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:36:41.165027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Getting quotas for user ff08b016916d424bb02fc85902c86e31 and project 7693230823224454800700ef38887cf8. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:36:41.177342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:36:41.179661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:36:41.226785 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ebbb627f-ded0-4ae1-a227-8c17ea51918e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554058 Aug 27 05:36:41.227452 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3679/7404] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:36:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:36:41.238288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bfbf08d3-a838-4211-8481-d6694694418a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:41.238920 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bfbf08d3-a838-4211-8481-d6694694418a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:41.294647 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bfbf08d3-a838-4211-8481-d6694694418a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:41.301852 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bfbf08d3-a838-4211-8481-d6694694418a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 200 len: 1263 microversion: 2.1 time: 0.067493 Aug 27 05:36:41.302427 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3726/7405] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:41 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 1263 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:42.324639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2349656b-9468-40b5-bda9-7792ad52be74 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:42.325953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2349656b-9468-40b5-bda9-7792ad52be74 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:42.332341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2349656b-9468-40b5-bda9-7792ad52be74 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:42.332870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2349656b-9468-40b5-bda9-7792ad52be74 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:42.333312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2349656b-9468-40b5-bda9-7792ad52be74 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:42.334022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2349656b-9468-40b5-bda9-7792ad52be74 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:42.334482 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2349656b-9468-40b5-bda9-7792ad52be74 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:42.334909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2349656b-9468-40b5-bda9-7792ad52be74 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:42.406139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2349656b-9468-40b5-bda9-7792ad52be74 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:42.414473 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2349656b-9468-40b5-bda9-7792ad52be74 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 200 len: 1315 microversion: 2.1 time: 0.095779 Aug 27 05:36:42.415066 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3680/7406] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:42 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 1315 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:43.435867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ceccaa0-64db-4602-968a-9534ea9bb276 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:43.437336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ceccaa0-64db-4602-968a-9534ea9bb276 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:43.453062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ceccaa0-64db-4602-968a-9534ea9bb276 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:43.456678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ceccaa0-64db-4602-968a-9534ea9bb276 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:43.457074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ceccaa0-64db-4602-968a-9534ea9bb276 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:43.457871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ceccaa0-64db-4602-968a-9534ea9bb276 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:43.458366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ceccaa0-64db-4602-968a-9534ea9bb276 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:43.464012 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ceccaa0-64db-4602-968a-9534ea9bb276 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:43.638763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ceccaa0-64db-4602-968a-9534ea9bb276 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:43.647139 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ceccaa0-64db-4602-968a-9534ea9bb276 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 200 len: 1363 microversion: 2.1 time: 0.215018 Aug 27 05:36:43.648157 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3727/7407] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:43 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:43.872480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-08d42dfd-f123-433e-8ccd-ef6ecfa8028c req-52e4f983-2d38-43b5-a20f-d2c588a3e416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e33c9b-ea37-429a-9676-ed2353028014", "tag": "f43b6506-a7f5-45f3-ae51-3e202736f0e0"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:43.886635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-08d42dfd-f123-433e-8ccd-ef6ecfa8028c req-52e4f983-2d38-43b5-a20f-d2c588a3e416 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:43.887125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-08d42dfd-f123-433e-8ccd-ef6ecfa8028c req-52e4f983-2d38-43b5-a20f-d2c588a3e416 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:43.887596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-08d42dfd-f123-433e-8ccd-ef6ecfa8028c req-52e4f983-2d38-43b5-a20f-d2c588a3e416 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:43.910297 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-08d42dfd-f123-433e-8ccd-ef6ecfa8028c req-52e4f983-2d38-43b5-a20f-d2c588a3e416 service nova] Creating event network-changed:f43b6506-a7f5-45f3-ae51-3e202736f0e0 for instance 04e33c9b-ea37-429a-9676-ed2353028014 on n-h1-854823-1 Aug 27 05:36:43.918707 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-08d42dfd-f123-433e-8ccd-ef6ecfa8028c req-52e4f983-2d38-43b5-a20f-d2c588a3e416 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049923 Aug 27 05:36:43.921106 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3681/7408] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:36:44.670342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e85523d3-8add-42a8-a48a-1826c6a13b11 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:44.670971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e85523d3-8add-42a8-a48a-1826c6a13b11 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:44.677931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e85523d3-8add-42a8-a48a-1826c6a13b11 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:44.678429 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e85523d3-8add-42a8-a48a-1826c6a13b11 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:44.678883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e85523d3-8add-42a8-a48a-1826c6a13b11 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:44.679602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e85523d3-8add-42a8-a48a-1826c6a13b11 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:44.680053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e85523d3-8add-42a8-a48a-1826c6a13b11 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:44.680494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e85523d3-8add-42a8-a48a-1826c6a13b11 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:44.811779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e85523d3-8add-42a8-a48a-1826c6a13b11 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:44.819908 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e85523d3-8add-42a8-a48a-1826c6a13b11 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 200 len: 1363 microversion: 2.1 time: 0.153524 Aug 27 05:36:44.820479 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3728/7409] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:44 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:45.843760 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-71f8fe74-f9ec-4a01-a020-f6789e9edee8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:45.844463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-71f8fe74-f9ec-4a01-a020-f6789e9edee8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:45.850882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71f8fe74-f9ec-4a01-a020-f6789e9edee8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:45.851376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71f8fe74-f9ec-4a01-a020-f6789e9edee8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:45.851814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71f8fe74-f9ec-4a01-a020-f6789e9edee8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:45.852545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71f8fe74-f9ec-4a01-a020-f6789e9edee8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:45.853011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71f8fe74-f9ec-4a01-a020-f6789e9edee8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:45.853440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-71f8fe74-f9ec-4a01-a020-f6789e9edee8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:45.997759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-71f8fe74-f9ec-4a01-a020-f6789e9edee8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:46.005680 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-71f8fe74-f9ec-4a01-a020-f6789e9edee8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 200 len: 1363 microversion: 2.1 time: 0.167250 Aug 27 05:36:46.006258 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3682/7410] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:45 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:36:47.028261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8948078-240e-40f8-994d-df9ed50c880e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:47.029218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b8948078-240e-40f8-994d-df9ed50c880e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:47.036096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8948078-240e-40f8-994d-df9ed50c880e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:47.036707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8948078-240e-40f8-994d-df9ed50c880e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:47.037163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8948078-240e-40f8-994d-df9ed50c880e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:47.037869 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8948078-240e-40f8-994d-df9ed50c880e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:47.038345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8948078-240e-40f8-994d-df9ed50c880e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:47.038783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8948078-240e-40f8-994d-df9ed50c880e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:47.168411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b8948078-240e-40f8-994d-df9ed50c880e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:47.176309 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b8948078-240e-40f8-994d-df9ed50c880e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 200 len: 1363 microversion: 2.1 time: 0.152849 Aug 27 05:36:47.176917 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3729/7411] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:47 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:48.197536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2737db55-cc62-49e6-a84e-9580ddc9ae73 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:48.198491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2737db55-cc62-49e6-a84e-9580ddc9ae73 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:48.205867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737db55-cc62-49e6-a84e-9580ddc9ae73 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:48.206410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737db55-cc62-49e6-a84e-9580ddc9ae73 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:48.206932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737db55-cc62-49e6-a84e-9580ddc9ae73 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:48.208018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737db55-cc62-49e6-a84e-9580ddc9ae73 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:48.208751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737db55-cc62-49e6-a84e-9580ddc9ae73 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:48.209187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2737db55-cc62-49e6-a84e-9580ddc9ae73 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:48.346705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2737db55-cc62-49e6-a84e-9580ddc9ae73 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:48.355239 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2737db55-cc62-49e6-a84e-9580ddc9ae73 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 200 len: 1363 microversion: 2.1 time: 0.162061 Aug 27 05:36:48.355819 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3683/7412] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:48 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:49.375735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34b18d8d-60bb-455f-a480-bfd8bae62f8d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:49.376367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34b18d8d-60bb-455f-a480-bfd8bae62f8d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:49.383406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34b18d8d-60bb-455f-a480-bfd8bae62f8d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:49.384009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34b18d8d-60bb-455f-a480-bfd8bae62f8d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:49.384459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34b18d8d-60bb-455f-a480-bfd8bae62f8d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:49.385208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34b18d8d-60bb-455f-a480-bfd8bae62f8d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:49.385680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34b18d8d-60bb-455f-a480-bfd8bae62f8d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:49.386122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34b18d8d-60bb-455f-a480-bfd8bae62f8d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:49.518980 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34b18d8d-60bb-455f-a480-bfd8bae62f8d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:49.526903 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34b18d8d-60bb-455f-a480-bfd8bae62f8d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 200 len: 1363 microversion: 2.1 time: 0.155160 Aug 27 05:36:49.527486 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3730/7413] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:49 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:50.203243 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-283f4345-0735-4725-b031-7f9cd90c92ee req-01dc0dea-fa3a-4cc3-88c0-41e5e428c138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e33c9b-ea37-429a-9676-ed2353028014", "name": "network-vif-plugged", "status": "completed", "tag": "f43b6506-a7f5-45f3-ae51-3e202736f0e0"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:50.218144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-283f4345-0735-4725-b031-7f9cd90c92ee req-01dc0dea-fa3a-4cc3-88c0-41e5e428c138 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:50.218644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-283f4345-0735-4725-b031-7f9cd90c92ee req-01dc0dea-fa3a-4cc3-88c0-41e5e428c138 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:50.219435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-283f4345-0735-4725-b031-7f9cd90c92ee req-01dc0dea-fa3a-4cc3-88c0-41e5e428c138 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:50.231491 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-283f4345-0735-4725-b031-7f9cd90c92ee req-01dc0dea-fa3a-4cc3-88c0-41e5e428c138 service nova] Creating event network-vif-plugged:f43b6506-a7f5-45f3-ae51-3e202736f0e0 for instance 04e33c9b-ea37-429a-9676-ed2353028014 on n-h1-854823-1 Aug 27 05:36:50.236723 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-283f4345-0735-4725-b031-7f9cd90c92ee req-01dc0dea-fa3a-4cc3-88c0-41e5e428c138 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037338 Aug 27 05:36:50.237550 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3684/7414] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:36:50.548751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7df721a0-fe93-4e9b-83d2-d799aa609c58 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:50.549434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7df721a0-fe93-4e9b-83d2-d799aa609c58 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:50.556345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7df721a0-fe93-4e9b-83d2-d799aa609c58 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:50.556878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7df721a0-fe93-4e9b-83d2-d799aa609c58 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:50.557838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7df721a0-fe93-4e9b-83d2-d799aa609c58 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:50.558860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7df721a0-fe93-4e9b-83d2-d799aa609c58 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:50.559330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7df721a0-fe93-4e9b-83d2-d799aa609c58 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:50.559775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7df721a0-fe93-4e9b-83d2-d799aa609c58 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:50.689301 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7df721a0-fe93-4e9b-83d2-d799aa609c58 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:50.697170 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7df721a0-fe93-4e9b-83d2-d799aa609c58 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 200 len: 1363 microversion: 2.1 time: 0.152436 Aug 27 05:36:50.697759 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3731/7415] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:50 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:51.719673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-47f9b469-8b8f-40c1-a691-b9c8c7701bbb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:51.721076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-47f9b469-8b8f-40c1-a691-b9c8c7701bbb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:51.727138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:51.728428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:51.731727 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47f9b469-8b8f-40c1-a691-b9c8c7701bbb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:51.732380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47f9b469-8b8f-40c1-a691-b9c8c7701bbb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:51.732863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47f9b469-8b8f-40c1-a691-b9c8c7701bbb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:51.733874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47f9b469-8b8f-40c1-a691-b9c8c7701bbb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:51.734492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47f9b469-8b8f-40c1-a691-b9c8c7701bbb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:51.735100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-47f9b469-8b8f-40c1-a691-b9c8c7701bbb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:51.880876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-47f9b469-8b8f-40c1-a691-b9c8c7701bbb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:51.889730 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-47f9b469-8b8f-40c1-a691-b9c8c7701bbb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 200 len: 1556 microversion: 2.1 time: 0.174774 Aug 27 05:36:51.890377 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3685/7416] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:51 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:51.910352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83d8744c-2551-4b37-837f-320ac488b00b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:36:51.910990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-83d8744c-2551-4b37-837f-320ac488b00b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:51.912929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:36:51.919437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83d8744c-2551-4b37-837f-320ac488b00b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:51.919950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83d8744c-2551-4b37-837f-320ac488b00b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:51.920407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83d8744c-2551-4b37-837f-320ac488b00b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:51.921199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83d8744c-2551-4b37-837f-320ac488b00b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:51.921673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83d8744c-2551-4b37-837f-320ac488b00b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:51.922119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83d8744c-2551-4b37-837f-320ac488b00b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:52.056720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83d8744c-2551-4b37-837f-320ac488b00b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:36:52.064423 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83d8744c-2551-4b37-837f-320ac488b00b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 200 len: 1556 microversion: 2.1 time: 0.157934 Aug 27 05:36:52.065045 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3732/7417] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:36:51 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:36:53.685865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-356665a8-53a1-4455-8063-c6b5dc26f6a2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "119c47f2-c400-47e3-8ca7-3724df614b99"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:36:53.688178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-356665a8-53a1-4455-8063-c6b5dc26f6a2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:36:53.694956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-356665a8-53a1-4455-8063-c6b5dc26f6a2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:53.695436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-356665a8-53a1-4455-8063-c6b5dc26f6a2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:53.695869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-356665a8-53a1-4455-8063-c6b5dc26f6a2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:53.696573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-356665a8-53a1-4455-8063-c6b5dc26f6a2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:36:53.697026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-356665a8-53a1-4455-8063-c6b5dc26f6a2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:36:53.697451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-356665a8-53a1-4455-8063-c6b5dc26f6a2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:36:53.938222 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-356665a8-53a1-4455-8063-c6b5dc26f6a2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "POST /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256798 Aug 27 05:36:53.938834 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3686/7418] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:36:53 2022] POST /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:04.633911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-262f314a-f301-4ef3-b53c-f73aac836828 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:04.634606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-262f314a-f301-4ef3-b53c-f73aac836828 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:04.636910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:04.637641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=36 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:04.644048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-262f314a-f301-4ef3-b53c-f73aac836828 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:04.644578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-262f314a-f301-4ef3-b53c-f73aac836828 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:04.645040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-262f314a-f301-4ef3-b53c-f73aac836828 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:04.645755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-262f314a-f301-4ef3-b53c-f73aac836828 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:04.646233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-262f314a-f301-4ef3-b53c-f73aac836828 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:04.646675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-262f314a-f301-4ef3-b53c-f73aac836828 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:04.729883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-262f314a-f301-4ef3-b53c-f73aac836828 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lazy-loading 'services' on Instance uuid 04e33c9b-ea37-429a-9676-ed2353028014 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:37:04.802519 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-262f314a-f301-4ef3-b53c-f73aac836828 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "DELETE /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments/119c47f2-c400-47e3-8ca7-3724df614b99" status: 202 len: 0 microversion: 2.1 time: 0.172784 Aug 27 05:37:04.803165 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3733/7419] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:37:04 2022] DELETE /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments/119c47f2-c400-47e3-8ca7-3724df614b99 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:37:04.810170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:04.811043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:04.815905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-311314c7-045c-4840-8aae-16324313d676 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:04.818313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-311314c7-045c-4840-8aae-16324313d676 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:04.827272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-311314c7-045c-4840-8aae-16324313d676 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:04.827834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-311314c7-045c-4840-8aae-16324313d676 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:04.828281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-311314c7-045c-4840-8aae-16324313d676 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:04.829025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-311314c7-045c-4840-8aae-16324313d676 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:04.829489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-311314c7-045c-4840-8aae-16324313d676 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:04.829923 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-311314c7-045c-4840-8aae-16324313d676 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:04.867613 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-311314c7-045c-4840-8aae-16324313d676 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059897 Aug 27 05:37:04.868255 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3687/7420] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:37:04 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:05.881881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6cee3475-4082-4298-8fcf-40954a8146ce tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:05.885065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6cee3475-4082-4298-8fcf-40954a8146ce tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:05.893809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cee3475-4082-4298-8fcf-40954a8146ce tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:05.894316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cee3475-4082-4298-8fcf-40954a8146ce tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:05.894771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cee3475-4082-4298-8fcf-40954a8146ce tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:05.895490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cee3475-4082-4298-8fcf-40954a8146ce tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:05.895961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cee3475-4082-4298-8fcf-40954a8146ce tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:05.896402 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cee3475-4082-4298-8fcf-40954a8146ce tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:05.928993 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6cee3475-4082-4298-8fcf-40954a8146ce tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052380 Aug 27 05:37:05.929570 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3734/7421] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:37:05 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:06.941411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a611fba0-9079-4303-b1f3-aed38840e4d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:06.943785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a611fba0-9079-4303-b1f3-aed38840e4d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:06.951059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a611fba0-9079-4303-b1f3-aed38840e4d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:06.951551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a611fba0-9079-4303-b1f3-aed38840e4d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:06.951986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a611fba0-9079-4303-b1f3-aed38840e4d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:06.952768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a611fba0-9079-4303-b1f3-aed38840e4d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:06.953226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a611fba0-9079-4303-b1f3-aed38840e4d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:06.953657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a611fba0-9079-4303-b1f3-aed38840e4d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:06.986715 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a611fba0-9079-4303-b1f3-aed38840e4d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049345 Aug 27 05:37:06.987299 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3688/7422] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:37:06 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:07.999211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a96e9e0c-7704-42a0-95f6-d81821ee8dc8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:08.001457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a96e9e0c-7704-42a0-95f6-d81821ee8dc8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:08.008548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a96e9e0c-7704-42a0-95f6-d81821ee8dc8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:08.009053 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a96e9e0c-7704-42a0-95f6-d81821ee8dc8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:08.009502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a96e9e0c-7704-42a0-95f6-d81821ee8dc8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:08.010220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a96e9e0c-7704-42a0-95f6-d81821ee8dc8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:08.011178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a96e9e0c-7704-42a0-95f6-d81821ee8dc8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:08.011612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a96e9e0c-7704-42a0-95f6-d81821ee8dc8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:08.045443 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a96e9e0c-7704-42a0-95f6-d81821ee8dc8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050358 Aug 27 05:37:08.046045 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3735/7423] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:37:07 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:09.058365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d7fd9004-02aa-416a-b83d-96b5fa36e811 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:09.060652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d7fd9004-02aa-416a-b83d-96b5fa36e811 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:09.068008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7fd9004-02aa-416a-b83d-96b5fa36e811 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:09.068495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7fd9004-02aa-416a-b83d-96b5fa36e811 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:09.068964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7fd9004-02aa-416a-b83d-96b5fa36e811 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:09.069668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7fd9004-02aa-416a-b83d-96b5fa36e811 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:09.070126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7fd9004-02aa-416a-b83d-96b5fa36e811 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:09.070550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d7fd9004-02aa-416a-b83d-96b5fa36e811 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:09.105499 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d7fd9004-02aa-416a-b83d-96b5fa36e811 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051154 Aug 27 05:37:09.106102 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3689/7424] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:37:09 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:10.117645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f26b5c4b-93db-4d28-bf87-8419a446a564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:10.120413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f26b5c4b-93db-4d28-bf87-8419a446a564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:10.127298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26b5c4b-93db-4d28-bf87-8419a446a564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:10.127797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26b5c4b-93db-4d28-bf87-8419a446a564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:10.128277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26b5c4b-93db-4d28-bf87-8419a446a564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:10.129011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26b5c4b-93db-4d28-bf87-8419a446a564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:10.129478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26b5c4b-93db-4d28-bf87-8419a446a564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:10.129917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f26b5c4b-93db-4d28-bf87-8419a446a564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:10.160779 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f26b5c4b-93db-4d28-bf87-8419a446a564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047087 Aug 27 05:37:10.161356 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3736/7425] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:37:10 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:37:10.172435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4c490eb-ac6e-4786-95bf-0e9e4d03f79e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:10.173011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f4c490eb-ac6e-4786-95bf-0e9e4d03f79e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:10.179709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4c490eb-ac6e-4786-95bf-0e9e4d03f79e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:10.180195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4c490eb-ac6e-4786-95bf-0e9e4d03f79e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:10.180660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4c490eb-ac6e-4786-95bf-0e9e4d03f79e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:10.181355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4c490eb-ac6e-4786-95bf-0e9e4d03f79e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:10.181829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4c490eb-ac6e-4786-95bf-0e9e4d03f79e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:10.182876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4c490eb-ac6e-4786-95bf-0e9e4d03f79e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:10.258670 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-f4c490eb-ac6e-4786-95bf-0e9e4d03f79e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] HTTP exception thrown: Instance 04e33c9b-ea37-429a-9676-ed2353028014 is not attached to volume 119c47f2-c400-47e3-8ca7-3724df614b99 Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4c490eb-ac6e-4786-95bf-0e9e4d03f79e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Request method failure captured: Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: request: DELETE /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments/119c47f2-c400-47e3-8ca7-3724df614b99 HTTP/1.1 Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCa1i09QyXrx4LCtGw_XRC1ySsnYn0fWsyjDQuk7zKqPoXAMy6NU-sB9PW8ug48cHSo-X_FHN9rzP4-bCeJCjMTI9OG5NSf1OjNWiibp72R0lLWwW3hQaGEM50xrq0pI0_wzCqGjU52_wIX-No3zlC5lF3Sh7o9O4v6x0thbGCb1NiaU Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 7693230823224454800700ef38887cf8 Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7693230823224454800700ef38887cf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7693230823224454800700ef38887cf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7693230823224454800700ef38887cf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7693230823224454800700ef38887cf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 7693230823224454800700ef38887cf8 Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestEncryptedCinderVolumes-501333086-project Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: ff08b016916d424bb02fc85902c86e31 Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestEncryptedCinderVolumes-501333086-project Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 04e33c9b-ea37-429a-9676-ed2353028014 is not attached to volume 119c47f2-c400-47e3-8ca7-3724df614b99 Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'server_id': '04e33c9b-ea37-429a-9676-ed2353028014', 'id': '119c47f2-c400-47e3-8ca7-3724df614b99'} Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 119c47f2-c400-47e3-8ca7-3724df614b99. Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e33c9b-ea37-429a-9676-ed2353028014 is not attached to volume 119c47f2-c400-47e3-8ca7-3724df614b99 Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:37:10.274070 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:37:10.279883 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:37:10.279883 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:37:10.279883 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e33c9b-ea37-429a-9676-ed2353028014 is not attached to volume 119c47f2-c400-47e3-8ca7-3724df614b99 Aug 27 05:37:10.279883 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:37:10.279883 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4c490eb-ac6e-4786-95bf-0e9e4d03f79e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Returning 404 to user: Instance 04e33c9b-ea37-429a-9676-ed2353028014 is not attached to volume 119c47f2-c400-47e3-8ca7-3724df614b99 {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:37:10.279883 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f4c490eb-ac6e-4786-95bf-0e9e4d03f79e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "DELETE /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments/119c47f2-c400-47e3-8ca7-3724df614b99" status: 404 len: 154 microversion: 2.1 time: 0.107154 Aug 27 05:37:10.279883 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3690/7426] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:37:10 2022] DELETE /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014/os-volume_attachments/119c47f2-c400-47e3-8ca7-3724df614b99 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:37:13.620913 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54a09090-6af9-42d0-ac9f-971f3894764d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:13.621505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-54a09090-6af9-42d0-ac9f-971f3894764d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:13.628685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54a09090-6af9-42d0-ac9f-971f3894764d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:13.629204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54a09090-6af9-42d0-ac9f-971f3894764d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:13.629665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54a09090-6af9-42d0-ac9f-971f3894764d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:13.630406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54a09090-6af9-42d0-ac9f-971f3894764d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:13.630886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54a09090-6af9-42d0-ac9f-971f3894764d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:13.631329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54a09090-6af9-42d0-ac9f-971f3894764d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:13.659180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-54a09090-6af9-42d0-ac9f-971f3894764d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:37:13.746384 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-54a09090-6af9-42d0-ac9f-971f3894764d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "DELETE /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 204 len: 0 microversion: 2.1 time: 0.129472 Aug 27 05:37:13.747003 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3737/7427] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:37:13 2022] DELETE /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:37:13.755136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a49668d8-1e53-4a77-999f-457d7b965bfd tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:13.755860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a49668d8-1e53-4a77-999f-457d7b965bfd tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:13.765872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a49668d8-1e53-4a77-999f-457d7b965bfd tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:13.766391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a49668d8-1e53-4a77-999f-457d7b965bfd tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:13.766862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a49668d8-1e53-4a77-999f-457d7b965bfd tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:13.767562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a49668d8-1e53-4a77-999f-457d7b965bfd tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:13.768017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a49668d8-1e53-4a77-999f-457d7b965bfd tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:13.768446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a49668d8-1e53-4a77-999f-457d7b965bfd tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:13.902666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a49668d8-1e53-4a77-999f-457d7b965bfd tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:13.910877 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a49668d8-1e53-4a77-999f-457d7b965bfd tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 200 len: 1562 microversion: 2.1 time: 0.159584 Aug 27 05:37:13.911456 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3691/7428] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:13 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:14.934034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc153014-115c-402a-92f0-a2d73ecd65be tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:14.934746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc153014-115c-402a-92f0-a2d73ecd65be tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:14.941701 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc153014-115c-402a-92f0-a2d73ecd65be tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:14.942194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc153014-115c-402a-92f0-a2d73ecd65be tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:14.942645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc153014-115c-402a-92f0-a2d73ecd65be tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:14.943377 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc153014-115c-402a-92f0-a2d73ecd65be tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:14.943842 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc153014-115c-402a-92f0-a2d73ecd65be tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:14.944279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc153014-115c-402a-92f0-a2d73ecd65be tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:15.409608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dc153014-115c-402a-92f0-a2d73ecd65be tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:15.417417 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc153014-115c-402a-92f0-a2d73ecd65be tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 200 len: 1562 microversion: 2.1 time: 0.488289 Aug 27 05:37:15.418005 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3738/7429] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:14 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 1562 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:16.101724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-2b52e920-a24a-4506-978f-740f49af09df req-d4f25561-cc8b-4702-ad8c-e93c7befbe45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e33c9b-ea37-429a-9676-ed2353028014", "name": "network-vif-deleted", "tag": "f43b6506-a7f5-45f3-ae51-3e202736f0e0"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:16.112761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2b52e920-a24a-4506-978f-740f49af09df req-d4f25561-cc8b-4702-ad8c-e93c7befbe45 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:16.113251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2b52e920-a24a-4506-978f-740f49af09df req-d4f25561-cc8b-4702-ad8c-e93c7befbe45 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:16.113673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2b52e920-a24a-4506-978f-740f49af09df req-d4f25561-cc8b-4702-ad8c-e93c7befbe45 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:16.126330 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-2b52e920-a24a-4506-978f-740f49af09df req-d4f25561-cc8b-4702-ad8c-e93c7befbe45 service nova] Creating event network-vif-deleted:f43b6506-a7f5-45f3-ae51-3e202736f0e0 for instance 04e33c9b-ea37-429a-9676-ed2353028014 on n-h1-854823-1 Aug 27 05:37:16.131895 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-2b52e920-a24a-4506-978f-740f49af09df req-d4f25561-cc8b-4702-ad8c-e93c7befbe45 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033795 Aug 27 05:37:16.132517 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3692/7430] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:16.438127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c618199b-feb0-4153-99bc-afe1a86d1cc3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:16.438668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c618199b-feb0-4153-99bc-afe1a86d1cc3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:16.445515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618199b-feb0-4153-99bc-afe1a86d1cc3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:16.446027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618199b-feb0-4153-99bc-afe1a86d1cc3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:16.446477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618199b-feb0-4153-99bc-afe1a86d1cc3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:16.447185 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618199b-feb0-4153-99bc-afe1a86d1cc3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:16.447653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618199b-feb0-4153-99bc-afe1a86d1cc3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:16.448096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618199b-feb0-4153-99bc-afe1a86d1cc3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:16.480934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618199b-feb0-4153-99bc-afe1a86d1cc3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:16.481430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618199b-feb0-4153-99bc-afe1a86d1cc3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:16.481890 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618199b-feb0-4153-99bc-afe1a86d1cc3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:16.482368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-c618199b-feb0-4153-99bc-afe1a86d1cc3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lazy-loading 'fault' on Instance uuid 04e33c9b-ea37-429a-9676-ed2353028014 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:37:16.529298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c618199b-feb0-4153-99bc-afe1a86d1cc3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:16.538002 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c618199b-feb0-4153-99bc-afe1a86d1cc3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 200 len: 1353 microversion: 2.1 time: 0.103800 Aug 27 05:37:16.538606 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3739/7431] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:16 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 1353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:17.561613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b63fe327-67ad-4d5b-a635-081ee22c21f2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:17.562316 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b63fe327-67ad-4d5b-a635-081ee22c21f2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 04e33c9b-ea37-429a-9676-ed2353028014] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:17.568428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b63fe327-67ad-4d5b-a635-081ee22c21f2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:17.568947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b63fe327-67ad-4d5b-a635-081ee22c21f2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:17.569386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b63fe327-67ad-4d5b-a635-081ee22c21f2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:17.570076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b63fe327-67ad-4d5b-a635-081ee22c21f2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:17.570533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b63fe327-67ad-4d5b-a635-081ee22c21f2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:17.571048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b63fe327-67ad-4d5b-a635-081ee22c21f2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:17.584861 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-b63fe327-67ad-4d5b-a635-081ee22c21f2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] HTTP exception thrown: Instance 04e33c9b-ea37-429a-9676-ed2353028014 could not be found. Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b63fe327-67ad-4d5b-a635-081ee22c21f2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Request method failure captured: Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 HTTP/1.1 Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCa1i09QyXrx4LCtGw_XRC1ySsnYn0fWsyjDQuk7zKqPoXAMy6NU-sB9PW8ug48cHSo-X_FHN9rzP4-bCeJCjMTI9OG5NSf1OjNWiibp72R0lLWwW3hQaGEM50xrq0pI0_wzCqGjU52_wIX-No3zlC5lF3Sh7o9O4v6x0thbGCb1NiaU Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 7693230823224454800700ef38887cf8 Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7693230823224454800700ef38887cf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7693230823224454800700ef38887cf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7693230823224454800700ef38887cf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7693230823224454800700ef38887cf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 7693230823224454800700ef38887cf8 Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestEncryptedCinderVolumes-501333086-project Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: ff08b016916d424bb02fc85902c86e31 Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestEncryptedCinderVolumes-501333086-project Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 04e33c9b-ea37-429a-9676-ed2353028014 could not be found. Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '04e33c9b-ea37-429a-9676-ed2353028014'} Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e33c9b-ea37-429a-9676-ed2353028014 could not be found. Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e33c9b-ea37-429a-9676-ed2353028014 could not be found. Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:37:17.586477 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:37:17.591073 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:17.591073 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:37:17.591073 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:37:17.591073 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:37:17.591073 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:37:17.591073 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e33c9b-ea37-429a-9676-ed2353028014 could not be found. Aug 27 05:37:17.591073 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:37:17.591073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b63fe327-67ad-4d5b-a635-081ee22c21f2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Returning 404 to user: Instance 04e33c9b-ea37-429a-9676-ed2353028014 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:37:17.591073 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b63fe327-67ad-4d5b-a635-081ee22c21f2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014" status: 404 len: 111 microversion: 2.1 time: 0.031939 Aug 27 05:37:17.591073 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3693/7432] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:17 2022] GET /compute/v2.1/servers/04e33c9b-ea37-429a-9676-ed2353028014 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:37:17.596557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59fbf3c4-7a8a-4243-8d37-9ae9905de652 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '.version_select at 0x7f1f20bed160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:17.616601 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59fbf3c4-7a8a-4243-8d37-9ae9905de652 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1973224455" status: 202 len: 0 microversion: 2.1 time: 0.023774 Aug 27 05:37:17.617203 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3740/7433] 10.222.0.79 () {58 vars in 1278 bytes} [Sat Aug 27 05:37:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1973224455 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:37:17.634587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-378e574e-19a6-416e-be9f-8f732529fa6d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Action: 'create', calling method: .version_select at 0x7f1f227b0700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1946269450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP070u/3P22KKxi/GsMuHSnNS+RG2R99hii/Yh+1T+xD9pfZhfCFohvvkzCiSUtTj+Thr9Tdx9TnBu92PhA8uA5uZeRH8/WHZeeZipDsPGOzi7absI+o2R1j0+8Zh3W0Qg=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:17.650611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-378e574e-19a6-416e-be9f-8f732529fa6d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Getting quotas for project 7693230823224454800700ef38887cf8. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:37:17.655971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-378e574e-19a6-416e-be9f-8f732529fa6d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Getting quotas for user ff08b016916d424bb02fc85902c86e31 and project 7693230823224454800700ef38887cf8. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:37:17.670294 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [None req-378e574e-19a6-416e-be9f-8f732529fa6d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [6833264e-9841-40aa-958e-728842aecfe8] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 05:37:18.677563 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [None req-378e574e-19a6-416e-be9f-8f732529fa6d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [6833264e-9841-40aa-958e-728842aecfe8] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 43050. Aug 27 05:37:18.692505 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-378e574e-19a6-416e-be9f-8f732529fa6d tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.061828 Aug 27 05:37:18.693136 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3694/7434] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:37:17 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:18.744493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-186197582", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1946269450", "networks": [{"uuid": "2f9ee00e-36e4-487c-9a94-85063157b8ec"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:18.800139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] validate_networks() for [('2f9ee00e-36e4-487c-9a94-85063157b8ec', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:37:19.185788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:37:19.186254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:37:19.186747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:37:19.187170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:37:19.187600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:37:19.197214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:19.197918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:19.198393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:19.199148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:19.199626 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:19.200067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:19.217877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Getting quotas for project 7693230823224454800700ef38887cf8. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:37:19.223198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Getting quotas for user ff08b016916d424bb02fc85902c86e31 and project 7693230823224454800700ef38887cf8. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:37:19.235976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:37:19.238331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:37:19.285624 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e137640-dad3-4675-95b9-09717dd69187 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545859 Aug 27 05:37:19.286309 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3741/7435] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:37:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:37:19.297886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fea3f3d2-ae84-41cc-9a96-ce793b115ddb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:19.298535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fea3f3d2-ae84-41cc-9a96-ce793b115ddb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:19.355566 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fea3f3d2-ae84-41cc-9a96-ce793b115ddb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:19.362774 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fea3f3d2-ae84-41cc-9a96-ce793b115ddb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1262 microversion: 2.1 time: 0.069048 Aug 27 05:37:19.363349 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3695/7436] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:19 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:37:20.385779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cbca716a-32be-4af2-a156-729214d38332 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:20.386969 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cbca716a-32be-4af2-a156-729214d38332 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:20.393776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbca716a-32be-4af2-a156-729214d38332 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:20.394273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbca716a-32be-4af2-a156-729214d38332 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:20.394718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbca716a-32be-4af2-a156-729214d38332 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:20.395441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbca716a-32be-4af2-a156-729214d38332 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:20.395908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbca716a-32be-4af2-a156-729214d38332 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:20.396344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbca716a-32be-4af2-a156-729214d38332 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:20.464309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cbca716a-32be-4af2-a156-729214d38332 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:20.472243 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cbca716a-32be-4af2-a156-729214d38332 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1320 microversion: 2.1 time: 0.091666 Aug 27 05:37:20.472877 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3742/7437] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:20 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1320 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:37:21.493493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-674724e9-e582-4cea-953c-fa56b1088823 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:21.494112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-674724e9-e582-4cea-953c-fa56b1088823 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:21.501960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-674724e9-e582-4cea-953c-fa56b1088823 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:21.502447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-674724e9-e582-4cea-953c-fa56b1088823 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:21.502890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-674724e9-e582-4cea-953c-fa56b1088823 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:21.503584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-674724e9-e582-4cea-953c-fa56b1088823 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:21.504042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-674724e9-e582-4cea-953c-fa56b1088823 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:21.504469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-674724e9-e582-4cea-953c-fa56b1088823 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:21.538926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dd65abad-f7ed-466d-a5ce-6aed215e8a08 req-a9bab802-8c7d-46d1-9fca-106818e49180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75", "tag": "14cda21c-6203-497b-80c9-3b19aa2dcd87"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:21.553620 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dd65abad-f7ed-466d-a5ce-6aed215e8a08 req-a9bab802-8c7d-46d1-9fca-106818e49180 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:21.554433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dd65abad-f7ed-466d-a5ce-6aed215e8a08 req-a9bab802-8c7d-46d1-9fca-106818e49180 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:21.554998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dd65abad-f7ed-466d-a5ce-6aed215e8a08 req-a9bab802-8c7d-46d1-9fca-106818e49180 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:21.568697 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dd65abad-f7ed-466d-a5ce-6aed215e8a08 req-a9bab802-8c7d-46d1-9fca-106818e49180 service nova] Creating event network-changed:14cda21c-6203-497b-80c9-3b19aa2dcd87 for instance cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 on n-h1-854823-1 Aug 27 05:37:21.574683 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dd65abad-f7ed-466d-a5ce-6aed215e8a08 req-a9bab802-8c7d-46d1-9fca-106818e49180 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040224 Aug 27 05:37:21.575360 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3743/7438] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:21.763582 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-674724e9-e582-4cea-953c-fa56b1088823 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:21.771374 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-674724e9-e582-4cea-953c-fa56b1088823 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1362 microversion: 2.1 time: 0.281829 Aug 27 05:37:21.771965 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3696/7439] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:21 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:22.793930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5ad2328-bd80-4740-b188-b1f3114ccc50 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:22.794679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5ad2328-bd80-4740-b188-b1f3114ccc50 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:22.802326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5ad2328-bd80-4740-b188-b1f3114ccc50 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:22.802866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5ad2328-bd80-4740-b188-b1f3114ccc50 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:22.803322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5ad2328-bd80-4740-b188-b1f3114ccc50 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:22.804048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5ad2328-bd80-4740-b188-b1f3114ccc50 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:22.804522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5ad2328-bd80-4740-b188-b1f3114ccc50 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:22.805004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5ad2328-bd80-4740-b188-b1f3114ccc50 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:22.937901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c5ad2328-bd80-4740-b188-b1f3114ccc50 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:22.945639 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5ad2328-bd80-4740-b188-b1f3114ccc50 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1362 microversion: 2.1 time: 0.156843 Aug 27 05:37:22.946249 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3744/7440] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:22 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:23.966993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ab184d25-6dbc-4ae2-b291-96fb8bfc5604 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:23.967674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ab184d25-6dbc-4ae2-b291-96fb8bfc5604 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:23.974451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab184d25-6dbc-4ae2-b291-96fb8bfc5604 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:23.974938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab184d25-6dbc-4ae2-b291-96fb8bfc5604 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:23.975374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab184d25-6dbc-4ae2-b291-96fb8bfc5604 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:23.976063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab184d25-6dbc-4ae2-b291-96fb8bfc5604 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:23.976518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab184d25-6dbc-4ae2-b291-96fb8bfc5604 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:23.976977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab184d25-6dbc-4ae2-b291-96fb8bfc5604 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:24.108928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ab184d25-6dbc-4ae2-b291-96fb8bfc5604 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:24.116460 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ab184d25-6dbc-4ae2-b291-96fb8bfc5604 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1362 microversion: 2.1 time: 0.153487 Aug 27 05:37:24.117068 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3697/7441] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:23 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:37:25.137824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-00387981-a9a1-49d9-bff1-b8fd1a375a7c tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:25.138455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-00387981-a9a1-49d9-bff1-b8fd1a375a7c tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:25.145441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00387981-a9a1-49d9-bff1-b8fd1a375a7c tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:25.145944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00387981-a9a1-49d9-bff1-b8fd1a375a7c tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:25.146394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00387981-a9a1-49d9-bff1-b8fd1a375a7c tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:25.147105 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00387981-a9a1-49d9-bff1-b8fd1a375a7c tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:25.147576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00387981-a9a1-49d9-bff1-b8fd1a375a7c tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:25.148018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00387981-a9a1-49d9-bff1-b8fd1a375a7c tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:25.279994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-00387981-a9a1-49d9-bff1-b8fd1a375a7c tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:25.287872 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-00387981-a9a1-49d9-bff1-b8fd1a375a7c tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1362 microversion: 2.1 time: 0.154662 Aug 27 05:37:25.288467 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3745/7442] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:25 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:26.309381 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-75e936cc-2318-41ab-92ce-fc84eb5c2182 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:26.310108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-75e936cc-2318-41ab-92ce-fc84eb5c2182 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:26.317245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75e936cc-2318-41ab-92ce-fc84eb5c2182 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:26.317748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75e936cc-2318-41ab-92ce-fc84eb5c2182 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:26.318192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75e936cc-2318-41ab-92ce-fc84eb5c2182 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:26.318895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75e936cc-2318-41ab-92ce-fc84eb5c2182 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:26.319356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75e936cc-2318-41ab-92ce-fc84eb5c2182 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:26.319890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75e936cc-2318-41ab-92ce-fc84eb5c2182 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:26.451583 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-75e936cc-2318-41ab-92ce-fc84eb5c2182 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:26.459203 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-75e936cc-2318-41ab-92ce-fc84eb5c2182 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1362 microversion: 2.1 time: 0.154311 Aug 27 05:37:26.459980 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3698/7443] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:26 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:27.480731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b526b5f-d606-4da5-b212-07653fe1211a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:27.481355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b526b5f-d606-4da5-b212-07653fe1211a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:27.488247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b526b5f-d606-4da5-b212-07653fe1211a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:27.488785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b526b5f-d606-4da5-b212-07653fe1211a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:27.489236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b526b5f-d606-4da5-b212-07653fe1211a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:27.489950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b526b5f-d606-4da5-b212-07653fe1211a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:27.490419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b526b5f-d606-4da5-b212-07653fe1211a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:27.490853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b526b5f-d606-4da5-b212-07653fe1211a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:27.623993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8b526b5f-d606-4da5-b212-07653fe1211a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:27.631789 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b526b5f-d606-4da5-b212-07653fe1211a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1362 microversion: 2.1 time: 0.155675 Aug 27 05:37:27.632371 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3746/7444] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:27 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:28.305318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1915cece-efcd-4d65-ac98-a01397a2a22d req-b8497043-fb86-4a19-8759-6c53d8d7325f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75", "name": "network-vif-plugged", "status": "completed", "tag": "14cda21c-6203-497b-80c9-3b19aa2dcd87"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:28.316498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1915cece-efcd-4d65-ac98-a01397a2a22d req-b8497043-fb86-4a19-8759-6c53d8d7325f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:28.317011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1915cece-efcd-4d65-ac98-a01397a2a22d req-b8497043-fb86-4a19-8759-6c53d8d7325f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:28.317492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1915cece-efcd-4d65-ac98-a01397a2a22d req-b8497043-fb86-4a19-8759-6c53d8d7325f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:28.330148 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1915cece-efcd-4d65-ac98-a01397a2a22d req-b8497043-fb86-4a19-8759-6c53d8d7325f service nova] Creating event network-vif-plugged:14cda21c-6203-497b-80c9-3b19aa2dcd87 for instance cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 on n-h1-854823-1 Aug 27 05:37:28.335121 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1915cece-efcd-4d65-ac98-a01397a2a22d req-b8497043-fb86-4a19-8759-6c53d8d7325f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033668 Aug 27 05:37:28.335727 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3699/7445] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:28.652796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-524b38ca-9cd3-463e-847c-47b0588ca117 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:28.653373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-524b38ca-9cd3-463e-847c-47b0588ca117 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:28.660545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-524b38ca-9cd3-463e-847c-47b0588ca117 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:28.661066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-524b38ca-9cd3-463e-847c-47b0588ca117 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:28.661522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-524b38ca-9cd3-463e-847c-47b0588ca117 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:28.662236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-524b38ca-9cd3-463e-847c-47b0588ca117 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:28.662709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-524b38ca-9cd3-463e-847c-47b0588ca117 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:28.663152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-524b38ca-9cd3-463e-847c-47b0588ca117 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:28.791643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-524b38ca-9cd3-463e-847c-47b0588ca117 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:28.800069 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-524b38ca-9cd3-463e-847c-47b0588ca117 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1362 microversion: 2.1 time: 0.151900 Aug 27 05:37:28.800681 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3747/7446] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:28 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:29.819303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:29.823823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-05807c59-50a1-4852-8165-b71c2d6bb56e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:29.824553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-05807c59-50a1-4852-8165-b71c2d6bb56e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:29.831068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05807c59-50a1-4852-8165-b71c2d6bb56e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:29.831560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05807c59-50a1-4852-8165-b71c2d6bb56e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:29.832064 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05807c59-50a1-4852-8165-b71c2d6bb56e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:29.832793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05807c59-50a1-4852-8165-b71c2d6bb56e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:29.833258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05807c59-50a1-4852-8165-b71c2d6bb56e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:29.833689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-05807c59-50a1-4852-8165-b71c2d6bb56e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:29.971929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-05807c59-50a1-4852-8165-b71c2d6bb56e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:29.980958 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-05807c59-50a1-4852-8165-b71c2d6bb56e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1362 microversion: 2.1 time: 0.163460 Aug 27 05:37:29.981546 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3700/7447] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:29 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:31.002083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cbe9ad5f-dd3b-4365-85d4-639b3e2f8afc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:31.002750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cbe9ad5f-dd3b-4365-85d4-639b3e2f8afc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:31.004765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:31.005698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:31.013076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbe9ad5f-dd3b-4365-85d4-639b3e2f8afc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:31.013586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbe9ad5f-dd3b-4365-85d4-639b3e2f8afc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:31.014043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbe9ad5f-dd3b-4365-85d4-639b3e2f8afc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:31.014763 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbe9ad5f-dd3b-4365-85d4-639b3e2f8afc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:31.015241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbe9ad5f-dd3b-4365-85d4-639b3e2f8afc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:31.015687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbe9ad5f-dd3b-4365-85d4-639b3e2f8afc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:31.148392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cbe9ad5f-dd3b-4365-85d4-639b3e2f8afc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:31.156660 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cbe9ad5f-dd3b-4365-85d4-639b3e2f8afc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1554 microversion: 2.1 time: 0.158503 Aug 27 05:37:31.157248 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3748/7448] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:30 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:31.176758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1ce72fc6-af11-4ea3-b94c-b774c887d538 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:31.177384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1ce72fc6-af11-4ea3-b94c-b774c887d538 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:31.184778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ce72fc6-af11-4ea3-b94c-b774c887d538 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:31.185291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ce72fc6-af11-4ea3-b94c-b774c887d538 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:31.185736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ce72fc6-af11-4ea3-b94c-b774c887d538 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:31.186433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ce72fc6-af11-4ea3-b94c-b774c887d538 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:31.186896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ce72fc6-af11-4ea3-b94c-b774c887d538 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:31.187327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1ce72fc6-af11-4ea3-b94c-b774c887d538 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:31.320237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1ce72fc6-af11-4ea3-b94c-b774c887d538 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:31.328103 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1ce72fc6-af11-4ea3-b94c-b774c887d538 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1554 microversion: 2.1 time: 0.155213 Aug 27 05:37:31.328709 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3701/7449] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:31 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:32.820873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-791a8548-1d84-40cf-b5e0-990c371191c8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71b07221-1d2f-4b5d-994c-cf19e95f6eba"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:32.823825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-791a8548-1d84-40cf-b5e0-990c371191c8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:32.830054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791a8548-1d84-40cf-b5e0-990c371191c8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:32.830560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791a8548-1d84-40cf-b5e0-990c371191c8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:32.831016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791a8548-1d84-40cf-b5e0-990c371191c8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:32.831729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791a8548-1d84-40cf-b5e0-990c371191c8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:32.832205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791a8548-1d84-40cf-b5e0-990c371191c8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:32.832674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-791a8548-1d84-40cf-b5e0-990c371191c8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:32.836401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:33.075297 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-791a8548-1d84-40cf-b5e0-990c371191c8 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "POST /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258456 Aug 27 05:37:33.075925 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3749/7450] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:37:32 2022] POST /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:43.783079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-50b3983d-89c3-4512-94ff-c1658983690b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:43.783575 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-50b3983d-89c3-4512-94ff-c1658983690b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:43.786493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:43.787154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=66 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:43.795042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50b3983d-89c3-4512-94ff-c1658983690b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:43.795534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50b3983d-89c3-4512-94ff-c1658983690b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:43.795974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50b3983d-89c3-4512-94ff-c1658983690b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:43.796714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50b3983d-89c3-4512-94ff-c1658983690b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:43.797182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50b3983d-89c3-4512-94ff-c1658983690b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:43.797614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-50b3983d-89c3-4512-94ff-c1658983690b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:43.878390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-50b3983d-89c3-4512-94ff-c1658983690b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lazy-loading 'services' on Instance uuid cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:37:43.949867 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-50b3983d-89c3-4512-94ff-c1658983690b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments/71b07221-1d2f-4b5d-994c-cf19e95f6eba" status: 202 len: 0 microversion: 2.1 time: 0.170815 Aug 27 05:37:43.950486 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3702/7451] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:37:43 2022] DELETE /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments/71b07221-1d2f-4b5d-994c-cf19e95f6eba => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:37:43.964706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5dfaebdf-59d6-4507-93e9-fdf4de4f30b5 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:43.968953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5dfaebdf-59d6-4507-93e9-fdf4de4f30b5 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:43.975210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:43.976385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=9,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:37:43.986695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dfaebdf-59d6-4507-93e9-fdf4de4f30b5 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:43.987266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dfaebdf-59d6-4507-93e9-fdf4de4f30b5 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:43.987760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dfaebdf-59d6-4507-93e9-fdf4de4f30b5 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:43.988705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dfaebdf-59d6-4507-93e9-fdf4de4f30b5 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:43.989213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dfaebdf-59d6-4507-93e9-fdf4de4f30b5 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:43.990127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dfaebdf-59d6-4507-93e9-fdf4de4f30b5 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:44.024683 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5dfaebdf-59d6-4507-93e9-fdf4de4f30b5 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068670 Aug 27 05:37:44.025286 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3750/7452] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:37:43 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:37:45.039955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-44e7c346-61cd-49b7-8f66-813bfb57d43b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:45.042653 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-44e7c346-61cd-49b7-8f66-813bfb57d43b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:45.049267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44e7c346-61cd-49b7-8f66-813bfb57d43b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:45.049937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44e7c346-61cd-49b7-8f66-813bfb57d43b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:45.050478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44e7c346-61cd-49b7-8f66-813bfb57d43b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:45.051250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44e7c346-61cd-49b7-8f66-813bfb57d43b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:45.051790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44e7c346-61cd-49b7-8f66-813bfb57d43b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:45.052274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44e7c346-61cd-49b7-8f66-813bfb57d43b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:45.086886 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-44e7c346-61cd-49b7-8f66-813bfb57d43b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052850 Aug 27 05:37:45.087759 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3703/7453] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:37:45 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:46.099677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14b9f900-7220-4947-bec6-484c7a08baa1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:46.102201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14b9f900-7220-4947-bec6-484c7a08baa1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:46.110116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b9f900-7220-4947-bec6-484c7a08baa1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:46.110628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b9f900-7220-4947-bec6-484c7a08baa1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:46.111086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b9f900-7220-4947-bec6-484c7a08baa1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:46.111812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b9f900-7220-4947-bec6-484c7a08baa1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:46.112287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b9f900-7220-4947-bec6-484c7a08baa1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:46.112761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b9f900-7220-4947-bec6-484c7a08baa1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:46.146238 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14b9f900-7220-4947-bec6-484c7a08baa1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050543 Aug 27 05:37:46.146821 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3751/7454] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:37:46 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:47.158830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-32f455bc-e04e-44d0-b0b3-c5825a4b8b4e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:47.160977 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-32f455bc-e04e-44d0-b0b3-c5825a4b8b4e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:47.167996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32f455bc-e04e-44d0-b0b3-c5825a4b8b4e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:47.168481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32f455bc-e04e-44d0-b0b3-c5825a4b8b4e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:47.168935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32f455bc-e04e-44d0-b0b3-c5825a4b8b4e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:47.169634 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32f455bc-e04e-44d0-b0b3-c5825a4b8b4e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:47.170081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32f455bc-e04e-44d0-b0b3-c5825a4b8b4e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:47.170502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-32f455bc-e04e-44d0-b0b3-c5825a4b8b4e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:47.200313 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-32f455bc-e04e-44d0-b0b3-c5825a4b8b4e tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045492 Aug 27 05:37:47.200918 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3704/7455] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:37:47 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:48.212189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d104223d-1739-4496-8ba3-53eab8b3b9c0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:48.214393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d104223d-1739-4496-8ba3-53eab8b3b9c0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:48.221251 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d104223d-1739-4496-8ba3-53eab8b3b9c0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:48.221748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d104223d-1739-4496-8ba3-53eab8b3b9c0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:48.222193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d104223d-1739-4496-8ba3-53eab8b3b9c0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:48.222897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d104223d-1739-4496-8ba3-53eab8b3b9c0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:48.223359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d104223d-1739-4496-8ba3-53eab8b3b9c0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:48.223795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d104223d-1739-4496-8ba3-53eab8b3b9c0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:48.254934 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d104223d-1739-4496-8ba3-53eab8b3b9c0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046788 Aug 27 05:37:48.255516 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3752/7456] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:37:48 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:49.266815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e2094f87-3656-422f-ac45-0402b0ae60e2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:49.269058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e2094f87-3656-422f-ac45-0402b0ae60e2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:49.276552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2094f87-3656-422f-ac45-0402b0ae60e2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:49.277033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2094f87-3656-422f-ac45-0402b0ae60e2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:49.277466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2094f87-3656-422f-ac45-0402b0ae60e2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:49.278157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2094f87-3656-422f-ac45-0402b0ae60e2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:49.278606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2094f87-3656-422f-ac45-0402b0ae60e2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:49.279276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e2094f87-3656-422f-ac45-0402b0ae60e2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:49.308084 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e2094f87-3656-422f-ac45-0402b0ae60e2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045278 Aug 27 05:37:49.308667 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3705/7457] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:37:49 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:37:49.320584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-419f425f-fdaa-41ee-a6e9-af6fad65c0fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:49.321331 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-419f425f-fdaa-41ee-a6e9-af6fad65c0fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:49.328621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-419f425f-fdaa-41ee-a6e9-af6fad65c0fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:49.328914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-419f425f-fdaa-41ee-a6e9-af6fad65c0fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:49.329373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-419f425f-fdaa-41ee-a6e9-af6fad65c0fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:49.330100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-419f425f-fdaa-41ee-a6e9-af6fad65c0fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:49.330578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-419f425f-fdaa-41ee-a6e9-af6fad65c0fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:49.331022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-419f425f-fdaa-41ee-a6e9-af6fad65c0fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:49.409097 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-419f425f-fdaa-41ee-a6e9-af6fad65c0fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] HTTP exception thrown: Instance cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 is not attached to volume 71b07221-1d2f-4b5d-994c-cf19e95f6eba Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-419f425f-fdaa-41ee-a6e9-af6fad65c0fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Request method failure captured: Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments/71b07221-1d2f-4b5d-994c-cf19e95f6eba HTTP/1.1 Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCa1i09QyXrx4LCtGw_XRC1ySsnYn0fWsyjDQuk7zKqPoXAMy6NU-sB9PW8ug48cHSo-X_FHN9rzP4-bCeJCjMTI9OG5NSf1OjNWiibp72R0lLWwW3hQaGEM50xrq0pI0_wzCqGjU52_wIX-No3zlC5lF3Sh7o9O4v6x0thbGCb1NiaU Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 7693230823224454800700ef38887cf8 Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7693230823224454800700ef38887cf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7693230823224454800700ef38887cf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7693230823224454800700ef38887cf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7693230823224454800700ef38887cf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 7693230823224454800700ef38887cf8 Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestEncryptedCinderVolumes-501333086-project Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: ff08b016916d424bb02fc85902c86e31 Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestEncryptedCinderVolumes-501333086-project Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 is not attached to volume 71b07221-1d2f-4b5d-994c-cf19e95f6eba Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'server_id': 'cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75', 'id': '71b07221-1d2f-4b5d-994c-cf19e95f6eba'} Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 71b07221-1d2f-4b5d-994c-cf19e95f6eba. Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 is not attached to volume 71b07221-1d2f-4b5d-994c-cf19e95f6eba Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:37:49.411071 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:37:49.415407 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:37:49.415407 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:37:49.415407 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 is not attached to volume 71b07221-1d2f-4b5d-994c-cf19e95f6eba Aug 27 05:37:49.415407 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:37:49.415407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-419f425f-fdaa-41ee-a6e9-af6fad65c0fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Returning 404 to user: Instance cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 is not attached to volume 71b07221-1d2f-4b5d-994c-cf19e95f6eba {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:37:49.415407 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-419f425f-fdaa-41ee-a6e9-af6fad65c0fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments/71b07221-1d2f-4b5d-994c-cf19e95f6eba" status: 404 len: 154 microversion: 2.1 time: 0.096253 Aug 27 05:37:49.415407 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3753/7458] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:37:49 2022] DELETE /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75/os-volume_attachments/71b07221-1d2f-4b5d-994c-cf19e95f6eba => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:37:52.755938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f8eb96a4-5a28-4520-9bf3-e403f50782e4 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:52.756444 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f8eb96a4-5a28-4520-9bf3-e403f50782e4 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:52.764156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8eb96a4-5a28-4520-9bf3-e403f50782e4 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:52.764693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8eb96a4-5a28-4520-9bf3-e403f50782e4 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:52.765142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8eb96a4-5a28-4520-9bf3-e403f50782e4 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:52.765870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8eb96a4-5a28-4520-9bf3-e403f50782e4 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:52.766335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8eb96a4-5a28-4520-9bf3-e403f50782e4 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:52.766775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f8eb96a4-5a28-4520-9bf3-e403f50782e4 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:52.794879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f8eb96a4-5a28-4520-9bf3-e403f50782e4 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:37:52.876727 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f8eb96a4-5a28-4520-9bf3-e403f50782e4 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 204 len: 0 microversion: 2.1 time: 0.124294 Aug 27 05:37:52.877393 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3706/7459] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:37:52 2022] DELETE /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:37:52.886875 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc95126d-43ae-41d0-8646-5071d1b7e824 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:52.887510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fc95126d-43ae-41d0-8646-5071d1b7e824 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:52.894492 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc95126d-43ae-41d0-8646-5071d1b7e824 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:52.894999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc95126d-43ae-41d0-8646-5071d1b7e824 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:52.895463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc95126d-43ae-41d0-8646-5071d1b7e824 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:52.896171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc95126d-43ae-41d0-8646-5071d1b7e824 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:52.896669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc95126d-43ae-41d0-8646-5071d1b7e824 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:52.897118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc95126d-43ae-41d0-8646-5071d1b7e824 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:53.030644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fc95126d-43ae-41d0-8646-5071d1b7e824 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:53.038593 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc95126d-43ae-41d0-8646-5071d1b7e824 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1560 microversion: 2.1 time: 0.156319 Aug 27 05:37:53.039149 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3754/7460] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:52 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:54.060213 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8ccb5b7d-0c46-42e1-b8f3-b8b928129fac tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:54.060950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8ccb5b7d-0c46-42e1-b8f3-b8b928129fac tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:54.068040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ccb5b7d-0c46-42e1-b8f3-b8b928129fac tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:54.068522 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ccb5b7d-0c46-42e1-b8f3-b8b928129fac tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:54.068987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ccb5b7d-0c46-42e1-b8f3-b8b928129fac tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:54.069675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ccb5b7d-0c46-42e1-b8f3-b8b928129fac tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:54.070144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ccb5b7d-0c46-42e1-b8f3-b8b928129fac tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:54.070568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8ccb5b7d-0c46-42e1-b8f3-b8b928129fac tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:54.206410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8ccb5b7d-0c46-42e1-b8f3-b8b928129fac tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:54.215872 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8ccb5b7d-0c46-42e1-b8f3-b8b928129fac tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1560 microversion: 2.1 time: 0.159778 Aug 27 05:37:54.216718 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3707/7461] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:54 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:37:55.067005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c9872c9b-0a88-41f3-b5e4-3ae133668aeb req-ec6eaa53-53ea-48c7-bdba-cd725b7d525d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75", "name": "network-vif-deleted", "tag": "14cda21c-6203-497b-80c9-3b19aa2dcd87"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:55.077819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9872c9b-0a88-41f3-b5e4-3ae133668aeb req-ec6eaa53-53ea-48c7-bdba-cd725b7d525d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:55.078380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9872c9b-0a88-41f3-b5e4-3ae133668aeb req-ec6eaa53-53ea-48c7-bdba-cd725b7d525d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:55.078832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9872c9b-0a88-41f3-b5e4-3ae133668aeb req-ec6eaa53-53ea-48c7-bdba-cd725b7d525d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:55.092243 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c9872c9b-0a88-41f3-b5e4-3ae133668aeb req-ec6eaa53-53ea-48c7-bdba-cd725b7d525d service nova] Creating event network-vif-deleted:14cda21c-6203-497b-80c9-3b19aa2dcd87 for instance cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 on n-h1-854823-1 Aug 27 05:37:55.097531 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c9872c9b-0a88-41f3-b5e4-3ae133668aeb req-ec6eaa53-53ea-48c7-bdba-cd725b7d525d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097799 Aug 27 05:37:55.098701 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3755/7462] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:55.237193 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-757b4f60-97aa-451a-95c1-b3c89e4b47b1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:55.237758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-757b4f60-97aa-451a-95c1-b3c89e4b47b1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:55.244550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-757b4f60-97aa-451a-95c1-b3c89e4b47b1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:55.245032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-757b4f60-97aa-451a-95c1-b3c89e4b47b1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:55.245462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-757b4f60-97aa-451a-95c1-b3c89e4b47b1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:55.246147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-757b4f60-97aa-451a-95c1-b3c89e4b47b1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:55.246595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-757b4f60-97aa-451a-95c1-b3c89e4b47b1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:55.247016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-757b4f60-97aa-451a-95c1-b3c89e4b47b1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:55.278374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-757b4f60-97aa-451a-95c1-b3c89e4b47b1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:55.279109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-757b4f60-97aa-451a-95c1-b3c89e4b47b1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:55.279541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-757b4f60-97aa-451a-95c1-b3c89e4b47b1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:55.279984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-757b4f60-97aa-451a-95c1-b3c89e4b47b1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lazy-loading 'fault' on Instance uuid cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:37:55.320363 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-757b4f60-97aa-451a-95c1-b3c89e4b47b1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:55.328078 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-757b4f60-97aa-451a-95c1-b3c89e4b47b1 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 200 len: 1352 microversion: 2.1 time: 0.094858 Aug 27 05:37:55.328667 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3708/7463] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:55 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:56.350976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e2388ba7-21bb-496a-85be-bc196ca6fc4f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:56.351689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e2388ba7-21bb-496a-85be-bc196ca6fc4f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:56.358512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2388ba7-21bb-496a-85be-bc196ca6fc4f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:56.359011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2388ba7-21bb-496a-85be-bc196ca6fc4f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:56.359463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2388ba7-21bb-496a-85be-bc196ca6fc4f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:56.360164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2388ba7-21bb-496a-85be-bc196ca6fc4f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:56.360650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2388ba7-21bb-496a-85be-bc196ca6fc4f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:56.361090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2388ba7-21bb-496a-85be-bc196ca6fc4f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:56.374905 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e2388ba7-21bb-496a-85be-bc196ca6fc4f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] HTTP exception thrown: Instance cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 could not be found. Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e2388ba7-21bb-496a-85be-bc196ca6fc4f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Request method failure captured: Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 HTTP/1.1 Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCa1i09QyXrx4LCtGw_XRC1ySsnYn0fWsyjDQuk7zKqPoXAMy6NU-sB9PW8ug48cHSo-X_FHN9rzP4-bCeJCjMTI9OG5NSf1OjNWiibp72R0lLWwW3hQaGEM50xrq0pI0_wzCqGjU52_wIX-No3zlC5lF3Sh7o9O4v6x0thbGCb1NiaU Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 7693230823224454800700ef38887cf8 Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7693230823224454800700ef38887cf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7693230823224454800700ef38887cf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7693230823224454800700ef38887cf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7693230823224454800700ef38887cf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 7693230823224454800700ef38887cf8 Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestEncryptedCinderVolumes-501333086-project Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: ff08b016916d424bb02fc85902c86e31 Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestEncryptedCinderVolumes-501333086-project Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 could not be found. Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75'} Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 could not be found. Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 could not be found. Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:37:56.376522 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:37:56.381461 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:37:56.381461 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:37:56.381461 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:37:56.381461 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:37:56.381461 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:37:56.381461 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 could not be found. Aug 27 05:37:56.381461 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:37:56.381461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e2388ba7-21bb-496a-85be-bc196ca6fc4f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Returning 404 to user: Instance cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:37:56.381461 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e2388ba7-21bb-496a-85be-bc196ca6fc4f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75" status: 404 len: 111 microversion: 2.1 time: 0.032172 Aug 27 05:37:56.381461 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3756/7464] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:56 2022] GET /compute/v2.1/servers/cbbd8e1e-32ad-406b-9e3b-ea25d1b0bd75 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:37:56.386963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5db1834e-62b0-48fb-a677-a34d83bed632 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '.version_select at 0x7f1f20811ee0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:56.407159 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5db1834e-62b0-48fb-a677-a34d83bed632 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1946269450" status: 202 len: 0 microversion: 2.1 time: 0.024101 Aug 27 05:37:56.407727 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3709/7465] 10.222.0.79 () {58 vars in 1278 bytes} [Sat Aug 27 05:37:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1946269450 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:37:56.425218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f10bace3-3385-49b4-a745-73fa717ab5c5 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Action: 'create', calling method: .version_select at 0x7f1f204cb160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1009692136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1kOClaOq3QA8ywBt5CAUVBOGdfyEZwVBJDCrSq6Op3MFLiOZmM/l32FJVwY7XfLBXR5DN1TE8fl912kA9yu1s5Q/NKzSHWtBNanQ7RDV1P63+yCS7hg0rH32KBu26rDQ=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:56.441179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f10bace3-3385-49b4-a745-73fa717ab5c5 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Getting quotas for project 7693230823224454800700ef38887cf8. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:37:56.447002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f10bace3-3385-49b4-a745-73fa717ab5c5 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Getting quotas for user ff08b016916d424bb02fc85902c86e31 and project 7693230823224454800700ef38887cf8. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:37:56.471297 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f10bace3-3385-49b4-a745-73fa717ab5c5 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049886 Aug 27 05:37:56.471908 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3757/7466] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:37:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:37:56.521998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1218795782", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1009692136", "networks": [{"uuid": "2f9ee00e-36e4-487c-9a94-85063157b8ec"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:56.575533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] validate_networks() for [('2f9ee00e-36e4-487c-9a94-85063157b8ec', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:37:56.951973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:37:56.952567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:37:56.953174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:37:56.953694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:37:56.954203 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:37:56.963029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:56.963507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:56.963938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:56.964699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:56.965152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:56.965573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:56.985713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Getting quotas for project 7693230823224454800700ef38887cf8. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:37:56.990903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Getting quotas for user ff08b016916d424bb02fc85902c86e31 and project 7693230823224454800700ef38887cf8. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:37:57.003802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:37:57.006124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:37:57.050521 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-20c56daa-5f8d-4b5d-85d2-19f150c86fe7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532506 Aug 27 05:37:57.051166 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3710/7467] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:37:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:37:57.062772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-374a3580-6c28-415e-8a4b-7350af15458a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:57.063404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-374a3580-6c28-415e-8a4b-7350af15458a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:57.117380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-374a3580-6c28-415e-8a4b-7350af15458a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:57.124409 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-374a3580-6c28-415e-8a4b-7350af15458a tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 200 len: 1263 microversion: 2.1 time: 0.065769 Aug 27 05:37:57.125038 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3758/7468] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:57 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 1263 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:58.146707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-da4c8fd1-0fe8-41b2-890c-daf0cc69e374 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:58.147496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-da4c8fd1-0fe8-41b2-890c-daf0cc69e374 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:58.155553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da4c8fd1-0fe8-41b2-890c-daf0cc69e374 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:58.156385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da4c8fd1-0fe8-41b2-890c-daf0cc69e374 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:58.157484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da4c8fd1-0fe8-41b2-890c-daf0cc69e374 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:58.158868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da4c8fd1-0fe8-41b2-890c-daf0cc69e374 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:58.158868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da4c8fd1-0fe8-41b2-890c-daf0cc69e374 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:58.158868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da4c8fd1-0fe8-41b2-890c-daf0cc69e374 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:58.229072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-da4c8fd1-0fe8-41b2-890c-daf0cc69e374 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:58.237573 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-da4c8fd1-0fe8-41b2-890c-daf0cc69e374 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 200 len: 1333 microversion: 2.1 time: 0.095864 Aug 27 05:37:58.239062 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3711/7469] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:58 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:59.259433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2dae11f8-c759-4220-a386-4c6fe0d7d7fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:37:59.260226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2dae11f8-c759-4220-a386-4c6fe0d7d7fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:37:59.267231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-c759-4220-a386-4c6fe0d7d7fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:59.267822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-c759-4220-a386-4c6fe0d7d7fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:59.268287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-c759-4220-a386-4c6fe0d7d7fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:59.269037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-c759-4220-a386-4c6fe0d7d7fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:59.269525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-c759-4220-a386-4c6fe0d7d7fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:59.269962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dae11f8-c759-4220-a386-4c6fe0d7d7fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:59.458263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2dae11f8-c759-4220-a386-4c6fe0d7d7fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:37:59.466724 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2dae11f8-c759-4220-a386-4c6fe0d7d7fc tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 200 len: 1363 microversion: 2.1 time: 0.211278 Aug 27 05:37:59.467799 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3759/7470] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:37:59 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:37:59.483711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-baccd24a-e7cb-4b74-acfd-23a403913e43 req-70da4d29-7cd6-42a5-abd6-9407fdfa3705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bea5b89-f174-4650-9f77-9dce29b6da62", "tag": "73fa3414-51aa-455e-8f4f-10841a3f4240"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:37:59.496068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-baccd24a-e7cb-4b74-acfd-23a403913e43 req-70da4d29-7cd6-42a5-abd6-9407fdfa3705 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:37:59.496578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-baccd24a-e7cb-4b74-acfd-23a403913e43 req-70da4d29-7cd6-42a5-abd6-9407fdfa3705 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:37:59.497013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-baccd24a-e7cb-4b74-acfd-23a403913e43 req-70da4d29-7cd6-42a5-abd6-9407fdfa3705 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:37:59.509981 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-baccd24a-e7cb-4b74-acfd-23a403913e43 req-70da4d29-7cd6-42a5-abd6-9407fdfa3705 service nova] Creating event network-changed:73fa3414-51aa-455e-8f4f-10841a3f4240 for instance 2bea5b89-f174-4650-9f77-9dce29b6da62 on n-h2-854823-1 Aug 27 05:37:59.516848 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-baccd24a-e7cb-4b74-acfd-23a403913e43 req-70da4d29-7cd6-42a5-abd6-9407fdfa3705 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036898 Aug 27 05:37:59.518105 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3712/7471] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:00.491215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1cda70f1-d7a4-48d2-85a6-4ec1ab34d373 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:00.491846 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1cda70f1-d7a4-48d2-85a6-4ec1ab34d373 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:00.499274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cda70f1-d7a4-48d2-85a6-4ec1ab34d373 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:00.499769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cda70f1-d7a4-48d2-85a6-4ec1ab34d373 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:00.500215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cda70f1-d7a4-48d2-85a6-4ec1ab34d373 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:00.500957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cda70f1-d7a4-48d2-85a6-4ec1ab34d373 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:00.501425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cda70f1-d7a4-48d2-85a6-4ec1ab34d373 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:00.501866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cda70f1-d7a4-48d2-85a6-4ec1ab34d373 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:00.635940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1cda70f1-d7a4-48d2-85a6-4ec1ab34d373 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:00.643686 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1cda70f1-d7a4-48d2-85a6-4ec1ab34d373 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 200 len: 1363 microversion: 2.1 time: 0.156397 Aug 27 05:38:00.644278 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3760/7472] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:00 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:01.666160 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ca68539e-39c4-4d1f-83c4-51501b7b166f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:01.666787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ca68539e-39c4-4d1f-83c4-51501b7b166f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:01.673063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca68539e-39c4-4d1f-83c4-51501b7b166f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:01.673554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca68539e-39c4-4d1f-83c4-51501b7b166f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:01.673998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca68539e-39c4-4d1f-83c4-51501b7b166f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:01.674697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca68539e-39c4-4d1f-83c4-51501b7b166f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:01.675154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca68539e-39c4-4d1f-83c4-51501b7b166f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:01.675586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca68539e-39c4-4d1f-83c4-51501b7b166f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:01.810106 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ca68539e-39c4-4d1f-83c4-51501b7b166f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:01.817843 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ca68539e-39c4-4d1f-83c4-51501b7b166f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 200 len: 1363 microversion: 2.1 time: 0.156910 Aug 27 05:38:01.818408 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3713/7473] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:01 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:02.839640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-277a197b-5722-44ef-ace8-c62041fb91d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:02.840279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-277a197b-5722-44ef-ace8-c62041fb91d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:02.846691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277a197b-5722-44ef-ace8-c62041fb91d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:02.847194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277a197b-5722-44ef-ace8-c62041fb91d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:02.847634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277a197b-5722-44ef-ace8-c62041fb91d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:02.848332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277a197b-5722-44ef-ace8-c62041fb91d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:02.848831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277a197b-5722-44ef-ace8-c62041fb91d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:02.849266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277a197b-5722-44ef-ace8-c62041fb91d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:02.985511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-277a197b-5722-44ef-ace8-c62041fb91d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:02.993404 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-277a197b-5722-44ef-ace8-c62041fb91d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 200 len: 1363 microversion: 2.1 time: 0.158330 Aug 27 05:38:02.994050 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3761/7474] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:02 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:04.014404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae0f4c75-0e31-4581-8d0d-834386fcb1e6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:04.015044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ae0f4c75-0e31-4581-8d0d-834386fcb1e6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:04.021275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0f4c75-0e31-4581-8d0d-834386fcb1e6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:04.021754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0f4c75-0e31-4581-8d0d-834386fcb1e6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:04.022188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0f4c75-0e31-4581-8d0d-834386fcb1e6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:04.022880 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0f4c75-0e31-4581-8d0d-834386fcb1e6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:04.023327 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0f4c75-0e31-4581-8d0d-834386fcb1e6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:04.023752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae0f4c75-0e31-4581-8d0d-834386fcb1e6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:04.153226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ae0f4c75-0e31-4581-8d0d-834386fcb1e6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:04.161137 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ae0f4c75-0e31-4581-8d0d-834386fcb1e6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 200 len: 1363 microversion: 2.1 time: 0.150791 Aug 27 05:38:04.161706 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3714/7475] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:04 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:05.183139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-423d10c4-e24b-446f-a374-5a04788ae32f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:05.183760 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-423d10c4-e24b-446f-a374-5a04788ae32f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:05.190657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423d10c4-e24b-446f-a374-5a04788ae32f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:05.191148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423d10c4-e24b-446f-a374-5a04788ae32f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:05.191595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423d10c4-e24b-446f-a374-5a04788ae32f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:05.192304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423d10c4-e24b-446f-a374-5a04788ae32f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:05.192791 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423d10c4-e24b-446f-a374-5a04788ae32f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:05.193224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-423d10c4-e24b-446f-a374-5a04788ae32f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:05.211001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-00316d6b-edca-46dd-94d2-54cd7791c4c9 req-14297340-119e-4512-9e36-b92483677f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bea5b89-f174-4650-9f77-9dce29b6da62", "name": "network-vif-plugged", "status": "completed", "tag": "73fa3414-51aa-455e-8f4f-10841a3f4240"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:05.223368 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-00316d6b-edca-46dd-94d2-54cd7791c4c9 req-14297340-119e-4512-9e36-b92483677f27 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:05.223836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-00316d6b-edca-46dd-94d2-54cd7791c4c9 req-14297340-119e-4512-9e36-b92483677f27 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:05.224576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-00316d6b-edca-46dd-94d2-54cd7791c4c9 req-14297340-119e-4512-9e36-b92483677f27 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:05.236691 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-00316d6b-edca-46dd-94d2-54cd7791c4c9 req-14297340-119e-4512-9e36-b92483677f27 service nova] Creating event network-vif-plugged:73fa3414-51aa-455e-8f4f-10841a3f4240 for instance 2bea5b89-f174-4650-9f77-9dce29b6da62 on n-h2-854823-1 Aug 27 05:38:05.242097 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-00316d6b-edca-46dd-94d2-54cd7791c4c9 req-14297340-119e-4512-9e36-b92483677f27 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034749 Aug 27 05:38:05.243429 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3715/7476] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:38:05.375189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-423d10c4-e24b-446f-a374-5a04788ae32f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:05.383020 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-423d10c4-e24b-446f-a374-5a04788ae32f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 200 len: 1363 microversion: 2.1 time: 0.204472 Aug 27 05:38:05.383613 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3762/7477] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:05 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:06.405019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c6e11ce9-a4db-4d6c-a7ab-2d3cf8529770 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:06.405732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c6e11ce9-a4db-4d6c-a7ab-2d3cf8529770 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:06.413234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6e11ce9-a4db-4d6c-a7ab-2d3cf8529770 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:06.414104 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6e11ce9-a4db-4d6c-a7ab-2d3cf8529770 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:06.414671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6e11ce9-a4db-4d6c-a7ab-2d3cf8529770 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:06.415390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6e11ce9-a4db-4d6c-a7ab-2d3cf8529770 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:06.415856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6e11ce9-a4db-4d6c-a7ab-2d3cf8529770 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:06.416291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c6e11ce9-a4db-4d6c-a7ab-2d3cf8529770 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:06.548994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c6e11ce9-a4db-4d6c-a7ab-2d3cf8529770 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:06.557728 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c6e11ce9-a4db-4d6c-a7ab-2d3cf8529770 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 200 len: 1363 microversion: 2.1 time: 0.157058 Aug 27 05:38:06.558137 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3716/7478] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:06 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:07.579312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed477910-71d3-4db4-90d0-35979809fa36 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:07.579939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ed477910-71d3-4db4-90d0-35979809fa36 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:07.582864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:07.589260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed477910-71d3-4db4-90d0-35979809fa36 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:07.589774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed477910-71d3-4db4-90d0-35979809fa36 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:07.590229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed477910-71d3-4db4-90d0-35979809fa36 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:07.590946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed477910-71d3-4db4-90d0-35979809fa36 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:07.591421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed477910-71d3-4db4-90d0-35979809fa36 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:07.591864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed477910-71d3-4db4-90d0-35979809fa36 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:07.723821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed477910-71d3-4db4-90d0-35979809fa36 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:07.731759 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ed477910-71d3-4db4-90d0-35979809fa36 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 200 len: 1555 microversion: 2.1 time: 0.156380 Aug 27 05:38:07.732363 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3763/7479] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:07 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:07.752220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-10291626-dd82-4a9b-97b3-246069dfee3b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:07.752868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-10291626-dd82-4a9b-97b3-246069dfee3b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:07.754848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:07.755505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:07.763394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10291626-dd82-4a9b-97b3-246069dfee3b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:07.763906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10291626-dd82-4a9b-97b3-246069dfee3b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:07.764326 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10291626-dd82-4a9b-97b3-246069dfee3b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:07.765048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10291626-dd82-4a9b-97b3-246069dfee3b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:07.765502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10291626-dd82-4a9b-97b3-246069dfee3b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:07.765921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10291626-dd82-4a9b-97b3-246069dfee3b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:07.900362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10291626-dd82-4a9b-97b3-246069dfee3b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:07.908494 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-10291626-dd82-4a9b-97b3-246069dfee3b tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 200 len: 1555 microversion: 2.1 time: 0.160098 Aug 27 05:38:07.909098 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3717/7480] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:07 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:09.397196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a95bd9d1-8d81-4d67-8e63-241d02b4b362 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9381139-a514-4d56-b990-37463a909ed2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:09.399634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a95bd9d1-8d81-4d67-8e63-241d02b4b362 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:09.406786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a95bd9d1-8d81-4d67-8e63-241d02b4b362 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:09.407287 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a95bd9d1-8d81-4d67-8e63-241d02b4b362 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:09.407740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a95bd9d1-8d81-4d67-8e63-241d02b4b362 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:09.408444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a95bd9d1-8d81-4d67-8e63-241d02b4b362 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:09.408946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a95bd9d1-8d81-4d67-8e63-241d02b4b362 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:09.409387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a95bd9d1-8d81-4d67-8e63-241d02b4b362 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:09.647185 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a95bd9d1-8d81-4d67-8e63-241d02b4b362 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "POST /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253677 Aug 27 05:38:09.647762 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3764/7481] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:38:09 2022] POST /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:20.342903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5cc952b4-d462-4934-90d3-e99bea3294d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:20.343438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5cc952b4-d462-4934-90d3-e99bea3294d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:20.346197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:20.346951 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:20.352779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cc952b4-d462-4934-90d3-e99bea3294d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:20.353785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cc952b4-d462-4934-90d3-e99bea3294d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:20.354217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cc952b4-d462-4934-90d3-e99bea3294d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:20.354901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cc952b4-d462-4934-90d3-e99bea3294d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:20.355371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cc952b4-d462-4934-90d3-e99bea3294d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:20.355769 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5cc952b4-d462-4934-90d3-e99bea3294d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:20.441426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-5cc952b4-d462-4934-90d3-e99bea3294d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lazy-loading 'services' on Instance uuid 2bea5b89-f174-4650-9f77-9dce29b6da62 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:38:20.511767 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5cc952b4-d462-4934-90d3-e99bea3294d0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments/a9381139-a514-4d56-b990-37463a909ed2" status: 202 len: 0 microversion: 2.1 time: 0.172726 Aug 27 05:38:20.512460 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3718/7482] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:38:20 2022] DELETE /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments/a9381139-a514-4d56-b990-37463a909ed2 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:38:20.521618 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97994ebf-cde2-4d7b-8abd-ecab313eb02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:20.524032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97994ebf-cde2-4d7b-8abd-ecab313eb02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:20.528225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:20.529231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:20.533266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97994ebf-cde2-4d7b-8abd-ecab313eb02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:20.534029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97994ebf-cde2-4d7b-8abd-ecab313eb02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:20.534484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97994ebf-cde2-4d7b-8abd-ecab313eb02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:20.535224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97994ebf-cde2-4d7b-8abd-ecab313eb02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:20.535696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97994ebf-cde2-4d7b-8abd-ecab313eb02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:20.536138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97994ebf-cde2-4d7b-8abd-ecab313eb02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:20.571392 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97994ebf-cde2-4d7b-8abd-ecab313eb02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054313 Aug 27 05:38:20.572041 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3765/7483] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:38:20 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:21.584773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-020e4544-0cc5-4ece-ae71-10415ae5b5ff tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:21.587111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-020e4544-0cc5-4ece-ae71-10415ae5b5ff tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:21.593865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-020e4544-0cc5-4ece-ae71-10415ae5b5ff tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:21.594351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-020e4544-0cc5-4ece-ae71-10415ae5b5ff tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:21.594783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-020e4544-0cc5-4ece-ae71-10415ae5b5ff tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:21.595474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-020e4544-0cc5-4ece-ae71-10415ae5b5ff tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:21.595925 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-020e4544-0cc5-4ece-ae71-10415ae5b5ff tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:21.596346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-020e4544-0cc5-4ece-ae71-10415ae5b5ff tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:21.627577 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-020e4544-0cc5-4ece-ae71-10415ae5b5ff tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047919 Aug 27 05:38:21.628434 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3719/7484] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:38:21 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:22.639614 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d368725a-6788-453e-8dae-a412443ce3a6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:22.641884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d368725a-6788-453e-8dae-a412443ce3a6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:22.648921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d368725a-6788-453e-8dae-a412443ce3a6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:22.649433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d368725a-6788-453e-8dae-a412443ce3a6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:22.649907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d368725a-6788-453e-8dae-a412443ce3a6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:22.650648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d368725a-6788-453e-8dae-a412443ce3a6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:22.651122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d368725a-6788-453e-8dae-a412443ce3a6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:22.651567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d368725a-6788-453e-8dae-a412443ce3a6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:22.685603 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d368725a-6788-453e-8dae-a412443ce3a6 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049991 Aug 27 05:38:22.686199 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3766/7485] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:38:22 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:23.698173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7de2ae4-6239-41fb-96c0-9c61cb9c40a7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:23.700250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c7de2ae4-6239-41fb-96c0-9c61cb9c40a7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:23.707060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7de2ae4-6239-41fb-96c0-9c61cb9c40a7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:23.707540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7de2ae4-6239-41fb-96c0-9c61cb9c40a7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:23.707978 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7de2ae4-6239-41fb-96c0-9c61cb9c40a7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:23.708703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7de2ae4-6239-41fb-96c0-9c61cb9c40a7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:23.709156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7de2ae4-6239-41fb-96c0-9c61cb9c40a7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:23.709576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7de2ae4-6239-41fb-96c0-9c61cb9c40a7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:23.740564 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7de2ae4-6239-41fb-96c0-9c61cb9c40a7 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046466 Aug 27 05:38:23.741130 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3720/7486] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:38:23 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:24.752318 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4dc5e086-4c99-4190-998c-2ee0806bc02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:24.754545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4dc5e086-4c99-4190-998c-2ee0806bc02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:24.762027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc5e086-4c99-4190-998c-2ee0806bc02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:24.762529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc5e086-4c99-4190-998c-2ee0806bc02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:24.762982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc5e086-4c99-4190-998c-2ee0806bc02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:24.763699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc5e086-4c99-4190-998c-2ee0806bc02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:24.764168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc5e086-4c99-4190-998c-2ee0806bc02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:24.764642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc5e086-4c99-4190-998c-2ee0806bc02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:24.796147 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4dc5e086-4c99-4190-998c-2ee0806bc02f tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048034 Aug 27 05:38:24.796755 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3767/7487] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:38:24 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:25.808048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-412f1949-fec9-43e9-82bd-fdb1cba58ccb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:25.810295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-412f1949-fec9-43e9-82bd-fdb1cba58ccb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:25.817182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-412f1949-fec9-43e9-82bd-fdb1cba58ccb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:25.817733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-412f1949-fec9-43e9-82bd-fdb1cba58ccb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:25.818172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-412f1949-fec9-43e9-82bd-fdb1cba58ccb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:25.818910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-412f1949-fec9-43e9-82bd-fdb1cba58ccb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:25.819549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-412f1949-fec9-43e9-82bd-fdb1cba58ccb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:25.820324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-412f1949-fec9-43e9-82bd-fdb1cba58ccb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:25.850333 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-412f1949-fec9-43e9-82bd-fdb1cba58ccb tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046747 Aug 27 05:38:25.850862 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3721/7488] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:38:25 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:38:25.861451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4623b531-ec6d-4121-ac9a-97aa2f5afa10 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:25.861954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4623b531-ec6d-4121-ac9a-97aa2f5afa10 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:25.869266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4623b531-ec6d-4121-ac9a-97aa2f5afa10 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:25.869790 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4623b531-ec6d-4121-ac9a-97aa2f5afa10 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:25.870214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4623b531-ec6d-4121-ac9a-97aa2f5afa10 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:25.870917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4623b531-ec6d-4121-ac9a-97aa2f5afa10 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:25.871386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4623b531-ec6d-4121-ac9a-97aa2f5afa10 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:25.871830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4623b531-ec6d-4121-ac9a-97aa2f5afa10 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:25.947372 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4623b531-ec6d-4121-ac9a-97aa2f5afa10 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] HTTP exception thrown: Instance 2bea5b89-f174-4650-9f77-9dce29b6da62 is not attached to volume a9381139-a514-4d56-b990-37463a909ed2 Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4623b531-ec6d-4121-ac9a-97aa2f5afa10 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Request method failure captured: Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments/a9381139-a514-4d56-b990-37463a909ed2 HTTP/1.1 Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCa1i09QyXrx4LCtGw_XRC1ySsnYn0fWsyjDQuk7zKqPoXAMy6NU-sB9PW8ug48cHSo-X_FHN9rzP4-bCeJCjMTI9OG5NSf1OjNWiibp72R0lLWwW3hQaGEM50xrq0pI0_wzCqGjU52_wIX-No3zlC5lF3Sh7o9O4v6x0thbGCb1NiaU Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 7693230823224454800700ef38887cf8 Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7693230823224454800700ef38887cf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7693230823224454800700ef38887cf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7693230823224454800700ef38887cf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7693230823224454800700ef38887cf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 7693230823224454800700ef38887cf8 Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestEncryptedCinderVolumes-501333086-project Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: ff08b016916d424bb02fc85902c86e31 Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestEncryptedCinderVolumes-501333086-project Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 2bea5b89-f174-4650-9f77-9dce29b6da62 is not attached to volume a9381139-a514-4d56-b990-37463a909ed2 Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'server_id': '2bea5b89-f174-4650-9f77-9dce29b6da62', 'id': 'a9381139-a514-4d56-b990-37463a909ed2'} Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a9381139-a514-4d56-b990-37463a909ed2. Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bea5b89-f174-4650-9f77-9dce29b6da62 is not attached to volume a9381139-a514-4d56-b990-37463a909ed2 Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:38:25.949043 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:38:25.953852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:38:25.953852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:38:25.953852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bea5b89-f174-4650-9f77-9dce29b6da62 is not attached to volume a9381139-a514-4d56-b990-37463a909ed2 Aug 27 05:38:25.953852 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:38:25.953852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4623b531-ec6d-4121-ac9a-97aa2f5afa10 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Returning 404 to user: Instance 2bea5b89-f174-4650-9f77-9dce29b6da62 is not attached to volume a9381139-a514-4d56-b990-37463a909ed2 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:38:25.953852 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4623b531-ec6d-4121-ac9a-97aa2f5afa10 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments/a9381139-a514-4d56-b990-37463a909ed2" status: 404 len: 154 microversion: 2.1 time: 0.093235 Aug 27 05:38:25.953852 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3768/7489] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:38:25 2022] DELETE /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62/os-volume_attachments/a9381139-a514-4d56-b990-37463a909ed2 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:38:29.293057 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7c81b27d-9480-4fb3-b36b-a00ad3d9a0c3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:29.293595 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7c81b27d-9480-4fb3-b36b-a00ad3d9a0c3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:29.300748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c81b27d-9480-4fb3-b36b-a00ad3d9a0c3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:29.301247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c81b27d-9480-4fb3-b36b-a00ad3d9a0c3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:29.301692 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c81b27d-9480-4fb3-b36b-a00ad3d9a0c3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:29.302406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c81b27d-9480-4fb3-b36b-a00ad3d9a0c3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:29.302879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c81b27d-9480-4fb3-b36b-a00ad3d9a0c3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:29.303310 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7c81b27d-9480-4fb3-b36b-a00ad3d9a0c3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:29.330715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7c81b27d-9480-4fb3-b36b-a00ad3d9a0c3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:38:29.410198 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7c81b27d-9480-4fb3-b36b-a00ad3d9a0c3 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 204 len: 0 microversion: 2.1 time: 0.120802 Aug 27 05:38:29.410824 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3722/7490] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:38:29 2022] DELETE /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:38:29.419124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-304a1675-bf0a-47c5-bc11-c52fbfc02914 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:29.419754 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-304a1675-bf0a-47c5-bc11-c52fbfc02914 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:29.427646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-304a1675-bf0a-47c5-bc11-c52fbfc02914 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:29.428082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-304a1675-bf0a-47c5-bc11-c52fbfc02914 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:29.428587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-304a1675-bf0a-47c5-bc11-c52fbfc02914 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:29.429284 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-304a1675-bf0a-47c5-bc11-c52fbfc02914 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:29.429755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-304a1675-bf0a-47c5-bc11-c52fbfc02914 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:29.430195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-304a1675-bf0a-47c5-bc11-c52fbfc02914 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:29.564657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-304a1675-bf0a-47c5-bc11-c52fbfc02914 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:29.573188 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-304a1675-bf0a-47c5-bc11-c52fbfc02914 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 200 len: 1561 microversion: 2.1 time: 0.157568 Aug 27 05:38:29.573767 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3769/7491] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:29 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:30.594602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d22e68e9-fdd5-405f-913b-71ee1a790bf0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:30.595311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d22e68e9-fdd5-405f-913b-71ee1a790bf0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:30.602313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22e68e9-fdd5-405f-913b-71ee1a790bf0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:30.603406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22e68e9-fdd5-405f-913b-71ee1a790bf0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:30.603848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22e68e9-fdd5-405f-913b-71ee1a790bf0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:30.604568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22e68e9-fdd5-405f-913b-71ee1a790bf0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:30.605031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22e68e9-fdd5-405f-913b-71ee1a790bf0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:30.605457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d22e68e9-fdd5-405f-913b-71ee1a790bf0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:30.737174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d22e68e9-fdd5-405f-913b-71ee1a790bf0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:30.744875 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d22e68e9-fdd5-405f-913b-71ee1a790bf0 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 200 len: 1561 microversion: 2.1 time: 0.154588 Aug 27 05:38:30.745449 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3723/7492] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:30 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:31.555453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b3d56436-ff02-41cf-9875-3b178dbb3781 req-7c737ee7-001b-40a1-8759-031d7e646f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bea5b89-f174-4650-9f77-9dce29b6da62", "name": "network-vif-deleted", "tag": "73fa3414-51aa-455e-8f4f-10841a3f4240"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:31.566350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b3d56436-ff02-41cf-9875-3b178dbb3781 req-7c737ee7-001b-40a1-8759-031d7e646f5f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:31.566849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b3d56436-ff02-41cf-9875-3b178dbb3781 req-7c737ee7-001b-40a1-8759-031d7e646f5f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:31.567297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b3d56436-ff02-41cf-9875-3b178dbb3781 req-7c737ee7-001b-40a1-8759-031d7e646f5f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:31.586723 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b3d56436-ff02-41cf-9875-3b178dbb3781 req-7c737ee7-001b-40a1-8759-031d7e646f5f service nova] Creating event network-vif-deleted:73fa3414-51aa-455e-8f4f-10841a3f4240 for instance 2bea5b89-f174-4650-9f77-9dce29b6da62 on n-h2-854823-1 Aug 27 05:38:31.594939 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b3d56436-ff02-41cf-9875-3b178dbb3781 req-7c737ee7-001b-40a1-8759-031d7e646f5f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043072 Aug 27 05:38:31.595577 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3770/7493] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:31.765991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-eb6b152e-fea4-4a4e-ac2f-df5273aca493 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:31.766641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-eb6b152e-fea4-4a4e-ac2f-df5273aca493 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:31.773533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb6b152e-fea4-4a4e-ac2f-df5273aca493 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:31.773975 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb6b152e-fea4-4a4e-ac2f-df5273aca493 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:31.774418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb6b152e-fea4-4a4e-ac2f-df5273aca493 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:31.775770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb6b152e-fea4-4a4e-ac2f-df5273aca493 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:31.776228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb6b152e-fea4-4a4e-ac2f-df5273aca493 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:31.776700 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb6b152e-fea4-4a4e-ac2f-df5273aca493 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:31.809047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb6b152e-fea4-4a4e-ac2f-df5273aca493 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:31.809534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb6b152e-fea4-4a4e-ac2f-df5273aca493 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:31.809973 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-eb6b152e-fea4-4a4e-ac2f-df5273aca493 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:31.810423 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-eb6b152e-fea4-4a4e-ac2f-df5273aca493 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lazy-loading 'fault' on Instance uuid 2bea5b89-f174-4650-9f77-9dce29b6da62 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:38:31.851181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-eb6b152e-fea4-4a4e-ac2f-df5273aca493 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff08b016916d424bb02fc85902c86e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7693230823224454800700ef38887cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:38:31.859119 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-eb6b152e-fea4-4a4e-ac2f-df5273aca493 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 200 len: 1353 microversion: 2.1 time: 0.096989 Aug 27 05:38:31.859693 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3724/7494] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:31 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 1353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:38:32.882345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3644dc2e-6bc5-4347-9f20-d7a8bbfa4564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:32.883059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3644dc2e-6bc5-4347-9f20-d7a8bbfa4564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] [instance: 2bea5b89-f174-4650-9f77-9dce29b6da62] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:38:32.889355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3644dc2e-6bc5-4347-9f20-d7a8bbfa4564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:32.889849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3644dc2e-6bc5-4347-9f20-d7a8bbfa4564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:32.890298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3644dc2e-6bc5-4347-9f20-d7a8bbfa4564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:32.890999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3644dc2e-6bc5-4347-9f20-d7a8bbfa4564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:38:32.891463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3644dc2e-6bc5-4347-9f20-d7a8bbfa4564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:38:32.891899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3644dc2e-6bc5-4347-9f20-d7a8bbfa4564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:38:32.905880 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3644dc2e-6bc5-4347-9f20-d7a8bbfa4564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] HTTP exception thrown: Instance 2bea5b89-f174-4650-9f77-9dce29b6da62 could not be found. Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3644dc2e-6bc5-4347-9f20-d7a8bbfa4564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Request method failure captured: Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 HTTP/1.1 Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCa1i09QyXrx4LCtGw_XRC1ySsnYn0fWsyjDQuk7zKqPoXAMy6NU-sB9PW8ug48cHSo-X_FHN9rzP4-bCeJCjMTI9OG5NSf1OjNWiibp72R0lLWwW3hQaGEM50xrq0pI0_wzCqGjU52_wIX-No3zlC5lF3Sh7o9O4v6x0thbGCb1NiaU Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 7693230823224454800700ef38887cf8 Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7693230823224454800700ef38887cf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7693230823224454800700ef38887cf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7693230823224454800700ef38887cf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7693230823224454800700ef38887cf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 7693230823224454800700ef38887cf8 Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-501333086 Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestEncryptedCinderVolumes-501333086-project Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: ff08b016916d424bb02fc85902c86e31 Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestEncryptedCinderVolumes-501333086-project Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 2bea5b89-f174-4650-9f77-9dce29b6da62 could not be found. Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '2bea5b89-f174-4650-9f77-9dce29b6da62'} Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bea5b89-f174-4650-9f77-9dce29b6da62 could not be found. Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bea5b89-f174-4650-9f77-9dce29b6da62 could not be found. Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:38:32.907527 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:38:32.912155 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:38:32.912155 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:38:32.912155 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:38:32.912155 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:38:32.912155 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:38:32.912155 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bea5b89-f174-4650-9f77-9dce29b6da62 could not be found. Aug 27 05:38:32.912155 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:38:32.912155 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3644dc2e-6bc5-4347-9f20-d7a8bbfa4564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Returning 404 to user: Instance 2bea5b89-f174-4650-9f77-9dce29b6da62 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:38:32.912155 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3644dc2e-6bc5-4347-9f20-d7a8bbfa4564 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62" status: 404 len: 111 microversion: 2.1 time: 0.031797 Aug 27 05:38:32.912155 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3771/7495] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:38:32 2022] GET /compute/v2.1/servers/2bea5b89-f174-4650-9f77-9dce29b6da62 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:38:32.918956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0b4a419a-5f46-4e83-9613-1d5da11644a2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] Calling method '.version_select at 0x7f1f20f71040>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:38:32.938865 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0b4a419a-5f46-4e83-9613-1d5da11644a2 tempest-TestEncryptedCinderVolumes-501333086 tempest-TestEncryptedCinderVolumes-501333086-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1009692136" status: 202 len: 0 microversion: 2.1 time: 0.024351 Aug 27 05:38:32.939447 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3725/7496] 10.222.0.79 () {58 vars in 1278 bytes} [Sat Aug 27 05:38:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1009692136 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:38:59.855279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c29b47b4-73b4-4446-b37c-c361e4e963da tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Action: 'create', calling method: .version_select at 0x7f1f21a235e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-704468500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBozF2c4N+boSJzTUwKux0YXrsIiI1JY3sBLHJm8nkEvVZESH/oj//FiO1IcbnH9Dd0rOaFILHF6g2Y5HgKzXnJXGmNUcW9S55nTQ3DomsZYu3fJF5vkNPrUsqrNCcwcAA=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:38:59.861874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=14 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:59.862542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=34 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:59.875872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c29b47b4-73b4-4446-b37c-c361e4e963da tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Getting quotas for project cd7f3f400b144f5ca7ac796123a2206b. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:38:59.881014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c29b47b4-73b4-4446-b37c-c361e4e963da tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Getting quotas for user bd902c0afe40463f839abcecb4e39440 and project cd7f3f400b144f5ca7ac796123a2206b. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:38:59.905197 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c29b47b4-73b4-4446-b37c-c361e4e963da tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053905 Aug 27 05:38:59.905812 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3772/7497] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:38:59 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:38:59.957627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:59.958452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:38:59.962852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2049856820", "imageRef": "80d46e93-d045-42c5-b958-f59acc86eb29", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-704468500", "networks": [{"uuid": "1042a420-1cb9-451a-828a-4e1f6849f642"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:00.017451 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] validate_networks() for [('1042a420-1cb9-451a-828a-4e1f6849f642', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:39:00.388298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:39:00.388770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:39:00.389254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:39:00.389669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:39:00.390089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:39:00.399731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:00.400225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:00.400706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:00.401443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:00.401901 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:00.402330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:00.420047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Getting quotas for project cd7f3f400b144f5ca7ac796123a2206b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:39:00.425585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Getting quotas for user bd902c0afe40463f839abcecb4e39440 and project cd7f3f400b144f5ca7ac796123a2206b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:39:00.438342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:39:00.440604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='80d46e93-d045-42c5-b958-f59acc86eb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:39:00.487047 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cac62a46-0498-4e34-9ea4-a09da649061c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531751 Aug 27 05:39:00.487718 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3726/7498] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:38:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:39:00.498653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da644b7b-1402-462d-bfac-76880ae27d10 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:00.499412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da644b7b-1402-462d-bfac-76880ae27d10 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:00.556486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da644b7b-1402-462d-bfac-76880ae27d10 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:00.563574 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da644b7b-1402-462d-bfac-76880ae27d10 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1258 microversion: 2.1 time: 0.068937 Aug 27 05:39:00.564150 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3773/7499] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:00 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:01.584215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a9d2d81a-1a00-4272-82fb-cfd320afba68 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:01.584879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a9d2d81a-1a00-4272-82fb-cfd320afba68 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:01.593819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9d2d81a-1a00-4272-82fb-cfd320afba68 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:01.594392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9d2d81a-1a00-4272-82fb-cfd320afba68 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:01.595419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9d2d81a-1a00-4272-82fb-cfd320afba68 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:01.595610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9d2d81a-1a00-4272-82fb-cfd320afba68 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:01.596616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9d2d81a-1a00-4272-82fb-cfd320afba68 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:01.596616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9d2d81a-1a00-4272-82fb-cfd320afba68 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:01.675020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a9d2d81a-1a00-4272-82fb-cfd320afba68 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:01.683913 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a9d2d81a-1a00-4272-82fb-cfd320afba68 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1328 microversion: 2.1 time: 0.103696 Aug 27 05:39:01.684632 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3727/7500] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:01 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:02.705924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abd04a2c-28e7-4ccb-ae90-2c00b5a38a08 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:02.706553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-abd04a2c-28e7-4ccb-ae90-2c00b5a38a08 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:02.715174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abd04a2c-28e7-4ccb-ae90-2c00b5a38a08 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:02.715949 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abd04a2c-28e7-4ccb-ae90-2c00b5a38a08 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:02.718056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abd04a2c-28e7-4ccb-ae90-2c00b5a38a08 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:02.719194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abd04a2c-28e7-4ccb-ae90-2c00b5a38a08 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:02.719881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abd04a2c-28e7-4ccb-ae90-2c00b5a38a08 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:02.720501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abd04a2c-28e7-4ccb-ae90-2c00b5a38a08 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:02.901713 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-abd04a2c-28e7-4ccb-ae90-2c00b5a38a08 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:02.911654 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-abd04a2c-28e7-4ccb-ae90-2c00b5a38a08 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.209630 Aug 27 05:39:02.912415 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3774/7501] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:02 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:03.933847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-149b3a82-a49c-4179-afc7-9e3b1a2d09ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:03.934473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-149b3a82-a49c-4179-afc7-9e3b1a2d09ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:03.940922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-149b3a82-a49c-4179-afc7-9e3b1a2d09ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:03.941419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-149b3a82-a49c-4179-afc7-9e3b1a2d09ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:03.941861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-149b3a82-a49c-4179-afc7-9e3b1a2d09ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:03.942747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-149b3a82-a49c-4179-afc7-9e3b1a2d09ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:03.943296 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-149b3a82-a49c-4179-afc7-9e3b1a2d09ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:03.943733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-149b3a82-a49c-4179-afc7-9e3b1a2d09ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:04.424395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-149b3a82-a49c-4179-afc7-9e3b1a2d09ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:04.432669 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-149b3a82-a49c-4179-afc7-9e3b1a2d09ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.503200 Aug 27 05:39:04.433650 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3728/7502] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:03 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:05.454118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-adf5ad2c-7a7e-4f33-98bc-963c895554c9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:05.455475 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-adf5ad2c-7a7e-4f33-98bc-963c895554c9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:05.462782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adf5ad2c-7a7e-4f33-98bc-963c895554c9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:05.463436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adf5ad2c-7a7e-4f33-98bc-963c895554c9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:05.463891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adf5ad2c-7a7e-4f33-98bc-963c895554c9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:05.464640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adf5ad2c-7a7e-4f33-98bc-963c895554c9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:05.465120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adf5ad2c-7a7e-4f33-98bc-963c895554c9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:05.465547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adf5ad2c-7a7e-4f33-98bc-963c895554c9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:05.624717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-adf5ad2c-7a7e-4f33-98bc-963c895554c9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:05.632832 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-adf5ad2c-7a7e-4f33-98bc-963c895554c9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.182582 Aug 27 05:39:05.633851 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3775/7503] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:05 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:06.653283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-60078528-c79b-4cce-8dff-44df193de1c6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:06.653905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-60078528-c79b-4cce-8dff-44df193de1c6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:06.661187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60078528-c79b-4cce-8dff-44df193de1c6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:06.661747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60078528-c79b-4cce-8dff-44df193de1c6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:06.662234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60078528-c79b-4cce-8dff-44df193de1c6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:06.662949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60078528-c79b-4cce-8dff-44df193de1c6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:06.663409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60078528-c79b-4cce-8dff-44df193de1c6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:06.663837 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-60078528-c79b-4cce-8dff-44df193de1c6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:06.804236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-60078528-c79b-4cce-8dff-44df193de1c6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:06.813245 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-60078528-c79b-4cce-8dff-44df193de1c6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.163473 Aug 27 05:39:06.813605 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3729/7504] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:06 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:07.834865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dec4651c-5774-40f4-9305-268dcd41d9bd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:07.835582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dec4651c-5774-40f4-9305-268dcd41d9bd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:07.843629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dec4651c-5774-40f4-9305-268dcd41d9bd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:07.844187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dec4651c-5774-40f4-9305-268dcd41d9bd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:07.844753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dec4651c-5774-40f4-9305-268dcd41d9bd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:07.851816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dec4651c-5774-40f4-9305-268dcd41d9bd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:07.852340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dec4651c-5774-40f4-9305-268dcd41d9bd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:07.852895 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dec4651c-5774-40f4-9305-268dcd41d9bd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:07.995756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dec4651c-5774-40f4-9305-268dcd41d9bd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:08.005131 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dec4651c-5774-40f4-9305-268dcd41d9bd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.174339 Aug 27 05:39:08.006091 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3776/7505] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:07 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:09.028829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1bbfa1b9-94d4-4f10-838b-7d18f801eba2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:09.029687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1bbfa1b9-94d4-4f10-838b-7d18f801eba2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:09.036670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1bbfa1b9-94d4-4f10-838b-7d18f801eba2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:09.037166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1bbfa1b9-94d4-4f10-838b-7d18f801eba2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:09.037605 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1bbfa1b9-94d4-4f10-838b-7d18f801eba2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:09.040043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1bbfa1b9-94d4-4f10-838b-7d18f801eba2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:09.040573 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1bbfa1b9-94d4-4f10-838b-7d18f801eba2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:09.041085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1bbfa1b9-94d4-4f10-838b-7d18f801eba2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:09.179044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1bbfa1b9-94d4-4f10-838b-7d18f801eba2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:09.187359 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1bbfa1b9-94d4-4f10-838b-7d18f801eba2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.162765 Aug 27 05:39:09.187943 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3730/7506] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:09 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:10.207965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7eeda6b2-46c1-4ac2-8633-bf0a296e03bb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:10.208653 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7eeda6b2-46c1-4ac2-8633-bf0a296e03bb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:10.215629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7eeda6b2-46c1-4ac2-8633-bf0a296e03bb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:10.216124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7eeda6b2-46c1-4ac2-8633-bf0a296e03bb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:10.216602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7eeda6b2-46c1-4ac2-8633-bf0a296e03bb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:10.217304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7eeda6b2-46c1-4ac2-8633-bf0a296e03bb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:10.217772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7eeda6b2-46c1-4ac2-8633-bf0a296e03bb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:10.218207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7eeda6b2-46c1-4ac2-8633-bf0a296e03bb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:10.346562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7eeda6b2-46c1-4ac2-8633-bf0a296e03bb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:10.354313 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7eeda6b2-46c1-4ac2-8633-bf0a296e03bb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.150303 Aug 27 05:39:10.354887 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3777/7507] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:10 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:11.375358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f4b556cb-303b-4e8e-8940-4f9fe336f240 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:11.375962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f4b556cb-303b-4e8e-8940-4f9fe336f240 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:11.378644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:11.379306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:11.385645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4b556cb-303b-4e8e-8940-4f9fe336f240 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:11.386130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4b556cb-303b-4e8e-8940-4f9fe336f240 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:11.386563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4b556cb-303b-4e8e-8940-4f9fe336f240 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:11.387256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4b556cb-303b-4e8e-8940-4f9fe336f240 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:11.387721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4b556cb-303b-4e8e-8940-4f9fe336f240 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:11.388144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f4b556cb-303b-4e8e-8940-4f9fe336f240 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:11.522229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f4b556cb-303b-4e8e-8940-4f9fe336f240 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:11.530970 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f4b556cb-303b-4e8e-8940-4f9fe336f240 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.159557 Aug 27 05:39:11.531552 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3731/7508] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:11 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:12.551279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc5d08a6-ba69-4fc4-97a5-abbb7bfb1670 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:12.551908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc5d08a6-ba69-4fc4-97a5-abbb7bfb1670 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:12.553849 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:12.560604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5d08a6-ba69-4fc4-97a5-abbb7bfb1670 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:12.561118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5d08a6-ba69-4fc4-97a5-abbb7bfb1670 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:12.561571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5d08a6-ba69-4fc4-97a5-abbb7bfb1670 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:12.562290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5d08a6-ba69-4fc4-97a5-abbb7bfb1670 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:12.562762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5d08a6-ba69-4fc4-97a5-abbb7bfb1670 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:12.563201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5d08a6-ba69-4fc4-97a5-abbb7bfb1670 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:12.700349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dc5d08a6-ba69-4fc4-97a5-abbb7bfb1670 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:12.708157 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc5d08a6-ba69-4fc4-97a5-abbb7bfb1670 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.160799 Aug 27 05:39:12.709939 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3778/7509] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:12 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:12.768377 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d6c5bda4-0102-4c39-b771-885d104bd55c req-2667c74d-238f-4fc3-bd02-1a94da9b78de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1a836a-2576-4e4b-b700-fb94ae487e41", "tag": "c08af019-9f7a-4e7b-b096-b5471323483d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:12.783730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d6c5bda4-0102-4c39-b771-885d104bd55c req-2667c74d-238f-4fc3-bd02-1a94da9b78de service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:12.784375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d6c5bda4-0102-4c39-b771-885d104bd55c req-2667c74d-238f-4fc3-bd02-1a94da9b78de service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:12.785006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d6c5bda4-0102-4c39-b771-885d104bd55c req-2667c74d-238f-4fc3-bd02-1a94da9b78de service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:12.797484 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d6c5bda4-0102-4c39-b771-885d104bd55c req-2667c74d-238f-4fc3-bd02-1a94da9b78de service nova] Creating event network-changed:c08af019-9f7a-4e7b-b096-b5471323483d for instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 on n-h1-854823-1 Aug 27 05:39:12.803299 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d6c5bda4-0102-4c39-b771-885d104bd55c req-2667c74d-238f-4fc3-bd02-1a94da9b78de service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038608 Aug 27 05:39:12.804160 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3732/7510] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:39:13.730372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0289bc71-8181-4348-b66b-37c0c7841db2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:13.731011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0289bc71-8181-4348-b66b-37c0c7841db2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:13.738211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0289bc71-8181-4348-b66b-37c0c7841db2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:13.738654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0289bc71-8181-4348-b66b-37c0c7841db2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:13.739109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0289bc71-8181-4348-b66b-37c0c7841db2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:13.739827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0289bc71-8181-4348-b66b-37c0c7841db2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:13.740307 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0289bc71-8181-4348-b66b-37c0c7841db2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:13.740787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0289bc71-8181-4348-b66b-37c0c7841db2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:13.873293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0289bc71-8181-4348-b66b-37c0c7841db2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:13.881034 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0289bc71-8181-4348-b66b-37c0c7841db2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.155188 Aug 27 05:39:13.881620 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3779/7511] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:13 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:14.902866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-354dc388-cb58-457a-8b63-762d3b4edacd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:14.903565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-354dc388-cb58-457a-8b63-762d3b4edacd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:14.910894 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-354dc388-cb58-457a-8b63-762d3b4edacd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:14.911382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-354dc388-cb58-457a-8b63-762d3b4edacd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:14.911910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-354dc388-cb58-457a-8b63-762d3b4edacd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:14.912638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-354dc388-cb58-457a-8b63-762d3b4edacd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:14.913176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-354dc388-cb58-457a-8b63-762d3b4edacd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:14.913602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-354dc388-cb58-457a-8b63-762d3b4edacd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:15.044424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-354dc388-cb58-457a-8b63-762d3b4edacd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:15.052676 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-354dc388-cb58-457a-8b63-762d3b4edacd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.154474 Aug 27 05:39:15.053261 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3733/7512] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:14 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:16.073944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cb9659f-9351-4ce0-8535-c24b00b6461f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:16.074587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2cb9659f-9351-4ce0-8535-c24b00b6461f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:16.081449 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb9659f-9351-4ce0-8535-c24b00b6461f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:16.081947 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb9659f-9351-4ce0-8535-c24b00b6461f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:16.082393 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb9659f-9351-4ce0-8535-c24b00b6461f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:16.083093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb9659f-9351-4ce0-8535-c24b00b6461f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:16.083576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb9659f-9351-4ce0-8535-c24b00b6461f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:16.084000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb9659f-9351-4ce0-8535-c24b00b6461f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:16.211819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2cb9659f-9351-4ce0-8535-c24b00b6461f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:16.219596 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2cb9659f-9351-4ce0-8535-c24b00b6461f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.150197 Aug 27 05:39:16.220179 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3780/7513] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:16 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:17.239584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b707ffbe-45c6-4902-a6ac-816f969e4610 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:17.240436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b707ffbe-45c6-4902-a6ac-816f969e4610 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:17.247291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b707ffbe-45c6-4902-a6ac-816f969e4610 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:17.247779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b707ffbe-45c6-4902-a6ac-816f969e4610 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:17.248216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b707ffbe-45c6-4902-a6ac-816f969e4610 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:17.249320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b707ffbe-45c6-4902-a6ac-816f969e4610 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:17.249445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b707ffbe-45c6-4902-a6ac-816f969e4610 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:17.249810 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b707ffbe-45c6-4902-a6ac-816f969e4610 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:17.379128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b707ffbe-45c6-4902-a6ac-816f969e4610 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:17.387310 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b707ffbe-45c6-4902-a6ac-816f969e4610 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.151630 Aug 27 05:39:17.387880 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3734/7514] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:17 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:18.409032 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b8f8c3d-8197-4540-921b-efc5d2157898 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:18.409577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b8f8c3d-8197-4540-921b-efc5d2157898 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:18.416514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f8c3d-8197-4540-921b-efc5d2157898 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:18.417043 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f8c3d-8197-4540-921b-efc5d2157898 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:18.417491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f8c3d-8197-4540-921b-efc5d2157898 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:18.418203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f8c3d-8197-4540-921b-efc5d2157898 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:18.418676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f8c3d-8197-4540-921b-efc5d2157898 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:18.419116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b8f8c3d-8197-4540-921b-efc5d2157898 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:18.555634 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b8f8c3d-8197-4540-921b-efc5d2157898 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:18.563462 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b8f8c3d-8197-4540-921b-efc5d2157898 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.158514 Aug 27 05:39:18.564049 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3781/7515] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:18 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:18.835141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-fa790a84-19b5-462e-bc7c-e6d709b77df7 req-01fac2ec-7e76-48f7-a5e7-e1988dacd8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1a836a-2576-4e4b-b700-fb94ae487e41", "name": "network-vif-plugged", "status": "completed", "tag": "c08af019-9f7a-4e7b-b096-b5471323483d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:18.846224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fa790a84-19b5-462e-bc7c-e6d709b77df7 req-01fac2ec-7e76-48f7-a5e7-e1988dacd8f3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:18.846712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fa790a84-19b5-462e-bc7c-e6d709b77df7 req-01fac2ec-7e76-48f7-a5e7-e1988dacd8f3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:18.847151 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-fa790a84-19b5-462e-bc7c-e6d709b77df7 req-01fac2ec-7e76-48f7-a5e7-e1988dacd8f3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:18.858567 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-fa790a84-19b5-462e-bc7c-e6d709b77df7 req-01fac2ec-7e76-48f7-a5e7-e1988dacd8f3 service nova] Creating event network-vif-plugged:c08af019-9f7a-4e7b-b096-b5471323483d for instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 on n-h1-854823-1 Aug 27 05:39:18.863470 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-fa790a84-19b5-462e-bc7c-e6d709b77df7 req-01fac2ec-7e76-48f7-a5e7-e1988dacd8f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032301 Aug 27 05:39:18.864075 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3735/7516] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:39:19.584021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-855033f5-f9c2-4ad6-914d-41512ef5d029 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:19.584820 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-855033f5-f9c2-4ad6-914d-41512ef5d029 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:19.591975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-855033f5-f9c2-4ad6-914d-41512ef5d029 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:19.592473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-855033f5-f9c2-4ad6-914d-41512ef5d029 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:19.592952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-855033f5-f9c2-4ad6-914d-41512ef5d029 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:19.593660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-855033f5-f9c2-4ad6-914d-41512ef5d029 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:19.594131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-855033f5-f9c2-4ad6-914d-41512ef5d029 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:19.594832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-855033f5-f9c2-4ad6-914d-41512ef5d029 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:19.723509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-855033f5-f9c2-4ad6-914d-41512ef5d029 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:19.731303 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-855033f5-f9c2-4ad6-914d-41512ef5d029 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1358 microversion: 2.1 time: 0.151248 Aug 27 05:39:19.731884 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3782/7517] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:19 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:20.752862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1792aa27-ba08-49b0-88ac-e809a8a3be7d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:20.753480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1792aa27-ba08-49b0-88ac-e809a8a3be7d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:20.759695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1792aa27-ba08-49b0-88ac-e809a8a3be7d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:20.760172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1792aa27-ba08-49b0-88ac-e809a8a3be7d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:20.760645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1792aa27-ba08-49b0-88ac-e809a8a3be7d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:20.761338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1792aa27-ba08-49b0-88ac-e809a8a3be7d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:20.761815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1792aa27-ba08-49b0-88ac-e809a8a3be7d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:20.762234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1792aa27-ba08-49b0-88ac-e809a8a3be7d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:20.891046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1792aa27-ba08-49b0-88ac-e809a8a3be7d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:20.899175 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1792aa27-ba08-49b0-88ac-e809a8a3be7d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1549 microversion: 2.1 time: 0.151564 Aug 27 05:39:20.899760 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3736/7518] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:20 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:20.919889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dedbba7c-f032-49ce-9f08-7908363e0ef1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:20.920557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dedbba7c-f032-49ce-9f08-7908363e0ef1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:20.927463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dedbba7c-f032-49ce-9f08-7908363e0ef1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:20.927972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dedbba7c-f032-49ce-9f08-7908363e0ef1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:20.928513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dedbba7c-f032-49ce-9f08-7908363e0ef1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:20.929269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dedbba7c-f032-49ce-9f08-7908363e0ef1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:20.929729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dedbba7c-f032-49ce-9f08-7908363e0ef1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:20.930179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dedbba7c-f032-49ce-9f08-7908363e0ef1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:21.057629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dedbba7c-f032-49ce-9f08-7908363e0ef1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:21.065925 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dedbba7c-f032-49ce-9f08-7908363e0ef1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1549 microversion: 2.1 time: 0.149429 Aug 27 05:39:21.066577 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3783/7519] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:20 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:21.086920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2832d7e6-0c89-49cf-a4db-2897bd5cbc28 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:21.091586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2832d7e6-0c89-49cf-a4db-2897bd5cbc28 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:21.092359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2832d7e6-0c89-49cf-a4db-2897bd5cbc28 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Searching by: {'deleted': False, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:39:21.097744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2832d7e6-0c89-49cf-a4db-2897bd5cbc28 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:21.098226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2832d7e6-0c89-49cf-a4db-2897bd5cbc28 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:21.098665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2832d7e6-0c89-49cf-a4db-2897bd5cbc28 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:21.099479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2832d7e6-0c89-49cf-a4db-2897bd5cbc28 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:21.099936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2832d7e6-0c89-49cf-a4db-2897bd5cbc28 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:21.100362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2832d7e6-0c89-49cf-a4db-2897bd5cbc28 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:21.123976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-2832d7e6-0c89-49cf-a4db-2897bd5cbc28 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:39:21.151523 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2832d7e6-0c89-49cf-a4db-2897bd5cbc28 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069014 Aug 27 05:39:21.152109 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3737/7520] 10.222.0.79 () {58 vars in 1125 bytes} [Sat Aug 27 05:39:21 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:39:21.163590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37325137-7c64-4e41-a2a1-4c3e1933e7bc tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:21.164271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37325137-7c64-4e41-a2a1-4c3e1933e7bc tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:21.170326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37325137-7c64-4e41-a2a1-4c3e1933e7bc tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:21.170825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37325137-7c64-4e41-a2a1-4c3e1933e7bc tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:21.171276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37325137-7c64-4e41-a2a1-4c3e1933e7bc tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:21.171981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37325137-7c64-4e41-a2a1-4c3e1933e7bc tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:21.172451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37325137-7c64-4e41-a2a1-4c3e1933e7bc tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:21.172929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37325137-7c64-4e41-a2a1-4c3e1933e7bc tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:21.307982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-37325137-7c64-4e41-a2a1-4c3e1933e7bc tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:21.315778 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37325137-7c64-4e41-a2a1-4c3e1933e7bc tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1549 microversion: 2.1 time: 0.156113 Aug 27 05:39:21.316359 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3784/7521] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:21 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:22.851324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1da14a05-192a-468c-898c-4e3e0cebfbb9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84d8e7ee-352e-4316-a19f-8d4a31dbe812"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:22.853724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1da14a05-192a-468c-898c-4e3e0cebfbb9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:22.860572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1da14a05-192a-468c-898c-4e3e0cebfbb9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:22.861124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1da14a05-192a-468c-898c-4e3e0cebfbb9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:22.861557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1da14a05-192a-468c-898c-4e3e0cebfbb9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:22.862244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1da14a05-192a-468c-898c-4e3e0cebfbb9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:22.862695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1da14a05-192a-468c-898c-4e3e0cebfbb9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:22.863116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1da14a05-192a-468c-898c-4e3e0cebfbb9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:23.107114 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1da14a05-192a-468c-898c-4e3e0cebfbb9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "POST /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259276 Aug 27 05:39:23.107781 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3738/7522] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:39:22 2022] POST /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:39:36.132373 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-224b0c66-d742-46a2-b4fc-4cebec1d1d7b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:36.133055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-224b0c66-d742-46a2-b4fc-4cebec1d1d7b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:36.135232 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:39:36.135364 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:39:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 (ip 10.222.0.79) !!! Aug 27 05:39:36.136814 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:36.137489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=66 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:36.145236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224b0c66-d742-46a2-b4fc-4cebec1d1d7b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:36.145753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224b0c66-d742-46a2-b4fc-4cebec1d1d7b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:36.146203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224b0c66-d742-46a2-b4fc-4cebec1d1d7b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:36.146924 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224b0c66-d742-46a2-b4fc-4cebec1d1d7b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:36.147398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224b0c66-d742-46a2-b4fc-4cebec1d1d7b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:36.147841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224b0c66-d742-46a2-b4fc-4cebec1d1d7b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:36.278781 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-224b0c66-d742-46a2-b4fc-4cebec1d1d7b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:36.287435 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-224b0c66-d742-46a2-b4fc-4cebec1d1d7b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1595 microversion: 2.1 time: 0.159276 Aug 27 05:39:36.288042 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3785/7523] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:36 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:39:38.435126 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1b3e4199-6e0c-42df-ada1-4588e98e2f6d req-4d5496fd-fb61-4163-a43a-f9a9813d395b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1a836a-2576-4e4b-b700-fb94ae487e41", "tag": "c08af019-9f7a-4e7b-b096-b5471323483d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:38.447095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:38.450333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:38.451013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:39:38.460833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1b3e4199-6e0c-42df-ada1-4588e98e2f6d req-4d5496fd-fb61-4163-a43a-f9a9813d395b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:38.461199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1b3e4199-6e0c-42df-ada1-4588e98e2f6d req-4d5496fd-fb61-4163-a43a-f9a9813d395b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:38.461395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1b3e4199-6e0c-42df-ada1-4588e98e2f6d req-4d5496fd-fb61-4163-a43a-f9a9813d395b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:38.476450 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1b3e4199-6e0c-42df-ada1-4588e98e2f6d req-4d5496fd-fb61-4163-a43a-f9a9813d395b service nova] Creating event network-changed:c08af019-9f7a-4e7b-b096-b5471323483d for instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 on n-h1-854823-1 Aug 27 05:39:38.483097 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1b3e4199-6e0c-42df-ada1-4588e98e2f6d req-4d5496fd-fb61-4163-a43a-f9a9813d395b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056424 Aug 27 05:39:38.483719 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3739/7524] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:39:39.680472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c151ffe9-3f12-44e0-a907-6a84ab7328d8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-580202282"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:39.681759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c151ffe9-3f12-44e0-a907-6a84ab7328d8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:39.688848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c151ffe9-3f12-44e0-a907-6a84ab7328d8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:39.689341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c151ffe9-3f12-44e0-a907-6a84ab7328d8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:39.689796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c151ffe9-3f12-44e0-a907-6a84ab7328d8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:39.690497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c151ffe9-3f12-44e0-a907-6a84ab7328d8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:39.690963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c151ffe9-3f12-44e0-a907-6a84ab7328d8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:39.691400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c151ffe9-3f12-44e0-a907-6a84ab7328d8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:39.820284 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.network.security_group_api [None req-c151ffe9-3f12-44e0-a907-6a84ab7328d8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Adding security group bdb3818a-10eb-4ff6-a14f-edbcac8fcd1d to port c08af019-9f7a-4e7b-b096-b5471323483d Aug 27 05:39:40.136725 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c151ffe9-3f12-44e0-a907-6a84ab7328d8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "POST /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/action" status: 202 len: 0 microversion: 2.1 time: 0.460320 Aug 27 05:39:40.137354 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3786/7525] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:39:39 2022] POST /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:39:40.146415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b382a81-a7c7-457e-bce0-f18c9076461c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:39:40.146756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d11a4920-a5f4-4484-a6d3-6bc9133699ac req-dbbba6f2-cba9-4634-8ece-9ad30558b558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1a836a-2576-4e4b-b700-fb94ae487e41", "tag": "c08af019-9f7a-4e7b-b096-b5471323483d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:39:40.147369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b382a81-a7c7-457e-bce0-f18c9076461c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:39:40.155604 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b382a81-a7c7-457e-bce0-f18c9076461c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:40.156188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b382a81-a7c7-457e-bce0-f18c9076461c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:40.156692 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b382a81-a7c7-457e-bce0-f18c9076461c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:40.157438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b382a81-a7c7-457e-bce0-f18c9076461c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:40.158021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b382a81-a7c7-457e-bce0-f18c9076461c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:40.158843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b382a81-a7c7-457e-bce0-f18c9076461c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:40.161341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d11a4920-a5f4-4484-a6d3-6bc9133699ac req-dbbba6f2-cba9-4634-8ece-9ad30558b558 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:39:40.162122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d11a4920-a5f4-4484-a6d3-6bc9133699ac req-dbbba6f2-cba9-4634-8ece-9ad30558b558 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:39:40.162561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d11a4920-a5f4-4484-a6d3-6bc9133699ac req-dbbba6f2-cba9-4634-8ece-9ad30558b558 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:39:40.176490 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d11a4920-a5f4-4484-a6d3-6bc9133699ac req-dbbba6f2-cba9-4634-8ece-9ad30558b558 service nova] Creating event network-changed:c08af019-9f7a-4e7b-b096-b5471323483d for instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 on n-h1-854823-1 Aug 27 05:39:40.182581 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d11a4920-a5f4-4484-a6d3-6bc9133699ac req-dbbba6f2-cba9-4634-8ece-9ad30558b558 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041756 Aug 27 05:39:40.187525 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3740/7526] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:39:40.327236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b382a81-a7c7-457e-bce0-f18c9076461c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:39:40.336564 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b382a81-a7c7-457e-bce0-f18c9076461c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1759 microversion: 2.1 time: 0.194833 Aug 27 05:39:40.338040 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3787/7527] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:39:40 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1759 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:01.727370 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30b4270-6763-4864-8153-10d27fd192b5] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 05:42:01.728189 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2badfd4b-a808-402a-925c-31461d1cb878] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 05:42:01.728752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:01.729497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:01.731022 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:42:01.731170 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 05:42:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/action (ip 10.222.0.79) !!! Aug 27 05:42:01.732486 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:42:01.732713 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 05:42:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/action (ip 10.222.0.79) !!! Aug 27 05:42:01.739664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0095b979-f19d-4880-8a42-0225d31d66d1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:42:01.742031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0095b979-f19d-4880-8a42-0225d31d66d1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:01.751910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0095b979-f19d-4880-8a42-0225d31d66d1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:01.752416 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0095b979-f19d-4880-8a42-0225d31d66d1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:01.752881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0095b979-f19d-4880-8a42-0225d31d66d1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:01.753576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0095b979-f19d-4880-8a42-0225d31d66d1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:01.754043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0095b979-f19d-4880-8a42-0225d31d66d1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:01.754472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0095b979-f19d-4880-8a42-0225d31d66d1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:01.826906 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0095b979-f19d-4880-8a42-0225d31d66d1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "POST /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/action" status: 202 len: 0 microversion: 2.1 time: 0.101118 Aug 27 05:42:01.829980 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3741/7528] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:42:01 2022] POST /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:42:01.834072 n-d-854823-1 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c18b0a9-ed40-4090-a136-c7167e1677a5] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:42:01.835048 n-d-854823-1 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5167bf5-c65d-49e1-967f-4d4da9273246] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 05:42:01.835852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:01.836759 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=16 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:42:01.837633 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:42:01.837830 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:42:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 (ip 10.222.0.79) !!! Aug 27 05:42:01.839420 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:42:01.839571 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:42:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 (ip 10.222.0.79) !!! Aug 27 05:42:01.844717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1646d396-a659-4366-854f-3d29addc6216 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:01.845374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1646d396-a659-4366-854f-3d29addc6216 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:01.860680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1646d396-a659-4366-854f-3d29addc6216 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:01.861266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1646d396-a659-4366-854f-3d29addc6216 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:01.862368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1646d396-a659-4366-854f-3d29addc6216 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:01.863094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1646d396-a659-4366-854f-3d29addc6216 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:01.863560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1646d396-a659-4366-854f-3d29addc6216 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:01.864000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1646d396-a659-4366-854f-3d29addc6216 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:02.167135 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1646d396-a659-4366-854f-3d29addc6216 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:02.175649 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1646d396-a659-4366-854f-3d29addc6216 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1761 microversion: 2.1 time: 0.343559 Aug 27 05:42:02.176236 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3788/7529] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:01 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1761 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:42:03.199343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c60bf372-693d-43e4-aa3f-b78ce4af2eb6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:42:03.200056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c60bf372-693d-43e4-aa3f-b78ce4af2eb6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:42:03.208355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c60bf372-693d-43e4-aa3f-b78ce4af2eb6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:03.208935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c60bf372-693d-43e4-aa3f-b78ce4af2eb6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:03.209387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c60bf372-693d-43e4-aa3f-b78ce4af2eb6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:03.210153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c60bf372-693d-43e4-aa3f-b78ce4af2eb6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:42:03.210681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c60bf372-693d-43e4-aa3f-b78ce4af2eb6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:42:03.211135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c60bf372-693d-43e4-aa3f-b78ce4af2eb6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:42:03.218630 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] [2badfd4b-a808-402a-925c-31461d1cb878] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 43748. Aug 27 05:42:03.219363 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30b4270-6763-4864-8153-10d27fd192b5] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 43746. Aug 27 05:42:03.410497 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c60bf372-693d-43e4-aa3f-b78ce4af2eb6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:42:03.419599 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c60bf372-693d-43e4-aa3f-b78ce4af2eb6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1759 microversion: 2.1 time: 0.226143 Aug 27 05:42:03.420172 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3742/7530] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:42:03 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1759 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:43:34.726595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:43:34.727410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:43:34.733241 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6dc9cc2c-b8a5-4f13-afe3-720a14b8cc17 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-580202282"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:43:34.733737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6dc9cc2c-b8a5-4f13-afe3-720a14b8cc17 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:34.743076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc2c-b8a5-4f13-afe3-720a14b8cc17 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:34.743581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc2c-b8a5-4f13-afe3-720a14b8cc17 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:34.744034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc2c-b8a5-4f13-afe3-720a14b8cc17 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:34.744774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc2c-b8a5-4f13-afe3-720a14b8cc17 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:34.745252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc2c-b8a5-4f13-afe3-720a14b8cc17 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:34.745695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc2c-b8a5-4f13-afe3-720a14b8cc17 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:34.749484 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c18b0a9-ed40-4090-a136-c7167e1677a5] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 43792. Aug 27 05:43:34.750210 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5167bf5-c65d-49e1-967f-4d4da9273246] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 43794. Aug 27 05:43:34.881448 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.network.security_group_api [None req-6dc9cc2c-b8a5-4f13-afe3-720a14b8cc17 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Removing security group bdb3818a-10eb-4ff6-a14f-edbcac8fcd1d from port c08af019-9f7a-4e7b-b096-b5471323483d Aug 27 05:43:35.189210 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6dc9cc2c-b8a5-4f13-afe3-720a14b8cc17 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "POST /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/action" status: 202 len: 0 microversion: 2.1 time: 0.464989 Aug 27 05:43:35.193188 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3789/7531] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:43:34 2022] POST /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:43:35.195278 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:43:35.196424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:43:35.290723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ffc3a7e6-9491-4493-a8f3-52c2bf86a836 req-cdce2012-2e87-41fd-aa8f-01fbe567d005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1a836a-2576-4e4b-b700-fb94ae487e41", "tag": "c08af019-9f7a-4e7b-b096-b5471323483d"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:43:35.301298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ffc3a7e6-9491-4493-a8f3-52c2bf86a836 req-cdce2012-2e87-41fd-aa8f-01fbe567d005 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:35.302082 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ffc3a7e6-9491-4493-a8f3-52c2bf86a836 req-cdce2012-2e87-41fd-aa8f-01fbe567d005 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:35.302519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ffc3a7e6-9491-4493-a8f3-52c2bf86a836 req-cdce2012-2e87-41fd-aa8f-01fbe567d005 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:35.315099 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ffc3a7e6-9491-4493-a8f3-52c2bf86a836 req-cdce2012-2e87-41fd-aa8f-01fbe567d005 service nova] Creating event network-changed:c08af019-9f7a-4e7b-b096-b5471323483d for instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 on n-h1-854823-1 Aug 27 05:43:35.320324 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ffc3a7e6-9491-4493-a8f3-52c2bf86a836 req-cdce2012-2e87-41fd-aa8f-01fbe567d005 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126768 Aug 27 05:43:35.321218 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3743/7532] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:43:36.358923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a6949ae-fc5d-44c7-9e3f-8d5faf725809 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:36.359464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a6949ae-fc5d-44c7-9e3f-8d5faf725809 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:36.365663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a6949ae-fc5d-44c7-9e3f-8d5faf725809 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:36.366167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a6949ae-fc5d-44c7-9e3f-8d5faf725809 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:36.366621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a6949ae-fc5d-44c7-9e3f-8d5faf725809 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:36.367333 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a6949ae-fc5d-44c7-9e3f-8d5faf725809 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:36.367803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a6949ae-fc5d-44c7-9e3f-8d5faf725809 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:36.368447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a6949ae-fc5d-44c7-9e3f-8d5faf725809 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:36.455914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-0a6949ae-fc5d-44c7-9e3f-8d5faf725809 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lazy-loading 'services' on Instance uuid 1a1a836a-2576-4e4b-b700-fb94ae487e41 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:43:36.538349 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a6949ae-fc5d-44c7-9e3f-8d5faf725809 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments/84d8e7ee-352e-4316-a19f-8d4a31dbe812" status: 202 len: 0 microversion: 2.1 time: 0.184166 Aug 27 05:43:36.539083 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3790/7533] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:43:36 2022] DELETE /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments/84d8e7ee-352e-4316-a19f-8d4a31dbe812 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:43:36.548877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-85441141-8ca1-488e-ba63-e31fadbb771f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:36.551384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-85441141-8ca1-488e-ba63-e31fadbb771f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:36.559157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85441141-8ca1-488e-ba63-e31fadbb771f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:36.560614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85441141-8ca1-488e-ba63-e31fadbb771f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:36.561655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85441141-8ca1-488e-ba63-e31fadbb771f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:36.562611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85441141-8ca1-488e-ba63-e31fadbb771f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:36.563085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85441141-8ca1-488e-ba63-e31fadbb771f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:36.563584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-85441141-8ca1-488e-ba63-e31fadbb771f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:36.608372 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-85441141-8ca1-488e-ba63-e31fadbb771f tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064470 Aug 27 05:43:36.612566 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3744/7534] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:43:36 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:43:37.339075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e37ed49b-91e1-497f-8cb6-8eaf1a06e57f req-06ae4f77-9e3b-4c75-86b8-5b0ac96fde99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1a836a-2576-4e4b-b700-fb94ae487e41", "tag": "c08af019-9f7a-4e7b-b096-b5471323483d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:43:37.349918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e37ed49b-91e1-497f-8cb6-8eaf1a06e57f req-06ae4f77-9e3b-4c75-86b8-5b0ac96fde99 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:37.350448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e37ed49b-91e1-497f-8cb6-8eaf1a06e57f req-06ae4f77-9e3b-4c75-86b8-5b0ac96fde99 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:37.350898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e37ed49b-91e1-497f-8cb6-8eaf1a06e57f req-06ae4f77-9e3b-4c75-86b8-5b0ac96fde99 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:37.362589 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e37ed49b-91e1-497f-8cb6-8eaf1a06e57f req-06ae4f77-9e3b-4c75-86b8-5b0ac96fde99 service nova] Creating event network-changed:c08af019-9f7a-4e7b-b096-b5471323483d for instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 on n-h1-854823-1 Aug 27 05:43:37.367493 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e37ed49b-91e1-497f-8cb6-8eaf1a06e57f req-06ae4f77-9e3b-4c75-86b8-5b0ac96fde99 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032667 Aug 27 05:43:37.368110 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3791/7535] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:43:37.628040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f06545b0-f6f0-4a0a-bfb4-ea529329f531 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:37.631785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f06545b0-f6f0-4a0a-bfb4-ea529329f531 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:37.641562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f06545b0-f6f0-4a0a-bfb4-ea529329f531 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:37.642046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f06545b0-f6f0-4a0a-bfb4-ea529329f531 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:37.642480 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f06545b0-f6f0-4a0a-bfb4-ea529329f531 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:37.643179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f06545b0-f6f0-4a0a-bfb4-ea529329f531 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:37.643630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f06545b0-f6f0-4a0a-bfb4-ea529329f531 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:37.644050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f06545b0-f6f0-4a0a-bfb4-ea529329f531 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:37.678679 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f06545b0-f6f0-4a0a-bfb4-ea529329f531 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059100 Aug 27 05:43:37.679275 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3745/7536] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:43:37 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:43:38.693531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f8f80fb-7a5c-488f-bf8f-0c375894e10b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:38.695826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f8f80fb-7a5c-488f-bf8f-0c375894e10b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:38.702500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f8f80fb-7a5c-488f-bf8f-0c375894e10b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:38.703014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f8f80fb-7a5c-488f-bf8f-0c375894e10b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:38.703471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f8f80fb-7a5c-488f-bf8f-0c375894e10b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:38.704204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f8f80fb-7a5c-488f-bf8f-0c375894e10b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:38.704714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f8f80fb-7a5c-488f-bf8f-0c375894e10b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:38.705161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f8f80fb-7a5c-488f-bf8f-0c375894e10b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:38.736625 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f8f80fb-7a5c-488f-bf8f-0c375894e10b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048432 Aug 27 05:43:38.737244 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3792/7537] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:43:38 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:43:39.749751 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-37cc5517-1bde-4fec-81cd-1bf5cba7855e tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:39.752047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-37cc5517-1bde-4fec-81cd-1bf5cba7855e tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:39.758940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37cc5517-1bde-4fec-81cd-1bf5cba7855e tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:39.759419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37cc5517-1bde-4fec-81cd-1bf5cba7855e tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:39.759850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37cc5517-1bde-4fec-81cd-1bf5cba7855e tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:39.760555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37cc5517-1bde-4fec-81cd-1bf5cba7855e tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:39.761013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37cc5517-1bde-4fec-81cd-1bf5cba7855e tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:39.761433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-37cc5517-1bde-4fec-81cd-1bf5cba7855e tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:39.790932 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-37cc5517-1bde-4fec-81cd-1bf5cba7855e tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045940 Aug 27 05:43:39.791494 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3746/7538] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:43:39 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:43:40.803709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b1d96da-f3cd-4dae-b770-27a332466938 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:40.806657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b1d96da-f3cd-4dae-b770-27a332466938 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:40.814385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b1d96da-f3cd-4dae-b770-27a332466938 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:40.814914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b1d96da-f3cd-4dae-b770-27a332466938 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:40.815365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b1d96da-f3cd-4dae-b770-27a332466938 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:40.816075 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b1d96da-f3cd-4dae-b770-27a332466938 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:40.816570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b1d96da-f3cd-4dae-b770-27a332466938 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:40.817011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b1d96da-f3cd-4dae-b770-27a332466938 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:40.847462 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b1d96da-f3cd-4dae-b770-27a332466938 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047878 Aug 27 05:43:40.848049 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3793/7539] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:43:40 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:43:41.859823 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aa35a86b-4a18-4074-8cce-895f6c26b795 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:41.862087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aa35a86b-4a18-4074-8cce-895f6c26b795 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:41.869661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa35a86b-4a18-4074-8cce-895f6c26b795 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:41.870155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa35a86b-4a18-4074-8cce-895f6c26b795 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:41.870597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa35a86b-4a18-4074-8cce-895f6c26b795 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:41.871297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa35a86b-4a18-4074-8cce-895f6c26b795 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:41.871755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa35a86b-4a18-4074-8cce-895f6c26b795 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:41.872183 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa35a86b-4a18-4074-8cce-895f6c26b795 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:41.901846 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aa35a86b-4a18-4074-8cce-895f6c26b795 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046155 Aug 27 05:43:41.902432 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3747/7540] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:43:41 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:43:41.914052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6038d01-f938-42ed-9c29-19df5c716a3a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:41.914553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6038d01-f938-42ed-9c29-19df5c716a3a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:41.917490 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:43:41.917635 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:43:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments/84d8e7ee-352e-4316-a19f-8d4a31dbe812 (ip 10.222.0.79) !!! Aug 27 05:43:41.931028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6038d01-f938-42ed-9c29-19df5c716a3a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:41.931531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6038d01-f938-42ed-9c29-19df5c716a3a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:41.931984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6038d01-f938-42ed-9c29-19df5c716a3a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:41.932730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6038d01-f938-42ed-9c29-19df5c716a3a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:41.933203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6038d01-f938-42ed-9c29-19df5c716a3a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:41.933645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6038d01-f938-42ed-9c29-19df5c716a3a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:42.008001 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f6038d01-f938-42ed-9c29-19df5c716a3a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] HTTP exception thrown: Instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 is not attached to volume 84d8e7ee-352e-4316-a19f-8d4a31dbe812 Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6038d01-f938-42ed-9c29-19df5c716a3a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Request method failure captured: Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments/84d8e7ee-352e-4316-a19f-8d4a31dbe812 HTTP/1.1 Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCa3kl5AqRFH5rLHgVjoZ2eCiY6duwGSzGp14HqdlhnSqULpw19ux3uxZ7x8t_MmlMve-HHqSZL-I8cRl_nvB87MKHrEdcBbKMyT2uQZxuD0DZBGvWvjyiXkccZxYN_nOlqit4qhsZqovz_e2OHmc5MOG1lDmpUgwXCWxF5xOXYS4MmU Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cd7f3f400b144f5ca7ac796123a2206b Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestMinimumBasicScenario-1835637884 Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestMinimumBasicScenario-1835637884 Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cd7f3f400b144f5ca7ac796123a2206b Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1835637884 Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestMinimumBasicScenario-1835637884-project Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: bd902c0afe40463f839abcecb4e39440 Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestMinimumBasicScenario-1835637884-project Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 is not attached to volume 84d8e7ee-352e-4316-a19f-8d4a31dbe812 Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'server_id': '1a1a836a-2576-4e4b-b700-fb94ae487e41', 'id': '84d8e7ee-352e-4316-a19f-8d4a31dbe812'} Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 84d8e7ee-352e-4316-a19f-8d4a31dbe812. Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 is not attached to volume 84d8e7ee-352e-4316-a19f-8d4a31dbe812 Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:43:42.009728 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:43:42.015157 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:43:42.015157 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:43:42.015157 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 is not attached to volume 84d8e7ee-352e-4316-a19f-8d4a31dbe812 Aug 27 05:43:42.015157 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:43:42.015157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6038d01-f938-42ed-9c29-19df5c716a3a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Returning 404 to user: Instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 is not attached to volume 84d8e7ee-352e-4316-a19f-8d4a31dbe812 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:43:42.015157 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6038d01-f938-42ed-9c29-19df5c716a3a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments/84d8e7ee-352e-4316-a19f-8d4a31dbe812" status: 404 len: 154 microversion: 2.1 time: 0.101246 Aug 27 05:43:42.015157 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3794/7541] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:43:41 2022] DELETE /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41/os-volume_attachments/84d8e7ee-352e-4316-a19f-8d4a31dbe812 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:43:45.263878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5bedbede-fb7b-45dc-a031-faef11a4c733 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:45.264421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5bedbede-fb7b-45dc-a031-faef11a4c733 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:45.271464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bedbede-fb7b-45dc-a031-faef11a4c733 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:45.271953 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bedbede-fb7b-45dc-a031-faef11a4c733 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:45.272396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bedbede-fb7b-45dc-a031-faef11a4c733 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:45.273134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bedbede-fb7b-45dc-a031-faef11a4c733 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:45.273590 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bedbede-fb7b-45dc-a031-faef11a4c733 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:45.274019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bedbede-fb7b-45dc-a031-faef11a4c733 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:45.299661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5bedbede-fb7b-45dc-a031-faef11a4c733 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:43:45.386104 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5bedbede-fb7b-45dc-a031-faef11a4c733 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 204 len: 0 microversion: 2.1 time: 0.126215 Aug 27 05:43:45.387209 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3748/7542] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:43:45 2022] DELETE /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:43:45.396401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b95072c6-bbb7-4ff3-9516-fc0ba3fdd4fa tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:45.397233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b95072c6-bbb7-4ff3-9516-fc0ba3fdd4fa tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:45.406005 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b95072c6-bbb7-4ff3-9516-fc0ba3fdd4fa tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:45.406611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b95072c6-bbb7-4ff3-9516-fc0ba3fdd4fa tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:45.407137 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b95072c6-bbb7-4ff3-9516-fc0ba3fdd4fa tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:45.407934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b95072c6-bbb7-4ff3-9516-fc0ba3fdd4fa tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:45.408501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b95072c6-bbb7-4ff3-9516-fc0ba3fdd4fa tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:45.409007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b95072c6-bbb7-4ff3-9516-fc0ba3fdd4fa tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:45.546378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b95072c6-bbb7-4ff3-9516-fc0ba3fdd4fa tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:43:45.554186 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b95072c6-bbb7-4ff3-9516-fc0ba3fdd4fa tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1555 microversion: 2.1 time: 0.161900 Aug 27 05:43:45.554754 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3795/7543] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:43:45 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:43:46.577750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4200dd16-1be7-4bc0-bff2-c24063229164 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:46.578467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4200dd16-1be7-4bc0-bff2-c24063229164 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:46.586056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4200dd16-1be7-4bc0-bff2-c24063229164 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:46.586549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4200dd16-1be7-4bc0-bff2-c24063229164 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:46.586989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4200dd16-1be7-4bc0-bff2-c24063229164 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:46.587691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4200dd16-1be7-4bc0-bff2-c24063229164 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:46.588149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4200dd16-1be7-4bc0-bff2-c24063229164 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:46.588607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4200dd16-1be7-4bc0-bff2-c24063229164 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:46.721828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4200dd16-1be7-4bc0-bff2-c24063229164 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:43:46.729555 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4200dd16-1be7-4bc0-bff2-c24063229164 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1555 microversion: 2.1 time: 0.156868 Aug 27 05:43:46.730140 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3749/7544] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:43:46 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:43:47.645592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-786f2237-7d49-4197-8bad-17a953560199 req-567fcf89-be8b-4c0e-940e-c1af1a762f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1a836a-2576-4e4b-b700-fb94ae487e41", "name": "network-vif-deleted", "tag": "c08af019-9f7a-4e7b-b096-b5471323483d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:43:47.657019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-786f2237-7d49-4197-8bad-17a953560199 req-567fcf89-be8b-4c0e-940e-c1af1a762f8b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:47.657438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-786f2237-7d49-4197-8bad-17a953560199 req-567fcf89-be8b-4c0e-940e-c1af1a762f8b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:47.657946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-786f2237-7d49-4197-8bad-17a953560199 req-567fcf89-be8b-4c0e-940e-c1af1a762f8b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:47.670403 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-786f2237-7d49-4197-8bad-17a953560199 req-567fcf89-be8b-4c0e-940e-c1af1a762f8b service nova] Creating event network-vif-deleted:c08af019-9f7a-4e7b-b096-b5471323483d for instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 on n-h1-854823-1 Aug 27 05:43:47.675492 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-786f2237-7d49-4197-8bad-17a953560199 req-567fcf89-be8b-4c0e-940e-c1af1a762f8b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108685 Aug 27 05:43:47.676116 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3796/7545] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:43:47.749613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5ceb1848-ffbe-4389-971d-739cd69a9eb3 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:47.750223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5ceb1848-ffbe-4389-971d-739cd69a9eb3 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:47.757428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ceb1848-ffbe-4389-971d-739cd69a9eb3 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:47.757916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ceb1848-ffbe-4389-971d-739cd69a9eb3 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:47.758358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ceb1848-ffbe-4389-971d-739cd69a9eb3 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:47.759053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ceb1848-ffbe-4389-971d-739cd69a9eb3 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:47.759507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ceb1848-ffbe-4389-971d-739cd69a9eb3 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:47.759935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ceb1848-ffbe-4389-971d-739cd69a9eb3 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:47.791854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ceb1848-ffbe-4389-971d-739cd69a9eb3 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:47.792265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ceb1848-ffbe-4389-971d-739cd69a9eb3 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:47.792740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5ceb1848-ffbe-4389-971d-739cd69a9eb3 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:47.793190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-5ceb1848-ffbe-4389-971d-739cd69a9eb3 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lazy-loading 'fault' on Instance uuid 1a1a836a-2576-4e4b-b700-fb94ae487e41 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:43:47.837014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5ceb1848-ffbe-4389-971d-739cd69a9eb3 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:43:47.845543 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5ceb1848-ffbe-4389-971d-739cd69a9eb3 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 200 len: 1348 microversion: 2.1 time: 0.099766 Aug 27 05:43:47.846132 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3750/7546] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:43:47 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:43:48.868099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b54caad1-e12d-4b49-be7d-becf4e64b9ff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:48.869205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b54caad1-e12d-4b49-be7d-becf4e64b9ff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: 1a1a836a-2576-4e4b-b700-fb94ae487e41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:48.876329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54caad1-e12d-4b49-be7d-becf4e64b9ff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:48.876855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54caad1-e12d-4b49-be7d-becf4e64b9ff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:48.877309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54caad1-e12d-4b49-be7d-becf4e64b9ff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:48.878024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54caad1-e12d-4b49-be7d-becf4e64b9ff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:48.878494 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54caad1-e12d-4b49-be7d-becf4e64b9ff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:48.878964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54caad1-e12d-4b49-be7d-becf4e64b9ff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:48.893834 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b54caad1-e12d-4b49-be7d-becf4e64b9ff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] HTTP exception thrown: Instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 could not be found. Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b54caad1-e12d-4b49-be7d-becf4e64b9ff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Request method failure captured: Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 HTTP/1.1 Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCa3kl5AqRFH5rLHgVjoZ2eCiY6duwGSzGp14HqdlhnSqULpw19ux3uxZ7x8t_MmlMve-HHqSZL-I8cRl_nvB87MKHrEdcBbKMyT2uQZxuD0DZBGvWvjyiXkccZxYN_nOlqit4qhsZqovz_e2OHmc5MOG1lDmpUgwXCWxF5xOXYS4MmU Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cd7f3f400b144f5ca7ac796123a2206b Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestMinimumBasicScenario-1835637884 Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestMinimumBasicScenario-1835637884 Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cd7f3f400b144f5ca7ac796123a2206b Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1835637884 Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestMinimumBasicScenario-1835637884-project Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: bd902c0afe40463f839abcecb4e39440 Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestMinimumBasicScenario-1835637884-project Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 could not be found. Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '1a1a836a-2576-4e4b-b700-fb94ae487e41'} Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 could not be found. Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 could not be found. Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:43:48.895493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:43:48.900600 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:43:48.900600 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:43:48.900600 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:43:48.900600 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:43:48.900600 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:43:48.900600 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 could not be found. Aug 27 05:43:48.900600 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:43:48.900600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b54caad1-e12d-4b49-be7d-becf4e64b9ff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Returning 404 to user: Instance 1a1a836a-2576-4e4b-b700-fb94ae487e41 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:43:48.900600 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b54caad1-e12d-4b49-be7d-becf4e64b9ff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41" status: 404 len: 111 microversion: 2.1 time: 0.033951 Aug 27 05:43:48.901472 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3797/7547] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:43:48 2022] GET /compute/v2.1/servers/1a1a836a-2576-4e4b-b700-fb94ae487e41 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:43:48.906105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6fc11e85-25ad-46f2-bde4-6afa9b1b30f9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '.version_select at 0x7f1f207e8b80>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:48.931509 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6fc11e85-25ad-46f2-bde4-6afa9b1b30f9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-704468500" status: 202 len: 0 microversion: 2.1 time: 0.029545 Aug 27 05:43:48.932107 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3751/7548] 10.222.0.79 () {58 vars in 1269 bytes} [Sat Aug 27 05:43:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-704468500 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:43:58.086179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47ae7dc2-24c7-46e9-ab9a-e0edcdcbf154 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Action: 'create', calling method: .version_select at 0x7f1f2042fa60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1663136270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYk1OuWaRtifLoiPnfrVI5EsYhPwXTjWGUx/RV8eu0fBwG2qqRL5jvjmbo39jO7ZyX4jWJKYJYitRE2PokTgWblCAcMB7Y2b0qiCxas+HKDSYKsHlQbKI7UCuwZXyGxMA=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:43:58.109837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-47ae7dc2-24c7-46e9-ab9a-e0edcdcbf154 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Getting quotas for project cd7f3f400b144f5ca7ac796123a2206b. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:43:58.116293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-47ae7dc2-24c7-46e9-ab9a-e0edcdcbf154 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Getting quotas for user bd902c0afe40463f839abcecb4e39440 and project cd7f3f400b144f5ca7ac796123a2206b. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:43:58.145298 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47ae7dc2-24c7-46e9-ab9a-e0edcdcbf154 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062931 Aug 27 05:43:58.145920 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3798/7549] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:43:58 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:43:58.195501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:43:58.199773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1337203937", "imageRef": "841c2a6b-0505-437f-9f7e-ad9fa0a506fe", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1663136270", "networks": [{"uuid": "1042a420-1cb9-451a-828a-4e1f6849f642"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:43:58.255003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] validate_networks() for [('1042a420-1cb9-451a-828a-4e1f6849f642', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:43:58.970629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:43:58.971079 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:43:58.971553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:43:58.971964 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:43:58.972376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:43:58.981211 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:58.981697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:58.982280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:58.983153 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:43:58.983611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:43:58.984039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:43:59.003889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Getting quotas for project cd7f3f400b144f5ca7ac796123a2206b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:43:59.009331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Getting quotas for user bd902c0afe40463f839abcecb4e39440 and project cd7f3f400b144f5ca7ac796123a2206b. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:43:59.022409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:43:59.024656 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='841c2a6b-0505-437f-9f7e-ad9fa0a506fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:43:59.071765 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-96fe637d-9482-4aa3-9493-dc5e4ce38781 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.878006 Aug 27 05:43:59.072500 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3752/7550] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:43:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:43:59.080643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:43:59.084740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd853b01-f0cf-4114-8579-107421daab1d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:43:59.085378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd853b01-f0cf-4114-8579-107421daab1d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:43:59.143027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bd853b01-f0cf-4114-8579-107421daab1d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:43:59.150100 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd853b01-f0cf-4114-8579-107421daab1d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1259 microversion: 2.1 time: 0.070289 Aug 27 05:43:59.150682 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3799/7551] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:43:59 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:00.173397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3df2ecf0-774f-48b3-9807-50c4c4f40875 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:00.175215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3df2ecf0-774f-48b3-9807-50c4c4f40875 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:00.183549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3df2ecf0-774f-48b3-9807-50c4c4f40875 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:00.184048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3df2ecf0-774f-48b3-9807-50c4c4f40875 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:00.185001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3df2ecf0-774f-48b3-9807-50c4c4f40875 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:00.185725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3df2ecf0-774f-48b3-9807-50c4c4f40875 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:00.186186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3df2ecf0-774f-48b3-9807-50c4c4f40875 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:00.187419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3df2ecf0-774f-48b3-9807-50c4c4f40875 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:00.271662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3df2ecf0-774f-48b3-9807-50c4c4f40875 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:00.279470 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3df2ecf0-774f-48b3-9807-50c4c4f40875 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1329 microversion: 2.1 time: 0.111696 Aug 27 05:44:00.280307 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3753/7552] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:00 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1329 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:01.302253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aadb3ff6-470a-47b0-991b-33726530f96a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:01.303445 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aadb3ff6-470a-47b0-991b-33726530f96a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:01.311929 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aadb3ff6-470a-47b0-991b-33726530f96a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:01.312436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aadb3ff6-470a-47b0-991b-33726530f96a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:01.313064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aadb3ff6-470a-47b0-991b-33726530f96a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:01.313819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aadb3ff6-470a-47b0-991b-33726530f96a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:01.314285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aadb3ff6-470a-47b0-991b-33726530f96a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:01.314721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aadb3ff6-470a-47b0-991b-33726530f96a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:01.458632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aadb3ff6-470a-47b0-991b-33726530f96a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:01.469692 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aadb3ff6-470a-47b0-991b-33726530f96a tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.169329 Aug 27 05:44:01.469692 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3800/7553] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:01 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:02.489558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2b11da6a-4645-41d6-9f7b-e3efadb71a18 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:02.490180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2b11da6a-4645-41d6-9f7b-e3efadb71a18 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:02.497856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b11da6a-4645-41d6-9f7b-e3efadb71a18 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:02.498317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b11da6a-4645-41d6-9f7b-e3efadb71a18 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:02.498936 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b11da6a-4645-41d6-9f7b-e3efadb71a18 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:02.499799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b11da6a-4645-41d6-9f7b-e3efadb71a18 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:02.500419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b11da6a-4645-41d6-9f7b-e3efadb71a18 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:02.500927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b11da6a-4645-41d6-9f7b-e3efadb71a18 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:02.649168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2b11da6a-4645-41d6-9f7b-e3efadb71a18 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:02.657920 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2b11da6a-4645-41d6-9f7b-e3efadb71a18 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.172641 Aug 27 05:44:02.660568 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3754/7554] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:02 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:03.679300 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31673844-ecb2-4d9c-903c-6ca65664eedb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:03.679984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31673844-ecb2-4d9c-903c-6ca65664eedb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:03.693317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31673844-ecb2-4d9c-903c-6ca65664eedb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:03.694317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31673844-ecb2-4d9c-903c-6ca65664eedb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:03.695146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31673844-ecb2-4d9c-903c-6ca65664eedb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:03.695887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31673844-ecb2-4d9c-903c-6ca65664eedb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:03.696362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31673844-ecb2-4d9c-903c-6ca65664eedb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:03.696828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31673844-ecb2-4d9c-903c-6ca65664eedb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:03.840224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31673844-ecb2-4d9c-903c-6ca65664eedb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:03.848431 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31673844-ecb2-4d9c-903c-6ca65664eedb tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.173183 Aug 27 05:44:03.849064 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3801/7555] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:03 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:04.869567 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-846e3080-340d-43e8-9e0c-f90d8ab2b139 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:04.870295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-846e3080-340d-43e8-9e0c-f90d8ab2b139 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:04.876895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-846e3080-340d-43e8-9e0c-f90d8ab2b139 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:04.877388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-846e3080-340d-43e8-9e0c-f90d8ab2b139 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:04.877830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-846e3080-340d-43e8-9e0c-f90d8ab2b139 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:04.878536 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-846e3080-340d-43e8-9e0c-f90d8ab2b139 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:04.878999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-846e3080-340d-43e8-9e0c-f90d8ab2b139 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:04.879428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-846e3080-340d-43e8-9e0c-f90d8ab2b139 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:05.017355 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-846e3080-340d-43e8-9e0c-f90d8ab2b139 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:05.025387 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-846e3080-340d-43e8-9e0c-f90d8ab2b139 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.159668 Aug 27 05:44:05.025987 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3755/7556] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:04 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:06.047786 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-916010ed-e0e4-4531-aa1b-0392453dd0df tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:06.048418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-916010ed-e0e4-4531-aa1b-0392453dd0df tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:06.050641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:44:06.056128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-916010ed-e0e4-4531-aa1b-0392453dd0df tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:06.056676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-916010ed-e0e4-4531-aa1b-0392453dd0df tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:06.057139 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-916010ed-e0e4-4531-aa1b-0392453dd0df tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:06.057867 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-916010ed-e0e4-4531-aa1b-0392453dd0df tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:06.058344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-916010ed-e0e4-4531-aa1b-0392453dd0df tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:06.058797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-916010ed-e0e4-4531-aa1b-0392453dd0df tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:06.202469 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-916010ed-e0e4-4531-aa1b-0392453dd0df tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:06.211012 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-916010ed-e0e4-4531-aa1b-0392453dd0df tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.167768 Aug 27 05:44:06.211569 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3802/7557] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:06 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:07.231881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-990855d0-5db9-45ea-a17c-bd36b22d8cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:07.232731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-990855d0-5db9-45ea-a17c-bd36b22d8cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:07.235622 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:44:07.242032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-990855d0-5db9-45ea-a17c-bd36b22d8cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:07.242614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-990855d0-5db9-45ea-a17c-bd36b22d8cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:07.243312 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-990855d0-5db9-45ea-a17c-bd36b22d8cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:07.244128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-990855d0-5db9-45ea-a17c-bd36b22d8cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:07.244685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-990855d0-5db9-45ea-a17c-bd36b22d8cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:07.245181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-990855d0-5db9-45ea-a17c-bd36b22d8cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:07.409865 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-990855d0-5db9-45ea-a17c-bd36b22d8cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:07.417918 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-990855d0-5db9-45ea-a17c-bd36b22d8cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.190390 Aug 27 05:44:07.429958 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3756/7558] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:07 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:08.438461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-41ffc2ca-a538-4b20-a546-0996849c32ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:08.439085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41ffc2ca-a538-4b20-a546-0996849c32ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:08.446037 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ffc2ca-a538-4b20-a546-0996849c32ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:08.446530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ffc2ca-a538-4b20-a546-0996849c32ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:08.446975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ffc2ca-a538-4b20-a546-0996849c32ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:08.447677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ffc2ca-a538-4b20-a546-0996849c32ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:08.448142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ffc2ca-a538-4b20-a546-0996849c32ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:08.448612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ffc2ca-a538-4b20-a546-0996849c32ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:08.579027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-41ffc2ca-a538-4b20-a546-0996849c32ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:08.586789 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-41ffc2ca-a538-4b20-a546-0996849c32ae tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.152344 Aug 27 05:44:08.587362 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3803/7559] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:08 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:09.608088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2b2c71f9-a5a8-4381-a33f-e75205245aff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:09.608748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2b2c71f9-a5a8-4381-a33f-e75205245aff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:09.611472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:44:09.612145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:44:09.618074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b2c71f9-a5a8-4381-a33f-e75205245aff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:09.618564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b2c71f9-a5a8-4381-a33f-e75205245aff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:09.619006 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b2c71f9-a5a8-4381-a33f-e75205245aff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:09.619707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b2c71f9-a5a8-4381-a33f-e75205245aff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:09.620168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b2c71f9-a5a8-4381-a33f-e75205245aff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:09.620628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2b2c71f9-a5a8-4381-a33f-e75205245aff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:09.748612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2b2c71f9-a5a8-4381-a33f-e75205245aff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:09.756357 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2b2c71f9-a5a8-4381-a33f-e75205245aff tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.152247 Aug 27 05:44:09.756972 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3757/7560] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:09 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:10.778886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-295f5211-13d9-4f6c-9708-ba36d195b8fe tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:10.779590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-295f5211-13d9-4f6c-9708-ba36d195b8fe tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:10.781714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:44:10.788334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-295f5211-13d9-4f6c-9708-ba36d195b8fe tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:10.788873 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-295f5211-13d9-4f6c-9708-ba36d195b8fe tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:10.789328 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-295f5211-13d9-4f6c-9708-ba36d195b8fe tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:10.790045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-295f5211-13d9-4f6c-9708-ba36d195b8fe tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:10.790520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-295f5211-13d9-4f6c-9708-ba36d195b8fe tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:10.790968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-295f5211-13d9-4f6c-9708-ba36d195b8fe tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:10.923362 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-295f5211-13d9-4f6c-9708-ba36d195b8fe tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:10.931152 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-295f5211-13d9-4f6c-9708-ba36d195b8fe tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.156756 Aug 27 05:44:10.931732 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3804/7561] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:10 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:11.951818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0bbba702-7195-4998-9848-f1e1a66e4f79 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:11.952438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0bbba702-7195-4998-9848-f1e1a66e4f79 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:11.959884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbba702-7195-4998-9848-f1e1a66e4f79 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:11.960376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbba702-7195-4998-9848-f1e1a66e4f79 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:11.960836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbba702-7195-4998-9848-f1e1a66e4f79 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:11.961538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbba702-7195-4998-9848-f1e1a66e4f79 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:11.961998 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbba702-7195-4998-9848-f1e1a66e4f79 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:11.962422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0bbba702-7195-4998-9848-f1e1a66e4f79 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:12.066769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0689cfce-af65-4ed1-b3da-3af5510f9da4 req-23bddc7a-0ca0-4dc9-b8f2-bbda367887f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4b495f-4cdf-4e10-87fa-8c48545d7810", "tag": "e6738163-d0c6-418a-9584-fce9014a8a31"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:44:12.078989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0689cfce-af65-4ed1-b3da-3af5510f9da4 req-23bddc7a-0ca0-4dc9-b8f2-bbda367887f1 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:12.079584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0689cfce-af65-4ed1-b3da-3af5510f9da4 req-23bddc7a-0ca0-4dc9-b8f2-bbda367887f1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:12.080126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0689cfce-af65-4ed1-b3da-3af5510f9da4 req-23bddc7a-0ca0-4dc9-b8f2-bbda367887f1 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:12.091364 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0689cfce-af65-4ed1-b3da-3af5510f9da4 req-23bddc7a-0ca0-4dc9-b8f2-bbda367887f1 service nova] Creating event network-changed:e6738163-d0c6-418a-9584-fce9014a8a31 for instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 on n-h1-854823-1 Aug 27 05:44:12.096697 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0689cfce-af65-4ed1-b3da-3af5510f9da4 req-23bddc7a-0ca0-4dc9-b8f2-bbda367887f1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033731 Aug 27 05:44:12.097317 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3805/7562] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:44:12.256166 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0bbba702-7195-4998-9848-f1e1a66e4f79 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:12.264650 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0bbba702-7195-4998-9848-f1e1a66e4f79 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.317264 Aug 27 05:44:12.265224 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3758/7563] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:11 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:13.286051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f190453-8336-446c-9398-28bbf35422f2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:13.286787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f190453-8336-446c-9398-28bbf35422f2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:13.294285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f190453-8336-446c-9398-28bbf35422f2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:13.294782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f190453-8336-446c-9398-28bbf35422f2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:13.295220 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f190453-8336-446c-9398-28bbf35422f2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:13.295916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f190453-8336-446c-9398-28bbf35422f2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:13.296380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f190453-8336-446c-9398-28bbf35422f2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:13.296891 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f190453-8336-446c-9398-28bbf35422f2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:13.428720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f190453-8336-446c-9398-28bbf35422f2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:13.437354 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f190453-8336-446c-9398-28bbf35422f2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.155578 Aug 27 05:44:13.437941 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3806/7564] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:13 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:14.458139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7259e282-9a3f-4381-88ea-838d5b8dc285 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:14.458761 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7259e282-9a3f-4381-88ea-838d5b8dc285 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:14.466131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7259e282-9a3f-4381-88ea-838d5b8dc285 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:14.466724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7259e282-9a3f-4381-88ea-838d5b8dc285 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:14.467048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7259e282-9a3f-4381-88ea-838d5b8dc285 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:14.467745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7259e282-9a3f-4381-88ea-838d5b8dc285 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:14.468206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7259e282-9a3f-4381-88ea-838d5b8dc285 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:14.468715 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7259e282-9a3f-4381-88ea-838d5b8dc285 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:14.682143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7259e282-9a3f-4381-88ea-838d5b8dc285 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:14.690118 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7259e282-9a3f-4381-88ea-838d5b8dc285 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.235857 Aug 27 05:44:14.690840 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3759/7565] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:14 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:15.711541 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cd827910-f27a-4e10-ab61-ff824a84bcc4 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:15.712174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cd827910-f27a-4e10-ab61-ff824a84bcc4 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:15.719945 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd827910-f27a-4e10-ab61-ff824a84bcc4 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:15.720421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd827910-f27a-4e10-ab61-ff824a84bcc4 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:15.720908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd827910-f27a-4e10-ab61-ff824a84bcc4 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:15.721637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd827910-f27a-4e10-ab61-ff824a84bcc4 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:15.722103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd827910-f27a-4e10-ab61-ff824a84bcc4 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:15.722536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd827910-f27a-4e10-ab61-ff824a84bcc4 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:15.851303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cd827910-f27a-4e10-ab61-ff824a84bcc4 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:15.860152 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cd827910-f27a-4e10-ab61-ff824a84bcc4 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.152568 Aug 27 05:44:15.860768 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3807/7566] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:15 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:16.881129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e506268c-d34d-4856-98b0-d945e6a2b6bf tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:16.881722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e506268c-d34d-4856-98b0-d945e6a2b6bf tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:16.889281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e506268c-d34d-4856-98b0-d945e6a2b6bf tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:16.889764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e506268c-d34d-4856-98b0-d945e6a2b6bf tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:16.890202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e506268c-d34d-4856-98b0-d945e6a2b6bf tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:16.890897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e506268c-d34d-4856-98b0-d945e6a2b6bf tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:16.891348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e506268c-d34d-4856-98b0-d945e6a2b6bf tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:16.891764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e506268c-d34d-4856-98b0-d945e6a2b6bf tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:17.021639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e506268c-d34d-4856-98b0-d945e6a2b6bf tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:17.030000 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e506268c-d34d-4856-98b0-d945e6a2b6bf tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.152707 Aug 27 05:44:17.030845 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3760/7567] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:16 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:18.051066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbb3e36a-32ba-470a-b5ba-c81f205d8780 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:18.051693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dbb3e36a-32ba-470a-b5ba-c81f205d8780 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:18.058550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbb3e36a-32ba-470a-b5ba-c81f205d8780 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:18.059048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbb3e36a-32ba-470a-b5ba-c81f205d8780 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:18.059520 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbb3e36a-32ba-470a-b5ba-c81f205d8780 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:18.060749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbb3e36a-32ba-470a-b5ba-c81f205d8780 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:18.061223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbb3e36a-32ba-470a-b5ba-c81f205d8780 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:18.061661 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbb3e36a-32ba-470a-b5ba-c81f205d8780 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:18.196065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dbb3e36a-32ba-470a-b5ba-c81f205d8780 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:18.204452 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbb3e36a-32ba-470a-b5ba-c81f205d8780 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.157386 Aug 27 05:44:18.205059 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3808/7568] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:18 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:18.546746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-45a30e39-8bb2-4a46-947c-0366d28fcd78 req-967d45e5-6d4e-4bcb-84c4-791adf8e2c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4b495f-4cdf-4e10-87fa-8c48545d7810", "name": "network-vif-plugged", "status": "completed", "tag": "e6738163-d0c6-418a-9584-fce9014a8a31"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:44:18.556226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-45a30e39-8bb2-4a46-947c-0366d28fcd78 req-967d45e5-6d4e-4bcb-84c4-791adf8e2c13 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:18.556652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-45a30e39-8bb2-4a46-947c-0366d28fcd78 req-967d45e5-6d4e-4bcb-84c4-791adf8e2c13 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:18.557087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-45a30e39-8bb2-4a46-947c-0366d28fcd78 req-967d45e5-6d4e-4bcb-84c4-791adf8e2c13 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:18.568681 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-45a30e39-8bb2-4a46-947c-0366d28fcd78 req-967d45e5-6d4e-4bcb-84c4-791adf8e2c13 service nova] Creating event network-vif-plugged:e6738163-d0c6-418a-9584-fce9014a8a31 for instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 on n-h1-854823-1 Aug 27 05:44:18.573710 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-45a30e39-8bb2-4a46-947c-0366d28fcd78 req-967d45e5-6d4e-4bcb-84c4-791adf8e2c13 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102328 Aug 27 05:44:18.574300 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3761/7569] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:44:19.225193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9dc2434-4f99-4253-86a0-3d115ed26af2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:19.225825 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9dc2434-4f99-4253-86a0-3d115ed26af2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:19.232879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9dc2434-4f99-4253-86a0-3d115ed26af2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:19.233381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9dc2434-4f99-4253-86a0-3d115ed26af2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:19.233834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9dc2434-4f99-4253-86a0-3d115ed26af2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:19.234544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9dc2434-4f99-4253-86a0-3d115ed26af2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:19.235019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9dc2434-4f99-4253-86a0-3d115ed26af2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:19.235455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9dc2434-4f99-4253-86a0-3d115ed26af2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:19.366459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9dc2434-4f99-4253-86a0-3d115ed26af2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:19.374355 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9dc2434-4f99-4253-86a0-3d115ed26af2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1359 microversion: 2.1 time: 0.153066 Aug 27 05:44:19.374954 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3809/7570] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:19 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:20.396642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-39de6508-dda1-4c0b-b7b1-2dab8c88469b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:20.397360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-39de6508-dda1-4c0b-b7b1-2dab8c88469b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:20.404100 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39de6508-dda1-4c0b-b7b1-2dab8c88469b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:20.404610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39de6508-dda1-4c0b-b7b1-2dab8c88469b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:20.405301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39de6508-dda1-4c0b-b7b1-2dab8c88469b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:20.406002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39de6508-dda1-4c0b-b7b1-2dab8c88469b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:20.406460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39de6508-dda1-4c0b-b7b1-2dab8c88469b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:20.406887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-39de6508-dda1-4c0b-b7b1-2dab8c88469b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:20.541510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-39de6508-dda1-4c0b-b7b1-2dab8c88469b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:20.550220 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-39de6508-dda1-4c0b-b7b1-2dab8c88469b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1549 microversion: 2.1 time: 0.158865 Aug 27 05:44:20.550801 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3762/7571] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:20 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:20.570116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-11bbbdb3-3e3a-45d7-85be-6202bd271cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:20.570738 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-11bbbdb3-3e3a-45d7-85be-6202bd271cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:20.577516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11bbbdb3-3e3a-45d7-85be-6202bd271cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:20.578015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11bbbdb3-3e3a-45d7-85be-6202bd271cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:20.578460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11bbbdb3-3e3a-45d7-85be-6202bd271cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:20.579161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11bbbdb3-3e3a-45d7-85be-6202bd271cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:20.579623 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11bbbdb3-3e3a-45d7-85be-6202bd271cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:20.580054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11bbbdb3-3e3a-45d7-85be-6202bd271cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:20.712451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11bbbdb3-3e3a-45d7-85be-6202bd271cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:20.721153 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-11bbbdb3-3e3a-45d7-85be-6202bd271cd1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1549 microversion: 2.1 time: 0.154840 Aug 27 05:44:20.721750 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3810/7572] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:20 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:20.740746 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1fb047ad-bcc4-412e-818e-4ccd45f66f69 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:20.745401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1fb047ad-bcc4-412e-818e-4ccd45f66f69 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:20.746167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1fb047ad-bcc4-412e-818e-4ccd45f66f69 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Searching by: {'deleted': False, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b'} {{(pid=128870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 05:44:20.751515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fb047ad-bcc4-412e-818e-4ccd45f66f69 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:20.751999 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fb047ad-bcc4-412e-818e-4ccd45f66f69 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:20.752435 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fb047ad-bcc4-412e-818e-4ccd45f66f69 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:20.753188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fb047ad-bcc4-412e-818e-4ccd45f66f69 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:20.753645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fb047ad-bcc4-412e-818e-4ccd45f66f69 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:20.754069 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fb047ad-bcc4-412e-818e-4ccd45f66f69 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:20.777556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.multi_cell_list [None req-1fb047ad-bcc4-412e-818e-4ccd45f66f69 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 05:44:20.804513 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1fb047ad-bcc4-412e-818e-4ccd45f66f69 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067580 Aug 27 05:44:20.805121 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3763/7573] 10.222.0.79 () {58 vars in 1125 bytes} [Sat Aug 27 05:44:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:44:20.816210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-531f9ae7-3d0d-4847-be70-4a0c64e2c01b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:20.816878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-531f9ae7-3d0d-4847-be70-4a0c64e2c01b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:20.823023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531f9ae7-3d0d-4847-be70-4a0c64e2c01b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:20.823526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531f9ae7-3d0d-4847-be70-4a0c64e2c01b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:20.823985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531f9ae7-3d0d-4847-be70-4a0c64e2c01b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:20.824776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531f9ae7-3d0d-4847-be70-4a0c64e2c01b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:20.825827 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531f9ae7-3d0d-4847-be70-4a0c64e2c01b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:20.826274 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531f9ae7-3d0d-4847-be70-4a0c64e2c01b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:20.957436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-531f9ae7-3d0d-4847-be70-4a0c64e2c01b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:20.965170 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-531f9ae7-3d0d-4847-be70-4a0c64e2c01b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1549 microversion: 2.1 time: 0.152894 Aug 27 05:44:20.965754 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3811/7574] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:20 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:22.466035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0ca6a1df-8b5b-4df8-8ab2-2c5afda4cd0c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30e1a143-c6ab-4f10-9c14-523f2908b4f8"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:44:22.468388 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0ca6a1df-8b5b-4df8-8ab2-2c5afda4cd0c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:22.475150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ca6a1df-8b5b-4df8-8ab2-2c5afda4cd0c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:22.475629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ca6a1df-8b5b-4df8-8ab2-2c5afda4cd0c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:22.476090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ca6a1df-8b5b-4df8-8ab2-2c5afda4cd0c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:22.476891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ca6a1df-8b5b-4df8-8ab2-2c5afda4cd0c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:22.477344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ca6a1df-8b5b-4df8-8ab2-2c5afda4cd0c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:22.477763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0ca6a1df-8b5b-4df8-8ab2-2c5afda4cd0c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:22.715499 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0ca6a1df-8b5b-4df8-8ab2-2c5afda4cd0c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "POST /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253112 Aug 27 05:44:22.716214 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3764/7575] 10.222.0.79 () {60 vars in 1323 bytes} [Sat Aug 27 05:44:22 2022] POST /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:44:33.483510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f794c13e-3766-4258-8db2-8b0644430f8d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:33.484140 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f794c13e-3766-4258-8db2-8b0644430f8d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:33.487226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=19 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:44:33.487903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=68 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:44:33.493828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f794c13e-3766-4258-8db2-8b0644430f8d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:33.494334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f794c13e-3766-4258-8db2-8b0644430f8d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:33.494792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f794c13e-3766-4258-8db2-8b0644430f8d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:33.495506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f794c13e-3766-4258-8db2-8b0644430f8d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:33.495981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f794c13e-3766-4258-8db2-8b0644430f8d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:33.496422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f794c13e-3766-4258-8db2-8b0644430f8d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:33.624413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f794c13e-3766-4258-8db2-8b0644430f8d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:33.632792 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f794c13e-3766-4258-8db2-8b0644430f8d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1595 microversion: 2.1 time: 0.153156 Aug 27 05:44:33.633404 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3812/7576] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:33 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:35.570843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e4f5c5f1-0b1f-47aa-9f23-00756b07927a req-ee3d583e-f639-4c68-9ad7-1a75c42dfbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4b495f-4cdf-4e10-87fa-8c48545d7810", "tag": "e6738163-d0c6-418a-9584-fce9014a8a31"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:44:35.586353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:44:35.587030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=17 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:44:35.591167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:44:35.604035 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e4f5c5f1-0b1f-47aa-9f23-00756b07927a req-ee3d583e-f639-4c68-9ad7-1a75c42dfbd0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:35.604553 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e4f5c5f1-0b1f-47aa-9f23-00756b07927a req-ee3d583e-f639-4c68-9ad7-1a75c42dfbd0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:35.605007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e4f5c5f1-0b1f-47aa-9f23-00756b07927a req-ee3d583e-f639-4c68-9ad7-1a75c42dfbd0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:35.624199 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e4f5c5f1-0b1f-47aa-9f23-00756b07927a req-ee3d583e-f639-4c68-9ad7-1a75c42dfbd0 service nova] Creating event network-changed:e6738163-d0c6-418a-9584-fce9014a8a31 for instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 on n-h1-854823-1 Aug 27 05:44:35.629859 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e4f5c5f1-0b1f-47aa-9f23-00756b07927a req-ee3d583e-f639-4c68-9ad7-1a75c42dfbd0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063106 Aug 27 05:44:35.630827 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3765/7577] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:44:36.711982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75bfbbf3-c785-4a17-ac4d-d3ba690ad089 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1022901263"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:44:36.712785 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75bfbbf3-c785-4a17-ac4d-d3ba690ad089 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:36.718954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75bfbbf3-c785-4a17-ac4d-d3ba690ad089 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:36.719461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75bfbbf3-c785-4a17-ac4d-d3ba690ad089 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:36.719922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75bfbbf3-c785-4a17-ac4d-d3ba690ad089 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:36.720669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75bfbbf3-c785-4a17-ac4d-d3ba690ad089 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:36.721146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75bfbbf3-c785-4a17-ac4d-d3ba690ad089 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:36.721590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75bfbbf3-c785-4a17-ac4d-d3ba690ad089 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:36.860405 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.network.security_group_api [None req-75bfbbf3-c785-4a17-ac4d-d3ba690ad089 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Adding security group f9eb0ff5-0d93-4ea8-9231-23a0ddf38f8f to port e6738163-d0c6-418a-9584-fce9014a8a31 Aug 27 05:44:37.169757 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75bfbbf3-c785-4a17-ac4d-d3ba690ad089 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "POST /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/action" status: 202 len: 0 microversion: 2.1 time: 0.462175 Aug 27 05:44:37.172573 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3813/7578] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:44:36 2022] POST /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:44:37.179032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-62c455e7-7d87-4996-acb3-61ad0f33745b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:44:37.179744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-62c455e7-7d87-4996-acb3-61ad0f33745b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:44:37.187663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62c455e7-7d87-4996-acb3-61ad0f33745b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:37.188454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62c455e7-7d87-4996-acb3-61ad0f33745b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:37.189113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62c455e7-7d87-4996-acb3-61ad0f33745b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:37.189969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62c455e7-7d87-4996-acb3-61ad0f33745b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:37.190594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62c455e7-7d87-4996-acb3-61ad0f33745b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:37.191232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-62c455e7-7d87-4996-acb3-61ad0f33745b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:37.352508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-62c455e7-7d87-4996-acb3-61ad0f33745b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:44:37.361120 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-62c455e7-7d87-4996-acb3-61ad0f33745b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1761 microversion: 2.1 time: 0.186372 Aug 27 05:44:37.361712 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3766/7579] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:44:37 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1761 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:44:37.648971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7c39b0b8-d837-4b3a-a091-288737848ba7 req-5f9a5700-691a-4ae4-892d-03eba723c41c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4b495f-4cdf-4e10-87fa-8c48545d7810", "tag": "e6738163-d0c6-418a-9584-fce9014a8a31"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:44:37.660783 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7c39b0b8-d837-4b3a-a091-288737848ba7 req-5f9a5700-691a-4ae4-892d-03eba723c41c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:44:37.661398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7c39b0b8-d837-4b3a-a091-288737848ba7 req-5f9a5700-691a-4ae4-892d-03eba723c41c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:44:37.662050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7c39b0b8-d837-4b3a-a091-288737848ba7 req-5f9a5700-691a-4ae4-892d-03eba723c41c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:44:37.676388 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7c39b0b8-d837-4b3a-a091-288737848ba7 req-5f9a5700-691a-4ae4-892d-03eba723c41c service nova] Creating event network-changed:e6738163-d0c6-418a-9584-fce9014a8a31 for instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 on n-h1-854823-1 Aug 27 05:44:37.681848 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7c39b0b8-d837-4b3a-a091-288737848ba7 req-5f9a5700-691a-4ae4-892d-03eba723c41c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036685 Aug 27 05:44:37.682660 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3814/7580] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:45:25.483813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ab09e7c9-2736-4c28-9ca9-2497c00b34d0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:45:25.485487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ab09e7c9-2736-4c28-9ca9-2497c00b34d0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:25.487604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:45:25.488255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:45:25.494734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab09e7c9-2736-4c28-9ca9-2497c00b34d0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:25.495229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab09e7c9-2736-4c28-9ca9-2497c00b34d0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:25.495720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab09e7c9-2736-4c28-9ca9-2497c00b34d0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:25.496422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab09e7c9-2736-4c28-9ca9-2497c00b34d0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:25.496893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab09e7c9-2736-4c28-9ca9-2497c00b34d0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:25.497317 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab09e7c9-2736-4c28-9ca9-2497c00b34d0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:25.571263 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ab09e7c9-2736-4c28-9ca9-2497c00b34d0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "POST /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/action" status: 202 len: 0 microversion: 2.1 time: 0.092693 Aug 27 05:45:25.571896 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3767/7581] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:45:25 2022] POST /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:45:25.578758 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:45:25.579596 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:45:25.584817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d80edd5-b10c-4eab-83f3-4ad1ef616bda tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:25.585717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d80edd5-b10c-4eab-83f3-4ad1ef616bda tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:25.593657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d80edd5-b10c-4eab-83f3-4ad1ef616bda tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:25.594253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d80edd5-b10c-4eab-83f3-4ad1ef616bda tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:25.594708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d80edd5-b10c-4eab-83f3-4ad1ef616bda tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:25.595427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d80edd5-b10c-4eab-83f3-4ad1ef616bda tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:25.595903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d80edd5-b10c-4eab-83f3-4ad1ef616bda tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:25.596350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d80edd5-b10c-4eab-83f3-4ad1ef616bda tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:25.749946 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d80edd5-b10c-4eab-83f3-4ad1ef616bda tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:25.758411 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d80edd5-b10c-4eab-83f3-4ad1ef616bda tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1753 microversion: 2.1 time: 0.181885 Aug 27 05:45:25.759287 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3815/7582] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:25 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:26.781518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d0a3a4bf-5304-4de1-a3fd-87dcd2a62cd6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:26.782220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d0a3a4bf-5304-4de1-a3fd-87dcd2a62cd6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:26.788346 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0a3a4bf-5304-4de1-a3fd-87dcd2a62cd6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:26.788898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0a3a4bf-5304-4de1-a3fd-87dcd2a62cd6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:26.789337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0a3a4bf-5304-4de1-a3fd-87dcd2a62cd6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:26.790020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0a3a4bf-5304-4de1-a3fd-87dcd2a62cd6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:26.790472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0a3a4bf-5304-4de1-a3fd-87dcd2a62cd6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:26.790888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d0a3a4bf-5304-4de1-a3fd-87dcd2a62cd6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:26.933133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d0a3a4bf-5304-4de1-a3fd-87dcd2a62cd6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:26.941790 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d0a3a4bf-5304-4de1-a3fd-87dcd2a62cd6 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1758 microversion: 2.1 time: 0.165862 Aug 27 05:45:26.942357 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3768/7583] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:26 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:27.963268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f9ff9c65-592d-45c2-ac1b-e62f32a2dbc5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:27.963899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f9ff9c65-592d-45c2-ac1b-e62f32a2dbc5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:27.971710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9ff9c65-592d-45c2-ac1b-e62f32a2dbc5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:27.972213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9ff9c65-592d-45c2-ac1b-e62f32a2dbc5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:27.972698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9ff9c65-592d-45c2-ac1b-e62f32a2dbc5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:27.973410 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9ff9c65-592d-45c2-ac1b-e62f32a2dbc5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:27.973883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9ff9c65-592d-45c2-ac1b-e62f32a2dbc5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:27.974368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9ff9c65-592d-45c2-ac1b-e62f32a2dbc5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:28.124384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f9ff9c65-592d-45c2-ac1b-e62f32a2dbc5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:28.133270 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f9ff9c65-592d-45c2-ac1b-e62f32a2dbc5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1758 microversion: 2.1 time: 0.173870 Aug 27 05:45:28.134072 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3816/7584] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:27 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:29.156055 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5c22753b-3d0e-4632-8524-c4afadf29b29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:29.156703 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5c22753b-3d0e-4632-8524-c4afadf29b29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:29.163491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c22753b-3d0e-4632-8524-c4afadf29b29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:29.164000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c22753b-3d0e-4632-8524-c4afadf29b29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:29.164439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c22753b-3d0e-4632-8524-c4afadf29b29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:29.165214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c22753b-3d0e-4632-8524-c4afadf29b29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:29.165665 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c22753b-3d0e-4632-8524-c4afadf29b29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:29.166085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c22753b-3d0e-4632-8524-c4afadf29b29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:29.310385 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5c22753b-3d0e-4632-8524-c4afadf29b29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:29.319376 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5c22753b-3d0e-4632-8524-c4afadf29b29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1758 microversion: 2.1 time: 0.167497 Aug 27 05:45:29.319957 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3769/7585] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:29 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:30.341238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25628689-bb8f-4f16-9fee-f5dd3a213707 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:30.341871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25628689-bb8f-4f16-9fee-f5dd3a213707 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:30.349361 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25628689-bb8f-4f16-9fee-f5dd3a213707 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:30.349860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25628689-bb8f-4f16-9fee-f5dd3a213707 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:30.350347 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25628689-bb8f-4f16-9fee-f5dd3a213707 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:30.351052 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25628689-bb8f-4f16-9fee-f5dd3a213707 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:30.351522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25628689-bb8f-4f16-9fee-f5dd3a213707 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:30.351960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25628689-bb8f-4f16-9fee-f5dd3a213707 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:30.491315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25628689-bb8f-4f16-9fee-f5dd3a213707 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:30.500066 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25628689-bb8f-4f16-9fee-f5dd3a213707 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1758 microversion: 2.1 time: 0.162802 Aug 27 05:45:30.500664 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3817/7586] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:30 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:31.521270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5d6b146a-6e35-4f8b-8bbc-17230393027d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:31.521921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5d6b146a-6e35-4f8b-8bbc-17230393027d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:31.528888 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d6b146a-6e35-4f8b-8bbc-17230393027d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:31.529374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d6b146a-6e35-4f8b-8bbc-17230393027d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:31.530722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d6b146a-6e35-4f8b-8bbc-17230393027d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:31.531449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d6b146a-6e35-4f8b-8bbc-17230393027d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:31.531969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d6b146a-6e35-4f8b-8bbc-17230393027d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:31.532401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d6b146a-6e35-4f8b-8bbc-17230393027d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:31.672473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5d6b146a-6e35-4f8b-8bbc-17230393027d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:31.680894 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5d6b146a-6e35-4f8b-8bbc-17230393027d tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1758 microversion: 2.1 time: 0.163541 Aug 27 05:45:31.681464 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3770/7587] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:31 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:32.701442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34ccf02c-ef44-4c5f-bc1c-f752e1f2790c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:32.702209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34ccf02c-ef44-4c5f-bc1c-f752e1f2790c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:32.708921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ccf02c-ef44-4c5f-bc1c-f752e1f2790c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:32.709416 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ccf02c-ef44-4c5f-bc1c-f752e1f2790c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:32.709861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ccf02c-ef44-4c5f-bc1c-f752e1f2790c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:32.710564 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ccf02c-ef44-4c5f-bc1c-f752e1f2790c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:32.711026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ccf02c-ef44-4c5f-bc1c-f752e1f2790c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:32.711458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ccf02c-ef44-4c5f-bc1c-f752e1f2790c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:32.859107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34ccf02c-ef44-4c5f-bc1c-f752e1f2790c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:32.867798 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34ccf02c-ef44-4c5f-bc1c-f752e1f2790c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1758 microversion: 2.1 time: 0.170361 Aug 27 05:45:32.868475 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3818/7588] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:32 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:33.889268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-44ebc949-4ef8-4e70-ab9b-8f0522ec183b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:33.889885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-44ebc949-4ef8-4e70-ab9b-8f0522ec183b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:33.895790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44ebc949-4ef8-4e70-ab9b-8f0522ec183b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:33.896272 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44ebc949-4ef8-4e70-ab9b-8f0522ec183b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:33.896744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44ebc949-4ef8-4e70-ab9b-8f0522ec183b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:33.897422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44ebc949-4ef8-4e70-ab9b-8f0522ec183b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:33.897873 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44ebc949-4ef8-4e70-ab9b-8f0522ec183b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:33.898292 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-44ebc949-4ef8-4e70-ab9b-8f0522ec183b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:34.047275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-44ebc949-4ef8-4e70-ab9b-8f0522ec183b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:34.055648 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-44ebc949-4ef8-4e70-ab9b-8f0522ec183b tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1758 microversion: 2.1 time: 0.170492 Aug 27 05:45:34.056234 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3771/7589] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:33 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:35.078680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66a2889a-3a14-4b56-9050-707ecccd61f0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:35.079317 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66a2889a-3a14-4b56-9050-707ecccd61f0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:35.085557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66a2889a-3a14-4b56-9050-707ecccd61f0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:35.086066 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66a2889a-3a14-4b56-9050-707ecccd61f0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:35.086519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66a2889a-3a14-4b56-9050-707ecccd61f0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:35.087268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66a2889a-3a14-4b56-9050-707ecccd61f0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:35.087751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66a2889a-3a14-4b56-9050-707ecccd61f0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:35.088194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66a2889a-3a14-4b56-9050-707ecccd61f0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:35.234665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66a2889a-3a14-4b56-9050-707ecccd61f0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:35.242922 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66a2889a-3a14-4b56-9050-707ecccd61f0 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1758 microversion: 2.1 time: 0.169217 Aug 27 05:45:35.243508 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3819/7590] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:35 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:36.265141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d37f35bb-02d3-49f2-ab88-43c55d6f43ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:36.265791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d37f35bb-02d3-49f2-ab88-43c55d6f43ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:36.272696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d37f35bb-02d3-49f2-ab88-43c55d6f43ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:36.273177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d37f35bb-02d3-49f2-ab88-43c55d6f43ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:36.273609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d37f35bb-02d3-49f2-ab88-43c55d6f43ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:36.274293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d37f35bb-02d3-49f2-ab88-43c55d6f43ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:36.274744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d37f35bb-02d3-49f2-ab88-43c55d6f43ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:36.275165 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d37f35bb-02d3-49f2-ab88-43c55d6f43ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:36.421645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d37f35bb-02d3-49f2-ab88-43c55d6f43ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:36.430341 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d37f35bb-02d3-49f2-ab88-43c55d6f43ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1758 microversion: 2.1 time: 0.169668 Aug 27 05:45:36.430949 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3772/7591] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:36 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:45:37.452348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c310b136-80af-46bb-a5de-97618f346e29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:45:37.453101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c310b136-80af-46bb-a5de-97618f346e29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:45:37.459812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c310b136-80af-46bb-a5de-97618f346e29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:37.460310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c310b136-80af-46bb-a5de-97618f346e29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:37.460798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c310b136-80af-46bb-a5de-97618f346e29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:37.461505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c310b136-80af-46bb-a5de-97618f346e29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:45:37.461975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c310b136-80af-46bb-a5de-97618f346e29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:45:37.462412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c310b136-80af-46bb-a5de-97618f346e29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:45:37.606160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c310b136-80af-46bb-a5de-97618f346e29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:45:37.615017 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c310b136-80af-46bb-a5de-97618f346e29 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1761 microversion: 2.1 time: 0.167632 Aug 27 05:45:37.615593 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3820/7592] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:45:37 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1761 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:40.985149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=12 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:40.986455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:40.991135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4fd24490-a6ed-483a-9304-fc0b782d9ecd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1022901263"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:40.991710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4fd24490-a6ed-483a-9304-fc0b782d9ecd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:40.998806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fd24490-a6ed-483a-9304-fc0b782d9ecd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:40.999332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fd24490-a6ed-483a-9304-fc0b782d9ecd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:40.999767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fd24490-a6ed-483a-9304-fc0b782d9ecd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:41.000463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fd24490-a6ed-483a-9304-fc0b782d9ecd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:41.000947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fd24490-a6ed-483a-9304-fc0b782d9ecd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:41.001564 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4fd24490-a6ed-483a-9304-fc0b782d9ecd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:41.133419 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.network.security_group_api [None req-4fd24490-a6ed-483a-9304-fc0b782d9ecd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Removing security group f9eb0ff5-0d93-4ea8-9231-23a0ddf38f8f from port e6738163-d0c6-418a-9584-fce9014a8a31 Aug 27 05:46:41.437571 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4fd24490-a6ed-483a-9304-fc0b782d9ecd tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "POST /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/action" status: 202 len: 0 microversion: 2.1 time: 0.454357 Aug 27 05:46:41.442040 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3773/7593] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:46:40 2022] POST /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:46:41.456424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4b994ddd-d6ef-46b7-a76c-086eee2a7e6e req-f6d8260f-6fed-43f0-99de-9aeeecd3948d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4b495f-4cdf-4e10-87fa-8c48545d7810", "tag": "e6738163-d0c6-418a-9584-fce9014a8a31"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:41.462097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:41.462963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=36 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:46:41.489485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4b994ddd-d6ef-46b7-a76c-086eee2a7e6e req-f6d8260f-6fed-43f0-99de-9aeeecd3948d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:41.490232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4b994ddd-d6ef-46b7-a76c-086eee2a7e6e req-f6d8260f-6fed-43f0-99de-9aeeecd3948d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:41.490883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4b994ddd-d6ef-46b7-a76c-086eee2a7e6e req-f6d8260f-6fed-43f0-99de-9aeeecd3948d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:41.520871 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4b994ddd-d6ef-46b7-a76c-086eee2a7e6e req-f6d8260f-6fed-43f0-99de-9aeeecd3948d service nova] Creating event network-changed:e6738163-d0c6-418a-9584-fce9014a8a31 for instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 on n-h1-854823-1 Aug 27 05:46:41.531673 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4b994ddd-d6ef-46b7-a76c-086eee2a7e6e req-f6d8260f-6fed-43f0-99de-9aeeecd3948d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086198 Aug 27 05:46:41.533842 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3821/7594] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:42.552685 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d5f528b3-d8ba-4b4e-8163-464a466882b8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:42.553309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d5f528b3-d8ba-4b4e-8163-464a466882b8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:42.554157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6f62baed-4b15-4160-9af9-31d6eeb33be4 req-e9d23819-96b3-4dbd-99f9-50a0bb961e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4b495f-4cdf-4e10-87fa-8c48545d7810", "tag": "e6738163-d0c6-418a-9584-fce9014a8a31"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:42.559650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5f528b3-d8ba-4b4e-8163-464a466882b8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:42.560247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5f528b3-d8ba-4b4e-8163-464a466882b8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:42.560952 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5f528b3-d8ba-4b4e-8163-464a466882b8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:42.561754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5f528b3-d8ba-4b4e-8163-464a466882b8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:42.562324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5f528b3-d8ba-4b4e-8163-464a466882b8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:42.562970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d5f528b3-d8ba-4b4e-8163-464a466882b8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:42.564899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6f62baed-4b15-4160-9af9-31d6eeb33be4 req-e9d23819-96b3-4dbd-99f9-50a0bb961e0b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:42.565622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6f62baed-4b15-4160-9af9-31d6eeb33be4 req-e9d23819-96b3-4dbd-99f9-50a0bb961e0b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:42.566346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6f62baed-4b15-4160-9af9-31d6eeb33be4 req-e9d23819-96b3-4dbd-99f9-50a0bb961e0b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:42.577789 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6f62baed-4b15-4160-9af9-31d6eeb33be4 req-e9d23819-96b3-4dbd-99f9-50a0bb961e0b service nova] Creating event network-changed:e6738163-d0c6-418a-9584-fce9014a8a31 for instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 on n-h1-854823-1 Aug 27 05:46:42.583356 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6f62baed-4b15-4160-9af9-31d6eeb33be4 req-e9d23819-96b3-4dbd-99f9-50a0bb961e0b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033201 Aug 27 05:46:42.584361 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3822/7595] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:42.663167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-d5f528b3-d8ba-4b4e-8163-464a466882b8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lazy-loading 'services' on Instance uuid aa4b495f-4cdf-4e10-87fa-8c48545d7810 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:46:42.746612 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d5f528b3-d8ba-4b4e-8163-464a466882b8 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments/30e1a143-c6ab-4f10-9c14-523f2908b4f8" status: 202 len: 0 microversion: 2.1 time: 0.199839 Aug 27 05:46:42.747493 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3774/7596] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:46:42 2022] DELETE /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments/30e1a143-c6ab-4f10-9c14-523f2908b4f8 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:46:42.765963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-71f4baff-2473-4db8-83df-aa85cc1bf571 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:42.768372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-71f4baff-2473-4db8-83df-aa85cc1bf571 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:42.781966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71f4baff-2473-4db8-83df-aa85cc1bf571 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:42.784113 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71f4baff-2473-4db8-83df-aa85cc1bf571 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:42.784682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71f4baff-2473-4db8-83df-aa85cc1bf571 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:42.785666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71f4baff-2473-4db8-83df-aa85cc1bf571 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:42.786235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71f4baff-2473-4db8-83df-aa85cc1bf571 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:42.786910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71f4baff-2473-4db8-83df-aa85cc1bf571 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:42.820681 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-71f4baff-2473-4db8-83df-aa85cc1bf571 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067549 Aug 27 05:46:42.821352 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3823/7597] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:46:42 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:43.835314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3100e568-2f01-4fdc-a8b2-39586155dce5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:43.837756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3100e568-2f01-4fdc-a8b2-39586155dce5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:43.844220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3100e568-2f01-4fdc-a8b2-39586155dce5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:43.844747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3100e568-2f01-4fdc-a8b2-39586155dce5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:43.845189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3100e568-2f01-4fdc-a8b2-39586155dce5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:43.845887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3100e568-2f01-4fdc-a8b2-39586155dce5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:43.846348 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3100e568-2f01-4fdc-a8b2-39586155dce5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:43.846771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3100e568-2f01-4fdc-a8b2-39586155dce5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:43.878701 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3100e568-2f01-4fdc-a8b2-39586155dce5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049068 Aug 27 05:46:43.879326 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3775/7598] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:46:43 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:44.891334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-00388e3f-aaae-4038-8f93-4443c408aec5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:44.893587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-00388e3f-aaae-4038-8f93-4443c408aec5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:44.900721 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00388e3f-aaae-4038-8f93-4443c408aec5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:44.901225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00388e3f-aaae-4038-8f93-4443c408aec5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:44.901670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00388e3f-aaae-4038-8f93-4443c408aec5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:44.902389 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00388e3f-aaae-4038-8f93-4443c408aec5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:44.902856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00388e3f-aaae-4038-8f93-4443c408aec5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:44.903288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00388e3f-aaae-4038-8f93-4443c408aec5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:44.934530 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-00388e3f-aaae-4038-8f93-4443c408aec5 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047088 Aug 27 05:46:44.935087 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3824/7599] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:46:44 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:45.947813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-12cd2bfa-7eb8-4ee3-8286-238a46698be7 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:45.950050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-12cd2bfa-7eb8-4ee3-8286-238a46698be7 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:45.957140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12cd2bfa-7eb8-4ee3-8286-238a46698be7 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:45.957655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12cd2bfa-7eb8-4ee3-8286-238a46698be7 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:45.958132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12cd2bfa-7eb8-4ee3-8286-238a46698be7 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:45.958863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12cd2bfa-7eb8-4ee3-8286-238a46698be7 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:45.959349 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12cd2bfa-7eb8-4ee3-8286-238a46698be7 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:45.959805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-12cd2bfa-7eb8-4ee3-8286-238a46698be7 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:45.995009 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-12cd2bfa-7eb8-4ee3-8286-238a46698be7 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051538 Aug 27 05:46:45.995592 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3776/7600] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:46:45 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:47.007644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5057c38e-bd59-4c3b-b101-dd440a9efbb2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:47.009886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5057c38e-bd59-4c3b-b101-dd440a9efbb2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:47.016839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5057c38e-bd59-4c3b-b101-dd440a9efbb2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:47.017339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5057c38e-bd59-4c3b-b101-dd440a9efbb2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:47.017794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5057c38e-bd59-4c3b-b101-dd440a9efbb2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:47.018502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5057c38e-bd59-4c3b-b101-dd440a9efbb2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:47.018999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5057c38e-bd59-4c3b-b101-dd440a9efbb2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:47.019440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5057c38e-bd59-4c3b-b101-dd440a9efbb2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:47.050429 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5057c38e-bd59-4c3b-b101-dd440a9efbb2 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046818 Aug 27 05:46:47.051009 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3825/7601] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:46:47 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:48.062905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b035a249-48e3-4676-b3cd-96184f3ee340 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:48.065722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b035a249-48e3-4676-b3cd-96184f3ee340 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:48.072521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b035a249-48e3-4676-b3cd-96184f3ee340 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:48.073026 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b035a249-48e3-4676-b3cd-96184f3ee340 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:48.073464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b035a249-48e3-4676-b3cd-96184f3ee340 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:48.074152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b035a249-48e3-4676-b3cd-96184f3ee340 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:48.074609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b035a249-48e3-4676-b3cd-96184f3ee340 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:48.075033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b035a249-48e3-4676-b3cd-96184f3ee340 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:48.105391 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b035a249-48e3-4676-b3cd-96184f3ee340 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046504 Aug 27 05:46:48.105954 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3777/7602] 10.222.0.79 () {58 vars in 1302 bytes} [Sat Aug 27 05:46:48 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 05:46:48.116960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-148547c3-477e-4b3b-86bc-4abaee67d697 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:48.117466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-148547c3-477e-4b3b-86bc-4abaee67d697 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:48.124214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-148547c3-477e-4b3b-86bc-4abaee67d697 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:48.124961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-148547c3-477e-4b3b-86bc-4abaee67d697 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:48.125288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-148547c3-477e-4b3b-86bc-4abaee67d697 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:48.125999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-148547c3-477e-4b3b-86bc-4abaee67d697 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:48.127061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-148547c3-477e-4b3b-86bc-4abaee67d697 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:48.127495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-148547c3-477e-4b3b-86bc-4abaee67d697 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:48.204329 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-148547c3-477e-4b3b-86bc-4abaee67d697 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] HTTP exception thrown: Instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 is not attached to volume 30e1a143-c6ab-4f10-9c14-523f2908b4f8 Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-148547c3-477e-4b3b-86bc-4abaee67d697 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Request method failure captured: Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments/30e1a143-c6ab-4f10-9c14-523f2908b4f8 HTTP/1.1 Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCa3kl5AqRFH5rLHgVjoZ2eCiY6duwGSzGp14HqdlhnSqULpw19ux3uxZ7x8t_MmlMve-HHqSZL-I8cRl_nvB87MKHrEdcBbKMyT2uQZxuD0DZBGvWvjyiXkccZxYN_nOlqit4qhsZqovz_e2OHmc5MOG1lDmpUgwXCWxF5xOXYS4MmU Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cd7f3f400b144f5ca7ac796123a2206b Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestMinimumBasicScenario-1835637884 Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestMinimumBasicScenario-1835637884 Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cd7f3f400b144f5ca7ac796123a2206b Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1835637884 Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestMinimumBasicScenario-1835637884-project Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: bd902c0afe40463f839abcecb4e39440 Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestMinimumBasicScenario-1835637884-project Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 is not attached to volume 30e1a143-c6ab-4f10-9c14-523f2908b4f8 Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'server_id': 'aa4b495f-4cdf-4e10-87fa-8c48545d7810', 'id': '30e1a143-c6ab-4f10-9c14-523f2908b4f8'} Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 30e1a143-c6ab-4f10-9c14-523f2908b4f8. Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 is not attached to volume 30e1a143-c6ab-4f10-9c14-523f2908b4f8 Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:46:48.206088 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:46:48.211592 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:46:48.211592 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:46:48.211592 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 is not attached to volume 30e1a143-c6ab-4f10-9c14-523f2908b4f8 Aug 27 05:46:48.211592 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:46:48.211592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-148547c3-477e-4b3b-86bc-4abaee67d697 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Returning 404 to user: Instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 is not attached to volume 30e1a143-c6ab-4f10-9c14-523f2908b4f8 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:46:48.211592 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-148547c3-477e-4b3b-86bc-4abaee67d697 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments/30e1a143-c6ab-4f10-9c14-523f2908b4f8" status: 404 len: 154 microversion: 2.1 time: 0.094641 Aug 27 05:46:48.211592 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3826/7603] 10.222.0.79 () {58 vars in 1416 bytes} [Sat Aug 27 05:46:48 2022] DELETE /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810/os-volume_attachments/30e1a143-c6ab-4f10-9c14-523f2908b4f8 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:46:51.463044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8c6efa57-65ea-4dbe-9673-aeccb566709c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:51.464232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8c6efa57-65ea-4dbe-9673-aeccb566709c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:51.472375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c6efa57-65ea-4dbe-9673-aeccb566709c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:51.476716 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c6efa57-65ea-4dbe-9673-aeccb566709c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:51.477323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c6efa57-65ea-4dbe-9673-aeccb566709c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:51.478454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c6efa57-65ea-4dbe-9673-aeccb566709c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:51.479225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c6efa57-65ea-4dbe-9673-aeccb566709c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:51.479853 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8c6efa57-65ea-4dbe-9673-aeccb566709c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:51.781110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8c6efa57-65ea-4dbe-9673-aeccb566709c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:46:51.866165 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8c6efa57-65ea-4dbe-9673-aeccb566709c tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 204 len: 0 microversion: 2.1 time: 0.406863 Aug 27 05:46:51.870688 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3778/7604] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:46:51 2022] DELETE /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:46:51.877878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-71fdc888-3c03-4a56-a4b8-06afae218419 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:51.879061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-71fdc888-3c03-4a56-a4b8-06afae218419 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:51.891196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71fdc888-3c03-4a56-a4b8-06afae218419 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:51.892782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71fdc888-3c03-4a56-a4b8-06afae218419 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:51.893465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71fdc888-3c03-4a56-a4b8-06afae218419 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:51.894591 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71fdc888-3c03-4a56-a4b8-06afae218419 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:51.895485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71fdc888-3c03-4a56-a4b8-06afae218419 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:51.896035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71fdc888-3c03-4a56-a4b8-06afae218419 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:52.052705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71fdc888-3c03-4a56-a4b8-06afae218419 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:52.061549 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-71fdc888-3c03-4a56-a4b8-06afae218419 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1555 microversion: 2.1 time: 0.189300 Aug 27 05:46:52.062328 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3827/7605] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:51 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:53.083841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-46f3f686-6afc-4a25-8a8c-1b8300c0a3ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:53.084565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-46f3f686-6afc-4a25-8a8c-1b8300c0a3ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:53.091994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46f3f686-6afc-4a25-8a8c-1b8300c0a3ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:53.092478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46f3f686-6afc-4a25-8a8c-1b8300c0a3ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:53.092940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46f3f686-6afc-4a25-8a8c-1b8300c0a3ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:53.093633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46f3f686-6afc-4a25-8a8c-1b8300c0a3ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:53.094088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46f3f686-6afc-4a25-8a8c-1b8300c0a3ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:53.094516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-46f3f686-6afc-4a25-8a8c-1b8300c0a3ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:53.223202 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-46f3f686-6afc-4a25-8a8c-1b8300c0a3ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:53.231178 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-46f3f686-6afc-4a25-8a8c-1b8300c0a3ef tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1555 microversion: 2.1 time: 0.152134 Aug 27 05:46:53.231754 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3779/7606] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:53 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:54.120898 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a41bf2b0-664c-4ea5-8a5f-1da79c643f73 req-c941facb-e9e8-4c4b-99fc-c7ebafd42b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4b495f-4cdf-4e10-87fa-8c48545d7810", "name": "network-vif-deleted", "tag": "e6738163-d0c6-418a-9584-fce9014a8a31"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:46:54.135207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a41bf2b0-664c-4ea5-8a5f-1da79c643f73 req-c941facb-e9e8-4c4b-99fc-c7ebafd42b2b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:54.135775 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a41bf2b0-664c-4ea5-8a5f-1da79c643f73 req-c941facb-e9e8-4c4b-99fc-c7ebafd42b2b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:54.136225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a41bf2b0-664c-4ea5-8a5f-1da79c643f73 req-c941facb-e9e8-4c4b-99fc-c7ebafd42b2b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:54.147870 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a41bf2b0-664c-4ea5-8a5f-1da79c643f73 req-c941facb-e9e8-4c4b-99fc-c7ebafd42b2b service nova] Creating event network-vif-deleted:e6738163-d0c6-418a-9584-fce9014a8a31 for instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 on n-h1-854823-1 Aug 27 05:46:54.153141 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a41bf2b0-664c-4ea5-8a5f-1da79c643f73 req-c941facb-e9e8-4c4b-99fc-c7ebafd42b2b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036198 Aug 27 05:46:54.153960 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3828/7607] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:46:54.253577 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2f5ff68b-def3-4b94-b391-d98058a7c9a9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:54.254218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2f5ff68b-def3-4b94-b391-d98058a7c9a9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:54.261658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f5ff68b-def3-4b94-b391-d98058a7c9a9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:54.262450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f5ff68b-def3-4b94-b391-d98058a7c9a9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:54.262897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f5ff68b-def3-4b94-b391-d98058a7c9a9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:54.263616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f5ff68b-def3-4b94-b391-d98058a7c9a9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:54.264077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f5ff68b-def3-4b94-b391-d98058a7c9a9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:54.264512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f5ff68b-def3-4b94-b391-d98058a7c9a9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:54.296694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f5ff68b-def3-4b94-b391-d98058a7c9a9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:54.297192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f5ff68b-def3-4b94-b391-d98058a7c9a9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:54.297713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2f5ff68b-def3-4b94-b391-d98058a7c9a9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:54.298253 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-2f5ff68b-def3-4b94-b391-d98058a7c9a9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lazy-loading 'fault' on Instance uuid aa4b495f-4cdf-4e10-87fa-8c48545d7810 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:46:54.340170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2f5ff68b-def3-4b94-b391-d98058a7c9a9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd902c0afe40463f839abcecb4e39440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7f3f400b144f5ca7ac796123a2206b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:46:54.348051 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2f5ff68b-def3-4b94-b391-d98058a7c9a9 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 200 len: 1349 microversion: 2.1 time: 0.098976 Aug 27 05:46:54.348637 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3780/7608] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:54 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:46:55.370548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fdd6acb-f804-49cf-aaab-eba148e205ec tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:55.371207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6fdd6acb-f804-49cf-aaab-eba148e205ec tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [instance: aa4b495f-4cdf-4e10-87fa-8c48545d7810] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:46:55.377526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fdd6acb-f804-49cf-aaab-eba148e205ec tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:55.378026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fdd6acb-f804-49cf-aaab-eba148e205ec tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:55.378481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fdd6acb-f804-49cf-aaab-eba148e205ec tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:55.379197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fdd6acb-f804-49cf-aaab-eba148e205ec tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:46:55.379674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fdd6acb-f804-49cf-aaab-eba148e205ec tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:46:55.380117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fdd6acb-f804-49cf-aaab-eba148e205ec tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:46:55.394089 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6fdd6acb-f804-49cf-aaab-eba148e205ec tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] HTTP exception thrown: Instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 could not be found. Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fdd6acb-f804-49cf-aaab-eba148e205ec tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Request method failure captured: Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 HTTP/1.1 Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCa3kl5AqRFH5rLHgVjoZ2eCiY6duwGSzGp14HqdlhnSqULpw19ux3uxZ7x8t_MmlMve-HHqSZL-I8cRl_nvB87MKHrEdcBbKMyT2uQZxuD0DZBGvWvjyiXkccZxYN_nOlqit4qhsZqovz_e2OHmc5MOG1lDmpUgwXCWxF5xOXYS4MmU Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: cd7f3f400b144f5ca7ac796123a2206b Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestMinimumBasicScenario-1835637884 Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd7f3f400b144f5ca7ac796123a2206b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestMinimumBasicScenario-1835637884 Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: cd7f3f400b144f5ca7ac796123a2206b Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1835637884 Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestMinimumBasicScenario-1835637884-project Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: bd902c0afe40463f839abcecb4e39440 Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestMinimumBasicScenario-1835637884-project Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 could not be found. Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'aa4b495f-4cdf-4e10-87fa-8c48545d7810'} Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 could not be found. Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 could not be found. Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:46:55.395733 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:46:55.400553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:46:55.400553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:46:55.400553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:46:55.400553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:46:55.400553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:46:55.400553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 could not be found. Aug 27 05:46:55.400553 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:46:55.400553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fdd6acb-f804-49cf-aaab-eba148e205ec tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Returning 404 to user: Instance aa4b495f-4cdf-4e10-87fa-8c48545d7810 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:46:55.400553 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6fdd6acb-f804-49cf-aaab-eba148e205ec tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810" status: 404 len: 111 microversion: 2.1 time: 0.031994 Aug 27 05:46:55.400553 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3829/7609] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:46:55 2022] GET /compute/v2.1/servers/aa4b495f-4cdf-4e10-87fa-8c48545d7810 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:46:55.406224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-db3d762d-a84e-4024-a50c-840dc56241f1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] Calling method '.version_select at 0x7f1f20746b80>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:46:55.411512 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [None req-db3d762d-a84e-4024-a50c-840dc56241f1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [6833264e-9841-40aa-958e-728842aecfe8] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 05:46:56.419159 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [None req-db3d762d-a84e-4024-a50c-840dc56241f1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] [6833264e-9841-40aa-958e-728842aecfe8] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 44266. Aug 27 05:46:56.439067 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-db3d762d-a84e-4024-a50c-840dc56241f1 tempest-TestMinimumBasicScenario-1835637884 tempest-TestMinimumBasicScenario-1835637884-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1663136270" status: 202 len: 0 microversion: 2.1 time: 1.036334 Aug 27 05:46:56.439637 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3781/7610] 10.222.0.79 () {58 vars in 1272 bytes} [Sat Aug 27 05:46:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1663136270 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:47:05.703232 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=18 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:05.704535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=38 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:05.705413 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:47:05.705603 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:47:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.79) !!! Aug 27 05:47:05.706599 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:47:05.706789 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:47:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.79) !!! Aug 27 05:47:05.879268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fac08649-c97c-4123-8093-4b9ad63c205d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'create', calling method: .version_select at 0x7f1f20439550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-773239502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3nO+lWQnHRF0NXSqAdbtS1ZLFdK9tkAlvn6lhaHszSpLDRId3mL7yrPF/g0r8XjT/BHDyOSLZZV144XhC689moMapbePsPB6o95wY2aH6p+996/wxoKd5K685CyVSypA=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:05.895500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-fac08649-c97c-4123-8093-4b9ad63c205d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for project 277e817efae04205bf58e32de7c168ce. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:47:05.900727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-fac08649-c97c-4123-8093-4b9ad63c205d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for user 19fb9c5c1cfd4cb2b33a7c22d7311ffe and project 277e817efae04205bf58e32de7c168ce. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:47:05.929088 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fac08649-c97c-4123-8093-4b9ad63c205d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.230812 Aug 27 05:47:05.929699 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3830/7611] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:47:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:47:11.827667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-695764476", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "cb5a6722-3cb1-4bc4-b22e-0c6a8c582dfa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-773239502", "security_groups": [{"name": "tempest-secgroup-smoke-2028042717"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:11.846052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:11.847593 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:47:11.847794 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 05:47:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.79) !!! Aug 27 05:47:11.849171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:12.095691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] validate_networks() for [('cb5a6722-3cb1-4bc4-b22e-0c6a8c582dfa', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:47:12.494081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:47:12.494543 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:47:12.495017 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:47:12.495426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:47:12.496031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:47:12.504785 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:12.505276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:12.505719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:12.506449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:12.506906 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:12.507344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:12.529517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for project 277e817efae04205bf58e32de7c168ce. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:47:12.535670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for user 19fb9c5c1cfd4cb2b33a7c22d7311ffe and project 277e817efae04205bf58e32de7c168ce. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:47:12.548730 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:47:12.551056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:47:12.601632 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e97f6839-1c9f-475d-af8f-3def4d8511d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.778294 Aug 27 05:47:12.602644 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3782/7612] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:47:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:47:12.614256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1220a272-a81d-4e39-9fe8-505f98b56c72 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:12.614879 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1220a272-a81d-4e39-9fe8-505f98b56c72 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:12.750621 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1220a272-a81d-4e39-9fe8-505f98b56c72 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:12.760435 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1220a272-a81d-4e39-9fe8-505f98b56c72 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1265 microversion: 2.1 time: 0.150155 Aug 27 05:47:12.761318 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3831/7613] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:12 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:13.782790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3aa10de0-ed2e-43d3-9216-bd1ec8a99eca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:13.783425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3aa10de0-ed2e-43d3-9216-bd1ec8a99eca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:13.791481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3aa10de0-ed2e-43d3-9216-bd1ec8a99eca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:13.792088 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3aa10de0-ed2e-43d3-9216-bd1ec8a99eca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:13.792822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3aa10de0-ed2e-43d3-9216-bd1ec8a99eca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:13.793920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3aa10de0-ed2e-43d3-9216-bd1ec8a99eca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:13.794594 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3aa10de0-ed2e-43d3-9216-bd1ec8a99eca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:13.795298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3aa10de0-ed2e-43d3-9216-bd1ec8a99eca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:13.907635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3aa10de0-ed2e-43d3-9216-bd1ec8a99eca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:13.918395 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3aa10de0-ed2e-43d3-9216-bd1ec8a99eca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1317 microversion: 2.1 time: 0.141163 Aug 27 05:47:13.920401 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3783/7614] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:13 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:14.941639 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3280953c-bf4c-4676-8608-5fdcd25fb09a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:14.942961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3280953c-bf4c-4676-8608-5fdcd25fb09a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:14.953534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3280953c-bf4c-4676-8608-5fdcd25fb09a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:14.954062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3280953c-bf4c-4676-8608-5fdcd25fb09a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:14.954514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3280953c-bf4c-4676-8608-5fdcd25fb09a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:14.955470 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3280953c-bf4c-4676-8608-5fdcd25fb09a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:14.955944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3280953c-bf4c-4676-8608-5fdcd25fb09a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:14.956594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3280953c-bf4c-4676-8608-5fdcd25fb09a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:15.170941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3280953c-bf4c-4676-8608-5fdcd25fb09a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:15.179172 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3280953c-bf4c-4676-8608-5fdcd25fb09a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1391 microversion: 2.1 time: 0.242261 Aug 27 05:47:15.179873 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3832/7615] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:14 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1391 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:15.478373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-885c5e88-e913-4fbd-af34-6fb92ff086a7 req-ae10607c-ee09-45ef-8534-068763df38d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcb524e-5bd5-4514-a68d-1807c5767ef4", "tag": "9cf5cc92-68d3-4e4f-92b0-ae87b82ef658"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:15.491538 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-885c5e88-e913-4fbd-af34-6fb92ff086a7 req-ae10607c-ee09-45ef-8534-068763df38d0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:15.492040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-885c5e88-e913-4fbd-af34-6fb92ff086a7 req-ae10607c-ee09-45ef-8534-068763df38d0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:15.492449 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-885c5e88-e913-4fbd-af34-6fb92ff086a7 req-ae10607c-ee09-45ef-8534-068763df38d0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:15.506399 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-885c5e88-e913-4fbd-af34-6fb92ff086a7 req-ae10607c-ee09-45ef-8534-068763df38d0 service nova] Creating event network-changed:9cf5cc92-68d3-4e4f-92b0-ae87b82ef658 for instance cbcb524e-5bd5-4514-a68d-1807c5767ef4 on n-h2-854823-1 Aug 27 05:47:15.512091 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-885c5e88-e913-4fbd-af34-6fb92ff086a7 req-ae10607c-ee09-45ef-8534-068763df38d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037625 Aug 27 05:47:15.513316 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3784/7616] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:47:16.202359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f2a78d45-d434-4357-bbae-6e2b099784b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:16.202941 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f2a78d45-d434-4357-bbae-6e2b099784b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:16.210560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2a78d45-d434-4357-bbae-6e2b099784b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:16.211057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2a78d45-d434-4357-bbae-6e2b099784b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:16.211506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2a78d45-d434-4357-bbae-6e2b099784b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:16.212209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2a78d45-d434-4357-bbae-6e2b099784b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:16.212719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2a78d45-d434-4357-bbae-6e2b099784b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:16.213156 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2a78d45-d434-4357-bbae-6e2b099784b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:16.347132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f2a78d45-d434-4357-bbae-6e2b099784b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:16.354967 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f2a78d45-d434-4357-bbae-6e2b099784b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1391 microversion: 2.1 time: 0.156777 Aug 27 05:47:16.355548 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3833/7617] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:16 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:17.376134 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-34ed7ce2-1e9f-4ad0-be29-c712500671b4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:17.376914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-34ed7ce2-1e9f-4ad0-be29-c712500671b4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:17.384402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34ed7ce2-1e9f-4ad0-be29-c712500671b4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:17.384947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34ed7ce2-1e9f-4ad0-be29-c712500671b4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:17.385400 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34ed7ce2-1e9f-4ad0-be29-c712500671b4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:17.386152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34ed7ce2-1e9f-4ad0-be29-c712500671b4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:17.386617 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34ed7ce2-1e9f-4ad0-be29-c712500671b4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:17.387052 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-34ed7ce2-1e9f-4ad0-be29-c712500671b4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:17.537607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-34ed7ce2-1e9f-4ad0-be29-c712500671b4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:17.545862 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-34ed7ce2-1e9f-4ad0-be29-c712500671b4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1391 microversion: 2.1 time: 0.174089 Aug 27 05:47:17.546465 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3785/7618] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:17 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:18.567610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6da93f6f-c22e-4eaf-b8f5-8585bc92c847 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:18.568296 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6da93f6f-c22e-4eaf-b8f5-8585bc92c847 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:18.575217 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6da93f6f-c22e-4eaf-b8f5-8585bc92c847 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:18.575725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6da93f6f-c22e-4eaf-b8f5-8585bc92c847 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:18.576181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6da93f6f-c22e-4eaf-b8f5-8585bc92c847 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:18.576938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6da93f6f-c22e-4eaf-b8f5-8585bc92c847 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:18.577418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6da93f6f-c22e-4eaf-b8f5-8585bc92c847 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:18.577866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6da93f6f-c22e-4eaf-b8f5-8585bc92c847 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:18.715206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6da93f6f-c22e-4eaf-b8f5-8585bc92c847 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:18.722918 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6da93f6f-c22e-4eaf-b8f5-8585bc92c847 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1391 microversion: 2.1 time: 0.159889 Aug 27 05:47:18.723512 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3834/7619] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:18 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:47:19.744073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ba3852ba-db93-4d26-b30f-2d73e54fe42b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:19.744796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ba3852ba-db93-4d26-b30f-2d73e54fe42b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:19.752465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ba3852ba-db93-4d26-b30f-2d73e54fe42b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:19.752996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ba3852ba-db93-4d26-b30f-2d73e54fe42b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:19.753439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ba3852ba-db93-4d26-b30f-2d73e54fe42b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:19.754139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ba3852ba-db93-4d26-b30f-2d73e54fe42b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:19.754602 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ba3852ba-db93-4d26-b30f-2d73e54fe42b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:19.755032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ba3852ba-db93-4d26-b30f-2d73e54fe42b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:19.886720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ba3852ba-db93-4d26-b30f-2d73e54fe42b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:19.894963 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ba3852ba-db93-4d26-b30f-2d73e54fe42b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1391 microversion: 2.1 time: 0.155190 Aug 27 05:47:19.895533 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3786/7620] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:19 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:20.915026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd3b6fcb-25ac-4ea1-81a4-44b81ce6168d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:20.915652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd3b6fcb-25ac-4ea1-81a4-44b81ce6168d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:20.923204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd3b6fcb-25ac-4ea1-81a4-44b81ce6168d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:20.923700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd3b6fcb-25ac-4ea1-81a4-44b81ce6168d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:20.924148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd3b6fcb-25ac-4ea1-81a4-44b81ce6168d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:20.924885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd3b6fcb-25ac-4ea1-81a4-44b81ce6168d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:20.925354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd3b6fcb-25ac-4ea1-81a4-44b81ce6168d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:20.925793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd3b6fcb-25ac-4ea1-81a4-44b81ce6168d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:21.055551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd3b6fcb-25ac-4ea1-81a4-44b81ce6168d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:21.063944 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd3b6fcb-25ac-4ea1-81a4-44b81ce6168d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1391 microversion: 2.1 time: 0.152251 Aug 27 05:47:21.064550 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3835/7621] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:20 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:21.627273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e1bd3f67-f672-48c5-854d-30f470ad4c3e req-286c3f38-0703-4cf3-83df-9e78d8790745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcb524e-5bd5-4514-a68d-1807c5767ef4", "name": "network-vif-plugged", "status": "completed", "tag": "9cf5cc92-68d3-4e4f-92b0-ae87b82ef658"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:21.638257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e1bd3f67-f672-48c5-854d-30f470ad4c3e req-286c3f38-0703-4cf3-83df-9e78d8790745 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:21.638748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e1bd3f67-f672-48c5-854d-30f470ad4c3e req-286c3f38-0703-4cf3-83df-9e78d8790745 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:21.639199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e1bd3f67-f672-48c5-854d-30f470ad4c3e req-286c3f38-0703-4cf3-83df-9e78d8790745 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:21.651177 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e1bd3f67-f672-48c5-854d-30f470ad4c3e req-286c3f38-0703-4cf3-83df-9e78d8790745 service nova] Creating event network-vif-plugged:9cf5cc92-68d3-4e4f-92b0-ae87b82ef658 for instance cbcb524e-5bd5-4514-a68d-1807c5767ef4 on n-h2-854823-1 Aug 27 05:47:21.657632 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e1bd3f67-f672-48c5-854d-30f470ad4c3e req-286c3f38-0703-4cf3-83df-9e78d8790745 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033365 Aug 27 05:47:21.658255 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3787/7622] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:47:22.085761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9c206ba-040d-4047-bdf2-471101782b22 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:22.086384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9c206ba-040d-4047-bdf2-471101782b22 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:22.093248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9c206ba-040d-4047-bdf2-471101782b22 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:22.093743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9c206ba-040d-4047-bdf2-471101782b22 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:22.094189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9c206ba-040d-4047-bdf2-471101782b22 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:22.094972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9c206ba-040d-4047-bdf2-471101782b22 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:22.095464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9c206ba-040d-4047-bdf2-471101782b22 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:22.095927 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9c206ba-040d-4047-bdf2-471101782b22 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:22.227216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9c206ba-040d-4047-bdf2-471101782b22 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:22.235530 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9c206ba-040d-4047-bdf2-471101782b22 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1391 microversion: 2.1 time: 0.153620 Aug 27 05:47:22.236125 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3836/7623] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:22 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:23.256891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5b336c03-aaf8-4cf6-b2e5-db0372df1cb5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:23.257603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5b336c03-aaf8-4cf6-b2e5-db0372df1cb5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:23.259613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:23.260424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:23.270439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b336c03-aaf8-4cf6-b2e5-db0372df1cb5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:23.270439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b336c03-aaf8-4cf6-b2e5-db0372df1cb5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:23.270439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b336c03-aaf8-4cf6-b2e5-db0372df1cb5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:23.270439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b336c03-aaf8-4cf6-b2e5-db0372df1cb5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:23.270439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b336c03-aaf8-4cf6-b2e5-db0372df1cb5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:23.270439 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b336c03-aaf8-4cf6-b2e5-db0372df1cb5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:23.410143 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5b336c03-aaf8-4cf6-b2e5-db0372df1cb5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:23.417939 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5b336c03-aaf8-4cf6-b2e5-db0372df1cb5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1562 microversion: 2.1 time: 0.165389 Aug 27 05:47:23.418540 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3788/7624] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:23 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:23.438674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8cecb60b-cce7-4675-857f-5e35e5338fd6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:23.439506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8cecb60b-cce7-4675-857f-5e35e5338fd6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:23.441422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:23.447872 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cecb60b-cce7-4675-857f-5e35e5338fd6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:23.448370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cecb60b-cce7-4675-857f-5e35e5338fd6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:23.448871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cecb60b-cce7-4675-857f-5e35e5338fd6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:23.449939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cecb60b-cce7-4675-857f-5e35e5338fd6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:23.450148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cecb60b-cce7-4675-857f-5e35e5338fd6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:23.450613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cecb60b-cce7-4675-857f-5e35e5338fd6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:23.588744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8cecb60b-cce7-4675-857f-5e35e5338fd6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:23.597234 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8cecb60b-cce7-4675-857f-5e35e5338fd6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1562 microversion: 2.1 time: 0.162978 Aug 27 05:47:23.597865 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3837/7625] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:23 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:25.192668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b5fad855-d2d6-4a2d-913e-3ec5f59c6f70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:47:25.193299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b5fad855-d2d6-4a2d-913e-3ec5f59c6f70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:25.194761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f885b8bd-195d-48f2-8075-5fe0568b6bef req-67cb4687-5b9c-46d7-bf54-7c59d3d3ef01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcb524e-5bd5-4514-a68d-1807c5767ef4", "tag": "9cf5cc92-68d3-4e4f-92b0-ae87b82ef658"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:25.201895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5fad855-d2d6-4a2d-913e-3ec5f59c6f70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:25.202406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5fad855-d2d6-4a2d-913e-3ec5f59c6f70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:25.202935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5fad855-d2d6-4a2d-913e-3ec5f59c6f70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:25.203706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5fad855-d2d6-4a2d-913e-3ec5f59c6f70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:25.208560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5fad855-d2d6-4a2d-913e-3ec5f59c6f70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:25.208560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b5fad855-d2d6-4a2d-913e-3ec5f59c6f70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:25.212446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f885b8bd-195d-48f2-8075-5fe0568b6bef req-67cb4687-5b9c-46d7-bf54-7c59d3d3ef01 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:25.212996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f885b8bd-195d-48f2-8075-5fe0568b6bef req-67cb4687-5b9c-46d7-bf54-7c59d3d3ef01 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:25.213433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f885b8bd-195d-48f2-8075-5fe0568b6bef req-67cb4687-5b9c-46d7-bf54-7c59d3d3ef01 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:25.253877 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f885b8bd-195d-48f2-8075-5fe0568b6bef req-67cb4687-5b9c-46d7-bf54-7c59d3d3ef01 service nova] Creating event network-changed:9cf5cc92-68d3-4e4f-92b0-ae87b82ef658 for instance cbcb524e-5bd5-4514-a68d-1807c5767ef4 on n-h2-854823-1 Aug 27 05:47:25.263670 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f885b8bd-195d-48f2-8075-5fe0568b6bef req-67cb4687-5b9c-46d7-bf54-7c59d3d3ef01 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072082 Aug 27 05:47:25.269549 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3838/7626] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:47:25.373109 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b5fad855-d2d6-4a2d-913e-3ec5f59c6f70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:47:25.386783 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b5fad855-d2d6-4a2d-913e-3ec5f59c6f70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1562 microversion: 2.1 time: 0.197945 Aug 27 05:47:25.388144 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3789/7627] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:47:25 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1562 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:47:50.695215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:50.696143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=38 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:47:50.700770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90dad1ea-bb52-461e-8f10-79c84a15b4ba tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:47:50.703039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90dad1ea-bb52-461e-8f10-79c84a15b4ba tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:47:50.710531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90dad1ea-bb52-461e-8f10-79c84a15b4ba tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:50.711029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90dad1ea-bb52-461e-8f10-79c84a15b4ba tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:50.711569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90dad1ea-bb52-461e-8f10-79c84a15b4ba tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:50.712277 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90dad1ea-bb52-461e-8f10-79c84a15b4ba tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:47:50.712794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90dad1ea-bb52-461e-8f10-79c84a15b4ba tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:47:50.713240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90dad1ea-bb52-461e-8f10-79c84a15b4ba tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:47:50.765262 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90dad1ea-bb52-461e-8f10-79c84a15b4ba tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4/action" status: 200 len: 24568 microversion: 2.1 time: 0.072021 Aug 27 05:47:50.766168 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3839/7628] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:47:50 2022] POST /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4/action => generated 24568 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:48:01.756948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5573078f-0d95-42cb-a07d-b2ec59b094ce tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:01.757496 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5573078f-0d95-42cb-a07d-b2ec59b094ce tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:01.759789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:01.760452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=36 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:01.767107 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5573078f-0d95-42cb-a07d-b2ec59b094ce tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:01.767718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5573078f-0d95-42cb-a07d-b2ec59b094ce tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:01.768219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5573078f-0d95-42cb-a07d-b2ec59b094ce tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:01.769224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5573078f-0d95-42cb-a07d-b2ec59b094ce tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:01.769693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5573078f-0d95-42cb-a07d-b2ec59b094ce tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:01.770128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5573078f-0d95-42cb-a07d-b2ec59b094ce tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:01.841025 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5573078f-0d95-42cb-a07d-b2ec59b094ce tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4/action" status: 202 len: 0 microversion: 2.1 time: 0.088054 Aug 27 05:48:01.841909 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3790/7629] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:48:01 2022] POST /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:48:01.851236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca5b0f5f-b1fc-46dc-98dc-f7b8ef4c51c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:01.852011 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca5b0f5f-b1fc-46dc-98dc-f7b8ef4c51c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:01.854960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:01.855732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:01.864684 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca5b0f5f-b1fc-46dc-98dc-f7b8ef4c51c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:01.865209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca5b0f5f-b1fc-46dc-98dc-f7b8ef4c51c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:01.865664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca5b0f5f-b1fc-46dc-98dc-f7b8ef4c51c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:01.866384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca5b0f5f-b1fc-46dc-98dc-f7b8ef4c51c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:01.866856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca5b0f5f-b1fc-46dc-98dc-f7b8ef4c51c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:01.867299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca5b0f5f-b1fc-46dc-98dc-f7b8ef4c51c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:02.006545 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca5b0f5f-b1fc-46dc-98dc-f7b8ef4c51c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:02.015498 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca5b0f5f-b1fc-46dc-98dc-f7b8ef4c51c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1686 microversion: 2.1 time: 0.169184 Aug 27 05:48:02.016090 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3840/7630] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:01 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:03.040384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2cc23f00-c7f7-4faf-884d-4161815c2817 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:03.041110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2cc23f00-c7f7-4faf-884d-4161815c2817 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:03.047641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2cc23f00-c7f7-4faf-884d-4161815c2817 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:03.048120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2cc23f00-c7f7-4faf-884d-4161815c2817 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:03.048571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2cc23f00-c7f7-4faf-884d-4161815c2817 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:03.049257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2cc23f00-c7f7-4faf-884d-4161815c2817 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:03.049709 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2cc23f00-c7f7-4faf-884d-4161815c2817 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:03.050131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2cc23f00-c7f7-4faf-884d-4161815c2817 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:03.188681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-2cc23f00-c7f7-4faf-884d-4161815c2817 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:03.196984 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2cc23f00-c7f7-4faf-884d-4161815c2817 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1666 microversion: 2.1 time: 0.162362 Aug 27 05:48:03.197571 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3791/7631] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:03 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1666 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:04.297811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f45d5030-9526-461a-9a57-1b1b77193518 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:04.300134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f45d5030-9526-461a-9a57-1b1b77193518 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:04.307406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f45d5030-9526-461a-9a57-1b1b77193518 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:04.307905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f45d5030-9526-461a-9a57-1b1b77193518 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:04.308366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f45d5030-9526-461a-9a57-1b1b77193518 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:04.309106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f45d5030-9526-461a-9a57-1b1b77193518 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:04.309699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f45d5030-9526-461a-9a57-1b1b77193518 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:04.310007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f45d5030-9526-461a-9a57-1b1b77193518 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:04.361521 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f45d5030-9526-461a-9a57-1b1b77193518 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4/action" status: 200 len: 32647 microversion: 2.1 time: 0.067477 Aug 27 05:48:04.362175 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3841/7632] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:48:04 2022] POST /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4/action => generated 32647 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:48:04.374902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c2fe347d-7147-4c83-89e9-1e6273dfe9b3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:04.375454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c2fe347d-7147-4c83-89e9-1e6273dfe9b3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:04.382616 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2fe347d-7147-4c83-89e9-1e6273dfe9b3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:04.383110 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2fe347d-7147-4c83-89e9-1e6273dfe9b3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:04.383652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2fe347d-7147-4c83-89e9-1e6273dfe9b3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:04.384361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2fe347d-7147-4c83-89e9-1e6273dfe9b3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:04.384856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2fe347d-7147-4c83-89e9-1e6273dfe9b3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:04.385294 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c2fe347d-7147-4c83-89e9-1e6273dfe9b3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:04.453822 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c2fe347d-7147-4c83-89e9-1e6273dfe9b3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4/action" status: 202 len: 0 microversion: 2.1 time: 0.082950 Aug 27 05:48:04.454681 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3792/7633] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:48:04 2022] POST /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:48:04.463744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eeb5a8c8-fce3-4e53-b7f9-bdeb35057c05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:04.464477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eeb5a8c8-fce3-4e53-b7f9-bdeb35057c05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:04.471552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeb5a8c8-fce3-4e53-b7f9-bdeb35057c05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:04.472059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeb5a8c8-fce3-4e53-b7f9-bdeb35057c05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:04.472550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeb5a8c8-fce3-4e53-b7f9-bdeb35057c05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:04.473255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeb5a8c8-fce3-4e53-b7f9-bdeb35057c05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:04.473965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeb5a8c8-fce3-4e53-b7f9-bdeb35057c05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:04.474172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeb5a8c8-fce3-4e53-b7f9-bdeb35057c05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:04.609500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eeb5a8c8-fce3-4e53-b7f9-bdeb35057c05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:04.618835 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eeb5a8c8-fce3-4e53-b7f9-bdeb35057c05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1673 microversion: 2.1 time: 0.159541 Aug 27 05:48:04.619471 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3842/7634] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:04 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:05.641149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-640cd7b9-e7a3-4afd-842f-4bb2b0c88358 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:05.641856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-640cd7b9-e7a3-4afd-842f-4bb2b0c88358 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:05.649625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-640cd7b9-e7a3-4afd-842f-4bb2b0c88358 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:05.650111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-640cd7b9-e7a3-4afd-842f-4bb2b0c88358 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:05.650552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-640cd7b9-e7a3-4afd-842f-4bb2b0c88358 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:05.651239 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-640cd7b9-e7a3-4afd-842f-4bb2b0c88358 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:05.651698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-640cd7b9-e7a3-4afd-842f-4bb2b0c88358 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:05.652124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-640cd7b9-e7a3-4afd-842f-4bb2b0c88358 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:05.787145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-640cd7b9-e7a3-4afd-842f-4bb2b0c88358 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:05.795081 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-640cd7b9-e7a3-4afd-842f-4bb2b0c88358 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1681 microversion: 2.1 time: 0.158165 Aug 27 05:48:05.795660 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3793/7635] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:05 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:05.902914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a9de2b1-54f5-4581-ba74-8a619d514321 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:05.905245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a9de2b1-54f5-4581-ba74-8a619d514321 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:05.913498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a9de2b1-54f5-4581-ba74-8a619d514321 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:05.914009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a9de2b1-54f5-4581-ba74-8a619d514321 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:05.914471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a9de2b1-54f5-4581-ba74-8a619d514321 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:05.915191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a9de2b1-54f5-4581-ba74-8a619d514321 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:05.915663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a9de2b1-54f5-4581-ba74-8a619d514321 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:05.916112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a9de2b1-54f5-4581-ba74-8a619d514321 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:05.967760 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a9de2b1-54f5-4581-ba74-8a619d514321 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4/action" status: 200 len: 36165 microversion: 2.1 time: 0.068944 Aug 27 05:48:05.968405 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3843/7636] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:48:05 2022] POST /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4/action => generated 36165 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:48:06.994996 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3ad76a6e-54f1-4d35-93da-148ae42f92a8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:06.995500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3ad76a6e-54f1-4d35-93da-148ae42f92a8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:07.001977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f85048bd-7b16-4912-9e57-320db9b53ea6 req-fc68bc8c-f9e7-4663-a633-7e4cd1d3400a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcb524e-5bd5-4514-a68d-1807c5767ef4", "tag": "9cf5cc92-68d3-4e4f-92b0-ae87b82ef658"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:07.012447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ad76a6e-54f1-4d35-93da-148ae42f92a8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:07.012990 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ad76a6e-54f1-4d35-93da-148ae42f92a8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:07.013438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ad76a6e-54f1-4d35-93da-148ae42f92a8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:07.014159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ad76a6e-54f1-4d35-93da-148ae42f92a8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:07.014618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ad76a6e-54f1-4d35-93da-148ae42f92a8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:07.015254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3ad76a6e-54f1-4d35-93da-148ae42f92a8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:07.016252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f85048bd-7b16-4912-9e57-320db9b53ea6 req-fc68bc8c-f9e7-4663-a633-7e4cd1d3400a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:07.016776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f85048bd-7b16-4912-9e57-320db9b53ea6 req-fc68bc8c-f9e7-4663-a633-7e4cd1d3400a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:07.017221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f85048bd-7b16-4912-9e57-320db9b53ea6 req-fc68bc8c-f9e7-4663-a633-7e4cd1d3400a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:07.029839 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f85048bd-7b16-4912-9e57-320db9b53ea6 req-fc68bc8c-f9e7-4663-a633-7e4cd1d3400a service nova] Creating event network-changed:9cf5cc92-68d3-4e4f-92b0-ae87b82ef658 for instance cbcb524e-5bd5-4514-a68d-1807c5767ef4 on n-h2-854823-1 Aug 27 05:48:07.035050 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f85048bd-7b16-4912-9e57-320db9b53ea6 req-fc68bc8c-f9e7-4663-a633-7e4cd1d3400a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037059 Aug 27 05:48:07.036167 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3844/7637] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:48:07.043053 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3ad76a6e-54f1-4d35-93da-148ae42f92a8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Going to try to terminate instance {{(pid=128870) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:48:07.130839 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3ad76a6e-54f1-4d35-93da-148ae42f92a8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 204 len: 0 microversion: 2.1 time: 0.139620 Aug 27 05:48:07.131857 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3794/7638] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:48:06 2022] DELETE /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:48:07.142549 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50b3e2c6-b459-45b0-ba09-d53e049b9a42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:07.143662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50b3e2c6-b459-45b0-ba09-d53e049b9a42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:07.151490 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b3e2c6-b459-45b0-ba09-d53e049b9a42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:07.152353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b3e2c6-b459-45b0-ba09-d53e049b9a42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:07.153090 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b3e2c6-b459-45b0-ba09-d53e049b9a42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:07.154073 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b3e2c6-b459-45b0-ba09-d53e049b9a42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:07.154821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b3e2c6-b459-45b0-ba09-d53e049b9a42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:07.155579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b3e2c6-b459-45b0-ba09-d53e049b9a42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:07.323172 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50b3e2c6-b459-45b0-ba09-d53e049b9a42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:07.331020 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50b3e2c6-b459-45b0-ba09-d53e049b9a42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1687 microversion: 2.1 time: 0.193694 Aug 27 05:48:07.331597 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3845/7639] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:07 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1687 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:08.354524 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b96d6a2c-1e5a-4c06-83a7-afbf5e1468e6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:08.355233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b96d6a2c-1e5a-4c06-83a7-afbf5e1468e6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:08.362030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b96d6a2c-1e5a-4c06-83a7-afbf5e1468e6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:08.362520 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b96d6a2c-1e5a-4c06-83a7-afbf5e1468e6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:08.362961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b96d6a2c-1e5a-4c06-83a7-afbf5e1468e6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:08.364152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b96d6a2c-1e5a-4c06-83a7-afbf5e1468e6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:08.364676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b96d6a2c-1e5a-4c06-83a7-afbf5e1468e6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:08.365129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b96d6a2c-1e5a-4c06-83a7-afbf5e1468e6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:08.513916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b96d6a2c-1e5a-4c06-83a7-afbf5e1468e6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:08.523531 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b96d6a2c-1e5a-4c06-83a7-afbf5e1468e6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1687 microversion: 2.1 time: 0.173318 Aug 27 05:48:08.524340 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3795/7640] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:08 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:48:09.530338 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5a609178-542e-405c-89f2-d761135aa578 req-7b0911d5-16f9-455e-98d5-f03b6d25fc61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcb524e-5bd5-4514-a68d-1807c5767ef4", "name": "network-vif-deleted", "tag": "9cf5cc92-68d3-4e4f-92b0-ae87b82ef658"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:09.543223 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5a609178-542e-405c-89f2-d761135aa578 req-7b0911d5-16f9-455e-98d5-f03b6d25fc61 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:09.543855 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5a609178-542e-405c-89f2-d761135aa578 req-7b0911d5-16f9-455e-98d5-f03b6d25fc61 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:09.544540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5a609178-542e-405c-89f2-d761135aa578 req-7b0911d5-16f9-455e-98d5-f03b6d25fc61 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:09.546719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-29856351-d176-49c1-9696-a866b501e7f3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:09.547313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-29856351-d176-49c1-9696-a866b501e7f3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:09.554868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29856351-d176-49c1-9696-a866b501e7f3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:09.555530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29856351-d176-49c1-9696-a866b501e7f3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:09.556000 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29856351-d176-49c1-9696-a866b501e7f3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:09.556749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29856351-d176-49c1-9696-a866b501e7f3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:09.557282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29856351-d176-49c1-9696-a866b501e7f3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:09.557630 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-29856351-d176-49c1-9696-a866b501e7f3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:09.560055 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5a609178-542e-405c-89f2-d761135aa578 req-7b0911d5-16f9-455e-98d5-f03b6d25fc61 service nova] Creating event network-vif-deleted:9cf5cc92-68d3-4e4f-92b0-ae87b82ef658 for instance cbcb524e-5bd5-4514-a68d-1807c5767ef4 on n-h2-854823-1 Aug 27 05:48:09.565207 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5a609178-542e-405c-89f2-d761135aa578 req-7b0911d5-16f9-455e-98d5-f03b6d25fc61 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038584 Aug 27 05:48:09.566190 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3846/7641] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:48:09.630437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-29856351-d176-49c1-9696-a866b501e7f3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:09.638618 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-29856351-d176-49c1-9696-a866b501e7f3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 200 len: 1350 microversion: 2.1 time: 0.096099 Aug 27 05:48:09.639205 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3796/7642] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:09 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:48:10.662004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa22d88f-fb0e-459f-95da-001d9045d37e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:10.662714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aa22d88f-fb0e-459f-95da-001d9045d37e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: cbcb524e-5bd5-4514-a68d-1807c5767ef4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:10.669049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa22d88f-fb0e-459f-95da-001d9045d37e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:10.669556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa22d88f-fb0e-459f-95da-001d9045d37e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:10.670014 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa22d88f-fb0e-459f-95da-001d9045d37e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:10.670727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa22d88f-fb0e-459f-95da-001d9045d37e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:10.671206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa22d88f-fb0e-459f-95da-001d9045d37e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:10.671694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa22d88f-fb0e-459f-95da-001d9045d37e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:10.684839 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-aa22d88f-fb0e-459f-95da-001d9045d37e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] HTTP exception thrown: Instance cbcb524e-5bd5-4514-a68d-1807c5767ef4 could not be found. Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa22d88f-fb0e-459f-95da-001d9045d37e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Request method failure captured: Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 HTTP/1.1 Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCa_ZB1xxAu3ecBWGCK15_VmwaqF85neIEJdIAs7jNcxu1djgNXg7VI5VEOXS6WWCK2ve_0FSkl7NBlNjuccjBtXyVgh36GbN5jZ_YNqVuaf7D46o15NEfIZsTXQ1HZhwQ_n0Ff1o9_p7xlfNP4YcpgeNU05P-LCu3qnPhIYmdM1z8e8 Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 277e817efae04205bf58e32de7c168ce Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/277e817efae04205bf58e32de7c168ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_277e817efae04205bf58e32de7c168ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/277e817efae04205bf58e32de7c168ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/277e817efae04205bf58e32de7c168ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 277e817efae04205bf58e32de7c168ce Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestNetworkAdvancedServerOps-1233409680-project Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 19fb9c5c1cfd4cb2b33a7c22d7311ffe Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1233409680-project Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance cbcb524e-5bd5-4514-a68d-1807c5767ef4 could not be found. Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'cbcb524e-5bd5-4514-a68d-1807c5767ef4'} Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbcb524e-5bd5-4514-a68d-1807c5767ef4 could not be found. Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbcb524e-5bd5-4514-a68d-1807c5767ef4 could not be found. Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:48:10.686478 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:48:10.692236 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:48:10.692236 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:48:10.692236 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:48:10.692236 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:48:10.692236 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:48:10.692236 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:48:10.692236 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbcb524e-5bd5-4514-a68d-1807c5767ef4 could not be found. Aug 27 05:48:10.692236 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:48:10.692236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa22d88f-fb0e-459f-95da-001d9045d37e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Returning 404 to user: Instance cbcb524e-5bd5-4514-a68d-1807c5767ef4 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:48:10.692236 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa22d88f-fb0e-459f-95da-001d9045d37e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4" status: 404 len: 111 microversion: 2.1 time: 0.031339 Aug 27 05:48:10.692236 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3847/7643] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:10 2022] GET /compute/v2.1/servers/cbcb524e-5bd5-4514-a68d-1807c5767ef4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 05:48:14.342732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ad521908-fedb-4fe2-a4b7-e9261a8f2544 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '.version_select at 0x7f1f219d7e50>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:14.365515 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ad521908-fedb-4fe2-a4b7-e9261a8f2544 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-773239502" status: 202 len: 0 microversion: 2.1 time: 0.028169 Aug 27 05:48:14.366118 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3797/7644] 10.222.0.79 () {58 vars in 1281 bytes} [Sat Aug 27 05:48:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-773239502 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:48:14.396714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a51a8486-fc31-4d36-92b0-5fe60ac076d4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'create', calling method: .version_select at 0x7f1f20439550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1462809902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+XsBIZIVJweE0WWwCmkLVJsSqeiGgkbLFqslbWpmqRP20RgfWK6bGK0cGMC2/QWuWmYjkPMpifXZgsVI+RfbRvBSEBLw1LYJ2dO5QEVYyo23Bdjjz63B1ouz0wfkhNug=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:14.412905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-a51a8486-fc31-4d36-92b0-5fe60ac076d4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for project 277e817efae04205bf58e32de7c168ce. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:48:14.419007 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-a51a8486-fc31-4d36-92b0-5fe60ac076d4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for user 19fb9c5c1cfd4cb2b33a7c22d7311ffe and project 277e817efae04205bf58e32de7c168ce. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:48:14.443822 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a51a8486-fc31-4d36-92b0-5fe60ac076d4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051804 Aug 27 05:48:14.444765 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3848/7645] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:48:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:48:19.792214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:19.797226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-482414639", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "a507afed-47eb-4345-8cd6-05f840de25a3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1462809902", "security_groups": [{"name": "tempest-secgroup-smoke-853773338"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:19.923136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] validate_networks() for [('a507afed-47eb-4345-8cd6-05f840de25a3', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:48:20.376338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:48:20.377618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:48:20.378092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:48:20.378502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:48:20.378980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:48:20.392802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:20.393225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:20.393659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:20.394397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:20.394897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:20.395323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:20.420919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for project 277e817efae04205bf58e32de7c168ce. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:48:20.431162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for user 19fb9c5c1cfd4cb2b33a7c22d7311ffe and project 277e817efae04205bf58e32de7c168ce. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:48:20.445861 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:48:20.448318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:48:20.538894 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-92c0f450-c3c9-445e-a80e-4ded34957af4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.747990 Aug 27 05:48:20.540204 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3798/7646] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:48:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:48:20.553718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7b83d63-828f-42dd-8fd2-f38317fbab64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:20.554719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d7b83d63-828f-42dd-8fd2-f38317fbab64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:20.634553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d7b83d63-828f-42dd-8fd2-f38317fbab64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:20.642248 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7b83d63-828f-42dd-8fd2-f38317fbab64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1266 microversion: 2.1 time: 0.095156 Aug 27 05:48:20.644175 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3849/7647] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:20 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:48:21.671755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a866b301-340d-4347-be8f-9af3a4c9e03a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:21.672481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a866b301-340d-4347-be8f-9af3a4c9e03a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:21.684325 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a866b301-340d-4347-be8f-9af3a4c9e03a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:21.685302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a866b301-340d-4347-be8f-9af3a4c9e03a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:21.686004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a866b301-340d-4347-be8f-9af3a4c9e03a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:21.687251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a866b301-340d-4347-be8f-9af3a4c9e03a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:21.687944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a866b301-340d-4347-be8f-9af3a4c9e03a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:21.688718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a866b301-340d-4347-be8f-9af3a4c9e03a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:21.774293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a866b301-340d-4347-be8f-9af3a4c9e03a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:21.783800 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a866b301-340d-4347-be8f-9af3a4c9e03a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1336 microversion: 2.1 time: 0.118289 Aug 27 05:48:21.789723 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3799/7648] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:21 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1336 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:22.806473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ffd8545c-6f8a-4f58-a6ad-e1fe7fac1204 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:22.807305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ffd8545c-6f8a-4f58-a6ad-e1fe7fac1204 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:22.809662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=32 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:22.818029 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffd8545c-6f8a-4f58-a6ad-e1fe7fac1204 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:22.818660 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffd8545c-6f8a-4f58-a6ad-e1fe7fac1204 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:22.819187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffd8545c-6f8a-4f58-a6ad-e1fe7fac1204 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:22.820019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffd8545c-6f8a-4f58-a6ad-e1fe7fac1204 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:22.820594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffd8545c-6f8a-4f58-a6ad-e1fe7fac1204 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:22.821356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffd8545c-6f8a-4f58-a6ad-e1fe7fac1204 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:22.976556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ffd8545c-6f8a-4f58-a6ad-e1fe7fac1204 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:22.985211 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ffd8545c-6f8a-4f58-a6ad-e1fe7fac1204 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1391 microversion: 2.1 time: 0.183471 Aug 27 05:48:22.985815 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3850/7649] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:22 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:23.165645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e38f3a74-77bf-46af-87f3-c68a4edb1038 req-3ed008bc-4f3e-4ad5-bef1-40e87ecfafb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12c38601-a723-4e25-9c2f-bd9aa34a129d", "tag": "438f0405-844f-4782-ab58-f97e5060ed23"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:23.182051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e38f3a74-77bf-46af-87f3-c68a4edb1038 req-3ed008bc-4f3e-4ad5-bef1-40e87ecfafb0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:23.182893 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e38f3a74-77bf-46af-87f3-c68a4edb1038 req-3ed008bc-4f3e-4ad5-bef1-40e87ecfafb0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:23.183551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e38f3a74-77bf-46af-87f3-c68a4edb1038 req-3ed008bc-4f3e-4ad5-bef1-40e87ecfafb0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:23.196383 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e38f3a74-77bf-46af-87f3-c68a4edb1038 req-3ed008bc-4f3e-4ad5-bef1-40e87ecfafb0 service nova] Creating event network-changed:438f0405-844f-4782-ab58-f97e5060ed23 for instance 12c38601-a723-4e25-9c2f-bd9aa34a129d on n-h1-854823-1 Aug 27 05:48:23.201511 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e38f3a74-77bf-46af-87f3-c68a4edb1038 req-3ed008bc-4f3e-4ad5-bef1-40e87ecfafb0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039985 Aug 27 05:48:23.202123 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3800/7650] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:48:24.007421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-61234088-8b1d-42bb-9ca6-42dc3d0d989c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:24.008051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-61234088-8b1d-42bb-9ca6-42dc3d0d989c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:24.014640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61234088-8b1d-42bb-9ca6-42dc3d0d989c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:24.015147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61234088-8b1d-42bb-9ca6-42dc3d0d989c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:24.015601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61234088-8b1d-42bb-9ca6-42dc3d0d989c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:24.016314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61234088-8b1d-42bb-9ca6-42dc3d0d989c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:24.016815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61234088-8b1d-42bb-9ca6-42dc3d0d989c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:24.017267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61234088-8b1d-42bb-9ca6-42dc3d0d989c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:24.149551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-61234088-8b1d-42bb-9ca6-42dc3d0d989c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:24.157459 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-61234088-8b1d-42bb-9ca6-42dc3d0d989c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1391 microversion: 2.1 time: 0.153990 Aug 27 05:48:24.158069 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3851/7651] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:24 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:48:25.179962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-75e88a1d-aed5-48b4-afcb-262700c2bd74 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:25.180721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-75e88a1d-aed5-48b4-afcb-262700c2bd74 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:25.186904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75e88a1d-aed5-48b4-afcb-262700c2bd74 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:25.187393 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75e88a1d-aed5-48b4-afcb-262700c2bd74 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:25.187836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75e88a1d-aed5-48b4-afcb-262700c2bd74 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:25.188548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75e88a1d-aed5-48b4-afcb-262700c2bd74 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:25.189022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75e88a1d-aed5-48b4-afcb-262700c2bd74 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:25.189453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-75e88a1d-aed5-48b4-afcb-262700c2bd74 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:25.326780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-75e88a1d-aed5-48b4-afcb-262700c2bd74 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:25.334733 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-75e88a1d-aed5-48b4-afcb-262700c2bd74 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1391 microversion: 2.1 time: 0.159992 Aug 27 05:48:25.335316 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3801/7652] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:25 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:26.355573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aec6a365-56f9-420d-b254-9f44c884daa8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:26.356123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aec6a365-56f9-420d-b254-9f44c884daa8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:26.363382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec6a365-56f9-420d-b254-9f44c884daa8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:26.363918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec6a365-56f9-420d-b254-9f44c884daa8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:26.364412 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec6a365-56f9-420d-b254-9f44c884daa8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:26.365188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec6a365-56f9-420d-b254-9f44c884daa8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:26.365662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec6a365-56f9-420d-b254-9f44c884daa8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:26.366106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec6a365-56f9-420d-b254-9f44c884daa8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:26.501176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aec6a365-56f9-420d-b254-9f44c884daa8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:26.510408 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aec6a365-56f9-420d-b254-9f44c884daa8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1391 microversion: 2.1 time: 0.158939 Aug 27 05:48:26.510988 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3852/7653] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:26 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:27.531686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ab9e232b-97e0-4717-bf17-e6791640e64f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:27.532304 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ab9e232b-97e0-4717-bf17-e6791640e64f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:27.540176 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab9e232b-97e0-4717-bf17-e6791640e64f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:27.540698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab9e232b-97e0-4717-bf17-e6791640e64f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:27.541137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab9e232b-97e0-4717-bf17-e6791640e64f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:27.541834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab9e232b-97e0-4717-bf17-e6791640e64f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:27.542291 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab9e232b-97e0-4717-bf17-e6791640e64f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:27.542718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ab9e232b-97e0-4717-bf17-e6791640e64f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:27.680380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ab9e232b-97e0-4717-bf17-e6791640e64f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:27.688283 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ab9e232b-97e0-4717-bf17-e6791640e64f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1391 microversion: 2.1 time: 0.160506 Aug 27 05:48:27.691571 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3802/7654] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:27 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:28.713632 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f82ef75-8487-49c5-a4de-20f13df2b48f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:28.714262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f82ef75-8487-49c5-a4de-20f13df2b48f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:28.721306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f82ef75-8487-49c5-a4de-20f13df2b48f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:28.721813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f82ef75-8487-49c5-a4de-20f13df2b48f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:28.722267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f82ef75-8487-49c5-a4de-20f13df2b48f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:28.723484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f82ef75-8487-49c5-a4de-20f13df2b48f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:28.723957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f82ef75-8487-49c5-a4de-20f13df2b48f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:28.724398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f82ef75-8487-49c5-a4de-20f13df2b48f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:28.857094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f82ef75-8487-49c5-a4de-20f13df2b48f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:28.865433 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f82ef75-8487-49c5-a4de-20f13df2b48f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1391 microversion: 2.1 time: 0.155768 Aug 27 05:48:28.866004 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3853/7655] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:28 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:29.708099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-15e24ef7-1131-44fc-b207-b1a7a546b314 req-8f490618-1b5f-468e-8bfb-1e38f3372f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12c38601-a723-4e25-9c2f-bd9aa34a129d", "name": "network-vif-plugged", "status": "completed", "tag": "438f0405-844f-4782-ab58-f97e5060ed23"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:29.719763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-15e24ef7-1131-44fc-b207-b1a7a546b314 req-8f490618-1b5f-468e-8bfb-1e38f3372f3f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:29.720251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-15e24ef7-1131-44fc-b207-b1a7a546b314 req-8f490618-1b5f-468e-8bfb-1e38f3372f3f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:29.720721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-15e24ef7-1131-44fc-b207-b1a7a546b314 req-8f490618-1b5f-468e-8bfb-1e38f3372f3f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:29.731864 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-15e24ef7-1131-44fc-b207-b1a7a546b314 req-8f490618-1b5f-468e-8bfb-1e38f3372f3f service nova] Creating event network-vif-plugged:438f0405-844f-4782-ab58-f97e5060ed23 for instance 12c38601-a723-4e25-9c2f-bd9aa34a129d on n-h1-854823-1 Aug 27 05:48:29.736955 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-15e24ef7-1131-44fc-b207-b1a7a546b314 req-8f490618-1b5f-468e-8bfb-1e38f3372f3f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033122 Aug 27 05:48:29.737662 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3803/7656] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:48:29.886442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a329935-fdfc-4cb4-aa81-71202665f639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:29.887119 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a329935-fdfc-4cb4-aa81-71202665f639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:29.893987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a329935-fdfc-4cb4-aa81-71202665f639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:29.894491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a329935-fdfc-4cb4-aa81-71202665f639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:29.895031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a329935-fdfc-4cb4-aa81-71202665f639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:29.895777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a329935-fdfc-4cb4-aa81-71202665f639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:29.896253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a329935-fdfc-4cb4-aa81-71202665f639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:29.896730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a329935-fdfc-4cb4-aa81-71202665f639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:30.361768 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a329935-fdfc-4cb4-aa81-71202665f639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:30.370280 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a329935-fdfc-4cb4-aa81-71202665f639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1391 microversion: 2.1 time: 0.488008 Aug 27 05:48:30.370868 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3854/7657] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:29 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1391 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:31.388565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:31.389347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:31.394707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-07210f2e-0daf-4577-bfe6-b486c4263ac9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:31.395963 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-07210f2e-0daf-4577-bfe6-b486c4263ac9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:31.403102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07210f2e-0daf-4577-bfe6-b486c4263ac9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:31.403600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07210f2e-0daf-4577-bfe6-b486c4263ac9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:31.404046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07210f2e-0daf-4577-bfe6-b486c4263ac9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:31.404782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07210f2e-0daf-4577-bfe6-b486c4263ac9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:31.405250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07210f2e-0daf-4577-bfe6-b486c4263ac9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:31.405695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07210f2e-0daf-4577-bfe6-b486c4263ac9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:31.546175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-07210f2e-0daf-4577-bfe6-b486c4263ac9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:31.554791 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-07210f2e-0daf-4577-bfe6-b486c4263ac9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1562 microversion: 2.1 time: 0.167093 Aug 27 05:48:31.555399 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3804/7658] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:31 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:31.575601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7762d20d-f5fc-4942-9fe6-3ad13c728499 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:31.576226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7762d20d-f5fc-4942-9fe6-3ad13c728499 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:31.578161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:31.584764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7762d20d-f5fc-4942-9fe6-3ad13c728499 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:31.585263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7762d20d-f5fc-4942-9fe6-3ad13c728499 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:31.585716 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7762d20d-f5fc-4942-9fe6-3ad13c728499 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:31.586424 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7762d20d-f5fc-4942-9fe6-3ad13c728499 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:31.586904 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7762d20d-f5fc-4942-9fe6-3ad13c728499 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:31.587341 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7762d20d-f5fc-4942-9fe6-3ad13c728499 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:31.718292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7762d20d-f5fc-4942-9fe6-3ad13c728499 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:31.726123 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7762d20d-f5fc-4942-9fe6-3ad13c728499 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1562 microversion: 2.1 time: 0.154754 Aug 27 05:48:31.726706 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3855/7659] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:31 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:48:33.315781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-13b076fd-158d-4875-8191-ced32b8e8f12 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:48:33.317001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-13b076fd-158d-4875-8191-ced32b8e8f12 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:48:33.318202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d503882c-cf39-4b28-8012-55b696b562d9 req-6b205a5f-580d-4fe1-bdf2-d8981a53143b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12c38601-a723-4e25-9c2f-bd9aa34a129d", "tag": "438f0405-844f-4782-ab58-f97e5060ed23"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:48:33.320585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:33.327013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13b076fd-158d-4875-8191-ced32b8e8f12 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:33.327674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:48:33.327985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13b076fd-158d-4875-8191-ced32b8e8f12 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:33.328679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13b076fd-158d-4875-8191-ced32b8e8f12 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:33.329380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13b076fd-158d-4875-8191-ced32b8e8f12 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:33.330094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13b076fd-158d-4875-8191-ced32b8e8f12 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:33.330534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-13b076fd-158d-4875-8191-ced32b8e8f12 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:33.336247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d503882c-cf39-4b28-8012-55b696b562d9 req-6b205a5f-580d-4fe1-bdf2-d8981a53143b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:48:33.336897 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d503882c-cf39-4b28-8012-55b696b562d9 req-6b205a5f-580d-4fe1-bdf2-d8981a53143b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:48:33.337881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d503882c-cf39-4b28-8012-55b696b562d9 req-6b205a5f-580d-4fe1-bdf2-d8981a53143b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:48:33.350394 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d503882c-cf39-4b28-8012-55b696b562d9 req-6b205a5f-580d-4fe1-bdf2-d8981a53143b service nova] Creating event network-changed:438f0405-844f-4782-ab58-f97e5060ed23 for instance 12c38601-a723-4e25-9c2f-bd9aa34a129d on n-h1-854823-1 Aug 27 05:48:33.355702 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d503882c-cf39-4b28-8012-55b696b562d9 req-6b205a5f-580d-4fe1-bdf2-d8981a53143b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042237 Aug 27 05:48:33.356422 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3856/7660] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:48:33.578283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-13b076fd-158d-4875-8191-ced32b8e8f12 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:48:33.586659 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-13b076fd-158d-4875-8191-ced32b8e8f12 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1562 microversion: 2.1 time: 0.275572 Aug 27 05:48:33.587246 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3805/7661] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:48:33 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1562 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:08.877590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:49:08.878354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=38 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:49:08.883552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c62c2369-c41c-4131-bba3-2354a9b8465b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:49:08.886453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c62c2369-c41c-4131-bba3-2354a9b8465b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:08.893711 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c62c2369-c41c-4131-bba3-2354a9b8465b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:08.894212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c62c2369-c41c-4131-bba3-2354a9b8465b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:08.894665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c62c2369-c41c-4131-bba3-2354a9b8465b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:08.895371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c62c2369-c41c-4131-bba3-2354a9b8465b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:08.895843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c62c2369-c41c-4131-bba3-2354a9b8465b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:08.896283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c62c2369-c41c-4131-bba3-2354a9b8465b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:08.953022 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c62c2369-c41c-4131-bba3-2354a9b8465b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d/action" status: 200 len: 24565 microversion: 2.1 time: 0.077414 Aug 27 05:49:08.953897 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3857/7662] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:49:08 2022] POST /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d/action => generated 24565 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:49:39.426433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:49:39.427182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=36 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:49:39.433410 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-08f4daff-336a-41cd-a7cc-4c0fb7b5b41f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:49:39.435618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-08f4daff-336a-41cd-a7cc-4c0fb7b5b41f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:39.442780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08f4daff-336a-41cd-a7cc-4c0fb7b5b41f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:39.443276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08f4daff-336a-41cd-a7cc-4c0fb7b5b41f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:39.443722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08f4daff-336a-41cd-a7cc-4c0fb7b5b41f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:39.444424 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08f4daff-336a-41cd-a7cc-4c0fb7b5b41f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:39.444919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08f4daff-336a-41cd-a7cc-4c0fb7b5b41f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:39.445353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08f4daff-336a-41cd-a7cc-4c0fb7b5b41f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:39.520220 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-08f4daff-336a-41cd-a7cc-4c0fb7b5b41f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d/action" status: 202 len: 0 microversion: 2.1 time: 0.095598 Aug 27 05:49:39.520992 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3806/7663] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:49:39 2022] POST /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:49:39.530687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f4c0cad-0718-4cee-b2b2-18ea9c970efa tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:39.531534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f4c0cad-0718-4cee-b2b2-18ea9c970efa tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:39.535305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:49:39.536204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:49:39.541438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4c0cad-0718-4cee-b2b2-18ea9c970efa tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:39.541939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4c0cad-0718-4cee-b2b2-18ea9c970efa tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:39.542386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4c0cad-0718-4cee-b2b2-18ea9c970efa tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:39.543095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4c0cad-0718-4cee-b2b2-18ea9c970efa tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:39.543560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4c0cad-0718-4cee-b2b2-18ea9c970efa tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:39.543995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4c0cad-0718-4cee-b2b2-18ea9c970efa tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:39.686707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f4c0cad-0718-4cee-b2b2-18ea9c970efa tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:39.694827 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f4c0cad-0718-4cee-b2b2-18ea9c970efa tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1672 microversion: 2.1 time: 0.168742 Aug 27 05:49:39.695550 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3858/7664] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:39 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:40.718843 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-28792710-0fec-4a4a-ae10-836a04b744e9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:40.719549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-28792710-0fec-4a4a-ae10-836a04b744e9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:40.725748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28792710-0fec-4a4a-ae10-836a04b744e9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:40.726233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28792710-0fec-4a4a-ae10-836a04b744e9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:40.726668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28792710-0fec-4a4a-ae10-836a04b744e9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:40.727357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28792710-0fec-4a4a-ae10-836a04b744e9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:40.727974 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28792710-0fec-4a4a-ae10-836a04b744e9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:40.728397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28792710-0fec-4a4a-ae10-836a04b744e9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:40.863116 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-28792710-0fec-4a4a-ae10-836a04b744e9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:40.871323 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-28792710-0fec-4a4a-ae10-836a04b744e9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1677 microversion: 2.1 time: 0.158770 Aug 27 05:49:40.871907 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3807/7665] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:40 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:41.895309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b20237a-de94-42ed-b64b-8ec15492d4dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:41.895918 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b20237a-de94-42ed-b64b-8ec15492d4dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:41.903372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b20237a-de94-42ed-b64b-8ec15492d4dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:41.903874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b20237a-de94-42ed-b64b-8ec15492d4dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:41.904321 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b20237a-de94-42ed-b64b-8ec15492d4dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:41.905050 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b20237a-de94-42ed-b64b-8ec15492d4dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:41.905516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b20237a-de94-42ed-b64b-8ec15492d4dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:41.905951 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b20237a-de94-42ed-b64b-8ec15492d4dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:42.037176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b20237a-de94-42ed-b64b-8ec15492d4dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:42.045216 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b20237a-de94-42ed-b64b-8ec15492d4dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1677 microversion: 2.1 time: 0.153911 Aug 27 05:49:42.045791 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3859/7666] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:41 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:49:43.067066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8d54a429-b28b-4581-9ea9-33ebd8b990e7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:43.067699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8d54a429-b28b-4581-9ea9-33ebd8b990e7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:43.075306 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d54a429-b28b-4581-9ea9-33ebd8b990e7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:43.076212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d54a429-b28b-4581-9ea9-33ebd8b990e7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:43.076980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d54a429-b28b-4581-9ea9-33ebd8b990e7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:43.078366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d54a429-b28b-4581-9ea9-33ebd8b990e7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:43.078833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d54a429-b28b-4581-9ea9-33ebd8b990e7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:43.079264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8d54a429-b28b-4581-9ea9-33ebd8b990e7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:43.213728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-8d54a429-b28b-4581-9ea9-33ebd8b990e7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:43.221488 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8d54a429-b28b-4581-9ea9-33ebd8b990e7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1677 microversion: 2.1 time: 0.158700 Aug 27 05:49:43.222071 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3808/7667] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:43 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:44.242605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a67eaa45-8723-4100-8a3e-da49dae9a5ad tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:44.243143 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a67eaa45-8723-4100-8a3e-da49dae9a5ad tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:44.250148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a67eaa45-8723-4100-8a3e-da49dae9a5ad tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:44.250662 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a67eaa45-8723-4100-8a3e-da49dae9a5ad tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:44.251114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a67eaa45-8723-4100-8a3e-da49dae9a5ad tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:44.251856 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a67eaa45-8723-4100-8a3e-da49dae9a5ad tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:44.252326 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a67eaa45-8723-4100-8a3e-da49dae9a5ad tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:44.252795 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a67eaa45-8723-4100-8a3e-da49dae9a5ad tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:44.385910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a67eaa45-8723-4100-8a3e-da49dae9a5ad tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:44.393655 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a67eaa45-8723-4100-8a3e-da49dae9a5ad tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1677 microversion: 2.1 time: 0.155077 Aug 27 05:49:44.394239 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3860/7668] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:44 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:45.419066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d3a4c036-410a-46c1-941e-1753c581c5d1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:45.419659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d3a4c036-410a-46c1-941e-1753c581c5d1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:45.426509 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3a4c036-410a-46c1-941e-1753c581c5d1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:45.426994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3a4c036-410a-46c1-941e-1753c581c5d1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:45.427433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3a4c036-410a-46c1-941e-1753c581c5d1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:45.428123 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3a4c036-410a-46c1-941e-1753c581c5d1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:45.428611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3a4c036-410a-46c1-941e-1753c581c5d1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:45.429042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d3a4c036-410a-46c1-941e-1753c581c5d1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:45.562881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d3a4c036-410a-46c1-941e-1753c581c5d1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:45.570679 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d3a4c036-410a-46c1-941e-1753c581c5d1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1677 microversion: 2.1 time: 0.156477 Aug 27 05:49:45.571459 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3809/7669] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:45 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:46.593263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ddef330-5dde-4729-a4c8-e41448ae5b0e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:46.593883 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ddef330-5dde-4729-a4c8-e41448ae5b0e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:46.600728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ddef330-5dde-4729-a4c8-e41448ae5b0e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:46.601230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ddef330-5dde-4729-a4c8-e41448ae5b0e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:46.601681 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ddef330-5dde-4729-a4c8-e41448ae5b0e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:46.602394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ddef330-5dde-4729-a4c8-e41448ae5b0e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:46.602860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ddef330-5dde-4729-a4c8-e41448ae5b0e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:46.603298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ddef330-5dde-4729-a4c8-e41448ae5b0e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:46.999047 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ddef330-5dde-4729-a4c8-e41448ae5b0e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:47.006776 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ddef330-5dde-4729-a4c8-e41448ae5b0e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1677 microversion: 2.1 time: 0.418084 Aug 27 05:49:47.007349 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3861/7670] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:46 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1677 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:48.028510 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6661fc17-6f99-4ebe-bae6-3c0d5aad4cbd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:48.029159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6661fc17-6f99-4ebe-bae6-3c0d5aad4cbd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:48.036063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6661fc17-6f99-4ebe-bae6-3c0d5aad4cbd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:48.036863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6661fc17-6f99-4ebe-bae6-3c0d5aad4cbd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:48.037308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6661fc17-6f99-4ebe-bae6-3c0d5aad4cbd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:48.038008 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6661fc17-6f99-4ebe-bae6-3c0d5aad4cbd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:48.038473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6661fc17-6f99-4ebe-bae6-3c0d5aad4cbd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:48.038912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6661fc17-6f99-4ebe-bae6-3c0d5aad4cbd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:48.173314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6661fc17-6f99-4ebe-bae6-3c0d5aad4cbd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:48.181946 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6661fc17-6f99-4ebe-bae6-3c0d5aad4cbd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1677 microversion: 2.1 time: 0.157377 Aug 27 05:49:48.183094 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3810/7671] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:48 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:49.203501 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74f8f516-fd51-4935-a992-32ab4da4d9de tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:49.204107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74f8f516-fd51-4935-a992-32ab4da4d9de tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:49.211158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74f8f516-fd51-4935-a992-32ab4da4d9de tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:49.211654 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74f8f516-fd51-4935-a992-32ab4da4d9de tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:49.212130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74f8f516-fd51-4935-a992-32ab4da4d9de tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:49.212863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74f8f516-fd51-4935-a992-32ab4da4d9de tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:49.213324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74f8f516-fd51-4935-a992-32ab4da4d9de tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:49.214269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74f8f516-fd51-4935-a992-32ab4da4d9de tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:49.344704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-74f8f516-fd51-4935-a992-32ab4da4d9de tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:49.352479 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74f8f516-fd51-4935-a992-32ab4da4d9de tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1677 microversion: 2.1 time: 0.152861 Aug 27 05:49:49.353189 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3862/7672] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:49 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:50.374245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-9165944a-19c1-43b5-9d42-9b6a92826412 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:50.374789 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-9165944a-19c1-43b5-9d42-9b6a92826412 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:50.381759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9165944a-19c1-43b5-9d42-9b6a92826412 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:50.382251 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9165944a-19c1-43b5-9d42-9b6a92826412 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:50.382695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9165944a-19c1-43b5-9d42-9b6a92826412 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:50.383395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9165944a-19c1-43b5-9d42-9b6a92826412 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:50.383855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9165944a-19c1-43b5-9d42-9b6a92826412 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:50.384288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-9165944a-19c1-43b5-9d42-9b6a92826412 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:50.518875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-9165944a-19c1-43b5-9d42-9b6a92826412 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:50.526649 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-9165944a-19c1-43b5-9d42-9b6a92826412 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1677 microversion: 2.1 time: 0.157044 Aug 27 05:49:50.527385 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3811/7673] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:50 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:49:51.625516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cd38667b-8bde-41ea-994f-ad94d077b639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:49:51.626216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cd38667b-8bde-41ea-994f-ad94d077b639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:49:51.633434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd38667b-8bde-41ea-994f-ad94d077b639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:51.633977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd38667b-8bde-41ea-994f-ad94d077b639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:51.634432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd38667b-8bde-41ea-994f-ad94d077b639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:51.635164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd38667b-8bde-41ea-994f-ad94d077b639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:49:51.635643 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd38667b-8bde-41ea-994f-ad94d077b639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:49:51.636091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd38667b-8bde-41ea-994f-ad94d077b639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:49:51.777036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cd38667b-8bde-41ea-994f-ad94d077b639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:49:51.785117 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cd38667b-8bde-41ea-994f-ad94d077b639 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1680 microversion: 2.1 time: 0.163620 Aug 27 05:49:51.785702 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3863/7674] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:49:51 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:26.012916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-25518627-f431-43ed-a0e6-0c12a0dec82a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:50:26.015119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-25518627-f431-43ed-a0e6-0c12a0dec82a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:26.017654 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=12 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:50:26.018479 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:50:26.025234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25518627-f431-43ed-a0e6-0c12a0dec82a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:26.025821 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25518627-f431-43ed-a0e6-0c12a0dec82a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:26.026324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25518627-f431-43ed-a0e6-0c12a0dec82a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:26.027178 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25518627-f431-43ed-a0e6-0c12a0dec82a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:26.027705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25518627-f431-43ed-a0e6-0c12a0dec82a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:26.028196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-25518627-f431-43ed-a0e6-0c12a0dec82a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:26.103264 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-25518627-f431-43ed-a0e6-0c12a0dec82a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d/action" status: 200 len: 69039 microversion: 2.1 time: 0.094577 Aug 27 05:50:26.104580 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3812/7675] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:50:26 2022] POST /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d/action => generated 69039 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:50:49.647709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f3f3b12-34b0-4635-8903-2574f562aa70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:49.648252 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f3f3b12-34b0-4635-8903-2574f562aa70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:49.652304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:50:49.653125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=36 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:50:49.654541 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:50:49.654732 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:50:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d (ip 10.222.0.79) !!! Aug 27 05:50:49.660588 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f3f3b12-34b0-4635-8903-2574f562aa70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:49.660881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:50:49.661324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f3f3b12-34b0-4635-8903-2574f562aa70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:49.661792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f3f3b12-34b0-4635-8903-2574f562aa70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:49.661976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:50:49.662508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f3f3b12-34b0-4635-8903-2574f562aa70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:49.663324 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f3f3b12-34b0-4635-8903-2574f562aa70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:49.663847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f3f3b12-34b0-4635-8903-2574f562aa70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:49.696021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f3f3b12-34b0-4635-8903-2574f562aa70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:50:49.734145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-91030f5f-b799-4b68-b1c1-0b0e408792de req-6ab162f7-39f2-4cf7-a4a5-bcab7db20b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12c38601-a723-4e25-9c2f-bd9aa34a129d", "tag": "438f0405-844f-4782-ab58-f97e5060ed23"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:50:49.752786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-91030f5f-b799-4b68-b1c1-0b0e408792de req-6ab162f7-39f2-4cf7-a4a5-bcab7db20b63 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:49.753367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-91030f5f-b799-4b68-b1c1-0b0e408792de req-6ab162f7-39f2-4cf7-a4a5-bcab7db20b63 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:49.754007 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-91030f5f-b799-4b68-b1c1-0b0e408792de req-6ab162f7-39f2-4cf7-a4a5-bcab7db20b63 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:49.766028 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-91030f5f-b799-4b68-b1c1-0b0e408792de req-6ab162f7-39f2-4cf7-a4a5-bcab7db20b63 service nova] Creating event network-changed:438f0405-844f-4782-ab58-f97e5060ed23 for instance 12c38601-a723-4e25-9c2f-bd9aa34a129d on n-h1-854823-1 Aug 27 05:50:49.779694 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f3f3b12-34b0-4635-8903-2574f562aa70 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "DELETE /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 204 len: 0 microversion: 2.1 time: 0.135532 Aug 27 05:50:49.784974 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3864/7676] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:50:49 2022] DELETE /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 05:50:49.786463 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-91030f5f-b799-4b68-b1c1-0b0e408792de req-6ab162f7-39f2-4cf7-a4a5-bcab7db20b63 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134659 Aug 27 05:50:49.787387 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3813/7677] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:50:49.791069 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e10cb7f-b275-4308-8ac4-3a3e0b7f6e05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:49.791822 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e10cb7f-b275-4308-8ac4-3a3e0b7f6e05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:49.798484 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e10cb7f-b275-4308-8ac4-3a3e0b7f6e05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:49.798995 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e10cb7f-b275-4308-8ac4-3a3e0b7f6e05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:49.799444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e10cb7f-b275-4308-8ac4-3a3e0b7f6e05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:49.800161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e10cb7f-b275-4308-8ac4-3a3e0b7f6e05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:49.800668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e10cb7f-b275-4308-8ac4-3a3e0b7f6e05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:49.801109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e10cb7f-b275-4308-8ac4-3a3e0b7f6e05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:49.941680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e10cb7f-b275-4308-8ac4-3a3e0b7f6e05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:49.949891 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e10cb7f-b275-4308-8ac4-3a3e0b7f6e05 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1686 microversion: 2.1 time: 0.163472 Aug 27 05:50:49.950740 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3865/7678] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:49 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:50.975401 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-22818b75-ae5d-4d01-a686-a886321541b9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:50.976013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-22818b75-ae5d-4d01-a686-a886321541b9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:50.982344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22818b75-ae5d-4d01-a686-a886321541b9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:50.983854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22818b75-ae5d-4d01-a686-a886321541b9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:50.984050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22818b75-ae5d-4d01-a686-a886321541b9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:50.984775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22818b75-ae5d-4d01-a686-a886321541b9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:50.985238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22818b75-ae5d-4d01-a686-a886321541b9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:50.985657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-22818b75-ae5d-4d01-a686-a886321541b9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:51.214539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-22818b75-ae5d-4d01-a686-a886321541b9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:51.224286 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-22818b75-ae5d-4d01-a686-a886321541b9 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1686 microversion: 2.1 time: 0.254135 Aug 27 05:50:51.225022 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3814/7679] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:50 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1686 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:50:52.231344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8b24e19f-dcf0-4dd5-8175-41a988073e4d req-ea0bd7c7-afa5-4ea9-9c5c-e87d68a140d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12c38601-a723-4e25-9c2f-bd9aa34a129d", "name": "network-vif-deleted", "tag": "438f0405-844f-4782-ab58-f97e5060ed23"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:50:52.244096 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8b24e19f-dcf0-4dd5-8175-41a988073e4d req-ea0bd7c7-afa5-4ea9-9c5c-e87d68a140d0 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:52.244695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8b24e19f-dcf0-4dd5-8175-41a988073e4d req-ea0bd7c7-afa5-4ea9-9c5c-e87d68a140d0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:52.245153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8b24e19f-dcf0-4dd5-8175-41a988073e4d req-ea0bd7c7-afa5-4ea9-9c5c-e87d68a140d0 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:52.250027 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-468adf18-90b5-49a1-9914-2127bafb1b6b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:52.256490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-468adf18-90b5-49a1-9914-2127bafb1b6b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:52.260552 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8b24e19f-dcf0-4dd5-8175-41a988073e4d req-ea0bd7c7-afa5-4ea9-9c5c-e87d68a140d0 service nova] Creating event network-vif-deleted:438f0405-844f-4782-ab58-f97e5060ed23 for instance 12c38601-a723-4e25-9c2f-bd9aa34a129d on n-h1-854823-1 Aug 27 05:50:52.266715 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8b24e19f-dcf0-4dd5-8175-41a988073e4d req-ea0bd7c7-afa5-4ea9-9c5c-e87d68a140d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038925 Aug 27 05:50:52.267355 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3866/7680] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:50:52.271992 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-468adf18-90b5-49a1-9914-2127bafb1b6b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:52.272469 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-468adf18-90b5-49a1-9914-2127bafb1b6b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:52.273159 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-468adf18-90b5-49a1-9914-2127bafb1b6b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:52.273954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-468adf18-90b5-49a1-9914-2127bafb1b6b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:52.274462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-468adf18-90b5-49a1-9914-2127bafb1b6b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:52.274899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-468adf18-90b5-49a1-9914-2127bafb1b6b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:52.355852 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-468adf18-90b5-49a1-9914-2127bafb1b6b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:50:52.364589 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-468adf18-90b5-49a1-9914-2127bafb1b6b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 200 len: 1351 microversion: 2.1 time: 0.123199 Aug 27 05:50:52.365207 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3815/7681] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:52 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 1351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:50:53.387752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f0f2475-8626-43d6-8521-ff5081e2480f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:53.388461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f0f2475-8626-43d6-8521-ff5081e2480f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 12c38601-a723-4e25-9c2f-bd9aa34a129d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:50:53.394828 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f0f2475-8626-43d6-8521-ff5081e2480f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:53.395306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f0f2475-8626-43d6-8521-ff5081e2480f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:53.395764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f0f2475-8626-43d6-8521-ff5081e2480f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:53.396465 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f0f2475-8626-43d6-8521-ff5081e2480f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:50:53.396964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f0f2475-8626-43d6-8521-ff5081e2480f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:50:53.397405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f0f2475-8626-43d6-8521-ff5081e2480f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:50:53.410857 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0f0f2475-8626-43d6-8521-ff5081e2480f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] HTTP exception thrown: Instance 12c38601-a723-4e25-9c2f-bd9aa34a129d could not be found. Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f0f2475-8626-43d6-8521-ff5081e2480f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Request method failure captured: Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d HTTP/1.1 Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCa_ZB1xxAu3ecBWGCK15_VmwaqF85neIEJdIAs7jNcxu1djgNXg7VI5VEOXS6WWCK2ve_0FSkl7NBlNjuccjBtXyVgh36GbN5jZ_YNqVuaf7D46o15NEfIZsTXQ1HZhwQ_n0Ff1o9_p7xlfNP4YcpgeNU05P-LCu3qnPhIYmdM1z8e8 Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 277e817efae04205bf58e32de7c168ce Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/277e817efae04205bf58e32de7c168ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_277e817efae04205bf58e32de7c168ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/277e817efae04205bf58e32de7c168ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/277e817efae04205bf58e32de7c168ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 277e817efae04205bf58e32de7c168ce Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestNetworkAdvancedServerOps-1233409680-project Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 19fb9c5c1cfd4cb2b33a7c22d7311ffe Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1233409680-project Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 12c38601-a723-4e25-9c2f-bd9aa34a129d could not be found. Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '12c38601-a723-4e25-9c2f-bd9aa34a129d'} Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12c38601-a723-4e25-9c2f-bd9aa34a129d could not be found. Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12c38601-a723-4e25-9c2f-bd9aa34a129d could not be found. Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:50:53.412642 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:50:53.417769 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:50:53.417769 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:50:53.417769 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:50:53.417769 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:50:53.417769 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:50:53.417769 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:50:53.417769 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12c38601-a723-4e25-9c2f-bd9aa34a129d could not be found. Aug 27 05:50:53.417769 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 05:50:53.417769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f0f2475-8626-43d6-8521-ff5081e2480f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Returning 404 to user: Instance 12c38601-a723-4e25-9c2f-bd9aa34a129d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:50:53.417769 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f0f2475-8626-43d6-8521-ff5081e2480f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d" status: 404 len: 111 microversion: 2.1 time: 0.031727 Aug 27 05:50:53.417769 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3867/7682] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:50:53 2022] GET /compute/v2.1/servers/12c38601-a723-4e25-9c2f-bd9aa34a129d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:50:56.762744 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f1cfeed0-0f9f-4b9c-a5b8-d671e0b9ef5d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '.version_select at 0x7f1f233ff4c0>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:50:56.767346 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f1cfeed0-0f9f-4b9c-a5b8-d671e0b9ef5d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [6833264e-9841-40aa-958e-728842aecfe8] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 05:50:57.777716 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [None req-f1cfeed0-0f9f-4b9c-a5b8-d671e0b9ef5d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [6833264e-9841-40aa-958e-728842aecfe8] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 44772. Aug 27 05:50:57.797415 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f1cfeed0-0f9f-4b9c-a5b8-d671e0b9ef5d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1462809902" status: 202 len: 0 microversion: 2.1 time: 1.038567 Aug 27 05:50:57.798009 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3816/7683] 10.222.0.79 () {58 vars in 1284 bytes} [Sat Aug 27 05:50:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1462809902 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:50:57.829397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97f24685-ddbe-4b2e-b52a-1cf78e8bd0db tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'create', calling method: .version_select at 0x7f1f20439700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-697574875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyyvd+v1ICuDarBwBnzCui4tID9fW+hmzg4y9o93CrdcguIEmmm+T7rfmuzuF5lta11nS/2kFpgV00h2N/3LEGK74pxKpTG+Z8+HB1Sb5OB2AtrSZvMrbkH4TGsMn7/ZQ=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:50:57.846811 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-97f24685-ddbe-4b2e-b52a-1cf78e8bd0db tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for project 277e817efae04205bf58e32de7c168ce. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:50:57.851599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-97f24685-ddbe-4b2e-b52a-1cf78e8bd0db tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for user 19fb9c5c1cfd4cb2b33a7c22d7311ffe and project 277e817efae04205bf58e32de7c168ce. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:50:57.876877 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97f24685-ddbe-4b2e-b52a-1cf78e8bd0db tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051335 Aug 27 05:50:57.877492 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3868/7684] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:50:57 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:51:03.476962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=14 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:03.484095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-298786223", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "39e2ba9d-8fc1-4608-980b-4e0df2c9d9b4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-697574875", "security_groups": [{"name": "tempest-secgroup-smoke-1828687168"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:51:03.605003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] validate_networks() for [('39e2ba9d-8fc1-4608-980b-4e0df2c9d9b4', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:51:04.083534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:51:04.084080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:51:04.084661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:51:04.085152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:51:04.085680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:51:04.095929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:04.096554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:04.097013 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:04.097762 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:04.098228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:04.098667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:04.117141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for project 277e817efae04205bf58e32de7c168ce. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:51:04.122800 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for user 19fb9c5c1cfd4cb2b33a7c22d7311ffe and project 277e817efae04205bf58e32de7c168ce. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:51:04.137495 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:51:04.140473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:51:04.189500 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a8a37f6-16e4-4ff8-80e6-533b763e0b8a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.714556 Aug 27 05:51:04.190337 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3817/7685] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:51:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:51:04.199409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:04.206209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1fed20e9-1ddf-4f9a-840d-a1a624ddc011 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:04.207322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1fed20e9-1ddf-4f9a-840d-a1a624ddc011 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:04.270673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1fed20e9-1ddf-4f9a-840d-a1a624ddc011 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:04.277860 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1fed20e9-1ddf-4f9a-840d-a1a624ddc011 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1265 microversion: 2.1 time: 0.080300 Aug 27 05:51:04.286885 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3869/7686] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:04 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:05.302175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-463bf71a-4ff4-4619-b389-9bd23d3437a1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:05.302795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-463bf71a-4ff4-4619-b389-9bd23d3437a1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:05.310080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-463bf71a-4ff4-4619-b389-9bd23d3437a1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:05.310571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-463bf71a-4ff4-4619-b389-9bd23d3437a1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:05.311012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-463bf71a-4ff4-4619-b389-9bd23d3437a1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:05.311749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-463bf71a-4ff4-4619-b389-9bd23d3437a1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:05.312204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-463bf71a-4ff4-4619-b389-9bd23d3437a1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:05.312938 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-463bf71a-4ff4-4619-b389-9bd23d3437a1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:05.390534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-463bf71a-4ff4-4619-b389-9bd23d3437a1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:05.400035 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-463bf71a-4ff4-4619-b389-9bd23d3437a1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1317 microversion: 2.1 time: 0.105192 Aug 27 05:51:05.410645 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3818/7687] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:05 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1317 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:06.424036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-686d6b3b-b9d9-4c89-bb4f-73fc53841e68 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:06.424712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-686d6b3b-b9d9-4c89-bb4f-73fc53841e68 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:06.432394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-686d6b3b-b9d9-4c89-bb4f-73fc53841e68 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:06.433262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-686d6b3b-b9d9-4c89-bb4f-73fc53841e68 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:06.433803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-686d6b3b-b9d9-4c89-bb4f-73fc53841e68 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:06.434630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-686d6b3b-b9d9-4c89-bb4f-73fc53841e68 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:06.435184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-686d6b3b-b9d9-4c89-bb4f-73fc53841e68 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:06.435624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-686d6b3b-b9d9-4c89-bb4f-73fc53841e68 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:06.603057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-686d6b3b-b9d9-4c89-bb4f-73fc53841e68 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:06.612692 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-686d6b3b-b9d9-4c89-bb4f-73fc53841e68 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1391 microversion: 2.1 time: 0.193110 Aug 27 05:51:06.613911 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3870/7688] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:06 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1391 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:07.025971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-4f7b5c8e-d3c3-49f0-bc84-777ee2ec4c22 req-cc74f585-4faa-4064-b16c-81965738bc2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bdcd7e7-65a2-42d5-8ec1-4910888130a4", "tag": "c2b9e636-5a72-4d35-aa4b-5eb3590f65a7"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:51:07.038360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4f7b5c8e-d3c3-49f0-bc84-777ee2ec4c22 req-cc74f585-4faa-4064-b16c-81965738bc2e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:07.039376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4f7b5c8e-d3c3-49f0-bc84-777ee2ec4c22 req-cc74f585-4faa-4064-b16c-81965738bc2e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:07.039809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4f7b5c8e-d3c3-49f0-bc84-777ee2ec4c22 req-cc74f585-4faa-4064-b16c-81965738bc2e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:07.053745 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-4f7b5c8e-d3c3-49f0-bc84-777ee2ec4c22 req-cc74f585-4faa-4064-b16c-81965738bc2e service nova] Creating event network-changed:c2b9e636-5a72-4d35-aa4b-5eb3590f65a7 for instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 on n-h2-854823-1 Aug 27 05:51:07.059486 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-4f7b5c8e-d3c3-49f0-bc84-777ee2ec4c22 req-cc74f585-4faa-4064-b16c-81965738bc2e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038499 Aug 27 05:51:07.060115 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3819/7689] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:51:07.634476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-074ad8a9-3b0c-4231-b907-deec0e84eccd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:07.635083 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-074ad8a9-3b0c-4231-b907-deec0e84eccd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:07.642720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-074ad8a9-3b0c-4231-b907-deec0e84eccd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:07.643228 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-074ad8a9-3b0c-4231-b907-deec0e84eccd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:07.643670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-074ad8a9-3b0c-4231-b907-deec0e84eccd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:07.644587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-074ad8a9-3b0c-4231-b907-deec0e84eccd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:07.645059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-074ad8a9-3b0c-4231-b907-deec0e84eccd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:07.645493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-074ad8a9-3b0c-4231-b907-deec0e84eccd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:07.782630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-074ad8a9-3b0c-4231-b907-deec0e84eccd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:07.790674 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-074ad8a9-3b0c-4231-b907-deec0e84eccd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1391 microversion: 2.1 time: 0.160122 Aug 27 05:51:07.791256 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3871/7690] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:07 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:08.813065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fe6ac47f-6e99-4fc8-b6a0-a440b180afe5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:08.813772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fe6ac47f-6e99-4fc8-b6a0-a440b180afe5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:08.820133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe6ac47f-6e99-4fc8-b6a0-a440b180afe5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:08.820676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe6ac47f-6e99-4fc8-b6a0-a440b180afe5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:08.821120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe6ac47f-6e99-4fc8-b6a0-a440b180afe5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:08.821830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe6ac47f-6e99-4fc8-b6a0-a440b180afe5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:08.822287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe6ac47f-6e99-4fc8-b6a0-a440b180afe5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:08.822720 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fe6ac47f-6e99-4fc8-b6a0-a440b180afe5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:09.044283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fe6ac47f-6e99-4fc8-b6a0-a440b180afe5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:09.052283 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fe6ac47f-6e99-4fc8-b6a0-a440b180afe5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1391 microversion: 2.1 time: 0.244419 Aug 27 05:51:09.052890 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3820/7691] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:08 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1391 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:10.073166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfce3cae-ae7c-4d1d-9ed9-61b2579666b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:10.073792 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dfce3cae-ae7c-4d1d-9ed9-61b2579666b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:10.080723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce3cae-ae7c-4d1d-9ed9-61b2579666b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:10.081224 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce3cae-ae7c-4d1d-9ed9-61b2579666b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:10.081675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce3cae-ae7c-4d1d-9ed9-61b2579666b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:10.082382 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce3cae-ae7c-4d1d-9ed9-61b2579666b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:10.082845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce3cae-ae7c-4d1d-9ed9-61b2579666b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:10.083282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce3cae-ae7c-4d1d-9ed9-61b2579666b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:10.219250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dfce3cae-ae7c-4d1d-9ed9-61b2579666b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:10.227063 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dfce3cae-ae7c-4d1d-9ed9-61b2579666b8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1391 microversion: 2.1 time: 0.157930 Aug 27 05:51:10.227640 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3872/7692] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:10 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:11.249458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5b1cfc8b-e117-4a3f-9cc3-8a7a0593164c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:11.250010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5b1cfc8b-e117-4a3f-9cc3-8a7a0593164c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:11.256809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b1cfc8b-e117-4a3f-9cc3-8a7a0593164c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:11.257307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b1cfc8b-e117-4a3f-9cc3-8a7a0593164c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:11.257752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b1cfc8b-e117-4a3f-9cc3-8a7a0593164c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:11.258455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b1cfc8b-e117-4a3f-9cc3-8a7a0593164c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:11.259255 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b1cfc8b-e117-4a3f-9cc3-8a7a0593164c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:11.259394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b1cfc8b-e117-4a3f-9cc3-8a7a0593164c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:11.401867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5b1cfc8b-e117-4a3f-9cc3-8a7a0593164c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:11.409968 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5b1cfc8b-e117-4a3f-9cc3-8a7a0593164c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1391 microversion: 2.1 time: 0.165236 Aug 27 05:51:11.410541 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3821/7693] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:11 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:51:12.431407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0be10df-ac5c-4622-8e95-36def7ccbc52 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:12.432018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a0be10df-ac5c-4622-8e95-36def7ccbc52 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:12.439407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0be10df-ac5c-4622-8e95-36def7ccbc52 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:12.439906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0be10df-ac5c-4622-8e95-36def7ccbc52 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:12.440353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0be10df-ac5c-4622-8e95-36def7ccbc52 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:12.441095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0be10df-ac5c-4622-8e95-36def7ccbc52 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:12.441562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0be10df-ac5c-4622-8e95-36def7ccbc52 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:12.442002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0be10df-ac5c-4622-8e95-36def7ccbc52 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:12.574641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a0be10df-ac5c-4622-8e95-36def7ccbc52 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:12.583216 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0be10df-ac5c-4622-8e95-36def7ccbc52 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1391 microversion: 2.1 time: 0.155742 Aug 27 05:51:12.583808 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3873/7694] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:12 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:12.779691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e15e7ef7-246d-4def-9a43-214dd04ffca9 req-227d8421-4574-45c1-bd09-15c2debf25dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bdcd7e7-65a2-42d5-8ec1-4910888130a4", "name": "network-vif-plugged", "status": "completed", "tag": "c2b9e636-5a72-4d35-aa4b-5eb3590f65a7"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:51:12.789689 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e15e7ef7-246d-4def-9a43-214dd04ffca9 req-227d8421-4574-45c1-bd09-15c2debf25dc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:12.790209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e15e7ef7-246d-4def-9a43-214dd04ffca9 req-227d8421-4574-45c1-bd09-15c2debf25dc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:12.790830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e15e7ef7-246d-4def-9a43-214dd04ffca9 req-227d8421-4574-45c1-bd09-15c2debf25dc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:12.802682 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e15e7ef7-246d-4def-9a43-214dd04ffca9 req-227d8421-4574-45c1-bd09-15c2debf25dc service nova] Creating event network-vif-plugged:c2b9e636-5a72-4d35-aa4b-5eb3590f65a7 for instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 on n-h2-854823-1 Aug 27 05:51:12.807846 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e15e7ef7-246d-4def-9a43-214dd04ffca9 req-227d8421-4574-45c1-bd09-15c2debf25dc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089183 Aug 27 05:51:12.808434 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3822/7695] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:51:13.604087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50db6809-d643-4fd5-b26e-e24695c18da4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:13.604777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50db6809-d643-4fd5-b26e-e24695c18da4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:13.611608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50db6809-d643-4fd5-b26e-e24695c18da4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:13.612111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50db6809-d643-4fd5-b26e-e24695c18da4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:13.612584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50db6809-d643-4fd5-b26e-e24695c18da4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:13.613295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50db6809-d643-4fd5-b26e-e24695c18da4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:13.613765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50db6809-d643-4fd5-b26e-e24695c18da4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:13.614206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50db6809-d643-4fd5-b26e-e24695c18da4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:13.747275 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50db6809-d643-4fd5-b26e-e24695c18da4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:13.754919 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50db6809-d643-4fd5-b26e-e24695c18da4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1391 microversion: 2.1 time: 0.154867 Aug 27 05:51:13.755516 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3874/7696] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:13 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:14.774414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:14.775191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:14.779642 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c7be3fcc-f682-4686-a88f-6135f6894b1a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:14.780879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c7be3fcc-f682-4686-a88f-6135f6894b1a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:14.787958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7be3fcc-f682-4686-a88f-6135f6894b1a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:14.788446 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7be3fcc-f682-4686-a88f-6135f6894b1a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:14.789180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7be3fcc-f682-4686-a88f-6135f6894b1a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:14.789876 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7be3fcc-f682-4686-a88f-6135f6894b1a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:14.790335 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7be3fcc-f682-4686-a88f-6135f6894b1a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:14.790771 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c7be3fcc-f682-4686-a88f-6135f6894b1a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:14.924130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c7be3fcc-f682-4686-a88f-6135f6894b1a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:14.931970 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c7be3fcc-f682-4686-a88f-6135f6894b1a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1564 microversion: 2.1 time: 0.159346 Aug 27 05:51:14.932485 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3823/7697] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:14 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:14.953612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bd4e645-a010-4ded-89e6-27cb7abd1c87 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:14.954234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6bd4e645-a010-4ded-89e6-27cb7abd1c87 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:14.956136 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:14.962064 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bd4e645-a010-4ded-89e6-27cb7abd1c87 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:14.962542 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bd4e645-a010-4ded-89e6-27cb7abd1c87 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:14.962989 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bd4e645-a010-4ded-89e6-27cb7abd1c87 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:14.963698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bd4e645-a010-4ded-89e6-27cb7abd1c87 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:14.964149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bd4e645-a010-4ded-89e6-27cb7abd1c87 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:14.964605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bd4e645-a010-4ded-89e6-27cb7abd1c87 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:15.099685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6bd4e645-a010-4ded-89e6-27cb7abd1c87 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:15.107770 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6bd4e645-a010-4ded-89e6-27cb7abd1c87 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1564 microversion: 2.1 time: 0.158794 Aug 27 05:51:15.108356 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3875/7698] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:14 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:17.021488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-82498677-371d-4b47-ba06-8bd56379db3d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:17.022102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-82498677-371d-4b47-ba06-8bd56379db3d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:17.029723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82498677-371d-4b47-ba06-8bd56379db3d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:17.030699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82498677-371d-4b47-ba06-8bd56379db3d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:17.031353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82498677-371d-4b47-ba06-8bd56379db3d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:17.032049 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82498677-371d-4b47-ba06-8bd56379db3d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:17.032501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82498677-371d-4b47-ba06-8bd56379db3d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:17.033117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-82498677-371d-4b47-ba06-8bd56379db3d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:17.086112 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2638bf79-ecfc-4bfd-bf70-31f7802fde57 req-bacd2c35-e590-453f-8c87-44076af709d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bdcd7e7-65a2-42d5-8ec1-4910888130a4", "tag": "c2b9e636-5a72-4d35-aa4b-5eb3590f65a7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:51:17.097173 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2638bf79-ecfc-4bfd-bf70-31f7802fde57 req-bacd2c35-e590-453f-8c87-44076af709d8 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:17.097805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2638bf79-ecfc-4bfd-bf70-31f7802fde57 req-bacd2c35-e590-453f-8c87-44076af709d8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:17.098282 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2638bf79-ecfc-4bfd-bf70-31f7802fde57 req-bacd2c35-e590-453f-8c87-44076af709d8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:17.110615 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2638bf79-ecfc-4bfd-bf70-31f7802fde57 req-bacd2c35-e590-453f-8c87-44076af709d8 service nova] Creating event network-changed:c2b9e636-5a72-4d35-aa4b-5eb3590f65a7 for instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 on n-h2-854823-1 Aug 27 05:51:17.116471 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2638bf79-ecfc-4bfd-bf70-31f7802fde57 req-bacd2c35-e590-453f-8c87-44076af709d8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097969 Aug 27 05:51:17.117139 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3876/7699] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:51:17.222773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-82498677-371d-4b47-ba06-8bd56379db3d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:17.231269 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-82498677-371d-4b47-ba06-8bd56379db3d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1564 microversion: 2.1 time: 0.213922 Aug 27 05:51:17.231852 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3824/7700] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:17 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1564 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:42.493601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-548c398d-a5c5-418a-9faf-1a8322e4b597 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:51:42.495972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-548c398d-a5c5-418a-9faf-1a8322e4b597 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:42.498478 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:42.499170 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=38 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:42.505731 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-548c398d-a5c5-418a-9faf-1a8322e4b597 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:42.506246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-548c398d-a5c5-418a-9faf-1a8322e4b597 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:42.506704 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-548c398d-a5c5-418a-9faf-1a8322e4b597 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:42.507422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-548c398d-a5c5-418a-9faf-1a8322e4b597 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:42.507903 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-548c398d-a5c5-418a-9faf-1a8322e4b597 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:42.508352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-548c398d-a5c5-418a-9faf-1a8322e4b597 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:42.564637 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-548c398d-a5c5-418a-9faf-1a8322e4b597 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4/action" status: 200 len: 24571 microversion: 2.1 time: 0.075215 Aug 27 05:51:42.565317 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3877/7701] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:51:42 2022] POST /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4/action => generated 24571 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:51:53.531023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:51:53.533474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:53.536111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:53.536791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=36 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:53.543458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:53.543949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:53.544387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:53.545108 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:53.545562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:53.545986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:53.590434 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:53.597249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Old instance type m1.heat2, new instance type m1.heat {{(pid=128870) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 05:51:53.603815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:51:53.604236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:51:53.604740 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:51:53.605152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:51:53.605563 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:51:53.669374 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1f0e2695-6d24-4f2a-a62a-a2c3e6bd5e06 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4/action" status: 202 len: 0 microversion: 2.1 time: 0.142516 Aug 27 05:51:53.670003 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3825/7702] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:51:53 2022] POST /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:51:53.679461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72ee0017-8678-44ff-b34d-b75605847552 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:53.680174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-72ee0017-8678-44ff-b34d-b75605847552 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:53.683316 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:53.684004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:51:53.690387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72ee0017-8678-44ff-b34d-b75605847552 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:53.692516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72ee0017-8678-44ff-b34d-b75605847552 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:53.692516 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72ee0017-8678-44ff-b34d-b75605847552 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:53.692809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72ee0017-8678-44ff-b34d-b75605847552 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:53.693124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72ee0017-8678-44ff-b34d-b75605847552 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:53.693563 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72ee0017-8678-44ff-b34d-b75605847552 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:53.833766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-72ee0017-8678-44ff-b34d-b75605847552 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:53.842478 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-72ee0017-8678-44ff-b34d-b75605847552 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1691 microversion: 2.1 time: 0.167194 Aug 27 05:51:53.842990 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3878/7703] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:53 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:54.867441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-604bbf9f-e2c2-4fb3-92f4-e1d3d5daf073 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:54.868706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-604bbf9f-e2c2-4fb3-92f4-e1d3d5daf073 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:54.878458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-604bbf9f-e2c2-4fb3-92f4-e1d3d5daf073 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:54.879514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-604bbf9f-e2c2-4fb3-92f4-e1d3d5daf073 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:54.880149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-604bbf9f-e2c2-4fb3-92f4-e1d3d5daf073 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:54.881139 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-604bbf9f-e2c2-4fb3-92f4-e1d3d5daf073 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:54.881874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-604bbf9f-e2c2-4fb3-92f4-e1d3d5daf073 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:54.882561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-604bbf9f-e2c2-4fb3-92f4-e1d3d5daf073 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:55.110713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-604bbf9f-e2c2-4fb3-92f4-e1d3d5daf073 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:55.118865 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-604bbf9f-e2c2-4fb3-92f4-e1d3d5daf073 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1691 microversion: 2.1 time: 0.257905 Aug 27 05:51:55.119394 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3826/7704] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:54 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1691 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:51:56.142536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-542a35df-0a2b-426b-8d7f-843f1f2a475c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:56.143205 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-542a35df-0a2b-426b-8d7f-843f1f2a475c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:56.153399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-542a35df-0a2b-426b-8d7f-843f1f2a475c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:56.153921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-542a35df-0a2b-426b-8d7f-843f1f2a475c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:56.154375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-542a35df-0a2b-426b-8d7f-843f1f2a475c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:56.155103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-542a35df-0a2b-426b-8d7f-843f1f2a475c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:56.155578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-542a35df-0a2b-426b-8d7f-843f1f2a475c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:56.156056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-542a35df-0a2b-426b-8d7f-843f1f2a475c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:56.291288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-542a35df-0a2b-426b-8d7f-843f1f2a475c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:56.300117 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-542a35df-0a2b-426b-8d7f-843f1f2a475c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1691 microversion: 2.1 time: 0.162216 Aug 27 05:51:56.300742 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3879/7705] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:56 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:57.323411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6e99ae73-a5bc-4e93-9ae0-ba1ad272d24b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:57.324037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6e99ae73-a5bc-4e93-9ae0-ba1ad272d24b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:57.331407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e99ae73-a5bc-4e93-9ae0-ba1ad272d24b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:57.331897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e99ae73-a5bc-4e93-9ae0-ba1ad272d24b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:57.332339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e99ae73-a5bc-4e93-9ae0-ba1ad272d24b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:57.333068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e99ae73-a5bc-4e93-9ae0-ba1ad272d24b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:57.333530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e99ae73-a5bc-4e93-9ae0-ba1ad272d24b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:57.333959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e99ae73-a5bc-4e93-9ae0-ba1ad272d24b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:57.479849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6e99ae73-a5bc-4e93-9ae0-ba1ad272d24b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:57.487742 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6e99ae73-a5bc-4e93-9ae0-ba1ad272d24b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1696 microversion: 2.1 time: 0.168563 Aug 27 05:51:57.488323 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3827/7706] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:57 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:58.509734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-16f45367-b983-4195-a0b4-eba1e89a1116 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:58.510366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-16f45367-b983-4195-a0b4-eba1e89a1116 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:58.518039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f45367-b983-4195-a0b4-eba1e89a1116 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:58.518543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f45367-b983-4195-a0b4-eba1e89a1116 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:58.518997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f45367-b983-4195-a0b4-eba1e89a1116 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:58.519714 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f45367-b983-4195-a0b4-eba1e89a1116 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:58.520187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f45367-b983-4195-a0b4-eba1e89a1116 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:58.520657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f45367-b983-4195-a0b4-eba1e89a1116 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:58.653276 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-16f45367-b983-4195-a0b4-eba1e89a1116 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:58.661718 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-16f45367-b983-4195-a0b4-eba1e89a1116 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1696 microversion: 2.1 time: 0.156024 Aug 27 05:51:58.662333 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3880/7707] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:58 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:51:59.683505 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5b09d0f8-18df-41ce-8362-68635ba0d87d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:51:59.684179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5b09d0f8-18df-41ce-8362-68635ba0d87d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:51:59.691845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b09d0f8-18df-41ce-8362-68635ba0d87d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:59.692344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b09d0f8-18df-41ce-8362-68635ba0d87d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:59.692828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b09d0f8-18df-41ce-8362-68635ba0d87d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:59.693539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b09d0f8-18df-41ce-8362-68635ba0d87d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:51:59.694001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b09d0f8-18df-41ce-8362-68635ba0d87d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:51:59.694485 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b09d0f8-18df-41ce-8362-68635ba0d87d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:51:59.826955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5b09d0f8-18df-41ce-8362-68635ba0d87d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:51:59.835382 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5b09d0f8-18df-41ce-8362-68635ba0d87d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1696 microversion: 2.1 time: 0.155955 Aug 27 05:51:59.835957 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3828/7708] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:51:59 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:00.856364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d912bc4-3d32-4524-8dd9-30d2a4b2b53f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:00.857026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d912bc4-3d32-4524-8dd9-30d2a4b2b53f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:00.864408 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d912bc4-3d32-4524-8dd9-30d2a4b2b53f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:00.864943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d912bc4-3d32-4524-8dd9-30d2a4b2b53f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:00.865397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d912bc4-3d32-4524-8dd9-30d2a4b2b53f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:00.866107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d912bc4-3d32-4524-8dd9-30d2a4b2b53f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:00.866580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d912bc4-3d32-4524-8dd9-30d2a4b2b53f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:00.867030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d912bc4-3d32-4524-8dd9-30d2a4b2b53f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:01.000211 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d912bc4-3d32-4524-8dd9-30d2a4b2b53f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:01.007922 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d912bc4-3d32-4524-8dd9-30d2a4b2b53f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1696 microversion: 2.1 time: 0.155486 Aug 27 05:52:01.008500 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3881/7709] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:00 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:02.028645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d01536fc-5601-4fcc-8881-284ed715a7b5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:02.029262 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d01536fc-5601-4fcc-8881-284ed715a7b5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:02.036422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d01536fc-5601-4fcc-8881-284ed715a7b5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:02.036937 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d01536fc-5601-4fcc-8881-284ed715a7b5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:02.037375 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d01536fc-5601-4fcc-8881-284ed715a7b5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:02.038067 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d01536fc-5601-4fcc-8881-284ed715a7b5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:02.038523 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d01536fc-5601-4fcc-8881-284ed715a7b5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:02.038969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d01536fc-5601-4fcc-8881-284ed715a7b5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:02.169302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d01536fc-5601-4fcc-8881-284ed715a7b5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:02.177980 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d01536fc-5601-4fcc-8881-284ed715a7b5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1696 microversion: 2.1 time: 0.153161 Aug 27 05:52:02.178546 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3829/7710] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:02 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:03.199145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8d4d820-7f26-42b7-b9ec-84eb25537363 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:03.200149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8d4d820-7f26-42b7-b9ec-84eb25537363 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:03.207462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8d4d820-7f26-42b7-b9ec-84eb25537363 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:03.207960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8d4d820-7f26-42b7-b9ec-84eb25537363 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:03.208409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8d4d820-7f26-42b7-b9ec-84eb25537363 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:03.209131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8d4d820-7f26-42b7-b9ec-84eb25537363 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:03.209599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8d4d820-7f26-42b7-b9ec-84eb25537363 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:03.210039 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8d4d820-7f26-42b7-b9ec-84eb25537363 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:03.349087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8d4d820-7f26-42b7-b9ec-84eb25537363 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:03.357062 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8d4d820-7f26-42b7-b9ec-84eb25537363 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1696 microversion: 2.1 time: 0.161855 Aug 27 05:52:03.357647 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3882/7711] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:03 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:04.379288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99163b92-ca54-40db-b77e-5082f73a267c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:04.379979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-99163b92-ca54-40db-b77e-5082f73a267c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:04.386445 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99163b92-ca54-40db-b77e-5082f73a267c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:04.386934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99163b92-ca54-40db-b77e-5082f73a267c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:04.387371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99163b92-ca54-40db-b77e-5082f73a267c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:04.388066 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99163b92-ca54-40db-b77e-5082f73a267c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:04.388539 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99163b92-ca54-40db-b77e-5082f73a267c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:04.388971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99163b92-ca54-40db-b77e-5082f73a267c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:04.535396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-99163b92-ca54-40db-b77e-5082f73a267c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:04.543647 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-99163b92-ca54-40db-b77e-5082f73a267c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1696 microversion: 2.1 time: 0.168812 Aug 27 05:52:04.544230 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3830/7712] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:04 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:05.653547 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-879dc426-d7e4-4a6b-85d8-7b840f257723 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:05.654186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-879dc426-d7e4-4a6b-85d8-7b840f257723 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:05.660327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-879dc426-d7e4-4a6b-85d8-7b840f257723 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:05.660876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-879dc426-d7e4-4a6b-85d8-7b840f257723 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:05.661336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-879dc426-d7e4-4a6b-85d8-7b840f257723 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:05.662056 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-879dc426-d7e4-4a6b-85d8-7b840f257723 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:05.662574 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-879dc426-d7e4-4a6b-85d8-7b840f257723 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:05.663087 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-879dc426-d7e4-4a6b-85d8-7b840f257723 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:05.795565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-879dc426-d7e4-4a6b-85d8-7b840f257723 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:05.803440 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-879dc426-d7e4-4a6b-85d8-7b840f257723 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1696 microversion: 2.1 time: 0.241330 Aug 27 05:52:05.804029 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3883/7713] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:05 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1696 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:06.825397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-414193c6-34ea-4fa5-be56-18f346b725ec tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:06.827413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-414193c6-34ea-4fa5-be56-18f346b725ec tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:06.833418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-414193c6-34ea-4fa5-be56-18f346b725ec tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:06.833902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-414193c6-34ea-4fa5-be56-18f346b725ec tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:06.834343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-414193c6-34ea-4fa5-be56-18f346b725ec tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:06.835032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-414193c6-34ea-4fa5-be56-18f346b725ec tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:06.835489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-414193c6-34ea-4fa5-be56-18f346b725ec tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:06.835911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-414193c6-34ea-4fa5-be56-18f346b725ec tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:06.969903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-414193c6-34ea-4fa5-be56-18f346b725ec tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:06.977779 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-414193c6-34ea-4fa5-be56-18f346b725ec tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1696 microversion: 2.1 time: 0.156193 Aug 27 05:52:06.978849 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3831/7714] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:06 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:07.999433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c636083e-fb17-4725-b9dd-c7b52f7feb86 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:08.000629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c636083e-fb17-4725-b9dd-c7b52f7feb86 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:08.008198 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c636083e-fb17-4725-b9dd-c7b52f7feb86 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:08.008732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c636083e-fb17-4725-b9dd-c7b52f7feb86 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:08.009182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c636083e-fb17-4725-b9dd-c7b52f7feb86 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:08.009887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c636083e-fb17-4725-b9dd-c7b52f7feb86 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:08.010352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c636083e-fb17-4725-b9dd-c7b52f7feb86 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:08.010784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c636083e-fb17-4725-b9dd-c7b52f7feb86 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:08.145463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c636083e-fb17-4725-b9dd-c7b52f7feb86 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:08.153534 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c636083e-fb17-4725-b9dd-c7b52f7feb86 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1696 microversion: 2.1 time: 0.157976 Aug 27 05:52:08.154118 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3884/7715] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:07 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:09.091983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ee159538-06c1-4aec-8018-36766dc4eceb req-d915ed61-3a99-46ab-9929-aeaa85ae2cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bdcd7e7-65a2-42d5-8ec1-4910888130a4", "name": "network-vif-unplugged", "status": "completed", "tag": "c2b9e636-5a72-4d35-aa4b-5eb3590f65a7"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:09.104502 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ee159538-06c1-4aec-8018-36766dc4eceb req-d915ed61-3a99-46ab-9929-aeaa85ae2cea service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:09.105012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ee159538-06c1-4aec-8018-36766dc4eceb req-d915ed61-3a99-46ab-9929-aeaa85ae2cea service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:09.105452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ee159538-06c1-4aec-8018-36766dc4eceb req-d915ed61-3a99-46ab-9929-aeaa85ae2cea service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:09.117483 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ee159538-06c1-4aec-8018-36766dc4eceb req-d915ed61-3a99-46ab-9929-aeaa85ae2cea service nova] Creating event network-vif-unplugged:c2b9e636-5a72-4d35-aa4b-5eb3590f65a7 for instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 on n-h1-854823-1 Aug 27 05:52:09.122933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-ee159538-06c1-4aec-8018-36766dc4eceb req-d915ed61-3a99-46ab-9929-aeaa85ae2cea service nova] Instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:52:09.133966 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ee159538-06c1-4aec-8018-36766dc4eceb req-d915ed61-3a99-46ab-9929-aeaa85ae2cea service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046164 Aug 27 05:52:09.134819 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3832/7716] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:52:09.174552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a84dc9bb-969e-4061-8ec9-5dd3215402b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:09.175192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a84dc9bb-969e-4061-8ec9-5dd3215402b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:09.182332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a84dc9bb-969e-4061-8ec9-5dd3215402b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:09.182850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a84dc9bb-969e-4061-8ec9-5dd3215402b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:09.183306 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a84dc9bb-969e-4061-8ec9-5dd3215402b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:09.184045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a84dc9bb-969e-4061-8ec9-5dd3215402b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:09.184518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a84dc9bb-969e-4061-8ec9-5dd3215402b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:09.184985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a84dc9bb-969e-4061-8ec9-5dd3215402b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:09.336554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a84dc9bb-969e-4061-8ec9-5dd3215402b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:09.344569 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a84dc9bb-969e-4061-8ec9-5dd3215402b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1695 microversion: 2.1 time: 0.174084 Aug 27 05:52:09.345158 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3885/7717] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:09 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:10.368840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-08b9797a-0b6f-4959-85bb-3fe4b93d5b1e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:10.369483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-08b9797a-0b6f-4959-85bb-3fe4b93d5b1e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:10.375735 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08b9797a-0b6f-4959-85bb-3fe4b93d5b1e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:10.376223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08b9797a-0b6f-4959-85bb-3fe4b93d5b1e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:10.376698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08b9797a-0b6f-4959-85bb-3fe4b93d5b1e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:10.377392 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08b9797a-0b6f-4959-85bb-3fe4b93d5b1e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:10.377859 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08b9797a-0b6f-4959-85bb-3fe4b93d5b1e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:10.378288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-08b9797a-0b6f-4959-85bb-3fe4b93d5b1e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:10.516040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-08b9797a-0b6f-4959-85bb-3fe4b93d5b1e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:10.523885 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-08b9797a-0b6f-4959-85bb-3fe4b93d5b1e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1693 microversion: 2.1 time: 0.160261 Aug 27 05:52:10.524519 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3833/7718] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:10 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:11.172832 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-76988b38-0697-492c-a51c-b097a19d3f68 req-271f1e14-0375-4b08-8779-891c7b55211e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bdcd7e7-65a2-42d5-8ec1-4910888130a4", "tag": "c2b9e636-5a72-4d35-aa4b-5eb3590f65a7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:11.183628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-76988b38-0697-492c-a51c-b097a19d3f68 req-271f1e14-0375-4b08-8779-891c7b55211e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:11.184128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-76988b38-0697-492c-a51c-b097a19d3f68 req-271f1e14-0375-4b08-8779-891c7b55211e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:11.184605 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-76988b38-0697-492c-a51c-b097a19d3f68 req-271f1e14-0375-4b08-8779-891c7b55211e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:11.196652 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-76988b38-0697-492c-a51c-b097a19d3f68 req-271f1e14-0375-4b08-8779-891c7b55211e service nova] Creating event network-changed:c2b9e636-5a72-4d35-aa4b-5eb3590f65a7 for instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 on n-h1-854823-1 Aug 27 05:52:11.202013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-76988b38-0697-492c-a51c-b097a19d3f68 req-271f1e14-0375-4b08-8779-891c7b55211e service nova] Instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:52:11.213397 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-76988b38-0697-492c-a51c-b097a19d3f68 req-271f1e14-0375-4b08-8779-891c7b55211e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044409 Aug 27 05:52:11.214001 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3886/7719] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:52:11.547133 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3a2b9d9d-c850-451b-b987-2e635cd92937 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:11.547752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3a2b9d9d-c850-451b-b987-2e635cd92937 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:11.554967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a2b9d9d-c850-451b-b987-2e635cd92937 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:11.555447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a2b9d9d-c850-451b-b987-2e635cd92937 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:11.555881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a2b9d9d-c850-451b-b987-2e635cd92937 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:11.556636 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a2b9d9d-c850-451b-b987-2e635cd92937 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:11.557091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a2b9d9d-c850-451b-b987-2e635cd92937 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:11.557515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3a2b9d9d-c850-451b-b987-2e635cd92937 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:11.818599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3a2b9d9d-c850-451b-b987-2e635cd92937 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:11.827113 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3a2b9d9d-c850-451b-b987-2e635cd92937 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1693 microversion: 2.1 time: 0.284358 Aug 27 05:52:11.827942 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3834/7720] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:11 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1693 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:12.850510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec8dbc59-e099-4071-81a3-84a3a7a0f2af tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:12.851233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec8dbc59-e099-4071-81a3-84a3a7a0f2af tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:12.857458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec8dbc59-e099-4071-81a3-84a3a7a0f2af tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:12.857959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec8dbc59-e099-4071-81a3-84a3a7a0f2af tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:12.858409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec8dbc59-e099-4071-81a3-84a3a7a0f2af tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:12.859116 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec8dbc59-e099-4071-81a3-84a3a7a0f2af tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:12.859590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec8dbc59-e099-4071-81a3-84a3a7a0f2af tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:12.860175 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec8dbc59-e099-4071-81a3-84a3a7a0f2af tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:13.056068 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec8dbc59-e099-4071-81a3-84a3a7a0f2af tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:13.064602 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec8dbc59-e099-4071-81a3-84a3a7a0f2af tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1693 microversion: 2.1 time: 0.219252 Aug 27 05:52:13.065281 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3887/7721] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:12 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1693 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:14.087113 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bfbacf54-34b8-4595-bee9-0c3393149849 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:14.087775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bfbacf54-34b8-4595-bee9-0c3393149849 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:14.095571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfbacf54-34b8-4595-bee9-0c3393149849 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:14.096068 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfbacf54-34b8-4595-bee9-0c3393149849 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:14.096512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfbacf54-34b8-4595-bee9-0c3393149849 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:14.097246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfbacf54-34b8-4595-bee9-0c3393149849 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:14.097707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfbacf54-34b8-4595-bee9-0c3393149849 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:14.098135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfbacf54-34b8-4595-bee9-0c3393149849 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:14.240132 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bfbacf54-34b8-4595-bee9-0c3393149849 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:14.248196 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bfbacf54-34b8-4595-bee9-0c3393149849 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1690 microversion: 2.1 time: 0.165079 Aug 27 05:52:14.248790 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3835/7722] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:14 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:14.269122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6253779f-7154-42d6-8e2d-22c534f0bd2b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:14.269675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6253779f-7154-42d6-8e2d-22c534f0bd2b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:14.277003 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6253779f-7154-42d6-8e2d-22c534f0bd2b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:14.277506 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6253779f-7154-42d6-8e2d-22c534f0bd2b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:14.277959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6253779f-7154-42d6-8e2d-22c534f0bd2b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:14.278693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6253779f-7154-42d6-8e2d-22c534f0bd2b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:14.279147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6253779f-7154-42d6-8e2d-22c534f0bd2b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:14.279589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6253779f-7154-42d6-8e2d-22c534f0bd2b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:14.341256 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6253779f-7154-42d6-8e2d-22c534f0bd2b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4/action" status: 204 len: 0 microversion: 2.1 time: 0.076449 Aug 27 05:52:14.341908 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3888/7723] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:52:14 2022] POST /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:52:14.350818 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-bfe3711a-19ad-431e-81e1-0482b49466a0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:14.351474 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-bfe3711a-19ad-431e-81e1-0482b49466a0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:14.357816 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe3711a-19ad-431e-81e1-0482b49466a0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:14.358254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe3711a-19ad-431e-81e1-0482b49466a0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:14.358697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe3711a-19ad-431e-81e1-0482b49466a0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:14.359491 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe3711a-19ad-431e-81e1-0482b49466a0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:14.359955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe3711a-19ad-431e-81e1-0482b49466a0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:14.360664 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-bfe3711a-19ad-431e-81e1-0482b49466a0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:14.537119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-bfe3711a-19ad-431e-81e1-0482b49466a0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:14.546626 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-bfe3711a-19ad-431e-81e1-0482b49466a0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1690 microversion: 2.1 time: 0.199747 Aug 27 05:52:14.547238 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3836/7724] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:14 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:14.567868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc404d71-f6c6-46a5-9c94-8cd7c02abeb6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:14.568622 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bc404d71-f6c6-46a5-9c94-8cd7c02abeb6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:14.575262 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc404d71-f6c6-46a5-9c94-8cd7c02abeb6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:14.575769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc404d71-f6c6-46a5-9c94-8cd7c02abeb6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:14.576225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc404d71-f6c6-46a5-9c94-8cd7c02abeb6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:14.576981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc404d71-f6c6-46a5-9c94-8cd7c02abeb6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:14.577488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc404d71-f6c6-46a5-9c94-8cd7c02abeb6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:14.578656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc404d71-f6c6-46a5-9c94-8cd7c02abeb6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:14.725221 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bc404d71-f6c6-46a5-9c94-8cd7c02abeb6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:14.733215 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc404d71-f6c6-46a5-9c94-8cd7c02abeb6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1690 microversion: 2.1 time: 0.169683 Aug 27 05:52:14.733888 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3889/7725] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:14 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:15.075112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-39f8539d-bf8e-4736-983a-2b37854ceea8 req-34934ac4-6a6f-421e-9770-62b1f1a0fafb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bdcd7e7-65a2-42d5-8ec1-4910888130a4", "name": "network-vif-plugged", "status": "completed", "tag": "c2b9e636-5a72-4d35-aa4b-5eb3590f65a7"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:15.084850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-39f8539d-bf8e-4736-983a-2b37854ceea8 req-34934ac4-6a6f-421e-9770-62b1f1a0fafb service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:15.085331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-39f8539d-bf8e-4736-983a-2b37854ceea8 req-34934ac4-6a6f-421e-9770-62b1f1a0fafb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:15.085920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-39f8539d-bf8e-4736-983a-2b37854ceea8 req-34934ac4-6a6f-421e-9770-62b1f1a0fafb service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:15.099415 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-39f8539d-bf8e-4736-983a-2b37854ceea8 req-34934ac4-6a6f-421e-9770-62b1f1a0fafb service nova] Creating event network-vif-plugged:c2b9e636-5a72-4d35-aa4b-5eb3590f65a7 for instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 on n-h1-854823-1 Aug 27 05:52:15.106018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [req-39f8539d-bf8e-4736-983a-2b37854ceea8 req-34934ac4-6a6f-421e-9770-62b1f1a0fafb service nova] Instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-1', 'n-h1-854823-1'} {{(pid=128870) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 05:52:15.117746 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-39f8539d-bf8e-4736-983a-2b37854ceea8 req-34934ac4-6a6f-421e-9770-62b1f1a0fafb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046251 Aug 27 05:52:15.118987 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3837/7726] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:52:15.755551 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0a350c1-8e51-45b9-be93-a285301dec13 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:52:15.756192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0a350c1-8e51-45b9-be93-a285301dec13 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:15.763336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a350c1-8e51-45b9-be93-a285301dec13 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:15.763930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a350c1-8e51-45b9-be93-a285301dec13 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:15.764395 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a350c1-8e51-45b9-be93-a285301dec13 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:15.765190 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a350c1-8e51-45b9-be93-a285301dec13 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:15.766167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a350c1-8e51-45b9-be93-a285301dec13 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:15.766610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0a350c1-8e51-45b9-be93-a285301dec13 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:15.904815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0a350c1-8e51-45b9-be93-a285301dec13 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:52:15.913411 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0a350c1-8e51-45b9-be93-a285301dec13 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1682 microversion: 2.1 time: 0.162387 Aug 27 05:52:15.913993 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3890/7727] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:52:15 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:52:46.122907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=30 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:52:46.123659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:52:46.128515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ef0b3855-af47-49ce-aff0-1a3f72d0de27 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:52:46.130849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ef0b3855-af47-49ce-aff0-1a3f72d0de27 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:52:46.138141 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef0b3855-af47-49ce-aff0-1a3f72d0de27 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:46.138626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef0b3855-af47-49ce-aff0-1a3f72d0de27 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:46.139059 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef0b3855-af47-49ce-aff0-1a3f72d0de27 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:46.139755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef0b3855-af47-49ce-aff0-1a3f72d0de27 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:52:46.140208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef0b3855-af47-49ce-aff0-1a3f72d0de27 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:52:46.140669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ef0b3855-af47-49ce-aff0-1a3f72d0de27 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:52:46.195711 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ef0b3855-af47-49ce-aff0-1a3f72d0de27 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4/action" status: 200 len: 24578 microversion: 2.1 time: 0.074528 Aug 27 05:52:46.196315 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3838/7728] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:52:46 2022] POST /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4/action => generated 24578 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:53:09.748146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f00e02a8-8a0b-49b9-8247-7432905d2b9e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:09.748699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f00e02a8-8a0b-49b9-8247-7432905d2b9e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:09.752404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-75edc165-b672-498e-adbe-a65d59bd06e5 req-91cf14b4-7de5-458f-aac3-b34f1bf9199e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bdcd7e7-65a2-42d5-8ec1-4910888130a4", "tag": "c2b9e636-5a72-4d35-aa4b-5eb3590f65a7"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:53:09.753346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=26 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:53:09.754144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:53:09.755414 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 05:53:09.755566 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 (ip 10.222.0.79) !!! Aug 27 05:53:09.758641 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:53:09.759693 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:53:09.766899 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-75edc165-b672-498e-adbe-a65d59bd06e5 req-91cf14b4-7de5-458f-aac3-b34f1bf9199e service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:09.767702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-75edc165-b672-498e-adbe-a65d59bd06e5 req-91cf14b4-7de5-458f-aac3-b34f1bf9199e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:09.768152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-75edc165-b672-498e-adbe-a65d59bd06e5 req-91cf14b4-7de5-458f-aac3-b34f1bf9199e service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:09.770530 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f00e02a8-8a0b-49b9-8247-7432905d2b9e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:09.771033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f00e02a8-8a0b-49b9-8247-7432905d2b9e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:09.771483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f00e02a8-8a0b-49b9-8247-7432905d2b9e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:09.772192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f00e02a8-8a0b-49b9-8247-7432905d2b9e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:09.772698 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f00e02a8-8a0b-49b9-8247-7432905d2b9e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:09.773131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f00e02a8-8a0b-49b9-8247-7432905d2b9e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:09.782047 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-75edc165-b672-498e-adbe-a65d59bd06e5 req-91cf14b4-7de5-458f-aac3-b34f1bf9199e service nova] Creating event network-changed:c2b9e636-5a72-4d35-aa4b-5eb3590f65a7 for instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 on n-h1-854823-1 Aug 27 05:53:09.788042 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-75edc165-b672-498e-adbe-a65d59bd06e5 req-91cf14b4-7de5-458f-aac3-b34f1bf9199e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040844 Aug 27 05:53:09.789415 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3839/7729] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:53:09.808495 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f00e02a8-8a0b-49b9-8247-7432905d2b9e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:53:09.894243 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f00e02a8-8a0b-49b9-8247-7432905d2b9e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 204 len: 0 microversion: 2.1 time: 0.149747 Aug 27 05:53:09.894987 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3891/7730] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:53:09 2022] DELETE /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:53:09.904264 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-28546540-d40e-4f55-a9c4-6bd91132d2d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:09.905120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-28546540-d40e-4f55-a9c4-6bd91132d2d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:09.911705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28546540-d40e-4f55-a9c4-6bd91132d2d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:09.912204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28546540-d40e-4f55-a9c4-6bd91132d2d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:09.912745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28546540-d40e-4f55-a9c4-6bd91132d2d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:09.913504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28546540-d40e-4f55-a9c4-6bd91132d2d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:09.913989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28546540-d40e-4f55-a9c4-6bd91132d2d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:09.914453 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-28546540-d40e-4f55-a9c4-6bd91132d2d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:10.102513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-28546540-d40e-4f55-a9c4-6bd91132d2d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:10.111742 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-28546540-d40e-4f55-a9c4-6bd91132d2d2 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1688 microversion: 2.1 time: 0.211579 Aug 27 05:53:10.112381 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3840/7731] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:09 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1688 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:11.135483 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca050dfe-4286-48b8-9b6a-cfec1f32fb2f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:11.136208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca050dfe-4286-48b8-9b6a-cfec1f32fb2f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:11.144027 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca050dfe-4286-48b8-9b6a-cfec1f32fb2f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:11.144557 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca050dfe-4286-48b8-9b6a-cfec1f32fb2f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:11.145025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca050dfe-4286-48b8-9b6a-cfec1f32fb2f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:11.145748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca050dfe-4286-48b8-9b6a-cfec1f32fb2f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:11.146229 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca050dfe-4286-48b8-9b6a-cfec1f32fb2f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:11.146674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca050dfe-4286-48b8-9b6a-cfec1f32fb2f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:11.284611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca050dfe-4286-48b8-9b6a-cfec1f32fb2f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:11.292807 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca050dfe-4286-48b8-9b6a-cfec1f32fb2f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1688 microversion: 2.1 time: 0.161653 Aug 27 05:53:11.293402 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3892/7732] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:11 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:12.004572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-2df440e1-00b6-4c11-bfae-87c6091b62ba req-e7d0f88f-fec2-42cc-b81a-5ce308d9d023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bdcd7e7-65a2-42d5-8ec1-4910888130a4", "name": "network-vif-deleted", "tag": "c2b9e636-5a72-4d35-aa4b-5eb3590f65a7"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:53:12.015340 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2df440e1-00b6-4c11-bfae-87c6091b62ba req-e7d0f88f-fec2-42cc-b81a-5ce308d9d023 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:12.015747 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2df440e1-00b6-4c11-bfae-87c6091b62ba req-e7d0f88f-fec2-42cc-b81a-5ce308d9d023 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:12.016182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2df440e1-00b6-4c11-bfae-87c6091b62ba req-e7d0f88f-fec2-42cc-b81a-5ce308d9d023 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:12.028129 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-2df440e1-00b6-4c11-bfae-87c6091b62ba req-e7d0f88f-fec2-42cc-b81a-5ce308d9d023 service nova] Creating event network-vif-deleted:c2b9e636-5a72-4d35-aa4b-5eb3590f65a7 for instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 on n-h1-854823-1 Aug 27 05:53:12.033762 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-2df440e1-00b6-4c11-bfae-87c6091b62ba req-e7d0f88f-fec2-42cc-b81a-5ce308d9d023 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032229 Aug 27 05:53:12.034372 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3841/7733] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:53:12.315191 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4d742405-9dac-4492-b594-f9a7942b844b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:12.315821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4d742405-9dac-4492-b594-f9a7942b844b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:12.322943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d742405-9dac-4492-b594-f9a7942b844b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:12.323459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d742405-9dac-4492-b594-f9a7942b844b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:12.323911 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d742405-9dac-4492-b594-f9a7942b844b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:12.324665 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d742405-9dac-4492-b594-f9a7942b844b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:12.325142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d742405-9dac-4492-b594-f9a7942b844b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:12.325582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d742405-9dac-4492-b594-f9a7942b844b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:12.361313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d742405-9dac-4492-b594-f9a7942b844b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:12.361823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d742405-9dac-4492-b594-f9a7942b844b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:12.363061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d742405-9dac-4492-b594-f9a7942b844b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:12.363987 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-4d742405-9dac-4492-b594-f9a7942b844b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lazy-loading 'fault' on Instance uuid 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:53:12.409772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4d742405-9dac-4492-b594-f9a7942b844b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:12.419803 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4d742405-9dac-4492-b594-f9a7942b844b tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 200 len: 1355 microversion: 2.1 time: 0.109027 Aug 27 05:53:12.420423 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3893/7734] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:12 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 1355 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:13.446034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-07cdb2d3-2c58-424f-a945-d0aaf6ca0751 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:13.446603 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-07cdb2d3-2c58-424f-a945-d0aaf6ca0751 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 1bdcd7e7-65a2-42d5-8ec1-4910888130a4] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:13.452786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07cdb2d3-2c58-424f-a945-d0aaf6ca0751 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:13.453274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07cdb2d3-2c58-424f-a945-d0aaf6ca0751 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:13.453710 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07cdb2d3-2c58-424f-a945-d0aaf6ca0751 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:13.454959 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07cdb2d3-2c58-424f-a945-d0aaf6ca0751 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:13.455425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07cdb2d3-2c58-424f-a945-d0aaf6ca0751 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:13.455850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-07cdb2d3-2c58-424f-a945-d0aaf6ca0751 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:13.469158 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-07cdb2d3-2c58-424f-a945-d0aaf6ca0751 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] HTTP exception thrown: Instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 could not be found. Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-07cdb2d3-2c58-424f-a945-d0aaf6ca0751 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Request method failure captured: Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 HTTP/1.1 Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCa_ZB1xxAu3ecBWGCK15_VmwaqF85neIEJdIAs7jNcxu1djgNXg7VI5VEOXS6WWCK2ve_0FSkl7NBlNjuccjBtXyVgh36GbN5jZ_YNqVuaf7D46o15NEfIZsTXQ1HZhwQ_n0Ff1o9_p7xlfNP4YcpgeNU05P-LCu3qnPhIYmdM1z8e8 Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 277e817efae04205bf58e32de7c168ce Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/277e817efae04205bf58e32de7c168ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_277e817efae04205bf58e32de7c168ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/277e817efae04205bf58e32de7c168ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/277e817efae04205bf58e32de7c168ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 277e817efae04205bf58e32de7c168ce Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestNetworkAdvancedServerOps-1233409680-project Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 19fb9c5c1cfd4cb2b33a7c22d7311ffe Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1233409680-project Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 could not be found. Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '1bdcd7e7-65a2-42d5-8ec1-4910888130a4'} Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 could not be found. Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 could not be found. Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:53:13.471436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:53:13.476694 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:53:13.476694 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:53:13.476694 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:53:13.476694 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:53:13.476694 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:53:13.476694 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:53:13.476694 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 could not be found. Aug 27 05:53:13.476694 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:53:13.476694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-07cdb2d3-2c58-424f-a945-d0aaf6ca0751 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Returning 404 to user: Instance 1bdcd7e7-65a2-42d5-8ec1-4910888130a4 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:53:13.476694 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-07cdb2d3-2c58-424f-a945-d0aaf6ca0751 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4" status: 404 len: 111 microversion: 2.1 time: 0.032124 Aug 27 05:53:13.476694 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3842/7735] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:13 2022] GET /compute/v2.1/servers/1bdcd7e7-65a2-42d5-8ec1-4910888130a4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:53:16.519133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b12ffba9-5f6c-4c7c-98a0-fbf2a23a7937 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '.version_select at 0x7f1f206ad820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:16.553820 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b12ffba9-5f6c-4c7c-98a0-fbf2a23a7937 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-697574875" status: 202 len: 0 microversion: 2.1 time: 0.039363 Aug 27 05:53:16.555375 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3894/7736] 10.222.0.79 () {58 vars in 1281 bytes} [Sat Aug 27 05:53:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-697574875 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:53:16.582712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-28e95285-e369-4dab-90fa-9692f1065f3d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'create', calling method: .version_select at 0x7f1f222dc820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-231190212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEWLkfX5705EXqycn9Vs1gBgnxWhtIdV3efrco1lrbBklo+YsnF0nrz1NVdZiI9Ou082TsQwQPWCueQdf7nJADl5CdL+RfYzfrJgTLKDbAex6VxiPE7tsa2BdkXXUc6sg=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:53:16.600822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-28e95285-e369-4dab-90fa-9692f1065f3d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for project 277e817efae04205bf58e32de7c168ce. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:53:16.606245 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-28e95285-e369-4dab-90fa-9692f1065f3d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for user 19fb9c5c1cfd4cb2b33a7c22d7311ffe and project 277e817efae04205bf58e32de7c168ce. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:53:16.629670 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-28e95285-e369-4dab-90fa-9692f1065f3d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051356 Aug 27 05:53:16.630213 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3843/7737] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:53:16 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:53:22.204708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-162651293", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "04fdc5ea-e9e0-440c-988c-777a2150cffd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-231190212", "security_groups": [{"name": "tempest-secgroup-smoke-1228678391"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:53:22.339479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] validate_networks() for [('04fdc5ea-e9e0-440c-988c-777a2150cffd', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:53:22.414454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:53:22.862158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:53:22.862648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:53:22.863149 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:53:22.863586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:53:22.864025 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:53:22.873914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:22.874432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:22.874894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:22.875648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:22.876126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:22.877124 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:22.897959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for project 277e817efae04205bf58e32de7c168ce. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:53:22.903948 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for user 19fb9c5c1cfd4cb2b33a7c22d7311ffe and project 277e817efae04205bf58e32de7c168ce. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:53:22.917806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:53:22.920242 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:53:22.971822 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bbae1d1b-0b87-447d-b8b2-96b8aa0e191e tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.771021 Aug 27 05:53:22.972822 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3895/7738] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:53:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:53:22.985070 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1cd79e91-40bb-47e4-8a56-365befc8a567 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:22.985481 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1cd79e91-40bb-47e4-8a56-365befc8a567 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:23.049256 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1cd79e91-40bb-47e4-8a56-365befc8a567 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:23.056837 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1cd79e91-40bb-47e4-8a56-365befc8a567 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1265 microversion: 2.1 time: 0.077064 Aug 27 05:53:23.057438 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3844/7739] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:22 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:53:24.078084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90aa8141-4de4-4b07-8f54-fc9b8764eef4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:24.079463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90aa8141-4de4-4b07-8f54-fc9b8764eef4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:24.151387 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-90aa8141-4de4-4b07-8f54-fc9b8764eef4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:24.161055 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90aa8141-4de4-4b07-8f54-fc9b8764eef4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1265 microversion: 2.1 time: 0.086742 Aug 27 05:53:24.162176 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3896/7740] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:24 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:25.181778 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aa4d2f53-c9fd-4238-99db-38f9f10e9621 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:25.182395 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aa4d2f53-c9fd-4238-99db-38f9f10e9621 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:25.184361 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=12 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:53:25.240842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aa4d2f53-c9fd-4238-99db-38f9f10e9621 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:25.248021 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aa4d2f53-c9fd-4238-99db-38f9f10e9621 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1265 microversion: 2.1 time: 0.070071 Aug 27 05:53:25.248625 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3845/7741] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:25 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1265 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:53:26.273434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df06ee4a-1275-406a-b069-17d18c87d80d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:26.274147 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-df06ee4a-1275-406a-b069-17d18c87d80d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:26.327196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-df06ee4a-1275-406a-b069-17d18c87d80d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:26.335412 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-df06ee4a-1275-406a-b069-17d18c87d80d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1265 microversion: 2.1 time: 0.066004 Aug 27 05:53:26.335983 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3897/7742] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:26 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1265 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:27.356830 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-053fdd95-d0dd-4f0f-b264-21f72bbf3f0c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:27.357452 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-053fdd95-d0dd-4f0f-b264-21f72bbf3f0c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:27.364962 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-053fdd95-d0dd-4f0f-b264-21f72bbf3f0c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:27.365457 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-053fdd95-d0dd-4f0f-b264-21f72bbf3f0c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:27.365904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-053fdd95-d0dd-4f0f-b264-21f72bbf3f0c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:27.366610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-053fdd95-d0dd-4f0f-b264-21f72bbf3f0c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:27.367081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-053fdd95-d0dd-4f0f-b264-21f72bbf3f0c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:27.367517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-053fdd95-d0dd-4f0f-b264-21f72bbf3f0c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:27.429040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-053fdd95-d0dd-4f0f-b264-21f72bbf3f0c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:27.436788 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-053fdd95-d0dd-4f0f-b264-21f72bbf3f0c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1269 microversion: 2.1 time: 0.083918 Aug 27 05:53:27.437366 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3846/7743] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:27 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1269 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:28.457755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3977f824-3e99-435e-8633-c7373b9d5bda tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:28.458418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3977f824-3e99-435e-8633-c7373b9d5bda tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:28.465628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3977f824-3e99-435e-8633-c7373b9d5bda tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:28.466130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3977f824-3e99-435e-8633-c7373b9d5bda tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:28.466573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3977f824-3e99-435e-8633-c7373b9d5bda tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:28.467293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3977f824-3e99-435e-8633-c7373b9d5bda tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:28.467761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3977f824-3e99-435e-8633-c7373b9d5bda tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:28.468196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3977f824-3e99-435e-8633-c7373b9d5bda tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:28.532197 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3977f824-3e99-435e-8633-c7373b9d5bda tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:28.551751 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3977f824-3e99-435e-8633-c7373b9d5bda tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1323 microversion: 2.1 time: 0.098436 Aug 27 05:53:28.552822 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3898/7744] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:28 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1323 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:29.523913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e0be4a84-4a5b-40f5-a7af-718cf184cb45 req-13965b76-89ba-43f7-b217-a5c85aeeda56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b75ad15-be48-4cb4-b2de-d2950897416a", "tag": "4109cc89-bab1-404d-86d3-0aca451033e2"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:53:29.534950 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e0be4a84-4a5b-40f5-a7af-718cf184cb45 req-13965b76-89ba-43f7-b217-a5c85aeeda56 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:29.535674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e0be4a84-4a5b-40f5-a7af-718cf184cb45 req-13965b76-89ba-43f7-b217-a5c85aeeda56 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:29.536299 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e0be4a84-4a5b-40f5-a7af-718cf184cb45 req-13965b76-89ba-43f7-b217-a5c85aeeda56 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:29.550077 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e0be4a84-4a5b-40f5-a7af-718cf184cb45 req-13965b76-89ba-43f7-b217-a5c85aeeda56 service nova] Creating event network-changed:4109cc89-bab1-404d-86d3-0aca451033e2 for instance 7b75ad15-be48-4cb4-b2de-d2950897416a on n-h2-854823-1 Aug 27 05:53:29.555660 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e0be4a84-4a5b-40f5-a7af-718cf184cb45 req-13965b76-89ba-43f7-b217-a5c85aeeda56 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035835 Aug 27 05:53:29.556277 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3847/7745] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:53:29.573751 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82af7154-9661-4fd9-9056-46b04c712029 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:29.574371 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-82af7154-9661-4fd9-9056-46b04c712029 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:29.582146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82af7154-9661-4fd9-9056-46b04c712029 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:29.582646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82af7154-9661-4fd9-9056-46b04c712029 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:29.583094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82af7154-9661-4fd9-9056-46b04c712029 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:29.583809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82af7154-9661-4fd9-9056-46b04c712029 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:29.584279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82af7154-9661-4fd9-9056-46b04c712029 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:29.584965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82af7154-9661-4fd9-9056-46b04c712029 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:29.725271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-82af7154-9661-4fd9-9056-46b04c712029 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:29.733932 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-82af7154-9661-4fd9-9056-46b04c712029 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1391 microversion: 2.1 time: 0.164438 Aug 27 05:53:29.734536 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3899/7746] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:29 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:30.755645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cb798a81-bf89-47d5-bafd-1c6d46a3e22f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:30.756275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cb798a81-bf89-47d5-bafd-1c6d46a3e22f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:30.763425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb798a81-bf89-47d5-bafd-1c6d46a3e22f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:30.763914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb798a81-bf89-47d5-bafd-1c6d46a3e22f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:30.764356 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb798a81-bf89-47d5-bafd-1c6d46a3e22f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:30.765090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb798a81-bf89-47d5-bafd-1c6d46a3e22f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:30.765554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb798a81-bf89-47d5-bafd-1c6d46a3e22f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:30.765987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb798a81-bf89-47d5-bafd-1c6d46a3e22f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:30.987241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cb798a81-bf89-47d5-bafd-1c6d46a3e22f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:30.995225 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cb798a81-bf89-47d5-bafd-1c6d46a3e22f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1391 microversion: 2.1 time: 0.243927 Aug 27 05:53:30.995828 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3848/7747] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:30 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1391 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:32.016455 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d05f275-79ff-4865-9868-0d07810cf3ee tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:32.017204 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8d05f275-79ff-4865-9868-0d07810cf3ee tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:32.024295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d05f275-79ff-4865-9868-0d07810cf3ee tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:32.024841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d05f275-79ff-4865-9868-0d07810cf3ee tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:32.025305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d05f275-79ff-4865-9868-0d07810cf3ee tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:32.026030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d05f275-79ff-4865-9868-0d07810cf3ee tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:32.026534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d05f275-79ff-4865-9868-0d07810cf3ee tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:32.026985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d05f275-79ff-4865-9868-0d07810cf3ee tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:32.160837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8d05f275-79ff-4865-9868-0d07810cf3ee tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:32.168839 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8d05f275-79ff-4865-9868-0d07810cf3ee tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1391 microversion: 2.1 time: 0.156424 Aug 27 05:53:32.169433 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3900/7748] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:32 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:33.190081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-3af207c0-351f-4cb3-b0b3-f7fbe229f934 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:33.190702 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-3af207c0-351f-4cb3-b0b3-f7fbe229f934 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:33.197993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3af207c0-351f-4cb3-b0b3-f7fbe229f934 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:33.198487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3af207c0-351f-4cb3-b0b3-f7fbe229f934 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:33.198935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3af207c0-351f-4cb3-b0b3-f7fbe229f934 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:33.199644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3af207c0-351f-4cb3-b0b3-f7fbe229f934 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:33.200127 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3af207c0-351f-4cb3-b0b3-f7fbe229f934 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:33.200547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-3af207c0-351f-4cb3-b0b3-f7fbe229f934 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:33.341045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-3af207c0-351f-4cb3-b0b3-f7fbe229f934 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:33.349841 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-3af207c0-351f-4cb3-b0b3-f7fbe229f934 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1391 microversion: 2.1 time: 0.163689 Aug 27 05:53:33.350453 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3849/7749] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:33 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:53:33.385466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-33616acd-f23f-4199-9ac3-7134c23531bc req-6169c37c-1f2a-4034-b979-bd24649b998f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b75ad15-be48-4cb4-b2de-d2950897416a", "name": "network-vif-plugged", "status": "completed", "tag": "4109cc89-bab1-404d-86d3-0aca451033e2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:53:33.390753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:53:33.398559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-33616acd-f23f-4199-9ac3-7134c23531bc req-6169c37c-1f2a-4034-b979-bd24649b998f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:33.399131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-33616acd-f23f-4199-9ac3-7134c23531bc req-6169c37c-1f2a-4034-b979-bd24649b998f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:33.399566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-33616acd-f23f-4199-9ac3-7134c23531bc req-6169c37c-1f2a-4034-b979-bd24649b998f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:33.411781 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-33616acd-f23f-4199-9ac3-7134c23531bc req-6169c37c-1f2a-4034-b979-bd24649b998f service nova] Creating event network-vif-plugged:4109cc89-bab1-404d-86d3-0aca451033e2 for instance 7b75ad15-be48-4cb4-b2de-d2950897416a on n-h2-854823-1 Aug 27 05:53:33.416770 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-33616acd-f23f-4199-9ac3-7134c23531bc req-6169c37c-1f2a-4034-b979-bd24649b998f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035104 Aug 27 05:53:33.417722 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3901/7750] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:53:34.370834 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a3dc73cb-86e3-4871-9b40-6819bf43b3ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:34.371565 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a3dc73cb-86e3-4871-9b40-6819bf43b3ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:34.378898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3dc73cb-86e3-4871-9b40-6819bf43b3ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:34.379382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3dc73cb-86e3-4871-9b40-6819bf43b3ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:34.379820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3dc73cb-86e3-4871-9b40-6819bf43b3ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:34.380508 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3dc73cb-86e3-4871-9b40-6819bf43b3ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:34.381015 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3dc73cb-86e3-4871-9b40-6819bf43b3ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:34.381443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a3dc73cb-86e3-4871-9b40-6819bf43b3ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:34.516854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a3dc73cb-86e3-4871-9b40-6819bf43b3ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:34.525245 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a3dc73cb-86e3-4871-9b40-6819bf43b3ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1391 microversion: 2.1 time: 0.158329 Aug 27 05:53:34.525815 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3850/7751] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:34 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:35.549302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc076ec4-fd9d-4ee6-b0b5-f7203d0f9f84 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:35.550026 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fc076ec4-fd9d-4ee6-b0b5-f7203d0f9f84 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:35.556315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc076ec4-fd9d-4ee6-b0b5-f7203d0f9f84 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:35.556850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc076ec4-fd9d-4ee6-b0b5-f7203d0f9f84 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:35.557303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc076ec4-fd9d-4ee6-b0b5-f7203d0f9f84 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:35.558018 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc076ec4-fd9d-4ee6-b0b5-f7203d0f9f84 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:35.558489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc076ec4-fd9d-4ee6-b0b5-f7203d0f9f84 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:35.558933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc076ec4-fd9d-4ee6-b0b5-f7203d0f9f84 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:35.692192 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fc076ec4-fd9d-4ee6-b0b5-f7203d0f9f84 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:35.700502 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc076ec4-fd9d-4ee6-b0b5-f7203d0f9f84 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1563 microversion: 2.1 time: 0.157103 Aug 27 05:53:35.701144 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3902/7752] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:35 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:35.721767 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-84179589-a1c7-466d-b14e-9bd11ce04887 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:35.722411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-84179589-a1c7-466d-b14e-9bd11ce04887 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:35.724371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=8 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:53:35.730646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84179589-a1c7-466d-b14e-9bd11ce04887 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:35.731129 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84179589-a1c7-466d-b14e-9bd11ce04887 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:35.731561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84179589-a1c7-466d-b14e-9bd11ce04887 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:35.732250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84179589-a1c7-466d-b14e-9bd11ce04887 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:35.732766 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84179589-a1c7-466d-b14e-9bd11ce04887 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:35.733222 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-84179589-a1c7-466d-b14e-9bd11ce04887 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:35.862882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-84179589-a1c7-466d-b14e-9bd11ce04887 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:35.871300 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-84179589-a1c7-466d-b14e-9bd11ce04887 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1563 microversion: 2.1 time: 0.153957 Aug 27 05:53:35.871935 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3851/7753] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:35 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:53:37.816750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f113451-972b-4d25-ab1f-75bffe8e5f64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:53:37.817452 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f113451-972b-4d25-ab1f-75bffe8e5f64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:53:37.822519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-1a3cd3ff-8065-4626-80b1-42e453e42cde req-2f89da2d-4d5a-4341-9e4e-93b803fff34c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b75ad15-be48-4cb4-b2de-d2950897416a", "tag": "4109cc89-bab1-404d-86d3-0aca451033e2"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:53:37.828724 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:53:37.841646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f113451-972b-4d25-ab1f-75bffe8e5f64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:37.842555 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f113451-972b-4d25-ab1f-75bffe8e5f64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:37.842982 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1a3cd3ff-8065-4626-80b1-42e453e42cde req-2f89da2d-4d5a-4341-9e4e-93b803fff34c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:37.843372 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f113451-972b-4d25-ab1f-75bffe8e5f64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:37.843500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1a3cd3ff-8065-4626-80b1-42e453e42cde req-2f89da2d-4d5a-4341-9e4e-93b803fff34c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:37.844022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-1a3cd3ff-8065-4626-80b1-42e453e42cde req-2f89da2d-4d5a-4341-9e4e-93b803fff34c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:37.844878 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f113451-972b-4d25-ab1f-75bffe8e5f64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:53:37.846210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f113451-972b-4d25-ab1f-75bffe8e5f64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:53:37.846613 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f113451-972b-4d25-ab1f-75bffe8e5f64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:53:37.856294 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-1a3cd3ff-8065-4626-80b1-42e453e42cde req-2f89da2d-4d5a-4341-9e4e-93b803fff34c service nova] Creating event network-changed:4109cc89-bab1-404d-86d3-0aca451033e2 for instance 7b75ad15-be48-4cb4-b2de-d2950897416a on n-h2-854823-1 Aug 27 05:53:37.861653 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-1a3cd3ff-8065-4626-80b1-42e453e42cde req-2f89da2d-4d5a-4341-9e4e-93b803fff34c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051112 Aug 27 05:53:37.862560 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3852/7754] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:53:38.012329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f113451-972b-4d25-ab1f-75bffe8e5f64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:53:38.021867 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f113451-972b-4d25-ab1f-75bffe8e5f64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1563 microversion: 2.1 time: 0.213615 Aug 27 05:53:38.022739 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3903/7755] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:53:37 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1563 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:54:03.284554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:03.285322 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=34 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:03.290829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e32decd2-b8b0-4461-9773-9a12ff5db475 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:03.292314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e32decd2-b8b0-4461-9773-9a12ff5db475 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:03.301288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e32decd2-b8b0-4461-9773-9a12ff5db475 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:03.302042 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e32decd2-b8b0-4461-9773-9a12ff5db475 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:03.302488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e32decd2-b8b0-4461-9773-9a12ff5db475 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:03.303196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e32decd2-b8b0-4461-9773-9a12ff5db475 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:03.303659 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e32decd2-b8b0-4461-9773-9a12ff5db475 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:03.304084 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e32decd2-b8b0-4461-9773-9a12ff5db475 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:03.357323 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e32decd2-b8b0-4461-9773-9a12ff5db475 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a/action" status: 200 len: 24573 microversion: 2.1 time: 0.074639 Aug 27 05:54:03.357987 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3853/7756] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:54:03 2022] POST /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a/action => generated 24573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:54:14.366138 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5047d4bb-2ef9-40a4-8711-837c57500eb0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:14.368488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:14.369230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=34 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:14.375148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5047d4bb-2ef9-40a4-8711-837c57500eb0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:14.375642 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5047d4bb-2ef9-40a4-8711-837c57500eb0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:14.376086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5047d4bb-2ef9-40a4-8711-837c57500eb0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:14.399150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5047d4bb-2ef9-40a4-8711-837c57500eb0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Going to try to stop instance {{(pid=128869) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 05:54:14.443550 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5047d4bb-2ef9-40a4-8711-837c57500eb0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a/action" status: 202 len: 0 microversion: 2.1 time: 0.080723 Aug 27 05:54:14.444202 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3904/7757] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:54:14 2022] POST /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 05:54:14.453394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a16d45d5-0423-4cbd-b5f5-d47411aabf5a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:14.454267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a16d45d5-0423-4cbd-b5f5-d47411aabf5a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:14.457658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:14.459204 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:14.467380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a16d45d5-0423-4cbd-b5f5-d47411aabf5a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:14.467877 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a16d45d5-0423-4cbd-b5f5-d47411aabf5a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:14.468323 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a16d45d5-0423-4cbd-b5f5-d47411aabf5a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:14.469214 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a16d45d5-0423-4cbd-b5f5-d47411aabf5a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:14.469686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a16d45d5-0423-4cbd-b5f5-d47411aabf5a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:14.470120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a16d45d5-0423-4cbd-b5f5-d47411aabf5a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:14.610930 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a16d45d5-0423-4cbd-b5f5-d47411aabf5a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:14.618918 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a16d45d5-0423-4cbd-b5f5-d47411aabf5a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1691 microversion: 2.1 time: 0.170001 Aug 27 05:54:14.619431 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3854/7758] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:14 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:15.642590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33938e3b-172c-4464-aeb8-1d50500174ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:15.643315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33938e3b-172c-4464-aeb8-1d50500174ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:15.651177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33938e3b-172c-4464-aeb8-1d50500174ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:15.651678 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33938e3b-172c-4464-aeb8-1d50500174ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:15.652133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33938e3b-172c-4464-aeb8-1d50500174ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:15.652874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33938e3b-172c-4464-aeb8-1d50500174ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:15.653348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33938e3b-172c-4464-aeb8-1d50500174ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:15.653787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33938e3b-172c-4464-aeb8-1d50500174ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:15.786797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33938e3b-172c-4464-aeb8-1d50500174ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:15.795166 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33938e3b-172c-4464-aeb8-1d50500174ca tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1691 microversion: 2.1 time: 0.157001 Aug 27 05:54:15.795758 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3905/7759] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:15 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:16.817282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-10e79de1-5f71-4be3-8b9b-b4001001b410 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:16.818422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-10e79de1-5f71-4be3-8b9b-b4001001b410 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:16.825415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10e79de1-5f71-4be3-8b9b-b4001001b410 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:16.825905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10e79de1-5f71-4be3-8b9b-b4001001b410 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:16.826369 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10e79de1-5f71-4be3-8b9b-b4001001b410 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:16.827101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10e79de1-5f71-4be3-8b9b-b4001001b410 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:16.827525 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10e79de1-5f71-4be3-8b9b-b4001001b410 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:16.827947 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-10e79de1-5f71-4be3-8b9b-b4001001b410 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:16.969192 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-10e79de1-5f71-4be3-8b9b-b4001001b410 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:16.977312 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-10e79de1-5f71-4be3-8b9b-b4001001b410 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1691 microversion: 2.1 time: 0.163936 Aug 27 05:54:16.977914 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3855/7760] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:16 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:17.998086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c25eb0b-1f80-4698-8b0d-04e6bfe8e0b6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:17.998709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c25eb0b-1f80-4698-8b0d-04e6bfe8e0b6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:18.005573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c25eb0b-1f80-4698-8b0d-04e6bfe8e0b6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:18.006071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c25eb0b-1f80-4698-8b0d-04e6bfe8e0b6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:18.006523 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c25eb0b-1f80-4698-8b0d-04e6bfe8e0b6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:18.007226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c25eb0b-1f80-4698-8b0d-04e6bfe8e0b6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:18.007693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c25eb0b-1f80-4698-8b0d-04e6bfe8e0b6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:18.008128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c25eb0b-1f80-4698-8b0d-04e6bfe8e0b6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:18.140042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c25eb0b-1f80-4698-8b0d-04e6bfe8e0b6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:18.148271 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c25eb0b-1f80-4698-8b0d-04e6bfe8e0b6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1691 microversion: 2.1 time: 0.154329 Aug 27 05:54:18.148902 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3906/7761] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:17 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:54:19.170513 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c4051d2d-f33a-4c3f-b9e8-724e20f116b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:19.171120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c4051d2d-f33a-4c3f-b9e8-724e20f116b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:19.178655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4051d2d-f33a-4c3f-b9e8-724e20f116b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:19.179147 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4051d2d-f33a-4c3f-b9e8-724e20f116b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:19.179596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4051d2d-f33a-4c3f-b9e8-724e20f116b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:19.180300 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4051d2d-f33a-4c3f-b9e8-724e20f116b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:19.180874 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4051d2d-f33a-4c3f-b9e8-724e20f116b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:19.181314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4051d2d-f33a-4c3f-b9e8-724e20f116b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:19.311783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c4051d2d-f33a-4c3f-b9e8-724e20f116b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:19.319660 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c4051d2d-f33a-4c3f-b9e8-724e20f116b0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1691 microversion: 2.1 time: 0.153415 Aug 27 05:54:19.320261 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3856/7762] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:19 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:20.341598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-befd5d7d-668c-40fe-a380-74c11760ccae tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:20.342231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-befd5d7d-668c-40fe-a380-74c11760ccae tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:20.349816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-befd5d7d-668c-40fe-a380-74c11760ccae tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:20.350323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-befd5d7d-668c-40fe-a380-74c11760ccae tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:20.350774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-befd5d7d-668c-40fe-a380-74c11760ccae tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:20.351485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-befd5d7d-668c-40fe-a380-74c11760ccae tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:20.351961 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-befd5d7d-668c-40fe-a380-74c11760ccae tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:20.352415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-befd5d7d-668c-40fe-a380-74c11760ccae tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:20.486906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-befd5d7d-668c-40fe-a380-74c11760ccae tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:20.495164 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-befd5d7d-668c-40fe-a380-74c11760ccae tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1691 microversion: 2.1 time: 0.157540 Aug 27 05:54:20.495753 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3907/7763] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:20 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:21.518530 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-331b7763-cb61-4f69-a2c9-72d8372717fb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:21.519152 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-331b7763-cb61-4f69-a2c9-72d8372717fb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:21.526773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-331b7763-cb61-4f69-a2c9-72d8372717fb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:21.527258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-331b7763-cb61-4f69-a2c9-72d8372717fb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:21.527699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-331b7763-cb61-4f69-a2c9-72d8372717fb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:21.528396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-331b7763-cb61-4f69-a2c9-72d8372717fb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:21.528885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-331b7763-cb61-4f69-a2c9-72d8372717fb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:21.529318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-331b7763-cb61-4f69-a2c9-72d8372717fb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:21.665231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-331b7763-cb61-4f69-a2c9-72d8372717fb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:21.673317 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-331b7763-cb61-4f69-a2c9-72d8372717fb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1691 microversion: 2.1 time: 0.160159 Aug 27 05:54:21.673900 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3857/7764] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:21 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:22.696332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3853fed-3ea5-4d2a-85c9-8b39a7ccbbe3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:22.697180 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3853fed-3ea5-4d2a-85c9-8b39a7ccbbe3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:22.704496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3853fed-3ea5-4d2a-85c9-8b39a7ccbbe3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:22.705030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3853fed-3ea5-4d2a-85c9-8b39a7ccbbe3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:22.705487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3853fed-3ea5-4d2a-85c9-8b39a7ccbbe3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:22.706206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3853fed-3ea5-4d2a-85c9-8b39a7ccbbe3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:22.706680 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3853fed-3ea5-4d2a-85c9-8b39a7ccbbe3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:22.707125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3853fed-3ea5-4d2a-85c9-8b39a7ccbbe3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:22.848126 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3853fed-3ea5-4d2a-85c9-8b39a7ccbbe3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:22.856573 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3853fed-3ea5-4d2a-85c9-8b39a7ccbbe3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1691 microversion: 2.1 time: 0.165104 Aug 27 05:54:22.857160 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3908/7765] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:22 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:23.878471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6be713db-6999-45c8-af52-ac8cea333d57 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:23.879089 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6be713db-6999-45c8-af52-ac8cea333d57 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:23.886842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6be713db-6999-45c8-af52-ac8cea333d57 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:23.887334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6be713db-6999-45c8-af52-ac8cea333d57 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:23.887779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6be713db-6999-45c8-af52-ac8cea333d57 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:23.888484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6be713db-6999-45c8-af52-ac8cea333d57 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:23.888969 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6be713db-6999-45c8-af52-ac8cea333d57 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:23.889402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6be713db-6999-45c8-af52-ac8cea333d57 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:24.020142 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6be713db-6999-45c8-af52-ac8cea333d57 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:24.028164 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6be713db-6999-45c8-af52-ac8cea333d57 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1691 microversion: 2.1 time: 0.153841 Aug 27 05:54:24.028778 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3858/7766] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:23 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:25.050208 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82798a3e-6789-40e9-9d91-bd739e2fd895 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:25.050838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-82798a3e-6789-40e9-9d91-bd739e2fd895 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:25.057955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82798a3e-6789-40e9-9d91-bd739e2fd895 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:25.058461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82798a3e-6789-40e9-9d91-bd739e2fd895 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:25.058914 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82798a3e-6789-40e9-9d91-bd739e2fd895 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:25.059625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82798a3e-6789-40e9-9d91-bd739e2fd895 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:25.060099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82798a3e-6789-40e9-9d91-bd739e2fd895 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:25.060567 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82798a3e-6789-40e9-9d91-bd739e2fd895 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:25.205342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-82798a3e-6789-40e9-9d91-bd739e2fd895 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:25.215127 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-82798a3e-6789-40e9-9d91-bd739e2fd895 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1668 microversion: 2.1 time: 0.168807 Aug 27 05:54:25.215838 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3909/7767] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:25 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:26.315648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-2ea29ff1-83b2-456f-97fe-9af65974a90f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:26.318676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-2ea29ff1-83b2-456f-97fe-9af65974a90f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:26.325714 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ea29ff1-83b2-456f-97fe-9af65974a90f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:26.326210 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ea29ff1-83b2-456f-97fe-9af65974a90f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:26.326686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ea29ff1-83b2-456f-97fe-9af65974a90f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:26.327417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ea29ff1-83b2-456f-97fe-9af65974a90f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:26.327882 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ea29ff1-83b2-456f-97fe-9af65974a90f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:26.328313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-2ea29ff1-83b2-456f-97fe-9af65974a90f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:26.381392 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-2ea29ff1-83b2-456f-97fe-9af65974a90f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a/action" status: 200 len: 38197 microversion: 2.1 time: 0.068860 Aug 27 05:54:26.382084 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3859/7768] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:54:26 2022] POST /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a/action => generated 38197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:54:26.393906 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc8ecf54-eae6-40ba-ad9b-2814d894d042 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:26.401267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc8ecf54-eae6-40ba-ad9b-2814d894d042 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:26.401779 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc8ecf54-eae6-40ba-ad9b-2814d894d042 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:26.402233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc8ecf54-eae6-40ba-ad9b-2814d894d042 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:26.425473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc8ecf54-eae6-40ba-ad9b-2814d894d042 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Going to try to start instance {{(pid=128869) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 05:54:26.467633 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc8ecf54-eae6-40ba-ad9b-2814d894d042 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a/action" status: 202 len: 0 microversion: 2.1 time: 0.077473 Aug 27 05:54:26.468252 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3910/7769] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:54:26 2022] POST /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:54:26.477780 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-99e700ec-942c-4db9-9612-595a448f19c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:26.478500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-99e700ec-942c-4db9-9612-595a448f19c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:26.485756 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e700ec-942c-4db9-9612-595a448f19c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:26.486270 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e700ec-942c-4db9-9612-595a448f19c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:26.486687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e700ec-942c-4db9-9612-595a448f19c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:26.487403 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e700ec-942c-4db9-9612-595a448f19c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:26.487864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e700ec-942c-4db9-9612-595a448f19c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:26.488297 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-99e700ec-942c-4db9-9612-595a448f19c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:26.712428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-99e700ec-942c-4db9-9612-595a448f19c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:26.720429 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-99e700ec-942c-4db9-9612-595a448f19c8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1677 microversion: 2.1 time: 0.247466 Aug 27 05:54:26.721045 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3860/7770] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:26 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1677 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:27.743831 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ddedb45-3cda-47a7-913a-aecaff4bb07a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:54:27.744480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ddedb45-3cda-47a7-913a-aecaff4bb07a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:27.751851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ddedb45-3cda-47a7-913a-aecaff4bb07a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:27.752364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ddedb45-3cda-47a7-913a-aecaff4bb07a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:27.752857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ddedb45-3cda-47a7-913a-aecaff4bb07a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:27.753581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ddedb45-3cda-47a7-913a-aecaff4bb07a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:27.754063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ddedb45-3cda-47a7-913a-aecaff4bb07a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:27.754509 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ddedb45-3cda-47a7-913a-aecaff4bb07a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:27.889186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4ddedb45-3cda-47a7-913a-aecaff4bb07a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:54:27.896925 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ddedb45-3cda-47a7-913a-aecaff4bb07a tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1681 microversion: 2.1 time: 0.158412 Aug 27 05:54:27.897496 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3911/7771] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:54:27 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:54:56.108217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a76012cc-d1b8-4889-8df8-932ad9177db5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:54:56.110461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a76012cc-d1b8-4889-8df8-932ad9177db5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:54:56.113121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=14 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:56.113791 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=40 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:54:56.122091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a76012cc-d1b8-4889-8df8-932ad9177db5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:56.122591 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a76012cc-d1b8-4889-8df8-932ad9177db5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:56.123040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a76012cc-d1b8-4889-8df8-932ad9177db5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:56.123752 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a76012cc-d1b8-4889-8df8-932ad9177db5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:54:56.124216 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a76012cc-d1b8-4889-8df8-932ad9177db5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:54:56.124675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a76012cc-d1b8-4889-8df8-932ad9177db5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:54:56.184865 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a76012cc-d1b8-4889-8df8-932ad9177db5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a/action" status: 200 len: 62723 microversion: 2.1 time: 0.080608 Aug 27 05:54:56.185543 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3861/7772] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:54:56 2022] POST /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a/action => generated 62723 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:55:07.954403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39b76575-ffb7-4e39-ae65-e17b7349dd89 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:07.954959 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39b76575-ffb7-4e39-ae65-e17b7349dd89 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:07.956626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-4e927339-2429-4102-8e3c-37f230403320 req-bbcc5533-6326-4602-ad6b-f64904a6e64a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b75ad15-be48-4cb4-b2de-d2950897416a", "tag": "4109cc89-bab1-404d-86d3-0aca451033e2"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:55:07.957206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=16 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:55:07.958107 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:55:07.965425 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:55:07.965942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39b76575-ffb7-4e39-ae65-e17b7349dd89 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:07.966480 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39b76575-ffb7-4e39-ae65-e17b7349dd89 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:07.966717 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:55:07.966902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39b76575-ffb7-4e39-ae65-e17b7349dd89 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:07.967638 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39b76575-ffb7-4e39-ae65-e17b7349dd89 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:07.968238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39b76575-ffb7-4e39-ae65-e17b7349dd89 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:07.968727 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39b76575-ffb7-4e39-ae65-e17b7349dd89 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:07.975420 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4e927339-2429-4102-8e3c-37f230403320 req-bbcc5533-6326-4602-ad6b-f64904a6e64a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:07.976224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4e927339-2429-4102-8e3c-37f230403320 req-bbcc5533-6326-4602-ad6b-f64904a6e64a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:07.976919 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-4e927339-2429-4102-8e3c-37f230403320 req-bbcc5533-6326-4602-ad6b-f64904a6e64a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:07.990249 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-4e927339-2429-4102-8e3c-37f230403320 req-bbcc5533-6326-4602-ad6b-f64904a6e64a service nova] Creating event network-changed:4109cc89-bab1-404d-86d3-0aca451033e2 for instance 7b75ad15-be48-4cb4-b2de-d2950897416a on n-h2-854823-1 Aug 27 05:55:07.996557 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-4e927339-2429-4102-8e3c-37f230403320 req-bbcc5533-6326-4602-ad6b-f64904a6e64a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044135 Aug 27 05:55:07.998124 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3862/7773] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:55:07.999669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39b76575-ffb7-4e39-ae65-e17b7349dd89 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:55:08.089687 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39b76575-ffb7-4e39-ae65-e17b7349dd89 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 204 len: 0 microversion: 2.1 time: 0.139671 Aug 27 05:55:08.096631 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3912/7774] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:55:07 2022] DELETE /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:55:08.102350 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-86532ac5-0591-4f54-a6ba-64a4818bcd26 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:08.103071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-86532ac5-0591-4f54-a6ba-64a4818bcd26 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:08.110638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86532ac5-0591-4f54-a6ba-64a4818bcd26 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:08.111140 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86532ac5-0591-4f54-a6ba-64a4818bcd26 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:08.112295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86532ac5-0591-4f54-a6ba-64a4818bcd26 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:08.112295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86532ac5-0591-4f54-a6ba-64a4818bcd26 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:08.112782 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86532ac5-0591-4f54-a6ba-64a4818bcd26 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:08.113212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-86532ac5-0591-4f54-a6ba-64a4818bcd26 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:08.284612 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-86532ac5-0591-4f54-a6ba-64a4818bcd26 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:08.293147 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-86532ac5-0591-4f54-a6ba-64a4818bcd26 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1687 microversion: 2.1 time: 0.196190 Aug 27 05:55:08.293731 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3863/7775] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:08 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1687 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:09.316188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f07e1be-df78-4e5a-9938-e3355a9ce906 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:09.316942 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3f07e1be-df78-4e5a-9938-e3355a9ce906 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:09.323858 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f07e1be-df78-4e5a-9938-e3355a9ce906 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:09.324357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f07e1be-df78-4e5a-9938-e3355a9ce906 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:09.324839 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f07e1be-df78-4e5a-9938-e3355a9ce906 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:09.325554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f07e1be-df78-4e5a-9938-e3355a9ce906 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:09.326031 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f07e1be-df78-4e5a-9938-e3355a9ce906 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:09.326471 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f07e1be-df78-4e5a-9938-e3355a9ce906 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:09.461676 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f07e1be-df78-4e5a-9938-e3355a9ce906 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:09.469814 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f07e1be-df78-4e5a-9938-e3355a9ce906 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1687 microversion: 2.1 time: 0.157988 Aug 27 05:55:09.470433 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3913/7776] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:09 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:10.417650 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e5bbd7b0-50e5-44b8-8920-f9a25c702108 req-f97e3074-8c4f-4500-9b49-0c7182cfab3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b75ad15-be48-4cb4-b2de-d2950897416a", "name": "network-vif-deleted", "tag": "4109cc89-bab1-404d-86d3-0aca451033e2"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:55:10.429001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e5bbd7b0-50e5-44b8-8920-f9a25c702108 req-f97e3074-8c4f-4500-9b49-0c7182cfab3f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:10.429493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e5bbd7b0-50e5-44b8-8920-f9a25c702108 req-f97e3074-8c4f-4500-9b49-0c7182cfab3f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:10.429929 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e5bbd7b0-50e5-44b8-8920-f9a25c702108 req-f97e3074-8c4f-4500-9b49-0c7182cfab3f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:10.441860 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e5bbd7b0-50e5-44b8-8920-f9a25c702108 req-f97e3074-8c4f-4500-9b49-0c7182cfab3f service nova] Creating event network-vif-deleted:4109cc89-bab1-404d-86d3-0aca451033e2 for instance 7b75ad15-be48-4cb4-b2de-d2950897416a on n-h2-854823-1 Aug 27 05:55:10.447501 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e5bbd7b0-50e5-44b8-8920-f9a25c702108 req-f97e3074-8c4f-4500-9b49-0c7182cfab3f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033547 Aug 27 05:55:10.448120 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3864/7777] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:55:10.491297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63cfc68e-2190-4702-a666-2f998d53c7dc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:10.492015 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-63cfc68e-2190-4702-a666-2f998d53c7dc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:10.499782 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63cfc68e-2190-4702-a666-2f998d53c7dc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:10.500294 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63cfc68e-2190-4702-a666-2f998d53c7dc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:10.500798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63cfc68e-2190-4702-a666-2f998d53c7dc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:10.501505 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63cfc68e-2190-4702-a666-2f998d53c7dc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:10.501981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63cfc68e-2190-4702-a666-2f998d53c7dc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:10.502421 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63cfc68e-2190-4702-a666-2f998d53c7dc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:10.548594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63cfc68e-2190-4702-a666-2f998d53c7dc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:10.549097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63cfc68e-2190-4702-a666-2f998d53c7dc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:10.549550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63cfc68e-2190-4702-a666-2f998d53c7dc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:10.550016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-63cfc68e-2190-4702-a666-2f998d53c7dc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lazy-loading 'fault' on Instance uuid 7b75ad15-be48-4cb4-b2de-d2950897416a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:55:10.593529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63cfc68e-2190-4702-a666-2f998d53c7dc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:10.602395 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63cfc68e-2190-4702-a666-2f998d53c7dc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 200 len: 1355 microversion: 2.1 time: 0.115008 Aug 27 05:55:10.603217 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3914/7778] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:10 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 1355 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:11.625548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8744545b-b36e-4216-8bb5-5d680c3451c3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:11.626282 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-8744545b-b36e-4216-8bb5-5d680c3451c3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 7b75ad15-be48-4cb4-b2de-d2950897416a] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:11.632688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8744545b-b36e-4216-8bb5-5d680c3451c3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:11.633182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8744545b-b36e-4216-8bb5-5d680c3451c3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:11.633627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8744545b-b36e-4216-8bb5-5d680c3451c3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:11.634324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8744545b-b36e-4216-8bb5-5d680c3451c3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:11.634790 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8744545b-b36e-4216-8bb5-5d680c3451c3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:11.635223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-8744545b-b36e-4216-8bb5-5d680c3451c3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:11.648675 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-8744545b-b36e-4216-8bb5-5d680c3451c3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] HTTP exception thrown: Instance 7b75ad15-be48-4cb4-b2de-d2950897416a could not be found. Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8744545b-b36e-4216-8bb5-5d680c3451c3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Request method failure captured: Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a HTTP/1.1 Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCa_ZB1xxAu3ecBWGCK15_VmwaqF85neIEJdIAs7jNcxu1djgNXg7VI5VEOXS6WWCK2ve_0FSkl7NBlNjuccjBtXyVgh36GbN5jZ_YNqVuaf7D46o15NEfIZsTXQ1HZhwQ_n0Ff1o9_p7xlfNP4YcpgeNU05P-LCu3qnPhIYmdM1z8e8 Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 277e817efae04205bf58e32de7c168ce Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/277e817efae04205bf58e32de7c168ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_277e817efae04205bf58e32de7c168ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/277e817efae04205bf58e32de7c168ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/277e817efae04205bf58e32de7c168ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 277e817efae04205bf58e32de7c168ce Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestNetworkAdvancedServerOps-1233409680-project Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 19fb9c5c1cfd4cb2b33a7c22d7311ffe Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1233409680-project Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 7b75ad15-be48-4cb4-b2de-d2950897416a could not be found. Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '7b75ad15-be48-4cb4-b2de-d2950897416a'} Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b75ad15-be48-4cb4-b2de-d2950897416a could not be found. Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b75ad15-be48-4cb4-b2de-d2950897416a could not be found. Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:55:11.650318 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:55:11.655283 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:55:11.655283 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:55:11.655283 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:55:11.655283 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:55:11.655283 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:55:11.655283 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:55:11.655283 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b75ad15-be48-4cb4-b2de-d2950897416a could not be found. Aug 27 05:55:11.655283 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:55:11.655283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-8744545b-b36e-4216-8bb5-5d680c3451c3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Returning 404 to user: Instance 7b75ad15-be48-4cb4-b2de-d2950897416a could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:55:11.655283 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-8744545b-b36e-4216-8bb5-5d680c3451c3 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a" status: 404 len: 111 microversion: 2.1 time: 0.031511 Aug 27 05:55:11.655283 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3865/7779] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:11 2022] GET /compute/v2.1/servers/7b75ad15-be48-4cb4-b2de-d2950897416a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:55:15.061635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a04c0769-0ea1-4b63-96cd-b2dc31c0cf88 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '.version_select at 0x7f1f205d55e0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:15.088805 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a04c0769-0ea1-4b63-96cd-b2dc31c0cf88 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-231190212" status: 202 len: 0 microversion: 2.1 time: 0.031857 Aug 27 05:55:15.091234 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3915/7780] 10.222.0.79 () {58 vars in 1281 bytes} [Sat Aug 27 05:55:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-231190212 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:55:15.124047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-956c2597-14fc-4f33-a794-cb2f47228ec6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'create', calling method: .version_select at 0x7f1f214b7280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1283588238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBqe+1HbaQWkFcP4Ro29sz3+OAgYtFrfgMoQdqPm6eQ1ZyR7cLUfJ7pKmdJTrsNbXBvSRn53Y4tn49wUUacskYp5UIRpTl5uZoy+aHoEEdlVjOW507xVzzehPt4bYg4Lw=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:55:15.133340 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:55:15.133535 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 05:55:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.79) !!! Aug 27 05:55:15.147206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-956c2597-14fc-4f33-a794-cb2f47228ec6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for project 277e817efae04205bf58e32de7c168ce. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:55:15.153407 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-956c2597-14fc-4f33-a794-cb2f47228ec6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for user 19fb9c5c1cfd4cb2b33a7c22d7311ffe and project 277e817efae04205bf58e32de7c168ce. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:55:15.182995 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-956c2597-14fc-4f33-a794-cb2f47228ec6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.063116 Aug 27 05:55:15.183869 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3866/7781] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:55:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:55:20.787655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-36384232", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "networks": [{"uuid": "1a0cc2ff-7dff-4934-864f-7ee890bb58cd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1283588238", "security_groups": [{"name": "tempest-secgroup-smoke-1178583748"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:55:20.808489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:55:20.918667 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] validate_networks() for [('1a0cc2ff-7dff-4934-864f-7ee890bb58cd', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:55:21.320299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:55:21.320772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:55:21.321258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:55:21.321691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:55:21.322226 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:55:21.332063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:21.332720 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:21.333176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:21.334460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:21.335080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:21.335569 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:21.354231 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for project 277e817efae04205bf58e32de7c168ce. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:55:21.359766 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Getting quotas for user 19fb9c5c1cfd4cb2b33a7c22d7311ffe and project 277e817efae04205bf58e32de7c168ce. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:55:21.374723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:55:21.377243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:55:21.428302 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-caa30e83-6926-4ba6-ad4e-f6339c63f8e1 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.645116 Aug 27 05:55:21.429212 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3916/7782] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:55:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:55:21.441419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c425fe2-f015-421b-bd86-83595a999920 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:21.443458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1c425fe2-f015-421b-bd86-83595a999920 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:21.522912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1c425fe2-f015-421b-bd86-83595a999920 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:21.532462 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1c425fe2-f015-421b-bd86-83595a999920 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1265 microversion: 2.1 time: 0.095959 Aug 27 05:55:21.533306 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3867/7783] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:21 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:22.556273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84f995f1-7ecf-44aa-a7ab-88fd437ecf42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:22.556923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-84f995f1-7ecf-44aa-a7ab-88fd437ecf42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:22.564370 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84f995f1-7ecf-44aa-a7ab-88fd437ecf42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:22.565145 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84f995f1-7ecf-44aa-a7ab-88fd437ecf42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:22.565798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84f995f1-7ecf-44aa-a7ab-88fd437ecf42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:22.566707 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84f995f1-7ecf-44aa-a7ab-88fd437ecf42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:22.567940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84f995f1-7ecf-44aa-a7ab-88fd437ecf42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:22.568561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84f995f1-7ecf-44aa-a7ab-88fd437ecf42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:22.636649 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84f995f1-7ecf-44aa-a7ab-88fd437ecf42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:22.646788 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-84f995f1-7ecf-44aa-a7ab-88fd437ecf42 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1335 microversion: 2.1 time: 0.096202 Aug 27 05:55:22.662325 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3917/7784] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:22 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:23.670515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-464996db-f650-4f3f-b356-a94604b51ebf tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:23.671144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-464996db-f650-4f3f-b356-a94604b51ebf tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:23.674409 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=12 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:55:23.681580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-464996db-f650-4f3f-b356-a94604b51ebf tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:23.686462 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-464996db-f650-4f3f-b356-a94604b51ebf tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:23.687009 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-464996db-f650-4f3f-b356-a94604b51ebf tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:23.687848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-464996db-f650-4f3f-b356-a94604b51ebf tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:23.688394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-464996db-f650-4f3f-b356-a94604b51ebf tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:23.688931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-464996db-f650-4f3f-b356-a94604b51ebf tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:23.935426 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-464996db-f650-4f3f-b356-a94604b51ebf tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:23.943290 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-464996db-f650-4f3f-b356-a94604b51ebf tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1391 microversion: 2.1 time: 0.277013 Aug 27 05:55:23.943878 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3868/7785] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:23 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1391 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:24.066453 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b376c4a8-cf78-4977-bf1d-dd9a06dc5892 req-ba32b1ef-f439-4bc1-a29c-2c8d73ebb052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd1b535-6621-4032-896a-3ad8fd88bc75", "tag": "e86b3bf7-cd5e-4b7e-858b-9e5f6efe6a83"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:55:24.085411 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b376c4a8-cf78-4977-bf1d-dd9a06dc5892 req-ba32b1ef-f439-4bc1-a29c-2c8d73ebb052 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:24.086051 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b376c4a8-cf78-4977-bf1d-dd9a06dc5892 req-ba32b1ef-f439-4bc1-a29c-2c8d73ebb052 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:24.086748 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b376c4a8-cf78-4977-bf1d-dd9a06dc5892 req-ba32b1ef-f439-4bc1-a29c-2c8d73ebb052 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:24.103133 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b376c4a8-cf78-4977-bf1d-dd9a06dc5892 req-ba32b1ef-f439-4bc1-a29c-2c8d73ebb052 service nova] Creating event network-changed:e86b3bf7-cd5e-4b7e-858b-9e5f6efe6a83 for instance 8cd1b535-6621-4032-896a-3ad8fd88bc75 on n-h1-854823-1 Aug 27 05:55:24.110453 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b376c4a8-cf78-4977-bf1d-dd9a06dc5892 req-ba32b1ef-f439-4bc1-a29c-2c8d73ebb052 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047338 Aug 27 05:55:24.111858 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3918/7786] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:55:24.964584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ca1577ef-abd9-4273-8eb6-757b1469cefe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:24.965225 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ca1577ef-abd9-4273-8eb6-757b1469cefe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:24.972004 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca1577ef-abd9-4273-8eb6-757b1469cefe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:24.972487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca1577ef-abd9-4273-8eb6-757b1469cefe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:24.973029 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca1577ef-abd9-4273-8eb6-757b1469cefe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:24.973719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca1577ef-abd9-4273-8eb6-757b1469cefe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:24.974175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca1577ef-abd9-4273-8eb6-757b1469cefe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:24.974604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ca1577ef-abd9-4273-8eb6-757b1469cefe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:25.109045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ca1577ef-abd9-4273-8eb6-757b1469cefe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:25.116841 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ca1577ef-abd9-4273-8eb6-757b1469cefe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1391 microversion: 2.1 time: 0.156154 Aug 27 05:55:25.117470 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3869/7787] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:24 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:26.140984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ea387f6-ad56-4db0-953c-3171b38654bb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:26.141823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ea387f6-ad56-4db0-953c-3171b38654bb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:26.148157 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ea387f6-ad56-4db0-953c-3171b38654bb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:26.148700 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ea387f6-ad56-4db0-953c-3171b38654bb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:26.149199 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ea387f6-ad56-4db0-953c-3171b38654bb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:26.149884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ea387f6-ad56-4db0-953c-3171b38654bb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:26.150355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ea387f6-ad56-4db0-953c-3171b38654bb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:26.150823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ea387f6-ad56-4db0-953c-3171b38654bb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:26.286810 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4ea387f6-ad56-4db0-953c-3171b38654bb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:26.295000 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ea387f6-ad56-4db0-953c-3171b38654bb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1391 microversion: 2.1 time: 0.159146 Aug 27 05:55:26.295588 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3919/7788] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:26 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:27.316504 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-982bed14-4f63-4652-a296-a0fe724a4cf5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:27.317181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-982bed14-4f63-4652-a296-a0fe724a4cf5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:27.324196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-982bed14-4f63-4652-a296-a0fe724a4cf5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:27.324742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-982bed14-4f63-4652-a296-a0fe724a4cf5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:27.325219 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-982bed14-4f63-4652-a296-a0fe724a4cf5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:27.325955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-982bed14-4f63-4652-a296-a0fe724a4cf5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:27.326463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-982bed14-4f63-4652-a296-a0fe724a4cf5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:27.326916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-982bed14-4f63-4652-a296-a0fe724a4cf5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:27.474669 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-982bed14-4f63-4652-a296-a0fe724a4cf5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:27.482607 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-982bed14-4f63-4652-a296-a0fe724a4cf5 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1391 microversion: 2.1 time: 0.170168 Aug 27 05:55:27.483207 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3870/7789] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:27 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:28.503472 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-509a30c2-bb13-4a1c-937b-f13fcc0446a6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:28.504120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-509a30c2-bb13-4a1c-937b-f13fcc0446a6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:28.511255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-509a30c2-bb13-4a1c-937b-f13fcc0446a6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:28.511841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-509a30c2-bb13-4a1c-937b-f13fcc0446a6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:28.512366 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-509a30c2-bb13-4a1c-937b-f13fcc0446a6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:28.513159 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-509a30c2-bb13-4a1c-937b-f13fcc0446a6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:28.513624 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-509a30c2-bb13-4a1c-937b-f13fcc0446a6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:28.514283 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-509a30c2-bb13-4a1c-937b-f13fcc0446a6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:28.649123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-509a30c2-bb13-4a1c-937b-f13fcc0446a6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:28.657242 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-509a30c2-bb13-4a1c-937b-f13fcc0446a6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1391 microversion: 2.1 time: 0.157790 Aug 27 05:55:28.657845 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3920/7790] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:28 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:29.679277 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae910ae6-589a-46c1-9efc-1010669f8fdb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:29.679890 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ae910ae6-589a-46c1-9efc-1010669f8fdb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:29.686684 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae910ae6-589a-46c1-9efc-1010669f8fdb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:29.687170 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae910ae6-589a-46c1-9efc-1010669f8fdb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:29.687609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae910ae6-589a-46c1-9efc-1010669f8fdb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:29.688309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae910ae6-589a-46c1-9efc-1010669f8fdb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:29.688798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae910ae6-589a-46c1-9efc-1010669f8fdb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:29.689237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae910ae6-589a-46c1-9efc-1010669f8fdb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:29.820172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ae910ae6-589a-46c1-9efc-1010669f8fdb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:29.828155 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ae910ae6-589a-46c1-9efc-1010669f8fdb tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1391 microversion: 2.1 time: 0.152778 Aug 27 05:55:29.828768 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3871/7791] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:29 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:30.136369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9f88c84c-2142-431e-8685-a3852a2d2fee req-ea1a895f-966a-4c59-b81c-59cbc210c57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd1b535-6621-4032-896a-3ad8fd88bc75", "name": "network-vif-plugged", "status": "completed", "tag": "e86b3bf7-cd5e-4b7e-858b-9e5f6efe6a83"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:55:30.147964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9f88c84c-2142-431e-8685-a3852a2d2fee req-ea1a895f-966a-4c59-b81c-59cbc210c57c service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:30.148659 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9f88c84c-2142-431e-8685-a3852a2d2fee req-ea1a895f-966a-4c59-b81c-59cbc210c57c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:30.149640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9f88c84c-2142-431e-8685-a3852a2d2fee req-ea1a895f-966a-4c59-b81c-59cbc210c57c service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:30.162210 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9f88c84c-2142-431e-8685-a3852a2d2fee req-ea1a895f-966a-4c59-b81c-59cbc210c57c service nova] Creating event network-vif-plugged:e86b3bf7-cd5e-4b7e-858b-9e5f6efe6a83 for instance 8cd1b535-6621-4032-896a-3ad8fd88bc75 on n-h1-854823-1 Aug 27 05:55:30.167686 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9f88c84c-2142-431e-8685-a3852a2d2fee req-ea1a895f-966a-4c59-b81c-59cbc210c57c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035152 Aug 27 05:55:30.168493 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3921/7792] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:55:30.849189 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6a7ceea2-bf8a-44ff-9447-b396cc83affe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:30.849813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6a7ceea2-bf8a-44ff-9447-b396cc83affe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:30.857273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a7ceea2-bf8a-44ff-9447-b396cc83affe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:30.857764 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a7ceea2-bf8a-44ff-9447-b396cc83affe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:30.858207 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a7ceea2-bf8a-44ff-9447-b396cc83affe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:30.858905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a7ceea2-bf8a-44ff-9447-b396cc83affe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:30.859365 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a7ceea2-bf8a-44ff-9447-b396cc83affe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:30.859796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6a7ceea2-bf8a-44ff-9447-b396cc83affe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:30.993071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6a7ceea2-bf8a-44ff-9447-b396cc83affe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:31.000821 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6a7ceea2-bf8a-44ff-9447-b396cc83affe tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1391 microversion: 2.1 time: 0.155615 Aug 27 05:55:31.001404 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3872/7793] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:30 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:32.023035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c597f4b9-e5cc-4161-b540-d0d8b08afdf7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:32.023732 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c597f4b9-e5cc-4161-b540-d0d8b08afdf7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:32.026646 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:55:32.027364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:55:32.033548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c597f4b9-e5cc-4161-b540-d0d8b08afdf7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:32.034057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c597f4b9-e5cc-4161-b540-d0d8b08afdf7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:32.034519 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c597f4b9-e5cc-4161-b540-d0d8b08afdf7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:32.035239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c597f4b9-e5cc-4161-b540-d0d8b08afdf7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:32.036216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c597f4b9-e5cc-4161-b540-d0d8b08afdf7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:32.036708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c597f4b9-e5cc-4161-b540-d0d8b08afdf7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:32.168824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c597f4b9-e5cc-4161-b540-d0d8b08afdf7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:32.177143 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c597f4b9-e5cc-4161-b540-d0d8b08afdf7 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1563 microversion: 2.1 time: 0.158573 Aug 27 05:55:32.177756 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3922/7794] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:32 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:32.199076 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a42da12e-a20e-4336-a9db-876a76b725c0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:32.199698 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a42da12e-a20e-4336-a9db-876a76b725c0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:32.201667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:55:32.208686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42da12e-a20e-4336-a9db-876a76b725c0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:32.209179 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42da12e-a20e-4336-a9db-876a76b725c0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:32.209626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42da12e-a20e-4336-a9db-876a76b725c0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:32.210328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42da12e-a20e-4336-a9db-876a76b725c0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:32.210796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42da12e-a20e-4336-a9db-876a76b725c0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:32.211232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a42da12e-a20e-4336-a9db-876a76b725c0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:32.342806 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a42da12e-a20e-4336-a9db-876a76b725c0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:32.351194 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a42da12e-a20e-4336-a9db-876a76b725c0 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1563 microversion: 2.1 time: 0.156745 Aug 27 05:55:32.351774 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3873/7795] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:32 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:55:34.251462 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5e97007-b1f9-4665-a1cd-6adfc3cf87fc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:55:34.252844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b5e97007-b1f9-4665-a1cd-6adfc3cf87fc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:55:34.253220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-09af8d24-2120-46a6-b3ea-bd1882bfe0f8 req-063501b7-00d1-416b-a794-fa4be26bc506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd1b535-6621-4032-896a-3ad8fd88bc75", "tag": "e86b3bf7-cd5e-4b7e-858b-9e5f6efe6a83"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:55:34.260398 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e97007-b1f9-4665-a1cd-6adfc3cf87fc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:34.261355 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e97007-b1f9-4665-a1cd-6adfc3cf87fc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:34.261816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e97007-b1f9-4665-a1cd-6adfc3cf87fc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:34.262544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e97007-b1f9-4665-a1cd-6adfc3cf87fc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:34.263017 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e97007-b1f9-4665-a1cd-6adfc3cf87fc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:34.263459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e97007-b1f9-4665-a1cd-6adfc3cf87fc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:34.264180 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-09af8d24-2120-46a6-b3ea-bd1882bfe0f8 req-063501b7-00d1-416b-a794-fa4be26bc506 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:55:34.264696 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-09af8d24-2120-46a6-b3ea-bd1882bfe0f8 req-063501b7-00d1-416b-a794-fa4be26bc506 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:55:34.265122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-09af8d24-2120-46a6-b3ea-bd1882bfe0f8 req-063501b7-00d1-416b-a794-fa4be26bc506 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:55:34.278175 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-09af8d24-2120-46a6-b3ea-bd1882bfe0f8 req-063501b7-00d1-416b-a794-fa4be26bc506 service nova] Creating event network-changed:e86b3bf7-cd5e-4b7e-858b-9e5f6efe6a83 for instance 8cd1b535-6621-4032-896a-3ad8fd88bc75 on n-h1-854823-1 Aug 27 05:55:34.283522 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-09af8d24-2120-46a6-b3ea-bd1882bfe0f8 req-063501b7-00d1-416b-a794-fa4be26bc506 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034291 Aug 27 05:55:34.284772 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3874/7796] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:55:34.425594 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5e97007-b1f9-4665-a1cd-6adfc3cf87fc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:55:34.434886 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5e97007-b1f9-4665-a1cd-6adfc3cf87fc tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1563 microversion: 2.1 time: 0.187736 Aug 27 05:55:34.435499 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3923/7797] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:55:34 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1563 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:07.741231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:56:07.741935 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=38 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:56:07.746087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-56a2c3d1-0f16-4787-9a33-9f0204ccaea4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:56:07.748354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-56a2c3d1-0f16-4787-9a33-9f0204ccaea4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:07.755527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a2c3d1-0f16-4787-9a33-9f0204ccaea4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:07.756011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a2c3d1-0f16-4787-9a33-9f0204ccaea4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:07.756450 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a2c3d1-0f16-4787-9a33-9f0204ccaea4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:07.757177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a2c3d1-0f16-4787-9a33-9f0204ccaea4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:07.757629 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a2c3d1-0f16-4787-9a33-9f0204ccaea4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:07.758054 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-56a2c3d1-0f16-4787-9a33-9f0204ccaea4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:07.811842 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-56a2c3d1-0f16-4787-9a33-9f0204ccaea4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75/action" status: 200 len: 24572 microversion: 2.1 time: 0.073212 Aug 27 05:56:07.812813 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3875/7798] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:56:07 2022] POST /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75/action => generated 24572 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:56:38.242955 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:56:38.243815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=36 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:56:38.248683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4dfe1dce-cfec-47af-9b77-3edc4360315f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:56:38.249240 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4dfe1dce-cfec-47af-9b77-3edc4360315f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:38.257060 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dfe1dce-cfec-47af-9b77-3edc4360315f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:38.257583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dfe1dce-cfec-47af-9b77-3edc4360315f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:38.258008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dfe1dce-cfec-47af-9b77-3edc4360315f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:38.258743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dfe1dce-cfec-47af-9b77-3edc4360315f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:38.259212 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dfe1dce-cfec-47af-9b77-3edc4360315f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:38.259650 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dfe1dce-cfec-47af-9b77-3edc4360315f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:38.283695 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-4dfe1dce-cfec-47af-9b77-3edc4360315f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lazy-loading 'flavor' on Instance uuid 8cd1b535-6621-4032-896a-3ad8fd88bc75 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:56:38.352026 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4dfe1dce-cfec-47af-9b77-3edc4360315f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75/action" status: 202 len: 0 microversion: 2.1 time: 0.112095 Aug 27 05:56:38.352826 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3924/7799] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:56:38 2022] POST /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:56:38.361910 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c3246c3c-0e48-434d-853e-305b06a76e98 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:38.362624 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c3246c3c-0e48-434d-853e-305b06a76e98 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:38.365759 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:56:38.366422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:56:38.373298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3246c3c-0e48-434d-853e-305b06a76e98 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:38.373798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3246c3c-0e48-434d-853e-305b06a76e98 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:38.374242 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3246c3c-0e48-434d-853e-305b06a76e98 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:38.374954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3246c3c-0e48-434d-853e-305b06a76e98 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:38.375408 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3246c3c-0e48-434d-853e-305b06a76e98 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:38.375842 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c3246c3c-0e48-434d-853e-305b06a76e98 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:38.516772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c3246c3c-0e48-434d-853e-305b06a76e98 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:38.525366 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c3246c3c-0e48-434d-853e-305b06a76e98 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1689 microversion: 2.1 time: 0.167962 Aug 27 05:56:38.525976 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3876/7800] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:38 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:39.549380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0521dc1d-e902-45c2-95c5-0628c590cef4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:39.550128 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0521dc1d-e902-45c2-95c5-0628c590cef4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:39.556615 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0521dc1d-e902-45c2-95c5-0628c590cef4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:39.557125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0521dc1d-e902-45c2-95c5-0628c590cef4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:39.557582 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0521dc1d-e902-45c2-95c5-0628c590cef4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:39.558305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0521dc1d-e902-45c2-95c5-0628c590cef4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:39.558808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0521dc1d-e902-45c2-95c5-0628c590cef4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:39.559640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0521dc1d-e902-45c2-95c5-0628c590cef4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:39.697072 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0521dc1d-e902-45c2-95c5-0628c590cef4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:39.705211 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0521dc1d-e902-45c2-95c5-0628c590cef4 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1689 microversion: 2.1 time: 0.161550 Aug 27 05:56:39.705800 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3925/7801] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:39 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:40.728075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-40c20951-a7c7-466a-98ae-a5b2d0eb5d1c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:40.728723 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-40c20951-a7c7-466a-98ae-a5b2d0eb5d1c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:40.739230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c20951-a7c7-466a-98ae-a5b2d0eb5d1c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:40.739657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c20951-a7c7-466a-98ae-a5b2d0eb5d1c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:40.740750 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c20951-a7c7-466a-98ae-a5b2d0eb5d1c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:40.741556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c20951-a7c7-466a-98ae-a5b2d0eb5d1c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:40.742016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c20951-a7c7-466a-98ae-a5b2d0eb5d1c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:40.742448 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-40c20951-a7c7-466a-98ae-a5b2d0eb5d1c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:40.874185 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-40c20951-a7c7-466a-98ae-a5b2d0eb5d1c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:40.882585 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-40c20951-a7c7-466a-98ae-a5b2d0eb5d1c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1672 microversion: 2.1 time: 0.159181 Aug 27 05:56:40.883174 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3877/7802] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:40 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:41.974514 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9883704f-8641-49db-8f5c-9b5858e25330 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:56:41.976936 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9883704f-8641-49db-8f5c-9b5858e25330 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:41.983866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9883704f-8641-49db-8f5c-9b5858e25330 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:41.984496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9883704f-8641-49db-8f5c-9b5858e25330 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:41.985009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9883704f-8641-49db-8f5c-9b5858e25330 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:41.985863 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9883704f-8641-49db-8f5c-9b5858e25330 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:41.986345 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9883704f-8641-49db-8f5c-9b5858e25330 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:41.986801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9883704f-8641-49db-8f5c-9b5858e25330 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:42.041683 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9883704f-8641-49db-8f5c-9b5858e25330 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75/action" status: 200 len: 35325 microversion: 2.1 time: 0.070975 Aug 27 05:56:42.042362 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3926/7803] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:56:41 2022] POST /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75/action => generated 35325 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:56:42.054691 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6e50b7d6-70ab-4bce-80a0-73b8193fc6bd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:56:42.055212 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6e50b7d6-70ab-4bce-80a0-73b8193fc6bd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:42.061848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e50b7d6-70ab-4bce-80a0-73b8193fc6bd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:42.062330 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e50b7d6-70ab-4bce-80a0-73b8193fc6bd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:42.062768 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e50b7d6-70ab-4bce-80a0-73b8193fc6bd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:42.063460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e50b7d6-70ab-4bce-80a0-73b8193fc6bd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:42.063922 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e50b7d6-70ab-4bce-80a0-73b8193fc6bd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:42.064344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6e50b7d6-70ab-4bce-80a0-73b8193fc6bd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:42.132329 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6e50b7d6-70ab-4bce-80a0-73b8193fc6bd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75/action" status: 202 len: 0 microversion: 2.1 time: 0.081716 Aug 27 05:56:42.132881 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3878/7804] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:56:42 2022] POST /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:56:42.141696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8fd5b153-52ec-4984-8d77-e11d2002509f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:42.142511 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8fd5b153-52ec-4984-8d77-e11d2002509f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:42.151082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fd5b153-52ec-4984-8d77-e11d2002509f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:42.151590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fd5b153-52ec-4984-8d77-e11d2002509f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:42.152048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fd5b153-52ec-4984-8d77-e11d2002509f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:42.153239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fd5b153-52ec-4984-8d77-e11d2002509f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:42.153369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fd5b153-52ec-4984-8d77-e11d2002509f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:42.153728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fd5b153-52ec-4984-8d77-e11d2002509f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:42.301267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8fd5b153-52ec-4984-8d77-e11d2002509f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:42.309896 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8fd5b153-52ec-4984-8d77-e11d2002509f tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1678 microversion: 2.1 time: 0.172493 Aug 27 05:56:42.310477 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3927/7805] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:42 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:43.332835 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e1e745f2-2cf6-46f1-bd7d-5f1b00821218 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:43.333550 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e1e745f2-2cf6-46f1-bd7d-5f1b00821218 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:43.340515 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1e745f2-2cf6-46f1-bd7d-5f1b00821218 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:43.341061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1e745f2-2cf6-46f1-bd7d-5f1b00821218 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:43.341529 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1e745f2-2cf6-46f1-bd7d-5f1b00821218 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:43.342281 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1e745f2-2cf6-46f1-bd7d-5f1b00821218 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:43.342774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1e745f2-2cf6-46f1-bd7d-5f1b00821218 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:43.343206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e1e745f2-2cf6-46f1-bd7d-5f1b00821218 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:43.483163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e1e745f2-2cf6-46f1-bd7d-5f1b00821218 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:43.491459 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e1e745f2-2cf6-46f1-bd7d-5f1b00821218 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1678 microversion: 2.1 time: 0.163622 Aug 27 05:56:43.491996 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3879/7806] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:43 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:44.513067 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c180ce6-133d-448f-9f2b-c5ccf0dbc094 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:44.513800 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c180ce6-133d-448f-9f2b-c5ccf0dbc094 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:44.520742 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c180ce6-133d-448f-9f2b-c5ccf0dbc094 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:44.521253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c180ce6-133d-448f-9f2b-c5ccf0dbc094 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:44.522351 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c180ce6-133d-448f-9f2b-c5ccf0dbc094 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:44.523071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c180ce6-133d-448f-9f2b-c5ccf0dbc094 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:44.523550 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c180ce6-133d-448f-9f2b-c5ccf0dbc094 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:44.523997 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c180ce6-133d-448f-9f2b-c5ccf0dbc094 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:44.657606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c180ce6-133d-448f-9f2b-c5ccf0dbc094 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:44.665529 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c180ce6-133d-448f-9f2b-c5ccf0dbc094 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1681 microversion: 2.1 time: 0.156477 Aug 27 05:56:44.666106 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3928/7807] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:44 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:44.768045 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c57c3237-046c-4817-af95-ccbb91314a1d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:56:44.770274 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c57c3237-046c-4817-af95-ccbb91314a1d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:44.777182 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c57c3237-046c-4817-af95-ccbb91314a1d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:44.777674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c57c3237-046c-4817-af95-ccbb91314a1d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:44.778103 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c57c3237-046c-4817-af95-ccbb91314a1d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:44.778796 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c57c3237-046c-4817-af95-ccbb91314a1d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:44.779248 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c57c3237-046c-4817-af95-ccbb91314a1d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:44.779671 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c57c3237-046c-4817-af95-ccbb91314a1d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:44.824744 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c57c3237-046c-4817-af95-ccbb91314a1d tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "POST /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75/action" status: 200 len: 35325 microversion: 2.1 time: 0.060392 Aug 27 05:56:44.825396 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3880/7808] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:56:44 2022] POST /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75/action => generated 35325 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 05:56:45.885699 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8dbc96be-d612-4272-97cc-d974b6ff48d6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:45.886225 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8dbc96be-d612-4272-97cc-d974b6ff48d6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:45.894222 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dbc96be-d612-4272-97cc-d974b6ff48d6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:45.895024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dbc96be-d612-4272-97cc-d974b6ff48d6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:45.895544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dbc96be-d612-4272-97cc-d974b6ff48d6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:45.897691 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dbc96be-d612-4272-97cc-d974b6ff48d6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:45.898461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dbc96be-d612-4272-97cc-d974b6ff48d6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:45.909804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dbc96be-d612-4272-97cc-d974b6ff48d6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:45.943635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8dbc96be-d612-4272-97cc-d974b6ff48d6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 05:56:45.950651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-222b3d2c-567d-48bb-b3c6-eb41e3b183b3 req-f4d11f43-3c1c-48ec-bfd3-5b4d548bd263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd1b535-6621-4032-896a-3ad8fd88bc75", "tag": "e86b3bf7-cd5e-4b7e-858b-9e5f6efe6a83"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:56:45.963456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-222b3d2c-567d-48bb-b3c6-eb41e3b183b3 req-f4d11f43-3c1c-48ec-bfd3-5b4d548bd263 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:45.964259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-222b3d2c-567d-48bb-b3c6-eb41e3b183b3 req-f4d11f43-3c1c-48ec-bfd3-5b4d548bd263 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:45.964627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-222b3d2c-567d-48bb-b3c6-eb41e3b183b3 req-f4d11f43-3c1c-48ec-bfd3-5b4d548bd263 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:45.975573 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-222b3d2c-567d-48bb-b3c6-eb41e3b183b3 req-f4d11f43-3c1c-48ec-bfd3-5b4d548bd263 service nova] Creating event network-changed:e86b3bf7-cd5e-4b7e-858b-9e5f6efe6a83 for instance 8cd1b535-6621-4032-896a-3ad8fd88bc75 on n-h1-854823-1 Aug 27 05:56:45.980705 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-222b3d2c-567d-48bb-b3c6-eb41e3b183b3 req-f4d11f43-3c1c-48ec-bfd3-5b4d548bd263 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096451 Aug 27 05:56:45.981963 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3881/7809] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:56:46.031018 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8dbc96be-d612-4272-97cc-d974b6ff48d6 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 204 len: 0 microversion: 2.1 time: 0.149838 Aug 27 05:56:46.032143 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3929/7810] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 05:56:45 2022] DELETE /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 05:56:46.043666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-52a78016-c574-4e5f-af3d-44e4ace5e482 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:46.044394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-52a78016-c574-4e5f-af3d-44e4ace5e482 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:46.056196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52a78016-c574-4e5f-af3d-44e4ace5e482 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:46.056753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52a78016-c574-4e5f-af3d-44e4ace5e482 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:46.057205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52a78016-c574-4e5f-af3d-44e4ace5e482 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:46.057926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52a78016-c574-4e5f-af3d-44e4ace5e482 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:46.058464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52a78016-c574-4e5f-af3d-44e4ace5e482 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:46.058905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-52a78016-c574-4e5f-af3d-44e4ace5e482 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:46.195571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-52a78016-c574-4e5f-af3d-44e4ace5e482 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:46.203631 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-52a78016-c574-4e5f-af3d-44e4ace5e482 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1687 microversion: 2.1 time: 0.165602 Aug 27 05:56:46.204225 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3882/7811] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:46 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:47.227460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8eb89cf1-6f5f-4b3d-8c92-0e14af60c54c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:47.228093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8eb89cf1-6f5f-4b3d-8c92-0e14af60c54c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:47.235089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8eb89cf1-6f5f-4b3d-8c92-0e14af60c54c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:47.235593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8eb89cf1-6f5f-4b3d-8c92-0e14af60c54c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:47.236046 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8eb89cf1-6f5f-4b3d-8c92-0e14af60c54c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:47.236787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8eb89cf1-6f5f-4b3d-8c92-0e14af60c54c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:47.237260 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8eb89cf1-6f5f-4b3d-8c92-0e14af60c54c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:47.237702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8eb89cf1-6f5f-4b3d-8c92-0e14af60c54c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:47.374608 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8eb89cf1-6f5f-4b3d-8c92-0e14af60c54c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:47.383055 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8eb89cf1-6f5f-4b3d-8c92-0e14af60c54c tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1687 microversion: 2.1 time: 0.160071 Aug 27 05:56:47.383634 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3930/7812] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:47 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:56:48.406401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff401def-165b-4214-b1d1-cb9fbee0c9dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:48.407062 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ff401def-165b-4214-b1d1-cb9fbee0c9dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:48.416740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff401def-165b-4214-b1d1-cb9fbee0c9dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:48.417253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff401def-165b-4214-b1d1-cb9fbee0c9dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:48.417705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff401def-165b-4214-b1d1-cb9fbee0c9dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:48.418705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff401def-165b-4214-b1d1-cb9fbee0c9dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:48.419246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff401def-165b-4214-b1d1-cb9fbee0c9dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:48.419966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff401def-165b-4214-b1d1-cb9fbee0c9dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:48.439725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-906d57fa-f29b-4bf4-8451-567783fe41d0 req-d9008702-4d1c-4df9-bcca-f053816e181a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd1b535-6621-4032-896a-3ad8fd88bc75", "name": "network-vif-deleted", "tag": "e86b3bf7-cd5e-4b7e-858b-9e5f6efe6a83"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:56:48.449418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-906d57fa-f29b-4bf4-8451-567783fe41d0 req-d9008702-4d1c-4df9-bcca-f053816e181a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:48.450237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-906d57fa-f29b-4bf4-8451-567783fe41d0 req-d9008702-4d1c-4df9-bcca-f053816e181a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:48.450891 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-906d57fa-f29b-4bf4-8451-567783fe41d0 req-d9008702-4d1c-4df9-bcca-f053816e181a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:48.463422 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-906d57fa-f29b-4bf4-8451-567783fe41d0 req-d9008702-4d1c-4df9-bcca-f053816e181a service nova] Creating event network-vif-deleted:e86b3bf7-cd5e-4b7e-858b-9e5f6efe6a83 for instance 8cd1b535-6621-4032-896a-3ad8fd88bc75 on n-h1-854823-1 Aug 27 05:56:48.468302 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-906d57fa-f29b-4bf4-8451-567783fe41d0 req-d9008702-4d1c-4df9-bcca-f053816e181a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094597 Aug 27 05:56:48.469265 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3883/7813] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:56:48.486672 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ff401def-165b-4214-b1d1-cb9fbee0c9dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fb9c5c1cfd4cb2b33a7c22d7311ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277e817efae04205bf58e32de7c168ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:56:48.496444 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff401def-165b-4214-b1d1-cb9fbee0c9dd tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 200 len: 1350 microversion: 2.1 time: 0.095068 Aug 27 05:56:48.497298 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3931/7814] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:48 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:56:49.519250 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4b1b895b-b76e-4c96-b359-cc8bdbb3b7f8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:49.519956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4b1b895b-b76e-4c96-b359-cc8bdbb3b7f8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] [instance: 8cd1b535-6621-4032-896a-3ad8fd88bc75] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:56:49.526954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b1b895b-b76e-4c96-b359-cc8bdbb3b7f8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:49.527483 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b1b895b-b76e-4c96-b359-cc8bdbb3b7f8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:49.527927 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b1b895b-b76e-4c96-b359-cc8bdbb3b7f8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:49.528662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b1b895b-b76e-4c96-b359-cc8bdbb3b7f8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:56:49.529125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b1b895b-b76e-4c96-b359-cc8bdbb3b7f8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:56:49.529556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4b1b895b-b76e-4c96-b359-cc8bdbb3b7f8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:56:49.546153 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-4b1b895b-b76e-4c96-b359-cc8bdbb3b7f8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] HTTP exception thrown: Instance 8cd1b535-6621-4032-896a-3ad8fd88bc75 could not be found. Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4b1b895b-b76e-4c96-b359-cc8bdbb3b7f8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Request method failure captured: Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 HTTP/1.1 Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCa_ZB1xxAu3ecBWGCK15_VmwaqF85neIEJdIAs7jNcxu1djgNXg7VI5VEOXS6WWCK2ve_0FSkl7NBlNjuccjBtXyVgh36GbN5jZ_YNqVuaf7D46o15NEfIZsTXQ1HZhwQ_n0Ff1o9_p7xlfNP4YcpgeNU05P-LCu3qnPhIYmdM1z8e8 Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 277e817efae04205bf58e32de7c168ce Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/277e817efae04205bf58e32de7c168ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_277e817efae04205bf58e32de7c168ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/277e817efae04205bf58e32de7c168ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/277e817efae04205bf58e32de7c168ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 277e817efae04205bf58e32de7c168ce Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1233409680 Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestNetworkAdvancedServerOps-1233409680-project Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 19fb9c5c1cfd4cb2b33a7c22d7311ffe Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1233409680-project Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 8cd1b535-6621-4032-896a-3ad8fd88bc75 could not be found. Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '8cd1b535-6621-4032-896a-3ad8fd88bc75'} Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd1b535-6621-4032-896a-3ad8fd88bc75 could not be found. Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd1b535-6621-4032-896a-3ad8fd88bc75 could not be found. Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:56:49.548044 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 05:56:49.553324 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:56:49.553324 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 05:56:49.553324 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 05:56:49.553324 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 05:56:49.553324 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 05:56:49.553324 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 05:56:49.553324 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd1b535-6621-4032-896a-3ad8fd88bc75 could not be found. Aug 27 05:56:49.553324 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 05:56:49.553324 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4b1b895b-b76e-4c96-b359-cc8bdbb3b7f8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Returning 404 to user: Instance 8cd1b535-6621-4032-896a-3ad8fd88bc75 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 05:56:49.553324 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4b1b895b-b76e-4c96-b359-cc8bdbb3b7f8 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75" status: 404 len: 111 microversion: 2.1 time: 0.035430 Aug 27 05:56:49.553324 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3884/7815] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:56:49 2022] GET /compute/v2.1/servers/8cd1b535-6621-4032-896a-3ad8fd88bc75 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 05:56:52.971798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-395110e9-c3a7-4a0e-9560-df92a7372a64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] Calling method '.version_select at 0x7f1f20630dc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:56:52.993170 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-395110e9-c3a7-4a0e-9560-df92a7372a64 tempest-TestNetworkAdvancedServerOps-1233409680 tempest-TestNetworkAdvancedServerOps-1233409680-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1283588238" status: 202 len: 0 microversion: 2.1 time: 0.025339 Aug 27 05:56:52.997171 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3932/7816] 10.222.0.79 () {58 vars in 1284 bytes} [Sat Aug 27 05:56:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1283588238 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:57:04.288776 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=18 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:04.290371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:04.548897 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-662f3c89-6a04-4b88-a298-abb40666c696 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Action: 'create', calling method: .version_select at 0x7f1f2161fa60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1927527385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMHypM/TrkEtlS14u46svcRGsaS5vCxKnkHBvYcIfaMT79ylAS3cDeGipmXM3jmd4eENw0ZTXJv4b3B3MXePcbct12x3X0BJrgdYOpLYrucYovLOHwVVHIE1foms9xqMQ=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:57:04.567666 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-662f3c89-6a04-4b88-a298-abb40666c696 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Getting quotas for project 9bc082e6aa8b4dc8a1f8557d3d6ae1ee. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:57:04.580043 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-662f3c89-6a04-4b88-a298-abb40666c696 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Getting quotas for user 7852e0941a584aaab239be7e2620866a and project 9bc082e6aa8b4dc8a1f8557d3d6ae1ee. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:57:04.609091 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-662f3c89-6a04-4b88-a298-abb40666c696 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.327044 Aug 27 05:57:04.609851 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3885/7817] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 05:57:04 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 05:57:05.652160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:05.653491 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:05.658074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1331534873", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1927527385", "security_groups": [{"name": "tempest-secgroup-smoke-1541898247"}], "networks": [{"uuid": "a2d8ca23-1bce-4dd4-ab0c-b382ba8d9333"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:57:05.773095 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] validate_networks() for [('a2d8ca23-1bce-4dd4-ab0c-b382ba8d9333', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 05:57:06.166706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 05:57:06.167150 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 05:57:06.167673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 05:57:06.168101 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 05:57:06.168553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 05:57:06.178868 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:06.179930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:06.180446 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:06.181329 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:06.181857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:06.182379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:06.200590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Getting quotas for project 9bc082e6aa8b4dc8a1f8557d3d6ae1ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 05:57:06.206214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Getting quotas for user 7852e0941a584aaab239be7e2620866a and project 9bc082e6aa8b4dc8a1f8557d3d6ae1ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 05:57:06.219909 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 05:57:06.222379 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 05:57:06.270972 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e09a6a9-065b-4d0c-ab01-e05de81914ae tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.620911 Aug 27 05:57:06.271845 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3933/7818] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 05:57:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 05:57:06.283531 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-895452cf-c2a7-4b43-9fd5-2e50d9d6f75a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:06.284175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-895452cf-c2a7-4b43-9fd5-2e50d9d6f75a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:06.346283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-895452cf-c2a7-4b43-9fd5-2e50d9d6f75a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:06.357132 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-895452cf-c2a7-4b43-9fd5-2e50d9d6f75a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1247 microversion: 2.1 time: 0.078315 Aug 27 05:57:06.358806 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3886/7819] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:06 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1247 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:07.380612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1db4a8c-15e7-4b41-b694-fa548eb3ee7a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:07.381978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1db4a8c-15e7-4b41-b694-fa548eb3ee7a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:07.390153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1db4a8c-15e7-4b41-b694-fa548eb3ee7a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:07.390939 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1db4a8c-15e7-4b41-b694-fa548eb3ee7a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:07.391669 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1db4a8c-15e7-4b41-b694-fa548eb3ee7a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:07.392746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1db4a8c-15e7-4b41-b694-fa548eb3ee7a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:07.393476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1db4a8c-15e7-4b41-b694-fa548eb3ee7a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:07.394002 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1db4a8c-15e7-4b41-b694-fa548eb3ee7a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:07.496218 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1db4a8c-15e7-4b41-b694-fa548eb3ee7a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:07.510894 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1db4a8c-15e7-4b41-b694-fa548eb3ee7a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1307 microversion: 2.1 time: 0.133640 Aug 27 05:57:07.514052 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3934/7820] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:07 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1307 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:08.534705 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-742b650c-ba71-44fb-b415-91008f02c761 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:08.536472 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-742b650c-ba71-44fb-b415-91008f02c761 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:08.546199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742b650c-ba71-44fb-b415-91008f02c761 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:08.546960 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742b650c-ba71-44fb-b415-91008f02c761 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:08.547405 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742b650c-ba71-44fb-b415-91008f02c761 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:08.548135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742b650c-ba71-44fb-b415-91008f02c761 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:08.554745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742b650c-ba71-44fb-b415-91008f02c761 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:08.555235 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-742b650c-ba71-44fb-b415-91008f02c761 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:08.727801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-742b650c-ba71-44fb-b415-91008f02c761 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:08.735947 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-742b650c-ba71-44fb-b415-91008f02c761 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1373 microversion: 2.1 time: 0.207441 Aug 27 05:57:08.736556 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3887/7821] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:08 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:09.254807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ed04c261-314f-4087-a666-ac8eb93f8c2c req-b0d3c1fa-55d5-4223-a4b0-81b115b19046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6b48c6-93a6-4e37-9603-93cd4981613e", "tag": "1cfb9f31-555d-41d0-a2b6-02cd7159a192"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:57:09.268573 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ed04c261-314f-4087-a666-ac8eb93f8c2c req-b0d3c1fa-55d5-4223-a4b0-81b115b19046 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:09.269122 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ed04c261-314f-4087-a666-ac8eb93f8c2c req-b0d3c1fa-55d5-4223-a4b0-81b115b19046 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:09.269576 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ed04c261-314f-4087-a666-ac8eb93f8c2c req-b0d3c1fa-55d5-4223-a4b0-81b115b19046 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:09.283262 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ed04c261-314f-4087-a666-ac8eb93f8c2c req-b0d3c1fa-55d5-4223-a4b0-81b115b19046 service nova] Creating event network-changed:1cfb9f31-555d-41d0-a2b6-02cd7159a192 for instance 0c6b48c6-93a6-4e37-9603-93cd4981613e on n-h2-854823-1 Aug 27 05:57:09.288418 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ed04c261-314f-4087-a666-ac8eb93f8c2c req-b0d3c1fa-55d5-4223-a4b0-81b115b19046 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037533 Aug 27 05:57:09.289145 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3935/7822] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:57:09.758655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ae983a2b-491c-413a-9836-2a5c378e87ce tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:09.759265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ae983a2b-491c-413a-9836-2a5c378e87ce tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:09.766145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae983a2b-491c-413a-9836-2a5c378e87ce tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:09.766626 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae983a2b-491c-413a-9836-2a5c378e87ce tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:09.767061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae983a2b-491c-413a-9836-2a5c378e87ce tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:09.767753 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae983a2b-491c-413a-9836-2a5c378e87ce tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:09.768208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae983a2b-491c-413a-9836-2a5c378e87ce tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:09.768662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ae983a2b-491c-413a-9836-2a5c378e87ce tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:09.904921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ae983a2b-491c-413a-9836-2a5c378e87ce tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:09.914272 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ae983a2b-491c-413a-9836-2a5c378e87ce tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1373 microversion: 2.1 time: 0.160209 Aug 27 05:57:09.914875 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3888/7823] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:09 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:10.937098 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47aa7347-1cc9-4a82-b08d-7921fdb43cd1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:10.937926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47aa7347-1cc9-4a82-b08d-7921fdb43cd1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:10.944293 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47aa7347-1cc9-4a82-b08d-7921fdb43cd1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:10.945962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47aa7347-1cc9-4a82-b08d-7921fdb43cd1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:10.946437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47aa7347-1cc9-4a82-b08d-7921fdb43cd1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:10.947177 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47aa7347-1cc9-4a82-b08d-7921fdb43cd1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:10.947663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47aa7347-1cc9-4a82-b08d-7921fdb43cd1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:10.948111 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47aa7347-1cc9-4a82-b08d-7921fdb43cd1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:11.185824 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47aa7347-1cc9-4a82-b08d-7921fdb43cd1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:11.193664 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47aa7347-1cc9-4a82-b08d-7921fdb43cd1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1373 microversion: 2.1 time: 0.262009 Aug 27 05:57:11.194588 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3936/7824] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:10 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1373 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:12.215398 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e06ac038-0295-4b0d-8c94-034de9559e05 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:12.216031 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-e06ac038-0295-4b0d-8c94-034de9559e05 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:12.222931 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e06ac038-0295-4b0d-8c94-034de9559e05 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:12.223419 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e06ac038-0295-4b0d-8c94-034de9559e05 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:12.223862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e06ac038-0295-4b0d-8c94-034de9559e05 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:12.225099 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e06ac038-0295-4b0d-8c94-034de9559e05 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:12.226174 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e06ac038-0295-4b0d-8c94-034de9559e05 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:12.226613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-e06ac038-0295-4b0d-8c94-034de9559e05 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:12.527382 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-e06ac038-0295-4b0d-8c94-034de9559e05 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:12.535162 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e06ac038-0295-4b0d-8c94-034de9559e05 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1373 microversion: 2.1 time: 0.323725 Aug 27 05:57:12.535732 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3889/7825] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:12 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1373 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:13.557687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1157c8e0-4336-40a3-9f8a-b81bb8747326 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:13.558311 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1157c8e0-4336-40a3-9f8a-b81bb8747326 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:13.566679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1157c8e0-4336-40a3-9f8a-b81bb8747326 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:13.567183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1157c8e0-4336-40a3-9f8a-b81bb8747326 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:13.567765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1157c8e0-4336-40a3-9f8a-b81bb8747326 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:13.569292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1157c8e0-4336-40a3-9f8a-b81bb8747326 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:13.569770 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1157c8e0-4336-40a3-9f8a-b81bb8747326 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:13.570209 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1157c8e0-4336-40a3-9f8a-b81bb8747326 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:13.760772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1157c8e0-4336-40a3-9f8a-b81bb8747326 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:13.768579 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1157c8e0-4336-40a3-9f8a-b81bb8747326 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1373 microversion: 2.1 time: 0.214767 Aug 27 05:57:13.769174 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3937/7826] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:13 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1373 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:14.404105 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-6f83fb5c-ab22-41af-b47e-a99f3e8a3594 req-d9a027b4-0278-49fa-9b9d-bfccc2a55e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6b48c6-93a6-4e37-9603-93cd4981613e", "name": "network-vif-plugged", "status": "completed", "tag": "1cfb9f31-555d-41d0-a2b6-02cd7159a192"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:57:14.415552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6f83fb5c-ab22-41af-b47e-a99f3e8a3594 req-d9a027b4-0278-49fa-9b9d-bfccc2a55e9a service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:14.415552 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6f83fb5c-ab22-41af-b47e-a99f3e8a3594 req-d9a027b4-0278-49fa-9b9d-bfccc2a55e9a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:14.415850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-6f83fb5c-ab22-41af-b47e-a99f3e8a3594 req-d9a027b4-0278-49fa-9b9d-bfccc2a55e9a service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:14.428790 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-6f83fb5c-ab22-41af-b47e-a99f3e8a3594 req-d9a027b4-0278-49fa-9b9d-bfccc2a55e9a service nova] Creating event network-vif-plugged:1cfb9f31-555d-41d0-a2b6-02cd7159a192 for instance 0c6b48c6-93a6-4e37-9603-93cd4981613e on n-h2-854823-1 Aug 27 05:57:14.433686 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-6f83fb5c-ab22-41af-b47e-a99f3e8a3594 req-d9a027b4-0278-49fa-9b9d-bfccc2a55e9a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091124 Aug 27 05:57:14.434292 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3890/7827] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:57:14.788999 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-354645db-fdd8-445f-9a5f-7624ebe25795 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:14.789625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-354645db-fdd8-445f-9a5f-7624ebe25795 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:14.796611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-354645db-fdd8-445f-9a5f-7624ebe25795 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:14.797313 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-354645db-fdd8-445f-9a5f-7624ebe25795 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:14.797761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-354645db-fdd8-445f-9a5f-7624ebe25795 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:14.798464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-354645db-fdd8-445f-9a5f-7624ebe25795 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:14.798931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-354645db-fdd8-445f-9a5f-7624ebe25795 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:14.799368 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-354645db-fdd8-445f-9a5f-7624ebe25795 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:14.935715 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-354645db-fdd8-445f-9a5f-7624ebe25795 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:14.943661 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-354645db-fdd8-445f-9a5f-7624ebe25795 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1373 microversion: 2.1 time: 0.159233 Aug 27 05:57:14.944254 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3938/7828] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:14 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:15.965589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-77a27a2b-c002-456e-ba74-2cdc1356cf26 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:15.966223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-77a27a2b-c002-456e-ba74-2cdc1356cf26 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:15.972471 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77a27a2b-c002-456e-ba74-2cdc1356cf26 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:15.972993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77a27a2b-c002-456e-ba74-2cdc1356cf26 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:15.973437 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77a27a2b-c002-456e-ba74-2cdc1356cf26 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:15.974136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77a27a2b-c002-456e-ba74-2cdc1356cf26 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:15.974599 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77a27a2b-c002-456e-ba74-2cdc1356cf26 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:15.975040 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-77a27a2b-c002-456e-ba74-2cdc1356cf26 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:16.110367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-77a27a2b-c002-456e-ba74-2cdc1356cf26 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:16.118265 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-77a27a2b-c002-456e-ba74-2cdc1356cf26 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1555 microversion: 2.1 time: 0.158111 Aug 27 05:57:16.118840 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3891/7829] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:15 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:57:16.139607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cd37ff01-b530-4094-b1e8-ac7b86e13e34 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:57:16.140238 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cd37ff01-b530-4094-b1e8-ac7b86e13e34 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:57:16.147694 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd37ff01-b530-4094-b1e8-ac7b86e13e34 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:16.148187 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd37ff01-b530-4094-b1e8-ac7b86e13e34 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:16.148689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd37ff01-b530-4094-b1e8-ac7b86e13e34 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:16.149390 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd37ff01-b530-4094-b1e8-ac7b86e13e34 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:16.149860 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd37ff01-b530-4094-b1e8-ac7b86e13e34 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:16.150295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd37ff01-b530-4094-b1e8-ac7b86e13e34 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:16.189974 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:16.213853 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:16.282304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cd37ff01-b530-4094-b1e8-ac7b86e13e34 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:57:16.290201 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cd37ff01-b530-4094-b1e8-ac7b86e13e34 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1555 microversion: 2.1 time: 0.154576 Aug 27 05:57:16.290791 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3939/7830] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:57:16 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:57:17.935033 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-9d5780a5-f62c-427a-ab2e-50e8b6758db6 req-8f3eac9b-6d86-4b83-98ba-66998e2533b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6b48c6-93a6-4e37-9603-93cd4981613e", "tag": "1cfb9f31-555d-41d0-a2b6-02cd7159a192"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:57:17.939895 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:57:17.947233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9d5780a5-f62c-427a-ab2e-50e8b6758db6 req-8f3eac9b-6d86-4b83-98ba-66998e2533b3 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:57:17.947850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9d5780a5-f62c-427a-ab2e-50e8b6758db6 req-8f3eac9b-6d86-4b83-98ba-66998e2533b3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:57:17.948145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-9d5780a5-f62c-427a-ab2e-50e8b6758db6 req-8f3eac9b-6d86-4b83-98ba-66998e2533b3 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:57:17.959485 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-9d5780a5-f62c-427a-ab2e-50e8b6758db6 req-8f3eac9b-6d86-4b83-98ba-66998e2533b3 service nova] Creating event network-changed:1cfb9f31-555d-41d0-a2b6-02cd7159a192 for instance 0c6b48c6-93a6-4e37-9603-93cd4981613e on n-h2-854823-1 Aug 27 05:57:17.964663 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-9d5780a5-f62c-427a-ab2e-50e8b6758db6 req-8f3eac9b-6d86-4b83-98ba-66998e2533b3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033242 Aug 27 05:57:17.965493 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3892/7831] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:59:16.391973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:16.392789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=34 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:16.394264 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 05:59:16.394424 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 05:59:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e/action (ip 10.222.0.79) !!! Aug 27 05:59:16.398644 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a3b2dce2-db44-4583-b5c6-c3f2fa93ffd3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:16.399213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a3b2dce2-db44-4583-b5c6-c3f2fa93ffd3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:16.408285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3b2dce2-db44-4583-b5c6-c3f2fa93ffd3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:16.408805 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3b2dce2-db44-4583-b5c6-c3f2fa93ffd3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:16.409256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3b2dce2-db44-4583-b5c6-c3f2fa93ffd3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:16.409962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3b2dce2-db44-4583-b5c6-c3f2fa93ffd3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:16.410434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3b2dce2-db44-4583-b5c6-c3f2fa93ffd3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:16.410865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3b2dce2-db44-4583-b5c6-c3f2fa93ffd3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:16.435803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-a3b2dce2-db44-4583-b5c6-c3f2fa93ffd3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lazy-loading 'flavor' on Instance uuid 0c6b48c6-93a6-4e37-9603-93cd4981613e {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 05:59:16.621293 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a3b2dce2-db44-4583-b5c6-c3f2fa93ffd3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "POST /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e/action" status: 202 len: 0 microversion: 2.1 time: 0.230661 Aug 27 05:59:16.621915 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3940/7832] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:59:16 2022] POST /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:59:16.628681 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2badfd4b-a808-402a-925c-31461d1cb878] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 05:59:16.629728 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30b4270-6763-4864-8153-10d27fd192b5] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 05:59:16.630362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:16.631486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=28 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:16.633048 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 05:59:16.633426 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 05:59:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e (ip 10.222.0.79) !!! Aug 27 05:59:16.641494 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b26fe3f9-c7b9-4c42-bc86-4c0b4cd31660 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:16.642257 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b26fe3f9-c7b9-4c42-bc86-4c0b4cd31660 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:16.655610 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b26fe3f9-c7b9-4c42-bc86-4c0b4cd31660 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:16.656101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b26fe3f9-c7b9-4c42-bc86-4c0b4cd31660 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:16.656558 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b26fe3f9-c7b9-4c42-bc86-4c0b4cd31660 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:16.657477 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b26fe3f9-c7b9-4c42-bc86-4c0b4cd31660 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:16.657944 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b26fe3f9-c7b9-4c42-bc86-4c0b4cd31660 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:16.658374 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b26fe3f9-c7b9-4c42-bc86-4c0b4cd31660 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:16.796958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b26fe3f9-c7b9-4c42-bc86-4c0b4cd31660 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:16.805149 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b26fe3f9-c7b9-4c42-bc86-4c0b4cd31660 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1678 microversion: 2.1 time: 0.178562 Aug 27 05:59:16.805742 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3893/7833] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:16 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:17.828508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec26be4e-070c-41a7-a3d8-01f863dd9b82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:17.829256 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec26be4e-070c-41a7-a3d8-01f863dd9b82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:17.836512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec26be4e-070c-41a7-a3d8-01f863dd9b82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:17.837034 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec26be4e-070c-41a7-a3d8-01f863dd9b82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:17.837677 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec26be4e-070c-41a7-a3d8-01f863dd9b82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:17.838901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec26be4e-070c-41a7-a3d8-01f863dd9b82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:17.839378 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec26be4e-070c-41a7-a3d8-01f863dd9b82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:17.839818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec26be4e-070c-41a7-a3d8-01f863dd9b82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:17.970299 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec26be4e-070c-41a7-a3d8-01f863dd9b82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:17.978172 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec26be4e-070c-41a7-a3d8-01f863dd9b82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1678 microversion: 2.1 time: 0.155283 Aug 27 05:59:17.978803 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3941/7834] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:17 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:19.000135 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0687fb9f-7fdf-4be5-ad25-ad724959151a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:19.000832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0687fb9f-7fdf-4be5-ad25-ad724959151a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:19.010397 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0687fb9f-7fdf-4be5-ad25-ad724959151a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:19.011119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0687fb9f-7fdf-4be5-ad25-ad724959151a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:19.011763 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0687fb9f-7fdf-4be5-ad25-ad724959151a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:19.012660 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0687fb9f-7fdf-4be5-ad25-ad724959151a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:19.013120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0687fb9f-7fdf-4be5-ad25-ad724959151a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:19.013548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0687fb9f-7fdf-4be5-ad25-ad724959151a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:19.032353 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] [2badfd4b-a808-402a-925c-31461d1cb878] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 45648. Aug 27 05:59:19.036260 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30b4270-6763-4864-8153-10d27fd192b5] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 45650. Aug 27 05:59:19.154988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0687fb9f-7fdf-4be5-ad25-ad724959151a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:19.162885 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0687fb9f-7fdf-4be5-ad25-ad724959151a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1678 microversion: 2.1 time: 0.166705 Aug 27 05:59:19.163484 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3894/7835] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:18 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:20.184269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-516c0641-8a52-47f0-84d2-c265b360e920 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:20.184930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-516c0641-8a52-47f0-84d2-c265b360e920 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:20.191752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516c0641-8a52-47f0-84d2-c265b360e920 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:20.192250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516c0641-8a52-47f0-84d2-c265b360e920 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:20.192750 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516c0641-8a52-47f0-84d2-c265b360e920 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:20.193458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516c0641-8a52-47f0-84d2-c265b360e920 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:20.193917 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516c0641-8a52-47f0-84d2-c265b360e920 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:20.194357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516c0641-8a52-47f0-84d2-c265b360e920 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:20.329261 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-516c0641-8a52-47f0-84d2-c265b360e920 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:20.339518 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-516c0641-8a52-47f0-84d2-c265b360e920 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1678 microversion: 2.1 time: 0.159241 Aug 27 05:59:20.340112 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3942/7836] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:20 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:21.360625 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dce492e7-0d45-41fa-a338-cfce124bf227 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:21.361228 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dce492e7-0d45-41fa-a338-cfce124bf227 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:21.368574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dce492e7-0d45-41fa-a338-cfce124bf227 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:21.369072 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dce492e7-0d45-41fa-a338-cfce124bf227 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:21.370012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dce492e7-0d45-41fa-a338-cfce124bf227 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:21.370749 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dce492e7-0d45-41fa-a338-cfce124bf227 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:21.371215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dce492e7-0d45-41fa-a338-cfce124bf227 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:21.371635 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dce492e7-0d45-41fa-a338-cfce124bf227 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:21.511314 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dce492e7-0d45-41fa-a338-cfce124bf227 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:21.519838 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dce492e7-0d45-41fa-a338-cfce124bf227 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1678 microversion: 2.1 time: 0.163196 Aug 27 05:59:21.520416 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3895/7837] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:21 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:22.540816 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92ff2e23-96e8-4afe-a35e-0f26e52af676 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:22.541937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92ff2e23-96e8-4afe-a35e-0f26e52af676 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:22.549168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92ff2e23-96e8-4afe-a35e-0f26e52af676 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:22.549673 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92ff2e23-96e8-4afe-a35e-0f26e52af676 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:22.550142 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92ff2e23-96e8-4afe-a35e-0f26e52af676 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:22.550833 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92ff2e23-96e8-4afe-a35e-0f26e52af676 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:22.551305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92ff2e23-96e8-4afe-a35e-0f26e52af676 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:22.551747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92ff2e23-96e8-4afe-a35e-0f26e52af676 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:22.687725 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92ff2e23-96e8-4afe-a35e-0f26e52af676 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:22.695542 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92ff2e23-96e8-4afe-a35e-0f26e52af676 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1678 microversion: 2.1 time: 0.158728 Aug 27 05:59:22.696135 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3943/7838] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:22 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:23.717005 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-372cf812-3caa-403a-a614-4d8630cb9f96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:23.717576 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-372cf812-3caa-403a-a614-4d8630cb9f96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:23.724507 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-372cf812-3caa-403a-a614-4d8630cb9f96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:23.725032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-372cf812-3caa-403a-a614-4d8630cb9f96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:23.725487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-372cf812-3caa-403a-a614-4d8630cb9f96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:23.726187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-372cf812-3caa-403a-a614-4d8630cb9f96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:23.726651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-372cf812-3caa-403a-a614-4d8630cb9f96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:23.727081 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-372cf812-3caa-403a-a614-4d8630cb9f96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:23.859199 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-372cf812-3caa-403a-a614-4d8630cb9f96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:23.866963 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-372cf812-3caa-403a-a614-4d8630cb9f96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1678 microversion: 2.1 time: 0.155013 Aug 27 05:59:23.867545 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3896/7839] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:23 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:24.888042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d06c7b8-169a-4a51-a910-917ea53e66cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:24.888712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d06c7b8-169a-4a51-a910-917ea53e66cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:24.895589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d06c7b8-169a-4a51-a910-917ea53e66cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:24.896089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d06c7b8-169a-4a51-a910-917ea53e66cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:24.896571 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d06c7b8-169a-4a51-a910-917ea53e66cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:24.897290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d06c7b8-169a-4a51-a910-917ea53e66cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:24.897761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d06c7b8-169a-4a51-a910-917ea53e66cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:24.898202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d06c7b8-169a-4a51-a910-917ea53e66cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:25.034896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d06c7b8-169a-4a51-a910-917ea53e66cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:25.043867 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d06c7b8-169a-4a51-a910-917ea53e66cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1678 microversion: 2.1 time: 0.159716 Aug 27 05:59:25.044468 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3944/7840] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:24 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:26.069011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a8be960c-66cf-4f94-a463-8a01ab0177d1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:26.069640 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a8be960c-66cf-4f94-a463-8a01ab0177d1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:26.077095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8be960c-66cf-4f94-a463-8a01ab0177d1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:26.077579 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8be960c-66cf-4f94-a463-8a01ab0177d1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:26.078018 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8be960c-66cf-4f94-a463-8a01ab0177d1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:26.078707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8be960c-66cf-4f94-a463-8a01ab0177d1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:26.079162 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8be960c-66cf-4f94-a463-8a01ab0177d1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:26.079585 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a8be960c-66cf-4f94-a463-8a01ab0177d1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:26.214918 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a8be960c-66cf-4f94-a463-8a01ab0177d1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:26.222810 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a8be960c-66cf-4f94-a463-8a01ab0177d1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1678 microversion: 2.1 time: 0.157769 Aug 27 05:59:26.223395 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3897/7841] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:26 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:27.243464 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c13da62c-58a7-4075-b9e2-12173ef2e50d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:27.244129 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c13da62c-58a7-4075-b9e2-12173ef2e50d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:27.251385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c13da62c-58a7-4075-b9e2-12173ef2e50d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:27.251894 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c13da62c-58a7-4075-b9e2-12173ef2e50d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:27.252352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c13da62c-58a7-4075-b9e2-12173ef2e50d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:27.253100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c13da62c-58a7-4075-b9e2-12173ef2e50d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:27.253580 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c13da62c-58a7-4075-b9e2-12173ef2e50d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:27.254035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c13da62c-58a7-4075-b9e2-12173ef2e50d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:27.390163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c13da62c-58a7-4075-b9e2-12173ef2e50d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:27.398078 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c13da62c-58a7-4075-b9e2-12173ef2e50d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1699 microversion: 2.1 time: 0.158654 Aug 27 05:59:27.398663 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3945/7842] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:27 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:28.420078 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a59e781c-10a2-47c1-8d32-f43eeede5889 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:28.420643 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a59e781c-10a2-47c1-8d32-f43eeede5889 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:28.428050 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a59e781c-10a2-47c1-8d32-f43eeede5889 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:28.428686 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a59e781c-10a2-47c1-8d32-f43eeede5889 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:28.429002 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a59e781c-10a2-47c1-8d32-f43eeede5889 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:28.429694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a59e781c-10a2-47c1-8d32-f43eeede5889 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:28.430149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a59e781c-10a2-47c1-8d32-f43eeede5889 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:28.430574 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a59e781c-10a2-47c1-8d32-f43eeede5889 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:28.563857 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a59e781c-10a2-47c1-8d32-f43eeede5889 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:28.572111 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a59e781c-10a2-47c1-8d32-f43eeede5889 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1699 microversion: 2.1 time: 0.155864 Aug 27 05:59:28.572599 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3898/7843] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:28 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:29.595286 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8bf9dc2-5e80-44d9-a377-07be999b74b7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:29.595943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8bf9dc2-5e80-44d9-a377-07be999b74b7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:29.602921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8bf9dc2-5e80-44d9-a377-07be999b74b7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:29.603434 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8bf9dc2-5e80-44d9-a377-07be999b74b7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:29.603900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8bf9dc2-5e80-44d9-a377-07be999b74b7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:29.604629 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8bf9dc2-5e80-44d9-a377-07be999b74b7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:29.605099 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8bf9dc2-5e80-44d9-a377-07be999b74b7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:29.605537 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8bf9dc2-5e80-44d9-a377-07be999b74b7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:29.739403 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8bf9dc2-5e80-44d9-a377-07be999b74b7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:29.748490 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8bf9dc2-5e80-44d9-a377-07be999b74b7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1694 microversion: 2.1 time: 0.158395 Aug 27 05:59:29.749178 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3946/7844] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:29 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:30.775775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-63c71509-23bc-4a25-b92a-e5001d1f84d4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:30.776655 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-63c71509-23bc-4a25-b92a-e5001d1f84d4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:30.783825 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63c71509-23bc-4a25-b92a-e5001d1f84d4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:30.784456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63c71509-23bc-4a25-b92a-e5001d1f84d4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:30.785019 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63c71509-23bc-4a25-b92a-e5001d1f84d4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:30.785972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63c71509-23bc-4a25-b92a-e5001d1f84d4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:30.786637 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63c71509-23bc-4a25-b92a-e5001d1f84d4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:30.787289 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-63c71509-23bc-4a25-b92a-e5001d1f84d4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:30.955770 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-63c71509-23bc-4a25-b92a-e5001d1f84d4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:30.964232 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-63c71509-23bc-4a25-b92a-e5001d1f84d4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1694 microversion: 2.1 time: 0.196779 Aug 27 05:59:30.981337 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3899/7845] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:30 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1694 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:31.103021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-779a15c8-f06e-4f9f-b2b2-e876a09570ad req-bb56b6e3-3644-4182-a9af-9e2829264d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6b48c6-93a6-4e37-9603-93cd4981613e", "name": "network-vif-plugged", "status": "completed", "tag": "1cfb9f31-555d-41d0-a2b6-02cd7159a192"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:31.113847 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-779a15c8-f06e-4f9f-b2b2-e876a09570ad req-bb56b6e3-3644-4182-a9af-9e2829264d2d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:31.114765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-779a15c8-f06e-4f9f-b2b2-e876a09570ad req-bb56b6e3-3644-4182-a9af-9e2829264d2d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:31.115467 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-779a15c8-f06e-4f9f-b2b2-e876a09570ad req-bb56b6e3-3644-4182-a9af-9e2829264d2d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:31.130640 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-779a15c8-f06e-4f9f-b2b2-e876a09570ad req-bb56b6e3-3644-4182-a9af-9e2829264d2d service nova] Creating event network-vif-plugged:1cfb9f31-555d-41d0-a2b6-02cd7159a192 for instance 0c6b48c6-93a6-4e37-9603-93cd4981613e on n-h2-854823-1 Aug 27 05:59:31.136257 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-779a15c8-f06e-4f9f-b2b2-e876a09570ad req-bb56b6e3-3644-4182-a9af-9e2829264d2d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037689 Aug 27 05:59:31.137649 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3947/7846] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:59:31.988168 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-27b27ad7-236c-4a10-ae55-cbf2d9f82fab tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:31.989581 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-27b27ad7-236c-4a10-ae55-cbf2d9f82fab tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:31.996775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27b27ad7-236c-4a10-ae55-cbf2d9f82fab tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:31.997493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27b27ad7-236c-4a10-ae55-cbf2d9f82fab tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:31.998149 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27b27ad7-236c-4a10-ae55-cbf2d9f82fab tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:31.998958 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27b27ad7-236c-4a10-ae55-cbf2d9f82fab tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:31.999415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27b27ad7-236c-4a10-ae55-cbf2d9f82fab tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:31.999884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-27b27ad7-236c-4a10-ae55-cbf2d9f82fab tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:32.177295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-27b27ad7-236c-4a10-ae55-cbf2d9f82fab tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:32.186198 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-27b27ad7-236c-4a10-ae55-cbf2d9f82fab tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1694 microversion: 2.1 time: 0.202240 Aug 27 05:59:32.187354 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3900/7847] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:31 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1694 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:33.214865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e27ecda2-958e-44af-92fe-e8441efc9646 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:33.216213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e27ecda2-958e-44af-92fe-e8441efc9646 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:33.223752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e27ecda2-958e-44af-92fe-e8441efc9646 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:33.224263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e27ecda2-958e-44af-92fe-e8441efc9646 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:33.224798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e27ecda2-958e-44af-92fe-e8441efc9646 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:33.225535 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e27ecda2-958e-44af-92fe-e8441efc9646 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:33.226013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e27ecda2-958e-44af-92fe-e8441efc9646 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:33.226460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e27ecda2-958e-44af-92fe-e8441efc9646 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:33.401865 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e27ecda2-958e-44af-92fe-e8441efc9646 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:33.412811 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e27ecda2-958e-44af-92fe-e8441efc9646 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1694 microversion: 2.1 time: 0.204673 Aug 27 05:59:33.413567 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3948/7848] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:33 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1694 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:34.438662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-7463ec63-9621-426f-bcd0-24a512d95af9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:34.439258 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-7463ec63-9621-426f-bcd0-24a512d95af9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:34.447540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7463ec63-9621-426f-bcd0-24a512d95af9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:34.448030 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7463ec63-9621-426f-bcd0-24a512d95af9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:34.448464 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7463ec63-9621-426f-bcd0-24a512d95af9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:34.449301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7463ec63-9621-426f-bcd0-24a512d95af9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:34.449815 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7463ec63-9621-426f-bcd0-24a512d95af9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:34.450313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-7463ec63-9621-426f-bcd0-24a512d95af9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:34.602532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-7463ec63-9621-426f-bcd0-24a512d95af9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:34.611874 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-7463ec63-9621-426f-bcd0-24a512d95af9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1694 microversion: 2.1 time: 0.179159 Aug 27 05:59:34.612997 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3901/7849] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:34 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1694 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:35.634065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45d13d0f-f4ea-422e-9fc0-150b4e9136d6 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:35.636094 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-45d13d0f-f4ea-422e-9fc0-150b4e9136d6 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:35.643164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45d13d0f-f4ea-422e-9fc0-150b4e9136d6 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:35.643671 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45d13d0f-f4ea-422e-9fc0-150b4e9136d6 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:35.644121 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45d13d0f-f4ea-422e-9fc0-150b4e9136d6 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:35.645235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45d13d0f-f4ea-422e-9fc0-150b4e9136d6 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:35.646292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45d13d0f-f4ea-422e-9fc0-150b4e9136d6 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:35.647167 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45d13d0f-f4ea-422e-9fc0-150b4e9136d6 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:35.797425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-45d13d0f-f4ea-422e-9fc0-150b4e9136d6 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:35.811301 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45d13d0f-f4ea-422e-9fc0-150b4e9136d6 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1694 microversion: 2.1 time: 0.181073 Aug 27 05:59:35.812243 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3949/7850] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:35 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:59:36.832676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-498b96fb-4343-4758-af76-3a1b023fec07 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:36.834221 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-498b96fb-4343-4758-af76-3a1b023fec07 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:36.842713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-498b96fb-4343-4758-af76-3a1b023fec07 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:36.843570 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-498b96fb-4343-4758-af76-3a1b023fec07 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:36.844679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-498b96fb-4343-4758-af76-3a1b023fec07 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:36.845965 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-498b96fb-4343-4758-af76-3a1b023fec07 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:36.847347 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-498b96fb-4343-4758-af76-3a1b023fec07 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:36.848783 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-498b96fb-4343-4758-af76-3a1b023fec07 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:37.021527 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-498b96fb-4343-4758-af76-3a1b023fec07 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:37.032292 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-498b96fb-4343-4758-af76-3a1b023fec07 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1694 microversion: 2.1 time: 0.203429 Aug 27 05:59:37.036265 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3902/7851] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:36 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1694 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:38.054889 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5475c5f8-74f6-49a6-9cad-852f4c65d270 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:38.055442 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5475c5f8-74f6-49a6-9cad-852f4c65d270 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:38.063431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5475c5f8-74f6-49a6-9cad-852f4c65d270 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:38.064045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5475c5f8-74f6-49a6-9cad-852f4c65d270 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:38.064589 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5475c5f8-74f6-49a6-9cad-852f4c65d270 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:38.065459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5475c5f8-74f6-49a6-9cad-852f4c65d270 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:38.065933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5475c5f8-74f6-49a6-9cad-852f4c65d270 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:38.066459 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5475c5f8-74f6-49a6-9cad-852f4c65d270 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:38.215489 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5475c5f8-74f6-49a6-9cad-852f4c65d270 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:38.224430 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5475c5f8-74f6-49a6-9cad-852f4c65d270 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1694 microversion: 2.1 time: 0.173968 Aug 27 05:59:38.225345 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3950/7852] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:38 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:39.247351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-24584386-d49c-4b68-8d2b-5b336a68a6c0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:39.247970 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-24584386-d49c-4b68-8d2b-5b336a68a6c0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:39.255190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24584386-d49c-4b68-8d2b-5b336a68a6c0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:39.255676 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24584386-d49c-4b68-8d2b-5b336a68a6c0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:39.256119 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24584386-d49c-4b68-8d2b-5b336a68a6c0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:39.256849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24584386-d49c-4b68-8d2b-5b336a68a6c0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:39.257309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24584386-d49c-4b68-8d2b-5b336a68a6c0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:39.257736 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24584386-d49c-4b68-8d2b-5b336a68a6c0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:39.410500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-24584386-d49c-4b68-8d2b-5b336a68a6c0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:39.418325 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-24584386-d49c-4b68-8d2b-5b336a68a6c0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1676 microversion: 2.1 time: 0.174948 Aug 27 05:59:39.424857 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3903/7853] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:39 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:40.441188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0df3931-92ba-48fa-b39a-a3ddd471337c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:40.441852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0df3931-92ba-48fa-b39a-a3ddd471337c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:40.448689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0df3931-92ba-48fa-b39a-a3ddd471337c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:40.449196 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0df3931-92ba-48fa-b39a-a3ddd471337c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:40.449652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0df3931-92ba-48fa-b39a-a3ddd471337c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:40.450367 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0df3931-92ba-48fa-b39a-a3ddd471337c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:40.450844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0df3931-92ba-48fa-b39a-a3ddd471337c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:40.451289 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0df3931-92ba-48fa-b39a-a3ddd471337c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:40.588787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0df3931-92ba-48fa-b39a-a3ddd471337c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:40.596845 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0df3931-92ba-48fa-b39a-a3ddd471337c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1676 microversion: 2.1 time: 0.159601 Aug 27 05:59:40.597436 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3951/7854] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:40 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:41.616813 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ee8ee7a8-7163-4c23-99af-aa2829335303 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:41.617456 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ee8ee7a8-7163-4c23-99af-aa2829335303 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:41.624860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee8ee7a8-7163-4c23-99af-aa2829335303 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:41.625341 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee8ee7a8-7163-4c23-99af-aa2829335303 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:41.625775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee8ee7a8-7163-4c23-99af-aa2829335303 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:41.626463 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee8ee7a8-7163-4c23-99af-aa2829335303 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:41.626920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee8ee7a8-7163-4c23-99af-aa2829335303 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:41.627343 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ee8ee7a8-7163-4c23-99af-aa2829335303 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:41.762025 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ee8ee7a8-7163-4c23-99af-aa2829335303 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:41.769866 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ee8ee7a8-7163-4c23-99af-aa2829335303 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1679 microversion: 2.1 time: 0.156985 Aug 27 05:59:41.770443 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3904/7855] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:41 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:41.790214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56261690-0738-4a16-9cc5-5036372290e2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:41.790851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-56261690-0738-4a16-9cc5-5036372290e2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:41.797733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56261690-0738-4a16-9cc5-5036372290e2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:41.798235 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56261690-0738-4a16-9cc5-5036372290e2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:41.798687 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56261690-0738-4a16-9cc5-5036372290e2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:41.799656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56261690-0738-4a16-9cc5-5036372290e2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:41.800133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56261690-0738-4a16-9cc5-5036372290e2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:41.800601 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56261690-0738-4a16-9cc5-5036372290e2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:41.892544 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-56261690-0738-4a16-9cc5-5036372290e2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128869) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 05:59:41.959773 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-56261690-0738-4a16-9cc5-5036372290e2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "POST /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e/action" status: 202 len: 0 microversion: 2.1 time: 0.173632 Aug 27 05:59:41.960397 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3952/7856] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 05:59:41 2022] POST /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 05:59:41.968517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6c3eecbf-ee83-4530-bcdd-3f1711c375e9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:41.969373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6c3eecbf-ee83-4530-bcdd-3f1711c375e9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:41.975597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c3eecbf-ee83-4530-bcdd-3f1711c375e9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:41.976091 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c3eecbf-ee83-4530-bcdd-3f1711c375e9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:41.976555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c3eecbf-ee83-4530-bcdd-3f1711c375e9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:41.977269 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c3eecbf-ee83-4530-bcdd-3f1711c375e9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:41.977732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c3eecbf-ee83-4530-bcdd-3f1711c375e9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:41.978167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6c3eecbf-ee83-4530-bcdd-3f1711c375e9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:42.128373 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6c3eecbf-ee83-4530-bcdd-3f1711c375e9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:42.136845 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6c3eecbf-ee83-4530-bcdd-3f1711c375e9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1627 microversion: 2.1 time: 0.172196 Aug 27 05:59:42.137432 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3905/7857] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:41 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1627 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:43.091487 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-47a0e1be-9487-4aef-a4c0-d5da97281239 req-a94ced46-019f-423f-a272-f05c97f2b11b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6b48c6-93a6-4e37-9603-93cd4981613e", "name": "network-vif-unplugged", "status": "completed", "tag": "1cfb9f31-555d-41d0-a2b6-02cd7159a192"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:43.101507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-47a0e1be-9487-4aef-a4c0-d5da97281239 req-a94ced46-019f-423f-a272-f05c97f2b11b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:43.102006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-47a0e1be-9487-4aef-a4c0-d5da97281239 req-a94ced46-019f-423f-a272-f05c97f2b11b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:43.102440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-47a0e1be-9487-4aef-a4c0-d5da97281239 req-a94ced46-019f-423f-a272-f05c97f2b11b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:43.114023 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-47a0e1be-9487-4aef-a4c0-d5da97281239 req-a94ced46-019f-423f-a272-f05c97f2b11b service nova] Creating event network-vif-unplugged:1cfb9f31-555d-41d0-a2b6-02cd7159a192 for instance 0c6b48c6-93a6-4e37-9603-93cd4981613e on n-h1-854823-1 Aug 27 05:59:43.118915 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-47a0e1be-9487-4aef-a4c0-d5da97281239 req-a94ced46-019f-423f-a272-f05c97f2b11b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032713 Aug 27 05:59:43.120036 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3953/7858] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:59:43.160784 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-878f8ae0-898a-4f74-af4b-a28edcc3d301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:43.161402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-878f8ae0-898a-4f74-af4b-a28edcc3d301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:43.168283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-878f8ae0-898a-4f74-af4b-a28edcc3d301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:43.168805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-878f8ae0-898a-4f74-af4b-a28edcc3d301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:43.169249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-878f8ae0-898a-4f74-af4b-a28edcc3d301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:43.169945 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-878f8ae0-898a-4f74-af4b-a28edcc3d301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:43.170402 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-878f8ae0-898a-4f74-af4b-a28edcc3d301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:43.170831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-878f8ae0-898a-4f74-af4b-a28edcc3d301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:43.324892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-878f8ae0-898a-4f74-af4b-a28edcc3d301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:43.332861 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-878f8ae0-898a-4f74-af4b-a28edcc3d301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.175967 Aug 27 05:59:43.333461 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3906/7859] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:43 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:59:44.083990 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1532fd75-7a3f-42dc-b816-0efb0eba70dd req-ade4478d-4ac9-419e-8723-83456351bfd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6b48c6-93a6-4e37-9603-93cd4981613e", "tag": "1cfb9f31-555d-41d0-a2b6-02cd7159a192"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 05:59:44.095348 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1532fd75-7a3f-42dc-b816-0efb0eba70dd req-ade4478d-4ac9-419e-8723-83456351bfd6 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:44.095958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1532fd75-7a3f-42dc-b816-0efb0eba70dd req-ade4478d-4ac9-419e-8723-83456351bfd6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:44.096425 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1532fd75-7a3f-42dc-b816-0efb0eba70dd req-ade4478d-4ac9-419e-8723-83456351bfd6 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:44.109092 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1532fd75-7a3f-42dc-b816-0efb0eba70dd req-ade4478d-4ac9-419e-8723-83456351bfd6 service nova] Creating event network-changed:1cfb9f31-555d-41d0-a2b6-02cd7159a192 for instance 0c6b48c6-93a6-4e37-9603-93cd4981613e on n-h1-854823-1 Aug 27 05:59:44.114138 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1532fd75-7a3f-42dc-b816-0efb0eba70dd req-ade4478d-4ac9-419e-8723-83456351bfd6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034495 Aug 27 05:59:44.114759 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3954/7860] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 05:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 05:59:44.354846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c5ab616b-b0a6-4d0c-a50f-f87ce2f72726 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:44.355460 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c5ab616b-b0a6-4d0c-a50f-f87ce2f72726 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:44.362592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5ab616b-b0a6-4d0c-a50f-f87ce2f72726 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:44.363077 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5ab616b-b0a6-4d0c-a50f-f87ce2f72726 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:44.363618 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5ab616b-b0a6-4d0c-a50f-f87ce2f72726 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:44.364511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5ab616b-b0a6-4d0c-a50f-f87ce2f72726 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:44.364993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5ab616b-b0a6-4d0c-a50f-f87ce2f72726 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:44.365422 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c5ab616b-b0a6-4d0c-a50f-f87ce2f72726 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:44.577886 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c5ab616b-b0a6-4d0c-a50f-f87ce2f72726 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:44.585758 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c5ab616b-b0a6-4d0c-a50f-f87ce2f72726 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.234854 Aug 27 05:59:44.586344 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3907/7861] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:44 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:45.610206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa1c1f00-30d4-4c6c-b116-63a285d17501 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:45.611685 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aa1c1f00-30d4-4c6c-b116-63a285d17501 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:45.618774 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa1c1f00-30d4-4c6c-b116-63a285d17501 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:45.619784 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa1c1f00-30d4-4c6c-b116-63a285d17501 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:45.620438 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa1c1f00-30d4-4c6c-b116-63a285d17501 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:45.621183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa1c1f00-30d4-4c6c-b116-63a285d17501 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:45.621652 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa1c1f00-30d4-4c6c-b116-63a285d17501 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:45.622091 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa1c1f00-30d4-4c6c-b116-63a285d17501 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:45.647753 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:45.780821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aa1c1f00-30d4-4c6c-b116-63a285d17501 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:45.793293 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa1c1f00-30d4-4c6c-b116-63a285d17501 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.189671 Aug 27 05:59:45.794249 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3955/7862] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:45 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:46.815554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5d1e5b19-01e7-46db-9492-99e1c9f46835 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:46.816237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5d1e5b19-01e7-46db-9492-99e1c9f46835 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:46.819175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=31 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:46.825038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d1e5b19-01e7-46db-9492-99e1c9f46835 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:46.825555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d1e5b19-01e7-46db-9492-99e1c9f46835 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:46.826063 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d1e5b19-01e7-46db-9492-99e1c9f46835 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:46.826819 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d1e5b19-01e7-46db-9492-99e1c9f46835 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:46.827303 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d1e5b19-01e7-46db-9492-99e1c9f46835 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:46.827781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5d1e5b19-01e7-46db-9492-99e1c9f46835 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:46.830903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=91 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:46.968884 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5d1e5b19-01e7-46db-9492-99e1c9f46835 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:46.979025 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5d1e5b19-01e7-46db-9492-99e1c9f46835 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.166912 Aug 27 05:59:46.994732 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3908/7863] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:46 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:48.002144 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4f66629-27db-4017-9684-ab3498998673 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:48.002778 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4f66629-27db-4017-9684-ab3498998673 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:48.005886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:59:48.011290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f66629-27db-4017-9684-ab3498998673 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:48.011809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f66629-27db-4017-9684-ab3498998673 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:48.012270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f66629-27db-4017-9684-ab3498998673 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:48.013035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f66629-27db-4017-9684-ab3498998673 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:48.013518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f66629-27db-4017-9684-ab3498998673 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:48.013983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f66629-27db-4017-9684-ab3498998673 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:48.172954 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4f66629-27db-4017-9684-ab3498998673 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:48.183085 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4f66629-27db-4017-9684-ab3498998673 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.183356 Aug 27 05:59:48.184095 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3956/7864] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:47 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 05:59:49.205517 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0a2c83bf-fe34-461d-b15d-b06b87403fbe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:49.206390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0a2c83bf-fe34-461d-b15d-b06b87403fbe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:49.213114 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a2c83bf-fe34-461d-b15d-b06b87403fbe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:49.213687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a2c83bf-fe34-461d-b15d-b06b87403fbe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:49.214195 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a2c83bf-fe34-461d-b15d-b06b87403fbe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:49.214905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a2c83bf-fe34-461d-b15d-b06b87403fbe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:49.215359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a2c83bf-fe34-461d-b15d-b06b87403fbe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:49.215786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0a2c83bf-fe34-461d-b15d-b06b87403fbe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:49.360376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0a2c83bf-fe34-461d-b15d-b06b87403fbe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:49.369998 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0a2c83bf-fe34-461d-b15d-b06b87403fbe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.168108 Aug 27 05:59:49.371687 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3909/7865] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:49 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:50.391802 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-709feb02-b8bb-44d3-a2ea-99a4807b4a29 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:50.392862 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-709feb02-b8bb-44d3-a2ea-99a4807b4a29 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:50.401271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-709feb02-b8bb-44d3-a2ea-99a4807b4a29 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:50.401801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-709feb02-b8bb-44d3-a2ea-99a4807b4a29 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:50.402327 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-709feb02-b8bb-44d3-a2ea-99a4807b4a29 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:50.403407 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-709feb02-b8bb-44d3-a2ea-99a4807b4a29 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:50.403943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-709feb02-b8bb-44d3-a2ea-99a4807b4a29 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:50.404458 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-709feb02-b8bb-44d3-a2ea-99a4807b4a29 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:50.556063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-709feb02-b8bb-44d3-a2ea-99a4807b4a29 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:50.565054 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-709feb02-b8bb-44d3-a2ea-99a4807b4a29 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.177107 Aug 27 05:59:50.565844 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3957/7866] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:50 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:51.589001 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fae7bc58-734f-4724-86c5-9ec634a826eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:51.590075 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fae7bc58-734f-4724-86c5-9ec634a826eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:51.597511 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fae7bc58-734f-4724-86c5-9ec634a826eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:51.597921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fae7bc58-734f-4724-86c5-9ec634a826eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:51.598357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fae7bc58-734f-4724-86c5-9ec634a826eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:51.599073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fae7bc58-734f-4724-86c5-9ec634a826eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:51.599559 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fae7bc58-734f-4724-86c5-9ec634a826eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:51.600138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fae7bc58-734f-4724-86c5-9ec634a826eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:51.779080 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fae7bc58-734f-4724-86c5-9ec634a826eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:51.788402 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fae7bc58-734f-4724-86c5-9ec634a826eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.203589 Aug 27 05:59:51.789095 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3910/7867] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:51 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:52.811186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c9d053a-2de8-46e7-b7fb-6094ede66464 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:52.811818 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c9d053a-2de8-46e7-b7fb-6094ede66464 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:52.818761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9d053a-2de8-46e7-b7fb-6094ede66464 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:52.819263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9d053a-2de8-46e7-b7fb-6094ede66464 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:52.819718 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9d053a-2de8-46e7-b7fb-6094ede66464 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:52.820430 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9d053a-2de8-46e7-b7fb-6094ede66464 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:52.820932 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9d053a-2de8-46e7-b7fb-6094ede66464 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:52.821375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9d053a-2de8-46e7-b7fb-6094ede66464 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:52.954386 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c9d053a-2de8-46e7-b7fb-6094ede66464 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:52.962263 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c9d053a-2de8-46e7-b7fb-6094ede66464 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.155661 Aug 27 05:59:52.963344 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3958/7868] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:52 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:53.985231 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-24f87327-aae9-4749-bebb-66d4828ce1eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:53.985862 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-24f87327-aae9-4749-bebb-66d4828ce1eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:53.992885 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24f87327-aae9-4749-bebb-66d4828ce1eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:53.993390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24f87327-aae9-4749-bebb-66d4828ce1eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:53.993867 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24f87327-aae9-4749-bebb-66d4828ce1eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:53.994597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24f87327-aae9-4749-bebb-66d4828ce1eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:53.995060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24f87327-aae9-4749-bebb-66d4828ce1eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:53.995492 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-24f87327-aae9-4749-bebb-66d4828ce1eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:54.129688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-24f87327-aae9-4749-bebb-66d4828ce1eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:54.138116 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-24f87327-aae9-4749-bebb-66d4828ce1eb tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.156872 Aug 27 05:59:54.138696 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3911/7869] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:53 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:55.159281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-884cd563-c7f8-4090-975a-f307a03dd409 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:55.159912 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-884cd563-c7f8-4090-975a-f307a03dd409 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:55.167433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-884cd563-c7f8-4090-975a-f307a03dd409 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:55.167930 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-884cd563-c7f8-4090-975a-f307a03dd409 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:55.168375 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-884cd563-c7f8-4090-975a-f307a03dd409 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:55.169109 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-884cd563-c7f8-4090-975a-f307a03dd409 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:55.169579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-884cd563-c7f8-4090-975a-f307a03dd409 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:55.170019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-884cd563-c7f8-4090-975a-f307a03dd409 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:55.301852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-884cd563-c7f8-4090-975a-f307a03dd409 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:55.309763 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-884cd563-c7f8-4090-975a-f307a03dd409 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.154438 Aug 27 05:59:55.310345 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3959/7870] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:55 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:56.330681 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-989749cc-232f-40b8-901a-a0621c0c641f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:56.331293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-989749cc-232f-40b8-901a-a0621c0c641f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:56.338360 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-989749cc-232f-40b8-901a-a0621c0c641f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:56.338841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-989749cc-232f-40b8-901a-a0621c0c641f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:56.339275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-989749cc-232f-40b8-901a-a0621c0c641f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:56.339983 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-989749cc-232f-40b8-901a-a0621c0c641f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:56.340441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-989749cc-232f-40b8-901a-a0621c0c641f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:56.340892 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-989749cc-232f-40b8-901a-a0621c0c641f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:56.472319 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-989749cc-232f-40b8-901a-a0621c0c641f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:56.480672 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-989749cc-232f-40b8-901a-a0621c0c641f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.153858 Aug 27 05:59:56.481255 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3912/7871] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:56 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:57.503009 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-19b24984-83f9-4ac9-b88c-4b8158bdc403 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:57.503578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-19b24984-83f9-4ac9-b88c-4b8158bdc403 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:57.511131 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19b24984-83f9-4ac9-b88c-4b8158bdc403 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:57.511635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19b24984-83f9-4ac9-b88c-4b8158bdc403 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:57.512088 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19b24984-83f9-4ac9-b88c-4b8158bdc403 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:57.512841 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19b24984-83f9-4ac9-b88c-4b8158bdc403 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:57.513314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19b24984-83f9-4ac9-b88c-4b8158bdc403 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:57.513755 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19b24984-83f9-4ac9-b88c-4b8158bdc403 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:57.644826 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-19b24984-83f9-4ac9-b88c-4b8158bdc403 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:57.652797 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-19b24984-83f9-4ac9-b88c-4b8158bdc403 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.154268 Aug 27 05:59:57.653390 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3960/7872] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:57 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:58.674598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a9fd6920-2922-4aa6-a79f-58e289d48a14 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:58.675246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a9fd6920-2922-4aa6-a79f-58e289d48a14 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:58.682614 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9fd6920-2922-4aa6-a79f-58e289d48a14 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:58.683233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9fd6920-2922-4aa6-a79f-58e289d48a14 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:58.683694 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9fd6920-2922-4aa6-a79f-58e289d48a14 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:58.684466 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9fd6920-2922-4aa6-a79f-58e289d48a14 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:58.685010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9fd6920-2922-4aa6-a79f-58e289d48a14 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:58.685484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9fd6920-2922-4aa6-a79f-58e289d48a14 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:58.816745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a9fd6920-2922-4aa6-a79f-58e289d48a14 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 05:59:58.824982 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a9fd6920-2922-4aa6-a79f-58e289d48a14 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.154577 Aug 27 05:59:58.825561 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3913/7873] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:58 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 05:59:59.847418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb188525-a6c6-4a6c-a780-dc2571fa1b5b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 05:59:59.848166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fb188525-a6c6-4a6c-a780-dc2571fa1b5b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 05:59:59.855554 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb188525-a6c6-4a6c-a780-dc2571fa1b5b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:59.856061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb188525-a6c6-4a6c-a780-dc2571fa1b5b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:59.856513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb188525-a6c6-4a6c-a780-dc2571fa1b5b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:59.857254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb188525-a6c6-4a6c-a780-dc2571fa1b5b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 05:59:59.857729 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb188525-a6c6-4a6c-a780-dc2571fa1b5b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 05:59:59.858171 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb188525-a6c6-4a6c-a780-dc2571fa1b5b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 05:59:59.995641 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fb188525-a6c6-4a6c-a780-dc2571fa1b5b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:00.004063 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fb188525-a6c6-4a6c-a780-dc2571fa1b5b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.160450 Aug 27 06:00:00.004683 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3961/7874] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 05:59:59 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:01.025056 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a2d9f751-97b8-4bbf-84f8-2357169fdec2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:01.025680 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a2d9f751-97b8-4bbf-84f8-2357169fdec2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:01.032713 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d9f751-97b8-4bbf-84f8-2357169fdec2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:01.033205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d9f751-97b8-4bbf-84f8-2357169fdec2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:01.033644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d9f751-97b8-4bbf-84f8-2357169fdec2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:01.034342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d9f751-97b8-4bbf-84f8-2357169fdec2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:01.034879 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d9f751-97b8-4bbf-84f8-2357169fdec2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:01.035233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a2d9f751-97b8-4bbf-84f8-2357169fdec2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:01.171587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a2d9f751-97b8-4bbf-84f8-2357169fdec2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:01.179496 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a2d9f751-97b8-4bbf-84f8-2357169fdec2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.158415 Aug 27 06:00:01.180071 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3914/7875] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:01 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:01.422437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dbea4abf-5f5a-4ee3-af0a-4b04115ea860 req-d813f103-e2c5-42bd-93ed-a8ca5f345957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6b48c6-93a6-4e37-9603-93cd4981613e", "name": "network-vif-plugged", "status": "completed", "tag": "1cfb9f31-555d-41d0-a2b6-02cd7159a192"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:00:01.434016 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dbea4abf-5f5a-4ee3-af0a-4b04115ea860 req-d813f103-e2c5-42bd-93ed-a8ca5f345957 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:01.434522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dbea4abf-5f5a-4ee3-af0a-4b04115ea860 req-d813f103-e2c5-42bd-93ed-a8ca5f345957 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:01.434964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dbea4abf-5f5a-4ee3-af0a-4b04115ea860 req-d813f103-e2c5-42bd-93ed-a8ca5f345957 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:01.446499 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dbea4abf-5f5a-4ee3-af0a-4b04115ea860 req-d813f103-e2c5-42bd-93ed-a8ca5f345957 service nova] Creating event network-vif-plugged:1cfb9f31-555d-41d0-a2b6-02cd7159a192 for instance 0c6b48c6-93a6-4e37-9603-93cd4981613e on n-h1-854823-1 Aug 27 06:00:01.451956 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dbea4abf-5f5a-4ee3-af0a-4b04115ea860 req-d813f103-e2c5-42bd-93ed-a8ca5f345957 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033351 Aug 27 06:00:01.452786 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3962/7876] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:00:02.201490 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-841dffda-4799-4ecf-ba11-53a4e7464ebc tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:02.202102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-841dffda-4799-4ecf-ba11-53a4e7464ebc tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:02.209244 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-841dffda-4799-4ecf-ba11-53a4e7464ebc tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:02.209737 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-841dffda-4799-4ecf-ba11-53a4e7464ebc tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:02.210163 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-841dffda-4799-4ecf-ba11-53a4e7464ebc tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:02.210851 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-841dffda-4799-4ecf-ba11-53a4e7464ebc tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:02.211307 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-841dffda-4799-4ecf-ba11-53a4e7464ebc tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:02.211732 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-841dffda-4799-4ecf-ba11-53a4e7464ebc tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:02.349487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-841dffda-4799-4ecf-ba11-53a4e7464ebc tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:02.357762 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-841dffda-4799-4ecf-ba11-53a4e7464ebc tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.160622 Aug 27 06:00:02.358375 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3915/7877] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:02 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:03.381290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4cdbee55-e146-42a9-bb2b-f5ef2353e477 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:03.382019 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4cdbee55-e146-42a9-bb2b-f5ef2353e477 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:03.388866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cdbee55-e146-42a9-bb2b-f5ef2353e477 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:03.389383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cdbee55-e146-42a9-bb2b-f5ef2353e477 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:03.389836 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cdbee55-e146-42a9-bb2b-f5ef2353e477 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:03.390556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cdbee55-e146-42a9-bb2b-f5ef2353e477 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:03.391030 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cdbee55-e146-42a9-bb2b-f5ef2353e477 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:03.391512 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cdbee55-e146-42a9-bb2b-f5ef2353e477 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:03.547497 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4cdbee55-e146-42a9-bb2b-f5ef2353e477 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:03.555794 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4cdbee55-e146-42a9-bb2b-f5ef2353e477 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1685 microversion: 2.1 time: 0.179846 Aug 27 06:00:03.556471 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3963/7878] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:03 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:00:04.579620 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-723f2257-a175-477f-87a3-60623c794a63 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:00:04.580321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-723f2257-a175-477f-87a3-60623c794a63 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:00:04.587465 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-723f2257-a175-477f-87a3-60623c794a63 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:04.587948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-723f2257-a175-477f-87a3-60623c794a63 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:04.588379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-723f2257-a175-477f-87a3-60623c794a63 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:04.589098 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-723f2257-a175-477f-87a3-60623c794a63 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:00:04.589554 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-723f2257-a175-477f-87a3-60623c794a63 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:00:04.589976 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-723f2257-a175-477f-87a3-60623c794a63 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:00:04.721748 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-723f2257-a175-477f-87a3-60623c794a63 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:00:04.729851 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-723f2257-a175-477f-87a3-60623c794a63 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1672 microversion: 2.1 time: 0.156021 Aug 27 06:00:04.730440 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3916/7879] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:00:04 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:49.588178 n-d-854823-1 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5167bf5-c65d-49e1-967f-4d4da9273246] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:01:49.591932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=17 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:01:49.592406 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcb6849d-e32a-4e2c-9312-4c16ff26ba78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:49.593006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fcb6849d-e32a-4e2c-9312-4c16ff26ba78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:49.593802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=53 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:01:49.595034 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:01:49.595250 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 06:01:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.79) !!! Aug 27 06:01:49.596052 n-d-854823-1 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c18b0a9-ed40-4090-a136-c7167e1677a5] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:01:49.597611 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:01:49.597830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=15 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:01:49.598490 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 06:01:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.79) !!! Aug 27 06:01:49.598963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=46 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:01:49.607938 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcb6849d-e32a-4e2c-9312-4c16ff26ba78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:49.609055 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcb6849d-e32a-4e2c-9312-4c16ff26ba78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:49.609730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcb6849d-e32a-4e2c-9312-4c16ff26ba78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:49.610813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcb6849d-e32a-4e2c-9312-4c16ff26ba78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:49.611353 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcb6849d-e32a-4e2c-9312-4c16ff26ba78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:49.612349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcb6849d-e32a-4e2c-9312-4c16ff26ba78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:49.642194 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fcb6849d-e32a-4e2c-9312-4c16ff26ba78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:01:49.684933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-2dcd03cc-68b8-4c70-b648-f9ec02ee881c req-60343044-eff8-4056-baca-3860f1322505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6b48c6-93a6-4e37-9603-93cd4981613e", "tag": "1cfb9f31-555d-41d0-a2b6-02cd7159a192"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:01:49.695406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2dcd03cc-68b8-4c70-b648-f9ec02ee881c req-60343044-eff8-4056-baca-3860f1322505 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:49.695926 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2dcd03cc-68b8-4c70-b648-f9ec02ee881c req-60343044-eff8-4056-baca-3860f1322505 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:49.696358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-2dcd03cc-68b8-4c70-b648-f9ec02ee881c req-60343044-eff8-4056-baca-3860f1322505 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:49.709579 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-2dcd03cc-68b8-4c70-b648-f9ec02ee881c req-60343044-eff8-4056-baca-3860f1322505 service nova] Creating event network-changed:1cfb9f31-555d-41d0-a2b6-02cd7159a192 for instance 0c6b48c6-93a6-4e37-9603-93cd4981613e on n-h1-854823-1 Aug 27 06:01:49.717305 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-2dcd03cc-68b8-4c70-b648-f9ec02ee881c req-60343044-eff8-4056-baca-3860f1322505 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128531 Aug 27 06:01:49.718520 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3917/7880] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:01:49.735093 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fcb6849d-e32a-4e2c-9312-4c16ff26ba78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 204 len: 0 microversion: 2.1 time: 0.148998 Aug 27 06:01:49.735974 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3964/7881] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 06:01:49 2022] DELETE /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:01:49.746606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-132e2f55-46c0-471f-bc35-dd17f9545e1d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:49.747320 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-132e2f55-46c0-471f-bc35-dd17f9545e1d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:49.754280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-132e2f55-46c0-471f-bc35-dd17f9545e1d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:49.754774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-132e2f55-46c0-471f-bc35-dd17f9545e1d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:49.755209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-132e2f55-46c0-471f-bc35-dd17f9545e1d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:49.755909 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-132e2f55-46c0-471f-bc35-dd17f9545e1d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:49.756399 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-132e2f55-46c0-471f-bc35-dd17f9545e1d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:49.756864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-132e2f55-46c0-471f-bc35-dd17f9545e1d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:49.901836 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-132e2f55-46c0-471f-bc35-dd17f9545e1d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:49.910258 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-132e2f55-46c0-471f-bc35-dd17f9545e1d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1678 microversion: 2.1 time: 0.169348 Aug 27 06:01:49.911064 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3918/7882] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:49 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:50.934201 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b10f8e35-accd-459c-bd9f-cf4c5bc73e32 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:50.934926 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b10f8e35-accd-459c-bd9f-cf4c5bc73e32 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:50.945529 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b10f8e35-accd-459c-bd9f-cf4c5bc73e32 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:50.946281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b10f8e35-accd-459c-bd9f-cf4c5bc73e32 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:50.946737 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b10f8e35-accd-459c-bd9f-cf4c5bc73e32 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:50.947460 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b10f8e35-accd-459c-bd9f-cf4c5bc73e32 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:50.947935 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b10f8e35-accd-459c-bd9f-cf4c5bc73e32 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:50.948376 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b10f8e35-accd-459c-bd9f-cf4c5bc73e32 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:50.953984 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5167bf5-c65d-49e1-967f-4d4da9273246] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 45922. Aug 27 06:01:50.957190 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c18b0a9-ed40-4090-a136-c7167e1677a5] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 45924. Aug 27 06:01:51.097304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b10f8e35-accd-459c-bd9f-cf4c5bc73e32 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:51.105583 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b10f8e35-accd-459c-bd9f-cf4c5bc73e32 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1678 microversion: 2.1 time: 0.175817 Aug 27 06:01:51.106175 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3965/7883] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:50 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:51.779584 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-772dcc68-aa66-477a-81aa-22174f8f9403 req-a83f5df2-ce2f-4d07-bc1d-0e73ec9c534d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6b48c6-93a6-4e37-9603-93cd4981613e", "name": "network-vif-deleted", "tag": "1cfb9f31-555d-41d0-a2b6-02cd7159a192"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:01:51.791604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-772dcc68-aa66-477a-81aa-22174f8f9403 req-a83f5df2-ce2f-4d07-bc1d-0e73ec9c534d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:51.792094 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-772dcc68-aa66-477a-81aa-22174f8f9403 req-a83f5df2-ce2f-4d07-bc1d-0e73ec9c534d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:51.792546 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-772dcc68-aa66-477a-81aa-22174f8f9403 req-a83f5df2-ce2f-4d07-bc1d-0e73ec9c534d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:51.806274 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-772dcc68-aa66-477a-81aa-22174f8f9403 req-a83f5df2-ce2f-4d07-bc1d-0e73ec9c534d service nova] Creating event network-vif-deleted:1cfb9f31-555d-41d0-a2b6-02cd7159a192 for instance 0c6b48c6-93a6-4e37-9603-93cd4981613e on n-h1-854823-1 Aug 27 06:01:51.811813 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-772dcc68-aa66-477a-81aa-22174f8f9403 req-a83f5df2-ce2f-4d07-bc1d-0e73ec9c534d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035919 Aug 27 06:01:51.815214 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3919/7884] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:01:52.127764 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-11d0211c-ea06-448e-b1f8-d6ea582dca94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:52.129271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-11d0211c-ea06-448e-b1f8-d6ea582dca94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:52.136548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11d0211c-ea06-448e-b1f8-d6ea582dca94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:52.137120 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11d0211c-ea06-448e-b1f8-d6ea582dca94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:52.137584 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11d0211c-ea06-448e-b1f8-d6ea582dca94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:52.138323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11d0211c-ea06-448e-b1f8-d6ea582dca94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:52.138798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11d0211c-ea06-448e-b1f8-d6ea582dca94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:52.139439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11d0211c-ea06-448e-b1f8-d6ea582dca94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:52.177674 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11d0211c-ea06-448e-b1f8-d6ea582dca94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:52.178028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11d0211c-ea06-448e-b1f8-d6ea582dca94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:52.178693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11d0211c-ea06-448e-b1f8-d6ea582dca94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:52.179332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-11d0211c-ea06-448e-b1f8-d6ea582dca94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lazy-loading 'fault' on Instance uuid 0c6b48c6-93a6-4e37-9603-93cd4981613e {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:01:52.248688 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11d0211c-ea06-448e-b1f8-d6ea582dca94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:01:52.256662 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-11d0211c-ea06-448e-b1f8-d6ea582dca94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 200 len: 1337 microversion: 2.1 time: 0.133179 Aug 27 06:01:52.257290 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3966/7885] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:52 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 1337 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:01:53.281440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-318018c5-d035-4274-91df-dd4f8e044c02 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:53.282181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-318018c5-d035-4274-91df-dd4f8e044c02 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: 0c6b48c6-93a6-4e37-9603-93cd4981613e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:01:53.289016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-318018c5-d035-4274-91df-dd4f8e044c02 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:53.289512 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-318018c5-d035-4274-91df-dd4f8e044c02 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:53.289957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-318018c5-d035-4274-91df-dd4f8e044c02 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:53.290661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-318018c5-d035-4274-91df-dd4f8e044c02 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:01:53.291124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-318018c5-d035-4274-91df-dd4f8e044c02 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:01:53.291592 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-318018c5-d035-4274-91df-dd4f8e044c02 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:01:53.305416 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-318018c5-d035-4274-91df-dd4f8e044c02 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] HTTP exception thrown: Instance 0c6b48c6-93a6-4e37-9603-93cd4981613e could not be found. Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-318018c5-d035-4274-91df-dd4f8e044c02 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Request method failure captured: Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e HTTP/1.1 Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCbIrVXXZ4O3KyqrgRVxjgWlRQiscHsKVSVUx_I8GEEx28_TpGO6sjmE2bv8puRFusvtZPjORKNdv_oqj9jDwo7f9JL3LjXFwNaJy-Pf8UMLNjiibKaFTh1Nef0HawczEiePOJcPYEmQpiCfYMAr--8owXp2v4aCf7sgHY-Nl73FdB3Y Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 9bc082e6aa8b4dc8a1f8557d3d6ae1ee Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestShelveInstance-762024085 Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9bc082e6aa8b4dc8a1f8557d3d6ae1ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9bc082e6aa8b4dc8a1f8557d3d6ae1ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9bc082e6aa8b4dc8a1f8557d3d6ae1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9bc082e6aa8b4dc8a1f8557d3d6ae1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestShelveInstance-762024085 Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 9bc082e6aa8b4dc8a1f8557d3d6ae1ee Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestShelveInstance-762024085 Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestShelveInstance-762024085-project Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 7852e0941a584aaab239be7e2620866a Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestShelveInstance-762024085-project Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance 0c6b48c6-93a6-4e37-9603-93cd4981613e could not be found. Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': '0c6b48c6-93a6-4e37-9603-93cd4981613e'} Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c6b48c6-93a6-4e37-9603-93cd4981613e could not be found. Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c6b48c6-93a6-4e37-9603-93cd4981613e could not be found. Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:01:53.307048 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 06:01:53.313436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:01:53.313436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:01:53.313436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:01:53.313436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:01:53.313436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:01:53.313436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c6b48c6-93a6-4e37-9603-93cd4981613e could not be found. Aug 27 06:01:53.313436 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 06:01:53.313436 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-318018c5-d035-4274-91df-dd4f8e044c02 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Returning 404 to user: Instance 0c6b48c6-93a6-4e37-9603-93cd4981613e could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:01:53.313436 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-318018c5-d035-4274-91df-dd4f8e044c02 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e" status: 404 len: 111 microversion: 2.1 time: 0.032315 Aug 27 06:01:53.313436 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3920/7886] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:01:53 2022] GET /compute/v2.1/servers/0c6b48c6-93a6-4e37-9603-93cd4981613e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:01:53.466253 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89cc06df-6121-49b6-9f4f-fd7a5762644c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '.version_select at 0x7f1f20ea19d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:01:53.505522 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89cc06df-6121-49b6-9f4f-fd7a5762644c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1927527385" status: 202 len: 0 microversion: 2.1 time: 0.043167 Aug 27 06:01:53.506136 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3967/7887] 10.222.0.79 () {58 vars in 1254 bytes} [Sat Aug 27 06:01:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1927527385 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:01:53.531338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c231eb1a-8cf9-4ab0-b524-4b3a663ca26f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Action: 'create', calling method: .version_select at 0x7f1f215eae50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1716946841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9JqHmiJKlohqGhWVLGO7pCvP6agFUf/NlUhsS4I9UAfAl4tZX3GLqqfONt1Lvv2wIuG1iyOI/hDSmsc0fqP4J6pD0mm0LGCqyCjLSaTCcCFJt8HSAfscOwwTR033JDNg=="}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:01:53.549443 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-c231eb1a-8cf9-4ab0-b524-4b3a663ca26f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Getting quotas for project 9bc082e6aa8b4dc8a1f8557d3d6ae1ee. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:01:53.555514 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-c231eb1a-8cf9-4ab0-b524-4b3a663ca26f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Getting quotas for user 7852e0941a584aaab239be7e2620866a and project 9bc082e6aa8b4dc8a1f8557d3d6ae1ee. Resources: {'key_pairs'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:01:53.588174 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c231eb1a-8cf9-4ab0-b524-4b3a663ca26f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.061419 Aug 27 06:01:53.588849 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3921/7888] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 06:01:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:02:09.977154 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-800416758", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1716946841", "security_groups": [{"name": "tempest-secgroup-smoke-1919031806"}], "networks": [{"uuid": "a2d8ca23-1bce-4dd4-ab0c-b382ba8d9333"}], "block_device_mapping_v2": [{"uuid": "aa8d4872-9e4c-4304-ae50-f5273409c0cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:02:09.989392 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:02:09.990040 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:02:10.098213 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] validate_networks() for [('a2d8ca23-1bce-4dd4-ab0c-b382ba8d9333', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:02:10.475216 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:02:10.475635 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:02:10.476130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:02:10.476577 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:02:10.477006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:02:10.486668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:10.487160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:10.487609 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:10.488350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:10.488854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:10.489292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:10.507610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Getting quotas for project 9bc082e6aa8b4dc8a1f8557d3d6ae1ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:02:10.513292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Getting quotas for user 7852e0941a584aaab239be7e2620866a and project 9bc082e6aa8b4dc8a1f8557d3d6ae1ee. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:02:10.572788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:02:10.574965 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa8d4872-9e4c-4304-ae50-f5273409c0cf',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:02:10.711641 n-d-854823-1 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [24026710-703f-46a8-9444-f0501f50d18f] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 06:02:11.721267 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [24026710-703f-46a8-9444-f0501f50d18f] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 46098. Aug 27 06:02:11.726775 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e2aa6a0-92c7-4c53-87b6-88a5c8073d82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.753735 Aug 27 06:02:11.727602 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3968/7889] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 06:02:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 06:02:11.739313 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0a5be124-b47b-49ed-9d93-505d95a82e82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:11.739896 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0a5be124-b47b-49ed-9d93-505d95a82e82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:11.743432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=12 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:02:11.744196 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:02:11.745934 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:02:11.804273 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0a5be124-b47b-49ed-9d93-505d95a82e82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:11.811079 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0a5be124-b47b-49ed-9d93-505d95a82e82 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1088 microversion: 2.1 time: 0.076120 Aug 27 06:02:11.811651 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3922/7890] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:11 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:12.832466 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-adbe3fb6-df25-42f2-ae80-0fd5554fc068 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:12.833183 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-adbe3fb6-df25-42f2-ae80-0fd5554fc068 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:12.840401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adbe3fb6-df25-42f2-ae80-0fd5554fc068 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:12.840937 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adbe3fb6-df25-42f2-ae80-0fd5554fc068 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:12.841394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adbe3fb6-df25-42f2-ae80-0fd5554fc068 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:12.842114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adbe3fb6-df25-42f2-ae80-0fd5554fc068 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:12.842592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adbe3fb6-df25-42f2-ae80-0fd5554fc068 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:12.843035 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adbe3fb6-df25-42f2-ae80-0fd5554fc068 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:12.920115 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-adbe3fb6-df25-42f2-ae80-0fd5554fc068 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:12.929672 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-adbe3fb6-df25-42f2-ae80-0fd5554fc068 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1186 microversion: 2.1 time: 0.102238 Aug 27 06:02:12.930402 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3969/7891] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:12 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1186 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:13.951561 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-4c0ce72b-df70-4333-9580-a5afd0f94023 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:13.952186 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-4c0ce72b-df70-4333-9580-a5afd0f94023 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:13.960236 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c0ce72b-df70-4333-9580-a5afd0f94023 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:13.960795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c0ce72b-df70-4333-9580-a5afd0f94023 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:13.961238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c0ce72b-df70-4333-9580-a5afd0f94023 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:13.961949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c0ce72b-df70-4333-9580-a5afd0f94023 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:13.962406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c0ce72b-df70-4333-9580-a5afd0f94023 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:13.962832 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-4c0ce72b-df70-4333-9580-a5afd0f94023 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:14.190414 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-4c0ce72b-df70-4333-9580-a5afd0f94023 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:14.198890 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-4c0ce72b-df70-4333-9580-a5afd0f94023 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1272 microversion: 2.1 time: 0.251356 Aug 27 06:02:14.199574 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3923/7892] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:13 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:14.711184 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-76cb2fe5-e211-4ab3-bc0d-0accddb891f7 req-e6c02352-73b4-498f-b2ad-c63661494c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c84f7ea6-191a-41ce-9cbc-d1238e387425", "tag": "0636d81c-318f-4dad-808e-b858d0486fb1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:02:14.721340 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-76cb2fe5-e211-4ab3-bc0d-0accddb891f7 req-e6c02352-73b4-498f-b2ad-c63661494c58 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:14.721843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-76cb2fe5-e211-4ab3-bc0d-0accddb891f7 req-e6c02352-73b4-498f-b2ad-c63661494c58 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:14.722344 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-76cb2fe5-e211-4ab3-bc0d-0accddb891f7 req-e6c02352-73b4-498f-b2ad-c63661494c58 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:14.738281 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-76cb2fe5-e211-4ab3-bc0d-0accddb891f7 req-e6c02352-73b4-498f-b2ad-c63661494c58 service nova] Creating event network-changed:0636d81c-318f-4dad-808e-b858d0486fb1 for instance c84f7ea6-191a-41ce-9cbc-d1238e387425 on n-h2-854823-1 Aug 27 06:02:14.743349 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-76cb2fe5-e211-4ab3-bc0d-0accddb891f7 req-e6c02352-73b4-498f-b2ad-c63661494c58 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123088 Aug 27 06:02:14.744147 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3970/7893] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:02:15.219586 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-029ad534-73c9-4bd8-89ab-f6af55ef03d7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:15.220961 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-029ad534-73c9-4bd8-89ab-f6af55ef03d7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:15.230644 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-029ad534-73c9-4bd8-89ab-f6af55ef03d7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:15.231218 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-029ad534-73c9-4bd8-89ab-f6af55ef03d7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:15.231662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-029ad534-73c9-4bd8-89ab-f6af55ef03d7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:15.232371 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-029ad534-73c9-4bd8-89ab-f6af55ef03d7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:15.232860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-029ad534-73c9-4bd8-89ab-f6af55ef03d7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:15.233287 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-029ad534-73c9-4bd8-89ab-f6af55ef03d7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:15.374498 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-029ad534-73c9-4bd8-89ab-f6af55ef03d7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:15.382804 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-029ad534-73c9-4bd8-89ab-f6af55ef03d7 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1272 microversion: 2.1 time: 0.167348 Aug 27 06:02:15.394750 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3924/7894] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:15 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:16.405409 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e73b94b9-37c3-4a3a-846d-401f18b68078 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:16.406809 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e73b94b9-37c3-4a3a-846d-401f18b68078 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:16.413996 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73b94b9-37c3-4a3a-846d-401f18b68078 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:16.414504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73b94b9-37c3-4a3a-846d-401f18b68078 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:16.414953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73b94b9-37c3-4a3a-846d-401f18b68078 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:16.415682 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73b94b9-37c3-4a3a-846d-401f18b68078 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:16.416181 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73b94b9-37c3-4a3a-846d-401f18b68078 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:16.416850 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73b94b9-37c3-4a3a-846d-401f18b68078 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:16.629127 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e73b94b9-37c3-4a3a-846d-401f18b68078 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:16.636883 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e73b94b9-37c3-4a3a-846d-401f18b68078 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1272 microversion: 2.1 time: 0.236884 Aug 27 06:02:16.637466 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3971/7895] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:16 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1272 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:17.657956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5bcbca0e-164a-45f5-b601-6179a46ca983 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:17.659223 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5bcbca0e-164a-45f5-b601-6179a46ca983 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:17.666467 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bcbca0e-164a-45f5-b601-6179a46ca983 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:17.666991 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bcbca0e-164a-45f5-b601-6179a46ca983 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:17.667461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bcbca0e-164a-45f5-b601-6179a46ca983 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:17.668217 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bcbca0e-164a-45f5-b601-6179a46ca983 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:17.668734 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bcbca0e-164a-45f5-b601-6179a46ca983 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:17.669391 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5bcbca0e-164a-45f5-b601-6179a46ca983 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:17.817913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5bcbca0e-164a-45f5-b601-6179a46ca983 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:17.827103 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5bcbca0e-164a-45f5-b601-6179a46ca983 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1272 microversion: 2.1 time: 0.173812 Aug 27 06:02:17.828352 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3925/7896] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:17 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:18.850536 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32e94646-3293-4c1f-ad25-7c97ac5ff4c5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:18.851186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32e94646-3293-4c1f-ad25-7c97ac5ff4c5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:18.858193 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32e94646-3293-4c1f-ad25-7c97ac5ff4c5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:18.858679 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32e94646-3293-4c1f-ad25-7c97ac5ff4c5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:18.859123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32e94646-3293-4c1f-ad25-7c97ac5ff4c5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:18.859821 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32e94646-3293-4c1f-ad25-7c97ac5ff4c5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:18.860291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32e94646-3293-4c1f-ad25-7c97ac5ff4c5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:18.861552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32e94646-3293-4c1f-ad25-7c97ac5ff4c5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:18.991923 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32e94646-3293-4c1f-ad25-7c97ac5ff4c5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:18.999768 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32e94646-3293-4c1f-ad25-7c97ac5ff4c5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1260 microversion: 2.1 time: 0.153181 Aug 27 06:02:19.000340 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3972/7897] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:18 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:20.022111 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-70ff4b1d-4492-40d8-9fe0-9185c8bf3474 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:20.022724 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-70ff4b1d-4492-40d8-9fe0-9185c8bf3474 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:20.028878 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70ff4b1d-4492-40d8-9fe0-9185c8bf3474 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:20.029379 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70ff4b1d-4492-40d8-9fe0-9185c8bf3474 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:20.029820 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70ff4b1d-4492-40d8-9fe0-9185c8bf3474 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:20.030519 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70ff4b1d-4492-40d8-9fe0-9185c8bf3474 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:20.030988 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70ff4b1d-4492-40d8-9fe0-9185c8bf3474 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:20.031412 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-70ff4b1d-4492-40d8-9fe0-9185c8bf3474 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:20.163864 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-70ff4b1d-4492-40d8-9fe0-9185c8bf3474 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:20.171626 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-70ff4b1d-4492-40d8-9fe0-9185c8bf3474 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1260 microversion: 2.1 time: 0.153777 Aug 27 06:02:20.172204 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3926/7898] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:20 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:02:21.193813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73e0e9d7-4536-4f07-a352-41dff606a787 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:21.194440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73e0e9d7-4536-4f07-a352-41dff606a787 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:21.196719 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:02:21.197606 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:02:21.203000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73e0e9d7-4536-4f07-a352-41dff606a787 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:21.203496 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73e0e9d7-4536-4f07-a352-41dff606a787 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:21.203943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73e0e9d7-4536-4f07-a352-41dff606a787 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:21.205439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73e0e9d7-4536-4f07-a352-41dff606a787 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:21.205916 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73e0e9d7-4536-4f07-a352-41dff606a787 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:21.206352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73e0e9d7-4536-4f07-a352-41dff606a787 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:21.341153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-73e0e9d7-4536-4f07-a352-41dff606a787 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:21.349007 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-73e0e9d7-4536-4f07-a352-41dff606a787 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1260 microversion: 2.1 time: 0.159294 Aug 27 06:02:21.349597 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3973/7899] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:21 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:22.369588 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d89e2b9c-7381-4127-b0ac-2f59b16a3721 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:22.370208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d89e2b9c-7381-4127-b0ac-2f59b16a3721 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:22.373023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:02:22.378518 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d89e2b9c-7381-4127-b0ac-2f59b16a3721 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:22.379011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d89e2b9c-7381-4127-b0ac-2f59b16a3721 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:22.379455 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d89e2b9c-7381-4127-b0ac-2f59b16a3721 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:22.380156 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d89e2b9c-7381-4127-b0ac-2f59b16a3721 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:22.380652 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d89e2b9c-7381-4127-b0ac-2f59b16a3721 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:22.381090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d89e2b9c-7381-4127-b0ac-2f59b16a3721 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:22.519572 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d89e2b9c-7381-4127-b0ac-2f59b16a3721 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:22.527478 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d89e2b9c-7381-4127-b0ac-2f59b16a3721 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1260 microversion: 2.1 time: 0.161826 Aug 27 06:02:22.528073 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3927/7900] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:22 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:02:23.548964 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-663dfb40-7409-422c-9e3c-b67c5af3fb4f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:23.549598 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-663dfb40-7409-422c-9e3c-b67c5af3fb4f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:23.556796 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-663dfb40-7409-422c-9e3c-b67c5af3fb4f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:23.557309 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-663dfb40-7409-422c-9e3c-b67c5af3fb4f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:23.557767 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-663dfb40-7409-422c-9e3c-b67c5af3fb4f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:23.558477 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-663dfb40-7409-422c-9e3c-b67c5af3fb4f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:23.558953 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-663dfb40-7409-422c-9e3c-b67c5af3fb4f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:23.559401 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-663dfb40-7409-422c-9e3c-b67c5af3fb4f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:23.692265 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-663dfb40-7409-422c-9e3c-b67c5af3fb4f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:23.700124 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-663dfb40-7409-422c-9e3c-b67c5af3fb4f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1260 microversion: 2.1 time: 0.155355 Aug 27 06:02:23.700735 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3974/7901] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:23 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:24.722073 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d612a147-8ad8-46fe-a7c5-f7137012acfe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:24.722687 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d612a147-8ad8-46fe-a7c5-f7137012acfe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:24.729440 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d612a147-8ad8-46fe-a7c5-f7137012acfe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:24.729920 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d612a147-8ad8-46fe-a7c5-f7137012acfe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:24.730351 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d612a147-8ad8-46fe-a7c5-f7137012acfe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:24.731037 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d612a147-8ad8-46fe-a7c5-f7137012acfe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:24.731488 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d612a147-8ad8-46fe-a7c5-f7137012acfe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:24.731908 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d612a147-8ad8-46fe-a7c5-f7137012acfe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:24.859966 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d612a147-8ad8-46fe-a7c5-f7137012acfe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:24.867929 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d612a147-8ad8-46fe-a7c5-f7137012acfe tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1260 microversion: 2.1 time: 0.150350 Aug 27 06:02:24.868496 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3928/7902] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:24 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:25.888086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05a5e05f-eb4e-40bb-b3e0-9de5b9f74047 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:25.888747 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05a5e05f-eb4e-40bb-b3e0-9de5b9f74047 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:25.896439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a5e05f-eb4e-40bb-b3e0-9de5b9f74047 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:25.896992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a5e05f-eb4e-40bb-b3e0-9de5b9f74047 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:25.897448 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a5e05f-eb4e-40bb-b3e0-9de5b9f74047 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:25.898179 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a5e05f-eb4e-40bb-b3e0-9de5b9f74047 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:25.898651 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a5e05f-eb4e-40bb-b3e0-9de5b9f74047 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:25.899093 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a5e05f-eb4e-40bb-b3e0-9de5b9f74047 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:26.037103 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05a5e05f-eb4e-40bb-b3e0-9de5b9f74047 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:26.044923 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05a5e05f-eb4e-40bb-b3e0-9de5b9f74047 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1260 microversion: 2.1 time: 0.160821 Aug 27 06:02:26.045501 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3975/7903] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:25 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:27.065956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-da49819b-0a64-47c8-a387-6da69341fe8c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:27.066593 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-da49819b-0a64-47c8-a387-6da69341fe8c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:27.073721 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da49819b-0a64-47c8-a387-6da69341fe8c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:27.074205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da49819b-0a64-47c8-a387-6da69341fe8c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:27.074639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da49819b-0a64-47c8-a387-6da69341fe8c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:27.075333 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da49819b-0a64-47c8-a387-6da69341fe8c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:27.075786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da49819b-0a64-47c8-a387-6da69341fe8c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:27.076206 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-da49819b-0a64-47c8-a387-6da69341fe8c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:27.214645 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-da49819b-0a64-47c8-a387-6da69341fe8c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:27.222384 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-da49819b-0a64-47c8-a387-6da69341fe8c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1260 microversion: 2.1 time: 0.160375 Aug 27 06:02:27.222960 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3929/7904] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:27 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:27.936417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-32918cc6-de28-46c1-a74e-8c15d39f1e75 req-2e6b0367-c478-475b-9454-cec9a09bd0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c84f7ea6-191a-41ce-9cbc-d1238e387425", "name": "network-vif-plugged", "status": "completed", "tag": "0636d81c-318f-4dad-808e-b858d0486fb1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:02:27.947133 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-32918cc6-de28-46c1-a74e-8c15d39f1e75 req-2e6b0367-c478-475b-9454-cec9a09bd0c8 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:27.947628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-32918cc6-de28-46c1-a74e-8c15d39f1e75 req-2e6b0367-c478-475b-9454-cec9a09bd0c8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:27.948743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-32918cc6-de28-46c1-a74e-8c15d39f1e75 req-2e6b0367-c478-475b-9454-cec9a09bd0c8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:27.960214 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-32918cc6-de28-46c1-a74e-8c15d39f1e75 req-2e6b0367-c478-475b-9454-cec9a09bd0c8 service nova] Creating event network-vif-plugged:0636d81c-318f-4dad-808e-b858d0486fb1 for instance c84f7ea6-191a-41ce-9cbc-d1238e387425 on n-h2-854823-1 Aug 27 06:02:27.965528 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-32918cc6-de28-46c1-a74e-8c15d39f1e75 req-2e6b0367-c478-475b-9454-cec9a09bd0c8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086956 Aug 27 06:02:27.966386 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3976/7905] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:02:28.242932 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d1990ec1-ac24-40f0-a6e9-39f3baa918f5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:28.243541 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d1990ec1-ac24-40f0-a6e9-39f3baa918f5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:28.250545 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1990ec1-ac24-40f0-a6e9-39f3baa918f5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:28.250955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1990ec1-ac24-40f0-a6e9-39f3baa918f5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:28.251394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1990ec1-ac24-40f0-a6e9-39f3baa918f5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:28.252613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1990ec1-ac24-40f0-a6e9-39f3baa918f5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:28.253065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1990ec1-ac24-40f0-a6e9-39f3baa918f5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:28.253484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d1990ec1-ac24-40f0-a6e9-39f3baa918f5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:28.387267 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d1990ec1-ac24-40f0-a6e9-39f3baa918f5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:28.395415 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d1990ec1-ac24-40f0-a6e9-39f3baa918f5 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1260 microversion: 2.1 time: 0.156388 Aug 27 06:02:28.395987 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3930/7906] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:28 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:29.417776 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ffa1584-67a5-430a-9159-d92b430c6f97 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:29.418528 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ffa1584-67a5-430a-9159-d92b430c6f97 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:29.424943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ffa1584-67a5-430a-9159-d92b430c6f97 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:29.425657 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ffa1584-67a5-430a-9159-d92b430c6f97 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:29.425908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ffa1584-67a5-430a-9159-d92b430c6f97 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:29.426880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ffa1584-67a5-430a-9159-d92b430c6f97 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:29.427356 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ffa1584-67a5-430a-9159-d92b430c6f97 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:29.427804 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ffa1584-67a5-430a-9159-d92b430c6f97 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:29.562332 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ffa1584-67a5-430a-9159-d92b430c6f97 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:29.570754 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ffa1584-67a5-430a-9159-d92b430c6f97 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1442 microversion: 2.1 time: 0.158206 Aug 27 06:02:29.571350 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3977/7907] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:29 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:29.591528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0e4c7883-b34a-453c-95c8-d394bc8c9945 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:02:29.592144 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0e4c7883-b34a-453c-95c8-d394bc8c9945 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:02:29.598995 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e4c7883-b34a-453c-95c8-d394bc8c9945 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:29.599478 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e4c7883-b34a-453c-95c8-d394bc8c9945 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:29.599915 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e4c7883-b34a-453c-95c8-d394bc8c9945 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:29.600673 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e4c7883-b34a-453c-95c8-d394bc8c9945 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:29.601131 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e4c7883-b34a-453c-95c8-d394bc8c9945 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:29.601560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0e4c7883-b34a-453c-95c8-d394bc8c9945 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:29.732814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0e4c7883-b34a-453c-95c8-d394bc8c9945 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:02:29.740890 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0e4c7883-b34a-453c-95c8-d394bc8c9945 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1442 microversion: 2.1 time: 0.153664 Aug 27 06:02:29.741472 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3931/7908] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:02:29 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:02:31.685534 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8fe56d84-6980-42f1-8d7a-5d4e07433de1 req-070866e0-ef66-4b8b-8974-328425b23229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c84f7ea6-191a-41ce-9cbc-d1238e387425", "tag": "0636d81c-318f-4dad-808e-b858d0486fb1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:02:31.696777 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8fe56d84-6980-42f1-8d7a-5d4e07433de1 req-070866e0-ef66-4b8b-8974-328425b23229 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:02:31.697271 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8fe56d84-6980-42f1-8d7a-5d4e07433de1 req-070866e0-ef66-4b8b-8974-328425b23229 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:02:31.697710 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8fe56d84-6980-42f1-8d7a-5d4e07433de1 req-070866e0-ef66-4b8b-8974-328425b23229 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:02:31.711660 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8fe56d84-6980-42f1-8d7a-5d4e07433de1 req-070866e0-ef66-4b8b-8974-328425b23229 service nova] Creating event network-changed:0636d81c-318f-4dad-808e-b858d0486fb1 for instance c84f7ea6-191a-41ce-9cbc-d1238e387425 on n-h2-854823-1 Aug 27 06:02:31.716849 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8fe56d84-6980-42f1-8d7a-5d4e07433de1 req-070866e0-ef66-4b8b-8974-328425b23229 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035198 Aug 27 06:02:31.717547 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3978/7909] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:04:31.025808 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30b4270-6763-4864-8153-10d27fd192b5] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:04:31.026764 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2badfd4b-a808-402a-925c-31461d1cb878] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:04:31.027598 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=22 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:04:31.028344 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=54 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:04:31.029884 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:04:31.030092 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 06:04:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425/action (ip 10.222.0.79) !!! Aug 27 06:04:31.036209 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b9b7d28d-c725-4bfc-85d2-0d506f4bd51b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:04:31.036779 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b9b7d28d-c725-4bfc-85d2-0d506f4bd51b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:31.047062 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9b7d28d-c725-4bfc-85d2-0d506f4bd51b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:31.047547 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9b7d28d-c725-4bfc-85d2-0d506f4bd51b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:31.047987 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9b7d28d-c725-4bfc-85d2-0d506f4bd51b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:31.048731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9b7d28d-c725-4bfc-85d2-0d506f4bd51b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:31.049194 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9b7d28d-c725-4bfc-85d2-0d506f4bd51b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:31.049649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b9b7d28d-c725-4bfc-85d2-0d506f4bd51b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:31.073454 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.objects.instance [None req-b9b7d28d-c725-4bfc-85d2-0d506f4bd51b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lazy-loading 'flavor' on Instance uuid c84f7ea6-191a-41ce-9cbc-d1238e387425 {{(pid=128870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:04:31.145865 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b9b7d28d-c725-4bfc-85d2-0d506f4bd51b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "POST /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425/action" status: 202 len: 0 microversion: 2.1 time: 0.121787 Aug 27 06:04:31.146836 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3932/7910] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 06:04:31 2022] POST /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:04:31.154977 n-d-854823-1 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c18b0a9-ed40-4090-a136-c7167e1677a5] AMQP server on 10.222.0.79:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 27 06:04:31.156674 n-d-854823-1 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5167bf5-c65d-49e1-967f-4d4da9273246] AMQP server on 10.222.0.79:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 27 06:04:31.158074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:04:31.159444 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=50 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:04:31.162761 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:04:31.162937 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 06:04:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 (ip 10.222.0.79) !!! Aug 27 06:04:31.169706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-825a94f3-efa7-41c8-b04d-cc1d757ad455 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:31.170439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-825a94f3-efa7-41c8-b04d-cc1d757ad455 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:31.180339 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-825a94f3-efa7-41c8-b04d-cc1d757ad455 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:31.180882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-825a94f3-efa7-41c8-b04d-cc1d757ad455 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:31.181342 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-825a94f3-efa7-41c8-b04d-cc1d757ad455 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:31.182076 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-825a94f3-efa7-41c8-b04d-cc1d757ad455 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:31.182553 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-825a94f3-efa7-41c8-b04d-cc1d757ad455 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:31.183006 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-825a94f3-efa7-41c8-b04d-cc1d757ad455 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:31.321602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-825a94f3-efa7-41c8-b04d-cc1d757ad455 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:31.329684 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-825a94f3-efa7-41c8-b04d-cc1d757ad455 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.178138 Aug 27 06:04:31.330273 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3979/7911] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:31 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:32.351146 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-0cf5d460-4e8b-4088-bf79-9ee3e9e6570b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:32.351847 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-0cf5d460-4e8b-4088-bf79-9ee3e9e6570b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:32.360872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cf5d460-4e8b-4088-bf79-9ee3e9e6570b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:32.361359 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cf5d460-4e8b-4088-bf79-9ee3e9e6570b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:32.361793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cf5d460-4e8b-4088-bf79-9ee3e9e6570b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:32.362489 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cf5d460-4e8b-4088-bf79-9ee3e9e6570b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:32.363433 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cf5d460-4e8b-4088-bf79-9ee3e9e6570b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:32.363856 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-0cf5d460-4e8b-4088-bf79-9ee3e9e6570b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:32.371785 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] [2badfd4b-a808-402a-925c-31461d1cb878] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 46204. Aug 27 06:04:32.385273 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30b4270-6763-4864-8153-10d27fd192b5] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 46202. Aug 27 06:04:32.507012 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-0cf5d460-4e8b-4088-bf79-9ee3e9e6570b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:32.515185 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-0cf5d460-4e8b-4088-bf79-9ee3e9e6570b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.168348 Aug 27 06:04:32.515782 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3933/7912] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:32 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:33.537148 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d472b8c2-af4a-4d18-8e28-8d06e9acb32f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:33.537771 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d472b8c2-af4a-4d18-8e28-8d06e9acb32f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:33.547168 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d472b8c2-af4a-4d18-8e28-8d06e9acb32f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:33.547668 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d472b8c2-af4a-4d18-8e28-8d06e9acb32f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:33.548114 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d472b8c2-af4a-4d18-8e28-8d06e9acb32f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:33.548925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d472b8c2-af4a-4d18-8e28-8d06e9acb32f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:33.549394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d472b8c2-af4a-4d18-8e28-8d06e9acb32f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:33.549830 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d472b8c2-af4a-4d18-8e28-8d06e9acb32f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:33.554971 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c18b0a9-ed40-4090-a136-c7167e1677a5] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 46210. Aug 27 06:04:33.557878 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5167bf5-c65d-49e1-967f-4d4da9273246] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 46212. Aug 27 06:04:33.694237 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d472b8c2-af4a-4d18-8e28-8d06e9acb32f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:33.702168 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d472b8c2-af4a-4d18-8e28-8d06e9acb32f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.169091 Aug 27 06:04:33.702767 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3980/7913] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:33 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:34.724613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-61d4639d-1579-4b18-8f02-67cea0cb6f10 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:34.725240 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-61d4639d-1579-4b18-8f02-67cea0cb6f10 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:34.731781 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61d4639d-1579-4b18-8f02-67cea0cb6f10 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:34.732265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61d4639d-1579-4b18-8f02-67cea0cb6f10 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:34.732741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61d4639d-1579-4b18-8f02-67cea0cb6f10 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:34.733441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61d4639d-1579-4b18-8f02-67cea0cb6f10 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:34.733902 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61d4639d-1579-4b18-8f02-67cea0cb6f10 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:34.734332 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-61d4639d-1579-4b18-8f02-67cea0cb6f10 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:34.865568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-61d4639d-1579-4b18-8f02-67cea0cb6f10 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:34.873325 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-61d4639d-1579-4b18-8f02-67cea0cb6f10 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.153882 Aug 27 06:04:34.873902 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3934/7914] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:34 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:35.895640 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d46245a4-8692-494b-a155-309c1e6cc019 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:35.896268 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d46245a4-8692-494b-a155-309c1e6cc019 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:35.903285 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d46245a4-8692-494b-a155-309c1e6cc019 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:35.903788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d46245a4-8692-494b-a155-309c1e6cc019 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:35.904243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d46245a4-8692-494b-a155-309c1e6cc019 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:35.905008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d46245a4-8692-494b-a155-309c1e6cc019 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:35.905558 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d46245a4-8692-494b-a155-309c1e6cc019 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:35.906004 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d46245a4-8692-494b-a155-309c1e6cc019 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:36.037132 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d46245a4-8692-494b-a155-309c1e6cc019 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:36.045249 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d46245a4-8692-494b-a155-309c1e6cc019 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.154214 Aug 27 06:04:36.045969 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3981/7915] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:35 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:37.067177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5c50fb93-9b84-4e64-bf88-f641b93c2c27 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:37.067798 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5c50fb93-9b84-4e64-bf88-f641b93c2c27 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:37.074628 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c50fb93-9b84-4e64-bf88-f641b93c2c27 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:37.075112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c50fb93-9b84-4e64-bf88-f641b93c2c27 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:37.075597 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c50fb93-9b84-4e64-bf88-f641b93c2c27 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:37.076234 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c50fb93-9b84-4e64-bf88-f641b93c2c27 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:37.076722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c50fb93-9b84-4e64-bf88-f641b93c2c27 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:37.077150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5c50fb93-9b84-4e64-bf88-f641b93c2c27 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:37.211200 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5c50fb93-9b84-4e64-bf88-f641b93c2c27 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:37.219458 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5c50fb93-9b84-4e64-bf88-f641b93c2c27 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.156123 Aug 27 06:04:37.220083 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3935/7916] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:37 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:38.241743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74aa7bd6-d451-4eff-bc62-12a2bce72eca tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:38.242396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74aa7bd6-d451-4eff-bc62-12a2bce72eca tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:38.249323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74aa7bd6-d451-4eff-bc62-12a2bce72eca tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:38.249819 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74aa7bd6-d451-4eff-bc62-12a2bce72eca tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:38.250269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74aa7bd6-d451-4eff-bc62-12a2bce72eca tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:38.250979 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74aa7bd6-d451-4eff-bc62-12a2bce72eca tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:38.251447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74aa7bd6-d451-4eff-bc62-12a2bce72eca tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:38.251882 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74aa7bd6-d451-4eff-bc62-12a2bce72eca tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:38.384611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-74aa7bd6-d451-4eff-bc62-12a2bce72eca tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:38.392623 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74aa7bd6-d451-4eff-bc62-12a2bce72eca tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.155338 Aug 27 06:04:38.393209 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3982/7917] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:38 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:39.413639 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dffc0581-ae98-4540-84f8-3f8acc5d453b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:39.414254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dffc0581-ae98-4540-84f8-3f8acc5d453b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:39.421173 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dffc0581-ae98-4540-84f8-3f8acc5d453b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:39.421657 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dffc0581-ae98-4540-84f8-3f8acc5d453b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:39.422095 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dffc0581-ae98-4540-84f8-3f8acc5d453b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:39.422792 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dffc0581-ae98-4540-84f8-3f8acc5d453b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:39.423252 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dffc0581-ae98-4540-84f8-3f8acc5d453b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:39.423674 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dffc0581-ae98-4540-84f8-3f8acc5d453b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:39.561074 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dffc0581-ae98-4540-84f8-3f8acc5d453b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:39.568987 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dffc0581-ae98-4540-84f8-3f8acc5d453b tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.159827 Aug 27 06:04:39.569568 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3936/7918] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:39 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:40.590207 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a659aa6-b42f-482f-8611-1cdee8f08d86 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:40.590743 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a659aa6-b42f-482f-8611-1cdee8f08d86 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:40.597910 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a659aa6-b42f-482f-8611-1cdee8f08d86 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:40.598419 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a659aa6-b42f-482f-8611-1cdee8f08d86 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:40.598874 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a659aa6-b42f-482f-8611-1cdee8f08d86 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:40.599611 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a659aa6-b42f-482f-8611-1cdee8f08d86 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:40.600160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a659aa6-b42f-482f-8611-1cdee8f08d86 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:40.600789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a659aa6-b42f-482f-8611-1cdee8f08d86 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:40.737022 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a659aa6-b42f-482f-8611-1cdee8f08d86 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:40.745495 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a659aa6-b42f-482f-8611-1cdee8f08d86 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.159500 Aug 27 06:04:40.746078 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3983/7919] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:40 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:41.766540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1dbcc3b6-bcf1-4ce2-841b-d79e27ce0ba4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:41.767161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1dbcc3b6-bcf1-4ce2-841b-d79e27ce0ba4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:41.774220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dbcc3b6-bcf1-4ce2-841b-d79e27ce0ba4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:41.774711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dbcc3b6-bcf1-4ce2-841b-d79e27ce0ba4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:41.775148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dbcc3b6-bcf1-4ce2-841b-d79e27ce0ba4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:41.775854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dbcc3b6-bcf1-4ce2-841b-d79e27ce0ba4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:41.776309 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dbcc3b6-bcf1-4ce2-841b-d79e27ce0ba4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:41.776765 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1dbcc3b6-bcf1-4ce2-841b-d79e27ce0ba4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:41.916266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1dbcc3b6-bcf1-4ce2-841b-d79e27ce0ba4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:41.924230 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1dbcc3b6-bcf1-4ce2-841b-d79e27ce0ba4 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.161945 Aug 27 06:04:41.924841 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3937/7920] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:41 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:42.946084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-941dc816-172f-444d-968d-c21760f652b9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:42.946709 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-941dc816-172f-444d-968d-c21760f652b9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:42.953881 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-941dc816-172f-444d-968d-c21760f652b9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:42.954380 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-941dc816-172f-444d-968d-c21760f652b9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:42.954823 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-941dc816-172f-444d-968d-c21760f652b9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:42.955527 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-941dc816-172f-444d-968d-c21760f652b9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:42.956000 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-941dc816-172f-444d-968d-c21760f652b9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:42.956432 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-941dc816-172f-444d-968d-c21760f652b9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:43.099008 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-941dc816-172f-444d-968d-c21760f652b9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:43.106908 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-941dc816-172f-444d-968d-c21760f652b9 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.164795 Aug 27 06:04:43.107499 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3984/7921] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:42 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:44.128726 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5b899159-46e1-4f20-90ea-90f642774f94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:44.129329 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5b899159-46e1-4f20-90ea-90f642774f94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:44.138172 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b899159-46e1-4f20-90ea-90f642774f94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:44.138787 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b899159-46e1-4f20-90ea-90f642774f94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:44.139560 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b899159-46e1-4f20-90ea-90f642774f94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:44.140688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b899159-46e1-4f20-90ea-90f642774f94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:44.141161 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b899159-46e1-4f20-90ea-90f642774f94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:44.141596 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5b899159-46e1-4f20-90ea-90f642774f94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:44.284205 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5b899159-46e1-4f20-90ea-90f642774f94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:44.292974 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5b899159-46e1-4f20-90ea-90f642774f94 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.168408 Aug 27 06:04:44.293564 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3938/7922] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:44 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:45.314925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4aab6dfd-c389-434d-9dd6-d9e0c93d085c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:45.315548 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4aab6dfd-c389-434d-9dd6-d9e0c93d085c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:45.323397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aab6dfd-c389-434d-9dd6-d9e0c93d085c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:45.324186 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aab6dfd-c389-434d-9dd6-d9e0c93d085c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:45.325441 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aab6dfd-c389-434d-9dd6-d9e0c93d085c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:45.326310 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aab6dfd-c389-434d-9dd6-d9e0c93d085c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:45.326857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aab6dfd-c389-434d-9dd6-d9e0c93d085c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:45.327255 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aab6dfd-c389-434d-9dd6-d9e0c93d085c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:45.491540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4aab6dfd-c389-434d-9dd6-d9e0c93d085c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:45.500520 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4aab6dfd-c389-434d-9dd6-d9e0c93d085c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.189085 Aug 27 06:04:45.501208 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3985/7923] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:45 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:46.522284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1c7075fe-f861-4fe1-8536-860e1468b931 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:46.522943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1c7075fe-f861-4fe1-8536-860e1468b931 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:46.529772 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c7075fe-f861-4fe1-8536-860e1468b931 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:46.530265 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c7075fe-f861-4fe1-8536-860e1468b931 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:46.530708 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c7075fe-f861-4fe1-8536-860e1468b931 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:46.531413 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c7075fe-f861-4fe1-8536-860e1468b931 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:46.531871 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c7075fe-f861-4fe1-8536-860e1468b931 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:46.532302 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1c7075fe-f861-4fe1-8536-860e1468b931 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:46.545998 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f4eca3a1-e1ad-45d0-ae5e-ddb01ee7ad13 req-78455f2f-df32-49a0-b6fe-f1b4f7a8cbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c84f7ea6-191a-41ce-9cbc-d1238e387425", "name": "network-vif-unplugged", "status": "completed", "tag": "0636d81c-318f-4dad-808e-b858d0486fb1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:04:46.558117 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f4eca3a1-e1ad-45d0-ae5e-ddb01ee7ad13 req-78455f2f-df32-49a0-b6fe-f1b4f7a8cbe9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:46.558637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f4eca3a1-e1ad-45d0-ae5e-ddb01ee7ad13 req-78455f2f-df32-49a0-b6fe-f1b4f7a8cbe9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:46.559161 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f4eca3a1-e1ad-45d0-ae5e-ddb01ee7ad13 req-78455f2f-df32-49a0-b6fe-f1b4f7a8cbe9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:46.572844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.compute.server_external_events [req-f4eca3a1-e1ad-45d0-ae5e-ddb01ee7ad13 req-78455f2f-df32-49a0-b6fe-f1b4f7a8cbe9 service nova] Unable to find a host for instance c84f7ea6-191a-41ce-9cbc-d1238e387425. Dropping event network-vif-unplugged {{(pid=128869) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 06:04:46.573863 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f4eca3a1-e1ad-45d0-ae5e-ddb01ee7ad13 req-78455f2f-df32-49a0-b6fe-f1b4f7a8cbe9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031915 Aug 27 06:04:46.574920 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3986/7924] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 27 06:04:46.676956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1c7075fe-f861-4fe1-8536-860e1468b931 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:46.685086 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1c7075fe-f861-4fe1-8536-860e1468b931 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1508 microversion: 2.1 time: 0.167209 Aug 27 06:04:46.685674 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3939/7925] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:46 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:46.706963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-259a3a10-8db7-4f14-aa8a-4f5e3b78531e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:04:46.707575 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-259a3a10-8db7-4f14-aa8a-4f5e3b78531e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:46.713666 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259a3a10-8db7-4f14-aa8a-4f5e3b78531e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:46.714160 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259a3a10-8db7-4f14-aa8a-4f5e3b78531e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:46.714607 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259a3a10-8db7-4f14-aa8a-4f5e3b78531e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:46.715302 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259a3a10-8db7-4f14-aa8a-4f5e3b78531e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:46.715769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259a3a10-8db7-4f14-aa8a-4f5e3b78531e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:46.716206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259a3a10-8db7-4f14-aa8a-4f5e3b78531e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:46.745848 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-259a3a10-8db7-4f14-aa8a-4f5e3b78531e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128869) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 06:04:46.814574 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-259a3a10-8db7-4f14-aa8a-4f5e3b78531e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "POST /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425/action" status: 202 len: 0 microversion: 2.1 time: 0.111830 Aug 27 06:04:46.815150 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3987/7926] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 06:04:46 2022] POST /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 06:04:46.828968 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-aa43d6ed-9091-45e1-9da3-6cf392842908 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:46.830500 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-aa43d6ed-9091-45e1-9da3-6cf392842908 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:46.842358 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa43d6ed-9091-45e1-9da3-6cf392842908 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:46.843337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa43d6ed-9091-45e1-9da3-6cf392842908 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:46.844120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa43d6ed-9091-45e1-9da3-6cf392842908 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:46.845097 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa43d6ed-9091-45e1-9da3-6cf392842908 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:46.846376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa43d6ed-9091-45e1-9da3-6cf392842908 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:46.847860 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-aa43d6ed-9091-45e1-9da3-6cf392842908 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:47.025646 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-aa43d6ed-9091-45e1-9da3-6cf392842908 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:47.033729 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-aa43d6ed-9091-45e1-9da3-6cf392842908 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1516 microversion: 2.1 time: 0.213324 Aug 27 06:04:47.034315 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3940/7927] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:46 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1516 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:48.055500 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a17dc254-5b04-417b-b187-006bc39e567c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:48.056141 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a17dc254-5b04-417b-b187-006bc39e567c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:48.064290 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a17dc254-5b04-417b-b187-006bc39e567c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:48.065085 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a17dc254-5b04-417b-b187-006bc39e567c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:48.065943 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a17dc254-5b04-417b-b187-006bc39e567c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:48.067033 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a17dc254-5b04-417b-b187-006bc39e567c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:48.067772 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a17dc254-5b04-417b-b187-006bc39e567c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:48.068479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a17dc254-5b04-417b-b187-006bc39e567c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:48.212325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a17dc254-5b04-417b-b187-006bc39e567c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:48.220895 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a17dc254-5b04-417b-b187-006bc39e567c tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1516 microversion: 2.1 time: 0.170370 Aug 27 06:04:48.221488 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3988/7928] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:48 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:49.243308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-a9d467f4-e814-46b7-a5dc-9609001cf796 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:49.243898 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-a9d467f4-e814-46b7-a5dc-9609001cf796 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:49.250933 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9d467f4-e814-46b7-a5dc-9609001cf796 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:49.251415 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9d467f4-e814-46b7-a5dc-9609001cf796 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:49.251849 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9d467f4-e814-46b7-a5dc-9609001cf796 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:49.252568 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9d467f4-e814-46b7-a5dc-9609001cf796 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:49.253024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9d467f4-e814-46b7-a5dc-9609001cf796 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:49.253493 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-a9d467f4-e814-46b7-a5dc-9609001cf796 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:49.392668 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-a9d467f4-e814-46b7-a5dc-9609001cf796 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:49.401374 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-a9d467f4-e814-46b7-a5dc-9609001cf796 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1516 microversion: 2.1 time: 0.161857 Aug 27 06:04:49.402194 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3941/7929] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:49 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:50.423655 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c563f035-e52c-47ed-ad2e-4fb5d22e3f50 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:50.424517 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c563f035-e52c-47ed-ad2e-4fb5d22e3f50 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:50.432269 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c563f035-e52c-47ed-ad2e-4fb5d22e3f50 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:50.432815 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c563f035-e52c-47ed-ad2e-4fb5d22e3f50 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:50.433270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c563f035-e52c-47ed-ad2e-4fb5d22e3f50 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:50.433983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c563f035-e52c-47ed-ad2e-4fb5d22e3f50 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:50.434457 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c563f035-e52c-47ed-ad2e-4fb5d22e3f50 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:50.434899 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c563f035-e52c-47ed-ad2e-4fb5d22e3f50 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:50.586689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c563f035-e52c-47ed-ad2e-4fb5d22e3f50 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:50.594519 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c563f035-e52c-47ed-ad2e-4fb5d22e3f50 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1516 microversion: 2.1 time: 0.175112 Aug 27 06:04:50.595108 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3989/7930] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:50 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:51.617794 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-353dd930-fa6c-4b8f-bac2-80a9a1c6f4ee tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:51.618428 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-353dd930-fa6c-4b8f-bac2-80a9a1c6f4ee tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:51.625745 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-353dd930-fa6c-4b8f-bac2-80a9a1c6f4ee tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:51.626249 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-353dd930-fa6c-4b8f-bac2-80a9a1c6f4ee tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:51.626697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-353dd930-fa6c-4b8f-bac2-80a9a1c6f4ee tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:51.627406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-353dd930-fa6c-4b8f-bac2-80a9a1c6f4ee tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:51.627872 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-353dd930-fa6c-4b8f-bac2-80a9a1c6f4ee tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:51.628366 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-353dd930-fa6c-4b8f-bac2-80a9a1c6f4ee tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:51.780117 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-353dd930-fa6c-4b8f-bac2-80a9a1c6f4ee tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:51.789201 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-353dd930-fa6c-4b8f-bac2-80a9a1c6f4ee tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1518 microversion: 2.1 time: 0.175443 Aug 27 06:04:51.790352 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3942/7931] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:51 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:52.810405 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9b3df99c-3937-4c33-81b3-6d7199667f40 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:52.811061 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9b3df99c-3937-4c33-81b3-6d7199667f40 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:52.818834 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b3df99c-3937-4c33-81b3-6d7199667f40 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:52.819336 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b3df99c-3937-4c33-81b3-6d7199667f40 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:52.819787 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b3df99c-3937-4c33-81b3-6d7199667f40 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:52.820499 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b3df99c-3937-4c33-81b3-6d7199667f40 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:52.820985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b3df99c-3937-4c33-81b3-6d7199667f40 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:52.821422 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b3df99c-3937-4c33-81b3-6d7199667f40 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:52.960153 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b3df99c-3937-4c33-81b3-6d7199667f40 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:52.968812 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9b3df99c-3937-4c33-81b3-6d7199667f40 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1518 microversion: 2.1 time: 0.162358 Aug 27 06:04:52.969397 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3990/7932] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:52 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:53.992631 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c43227d1-2d7e-4f0f-96f0-783de891be78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:53.993254 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c43227d1-2d7e-4f0f-96f0-783de891be78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:54.000175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c43227d1-2d7e-4f0f-96f0-783de891be78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:54.000773 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c43227d1-2d7e-4f0f-96f0-783de891be78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:54.001215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c43227d1-2d7e-4f0f-96f0-783de891be78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:54.001913 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c43227d1-2d7e-4f0f-96f0-783de891be78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:54.002372 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c43227d1-2d7e-4f0f-96f0-783de891be78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:54.002799 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c43227d1-2d7e-4f0f-96f0-783de891be78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:54.138648 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c43227d1-2d7e-4f0f-96f0-783de891be78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:54.147072 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c43227d1-2d7e-4f0f-96f0-783de891be78 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1518 microversion: 2.1 time: 0.158518 Aug 27 06:04:54.147689 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3943/7933] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:53 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:55.169206 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-272fdcb8-41b2-491a-b5c1-7a7e746c7e6a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:55.169976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-272fdcb8-41b2-491a-b5c1-7a7e746c7e6a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:55.177663 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-272fdcb8-41b2-491a-b5c1-7a7e746c7e6a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:55.178507 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-272fdcb8-41b2-491a-b5c1-7a7e746c7e6a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:55.179023 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-272fdcb8-41b2-491a-b5c1-7a7e746c7e6a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:55.179803 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-272fdcb8-41b2-491a-b5c1-7a7e746c7e6a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:55.180346 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-272fdcb8-41b2-491a-b5c1-7a7e746c7e6a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:55.180876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-272fdcb8-41b2-491a-b5c1-7a7e746c7e6a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:55.314581 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-272fdcb8-41b2-491a-b5c1-7a7e746c7e6a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:55.322644 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-272fdcb8-41b2-491a-b5c1-7a7e746c7e6a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1518 microversion: 2.1 time: 0.157335 Aug 27 06:04:55.323243 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3991/7934] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:55 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:56.343427 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-894ad915-14a7-4246-8284-a110cb68a968 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:56.344047 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-894ad915-14a7-4246-8284-a110cb68a968 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:56.353831 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-894ad915-14a7-4246-8284-a110cb68a968 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:56.354387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-894ad915-14a7-4246-8284-a110cb68a968 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:56.354828 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-894ad915-14a7-4246-8284-a110cb68a968 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:56.355526 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-894ad915-14a7-4246-8284-a110cb68a968 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:56.355979 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-894ad915-14a7-4246-8284-a110cb68a968 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:56.356404 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-894ad915-14a7-4246-8284-a110cb68a968 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:56.497171 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-894ad915-14a7-4246-8284-a110cb68a968 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:56.506710 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-894ad915-14a7-4246-8284-a110cb68a968 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1518 microversion: 2.1 time: 0.166855 Aug 27 06:04:56.507494 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3944/7935] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:56 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:57.527266 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a28d44b-da4b-4ed7-a8e1-e7a8d06d7d20 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:57.527908 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a28d44b-da4b-4ed7-a8e1-e7a8d06d7d20 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:57.534789 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a28d44b-da4b-4ed7-a8e1-e7a8d06d7d20 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:57.535298 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a28d44b-da4b-4ed7-a8e1-e7a8d06d7d20 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:57.535756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a28d44b-da4b-4ed7-a8e1-e7a8d06d7d20 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:57.536476 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a28d44b-da4b-4ed7-a8e1-e7a8d06d7d20 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:57.537065 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a28d44b-da4b-4ed7-a8e1-e7a8d06d7d20 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:57.537518 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a28d44b-da4b-4ed7-a8e1-e7a8d06d7d20 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:57.670697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-3fa66fa0-6c60-4777-8d58-df93b6ab9d35 req-5867ce5d-ef50-4245-84f7-650c7833f473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c84f7ea6-191a-41ce-9cbc-d1238e387425", "tag": "0636d81c-318f-4dad-808e-b858d0486fb1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:04:57.685921 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3fa66fa0-6c60-4777-8d58-df93b6ab9d35 req-5867ce5d-ef50-4245-84f7-650c7833f473 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:57.686535 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3fa66fa0-6c60-4777-8d58-df93b6ab9d35 req-5867ce5d-ef50-4245-84f7-650c7833f473 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:57.687175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3fa66fa0-6c60-4777-8d58-df93b6ab9d35 req-5867ce5d-ef50-4245-84f7-650c7833f473 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:57.688236 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a28d44b-da4b-4ed7-a8e1-e7a8d06d7d20 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:57.698959 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a28d44b-da4b-4ed7-a8e1-e7a8d06d7d20 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1574 microversion: 2.1 time: 0.175261 Aug 27 06:04:57.699953 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3992/7936] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:57 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:57.700784 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-3fa66fa0-6c60-4777-8d58-df93b6ab9d35 req-5867ce5d-ef50-4245-84f7-650c7833f473 service nova] Creating event network-changed:0636d81c-318f-4dad-808e-b858d0486fb1 for instance c84f7ea6-191a-41ce-9cbc-d1238e387425 on n-h1-854823-1 Aug 27 06:04:57.714899 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-3fa66fa0-6c60-4777-8d58-df93b6ab9d35 req-5867ce5d-ef50-4245-84f7-650c7833f473 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048917 Aug 27 06:04:57.715543 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3945/7937] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:04:58.722752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfe20a4b-596b-40a5-9688-3851734aff96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:58.723631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dfe20a4b-596b-40a5-9688-3851734aff96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:58.729400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfe20a4b-596b-40a5-9688-3851734aff96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:58.729902 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfe20a4b-596b-40a5-9688-3851734aff96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:58.730359 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfe20a4b-596b-40a5-9688-3851734aff96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:58.731071 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfe20a4b-596b-40a5-9688-3851734aff96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:58.731559 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfe20a4b-596b-40a5-9688-3851734aff96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:58.731992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfe20a4b-596b-40a5-9688-3851734aff96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:58.862045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dfe20a4b-596b-40a5-9688-3851734aff96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:04:58.869918 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dfe20a4b-596b-40a5-9688-3851734aff96 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1574 microversion: 2.1 time: 0.152814 Aug 27 06:04:58.870497 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3993/7938] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:58 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:04:59.892822 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-00cb9e69-8b21-4c05-9a7d-adaca1569c52 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:04:59.893438 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-00cb9e69-8b21-4c05-9a7d-adaca1569c52 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:04:59.900034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00cb9e69-8b21-4c05-9a7d-adaca1569c52 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:59.900516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00cb9e69-8b21-4c05-9a7d-adaca1569c52 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:59.900980 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00cb9e69-8b21-4c05-9a7d-adaca1569c52 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:04:59.901672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00cb9e69-8b21-4c05-9a7d-adaca1569c52 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:04:59.902124 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00cb9e69-8b21-4c05-9a7d-adaca1569c52 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:04:59.902758 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-00cb9e69-8b21-4c05-9a7d-adaca1569c52 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:00.135706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-00cb9e69-8b21-4c05-9a7d-adaca1569c52 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:05:00.144388 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-00cb9e69-8b21-4c05-9a7d-adaca1569c52 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1574 microversion: 2.1 time: 0.256224 Aug 27 06:05:00.144952 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3946/7939] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:04:59 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1574 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:05:01.166384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-affc0def-b484-4837-9c50-28c78a283ac3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:05:01.166992 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-affc0def-b484-4837-9c50-28c78a283ac3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:05:01.173877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-affc0def-b484-4837-9c50-28c78a283ac3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:01.174396 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-affc0def-b484-4837-9c50-28c78a283ac3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:01.174844 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-affc0def-b484-4837-9c50-28c78a283ac3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:01.176352 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-affc0def-b484-4837-9c50-28c78a283ac3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:01.176851 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-affc0def-b484-4837-9c50-28c78a283ac3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:01.177291 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-affc0def-b484-4837-9c50-28c78a283ac3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:01.181633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:05:01.316988 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-affc0def-b484-4837-9c50-28c78a283ac3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:05:01.324738 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-affc0def-b484-4837-9c50-28c78a283ac3 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1574 microversion: 2.1 time: 0.162307 Aug 27 06:05:01.325319 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3994/7940] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:05:01 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:05:02.346181 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-ed069d55-91a3-4735-9e15-9c660099e301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:05:02.346802 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-ed069d55-91a3-4735-9e15-9c660099e301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:05:02.350145 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=31 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:05:02.355755 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed069d55-91a3-4735-9e15-9c660099e301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:02.356305 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed069d55-91a3-4735-9e15-9c660099e301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:02.356801 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed069d55-91a3-4735-9e15-9c660099e301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:02.357551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed069d55-91a3-4735-9e15-9c660099e301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:02.358197 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed069d55-91a3-4735-9e15-9c660099e301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:02.358844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-ed069d55-91a3-4735-9e15-9c660099e301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:02.363827 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:05:02.495854 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-ed069d55-91a3-4735-9e15-9c660099e301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:05:02.504371 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-ed069d55-91a3-4735-9e15-9c660099e301 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1574 microversion: 2.1 time: 0.162242 Aug 27 06:05:02.505017 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3947/7941] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:05:02 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:05:03.526950 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1d3334c-22c0-4233-ac34-de24c9a02c1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:05:03.527592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1d3334c-22c0-4233-ac34-de24c9a02c1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:05:03.530473 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:05:03.537633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d3334c-22c0-4233-ac34-de24c9a02c1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:03.538188 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d3334c-22c0-4233-ac34-de24c9a02c1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:03.538756 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d3334c-22c0-4233-ac34-de24c9a02c1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:03.539493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d3334c-22c0-4233-ac34-de24c9a02c1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:03.539977 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d3334c-22c0-4233-ac34-de24c9a02c1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:03.540461 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1d3334c-22c0-4233-ac34-de24c9a02c1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:03.679295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1d3334c-22c0-4233-ac34-de24c9a02c1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:05:03.691014 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1d3334c-22c0-4233-ac34-de24c9a02c1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1574 microversion: 2.1 time: 0.168283 Aug 27 06:05:03.691924 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3995/7942] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:05:03 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:05:04.712587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-68858dd6-b257-49d1-8b9a-377598ccd436 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:05:04.713137 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-68858dd6-b257-49d1-8b9a-377598ccd436 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:05:04.720191 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68858dd6-b257-49d1-8b9a-377598ccd436 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:04.720711 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68858dd6-b257-49d1-8b9a-377598ccd436 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:04.721150 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68858dd6-b257-49d1-8b9a-377598ccd436 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:04.721845 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68858dd6-b257-49d1-8b9a-377598ccd436 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:04.722311 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68858dd6-b257-49d1-8b9a-377598ccd436 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:04.722731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-68858dd6-b257-49d1-8b9a-377598ccd436 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:04.859085 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-68858dd6-b257-49d1-8b9a-377598ccd436 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:05:04.867458 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-68858dd6-b257-49d1-8b9a-377598ccd436 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1574 microversion: 2.1 time: 0.158915 Aug 27 06:05:04.868032 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3948/7943] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:05:04 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:05:05.889312 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9bc846ae-4f5a-42bb-94a7-c2a40eac38cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:05:05.889986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9bc846ae-4f5a-42bb-94a7-c2a40eac38cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:05:05.897733 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bc846ae-4f5a-42bb-94a7-c2a40eac38cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:05.898234 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bc846ae-4f5a-42bb-94a7-c2a40eac38cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:05.898683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bc846ae-4f5a-42bb-94a7-c2a40eac38cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:05.899394 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bc846ae-4f5a-42bb-94a7-c2a40eac38cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:05.899866 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bc846ae-4f5a-42bb-94a7-c2a40eac38cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:05.900308 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bc846ae-4f5a-42bb-94a7-c2a40eac38cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:06.033415 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9bc846ae-4f5a-42bb-94a7-c2a40eac38cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:05:06.041937 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9bc846ae-4f5a-42bb-94a7-c2a40eac38cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1574 microversion: 2.1 time: 0.156618 Aug 27 06:05:06.042531 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3996/7944] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:05:05 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:05:07.063712 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-683f333b-04f1-4367-8169-5aa193ddb5ec tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:05:07.064367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-683f333b-04f1-4367-8169-5aa193ddb5ec tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:05:07.071447 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-683f333b-04f1-4367-8169-5aa193ddb5ec tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:07.071940 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-683f333b-04f1-4367-8169-5aa193ddb5ec tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:07.072387 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-683f333b-04f1-4367-8169-5aa193ddb5ec tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:07.073121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-683f333b-04f1-4367-8169-5aa193ddb5ec tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:07.073589 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-683f333b-04f1-4367-8169-5aa193ddb5ec tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:07.074024 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-683f333b-04f1-4367-8169-5aa193ddb5ec tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:07.212357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-683f333b-04f1-4367-8169-5aa193ddb5ec tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:05:07.222263 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-683f333b-04f1-4367-8169-5aa193ddb5ec tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1574 microversion: 2.1 time: 0.162104 Aug 27 06:05:07.222866 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3949/7945] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:05:07 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:05:08.243479 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8ed1cd6-a4d0-40b0-b86a-db8ea7dadfbd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:05:08.244082 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8ed1cd6-a4d0-40b0-b86a-db8ea7dadfbd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:05:08.250944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8ed1cd6-a4d0-40b0-b86a-db8ea7dadfbd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:08.251440 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8ed1cd6-a4d0-40b0-b86a-db8ea7dadfbd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:08.251884 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8ed1cd6-a4d0-40b0-b86a-db8ea7dadfbd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:08.252610 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8ed1cd6-a4d0-40b0-b86a-db8ea7dadfbd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:08.253080 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8ed1cd6-a4d0-40b0-b86a-db8ea7dadfbd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:08.253515 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8ed1cd6-a4d0-40b0-b86a-db8ea7dadfbd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:08.392349 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d8ed1cd6-a4d0-40b0-b86a-db8ea7dadfbd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:05:08.400819 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8ed1cd6-a4d0-40b0-b86a-db8ea7dadfbd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1574 microversion: 2.1 time: 0.161416 Aug 27 06:05:08.401406 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3997/7946] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:05:08 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:05:09.007167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d6b2f6e9-daa9-44f4-9ec1-0ff6b0f94cee req-059f647d-2b3f-4599-95cd-46ddb7f8b80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c84f7ea6-191a-41ce-9cbc-d1238e387425", "name": "network-vif-plugged", "status": "completed", "tag": "0636d81c-318f-4dad-808e-b858d0486fb1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:05:09.017718 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d6b2f6e9-daa9-44f4-9ec1-0ff6b0f94cee req-059f647d-2b3f-4599-95cd-46ddb7f8b80b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:09.018208 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d6b2f6e9-daa9-44f4-9ec1-0ff6b0f94cee req-059f647d-2b3f-4599-95cd-46ddb7f8b80b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:09.019148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d6b2f6e9-daa9-44f4-9ec1-0ff6b0f94cee req-059f647d-2b3f-4599-95cd-46ddb7f8b80b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:09.031033 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d6b2f6e9-daa9-44f4-9ec1-0ff6b0f94cee req-059f647d-2b3f-4599-95cd-46ddb7f8b80b service nova] Creating event network-vif-plugged:0636d81c-318f-4dad-808e-b858d0486fb1 for instance c84f7ea6-191a-41ce-9cbc-d1238e387425 on n-h1-854823-1 Aug 27 06:05:09.036742 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d6b2f6e9-daa9-44f4-9ec1-0ff6b0f94cee req-059f647d-2b3f-4599-95cd-46ddb7f8b80b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033345 Aug 27 06:05:09.037355 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3950/7947] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:05:09.422940 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ada2524c-a0f2-40ff-b502-3132de28e3e1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:05:09.423562 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ada2524c-a0f2-40ff-b502-3132de28e3e1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:05:09.430706 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ada2524c-a0f2-40ff-b502-3132de28e3e1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:09.431203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ada2524c-a0f2-40ff-b502-3132de28e3e1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:09.431648 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ada2524c-a0f2-40ff-b502-3132de28e3e1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:09.432350 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ada2524c-a0f2-40ff-b502-3132de28e3e1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:09.432857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ada2524c-a0f2-40ff-b502-3132de28e3e1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:09.433292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ada2524c-a0f2-40ff-b502-3132de28e3e1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:09.563852 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ada2524c-a0f2-40ff-b502-3132de28e3e1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:05:09.572239 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ada2524c-a0f2-40ff-b502-3132de28e3e1 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1574 microversion: 2.1 time: 0.153239 Aug 27 06:05:09.572852 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3998/7948] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:05:09 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:05:10.594719 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-fc1b7ed9-46bb-4b11-adfd-da16cb14d65e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:05:10.595342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-fc1b7ed9-46bb-4b11-adfd-da16cb14d65e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:05:10.602461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc1b7ed9-46bb-4b11-adfd-da16cb14d65e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:10.602954 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc1b7ed9-46bb-4b11-adfd-da16cb14d65e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:10.603417 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc1b7ed9-46bb-4b11-adfd-da16cb14d65e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:10.604128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc1b7ed9-46bb-4b11-adfd-da16cb14d65e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:05:10.604608 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc1b7ed9-46bb-4b11-adfd-da16cb14d65e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:05:10.605038 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-fc1b7ed9-46bb-4b11-adfd-da16cb14d65e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:05:10.742532 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-fc1b7ed9-46bb-4b11-adfd-da16cb14d65e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:05:10.750782 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-fc1b7ed9-46bb-4b11-adfd-da16cb14d65e tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1561 microversion: 2.1 time: 0.161299 Aug 27 06:05:10.751369 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3951/7949] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:05:10 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:25.119788 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=7 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:25.120973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=29 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:25.121861 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:06:25.122036 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 06:06:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 (ip 10.222.0.79) !!! Aug 27 06:06:25.127613 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-939bc0c6-e7ac-4b27-8436-43fe8406776f req-f39eff7c-e065-4554-85fe-2f1d88dbbc8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c84f7ea6-191a-41ce-9cbc-d1238e387425", "tag": "0636d81c-318f-4dad-808e-b858d0486fb1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:06:25.130219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-807fb260-1494-4fe2-9ecb-e360a73ce8f0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:25.130797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-807fb260-1494-4fe2-9ecb-e360a73ce8f0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:25.133128 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=9 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:25.134804 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=25 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:25.136176 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:06:25.136301 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 06:06:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.79) !!! Aug 27 06:06:25.146243 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-807fb260-1494-4fe2-9ecb-e360a73ce8f0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:25.147456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-807fb260-1494-4fe2-9ecb-e360a73ce8f0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:25.148151 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-807fb260-1494-4fe2-9ecb-e360a73ce8f0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:25.148976 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-807fb260-1494-4fe2-9ecb-e360a73ce8f0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:25.149485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-807fb260-1494-4fe2-9ecb-e360a73ce8f0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:25.149933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-807fb260-1494-4fe2-9ecb-e360a73ce8f0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:25.151904 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-939bc0c6-e7ac-4b27-8436-43fe8406776f req-f39eff7c-e065-4554-85fe-2f1d88dbbc8d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:25.152569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-939bc0c6-e7ac-4b27-8436-43fe8406776f req-f39eff7c-e065-4554-85fe-2f1d88dbbc8d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:25.153020 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-939bc0c6-e7ac-4b27-8436-43fe8406776f req-f39eff7c-e065-4554-85fe-2f1d88dbbc8d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:25.166221 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-939bc0c6-e7ac-4b27-8436-43fe8406776f req-f39eff7c-e065-4554-85fe-2f1d88dbbc8d service nova] Creating event network-changed:0636d81c-318f-4dad-808e-b858d0486fb1 for instance c84f7ea6-191a-41ce-9cbc-d1238e387425 on n-h1-854823-1 Aug 27 06:06:25.172214 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-939bc0c6-e7ac-4b27-8436-43fe8406776f req-f39eff7c-e065-4554-85fe-2f1d88dbbc8d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052549 Aug 27 06:06:25.173729 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3952/7950] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:06:25.181973 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-807fb260-1494-4fe2-9ecb-e360a73ce8f0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:06:25.268077 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-807fb260-1494-4fe2-9ecb-e360a73ce8f0 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 204 len: 0 microversion: 2.1 time: 0.150273 Aug 27 06:06:25.269325 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3999/7951] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 06:06:25 2022] DELETE /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:06:25.280627 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1390e1ee-3bbd-4794-aade-cf61ca9ca1a2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:25.281331 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1390e1ee-3bbd-4794-aade-cf61ca9ca1a2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:25.287682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1390e1ee-3bbd-4794-aade-cf61ca9ca1a2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:25.288177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1390e1ee-3bbd-4794-aade-cf61ca9ca1a2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:25.288633 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1390e1ee-3bbd-4794-aade-cf61ca9ca1a2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:25.289675 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1390e1ee-3bbd-4794-aade-cf61ca9ca1a2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:25.290138 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1390e1ee-3bbd-4794-aade-cf61ca9ca1a2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:25.290562 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1390e1ee-3bbd-4794-aade-cf61ca9ca1a2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:25.462411 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1390e1ee-3bbd-4794-aade-cf61ca9ca1a2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:25.470863 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1390e1ee-3bbd-4794-aade-cf61ca9ca1a2 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.196401 Aug 27 06:06:25.471717 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3953/7952] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:25 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:26.497417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea1ffa1f-4279-410f-8d43-657108ce7d3f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:26.498166 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea1ffa1f-4279-410f-8d43-657108ce7d3f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:26.513656 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea1ffa1f-4279-410f-8d43-657108ce7d3f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:26.514330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea1ffa1f-4279-410f-8d43-657108ce7d3f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:26.515036 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea1ffa1f-4279-410f-8d43-657108ce7d3f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:26.515840 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea1ffa1f-4279-410f-8d43-657108ce7d3f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:26.516319 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea1ffa1f-4279-410f-8d43-657108ce7d3f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:26.516797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea1ffa1f-4279-410f-8d43-657108ce7d3f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:26.666152 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ea1ffa1f-4279-410f-8d43-657108ce7d3f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:26.677321 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea1ffa1f-4279-410f-8d43-657108ce7d3f tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1567 microversion: 2.1 time: 0.185528 Aug 27 06:06:26.677929 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4000/7953] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:26 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:27.383308 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-72fee331-acdb-4a22-bf07-7ed2c7fe71b2 req-98c7368c-51e5-4b22-95a3-d74449af8d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c84f7ea6-191a-41ce-9cbc-d1238e387425", "name": "network-vif-deleted", "tag": "0636d81c-318f-4dad-808e-b858d0486fb1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:06:27.395112 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-72fee331-acdb-4a22-bf07-7ed2c7fe71b2 req-98c7368c-51e5-4b22-95a3-d74449af8d91 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:27.395697 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-72fee331-acdb-4a22-bf07-7ed2c7fe71b2 req-98c7368c-51e5-4b22-95a3-d74449af8d91 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:27.396021 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-72fee331-acdb-4a22-bf07-7ed2c7fe71b2 req-98c7368c-51e5-4b22-95a3-d74449af8d91 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:27.408545 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-72fee331-acdb-4a22-bf07-7ed2c7fe71b2 req-98c7368c-51e5-4b22-95a3-d74449af8d91 service nova] Creating event network-vif-deleted:0636d81c-318f-4dad-808e-b858d0486fb1 for instance c84f7ea6-191a-41ce-9cbc-d1238e387425 on n-h1-854823-1 Aug 27 06:06:27.413735 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-72fee331-acdb-4a22-bf07-7ed2c7fe71b2 req-98c7368c-51e5-4b22-95a3-d74449af8d91 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034661 Aug 27 06:06:27.417126 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3954/7954] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:06:27.699773 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e815dab-018c-47ad-b1b9-44fac463ce1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:27.700983 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e815dab-018c-47ad-b1b9-44fac463ce1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:27.708746 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e815dab-018c-47ad-b1b9-44fac463ce1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:27.709561 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e815dab-018c-47ad-b1b9-44fac463ce1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:27.710110 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e815dab-018c-47ad-b1b9-44fac463ce1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:27.710931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e815dab-018c-47ad-b1b9-44fac463ce1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:27.712230 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e815dab-018c-47ad-b1b9-44fac463ce1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:27.712808 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e815dab-018c-47ad-b1b9-44fac463ce1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:27.780383 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0e815dab-018c-47ad-b1b9-44fac463ce1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:27.789231 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e815dab-018c-47ad-b1b9-44fac463ce1a tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1219 microversion: 2.1 time: 0.093769 Aug 27 06:06:27.790228 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4001/7955] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:27 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:28.812658 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d8ff6565-b017-4ce9-95d7-6a2f0e2e31cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:28.813376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d8ff6565-b017-4ce9-95d7-6a2f0e2e31cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:28.819984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8ff6565-b017-4ce9-95d7-6a2f0e2e31cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:28.820475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8ff6565-b017-4ce9-95d7-6a2f0e2e31cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:28.820949 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8ff6565-b017-4ce9-95d7-6a2f0e2e31cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:28.821649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8ff6565-b017-4ce9-95d7-6a2f0e2e31cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:28.822121 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8ff6565-b017-4ce9-95d7-6a2f0e2e31cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:28.822534 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d8ff6565-b017-4ce9-95d7-6a2f0e2e31cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:28.892337 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d8ff6565-b017-4ce9-95d7-6a2f0e2e31cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:28.900650 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d8ff6565-b017-4ce9-95d7-6a2f0e2e31cd tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1219 microversion: 2.1 time: 0.093669 Aug 27 06:06:28.901231 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3955/7956] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:28 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:29.924097 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7567d803-ebf9-4426-a779-4b95cc5b0338 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:29.925583 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7567d803-ebf9-4426-a779-4b95cc5b0338 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:29.932801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7567d803-ebf9-4426-a779-4b95cc5b0338 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:29.933630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7567d803-ebf9-4426-a779-4b95cc5b0338 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:29.934454 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7567d803-ebf9-4426-a779-4b95cc5b0338 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:29.935595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7567d803-ebf9-4426-a779-4b95cc5b0338 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:29.936864 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7567d803-ebf9-4426-a779-4b95cc5b0338 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:29.938123 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7567d803-ebf9-4426-a779-4b95cc5b0338 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:30.012801 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7567d803-ebf9-4426-a779-4b95cc5b0338 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:30.023211 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7567d803-ebf9-4426-a779-4b95cc5b0338 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1219 microversion: 2.1 time: 0.104387 Aug 27 06:06:30.024076 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4002/7957] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:29 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:31.043544 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1fdcf9e5-822b-4a1c-b975-69210dc40352 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:31.044187 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1fdcf9e5-822b-4a1c-b975-69210dc40352 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:31.051136 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fdcf9e5-822b-4a1c-b975-69210dc40352 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:31.051619 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fdcf9e5-822b-4a1c-b975-69210dc40352 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:31.052058 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fdcf9e5-822b-4a1c-b975-69210dc40352 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:31.052788 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fdcf9e5-822b-4a1c-b975-69210dc40352 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:31.053246 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fdcf9e5-822b-4a1c-b975-69210dc40352 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:31.053663 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1fdcf9e5-822b-4a1c-b975-69210dc40352 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:31.117461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1fdcf9e5-822b-4a1c-b975-69210dc40352 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7852e0941a584aaab239be7e2620866a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc082e6aa8b4dc8a1f8557d3d6ae1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:31.126509 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1fdcf9e5-822b-4a1c-b975-69210dc40352 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 200 len: 1219 microversion: 2.1 time: 0.086969 Aug 27 06:06:31.127310 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3956/7958] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:31 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:32.147498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4773b19f-2105-4ece-b048-dc28a2661669 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:32.148250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4773b19f-2105-4ece-b048-dc28a2661669 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] [instance: c84f7ea6-191a-41ce-9cbc-d1238e387425] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:32.156295 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4773b19f-2105-4ece-b048-dc28a2661669 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:32.156934 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4773b19f-2105-4ece-b048-dc28a2661669 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:32.157463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4773b19f-2105-4ece-b048-dc28a2661669 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:32.158259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4773b19f-2105-4ece-b048-dc28a2661669 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:32.158813 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4773b19f-2105-4ece-b048-dc28a2661669 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:32.159325 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4773b19f-2105-4ece-b048-dc28a2661669 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:32.175709 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4773b19f-2105-4ece-b048-dc28a2661669 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] HTTP exception thrown: Instance c84f7ea6-191a-41ce-9cbc-d1238e387425 could not be found. Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4773b19f-2105-4ece-b048-dc28a2661669 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Request method failure captured: Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 HTTP/1.1 Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCbIrVXXZ4O3KyqrgRVxjgWlRQiscHsKVSVUx_I8GEEx28_TpGO6sjmE2bv8puRFusvtZPjORKNdv_oqj9jDwo7f9JL3LjXFwNaJy-Pf8UMLNjiibKaFTh1Nef0HawczEiePOJcPYEmQpiCfYMAr--8owXp2v4aCf7sgHY-Nl73FdB3Y Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 9bc082e6aa8b4dc8a1f8557d3d6ae1ee Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestShelveInstance-762024085 Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9bc082e6aa8b4dc8a1f8557d3d6ae1ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9bc082e6aa8b4dc8a1f8557d3d6ae1ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9bc082e6aa8b4dc8a1f8557d3d6ae1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9bc082e6aa8b4dc8a1f8557d3d6ae1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestShelveInstance-762024085 Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 9bc082e6aa8b4dc8a1f8557d3d6ae1ee Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestShelveInstance-762024085 Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestShelveInstance-762024085-project Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 7852e0941a584aaab239be7e2620866a Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestShelveInstance-762024085-project Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance c84f7ea6-191a-41ce-9cbc-d1238e387425 could not be found. Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': 'c84f7ea6-191a-41ce-9cbc-d1238e387425'} Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c84f7ea6-191a-41ce-9cbc-d1238e387425 could not be found. Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c84f7ea6-191a-41ce-9cbc-d1238e387425 could not be found. Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:06:32.177493 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 06:06:32.182723 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:06:32.182723 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:06:32.182723 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:06:32.182723 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:06:32.182723 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:06:32.182723 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c84f7ea6-191a-41ce-9cbc-d1238e387425 could not be found. Aug 27 06:06:32.182723 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 06:06:32.182723 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4773b19f-2105-4ece-b048-dc28a2661669 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Returning 404 to user: Instance c84f7ea6-191a-41ce-9cbc-d1238e387425 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:06:32.182723 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4773b19f-2105-4ece-b048-dc28a2661669 tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425" status: 404 len: 111 microversion: 2.1 time: 0.035755 Aug 27 06:06:32.182723 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4003/7959] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:32 2022] GET /compute/v2.1/servers/c84f7ea6-191a-41ce-9cbc-d1238e387425 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:06:32.356014 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-e28bdb09-26fd-41eb-948e-d65ffdafb47d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] Calling method '.version_select at 0x7f1f20746670>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:32.403765 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-e28bdb09-26fd-41eb-948e-d65ffdafb47d tempest-TestShelveInstance-762024085 tempest-TestShelveInstance-762024085-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1716946841" status: 202 len: 0 microversion: 2.1 time: 0.051452 Aug 27 06:06:32.404323 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3957/7960] 10.222.0.79 () {58 vars in 1254 bytes} [Sat Aug 27 06:06:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1716946841 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 06:06:50.101769 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:50.102717 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:50.276254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26ec4ebd-4234-4f75-829b-a04505aefb32 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Action: 'create', calling method: .version_select at 0x7f1f203e85e0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1057055597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQsEusc/QH1QxwL/rs/I8RkBi/25MP2mcIJ2rmVyFF2xHnrYnLxKUL9qW60FnLexmO+RT95KeqxMne2SqpMnD/tMOFCA/xbjTDqWsWE3k/Rku/fEJTKvDxdT9z19RWsjQ=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:06:50.293106 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-26ec4ebd-4234-4f75-829b-a04505aefb32 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Getting quotas for project 1c30ca3bd3a14d12b0dacb222fdbd278. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:06:50.298794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-26ec4ebd-4234-4f75-829b-a04505aefb32 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Getting quotas for user 0c71dc794b4f409dafb7d22cbd2d396b and project 1c30ca3bd3a14d12b0dacb222fdbd278. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:06:50.328997 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26ec4ebd-4234-4f75-829b-a04505aefb32 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.232368 Aug 27 06:06:50.329626 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4004/7961] 10.222.0.79 () {60 vars in 1159 bytes} [Sat Aug 27 06:06:50 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:06:51.464948 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-826066059", "imageRef": "71228424-9f42-4121-865e-14501cc9b5c0", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1057055597", "security_groups": [{"name": "tempest-secgroup-smoke-1326933806"}], "networks": [{"uuid": "3b3c2c7e-e302-4961-83d8-bc6ea37d3cee"}]}} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:06:51.481855 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=22 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:51.484275 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:06:51.618003 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.network.neutron [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] validate_networks() for [('3b3c2c7e-e302-4961-83d8-bc6ea37d3cee', None, None, None, None, None)] {{(pid=128870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:06:52.182870 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Flavor limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:06:52.183284 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Image limits 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:06:52.183754 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Flavor pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:06:52.184487 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Image pref 0:0:0 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:06:52.185092 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.virt.hardware [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:06:52.194386 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:52.194869 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:52.195301 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:52.196023 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:52.196557 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:52.197651 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:52.218501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Getting quotas for project 1c30ca3bd3a14d12b0dacb222fdbd278. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:06:52.224118 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.quota [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Getting quotas for user 0c71dc794b4f409dafb7d22cbd2d396b and project 1c30ca3bd3a14d12b0dacb222fdbd278. Resources: {'instances', 'cores', 'ram'} {{(pid=128870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:06:52.238266 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Going to run 1 instances... {{(pid=128870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:06:52.240812 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71228424-9f42-4121-865e-14501cc9b5c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:06:52.289058 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-43df5b1a-a953-40f4-a385-00e30b15d018 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.828843 Aug 27 06:06:52.289915 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3958/7962] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 06:06:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 06:06:52.301683 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62666722-feee-46e7-a8f6-fd50c75c0f66 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:52.302322 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-62666722-feee-46e7-a8f6-fd50c75c0f66 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:52.364522 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-62666722-feee-46e7-a8f6-fd50c75c0f66 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:52.372504 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62666722-feee-46e7-a8f6-fd50c75c0f66 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e" status: 200 len: 1248 microversion: 2.1 time: 0.074838 Aug 27 06:06:52.373121 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4005/7963] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:52 2022] GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e => generated 1248 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:06:53.393725 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-79a8bd9a-a1a2-4e28-92d9-cb1f03f78644 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:53.395184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-79a8bd9a-a1a2-4e28-92d9-cb1f03f78644 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:53.403695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79a8bd9a-a1a2-4e28-92d9-cb1f03f78644 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:53.404556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79a8bd9a-a1a2-4e28-92d9-cb1f03f78644 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:53.405339 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79a8bd9a-a1a2-4e28-92d9-cb1f03f78644 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:53.406362 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79a8bd9a-a1a2-4e28-92d9-cb1f03f78644 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:53.407032 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79a8bd9a-a1a2-4e28-92d9-cb1f03f78644 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:53.407682 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-79a8bd9a-a1a2-4e28-92d9-cb1f03f78644 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:53.493353 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-79a8bd9a-a1a2-4e28-92d9-cb1f03f78644 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:53.503111 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-79a8bd9a-a1a2-4e28-92d9-cb1f03f78644 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e" status: 200 len: 1308 microversion: 2.1 time: 0.114178 Aug 27 06:06:53.516554 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3959/7964] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:53 2022] GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e => generated 1308 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:54.525702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14028acf-4297-4ad2-b73a-0c5f936bb79f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:54.526463 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14028acf-4297-4ad2-b73a-0c5f936bb79f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:54.540780 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14028acf-4297-4ad2-b73a-0c5f936bb79f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:54.541570 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14028acf-4297-4ad2-b73a-0c5f936bb79f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:54.542334 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14028acf-4297-4ad2-b73a-0c5f936bb79f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:54.543437 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14028acf-4297-4ad2-b73a-0c5f936bb79f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:54.544100 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14028acf-4297-4ad2-b73a-0c5f936bb79f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:54.544675 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14028acf-4297-4ad2-b73a-0c5f936bb79f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:55.156993 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14028acf-4297-4ad2-b73a-0c5f936bb79f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:55.165041 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14028acf-4297-4ad2-b73a-0c5f936bb79f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e" status: 200 len: 1374 microversion: 2.1 time: 0.643314 Aug 27 06:06:55.165729 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4006/7965] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:54 2022] GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e => generated 1374 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:55.282587 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-7c698b10-c273-4b14-9f53-1f744c172d4b req-7b96b1c7-1f5d-45d5-8a5e-c1fd3c32abcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7797859d-1d63-4e14-9545-7d6c4262731e", "tag": "e7034dd0-2eb2-4183-814c-d3e865418f41"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:06:55.296601 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7c698b10-c273-4b14-9f53-1f744c172d4b req-7b96b1c7-1f5d-45d5-8a5e-c1fd3c32abcc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:55.297087 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7c698b10-c273-4b14-9f53-1f744c172d4b req-7b96b1c7-1f5d-45d5-8a5e-c1fd3c32abcc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:55.297528 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7c698b10-c273-4b14-9f53-1f744c172d4b req-7b96b1c7-1f5d-45d5-8a5e-c1fd3c32abcc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:55.309254 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-7c698b10-c273-4b14-9f53-1f744c172d4b req-7b96b1c7-1f5d-45d5-8a5e-c1fd3c32abcc service nova] Creating event network-changed:e7034dd0-2eb2-4183-814c-d3e865418f41 for instance 7797859d-1d63-4e14-9545-7d6c4262731e on n-h2-854823-1 Aug 27 06:06:55.314219 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-7c698b10-c273-4b14-9f53-1f744c172d4b req-7b96b1c7-1f5d-45d5-8a5e-c1fd3c32abcc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035968 Aug 27 06:06:55.314837 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3960/7966] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:06:56.187267 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-481e3b63-2735-4496-98a5-31621ec33a2d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:56.187886 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-481e3b63-2735-4496-98a5-31621ec33a2d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:56.194752 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-481e3b63-2735-4496-98a5-31621ec33a2d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:56.195246 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-481e3b63-2735-4496-98a5-31621ec33a2d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:56.195693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-481e3b63-2735-4496-98a5-31621ec33a2d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:56.196397 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-481e3b63-2735-4496-98a5-31621ec33a2d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:56.196893 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-481e3b63-2735-4496-98a5-31621ec33a2d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:56.197330 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-481e3b63-2735-4496-98a5-31621ec33a2d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:56.334263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-481e3b63-2735-4496-98a5-31621ec33a2d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:56.342138 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-481e3b63-2735-4496-98a5-31621ec33a2d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e" status: 200 len: 1374 microversion: 2.1 time: 0.159454 Aug 27 06:06:56.342774 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4007/7967] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:56 2022] GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:57.364775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-226cdd2b-8f7c-43fb-b18a-f07edcd009e3 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:57.365521 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-226cdd2b-8f7c-43fb-b18a-f07edcd009e3 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:57.371733 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-226cdd2b-8f7c-43fb-b18a-f07edcd009e3 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:57.372220 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-226cdd2b-8f7c-43fb-b18a-f07edcd009e3 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:57.372690 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-226cdd2b-8f7c-43fb-b18a-f07edcd009e3 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:57.374044 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-226cdd2b-8f7c-43fb-b18a-f07edcd009e3 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:57.374503 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-226cdd2b-8f7c-43fb-b18a-f07edcd009e3 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:57.374928 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-226cdd2b-8f7c-43fb-b18a-f07edcd009e3 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:57.516811 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-226cdd2b-8f7c-43fb-b18a-f07edcd009e3 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:57.524669 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-226cdd2b-8f7c-43fb-b18a-f07edcd009e3 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e" status: 200 len: 1374 microversion: 2.1 time: 0.165084 Aug 27 06:06:57.525259 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3961/7968] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:57 2022] GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:58.545952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6dbd4380-b1de-41ba-a67b-0489f552d905 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:58.546579 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6dbd4380-b1de-41ba-a67b-0489f552d905 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:58.553586 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dbd4380-b1de-41ba-a67b-0489f552d905 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:58.554089 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dbd4380-b1de-41ba-a67b-0489f552d905 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:58.554797 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dbd4380-b1de-41ba-a67b-0489f552d905 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:58.555510 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dbd4380-b1de-41ba-a67b-0489f552d905 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:58.555986 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dbd4380-b1de-41ba-a67b-0489f552d905 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:58.556427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dbd4380-b1de-41ba-a67b-0489f552d905 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:58.688944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6dbd4380-b1de-41ba-a67b-0489f552d905 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:58.696790 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6dbd4380-b1de-41ba-a67b-0489f552d905 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e" status: 200 len: 1374 microversion: 2.1 time: 0.154907 Aug 27 06:06:58.697382 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4008/7969] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:58 2022] GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:06:59.344580 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-952ac80c-407f-47e4-9818-c39df6f8f5c3 req-3b5033ab-533c-48f6-9fe5-c98328e52288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7797859d-1d63-4e14-9545-7d6c4262731e", "name": "network-vif-plugged", "status": "completed", "tag": "e7034dd0-2eb2-4183-814c-d3e865418f41"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:06:59.355238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-952ac80c-407f-47e4-9818-c39df6f8f5c3 req-3b5033ab-533c-48f6-9fe5-c98328e52288 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:59.355731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-952ac80c-407f-47e4-9818-c39df6f8f5c3 req-3b5033ab-533c-48f6-9fe5-c98328e52288 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:59.356167 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-952ac80c-407f-47e4-9818-c39df6f8f5c3 req-3b5033ab-533c-48f6-9fe5-c98328e52288 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:59.368910 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-952ac80c-407f-47e4-9818-c39df6f8f5c3 req-3b5033ab-533c-48f6-9fe5-c98328e52288 service nova] Creating event network-vif-plugged:e7034dd0-2eb2-4183-814c-d3e865418f41 for instance 7797859d-1d63-4e14-9545-7d6c4262731e on n-h2-854823-1 Aug 27 06:06:59.374274 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-952ac80c-407f-47e4-9818-c39df6f8f5c3 req-3b5033ab-533c-48f6-9fe5-c98328e52288 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034311 Aug 27 06:06:59.375063 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3962/7970] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:06:59.717812 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e92e69dd-89c5-4386-a812-d15fde771866 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:06:59.718436 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e92e69dd-89c5-4386-a812-d15fde771866 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:06:59.725381 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e92e69dd-89c5-4386-a812-d15fde771866 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:59.725885 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e92e69dd-89c5-4386-a812-d15fde771866 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:59.726335 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e92e69dd-89c5-4386-a812-d15fde771866 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:59.727044 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e92e69dd-89c5-4386-a812-d15fde771866 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:06:59.727508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e92e69dd-89c5-4386-a812-d15fde771866 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:06:59.727944 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e92e69dd-89c5-4386-a812-d15fde771866 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:06:59.860447 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e92e69dd-89c5-4386-a812-d15fde771866 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:06:59.868192 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e92e69dd-89c5-4386-a812-d15fde771866 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e" status: 200 len: 1374 microversion: 2.1 time: 0.154383 Aug 27 06:06:59.868797 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4009/7971] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:06:59 2022] GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:07:00.890793 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-b1c599aa-4345-4b55-b633-fe4ad6977808 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:07:00.891421 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-b1c599aa-4345-4b55-b633-fe4ad6977808 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:07:00.898501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1c599aa-4345-4b55-b633-fe4ad6977808 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:00.898989 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1c599aa-4345-4b55-b633-fe4ad6977808 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:00.899432 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1c599aa-4345-4b55-b633-fe4ad6977808 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:00.900122 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1c599aa-4345-4b55-b633-fe4ad6977808 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:00.900611 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1c599aa-4345-4b55-b633-fe4ad6977808 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:00.901039 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-b1c599aa-4345-4b55-b633-fe4ad6977808 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:01.032903 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-b1c599aa-4345-4b55-b633-fe4ad6977808 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:07:01.040666 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-b1c599aa-4345-4b55-b633-fe4ad6977808 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e" status: 200 len: 1558 microversion: 2.1 time: 0.154858 Aug 27 06:07:01.041251 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3963/7972] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:07:00 2022] GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:07:01.060968 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4158f0c9-2065-431b-b46a-093226f0ed19 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:07:01.061592 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4158f0c9-2065-431b-b46a-093226f0ed19 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:07:01.068861 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4158f0c9-2065-431b-b46a-093226f0ed19 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:01.069354 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4158f0c9-2065-431b-b46a-093226f0ed19 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:01.069798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4158f0c9-2065-431b-b46a-093226f0ed19 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:01.070502 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4158f0c9-2065-431b-b46a-093226f0ed19 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:01.070971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4158f0c9-2065-431b-b46a-093226f0ed19 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:01.071404 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4158f0c9-2065-431b-b46a-093226f0ed19 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:01.210556 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4158f0c9-2065-431b-b46a-093226f0ed19 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:07:01.218412 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4158f0c9-2065-431b-b46a-093226f0ed19 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e" status: 200 len: 1558 microversion: 2.1 time: 0.161386 Aug 27 06:07:01.219002 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4010/7973] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:07:01 2022] GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:07:02.870224 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:07:02.871016 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=6 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:07:02.932907 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-e2768b38-61c7-4780-b080-2702a00c06cb req-ef3c8cdd-c38f-4831-9e55-46a6dca63da8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7797859d-1d63-4e14-9545-7d6c4262731e", "tag": "e7034dd0-2eb2-4183-814c-d3e865418f41"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:07:02.943328 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e2768b38-61c7-4780-b080-2702a00c06cb req-ef3c8cdd-c38f-4831-9e55-46a6dca63da8 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:07:02.943805 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e2768b38-61c7-4780-b080-2702a00c06cb req-ef3c8cdd-c38f-4831-9e55-46a6dca63da8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:07:02.944241 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-e2768b38-61c7-4780-b080-2702a00c06cb req-ef3c8cdd-c38f-4831-9e55-46a6dca63da8 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:07:02.956199 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-e2768b38-61c7-4780-b080-2702a00c06cb req-ef3c8cdd-c38f-4831-9e55-46a6dca63da8 service nova] Creating event network-changed:e7034dd0-2eb2-4183-814c-d3e865418f41 for instance 7797859d-1d63-4e14-9545-7d6c4262731e on n-h2-854823-1 Aug 27 06:07:02.961401 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-e2768b38-61c7-4780-b080-2702a00c06cb req-ef3c8cdd-c38f-4831-9e55-46a6dca63da8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096725 Aug 27 06:07:02.962109 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3964/7974] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:09:07.809247 n-d-854823-1 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5167bf5-c65d-49e1-967f-4d4da9273246] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:09:07.810195 n-d-854823-1 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c18b0a9-ed40-4090-a136-c7167e1677a5] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 06:09:07.810590 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:07.811540 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:07.812248 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=30 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:07.813210 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:09:07.813353 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 06:09:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e/action (ip 10.222.0.79) !!! Aug 27 06:09:07.820636 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e641ad7d-0a73-44e0-8fb6-42b9a2dd2a9c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1634128876"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:09:07.823024 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e641ad7d-0a73-44e0-8fb6-42b9a2dd2a9c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:07.831708 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e641ad7d-0a73-44e0-8fb6-42b9a2dd2a9c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:07.832215 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e641ad7d-0a73-44e0-8fb6-42b9a2dd2a9c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:07.832712 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e641ad7d-0a73-44e0-8fb6-42b9a2dd2a9c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:07.833431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e641ad7d-0a73-44e0-8fb6-42b9a2dd2a9c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:07.833905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e641ad7d-0a73-44e0-8fb6-42b9a2dd2a9c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:07.834358 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e641ad7d-0a73-44e0-8fb6-42b9a2dd2a9c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:08.140424 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e641ad7d-0a73-44e0-8fb6-42b9a2dd2a9c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "POST /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e/action" status: 202 len: 0 microversion: 2.1 time: 0.333134 Aug 27 06:09:08.141237 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4011/7975] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 06:09:07 2022] POST /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 06:09:14.135022 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30b4270-6763-4864-8153-10d27fd192b5] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 06:09:14.136300 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2badfd4b-a808-402a-925c-31461d1cb878] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 06:09:14.137175 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:14.138259 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=26 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:14.225774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-3977bddd-f0b3-4a76-9c76-048b63762cd5 req-b2e2bd9b-ed20-4dca-961c-9de2f6d7bd41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7797859d-1d63-4e14-9545-7d6c4262731e", "name": "network-vif-plugged", "status": "completed", "tag": "e7034dd0-2eb2-4183-814c-d3e865418f41"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:09:14.239571 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3977bddd-f0b3-4a76-9c76-048b63762cd5 req-b2e2bd9b-ed20-4dca-961c-9de2f6d7bd41 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:14.240342 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3977bddd-f0b3-4a76-9c76-048b63762cd5 req-b2e2bd9b-ed20-4dca-961c-9de2f6d7bd41 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:14.240972 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-3977bddd-f0b3-4a76-9c76-048b63762cd5 req-b2e2bd9b-ed20-4dca-961c-9de2f6d7bd41 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:14.255753 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-3977bddd-f0b3-4a76-9c76-048b63762cd5 req-b2e2bd9b-ed20-4dca-961c-9de2f6d7bd41 service nova] Creating event network-vif-plugged:e7034dd0-2eb2-4183-814c-d3e865418f41 for instance 7797859d-1d63-4e14-9545-7d6c4262731e on n-h2-854823-1 Aug 27 06:09:14.261875 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-3977bddd-f0b3-4a76-9c76-048b63762cd5 req-b2e2bd9b-ed20-4dca-961c-9de2f6d7bd41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128704 Aug 27 06:09:14.264563 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3965/7976] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:09:21.694176 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:21.694957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:21.699722 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1953543257", "imageRef": "dcd9d535-8d69-417b-93cc-7ab59ceeefe5", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1057055597", "security_groups": [{"name": "tempest-secgroup-smoke-1326933806"}], "networks": [{"uuid": "3b3c2c7e-e302-4961-83d8-bc6ea37d3cee"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:09:21.725070 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5167bf5-c65d-49e1-967f-4d4da9273246] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 46720. Aug 27 06:09:21.726580 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c18b0a9-ed40-4090-a136-c7167e1677a5] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 46722. Aug 27 06:09:21.817972 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] validate_networks() for [('3b3c2c7e-e302-4961-83d8-bc6ea37d3cee', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 06:09:22.256799 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 06:09:22.257239 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 06:09:22.257728 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 06:09:22.258174 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 06:09:22.258595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 06:09:22.267456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:22.267957 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:22.268400 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:22.269163 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:22.269630 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:22.270063 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:22.287907 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Getting quotas for project 1c30ca3bd3a14d12b0dacb222fdbd278. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 06:09:22.293182 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.quota [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Getting quotas for user 0c71dc794b4f409dafb7d22cbd2d396b and project 1c30ca3bd3a14d12b0dacb222fdbd278. Resources: {'instances', 'cores', 'ram'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 06:09:22.305488 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 06:09:22.308270 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dcd9d535-8d69-417b-93cc-7ab59ceeefe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 06:09:22.357414 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc10cc67-4c0d-44a0-abd4-e399cf6b6a41 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.665311 Aug 27 06:09:22.358301 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4012/7977] 10.222.0.79 () {60 vars in 1147 bytes} [Sat Aug 27 06:09:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 06:09:22.369742 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5f8f0933-a12a-4ec8-9c8f-b96c3aafcfd7 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:22.371120 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5f8f0933-a12a-4ec8-9c8f-b96c3aafcfd7 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:22.385317 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30b4270-6763-4864-8153-10d27fd192b5] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 46736. Aug 27 06:09:22.387165 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] [2badfd4b-a808-402a-925c-31461d1cb878] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 46738. Aug 27 06:09:22.484130 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5f8f0933-a12a-4ec8-9c8f-b96c3aafcfd7 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:22.491793 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5f8f0933-a12a-4ec8-9c8f-b96c3aafcfd7 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1249 microversion: 2.1 time: 0.126366 Aug 27 06:09:22.492361 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3966/7978] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:22 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1249 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:23.513612 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-edf722cf-8e9a-40db-b6e7-e08c4cf4d9c0 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:23.514247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-edf722cf-8e9a-40db-b6e7-e08c4cf4d9c0 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:23.568960 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-edf722cf-8e9a-40db-b6e7-e08c4cf4d9c0 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:23.575946 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-edf722cf-8e9a-40db-b6e7-e08c4cf4d9c0 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1249 microversion: 2.1 time: 0.067335 Aug 27 06:09:23.576550 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4013/7979] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:23 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1249 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:24.597071 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-25e95df8-e629-472d-9f17-5a516646e75f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:24.597786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-25e95df8-e629-472d-9f17-5a516646e75f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:24.600609 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:24.658955 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-25e95df8-e629-472d-9f17-5a516646e75f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:24.665872 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-25e95df8-e629-472d-9f17-5a516646e75f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1249 microversion: 2.1 time: 0.072712 Aug 27 06:09:24.666442 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3967/7980] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:24 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1249 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:25.687595 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-677d1b87-c854-4773-901b-360211877f3d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:25.688857 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-677d1b87-c854-4773-901b-360211877f3d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:25.743526 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-677d1b87-c854-4773-901b-360211877f3d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:25.750432 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-677d1b87-c854-4773-901b-360211877f3d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1249 microversion: 2.1 time: 0.066786 Aug 27 06:09:25.751015 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4014/7981] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:25 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1249 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:26.122604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-ca8d4b8c-cac5-4fea-8a23-8ed9eb599db9 req-880cf12d-157d-48ba-89df-a5ab99cdb4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7797859d-1d63-4e14-9545-7d6c4262731e", "name": "network-vif-unplugged", "status": "completed", "tag": "e7034dd0-2eb2-4183-814c-d3e865418f41"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:09:26.135516 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ca8d4b8c-cac5-4fea-8a23-8ed9eb599db9 req-880cf12d-157d-48ba-89df-a5ab99cdb4cf service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:26.136010 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ca8d4b8c-cac5-4fea-8a23-8ed9eb599db9 req-880cf12d-157d-48ba-89df-a5ab99cdb4cf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:26.136441 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-ca8d4b8c-cac5-4fea-8a23-8ed9eb599db9 req-880cf12d-157d-48ba-89df-a5ab99cdb4cf service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:26.146909 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-ca8d4b8c-cac5-4fea-8a23-8ed9eb599db9 req-880cf12d-157d-48ba-89df-a5ab99cdb4cf service nova] Creating event network-vif-unplugged:e7034dd0-2eb2-4183-814c-d3e865418f41 for instance 7797859d-1d63-4e14-9545-7d6c4262731e on n-h2-854823-1 Aug 27 06:09:26.152805 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-ca8d4b8c-cac5-4fea-8a23-8ed9eb599db9 req-880cf12d-157d-48ba-89df-a5ab99cdb4cf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034626 Aug 27 06:09:26.153475 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3968/7982] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:09:26.771933 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-484da846-5fca-4970-9ca8-c516b2fcb104 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:26.772587 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-484da846-5fca-4970-9ca8-c516b2fcb104 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:26.779757 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484da846-5fca-4970-9ca8-c516b2fcb104 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:26.780258 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484da846-5fca-4970-9ca8-c516b2fcb104 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:26.780741 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484da846-5fca-4970-9ca8-c516b2fcb104 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:26.781451 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484da846-5fca-4970-9ca8-c516b2fcb104 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:26.781931 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484da846-5fca-4970-9ca8-c516b2fcb104 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:26.782374 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-484da846-5fca-4970-9ca8-c516b2fcb104 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:26.845599 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-484da846-5fca-4970-9ca8-c516b2fcb104 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:26.855058 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-484da846-5fca-4970-9ca8-c516b2fcb104 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1253 microversion: 2.1 time: 0.087533 Aug 27 06:09:26.855651 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4015/7983] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:26 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1253 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:27.877229 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c4aafbcb-3042-4d51-bb8d-089c8cd67347 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:27.880293 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c4aafbcb-3042-4d51-bb8d-089c8cd67347 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:27.891215 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4aafbcb-3042-4d51-bb8d-089c8cd67347 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:27.892578 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4aafbcb-3042-4d51-bb8d-089c8cd67347 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:27.893600 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4aafbcb-3042-4d51-bb8d-089c8cd67347 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:27.894887 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4aafbcb-3042-4d51-bb8d-089c8cd67347 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:27.895881 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4aafbcb-3042-4d51-bb8d-089c8cd67347 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:27.896868 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c4aafbcb-3042-4d51-bb8d-089c8cd67347 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:28.043817 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-c4aafbcb-3042-4d51-bb8d-089c8cd67347 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:28.052905 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c4aafbcb-3042-4d51-bb8d-089c8cd67347 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1307 microversion: 2.1 time: 0.180856 Aug 27 06:09:28.057644 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3969/7984] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:27 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1307 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:29.079413 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6cec4f4-5d8d-4401-90a5-e579f945988d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:29.084048 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6cec4f4-5d8d-4401-90a5-e579f945988d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:29.092431 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6cec4f4-5d8d-4401-90a5-e579f945988d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:29.093247 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6cec4f4-5d8d-4401-90a5-e579f945988d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:29.093877 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6cec4f4-5d8d-4401-90a5-e579f945988d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:29.094984 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6cec4f4-5d8d-4401-90a5-e579f945988d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:29.095922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6cec4f4-5d8d-4401-90a5-e579f945988d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:29.096602 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6cec4f4-5d8d-4401-90a5-e579f945988d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:29.244189 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a6cec4f4-5d8d-4401-90a5-e579f945988d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:29.253639 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6cec4f4-5d8d-4401-90a5-e579f945988d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.178441 Aug 27 06:09:29.254342 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4016/7985] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:29 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:30.276840 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-d28b7f8e-6bc5-4de6-a28d-ef6054ee6c00 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:30.277569 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-d28b7f8e-6bc5-4de6-a28d-ef6054ee6c00 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:30.284774 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d28b7f8e-6bc5-4de6-a28d-ef6054ee6c00 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:30.285260 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d28b7f8e-6bc5-4de6-a28d-ef6054ee6c00 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:30.285722 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d28b7f8e-6bc5-4de6-a28d-ef6054ee6c00 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:30.286549 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d28b7f8e-6bc5-4de6-a28d-ef6054ee6c00 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:30.287046 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d28b7f8e-6bc5-4de6-a28d-ef6054ee6c00 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:30.287473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-d28b7f8e-6bc5-4de6-a28d-ef6054ee6c00 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:30.440839 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-d28b7f8e-6bc5-4de6-a28d-ef6054ee6c00 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:30.450188 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-d28b7f8e-6bc5-4de6-a28d-ef6054ee6c00 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.178201 Aug 27 06:09:30.451111 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3970/7986] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:30 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:31.471625 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1192d1ba-3dff-4bac-9a0d-6c1a524395a8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:31.472384 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1192d1ba-3dff-4bac-9a0d-6c1a524395a8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:31.480922 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1192d1ba-3dff-4bac-9a0d-6c1a524395a8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:31.481439 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1192d1ba-3dff-4bac-9a0d-6c1a524395a8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:31.481900 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1192d1ba-3dff-4bac-9a0d-6c1a524395a8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:31.482793 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1192d1ba-3dff-4bac-9a0d-6c1a524395a8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:31.483281 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1192d1ba-3dff-4bac-9a0d-6c1a524395a8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:31.483730 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1192d1ba-3dff-4bac-9a0d-6c1a524395a8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:31.635735 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1192d1ba-3dff-4bac-9a0d-6c1a524395a8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:31.643806 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1192d1ba-3dff-4bac-9a0d-6c1a524395a8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.176255 Aug 27 06:09:31.644615 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4017/7987] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:31 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:32.668036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-5e1ce7d2-08e5-4d8b-adec-077b892b644c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:32.668706 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-5e1ce7d2-08e5-4d8b-adec-077b892b644c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:32.676155 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e1ce7d2-08e5-4d8b-adec-077b892b644c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:32.677232 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e1ce7d2-08e5-4d8b-adec-077b892b644c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:32.677672 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e1ce7d2-08e5-4d8b-adec-077b892b644c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:32.678384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e1ce7d2-08e5-4d8b-adec-077b892b644c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:32.678848 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e1ce7d2-08e5-4d8b-adec-077b892b644c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:32.679268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-5e1ce7d2-08e5-4d8b-adec-077b892b644c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:32.844775 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-5e1ce7d2-08e5-4d8b-adec-077b892b644c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:32.853593 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-5e1ce7d2-08e5-4d8b-adec-077b892b644c tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.191095 Aug 27 06:09:32.854451 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3971/7988] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:32 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:33.875670 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2856d3fa-cab8-4658-8143-fb0dfbb1048b tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:33.876365 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2856d3fa-cab8-4658-8143-fb0dfbb1048b tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:33.878219 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:33.885288 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2856d3fa-cab8-4658-8143-fb0dfbb1048b tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:33.885794 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2856d3fa-cab8-4658-8143-fb0dfbb1048b tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:33.886245 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2856d3fa-cab8-4658-8143-fb0dfbb1048b tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:33.886952 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2856d3fa-cab8-4658-8143-fb0dfbb1048b tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:33.887418 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2856d3fa-cab8-4658-8143-fb0dfbb1048b tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:33.887854 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2856d3fa-cab8-4658-8143-fb0dfbb1048b tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:34.033391 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2856d3fa-cab8-4658-8143-fb0dfbb1048b tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:34.042154 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2856d3fa-cab8-4658-8143-fb0dfbb1048b tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.170599 Aug 27 06:09:34.042963 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4018/7989] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:33 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:35.066406 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-dfc098c3-0456-4e5f-9398-d0a8c2e3a8c1 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:35.067022 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-dfc098c3-0456-4e5f-9398-d0a8c2e3a8c1 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:35.070060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell0:SELECT=4 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:35.076993 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dfc098c3-0456-4e5f-9398-d0a8c2e3a8c1 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:35.077786 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dfc098c3-0456-4e5f-9398-d0a8c2e3a8c1 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:35.078298 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dfc098c3-0456-4e5f-9398-d0a8c2e3a8c1 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:35.079125 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dfc098c3-0456-4e5f-9398-d0a8c2e3a8c1 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:35.079699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dfc098c3-0456-4e5f-9398-d0a8c2e3a8c1 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:35.080230 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-dfc098c3-0456-4e5f-9398-d0a8c2e3a8c1 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:35.224795 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-dfc098c3-0456-4e5f-9398-d0a8c2e3a8c1 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:35.232843 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-dfc098c3-0456-4e5f-9398-d0a8c2e3a8c1 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.170930 Aug 27 06:09:35.233443 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3972/7990] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:35 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:36.254546 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5fb2c083-07bd-4981-98dd-fdae8b34b607 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:36.255210 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5fb2c083-07bd-4981-98dd-fdae8b34b607 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:36.257919 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:36.263762 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fb2c083-07bd-4981-98dd-fdae8b34b607 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:36.264273 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fb2c083-07bd-4981-98dd-fdae8b34b607 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:36.264761 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fb2c083-07bd-4981-98dd-fdae8b34b607 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:36.265486 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fb2c083-07bd-4981-98dd-fdae8b34b607 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:36.265966 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fb2c083-07bd-4981-98dd-fdae8b34b607 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:36.266414 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fb2c083-07bd-4981-98dd-fdae8b34b607 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:36.397600 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5fb2c083-07bd-4981-98dd-fdae8b34b607 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:36.405522 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5fb2c083-07bd-4981-98dd-fdae8b34b607 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.155035 Aug 27 06:09:36.406097 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4019/7991] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:36 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:37.427390 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-db37bd97-04ca-44f2-80a9-dfc6b455f337 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:37.427956 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-db37bd97-04ca-44f2-80a9-dfc6b455f337 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:37.435051 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db37bd97-04ca-44f2-80a9-dfc6b455f337 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:37.435540 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db37bd97-04ca-44f2-80a9-dfc6b455f337 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:37.435985 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db37bd97-04ca-44f2-80a9-dfc6b455f337 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:37.436707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db37bd97-04ca-44f2-80a9-dfc6b455f337 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:37.437177 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db37bd97-04ca-44f2-80a9-dfc6b455f337 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:37.437606 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-db37bd97-04ca-44f2-80a9-dfc6b455f337 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:37.574188 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-db37bd97-04ca-44f2-80a9-dfc6b455f337 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:37.582309 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-db37bd97-04ca-44f2-80a9-dfc6b455f337 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.159426 Aug 27 06:09:37.582895 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3973/7992] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:37 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:38.605084 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33f4b7e0-2183-43b2-878c-3540cb2c14dc tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:38.605807 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33f4b7e0-2183-43b2-878c-3540cb2c14dc tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:38.612994 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33f4b7e0-2183-43b2-878c-3540cb2c14dc tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:38.613531 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33f4b7e0-2183-43b2-878c-3540cb2c14dc tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:38.614028 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33f4b7e0-2183-43b2-878c-3540cb2c14dc tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:38.615250 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33f4b7e0-2183-43b2-878c-3540cb2c14dc tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:38.615734 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33f4b7e0-2183-43b2-878c-3540cb2c14dc tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:38.616178 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33f4b7e0-2183-43b2-878c-3540cb2c14dc tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:38.734065 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-81301da3-e829-457b-b50b-8ce21ebd33d4 req-1a4fde8e-8d67-40a9-b89c-650a17a51e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc17209-3c70-4215-a301-7607f753a778", "tag": "af6a1525-4e9d-46c2-9715-29f5bbc60ee1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:09:38.760688 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-81301da3-e829-457b-b50b-8ce21ebd33d4 req-1a4fde8e-8d67-40a9-b89c-650a17a51e50 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:38.761662 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-81301da3-e829-457b-b50b-8ce21ebd33d4 req-1a4fde8e-8d67-40a9-b89c-650a17a51e50 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:38.762093 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-81301da3-e829-457b-b50b-8ce21ebd33d4 req-1a4fde8e-8d67-40a9-b89c-650a17a51e50 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:38.763985 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33f4b7e0-2183-43b2-878c-3540cb2c14dc tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:38.773470 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33f4b7e0-2183-43b2-878c-3540cb2c14dc tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.172490 Aug 27 06:09:38.774390 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4020/7993] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:38 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:38.776692 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-81301da3-e829-457b-b50b-8ce21ebd33d4 req-1a4fde8e-8d67-40a9-b89c-650a17a51e50 service nova] Creating event network-changed:af6a1525-4e9d-46c2-9715-29f5bbc60ee1 for instance ddc17209-3c70-4215-a301-7607f753a778 on n-h1-854823-1 Aug 27 06:09:38.789943 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-81301da3-e829-457b-b50b-8ce21ebd33d4 req-1a4fde8e-8d67-40a9-b89c-650a17a51e50 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061088 Aug 27 06:09:38.790626 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3974/7994] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:09:39.794689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1c014875-967e-449c-8aba-440e084287bd tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:39.795315 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1c014875-967e-449c-8aba-440e084287bd tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:39.802817 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c014875-967e-449c-8aba-440e084287bd tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:39.803314 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c014875-967e-449c-8aba-440e084287bd tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:39.803765 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c014875-967e-449c-8aba-440e084287bd tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:39.804845 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c014875-967e-449c-8aba-440e084287bd tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:39.804967 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c014875-967e-449c-8aba-440e084287bd tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:39.805456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c014875-967e-449c-8aba-440e084287bd tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:39.939958 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c014875-967e-449c-8aba-440e084287bd tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:39.947778 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1c014875-967e-449c-8aba-440e084287bd tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.157032 Aug 27 06:09:39.948363 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4021/7995] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:39 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:40.969829 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-6cada349-401d-4e9f-9e81-fb73f6667637 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:40.970533 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-6cada349-401d-4e9f-9e81-fb73f6667637 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:40.976986 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6cada349-401d-4e9f-9e81-fb73f6667637 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:40.977473 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6cada349-401d-4e9f-9e81-fb73f6667637 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:40.977911 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6cada349-401d-4e9f-9e81-fb73f6667637 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:40.978604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6cada349-401d-4e9f-9e81-fb73f6667637 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:40.979060 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6cada349-401d-4e9f-9e81-fb73f6667637 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:40.979484 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-6cada349-401d-4e9f-9e81-fb73f6667637 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:41.115647 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-6cada349-401d-4e9f-9e81-fb73f6667637 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:41.124162 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-6cada349-401d-4e9f-9e81-fb73f6667637 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.159440 Aug 27 06:09:41.124813 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3975/7996] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:40 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:42.150304 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e72cf8f-7ef9-40fa-b445-21cd66a5cb40 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:42.151049 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e72cf8f-7ef9-40fa-b445-21cd66a5cb40 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:42.158303 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e72cf8f-7ef9-40fa-b445-21cd66a5cb40 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:42.158806 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e72cf8f-7ef9-40fa-b445-21cd66a5cb40 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:42.159259 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e72cf8f-7ef9-40fa-b445-21cd66a5cb40 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:42.159978 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e72cf8f-7ef9-40fa-b445-21cd66a5cb40 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:42.160456 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e72cf8f-7ef9-40fa-b445-21cd66a5cb40 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:42.160925 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e72cf8f-7ef9-40fa-b445-21cd66a5cb40 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:42.296254 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0e72cf8f-7ef9-40fa-b445-21cd66a5cb40 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:42.304235 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e72cf8f-7ef9-40fa-b445-21cd66a5cb40 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.159692 Aug 27 06:09:42.305082 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4022/7997] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:42 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:43.325661 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-520629e8-d378-4d70-8a5c-2a2c57aaea38 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:43.326288 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-520629e8-d378-4d70-8a5c-2a2c57aaea38 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:43.333728 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-520629e8-d378-4d70-8a5c-2a2c57aaea38 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:43.334226 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-520629e8-d378-4d70-8a5c-2a2c57aaea38 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:43.334667 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-520629e8-d378-4d70-8a5c-2a2c57aaea38 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:43.335380 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-520629e8-d378-4d70-8a5c-2a2c57aaea38 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:43.335841 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-520629e8-d378-4d70-8a5c-2a2c57aaea38 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:43.336271 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-520629e8-d378-4d70-8a5c-2a2c57aaea38 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:43.469866 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-520629e8-d378-4d70-8a5c-2a2c57aaea38 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:43.478244 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-520629e8-d378-4d70-8a5c-2a2c57aaea38 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.156521 Aug 27 06:09:43.478823 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3976/7998] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:43 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:44.339843 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3ddfe04d-1a48-484c-af13-bae136ab03f1 req-a73bdfa7-a8eb-432a-9cc7-6018a2cbc155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc17209-3c70-4215-a301-7607f753a778", "name": "network-vif-plugged", "status": "completed", "tag": "af6a1525-4e9d-46c2-9715-29f5bbc60ee1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:09:44.351749 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3ddfe04d-1a48-484c-af13-bae136ab03f1 req-a73bdfa7-a8eb-432a-9cc7-6018a2cbc155 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:44.352263 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3ddfe04d-1a48-484c-af13-bae136ab03f1 req-a73bdfa7-a8eb-432a-9cc7-6018a2cbc155 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:44.352740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3ddfe04d-1a48-484c-af13-bae136ab03f1 req-a73bdfa7-a8eb-432a-9cc7-6018a2cbc155 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:44.368479 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3ddfe04d-1a48-484c-af13-bae136ab03f1 req-a73bdfa7-a8eb-432a-9cc7-6018a2cbc155 service nova] Creating event network-vif-plugged:af6a1525-4e9d-46c2-9715-29f5bbc60ee1 for instance ddc17209-3c70-4215-a301-7607f753a778 on n-h1-854823-1 Aug 27 06:09:44.375158 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3ddfe04d-1a48-484c-af13-bae136ab03f1 req-a73bdfa7-a8eb-432a-9cc7-6018a2cbc155 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039362 Aug 27 06:09:44.375791 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4023/7999] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:09:44.499670 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-1e80d166-b67a-4709-958f-0deb634cb89f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:44.500283 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-1e80d166-b67a-4709-958f-0deb634cb89f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:44.503731 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=29 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:09:44.509461 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e80d166-b67a-4709-958f-0deb634cb89f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:44.509957 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e80d166-b67a-4709-958f-0deb634cb89f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:44.510394 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e80d166-b67a-4709-958f-0deb634cb89f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:44.511101 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e80d166-b67a-4709-958f-0deb634cb89f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:44.511555 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e80d166-b67a-4709-958f-0deb634cb89f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:44.512384 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-1e80d166-b67a-4709-958f-0deb634cb89f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:44.649237 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-1e80d166-b67a-4709-958f-0deb634cb89f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:44.656976 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-1e80d166-b67a-4709-958f-0deb634cb89f tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.161238 Aug 27 06:09:44.657573 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3977/8000] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:44 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:45.680158 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22695eac-5965-412d-be2a-405d498cfd24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:45.680921 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22695eac-5965-412d-be2a-405d498cfd24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:45.687481 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22695eac-5965-412d-be2a-405d498cfd24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:45.687981 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22695eac-5965-412d-be2a-405d498cfd24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:45.688426 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22695eac-5965-412d-be2a-405d498cfd24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:45.689164 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22695eac-5965-412d-be2a-405d498cfd24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:45.689633 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22695eac-5965-412d-be2a-405d498cfd24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:45.690074 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22695eac-5965-412d-be2a-405d498cfd24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:45.831214 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22695eac-5965-412d-be2a-405d498cfd24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:45.839334 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22695eac-5965-412d-be2a-405d498cfd24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1375 microversion: 2.1 time: 0.164861 Aug 27 06:09:45.839923 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4024/8001] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:45 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:46.859280 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-be6c6f48-67e4-4e36-8c7c-30d63bece795 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:46.859916 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-be6c6f48-67e4-4e36-8c7c-30d63bece795 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:46.866850 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be6c6f48-67e4-4e36-8c7c-30d63bece795 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:46.867334 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be6c6f48-67e4-4e36-8c7c-30d63bece795 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:46.868034 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be6c6f48-67e4-4e36-8c7c-30d63bece795 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:46.868458 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be6c6f48-67e4-4e36-8c7c-30d63bece795 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:46.868943 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be6c6f48-67e4-4e36-8c7c-30d63bece795 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:46.869367 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-be6c6f48-67e4-4e36-8c7c-30d63bece795 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:47.000809 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-be6c6f48-67e4-4e36-8c7c-30d63bece795 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:47.009148 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-be6c6f48-67e4-4e36-8c7c-30d63bece795 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1559 microversion: 2.1 time: 0.153771 Aug 27 06:09:47.009723 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3978/8002] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:46 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:47.028876 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9cbc91f8-2ed3-4a3b-95c2-e5d5a631ea24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:09:47.029498 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9cbc91f8-2ed3-4a3b-95c2-e5d5a631ea24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:09:47.036369 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cbc91f8-2ed3-4a3b-95c2-e5d5a631ea24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:47.036905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cbc91f8-2ed3-4a3b-95c2-e5d5a631ea24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:47.037357 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cbc91f8-2ed3-4a3b-95c2-e5d5a631ea24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:47.038059 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cbc91f8-2ed3-4a3b-95c2-e5d5a631ea24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:47.038525 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cbc91f8-2ed3-4a3b-95c2-e5d5a631ea24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:47.038963 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cbc91f8-2ed3-4a3b-95c2-e5d5a631ea24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:47.170744 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9cbc91f8-2ed3-4a3b-95c2-e5d5a631ea24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:09:47.178303 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9cbc91f8-2ed3-4a3b-95c2-e5d5a631ea24 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1559 microversion: 2.1 time: 0.153342 Aug 27 06:09:47.178883 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4025/8003] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:09:47 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:09:48.771875 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-cda0a820-7636-4e61-aea9-5bbe2471ec08 req-ac6f2e55-eb3a-42bb-90da-e8078fd7741f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc17209-3c70-4215-a301-7607f753a778", "tag": "af6a1525-4e9d-46c2-9715-29f5bbc60ee1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:09:48.783276 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cda0a820-7636-4e61-aea9-5bbe2471ec08 req-ac6f2e55-eb3a-42bb-90da-e8078fd7741f service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:09:48.783846 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cda0a820-7636-4e61-aea9-5bbe2471ec08 req-ac6f2e55-eb3a-42bb-90da-e8078fd7741f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:09:48.784364 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-cda0a820-7636-4e61-aea9-5bbe2471ec08 req-ac6f2e55-eb3a-42bb-90da-e8078fd7741f service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:09:48.797205 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-cda0a820-7636-4e61-aea9-5bbe2471ec08 req-ac6f2e55-eb3a-42bb-90da-e8078fd7741f service nova] Creating event network-changed:af6a1525-4e9d-46c2-9715-29f5bbc60ee1 for instance ddc17209-3c70-4215-a301-7607f753a778 on n-h1-854823-1 Aug 27 06:09:48.803298 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-cda0a820-7636-4e61-aea9-5bbe2471ec08 req-ac6f2e55-eb3a-42bb-90da-e8078fd7741f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035153 Aug 27 06:09:48.804267 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3979/8004] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:12:00.086645 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:00.087417 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=64 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:00.088342 n-d-854823-1 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:12:00.088490 n-d-854823-1 devstack@n-api.service[128869]: Sat Aug 27 06:12:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778/action (ip 10.222.0.79) !!! Aug 27 06:12:00.142195 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d43f741-bb3b-474d-9e15-5c2da9545f06 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-157391749"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:12:00.145130 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1d43f741-bb3b-474d-9e15-5c2da9545f06 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:00.151134 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d43f741-bb3b-474d-9e15-5c2da9545f06 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:00.151628 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d43f741-bb3b-474d-9e15-5c2da9545f06 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:00.152081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d43f741-bb3b-474d-9e15-5c2da9545f06 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:00.152962 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d43f741-bb3b-474d-9e15-5c2da9545f06 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:00.153433 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d43f741-bb3b-474d-9e15-5c2da9545f06 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:00.153871 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d43f741-bb3b-474d-9e15-5c2da9545f06 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:00.349149 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d43f741-bb3b-474d-9e15-5c2da9545f06 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778/action" status: 202 len: 0 microversion: 2.1 time: 0.264368 Aug 27 06:12:00.349740 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4026/8005] 10.222.0.79 () {60 vars in 1278 bytes} [Sat Aug 27 06:12:00 2022] POST /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 06:12:07.123907 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30b4270-6763-4864-8153-10d27fd192b5] AMQP server on 10.222.0.79:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 27 06:12:07.125245 n-d-854823-1 devstack@n-api.service[128870]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2badfd4b-a808-402a-925c-31461d1cb878] AMQP server on 10.222.0.79:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 27 06:12:07.125994 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=5 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:07.126971 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=60 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:07.127773 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:12:07.128039 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 06:12:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.79) !!! Aug 27 06:12:07.129915 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 06:12:07.130053 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 06:12:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.79) !!! Aug 27 06:12:07.131755 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 06:12:07.131889 n-d-854823-1 devstack@n-api.service[128870]: Sat Aug 27 06:12:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.79) !!! Aug 27 06:12:07.146863 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-d42c4318-64ae-45f7-861f-3bbe6265bc8c req-d7bc4be5-29ed-4dab-8463-21686c9044fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc17209-3c70-4215-a301-7607f753a778", "name": "network-vif-plugged", "status": "completed", "tag": "af6a1525-4e9d-46c2-9715-29f5bbc60ee1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:12:07.163148 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d42c4318-64ae-45f7-861f-3bbe6265bc8c req-d7bc4be5-29ed-4dab-8463-21686c9044fc service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:07.163607 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d42c4318-64ae-45f7-861f-3bbe6265bc8c req-d7bc4be5-29ed-4dab-8463-21686c9044fc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:07.164036 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-d42c4318-64ae-45f7-861f-3bbe6265bc8c req-d7bc4be5-29ed-4dab-8463-21686c9044fc service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:07.175819 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-d42c4318-64ae-45f7-861f-3bbe6265bc8c req-d7bc4be5-29ed-4dab-8463-21686c9044fc service nova] Creating event network-vif-plugged:af6a1525-4e9d-46c2-9715-29f5bbc60ee1 for instance ddc17209-3c70-4215-a301-7607f753a778 on n-h1-854823-1 Aug 27 06:12:07.181906 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-d42c4318-64ae-45f7-861f-3bbe6265bc8c req-d7bc4be5-29ed-4dab-8463-21686c9044fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061194 Aug 27 06:12:07.182785 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3980/8006] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:12:19.139705 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-578db9c7-9a0b-4283-a64e-cc465f1214ce tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:19.140552 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-578db9c7-9a0b-4283-a64e-cc465f1214ce tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:19.141238 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_api:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:19.142061 n-d-854823-1 devstack@n-api.service[128870]: DEBUG dbcounter [-] [128870] Writing DB stats nova_cell1:SELECT=2 {{(pid=128870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:19.151057 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:19.152693 n-d-854823-1 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 06:12:19.159118 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-578db9c7-9a0b-4283-a64e-cc465f1214ce tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:19.159631 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-578db9c7-9a0b-4283-a64e-cc465f1214ce tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:19.160081 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-578db9c7-9a0b-4283-a64e-cc465f1214ce tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:19.160837 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-578db9c7-9a0b-4283-a64e-cc465f1214ce tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:19.161305 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-578db9c7-9a0b-4283-a64e-cc465f1214ce tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:19.161736 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-578db9c7-9a0b-4283-a64e-cc465f1214ce tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:19.168801 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30b4270-6763-4864-8153-10d27fd192b5] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 47090. Aug 27 06:12:19.175354 n-d-854823-1 devstack@n-api.service[128870]: INFO oslo.messaging._drivers.impl_rabbit [-] [2badfd4b-a808-402a-925c-31461d1cb878] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 47092. Aug 27 06:12:19.192578 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-578db9c7-9a0b-4283-a64e-cc465f1214ce tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:12:19.234376 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-28568365-adcd-41fe-bfcc-61da0d2ce0a0 req-e26a87a6-6108-4fd5-87fe-dd26b2d2d336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc17209-3c70-4215-a301-7607f753a778", "tag": "af6a1525-4e9d-46c2-9715-29f5bbc60ee1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:12:19.248102 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-28568365-adcd-41fe-bfcc-61da0d2ce0a0 req-e26a87a6-6108-4fd5-87fe-dd26b2d2d336 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:19.248501 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-28568365-adcd-41fe-bfcc-61da0d2ce0a0 req-e26a87a6-6108-4fd5-87fe-dd26b2d2d336 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:19.249154 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-28568365-adcd-41fe-bfcc-61da0d2ce0a0 req-e26a87a6-6108-4fd5-87fe-dd26b2d2d336 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:19.263710 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-28568365-adcd-41fe-bfcc-61da0d2ce0a0 req-e26a87a6-6108-4fd5-87fe-dd26b2d2d336 service nova] Creating event network-changed:af6a1525-4e9d-46c2-9715-29f5bbc60ee1 for instance ddc17209-3c70-4215-a301-7607f753a778 on n-h1-854823-1 Aug 27 06:12:19.285666 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-578db9c7-9a0b-4283-a64e-cc465f1214ce tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 204 len: 0 microversion: 2.1 time: 0.149959 Aug 27 06:12:19.289727 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4027/8007] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 06:12:19 2022] DELETE /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 06:12:19.290051 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-28568365-adcd-41fe-bfcc-61da0d2ce0a0 req-e26a87a6-6108-4fd5-87fe-dd26b2d2d336 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145659 Aug 27 06:12:19.291315 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3981/8008] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:12:19.296880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-371955e9-8f6a-4e13-88d8-d488a0a64917 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:19.297896 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-371955e9-8f6a-4e13-88d8-d488a0a64917 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:19.305364 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-371955e9-8f6a-4e13-88d8-d488a0a64917 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:19.305975 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-371955e9-8f6a-4e13-88d8-d488a0a64917 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:19.306435 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-371955e9-8f6a-4e13-88d8-d488a0a64917 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:19.307169 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-371955e9-8f6a-4e13-88d8-d488a0a64917 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:19.307905 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-371955e9-8f6a-4e13-88d8-d488a0a64917 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:19.308360 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-371955e9-8f6a-4e13-88d8-d488a0a64917 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:19.456399 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-371955e9-8f6a-4e13-88d8-d488a0a64917 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:19.464310 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-371955e9-8f6a-4e13-88d8-d488a0a64917 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1683 microversion: 2.1 time: 0.172542 Aug 27 06:12:19.464935 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4028/8009] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:19 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:20.488295 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-f718a6f0-bbac-47ee-adb1-2cc1d72e9de8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:20.488984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-f718a6f0-bbac-47ee-adb1-2cc1d72e9de8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:20.495418 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f718a6f0-bbac-47ee-adb1-2cc1d72e9de8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:20.495912 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f718a6f0-bbac-47ee-adb1-2cc1d72e9de8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:20.496357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f718a6f0-bbac-47ee-adb1-2cc1d72e9de8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:20.497090 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f718a6f0-bbac-47ee-adb1-2cc1d72e9de8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:20.497556 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f718a6f0-bbac-47ee-adb1-2cc1d72e9de8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:20.497984 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-f718a6f0-bbac-47ee-adb1-2cc1d72e9de8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:20.725233 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-f718a6f0-bbac-47ee-adb1-2cc1d72e9de8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:20.733078 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-f718a6f0-bbac-47ee-adb1-2cc1d72e9de8 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1683 microversion: 2.1 time: 0.250415 Aug 27 06:12:20.733654 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3982/8010] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:20 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1683 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 06:12:21.160086 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d0ec6a26-db0c-4ade-9faa-225033961ece req-ca4eaf47-a8c3-41bc-8de7-bbdd6d4099a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc17209-3c70-4215-a301-7607f753a778", "name": "network-vif-unplugged", "status": "completed", "tag": "af6a1525-4e9d-46c2-9715-29f5bbc60ee1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:12:21.175297 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d0ec6a26-db0c-4ade-9faa-225033961ece req-ca4eaf47-a8c3-41bc-8de7-bbdd6d4099a9 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:21.176560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d0ec6a26-db0c-4ade-9faa-225033961ece req-ca4eaf47-a8c3-41bc-8de7-bbdd6d4099a9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:21.176560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d0ec6a26-db0c-4ade-9faa-225033961ece req-ca4eaf47-a8c3-41bc-8de7-bbdd6d4099a9 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:21.189412 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d0ec6a26-db0c-4ade-9faa-225033961ece req-ca4eaf47-a8c3-41bc-8de7-bbdd6d4099a9 service nova] Creating event network-vif-unplugged:af6a1525-4e9d-46c2-9715-29f5bbc60ee1 for instance ddc17209-3c70-4215-a301-7607f753a778 on n-h1-854823-1 Aug 27 06:12:21.195482 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d0ec6a26-db0c-4ade-9faa-225033961ece req-ca4eaf47-a8c3-41bc-8de7-bbdd6d4099a9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042426 Aug 27 06:12:21.196383 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4029/8011] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:12:21.590338 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-93914fef-d14f-4b4b-855f-a84bea59836b req-a0b7d27f-5553-4a68-8681-58cfd4691766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc17209-3c70-4215-a301-7607f753a778", "name": "network-vif-deleted", "tag": "af6a1525-4e9d-46c2-9715-29f5bbc60ee1"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:12:21.601632 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-93914fef-d14f-4b4b-855f-a84bea59836b req-a0b7d27f-5553-4a68-8681-58cfd4691766 service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:21.602115 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-93914fef-d14f-4b4b-855f-a84bea59836b req-a0b7d27f-5553-4a68-8681-58cfd4691766 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:21.602551 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-93914fef-d14f-4b4b-855f-a84bea59836b req-a0b7d27f-5553-4a68-8681-58cfd4691766 service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:21.616469 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-93914fef-d14f-4b4b-855f-a84bea59836b req-a0b7d27f-5553-4a68-8681-58cfd4691766 service nova] Creating event network-vif-deleted:af6a1525-4e9d-46c2-9715-29f5bbc60ee1 for instance ddc17209-3c70-4215-a301-7607f753a778 on n-h1-854823-1 Aug 27 06:12:21.621631 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-93914fef-d14f-4b4b-855f-a84bea59836b req-a0b7d27f-5553-4a68-8681-58cfd4691766 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034943 Aug 27 06:12:21.622236 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3983/8012] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:12:21.754565 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-caa79797-126d-4e43-8c35-98b86e718fac tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:21.755279 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-caa79797-126d-4e43-8c35-98b86e718fac tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:21.761560 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa79797-126d-4e43-8c35-98b86e718fac tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:21.762054 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa79797-126d-4e43-8c35-98b86e718fac tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:21.762504 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa79797-126d-4e43-8c35-98b86e718fac tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:21.763203 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa79797-126d-4e43-8c35-98b86e718fac tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:21.763689 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa79797-126d-4e43-8c35-98b86e718fac tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:21.764125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa79797-126d-4e43-8c35-98b86e718fac tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:21.798593 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa79797-126d-4e43-8c35-98b86e718fac tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:21.799125 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa79797-126d-4e43-8c35-98b86e718fac tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:21.799585 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa79797-126d-4e43-8c35-98b86e718fac tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:21.800045 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-caa79797-126d-4e43-8c35-98b86e718fac tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lazy-loading 'fault' on Instance uuid ddc17209-3c70-4215-a301-7607f753a778 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 06:12:21.843508 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-caa79797-126d-4e43-8c35-98b86e718fac tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:21.851987 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-caa79797-126d-4e43-8c35-98b86e718fac tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 200 len: 1339 microversion: 2.1 time: 0.101799 Aug 27 06:12:21.852981 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4030/8013] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:21 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:22.878844 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c93876cf-cf7f-4eee-8f8e-85874efafe95 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:22.879475 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-c93876cf-cf7f-4eee-8f8e-85874efafe95 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: ddc17209-3c70-4215-a301-7607f753a778] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:22.886695 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c93876cf-cf7f-4eee-8f8e-85874efafe95 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:22.887190 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c93876cf-cf7f-4eee-8f8e-85874efafe95 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:22.887638 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c93876cf-cf7f-4eee-8f8e-85874efafe95 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:22.888357 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c93876cf-cf7f-4eee-8f8e-85874efafe95 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:22.888833 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c93876cf-cf7f-4eee-8f8e-85874efafe95 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:22.889268 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-c93876cf-cf7f-4eee-8f8e-85874efafe95 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:22.903668 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.wsgi [None req-c93876cf-cf7f-4eee-8f8e-85874efafe95 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] HTTP exception thrown: Instance ddc17209-3c70-4215-a301-7607f753a778 could not be found. Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c93876cf-cf7f-4eee-8f8e-85874efafe95 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Request method failure captured: Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: request: GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 HTTP/1.1 Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: Accept: application/json Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: Accept-Encoding: identity Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: Connection: close Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: Content-Length: 0 Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: Content-Type: application/json Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: Host: 10.222.0.79 Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: Openstack-System-Scope: None Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: User-Agent: python-urllib3/1.26.11 Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Auth-Token: gAAAAABjCbR1Ob2gTURlbaGz1R9yarBbjKoCIG4x2AfyhTSFGWOF-_I3LuyS3IIgcedYTwoO9wDCH6inzAbC79areZe2U-cXjzNzAThz-nImAgt9_UD9gg6uABBZXqYpOUTKuPWsdZJCNippMUjJs0P7kdk2FIEnTKOI2LxDpczBI0SO5qp1oiI Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Id: None Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Domain-Name: None Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Identity-Status: Confirmed Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Is-Admin-Project: True Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Id: default Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Domain-Name: Default Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Id: 1c30ca3bd3a14d12b0dacb222fdbd278 Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Project-Name: tempest-TestSnapshotPattern-1602462160 Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Role: reader,member Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Roles: reader,member Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1c30ca3bd3a14d12b0dacb222fdbd278"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1c30ca3bd3a14d12b0dacb222fdbd278"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1c30ca3bd3a14d12b0dacb222fdbd278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1c30ca3bd3a14d12b0dacb222fdbd278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant: tempest-TestSnapshotPattern-1602462160 Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Id: 1c30ca3bd3a14d12b0dacb222fdbd278 Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-Tenant-Name: tempest-TestSnapshotPattern-1602462160 Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-User: tempest-TestSnapshotPattern-1602462160-project Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Id: default Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-User-Domain-Name: Default Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-User-Id: 0c71dc794b4f409dafb7d22cbd2d396b Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: X-User-Name: tempest-TestSnapshotPattern-1602462160-project Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: method: > Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: exception: Instance ddc17209-3c70-4215-a301-7607f753a778 could not be found. Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: action_args: {'id': 'ddc17209-3c70-4215-a301-7607f753a778'} Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc17209-3c70-4215-a301-7607f753a778 could not be found. Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc17209-3c70-4215-a301-7607f753a778 could not be found. Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:12:22.905321 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 06:12:22.910699 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:12:22.910699 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:12:22.910699 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:12:22.910699 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:12:22.910699 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:12:22.910699 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc17209-3c70-4215-a301-7607f753a778 could not be found. Aug 27 06:12:22.910699 n-d-854823-1 devstack@n-api.service[128870]: ERROR nova.api.openstack.wsgi Aug 27 06:12:22.910699 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-c93876cf-cf7f-4eee-8f8e-85874efafe95 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Returning 404 to user: Instance ddc17209-3c70-4215-a301-7607f753a778 could not be found. {{(pid=128870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:12:22.910699 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-c93876cf-cf7f-4eee-8f8e-85874efafe95 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778" status: 404 len: 111 microversion: 2.1 time: 0.032902 Aug 27 06:12:22.910699 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3984/8014] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:22 2022] GET /compute/v2.1/servers/ddc17209-3c70-4215-a301-7607f753a778 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:12:24.251292 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-afdc9d8c-ec3d-40a5-ba7c-181aa63af3bf tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:24.251880 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-afdc9d8c-ec3d-40a5-ba7c-181aa63af3bf tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:24.253967 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-7a744720-a6ce-433e-a7eb-76499d3fcabb req-bbaddf22-a098-4f54-b3cc-dd24c46a6c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7797859d-1d63-4e14-9545-7d6c4262731e", "tag": "e7034dd0-2eb2-4183-814c-d3e865418f41"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:12:24.259202 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afdc9d8c-ec3d-40a5-ba7c-181aa63af3bf tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:24.259702 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afdc9d8c-ec3d-40a5-ba7c-181aa63af3bf tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:24.260146 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afdc9d8c-ec3d-40a5-ba7c-181aa63af3bf tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:24.260887 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afdc9d8c-ec3d-40a5-ba7c-181aa63af3bf tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:24.261543 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afdc9d8c-ec3d-40a5-ba7c-181aa63af3bf tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:24.261982 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afdc9d8c-ec3d-40a5-ba7c-181aa63af3bf tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:24.265604 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7a744720-a6ce-433e-a7eb-76499d3fcabb req-bbaddf22-a098-4f54-b3cc-dd24c46a6c9d service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:24.266157 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7a744720-a6ce-433e-a7eb-76499d3fcabb req-bbaddf22-a098-4f54-b3cc-dd24c46a6c9d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:24.266905 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-7a744720-a6ce-433e-a7eb-76499d3fcabb req-bbaddf22-a098-4f54-b3cc-dd24c46a6c9d service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:24.278898 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-7a744720-a6ce-433e-a7eb-76499d3fcabb req-bbaddf22-a098-4f54-b3cc-dd24c46a6c9d service nova] Creating event network-changed:e7034dd0-2eb2-4183-814c-d3e865418f41 for instance 7797859d-1d63-4e14-9545-7d6c4262731e on n-h2-854823-1 Aug 27 06:12:24.284722 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-7a744720-a6ce-433e-a7eb-76499d3fcabb req-bbaddf22-a098-4f54-b3cc-dd24c46a6c9d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034518 Aug 27 06:12:24.285825 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3985/8015] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 06:12:24.291233 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-afdc9d8c-ec3d-40a5-ba7c-181aa63af3bf tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 06:12:24.374920 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-afdc9d8c-ec3d-40a5-ba7c-181aa63af3bf tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e" status: 204 len: 0 microversion: 2.1 time: 0.127467 Aug 27 06:12:24.375891 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4031/8016] 10.222.0.79 () {58 vars in 1239 bytes} [Sat Aug 27 06:12:24 2022] DELETE /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 06:12:24.386679 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-cb513578-ffed-4c15-8835-7a027113b286 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:24.387396 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.compute.api [None req-cb513578-ffed-4c15-8835-7a027113b286 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Fetching instance by UUID {{(pid=128870) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:24.394247 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb513578-ffed-4c15-8835-7a027113b286 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:24.394741 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb513578-ffed-4c15-8835-7a027113b286 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:24.395184 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb513578-ffed-4c15-8835-7a027113b286 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:24.395889 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb513578-ffed-4c15-8835-7a027113b286 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:24.396354 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb513578-ffed-4c15-8835-7a027113b286 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:24.396814 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [None req-cb513578-ffed-4c15-8835-7a027113b286 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:24.549649 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.policy [None req-cb513578-ffed-4c15-8835-7a027113b286 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128870) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:24.558174 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-cb513578-ffed-4c15-8835-7a027113b286 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e" status: 200 len: 1682 microversion: 2.1 time: 0.176939 Aug 27 06:12:24.558955 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3986/8017] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:24 2022] GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:25.583798 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-544fa588-ca93-48b9-8316-db3503515c18 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:25.585427 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-544fa588-ca93-48b9-8316-db3503515c18 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:25.595021 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-544fa588-ca93-48b9-8316-db3503515c18 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:25.595513 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-544fa588-ca93-48b9-8316-db3503515c18 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:25.595971 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-544fa588-ca93-48b9-8316-db3503515c18 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:25.596740 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-544fa588-ca93-48b9-8316-db3503515c18 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:25.597566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-544fa588-ca93-48b9-8316-db3503515c18 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:25.598013 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-544fa588-ca93-48b9-8316-db3503515c18 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:25.671696 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.policy [None req-544fa588-ca93-48b9-8316-db3503515c18 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c71dc794b4f409dafb7d22cbd2d396b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c30ca3bd3a14d12b0dacb222fdbd278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 06:12:25.680785 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-544fa588-ca93-48b9-8316-db3503515c18 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e" status: 200 len: 1496 microversion: 2.1 time: 0.102121 Aug 27 06:12:25.681517 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4032/8018] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:25 2022] GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e => generated 1496 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 06:12:26.299707 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [req-61ad4347-e749-4214-acfd-d4ff44974959 req-c56d476d-ec4d-43f6-b04c-34599a645c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7797859d-1d63-4e14-9545-7d6c4262731e", "name": "network-vif-deleted", "tag": "e7034dd0-2eb2-4183-814c-d3e865418f41"}]} {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 06:12:26.310011 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-61ad4347-e749-4214-acfd-d4ff44974959 req-c56d476d-ec4d-43f6-b04c-34599a645c3b service nova] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:26.310486 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-61ad4347-e749-4214-acfd-d4ff44974959 req-c56d476d-ec4d-43f6-b04c-34599a645c3b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:26.310914 n-d-854823-1 devstack@n-api.service[128870]: DEBUG oslo_concurrency.lockutils [req-61ad4347-e749-4214-acfd-d4ff44974959 req-c56d476d-ec4d-43f6-b04c-34599a645c3b service nova] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:26.321645 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.compute.server_external_events [req-61ad4347-e749-4214-acfd-d4ff44974959 req-c56d476d-ec4d-43f6-b04c-34599a645c3b service nova] Creating event network-vif-deleted:e7034dd0-2eb2-4183-814c-d3e865418f41 for instance 7797859d-1d63-4e14-9545-7d6c4262731e on n-h2-854823-1 Aug 27 06:12:26.326392 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [req-61ad4347-e749-4214-acfd-d4ff44974959 req-c56d476d-ec4d-43f6-b04c-34599a645c3b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030431 Aug 27 06:12:26.327060 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3987/8019] 10.222.0.79 () {64 vars in 1317 bytes} [Sat Aug 27 06:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 06:12:26.702703 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73bff0a5-bce4-43bd-8327-4220f7aacbd4 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:26.703323 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73bff0a5-bce4-43bd-8327-4220f7aacbd4 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] [instance: 7797859d-1d63-4e14-9545-7d6c4262731e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 06:12:26.710901 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73bff0a5-bce4-43bd-8327-4220f7aacbd4 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:26.711385 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73bff0a5-bce4-43bd-8327-4220f7aacbd4 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:26.711838 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73bff0a5-bce4-43bd-8327-4220f7aacbd4 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:26.712566 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73bff0a5-bce4-43bd-8327-4220f7aacbd4 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Acquiring lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 06:12:26.713042 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73bff0a5-bce4-43bd-8327-4220f7aacbd4 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 06:12:26.713485 n-d-854823-1 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73bff0a5-bce4-43bd-8327-4220f7aacbd4 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Lock "e7bc291f-2aa3-4d66-a942-e096e031ad4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 06:12:26.726959 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-73bff0a5-bce4-43bd-8327-4220f7aacbd4 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] HTTP exception thrown: Instance 7797859d-1d63-4e14-9545-7d6c4262731e could not be found. Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73bff0a5-bce4-43bd-8327-4220f7aacbd4 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Request method failure captured: Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e HTTP/1.1 Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: Accept: application/json Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: Accept-Encoding: identity Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: Connection: close Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: Content-Length: 0 Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: Content-Type: application/json Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: Host: 10.222.0.79 Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: Openstack-System-Scope: None Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.11 Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjCbR1Ob2gTURlbaGz1R9yarBbjKoCIG4x2AfyhTSFGWOF-_I3LuyS3IIgcedYTwoO9wDCH6inzAbC79areZe2U-cXjzNzAThz-nImAgt9_UD9gg6uABBZXqYpOUTKuPWsdZJCNippMUjJs0P7kdk2FIEnTKOI2LxDpczBI0SO5qp1oiI Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Id: None Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Domain-Name: None Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Is-Admin-Project: True Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Id: default Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Id: 1c30ca3bd3a14d12b0dacb222fdbd278 Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Project-Name: tempest-TestSnapshotPattern-1602462160 Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Role: reader,member Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Roles: reader,member Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1c30ca3bd3a14d12b0dacb222fdbd278"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1c30ca3bd3a14d12b0dacb222fdbd278"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1c30ca3bd3a14d12b0dacb222fdbd278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1c30ca3bd3a14d12b0dacb222fdbd278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant: tempest-TestSnapshotPattern-1602462160 Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Id: 1c30ca3bd3a14d12b0dacb222fdbd278 Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestSnapshotPattern-1602462160 Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-User: tempest-TestSnapshotPattern-1602462160-project Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Id: default Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-User-Domain-Name: Default Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-User-Id: 0c71dc794b4f409dafb7d22cbd2d396b Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: X-User-Name: tempest-TestSnapshotPattern-1602462160-project Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: method: > Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: exception: Instance 7797859d-1d63-4e14-9545-7d6c4262731e could not be found. Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: action_args: {'id': '7797859d-1d63-4e14-9545-7d6c4262731e'} Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7797859d-1d63-4e14-9545-7d6c4262731e could not be found. Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7797859d-1d63-4e14-9545-7d6c4262731e could not be found. Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 06:12:26.728664 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 06:12:26.733637 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 06:12:26.733637 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 06:12:26.733637 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 06:12:26.733637 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 06:12:26.733637 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 06:12:26.733637 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7797859d-1d63-4e14-9545-7d6c4262731e could not be found. Aug 27 06:12:26.733637 n-d-854823-1 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Aug 27 06:12:26.733637 n-d-854823-1 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73bff0a5-bce4-43bd-8327-4220f7aacbd4 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Returning 404 to user: Instance 7797859d-1d63-4e14-9545-7d6c4262731e could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 06:12:26.733637 n-d-854823-1 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-73bff0a5-bce4-43bd-8327-4220f7aacbd4 tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e" status: 404 len: 111 microversion: 2.1 time: 0.031544 Aug 27 06:12:26.733637 n-d-854823-1 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4033/8020] 10.222.0.79 () {58 vars in 1236 bytes} [Sat Aug 27 06:12:26 2022] GET /compute/v2.1/servers/7797859d-1d63-4e14-9545-7d6c4262731e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 06:12:26.896548 n-d-854823-1 devstack@n-api.service[128870]: DEBUG nova.api.openstack.wsgi [None req-db301c04-7b0d-4b28-b65d-ecd4863a971d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] Calling method '.version_select at 0x7f1f211bbc10>' {{(pid=128870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 06:12:26.920939 n-d-854823-1 devstack@n-api.service[128870]: INFO nova.api.openstack.requestlog [None req-db301c04-7b0d-4b28-b65d-ecd4863a971d tempest-TestSnapshotPattern-1602462160 tempest-TestSnapshotPattern-1602462160-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1057055597" status: 202 len: 0 microversion: 2.1 time: 0.029356 Aug 27 06:12:26.921451 n-d-854823-1 devstack@n-api.service[128870]: [pid: 128870|app: 0|req: 3988/8021] 10.222.0.79 () {58 vars in 1257 bytes} [Sat Aug 27 06:12:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1057055597 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)